Nov 29 17:47:09 user nova-compute[74613]: DEBUG os_vif [-] Loaded VIF plugin class '<class 'vif_plug_linux_bridge.linux_bridge.LinuxBridgePlugin'>' with name 'linux_bridge' {{(pid=74613) initialize /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:44}}
Nov 29 17:47:09 user nova-compute[74613]: DEBUG os_vif [-] Loaded VIF plugin class '<class 'vif_plug_noop.noop.NoOpPlugin'>' with name 'noop' {{(pid=74613) initialize /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:44}}
Nov 29 17:47:09 user nova-compute[74613]: DEBUG os_vif [-] Loaded VIF plugin class '<class 'vif_plug_ovs.ovs.OvsPlugin'>' with name 'ovs' {{(pid=74613) initialize /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:44}}
Nov 29 17:47:09 user nova-compute[74613]: INFO os_vif [-] Loaded VIF plugins: linux_bridge, noop, ovs
Nov 29 17:47:09 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): grep -F node.session.scan /sbin/iscsiadm {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 17:47:09 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "grep -F node.session.scan /sbin/iscsiadm" returned: 0 in 0.018s {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 17:47:09 user nova-compute[74613]: INFO nova.virt.driver [None req-4cf3280a-2aa3-4358-aecf-4946b5adf474 None None] Loading compute driver 'libvirt.LibvirtDriver'
Nov 29 17:47:09 user nova-compute[74613]: INFO nova.compute.provider_config [None req-4cf3280a-2aa3-4358-aecf-4946b5adf474 None None] No provider configs found in /etc/nova/provider_config/. If files are present, ensure the Nova process has access.
Nov 29 17:47:09 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-4cf3280a-2aa3-4358-aecf-4946b5adf474 None None] Acquiring lock "singleton_lock" {{(pid=74613) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 17:47:09 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-4cf3280a-2aa3-4358-aecf-4946b5adf474 None None] Acquired lock "singleton_lock" {{(pid=74613) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 17:47:09 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-4cf3280a-2aa3-4358-aecf-4946b5adf474 None None] Releasing lock "singleton_lock" {{(pid=74613) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 17:47:09 user nova-compute[74613]: DEBUG oslo_service.service [None req-4cf3280a-2aa3-4358-aecf-4946b5adf474 None None] Full set of CONF: {{(pid=74613) _wait_for_exit_or_signal /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/service.py:362}}
Nov 29 17:47:09 user nova-compute[74613]: DEBUG oslo_service.service [None req-4cf3280a-2aa3-4358-aecf-4946b5adf474 None None] ******************************************************************************** {{(pid=74613) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2589}}
Nov 29 17:47:09 user nova-compute[74613]: DEBUG oslo_service.service [None req-4cf3280a-2aa3-4358-aecf-4946b5adf474 None None] Configuration options gathered from: {{(pid=74613) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2590}}
Nov 29 17:47:09 user nova-compute[74613]: DEBUG oslo_service.service [None req-4cf3280a-2aa3-4358-aecf-4946b5adf474 None None] command line args: ['--config-file', '/etc/nova/nova-cpu.conf'] {{(pid=74613) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2591}}
Nov 29 17:47:09 user nova-compute[74613]: DEBUG oslo_service.service [None req-4cf3280a-2aa3-4358-aecf-4946b5adf474 None None] config files: ['/etc/nova/nova-cpu.conf'] {{(pid=74613) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2592}}
Nov 29 17:47:09 user nova-compute[74613]: DEBUG oslo_service.service [None req-4cf3280a-2aa3-4358-aecf-4946b5adf474 None None] ================================================================================ {{(pid=74613) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2594}}
Nov 29 17:47:09 user nova-compute[74613]: DEBUG oslo_service.service [None req-4cf3280a-2aa3-4358-aecf-4946b5adf474 None None] allow_resize_to_same_host      = True {{(pid=74613) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 17:47:09 user nova-compute[74613]: DEBUG oslo_service.service [None req-4cf3280a-2aa3-4358-aecf-4946b5adf474 None None] arq_binding_timeout            = 300 {{(pid=74613) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 17:47:09 user nova-compute[74613]: DEBUG oslo_service.service [None req-4cf3280a-2aa3-4358-aecf-4946b5adf474 None None] backdoor_port                  = None {{(pid=74613) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 17:47:09 user nova-compute[74613]: DEBUG oslo_service.service [None req-4cf3280a-2aa3-4358-aecf-4946b5adf474 None None] backdoor_socket                = None {{(pid=74613) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 17:47:09 user nova-compute[74613]: DEBUG oslo_service.service [None req-4cf3280a-2aa3-4358-aecf-4946b5adf474 None None] block_device_allocate_retries  = 300 {{(pid=74613) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 17:47:09 user nova-compute[74613]: DEBUG oslo_service.service [None req-4cf3280a-2aa3-4358-aecf-4946b5adf474 None None] block_device_allocate_retries_interval = 5 {{(pid=74613) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 17:47:09 user nova-compute[74613]: DEBUG oslo_service.service [None req-4cf3280a-2aa3-4358-aecf-4946b5adf474 None None] cert                           = self.pem {{(pid=74613) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 17:47:09 user nova-compute[74613]: DEBUG oslo_service.service [None req-4cf3280a-2aa3-4358-aecf-4946b5adf474 None None] compute_driver                 = libvirt.LibvirtDriver {{(pid=74613) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 17:47:09 user nova-compute[74613]: DEBUG oslo_service.service [None req-4cf3280a-2aa3-4358-aecf-4946b5adf474 None None] compute_monitors               = [] {{(pid=74613) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 17:47:09 user nova-compute[74613]: DEBUG oslo_service.service [None req-4cf3280a-2aa3-4358-aecf-4946b5adf474 None None] config_dir                     = [] {{(pid=74613) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 17:47:09 user nova-compute[74613]: DEBUG oslo_service.service [None req-4cf3280a-2aa3-4358-aecf-4946b5adf474 None None] config_drive_format            = iso9660 {{(pid=74613) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 17:47:09 user nova-compute[74613]: DEBUG oslo_service.service [None req-4cf3280a-2aa3-4358-aecf-4946b5adf474 None None] config_file                    = ['/etc/nova/nova-cpu.conf'] {{(pid=74613) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 17:47:09 user nova-compute[74613]: DEBUG oslo_service.service [None req-4cf3280a-2aa3-4358-aecf-4946b5adf474 None None] config_source                  = [] {{(pid=74613) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 17:47:09 user nova-compute[74613]: DEBUG oslo_service.service [None req-4cf3280a-2aa3-4358-aecf-4946b5adf474 None None] console_host                   = user {{(pid=74613) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 17:47:09 user nova-compute[74613]: DEBUG oslo_service.service [None req-4cf3280a-2aa3-4358-aecf-4946b5adf474 None None] control_exchange               = nova {{(pid=74613) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 17:47:09 user nova-compute[74613]: DEBUG oslo_service.service [None req-4cf3280a-2aa3-4358-aecf-4946b5adf474 None None] cpu_allocation_ratio           = None {{(pid=74613) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 17:47:09 user nova-compute[74613]: DEBUG oslo_service.service [None req-4cf3280a-2aa3-4358-aecf-4946b5adf474 None None] daemon                         = False {{(pid=74613) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 17:47:09 user nova-compute[74613]: DEBUG oslo_service.service [None req-4cf3280a-2aa3-4358-aecf-4946b5adf474 None None] debug                          = True {{(pid=74613) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 17:47:09 user nova-compute[74613]: DEBUG oslo_service.service [None req-4cf3280a-2aa3-4358-aecf-4946b5adf474 None None] default_access_ip_network_name = None {{(pid=74613) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 17:47:09 user nova-compute[74613]: DEBUG oslo_service.service [None req-4cf3280a-2aa3-4358-aecf-4946b5adf474 None None] default_availability_zone      = nova {{(pid=74613) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 17:47:09 user nova-compute[74613]: DEBUG oslo_service.service [None req-4cf3280a-2aa3-4358-aecf-4946b5adf474 None None] default_ephemeral_format       = ext4 {{(pid=74613) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 17:47:09 user nova-compute[74613]: DEBUG oslo_service.service [None req-4cf3280a-2aa3-4358-aecf-4946b5adf474 None None] default_green_pool_size        = 1000 {{(pid=74613) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 17:47:09 user nova-compute[74613]: DEBUG oslo_service.service [None req-4cf3280a-2aa3-4358-aecf-4946b5adf474 None None] default_log_levels             = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=74613) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 17:47:09 user nova-compute[74613]: DEBUG oslo_service.service [None req-4cf3280a-2aa3-4358-aecf-4946b5adf474 None None] default_schedule_zone          = None {{(pid=74613) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 17:47:09 user nova-compute[74613]: DEBUG oslo_service.service [None req-4cf3280a-2aa3-4358-aecf-4946b5adf474 None None] disk_allocation_ratio          = None {{(pid=74613) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 17:47:09 user nova-compute[74613]: DEBUG oslo_service.service [None req-4cf3280a-2aa3-4358-aecf-4946b5adf474 None None] enable_new_services            = True {{(pid=74613) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 17:47:09 user nova-compute[74613]: DEBUG oslo_service.service [None req-4cf3280a-2aa3-4358-aecf-4946b5adf474 None None] enabled_apis                   = ['osapi_compute'] {{(pid=74613) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 17:47:09 user nova-compute[74613]: DEBUG oslo_service.service [None req-4cf3280a-2aa3-4358-aecf-4946b5adf474 None None] enabled_ssl_apis               = [] {{(pid=74613) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 17:47:09 user nova-compute[74613]: DEBUG oslo_service.service [None req-4cf3280a-2aa3-4358-aecf-4946b5adf474 None None] flat_injected                  = False {{(pid=74613) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 17:47:09 user nova-compute[74613]: DEBUG oslo_service.service [None req-4cf3280a-2aa3-4358-aecf-4946b5adf474 None None] force_config_drive             = False {{(pid=74613) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 17:47:09 user nova-compute[74613]: DEBUG oslo_service.service [None req-4cf3280a-2aa3-4358-aecf-4946b5adf474 None None] force_raw_images               = True {{(pid=74613) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 17:47:09 user nova-compute[74613]: DEBUG oslo_service.service [None req-4cf3280a-2aa3-4358-aecf-4946b5adf474 None None] graceful_shutdown_timeout      = 5 {{(pid=74613) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 17:47:09 user nova-compute[74613]: DEBUG oslo_service.service [None req-4cf3280a-2aa3-4358-aecf-4946b5adf474 None None] heal_instance_info_cache_interval = 60 {{(pid=74613) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 17:47:09 user nova-compute[74613]: DEBUG oslo_service.service [None req-4cf3280a-2aa3-4358-aecf-4946b5adf474 None None] host                           = user {{(pid=74613) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 17:47:09 user nova-compute[74613]: DEBUG oslo_service.service [None req-4cf3280a-2aa3-4358-aecf-4946b5adf474 None None] initial_cpu_allocation_ratio   = 4.0 {{(pid=74613) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 17:47:09 user nova-compute[74613]: DEBUG oslo_service.service [None req-4cf3280a-2aa3-4358-aecf-4946b5adf474 None None] initial_disk_allocation_ratio  = 1.0 {{(pid=74613) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 17:47:09 user nova-compute[74613]: DEBUG oslo_service.service [None req-4cf3280a-2aa3-4358-aecf-4946b5adf474 None None] initial_ram_allocation_ratio   = 1.0 {{(pid=74613) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 17:47:09 user nova-compute[74613]: DEBUG oslo_service.service [None req-4cf3280a-2aa3-4358-aecf-4946b5adf474 None None] injected_network_template      = /opt/stack/nova/nova/virt/interfaces.template {{(pid=74613) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 17:47:09 user nova-compute[74613]: DEBUG oslo_service.service [None req-4cf3280a-2aa3-4358-aecf-4946b5adf474 None None] instance_build_timeout         = 0 {{(pid=74613) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 17:47:09 user nova-compute[74613]: DEBUG oslo_service.service [None req-4cf3280a-2aa3-4358-aecf-4946b5adf474 None None] instance_delete_interval       = 300 {{(pid=74613) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 17:47:09 user nova-compute[74613]: DEBUG oslo_service.service [None req-4cf3280a-2aa3-4358-aecf-4946b5adf474 None None] instance_format                = [instance: %(uuid)s]  {{(pid=74613) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 17:47:09 user nova-compute[74613]: DEBUG oslo_service.service [None req-4cf3280a-2aa3-4358-aecf-4946b5adf474 None None] instance_name_template         = instance-%08x {{(pid=74613) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 17:47:09 user nova-compute[74613]: DEBUG oslo_service.service [None req-4cf3280a-2aa3-4358-aecf-4946b5adf474 None None] instance_usage_audit           = False {{(pid=74613) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 17:47:09 user nova-compute[74613]: DEBUG oslo_service.service [None req-4cf3280a-2aa3-4358-aecf-4946b5adf474 None None] instance_usage_audit_period    = month {{(pid=74613) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 17:47:09 user nova-compute[74613]: DEBUG oslo_service.service [None req-4cf3280a-2aa3-4358-aecf-4946b5adf474 None None] instance_uuid_format           = [instance: %(uuid)s]  {{(pid=74613) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 17:47:09 user nova-compute[74613]: DEBUG oslo_service.service [None req-4cf3280a-2aa3-4358-aecf-4946b5adf474 None None] instances_path                 = /opt/stack/data/nova/instances {{(pid=74613) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 17:47:09 user nova-compute[74613]: DEBUG oslo_service.service [None req-4cf3280a-2aa3-4358-aecf-4946b5adf474 None None] internal_service_availability_zone = internal {{(pid=74613) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 17:47:09 user nova-compute[74613]: DEBUG oslo_service.service [None req-4cf3280a-2aa3-4358-aecf-4946b5adf474 None None] key                            = None {{(pid=74613) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 17:47:09 user nova-compute[74613]: DEBUG oslo_service.service [None req-4cf3280a-2aa3-4358-aecf-4946b5adf474 None None] live_migration_retry_count     = 30 {{(pid=74613) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 17:47:09 user nova-compute[74613]: DEBUG oslo_service.service [None req-4cf3280a-2aa3-4358-aecf-4946b5adf474 None None] log_config_append              = None {{(pid=74613) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 17:47:09 user nova-compute[74613]: DEBUG oslo_service.service [None req-4cf3280a-2aa3-4358-aecf-4946b5adf474 None None] log_date_format                = %Y-%m-%d %H:%M:%S {{(pid=74613) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 17:47:09 user nova-compute[74613]: DEBUG oslo_service.service [None req-4cf3280a-2aa3-4358-aecf-4946b5adf474 None None] log_dir                        = None {{(pid=74613) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 17:47:09 user nova-compute[74613]: DEBUG oslo_service.service [None req-4cf3280a-2aa3-4358-aecf-4946b5adf474 None None] log_file                       = None {{(pid=74613) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 17:47:09 user nova-compute[74613]: DEBUG oslo_service.service [None req-4cf3280a-2aa3-4358-aecf-4946b5adf474 None None] log_options                    = True {{(pid=74613) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 17:47:09 user nova-compute[74613]: DEBUG oslo_service.service [None req-4cf3280a-2aa3-4358-aecf-4946b5adf474 None None] log_rotate_interval            = 1 {{(pid=74613) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 17:47:09 user nova-compute[74613]: DEBUG oslo_service.service [None req-4cf3280a-2aa3-4358-aecf-4946b5adf474 None None] log_rotate_interval_type       = days {{(pid=74613) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 17:47:09 user nova-compute[74613]: DEBUG oslo_service.service [None req-4cf3280a-2aa3-4358-aecf-4946b5adf474 None None] log_rotation_type              = none {{(pid=74613) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 17:47:09 user nova-compute[74613]: DEBUG oslo_service.service [None req-4cf3280a-2aa3-4358-aecf-4946b5adf474 None None] logging_context_format_string  = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=74613) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 17:47:09 user nova-compute[74613]: DEBUG oslo_service.service [None req-4cf3280a-2aa3-4358-aecf-4946b5adf474 None None] logging_debug_format_suffix    = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=74613) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 17:47:09 user nova-compute[74613]: DEBUG oslo_service.service [None req-4cf3280a-2aa3-4358-aecf-4946b5adf474 None None] logging_default_format_string  = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=74613) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 17:47:09 user nova-compute[74613]: DEBUG oslo_service.service [None req-4cf3280a-2aa3-4358-aecf-4946b5adf474 None None] logging_exception_prefix       = ERROR %(name)s %(instance)s {{(pid=74613) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 17:47:09 user nova-compute[74613]: DEBUG oslo_service.service [None req-4cf3280a-2aa3-4358-aecf-4946b5adf474 None None] logging_user_identity_format   = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=74613) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 17:47:09 user nova-compute[74613]: DEBUG oslo_service.service [None req-4cf3280a-2aa3-4358-aecf-4946b5adf474 None None] long_rpc_timeout               = 1800 {{(pid=74613) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 17:47:09 user nova-compute[74613]: DEBUG oslo_service.service [None req-4cf3280a-2aa3-4358-aecf-4946b5adf474 None None] max_concurrent_builds          = 10 {{(pid=74613) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 17:47:09 user nova-compute[74613]: DEBUG oslo_service.service [None req-4cf3280a-2aa3-4358-aecf-4946b5adf474 None None] max_concurrent_live_migrations = 1 {{(pid=74613) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 17:47:09 user nova-compute[74613]: DEBUG oslo_service.service [None req-4cf3280a-2aa3-4358-aecf-4946b5adf474 None None] max_concurrent_snapshots       = 5 {{(pid=74613) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 17:47:09 user nova-compute[74613]: DEBUG oslo_service.service [None req-4cf3280a-2aa3-4358-aecf-4946b5adf474 None None] max_local_block_devices        = 3 {{(pid=74613) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 17:47:09 user nova-compute[74613]: DEBUG oslo_service.service [None req-4cf3280a-2aa3-4358-aecf-4946b5adf474 None None] max_logfile_count              = 30 {{(pid=74613) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 17:47:09 user nova-compute[74613]: DEBUG oslo_service.service [None req-4cf3280a-2aa3-4358-aecf-4946b5adf474 None None] max_logfile_size_mb            = 200 {{(pid=74613) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 17:47:09 user nova-compute[74613]: DEBUG oslo_service.service [None req-4cf3280a-2aa3-4358-aecf-4946b5adf474 None None] maximum_instance_delete_attempts = 5 {{(pid=74613) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 17:47:09 user nova-compute[74613]: DEBUG oslo_service.service [None req-4cf3280a-2aa3-4358-aecf-4946b5adf474 None None] metadata_listen                = 0.0.0.0 {{(pid=74613) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 17:47:09 user nova-compute[74613]: DEBUG oslo_service.service [None req-4cf3280a-2aa3-4358-aecf-4946b5adf474 None None] metadata_listen_port           = 8775 {{(pid=74613) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 17:47:09 user nova-compute[74613]: DEBUG oslo_service.service [None req-4cf3280a-2aa3-4358-aecf-4946b5adf474 None None] metadata_workers               = 3 {{(pid=74613) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 17:47:09 user nova-compute[74613]: DEBUG oslo_service.service [None req-4cf3280a-2aa3-4358-aecf-4946b5adf474 None None] migrate_max_retries            = -1 {{(pid=74613) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 17:47:09 user nova-compute[74613]: DEBUG oslo_service.service [None req-4cf3280a-2aa3-4358-aecf-4946b5adf474 None None] mkisofs_cmd                    = genisoimage {{(pid=74613) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 17:47:09 user nova-compute[74613]: DEBUG oslo_service.service [None req-4cf3280a-2aa3-4358-aecf-4946b5adf474 None None] my_block_storage_ip            = 10.0.0.210 {{(pid=74613) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 17:47:09 user nova-compute[74613]: DEBUG oslo_service.service [None req-4cf3280a-2aa3-4358-aecf-4946b5adf474 None None] my_ip                          = 10.0.0.210 {{(pid=74613) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 17:47:09 user nova-compute[74613]: DEBUG oslo_service.service [None req-4cf3280a-2aa3-4358-aecf-4946b5adf474 None None] network_allocate_retries       = 0 {{(pid=74613) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 17:47:09 user nova-compute[74613]: DEBUG oslo_service.service [None req-4cf3280a-2aa3-4358-aecf-4946b5adf474 None None] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=74613) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 17:47:09 user nova-compute[74613]: DEBUG oslo_service.service [None req-4cf3280a-2aa3-4358-aecf-4946b5adf474 None None] osapi_compute_listen           = 0.0.0.0 {{(pid=74613) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 17:47:09 user nova-compute[74613]: DEBUG oslo_service.service [None req-4cf3280a-2aa3-4358-aecf-4946b5adf474 None None] osapi_compute_listen_port      = 8774 {{(pid=74613) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 17:47:09 user nova-compute[74613]: DEBUG oslo_service.service [None req-4cf3280a-2aa3-4358-aecf-4946b5adf474 None None] osapi_compute_unique_server_name_scope =  {{(pid=74613) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 17:47:09 user nova-compute[74613]: DEBUG oslo_service.service [None req-4cf3280a-2aa3-4358-aecf-4946b5adf474 None None] osapi_compute_workers          = 3 {{(pid=74613) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 17:47:09 user nova-compute[74613]: DEBUG oslo_service.service [None req-4cf3280a-2aa3-4358-aecf-4946b5adf474 None None] password_length                = 12 {{(pid=74613) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 17:47:09 user nova-compute[74613]: DEBUG oslo_service.service [None req-4cf3280a-2aa3-4358-aecf-4946b5adf474 None None] periodic_enable                = True {{(pid=74613) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 17:47:09 user nova-compute[74613]: DEBUG oslo_service.service [None req-4cf3280a-2aa3-4358-aecf-4946b5adf474 None None] periodic_fuzzy_delay           = 60 {{(pid=74613) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 17:47:09 user nova-compute[74613]: DEBUG oslo_service.service [None req-4cf3280a-2aa3-4358-aecf-4946b5adf474 None None] pointer_model                  = ps2mouse {{(pid=74613) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 17:47:09 user nova-compute[74613]: DEBUG oslo_service.service [None req-4cf3280a-2aa3-4358-aecf-4946b5adf474 None None] preallocate_images             = none {{(pid=74613) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 17:47:09 user nova-compute[74613]: DEBUG oslo_service.service [None req-4cf3280a-2aa3-4358-aecf-4946b5adf474 None None] publish_errors                 = False {{(pid=74613) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 17:47:09 user nova-compute[74613]: DEBUG oslo_service.service [None req-4cf3280a-2aa3-4358-aecf-4946b5adf474 None None] pybasedir                      = /opt/stack/nova {{(pid=74613) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 17:47:09 user nova-compute[74613]: DEBUG oslo_service.service [None req-4cf3280a-2aa3-4358-aecf-4946b5adf474 None None] ram_allocation_ratio           = None {{(pid=74613) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 17:47:09 user nova-compute[74613]: DEBUG oslo_service.service [None req-4cf3280a-2aa3-4358-aecf-4946b5adf474 None None] rate_limit_burst               = 0 {{(pid=74613) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 17:47:09 user nova-compute[74613]: DEBUG oslo_service.service [None req-4cf3280a-2aa3-4358-aecf-4946b5adf474 None None] rate_limit_except_level        = CRITICAL {{(pid=74613) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 17:47:09 user nova-compute[74613]: DEBUG oslo_service.service [None req-4cf3280a-2aa3-4358-aecf-4946b5adf474 None None] rate_limit_interval            = 0 {{(pid=74613) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 17:47:09 user nova-compute[74613]: DEBUG oslo_service.service [None req-4cf3280a-2aa3-4358-aecf-4946b5adf474 None None] reboot_timeout                 = 0 {{(pid=74613) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 17:47:09 user nova-compute[74613]: DEBUG oslo_service.service [None req-4cf3280a-2aa3-4358-aecf-4946b5adf474 None None] reclaim_instance_interval      = 0 {{(pid=74613) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 17:47:09 user nova-compute[74613]: DEBUG oslo_service.service [None req-4cf3280a-2aa3-4358-aecf-4946b5adf474 None None] record                         = None {{(pid=74613) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 17:47:09 user nova-compute[74613]: DEBUG oslo_service.service [None req-4cf3280a-2aa3-4358-aecf-4946b5adf474 None None] reimage_timeout_per_gb         = 60 {{(pid=74613) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 17:47:09 user nova-compute[74613]: DEBUG oslo_service.service [None req-4cf3280a-2aa3-4358-aecf-4946b5adf474 None None] report_interval                = 120 {{(pid=74613) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 17:47:09 user nova-compute[74613]: DEBUG oslo_service.service [None req-4cf3280a-2aa3-4358-aecf-4946b5adf474 None None] rescue_timeout                 = 0 {{(pid=74613) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 17:47:09 user nova-compute[74613]: DEBUG oslo_service.service [None req-4cf3280a-2aa3-4358-aecf-4946b5adf474 None None] reserved_host_cpus             = 0 {{(pid=74613) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 17:47:09 user nova-compute[74613]: DEBUG oslo_service.service [None req-4cf3280a-2aa3-4358-aecf-4946b5adf474 None None] reserved_host_disk_mb          = 0 {{(pid=74613) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 17:47:09 user nova-compute[74613]: DEBUG oslo_service.service [None req-4cf3280a-2aa3-4358-aecf-4946b5adf474 None None] reserved_host_memory_mb        = 512 {{(pid=74613) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 17:47:09 user nova-compute[74613]: DEBUG oslo_service.service [None req-4cf3280a-2aa3-4358-aecf-4946b5adf474 None None] reserved_huge_pages            = None {{(pid=74613) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 17:47:09 user nova-compute[74613]: DEBUG oslo_service.service [None req-4cf3280a-2aa3-4358-aecf-4946b5adf474 None None] resize_confirm_window          = 0 {{(pid=74613) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 17:47:09 user nova-compute[74613]: DEBUG oslo_service.service [None req-4cf3280a-2aa3-4358-aecf-4946b5adf474 None None] resize_fs_using_block_device   = False {{(pid=74613) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 17:47:09 user nova-compute[74613]: DEBUG oslo_service.service [None req-4cf3280a-2aa3-4358-aecf-4946b5adf474 None None] resume_guests_state_on_host_boot = False {{(pid=74613) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 17:47:09 user nova-compute[74613]: DEBUG oslo_service.service [None req-4cf3280a-2aa3-4358-aecf-4946b5adf474 None None] rootwrap_config                = /etc/nova/rootwrap.conf {{(pid=74613) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 17:47:09 user nova-compute[74613]: DEBUG oslo_service.service [None req-4cf3280a-2aa3-4358-aecf-4946b5adf474 None None] rpc_response_timeout           = 60 {{(pid=74613) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 17:47:09 user nova-compute[74613]: DEBUG oslo_service.service [None req-4cf3280a-2aa3-4358-aecf-4946b5adf474 None None] run_external_periodic_tasks    = True {{(pid=74613) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 17:47:09 user nova-compute[74613]: DEBUG oslo_service.service [None req-4cf3280a-2aa3-4358-aecf-4946b5adf474 None None] running_deleted_instance_action = reap {{(pid=74613) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 17:47:09 user nova-compute[74613]: DEBUG oslo_service.service [None req-4cf3280a-2aa3-4358-aecf-4946b5adf474 None None] running_deleted_instance_poll_interval = 1800 {{(pid=74613) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 17:47:09 user nova-compute[74613]: DEBUG oslo_service.service [None req-4cf3280a-2aa3-4358-aecf-4946b5adf474 None None] running_deleted_instance_timeout = 0 {{(pid=74613) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 17:47:09 user nova-compute[74613]: DEBUG oslo_service.service [None req-4cf3280a-2aa3-4358-aecf-4946b5adf474 None None] scheduler_instance_sync_interval = 120 {{(pid=74613) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 17:47:09 user nova-compute[74613]: DEBUG oslo_service.service [None req-4cf3280a-2aa3-4358-aecf-4946b5adf474 None None] service_down_time              = 720 {{(pid=74613) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 17:47:09 user nova-compute[74613]: DEBUG oslo_service.service [None req-4cf3280a-2aa3-4358-aecf-4946b5adf474 None None] servicegroup_driver            = db {{(pid=74613) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 17:47:09 user nova-compute[74613]: DEBUG oslo_service.service [None req-4cf3280a-2aa3-4358-aecf-4946b5adf474 None None] shelved_offload_time           = 0 {{(pid=74613) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 17:47:09 user nova-compute[74613]: DEBUG oslo_service.service [None req-4cf3280a-2aa3-4358-aecf-4946b5adf474 None None] shelved_poll_interval          = 3600 {{(pid=74613) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 17:47:09 user nova-compute[74613]: DEBUG oslo_service.service [None req-4cf3280a-2aa3-4358-aecf-4946b5adf474 None None] shutdown_timeout               = 0 {{(pid=74613) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 17:47:09 user nova-compute[74613]: DEBUG oslo_service.service [None req-4cf3280a-2aa3-4358-aecf-4946b5adf474 None None] source_is_ipv6                 = False {{(pid=74613) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 17:47:09 user nova-compute[74613]: DEBUG oslo_service.service [None req-4cf3280a-2aa3-4358-aecf-4946b5adf474 None None] ssl_only                       = False {{(pid=74613) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 17:47:09 user nova-compute[74613]: DEBUG oslo_service.service [None req-4cf3280a-2aa3-4358-aecf-4946b5adf474 None None] state_path                     = /opt/stack/data/nova {{(pid=74613) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 17:47:09 user nova-compute[74613]: DEBUG oslo_service.service [None req-4cf3280a-2aa3-4358-aecf-4946b5adf474 None None] sync_power_state_interval      = 600 {{(pid=74613) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 17:47:09 user nova-compute[74613]: DEBUG oslo_service.service [None req-4cf3280a-2aa3-4358-aecf-4946b5adf474 None None] sync_power_state_pool_size     = 1000 {{(pid=74613) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 17:47:09 user nova-compute[74613]: DEBUG oslo_service.service [None req-4cf3280a-2aa3-4358-aecf-4946b5adf474 None None] syslog_log_facility            = LOG_USER {{(pid=74613) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 17:47:09 user nova-compute[74613]: DEBUG oslo_service.service [None req-4cf3280a-2aa3-4358-aecf-4946b5adf474 None None] tempdir                        = None {{(pid=74613) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 17:47:09 user nova-compute[74613]: DEBUG oslo_service.service [None req-4cf3280a-2aa3-4358-aecf-4946b5adf474 None None] timeout_nbd                    = 10 {{(pid=74613) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 17:47:09 user nova-compute[74613]: DEBUG oslo_service.service [None req-4cf3280a-2aa3-4358-aecf-4946b5adf474 None None] transport_url                  = **** {{(pid=74613) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 17:47:09 user nova-compute[74613]: DEBUG oslo_service.service [None req-4cf3280a-2aa3-4358-aecf-4946b5adf474 None None] update_resources_interval      = 0 {{(pid=74613) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 17:47:09 user nova-compute[74613]: DEBUG oslo_service.service [None req-4cf3280a-2aa3-4358-aecf-4946b5adf474 None None] use_cow_images                 = True {{(pid=74613) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 17:47:09 user nova-compute[74613]: DEBUG oslo_service.service [None req-4cf3280a-2aa3-4358-aecf-4946b5adf474 None None] use_eventlog                   = False {{(pid=74613) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 17:47:09 user nova-compute[74613]: DEBUG oslo_service.service [None req-4cf3280a-2aa3-4358-aecf-4946b5adf474 None None] use_journal                    = False {{(pid=74613) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 17:47:09 user nova-compute[74613]: DEBUG oslo_service.service [None req-4cf3280a-2aa3-4358-aecf-4946b5adf474 None None] use_json                       = False {{(pid=74613) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 17:47:09 user nova-compute[74613]: DEBUG oslo_service.service [None req-4cf3280a-2aa3-4358-aecf-4946b5adf474 None None] use_rootwrap_daemon            = False {{(pid=74613) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 17:47:09 user nova-compute[74613]: DEBUG oslo_service.service [None req-4cf3280a-2aa3-4358-aecf-4946b5adf474 None None] use_stderr                     = False {{(pid=74613) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 17:47:09 user nova-compute[74613]: DEBUG oslo_service.service [None req-4cf3280a-2aa3-4358-aecf-4946b5adf474 None None] use_syslog                     = False {{(pid=74613) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 17:47:09 user nova-compute[74613]: DEBUG oslo_service.service [None req-4cf3280a-2aa3-4358-aecf-4946b5adf474 None None] vcpu_pin_set                   = None {{(pid=74613) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 17:47:09 user nova-compute[74613]: DEBUG oslo_service.service [None req-4cf3280a-2aa3-4358-aecf-4946b5adf474 None None] vif_plugging_is_fatal          = False {{(pid=74613) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 17:47:09 user nova-compute[74613]: DEBUG oslo_service.service [None req-4cf3280a-2aa3-4358-aecf-4946b5adf474 None None] vif_plugging_timeout           = 0 {{(pid=74613) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 17:47:09 user nova-compute[74613]: DEBUG oslo_service.service [None req-4cf3280a-2aa3-4358-aecf-4946b5adf474 None None] virt_mkfs                      = [] {{(pid=74613) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 17:47:09 user nova-compute[74613]: DEBUG oslo_service.service [None req-4cf3280a-2aa3-4358-aecf-4946b5adf474 None None] volume_usage_poll_interval     = 0 {{(pid=74613) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 17:47:09 user nova-compute[74613]: DEBUG oslo_service.service [None req-4cf3280a-2aa3-4358-aecf-4946b5adf474 None None] watch_log_file                 = False {{(pid=74613) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 17:47:09 user nova-compute[74613]: DEBUG oslo_service.service [None req-4cf3280a-2aa3-4358-aecf-4946b5adf474 None None] web                            = /usr/share/spice-html5 {{(pid=74613) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 17:47:09 user nova-compute[74613]: DEBUG oslo_service.service [None req-4cf3280a-2aa3-4358-aecf-4946b5adf474 None None] oslo_concurrency.disable_process_locking = False {{(pid=74613) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 17:47:09 user nova-compute[74613]: DEBUG oslo_service.service [None req-4cf3280a-2aa3-4358-aecf-4946b5adf474 None None] oslo_concurrency.lock_path     = /opt/stack/data/nova {{(pid=74613) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 17:47:09 user nova-compute[74613]: DEBUG oslo_service.service [None req-4cf3280a-2aa3-4358-aecf-4946b5adf474 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=74613) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 17:47:09 user nova-compute[74613]: DEBUG oslo_service.service [None req-4cf3280a-2aa3-4358-aecf-4946b5adf474 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=74613) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 17:47:09 user nova-compute[74613]: DEBUG oslo_service.service [None req-4cf3280a-2aa3-4358-aecf-4946b5adf474 None None] oslo_messaging_metrics.metrics_process_name =  {{(pid=74613) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 17:47:09 user nova-compute[74613]: DEBUG oslo_service.service [None req-4cf3280a-2aa3-4358-aecf-4946b5adf474 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=74613) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 17:47:09 user nova-compute[74613]: DEBUG oslo_service.service [None req-4cf3280a-2aa3-4358-aecf-4946b5adf474 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=74613) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 17:47:09 user nova-compute[74613]: DEBUG oslo_service.service [None req-4cf3280a-2aa3-4358-aecf-4946b5adf474 None None] api.auth_strategy              = keystone {{(pid=74613) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 17:47:09 user nova-compute[74613]: DEBUG oslo_service.service [None req-4cf3280a-2aa3-4358-aecf-4946b5adf474 None None] api.compute_link_prefix        = None {{(pid=74613) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 17:47:09 user nova-compute[74613]: DEBUG oslo_service.service [None req-4cf3280a-2aa3-4358-aecf-4946b5adf474 None None] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=74613) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 17:47:09 user nova-compute[74613]: DEBUG oslo_service.service [None req-4cf3280a-2aa3-4358-aecf-4946b5adf474 None None] api.dhcp_domain                = novalocal {{(pid=74613) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 17:47:09 user nova-compute[74613]: DEBUG oslo_service.service [None req-4cf3280a-2aa3-4358-aecf-4946b5adf474 None None] api.enable_instance_password   = True {{(pid=74613) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 17:47:09 user nova-compute[74613]: DEBUG oslo_service.service [None req-4cf3280a-2aa3-4358-aecf-4946b5adf474 None None] api.glance_link_prefix         = None {{(pid=74613) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 17:47:09 user nova-compute[74613]: DEBUG oslo_service.service [None req-4cf3280a-2aa3-4358-aecf-4946b5adf474 None None] api.instance_list_cells_batch_fixed_size = 100 {{(pid=74613) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 17:47:09 user nova-compute[74613]: DEBUG oslo_service.service [None req-4cf3280a-2aa3-4358-aecf-4946b5adf474 None None] api.instance_list_cells_batch_strategy = distributed {{(pid=74613) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 17:47:09 user nova-compute[74613]: DEBUG oslo_service.service [None req-4cf3280a-2aa3-4358-aecf-4946b5adf474 None None] api.instance_list_per_project_cells = False {{(pid=74613) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 17:47:09 user nova-compute[74613]: DEBUG oslo_service.service [None req-4cf3280a-2aa3-4358-aecf-4946b5adf474 None None] api.list_records_by_skipping_down_cells = True {{(pid=74613) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 17:47:09 user nova-compute[74613]: DEBUG oslo_service.service [None req-4cf3280a-2aa3-4358-aecf-4946b5adf474 None None] api.local_metadata_per_cell    = False {{(pid=74613) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 17:47:09 user nova-compute[74613]: DEBUG oslo_service.service [None req-4cf3280a-2aa3-4358-aecf-4946b5adf474 None None] api.max_limit                  = 1000 {{(pid=74613) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 17:47:09 user nova-compute[74613]: DEBUG oslo_service.service [None req-4cf3280a-2aa3-4358-aecf-4946b5adf474 None None] api.metadata_cache_expiration  = 15 {{(pid=74613) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 17:47:09 user nova-compute[74613]: DEBUG oslo_service.service [None req-4cf3280a-2aa3-4358-aecf-4946b5adf474 None None] api.neutron_default_tenant_id  = default {{(pid=74613) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 17:47:09 user nova-compute[74613]: DEBUG oslo_service.service [None req-4cf3280a-2aa3-4358-aecf-4946b5adf474 None None] api.use_forwarded_for          = False {{(pid=74613) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 17:47:09 user nova-compute[74613]: DEBUG oslo_service.service [None req-4cf3280a-2aa3-4358-aecf-4946b5adf474 None None] api.use_neutron_default_nets   = False {{(pid=74613) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 17:47:09 user nova-compute[74613]: DEBUG oslo_service.service [None req-4cf3280a-2aa3-4358-aecf-4946b5adf474 None None] api.vendordata_dynamic_connect_timeout = 5 {{(pid=74613) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 17:47:09 user nova-compute[74613]: DEBUG oslo_service.service [None req-4cf3280a-2aa3-4358-aecf-4946b5adf474 None None] api.vendordata_dynamic_failure_fatal = False {{(pid=74613) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 17:47:09 user nova-compute[74613]: DEBUG oslo_service.service [None req-4cf3280a-2aa3-4358-aecf-4946b5adf474 None None] api.vendordata_dynamic_read_timeout = 5 {{(pid=74613) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 17:47:09 user nova-compute[74613]: DEBUG oslo_service.service [None req-4cf3280a-2aa3-4358-aecf-4946b5adf474 None None] api.vendordata_dynamic_ssl_certfile =  {{(pid=74613) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 17:47:09 user nova-compute[74613]: DEBUG oslo_service.service [None req-4cf3280a-2aa3-4358-aecf-4946b5adf474 None None] api.vendordata_dynamic_targets = [] {{(pid=74613) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 17:47:09 user nova-compute[74613]: DEBUG oslo_service.service [None req-4cf3280a-2aa3-4358-aecf-4946b5adf474 None None] api.vendordata_jsonfile_path   = None {{(pid=74613) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 17:47:09 user nova-compute[74613]: DEBUG oslo_service.service [None req-4cf3280a-2aa3-4358-aecf-4946b5adf474 None None] api.vendordata_providers       = ['StaticJSON'] {{(pid=74613) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 17:47:09 user nova-compute[74613]: DEBUG oslo_service.service [None req-4cf3280a-2aa3-4358-aecf-4946b5adf474 None None] cache.backend                  = dogpile.cache.memcached {{(pid=74613) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 17:47:09 user nova-compute[74613]: DEBUG oslo_service.service [None req-4cf3280a-2aa3-4358-aecf-4946b5adf474 None None] cache.backend_argument         = **** {{(pid=74613) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 17:47:09 user nova-compute[74613]: DEBUG oslo_service.service [None req-4cf3280a-2aa3-4358-aecf-4946b5adf474 None None] cache.config_prefix            = cache.oslo {{(pid=74613) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 17:47:09 user nova-compute[74613]: DEBUG oslo_service.service [None req-4cf3280a-2aa3-4358-aecf-4946b5adf474 None None] cache.dead_timeout             = 60.0 {{(pid=74613) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 17:47:09 user nova-compute[74613]: DEBUG oslo_service.service [None req-4cf3280a-2aa3-4358-aecf-4946b5adf474 None None] cache.debug_cache_backend      = False {{(pid=74613) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 17:47:09 user nova-compute[74613]: DEBUG oslo_service.service [None req-4cf3280a-2aa3-4358-aecf-4946b5adf474 None None] cache.enable_retry_client      = False {{(pid=74613) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 17:47:09 user nova-compute[74613]: DEBUG oslo_service.service [None req-4cf3280a-2aa3-4358-aecf-4946b5adf474 None None] cache.enable_socket_keepalive  = False {{(pid=74613) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 17:47:09 user nova-compute[74613]: DEBUG oslo_service.service [None req-4cf3280a-2aa3-4358-aecf-4946b5adf474 None None] cache.enabled                  = True {{(pid=74613) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 17:47:09 user nova-compute[74613]: DEBUG oslo_service.service [None req-4cf3280a-2aa3-4358-aecf-4946b5adf474 None None] cache.expiration_time          = 600 {{(pid=74613) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 17:47:09 user nova-compute[74613]: DEBUG oslo_service.service [None req-4cf3280a-2aa3-4358-aecf-4946b5adf474 None None] cache.hashclient_retry_attempts = 2 {{(pid=74613) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 17:47:09 user nova-compute[74613]: DEBUG oslo_service.service [None req-4cf3280a-2aa3-4358-aecf-4946b5adf474 None None] cache.hashclient_retry_delay   = 1.0 {{(pid=74613) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 17:47:09 user nova-compute[74613]: DEBUG oslo_service.service [None req-4cf3280a-2aa3-4358-aecf-4946b5adf474 None None] cache.memcache_dead_retry      = 300 {{(pid=74613) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 17:47:09 user nova-compute[74613]: DEBUG oslo_service.service [None req-4cf3280a-2aa3-4358-aecf-4946b5adf474 None None] cache.memcache_password        =  {{(pid=74613) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 17:47:09 user nova-compute[74613]: DEBUG oslo_service.service [None req-4cf3280a-2aa3-4358-aecf-4946b5adf474 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=74613) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 17:47:09 user nova-compute[74613]: DEBUG oslo_service.service [None req-4cf3280a-2aa3-4358-aecf-4946b5adf474 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=74613) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 17:47:09 user nova-compute[74613]: DEBUG oslo_service.service [None req-4cf3280a-2aa3-4358-aecf-4946b5adf474 None None] cache.memcache_pool_maxsize    = 10 {{(pid=74613) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 17:47:09 user nova-compute[74613]: DEBUG oslo_service.service [None req-4cf3280a-2aa3-4358-aecf-4946b5adf474 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=74613) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 17:47:09 user nova-compute[74613]: DEBUG oslo_service.service [None req-4cf3280a-2aa3-4358-aecf-4946b5adf474 None None] cache.memcache_sasl_enabled    = False {{(pid=74613) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 17:47:09 user nova-compute[74613]: DEBUG oslo_service.service [None req-4cf3280a-2aa3-4358-aecf-4946b5adf474 None None] cache.memcache_servers         = ['localhost:11211'] {{(pid=74613) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 17:47:09 user nova-compute[74613]: DEBUG oslo_service.service [None req-4cf3280a-2aa3-4358-aecf-4946b5adf474 None None] cache.memcache_socket_timeout  = 1.0 {{(pid=74613) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 17:47:09 user nova-compute[74613]: DEBUG oslo_service.service [None req-4cf3280a-2aa3-4358-aecf-4946b5adf474 None None] cache.memcache_username        =  {{(pid=74613) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 17:47:09 user nova-compute[74613]: DEBUG oslo_service.service [None req-4cf3280a-2aa3-4358-aecf-4946b5adf474 None None] cache.proxies                  = [] {{(pid=74613) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 17:47:09 user nova-compute[74613]: DEBUG oslo_service.service [None req-4cf3280a-2aa3-4358-aecf-4946b5adf474 None None] cache.retry_attempts           = 2 {{(pid=74613) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 17:47:09 user nova-compute[74613]: DEBUG oslo_service.service [None req-4cf3280a-2aa3-4358-aecf-4946b5adf474 None None] cache.retry_delay              = 0.0 {{(pid=74613) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 17:47:09 user nova-compute[74613]: DEBUG oslo_service.service [None req-4cf3280a-2aa3-4358-aecf-4946b5adf474 None None] cache.socket_keepalive_count   = 1 {{(pid=74613) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 17:47:09 user nova-compute[74613]: DEBUG oslo_service.service [None req-4cf3280a-2aa3-4358-aecf-4946b5adf474 None None] cache.socket_keepalive_idle    = 1 {{(pid=74613) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 17:47:09 user nova-compute[74613]: DEBUG oslo_service.service [None req-4cf3280a-2aa3-4358-aecf-4946b5adf474 None None] cache.socket_keepalive_interval = 1 {{(pid=74613) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 17:47:09 user nova-compute[74613]: DEBUG oslo_service.service [None req-4cf3280a-2aa3-4358-aecf-4946b5adf474 None None] cache.tls_allowed_ciphers      = None {{(pid=74613) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 17:47:09 user nova-compute[74613]: DEBUG oslo_service.service [None req-4cf3280a-2aa3-4358-aecf-4946b5adf474 None None] cache.tls_cafile               = None {{(pid=74613) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 17:47:09 user nova-compute[74613]: DEBUG oslo_service.service [None req-4cf3280a-2aa3-4358-aecf-4946b5adf474 None None] cache.tls_certfile             = None {{(pid=74613) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 17:47:09 user nova-compute[74613]: DEBUG oslo_service.service [None req-4cf3280a-2aa3-4358-aecf-4946b5adf474 None None] cache.tls_enabled              = False {{(pid=74613) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 17:47:09 user nova-compute[74613]: DEBUG oslo_service.service [None req-4cf3280a-2aa3-4358-aecf-4946b5adf474 None None] cache.tls_keyfile              = None {{(pid=74613) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 17:47:09 user nova-compute[74613]: DEBUG oslo_service.service [None req-4cf3280a-2aa3-4358-aecf-4946b5adf474 None None] cinder.auth_section            = None {{(pid=74613) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 17:47:09 user nova-compute[74613]: DEBUG oslo_service.service [None req-4cf3280a-2aa3-4358-aecf-4946b5adf474 None None] cinder.auth_type               = password {{(pid=74613) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 17:47:09 user nova-compute[74613]: DEBUG oslo_service.service [None req-4cf3280a-2aa3-4358-aecf-4946b5adf474 None None] cinder.cafile                  = None {{(pid=74613) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 17:47:09 user nova-compute[74613]: DEBUG oslo_service.service [None req-4cf3280a-2aa3-4358-aecf-4946b5adf474 None None] cinder.catalog_info            = volumev3::publicURL {{(pid=74613) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 17:47:09 user nova-compute[74613]: DEBUG oslo_service.service [None req-4cf3280a-2aa3-4358-aecf-4946b5adf474 None None] cinder.certfile                = None {{(pid=74613) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 17:47:09 user nova-compute[74613]: DEBUG oslo_service.service [None req-4cf3280a-2aa3-4358-aecf-4946b5adf474 None None] cinder.collect_timing          = False {{(pid=74613) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 17:47:09 user nova-compute[74613]: DEBUG oslo_service.service [None req-4cf3280a-2aa3-4358-aecf-4946b5adf474 None None] cinder.cross_az_attach         = True {{(pid=74613) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 17:47:09 user nova-compute[74613]: DEBUG oslo_service.service [None req-4cf3280a-2aa3-4358-aecf-4946b5adf474 None None] cinder.debug                   = False {{(pid=74613) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 17:47:09 user nova-compute[74613]: DEBUG oslo_service.service [None req-4cf3280a-2aa3-4358-aecf-4946b5adf474 None None] cinder.endpoint_template       = None {{(pid=74613) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 17:47:09 user nova-compute[74613]: DEBUG oslo_service.service [None req-4cf3280a-2aa3-4358-aecf-4946b5adf474 None None] cinder.http_retries            = 3 {{(pid=74613) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 17:47:09 user nova-compute[74613]: DEBUG oslo_service.service [None req-4cf3280a-2aa3-4358-aecf-4946b5adf474 None None] cinder.insecure                = False {{(pid=74613) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 17:47:09 user nova-compute[74613]: DEBUG oslo_service.service [None req-4cf3280a-2aa3-4358-aecf-4946b5adf474 None None] cinder.keyfile                 = None {{(pid=74613) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 17:47:09 user nova-compute[74613]: DEBUG oslo_service.service [None req-4cf3280a-2aa3-4358-aecf-4946b5adf474 None None] cinder.os_region_name          = RegionOne {{(pid=74613) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 17:47:09 user nova-compute[74613]: DEBUG oslo_service.service [None req-4cf3280a-2aa3-4358-aecf-4946b5adf474 None None] cinder.split_loggers           = False {{(pid=74613) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 17:47:09 user nova-compute[74613]: DEBUG oslo_service.service [None req-4cf3280a-2aa3-4358-aecf-4946b5adf474 None None] cinder.timeout                 = None {{(pid=74613) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 17:47:09 user nova-compute[74613]: DEBUG oslo_service.service [None req-4cf3280a-2aa3-4358-aecf-4946b5adf474 None None] compute.consecutive_build_service_disable_threshold = 10 {{(pid=74613) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 17:47:09 user nova-compute[74613]: DEBUG oslo_service.service [None req-4cf3280a-2aa3-4358-aecf-4946b5adf474 None None] compute.cpu_dedicated_set      = None {{(pid=74613) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 17:47:09 user nova-compute[74613]: DEBUG oslo_service.service [None req-4cf3280a-2aa3-4358-aecf-4946b5adf474 None None] compute.cpu_shared_set         = None {{(pid=74613) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 17:47:09 user nova-compute[74613]: DEBUG oslo_service.service [None req-4cf3280a-2aa3-4358-aecf-4946b5adf474 None None] compute.image_type_exclude_list = [] {{(pid=74613) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 17:47:09 user nova-compute[74613]: DEBUG oslo_service.service [None req-4cf3280a-2aa3-4358-aecf-4946b5adf474 None None] compute.live_migration_wait_for_vif_plug = True {{(pid=74613) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 17:47:09 user nova-compute[74613]: DEBUG oslo_service.service [None req-4cf3280a-2aa3-4358-aecf-4946b5adf474 None None] compute.max_concurrent_disk_ops = 0 {{(pid=74613) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 17:47:09 user nova-compute[74613]: DEBUG oslo_service.service [None req-4cf3280a-2aa3-4358-aecf-4946b5adf474 None None] compute.max_disk_devices_to_attach = -1 {{(pid=74613) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 17:47:09 user nova-compute[74613]: DEBUG oslo_service.service [None req-4cf3280a-2aa3-4358-aecf-4946b5adf474 None None] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=74613) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 17:47:09 user nova-compute[74613]: DEBUG oslo_service.service [None req-4cf3280a-2aa3-4358-aecf-4946b5adf474 None None] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=74613) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 17:47:09 user nova-compute[74613]: DEBUG oslo_service.service [None req-4cf3280a-2aa3-4358-aecf-4946b5adf474 None None] compute.resource_provider_association_refresh = 300 {{(pid=74613) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 17:47:09 user nova-compute[74613]: DEBUG oslo_service.service [None req-4cf3280a-2aa3-4358-aecf-4946b5adf474 None None] compute.shutdown_retry_interval = 10 {{(pid=74613) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 17:47:09 user nova-compute[74613]: DEBUG oslo_service.service [None req-4cf3280a-2aa3-4358-aecf-4946b5adf474 None None] compute.vmdk_allowed_types     = ['streamOptimized', 'monolithicSparse'] {{(pid=74613) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 17:47:09 user nova-compute[74613]: DEBUG oslo_service.service [None req-4cf3280a-2aa3-4358-aecf-4946b5adf474 None None] conductor.workers              = 3 {{(pid=74613) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 17:47:09 user nova-compute[74613]: DEBUG oslo_service.service [None req-4cf3280a-2aa3-4358-aecf-4946b5adf474 None None] console.allowed_origins        = [] {{(pid=74613) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 17:47:09 user nova-compute[74613]: DEBUG oslo_service.service [None req-4cf3280a-2aa3-4358-aecf-4946b5adf474 None None] console.ssl_ciphers            = None {{(pid=74613) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 17:47:09 user nova-compute[74613]: DEBUG oslo_service.service [None req-4cf3280a-2aa3-4358-aecf-4946b5adf474 None None] console.ssl_minimum_version    = default {{(pid=74613) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 17:47:09 user nova-compute[74613]: DEBUG oslo_service.service [None req-4cf3280a-2aa3-4358-aecf-4946b5adf474 None None] consoleauth.token_ttl          = 600 {{(pid=74613) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 17:47:09 user nova-compute[74613]: DEBUG oslo_service.service [None req-4cf3280a-2aa3-4358-aecf-4946b5adf474 None None] cyborg.cafile                  = None {{(pid=74613) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 17:47:09 user nova-compute[74613]: DEBUG oslo_service.service [None req-4cf3280a-2aa3-4358-aecf-4946b5adf474 None None] cyborg.certfile                = None {{(pid=74613) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 17:47:09 user nova-compute[74613]: DEBUG oslo_service.service [None req-4cf3280a-2aa3-4358-aecf-4946b5adf474 None None] cyborg.collect_timing          = False {{(pid=74613) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 17:47:09 user nova-compute[74613]: DEBUG oslo_service.service [None req-4cf3280a-2aa3-4358-aecf-4946b5adf474 None None] cyborg.connect_retries         = None {{(pid=74613) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 17:47:09 user nova-compute[74613]: DEBUG oslo_service.service [None req-4cf3280a-2aa3-4358-aecf-4946b5adf474 None None] cyborg.connect_retry_delay     = None {{(pid=74613) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 17:47:09 user nova-compute[74613]: DEBUG oslo_service.service [None req-4cf3280a-2aa3-4358-aecf-4946b5adf474 None None] cyborg.endpoint_override       = None {{(pid=74613) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 17:47:09 user nova-compute[74613]: DEBUG oslo_service.service [None req-4cf3280a-2aa3-4358-aecf-4946b5adf474 None None] cyborg.insecure                = False {{(pid=74613) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 17:47:09 user nova-compute[74613]: DEBUG oslo_service.service [None req-4cf3280a-2aa3-4358-aecf-4946b5adf474 None None] cyborg.keyfile                 = None {{(pid=74613) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 17:47:09 user nova-compute[74613]: DEBUG oslo_service.service [None req-4cf3280a-2aa3-4358-aecf-4946b5adf474 None None] cyborg.max_version             = None {{(pid=74613) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 17:47:09 user nova-compute[74613]: DEBUG oslo_service.service [None req-4cf3280a-2aa3-4358-aecf-4946b5adf474 None None] cyborg.min_version             = None {{(pid=74613) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 17:47:09 user nova-compute[74613]: DEBUG oslo_service.service [None req-4cf3280a-2aa3-4358-aecf-4946b5adf474 None None] cyborg.region_name             = None {{(pid=74613) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 17:47:09 user nova-compute[74613]: DEBUG oslo_service.service [None req-4cf3280a-2aa3-4358-aecf-4946b5adf474 None None] cyborg.service_name            = None {{(pid=74613) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 17:47:09 user nova-compute[74613]: DEBUG oslo_service.service [None req-4cf3280a-2aa3-4358-aecf-4946b5adf474 None None] cyborg.service_type            = accelerator {{(pid=74613) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 17:47:09 user nova-compute[74613]: DEBUG oslo_service.service [None req-4cf3280a-2aa3-4358-aecf-4946b5adf474 None None] cyborg.split_loggers           = False {{(pid=74613) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 17:47:09 user nova-compute[74613]: DEBUG oslo_service.service [None req-4cf3280a-2aa3-4358-aecf-4946b5adf474 None None] cyborg.status_code_retries     = None {{(pid=74613) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 17:47:09 user nova-compute[74613]: DEBUG oslo_service.service [None req-4cf3280a-2aa3-4358-aecf-4946b5adf474 None None] cyborg.status_code_retry_delay = None {{(pid=74613) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 17:47:09 user nova-compute[74613]: DEBUG oslo_service.service [None req-4cf3280a-2aa3-4358-aecf-4946b5adf474 None None] cyborg.timeout                 = None {{(pid=74613) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 17:47:09 user nova-compute[74613]: DEBUG oslo_service.service [None req-4cf3280a-2aa3-4358-aecf-4946b5adf474 None None] cyborg.valid_interfaces        = ['internal', 'public'] {{(pid=74613) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 17:47:09 user nova-compute[74613]: DEBUG oslo_service.service [None req-4cf3280a-2aa3-4358-aecf-4946b5adf474 None None] cyborg.version                 = None {{(pid=74613) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 17:47:09 user nova-compute[74613]: DEBUG oslo_service.service [None req-4cf3280a-2aa3-4358-aecf-4946b5adf474 None None] database.backend               = sqlalchemy {{(pid=74613) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 17:47:09 user nova-compute[74613]: DEBUG oslo_service.service [None req-4cf3280a-2aa3-4358-aecf-4946b5adf474 None None] database.connection            = **** {{(pid=74613) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 17:47:09 user nova-compute[74613]: DEBUG oslo_service.service [None req-4cf3280a-2aa3-4358-aecf-4946b5adf474 None None] database.connection_debug      = 0 {{(pid=74613) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 17:47:09 user nova-compute[74613]: DEBUG oslo_service.service [None req-4cf3280a-2aa3-4358-aecf-4946b5adf474 None None] database.connection_parameters =  {{(pid=74613) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 17:47:09 user nova-compute[74613]: DEBUG oslo_service.service [None req-4cf3280a-2aa3-4358-aecf-4946b5adf474 None None] database.connection_recycle_time = 3600 {{(pid=74613) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 17:47:09 user nova-compute[74613]: DEBUG oslo_service.service [None req-4cf3280a-2aa3-4358-aecf-4946b5adf474 None None] database.connection_trace      = False {{(pid=74613) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 17:47:09 user nova-compute[74613]: DEBUG oslo_service.service [None req-4cf3280a-2aa3-4358-aecf-4946b5adf474 None None] database.db_inc_retry_interval = True {{(pid=74613) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 17:47:09 user nova-compute[74613]: DEBUG oslo_service.service [None req-4cf3280a-2aa3-4358-aecf-4946b5adf474 None None] database.db_max_retries        = 20 {{(pid=74613) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 17:47:09 user nova-compute[74613]: DEBUG oslo_service.service [None req-4cf3280a-2aa3-4358-aecf-4946b5adf474 None None] database.db_max_retry_interval = 10 {{(pid=74613) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 17:47:09 user nova-compute[74613]: DEBUG oslo_service.service [None req-4cf3280a-2aa3-4358-aecf-4946b5adf474 None None] database.db_retry_interval     = 1 {{(pid=74613) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 17:47:09 user nova-compute[74613]: DEBUG oslo_service.service [None req-4cf3280a-2aa3-4358-aecf-4946b5adf474 None None] database.max_overflow          = 50 {{(pid=74613) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 17:47:09 user nova-compute[74613]: DEBUG oslo_service.service [None req-4cf3280a-2aa3-4358-aecf-4946b5adf474 None None] database.max_pool_size         = 5 {{(pid=74613) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 17:47:09 user nova-compute[74613]: DEBUG oslo_service.service [None req-4cf3280a-2aa3-4358-aecf-4946b5adf474 None None] database.max_retries           = 10 {{(pid=74613) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 17:47:09 user nova-compute[74613]: DEBUG oslo_service.service [None req-4cf3280a-2aa3-4358-aecf-4946b5adf474 None None] database.mysql_sql_mode        = TRADITIONAL {{(pid=74613) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 17:47:09 user nova-compute[74613]: DEBUG oslo_service.service [None req-4cf3280a-2aa3-4358-aecf-4946b5adf474 None None] database.mysql_wsrep_sync_wait = None {{(pid=74613) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 17:47:09 user nova-compute[74613]: DEBUG oslo_service.service [None req-4cf3280a-2aa3-4358-aecf-4946b5adf474 None None] database.pool_timeout          = None {{(pid=74613) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 17:47:09 user nova-compute[74613]: DEBUG oslo_service.service [None req-4cf3280a-2aa3-4358-aecf-4946b5adf474 None None] database.retry_interval        = 10 {{(pid=74613) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 17:47:09 user nova-compute[74613]: DEBUG oslo_service.service [None req-4cf3280a-2aa3-4358-aecf-4946b5adf474 None None] database.slave_connection      = **** {{(pid=74613) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 17:47:09 user nova-compute[74613]: DEBUG oslo_service.service [None req-4cf3280a-2aa3-4358-aecf-4946b5adf474 None None] database.sqlite_synchronous    = True {{(pid=74613) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 17:47:09 user nova-compute[74613]: DEBUG oslo_service.service [None req-4cf3280a-2aa3-4358-aecf-4946b5adf474 None None] api_database.backend           = sqlalchemy {{(pid=74613) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 17:47:09 user nova-compute[74613]: DEBUG oslo_service.service [None req-4cf3280a-2aa3-4358-aecf-4946b5adf474 None None] api_database.connection        = **** {{(pid=74613) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 17:47:09 user nova-compute[74613]: DEBUG oslo_service.service [None req-4cf3280a-2aa3-4358-aecf-4946b5adf474 None None] api_database.connection_debug  = 0 {{(pid=74613) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 17:47:09 user nova-compute[74613]: DEBUG oslo_service.service [None req-4cf3280a-2aa3-4358-aecf-4946b5adf474 None None] api_database.connection_parameters =  {{(pid=74613) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 17:47:09 user nova-compute[74613]: DEBUG oslo_service.service [None req-4cf3280a-2aa3-4358-aecf-4946b5adf474 None None] api_database.connection_recycle_time = 3600 {{(pid=74613) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 17:47:09 user nova-compute[74613]: DEBUG oslo_service.service [None req-4cf3280a-2aa3-4358-aecf-4946b5adf474 None None] api_database.connection_trace  = False {{(pid=74613) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 17:47:09 user nova-compute[74613]: DEBUG oslo_service.service [None req-4cf3280a-2aa3-4358-aecf-4946b5adf474 None None] api_database.db_inc_retry_interval = True {{(pid=74613) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 17:47:09 user nova-compute[74613]: DEBUG oslo_service.service [None req-4cf3280a-2aa3-4358-aecf-4946b5adf474 None None] api_database.db_max_retries    = 20 {{(pid=74613) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 17:47:09 user nova-compute[74613]: DEBUG oslo_service.service [None req-4cf3280a-2aa3-4358-aecf-4946b5adf474 None None] api_database.db_max_retry_interval = 10 {{(pid=74613) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 17:47:09 user nova-compute[74613]: DEBUG oslo_service.service [None req-4cf3280a-2aa3-4358-aecf-4946b5adf474 None None] api_database.db_retry_interval = 1 {{(pid=74613) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 17:47:09 user nova-compute[74613]: DEBUG oslo_service.service [None req-4cf3280a-2aa3-4358-aecf-4946b5adf474 None None] api_database.max_overflow      = 50 {{(pid=74613) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 17:47:09 user nova-compute[74613]: DEBUG oslo_service.service [None req-4cf3280a-2aa3-4358-aecf-4946b5adf474 None None] api_database.max_pool_size     = 5 {{(pid=74613) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 17:47:09 user nova-compute[74613]: DEBUG oslo_service.service [None req-4cf3280a-2aa3-4358-aecf-4946b5adf474 None None] api_database.max_retries       = 10 {{(pid=74613) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 17:47:09 user nova-compute[74613]: DEBUG oslo_service.service [None req-4cf3280a-2aa3-4358-aecf-4946b5adf474 None None] api_database.mysql_sql_mode    = TRADITIONAL {{(pid=74613) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 17:47:09 user nova-compute[74613]: DEBUG oslo_service.service [None req-4cf3280a-2aa3-4358-aecf-4946b5adf474 None None] api_database.mysql_wsrep_sync_wait = None {{(pid=74613) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 17:47:09 user nova-compute[74613]: DEBUG oslo_service.service [None req-4cf3280a-2aa3-4358-aecf-4946b5adf474 None None] api_database.pool_timeout      = None {{(pid=74613) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 17:47:09 user nova-compute[74613]: DEBUG oslo_service.service [None req-4cf3280a-2aa3-4358-aecf-4946b5adf474 None None] api_database.retry_interval    = 10 {{(pid=74613) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 17:47:09 user nova-compute[74613]: DEBUG oslo_service.service [None req-4cf3280a-2aa3-4358-aecf-4946b5adf474 None None] api_database.slave_connection  = **** {{(pid=74613) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 17:47:09 user nova-compute[74613]: DEBUG oslo_service.service [None req-4cf3280a-2aa3-4358-aecf-4946b5adf474 None None] api_database.sqlite_synchronous = True {{(pid=74613) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 17:47:09 user nova-compute[74613]: DEBUG oslo_service.service [None req-4cf3280a-2aa3-4358-aecf-4946b5adf474 None None] devices.enabled_mdev_types     = [] {{(pid=74613) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 17:47:09 user nova-compute[74613]: DEBUG oslo_service.service [None req-4cf3280a-2aa3-4358-aecf-4946b5adf474 None None] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=74613) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 17:47:09 user nova-compute[74613]: DEBUG oslo_service.service [None req-4cf3280a-2aa3-4358-aecf-4946b5adf474 None None] ephemeral_storage_encryption.enabled = False {{(pid=74613) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 17:47:09 user nova-compute[74613]: DEBUG oslo_service.service [None req-4cf3280a-2aa3-4358-aecf-4946b5adf474 None None] ephemeral_storage_encryption.key_size = 512 {{(pid=74613) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 17:47:09 user nova-compute[74613]: DEBUG oslo_service.service [None req-4cf3280a-2aa3-4358-aecf-4946b5adf474 None None] glance.api_servers             = None {{(pid=74613) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 17:47:09 user nova-compute[74613]: DEBUG oslo_service.service [None req-4cf3280a-2aa3-4358-aecf-4946b5adf474 None None] glance.cafile                  = None {{(pid=74613) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 17:47:09 user nova-compute[74613]: DEBUG oslo_service.service [None req-4cf3280a-2aa3-4358-aecf-4946b5adf474 None None] glance.certfile                = None {{(pid=74613) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 17:47:09 user nova-compute[74613]: DEBUG oslo_service.service [None req-4cf3280a-2aa3-4358-aecf-4946b5adf474 None None] glance.collect_timing          = False {{(pid=74613) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 17:47:09 user nova-compute[74613]: DEBUG oslo_service.service [None req-4cf3280a-2aa3-4358-aecf-4946b5adf474 None None] glance.connect_retries         = None {{(pid=74613) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 17:47:09 user nova-compute[74613]: DEBUG oslo_service.service [None req-4cf3280a-2aa3-4358-aecf-4946b5adf474 None None] glance.connect_retry_delay     = None {{(pid=74613) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 17:47:09 user nova-compute[74613]: DEBUG oslo_service.service [None req-4cf3280a-2aa3-4358-aecf-4946b5adf474 None None] glance.debug                   = False {{(pid=74613) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 17:47:09 user nova-compute[74613]: DEBUG oslo_service.service [None req-4cf3280a-2aa3-4358-aecf-4946b5adf474 None None] glance.default_trusted_certificate_ids = [] {{(pid=74613) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 17:47:09 user nova-compute[74613]: DEBUG oslo_service.service [None req-4cf3280a-2aa3-4358-aecf-4946b5adf474 None None] glance.enable_certificate_validation = False {{(pid=74613) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 17:47:09 user nova-compute[74613]: DEBUG oslo_service.service [None req-4cf3280a-2aa3-4358-aecf-4946b5adf474 None None] glance.enable_rbd_download     = False {{(pid=74613) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 17:47:09 user nova-compute[74613]: DEBUG oslo_service.service [None req-4cf3280a-2aa3-4358-aecf-4946b5adf474 None None] glance.endpoint_override       = None {{(pid=74613) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 17:47:09 user nova-compute[74613]: DEBUG oslo_service.service [None req-4cf3280a-2aa3-4358-aecf-4946b5adf474 None None] glance.insecure                = False {{(pid=74613) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 17:47:09 user nova-compute[74613]: DEBUG oslo_service.service [None req-4cf3280a-2aa3-4358-aecf-4946b5adf474 None None] glance.keyfile                 = None {{(pid=74613) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 17:47:09 user nova-compute[74613]: DEBUG oslo_service.service [None req-4cf3280a-2aa3-4358-aecf-4946b5adf474 None None] glance.max_version             = None {{(pid=74613) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 17:47:09 user nova-compute[74613]: DEBUG oslo_service.service [None req-4cf3280a-2aa3-4358-aecf-4946b5adf474 None None] glance.min_version             = None {{(pid=74613) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 17:47:09 user nova-compute[74613]: DEBUG oslo_service.service [None req-4cf3280a-2aa3-4358-aecf-4946b5adf474 None None] glance.num_retries             = 3 {{(pid=74613) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 17:47:09 user nova-compute[74613]: DEBUG oslo_service.service [None req-4cf3280a-2aa3-4358-aecf-4946b5adf474 None None] glance.rbd_ceph_conf           =  {{(pid=74613) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 17:47:09 user nova-compute[74613]: DEBUG oslo_service.service [None req-4cf3280a-2aa3-4358-aecf-4946b5adf474 None None] glance.rbd_connect_timeout     = 5 {{(pid=74613) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 17:47:09 user nova-compute[74613]: DEBUG oslo_service.service [None req-4cf3280a-2aa3-4358-aecf-4946b5adf474 None None] glance.rbd_pool                =  {{(pid=74613) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 17:47:09 user nova-compute[74613]: DEBUG oslo_service.service [None req-4cf3280a-2aa3-4358-aecf-4946b5adf474 None None] glance.rbd_user                =  {{(pid=74613) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 17:47:09 user nova-compute[74613]: DEBUG oslo_service.service [None req-4cf3280a-2aa3-4358-aecf-4946b5adf474 None None] glance.region_name             = None {{(pid=74613) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 17:47:09 user nova-compute[74613]: DEBUG oslo_service.service [None req-4cf3280a-2aa3-4358-aecf-4946b5adf474 None None] glance.service_name            = None {{(pid=74613) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 17:47:09 user nova-compute[74613]: DEBUG oslo_service.service [None req-4cf3280a-2aa3-4358-aecf-4946b5adf474 None None] glance.service_type            = image {{(pid=74613) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 17:47:09 user nova-compute[74613]: DEBUG oslo_service.service [None req-4cf3280a-2aa3-4358-aecf-4946b5adf474 None None] glance.split_loggers           = False {{(pid=74613) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 17:47:09 user nova-compute[74613]: DEBUG oslo_service.service [None req-4cf3280a-2aa3-4358-aecf-4946b5adf474 None None] glance.status_code_retries     = None {{(pid=74613) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 17:47:09 user nova-compute[74613]: DEBUG oslo_service.service [None req-4cf3280a-2aa3-4358-aecf-4946b5adf474 None None] glance.status_code_retry_delay = None {{(pid=74613) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 17:47:09 user nova-compute[74613]: DEBUG oslo_service.service [None req-4cf3280a-2aa3-4358-aecf-4946b5adf474 None None] glance.timeout                 = None {{(pid=74613) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 17:47:09 user nova-compute[74613]: DEBUG oslo_service.service [None req-4cf3280a-2aa3-4358-aecf-4946b5adf474 None None] glance.valid_interfaces        = ['internal', 'public'] {{(pid=74613) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 17:47:09 user nova-compute[74613]: DEBUG oslo_service.service [None req-4cf3280a-2aa3-4358-aecf-4946b5adf474 None None] glance.verify_glance_signatures = False {{(pid=74613) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 17:47:09 user nova-compute[74613]: DEBUG oslo_service.service [None req-4cf3280a-2aa3-4358-aecf-4946b5adf474 None None] glance.version                 = None {{(pid=74613) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 17:47:09 user nova-compute[74613]: DEBUG oslo_service.service [None req-4cf3280a-2aa3-4358-aecf-4946b5adf474 None None] guestfs.debug                  = False {{(pid=74613) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 17:47:09 user nova-compute[74613]: DEBUG oslo_service.service [None req-4cf3280a-2aa3-4358-aecf-4946b5adf474 None None] hyperv.config_drive_cdrom      = False {{(pid=74613) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 17:47:09 user nova-compute[74613]: DEBUG oslo_service.service [None req-4cf3280a-2aa3-4358-aecf-4946b5adf474 None None] hyperv.config_drive_inject_password = False {{(pid=74613) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 17:47:09 user nova-compute[74613]: DEBUG oslo_service.service [None req-4cf3280a-2aa3-4358-aecf-4946b5adf474 None None] hyperv.dynamic_memory_ratio    = 1.0 {{(pid=74613) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 17:47:09 user nova-compute[74613]: DEBUG oslo_service.service [None req-4cf3280a-2aa3-4358-aecf-4946b5adf474 None None] hyperv.enable_instance_metrics_collection = False {{(pid=74613) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 17:47:09 user nova-compute[74613]: DEBUG oslo_service.service [None req-4cf3280a-2aa3-4358-aecf-4946b5adf474 None None] hyperv.enable_remotefx         = False {{(pid=74613) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 17:47:09 user nova-compute[74613]: DEBUG oslo_service.service [None req-4cf3280a-2aa3-4358-aecf-4946b5adf474 None None] hyperv.instances_path_share    =  {{(pid=74613) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 17:47:09 user nova-compute[74613]: DEBUG oslo_service.service [None req-4cf3280a-2aa3-4358-aecf-4946b5adf474 None None] hyperv.iscsi_initiator_list    = [] {{(pid=74613) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 17:47:09 user nova-compute[74613]: DEBUG oslo_service.service [None req-4cf3280a-2aa3-4358-aecf-4946b5adf474 None None] hyperv.limit_cpu_features      = False {{(pid=74613) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 17:47:09 user nova-compute[74613]: DEBUG oslo_service.service [None req-4cf3280a-2aa3-4358-aecf-4946b5adf474 None None] hyperv.mounted_disk_query_retry_count = 10 {{(pid=74613) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 17:47:09 user nova-compute[74613]: DEBUG oslo_service.service [None req-4cf3280a-2aa3-4358-aecf-4946b5adf474 None None] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=74613) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 17:47:09 user nova-compute[74613]: DEBUG oslo_service.service [None req-4cf3280a-2aa3-4358-aecf-4946b5adf474 None None] hyperv.power_state_check_timeframe = 60 {{(pid=74613) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 17:47:09 user nova-compute[74613]: DEBUG oslo_service.service [None req-4cf3280a-2aa3-4358-aecf-4946b5adf474 None None] hyperv.power_state_event_polling_interval = 2 {{(pid=74613) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 17:47:09 user nova-compute[74613]: DEBUG oslo_service.service [None req-4cf3280a-2aa3-4358-aecf-4946b5adf474 None None] hyperv.qemu_img_cmd            = qemu-img.exe {{(pid=74613) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 17:47:09 user nova-compute[74613]: DEBUG oslo_service.service [None req-4cf3280a-2aa3-4358-aecf-4946b5adf474 None None] hyperv.use_multipath_io        = False {{(pid=74613) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 17:47:09 user nova-compute[74613]: DEBUG oslo_service.service [None req-4cf3280a-2aa3-4358-aecf-4946b5adf474 None None] hyperv.volume_attach_retry_count = 10 {{(pid=74613) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 17:47:09 user nova-compute[74613]: DEBUG oslo_service.service [None req-4cf3280a-2aa3-4358-aecf-4946b5adf474 None None] hyperv.volume_attach_retry_interval = 5 {{(pid=74613) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 17:47:09 user nova-compute[74613]: DEBUG oslo_service.service [None req-4cf3280a-2aa3-4358-aecf-4946b5adf474 None None] hyperv.vswitch_name            = None {{(pid=74613) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 17:47:09 user nova-compute[74613]: DEBUG oslo_service.service [None req-4cf3280a-2aa3-4358-aecf-4946b5adf474 None None] hyperv.wait_soft_reboot_seconds = 60 {{(pid=74613) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 17:47:09 user nova-compute[74613]: DEBUG oslo_service.service [None req-4cf3280a-2aa3-4358-aecf-4946b5adf474 None None] mks.enabled                    = False {{(pid=74613) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 17:47:09 user nova-compute[74613]: DEBUG oslo_service.service [None req-4cf3280a-2aa3-4358-aecf-4946b5adf474 None None] mks.mksproxy_base_url          = http://127.0.0.1:6090/ {{(pid=74613) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 17:47:09 user nova-compute[74613]: DEBUG oslo_service.service [None req-4cf3280a-2aa3-4358-aecf-4946b5adf474 None None] image_cache.manager_interval   = 2400 {{(pid=74613) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 17:47:09 user nova-compute[74613]: DEBUG oslo_service.service [None req-4cf3280a-2aa3-4358-aecf-4946b5adf474 None None] image_cache.precache_concurrency = 1 {{(pid=74613) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 17:47:09 user nova-compute[74613]: DEBUG oslo_service.service [None req-4cf3280a-2aa3-4358-aecf-4946b5adf474 None None] image_cache.remove_unused_base_images = True {{(pid=74613) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 17:47:09 user nova-compute[74613]: DEBUG oslo_service.service [None req-4cf3280a-2aa3-4358-aecf-4946b5adf474 None None] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=74613) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 17:47:09 user nova-compute[74613]: DEBUG oslo_service.service [None req-4cf3280a-2aa3-4358-aecf-4946b5adf474 None None] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=74613) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 17:47:09 user nova-compute[74613]: DEBUG oslo_service.service [None req-4cf3280a-2aa3-4358-aecf-4946b5adf474 None None] image_cache.subdirectory_name  = _base {{(pid=74613) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 17:47:09 user nova-compute[74613]: DEBUG oslo_service.service [None req-4cf3280a-2aa3-4358-aecf-4946b5adf474 None None] ironic.api_max_retries         = 60 {{(pid=74613) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 17:47:09 user nova-compute[74613]: DEBUG oslo_service.service [None req-4cf3280a-2aa3-4358-aecf-4946b5adf474 None None] ironic.api_retry_interval      = 2 {{(pid=74613) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 17:47:09 user nova-compute[74613]: DEBUG oslo_service.service [None req-4cf3280a-2aa3-4358-aecf-4946b5adf474 None None] ironic.auth_section            = None {{(pid=74613) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 17:47:09 user nova-compute[74613]: DEBUG oslo_service.service [None req-4cf3280a-2aa3-4358-aecf-4946b5adf474 None None] ironic.auth_type               = None {{(pid=74613) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 17:47:09 user nova-compute[74613]: DEBUG oslo_service.service [None req-4cf3280a-2aa3-4358-aecf-4946b5adf474 None None] ironic.cafile                  = None {{(pid=74613) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 17:47:09 user nova-compute[74613]: DEBUG oslo_service.service [None req-4cf3280a-2aa3-4358-aecf-4946b5adf474 None None] ironic.certfile                = None {{(pid=74613) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 17:47:09 user nova-compute[74613]: DEBUG oslo_service.service [None req-4cf3280a-2aa3-4358-aecf-4946b5adf474 None None] ironic.collect_timing          = False {{(pid=74613) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 17:47:09 user nova-compute[74613]: DEBUG oslo_service.service [None req-4cf3280a-2aa3-4358-aecf-4946b5adf474 None None] ironic.conductor_group         = None {{(pid=74613) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 17:47:09 user nova-compute[74613]: DEBUG oslo_service.service [None req-4cf3280a-2aa3-4358-aecf-4946b5adf474 None None] ironic.connect_retries         = None {{(pid=74613) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 17:47:09 user nova-compute[74613]: DEBUG oslo_service.service [None req-4cf3280a-2aa3-4358-aecf-4946b5adf474 None None] ironic.connect_retry_delay     = None {{(pid=74613) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 17:47:09 user nova-compute[74613]: DEBUG oslo_service.service [None req-4cf3280a-2aa3-4358-aecf-4946b5adf474 None None] ironic.endpoint_override       = None {{(pid=74613) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 17:47:09 user nova-compute[74613]: DEBUG oslo_service.service [None req-4cf3280a-2aa3-4358-aecf-4946b5adf474 None None] ironic.insecure                = False {{(pid=74613) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 17:47:09 user nova-compute[74613]: DEBUG oslo_service.service [None req-4cf3280a-2aa3-4358-aecf-4946b5adf474 None None] ironic.keyfile                 = None {{(pid=74613) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 17:47:09 user nova-compute[74613]: DEBUG oslo_service.service [None req-4cf3280a-2aa3-4358-aecf-4946b5adf474 None None] ironic.max_version             = None {{(pid=74613) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 17:47:09 user nova-compute[74613]: DEBUG oslo_service.service [None req-4cf3280a-2aa3-4358-aecf-4946b5adf474 None None] ironic.min_version             = None {{(pid=74613) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 17:47:09 user nova-compute[74613]: DEBUG oslo_service.service [None req-4cf3280a-2aa3-4358-aecf-4946b5adf474 None None] ironic.peer_list               = [] {{(pid=74613) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 17:47:09 user nova-compute[74613]: DEBUG oslo_service.service [None req-4cf3280a-2aa3-4358-aecf-4946b5adf474 None None] ironic.region_name             = None {{(pid=74613) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 17:47:09 user nova-compute[74613]: DEBUG oslo_service.service [None req-4cf3280a-2aa3-4358-aecf-4946b5adf474 None None] ironic.serial_console_state_timeout = 10 {{(pid=74613) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 17:47:09 user nova-compute[74613]: DEBUG oslo_service.service [None req-4cf3280a-2aa3-4358-aecf-4946b5adf474 None None] ironic.service_name            = None {{(pid=74613) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 17:47:09 user nova-compute[74613]: DEBUG oslo_service.service [None req-4cf3280a-2aa3-4358-aecf-4946b5adf474 None None] ironic.service_type            = baremetal {{(pid=74613) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 17:47:09 user nova-compute[74613]: DEBUG oslo_service.service [None req-4cf3280a-2aa3-4358-aecf-4946b5adf474 None None] ironic.split_loggers           = False {{(pid=74613) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 17:47:09 user nova-compute[74613]: DEBUG oslo_service.service [None req-4cf3280a-2aa3-4358-aecf-4946b5adf474 None None] ironic.status_code_retries     = None {{(pid=74613) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 17:47:09 user nova-compute[74613]: DEBUG oslo_service.service [None req-4cf3280a-2aa3-4358-aecf-4946b5adf474 None None] ironic.status_code_retry_delay = None {{(pid=74613) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 17:47:09 user nova-compute[74613]: DEBUG oslo_service.service [None req-4cf3280a-2aa3-4358-aecf-4946b5adf474 None None] ironic.timeout                 = None {{(pid=74613) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 17:47:09 user nova-compute[74613]: DEBUG oslo_service.service [None req-4cf3280a-2aa3-4358-aecf-4946b5adf474 None None] ironic.valid_interfaces        = ['internal', 'public'] {{(pid=74613) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 17:47:09 user nova-compute[74613]: DEBUG oslo_service.service [None req-4cf3280a-2aa3-4358-aecf-4946b5adf474 None None] ironic.version                 = None {{(pid=74613) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 17:47:09 user nova-compute[74613]: DEBUG oslo_service.service [None req-4cf3280a-2aa3-4358-aecf-4946b5adf474 None None] key_manager.backend            = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=74613) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 17:47:09 user nova-compute[74613]: DEBUG oslo_service.service [None req-4cf3280a-2aa3-4358-aecf-4946b5adf474 None None] key_manager.fixed_key          = **** {{(pid=74613) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 17:47:09 user nova-compute[74613]: DEBUG oslo_service.service [None req-4cf3280a-2aa3-4358-aecf-4946b5adf474 None None] barbican.auth_endpoint         = http://localhost/identity/v3 {{(pid=74613) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 17:47:09 user nova-compute[74613]: DEBUG oslo_service.service [None req-4cf3280a-2aa3-4358-aecf-4946b5adf474 None None] barbican.barbican_api_version  = None {{(pid=74613) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 17:47:09 user nova-compute[74613]: DEBUG oslo_service.service [None req-4cf3280a-2aa3-4358-aecf-4946b5adf474 None None] barbican.barbican_endpoint     = None {{(pid=74613) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 17:47:09 user nova-compute[74613]: DEBUG oslo_service.service [None req-4cf3280a-2aa3-4358-aecf-4946b5adf474 None None] barbican.barbican_endpoint_type = public {{(pid=74613) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 17:47:09 user nova-compute[74613]: DEBUG oslo_service.service [None req-4cf3280a-2aa3-4358-aecf-4946b5adf474 None None] barbican.barbican_region_name  = None {{(pid=74613) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 17:47:09 user nova-compute[74613]: DEBUG oslo_service.service [None req-4cf3280a-2aa3-4358-aecf-4946b5adf474 None None] barbican.cafile                = None {{(pid=74613) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 17:47:10 user nova-compute[74613]: DEBUG oslo_service.service [None req-4cf3280a-2aa3-4358-aecf-4946b5adf474 None None] barbican.certfile              = None {{(pid=74613) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 17:47:10 user nova-compute[74613]: DEBUG oslo_service.service [None req-4cf3280a-2aa3-4358-aecf-4946b5adf474 None None] barbican.collect_timing        = False {{(pid=74613) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 17:47:10 user nova-compute[74613]: DEBUG oslo_service.service [None req-4cf3280a-2aa3-4358-aecf-4946b5adf474 None None] barbican.insecure              = False {{(pid=74613) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 17:47:10 user nova-compute[74613]: DEBUG oslo_service.service [None req-4cf3280a-2aa3-4358-aecf-4946b5adf474 None None] barbican.keyfile               = None {{(pid=74613) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 17:47:10 user nova-compute[74613]: DEBUG oslo_service.service [None req-4cf3280a-2aa3-4358-aecf-4946b5adf474 None None] barbican.number_of_retries     = 60 {{(pid=74613) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 17:47:10 user nova-compute[74613]: DEBUG oslo_service.service [None req-4cf3280a-2aa3-4358-aecf-4946b5adf474 None None] barbican.retry_delay           = 1 {{(pid=74613) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 17:47:10 user nova-compute[74613]: DEBUG oslo_service.service [None req-4cf3280a-2aa3-4358-aecf-4946b5adf474 None None] barbican.send_service_user_token = False {{(pid=74613) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 17:47:10 user nova-compute[74613]: DEBUG oslo_service.service [None req-4cf3280a-2aa3-4358-aecf-4946b5adf474 None None] barbican.split_loggers         = False {{(pid=74613) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 17:47:10 user nova-compute[74613]: DEBUG oslo_service.service [None req-4cf3280a-2aa3-4358-aecf-4946b5adf474 None None] barbican.timeout               = None {{(pid=74613) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 17:47:10 user nova-compute[74613]: DEBUG oslo_service.service [None req-4cf3280a-2aa3-4358-aecf-4946b5adf474 None None] barbican.verify_ssl            = True {{(pid=74613) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 17:47:10 user nova-compute[74613]: DEBUG oslo_service.service [None req-4cf3280a-2aa3-4358-aecf-4946b5adf474 None None] barbican.verify_ssl_path       = None {{(pid=74613) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 17:47:10 user nova-compute[74613]: DEBUG oslo_service.service [None req-4cf3280a-2aa3-4358-aecf-4946b5adf474 None None] barbican_service_user.auth_section = None {{(pid=74613) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 17:47:10 user nova-compute[74613]: DEBUG oslo_service.service [None req-4cf3280a-2aa3-4358-aecf-4946b5adf474 None None] barbican_service_user.auth_type = None {{(pid=74613) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 17:47:10 user nova-compute[74613]: DEBUG oslo_service.service [None req-4cf3280a-2aa3-4358-aecf-4946b5adf474 None None] barbican_service_user.cafile   = None {{(pid=74613) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 17:47:10 user nova-compute[74613]: DEBUG oslo_service.service [None req-4cf3280a-2aa3-4358-aecf-4946b5adf474 None None] barbican_service_user.certfile = None {{(pid=74613) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 17:47:10 user nova-compute[74613]: DEBUG oslo_service.service [None req-4cf3280a-2aa3-4358-aecf-4946b5adf474 None None] barbican_service_user.collect_timing = False {{(pid=74613) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 17:47:10 user nova-compute[74613]: DEBUG oslo_service.service [None req-4cf3280a-2aa3-4358-aecf-4946b5adf474 None None] barbican_service_user.insecure = False {{(pid=74613) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 17:47:10 user nova-compute[74613]: DEBUG oslo_service.service [None req-4cf3280a-2aa3-4358-aecf-4946b5adf474 None None] barbican_service_user.keyfile  = None {{(pid=74613) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 17:47:10 user nova-compute[74613]: DEBUG oslo_service.service [None req-4cf3280a-2aa3-4358-aecf-4946b5adf474 None None] barbican_service_user.split_loggers = False {{(pid=74613) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 17:47:10 user nova-compute[74613]: DEBUG oslo_service.service [None req-4cf3280a-2aa3-4358-aecf-4946b5adf474 None None] barbican_service_user.timeout  = None {{(pid=74613) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 17:47:10 user nova-compute[74613]: DEBUG oslo_service.service [None req-4cf3280a-2aa3-4358-aecf-4946b5adf474 None None] vault.approle_role_id          = None {{(pid=74613) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 17:47:10 user nova-compute[74613]: DEBUG oslo_service.service [None req-4cf3280a-2aa3-4358-aecf-4946b5adf474 None None] vault.approle_secret_id        = None {{(pid=74613) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 17:47:10 user nova-compute[74613]: DEBUG oslo_service.service [None req-4cf3280a-2aa3-4358-aecf-4946b5adf474 None None] vault.cafile                   = None {{(pid=74613) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 17:47:10 user nova-compute[74613]: DEBUG oslo_service.service [None req-4cf3280a-2aa3-4358-aecf-4946b5adf474 None None] vault.certfile                 = None {{(pid=74613) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 17:47:10 user nova-compute[74613]: DEBUG oslo_service.service [None req-4cf3280a-2aa3-4358-aecf-4946b5adf474 None None] vault.collect_timing           = False {{(pid=74613) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 17:47:10 user nova-compute[74613]: DEBUG oslo_service.service [None req-4cf3280a-2aa3-4358-aecf-4946b5adf474 None None] vault.insecure                 = False {{(pid=74613) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 17:47:10 user nova-compute[74613]: DEBUG oslo_service.service [None req-4cf3280a-2aa3-4358-aecf-4946b5adf474 None None] vault.keyfile                  = None {{(pid=74613) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 17:47:10 user nova-compute[74613]: DEBUG oslo_service.service [None req-4cf3280a-2aa3-4358-aecf-4946b5adf474 None None] vault.kv_mountpoint            = secret {{(pid=74613) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 17:47:10 user nova-compute[74613]: DEBUG oslo_service.service [None req-4cf3280a-2aa3-4358-aecf-4946b5adf474 None None] vault.kv_path                  = None {{(pid=74613) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 17:47:10 user nova-compute[74613]: DEBUG oslo_service.service [None req-4cf3280a-2aa3-4358-aecf-4946b5adf474 None None] vault.kv_version               = 2 {{(pid=74613) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 17:47:10 user nova-compute[74613]: DEBUG oslo_service.service [None req-4cf3280a-2aa3-4358-aecf-4946b5adf474 None None] vault.namespace                = None {{(pid=74613) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 17:47:10 user nova-compute[74613]: DEBUG oslo_service.service [None req-4cf3280a-2aa3-4358-aecf-4946b5adf474 None None] vault.root_token_id            = None {{(pid=74613) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 17:47:10 user nova-compute[74613]: DEBUG oslo_service.service [None req-4cf3280a-2aa3-4358-aecf-4946b5adf474 None None] vault.split_loggers            = False {{(pid=74613) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 17:47:10 user nova-compute[74613]: DEBUG oslo_service.service [None req-4cf3280a-2aa3-4358-aecf-4946b5adf474 None None] vault.ssl_ca_crt_file          = None {{(pid=74613) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 17:47:10 user nova-compute[74613]: DEBUG oslo_service.service [None req-4cf3280a-2aa3-4358-aecf-4946b5adf474 None None] vault.timeout                  = None {{(pid=74613) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 17:47:10 user nova-compute[74613]: DEBUG oslo_service.service [None req-4cf3280a-2aa3-4358-aecf-4946b5adf474 None None] vault.use_ssl                  = False {{(pid=74613) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 17:47:10 user nova-compute[74613]: DEBUG oslo_service.service [None req-4cf3280a-2aa3-4358-aecf-4946b5adf474 None None] vault.vault_url                = http://127.0.0.1:8200 {{(pid=74613) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 17:47:10 user nova-compute[74613]: DEBUG oslo_service.service [None req-4cf3280a-2aa3-4358-aecf-4946b5adf474 None None] keystone.auth_section          = None {{(pid=74613) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 17:47:10 user nova-compute[74613]: DEBUG oslo_service.service [None req-4cf3280a-2aa3-4358-aecf-4946b5adf474 None None] keystone.auth_type             = None {{(pid=74613) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 17:47:10 user nova-compute[74613]: DEBUG oslo_service.service [None req-4cf3280a-2aa3-4358-aecf-4946b5adf474 None None] keystone.cafile                = None {{(pid=74613) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 17:47:10 user nova-compute[74613]: DEBUG oslo_service.service [None req-4cf3280a-2aa3-4358-aecf-4946b5adf474 None None] keystone.certfile              = None {{(pid=74613) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 17:47:10 user nova-compute[74613]: DEBUG oslo_service.service [None req-4cf3280a-2aa3-4358-aecf-4946b5adf474 None None] keystone.collect_timing        = False {{(pid=74613) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 17:47:10 user nova-compute[74613]: DEBUG oslo_service.service [None req-4cf3280a-2aa3-4358-aecf-4946b5adf474 None None] keystone.connect_retries       = None {{(pid=74613) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 17:47:10 user nova-compute[74613]: DEBUG oslo_service.service [None req-4cf3280a-2aa3-4358-aecf-4946b5adf474 None None] keystone.connect_retry_delay   = None {{(pid=74613) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 17:47:10 user nova-compute[74613]: DEBUG oslo_service.service [None req-4cf3280a-2aa3-4358-aecf-4946b5adf474 None None] keystone.endpoint_override     = None {{(pid=74613) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 17:47:10 user nova-compute[74613]: DEBUG oslo_service.service [None req-4cf3280a-2aa3-4358-aecf-4946b5adf474 None None] keystone.insecure              = False {{(pid=74613) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 17:47:10 user nova-compute[74613]: DEBUG oslo_service.service [None req-4cf3280a-2aa3-4358-aecf-4946b5adf474 None None] keystone.keyfile               = None {{(pid=74613) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 17:47:10 user nova-compute[74613]: DEBUG oslo_service.service [None req-4cf3280a-2aa3-4358-aecf-4946b5adf474 None None] keystone.max_version           = None {{(pid=74613) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 17:47:10 user nova-compute[74613]: DEBUG oslo_service.service [None req-4cf3280a-2aa3-4358-aecf-4946b5adf474 None None] keystone.min_version           = None {{(pid=74613) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 17:47:10 user nova-compute[74613]: DEBUG oslo_service.service [None req-4cf3280a-2aa3-4358-aecf-4946b5adf474 None None] keystone.region_name           = None {{(pid=74613) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 17:47:10 user nova-compute[74613]: DEBUG oslo_service.service [None req-4cf3280a-2aa3-4358-aecf-4946b5adf474 None None] keystone.service_name          = None {{(pid=74613) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 17:47:10 user nova-compute[74613]: DEBUG oslo_service.service [None req-4cf3280a-2aa3-4358-aecf-4946b5adf474 None None] keystone.service_type          = identity {{(pid=74613) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 17:47:10 user nova-compute[74613]: DEBUG oslo_service.service [None req-4cf3280a-2aa3-4358-aecf-4946b5adf474 None None] keystone.split_loggers         = False {{(pid=74613) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 17:47:10 user nova-compute[74613]: DEBUG oslo_service.service [None req-4cf3280a-2aa3-4358-aecf-4946b5adf474 None None] keystone.status_code_retries   = None {{(pid=74613) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 17:47:10 user nova-compute[74613]: DEBUG oslo_service.service [None req-4cf3280a-2aa3-4358-aecf-4946b5adf474 None None] keystone.status_code_retry_delay = None {{(pid=74613) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 17:47:10 user nova-compute[74613]: DEBUG oslo_service.service [None req-4cf3280a-2aa3-4358-aecf-4946b5adf474 None None] keystone.timeout               = None {{(pid=74613) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 17:47:10 user nova-compute[74613]: DEBUG oslo_service.service [None req-4cf3280a-2aa3-4358-aecf-4946b5adf474 None None] keystone.valid_interfaces      = ['internal', 'public'] {{(pid=74613) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 17:47:10 user nova-compute[74613]: DEBUG oslo_service.service [None req-4cf3280a-2aa3-4358-aecf-4946b5adf474 None None] keystone.version               = None {{(pid=74613) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 17:47:10 user nova-compute[74613]: DEBUG oslo_service.service [None req-4cf3280a-2aa3-4358-aecf-4946b5adf474 None None] libvirt.connection_uri         =  {{(pid=74613) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 17:47:10 user nova-compute[74613]: DEBUG oslo_service.service [None req-4cf3280a-2aa3-4358-aecf-4946b5adf474 None None] libvirt.cpu_mode               = custom {{(pid=74613) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 17:47:10 user nova-compute[74613]: DEBUG oslo_service.service [None req-4cf3280a-2aa3-4358-aecf-4946b5adf474 None None] libvirt.cpu_model_extra_flags  = [] {{(pid=74613) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 17:47:10 user nova-compute[74613]: WARNING oslo_config.cfg [None req-4cf3280a-2aa3-4358-aecf-4946b5adf474 None None] Deprecated: Option "cpu_model" from group "libvirt" is deprecated. Use option "cpu_models" from group "libvirt".
Nov 29 17:47:10 user nova-compute[74613]: DEBUG oslo_service.service [None req-4cf3280a-2aa3-4358-aecf-4946b5adf474 None None] libvirt.cpu_models             = ['Nehalem'] {{(pid=74613) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 17:47:10 user nova-compute[74613]: DEBUG oslo_service.service [None req-4cf3280a-2aa3-4358-aecf-4946b5adf474 None None] libvirt.cpu_power_governor_high = performance {{(pid=74613) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 17:47:10 user nova-compute[74613]: DEBUG oslo_service.service [None req-4cf3280a-2aa3-4358-aecf-4946b5adf474 None None] libvirt.cpu_power_governor_low = powersave {{(pid=74613) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 17:47:10 user nova-compute[74613]: DEBUG oslo_service.service [None req-4cf3280a-2aa3-4358-aecf-4946b5adf474 None None] libvirt.cpu_power_management   = False {{(pid=74613) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 17:47:10 user nova-compute[74613]: DEBUG oslo_service.service [None req-4cf3280a-2aa3-4358-aecf-4946b5adf474 None None] libvirt.cpu_power_management_strategy = cpu_state {{(pid=74613) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 17:47:10 user nova-compute[74613]: DEBUG oslo_service.service [None req-4cf3280a-2aa3-4358-aecf-4946b5adf474 None None] libvirt.device_detach_attempts = 8 {{(pid=74613) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 17:47:10 user nova-compute[74613]: DEBUG oslo_service.service [None req-4cf3280a-2aa3-4358-aecf-4946b5adf474 None None] libvirt.device_detach_timeout  = 20 {{(pid=74613) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 17:47:10 user nova-compute[74613]: DEBUG oslo_service.service [None req-4cf3280a-2aa3-4358-aecf-4946b5adf474 None None] libvirt.disk_cachemodes        = [] {{(pid=74613) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 17:47:10 user nova-compute[74613]: DEBUG oslo_service.service [None req-4cf3280a-2aa3-4358-aecf-4946b5adf474 None None] libvirt.disk_prefix            = None {{(pid=74613) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 17:47:10 user nova-compute[74613]: DEBUG oslo_service.service [None req-4cf3280a-2aa3-4358-aecf-4946b5adf474 None None] libvirt.enabled_perf_events    = [] {{(pid=74613) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 17:47:10 user nova-compute[74613]: DEBUG oslo_service.service [None req-4cf3280a-2aa3-4358-aecf-4946b5adf474 None None] libvirt.file_backed_memory     = 0 {{(pid=74613) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 17:47:10 user nova-compute[74613]: DEBUG oslo_service.service [None req-4cf3280a-2aa3-4358-aecf-4946b5adf474 None None] libvirt.gid_maps               = [] {{(pid=74613) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 17:47:10 user nova-compute[74613]: DEBUG oslo_service.service [None req-4cf3280a-2aa3-4358-aecf-4946b5adf474 None None] libvirt.hw_disk_discard        = None {{(pid=74613) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 17:47:10 user nova-compute[74613]: DEBUG oslo_service.service [None req-4cf3280a-2aa3-4358-aecf-4946b5adf474 None None] libvirt.hw_machine_type        = None {{(pid=74613) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 17:47:10 user nova-compute[74613]: DEBUG oslo_service.service [None req-4cf3280a-2aa3-4358-aecf-4946b5adf474 None None] libvirt.images_rbd_ceph_conf   =  {{(pid=74613) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 17:47:10 user nova-compute[74613]: DEBUG oslo_service.service [None req-4cf3280a-2aa3-4358-aecf-4946b5adf474 None None] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=74613) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 17:47:10 user nova-compute[74613]: DEBUG oslo_service.service [None req-4cf3280a-2aa3-4358-aecf-4946b5adf474 None None] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=74613) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 17:47:10 user nova-compute[74613]: DEBUG oslo_service.service [None req-4cf3280a-2aa3-4358-aecf-4946b5adf474 None None] libvirt.images_rbd_glance_store_name =  {{(pid=74613) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 17:47:10 user nova-compute[74613]: DEBUG oslo_service.service [None req-4cf3280a-2aa3-4358-aecf-4946b5adf474 None None] libvirt.images_rbd_pool        = rbd {{(pid=74613) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 17:47:10 user nova-compute[74613]: DEBUG oslo_service.service [None req-4cf3280a-2aa3-4358-aecf-4946b5adf474 None None] libvirt.images_type            = default {{(pid=74613) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 17:47:10 user nova-compute[74613]: DEBUG oslo_service.service [None req-4cf3280a-2aa3-4358-aecf-4946b5adf474 None None] libvirt.images_volume_group    = None {{(pid=74613) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 17:47:10 user nova-compute[74613]: DEBUG oslo_service.service [None req-4cf3280a-2aa3-4358-aecf-4946b5adf474 None None] libvirt.inject_key             = False {{(pid=74613) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 17:47:10 user nova-compute[74613]: DEBUG oslo_service.service [None req-4cf3280a-2aa3-4358-aecf-4946b5adf474 None None] libvirt.inject_partition       = -2 {{(pid=74613) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 17:47:10 user nova-compute[74613]: DEBUG oslo_service.service [None req-4cf3280a-2aa3-4358-aecf-4946b5adf474 None None] libvirt.inject_password        = False {{(pid=74613) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 17:47:10 user nova-compute[74613]: DEBUG oslo_service.service [None req-4cf3280a-2aa3-4358-aecf-4946b5adf474 None None] libvirt.iscsi_iface            = None {{(pid=74613) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 17:47:10 user nova-compute[74613]: DEBUG oslo_service.service [None req-4cf3280a-2aa3-4358-aecf-4946b5adf474 None None] libvirt.iser_use_multipath     = False {{(pid=74613) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 17:47:10 user nova-compute[74613]: DEBUG oslo_service.service [None req-4cf3280a-2aa3-4358-aecf-4946b5adf474 None None] libvirt.live_migration_bandwidth = 0 {{(pid=74613) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 17:47:10 user nova-compute[74613]: DEBUG oslo_service.service [None req-4cf3280a-2aa3-4358-aecf-4946b5adf474 None None] libvirt.live_migration_completion_timeout = 800 {{(pid=74613) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 17:47:10 user nova-compute[74613]: DEBUG oslo_service.service [None req-4cf3280a-2aa3-4358-aecf-4946b5adf474 None None] libvirt.live_migration_downtime = 500 {{(pid=74613) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 17:47:10 user nova-compute[74613]: DEBUG oslo_service.service [None req-4cf3280a-2aa3-4358-aecf-4946b5adf474 None None] libvirt.live_migration_downtime_delay = 75 {{(pid=74613) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 17:47:10 user nova-compute[74613]: DEBUG oslo_service.service [None req-4cf3280a-2aa3-4358-aecf-4946b5adf474 None None] libvirt.live_migration_downtime_steps = 10 {{(pid=74613) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 17:47:10 user nova-compute[74613]: DEBUG oslo_service.service [None req-4cf3280a-2aa3-4358-aecf-4946b5adf474 None None] libvirt.live_migration_inbound_addr = None {{(pid=74613) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 17:47:10 user nova-compute[74613]: DEBUG oslo_service.service [None req-4cf3280a-2aa3-4358-aecf-4946b5adf474 None None] libvirt.live_migration_permit_auto_converge = False {{(pid=74613) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 17:47:10 user nova-compute[74613]: DEBUG oslo_service.service [None req-4cf3280a-2aa3-4358-aecf-4946b5adf474 None None] libvirt.live_migration_permit_post_copy = False {{(pid=74613) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 17:47:10 user nova-compute[74613]: DEBUG oslo_service.service [None req-4cf3280a-2aa3-4358-aecf-4946b5adf474 None None] libvirt.live_migration_scheme  = None {{(pid=74613) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 17:47:10 user nova-compute[74613]: DEBUG oslo_service.service [None req-4cf3280a-2aa3-4358-aecf-4946b5adf474 None None] libvirt.live_migration_timeout_action = abort {{(pid=74613) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 17:47:10 user nova-compute[74613]: DEBUG oslo_service.service [None req-4cf3280a-2aa3-4358-aecf-4946b5adf474 None None] libvirt.live_migration_tunnelled = False {{(pid=74613) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 17:47:10 user nova-compute[74613]: WARNING oslo_config.cfg [None req-4cf3280a-2aa3-4358-aecf-4946b5adf474 None None] Deprecated: Option "live_migration_uri" from group "libvirt" is deprecated for removal (
Nov 29 17:47:10 user nova-compute[74613]: live_migration_uri is deprecated for removal in favor of two other options that
Nov 29 17:47:10 user nova-compute[74613]: allow to change live migration scheme and target URI: ``live_migration_scheme``
Nov 29 17:47:10 user nova-compute[74613]: and ``live_migration_inbound_addr`` respectively.
Nov 29 17:47:10 user nova-compute[74613]: ).  Its value may be silently ignored in the future.
Nov 29 17:47:10 user nova-compute[74613]: DEBUG oslo_service.service [None req-4cf3280a-2aa3-4358-aecf-4946b5adf474 None None] libvirt.live_migration_uri     = qemu+ssh://stack@%s/system {{(pid=74613) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 17:47:10 user nova-compute[74613]: DEBUG oslo_service.service [None req-4cf3280a-2aa3-4358-aecf-4946b5adf474 None None] libvirt.live_migration_with_native_tls = False {{(pid=74613) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 17:47:10 user nova-compute[74613]: DEBUG oslo_service.service [None req-4cf3280a-2aa3-4358-aecf-4946b5adf474 None None] libvirt.max_queues             = None {{(pid=74613) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 17:47:10 user nova-compute[74613]: DEBUG oslo_service.service [None req-4cf3280a-2aa3-4358-aecf-4946b5adf474 None None] libvirt.mem_stats_period_seconds = 10 {{(pid=74613) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 17:47:10 user nova-compute[74613]: DEBUG oslo_service.service [None req-4cf3280a-2aa3-4358-aecf-4946b5adf474 None None] libvirt.nfs_mount_options      = None {{(pid=74613) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 17:47:10 user nova-compute[74613]: DEBUG oslo_service.service [None req-4cf3280a-2aa3-4358-aecf-4946b5adf474 None None] libvirt.nfs_mount_point_base   = /opt/stack/data/nova/mnt {{(pid=74613) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 17:47:10 user nova-compute[74613]: DEBUG oslo_service.service [None req-4cf3280a-2aa3-4358-aecf-4946b5adf474 None None] libvirt.num_aoe_discover_tries = 3 {{(pid=74613) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 17:47:10 user nova-compute[74613]: DEBUG oslo_service.service [None req-4cf3280a-2aa3-4358-aecf-4946b5adf474 None None] libvirt.num_iser_scan_tries    = 5 {{(pid=74613) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 17:47:10 user nova-compute[74613]: DEBUG oslo_service.service [None req-4cf3280a-2aa3-4358-aecf-4946b5adf474 None None] libvirt.num_memory_encrypted_guests = None {{(pid=74613) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 17:47:10 user nova-compute[74613]: DEBUG oslo_service.service [None req-4cf3280a-2aa3-4358-aecf-4946b5adf474 None None] libvirt.num_nvme_discover_tries = 5 {{(pid=74613) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 17:47:10 user nova-compute[74613]: DEBUG oslo_service.service [None req-4cf3280a-2aa3-4358-aecf-4946b5adf474 None None] libvirt.num_pcie_ports         = 0 {{(pid=74613) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 17:47:10 user nova-compute[74613]: DEBUG oslo_service.service [None req-4cf3280a-2aa3-4358-aecf-4946b5adf474 None None] libvirt.num_volume_scan_tries  = 5 {{(pid=74613) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 17:47:10 user nova-compute[74613]: DEBUG oslo_service.service [None req-4cf3280a-2aa3-4358-aecf-4946b5adf474 None None] libvirt.pmem_namespaces        = [] {{(pid=74613) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 17:47:10 user nova-compute[74613]: DEBUG oslo_service.service [None req-4cf3280a-2aa3-4358-aecf-4946b5adf474 None None] libvirt.quobyte_client_cfg     = None {{(pid=74613) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 17:47:10 user nova-compute[74613]: DEBUG oslo_service.service [None req-4cf3280a-2aa3-4358-aecf-4946b5adf474 None None] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=74613) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 17:47:10 user nova-compute[74613]: DEBUG oslo_service.service [None req-4cf3280a-2aa3-4358-aecf-4946b5adf474 None None] libvirt.rbd_connect_timeout    = 5 {{(pid=74613) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 17:47:10 user nova-compute[74613]: DEBUG oslo_service.service [None req-4cf3280a-2aa3-4358-aecf-4946b5adf474 None None] libvirt.rbd_destroy_volume_retries = 12 {{(pid=74613) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 17:47:10 user nova-compute[74613]: DEBUG oslo_service.service [None req-4cf3280a-2aa3-4358-aecf-4946b5adf474 None None] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=74613) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 17:47:10 user nova-compute[74613]: DEBUG oslo_service.service [None req-4cf3280a-2aa3-4358-aecf-4946b5adf474 None None] libvirt.rbd_secret_uuid        = None {{(pid=74613) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 17:47:10 user nova-compute[74613]: DEBUG oslo_service.service [None req-4cf3280a-2aa3-4358-aecf-4946b5adf474 None None] libvirt.rbd_user               = None {{(pid=74613) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 17:47:10 user nova-compute[74613]: DEBUG oslo_service.service [None req-4cf3280a-2aa3-4358-aecf-4946b5adf474 None None] libvirt.realtime_scheduler_priority = 1 {{(pid=74613) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 17:47:10 user nova-compute[74613]: DEBUG oslo_service.service [None req-4cf3280a-2aa3-4358-aecf-4946b5adf474 None None] libvirt.remote_filesystem_transport = ssh {{(pid=74613) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 17:47:10 user nova-compute[74613]: DEBUG oslo_service.service [None req-4cf3280a-2aa3-4358-aecf-4946b5adf474 None None] libvirt.rescue_image_id        = None {{(pid=74613) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 17:47:10 user nova-compute[74613]: DEBUG oslo_service.service [None req-4cf3280a-2aa3-4358-aecf-4946b5adf474 None None] libvirt.rescue_kernel_id       = None {{(pid=74613) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 17:47:10 user nova-compute[74613]: DEBUG oslo_service.service [None req-4cf3280a-2aa3-4358-aecf-4946b5adf474 None None] libvirt.rescue_ramdisk_id      = None {{(pid=74613) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 17:47:10 user nova-compute[74613]: DEBUG oslo_service.service [None req-4cf3280a-2aa3-4358-aecf-4946b5adf474 None None] libvirt.rng_dev_path           = /dev/urandom {{(pid=74613) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 17:47:10 user nova-compute[74613]: DEBUG oslo_service.service [None req-4cf3280a-2aa3-4358-aecf-4946b5adf474 None None] libvirt.rx_queue_size          = None {{(pid=74613) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 17:47:10 user nova-compute[74613]: DEBUG oslo_service.service [None req-4cf3280a-2aa3-4358-aecf-4946b5adf474 None None] libvirt.smbfs_mount_options    =  {{(pid=74613) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 17:47:10 user nova-compute[74613]: DEBUG oslo_service.service [None req-4cf3280a-2aa3-4358-aecf-4946b5adf474 None None] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=74613) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 17:47:10 user nova-compute[74613]: DEBUG oslo_service.service [None req-4cf3280a-2aa3-4358-aecf-4946b5adf474 None None] libvirt.snapshot_compression   = False {{(pid=74613) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 17:47:10 user nova-compute[74613]: DEBUG oslo_service.service [None req-4cf3280a-2aa3-4358-aecf-4946b5adf474 None None] libvirt.snapshot_image_format  = None {{(pid=74613) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 17:47:10 user nova-compute[74613]: DEBUG oslo_service.service [None req-4cf3280a-2aa3-4358-aecf-4946b5adf474 None None] libvirt.snapshots_directory    = /opt/stack/data/nova/instances/snapshots {{(pid=74613) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 17:47:10 user nova-compute[74613]: DEBUG oslo_service.service [None req-4cf3280a-2aa3-4358-aecf-4946b5adf474 None None] libvirt.sparse_logical_volumes = False {{(pid=74613) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 17:47:10 user nova-compute[74613]: DEBUG oslo_service.service [None req-4cf3280a-2aa3-4358-aecf-4946b5adf474 None None] libvirt.swtpm_enabled          = False {{(pid=74613) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 17:47:10 user nova-compute[74613]: DEBUG oslo_service.service [None req-4cf3280a-2aa3-4358-aecf-4946b5adf474 None None] libvirt.swtpm_group            = tss {{(pid=74613) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 17:47:10 user nova-compute[74613]: DEBUG oslo_service.service [None req-4cf3280a-2aa3-4358-aecf-4946b5adf474 None None] libvirt.swtpm_user             = tss {{(pid=74613) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 17:47:10 user nova-compute[74613]: DEBUG oslo_service.service [None req-4cf3280a-2aa3-4358-aecf-4946b5adf474 None None] libvirt.sysinfo_serial         = unique {{(pid=74613) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 17:47:10 user nova-compute[74613]: DEBUG oslo_service.service [None req-4cf3280a-2aa3-4358-aecf-4946b5adf474 None None] libvirt.tb_cache_size          = None {{(pid=74613) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 17:47:10 user nova-compute[74613]: DEBUG oslo_service.service [None req-4cf3280a-2aa3-4358-aecf-4946b5adf474 None None] libvirt.tx_queue_size          = None {{(pid=74613) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 17:47:10 user nova-compute[74613]: DEBUG oslo_service.service [None req-4cf3280a-2aa3-4358-aecf-4946b5adf474 None None] libvirt.uid_maps               = [] {{(pid=74613) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 17:47:10 user nova-compute[74613]: DEBUG oslo_service.service [None req-4cf3280a-2aa3-4358-aecf-4946b5adf474 None None] libvirt.use_virtio_for_bridges = True {{(pid=74613) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 17:47:10 user nova-compute[74613]: DEBUG oslo_service.service [None req-4cf3280a-2aa3-4358-aecf-4946b5adf474 None None] libvirt.virt_type              = kvm {{(pid=74613) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 17:47:10 user nova-compute[74613]: DEBUG oslo_service.service [None req-4cf3280a-2aa3-4358-aecf-4946b5adf474 None None] libvirt.volume_clear           = zero {{(pid=74613) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 17:47:10 user nova-compute[74613]: DEBUG oslo_service.service [None req-4cf3280a-2aa3-4358-aecf-4946b5adf474 None None] libvirt.volume_clear_size      = 0 {{(pid=74613) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 17:47:10 user nova-compute[74613]: DEBUG oslo_service.service [None req-4cf3280a-2aa3-4358-aecf-4946b5adf474 None None] libvirt.volume_use_multipath   = False {{(pid=74613) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 17:47:10 user nova-compute[74613]: DEBUG oslo_service.service [None req-4cf3280a-2aa3-4358-aecf-4946b5adf474 None None] libvirt.vzstorage_cache_path   = None {{(pid=74613) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 17:47:10 user nova-compute[74613]: DEBUG oslo_service.service [None req-4cf3280a-2aa3-4358-aecf-4946b5adf474 None None] libvirt.vzstorage_log_path     = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=74613) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 17:47:10 user nova-compute[74613]: DEBUG oslo_service.service [None req-4cf3280a-2aa3-4358-aecf-4946b5adf474 None None] libvirt.vzstorage_mount_group  = qemu {{(pid=74613) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 17:47:10 user nova-compute[74613]: DEBUG oslo_service.service [None req-4cf3280a-2aa3-4358-aecf-4946b5adf474 None None] libvirt.vzstorage_mount_opts   = [] {{(pid=74613) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 17:47:10 user nova-compute[74613]: DEBUG oslo_service.service [None req-4cf3280a-2aa3-4358-aecf-4946b5adf474 None None] libvirt.vzstorage_mount_perms  = 0770 {{(pid=74613) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 17:47:10 user nova-compute[74613]: DEBUG oslo_service.service [None req-4cf3280a-2aa3-4358-aecf-4946b5adf474 None None] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=74613) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 17:47:10 user nova-compute[74613]: DEBUG oslo_service.service [None req-4cf3280a-2aa3-4358-aecf-4946b5adf474 None None] libvirt.vzstorage_mount_user   = stack {{(pid=74613) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 17:47:10 user nova-compute[74613]: DEBUG oslo_service.service [None req-4cf3280a-2aa3-4358-aecf-4946b5adf474 None None] libvirt.wait_soft_reboot_seconds = 120 {{(pid=74613) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 17:47:10 user nova-compute[74613]: DEBUG oslo_service.service [None req-4cf3280a-2aa3-4358-aecf-4946b5adf474 None None] neutron.auth_section           = None {{(pid=74613) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 17:47:10 user nova-compute[74613]: DEBUG oslo_service.service [None req-4cf3280a-2aa3-4358-aecf-4946b5adf474 None None] neutron.auth_type              = password {{(pid=74613) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 17:47:10 user nova-compute[74613]: DEBUG oslo_service.service [None req-4cf3280a-2aa3-4358-aecf-4946b5adf474 None None] neutron.cafile                 = None {{(pid=74613) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 17:47:10 user nova-compute[74613]: DEBUG oslo_service.service [None req-4cf3280a-2aa3-4358-aecf-4946b5adf474 None None] neutron.certfile               = None {{(pid=74613) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 17:47:10 user nova-compute[74613]: DEBUG oslo_service.service [None req-4cf3280a-2aa3-4358-aecf-4946b5adf474 None None] neutron.collect_timing         = False {{(pid=74613) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 17:47:10 user nova-compute[74613]: DEBUG oslo_service.service [None req-4cf3280a-2aa3-4358-aecf-4946b5adf474 None None] neutron.connect_retries        = None {{(pid=74613) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 17:47:10 user nova-compute[74613]: DEBUG oslo_service.service [None req-4cf3280a-2aa3-4358-aecf-4946b5adf474 None None] neutron.connect_retry_delay    = None {{(pid=74613) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 17:47:10 user nova-compute[74613]: DEBUG oslo_service.service [None req-4cf3280a-2aa3-4358-aecf-4946b5adf474 None None] neutron.default_floating_pool  = public {{(pid=74613) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 17:47:10 user nova-compute[74613]: DEBUG oslo_service.service [None req-4cf3280a-2aa3-4358-aecf-4946b5adf474 None None] neutron.endpoint_override      = None {{(pid=74613) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 17:47:10 user nova-compute[74613]: DEBUG oslo_service.service [None req-4cf3280a-2aa3-4358-aecf-4946b5adf474 None None] neutron.extension_sync_interval = 600 {{(pid=74613) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 17:47:10 user nova-compute[74613]: DEBUG oslo_service.service [None req-4cf3280a-2aa3-4358-aecf-4946b5adf474 None None] neutron.http_retries           = 3 {{(pid=74613) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 17:47:10 user nova-compute[74613]: DEBUG oslo_service.service [None req-4cf3280a-2aa3-4358-aecf-4946b5adf474 None None] neutron.insecure               = False {{(pid=74613) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 17:47:10 user nova-compute[74613]: DEBUG oslo_service.service [None req-4cf3280a-2aa3-4358-aecf-4946b5adf474 None None] neutron.keyfile                = None {{(pid=74613) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 17:47:10 user nova-compute[74613]: DEBUG oslo_service.service [None req-4cf3280a-2aa3-4358-aecf-4946b5adf474 None None] neutron.max_version            = None {{(pid=74613) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 17:47:10 user nova-compute[74613]: DEBUG oslo_service.service [None req-4cf3280a-2aa3-4358-aecf-4946b5adf474 None None] neutron.metadata_proxy_shared_secret = **** {{(pid=74613) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 17:47:10 user nova-compute[74613]: DEBUG oslo_service.service [None req-4cf3280a-2aa3-4358-aecf-4946b5adf474 None None] neutron.min_version            = None {{(pid=74613) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 17:47:10 user nova-compute[74613]: DEBUG oslo_service.service [None req-4cf3280a-2aa3-4358-aecf-4946b5adf474 None None] neutron.ovs_bridge             = br-int {{(pid=74613) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 17:47:10 user nova-compute[74613]: DEBUG oslo_service.service [None req-4cf3280a-2aa3-4358-aecf-4946b5adf474 None None] neutron.physnets               = [] {{(pid=74613) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 17:47:10 user nova-compute[74613]: DEBUG oslo_service.service [None req-4cf3280a-2aa3-4358-aecf-4946b5adf474 None None] neutron.region_name            = RegionOne {{(pid=74613) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 17:47:10 user nova-compute[74613]: DEBUG oslo_service.service [None req-4cf3280a-2aa3-4358-aecf-4946b5adf474 None None] neutron.service_metadata_proxy = True {{(pid=74613) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 17:47:10 user nova-compute[74613]: DEBUG oslo_service.service [None req-4cf3280a-2aa3-4358-aecf-4946b5adf474 None None] neutron.service_name           = None {{(pid=74613) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 17:47:10 user nova-compute[74613]: DEBUG oslo_service.service [None req-4cf3280a-2aa3-4358-aecf-4946b5adf474 None None] neutron.service_type           = network {{(pid=74613) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 17:47:10 user nova-compute[74613]: DEBUG oslo_service.service [None req-4cf3280a-2aa3-4358-aecf-4946b5adf474 None None] neutron.split_loggers          = False {{(pid=74613) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 17:47:10 user nova-compute[74613]: DEBUG oslo_service.service [None req-4cf3280a-2aa3-4358-aecf-4946b5adf474 None None] neutron.status_code_retries    = None {{(pid=74613) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 17:47:10 user nova-compute[74613]: DEBUG oslo_service.service [None req-4cf3280a-2aa3-4358-aecf-4946b5adf474 None None] neutron.status_code_retry_delay = None {{(pid=74613) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 17:47:10 user nova-compute[74613]: DEBUG oslo_service.service [None req-4cf3280a-2aa3-4358-aecf-4946b5adf474 None None] neutron.timeout                = None {{(pid=74613) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 17:47:10 user nova-compute[74613]: DEBUG oslo_service.service [None req-4cf3280a-2aa3-4358-aecf-4946b5adf474 None None] neutron.valid_interfaces       = ['internal', 'public'] {{(pid=74613) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 17:47:10 user nova-compute[74613]: DEBUG oslo_service.service [None req-4cf3280a-2aa3-4358-aecf-4946b5adf474 None None] neutron.version                = None {{(pid=74613) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 17:47:10 user nova-compute[74613]: DEBUG oslo_service.service [None req-4cf3280a-2aa3-4358-aecf-4946b5adf474 None None] notifications.bdms_in_notifications = False {{(pid=74613) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 17:47:10 user nova-compute[74613]: DEBUG oslo_service.service [None req-4cf3280a-2aa3-4358-aecf-4946b5adf474 None None] notifications.default_level    = INFO {{(pid=74613) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 17:47:10 user nova-compute[74613]: DEBUG oslo_service.service [None req-4cf3280a-2aa3-4358-aecf-4946b5adf474 None None] notifications.notification_format = unversioned {{(pid=74613) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 17:47:10 user nova-compute[74613]: DEBUG oslo_service.service [None req-4cf3280a-2aa3-4358-aecf-4946b5adf474 None None] notifications.notify_on_state_change = None {{(pid=74613) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 17:47:10 user nova-compute[74613]: DEBUG oslo_service.service [None req-4cf3280a-2aa3-4358-aecf-4946b5adf474 None None] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=74613) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 17:47:10 user nova-compute[74613]: DEBUG oslo_service.service [None req-4cf3280a-2aa3-4358-aecf-4946b5adf474 None None] pci.alias                      = [] {{(pid=74613) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 17:47:10 user nova-compute[74613]: DEBUG oslo_service.service [None req-4cf3280a-2aa3-4358-aecf-4946b5adf474 None None] pci.device_spec                = [] {{(pid=74613) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 17:47:10 user nova-compute[74613]: DEBUG oslo_service.service [None req-4cf3280a-2aa3-4358-aecf-4946b5adf474 None None] pci.report_in_placement        = False {{(pid=74613) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 17:47:10 user nova-compute[74613]: DEBUG oslo_service.service [None req-4cf3280a-2aa3-4358-aecf-4946b5adf474 None None] placement.auth_section         = None {{(pid=74613) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 17:47:10 user nova-compute[74613]: DEBUG oslo_service.service [None req-4cf3280a-2aa3-4358-aecf-4946b5adf474 None None] placement.auth_type            = password {{(pid=74613) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 17:47:10 user nova-compute[74613]: DEBUG oslo_service.service [None req-4cf3280a-2aa3-4358-aecf-4946b5adf474 None None] placement.auth_url             = http://10.0.0.210/identity {{(pid=74613) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 17:47:10 user nova-compute[74613]: DEBUG oslo_service.service [None req-4cf3280a-2aa3-4358-aecf-4946b5adf474 None None] placement.cafile               = None {{(pid=74613) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 17:47:10 user nova-compute[74613]: DEBUG oslo_service.service [None req-4cf3280a-2aa3-4358-aecf-4946b5adf474 None None] placement.certfile             = None {{(pid=74613) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 17:47:10 user nova-compute[74613]: DEBUG oslo_service.service [None req-4cf3280a-2aa3-4358-aecf-4946b5adf474 None None] placement.collect_timing       = False {{(pid=74613) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 17:47:10 user nova-compute[74613]: DEBUG oslo_service.service [None req-4cf3280a-2aa3-4358-aecf-4946b5adf474 None None] placement.connect_retries      = None {{(pid=74613) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 17:47:10 user nova-compute[74613]: DEBUG oslo_service.service [None req-4cf3280a-2aa3-4358-aecf-4946b5adf474 None None] placement.connect_retry_delay  = None {{(pid=74613) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 17:47:10 user nova-compute[74613]: DEBUG oslo_service.service [None req-4cf3280a-2aa3-4358-aecf-4946b5adf474 None None] placement.default_domain_id    = None {{(pid=74613) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 17:47:10 user nova-compute[74613]: DEBUG oslo_service.service [None req-4cf3280a-2aa3-4358-aecf-4946b5adf474 None None] placement.default_domain_name  = None {{(pid=74613) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 17:47:10 user nova-compute[74613]: DEBUG oslo_service.service [None req-4cf3280a-2aa3-4358-aecf-4946b5adf474 None None] placement.domain_id            = None {{(pid=74613) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 17:47:10 user nova-compute[74613]: DEBUG oslo_service.service [None req-4cf3280a-2aa3-4358-aecf-4946b5adf474 None None] placement.domain_name          = None {{(pid=74613) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 17:47:10 user nova-compute[74613]: DEBUG oslo_service.service [None req-4cf3280a-2aa3-4358-aecf-4946b5adf474 None None] placement.endpoint_override    = None {{(pid=74613) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 17:47:10 user nova-compute[74613]: DEBUG oslo_service.service [None req-4cf3280a-2aa3-4358-aecf-4946b5adf474 None None] placement.insecure             = False {{(pid=74613) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 17:47:10 user nova-compute[74613]: DEBUG oslo_service.service [None req-4cf3280a-2aa3-4358-aecf-4946b5adf474 None None] placement.keyfile              = None {{(pid=74613) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 17:47:10 user nova-compute[74613]: DEBUG oslo_service.service [None req-4cf3280a-2aa3-4358-aecf-4946b5adf474 None None] placement.max_version          = None {{(pid=74613) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 17:47:10 user nova-compute[74613]: DEBUG oslo_service.service [None req-4cf3280a-2aa3-4358-aecf-4946b5adf474 None None] placement.min_version          = None {{(pid=74613) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 17:47:10 user nova-compute[74613]: DEBUG oslo_service.service [None req-4cf3280a-2aa3-4358-aecf-4946b5adf474 None None] placement.password             = **** {{(pid=74613) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 17:47:10 user nova-compute[74613]: DEBUG oslo_service.service [None req-4cf3280a-2aa3-4358-aecf-4946b5adf474 None None] placement.project_domain_id    = None {{(pid=74613) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 17:47:10 user nova-compute[74613]: DEBUG oslo_service.service [None req-4cf3280a-2aa3-4358-aecf-4946b5adf474 None None] placement.project_domain_name  = Default {{(pid=74613) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 17:47:10 user nova-compute[74613]: DEBUG oslo_service.service [None req-4cf3280a-2aa3-4358-aecf-4946b5adf474 None None] placement.project_id           = None {{(pid=74613) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 17:47:10 user nova-compute[74613]: DEBUG oslo_service.service [None req-4cf3280a-2aa3-4358-aecf-4946b5adf474 None None] placement.project_name         = service {{(pid=74613) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 17:47:10 user nova-compute[74613]: DEBUG oslo_service.service [None req-4cf3280a-2aa3-4358-aecf-4946b5adf474 None None] placement.region_name          = RegionOne {{(pid=74613) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 17:47:10 user nova-compute[74613]: DEBUG oslo_service.service [None req-4cf3280a-2aa3-4358-aecf-4946b5adf474 None None] placement.service_name         = None {{(pid=74613) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 17:47:10 user nova-compute[74613]: DEBUG oslo_service.service [None req-4cf3280a-2aa3-4358-aecf-4946b5adf474 None None] placement.service_type         = placement {{(pid=74613) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 17:47:10 user nova-compute[74613]: DEBUG oslo_service.service [None req-4cf3280a-2aa3-4358-aecf-4946b5adf474 None None] placement.split_loggers        = False {{(pid=74613) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 17:47:10 user nova-compute[74613]: DEBUG oslo_service.service [None req-4cf3280a-2aa3-4358-aecf-4946b5adf474 None None] placement.status_code_retries  = None {{(pid=74613) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 17:47:10 user nova-compute[74613]: DEBUG oslo_service.service [None req-4cf3280a-2aa3-4358-aecf-4946b5adf474 None None] placement.status_code_retry_delay = None {{(pid=74613) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 17:47:10 user nova-compute[74613]: DEBUG oslo_service.service [None req-4cf3280a-2aa3-4358-aecf-4946b5adf474 None None] placement.system_scope         = None {{(pid=74613) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 17:47:10 user nova-compute[74613]: DEBUG oslo_service.service [None req-4cf3280a-2aa3-4358-aecf-4946b5adf474 None None] placement.timeout              = None {{(pid=74613) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 17:47:10 user nova-compute[74613]: DEBUG oslo_service.service [None req-4cf3280a-2aa3-4358-aecf-4946b5adf474 None None] placement.trust_id             = None {{(pid=74613) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 17:47:10 user nova-compute[74613]: DEBUG oslo_service.service [None req-4cf3280a-2aa3-4358-aecf-4946b5adf474 None None] placement.user_domain_id       = None {{(pid=74613) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 17:47:10 user nova-compute[74613]: DEBUG oslo_service.service [None req-4cf3280a-2aa3-4358-aecf-4946b5adf474 None None] placement.user_domain_name     = Default {{(pid=74613) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 17:47:10 user nova-compute[74613]: DEBUG oslo_service.service [None req-4cf3280a-2aa3-4358-aecf-4946b5adf474 None None] placement.user_id              = None {{(pid=74613) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 17:47:10 user nova-compute[74613]: DEBUG oslo_service.service [None req-4cf3280a-2aa3-4358-aecf-4946b5adf474 None None] placement.username             = placement {{(pid=74613) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 17:47:10 user nova-compute[74613]: DEBUG oslo_service.service [None req-4cf3280a-2aa3-4358-aecf-4946b5adf474 None None] placement.valid_interfaces     = ['internal', 'public'] {{(pid=74613) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 17:47:10 user nova-compute[74613]: DEBUG oslo_service.service [None req-4cf3280a-2aa3-4358-aecf-4946b5adf474 None None] placement.version              = None {{(pid=74613) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 17:47:10 user nova-compute[74613]: DEBUG oslo_service.service [None req-4cf3280a-2aa3-4358-aecf-4946b5adf474 None None] quota.cores                    = 20 {{(pid=74613) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 17:47:10 user nova-compute[74613]: DEBUG oslo_service.service [None req-4cf3280a-2aa3-4358-aecf-4946b5adf474 None None] quota.count_usage_from_placement = False {{(pid=74613) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 17:47:10 user nova-compute[74613]: DEBUG oslo_service.service [None req-4cf3280a-2aa3-4358-aecf-4946b5adf474 None None] quota.driver                   = nova.quota.DbQuotaDriver {{(pid=74613) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 17:47:10 user nova-compute[74613]: DEBUG oslo_service.service [None req-4cf3280a-2aa3-4358-aecf-4946b5adf474 None None] quota.injected_file_content_bytes = 10240 {{(pid=74613) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 17:47:10 user nova-compute[74613]: DEBUG oslo_service.service [None req-4cf3280a-2aa3-4358-aecf-4946b5adf474 None None] quota.injected_file_path_length = 255 {{(pid=74613) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 17:47:10 user nova-compute[74613]: DEBUG oslo_service.service [None req-4cf3280a-2aa3-4358-aecf-4946b5adf474 None None] quota.injected_files           = 5 {{(pid=74613) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 17:47:10 user nova-compute[74613]: DEBUG oslo_service.service [None req-4cf3280a-2aa3-4358-aecf-4946b5adf474 None None] quota.instances                = 10 {{(pid=74613) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 17:47:10 user nova-compute[74613]: DEBUG oslo_service.service [None req-4cf3280a-2aa3-4358-aecf-4946b5adf474 None None] quota.key_pairs                = 100 {{(pid=74613) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 17:47:10 user nova-compute[74613]: DEBUG oslo_service.service [None req-4cf3280a-2aa3-4358-aecf-4946b5adf474 None None] quota.metadata_items           = 128 {{(pid=74613) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 17:47:10 user nova-compute[74613]: DEBUG oslo_service.service [None req-4cf3280a-2aa3-4358-aecf-4946b5adf474 None None] quota.ram                      = 51200 {{(pid=74613) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 17:47:10 user nova-compute[74613]: DEBUG oslo_service.service [None req-4cf3280a-2aa3-4358-aecf-4946b5adf474 None None] quota.recheck_quota            = True {{(pid=74613) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 17:47:10 user nova-compute[74613]: DEBUG oslo_service.service [None req-4cf3280a-2aa3-4358-aecf-4946b5adf474 None None] quota.server_group_members     = 10 {{(pid=74613) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 17:47:10 user nova-compute[74613]: DEBUG oslo_service.service [None req-4cf3280a-2aa3-4358-aecf-4946b5adf474 None None] quota.server_groups            = 10 {{(pid=74613) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 17:47:10 user nova-compute[74613]: DEBUG oslo_service.service [None req-4cf3280a-2aa3-4358-aecf-4946b5adf474 None None] rdp.enabled                    = False {{(pid=74613) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 17:47:10 user nova-compute[74613]: DEBUG oslo_service.service [None req-4cf3280a-2aa3-4358-aecf-4946b5adf474 None None] rdp.html5_proxy_base_url       = http://127.0.0.1:6083/ {{(pid=74613) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 17:47:10 user nova-compute[74613]: DEBUG oslo_service.service [None req-4cf3280a-2aa3-4358-aecf-4946b5adf474 None None] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=74613) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 17:47:10 user nova-compute[74613]: DEBUG oslo_service.service [None req-4cf3280a-2aa3-4358-aecf-4946b5adf474 None None] scheduler.enable_isolated_aggregate_filtering = False {{(pid=74613) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 17:47:10 user nova-compute[74613]: DEBUG oslo_service.service [None req-4cf3280a-2aa3-4358-aecf-4946b5adf474 None None] scheduler.image_metadata_prefilter = False {{(pid=74613) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 17:47:10 user nova-compute[74613]: DEBUG oslo_service.service [None req-4cf3280a-2aa3-4358-aecf-4946b5adf474 None None] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=74613) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 17:47:10 user nova-compute[74613]: DEBUG oslo_service.service [None req-4cf3280a-2aa3-4358-aecf-4946b5adf474 None None] scheduler.max_attempts         = 3 {{(pid=74613) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 17:47:10 user nova-compute[74613]: DEBUG oslo_service.service [None req-4cf3280a-2aa3-4358-aecf-4946b5adf474 None None] scheduler.max_placement_results = 1000 {{(pid=74613) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 17:47:10 user nova-compute[74613]: DEBUG oslo_service.service [None req-4cf3280a-2aa3-4358-aecf-4946b5adf474 None None] scheduler.placement_aggregate_required_for_tenants = False {{(pid=74613) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 17:47:10 user nova-compute[74613]: DEBUG oslo_service.service [None req-4cf3280a-2aa3-4358-aecf-4946b5adf474 None None] scheduler.query_placement_for_image_type_support = False {{(pid=74613) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 17:47:10 user nova-compute[74613]: DEBUG oslo_service.service [None req-4cf3280a-2aa3-4358-aecf-4946b5adf474 None None] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=74613) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 17:47:10 user nova-compute[74613]: DEBUG oslo_service.service [None req-4cf3280a-2aa3-4358-aecf-4946b5adf474 None None] scheduler.workers              = 3 {{(pid=74613) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 17:47:10 user nova-compute[74613]: DEBUG oslo_service.service [None req-4cf3280a-2aa3-4358-aecf-4946b5adf474 None None] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=74613) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 17:47:10 user nova-compute[74613]: DEBUG oslo_service.service [None req-4cf3280a-2aa3-4358-aecf-4946b5adf474 None None] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=74613) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 17:47:10 user nova-compute[74613]: DEBUG oslo_service.service [None req-4cf3280a-2aa3-4358-aecf-4946b5adf474 None None] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=74613) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 17:47:10 user nova-compute[74613]: DEBUG oslo_service.service [None req-4cf3280a-2aa3-4358-aecf-4946b5adf474 None None] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=74613) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 17:47:10 user nova-compute[74613]: DEBUG oslo_service.service [None req-4cf3280a-2aa3-4358-aecf-4946b5adf474 None None] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=74613) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 17:47:10 user nova-compute[74613]: DEBUG oslo_service.service [None req-4cf3280a-2aa3-4358-aecf-4946b5adf474 None None] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=74613) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 17:47:10 user nova-compute[74613]: DEBUG oslo_service.service [None req-4cf3280a-2aa3-4358-aecf-4946b5adf474 None None] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=74613) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 17:47:10 user nova-compute[74613]: DEBUG oslo_service.service [None req-4cf3280a-2aa3-4358-aecf-4946b5adf474 None None] filter_scheduler.enabled_filters = ['ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=74613) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 17:47:10 user nova-compute[74613]: DEBUG oslo_service.service [None req-4cf3280a-2aa3-4358-aecf-4946b5adf474 None None] filter_scheduler.host_subset_size = 1 {{(pid=74613) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 17:47:10 user nova-compute[74613]: DEBUG oslo_service.service [None req-4cf3280a-2aa3-4358-aecf-4946b5adf474 None None] filter_scheduler.hypervisor_version_weight_multiplier = 1.0 {{(pid=74613) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 17:47:10 user nova-compute[74613]: DEBUG oslo_service.service [None req-4cf3280a-2aa3-4358-aecf-4946b5adf474 None None] filter_scheduler.image_properties_default_architecture = None {{(pid=74613) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 17:47:10 user nova-compute[74613]: DEBUG oslo_service.service [None req-4cf3280a-2aa3-4358-aecf-4946b5adf474 None None] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=74613) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 17:47:10 user nova-compute[74613]: DEBUG oslo_service.service [None req-4cf3280a-2aa3-4358-aecf-4946b5adf474 None None] filter_scheduler.isolated_hosts = [] {{(pid=74613) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 17:47:10 user nova-compute[74613]: DEBUG oslo_service.service [None req-4cf3280a-2aa3-4358-aecf-4946b5adf474 None None] filter_scheduler.isolated_images = [] {{(pid=74613) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 17:47:10 user nova-compute[74613]: DEBUG oslo_service.service [None req-4cf3280a-2aa3-4358-aecf-4946b5adf474 None None] filter_scheduler.max_instances_per_host = 50 {{(pid=74613) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 17:47:10 user nova-compute[74613]: DEBUG oslo_service.service [None req-4cf3280a-2aa3-4358-aecf-4946b5adf474 None None] filter_scheduler.max_io_ops_per_host = 8 {{(pid=74613) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 17:47:10 user nova-compute[74613]: DEBUG oslo_service.service [None req-4cf3280a-2aa3-4358-aecf-4946b5adf474 None None] filter_scheduler.num_instances_weight_multiplier = 0.0 {{(pid=74613) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 17:47:10 user nova-compute[74613]: DEBUG oslo_service.service [None req-4cf3280a-2aa3-4358-aecf-4946b5adf474 None None] filter_scheduler.pci_in_placement = False {{(pid=74613) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 17:47:10 user nova-compute[74613]: DEBUG oslo_service.service [None req-4cf3280a-2aa3-4358-aecf-4946b5adf474 None None] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=74613) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 17:47:10 user nova-compute[74613]: DEBUG oslo_service.service [None req-4cf3280a-2aa3-4358-aecf-4946b5adf474 None None] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=74613) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 17:47:10 user nova-compute[74613]: DEBUG oslo_service.service [None req-4cf3280a-2aa3-4358-aecf-4946b5adf474 None None] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=74613) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 17:47:10 user nova-compute[74613]: DEBUG oslo_service.service [None req-4cf3280a-2aa3-4358-aecf-4946b5adf474 None None] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=74613) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 17:47:10 user nova-compute[74613]: DEBUG oslo_service.service [None req-4cf3280a-2aa3-4358-aecf-4946b5adf474 None None] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=74613) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 17:47:10 user nova-compute[74613]: DEBUG oslo_service.service [None req-4cf3280a-2aa3-4358-aecf-4946b5adf474 None None] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=74613) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 17:47:10 user nova-compute[74613]: DEBUG oslo_service.service [None req-4cf3280a-2aa3-4358-aecf-4946b5adf474 None None] filter_scheduler.track_instance_changes = False {{(pid=74613) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 17:47:10 user nova-compute[74613]: DEBUG oslo_service.service [None req-4cf3280a-2aa3-4358-aecf-4946b5adf474 None None] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=74613) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 17:47:10 user nova-compute[74613]: DEBUG oslo_service.service [None req-4cf3280a-2aa3-4358-aecf-4946b5adf474 None None] metrics.required               = True {{(pid=74613) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 17:47:10 user nova-compute[74613]: DEBUG oslo_service.service [None req-4cf3280a-2aa3-4358-aecf-4946b5adf474 None None] metrics.weight_multiplier      = 1.0 {{(pid=74613) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 17:47:10 user nova-compute[74613]: DEBUG oslo_service.service [None req-4cf3280a-2aa3-4358-aecf-4946b5adf474 None None] metrics.weight_of_unavailable  = -10000.0 {{(pid=74613) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 17:47:10 user nova-compute[74613]: DEBUG oslo_service.service [None req-4cf3280a-2aa3-4358-aecf-4946b5adf474 None None] metrics.weight_setting         = [] {{(pid=74613) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 17:47:10 user nova-compute[74613]: DEBUG oslo_service.service [None req-4cf3280a-2aa3-4358-aecf-4946b5adf474 None None] serial_console.base_url        = ws://127.0.0.1:6083/ {{(pid=74613) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 17:47:10 user nova-compute[74613]: DEBUG oslo_service.service [None req-4cf3280a-2aa3-4358-aecf-4946b5adf474 None None] serial_console.enabled         = False {{(pid=74613) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 17:47:10 user nova-compute[74613]: DEBUG oslo_service.service [None req-4cf3280a-2aa3-4358-aecf-4946b5adf474 None None] serial_console.port_range      = 10000:20000 {{(pid=74613) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 17:47:10 user nova-compute[74613]: DEBUG oslo_service.service [None req-4cf3280a-2aa3-4358-aecf-4946b5adf474 None None] serial_console.proxyclient_address = 127.0.0.1 {{(pid=74613) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 17:47:10 user nova-compute[74613]: DEBUG oslo_service.service [None req-4cf3280a-2aa3-4358-aecf-4946b5adf474 None None] serial_console.serialproxy_host = 0.0.0.0 {{(pid=74613) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 17:47:10 user nova-compute[74613]: DEBUG oslo_service.service [None req-4cf3280a-2aa3-4358-aecf-4946b5adf474 None None] serial_console.serialproxy_port = 6083 {{(pid=74613) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 17:47:10 user nova-compute[74613]: DEBUG oslo_service.service [None req-4cf3280a-2aa3-4358-aecf-4946b5adf474 None None] service_user.auth_section      = None {{(pid=74613) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 17:47:10 user nova-compute[74613]: DEBUG oslo_service.service [None req-4cf3280a-2aa3-4358-aecf-4946b5adf474 None None] service_user.auth_type         = password {{(pid=74613) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 17:47:10 user nova-compute[74613]: DEBUG oslo_service.service [None req-4cf3280a-2aa3-4358-aecf-4946b5adf474 None None] service_user.cafile            = None {{(pid=74613) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 17:47:10 user nova-compute[74613]: DEBUG oslo_service.service [None req-4cf3280a-2aa3-4358-aecf-4946b5adf474 None None] service_user.certfile          = None {{(pid=74613) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 17:47:10 user nova-compute[74613]: DEBUG oslo_service.service [None req-4cf3280a-2aa3-4358-aecf-4946b5adf474 None None] service_user.collect_timing    = False {{(pid=74613) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 17:47:10 user nova-compute[74613]: DEBUG oslo_service.service [None req-4cf3280a-2aa3-4358-aecf-4946b5adf474 None None] service_user.insecure          = False {{(pid=74613) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 17:47:10 user nova-compute[74613]: DEBUG oslo_service.service [None req-4cf3280a-2aa3-4358-aecf-4946b5adf474 None None] service_user.keyfile           = None {{(pid=74613) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 17:47:10 user nova-compute[74613]: DEBUG oslo_service.service [None req-4cf3280a-2aa3-4358-aecf-4946b5adf474 None None] service_user.send_service_user_token = True {{(pid=74613) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 17:47:10 user nova-compute[74613]: DEBUG oslo_service.service [None req-4cf3280a-2aa3-4358-aecf-4946b5adf474 None None] service_user.split_loggers     = False {{(pid=74613) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 17:47:10 user nova-compute[74613]: DEBUG oslo_service.service [None req-4cf3280a-2aa3-4358-aecf-4946b5adf474 None None] service_user.timeout           = None {{(pid=74613) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 17:47:10 user nova-compute[74613]: DEBUG oslo_service.service [None req-4cf3280a-2aa3-4358-aecf-4946b5adf474 None None] spice.agent_enabled            = True {{(pid=74613) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 17:47:10 user nova-compute[74613]: DEBUG oslo_service.service [None req-4cf3280a-2aa3-4358-aecf-4946b5adf474 None None] spice.enabled                  = False {{(pid=74613) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 17:47:10 user nova-compute[74613]: DEBUG oslo_service.service [None req-4cf3280a-2aa3-4358-aecf-4946b5adf474 None None] spice.html5proxy_base_url      = http://10.0.0.210:6081/spice_auto.html {{(pid=74613) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 17:47:10 user nova-compute[74613]: DEBUG oslo_service.service [None req-4cf3280a-2aa3-4358-aecf-4946b5adf474 None None] spice.html5proxy_host          = 0.0.0.0 {{(pid=74613) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 17:47:10 user nova-compute[74613]: DEBUG oslo_service.service [None req-4cf3280a-2aa3-4358-aecf-4946b5adf474 None None] spice.html5proxy_port          = 6082 {{(pid=74613) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 17:47:10 user nova-compute[74613]: DEBUG oslo_service.service [None req-4cf3280a-2aa3-4358-aecf-4946b5adf474 None None] spice.image_compression        = None {{(pid=74613) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 17:47:10 user nova-compute[74613]: DEBUG oslo_service.service [None req-4cf3280a-2aa3-4358-aecf-4946b5adf474 None None] spice.jpeg_compression         = None {{(pid=74613) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 17:47:10 user nova-compute[74613]: DEBUG oslo_service.service [None req-4cf3280a-2aa3-4358-aecf-4946b5adf474 None None] spice.playback_compression     = None {{(pid=74613) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 17:47:10 user nova-compute[74613]: DEBUG oslo_service.service [None req-4cf3280a-2aa3-4358-aecf-4946b5adf474 None None] spice.server_listen            = 127.0.0.1 {{(pid=74613) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 17:47:10 user nova-compute[74613]: DEBUG oslo_service.service [None req-4cf3280a-2aa3-4358-aecf-4946b5adf474 None None] spice.server_proxyclient_address = 127.0.0.1 {{(pid=74613) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 17:47:10 user nova-compute[74613]: DEBUG oslo_service.service [None req-4cf3280a-2aa3-4358-aecf-4946b5adf474 None None] spice.streaming_mode           = None {{(pid=74613) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 17:47:10 user nova-compute[74613]: DEBUG oslo_service.service [None req-4cf3280a-2aa3-4358-aecf-4946b5adf474 None None] spice.zlib_compression         = None {{(pid=74613) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 17:47:10 user nova-compute[74613]: DEBUG oslo_service.service [None req-4cf3280a-2aa3-4358-aecf-4946b5adf474 None None] upgrade_levels.baseapi         = None {{(pid=74613) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 17:47:10 user nova-compute[74613]: DEBUG oslo_service.service [None req-4cf3280a-2aa3-4358-aecf-4946b5adf474 None None] upgrade_levels.compute         = auto {{(pid=74613) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 17:47:10 user nova-compute[74613]: DEBUG oslo_service.service [None req-4cf3280a-2aa3-4358-aecf-4946b5adf474 None None] upgrade_levels.conductor       = None {{(pid=74613) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 17:47:10 user nova-compute[74613]: DEBUG oslo_service.service [None req-4cf3280a-2aa3-4358-aecf-4946b5adf474 None None] upgrade_levels.scheduler       = None {{(pid=74613) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 17:47:10 user nova-compute[74613]: DEBUG oslo_service.service [None req-4cf3280a-2aa3-4358-aecf-4946b5adf474 None None] vendordata_dynamic_auth.auth_section = None {{(pid=74613) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 17:47:10 user nova-compute[74613]: DEBUG oslo_service.service [None req-4cf3280a-2aa3-4358-aecf-4946b5adf474 None None] vendordata_dynamic_auth.auth_type = None {{(pid=74613) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 17:47:10 user nova-compute[74613]: DEBUG oslo_service.service [None req-4cf3280a-2aa3-4358-aecf-4946b5adf474 None None] vendordata_dynamic_auth.cafile = None {{(pid=74613) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 17:47:10 user nova-compute[74613]: DEBUG oslo_service.service [None req-4cf3280a-2aa3-4358-aecf-4946b5adf474 None None] vendordata_dynamic_auth.certfile = None {{(pid=74613) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 17:47:10 user nova-compute[74613]: DEBUG oslo_service.service [None req-4cf3280a-2aa3-4358-aecf-4946b5adf474 None None] vendordata_dynamic_auth.collect_timing = False {{(pid=74613) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 17:47:10 user nova-compute[74613]: DEBUG oslo_service.service [None req-4cf3280a-2aa3-4358-aecf-4946b5adf474 None None] vendordata_dynamic_auth.insecure = False {{(pid=74613) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 17:47:10 user nova-compute[74613]: DEBUG oslo_service.service [None req-4cf3280a-2aa3-4358-aecf-4946b5adf474 None None] vendordata_dynamic_auth.keyfile = None {{(pid=74613) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 17:47:10 user nova-compute[74613]: DEBUG oslo_service.service [None req-4cf3280a-2aa3-4358-aecf-4946b5adf474 None None] vendordata_dynamic_auth.split_loggers = False {{(pid=74613) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 17:47:10 user nova-compute[74613]: DEBUG oslo_service.service [None req-4cf3280a-2aa3-4358-aecf-4946b5adf474 None None] vendordata_dynamic_auth.timeout = None {{(pid=74613) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 17:47:10 user nova-compute[74613]: DEBUG oslo_service.service [None req-4cf3280a-2aa3-4358-aecf-4946b5adf474 None None] vmware.api_retry_count         = 10 {{(pid=74613) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 17:47:10 user nova-compute[74613]: DEBUG oslo_service.service [None req-4cf3280a-2aa3-4358-aecf-4946b5adf474 None None] vmware.ca_file                 = None {{(pid=74613) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 17:47:10 user nova-compute[74613]: DEBUG oslo_service.service [None req-4cf3280a-2aa3-4358-aecf-4946b5adf474 None None] vmware.cache_prefix            = None {{(pid=74613) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 17:47:10 user nova-compute[74613]: DEBUG oslo_service.service [None req-4cf3280a-2aa3-4358-aecf-4946b5adf474 None None] vmware.cluster_name            = None {{(pid=74613) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 17:47:10 user nova-compute[74613]: DEBUG oslo_service.service [None req-4cf3280a-2aa3-4358-aecf-4946b5adf474 None None] vmware.connection_pool_size    = 10 {{(pid=74613) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 17:47:10 user nova-compute[74613]: DEBUG oslo_service.service [None req-4cf3280a-2aa3-4358-aecf-4946b5adf474 None None] vmware.console_delay_seconds   = None {{(pid=74613) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 17:47:10 user nova-compute[74613]: DEBUG oslo_service.service [None req-4cf3280a-2aa3-4358-aecf-4946b5adf474 None None] vmware.datastore_regex         = None {{(pid=74613) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 17:47:10 user nova-compute[74613]: DEBUG oslo_service.service [None req-4cf3280a-2aa3-4358-aecf-4946b5adf474 None None] vmware.host_ip                 = None {{(pid=74613) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 17:47:10 user nova-compute[74613]: DEBUG oslo_service.service [None req-4cf3280a-2aa3-4358-aecf-4946b5adf474 None None] vmware.host_password           = **** {{(pid=74613) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 17:47:10 user nova-compute[74613]: DEBUG oslo_service.service [None req-4cf3280a-2aa3-4358-aecf-4946b5adf474 None None] vmware.host_port               = 443 {{(pid=74613) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 17:47:10 user nova-compute[74613]: DEBUG oslo_service.service [None req-4cf3280a-2aa3-4358-aecf-4946b5adf474 None None] vmware.host_username           = None {{(pid=74613) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 17:47:10 user nova-compute[74613]: DEBUG oslo_service.service [None req-4cf3280a-2aa3-4358-aecf-4946b5adf474 None None] vmware.insecure                = False {{(pid=74613) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 17:47:10 user nova-compute[74613]: DEBUG oslo_service.service [None req-4cf3280a-2aa3-4358-aecf-4946b5adf474 None None] vmware.integration_bridge      = None {{(pid=74613) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 17:47:10 user nova-compute[74613]: DEBUG oslo_service.service [None req-4cf3280a-2aa3-4358-aecf-4946b5adf474 None None] vmware.maximum_objects         = 100 {{(pid=74613) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 17:47:10 user nova-compute[74613]: DEBUG oslo_service.service [None req-4cf3280a-2aa3-4358-aecf-4946b5adf474 None None] vmware.pbm_default_policy      = None {{(pid=74613) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 17:47:10 user nova-compute[74613]: DEBUG oslo_service.service [None req-4cf3280a-2aa3-4358-aecf-4946b5adf474 None None] vmware.pbm_enabled             = False {{(pid=74613) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 17:47:10 user nova-compute[74613]: DEBUG oslo_service.service [None req-4cf3280a-2aa3-4358-aecf-4946b5adf474 None None] vmware.pbm_wsdl_location       = None {{(pid=74613) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 17:47:10 user nova-compute[74613]: DEBUG oslo_service.service [None req-4cf3280a-2aa3-4358-aecf-4946b5adf474 None None] vmware.serial_log_dir          = /opt/vmware/vspc {{(pid=74613) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 17:47:10 user nova-compute[74613]: DEBUG oslo_service.service [None req-4cf3280a-2aa3-4358-aecf-4946b5adf474 None None] vmware.serial_port_proxy_uri   = None {{(pid=74613) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 17:47:10 user nova-compute[74613]: DEBUG oslo_service.service [None req-4cf3280a-2aa3-4358-aecf-4946b5adf474 None None] vmware.serial_port_service_uri = None {{(pid=74613) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 17:47:10 user nova-compute[74613]: DEBUG oslo_service.service [None req-4cf3280a-2aa3-4358-aecf-4946b5adf474 None None] vmware.task_poll_interval      = 0.5 {{(pid=74613) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 17:47:10 user nova-compute[74613]: DEBUG oslo_service.service [None req-4cf3280a-2aa3-4358-aecf-4946b5adf474 None None] vmware.use_linked_clone        = True {{(pid=74613) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 17:47:10 user nova-compute[74613]: DEBUG oslo_service.service [None req-4cf3280a-2aa3-4358-aecf-4946b5adf474 None None] vmware.vnc_keymap              = en-us {{(pid=74613) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 17:47:10 user nova-compute[74613]: DEBUG oslo_service.service [None req-4cf3280a-2aa3-4358-aecf-4946b5adf474 None None] vmware.vnc_port                = 5900 {{(pid=74613) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 17:47:10 user nova-compute[74613]: DEBUG oslo_service.service [None req-4cf3280a-2aa3-4358-aecf-4946b5adf474 None None] vmware.vnc_port_total          = 10000 {{(pid=74613) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 17:47:10 user nova-compute[74613]: DEBUG oslo_service.service [None req-4cf3280a-2aa3-4358-aecf-4946b5adf474 None None] vnc.auth_schemes               = ['none'] {{(pid=74613) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 17:47:10 user nova-compute[74613]: DEBUG oslo_service.service [None req-4cf3280a-2aa3-4358-aecf-4946b5adf474 None None] vnc.enabled                    = True {{(pid=74613) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 17:47:10 user nova-compute[74613]: DEBUG oslo_service.service [None req-4cf3280a-2aa3-4358-aecf-4946b5adf474 None None] vnc.novncproxy_base_url        = http://10.0.0.210:6080/vnc_lite.html {{(pid=74613) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 17:47:10 user nova-compute[74613]: DEBUG oslo_service.service [None req-4cf3280a-2aa3-4358-aecf-4946b5adf474 None None] vnc.novncproxy_host            = 0.0.0.0 {{(pid=74613) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 17:47:10 user nova-compute[74613]: DEBUG oslo_service.service [None req-4cf3280a-2aa3-4358-aecf-4946b5adf474 None None] vnc.novncproxy_port            = 6080 {{(pid=74613) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 17:47:10 user nova-compute[74613]: DEBUG oslo_service.service [None req-4cf3280a-2aa3-4358-aecf-4946b5adf474 None None] vnc.server_listen              = 0.0.0.0 {{(pid=74613) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 17:47:10 user nova-compute[74613]: DEBUG oslo_service.service [None req-4cf3280a-2aa3-4358-aecf-4946b5adf474 None None] vnc.server_proxyclient_address = 10.0.0.210 {{(pid=74613) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 17:47:10 user nova-compute[74613]: DEBUG oslo_service.service [None req-4cf3280a-2aa3-4358-aecf-4946b5adf474 None None] vnc.vencrypt_ca_certs          = None {{(pid=74613) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 17:47:10 user nova-compute[74613]: DEBUG oslo_service.service [None req-4cf3280a-2aa3-4358-aecf-4946b5adf474 None None] vnc.vencrypt_client_cert       = None {{(pid=74613) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 17:47:10 user nova-compute[74613]: DEBUG oslo_service.service [None req-4cf3280a-2aa3-4358-aecf-4946b5adf474 None None] vnc.vencrypt_client_key        = None {{(pid=74613) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 17:47:10 user nova-compute[74613]: DEBUG oslo_service.service [None req-4cf3280a-2aa3-4358-aecf-4946b5adf474 None None] workarounds.disable_compute_service_check_for_ffu = False {{(pid=74613) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 17:47:10 user nova-compute[74613]: DEBUG oslo_service.service [None req-4cf3280a-2aa3-4358-aecf-4946b5adf474 None None] workarounds.disable_fallback_pcpu_query = False {{(pid=74613) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 17:47:10 user nova-compute[74613]: DEBUG oslo_service.service [None req-4cf3280a-2aa3-4358-aecf-4946b5adf474 None None] workarounds.disable_group_policy_check_upcall = True {{(pid=74613) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 17:47:10 user nova-compute[74613]: DEBUG oslo_service.service [None req-4cf3280a-2aa3-4358-aecf-4946b5adf474 None None] workarounds.disable_libvirt_livesnapshot = False {{(pid=74613) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 17:47:10 user nova-compute[74613]: DEBUG oslo_service.service [None req-4cf3280a-2aa3-4358-aecf-4946b5adf474 None None] workarounds.disable_rootwrap   = False {{(pid=74613) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 17:47:10 user nova-compute[74613]: DEBUG oslo_service.service [None req-4cf3280a-2aa3-4358-aecf-4946b5adf474 None None] workarounds.enable_numa_live_migration = False {{(pid=74613) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 17:47:10 user nova-compute[74613]: DEBUG oslo_service.service [None req-4cf3280a-2aa3-4358-aecf-4946b5adf474 None None] workarounds.enable_qemu_monitor_announce_self = False {{(pid=74613) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 17:47:10 user nova-compute[74613]: DEBUG oslo_service.service [None req-4cf3280a-2aa3-4358-aecf-4946b5adf474 None None] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=74613) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 17:47:10 user nova-compute[74613]: DEBUG oslo_service.service [None req-4cf3280a-2aa3-4358-aecf-4946b5adf474 None None] workarounds.handle_virt_lifecycle_events = True {{(pid=74613) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 17:47:10 user nova-compute[74613]: DEBUG oslo_service.service [None req-4cf3280a-2aa3-4358-aecf-4946b5adf474 None None] workarounds.libvirt_disable_apic = False {{(pid=74613) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 17:47:10 user nova-compute[74613]: DEBUG oslo_service.service [None req-4cf3280a-2aa3-4358-aecf-4946b5adf474 None None] workarounds.never_download_image_if_on_rbd = False {{(pid=74613) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 17:47:10 user nova-compute[74613]: DEBUG oslo_service.service [None req-4cf3280a-2aa3-4358-aecf-4946b5adf474 None None] workarounds.qemu_monitor_announce_self_count = 3 {{(pid=74613) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 17:47:10 user nova-compute[74613]: DEBUG oslo_service.service [None req-4cf3280a-2aa3-4358-aecf-4946b5adf474 None None] workarounds.qemu_monitor_announce_self_interval = 1 {{(pid=74613) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 17:47:10 user nova-compute[74613]: DEBUG oslo_service.service [None req-4cf3280a-2aa3-4358-aecf-4946b5adf474 None None] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=74613) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 17:47:10 user nova-compute[74613]: DEBUG oslo_service.service [None req-4cf3280a-2aa3-4358-aecf-4946b5adf474 None None] workarounds.skip_cpu_compare_at_startup = False {{(pid=74613) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 17:47:10 user nova-compute[74613]: DEBUG oslo_service.service [None req-4cf3280a-2aa3-4358-aecf-4946b5adf474 None None] workarounds.skip_cpu_compare_on_dest = False {{(pid=74613) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 17:47:10 user nova-compute[74613]: DEBUG oslo_service.service [None req-4cf3280a-2aa3-4358-aecf-4946b5adf474 None None] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=74613) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 17:47:10 user nova-compute[74613]: DEBUG oslo_service.service [None req-4cf3280a-2aa3-4358-aecf-4946b5adf474 None None] workarounds.skip_reserve_in_use_ironic_nodes = False {{(pid=74613) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 17:47:10 user nova-compute[74613]: DEBUG oslo_service.service [None req-4cf3280a-2aa3-4358-aecf-4946b5adf474 None None] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=74613) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 17:47:10 user nova-compute[74613]: DEBUG oslo_service.service [None req-4cf3280a-2aa3-4358-aecf-4946b5adf474 None None] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=74613) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 17:47:10 user nova-compute[74613]: DEBUG oslo_service.service [None req-4cf3280a-2aa3-4358-aecf-4946b5adf474 None None] wsgi.api_paste_config          = /etc/nova/api-paste.ini {{(pid=74613) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 17:47:10 user nova-compute[74613]: DEBUG oslo_service.service [None req-4cf3280a-2aa3-4358-aecf-4946b5adf474 None None] wsgi.client_socket_timeout     = 900 {{(pid=74613) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 17:47:10 user nova-compute[74613]: DEBUG oslo_service.service [None req-4cf3280a-2aa3-4358-aecf-4946b5adf474 None None] wsgi.default_pool_size         = 1000 {{(pid=74613) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 17:47:10 user nova-compute[74613]: DEBUG oslo_service.service [None req-4cf3280a-2aa3-4358-aecf-4946b5adf474 None None] wsgi.keep_alive                = True {{(pid=74613) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 17:47:10 user nova-compute[74613]: DEBUG oslo_service.service [None req-4cf3280a-2aa3-4358-aecf-4946b5adf474 None None] wsgi.max_header_line           = 16384 {{(pid=74613) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 17:47:10 user nova-compute[74613]: DEBUG oslo_service.service [None req-4cf3280a-2aa3-4358-aecf-4946b5adf474 None None] wsgi.secure_proxy_ssl_header   = None {{(pid=74613) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 17:47:10 user nova-compute[74613]: DEBUG oslo_service.service [None req-4cf3280a-2aa3-4358-aecf-4946b5adf474 None None] wsgi.ssl_ca_file               = None {{(pid=74613) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 17:47:10 user nova-compute[74613]: DEBUG oslo_service.service [None req-4cf3280a-2aa3-4358-aecf-4946b5adf474 None None] wsgi.ssl_cert_file             = None {{(pid=74613) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 17:47:10 user nova-compute[74613]: DEBUG oslo_service.service [None req-4cf3280a-2aa3-4358-aecf-4946b5adf474 None None] wsgi.ssl_key_file              = None {{(pid=74613) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 17:47:10 user nova-compute[74613]: DEBUG oslo_service.service [None req-4cf3280a-2aa3-4358-aecf-4946b5adf474 None None] wsgi.tcp_keepidle              = 600 {{(pid=74613) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 17:47:10 user nova-compute[74613]: DEBUG oslo_service.service [None req-4cf3280a-2aa3-4358-aecf-4946b5adf474 None None] wsgi.wsgi_log_format           = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=74613) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 17:47:10 user nova-compute[74613]: DEBUG oslo_service.service [None req-4cf3280a-2aa3-4358-aecf-4946b5adf474 None None] zvm.ca_file                    = None {{(pid=74613) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 17:47:10 user nova-compute[74613]: DEBUG oslo_service.service [None req-4cf3280a-2aa3-4358-aecf-4946b5adf474 None None] zvm.cloud_connector_url        = None {{(pid=74613) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 17:47:10 user nova-compute[74613]: DEBUG oslo_service.service [None req-4cf3280a-2aa3-4358-aecf-4946b5adf474 None None] zvm.image_tmp_path             = /opt/stack/data/nova/images {{(pid=74613) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 17:47:10 user nova-compute[74613]: DEBUG oslo_service.service [None req-4cf3280a-2aa3-4358-aecf-4946b5adf474 None None] zvm.reachable_timeout          = 300 {{(pid=74613) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 17:47:10 user nova-compute[74613]: DEBUG oslo_service.service [None req-4cf3280a-2aa3-4358-aecf-4946b5adf474 None None] oslo_policy.enforce_new_defaults = True {{(pid=74613) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 17:47:10 user nova-compute[74613]: DEBUG oslo_service.service [None req-4cf3280a-2aa3-4358-aecf-4946b5adf474 None None] oslo_policy.enforce_scope      = True {{(pid=74613) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 17:47:10 user nova-compute[74613]: DEBUG oslo_service.service [None req-4cf3280a-2aa3-4358-aecf-4946b5adf474 None None] oslo_policy.policy_default_rule = default {{(pid=74613) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 17:47:10 user nova-compute[74613]: DEBUG oslo_service.service [None req-4cf3280a-2aa3-4358-aecf-4946b5adf474 None None] oslo_policy.policy_dirs        = ['policy.d'] {{(pid=74613) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 17:47:10 user nova-compute[74613]: DEBUG oslo_service.service [None req-4cf3280a-2aa3-4358-aecf-4946b5adf474 None None] oslo_policy.policy_file        = policy.yaml {{(pid=74613) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 17:47:10 user nova-compute[74613]: DEBUG oslo_service.service [None req-4cf3280a-2aa3-4358-aecf-4946b5adf474 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=74613) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 17:47:10 user nova-compute[74613]: DEBUG oslo_service.service [None req-4cf3280a-2aa3-4358-aecf-4946b5adf474 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=74613) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 17:47:10 user nova-compute[74613]: DEBUG oslo_service.service [None req-4cf3280a-2aa3-4358-aecf-4946b5adf474 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=74613) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 17:47:10 user nova-compute[74613]: DEBUG oslo_service.service [None req-4cf3280a-2aa3-4358-aecf-4946b5adf474 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=74613) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 17:47:10 user nova-compute[74613]: DEBUG oslo_service.service [None req-4cf3280a-2aa3-4358-aecf-4946b5adf474 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=74613) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 17:47:10 user nova-compute[74613]: DEBUG oslo_service.service [None req-4cf3280a-2aa3-4358-aecf-4946b5adf474 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=74613) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 17:47:10 user nova-compute[74613]: DEBUG oslo_service.service [None req-4cf3280a-2aa3-4358-aecf-4946b5adf474 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=74613) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 17:47:10 user nova-compute[74613]: DEBUG oslo_service.service [None req-4cf3280a-2aa3-4358-aecf-4946b5adf474 None None] profiler.connection_string     = messaging:// {{(pid=74613) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 17:47:10 user nova-compute[74613]: DEBUG oslo_service.service [None req-4cf3280a-2aa3-4358-aecf-4946b5adf474 None None] profiler.enabled               = False {{(pid=74613) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 17:47:10 user nova-compute[74613]: DEBUG oslo_service.service [None req-4cf3280a-2aa3-4358-aecf-4946b5adf474 None None] profiler.es_doc_type           = notification {{(pid=74613) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 17:47:10 user nova-compute[74613]: DEBUG oslo_service.service [None req-4cf3280a-2aa3-4358-aecf-4946b5adf474 None None] profiler.es_scroll_size        = 10000 {{(pid=74613) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 17:47:10 user nova-compute[74613]: DEBUG oslo_service.service [None req-4cf3280a-2aa3-4358-aecf-4946b5adf474 None None] profiler.es_scroll_time        = 2m {{(pid=74613) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 17:47:10 user nova-compute[74613]: DEBUG oslo_service.service [None req-4cf3280a-2aa3-4358-aecf-4946b5adf474 None None] profiler.filter_error_trace    = False {{(pid=74613) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 17:47:10 user nova-compute[74613]: DEBUG oslo_service.service [None req-4cf3280a-2aa3-4358-aecf-4946b5adf474 None None] profiler.hmac_keys             = **** {{(pid=74613) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 17:47:10 user nova-compute[74613]: DEBUG oslo_service.service [None req-4cf3280a-2aa3-4358-aecf-4946b5adf474 None None] profiler.sentinel_service_name = mymaster {{(pid=74613) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 17:47:10 user nova-compute[74613]: DEBUG oslo_service.service [None req-4cf3280a-2aa3-4358-aecf-4946b5adf474 None None] profiler.socket_timeout        = 0.1 {{(pid=74613) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 17:47:10 user nova-compute[74613]: DEBUG oslo_service.service [None req-4cf3280a-2aa3-4358-aecf-4946b5adf474 None None] profiler.trace_requests        = False {{(pid=74613) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 17:47:10 user nova-compute[74613]: DEBUG oslo_service.service [None req-4cf3280a-2aa3-4358-aecf-4946b5adf474 None None] profiler.trace_sqlalchemy      = False {{(pid=74613) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 17:47:10 user nova-compute[74613]: DEBUG oslo_service.service [None req-4cf3280a-2aa3-4358-aecf-4946b5adf474 None None] profiler_jaeger.process_tags   = {} {{(pid=74613) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 17:47:10 user nova-compute[74613]: DEBUG oslo_service.service [None req-4cf3280a-2aa3-4358-aecf-4946b5adf474 None None] profiler_jaeger.service_name_prefix = None {{(pid=74613) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 17:47:10 user nova-compute[74613]: DEBUG oslo_service.service [None req-4cf3280a-2aa3-4358-aecf-4946b5adf474 None None] profiler_otlp.service_name_prefix = None {{(pid=74613) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 17:47:10 user nova-compute[74613]: DEBUG oslo_service.service [None req-4cf3280a-2aa3-4358-aecf-4946b5adf474 None None] remote_debug.host              = None {{(pid=74613) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 17:47:10 user nova-compute[74613]: DEBUG oslo_service.service [None req-4cf3280a-2aa3-4358-aecf-4946b5adf474 None None] remote_debug.port              = None {{(pid=74613) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 17:47:10 user nova-compute[74613]: DEBUG oslo_service.service [None req-4cf3280a-2aa3-4358-aecf-4946b5adf474 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=74613) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 17:47:10 user nova-compute[74613]: DEBUG oslo_service.service [None req-4cf3280a-2aa3-4358-aecf-4946b5adf474 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=74613) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 17:47:10 user nova-compute[74613]: DEBUG oslo_service.service [None req-4cf3280a-2aa3-4358-aecf-4946b5adf474 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=74613) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 17:47:10 user nova-compute[74613]: DEBUG oslo_service.service [None req-4cf3280a-2aa3-4358-aecf-4946b5adf474 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=74613) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 17:47:10 user nova-compute[74613]: DEBUG oslo_service.service [None req-4cf3280a-2aa3-4358-aecf-4946b5adf474 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=74613) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 17:47:10 user nova-compute[74613]: DEBUG oslo_service.service [None req-4cf3280a-2aa3-4358-aecf-4946b5adf474 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=74613) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 17:47:10 user nova-compute[74613]: DEBUG oslo_service.service [None req-4cf3280a-2aa3-4358-aecf-4946b5adf474 None None] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=74613) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 17:47:10 user nova-compute[74613]: DEBUG oslo_service.service [None req-4cf3280a-2aa3-4358-aecf-4946b5adf474 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=74613) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 17:47:10 user nova-compute[74613]: DEBUG oslo_service.service [None req-4cf3280a-2aa3-4358-aecf-4946b5adf474 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=74613) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 17:47:10 user nova-compute[74613]: DEBUG oslo_service.service [None req-4cf3280a-2aa3-4358-aecf-4946b5adf474 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=74613) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 17:47:10 user nova-compute[74613]: DEBUG oslo_service.service [None req-4cf3280a-2aa3-4358-aecf-4946b5adf474 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=74613) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 17:47:10 user nova-compute[74613]: DEBUG oslo_service.service [None req-4cf3280a-2aa3-4358-aecf-4946b5adf474 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=74613) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 17:47:10 user nova-compute[74613]: DEBUG oslo_service.service [None req-4cf3280a-2aa3-4358-aecf-4946b5adf474 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=74613) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 17:47:10 user nova-compute[74613]: DEBUG oslo_service.service [None req-4cf3280a-2aa3-4358-aecf-4946b5adf474 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=74613) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 17:47:10 user nova-compute[74613]: DEBUG oslo_service.service [None req-4cf3280a-2aa3-4358-aecf-4946b5adf474 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=74613) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 17:47:10 user nova-compute[74613]: DEBUG oslo_service.service [None req-4cf3280a-2aa3-4358-aecf-4946b5adf474 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=74613) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 17:47:10 user nova-compute[74613]: DEBUG oslo_service.service [None req-4cf3280a-2aa3-4358-aecf-4946b5adf474 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=74613) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 17:47:10 user nova-compute[74613]: DEBUG oslo_service.service [None req-4cf3280a-2aa3-4358-aecf-4946b5adf474 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=74613) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 17:47:10 user nova-compute[74613]: DEBUG oslo_service.service [None req-4cf3280a-2aa3-4358-aecf-4946b5adf474 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=74613) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 17:47:10 user nova-compute[74613]: DEBUG oslo_service.service [None req-4cf3280a-2aa3-4358-aecf-4946b5adf474 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=74613) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 17:47:10 user nova-compute[74613]: DEBUG oslo_service.service [None req-4cf3280a-2aa3-4358-aecf-4946b5adf474 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=74613) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 17:47:10 user nova-compute[74613]: DEBUG oslo_service.service [None req-4cf3280a-2aa3-4358-aecf-4946b5adf474 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=74613) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 17:47:10 user nova-compute[74613]: DEBUG oslo_service.service [None req-4cf3280a-2aa3-4358-aecf-4946b5adf474 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=74613) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 17:47:10 user nova-compute[74613]: DEBUG oslo_service.service [None req-4cf3280a-2aa3-4358-aecf-4946b5adf474 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=74613) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 17:47:10 user nova-compute[74613]: DEBUG oslo_service.service [None req-4cf3280a-2aa3-4358-aecf-4946b5adf474 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=74613) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 17:47:10 user nova-compute[74613]: DEBUG oslo_service.service [None req-4cf3280a-2aa3-4358-aecf-4946b5adf474 None None] oslo_messaging_rabbit.ssl      = False {{(pid=74613) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 17:47:10 user nova-compute[74613]: DEBUG oslo_service.service [None req-4cf3280a-2aa3-4358-aecf-4946b5adf474 None None] oslo_messaging_rabbit.ssl_ca_file =  {{(pid=74613) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 17:47:10 user nova-compute[74613]: DEBUG oslo_service.service [None req-4cf3280a-2aa3-4358-aecf-4946b5adf474 None None] oslo_messaging_rabbit.ssl_cert_file =  {{(pid=74613) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 17:47:10 user nova-compute[74613]: DEBUG oslo_service.service [None req-4cf3280a-2aa3-4358-aecf-4946b5adf474 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=74613) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 17:47:10 user nova-compute[74613]: DEBUG oslo_service.service [None req-4cf3280a-2aa3-4358-aecf-4946b5adf474 None None] oslo_messaging_rabbit.ssl_key_file =  {{(pid=74613) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 17:47:10 user nova-compute[74613]: DEBUG oslo_service.service [None req-4cf3280a-2aa3-4358-aecf-4946b5adf474 None None] oslo_messaging_rabbit.ssl_version =  {{(pid=74613) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 17:47:10 user nova-compute[74613]: DEBUG oslo_service.service [None req-4cf3280a-2aa3-4358-aecf-4946b5adf474 None None] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=74613) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 17:47:10 user nova-compute[74613]: DEBUG oslo_service.service [None req-4cf3280a-2aa3-4358-aecf-4946b5adf474 None None] oslo_messaging_notifications.retry = -1 {{(pid=74613) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 17:47:10 user nova-compute[74613]: DEBUG oslo_service.service [None req-4cf3280a-2aa3-4358-aecf-4946b5adf474 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=74613) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 17:47:10 user nova-compute[74613]: DEBUG oslo_service.service [None req-4cf3280a-2aa3-4358-aecf-4946b5adf474 None None] oslo_messaging_notifications.transport_url = **** {{(pid=74613) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 17:47:10 user nova-compute[74613]: DEBUG oslo_service.service [None req-4cf3280a-2aa3-4358-aecf-4946b5adf474 None None] oslo_limit.auth_section        = None {{(pid=74613) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 17:47:10 user nova-compute[74613]: DEBUG oslo_service.service [None req-4cf3280a-2aa3-4358-aecf-4946b5adf474 None None] oslo_limit.auth_type           = None {{(pid=74613) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 17:47:10 user nova-compute[74613]: DEBUG oslo_service.service [None req-4cf3280a-2aa3-4358-aecf-4946b5adf474 None None] oslo_limit.cafile              = None {{(pid=74613) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 17:47:10 user nova-compute[74613]: DEBUG oslo_service.service [None req-4cf3280a-2aa3-4358-aecf-4946b5adf474 None None] oslo_limit.certfile            = None {{(pid=74613) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 17:47:10 user nova-compute[74613]: DEBUG oslo_service.service [None req-4cf3280a-2aa3-4358-aecf-4946b5adf474 None None] oslo_limit.collect_timing      = False {{(pid=74613) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 17:47:10 user nova-compute[74613]: DEBUG oslo_service.service [None req-4cf3280a-2aa3-4358-aecf-4946b5adf474 None None] oslo_limit.connect_retries     = None {{(pid=74613) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 17:47:10 user nova-compute[74613]: DEBUG oslo_service.service [None req-4cf3280a-2aa3-4358-aecf-4946b5adf474 None None] oslo_limit.connect_retry_delay = None {{(pid=74613) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 17:47:10 user nova-compute[74613]: DEBUG oslo_service.service [None req-4cf3280a-2aa3-4358-aecf-4946b5adf474 None None] oslo_limit.endpoint_id         = None {{(pid=74613) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 17:47:10 user nova-compute[74613]: DEBUG oslo_service.service [None req-4cf3280a-2aa3-4358-aecf-4946b5adf474 None None] oslo_limit.endpoint_override   = None {{(pid=74613) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 17:47:10 user nova-compute[74613]: DEBUG oslo_service.service [None req-4cf3280a-2aa3-4358-aecf-4946b5adf474 None None] oslo_limit.insecure            = False {{(pid=74613) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 17:47:10 user nova-compute[74613]: DEBUG oslo_service.service [None req-4cf3280a-2aa3-4358-aecf-4946b5adf474 None None] oslo_limit.keyfile             = None {{(pid=74613) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 17:47:10 user nova-compute[74613]: DEBUG oslo_service.service [None req-4cf3280a-2aa3-4358-aecf-4946b5adf474 None None] oslo_limit.max_version         = None {{(pid=74613) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 17:47:10 user nova-compute[74613]: DEBUG oslo_service.service [None req-4cf3280a-2aa3-4358-aecf-4946b5adf474 None None] oslo_limit.min_version         = None {{(pid=74613) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 17:47:10 user nova-compute[74613]: DEBUG oslo_service.service [None req-4cf3280a-2aa3-4358-aecf-4946b5adf474 None None] oslo_limit.region_name         = None {{(pid=74613) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 17:47:10 user nova-compute[74613]: DEBUG oslo_service.service [None req-4cf3280a-2aa3-4358-aecf-4946b5adf474 None None] oslo_limit.service_name        = None {{(pid=74613) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 17:47:10 user nova-compute[74613]: DEBUG oslo_service.service [None req-4cf3280a-2aa3-4358-aecf-4946b5adf474 None None] oslo_limit.service_type        = None {{(pid=74613) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 17:47:10 user nova-compute[74613]: DEBUG oslo_service.service [None req-4cf3280a-2aa3-4358-aecf-4946b5adf474 None None] oslo_limit.split_loggers       = False {{(pid=74613) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 17:47:10 user nova-compute[74613]: DEBUG oslo_service.service [None req-4cf3280a-2aa3-4358-aecf-4946b5adf474 None None] oslo_limit.status_code_retries = None {{(pid=74613) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 17:47:10 user nova-compute[74613]: DEBUG oslo_service.service [None req-4cf3280a-2aa3-4358-aecf-4946b5adf474 None None] oslo_limit.status_code_retry_delay = None {{(pid=74613) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 17:47:10 user nova-compute[74613]: DEBUG oslo_service.service [None req-4cf3280a-2aa3-4358-aecf-4946b5adf474 None None] oslo_limit.timeout             = None {{(pid=74613) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 17:47:10 user nova-compute[74613]: DEBUG oslo_service.service [None req-4cf3280a-2aa3-4358-aecf-4946b5adf474 None None] oslo_limit.valid_interfaces    = None {{(pid=74613) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 17:47:10 user nova-compute[74613]: DEBUG oslo_service.service [None req-4cf3280a-2aa3-4358-aecf-4946b5adf474 None None] oslo_limit.version             = None {{(pid=74613) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 17:47:10 user nova-compute[74613]: DEBUG oslo_service.service [None req-4cf3280a-2aa3-4358-aecf-4946b5adf474 None None] oslo_reports.file_event_handler = None {{(pid=74613) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 17:47:10 user nova-compute[74613]: DEBUG oslo_service.service [None req-4cf3280a-2aa3-4358-aecf-4946b5adf474 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=74613) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 17:47:10 user nova-compute[74613]: DEBUG oslo_service.service [None req-4cf3280a-2aa3-4358-aecf-4946b5adf474 None None] oslo_reports.log_dir           = None {{(pid=74613) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 17:47:10 user nova-compute[74613]: DEBUG oslo_service.service [None req-4cf3280a-2aa3-4358-aecf-4946b5adf474 None None] vif_plug_linux_bridge_privileged.capabilities = [12] {{(pid=74613) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 17:47:10 user nova-compute[74613]: DEBUG oslo_service.service [None req-4cf3280a-2aa3-4358-aecf-4946b5adf474 None None] vif_plug_linux_bridge_privileged.group = None {{(pid=74613) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 17:47:10 user nova-compute[74613]: DEBUG oslo_service.service [None req-4cf3280a-2aa3-4358-aecf-4946b5adf474 None None] vif_plug_linux_bridge_privileged.helper_command = None {{(pid=74613) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 17:47:10 user nova-compute[74613]: DEBUG oslo_service.service [None req-4cf3280a-2aa3-4358-aecf-4946b5adf474 None None] vif_plug_linux_bridge_privileged.logger_name = oslo_privsep.daemon {{(pid=74613) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 17:47:10 user nova-compute[74613]: DEBUG oslo_service.service [None req-4cf3280a-2aa3-4358-aecf-4946b5adf474 None None] vif_plug_linux_bridge_privileged.thread_pool_size = 12 {{(pid=74613) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 17:47:10 user nova-compute[74613]: DEBUG oslo_service.service [None req-4cf3280a-2aa3-4358-aecf-4946b5adf474 None None] vif_plug_linux_bridge_privileged.user = None {{(pid=74613) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 17:47:10 user nova-compute[74613]: DEBUG oslo_service.service [None req-4cf3280a-2aa3-4358-aecf-4946b5adf474 None None] vif_plug_ovs_privileged.capabilities = [12, 1] {{(pid=74613) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 17:47:10 user nova-compute[74613]: DEBUG oslo_service.service [None req-4cf3280a-2aa3-4358-aecf-4946b5adf474 None None] vif_plug_ovs_privileged.group  = None {{(pid=74613) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 17:47:10 user nova-compute[74613]: DEBUG oslo_service.service [None req-4cf3280a-2aa3-4358-aecf-4946b5adf474 None None] vif_plug_ovs_privileged.helper_command = None {{(pid=74613) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 17:47:10 user nova-compute[74613]: DEBUG oslo_service.service [None req-4cf3280a-2aa3-4358-aecf-4946b5adf474 None None] vif_plug_ovs_privileged.logger_name = oslo_privsep.daemon {{(pid=74613) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 17:47:10 user nova-compute[74613]: DEBUG oslo_service.service [None req-4cf3280a-2aa3-4358-aecf-4946b5adf474 None None] vif_plug_ovs_privileged.thread_pool_size = 12 {{(pid=74613) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 17:47:10 user nova-compute[74613]: DEBUG oslo_service.service [None req-4cf3280a-2aa3-4358-aecf-4946b5adf474 None None] vif_plug_ovs_privileged.user   = None {{(pid=74613) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 17:47:10 user nova-compute[74613]: DEBUG oslo_service.service [None req-4cf3280a-2aa3-4358-aecf-4946b5adf474 None None] os_vif_linux_bridge.flat_interface = None {{(pid=74613) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 17:47:10 user nova-compute[74613]: DEBUG oslo_service.service [None req-4cf3280a-2aa3-4358-aecf-4946b5adf474 None None] os_vif_linux_bridge.forward_bridge_interface = ['all'] {{(pid=74613) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 17:47:10 user nova-compute[74613]: DEBUG oslo_service.service [None req-4cf3280a-2aa3-4358-aecf-4946b5adf474 None None] os_vif_linux_bridge.iptables_bottom_regex =  {{(pid=74613) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 17:47:10 user nova-compute[74613]: DEBUG oslo_service.service [None req-4cf3280a-2aa3-4358-aecf-4946b5adf474 None None] os_vif_linux_bridge.iptables_drop_action = DROP {{(pid=74613) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 17:47:10 user nova-compute[74613]: DEBUG oslo_service.service [None req-4cf3280a-2aa3-4358-aecf-4946b5adf474 None None] os_vif_linux_bridge.iptables_top_regex =  {{(pid=74613) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 17:47:10 user nova-compute[74613]: DEBUG oslo_service.service [None req-4cf3280a-2aa3-4358-aecf-4946b5adf474 None None] os_vif_linux_bridge.network_device_mtu = 1500 {{(pid=74613) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 17:47:10 user nova-compute[74613]: DEBUG oslo_service.service [None req-4cf3280a-2aa3-4358-aecf-4946b5adf474 None None] os_vif_linux_bridge.use_ipv6   = False {{(pid=74613) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 17:47:10 user nova-compute[74613]: DEBUG oslo_service.service [None req-4cf3280a-2aa3-4358-aecf-4946b5adf474 None None] os_vif_linux_bridge.vlan_interface = None {{(pid=74613) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 17:47:10 user nova-compute[74613]: DEBUG oslo_service.service [None req-4cf3280a-2aa3-4358-aecf-4946b5adf474 None None] os_vif_ovs.default_qos_type    = linux-noop {{(pid=74613) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 17:47:10 user nova-compute[74613]: DEBUG oslo_service.service [None req-4cf3280a-2aa3-4358-aecf-4946b5adf474 None None] os_vif_ovs.isolate_vif         = False {{(pid=74613) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 17:47:10 user nova-compute[74613]: DEBUG oslo_service.service [None req-4cf3280a-2aa3-4358-aecf-4946b5adf474 None None] os_vif_ovs.network_device_mtu  = 1500 {{(pid=74613) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 17:47:10 user nova-compute[74613]: DEBUG oslo_service.service [None req-4cf3280a-2aa3-4358-aecf-4946b5adf474 None None] os_vif_ovs.ovs_vsctl_timeout   = 120 {{(pid=74613) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 17:47:10 user nova-compute[74613]: DEBUG oslo_service.service [None req-4cf3280a-2aa3-4358-aecf-4946b5adf474 None None] os_vif_ovs.ovsdb_connection    = tcp:127.0.0.1:6640 {{(pid=74613) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 17:47:10 user nova-compute[74613]: DEBUG oslo_service.service [None req-4cf3280a-2aa3-4358-aecf-4946b5adf474 None None] os_vif_ovs.ovsdb_interface     = native {{(pid=74613) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 17:47:10 user nova-compute[74613]: DEBUG oslo_service.service [None req-4cf3280a-2aa3-4358-aecf-4946b5adf474 None None] os_vif_ovs.per_port_bridge     = False {{(pid=74613) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 17:47:10 user nova-compute[74613]: DEBUG oslo_service.service [None req-4cf3280a-2aa3-4358-aecf-4946b5adf474 None None] os_brick.lock_path             = None {{(pid=74613) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 17:47:10 user nova-compute[74613]: DEBUG oslo_service.service [None req-4cf3280a-2aa3-4358-aecf-4946b5adf474 None None] privsep_osbrick.capabilities   = [21] {{(pid=74613) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 17:47:10 user nova-compute[74613]: DEBUG oslo_service.service [None req-4cf3280a-2aa3-4358-aecf-4946b5adf474 None None] privsep_osbrick.group          = None {{(pid=74613) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 17:47:10 user nova-compute[74613]: DEBUG oslo_service.service [None req-4cf3280a-2aa3-4358-aecf-4946b5adf474 None None] privsep_osbrick.helper_command = None {{(pid=74613) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 17:47:10 user nova-compute[74613]: DEBUG oslo_service.service [None req-4cf3280a-2aa3-4358-aecf-4946b5adf474 None None] privsep_osbrick.logger_name    = os_brick.privileged {{(pid=74613) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 17:47:10 user nova-compute[74613]: DEBUG oslo_service.service [None req-4cf3280a-2aa3-4358-aecf-4946b5adf474 None None] privsep_osbrick.thread_pool_size = 12 {{(pid=74613) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 17:47:10 user nova-compute[74613]: DEBUG oslo_service.service [None req-4cf3280a-2aa3-4358-aecf-4946b5adf474 None None] privsep_osbrick.user           = None {{(pid=74613) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 17:47:10 user nova-compute[74613]: DEBUG oslo_service.service [None req-4cf3280a-2aa3-4358-aecf-4946b5adf474 None None] nova_sys_admin.capabilities    = [0, 1, 2, 3, 12, 21] {{(pid=74613) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 17:47:10 user nova-compute[74613]: DEBUG oslo_service.service [None req-4cf3280a-2aa3-4358-aecf-4946b5adf474 None None] nova_sys_admin.group           = None {{(pid=74613) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 17:47:10 user nova-compute[74613]: DEBUG oslo_service.service [None req-4cf3280a-2aa3-4358-aecf-4946b5adf474 None None] nova_sys_admin.helper_command  = None {{(pid=74613) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 17:47:10 user nova-compute[74613]: DEBUG oslo_service.service [None req-4cf3280a-2aa3-4358-aecf-4946b5adf474 None None] nova_sys_admin.logger_name     = oslo_privsep.daemon {{(pid=74613) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 17:47:10 user nova-compute[74613]: DEBUG oslo_service.service [None req-4cf3280a-2aa3-4358-aecf-4946b5adf474 None None] nova_sys_admin.thread_pool_size = 12 {{(pid=74613) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 17:47:10 user nova-compute[74613]: DEBUG oslo_service.service [None req-4cf3280a-2aa3-4358-aecf-4946b5adf474 None None] nova_sys_admin.user            = None {{(pid=74613) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 17:47:10 user nova-compute[74613]: DEBUG oslo_service.service [None req-4cf3280a-2aa3-4358-aecf-4946b5adf474 None None] ******************************************************************************** {{(pid=74613) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}}
Nov 29 17:47:10 user nova-compute[74613]: INFO nova.service [-] Starting compute node (version 0.0.0)
Nov 29 17:47:10 user nova-compute[74613]: DEBUG nova.virt.libvirt.host [None req-ff6a7ff8-5f06-4fe1-9453-c4b85f4805d3 None None] Connecting to libvirt: qemu:///system {{(pid=74613) _get_new_connection /opt/stack/nova/nova/virt/libvirt/host.py:508}}
Nov 29 17:47:10 user nova-compute[74613]: DEBUG nova.virt.libvirt.host [None req-ff6a7ff8-5f06-4fe1-9453-c4b85f4805d3 None None] Registering for lifecycle events <nova.virt.libvirt.host.Host object at 0x7ff829f66380> {{(pid=74613) _get_new_connection /opt/stack/nova/nova/virt/libvirt/host.py:514}}
Nov 29 17:47:10 user nova-compute[74613]: libvirt:  error : internal error: could not initialize domain event timer
Nov 29 17:47:10 user nova-compute[74613]: WARNING nova.virt.libvirt.host [None req-ff6a7ff8-5f06-4fe1-9453-c4b85f4805d3 None None] URI qemu:///system does not support events: internal error: could not initialize domain event timer: libvirt.libvirtError: internal error: could not initialize domain event timer
Nov 29 17:47:10 user nova-compute[74613]: DEBUG nova.virt.libvirt.host [None req-ff6a7ff8-5f06-4fe1-9453-c4b85f4805d3 None None] Registering for connection events: <nova.virt.libvirt.host.Host object at 0x7ff829f66380> {{(pid=74613) _get_new_connection /opt/stack/nova/nova/virt/libvirt/host.py:535}}
Nov 29 17:47:10 user nova-compute[74613]: DEBUG nova.virt.libvirt.host [None req-ff6a7ff8-5f06-4fe1-9453-c4b85f4805d3 None None] Starting native event thread {{(pid=74613) _init_events /opt/stack/nova/nova/virt/libvirt/host.py:494}}
Nov 29 17:47:10 user nova-compute[74613]: DEBUG nova.virt.libvirt.host [None req-ff6a7ff8-5f06-4fe1-9453-c4b85f4805d3 None None] Starting green dispatch thread {{(pid=74613) _init_events /opt/stack/nova/nova/virt/libvirt/host.py:500}}
Nov 29 17:47:10 user nova-compute[74613]: DEBUG nova.virt.libvirt.host [None req-ff6a7ff8-5f06-4fe1-9453-c4b85f4805d3 None None] Starting connection event dispatch thread {{(pid=74613) _init_events /opt/stack/nova/nova/virt/libvirt/host.py:503}}
Nov 29 17:47:10 user nova-compute[74613]: INFO nova.virt.libvirt.driver [None req-ff6a7ff8-5f06-4fe1-9453-c4b85f4805d3 None None] Connection event '1' reason 'None'
Nov 29 17:47:10 user nova-compute[74613]: WARNING nova.virt.libvirt.driver [None req-ff6a7ff8-5f06-4fe1-9453-c4b85f4805d3 None None] Cannot update service status on host "user" since it is not registered.: nova.exception_Remote.ComputeHostNotFound_Remote: Compute host user could not be found.
Nov 29 17:47:10 user nova-compute[74613]: DEBUG nova.virt.libvirt.volume.mount [None req-ff6a7ff8-5f06-4fe1-9453-c4b85f4805d3 None None] Initialising _HostMountState generation 0 {{(pid=74613) host_up /opt/stack/nova/nova/virt/libvirt/volume/mount.py:130}}
Nov 29 17:47:17 user nova-compute[74613]: INFO nova.virt.libvirt.host [None req-ff6a7ff8-5f06-4fe1-9453-c4b85f4805d3 None None] Libvirt host capabilities <capabilities>
Nov 29 17:47:17 user nova-compute[74613]:   <host>
Nov 29 17:47:17 user nova-compute[74613]:     <uuid>e20c3142-5af9-7467-ecd8-70b2e4a210d6</uuid>
Nov 29 17:47:17 user nova-compute[74613]:     <cpu>
Nov 29 17:47:17 user nova-compute[74613]:       <arch>x86_64</arch>
Nov 29 17:47:17 user nova-compute[74613]:       <model>IvyBridge-IBRS</model>
Nov 29 17:47:17 user nova-compute[74613]:       <vendor>Intel</vendor>
Nov 29 17:47:17 user nova-compute[74613]:       <microcode version='1070'/>
Nov 29 17:47:17 user nova-compute[74613]:       <counter name='tsc' frequency='2094952000' scaling='no'/>
Nov 29 17:47:17 user nova-compute[74613]:       <topology sockets='6' dies='1' cores='1' threads='1'/>
Nov 29 17:47:17 user nova-compute[74613]:       <feature name='ss'/>
Nov 29 17:47:17 user nova-compute[74613]:       <feature name='vmx'/>
Nov 29 17:47:17 user nova-compute[74613]:       <feature name='pcid'/>
Nov 29 17:47:17 user nova-compute[74613]:       <feature name='osxsave'/>
Nov 29 17:47:17 user nova-compute[74613]:       <feature name='hypervisor'/>
Nov 29 17:47:17 user nova-compute[74613]:       <feature name='arat'/>
Nov 29 17:47:17 user nova-compute[74613]:       <feature name='tsc_adjust'/>
Nov 29 17:47:17 user nova-compute[74613]:       <feature name='md-clear'/>
Nov 29 17:47:17 user nova-compute[74613]:       <feature name='stibp'/>
Nov 29 17:47:17 user nova-compute[74613]:       <feature name='arch-capabilities'/>
Nov 29 17:47:17 user nova-compute[74613]:       <feature name='ssbd'/>
Nov 29 17:47:17 user nova-compute[74613]:       <feature name='invtsc'/>
Nov 29 17:47:17 user nova-compute[74613]:       <feature name='rsba'/>
Nov 29 17:47:17 user nova-compute[74613]:       <feature name='skip-l1dfl-vmentry'/>
Nov 29 17:47:17 user nova-compute[74613]:       <pages unit='KiB' size='4'/>
Nov 29 17:47:17 user nova-compute[74613]:       <pages unit='KiB' size='2048'/>
Nov 29 17:47:17 user nova-compute[74613]:     </cpu>
Nov 29 17:47:17 user nova-compute[74613]:     <power_management>
Nov 29 17:47:17 user nova-compute[74613]:       <suspend_mem/>
Nov 29 17:47:17 user nova-compute[74613]:       <suspend_disk/>
Nov 29 17:47:17 user nova-compute[74613]:       <suspend_hybrid/>
Nov 29 17:47:17 user nova-compute[74613]:     </power_management>
Nov 29 17:47:17 user nova-compute[74613]:     <iommu support='no'/>
Nov 29 17:47:17 user nova-compute[74613]:     <migration_features>
Nov 29 17:47:17 user nova-compute[74613]:       <live/>
Nov 29 17:47:17 user nova-compute[74613]:       <uri_transports>
Nov 29 17:47:17 user nova-compute[74613]:         <uri_transport>tcp</uri_transport>
Nov 29 17:47:17 user nova-compute[74613]:         <uri_transport>rdma</uri_transport>
Nov 29 17:47:17 user nova-compute[74613]:       </uri_transports>
Nov 29 17:47:17 user nova-compute[74613]:     </migration_features>
Nov 29 17:47:17 user nova-compute[74613]:     <topology>
Nov 29 17:47:17 user nova-compute[74613]:       <cells num='2'>
Nov 29 17:47:17 user nova-compute[74613]:         <cell id='0'>
Nov 29 17:47:17 user nova-compute[74613]:           <memory unit='KiB'>8140616</memory>
Nov 29 17:47:17 user nova-compute[74613]:           <pages unit='KiB' size='4'>2035154</pages>
Nov 29 17:47:17 user nova-compute[74613]:           <pages unit='KiB' size='2048'>0</pages>
Nov 29 17:47:17 user nova-compute[74613]:           <distances>
Nov 29 17:47:17 user nova-compute[74613]:             <sibling id='0' value='10'/>
Nov 29 17:47:17 user nova-compute[74613]:             <sibling id='1' value='20'/>
Nov 29 17:47:17 user nova-compute[74613]:           </distances>
Nov 29 17:47:17 user nova-compute[74613]:           <cpus num='6'>
Nov 29 17:47:17 user nova-compute[74613]:             <cpu id='0' socket_id='0' die_id='0' core_id='0' siblings='0'/>
Nov 29 17:47:17 user nova-compute[74613]:             <cpu id='1' socket_id='2' die_id='0' core_id='0' siblings='1'/>
Nov 29 17:47:17 user nova-compute[74613]:             <cpu id='2' socket_id='4' die_id='0' core_id='0' siblings='2'/>
Nov 29 17:47:17 user nova-compute[74613]:             <cpu id='3' socket_id='6' die_id='0' core_id='0' siblings='3'/>
Nov 29 17:47:17 user nova-compute[74613]:             <cpu id='4' socket_id='8' die_id='0' core_id='0' siblings='4'/>
Nov 29 17:47:17 user nova-compute[74613]:             <cpu id='5' socket_id='10' die_id='0' core_id='0' siblings='5'/>
Nov 29 17:47:17 user nova-compute[74613]:           </cpus>
Nov 29 17:47:17 user nova-compute[74613]:         </cell>
Nov 29 17:47:17 user nova-compute[74613]:         <cell id='1'>
Nov 29 17:47:17 user nova-compute[74613]:           <memory unit='KiB'>8255068</memory>
Nov 29 17:47:17 user nova-compute[74613]:           <pages unit='KiB' size='4'>2063767</pages>
Nov 29 17:47:17 user nova-compute[74613]:           <pages unit='KiB' size='2048'>0</pages>
Nov 29 17:47:17 user nova-compute[74613]:           <distances>
Nov 29 17:47:17 user nova-compute[74613]:             <sibling id='0' value='20'/>
Nov 29 17:47:17 user nova-compute[74613]:             <sibling id='1' value='10'/>
Nov 29 17:47:17 user nova-compute[74613]:           </distances>
Nov 29 17:47:17 user nova-compute[74613]:           <cpus num='6'>
Nov 29 17:47:17 user nova-compute[74613]:             <cpu id='6' socket_id='12' die_id='0' core_id='0' siblings='6'/>
Nov 29 17:47:17 user nova-compute[74613]:             <cpu id='7' socket_id='14' die_id='0' core_id='0' siblings='7'/>
Nov 29 17:47:17 user nova-compute[74613]:             <cpu id='8' socket_id='16' die_id='0' core_id='0' siblings='8'/>
Nov 29 17:47:17 user nova-compute[74613]:             <cpu id='9' socket_id='18' die_id='0' core_id='0' siblings='9'/>
Nov 29 17:47:17 user nova-compute[74613]:             <cpu id='10' socket_id='20' die_id='0' core_id='0' siblings='10'/>
Nov 29 17:47:17 user nova-compute[74613]:             <cpu id='11' socket_id='22' die_id='0' core_id='0' siblings='11'/>
Nov 29 17:47:17 user nova-compute[74613]:           </cpus>
Nov 29 17:47:17 user nova-compute[74613]:         </cell>
Nov 29 17:47:17 user nova-compute[74613]:       </cells>
Nov 29 17:47:17 user nova-compute[74613]:     </topology>
Nov 29 17:47:17 user nova-compute[74613]:     <cache>
Nov 29 17:47:17 user nova-compute[74613]:       <bank id='0' level='3' type='both' size='15' unit='MiB' cpus='0'/>
Nov 29 17:47:17 user nova-compute[74613]:       <bank id='2' level='3' type='both' size='15' unit='MiB' cpus='1'/>
Nov 29 17:47:17 user nova-compute[74613]:       <bank id='4' level='3' type='both' size='15' unit='MiB' cpus='2'/>
Nov 29 17:47:17 user nova-compute[74613]:       <bank id='6' level='3' type='both' size='15' unit='MiB' cpus='3'/>
Nov 29 17:47:17 user nova-compute[74613]:       <bank id='8' level='3' type='both' size='15' unit='MiB' cpus='4'/>
Nov 29 17:47:17 user nova-compute[74613]:       <bank id='10' level='3' type='both' size='15' unit='MiB' cpus='5'/>
Nov 29 17:47:17 user nova-compute[74613]:       <bank id='12' level='3' type='both' size='15' unit='MiB' cpus='6'/>
Nov 29 17:47:17 user nova-compute[74613]:       <bank id='14' level='3' type='both' size='15' unit='MiB' cpus='7'/>
Nov 29 17:47:17 user nova-compute[74613]:       <bank id='16' level='3' type='both' size='15' unit='MiB' cpus='8'/>
Nov 29 17:47:17 user nova-compute[74613]:       <bank id='18' level='3' type='both' size='15' unit='MiB' cpus='9'/>
Nov 29 17:47:17 user nova-compute[74613]:       <bank id='20' level='3' type='both' size='15' unit='MiB' cpus='10'/>
Nov 29 17:47:17 user nova-compute[74613]:       <bank id='22' level='3' type='both' size='15' unit='MiB' cpus='11'/>
Nov 29 17:47:17 user nova-compute[74613]:     </cache>
Nov 29 17:47:17 user nova-compute[74613]:     <secmodel>
Nov 29 17:47:17 user nova-compute[74613]:       <model>apparmor</model>
Nov 29 17:47:17 user nova-compute[74613]:       <doi>0</doi>
Nov 29 17:47:17 user nova-compute[74613]:     </secmodel>
Nov 29 17:47:17 user nova-compute[74613]:     <secmodel>
Nov 29 17:47:17 user nova-compute[74613]:       <model>dac</model>
Nov 29 17:47:17 user nova-compute[74613]:       <doi>0</doi>
Nov 29 17:47:17 user nova-compute[74613]:       <baselabel type='kvm'>+64055:+108</baselabel>
Nov 29 17:47:17 user nova-compute[74613]:       <baselabel type='qemu'>+64055:+108</baselabel>
Nov 29 17:47:17 user nova-compute[74613]:     </secmodel>
Nov 29 17:47:17 user nova-compute[74613]:   </host>
Nov 29 17:47:17 user nova-compute[74613]:   <guest>
Nov 29 17:47:17 user nova-compute[74613]:     <os_type>hvm</os_type>
Nov 29 17:47:17 user nova-compute[74613]:     <arch name='alpha'>
Nov 29 17:47:17 user nova-compute[74613]:       <wordsize>64</wordsize>
Nov 29 17:47:17 user nova-compute[74613]:       <emulator>/usr/bin/qemu-system-alpha</emulator>
Nov 29 17:47:17 user nova-compute[74613]:       <machine maxCpus='4'>clipper</machine>
Nov 29 17:47:17 user nova-compute[74613]:       <domain type='qemu'/>
Nov 29 17:47:17 user nova-compute[74613]:     </arch>
Nov 29 17:47:17 user nova-compute[74613]:     <features>
Nov 29 17:47:17 user nova-compute[74613]:       <cpuselection/>
Nov 29 17:47:17 user nova-compute[74613]:       <deviceboot/>
Nov 29 17:47:17 user nova-compute[74613]:       <disksnapshot default='on' toggle='no'/>
Nov 29 17:47:17 user nova-compute[74613]:     </features>
Nov 29 17:47:17 user nova-compute[74613]:   </guest>
Nov 29 17:47:17 user nova-compute[74613]:   <guest>
Nov 29 17:47:17 user nova-compute[74613]:     <os_type>hvm</os_type>
Nov 29 17:47:17 user nova-compute[74613]:     <arch name='armv6l'>
Nov 29 17:47:17 user nova-compute[74613]:       <wordsize>32</wordsize>
Nov 29 17:47:17 user nova-compute[74613]:       <emulator>/usr/bin/qemu-system-arm</emulator>
Nov 29 17:47:17 user nova-compute[74613]:       <machine maxCpus='1'>integratorcp</machine>
Nov 29 17:47:17 user nova-compute[74613]:       <machine maxCpus='2'>ast2600-evb</machine>
Nov 29 17:47:17 user nova-compute[74613]:       <machine maxCpus='1'>borzoi</machine>
Nov 29 17:47:17 user nova-compute[74613]:       <machine maxCpus='1'>spitz</machine>
Nov 29 17:47:17 user nova-compute[74613]:       <machine maxCpus='255'>virt-2.7</machine>
Nov 29 17:47:17 user nova-compute[74613]:       <machine maxCpus='2'>nuri</machine>
Nov 29 17:47:17 user nova-compute[74613]:       <machine maxCpus='2'>mcimx7d-sabre</machine>
Nov 29 17:47:17 user nova-compute[74613]:       <machine maxCpus='1'>romulus-bmc</machine>
Nov 29 17:47:17 user nova-compute[74613]:       <machine maxCpus='512'>virt-3.0</machine>
Nov 29 17:47:17 user nova-compute[74613]:       <machine maxCpus='512'>virt-5.0</machine>
Nov 29 17:47:17 user nova-compute[74613]:       <machine maxCpus='2'>npcm750-evb</machine>
Nov 29 17:47:17 user nova-compute[74613]:       <machine maxCpus='255'>virt-2.10</machine>
Nov 29 17:47:17 user nova-compute[74613]:       <machine maxCpus='2'>rainier-bmc</machine>
Nov 29 17:47:17 user nova-compute[74613]:       <machine maxCpus='1'>mps3-an547</machine>
Nov 29 17:47:17 user nova-compute[74613]:       <machine maxCpus='2'>musca-b1</machine>
Nov 29 17:47:17 user nova-compute[74613]:       <machine maxCpus='4'>realview-pbx-a9</machine>
Nov 29 17:47:17 user nova-compute[74613]:       <machine maxCpus='1'>versatileab</machine>
Nov 29 17:47:17 user nova-compute[74613]:       <machine maxCpus='1'>kzm</machine>
Nov 29 17:47:17 user nova-compute[74613]:       <machine maxCpus='255'>virt-2.8</machine>
Nov 29 17:47:17 user nova-compute[74613]:       <machine maxCpus='2'>musca-a</machine>
Nov 29 17:47:17 user nova-compute[74613]:       <machine maxCpus='512'>virt-3.1</machine>
Nov 29 17:47:17 user nova-compute[74613]:       <machine maxCpus='1'>mcimx6ul-evk</machine>
Nov 29 17:47:17 user nova-compute[74613]:       <machine maxCpus='512'>virt-5.1</machine>
Nov 29 17:47:17 user nova-compute[74613]:       <machine maxCpus='2'>smdkc210</machine>
Nov 29 17:47:17 user nova-compute[74613]:       <machine maxCpus='1'>sx1</machine>
Nov 29 17:47:17 user nova-compute[74613]:       <machine maxCpus='255'>virt-2.11</machine>
Nov 29 17:47:17 user nova-compute[74613]:       <machine maxCpus='1'>imx25-pdk</machine>
Nov 29 17:47:17 user nova-compute[74613]:       <machine maxCpus='1'>stm32vldiscovery</machine>
Nov 29 17:47:17 user nova-compute[74613]:       <machine maxCpus='255'>virt-2.9</machine>
Nov 29 17:47:17 user nova-compute[74613]:       <machine maxCpus='4'>orangepi-pc</machine>
Nov 29 17:47:17 user nova-compute[74613]:       <machine maxCpus='1'>quanta-q71l-bmc</machine>
Nov 29 17:47:17 user nova-compute[74613]:       <machine maxCpus='1'>z2</machine>
Nov 29 17:47:17 user nova-compute[74613]:       <machine maxCpus='512'>virt-5.2</machine>
Nov 29 17:47:17 user nova-compute[74613]:       <machine maxCpus='1'>xilinx-zynq-a9</machine>
Nov 29 17:47:17 user nova-compute[74613]:       <machine maxCpus='1'>tosa</machine>
Nov 29 17:47:17 user nova-compute[74613]:       <machine maxCpus='1'>mps2-an500</machine>
Nov 29 17:47:17 user nova-compute[74613]:       <machine maxCpus='255'>virt-2.12</machine>
Nov 29 17:47:17 user nova-compute[74613]:       <machine maxCpus='2'>mps2-an521</machine>
Nov 29 17:47:17 user nova-compute[74613]:       <machine maxCpus='4'>sabrelite</machine>
Nov 29 17:47:17 user nova-compute[74613]:       <machine maxCpus='1'>mps2-an511</machine>
Nov 29 17:47:17 user nova-compute[74613]:       <machine maxCpus='1'>canon-a1100</machine>
Nov 29 17:47:17 user nova-compute[74613]:       <machine maxCpus='1'>realview-eb</machine>
Nov 29 17:47:17 user nova-compute[74613]:       <machine maxCpus='2'>quanta-gbs-bmc</machine>
Nov 29 17:47:17 user nova-compute[74613]:       <machine maxCpus='1'>emcraft-sf2</machine>
Nov 29 17:47:17 user nova-compute[74613]:       <machine maxCpus='1'>realview-pb-a8</machine>
Nov 29 17:47:17 user nova-compute[74613]:       <machine maxCpus='512'>virt-4.0</machine>
Nov 29 17:47:17 user nova-compute[74613]:       <machine maxCpus='1'>raspi1ap</machine>
Nov 29 17:47:17 user nova-compute[74613]:       <machine maxCpus='1'>palmetto-bmc</machine>
Nov 29 17:47:17 user nova-compute[74613]:       <machine maxCpus='1'>sx1-v1</machine>
Nov 29 17:47:17 user nova-compute[74613]:       <machine maxCpus='1'>n810</machine>
Nov 29 17:47:17 user nova-compute[74613]:       <machine maxCpus='1'>g220a-bmc</machine>
Nov 29 17:47:17 user nova-compute[74613]:       <machine maxCpus='1'>n800</machine>
Nov 29 17:47:17 user nova-compute[74613]:       <machine maxCpus='2'>tacoma-bmc</machine>
Nov 29 17:47:17 user nova-compute[74613]:       <machine maxCpus='512'>virt-4.1</machine>
Nov 29 17:47:17 user nova-compute[74613]:       <machine maxCpus='2'>quanta-gsj</machine>
Nov 29 17:47:17 user nova-compute[74613]:       <machine maxCpus='1'>versatilepb</machine>
Nov 29 17:47:17 user nova-compute[74613]:       <machine maxCpus='1'>terrier</machine>
Nov 29 17:47:17 user nova-compute[74613]:       <machine maxCpus='1'>mainstone</machine>
Nov 29 17:47:17 user nova-compute[74613]:       <machine maxCpus='4'>realview-eb-mpcore</machine>
Nov 29 17:47:17 user nova-compute[74613]:       <machine maxCpus='1'>supermicrox11-bmc</machine>
Nov 29 17:47:17 user nova-compute[74613]:       <machine maxCpus='512'>virt-4.2</machine>
Nov 29 17:47:17 user nova-compute[74613]:       <machine maxCpus='1'>witherspoon-bmc</machine>
Nov 29 17:47:17 user nova-compute[74613]:       <machine maxCpus='2'>mps3-an524</machine>
Nov 29 17:47:17 user nova-compute[74613]:       <machine maxCpus='1' deprecated='yes'>swift-bmc</machine>
Nov 29 17:47:17 user nova-compute[74613]:       <machine maxCpus='2'>kudo-bmc</machine>
Nov 29 17:47:17 user nova-compute[74613]:       <machine maxCpus='4'>vexpress-a9</machine>
Nov 29 17:47:17 user nova-compute[74613]:       <machine maxCpus='4'>midway</machine>
Nov 29 17:47:17 user nova-compute[74613]:       <machine maxCpus='1'>musicpal</machine>
Nov 29 17:47:17 user nova-compute[74613]:       <machine maxCpus='1'>lm3s811evb</machine>
Nov 29 17:47:17 user nova-compute[74613]:       <machine maxCpus='1'>lm3s6965evb</machine>
Nov 29 17:47:17 user nova-compute[74613]:       <machine maxCpus='1'>microbit</machine>
Nov 29 17:47:17 user nova-compute[74613]:       <machine maxCpus='1'>mps2-an505</machine>
Nov 29 17:47:17 user nova-compute[74613]:       <machine maxCpus='1'>mps2-an385</machine>
Nov 29 17:47:17 user nova-compute[74613]:       <machine maxCpus='512'>virt-6.0</machine>
Nov 29 17:47:17 user nova-compute[74613]:       <machine maxCpus='1'>cubieboard</machine>
Nov 29 17:47:17 user nova-compute[74613]:       <machine maxCpus='1'>verdex</machine>
Nov 29 17:47:17 user nova-compute[74613]:       <machine maxCpus='1'>netduino2</machine>
Nov 29 17:47:17 user nova-compute[74613]:       <machine maxCpus='1'>mps2-an386</machine>
Nov 29 17:47:17 user nova-compute[74613]:       <machine maxCpus='512'>virt-6.1</machine>
Nov 29 17:47:17 user nova-compute[74613]:       <machine maxCpus='4'>raspi2b</machine>
Nov 29 17:47:17 user nova-compute[74613]:       <machine maxCpus='4'>vexpress-a15</machine>
Nov 29 17:47:17 user nova-compute[74613]:       <machine maxCpus='2'>fuji-bmc</machine>
Nov 29 17:47:17 user nova-compute[74613]:       <machine maxCpus='512'>virt-6.2</machine>
Nov 29 17:47:17 user nova-compute[74613]:       <machine canonical='virt-6.2' maxCpus='512'>virt</machine>
Nov 29 17:47:17 user nova-compute[74613]:       <machine maxCpus='1'>sonorapass-bmc</machine>
Nov 29 17:47:17 user nova-compute[74613]:       <machine maxCpus='1'>cheetah</machine>
Nov 29 17:47:17 user nova-compute[74613]:       <machine maxCpus='255'>virt-2.6</machine>
Nov 29 17:47:17 user nova-compute[74613]:       <machine maxCpus='1'>ast2500-evb</machine>
Nov 29 17:47:17 user nova-compute[74613]:       <machine maxCpus='4'>highbank</machine>
Nov 29 17:47:17 user nova-compute[74613]:       <machine maxCpus='1'>akita</machine>
Nov 29 17:47:17 user nova-compute[74613]:       <machine maxCpus='1'>connex</machine>
Nov 29 17:47:17 user nova-compute[74613]:       <machine maxCpus='1'>netduinoplus2</machine>
Nov 29 17:47:17 user nova-compute[74613]:       <machine maxCpus='1'>collie</machine>
Nov 29 17:47:17 user nova-compute[74613]:       <machine maxCpus='1'>raspi0</machine>
Nov 29 17:47:17 user nova-compute[74613]:       <machine maxCpus='1'>fp5280g2-bmc</machine>
Nov 29 17:47:17 user nova-compute[74613]:       <domain type='qemu'/>
Nov 29 17:47:17 user nova-compute[74613]:     </arch>
Nov 29 17:47:17 user nova-compute[74613]:     <features>
Nov 29 17:47:17 user nova-compute[74613]:       <cpuselection/>
Nov 29 17:47:17 user nova-compute[74613]:       <deviceboot/>
Nov 29 17:47:17 user nova-compute[74613]:       <disksnapshot default='on' toggle='no'/>
Nov 29 17:47:17 user nova-compute[74613]:     </features>
Nov 29 17:47:17 user nova-compute[74613]:   </guest>
Nov 29 17:47:17 user nova-compute[74613]:   <guest>
Nov 29 17:47:17 user nova-compute[74613]:     <os_type>hvm</os_type>
Nov 29 17:47:17 user nova-compute[74613]:     <arch name='armv7l'>
Nov 29 17:47:17 user nova-compute[74613]:       <wordsize>32</wordsize>
Nov 29 17:47:17 user nova-compute[74613]:       <emulator>/usr/bin/qemu-system-arm</emulator>
Nov 29 17:47:17 user nova-compute[74613]:       <machine maxCpus='1'>integratorcp</machine>
Nov 29 17:47:17 user nova-compute[74613]:       <machine maxCpus='2'>ast2600-evb</machine>
Nov 29 17:47:17 user nova-compute[74613]:       <machine maxCpus='1'>borzoi</machine>
Nov 29 17:47:17 user nova-compute[74613]:       <machine maxCpus='1'>spitz</machine>
Nov 29 17:47:17 user nova-compute[74613]:       <machine maxCpus='255'>virt-2.7</machine>
Nov 29 17:47:17 user nova-compute[74613]:       <machine maxCpus='2'>nuri</machine>
Nov 29 17:47:17 user nova-compute[74613]:       <machine maxCpus='2'>mcimx7d-sabre</machine>
Nov 29 17:47:17 user nova-compute[74613]:       <machine maxCpus='1'>romulus-bmc</machine>
Nov 29 17:47:17 user nova-compute[74613]:       <machine maxCpus='512'>virt-3.0</machine>
Nov 29 17:47:17 user nova-compute[74613]:       <machine maxCpus='512'>virt-5.0</machine>
Nov 29 17:47:17 user nova-compute[74613]:       <machine maxCpus='2'>npcm750-evb</machine>
Nov 29 17:47:17 user nova-compute[74613]:       <machine maxCpus='255'>virt-2.10</machine>
Nov 29 17:47:17 user nova-compute[74613]:       <machine maxCpus='2'>rainier-bmc</machine>
Nov 29 17:47:17 user nova-compute[74613]:       <machine maxCpus='1'>mps3-an547</machine>
Nov 29 17:47:17 user nova-compute[74613]:       <machine maxCpus='2'>musca-b1</machine>
Nov 29 17:47:17 user nova-compute[74613]:       <machine maxCpus='4'>realview-pbx-a9</machine>
Nov 29 17:47:17 user nova-compute[74613]:       <machine maxCpus='1'>versatileab</machine>
Nov 29 17:47:17 user nova-compute[74613]:       <machine maxCpus='1'>kzm</machine>
Nov 29 17:47:17 user nova-compute[74613]:       <machine maxCpus='255'>virt-2.8</machine>
Nov 29 17:47:17 user nova-compute[74613]:       <machine maxCpus='2'>musca-a</machine>
Nov 29 17:47:17 user nova-compute[74613]:       <machine maxCpus='512'>virt-3.1</machine>
Nov 29 17:47:17 user nova-compute[74613]:       <machine maxCpus='1'>mcimx6ul-evk</machine>
Nov 29 17:47:17 user nova-compute[74613]:       <machine maxCpus='512'>virt-5.1</machine>
Nov 29 17:47:17 user nova-compute[74613]:       <machine maxCpus='2'>smdkc210</machine>
Nov 29 17:47:17 user nova-compute[74613]:       <machine maxCpus='1'>sx1</machine>
Nov 29 17:47:17 user nova-compute[74613]:       <machine maxCpus='255'>virt-2.11</machine>
Nov 29 17:47:17 user nova-compute[74613]:       <machine maxCpus='1'>imx25-pdk</machine>
Nov 29 17:47:17 user nova-compute[74613]:       <machine maxCpus='1'>stm32vldiscovery</machine>
Nov 29 17:47:17 user nova-compute[74613]:       <machine maxCpus='255'>virt-2.9</machine>
Nov 29 17:47:17 user nova-compute[74613]:       <machine maxCpus='4'>orangepi-pc</machine>
Nov 29 17:47:17 user nova-compute[74613]:       <machine maxCpus='1'>quanta-q71l-bmc</machine>
Nov 29 17:47:17 user nova-compute[74613]:       <machine maxCpus='1'>z2</machine>
Nov 29 17:47:17 user nova-compute[74613]:       <machine maxCpus='512'>virt-5.2</machine>
Nov 29 17:47:17 user nova-compute[74613]:       <machine maxCpus='1'>xilinx-zynq-a9</machine>
Nov 29 17:47:17 user nova-compute[74613]:       <machine maxCpus='1'>tosa</machine>
Nov 29 17:47:17 user nova-compute[74613]:       <machine maxCpus='1'>mps2-an500</machine>
Nov 29 17:47:17 user nova-compute[74613]:       <machine maxCpus='255'>virt-2.12</machine>
Nov 29 17:47:17 user nova-compute[74613]:       <machine maxCpus='2'>mps2-an521</machine>
Nov 29 17:47:17 user nova-compute[74613]:       <machine maxCpus='4'>sabrelite</machine>
Nov 29 17:47:17 user nova-compute[74613]:       <machine maxCpus='1'>mps2-an511</machine>
Nov 29 17:47:17 user nova-compute[74613]:       <machine maxCpus='1'>canon-a1100</machine>
Nov 29 17:47:17 user nova-compute[74613]:       <machine maxCpus='1'>realview-eb</machine>
Nov 29 17:47:17 user nova-compute[74613]:       <machine maxCpus='2'>quanta-gbs-bmc</machine>
Nov 29 17:47:17 user nova-compute[74613]:       <machine maxCpus='1'>emcraft-sf2</machine>
Nov 29 17:47:17 user nova-compute[74613]:       <machine maxCpus='1'>realview-pb-a8</machine>
Nov 29 17:47:17 user nova-compute[74613]:       <machine maxCpus='512'>virt-4.0</machine>
Nov 29 17:47:17 user nova-compute[74613]:       <machine maxCpus='1'>raspi1ap</machine>
Nov 29 17:47:17 user nova-compute[74613]:       <machine maxCpus='1'>palmetto-bmc</machine>
Nov 29 17:47:17 user nova-compute[74613]:       <machine maxCpus='1'>sx1-v1</machine>
Nov 29 17:47:17 user nova-compute[74613]:       <machine maxCpus='1'>n810</machine>
Nov 29 17:47:17 user nova-compute[74613]:       <machine maxCpus='1'>g220a-bmc</machine>
Nov 29 17:47:17 user nova-compute[74613]:       <machine maxCpus='1'>n800</machine>
Nov 29 17:47:17 user nova-compute[74613]:       <machine maxCpus='2'>tacoma-bmc</machine>
Nov 29 17:47:17 user nova-compute[74613]:       <machine maxCpus='512'>virt-4.1</machine>
Nov 29 17:47:17 user nova-compute[74613]:       <machine maxCpus='2'>quanta-gsj</machine>
Nov 29 17:47:17 user nova-compute[74613]:       <machine maxCpus='1'>versatilepb</machine>
Nov 29 17:47:17 user nova-compute[74613]:       <machine maxCpus='1'>terrier</machine>
Nov 29 17:47:17 user nova-compute[74613]:       <machine maxCpus='1'>mainstone</machine>
Nov 29 17:47:17 user nova-compute[74613]:       <machine maxCpus='4'>realview-eb-mpcore</machine>
Nov 29 17:47:17 user nova-compute[74613]:       <machine maxCpus='1'>supermicrox11-bmc</machine>
Nov 29 17:47:17 user nova-compute[74613]:       <machine maxCpus='512'>virt-4.2</machine>
Nov 29 17:47:17 user nova-compute[74613]:       <machine maxCpus='1'>witherspoon-bmc</machine>
Nov 29 17:47:17 user nova-compute[74613]:       <machine maxCpus='2'>mps3-an524</machine>
Nov 29 17:47:17 user nova-compute[74613]:       <machine maxCpus='1' deprecated='yes'>swift-bmc</machine>
Nov 29 17:47:17 user nova-compute[74613]:       <machine maxCpus='2'>kudo-bmc</machine>
Nov 29 17:47:17 user nova-compute[74613]:       <machine maxCpus='4'>vexpress-a9</machine>
Nov 29 17:47:17 user nova-compute[74613]:       <machine maxCpus='4'>midway</machine>
Nov 29 17:47:17 user nova-compute[74613]:       <machine maxCpus='1'>musicpal</machine>
Nov 29 17:47:17 user nova-compute[74613]:       <machine maxCpus='1'>lm3s811evb</machine>
Nov 29 17:47:17 user nova-compute[74613]:       <machine maxCpus='1'>lm3s6965evb</machine>
Nov 29 17:47:17 user nova-compute[74613]:       <machine maxCpus='1'>microbit</machine>
Nov 29 17:47:17 user nova-compute[74613]:       <machine maxCpus='1'>mps2-an505</machine>
Nov 29 17:47:17 user nova-compute[74613]:       <machine maxCpus='1'>mps2-an385</machine>
Nov 29 17:47:17 user nova-compute[74613]:       <machine maxCpus='512'>virt-6.0</machine>
Nov 29 17:47:17 user nova-compute[74613]:       <machine maxCpus='1'>cubieboard</machine>
Nov 29 17:47:17 user nova-compute[74613]:       <machine maxCpus='1'>verdex</machine>
Nov 29 17:47:17 user nova-compute[74613]:       <machine maxCpus='1'>netduino2</machine>
Nov 29 17:47:17 user nova-compute[74613]:       <machine maxCpus='1'>mps2-an386</machine>
Nov 29 17:47:17 user nova-compute[74613]:       <machine maxCpus='512'>virt-6.1</machine>
Nov 29 17:47:17 user nova-compute[74613]:       <machine maxCpus='4'>raspi2b</machine>
Nov 29 17:47:17 user nova-compute[74613]:       <machine maxCpus='4'>vexpress-a15</machine>
Nov 29 17:47:17 user nova-compute[74613]:       <machine maxCpus='2'>fuji-bmc</machine>
Nov 29 17:47:17 user nova-compute[74613]:       <machine maxCpus='512'>virt-6.2</machine>
Nov 29 17:47:17 user nova-compute[74613]:       <machine canonical='virt-6.2' maxCpus='512'>virt</machine>
Nov 29 17:47:17 user nova-compute[74613]:       <machine maxCpus='1'>sonorapass-bmc</machine>
Nov 29 17:47:17 user nova-compute[74613]:       <machine maxCpus='1'>cheetah</machine>
Nov 29 17:47:17 user nova-compute[74613]:       <machine maxCpus='255'>virt-2.6</machine>
Nov 29 17:47:17 user nova-compute[74613]:       <machine maxCpus='1'>ast2500-evb</machine>
Nov 29 17:47:17 user nova-compute[74613]:       <machine maxCpus='4'>highbank</machine>
Nov 29 17:47:17 user nova-compute[74613]:       <machine maxCpus='1'>akita</machine>
Nov 29 17:47:17 user nova-compute[74613]:       <machine maxCpus='1'>connex</machine>
Nov 29 17:47:17 user nova-compute[74613]:       <machine maxCpus='1'>netduinoplus2</machine>
Nov 29 17:47:17 user nova-compute[74613]:       <machine maxCpus='1'>collie</machine>
Nov 29 17:47:17 user nova-compute[74613]:       <machine maxCpus='1'>raspi0</machine>
Nov 29 17:47:17 user nova-compute[74613]:       <machine maxCpus='1'>fp5280g2-bmc</machine>
Nov 29 17:47:17 user nova-compute[74613]:       <domain type='qemu'/>
Nov 29 17:47:17 user nova-compute[74613]:     </arch>
Nov 29 17:47:17 user nova-compute[74613]:     <features>
Nov 29 17:47:17 user nova-compute[74613]:       <cpuselection/>
Nov 29 17:47:17 user nova-compute[74613]:       <deviceboot/>
Nov 29 17:47:17 user nova-compute[74613]:       <disksnapshot default='on' toggle='no'/>
Nov 29 17:47:17 user nova-compute[74613]:     </features>
Nov 29 17:47:17 user nova-compute[74613]:   </guest>
Nov 29 17:47:17 user nova-compute[74613]:   <guest>
Nov 29 17:47:17 user nova-compute[74613]:     <os_type>hvm</os_type>
Nov 29 17:47:17 user nova-compute[74613]:     <arch name='aarch64'>
Nov 29 17:47:17 user nova-compute[74613]:       <wordsize>64</wordsize>
Nov 29 17:47:17 user nova-compute[74613]:       <emulator>/usr/bin/qemu-system-aarch64</emulator>
Nov 29 17:47:17 user nova-compute[74613]:       <machine maxCpus='1'>integratorcp</machine>
Nov 29 17:47:17 user nova-compute[74613]:       <machine maxCpus='2'>ast2600-evb</machine>
Nov 29 17:47:17 user nova-compute[74613]:       <machine maxCpus='1'>borzoi</machine>
Nov 29 17:47:17 user nova-compute[74613]:       <machine maxCpus='1'>spitz</machine>
Nov 29 17:47:17 user nova-compute[74613]:       <machine maxCpus='255'>virt-2.7</machine>
Nov 29 17:47:17 user nova-compute[74613]:       <machine maxCpus='2'>nuri</machine>
Nov 29 17:47:17 user nova-compute[74613]:       <machine maxCpus='2'>mcimx7d-sabre</machine>
Nov 29 17:47:17 user nova-compute[74613]:       <machine maxCpus='1'>romulus-bmc</machine>
Nov 29 17:47:17 user nova-compute[74613]:       <machine maxCpus='512'>virt-3.0</machine>
Nov 29 17:47:17 user nova-compute[74613]:       <machine maxCpus='512'>virt-5.0</machine>
Nov 29 17:47:17 user nova-compute[74613]:       <machine maxCpus='2'>npcm750-evb</machine>
Nov 29 17:47:17 user nova-compute[74613]:       <machine maxCpus='255'>virt-2.10</machine>
Nov 29 17:47:17 user nova-compute[74613]:       <machine maxCpus='2'>rainier-bmc</machine>
Nov 29 17:47:17 user nova-compute[74613]:       <machine maxCpus='1'>mps3-an547</machine>
Nov 29 17:47:17 user nova-compute[74613]:       <machine maxCpus='255'>virt-2.8</machine>
Nov 29 17:47:17 user nova-compute[74613]:       <machine maxCpus='2'>musca-b1</machine>
Nov 29 17:47:17 user nova-compute[74613]:       <machine maxCpus='4'>realview-pbx-a9</machine>
Nov 29 17:47:17 user nova-compute[74613]:       <machine maxCpus='1'>versatileab</machine>
Nov 29 17:47:17 user nova-compute[74613]:       <machine maxCpus='1'>kzm</machine>
Nov 29 17:47:17 user nova-compute[74613]:       <machine maxCpus='2'>musca-a</machine>
Nov 29 17:47:17 user nova-compute[74613]:       <machine maxCpus='512'>virt-3.1</machine>
Nov 29 17:47:17 user nova-compute[74613]:       <machine maxCpus='1'>mcimx6ul-evk</machine>
Nov 29 17:47:17 user nova-compute[74613]:       <machine maxCpus='512'>virt-5.1</machine>
Nov 29 17:47:17 user nova-compute[74613]:       <machine maxCpus='2'>smdkc210</machine>
Nov 29 17:47:17 user nova-compute[74613]:       <machine maxCpus='1'>sx1</machine>
Nov 29 17:47:17 user nova-compute[74613]:       <machine maxCpus='255'>virt-2.11</machine>
Nov 29 17:47:17 user nova-compute[74613]:       <machine maxCpus='1'>imx25-pdk</machine>
Nov 29 17:47:17 user nova-compute[74613]:       <machine maxCpus='1'>stm32vldiscovery</machine>
Nov 29 17:47:17 user nova-compute[74613]:       <machine maxCpus='255'>virt-2.9</machine>
Nov 29 17:47:17 user nova-compute[74613]:       <machine maxCpus='4'>orangepi-pc</machine>
Nov 29 17:47:17 user nova-compute[74613]:       <machine maxCpus='1'>quanta-q71l-bmc</machine>
Nov 29 17:47:17 user nova-compute[74613]:       <machine maxCpus='1'>z2</machine>
Nov 29 17:47:17 user nova-compute[74613]:       <machine maxCpus='512'>virt-5.2</machine>
Nov 29 17:47:17 user nova-compute[74613]:       <machine maxCpus='1'>xilinx-zynq-a9</machine>
Nov 29 17:47:17 user nova-compute[74613]:       <machine maxCpus='6'>xlnx-zcu102</machine>
Nov 29 17:47:17 user nova-compute[74613]:       <machine maxCpus='1'>tosa</machine>
Nov 29 17:47:17 user nova-compute[74613]:       <machine maxCpus='1'>mps2-an500</machine>
Nov 29 17:47:17 user nova-compute[74613]:       <machine maxCpus='255'>virt-2.12</machine>
Nov 29 17:47:17 user nova-compute[74613]:       <machine maxCpus='2'>mps2-an521</machine>
Nov 29 17:47:17 user nova-compute[74613]:       <machine maxCpus='4'>sabrelite</machine>
Nov 29 17:47:17 user nova-compute[74613]:       <machine maxCpus='1'>mps2-an511</machine>
Nov 29 17:47:17 user nova-compute[74613]:       <machine maxCpus='1'>canon-a1100</machine>
Nov 29 17:47:17 user nova-compute[74613]:       <machine maxCpus='1'>realview-eb</machine>
Nov 29 17:47:17 user nova-compute[74613]:       <machine maxCpus='2'>quanta-gbs-bmc</machine>
Nov 29 17:47:17 user nova-compute[74613]:       <machine maxCpus='1'>emcraft-sf2</machine>
Nov 29 17:47:17 user nova-compute[74613]:       <machine maxCpus='1'>realview-pb-a8</machine>
Nov 29 17:47:17 user nova-compute[74613]:       <machine maxCpus='512'>sbsa-ref</machine>
Nov 29 17:47:17 user nova-compute[74613]:       <machine maxCpus='512'>virt-4.0</machine>
Nov 29 17:47:17 user nova-compute[74613]:       <machine maxCpus='1'>raspi1ap</machine>
Nov 29 17:47:17 user nova-compute[74613]:       <machine maxCpus='1'>palmetto-bmc</machine>
Nov 29 17:47:17 user nova-compute[74613]:       <machine maxCpus='1'>sx1-v1</machine>
Nov 29 17:47:17 user nova-compute[74613]:       <machine maxCpus='1'>n810</machine>
Nov 29 17:47:17 user nova-compute[74613]:       <machine maxCpus='1'>g220a-bmc</machine>
Nov 29 17:47:17 user nova-compute[74613]:       <machine maxCpus='1'>n800</machine>
Nov 29 17:47:17 user nova-compute[74613]:       <machine maxCpus='2'>tacoma-bmc</machine>
Nov 29 17:47:17 user nova-compute[74613]:       <machine maxCpus='512'>virt-4.1</machine>
Nov 29 17:47:17 user nova-compute[74613]:       <machine maxCpus='2'>quanta-gsj</machine>
Nov 29 17:47:17 user nova-compute[74613]:       <machine maxCpus='1'>versatilepb</machine>
Nov 29 17:47:17 user nova-compute[74613]:       <machine maxCpus='1'>terrier</machine>
Nov 29 17:47:17 user nova-compute[74613]:       <machine maxCpus='1'>mainstone</machine>
Nov 29 17:47:17 user nova-compute[74613]:       <machine maxCpus='4'>realview-eb-mpcore</machine>
Nov 29 17:47:17 user nova-compute[74613]:       <machine maxCpus='1'>supermicrox11-bmc</machine>
Nov 29 17:47:17 user nova-compute[74613]:       <machine maxCpus='512'>virt-4.2</machine>
Nov 29 17:47:17 user nova-compute[74613]:       <machine maxCpus='1'>witherspoon-bmc</machine>
Nov 29 17:47:17 user nova-compute[74613]:       <machine maxCpus='2'>mps3-an524</machine>
Nov 29 17:47:17 user nova-compute[74613]:       <machine maxCpus='1' deprecated='yes'>swift-bmc</machine>
Nov 29 17:47:17 user nova-compute[74613]:       <machine maxCpus='2'>kudo-bmc</machine>
Nov 29 17:47:17 user nova-compute[74613]:       <machine maxCpus='4'>vexpress-a9</machine>
Nov 29 17:47:17 user nova-compute[74613]:       <machine maxCpus='4'>midway</machine>
Nov 29 17:47:17 user nova-compute[74613]:       <machine maxCpus='1'>musicpal</machine>
Nov 29 17:47:17 user nova-compute[74613]:       <machine maxCpus='1'>lm3s811evb</machine>
Nov 29 17:47:17 user nova-compute[74613]:       <machine maxCpus='1'>lm3s6965evb</machine>
Nov 29 17:47:17 user nova-compute[74613]:       <machine maxCpus='1'>microbit</machine>
Nov 29 17:47:17 user nova-compute[74613]:       <machine maxCpus='1'>mps2-an505</machine>
Nov 29 17:47:17 user nova-compute[74613]:       <machine maxCpus='1'>mps2-an385</machine>
Nov 29 17:47:17 user nova-compute[74613]:       <machine maxCpus='512'>virt-6.0</machine>
Nov 29 17:47:17 user nova-compute[74613]:       <machine maxCpus='4'>raspi3ap</machine>
Nov 29 17:47:17 user nova-compute[74613]:       <machine maxCpus='1'>cubieboard</machine>
Nov 29 17:47:17 user nova-compute[74613]:       <machine maxCpus='1'>verdex</machine>
Nov 29 17:47:17 user nova-compute[74613]:       <machine maxCpus='1'>netduino2</machine>
Nov 29 17:47:17 user nova-compute[74613]:       <machine maxCpus='2'>xlnx-versal-virt</machine>
Nov 29 17:47:17 user nova-compute[74613]:       <machine maxCpus='1'>mps2-an386</machine>
Nov 29 17:47:17 user nova-compute[74613]:       <machine maxCpus='512'>virt-6.1</machine>
Nov 29 17:47:17 user nova-compute[74613]:       <machine maxCpus='4'>raspi3b</machine>
Nov 29 17:47:17 user nova-compute[74613]:       <machine maxCpus='4'>raspi2b</machine>
Nov 29 17:47:17 user nova-compute[74613]:       <machine maxCpus='4'>vexpress-a15</machine>
Nov 29 17:47:17 user nova-compute[74613]:       <machine maxCpus='2'>fuji-bmc</machine>
Nov 29 17:47:17 user nova-compute[74613]:       <machine maxCpus='512'>virt-6.2</machine>
Nov 29 17:47:17 user nova-compute[74613]:       <machine canonical='virt-6.2' maxCpus='512'>virt</machine>
Nov 29 17:47:17 user nova-compute[74613]:       <machine maxCpus='1'>sonorapass-bmc</machine>
Nov 29 17:47:17 user nova-compute[74613]:       <machine maxCpus='1'>cheetah</machine>
Nov 29 17:47:17 user nova-compute[74613]:       <machine maxCpus='255'>virt-2.6</machine>
Nov 29 17:47:17 user nova-compute[74613]:       <machine maxCpus='1'>ast2500-evb</machine>
Nov 29 17:47:17 user nova-compute[74613]:       <machine maxCpus='4'>highbank</machine>
Nov 29 17:47:17 user nova-compute[74613]:       <machine maxCpus='1'>akita</machine>
Nov 29 17:47:17 user nova-compute[74613]:       <machine maxCpus='1'>connex</machine>
Nov 29 17:47:17 user nova-compute[74613]:       <machine maxCpus='1'>netduinoplus2</machine>
Nov 29 17:47:17 user nova-compute[74613]:       <machine maxCpus='1'>collie</machine>
Nov 29 17:47:17 user nova-compute[74613]:       <machine maxCpus='1'>raspi0</machine>
Nov 29 17:47:17 user nova-compute[74613]:       <machine maxCpus='1'>fp5280g2-bmc</machine>
Nov 29 17:47:17 user nova-compute[74613]:       <domain type='qemu'/>
Nov 29 17:47:17 user nova-compute[74613]:     </arch>
Nov 29 17:47:17 user nova-compute[74613]:     <features>
Nov 29 17:47:17 user nova-compute[74613]:       <acpi default='on' toggle='yes'/>
Nov 29 17:47:17 user nova-compute[74613]:       <cpuselection/>
Nov 29 17:47:17 user nova-compute[74613]:       <deviceboot/>
Nov 29 17:47:17 user nova-compute[74613]:       <disksnapshot default='on' toggle='no'/>
Nov 29 17:47:17 user nova-compute[74613]:     </features>
Nov 29 17:47:17 user nova-compute[74613]:   </guest>
Nov 29 17:47:17 user nova-compute[74613]:   <guest>
Nov 29 17:47:17 user nova-compute[74613]:     <os_type>hvm</os_type>
Nov 29 17:47:17 user nova-compute[74613]:     <arch name='cris'>
Nov 29 17:47:17 user nova-compute[74613]:       <wordsize>32</wordsize>
Nov 29 17:47:17 user nova-compute[74613]:       <emulator>/usr/bin/qemu-system-cris</emulator>
Nov 29 17:47:17 user nova-compute[74613]:       <machine maxCpus='1'>axis-dev88</machine>
Nov 29 17:47:17 user nova-compute[74613]:       <domain type='qemu'/>
Nov 29 17:47:17 user nova-compute[74613]:     </arch>
Nov 29 17:47:17 user nova-compute[74613]:     <features>
Nov 29 17:47:17 user nova-compute[74613]:       <cpuselection/>
Nov 29 17:47:17 user nova-compute[74613]:       <deviceboot/>
Nov 29 17:47:17 user nova-compute[74613]:       <disksnapshot default='on' toggle='no'/>
Nov 29 17:47:17 user nova-compute[74613]:     </features>
Nov 29 17:47:17 user nova-compute[74613]:   </guest>
Nov 29 17:47:17 user nova-compute[74613]:   <guest>
Nov 29 17:47:17 user nova-compute[74613]:     <os_type>hvm</os_type>
Nov 29 17:47:17 user nova-compute[74613]:     <arch name='i686'>
Nov 29 17:47:17 user nova-compute[74613]:       <wordsize>32</wordsize>
Nov 29 17:47:17 user nova-compute[74613]:       <emulator>/usr/bin/qemu-system-i386</emulator>
Nov 29 17:47:17 user nova-compute[74613]:       <machine maxCpus='255'>pc-i440fx-jammy</machine>
Nov 29 17:47:17 user nova-compute[74613]:       <machine canonical='pc-i440fx-jammy' maxCpus='255'>ubuntu</machine>
Nov 29 17:47:17 user nova-compute[74613]:       <machine maxCpus='255'>pc-i440fx-impish-hpb</machine>
Nov 29 17:47:17 user nova-compute[74613]:       <machine maxCpus='288'>pc-q35-5.2</machine>
Nov 29 17:47:17 user nova-compute[74613]:       <machine maxCpus='255'>pc-i440fx-2.12</machine>
Nov 29 17:47:17 user nova-compute[74613]:       <machine maxCpus='255'>pc-i440fx-2.0</machine>
Nov 29 17:47:17 user nova-compute[74613]:       <machine maxCpus='255'>pc-i440fx-xenial</machine>
Nov 29 17:47:17 user nova-compute[74613]:       <machine maxCpus='255'>pc-i440fx-6.2</machine>
Nov 29 17:47:17 user nova-compute[74613]:       <machine canonical='pc-i440fx-6.2' maxCpus='255'>pc</machine>
Nov 29 17:47:17 user nova-compute[74613]:       <machine maxCpus='288'>pc-q35-4.2</machine>
Nov 29 17:47:17 user nova-compute[74613]:       <machine maxCpus='255'>pc-i440fx-2.5</machine>
Nov 29 17:47:17 user nova-compute[74613]:       <machine maxCpus='255'>pc-i440fx-4.2</machine>
Nov 29 17:47:17 user nova-compute[74613]:       <machine maxCpus='255'>pc-i440fx-focal</machine>
Nov 29 17:47:17 user nova-compute[74613]:       <machine maxCpus='255'>pc-i440fx-hirsute</machine>
Nov 29 17:47:17 user nova-compute[74613]:       <machine maxCpus='255'>pc-q35-xenial</machine>
Nov 29 17:47:17 user nova-compute[74613]:       <machine maxCpus='255'>pc-i440fx-jammy-hpb</machine>
Nov 29 17:47:17 user nova-compute[74613]:       <machine maxCpus='255'>pc-i440fx-5.2</machine>
Nov 29 17:47:17 user nova-compute[74613]:       <machine maxCpus='255'>pc-i440fx-1.5</machine>
Nov 29 17:47:17 user nova-compute[74613]:       <machine maxCpus='255'>pc-q35-2.7</machine>
Nov 29 17:47:17 user nova-compute[74613]:       <machine maxCpus='288'>pc-q35-eoan-hpb</machine>
Nov 29 17:47:17 user nova-compute[74613]:       <machine maxCpus='255'>pc-i440fx-zesty</machine>
Nov 29 17:47:17 user nova-compute[74613]:       <machine maxCpus='255'>pc-i440fx-disco-hpb</machine>
Nov 29 17:47:17 user nova-compute[74613]:       <machine maxCpus='288'>pc-q35-groovy</machine>
Nov 29 17:47:17 user nova-compute[74613]:       <machine maxCpus='255'>pc-i440fx-groovy</machine>
Nov 29 17:47:17 user nova-compute[74613]:       <machine maxCpus='288'>pc-q35-artful</machine>
Nov 29 17:47:17 user nova-compute[74613]:       <machine maxCpus='255'>pc-i440fx-2.2</machine>
Nov 29 17:47:17 user nova-compute[74613]:       <machine maxCpus='255'>pc-i440fx-trusty</machine>
Nov 29 17:47:17 user nova-compute[74613]:       <machine maxCpus='255'>pc-i440fx-eoan-hpb</machine>
Nov 29 17:47:17 user nova-compute[74613]:       <machine maxCpus='288'>pc-q35-focal-hpb</machine>
Nov 29 17:47:17 user nova-compute[74613]:       <machine maxCpus='288'>pc-q35-bionic-hpb</machine>
Nov 29 17:47:17 user nova-compute[74613]:       <machine maxCpus='255'>pc-i440fx-artful</machine>
Nov 29 17:47:17 user nova-compute[74613]:       <machine maxCpus='255'>pc-i440fx-2.7</machine>
Nov 29 17:47:17 user nova-compute[74613]:       <machine maxCpus='288'>pc-q35-6.1</machine>
Nov 29 17:47:17 user nova-compute[74613]:       <machine maxCpus='255'>pc-i440fx-yakkety</machine>
Nov 29 17:47:17 user nova-compute[74613]:       <machine maxCpus='255'>pc-q35-2.4</machine>
Nov 29 17:47:17 user nova-compute[74613]:       <machine maxCpus='288'>pc-q35-cosmic-hpb</machine>
Nov 29 17:47:17 user nova-compute[74613]:       <machine maxCpus='288'>pc-q35-2.10</machine>
Nov 29 17:47:17 user nova-compute[74613]:       <machine maxCpus='1'>x-remote</machine>
Nov 29 17:47:17 user nova-compute[74613]:       <machine maxCpus='288'>pc-q35-5.1</machine>
Nov 29 17:47:17 user nova-compute[74613]:       <machine maxCpus='255'>pc-i440fx-1.7</machine>
Nov 29 17:47:17 user nova-compute[74613]:       <machine maxCpus='288'>pc-q35-2.9</machine>
Nov 29 17:47:17 user nova-compute[74613]:       <machine maxCpus='255'>pc-i440fx-2.11</machine>
Nov 29 17:47:17 user nova-compute[74613]:       <machine maxCpus='288'>pc-q35-3.1</machine>
Nov 29 17:47:17 user nova-compute[74613]:       <machine maxCpus='255'>pc-i440fx-6.1</machine>
Nov 29 17:47:17 user nova-compute[74613]:       <machine maxCpus='288'>pc-q35-4.1</machine>
Nov 29 17:47:17 user nova-compute[74613]:       <machine maxCpus='288'>pc-q35-jammy</machine>
Nov 29 17:47:17 user nova-compute[74613]:       <machine canonical='pc-q35-jammy' maxCpus='288'>ubuntu-q35</machine>
Nov 29 17:47:17 user nova-compute[74613]:       <machine maxCpus='255'>pc-i440fx-2.4</machine>
Nov 29 17:47:17 user nova-compute[74613]:       <machine maxCpus='255'>pc-i440fx-4.1</machine>
Nov 29 17:47:17 user nova-compute[74613]:       <machine maxCpus='288'>pc-q35-eoan</machine>
Nov 29 17:47:17 user nova-compute[74613]:       <machine maxCpus='288'>pc-q35-jammy-hpb</machine>
Nov 29 17:47:17 user nova-compute[74613]:       <machine maxCpus='255'>pc-i440fx-5.1</machine>
Nov 29 17:47:17 user nova-compute[74613]:       <machine maxCpus='255'>pc-i440fx-2.9</machine>
Nov 29 17:47:17 user nova-compute[74613]:       <machine maxCpus='255'>pc-i440fx-bionic-hpb</machine>
Nov 29 17:47:17 user nova-compute[74613]:       <machine maxCpus='1'>isapc</machine>
Nov 29 17:47:17 user nova-compute[74613]:       <machine maxCpus='255'>pc-i440fx-1.4</machine>
Nov 29 17:47:17 user nova-compute[74613]:       <machine maxCpus='288'>pc-q35-cosmic</machine>
Nov 29 17:47:17 user nova-compute[74613]:       <machine maxCpus='255'>pc-q35-2.6</machine>
Nov 29 17:47:17 user nova-compute[74613]:       <machine maxCpus='255'>pc-i440fx-3.1</machine>
Nov 29 17:47:17 user nova-compute[74613]:       <machine maxCpus='288'>pc-q35-bionic</machine>
Nov 29 17:47:17 user nova-compute[74613]:       <machine maxCpus='288'>pc-q35-disco-hpb</machine>
Nov 29 17:47:17 user nova-compute[74613]:       <machine maxCpus='255'>pc-i440fx-cosmic</machine>
Nov 29 17:47:17 user nova-compute[74613]:       <machine maxCpus='288'>pc-q35-2.12</machine>
Nov 29 17:47:17 user nova-compute[74613]:       <machine maxCpus='255'>pc-i440fx-bionic</machine>
Nov 29 17:47:17 user nova-compute[74613]:       <machine maxCpus='288'>pc-q35-groovy-hpb</machine>
Nov 29 17:47:17 user nova-compute[74613]:       <machine maxCpus='288'>pc-q35-disco</machine>
Nov 29 17:47:17 user nova-compute[74613]:       <machine maxCpus='255'>pc-i440fx-cosmic-hpb</machine>
Nov 29 17:47:17 user nova-compute[74613]:       <machine maxCpus='255'>pc-i440fx-2.1</machine>
Nov 29 17:47:17 user nova-compute[74613]:       <machine maxCpus='255'>pc-i440fx-wily</machine>
Nov 29 17:47:17 user nova-compute[74613]:       <machine maxCpus='288'>pc-q35-impish</machine>
Nov 29 17:47:17 user nova-compute[74613]:       <machine maxCpus='288'>pc-q35-6.0</machine>
Nov 29 17:47:17 user nova-compute[74613]:       <machine maxCpus='255'>pc-i440fx-impish</machine>
Nov 29 17:47:17 user nova-compute[74613]:       <machine maxCpus='255'>pc-i440fx-2.6</machine>
Nov 29 17:47:17 user nova-compute[74613]:       <machine maxCpus='288'>pc-q35-impish-hpb</machine>
Nov 29 17:47:17 user nova-compute[74613]:       <machine maxCpus='288'>pc-q35-hirsute</machine>
Nov 29 17:47:17 user nova-compute[74613]:       <machine maxCpus='288'>pc-q35-4.0.1</machine>
Nov 29 17:47:17 user nova-compute[74613]:       <machine maxCpus='288'>pc-q35-hirsute-hpb</machine>
Nov 29 17:47:17 user nova-compute[74613]:       <machine maxCpus='255'>pc-i440fx-1.6</machine>
Nov 29 17:47:17 user nova-compute[74613]:       <machine maxCpus='288'>pc-q35-5.0</machine>
Nov 29 17:47:17 user nova-compute[74613]:       <machine maxCpus='288'>pc-q35-2.8</machine>
Nov 29 17:47:17 user nova-compute[74613]:       <machine maxCpus='255'>pc-i440fx-2.10</machine>
Nov 29 17:47:17 user nova-compute[74613]:       <machine maxCpus='288'>pc-q35-3.0</machine>
Nov 29 17:47:17 user nova-compute[74613]:       <machine maxCpus='255'>pc-i440fx-6.0</machine>
Nov 29 17:47:17 user nova-compute[74613]:       <machine maxCpus='288'>pc-q35-zesty</machine>
Nov 29 17:47:17 user nova-compute[74613]:       <machine maxCpus='288'>pc-q35-4.0</machine>
Nov 29 17:47:17 user nova-compute[74613]:       <machine maxCpus='288'>pc-q35-focal</machine>
Nov 29 17:47:17 user nova-compute[74613]:       <machine maxCpus='288'>microvm</machine>
Nov 29 17:47:17 user nova-compute[74613]:       <machine maxCpus='255'>pc-i440fx-2.3</machine>
Nov 29 17:47:17 user nova-compute[74613]:       <machine maxCpus='255'>pc-i440fx-focal-hpb</machine>
Nov 29 17:47:17 user nova-compute[74613]:       <machine maxCpus='255'>pc-i440fx-disco</machine>
Nov 29 17:47:17 user nova-compute[74613]:       <machine maxCpus='255'>pc-i440fx-4.0</machine>
Nov 29 17:47:17 user nova-compute[74613]:       <machine maxCpus='255'>pc-i440fx-groovy-hpb</machine>
Nov 29 17:47:17 user nova-compute[74613]:       <machine maxCpus='255'>pc-i440fx-hirsute-hpb</machine>
Nov 29 17:47:17 user nova-compute[74613]:       <machine maxCpus='255'>pc-i440fx-5.0</machine>
Nov 29 17:47:17 user nova-compute[74613]:       <machine maxCpus='288'>pc-q35-6.2</machine>
Nov 29 17:47:17 user nova-compute[74613]:       <machine canonical='pc-q35-6.2' maxCpus='288'>q35</machine>
Nov 29 17:47:17 user nova-compute[74613]:       <machine maxCpus='255'>pc-i440fx-2.8</machine>
Nov 29 17:47:17 user nova-compute[74613]:       <machine maxCpus='255'>pc-i440fx-eoan</machine>
Nov 29 17:47:17 user nova-compute[74613]:       <machine maxCpus='255'>pc-q35-2.5</machine>
Nov 29 17:47:17 user nova-compute[74613]:       <machine maxCpus='255'>pc-i440fx-3.0</machine>
Nov 29 17:47:17 user nova-compute[74613]:       <machine maxCpus='255'>pc-q35-yakkety</machine>
Nov 29 17:47:17 user nova-compute[74613]:       <machine maxCpus='288'>pc-q35-2.11</machine>
Nov 29 17:47:17 user nova-compute[74613]:       <domain type='qemu'/>
Nov 29 17:47:17 user nova-compute[74613]:       <domain type='kvm'/>
Nov 29 17:47:17 user nova-compute[74613]:     </arch>
Nov 29 17:47:17 user nova-compute[74613]:     <features>
Nov 29 17:47:17 user nova-compute[74613]:       <pae/>
Nov 29 17:47:17 user nova-compute[74613]:       <nonpae/>
Nov 29 17:47:17 user nova-compute[74613]:       <acpi default='on' toggle='yes'/>
Nov 29 17:47:17 user nova-compute[74613]:       <apic default='on' toggle='no'/>
Nov 29 17:47:17 user nova-compute[74613]:       <cpuselection/>
Nov 29 17:47:17 user nova-compute[74613]:       <deviceboot/>
Nov 29 17:47:17 user nova-compute[74613]:       <disksnapshot default='on' toggle='no'/>
Nov 29 17:47:17 user nova-compute[74613]:     </features>
Nov 29 17:47:17 user nova-compute[74613]:   </guest>
Nov 29 17:47:17 user nova-compute[74613]:   <guest>
Nov 29 17:47:17 user nova-compute[74613]:     <os_type>hvm</os_type>
Nov 29 17:47:17 user nova-compute[74613]:     <arch name='m68k'>
Nov 29 17:47:17 user nova-compute[74613]:       <wordsize>32</wordsize>
Nov 29 17:47:17 user nova-compute[74613]:       <emulator>/usr/bin/qemu-system-m68k</emulator>
Nov 29 17:47:17 user nova-compute[74613]:       <machine maxCpus='1'>mcf5208evb</machine>
Nov 29 17:47:17 user nova-compute[74613]:       <machine maxCpus='1'>an5206</machine>
Nov 29 17:47:17 user nova-compute[74613]:       <machine maxCpus='1'>virt-6.0</machine>
Nov 29 17:47:17 user nova-compute[74613]:       <machine maxCpus='1'>q800</machine>
Nov 29 17:47:17 user nova-compute[74613]:       <machine maxCpus='1'>virt-6.2</machine>
Nov 29 17:47:17 user nova-compute[74613]:       <machine canonical='virt-6.2' maxCpus='1'>virt</machine>
Nov 29 17:47:17 user nova-compute[74613]:       <machine maxCpus='1'>next-cube</machine>
Nov 29 17:47:17 user nova-compute[74613]:       <machine maxCpus='1'>virt-6.1</machine>
Nov 29 17:47:17 user nova-compute[74613]:       <domain type='qemu'/>
Nov 29 17:47:17 user nova-compute[74613]:     </arch>
Nov 29 17:47:17 user nova-compute[74613]:     <features>
Nov 29 17:47:17 user nova-compute[74613]:       <cpuselection/>
Nov 29 17:47:17 user nova-compute[74613]:       <deviceboot/>
Nov 29 17:47:17 user nova-compute[74613]:       <disksnapshot default='on' toggle='no'/>
Nov 29 17:47:17 user nova-compute[74613]:     </features>
Nov 29 17:47:17 user nova-compute[74613]:   </guest>
Nov 29 17:47:17 user nova-compute[74613]:   <guest>
Nov 29 17:47:17 user nova-compute[74613]:     <os_type>hvm</os_type>
Nov 29 17:47:17 user nova-compute[74613]:     <arch name='microblaze'>
Nov 29 17:47:17 user nova-compute[74613]:       <wordsize>32</wordsize>
Nov 29 17:47:17 user nova-compute[74613]:       <emulator>/usr/bin/qemu-system-microblaze</emulator>
Nov 29 17:47:17 user nova-compute[74613]:       <machine maxCpus='1'>petalogix-s3adsp1800</machine>
Nov 29 17:47:17 user nova-compute[74613]:       <machine maxCpus='1'>petalogix-ml605</machine>
Nov 29 17:47:17 user nova-compute[74613]:       <machine maxCpus='1'>xlnx-zynqmp-pmu</machine>
Nov 29 17:47:17 user nova-compute[74613]:       <domain type='qemu'/>
Nov 29 17:47:17 user nova-compute[74613]:     </arch>
Nov 29 17:47:17 user nova-compute[74613]:     <features>
Nov 29 17:47:17 user nova-compute[74613]:       <cpuselection/>
Nov 29 17:47:17 user nova-compute[74613]:       <deviceboot/>
Nov 29 17:47:17 user nova-compute[74613]:       <disksnapshot default='on' toggle='no'/>
Nov 29 17:47:17 user nova-compute[74613]:     </features>
Nov 29 17:47:17 user nova-compute[74613]:   </guest>
Nov 29 17:47:17 user nova-compute[74613]:   <guest>
Nov 29 17:47:17 user nova-compute[74613]:     <os_type>hvm</os_type>
Nov 29 17:47:17 user nova-compute[74613]:     <arch name='microblazeel'>
Nov 29 17:47:17 user nova-compute[74613]:       <wordsize>32</wordsize>
Nov 29 17:47:17 user nova-compute[74613]:       <emulator>/usr/bin/qemu-system-microblazeel</emulator>
Nov 29 17:47:17 user nova-compute[74613]:       <machine maxCpus='1'>petalogix-s3adsp1800</machine>
Nov 29 17:47:17 user nova-compute[74613]:       <machine maxCpus='1'>petalogix-ml605</machine>
Nov 29 17:47:17 user nova-compute[74613]:       <machine maxCpus='1'>xlnx-zynqmp-pmu</machine>
Nov 29 17:47:17 user nova-compute[74613]:       <domain type='qemu'/>
Nov 29 17:47:17 user nova-compute[74613]:     </arch>
Nov 29 17:47:17 user nova-compute[74613]:     <features>
Nov 29 17:47:17 user nova-compute[74613]:       <cpuselection/>
Nov 29 17:47:17 user nova-compute[74613]:       <deviceboot/>
Nov 29 17:47:17 user nova-compute[74613]:       <disksnapshot default='on' toggle='no'/>
Nov 29 17:47:17 user nova-compute[74613]:     </features>
Nov 29 17:47:17 user nova-compute[74613]:   </guest>
Nov 29 17:47:17 user nova-compute[74613]:   <guest>
Nov 29 17:47:17 user nova-compute[74613]:     <os_type>hvm</os_type>
Nov 29 17:47:17 user nova-compute[74613]:     <arch name='mips'>
Nov 29 17:47:17 user nova-compute[74613]:       <wordsize>32</wordsize>
Nov 29 17:47:17 user nova-compute[74613]:       <emulator>/usr/bin/qemu-system-mips</emulator>
Nov 29 17:47:17 user nova-compute[74613]:       <machine maxCpus='16'>malta</machine>
Nov 29 17:47:17 user nova-compute[74613]:       <machine maxCpus='1'>mipssim</machine>
Nov 29 17:47:17 user nova-compute[74613]:       <domain type='qemu'/>
Nov 29 17:47:17 user nova-compute[74613]:     </arch>
Nov 29 17:47:17 user nova-compute[74613]:     <features>
Nov 29 17:47:17 user nova-compute[74613]:       <cpuselection/>
Nov 29 17:47:17 user nova-compute[74613]:       <deviceboot/>
Nov 29 17:47:17 user nova-compute[74613]:       <disksnapshot default='on' toggle='no'/>
Nov 29 17:47:17 user nova-compute[74613]:     </features>
Nov 29 17:47:17 user nova-compute[74613]:   </guest>
Nov 29 17:47:17 user nova-compute[74613]:   <guest>
Nov 29 17:47:17 user nova-compute[74613]:     <os_type>hvm</os_type>
Nov 29 17:47:17 user nova-compute[74613]:     <arch name='mipsel'>
Nov 29 17:47:17 user nova-compute[74613]:       <wordsize>32</wordsize>
Nov 29 17:47:17 user nova-compute[74613]:       <emulator>/usr/bin/qemu-system-mipsel</emulator>
Nov 29 17:47:17 user nova-compute[74613]:       <machine maxCpus='16'>malta</machine>
Nov 29 17:47:17 user nova-compute[74613]:       <machine maxCpus='1'>mipssim</machine>
Nov 29 17:47:17 user nova-compute[74613]:       <domain type='qemu'/>
Nov 29 17:47:17 user nova-compute[74613]:     </arch>
Nov 29 17:47:17 user nova-compute[74613]:     <features>
Nov 29 17:47:17 user nova-compute[74613]:       <cpuselection/>
Nov 29 17:47:17 user nova-compute[74613]:       <deviceboot/>
Nov 29 17:47:17 user nova-compute[74613]:       <disksnapshot default='on' toggle='no'/>
Nov 29 17:47:17 user nova-compute[74613]:     </features>
Nov 29 17:47:17 user nova-compute[74613]:   </guest>
Nov 29 17:47:17 user nova-compute[74613]:   <guest>
Nov 29 17:47:17 user nova-compute[74613]:     <os_type>hvm</os_type>
Nov 29 17:47:17 user nova-compute[74613]:     <arch name='mips64'>
Nov 29 17:47:17 user nova-compute[74613]:       <wordsize>64</wordsize>
Nov 29 17:47:17 user nova-compute[74613]:       <emulator>/usr/bin/qemu-system-mips64</emulator>
Nov 29 17:47:17 user nova-compute[74613]:       <machine maxCpus='16'>malta</machine>
Nov 29 17:47:17 user nova-compute[74613]:       <machine maxCpus='1'>mipssim</machine>
Nov 29 17:47:17 user nova-compute[74613]:       <machine maxCpus='1'>pica61</machine>
Nov 29 17:47:17 user nova-compute[74613]:       <machine maxCpus='1'>magnum</machine>
Nov 29 17:47:17 user nova-compute[74613]:       <domain type='qemu'/>
Nov 29 17:47:17 user nova-compute[74613]:     </arch>
Nov 29 17:47:17 user nova-compute[74613]:     <features>
Nov 29 17:47:17 user nova-compute[74613]:       <cpuselection/>
Nov 29 17:47:17 user nova-compute[74613]:       <deviceboot/>
Nov 29 17:47:17 user nova-compute[74613]:       <disksnapshot default='on' toggle='no'/>
Nov 29 17:47:17 user nova-compute[74613]:     </features>
Nov 29 17:47:17 user nova-compute[74613]:   </guest>
Nov 29 17:47:17 user nova-compute[74613]:   <guest>
Nov 29 17:47:17 user nova-compute[74613]:     <os_type>hvm</os_type>
Nov 29 17:47:17 user nova-compute[74613]:     <arch name='mips64el'>
Nov 29 17:47:17 user nova-compute[74613]:       <wordsize>64</wordsize>
Nov 29 17:47:17 user nova-compute[74613]:       <emulator>/usr/bin/qemu-system-mips64el</emulator>
Nov 29 17:47:17 user nova-compute[74613]:       <machine maxCpus='16'>malta</machine>
Nov 29 17:47:17 user nova-compute[74613]:       <machine maxCpus='16'>loongson3-virt</machine>
Nov 29 17:47:17 user nova-compute[74613]:       <machine maxCpus='1'>mipssim</machine>
Nov 29 17:47:17 user nova-compute[74613]:       <machine maxCpus='1'>pica61</machine>
Nov 29 17:47:17 user nova-compute[74613]:       <machine maxCpus='1'>magnum</machine>
Nov 29 17:47:17 user nova-compute[74613]:       <machine maxCpus='16'>boston</machine>
Nov 29 17:47:17 user nova-compute[74613]:       <machine maxCpus='1'>fuloong2e</machine>
Nov 29 17:47:17 user nova-compute[74613]:       <domain type='qemu'/>
Nov 29 17:47:17 user nova-compute[74613]:     </arch>
Nov 29 17:47:17 user nova-compute[74613]:     <features>
Nov 29 17:47:17 user nova-compute[74613]:       <cpuselection/>
Nov 29 17:47:17 user nova-compute[74613]:       <deviceboot/>
Nov 29 17:47:17 user nova-compute[74613]:       <disksnapshot default='on' toggle='no'/>
Nov 29 17:47:17 user nova-compute[74613]:     </features>
Nov 29 17:47:17 user nova-compute[74613]:   </guest>
Nov 29 17:47:17 user nova-compute[74613]:   <guest>
Nov 29 17:47:17 user nova-compute[74613]:     <os_type>hvm</os_type>
Nov 29 17:47:17 user nova-compute[74613]:     <arch name='ppc'>
Nov 29 17:47:17 user nova-compute[74613]:       <wordsize>32</wordsize>
Nov 29 17:47:17 user nova-compute[74613]:       <emulator>/usr/bin/qemu-system-ppc</emulator>
Nov 29 17:47:17 user nova-compute[74613]:       <machine maxCpus='1'>g3beige</machine>
Nov 29 17:47:17 user nova-compute[74613]:       <machine maxCpus='1'>virtex-ml507</machine>
Nov 29 17:47:17 user nova-compute[74613]:       <machine maxCpus='1'>mac99</machine>
Nov 29 17:47:17 user nova-compute[74613]:       <machine maxCpus='32'>ppce500</machine>
Nov 29 17:47:17 user nova-compute[74613]:       <machine maxCpus='1'>pegasos2</machine>
Nov 29 17:47:17 user nova-compute[74613]:       <machine maxCpus='1'>sam460ex</machine>
Nov 29 17:47:17 user nova-compute[74613]:       <machine maxCpus='1'>bamboo</machine>
Nov 29 17:47:17 user nova-compute[74613]:       <machine maxCpus='1'>40p</machine>
Nov 29 17:47:17 user nova-compute[74613]:       <machine maxCpus='1'>ref405ep</machine>
Nov 29 17:47:17 user nova-compute[74613]:       <machine maxCpus='15'>mpc8544ds</machine>
Nov 29 17:47:17 user nova-compute[74613]:       <machine maxCpus='1'>taihu</machine>
Nov 29 17:47:17 user nova-compute[74613]:       <domain type='qemu'/>
Nov 29 17:47:17 user nova-compute[74613]:     </arch>
Nov 29 17:47:17 user nova-compute[74613]:     <features>
Nov 29 17:47:17 user nova-compute[74613]:       <cpuselection/>
Nov 29 17:47:17 user nova-compute[74613]:       <deviceboot/>
Nov 29 17:47:17 user nova-compute[74613]:       <disksnapshot default='on' toggle='no'/>
Nov 29 17:47:17 user nova-compute[74613]:     </features>
Nov 29 17:47:17 user nova-compute[74613]:   </guest>
Nov 29 17:47:17 user nova-compute[74613]:   <guest>
Nov 29 17:47:17 user nova-compute[74613]:     <os_type>hvm</os_type>
Nov 29 17:47:17 user nova-compute[74613]:     <arch name='ppc64'>
Nov 29 17:47:17 user nova-compute[74613]:       <wordsize>64</wordsize>
Nov 29 17:47:17 user nova-compute[74613]:       <emulator>/usr/bin/qemu-system-ppc64</emulator>
Nov 29 17:47:17 user nova-compute[74613]:       <machine maxCpus='2147483647'>pseries-jammy</machine>
Nov 29 17:47:17 user nova-compute[74613]:       <machine canonical='pseries-jammy' maxCpus='2147483647'>pseries</machine>
Nov 29 17:47:17 user nova-compute[74613]:       <machine maxCpus='2048'>powernv9</machine>
Nov 29 17:47:17 user nova-compute[74613]:       <machine canonical='powernv9' maxCpus='2048'>powernv</machine>
Nov 29 17:47:17 user nova-compute[74613]:       <machine maxCpus='1'>taihu</machine>
Nov 29 17:47:17 user nova-compute[74613]:       <machine maxCpus='2147483647'>pseries-4.1</machine>
Nov 29 17:47:17 user nova-compute[74613]:       <machine maxCpus='15'>mpc8544ds</machine>
Nov 29 17:47:17 user nova-compute[74613]:       <machine maxCpus='2147483647'>pseries-6.1</machine>
Nov 29 17:47:17 user nova-compute[74613]:       <machine maxCpus='2147483647'>pseries-2.5</machine>
Nov 29 17:47:17 user nova-compute[74613]:       <machine maxCpus='2048'>powernv10</machine>
Nov 29 17:47:17 user nova-compute[74613]:       <machine maxCpus='2147483647'>pseries-xenial</machine>
Nov 29 17:47:17 user nova-compute[74613]:       <machine maxCpus='2147483647'>pseries-4.2</machine>
Nov 29 17:47:17 user nova-compute[74613]:       <machine maxCpus='2147483647'>pseries-6.2</machine>
Nov 29 17:47:17 user nova-compute[74613]:       <machine maxCpus='2147483647'>pseries-yakkety</machine>
Nov 29 17:47:17 user nova-compute[74613]:       <machine maxCpus='2147483647'>pseries-2.6</machine>
Nov 29 17:47:17 user nova-compute[74613]:       <machine maxCpus='32'>ppce500</machine>
Nov 29 17:47:17 user nova-compute[74613]:       <machine maxCpus='2147483647'>pseries-bionic-sxxm</machine>
Nov 29 17:47:17 user nova-compute[74613]:       <machine maxCpus='2147483647'>pseries-2.7</machine>
Nov 29 17:47:17 user nova-compute[74613]:       <machine maxCpus='2147483647'>pseries-3.0</machine>
Nov 29 17:47:17 user nova-compute[74613]:       <machine maxCpus='2147483647'>pseries-5.0</machine>
Nov 29 17:47:17 user nova-compute[74613]:       <machine maxCpus='1'>40p</machine>
Nov 29 17:47:17 user nova-compute[74613]:       <machine maxCpus='2147483647'>pseries-2.8</machine>
Nov 29 17:47:17 user nova-compute[74613]:       <machine maxCpus='1'>pegasos2</machine>
Nov 29 17:47:17 user nova-compute[74613]:       <machine maxCpus='2147483647'>pseries-hirsute</machine>
Nov 29 17:47:17 user nova-compute[74613]:       <machine maxCpus='2147483647'>pseries-3.1</machine>
Nov 29 17:47:17 user nova-compute[74613]:       <machine maxCpus='2147483647'>pseries-5.1</machine>
Nov 29 17:47:17 user nova-compute[74613]:       <machine maxCpus='2147483647'>pseries-eoan</machine>
Nov 29 17:47:17 user nova-compute[74613]:       <machine maxCpus='2147483647'>pseries-2.9</machine>
Nov 29 17:47:17 user nova-compute[74613]:       <machine maxCpus='2147483647'>pseries-zesty</machine>
Nov 29 17:47:17 user nova-compute[74613]:       <machine maxCpus='1'>bamboo</machine>
Nov 29 17:47:17 user nova-compute[74613]:       <machine maxCpus='2147483647'>pseries-groovy</machine>
Nov 29 17:47:17 user nova-compute[74613]:       <machine maxCpus='2147483647'>pseries-focal</machine>
Nov 29 17:47:17 user nova-compute[74613]:       <machine maxCpus='1'>g3beige</machine>
Nov 29 17:47:17 user nova-compute[74613]:       <machine maxCpus='2147483647'>pseries-5.2</machine>
Nov 29 17:47:17 user nova-compute[74613]:       <machine maxCpus='2147483647'>pseries-disco</machine>
Nov 29 17:47:17 user nova-compute[74613]:       <machine maxCpus='2147483647'>pseries-2.12-sxxm</machine>
Nov 29 17:47:17 user nova-compute[74613]:       <machine maxCpus='2147483647'>pseries-2.10</machine>
Nov 29 17:47:17 user nova-compute[74613]:       <machine maxCpus='1'>virtex-ml507</machine>
Nov 29 17:47:17 user nova-compute[74613]:       <machine maxCpus='2147483647'>pseries-2.11</machine>
Nov 29 17:47:17 user nova-compute[74613]:       <machine maxCpus='2147483647'>pseries-2.1</machine>
Nov 29 17:47:17 user nova-compute[74613]:       <machine maxCpus='2147483647'>pseries-cosmic</machine>
Nov 29 17:47:17 user nova-compute[74613]:       <machine maxCpus='2147483647'>pseries-bionic</machine>
Nov 29 17:47:17 user nova-compute[74613]:       <machine maxCpus='2147483647'>pseries-2.12</machine>
Nov 29 17:47:17 user nova-compute[74613]:       <machine maxCpus='2147483647'>pseries-2.2</machine>
Nov 29 17:47:17 user nova-compute[74613]:       <machine maxCpus='1'>mac99</machine>
Nov 29 17:47:17 user nova-compute[74613]:       <machine maxCpus='2147483647'>pseries-impish</machine>
Nov 29 17:47:17 user nova-compute[74613]:       <machine maxCpus='2147483647'>pseries-artful</machine>
Nov 29 17:47:17 user nova-compute[74613]:       <machine maxCpus='1'>sam460ex</machine>
Nov 29 17:47:17 user nova-compute[74613]:       <machine maxCpus='1'>ref405ep</machine>
Nov 29 17:47:17 user nova-compute[74613]:       <machine maxCpus='2147483647'>pseries-2.3</machine>
Nov 29 17:47:17 user nova-compute[74613]:       <machine maxCpus='2048'>powernv8</machine>
Nov 29 17:47:17 user nova-compute[74613]:       <machine maxCpus='2147483647'>pseries-4.0</machine>
Nov 29 17:47:17 user nova-compute[74613]:       <machine maxCpus='2147483647'>pseries-6.0</machine>
Nov 29 17:47:17 user nova-compute[74613]:       <machine maxCpus='2147483647'>pseries-2.4</machine>
Nov 29 17:47:17 user nova-compute[74613]:       <domain type='qemu'/>
Nov 29 17:47:17 user nova-compute[74613]:     </arch>
Nov 29 17:47:17 user nova-compute[74613]:     <features>
Nov 29 17:47:17 user nova-compute[74613]:       <cpuselection/>
Nov 29 17:47:17 user nova-compute[74613]:       <deviceboot/>
Nov 29 17:47:17 user nova-compute[74613]:       <disksnapshot default='on' toggle='no'/>
Nov 29 17:47:17 user nova-compute[74613]:     </features>
Nov 29 17:47:17 user nova-compute[74613]:   </guest>
Nov 29 17:47:17 user nova-compute[74613]:   <guest>
Nov 29 17:47:17 user nova-compute[74613]:     <os_type>hvm</os_type>
Nov 29 17:47:17 user nova-compute[74613]:     <arch name='ppc64le'>
Nov 29 17:47:17 user nova-compute[74613]:       <wordsize>64</wordsize>
Nov 29 17:47:17 user nova-compute[74613]:       <emulator>/usr/bin/qemu-system-ppc64le</emulator>
Nov 29 17:47:17 user nova-compute[74613]:       <machine maxCpus='2147483647'>pseries-jammy</machine>
Nov 29 17:47:17 user nova-compute[74613]:       <machine canonical='pseries-jammy' maxCpus='2147483647'>pseries</machine>
Nov 29 17:47:17 user nova-compute[74613]:       <machine maxCpus='2048'>powernv9</machine>
Nov 29 17:47:17 user nova-compute[74613]:       <machine canonical='powernv9' maxCpus='2048'>powernv</machine>
Nov 29 17:47:17 user nova-compute[74613]:       <machine maxCpus='1'>taihu</machine>
Nov 29 17:47:17 user nova-compute[74613]:       <machine maxCpus='2147483647'>pseries-4.1</machine>
Nov 29 17:47:17 user nova-compute[74613]:       <machine maxCpus='15'>mpc8544ds</machine>
Nov 29 17:47:17 user nova-compute[74613]:       <machine maxCpus='2147483647'>pseries-6.1</machine>
Nov 29 17:47:17 user nova-compute[74613]:       <machine maxCpus='2147483647'>pseries-2.5</machine>
Nov 29 17:47:17 user nova-compute[74613]:       <machine maxCpus='2048'>powernv10</machine>
Nov 29 17:47:17 user nova-compute[74613]:       <machine maxCpus='2147483647'>pseries-xenial</machine>
Nov 29 17:47:17 user nova-compute[74613]:       <machine maxCpus='2147483647'>pseries-4.2</machine>
Nov 29 17:47:17 user nova-compute[74613]:       <machine maxCpus='2147483647'>pseries-6.2</machine>
Nov 29 17:47:17 user nova-compute[74613]:       <machine maxCpus='2147483647'>pseries-yakkety</machine>
Nov 29 17:47:17 user nova-compute[74613]:       <machine maxCpus='2147483647'>pseries-2.6</machine>
Nov 29 17:47:17 user nova-compute[74613]:       <machine maxCpus='32'>ppce500</machine>
Nov 29 17:47:17 user nova-compute[74613]:       <machine maxCpus='2147483647'>pseries-bionic-sxxm</machine>
Nov 29 17:47:17 user nova-compute[74613]:       <machine maxCpus='2147483647'>pseries-2.7</machine>
Nov 29 17:47:17 user nova-compute[74613]:       <machine maxCpus='2147483647'>pseries-3.0</machine>
Nov 29 17:47:17 user nova-compute[74613]:       <machine maxCpus='2147483647'>pseries-5.0</machine>
Nov 29 17:47:17 user nova-compute[74613]:       <machine maxCpus='1'>40p</machine>
Nov 29 17:47:17 user nova-compute[74613]:       <machine maxCpus='2147483647'>pseries-2.8</machine>
Nov 29 17:47:17 user nova-compute[74613]:       <machine maxCpus='1'>pegasos2</machine>
Nov 29 17:47:17 user nova-compute[74613]:       <machine maxCpus='2147483647'>pseries-hirsute</machine>
Nov 29 17:47:17 user nova-compute[74613]:       <machine maxCpus='2147483647'>pseries-3.1</machine>
Nov 29 17:47:17 user nova-compute[74613]:       <machine maxCpus='2147483647'>pseries-5.1</machine>
Nov 29 17:47:17 user nova-compute[74613]:       <machine maxCpus='2147483647'>pseries-eoan</machine>
Nov 29 17:47:17 user nova-compute[74613]:       <machine maxCpus='2147483647'>pseries-2.9</machine>
Nov 29 17:47:17 user nova-compute[74613]:       <machine maxCpus='2147483647'>pseries-zesty</machine>
Nov 29 17:47:17 user nova-compute[74613]:       <machine maxCpus='1'>bamboo</machine>
Nov 29 17:47:17 user nova-compute[74613]:       <machine maxCpus='2147483647'>pseries-groovy</machine>
Nov 29 17:47:17 user nova-compute[74613]:       <machine maxCpus='2147483647'>pseries-focal</machine>
Nov 29 17:47:17 user nova-compute[74613]:       <machine maxCpus='1'>g3beige</machine>
Nov 29 17:47:17 user nova-compute[74613]:       <machine maxCpus='2147483647'>pseries-5.2</machine>
Nov 29 17:47:17 user nova-compute[74613]:       <machine maxCpus='2147483647'>pseries-disco</machine>
Nov 29 17:47:17 user nova-compute[74613]:       <machine maxCpus='2147483647'>pseries-2.12-sxxm</machine>
Nov 29 17:47:17 user nova-compute[74613]:       <machine maxCpus='2147483647'>pseries-2.10</machine>
Nov 29 17:47:17 user nova-compute[74613]:       <machine maxCpus='1'>virtex-ml507</machine>
Nov 29 17:47:17 user nova-compute[74613]:       <machine maxCpus='2147483647'>pseries-2.11</machine>
Nov 29 17:47:17 user nova-compute[74613]:       <machine maxCpus='2147483647'>pseries-2.1</machine>
Nov 29 17:47:17 user nova-compute[74613]:       <machine maxCpus='2147483647'>pseries-cosmic</machine>
Nov 29 17:47:17 user nova-compute[74613]:       <machine maxCpus='2147483647'>pseries-bionic</machine>
Nov 29 17:47:17 user nova-compute[74613]:       <machine maxCpus='2147483647'>pseries-2.12</machine>
Nov 29 17:47:17 user nova-compute[74613]:       <machine maxCpus='2147483647'>pseries-2.2</machine>
Nov 29 17:47:17 user nova-compute[74613]:       <machine maxCpus='1'>mac99</machine>
Nov 29 17:47:17 user nova-compute[74613]:       <machine maxCpus='2147483647'>pseries-impish</machine>
Nov 29 17:47:17 user nova-compute[74613]:       <machine maxCpus='2147483647'>pseries-artful</machine>
Nov 29 17:47:17 user nova-compute[74613]:       <machine maxCpus='1'>sam460ex</machine>
Nov 29 17:47:17 user nova-compute[74613]:       <machine maxCpus='1'>ref405ep</machine>
Nov 29 17:47:17 user nova-compute[74613]:       <machine maxCpus='2147483647'>pseries-2.3</machine>
Nov 29 17:47:17 user nova-compute[74613]:       <machine maxCpus='2048'>powernv8</machine>
Nov 29 17:47:17 user nova-compute[74613]:       <machine maxCpus='2147483647'>pseries-4.0</machine>
Nov 29 17:47:17 user nova-compute[74613]:       <machine maxCpus='2147483647'>pseries-6.0</machine>
Nov 29 17:47:17 user nova-compute[74613]:       <machine maxCpus='2147483647'>pseries-2.4</machine>
Nov 29 17:47:17 user nova-compute[74613]:       <domain type='qemu'/>
Nov 29 17:47:17 user nova-compute[74613]:     </arch>
Nov 29 17:47:17 user nova-compute[74613]:     <features>
Nov 29 17:47:17 user nova-compute[74613]:       <cpuselection/>
Nov 29 17:47:17 user nova-compute[74613]:       <deviceboot/>
Nov 29 17:47:17 user nova-compute[74613]:       <disksnapshot default='on' toggle='no'/>
Nov 29 17:47:17 user nova-compute[74613]:     </features>
Nov 29 17:47:17 user nova-compute[74613]:   </guest>
Nov 29 17:47:17 user nova-compute[74613]:   <guest>
Nov 29 17:47:17 user nova-compute[74613]:     <os_type>hvm</os_type>
Nov 29 17:47:17 user nova-compute[74613]:     <arch name='riscv32'>
Nov 29 17:47:17 user nova-compute[74613]:       <wordsize>32</wordsize>
Nov 29 17:47:17 user nova-compute[74613]:       <emulator>/usr/bin/qemu-system-riscv32</emulator>
Nov 29 17:47:17 user nova-compute[74613]:       <machine maxCpus='8'>spike</machine>
Nov 29 17:47:17 user nova-compute[74613]:       <machine maxCpus='1'>opentitan</machine>
Nov 29 17:47:17 user nova-compute[74613]:       <machine maxCpus='5'>sifive_u</machine>
Nov 29 17:47:17 user nova-compute[74613]:       <machine maxCpus='1'>sifive_e</machine>
Nov 29 17:47:17 user nova-compute[74613]:       <machine maxCpus='8'>virt</machine>
Nov 29 17:47:17 user nova-compute[74613]:       <domain type='qemu'/>
Nov 29 17:47:17 user nova-compute[74613]:     </arch>
Nov 29 17:47:17 user nova-compute[74613]:     <features>
Nov 29 17:47:17 user nova-compute[74613]:       <cpuselection/>
Nov 29 17:47:17 user nova-compute[74613]:       <deviceboot/>
Nov 29 17:47:17 user nova-compute[74613]:       <disksnapshot default='on' toggle='no'/>
Nov 29 17:47:17 user nova-compute[74613]:     </features>
Nov 29 17:47:17 user nova-compute[74613]:   </guest>
Nov 29 17:47:17 user nova-compute[74613]:   <guest>
Nov 29 17:47:17 user nova-compute[74613]:     <os_type>hvm</os_type>
Nov 29 17:47:17 user nova-compute[74613]:     <arch name='riscv64'>
Nov 29 17:47:17 user nova-compute[74613]:       <wordsize>64</wordsize>
Nov 29 17:47:17 user nova-compute[74613]:       <emulator>/usr/bin/qemu-system-riscv64</emulator>
Nov 29 17:47:17 user nova-compute[74613]:       <machine maxCpus='8'>spike</machine>
Nov 29 17:47:17 user nova-compute[74613]:       <machine maxCpus='5'>microchip-icicle-kit</machine>
Nov 29 17:47:17 user nova-compute[74613]:       <machine maxCpus='5'>sifive_u</machine>
Nov 29 17:47:17 user nova-compute[74613]:       <machine maxCpus='1'>shakti_c</machine>
Nov 29 17:47:17 user nova-compute[74613]:       <machine maxCpus='1'>sifive_e</machine>
Nov 29 17:47:17 user nova-compute[74613]:       <machine maxCpus='8'>virt</machine>
Nov 29 17:47:17 user nova-compute[74613]:       <domain type='qemu'/>
Nov 29 17:47:17 user nova-compute[74613]:     </arch>
Nov 29 17:47:17 user nova-compute[74613]:     <features>
Nov 29 17:47:17 user nova-compute[74613]:       <cpuselection/>
Nov 29 17:47:17 user nova-compute[74613]:       <deviceboot/>
Nov 29 17:47:17 user nova-compute[74613]:       <disksnapshot default='on' toggle='no'/>
Nov 29 17:47:17 user nova-compute[74613]:     </features>
Nov 29 17:47:17 user nova-compute[74613]:   </guest>
Nov 29 17:47:17 user nova-compute[74613]:   <guest>
Nov 29 17:47:17 user nova-compute[74613]:     <os_type>hvm</os_type>
Nov 29 17:47:17 user nova-compute[74613]:     <arch name='s390x'>
Nov 29 17:47:17 user nova-compute[74613]:       <wordsize>64</wordsize>
Nov 29 17:47:17 user nova-compute[74613]:       <emulator>/usr/bin/qemu-system-s390x</emulator>
Nov 29 17:47:17 user nova-compute[74613]:       <machine maxCpus='248'>s390-ccw-virtio-jammy</machine>
Nov 29 17:47:17 user nova-compute[74613]:       <machine canonical='s390-ccw-virtio-jammy' maxCpus='248'>s390-ccw-virtio</machine>
Nov 29 17:47:17 user nova-compute[74613]:       <machine maxCpus='248'>s390-ccw-virtio-4.0</machine>
Nov 29 17:47:17 user nova-compute[74613]:       <machine maxCpus='248'>s390-ccw-virtio-5.2</machine>
Nov 29 17:47:17 user nova-compute[74613]:       <machine maxCpus='248'>s390-ccw-virtio-artful</machine>
Nov 29 17:47:17 user nova-compute[74613]:       <machine maxCpus='248'>s390-ccw-virtio-3.1</machine>
Nov 29 17:47:17 user nova-compute[74613]:       <machine maxCpus='248'>s390-ccw-virtio-groovy</machine>
Nov 29 17:47:17 user nova-compute[74613]:       <machine maxCpus='248'>s390-ccw-virtio-hirsute</machine>
Nov 29 17:47:17 user nova-compute[74613]:       <machine maxCpus='248'>s390-ccw-virtio-disco</machine>
Nov 29 17:47:17 user nova-compute[74613]:       <machine maxCpus='248'>s390-ccw-virtio-2.12</machine>
Nov 29 17:47:17 user nova-compute[74613]:       <machine maxCpus='248'>s390-ccw-virtio-2.6</machine>
Nov 29 17:47:17 user nova-compute[74613]:       <machine maxCpus='248'>s390-ccw-virtio-yakkety</machine>
Nov 29 17:47:17 user nova-compute[74613]:       <machine maxCpus='248'>s390-ccw-virtio-eoan</machine>
Nov 29 17:47:17 user nova-compute[74613]:       <machine maxCpus='248'>s390-ccw-virtio-2.9</machine>
Nov 29 17:47:17 user nova-compute[74613]:       <machine maxCpus='248'>s390-ccw-virtio-6.0</machine>
Nov 29 17:47:17 user nova-compute[74613]:       <machine maxCpus='248'>s390-ccw-virtio-5.1</machine>
Nov 29 17:47:17 user nova-compute[74613]:       <machine maxCpus='248'>s390-ccw-virtio-3.0</machine>
Nov 29 17:47:17 user nova-compute[74613]:       <machine maxCpus='248'>s390-ccw-virtio-4.2</machine>
Nov 29 17:47:17 user nova-compute[74613]:       <machine maxCpus='248'>s390-ccw-virtio-2.5</machine>
Nov 29 17:47:17 user nova-compute[74613]:       <machine maxCpus='248'>s390-ccw-virtio-2.11</machine>
Nov 29 17:47:17 user nova-compute[74613]:       <machine maxCpus='248'>s390-ccw-virtio-xenial</machine>
Nov 29 17:47:17 user nova-compute[74613]:       <machine maxCpus='248'>s390-ccw-virtio-focal</machine>
Nov 29 17:47:17 user nova-compute[74613]:       <machine maxCpus='248'>s390-ccw-virtio-2.8</machine>
Nov 29 17:47:17 user nova-compute[74613]:       <machine maxCpus='248'>s390-ccw-virtio-impish</machine>
Nov 29 17:47:17 user nova-compute[74613]:       <machine maxCpus='248'>s390-ccw-virtio-bionic</machine>
Nov 29 17:47:17 user nova-compute[74613]:       <machine maxCpus='248'>s390-ccw-virtio-5.0</machine>
Nov 29 17:47:17 user nova-compute[74613]:       <machine maxCpus='248'>s390-ccw-virtio-6.2</machine>
Nov 29 17:47:17 user nova-compute[74613]:       <machine maxCpus='248'>s390-ccw-virtio-zesty</machine>
Nov 29 17:47:17 user nova-compute[74613]:       <machine maxCpus='248'>s390-ccw-virtio-4.1</machine>
Nov 29 17:47:17 user nova-compute[74613]:       <machine maxCpus='248'>s390-ccw-virtio-cosmic</machine>
Nov 29 17:47:17 user nova-compute[74613]:       <machine maxCpus='248'>s390-ccw-virtio-2.4</machine>
Nov 29 17:47:17 user nova-compute[74613]:       <machine maxCpus='248'>s390-ccw-virtio-2.10</machine>
Nov 29 17:47:17 user nova-compute[74613]:       <machine maxCpus='248'>s390-ccw-virtio-2.7</machine>
Nov 29 17:47:17 user nova-compute[74613]:       <machine maxCpus='248'>s390-ccw-virtio-6.1</machine>
Nov 29 17:47:17 user nova-compute[74613]:       <domain type='qemu'/>
Nov 29 17:47:17 user nova-compute[74613]:     </arch>
Nov 29 17:47:17 user nova-compute[74613]:     <features>
Nov 29 17:47:17 user nova-compute[74613]:       <cpuselection/>
Nov 29 17:47:17 user nova-compute[74613]:       <deviceboot/>
Nov 29 17:47:17 user nova-compute[74613]:       <disksnapshot default='on' toggle='no'/>
Nov 29 17:47:17 user nova-compute[74613]:     </features>
Nov 29 17:47:17 user nova-compute[74613]:   </guest>
Nov 29 17:47:17 user nova-compute[74613]:   <guest>
Nov 29 17:47:17 user nova-compute[74613]:     <os_type>hvm</os_type>
Nov 29 17:47:17 user nova-compute[74613]:     <arch name='sh4'>
Nov 29 17:47:17 user nova-compute[74613]:       <wordsize>32</wordsize>
Nov 29 17:47:17 user nova-compute[74613]:       <emulator>/usr/bin/qemu-system-sh4</emulator>
Nov 29 17:47:17 user nova-compute[74613]:       <machine maxCpus='1'>shix</machine>
Nov 29 17:47:17 user nova-compute[74613]:       <machine maxCpus='1'>r2d</machine>
Nov 29 17:47:17 user nova-compute[74613]:       <domain type='qemu'/>
Nov 29 17:47:17 user nova-compute[74613]:     </arch>
Nov 29 17:47:17 user nova-compute[74613]:     <features>
Nov 29 17:47:17 user nova-compute[74613]:       <cpuselection/>
Nov 29 17:47:17 user nova-compute[74613]:       <deviceboot/>
Nov 29 17:47:17 user nova-compute[74613]:       <disksnapshot default='on' toggle='no'/>
Nov 29 17:47:17 user nova-compute[74613]:     </features>
Nov 29 17:47:17 user nova-compute[74613]:   </guest>
Nov 29 17:47:17 user nova-compute[74613]:   <guest>
Nov 29 17:47:17 user nova-compute[74613]:     <os_type>hvm</os_type>
Nov 29 17:47:17 user nova-compute[74613]:     <arch name='sh4eb'>
Nov 29 17:47:17 user nova-compute[74613]:       <wordsize>64</wordsize>
Nov 29 17:47:17 user nova-compute[74613]:       <emulator>/usr/bin/qemu-system-sh4eb</emulator>
Nov 29 17:47:17 user nova-compute[74613]:       <machine maxCpus='1'>shix</machine>
Nov 29 17:47:17 user nova-compute[74613]:       <machine maxCpus='1'>r2d</machine>
Nov 29 17:47:17 user nova-compute[74613]:       <domain type='qemu'/>
Nov 29 17:47:17 user nova-compute[74613]:     </arch>
Nov 29 17:47:17 user nova-compute[74613]:     <features>
Nov 29 17:47:17 user nova-compute[74613]:       <cpuselection/>
Nov 29 17:47:17 user nova-compute[74613]:       <deviceboot/>
Nov 29 17:47:17 user nova-compute[74613]:       <disksnapshot default='on' toggle='no'/>
Nov 29 17:47:17 user nova-compute[74613]:     </features>
Nov 29 17:47:17 user nova-compute[74613]:   </guest>
Nov 29 17:47:17 user nova-compute[74613]:   <guest>
Nov 29 17:47:17 user nova-compute[74613]:     <os_type>hvm</os_type>
Nov 29 17:47:17 user nova-compute[74613]:     <arch name='sparc'>
Nov 29 17:47:17 user nova-compute[74613]:       <wordsize>32</wordsize>
Nov 29 17:47:17 user nova-compute[74613]:       <emulator>/usr/bin/qemu-system-sparc</emulator>
Nov 29 17:47:17 user nova-compute[74613]:       <machine maxCpus='1'>SS-5</machine>
Nov 29 17:47:17 user nova-compute[74613]:       <machine maxCpus='4'>SS-20</machine>
Nov 29 17:47:17 user nova-compute[74613]:       <machine maxCpus='1'>LX</machine>
Nov 29 17:47:17 user nova-compute[74613]:       <machine maxCpus='1'>SPARCClassic</machine>
Nov 29 17:47:17 user nova-compute[74613]:       <machine maxCpus='1'>leon3_generic</machine>
Nov 29 17:47:17 user nova-compute[74613]:       <machine maxCpus='1'>SPARCbook</machine>
Nov 29 17:47:17 user nova-compute[74613]:       <machine maxCpus='1'>SS-4</machine>
Nov 29 17:47:17 user nova-compute[74613]:       <machine maxCpus='4'>SS-600MP</machine>
Nov 29 17:47:17 user nova-compute[74613]:       <machine maxCpus='4'>SS-10</machine>
Nov 29 17:47:17 user nova-compute[74613]:       <machine maxCpus='1'>Voyager</machine>
Nov 29 17:47:17 user nova-compute[74613]:       <domain type='qemu'/>
Nov 29 17:47:17 user nova-compute[74613]:     </arch>
Nov 29 17:47:17 user nova-compute[74613]:     <features>
Nov 29 17:47:17 user nova-compute[74613]:       <cpuselection/>
Nov 29 17:47:17 user nova-compute[74613]:       <deviceboot/>
Nov 29 17:47:17 user nova-compute[74613]:       <disksnapshot default='on' toggle='no'/>
Nov 29 17:47:17 user nova-compute[74613]:     </features>
Nov 29 17:47:17 user nova-compute[74613]:   </guest>
Nov 29 17:47:17 user nova-compute[74613]:   <guest>
Nov 29 17:47:17 user nova-compute[74613]:     <os_type>hvm</os_type>
Nov 29 17:47:17 user nova-compute[74613]:     <arch name='sparc64'>
Nov 29 17:47:17 user nova-compute[74613]:       <wordsize>64</wordsize>
Nov 29 17:47:17 user nova-compute[74613]:       <emulator>/usr/bin/qemu-system-sparc64</emulator>
Nov 29 17:47:17 user nova-compute[74613]:       <machine maxCpus='1'>sun4u</machine>
Nov 29 17:47:17 user nova-compute[74613]:       <machine maxCpus='1'>niagara</machine>
Nov 29 17:47:17 user nova-compute[74613]:       <machine maxCpus='1'>sun4v</machine>
Nov 29 17:47:17 user nova-compute[74613]:       <domain type='qemu'/>
Nov 29 17:47:17 user nova-compute[74613]:     </arch>
Nov 29 17:47:17 user nova-compute[74613]:     <features>
Nov 29 17:47:17 user nova-compute[74613]:       <cpuselection/>
Nov 29 17:47:17 user nova-compute[74613]:       <deviceboot/>
Nov 29 17:47:17 user nova-compute[74613]:       <disksnapshot default='on' toggle='no'/>
Nov 29 17:47:17 user nova-compute[74613]:     </features>
Nov 29 17:47:17 user nova-compute[74613]:   </guest>
Nov 29 17:47:17 user nova-compute[74613]:   <guest>
Nov 29 17:47:17 user nova-compute[74613]:     <os_type>hvm</os_type>
Nov 29 17:47:17 user nova-compute[74613]:     <arch name='x86_64'>
Nov 29 17:47:17 user nova-compute[74613]:       <wordsize>64</wordsize>
Nov 29 17:47:17 user nova-compute[74613]:       <emulator>/usr/bin/qemu-system-x86_64</emulator>
Nov 29 17:47:17 user nova-compute[74613]:       <machine maxCpus='255'>pc-i440fx-jammy</machine>
Nov 29 17:47:17 user nova-compute[74613]:       <machine canonical='pc-i440fx-jammy' maxCpus='255'>ubuntu</machine>
Nov 29 17:47:17 user nova-compute[74613]:       <machine maxCpus='255'>pc-i440fx-impish-hpb</machine>
Nov 29 17:47:17 user nova-compute[74613]:       <machine maxCpus='288'>pc-q35-5.2</machine>
Nov 29 17:47:17 user nova-compute[74613]:       <machine maxCpus='255'>pc-i440fx-2.12</machine>
Nov 29 17:47:17 user nova-compute[74613]:       <machine maxCpus='255'>pc-i440fx-2.0</machine>
Nov 29 17:47:17 user nova-compute[74613]:       <machine maxCpus='255'>pc-i440fx-xenial</machine>
Nov 29 17:47:17 user nova-compute[74613]:       <machine maxCpus='255'>pc-i440fx-6.2</machine>
Nov 29 17:47:17 user nova-compute[74613]:       <machine canonical='pc-i440fx-6.2' maxCpus='255'>pc</machine>
Nov 29 17:47:17 user nova-compute[74613]:       <machine maxCpus='288'>pc-q35-4.2</machine>
Nov 29 17:47:17 user nova-compute[74613]:       <machine maxCpus='255'>pc-i440fx-2.5</machine>
Nov 29 17:47:17 user nova-compute[74613]:       <machine maxCpus='255'>pc-i440fx-4.2</machine>
Nov 29 17:47:17 user nova-compute[74613]:       <machine maxCpus='255'>pc-i440fx-hirsute</machine>
Nov 29 17:47:17 user nova-compute[74613]:       <machine maxCpus='255'>pc-i440fx-focal</machine>
Nov 29 17:47:17 user nova-compute[74613]:       <machine maxCpus='255'>pc-q35-xenial</machine>
Nov 29 17:47:17 user nova-compute[74613]:       <machine maxCpus='255'>pc-i440fx-jammy-hpb</machine>
Nov 29 17:47:17 user nova-compute[74613]:       <machine maxCpus='255'>pc-i440fx-5.2</machine>
Nov 29 17:47:17 user nova-compute[74613]:       <machine maxCpus='255'>pc-i440fx-1.5</machine>
Nov 29 17:47:17 user nova-compute[74613]:       <machine maxCpus='255'>pc-q35-2.7</machine>
Nov 29 17:47:17 user nova-compute[74613]:       <machine maxCpus='288'>pc-q35-eoan-hpb</machine>
Nov 29 17:47:17 user nova-compute[74613]:       <machine maxCpus='255'>pc-i440fx-zesty</machine>
Nov 29 17:47:17 user nova-compute[74613]:       <machine maxCpus='255'>pc-i440fx-disco-hpb</machine>
Nov 29 17:47:17 user nova-compute[74613]:       <machine maxCpus='288'>pc-q35-groovy</machine>
Nov 29 17:47:17 user nova-compute[74613]:       <machine maxCpus='255'>pc-i440fx-groovy</machine>
Nov 29 17:47:17 user nova-compute[74613]:       <machine maxCpus='288'>pc-q35-artful</machine>
Nov 29 17:47:17 user nova-compute[74613]:       <machine maxCpus='255'>pc-i440fx-trusty</machine>
Nov 29 17:47:17 user nova-compute[74613]:       <machine maxCpus='255'>pc-i440fx-2.2</machine>
Nov 29 17:47:17 user nova-compute[74613]:       <machine maxCpus='288'>pc-q35-focal-hpb</machine>
Nov 29 17:47:17 user nova-compute[74613]:       <machine maxCpus='255'>pc-i440fx-eoan-hpb</machine>
Nov 29 17:47:17 user nova-compute[74613]:       <machine maxCpus='288'>pc-q35-bionic-hpb</machine>
Nov 29 17:47:17 user nova-compute[74613]:       <machine maxCpus='255'>pc-i440fx-artful</machine>
Nov 29 17:47:17 user nova-compute[74613]:       <machine maxCpus='255'>pc-i440fx-2.7</machine>
Nov 29 17:47:17 user nova-compute[74613]:       <machine maxCpus='288'>pc-q35-6.1</machine>
Nov 29 17:47:17 user nova-compute[74613]:       <machine maxCpus='255'>pc-i440fx-yakkety</machine>
Nov 29 17:47:17 user nova-compute[74613]:       <machine maxCpus='255'>pc-q35-2.4</machine>
Nov 29 17:47:17 user nova-compute[74613]:       <machine maxCpus='288'>pc-q35-cosmic-hpb</machine>
Nov 29 17:47:17 user nova-compute[74613]:       <machine maxCpus='288'>pc-q35-2.10</machine>
Nov 29 17:47:17 user nova-compute[74613]:       <machine maxCpus='1'>x-remote</machine>
Nov 29 17:47:17 user nova-compute[74613]:       <machine maxCpus='288'>pc-q35-5.1</machine>
Nov 29 17:47:17 user nova-compute[74613]:       <machine maxCpus='255'>pc-i440fx-1.7</machine>
Nov 29 17:47:17 user nova-compute[74613]:       <machine maxCpus='288'>pc-q35-2.9</machine>
Nov 29 17:47:17 user nova-compute[74613]:       <machine maxCpus='255'>pc-i440fx-2.11</machine>
Nov 29 17:47:17 user nova-compute[74613]:       <machine maxCpus='288'>pc-q35-3.1</machine>
Nov 29 17:47:17 user nova-compute[74613]:       <machine maxCpus='255'>pc-i440fx-6.1</machine>
Nov 29 17:47:17 user nova-compute[74613]:       <machine maxCpus='288'>pc-q35-4.1</machine>
Nov 29 17:47:17 user nova-compute[74613]:       <machine maxCpus='288'>pc-q35-jammy</machine>
Nov 29 17:47:17 user nova-compute[74613]:       <machine canonical='pc-q35-jammy' maxCpus='288'>ubuntu-q35</machine>
Nov 29 17:47:17 user nova-compute[74613]:       <machine maxCpus='255'>pc-i440fx-2.4</machine>
Nov 29 17:47:17 user nova-compute[74613]:       <machine maxCpus='255'>pc-i440fx-4.1</machine>
Nov 29 17:47:17 user nova-compute[74613]:       <machine maxCpus='288'>pc-q35-eoan</machine>
Nov 29 17:47:17 user nova-compute[74613]:       <machine maxCpus='288'>pc-q35-jammy-hpb</machine>
Nov 29 17:47:17 user nova-compute[74613]:       <machine maxCpus='255'>pc-i440fx-5.1</machine>
Nov 29 17:47:17 user nova-compute[74613]:       <machine maxCpus='255'>pc-i440fx-2.9</machine>
Nov 29 17:47:17 user nova-compute[74613]:       <machine maxCpus='255'>pc-i440fx-bionic-hpb</machine>
Nov 29 17:47:17 user nova-compute[74613]:       <machine maxCpus='1'>isapc</machine>
Nov 29 17:47:17 user nova-compute[74613]:       <machine maxCpus='255'>pc-i440fx-1.4</machine>
Nov 29 17:47:17 user nova-compute[74613]:       <machine maxCpus='288'>pc-q35-cosmic</machine>
Nov 29 17:47:17 user nova-compute[74613]:       <machine maxCpus='255'>pc-q35-2.6</machine>
Nov 29 17:47:17 user nova-compute[74613]:       <machine maxCpus='255'>pc-i440fx-3.1</machine>
Nov 29 17:47:17 user nova-compute[74613]:       <machine maxCpus='288'>pc-q35-bionic</machine>
Nov 29 17:47:17 user nova-compute[74613]:       <machine maxCpus='288'>pc-q35-disco-hpb</machine>
Nov 29 17:47:17 user nova-compute[74613]:       <machine maxCpus='255'>pc-i440fx-cosmic</machine>
Nov 29 17:47:17 user nova-compute[74613]:       <machine maxCpus='288'>pc-q35-2.12</machine>
Nov 29 17:47:17 user nova-compute[74613]:       <machine maxCpus='255'>pc-i440fx-bionic</machine>
Nov 29 17:47:17 user nova-compute[74613]:       <machine maxCpus='288'>pc-q35-groovy-hpb</machine>
Nov 29 17:47:17 user nova-compute[74613]:       <machine maxCpus='288'>pc-q35-disco</machine>
Nov 29 17:47:17 user nova-compute[74613]:       <machine maxCpus='255'>pc-i440fx-cosmic-hpb</machine>
Nov 29 17:47:17 user nova-compute[74613]:       <machine maxCpus='255'>pc-i440fx-2.1</machine>
Nov 29 17:47:17 user nova-compute[74613]:       <machine maxCpus='255'>pc-i440fx-wily</machine>
Nov 29 17:47:17 user nova-compute[74613]:       <machine maxCpus='288'>pc-q35-impish</machine>
Nov 29 17:47:17 user nova-compute[74613]:       <machine maxCpus='255'>pc-i440fx-2.6</machine>
Nov 29 17:47:17 user nova-compute[74613]:       <machine maxCpus='288'>pc-q35-6.0</machine>
Nov 29 17:47:17 user nova-compute[74613]:       <machine maxCpus='255'>pc-i440fx-impish</machine>
Nov 29 17:47:17 user nova-compute[74613]:       <machine maxCpus='288'>pc-q35-impish-hpb</machine>
Nov 29 17:47:17 user nova-compute[74613]:       <machine maxCpus='288'>pc-q35-hirsute</machine>
Nov 29 17:47:17 user nova-compute[74613]:       <machine maxCpus='288'>pc-q35-4.0.1</machine>
Nov 29 17:47:17 user nova-compute[74613]:       <machine maxCpus='288'>pc-q35-hirsute-hpb</machine>
Nov 29 17:47:17 user nova-compute[74613]:       <machine maxCpus='255'>pc-i440fx-1.6</machine>
Nov 29 17:47:17 user nova-compute[74613]:       <machine maxCpus='288'>pc-q35-5.0</machine>
Nov 29 17:47:17 user nova-compute[74613]:       <machine maxCpus='288'>pc-q35-2.8</machine>
Nov 29 17:47:17 user nova-compute[74613]:       <machine maxCpus='255'>pc-i440fx-2.10</machine>
Nov 29 17:47:17 user nova-compute[74613]:       <machine maxCpus='288'>pc-q35-3.0</machine>
Nov 29 17:47:17 user nova-compute[74613]:       <machine maxCpus='288'>pc-q35-zesty</machine>
Nov 29 17:47:17 user nova-compute[74613]:       <machine maxCpus='288'>pc-q35-4.0</machine>
Nov 29 17:47:17 user nova-compute[74613]:       <machine maxCpus='288'>pc-q35-focal</machine>
Nov 29 17:47:17 user nova-compute[74613]:       <machine maxCpus='288'>microvm</machine>
Nov 29 17:47:17 user nova-compute[74613]:       <machine maxCpus='255'>pc-i440fx-6.0</machine>
Nov 29 17:47:17 user nova-compute[74613]:       <machine maxCpus='255'>pc-i440fx-2.3</machine>
Nov 29 17:47:17 user nova-compute[74613]:       <machine maxCpus='255'>pc-i440fx-disco</machine>
Nov 29 17:47:17 user nova-compute[74613]:       <machine maxCpus='255'>pc-i440fx-focal-hpb</machine>
Nov 29 17:47:17 user nova-compute[74613]:       <machine maxCpus='255'>pc-i440fx-4.0</machine>
Nov 29 17:47:17 user nova-compute[74613]:       <machine maxCpus='255'>pc-i440fx-groovy-hpb</machine>
Nov 29 17:47:17 user nova-compute[74613]:       <machine maxCpus='255'>pc-i440fx-hirsute-hpb</machine>
Nov 29 17:47:17 user nova-compute[74613]:       <machine maxCpus='255'>pc-i440fx-5.0</machine>
Nov 29 17:47:17 user nova-compute[74613]:       <machine maxCpus='255'>pc-i440fx-2.8</machine>
Nov 29 17:47:17 user nova-compute[74613]:       <machine maxCpus='288'>pc-q35-6.2</machine>
Nov 29 17:47:17 user nova-compute[74613]:       <machine canonical='pc-q35-6.2' maxCpus='288'>q35</machine>
Nov 29 17:47:17 user nova-compute[74613]:       <machine maxCpus='255'>pc-i440fx-eoan</machine>
Nov 29 17:47:17 user nova-compute[74613]:       <machine maxCpus='255'>pc-q35-2.5</machine>
Nov 29 17:47:17 user nova-compute[74613]:       <machine maxCpus='255'>pc-i440fx-3.0</machine>
Nov 29 17:47:17 user nova-compute[74613]:       <machine maxCpus='255'>pc-q35-yakkety</machine>
Nov 29 17:47:17 user nova-compute[74613]:       <machine maxCpus='288'>pc-q35-2.11</machine>
Nov 29 17:47:17 user nova-compute[74613]:       <domain type='qemu'/>
Nov 29 17:47:17 user nova-compute[74613]:       <domain type='kvm'/>
Nov 29 17:47:17 user nova-compute[74613]:     </arch>
Nov 29 17:47:17 user nova-compute[74613]:     <features>
Nov 29 17:47:17 user nova-compute[74613]:       <acpi default='on' toggle='yes'/>
Nov 29 17:47:17 user nova-compute[74613]:       <apic default='on' toggle='no'/>
Nov 29 17:47:17 user nova-compute[74613]:       <cpuselection/>
Nov 29 17:47:17 user nova-compute[74613]:       <deviceboot/>
Nov 29 17:47:17 user nova-compute[74613]:       <disksnapshot default='on' toggle='no'/>
Nov 29 17:47:17 user nova-compute[74613]:     </features>
Nov 29 17:47:17 user nova-compute[74613]:   </guest>
Nov 29 17:47:17 user nova-compute[74613]:   <guest>
Nov 29 17:47:17 user nova-compute[74613]:     <os_type>hvm</os_type>
Nov 29 17:47:17 user nova-compute[74613]:     <arch name='xtensa'>
Nov 29 17:47:17 user nova-compute[74613]:       <wordsize>32</wordsize>
Nov 29 17:47:17 user nova-compute[74613]:       <emulator>/usr/bin/qemu-system-xtensa</emulator>
Nov 29 17:47:17 user nova-compute[74613]:       <machine maxCpus='4'>sim</machine>
Nov 29 17:47:17 user nova-compute[74613]:       <machine maxCpus='32'>kc705</machine>
Nov 29 17:47:17 user nova-compute[74613]:       <machine maxCpus='32'>ml605</machine>
Nov 29 17:47:17 user nova-compute[74613]:       <machine maxCpus='32'>ml605-nommu</machine>
Nov 29 17:47:17 user nova-compute[74613]:       <machine maxCpus='32'>virt</machine>
Nov 29 17:47:17 user nova-compute[74613]:       <machine maxCpus='32'>lx60-nommu</machine>
Nov 29 17:47:17 user nova-compute[74613]:       <machine maxCpus='32'>lx200</machine>
Nov 29 17:47:17 user nova-compute[74613]:       <machine maxCpus='32'>lx200-nommu</machine>
Nov 29 17:47:17 user nova-compute[74613]:       <machine maxCpus='32'>lx60</machine>
Nov 29 17:47:17 user nova-compute[74613]:       <machine maxCpus='32'>kc705-nommu</machine>
Nov 29 17:47:17 user nova-compute[74613]:       <domain type='qemu'/>
Nov 29 17:47:17 user nova-compute[74613]:     </arch>
Nov 29 17:47:17 user nova-compute[74613]:     <features>
Nov 29 17:47:17 user nova-compute[74613]:       <cpuselection/>
Nov 29 17:47:17 user nova-compute[74613]:       <deviceboot/>
Nov 29 17:47:17 user nova-compute[74613]:       <disksnapshot default='on' toggle='no'/>
Nov 29 17:47:17 user nova-compute[74613]:     </features>
Nov 29 17:47:17 user nova-compute[74613]:   </guest>
Nov 29 17:47:17 user nova-compute[74613]:   <guest>
Nov 29 17:47:17 user nova-compute[74613]:     <os_type>hvm</os_type>
Nov 29 17:47:17 user nova-compute[74613]:     <arch name='xtensaeb'>
Nov 29 17:47:17 user nova-compute[74613]:       <wordsize>32</wordsize>
Nov 29 17:47:17 user nova-compute[74613]:       <emulator>/usr/bin/qemu-system-xtensaeb</emulator>
Nov 29 17:47:17 user nova-compute[74613]:       <machine maxCpus='4'>sim</machine>
Nov 29 17:47:17 user nova-compute[74613]:       <machine maxCpus='32'>kc705</machine>
Nov 29 17:47:17 user nova-compute[74613]:       <machine maxCpus='32'>ml605</machine>
Nov 29 17:47:17 user nova-compute[74613]:       <machine maxCpus='32'>ml605-nommu</machine>
Nov 29 17:47:17 user nova-compute[74613]:       <machine maxCpus='32'>virt</machine>
Nov 29 17:47:17 user nova-compute[74613]:       <machine maxCpus='32'>lx60-nommu</machine>
Nov 29 17:47:17 user nova-compute[74613]:       <machine maxCpus='32'>lx200</machine>
Nov 29 17:47:17 user nova-compute[74613]:       <machine maxCpus='32'>lx200-nommu</machine>
Nov 29 17:47:17 user nova-compute[74613]:       <machine maxCpus='32'>lx60</machine>
Nov 29 17:47:17 user nova-compute[74613]:       <machine maxCpus='32'>kc705-nommu</machine>
Nov 29 17:47:17 user nova-compute[74613]:       <domain type='qemu'/>
Nov 29 17:47:17 user nova-compute[74613]:     </arch>
Nov 29 17:47:17 user nova-compute[74613]:     <features>
Nov 29 17:47:17 user nova-compute[74613]:       <cpuselection/>
Nov 29 17:47:17 user nova-compute[74613]:       <deviceboot/>
Nov 29 17:47:17 user nova-compute[74613]:       <disksnapshot default='on' toggle='no'/>
Nov 29 17:47:17 user nova-compute[74613]:     </features>
Nov 29 17:47:17 user nova-compute[74613]:   </guest>
Nov 29 17:47:17 user nova-compute[74613]: </capabilities>
Nov 29 17:47:17 user nova-compute[74613]: 
Nov 29 17:47:17 user nova-compute[74613]: DEBUG nova.virt.libvirt.host [None req-ff6a7ff8-5f06-4fe1-9453-c4b85f4805d3 None None] Getting domain capabilities for alpha via machine types: {None} {{(pid=74613) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:954}}
Nov 29 17:47:17 user nova-compute[74613]: DEBUG nova.virt.libvirt.host [None req-ff6a7ff8-5f06-4fe1-9453-c4b85f4805d3 None None] Error from libvirt when retrieving domain capabilities for arch alpha / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-alpha' on this host {{(pid=74613) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Nov 29 17:47:17 user nova-compute[74613]: DEBUG nova.virt.libvirt.host [None req-ff6a7ff8-5f06-4fe1-9453-c4b85f4805d3 None None] Getting domain capabilities for armv6l via machine types: {'virt', None} {{(pid=74613) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:954}}
Nov 29 17:47:17 user nova-compute[74613]: DEBUG nova.virt.libvirt.host [None req-ff6a7ff8-5f06-4fe1-9453-c4b85f4805d3 None None] Error from libvirt when retrieving domain capabilities for arch armv6l / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-arm' on this host {{(pid=74613) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Nov 29 17:47:17 user nova-compute[74613]: DEBUG nova.virt.libvirt.host [None req-ff6a7ff8-5f06-4fe1-9453-c4b85f4805d3 None None] Error from libvirt when retrieving domain capabilities for arch armv6l / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-arm' on this host {{(pid=74613) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Nov 29 17:47:17 user nova-compute[74613]: DEBUG nova.virt.libvirt.host [None req-ff6a7ff8-5f06-4fe1-9453-c4b85f4805d3 None None] Getting domain capabilities for armv7l via machine types: {'virt'} {{(pid=74613) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:954}}
Nov 29 17:47:17 user nova-compute[74613]: DEBUG nova.virt.libvirt.host [None req-ff6a7ff8-5f06-4fe1-9453-c4b85f4805d3 None None] Error from libvirt when retrieving domain capabilities for arch armv7l / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-arm' on this host {{(pid=74613) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Nov 29 17:47:17 user nova-compute[74613]: DEBUG nova.virt.libvirt.host [None req-ff6a7ff8-5f06-4fe1-9453-c4b85f4805d3 None None] Getting domain capabilities for aarch64 via machine types: {'virt'} {{(pid=74613) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:954}}
Nov 29 17:47:17 user nova-compute[74613]: DEBUG nova.virt.libvirt.host [None req-ff6a7ff8-5f06-4fe1-9453-c4b85f4805d3 None None] Error from libvirt when retrieving domain capabilities for arch aarch64 / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-aarch64' on this host {{(pid=74613) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Nov 29 17:47:17 user nova-compute[74613]: DEBUG nova.virt.libvirt.host [None req-ff6a7ff8-5f06-4fe1-9453-c4b85f4805d3 None None] Getting domain capabilities for cris via machine types: {None} {{(pid=74613) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:954}}
Nov 29 17:47:17 user nova-compute[74613]: DEBUG nova.virt.libvirt.host [None req-ff6a7ff8-5f06-4fe1-9453-c4b85f4805d3 None None] Error from libvirt when retrieving domain capabilities for arch cris / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-cris' on this host {{(pid=74613) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Nov 29 17:47:17 user nova-compute[74613]: DEBUG nova.virt.libvirt.host [None req-ff6a7ff8-5f06-4fe1-9453-c4b85f4805d3 None None] Getting domain capabilities for i686 via machine types: {'ubuntu-q35', 'pc', 'ubuntu', 'q35'} {{(pid=74613) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:954}}
Nov 29 17:47:17 user nova-compute[74613]: DEBUG nova.virt.libvirt.host [None req-ff6a7ff8-5f06-4fe1-9453-c4b85f4805d3 None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=ubuntu-q35:
Nov 29 17:47:17 user nova-compute[74613]: <domainCapabilities>
Nov 29 17:47:17 user nova-compute[74613]:   <path>/usr/bin/qemu-system-i386</path>
Nov 29 17:47:17 user nova-compute[74613]:   <domain>kvm</domain>
Nov 29 17:47:17 user nova-compute[74613]:   <machine>pc-q35-jammy</machine>
Nov 29 17:47:17 user nova-compute[74613]:   <arch>i686</arch>
Nov 29 17:47:17 user nova-compute[74613]:   <vcpu max='288'/>
Nov 29 17:47:17 user nova-compute[74613]:   <iothreads supported='yes'/>
Nov 29 17:47:17 user nova-compute[74613]:   <os supported='yes'>
Nov 29 17:47:17 user nova-compute[74613]:     <enum name='firmware'/>
Nov 29 17:47:17 user nova-compute[74613]:     <loader supported='yes'>
Nov 29 17:47:17 user nova-compute[74613]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Nov 29 17:47:17 user nova-compute[74613]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Nov 29 17:47:17 user nova-compute[74613]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Nov 29 17:47:17 user nova-compute[74613]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Nov 29 17:47:17 user nova-compute[74613]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Nov 29 17:47:17 user nova-compute[74613]:       <enum name='type'>
Nov 29 17:47:17 user nova-compute[74613]:         <value>rom</value>
Nov 29 17:47:17 user nova-compute[74613]:         <value>pflash</value>
Nov 29 17:47:17 user nova-compute[74613]:       </enum>
Nov 29 17:47:17 user nova-compute[74613]:       <enum name='readonly'>
Nov 29 17:47:17 user nova-compute[74613]:         <value>yes</value>
Nov 29 17:47:17 user nova-compute[74613]:         <value>no</value>
Nov 29 17:47:17 user nova-compute[74613]:       </enum>
Nov 29 17:47:17 user nova-compute[74613]:       <enum name='secure'>
Nov 29 17:47:17 user nova-compute[74613]:         <value>no</value>
Nov 29 17:47:17 user nova-compute[74613]:       </enum>
Nov 29 17:47:17 user nova-compute[74613]:     </loader>
Nov 29 17:47:17 user nova-compute[74613]:   </os>
Nov 29 17:47:17 user nova-compute[74613]:   <cpu>
Nov 29 17:47:17 user nova-compute[74613]:     <mode name='host-passthrough' supported='yes'>
Nov 29 17:47:17 user nova-compute[74613]:       <enum name='hostPassthroughMigratable'>
Nov 29 17:47:17 user nova-compute[74613]:         <value>off</value>
Nov 29 17:47:17 user nova-compute[74613]:       </enum>
Nov 29 17:47:17 user nova-compute[74613]:     </mode>
Nov 29 17:47:17 user nova-compute[74613]:     <mode name='maximum' supported='yes'>
Nov 29 17:47:17 user nova-compute[74613]:       <enum name='maximumMigratable'>
Nov 29 17:47:17 user nova-compute[74613]:         <value>on</value>
Nov 29 17:47:17 user nova-compute[74613]:         <value>off</value>
Nov 29 17:47:17 user nova-compute[74613]:       </enum>
Nov 29 17:47:17 user nova-compute[74613]:     </mode>
Nov 29 17:47:17 user nova-compute[74613]:     <mode name='host-model' supported='yes'>
Nov 29 17:47:17 user nova-compute[74613]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Nov 29 17:47:17 user nova-compute[74613]:       <vendor>Intel</vendor>
Nov 29 17:47:17 user nova-compute[74613]:       <feature policy='require' name='ss'/>
Nov 29 17:47:17 user nova-compute[74613]:       <feature policy='require' name='vmx'/>
Nov 29 17:47:17 user nova-compute[74613]:       <feature policy='require' name='pcid'/>
Nov 29 17:47:17 user nova-compute[74613]:       <feature policy='require' name='hypervisor'/>
Nov 29 17:47:17 user nova-compute[74613]:       <feature policy='require' name='arat'/>
Nov 29 17:47:17 user nova-compute[74613]:       <feature policy='require' name='tsc_adjust'/>
Nov 29 17:47:17 user nova-compute[74613]:       <feature policy='require' name='umip'/>
Nov 29 17:47:17 user nova-compute[74613]:       <feature policy='require' name='md-clear'/>
Nov 29 17:47:17 user nova-compute[74613]:       <feature policy='require' name='stibp'/>
Nov 29 17:47:17 user nova-compute[74613]:       <feature policy='require' name='arch-capabilities'/>
Nov 29 17:47:17 user nova-compute[74613]:       <feature policy='require' name='ssbd'/>
Nov 29 17:47:17 user nova-compute[74613]:       <feature policy='require' name='ibpb'/>
Nov 29 17:47:17 user nova-compute[74613]:       <feature policy='require' name='ibrs'/>
Nov 29 17:47:17 user nova-compute[74613]:       <feature policy='require' name='amd-stibp'/>
Nov 29 17:47:17 user nova-compute[74613]:       <feature policy='require' name='amd-ssbd'/>
Nov 29 17:47:17 user nova-compute[74613]:       <feature policy='disable' name='erms'/>
Nov 29 17:47:17 user nova-compute[74613]:       <feature policy='disable' name='xsaveopt'/>
Nov 29 17:47:17 user nova-compute[74613]:       <feature policy='disable' name='lm'/>
Nov 29 17:47:17 user nova-compute[74613]:     </mode>
Nov 29 17:47:17 user nova-compute[74613]:     <mode name='custom' supported='yes'>
Nov 29 17:47:17 user nova-compute[74613]:       <model usable='no'>qemu64</model>
Nov 29 17:47:17 user nova-compute[74613]:       <model usable='yes'>qemu32</model>
Nov 29 17:47:17 user nova-compute[74613]:       <model usable='no'>phenom</model>
Nov 29 17:47:17 user nova-compute[74613]:       <model usable='yes'>pentium3</model>
Nov 29 17:47:17 user nova-compute[74613]:       <model usable='yes'>pentium2</model>
Nov 29 17:47:17 user nova-compute[74613]:       <model usable='yes'>pentium</model>
Nov 29 17:47:17 user nova-compute[74613]:       <model usable='no'>n270</model>
Nov 29 17:47:17 user nova-compute[74613]:       <model usable='no'>kvm64</model>
Nov 29 17:47:17 user nova-compute[74613]:       <model usable='yes'>kvm32</model>
Nov 29 17:47:17 user nova-compute[74613]:       <model usable='yes'>coreduo</model>
Nov 29 17:47:17 user nova-compute[74613]:       <model usable='no'>core2duo</model>
Nov 29 17:47:17 user nova-compute[74613]:       <model usable='no'>athlon</model>
Nov 29 17:47:17 user nova-compute[74613]:       <model usable='no'>Westmere-IBRS</model>
Nov 29 17:47:17 user nova-compute[74613]:       <model usable='no'>Westmere</model>
Nov 29 17:47:17 user nova-compute[74613]:       <model usable='no'>Snowridge</model>
Nov 29 17:47:17 user nova-compute[74613]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Nov 29 17:47:17 user nova-compute[74613]:       <model usable='no'>Skylake-Server-IBRS</model>
Nov 29 17:47:17 user nova-compute[74613]:       <model usable='no'>Skylake-Server</model>
Nov 29 17:47:17 user nova-compute[74613]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Nov 29 17:47:17 user nova-compute[74613]:       <model usable='no'>Skylake-Client-IBRS</model>
Nov 29 17:47:17 user nova-compute[74613]:       <model usable='no'>Skylake-Client</model>
Nov 29 17:47:17 user nova-compute[74613]:       <model usable='no'>SandyBridge-IBRS</model>
Nov 29 17:47:17 user nova-compute[74613]:       <model usable='no'>SandyBridge</model>
Nov 29 17:47:17 user nova-compute[74613]:       <model usable='no'>Penryn</model>
Nov 29 17:47:17 user nova-compute[74613]:       <model usable='no'>Opteron_G5</model>
Nov 29 17:47:17 user nova-compute[74613]:       <model usable='no'>Opteron_G4</model>
Nov 29 17:47:17 user nova-compute[74613]:       <model usable='no'>Opteron_G3</model>
Nov 29 17:47:17 user nova-compute[74613]:       <model usable='no'>Opteron_G2</model>
Nov 29 17:47:17 user nova-compute[74613]:       <model usable='no'>Opteron_G1</model>
Nov 29 17:47:17 user nova-compute[74613]:       <model usable='no'>Nehalem-IBRS</model>
Nov 29 17:47:17 user nova-compute[74613]:       <model usable='no'>Nehalem</model>
Nov 29 17:47:17 user nova-compute[74613]:       <model usable='no'>IvyBridge-IBRS</model>
Nov 29 17:47:17 user nova-compute[74613]:       <model usable='no'>IvyBridge</model>
Nov 29 17:47:17 user nova-compute[74613]:       <model usable='no'>Icelake-Server-noTSX</model>
Nov 29 17:47:17 user nova-compute[74613]:       <model usable='no'>Icelake-Server</model>
Nov 29 17:47:17 user nova-compute[74613]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Nov 29 17:47:17 user nova-compute[74613]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Nov 29 17:47:17 user nova-compute[74613]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Nov 29 17:47:17 user nova-compute[74613]:       <model usable='no'>Haswell-noTSX</model>
Nov 29 17:47:17 user nova-compute[74613]:       <model usable='no'>Haswell-IBRS</model>
Nov 29 17:47:17 user nova-compute[74613]:       <model usable='no'>Haswell</model>
Nov 29 17:47:17 user nova-compute[74613]:       <model usable='no'>EPYC-Rome</model>
Nov 29 17:47:17 user nova-compute[74613]:       <model usable='no'>EPYC-Milan</model>
Nov 29 17:47:17 user nova-compute[74613]:       <model usable='no'>EPYC-IBPB</model>
Nov 29 17:47:17 user nova-compute[74613]:       <model usable='no'>EPYC</model>
Nov 29 17:47:17 user nova-compute[74613]:       <model usable='no'>Dhyana</model>
Nov 29 17:47:17 user nova-compute[74613]:       <model usable='no'>Cooperlake</model>
Nov 29 17:47:17 user nova-compute[74613]:       <model usable='no'>Conroe</model>
Nov 29 17:47:17 user nova-compute[74613]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Nov 29 17:47:17 user nova-compute[74613]:       <model usable='no'>Cascadelake-Server</model>
Nov 29 17:47:17 user nova-compute[74613]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Nov 29 17:47:17 user nova-compute[74613]:       <model usable='no'>Broadwell-noTSX</model>
Nov 29 17:47:17 user nova-compute[74613]:       <model usable='no'>Broadwell-IBRS</model>
Nov 29 17:47:17 user nova-compute[74613]:       <model usable='no'>Broadwell</model>
Nov 29 17:47:17 user nova-compute[74613]:       <model usable='yes'>486</model>
Nov 29 17:47:17 user nova-compute[74613]:     </mode>
Nov 29 17:47:17 user nova-compute[74613]:   </cpu>
Nov 29 17:47:17 user nova-compute[74613]:   <memoryBacking supported='yes'>
Nov 29 17:47:17 user nova-compute[74613]:     <enum name='sourceType'>
Nov 29 17:47:17 user nova-compute[74613]:       <value>file</value>
Nov 29 17:47:17 user nova-compute[74613]:       <value>anonymous</value>
Nov 29 17:47:17 user nova-compute[74613]:       <value>memfd</value>
Nov 29 17:47:17 user nova-compute[74613]:     </enum>
Nov 29 17:47:17 user nova-compute[74613]:   </memoryBacking>
Nov 29 17:47:17 user nova-compute[74613]:   <devices>
Nov 29 17:47:17 user nova-compute[74613]:     <disk supported='yes'>
Nov 29 17:47:17 user nova-compute[74613]:       <enum name='diskDevice'>
Nov 29 17:47:17 user nova-compute[74613]:         <value>disk</value>
Nov 29 17:47:17 user nova-compute[74613]:         <value>cdrom</value>
Nov 29 17:47:17 user nova-compute[74613]:         <value>floppy</value>
Nov 29 17:47:17 user nova-compute[74613]:         <value>lun</value>
Nov 29 17:47:17 user nova-compute[74613]:       </enum>
Nov 29 17:47:17 user nova-compute[74613]:       <enum name='bus'>
Nov 29 17:47:17 user nova-compute[74613]:         <value>fdc</value>
Nov 29 17:47:17 user nova-compute[74613]:         <value>scsi</value>
Nov 29 17:47:17 user nova-compute[74613]:         <value>virtio</value>
Nov 29 17:47:17 user nova-compute[74613]:         <value>usb</value>
Nov 29 17:47:17 user nova-compute[74613]:         <value>sata</value>
Nov 29 17:47:17 user nova-compute[74613]:       </enum>
Nov 29 17:47:17 user nova-compute[74613]:       <enum name='model'>
Nov 29 17:47:17 user nova-compute[74613]:         <value>virtio</value>
Nov 29 17:47:17 user nova-compute[74613]:         <value>virtio-transitional</value>
Nov 29 17:47:17 user nova-compute[74613]:         <value>virtio-non-transitional</value>
Nov 29 17:47:17 user nova-compute[74613]:       </enum>
Nov 29 17:47:17 user nova-compute[74613]:     </disk>
Nov 29 17:47:17 user nova-compute[74613]:     <graphics supported='yes'>
Nov 29 17:47:17 user nova-compute[74613]:       <enum name='type'>
Nov 29 17:47:17 user nova-compute[74613]:         <value>sdl</value>
Nov 29 17:47:17 user nova-compute[74613]:         <value>vnc</value>
Nov 29 17:47:17 user nova-compute[74613]:         <value>spice</value>
Nov 29 17:47:17 user nova-compute[74613]:         <value>egl-headless</value>
Nov 29 17:47:17 user nova-compute[74613]:       </enum>
Nov 29 17:47:17 user nova-compute[74613]:     </graphics>
Nov 29 17:47:17 user nova-compute[74613]:     <video supported='yes'>
Nov 29 17:47:17 user nova-compute[74613]:       <enum name='modelType'>
Nov 29 17:47:17 user nova-compute[74613]:         <value>vga</value>
Nov 29 17:47:17 user nova-compute[74613]:         <value>cirrus</value>
Nov 29 17:47:17 user nova-compute[74613]:         <value>vmvga</value>
Nov 29 17:47:17 user nova-compute[74613]:         <value>qxl</value>
Nov 29 17:47:17 user nova-compute[74613]:         <value>virtio</value>
Nov 29 17:47:17 user nova-compute[74613]:         <value>none</value>
Nov 29 17:47:17 user nova-compute[74613]:         <value>bochs</value>
Nov 29 17:47:17 user nova-compute[74613]:         <value>ramfb</value>
Nov 29 17:47:17 user nova-compute[74613]:       </enum>
Nov 29 17:47:17 user nova-compute[74613]:     </video>
Nov 29 17:47:17 user nova-compute[74613]:     <hostdev supported='yes'>
Nov 29 17:47:17 user nova-compute[74613]:       <enum name='mode'>
Nov 29 17:47:17 user nova-compute[74613]:         <value>subsystem</value>
Nov 29 17:47:17 user nova-compute[74613]:       </enum>
Nov 29 17:47:17 user nova-compute[74613]:       <enum name='startupPolicy'>
Nov 29 17:47:17 user nova-compute[74613]:         <value>default</value>
Nov 29 17:47:17 user nova-compute[74613]:         <value>mandatory</value>
Nov 29 17:47:17 user nova-compute[74613]:         <value>requisite</value>
Nov 29 17:47:17 user nova-compute[74613]:         <value>optional</value>
Nov 29 17:47:17 user nova-compute[74613]:       </enum>
Nov 29 17:47:17 user nova-compute[74613]:       <enum name='subsysType'>
Nov 29 17:47:17 user nova-compute[74613]:         <value>usb</value>
Nov 29 17:47:17 user nova-compute[74613]:         <value>pci</value>
Nov 29 17:47:17 user nova-compute[74613]:         <value>scsi</value>
Nov 29 17:47:17 user nova-compute[74613]:       </enum>
Nov 29 17:47:17 user nova-compute[74613]:       <enum name='capsType'/>
Nov 29 17:47:17 user nova-compute[74613]:       <enum name='pciBackend'/>
Nov 29 17:47:17 user nova-compute[74613]:     </hostdev>
Nov 29 17:47:17 user nova-compute[74613]:     <rng supported='yes'>
Nov 29 17:47:17 user nova-compute[74613]:       <enum name='model'>
Nov 29 17:47:17 user nova-compute[74613]:         <value>virtio</value>
Nov 29 17:47:17 user nova-compute[74613]:         <value>virtio-transitional</value>
Nov 29 17:47:17 user nova-compute[74613]:         <value>virtio-non-transitional</value>
Nov 29 17:47:17 user nova-compute[74613]:       </enum>
Nov 29 17:47:17 user nova-compute[74613]:       <enum name='backendModel'>
Nov 29 17:47:17 user nova-compute[74613]:         <value>random</value>
Nov 29 17:47:17 user nova-compute[74613]:         <value>egd</value>
Nov 29 17:47:17 user nova-compute[74613]:         <value>builtin</value>
Nov 29 17:47:17 user nova-compute[74613]:       </enum>
Nov 29 17:47:17 user nova-compute[74613]:     </rng>
Nov 29 17:47:17 user nova-compute[74613]:     <filesystem supported='yes'>
Nov 29 17:47:17 user nova-compute[74613]:       <enum name='driverType'>
Nov 29 17:47:17 user nova-compute[74613]:         <value>path</value>
Nov 29 17:47:17 user nova-compute[74613]:         <value>handle</value>
Nov 29 17:47:17 user nova-compute[74613]:         <value>virtiofs</value>
Nov 29 17:47:17 user nova-compute[74613]:       </enum>
Nov 29 17:47:17 user nova-compute[74613]:     </filesystem>
Nov 29 17:47:17 user nova-compute[74613]:     <tpm supported='yes'>
Nov 29 17:47:17 user nova-compute[74613]:       <enum name='model'>
Nov 29 17:47:17 user nova-compute[74613]:         <value>tpm-tis</value>
Nov 29 17:47:17 user nova-compute[74613]:         <value>tpm-crb</value>
Nov 29 17:47:17 user nova-compute[74613]:       </enum>
Nov 29 17:47:17 user nova-compute[74613]:       <enum name='backendModel'>
Nov 29 17:47:17 user nova-compute[74613]:         <value>passthrough</value>
Nov 29 17:47:17 user nova-compute[74613]:         <value>emulator</value>
Nov 29 17:47:17 user nova-compute[74613]:       </enum>
Nov 29 17:47:17 user nova-compute[74613]:     </tpm>
Nov 29 17:47:17 user nova-compute[74613]:   </devices>
Nov 29 17:47:17 user nova-compute[74613]:   <features>
Nov 29 17:47:17 user nova-compute[74613]:     <gic supported='no'/>
Nov 29 17:47:17 user nova-compute[74613]:     <vmcoreinfo supported='yes'/>
Nov 29 17:47:17 user nova-compute[74613]:     <genid supported='yes'/>
Nov 29 17:47:17 user nova-compute[74613]:     <backingStoreInput supported='yes'/>
Nov 29 17:47:17 user nova-compute[74613]:     <backup supported='yes'/>
Nov 29 17:47:17 user nova-compute[74613]:     <sev supported='no'/>
Nov 29 17:47:17 user nova-compute[74613]:   </features>
Nov 29 17:47:17 user nova-compute[74613]: </domainCapabilities>
Nov 29 17:47:17 user nova-compute[74613]:  {{(pid=74613) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1039}}
Nov 29 17:47:17 user nova-compute[74613]: DEBUG nova.virt.libvirt.host [None req-ff6a7ff8-5f06-4fe1-9453-c4b85f4805d3 None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=pc:
Nov 29 17:47:17 user nova-compute[74613]: <domainCapabilities>
Nov 29 17:47:17 user nova-compute[74613]:   <path>/usr/bin/qemu-system-i386</path>
Nov 29 17:47:17 user nova-compute[74613]:   <domain>kvm</domain>
Nov 29 17:47:17 user nova-compute[74613]:   <machine>pc-i440fx-6.2</machine>
Nov 29 17:47:17 user nova-compute[74613]:   <arch>i686</arch>
Nov 29 17:47:17 user nova-compute[74613]:   <vcpu max='255'/>
Nov 29 17:47:17 user nova-compute[74613]:   <iothreads supported='yes'/>
Nov 29 17:47:17 user nova-compute[74613]:   <os supported='yes'>
Nov 29 17:47:17 user nova-compute[74613]:     <enum name='firmware'/>
Nov 29 17:47:17 user nova-compute[74613]:     <loader supported='yes'>
Nov 29 17:47:17 user nova-compute[74613]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Nov 29 17:47:17 user nova-compute[74613]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Nov 29 17:47:17 user nova-compute[74613]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Nov 29 17:47:17 user nova-compute[74613]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Nov 29 17:47:17 user nova-compute[74613]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Nov 29 17:47:17 user nova-compute[74613]:       <enum name='type'>
Nov 29 17:47:17 user nova-compute[74613]:         <value>rom</value>
Nov 29 17:47:17 user nova-compute[74613]:         <value>pflash</value>
Nov 29 17:47:17 user nova-compute[74613]:       </enum>
Nov 29 17:47:17 user nova-compute[74613]:       <enum name='readonly'>
Nov 29 17:47:17 user nova-compute[74613]:         <value>yes</value>
Nov 29 17:47:17 user nova-compute[74613]:         <value>no</value>
Nov 29 17:47:17 user nova-compute[74613]:       </enum>
Nov 29 17:47:17 user nova-compute[74613]:       <enum name='secure'>
Nov 29 17:47:17 user nova-compute[74613]:         <value>no</value>
Nov 29 17:47:17 user nova-compute[74613]:       </enum>
Nov 29 17:47:17 user nova-compute[74613]:     </loader>
Nov 29 17:47:17 user nova-compute[74613]:   </os>
Nov 29 17:47:17 user nova-compute[74613]:   <cpu>
Nov 29 17:47:17 user nova-compute[74613]:     <mode name='host-passthrough' supported='yes'>
Nov 29 17:47:17 user nova-compute[74613]:       <enum name='hostPassthroughMigratable'>
Nov 29 17:47:17 user nova-compute[74613]:         <value>off</value>
Nov 29 17:47:17 user nova-compute[74613]:       </enum>
Nov 29 17:47:17 user nova-compute[74613]:     </mode>
Nov 29 17:47:17 user nova-compute[74613]:     <mode name='maximum' supported='yes'>
Nov 29 17:47:17 user nova-compute[74613]:       <enum name='maximumMigratable'>
Nov 29 17:47:17 user nova-compute[74613]:         <value>on</value>
Nov 29 17:47:17 user nova-compute[74613]:         <value>off</value>
Nov 29 17:47:17 user nova-compute[74613]:       </enum>
Nov 29 17:47:17 user nova-compute[74613]:     </mode>
Nov 29 17:47:17 user nova-compute[74613]:     <mode name='host-model' supported='yes'>
Nov 29 17:47:17 user nova-compute[74613]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Nov 29 17:47:17 user nova-compute[74613]:       <vendor>Intel</vendor>
Nov 29 17:47:17 user nova-compute[74613]:       <feature policy='require' name='ss'/>
Nov 29 17:47:17 user nova-compute[74613]:       <feature policy='require' name='vmx'/>
Nov 29 17:47:17 user nova-compute[74613]:       <feature policy='require' name='pcid'/>
Nov 29 17:47:17 user nova-compute[74613]:       <feature policy='require' name='hypervisor'/>
Nov 29 17:47:17 user nova-compute[74613]:       <feature policy='require' name='arat'/>
Nov 29 17:47:17 user nova-compute[74613]:       <feature policy='require' name='tsc_adjust'/>
Nov 29 17:47:17 user nova-compute[74613]:       <feature policy='require' name='umip'/>
Nov 29 17:47:17 user nova-compute[74613]:       <feature policy='require' name='md-clear'/>
Nov 29 17:47:17 user nova-compute[74613]:       <feature policy='require' name='stibp'/>
Nov 29 17:47:17 user nova-compute[74613]:       <feature policy='require' name='arch-capabilities'/>
Nov 29 17:47:17 user nova-compute[74613]:       <feature policy='require' name='ssbd'/>
Nov 29 17:47:17 user nova-compute[74613]:       <feature policy='require' name='ibpb'/>
Nov 29 17:47:17 user nova-compute[74613]:       <feature policy='require' name='ibrs'/>
Nov 29 17:47:17 user nova-compute[74613]:       <feature policy='require' name='amd-stibp'/>
Nov 29 17:47:17 user nova-compute[74613]:       <feature policy='require' name='amd-ssbd'/>
Nov 29 17:47:17 user nova-compute[74613]:       <feature policy='disable' name='erms'/>
Nov 29 17:47:17 user nova-compute[74613]:       <feature policy='disable' name='xsaveopt'/>
Nov 29 17:47:17 user nova-compute[74613]:       <feature policy='disable' name='lm'/>
Nov 29 17:47:17 user nova-compute[74613]:     </mode>
Nov 29 17:47:17 user nova-compute[74613]:     <mode name='custom' supported='yes'>
Nov 29 17:47:17 user nova-compute[74613]:       <model usable='no'>qemu64</model>
Nov 29 17:47:17 user nova-compute[74613]:       <model usable='yes'>qemu32</model>
Nov 29 17:47:17 user nova-compute[74613]:       <model usable='no'>phenom</model>
Nov 29 17:47:17 user nova-compute[74613]:       <model usable='yes'>pentium3</model>
Nov 29 17:47:17 user nova-compute[74613]:       <model usable='yes'>pentium2</model>
Nov 29 17:47:17 user nova-compute[74613]:       <model usable='yes'>pentium</model>
Nov 29 17:47:17 user nova-compute[74613]:       <model usable='no'>n270</model>
Nov 29 17:47:17 user nova-compute[74613]:       <model usable='no'>kvm64</model>
Nov 29 17:47:17 user nova-compute[74613]:       <model usable='yes'>kvm32</model>
Nov 29 17:47:17 user nova-compute[74613]:       <model usable='yes'>coreduo</model>
Nov 29 17:47:17 user nova-compute[74613]:       <model usable='no'>core2duo</model>
Nov 29 17:47:17 user nova-compute[74613]:       <model usable='no'>athlon</model>
Nov 29 17:47:17 user nova-compute[74613]:       <model usable='no'>Westmere-IBRS</model>
Nov 29 17:47:17 user nova-compute[74613]:       <model usable='no'>Westmere</model>
Nov 29 17:47:17 user nova-compute[74613]:       <model usable='no'>Snowridge</model>
Nov 29 17:47:17 user nova-compute[74613]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Nov 29 17:47:17 user nova-compute[74613]:       <model usable='no'>Skylake-Server-IBRS</model>
Nov 29 17:47:17 user nova-compute[74613]:       <model usable='no'>Skylake-Server</model>
Nov 29 17:47:17 user nova-compute[74613]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Nov 29 17:47:17 user nova-compute[74613]:       <model usable='no'>Skylake-Client-IBRS</model>
Nov 29 17:47:17 user nova-compute[74613]:       <model usable='no'>Skylake-Client</model>
Nov 29 17:47:17 user nova-compute[74613]:       <model usable='no'>SandyBridge-IBRS</model>
Nov 29 17:47:17 user nova-compute[74613]:       <model usable='no'>SandyBridge</model>
Nov 29 17:47:17 user nova-compute[74613]:       <model usable='no'>Penryn</model>
Nov 29 17:47:17 user nova-compute[74613]:       <model usable='no'>Opteron_G5</model>
Nov 29 17:47:17 user nova-compute[74613]:       <model usable='no'>Opteron_G4</model>
Nov 29 17:47:17 user nova-compute[74613]:       <model usable='no'>Opteron_G3</model>
Nov 29 17:47:17 user nova-compute[74613]:       <model usable='no'>Opteron_G2</model>
Nov 29 17:47:17 user nova-compute[74613]:       <model usable='no'>Opteron_G1</model>
Nov 29 17:47:17 user nova-compute[74613]:       <model usable='no'>Nehalem-IBRS</model>
Nov 29 17:47:17 user nova-compute[74613]:       <model usable='no'>Nehalem</model>
Nov 29 17:47:17 user nova-compute[74613]:       <model usable='no'>IvyBridge-IBRS</model>
Nov 29 17:47:17 user nova-compute[74613]:       <model usable='no'>IvyBridge</model>
Nov 29 17:47:17 user nova-compute[74613]:       <model usable='no'>Icelake-Server-noTSX</model>
Nov 29 17:47:17 user nova-compute[74613]:       <model usable='no'>Icelake-Server</model>
Nov 29 17:47:17 user nova-compute[74613]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Nov 29 17:47:17 user nova-compute[74613]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Nov 29 17:47:17 user nova-compute[74613]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Nov 29 17:47:17 user nova-compute[74613]:       <model usable='no'>Haswell-noTSX</model>
Nov 29 17:47:17 user nova-compute[74613]:       <model usable='no'>Haswell-IBRS</model>
Nov 29 17:47:17 user nova-compute[74613]:       <model usable='no'>Haswell</model>
Nov 29 17:47:17 user nova-compute[74613]:       <model usable='no'>EPYC-Rome</model>
Nov 29 17:47:17 user nova-compute[74613]:       <model usable='no'>EPYC-Milan</model>
Nov 29 17:47:17 user nova-compute[74613]:       <model usable='no'>EPYC-IBPB</model>
Nov 29 17:47:17 user nova-compute[74613]:       <model usable='no'>EPYC</model>
Nov 29 17:47:17 user nova-compute[74613]:       <model usable='no'>Dhyana</model>
Nov 29 17:47:17 user nova-compute[74613]:       <model usable='no'>Cooperlake</model>
Nov 29 17:47:17 user nova-compute[74613]:       <model usable='no'>Conroe</model>
Nov 29 17:47:17 user nova-compute[74613]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Nov 29 17:47:17 user nova-compute[74613]:       <model usable='no'>Cascadelake-Server</model>
Nov 29 17:47:17 user nova-compute[74613]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Nov 29 17:47:17 user nova-compute[74613]:       <model usable='no'>Broadwell-noTSX</model>
Nov 29 17:47:17 user nova-compute[74613]:       <model usable='no'>Broadwell-IBRS</model>
Nov 29 17:47:17 user nova-compute[74613]:       <model usable='no'>Broadwell</model>
Nov 29 17:47:17 user nova-compute[74613]:       <model usable='yes'>486</model>
Nov 29 17:47:17 user nova-compute[74613]:     </mode>
Nov 29 17:47:17 user nova-compute[74613]:   </cpu>
Nov 29 17:47:17 user nova-compute[74613]:   <memoryBacking supported='yes'>
Nov 29 17:47:17 user nova-compute[74613]:     <enum name='sourceType'>
Nov 29 17:47:17 user nova-compute[74613]:       <value>file</value>
Nov 29 17:47:17 user nova-compute[74613]:       <value>anonymous</value>
Nov 29 17:47:17 user nova-compute[74613]:       <value>memfd</value>
Nov 29 17:47:17 user nova-compute[74613]:     </enum>
Nov 29 17:47:17 user nova-compute[74613]:   </memoryBacking>
Nov 29 17:47:17 user nova-compute[74613]:   <devices>
Nov 29 17:47:17 user nova-compute[74613]:     <disk supported='yes'>
Nov 29 17:47:17 user nova-compute[74613]:       <enum name='diskDevice'>
Nov 29 17:47:17 user nova-compute[74613]:         <value>disk</value>
Nov 29 17:47:17 user nova-compute[74613]:         <value>cdrom</value>
Nov 29 17:47:17 user nova-compute[74613]:         <value>floppy</value>
Nov 29 17:47:17 user nova-compute[74613]:         <value>lun</value>
Nov 29 17:47:17 user nova-compute[74613]:       </enum>
Nov 29 17:47:17 user nova-compute[74613]:       <enum name='bus'>
Nov 29 17:47:17 user nova-compute[74613]:         <value>ide</value>
Nov 29 17:47:17 user nova-compute[74613]:         <value>fdc</value>
Nov 29 17:47:17 user nova-compute[74613]:         <value>scsi</value>
Nov 29 17:47:17 user nova-compute[74613]:         <value>virtio</value>
Nov 29 17:47:17 user nova-compute[74613]:         <value>usb</value>
Nov 29 17:47:17 user nova-compute[74613]:         <value>sata</value>
Nov 29 17:47:17 user nova-compute[74613]:       </enum>
Nov 29 17:47:17 user nova-compute[74613]:       <enum name='model'>
Nov 29 17:47:17 user nova-compute[74613]:         <value>virtio</value>
Nov 29 17:47:17 user nova-compute[74613]:         <value>virtio-transitional</value>
Nov 29 17:47:17 user nova-compute[74613]:         <value>virtio-non-transitional</value>
Nov 29 17:47:17 user nova-compute[74613]:       </enum>
Nov 29 17:47:17 user nova-compute[74613]:     </disk>
Nov 29 17:47:17 user nova-compute[74613]:     <graphics supported='yes'>
Nov 29 17:47:17 user nova-compute[74613]:       <enum name='type'>
Nov 29 17:47:17 user nova-compute[74613]:         <value>sdl</value>
Nov 29 17:47:17 user nova-compute[74613]:         <value>vnc</value>
Nov 29 17:47:17 user nova-compute[74613]:         <value>spice</value>
Nov 29 17:47:17 user nova-compute[74613]:         <value>egl-headless</value>
Nov 29 17:47:17 user nova-compute[74613]:       </enum>
Nov 29 17:47:17 user nova-compute[74613]:     </graphics>
Nov 29 17:47:17 user nova-compute[74613]:     <video supported='yes'>
Nov 29 17:47:17 user nova-compute[74613]:       <enum name='modelType'>
Nov 29 17:47:17 user nova-compute[74613]:         <value>vga</value>
Nov 29 17:47:17 user nova-compute[74613]:         <value>cirrus</value>
Nov 29 17:47:17 user nova-compute[74613]:         <value>vmvga</value>
Nov 29 17:47:17 user nova-compute[74613]:         <value>qxl</value>
Nov 29 17:47:17 user nova-compute[74613]:         <value>virtio</value>
Nov 29 17:47:17 user nova-compute[74613]:         <value>none</value>
Nov 29 17:47:17 user nova-compute[74613]:         <value>bochs</value>
Nov 29 17:47:17 user nova-compute[74613]:         <value>ramfb</value>
Nov 29 17:47:17 user nova-compute[74613]:       </enum>
Nov 29 17:47:17 user nova-compute[74613]:     </video>
Nov 29 17:47:17 user nova-compute[74613]:     <hostdev supported='yes'>
Nov 29 17:47:17 user nova-compute[74613]:       <enum name='mode'>
Nov 29 17:47:17 user nova-compute[74613]:         <value>subsystem</value>
Nov 29 17:47:17 user nova-compute[74613]:       </enum>
Nov 29 17:47:17 user nova-compute[74613]:       <enum name='startupPolicy'>
Nov 29 17:47:17 user nova-compute[74613]:         <value>default</value>
Nov 29 17:47:17 user nova-compute[74613]:         <value>mandatory</value>
Nov 29 17:47:17 user nova-compute[74613]:         <value>requisite</value>
Nov 29 17:47:17 user nova-compute[74613]:         <value>optional</value>
Nov 29 17:47:17 user nova-compute[74613]:       </enum>
Nov 29 17:47:17 user nova-compute[74613]:       <enum name='subsysType'>
Nov 29 17:47:17 user nova-compute[74613]:         <value>usb</value>
Nov 29 17:47:17 user nova-compute[74613]:         <value>pci</value>
Nov 29 17:47:17 user nova-compute[74613]:         <value>scsi</value>
Nov 29 17:47:17 user nova-compute[74613]:       </enum>
Nov 29 17:47:17 user nova-compute[74613]:       <enum name='capsType'/>
Nov 29 17:47:17 user nova-compute[74613]:       <enum name='pciBackend'/>
Nov 29 17:47:17 user nova-compute[74613]:     </hostdev>
Nov 29 17:47:17 user nova-compute[74613]:     <rng supported='yes'>
Nov 29 17:47:17 user nova-compute[74613]:       <enum name='model'>
Nov 29 17:47:17 user nova-compute[74613]:         <value>virtio</value>
Nov 29 17:47:17 user nova-compute[74613]:         <value>virtio-transitional</value>
Nov 29 17:47:17 user nova-compute[74613]:         <value>virtio-non-transitional</value>
Nov 29 17:47:17 user nova-compute[74613]:       </enum>
Nov 29 17:47:17 user nova-compute[74613]:       <enum name='backendModel'>
Nov 29 17:47:17 user nova-compute[74613]:         <value>random</value>
Nov 29 17:47:17 user nova-compute[74613]:         <value>egd</value>
Nov 29 17:47:17 user nova-compute[74613]:         <value>builtin</value>
Nov 29 17:47:17 user nova-compute[74613]:       </enum>
Nov 29 17:47:17 user nova-compute[74613]:     </rng>
Nov 29 17:47:17 user nova-compute[74613]:     <filesystem supported='yes'>
Nov 29 17:47:17 user nova-compute[74613]:       <enum name='driverType'>
Nov 29 17:47:17 user nova-compute[74613]:         <value>path</value>
Nov 29 17:47:17 user nova-compute[74613]:         <value>handle</value>
Nov 29 17:47:17 user nova-compute[74613]:         <value>virtiofs</value>
Nov 29 17:47:17 user nova-compute[74613]:       </enum>
Nov 29 17:47:17 user nova-compute[74613]:     </filesystem>
Nov 29 17:47:17 user nova-compute[74613]:     <tpm supported='yes'>
Nov 29 17:47:17 user nova-compute[74613]:       <enum name='model'>
Nov 29 17:47:17 user nova-compute[74613]:         <value>tpm-tis</value>
Nov 29 17:47:17 user nova-compute[74613]:         <value>tpm-crb</value>
Nov 29 17:47:17 user nova-compute[74613]:       </enum>
Nov 29 17:47:17 user nova-compute[74613]:       <enum name='backendModel'>
Nov 29 17:47:17 user nova-compute[74613]:         <value>passthrough</value>
Nov 29 17:47:17 user nova-compute[74613]:         <value>emulator</value>
Nov 29 17:47:17 user nova-compute[74613]:       </enum>
Nov 29 17:47:17 user nova-compute[74613]:     </tpm>
Nov 29 17:47:17 user nova-compute[74613]:   </devices>
Nov 29 17:47:17 user nova-compute[74613]:   <features>
Nov 29 17:47:17 user nova-compute[74613]:     <gic supported='no'/>
Nov 29 17:47:17 user nova-compute[74613]:     <vmcoreinfo supported='yes'/>
Nov 29 17:47:17 user nova-compute[74613]:     <genid supported='yes'/>
Nov 29 17:47:17 user nova-compute[74613]:     <backingStoreInput supported='yes'/>
Nov 29 17:47:17 user nova-compute[74613]:     <backup supported='yes'/>
Nov 29 17:47:17 user nova-compute[74613]:     <sev supported='no'/>
Nov 29 17:47:17 user nova-compute[74613]:   </features>
Nov 29 17:47:17 user nova-compute[74613]: </domainCapabilities>
Nov 29 17:47:17 user nova-compute[74613]:  {{(pid=74613) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1039}}
Nov 29 17:47:17 user nova-compute[74613]: DEBUG nova.virt.libvirt.host [None req-ff6a7ff8-5f06-4fe1-9453-c4b85f4805d3 None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=ubuntu:
Nov 29 17:47:17 user nova-compute[74613]: <domainCapabilities>
Nov 29 17:47:17 user nova-compute[74613]:   <path>/usr/bin/qemu-system-i386</path>
Nov 29 17:47:17 user nova-compute[74613]:   <domain>kvm</domain>
Nov 29 17:47:17 user nova-compute[74613]:   <machine>pc-i440fx-jammy</machine>
Nov 29 17:47:17 user nova-compute[74613]:   <arch>i686</arch>
Nov 29 17:47:17 user nova-compute[74613]:   <vcpu max='255'/>
Nov 29 17:47:17 user nova-compute[74613]:   <iothreads supported='yes'/>
Nov 29 17:47:17 user nova-compute[74613]:   <os supported='yes'>
Nov 29 17:47:17 user nova-compute[74613]:     <enum name='firmware'/>
Nov 29 17:47:17 user nova-compute[74613]:     <loader supported='yes'>
Nov 29 17:47:17 user nova-compute[74613]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Nov 29 17:47:17 user nova-compute[74613]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Nov 29 17:47:17 user nova-compute[74613]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Nov 29 17:47:17 user nova-compute[74613]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Nov 29 17:47:17 user nova-compute[74613]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Nov 29 17:47:17 user nova-compute[74613]:       <enum name='type'>
Nov 29 17:47:17 user nova-compute[74613]:         <value>rom</value>
Nov 29 17:47:17 user nova-compute[74613]:         <value>pflash</value>
Nov 29 17:47:17 user nova-compute[74613]:       </enum>
Nov 29 17:47:17 user nova-compute[74613]:       <enum name='readonly'>
Nov 29 17:47:17 user nova-compute[74613]:         <value>yes</value>
Nov 29 17:47:17 user nova-compute[74613]:         <value>no</value>
Nov 29 17:47:17 user nova-compute[74613]:       </enum>
Nov 29 17:47:17 user nova-compute[74613]:       <enum name='secure'>
Nov 29 17:47:17 user nova-compute[74613]:         <value>no</value>
Nov 29 17:47:17 user nova-compute[74613]:       </enum>
Nov 29 17:47:17 user nova-compute[74613]:     </loader>
Nov 29 17:47:17 user nova-compute[74613]:   </os>
Nov 29 17:47:17 user nova-compute[74613]:   <cpu>
Nov 29 17:47:17 user nova-compute[74613]:     <mode name='host-passthrough' supported='yes'>
Nov 29 17:47:17 user nova-compute[74613]:       <enum name='hostPassthroughMigratable'>
Nov 29 17:47:17 user nova-compute[74613]:         <value>off</value>
Nov 29 17:47:17 user nova-compute[74613]:       </enum>
Nov 29 17:47:17 user nova-compute[74613]:     </mode>
Nov 29 17:47:17 user nova-compute[74613]:     <mode name='maximum' supported='yes'>
Nov 29 17:47:17 user nova-compute[74613]:       <enum name='maximumMigratable'>
Nov 29 17:47:17 user nova-compute[74613]:         <value>on</value>
Nov 29 17:47:17 user nova-compute[74613]:         <value>off</value>
Nov 29 17:47:17 user nova-compute[74613]:       </enum>
Nov 29 17:47:17 user nova-compute[74613]:     </mode>
Nov 29 17:47:17 user nova-compute[74613]:     <mode name='host-model' supported='yes'>
Nov 29 17:47:17 user nova-compute[74613]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Nov 29 17:47:17 user nova-compute[74613]:       <vendor>Intel</vendor>
Nov 29 17:47:17 user nova-compute[74613]:       <feature policy='require' name='ss'/>
Nov 29 17:47:17 user nova-compute[74613]:       <feature policy='require' name='vmx'/>
Nov 29 17:47:17 user nova-compute[74613]:       <feature policy='require' name='pcid'/>
Nov 29 17:47:17 user nova-compute[74613]:       <feature policy='require' name='hypervisor'/>
Nov 29 17:47:17 user nova-compute[74613]:       <feature policy='require' name='arat'/>
Nov 29 17:47:17 user nova-compute[74613]:       <feature policy='require' name='tsc_adjust'/>
Nov 29 17:47:17 user nova-compute[74613]:       <feature policy='require' name='umip'/>
Nov 29 17:47:17 user nova-compute[74613]:       <feature policy='require' name='md-clear'/>
Nov 29 17:47:17 user nova-compute[74613]:       <feature policy='require' name='stibp'/>
Nov 29 17:47:17 user nova-compute[74613]:       <feature policy='require' name='arch-capabilities'/>
Nov 29 17:47:17 user nova-compute[74613]:       <feature policy='require' name='ssbd'/>
Nov 29 17:47:17 user nova-compute[74613]:       <feature policy='require' name='ibpb'/>
Nov 29 17:47:17 user nova-compute[74613]:       <feature policy='require' name='ibrs'/>
Nov 29 17:47:17 user nova-compute[74613]:       <feature policy='require' name='amd-stibp'/>
Nov 29 17:47:17 user nova-compute[74613]:       <feature policy='require' name='amd-ssbd'/>
Nov 29 17:47:17 user nova-compute[74613]:       <feature policy='disable' name='erms'/>
Nov 29 17:47:17 user nova-compute[74613]:       <feature policy='disable' name='xsaveopt'/>
Nov 29 17:47:17 user nova-compute[74613]:       <feature policy='disable' name='lm'/>
Nov 29 17:47:17 user nova-compute[74613]:     </mode>
Nov 29 17:47:17 user nova-compute[74613]:     <mode name='custom' supported='yes'>
Nov 29 17:47:17 user nova-compute[74613]:       <model usable='no'>qemu64</model>
Nov 29 17:47:17 user nova-compute[74613]:       <model usable='yes'>qemu32</model>
Nov 29 17:47:17 user nova-compute[74613]:       <model usable='no'>phenom</model>
Nov 29 17:47:17 user nova-compute[74613]:       <model usable='yes'>pentium3</model>
Nov 29 17:47:17 user nova-compute[74613]:       <model usable='yes'>pentium2</model>
Nov 29 17:47:17 user nova-compute[74613]:       <model usable='yes'>pentium</model>
Nov 29 17:47:17 user nova-compute[74613]:       <model usable='no'>n270</model>
Nov 29 17:47:17 user nova-compute[74613]:       <model usable='no'>kvm64</model>
Nov 29 17:47:17 user nova-compute[74613]:       <model usable='yes'>kvm32</model>
Nov 29 17:47:17 user nova-compute[74613]:       <model usable='yes'>coreduo</model>
Nov 29 17:47:17 user nova-compute[74613]:       <model usable='no'>core2duo</model>
Nov 29 17:47:17 user nova-compute[74613]:       <model usable='no'>athlon</model>
Nov 29 17:47:17 user nova-compute[74613]:       <model usable='no'>Westmere-IBRS</model>
Nov 29 17:47:17 user nova-compute[74613]:       <model usable='no'>Westmere</model>
Nov 29 17:47:17 user nova-compute[74613]:       <model usable='no'>Snowridge</model>
Nov 29 17:47:17 user nova-compute[74613]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Nov 29 17:47:17 user nova-compute[74613]:       <model usable='no'>Skylake-Server-IBRS</model>
Nov 29 17:47:17 user nova-compute[74613]:       <model usable='no'>Skylake-Server</model>
Nov 29 17:47:17 user nova-compute[74613]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Nov 29 17:47:17 user nova-compute[74613]:       <model usable='no'>Skylake-Client-IBRS</model>
Nov 29 17:47:17 user nova-compute[74613]:       <model usable='no'>Skylake-Client</model>
Nov 29 17:47:17 user nova-compute[74613]:       <model usable='no'>SandyBridge-IBRS</model>
Nov 29 17:47:17 user nova-compute[74613]:       <model usable='no'>SandyBridge</model>
Nov 29 17:47:17 user nova-compute[74613]:       <model usable='no'>Penryn</model>
Nov 29 17:47:17 user nova-compute[74613]:       <model usable='no'>Opteron_G5</model>
Nov 29 17:47:17 user nova-compute[74613]:       <model usable='no'>Opteron_G4</model>
Nov 29 17:47:17 user nova-compute[74613]:       <model usable='no'>Opteron_G3</model>
Nov 29 17:47:17 user nova-compute[74613]:       <model usable='no'>Opteron_G2</model>
Nov 29 17:47:17 user nova-compute[74613]:       <model usable='no'>Opteron_G1</model>
Nov 29 17:47:17 user nova-compute[74613]:       <model usable='no'>Nehalem-IBRS</model>
Nov 29 17:47:17 user nova-compute[74613]:       <model usable='no'>Nehalem</model>
Nov 29 17:47:17 user nova-compute[74613]:       <model usable='no'>IvyBridge-IBRS</model>
Nov 29 17:47:17 user nova-compute[74613]:       <model usable='no'>IvyBridge</model>
Nov 29 17:47:17 user nova-compute[74613]:       <model usable='no'>Icelake-Server-noTSX</model>
Nov 29 17:47:17 user nova-compute[74613]:       <model usable='no'>Icelake-Server</model>
Nov 29 17:47:17 user nova-compute[74613]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Nov 29 17:47:17 user nova-compute[74613]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Nov 29 17:47:17 user nova-compute[74613]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Nov 29 17:47:17 user nova-compute[74613]:       <model usable='no'>Haswell-noTSX</model>
Nov 29 17:47:17 user nova-compute[74613]:       <model usable='no'>Haswell-IBRS</model>
Nov 29 17:47:17 user nova-compute[74613]:       <model usable='no'>Haswell</model>
Nov 29 17:47:17 user nova-compute[74613]:       <model usable='no'>EPYC-Rome</model>
Nov 29 17:47:17 user nova-compute[74613]:       <model usable='no'>EPYC-Milan</model>
Nov 29 17:47:17 user nova-compute[74613]:       <model usable='no'>EPYC-IBPB</model>
Nov 29 17:47:17 user nova-compute[74613]:       <model usable='no'>EPYC</model>
Nov 29 17:47:17 user nova-compute[74613]:       <model usable='no'>Dhyana</model>
Nov 29 17:47:17 user nova-compute[74613]:       <model usable='no'>Cooperlake</model>
Nov 29 17:47:17 user nova-compute[74613]:       <model usable='no'>Conroe</model>
Nov 29 17:47:17 user nova-compute[74613]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Nov 29 17:47:17 user nova-compute[74613]:       <model usable='no'>Cascadelake-Server</model>
Nov 29 17:47:17 user nova-compute[74613]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Nov 29 17:47:17 user nova-compute[74613]:       <model usable='no'>Broadwell-noTSX</model>
Nov 29 17:47:17 user nova-compute[74613]:       <model usable='no'>Broadwell-IBRS</model>
Nov 29 17:47:17 user nova-compute[74613]:       <model usable='no'>Broadwell</model>
Nov 29 17:47:17 user nova-compute[74613]:       <model usable='yes'>486</model>
Nov 29 17:47:17 user nova-compute[74613]:     </mode>
Nov 29 17:47:17 user nova-compute[74613]:   </cpu>
Nov 29 17:47:17 user nova-compute[74613]:   <memoryBacking supported='yes'>
Nov 29 17:47:17 user nova-compute[74613]:     <enum name='sourceType'>
Nov 29 17:47:17 user nova-compute[74613]:       <value>file</value>
Nov 29 17:47:17 user nova-compute[74613]:       <value>anonymous</value>
Nov 29 17:47:17 user nova-compute[74613]:       <value>memfd</value>
Nov 29 17:47:17 user nova-compute[74613]:     </enum>
Nov 29 17:47:17 user nova-compute[74613]:   </memoryBacking>
Nov 29 17:47:17 user nova-compute[74613]:   <devices>
Nov 29 17:47:17 user nova-compute[74613]:     <disk supported='yes'>
Nov 29 17:47:17 user nova-compute[74613]:       <enum name='diskDevice'>
Nov 29 17:47:17 user nova-compute[74613]:         <value>disk</value>
Nov 29 17:47:17 user nova-compute[74613]:         <value>cdrom</value>
Nov 29 17:47:17 user nova-compute[74613]:         <value>floppy</value>
Nov 29 17:47:17 user nova-compute[74613]:         <value>lun</value>
Nov 29 17:47:17 user nova-compute[74613]:       </enum>
Nov 29 17:47:17 user nova-compute[74613]:       <enum name='bus'>
Nov 29 17:47:17 user nova-compute[74613]:         <value>ide</value>
Nov 29 17:47:17 user nova-compute[74613]:         <value>fdc</value>
Nov 29 17:47:17 user nova-compute[74613]:         <value>scsi</value>
Nov 29 17:47:17 user nova-compute[74613]:         <value>virtio</value>
Nov 29 17:47:17 user nova-compute[74613]:         <value>usb</value>
Nov 29 17:47:17 user nova-compute[74613]:         <value>sata</value>
Nov 29 17:47:17 user nova-compute[74613]:       </enum>
Nov 29 17:47:17 user nova-compute[74613]:       <enum name='model'>
Nov 29 17:47:17 user nova-compute[74613]:         <value>virtio</value>
Nov 29 17:47:17 user nova-compute[74613]:         <value>virtio-transitional</value>
Nov 29 17:47:17 user nova-compute[74613]:         <value>virtio-non-transitional</value>
Nov 29 17:47:17 user nova-compute[74613]:       </enum>
Nov 29 17:47:17 user nova-compute[74613]:     </disk>
Nov 29 17:47:17 user nova-compute[74613]:     <graphics supported='yes'>
Nov 29 17:47:17 user nova-compute[74613]:       <enum name='type'>
Nov 29 17:47:17 user nova-compute[74613]:         <value>sdl</value>
Nov 29 17:47:17 user nova-compute[74613]:         <value>vnc</value>
Nov 29 17:47:17 user nova-compute[74613]:         <value>spice</value>
Nov 29 17:47:17 user nova-compute[74613]:         <value>egl-headless</value>
Nov 29 17:47:17 user nova-compute[74613]:       </enum>
Nov 29 17:47:17 user nova-compute[74613]:     </graphics>
Nov 29 17:47:17 user nova-compute[74613]:     <video supported='yes'>
Nov 29 17:47:17 user nova-compute[74613]:       <enum name='modelType'>
Nov 29 17:47:17 user nova-compute[74613]:         <value>vga</value>
Nov 29 17:47:17 user nova-compute[74613]:         <value>cirrus</value>
Nov 29 17:47:17 user nova-compute[74613]:         <value>vmvga</value>
Nov 29 17:47:17 user nova-compute[74613]:         <value>qxl</value>
Nov 29 17:47:17 user nova-compute[74613]:         <value>virtio</value>
Nov 29 17:47:17 user nova-compute[74613]:         <value>none</value>
Nov 29 17:47:17 user nova-compute[74613]:         <value>bochs</value>
Nov 29 17:47:17 user nova-compute[74613]:         <value>ramfb</value>
Nov 29 17:47:17 user nova-compute[74613]:       </enum>
Nov 29 17:47:17 user nova-compute[74613]:     </video>
Nov 29 17:47:17 user nova-compute[74613]:     <hostdev supported='yes'>
Nov 29 17:47:17 user nova-compute[74613]:       <enum name='mode'>
Nov 29 17:47:17 user nova-compute[74613]:         <value>subsystem</value>
Nov 29 17:47:17 user nova-compute[74613]:       </enum>
Nov 29 17:47:17 user nova-compute[74613]:       <enum name='startupPolicy'>
Nov 29 17:47:17 user nova-compute[74613]:         <value>default</value>
Nov 29 17:47:17 user nova-compute[74613]:         <value>mandatory</value>
Nov 29 17:47:17 user nova-compute[74613]:         <value>requisite</value>
Nov 29 17:47:17 user nova-compute[74613]:         <value>optional</value>
Nov 29 17:47:17 user nova-compute[74613]:       </enum>
Nov 29 17:47:17 user nova-compute[74613]:       <enum name='subsysType'>
Nov 29 17:47:17 user nova-compute[74613]:         <value>usb</value>
Nov 29 17:47:17 user nova-compute[74613]:         <value>pci</value>
Nov 29 17:47:17 user nova-compute[74613]:         <value>scsi</value>
Nov 29 17:47:17 user nova-compute[74613]:       </enum>
Nov 29 17:47:17 user nova-compute[74613]:       <enum name='capsType'/>
Nov 29 17:47:17 user nova-compute[74613]:       <enum name='pciBackend'/>
Nov 29 17:47:17 user nova-compute[74613]:     </hostdev>
Nov 29 17:47:17 user nova-compute[74613]:     <rng supported='yes'>
Nov 29 17:47:17 user nova-compute[74613]:       <enum name='model'>
Nov 29 17:47:17 user nova-compute[74613]:         <value>virtio</value>
Nov 29 17:47:17 user nova-compute[74613]:         <value>virtio-transitional</value>
Nov 29 17:47:17 user nova-compute[74613]:         <value>virtio-non-transitional</value>
Nov 29 17:47:17 user nova-compute[74613]:       </enum>
Nov 29 17:47:17 user nova-compute[74613]:       <enum name='backendModel'>
Nov 29 17:47:17 user nova-compute[74613]:         <value>random</value>
Nov 29 17:47:17 user nova-compute[74613]:         <value>egd</value>
Nov 29 17:47:17 user nova-compute[74613]:         <value>builtin</value>
Nov 29 17:47:17 user nova-compute[74613]:       </enum>
Nov 29 17:47:17 user nova-compute[74613]:     </rng>
Nov 29 17:47:17 user nova-compute[74613]:     <filesystem supported='yes'>
Nov 29 17:47:17 user nova-compute[74613]:       <enum name='driverType'>
Nov 29 17:47:17 user nova-compute[74613]:         <value>path</value>
Nov 29 17:47:17 user nova-compute[74613]:         <value>handle</value>
Nov 29 17:47:17 user nova-compute[74613]:         <value>virtiofs</value>
Nov 29 17:47:17 user nova-compute[74613]:       </enum>
Nov 29 17:47:17 user nova-compute[74613]:     </filesystem>
Nov 29 17:47:17 user nova-compute[74613]:     <tpm supported='yes'>
Nov 29 17:47:17 user nova-compute[74613]:       <enum name='model'>
Nov 29 17:47:17 user nova-compute[74613]:         <value>tpm-tis</value>
Nov 29 17:47:17 user nova-compute[74613]:         <value>tpm-crb</value>
Nov 29 17:47:17 user nova-compute[74613]:       </enum>
Nov 29 17:47:17 user nova-compute[74613]:       <enum name='backendModel'>
Nov 29 17:47:17 user nova-compute[74613]:         <value>passthrough</value>
Nov 29 17:47:17 user nova-compute[74613]:         <value>emulator</value>
Nov 29 17:47:17 user nova-compute[74613]:       </enum>
Nov 29 17:47:17 user nova-compute[74613]:     </tpm>
Nov 29 17:47:17 user nova-compute[74613]:   </devices>
Nov 29 17:47:17 user nova-compute[74613]:   <features>
Nov 29 17:47:17 user nova-compute[74613]:     <gic supported='no'/>
Nov 29 17:47:17 user nova-compute[74613]:     <vmcoreinfo supported='yes'/>
Nov 29 17:47:17 user nova-compute[74613]:     <genid supported='yes'/>
Nov 29 17:47:17 user nova-compute[74613]:     <backingStoreInput supported='yes'/>
Nov 29 17:47:17 user nova-compute[74613]:     <backup supported='yes'/>
Nov 29 17:47:17 user nova-compute[74613]:     <sev supported='no'/>
Nov 29 17:47:17 user nova-compute[74613]:   </features>
Nov 29 17:47:17 user nova-compute[74613]: </domainCapabilities>
Nov 29 17:47:17 user nova-compute[74613]:  {{(pid=74613) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1039}}
Nov 29 17:47:17 user nova-compute[74613]: DEBUG nova.virt.libvirt.host [None req-ff6a7ff8-5f06-4fe1-9453-c4b85f4805d3 None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=q35:
Nov 29 17:47:17 user nova-compute[74613]: <domainCapabilities>
Nov 29 17:47:17 user nova-compute[74613]:   <path>/usr/bin/qemu-system-i386</path>
Nov 29 17:47:17 user nova-compute[74613]:   <domain>kvm</domain>
Nov 29 17:47:17 user nova-compute[74613]:   <machine>pc-q35-6.2</machine>
Nov 29 17:47:17 user nova-compute[74613]:   <arch>i686</arch>
Nov 29 17:47:17 user nova-compute[74613]:   <vcpu max='288'/>
Nov 29 17:47:17 user nova-compute[74613]:   <iothreads supported='yes'/>
Nov 29 17:47:17 user nova-compute[74613]:   <os supported='yes'>
Nov 29 17:47:17 user nova-compute[74613]:     <enum name='firmware'/>
Nov 29 17:47:17 user nova-compute[74613]:     <loader supported='yes'>
Nov 29 17:47:17 user nova-compute[74613]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Nov 29 17:47:17 user nova-compute[74613]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Nov 29 17:47:17 user nova-compute[74613]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Nov 29 17:47:17 user nova-compute[74613]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Nov 29 17:47:17 user nova-compute[74613]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Nov 29 17:47:17 user nova-compute[74613]:       <enum name='type'>
Nov 29 17:47:17 user nova-compute[74613]:         <value>rom</value>
Nov 29 17:47:17 user nova-compute[74613]:         <value>pflash</value>
Nov 29 17:47:17 user nova-compute[74613]:       </enum>
Nov 29 17:47:17 user nova-compute[74613]:       <enum name='readonly'>
Nov 29 17:47:17 user nova-compute[74613]:         <value>yes</value>
Nov 29 17:47:17 user nova-compute[74613]:         <value>no</value>
Nov 29 17:47:17 user nova-compute[74613]:       </enum>
Nov 29 17:47:17 user nova-compute[74613]:       <enum name='secure'>
Nov 29 17:47:17 user nova-compute[74613]:         <value>no</value>
Nov 29 17:47:17 user nova-compute[74613]:       </enum>
Nov 29 17:47:17 user nova-compute[74613]:     </loader>
Nov 29 17:47:17 user nova-compute[74613]:   </os>
Nov 29 17:47:17 user nova-compute[74613]:   <cpu>
Nov 29 17:47:17 user nova-compute[74613]:     <mode name='host-passthrough' supported='yes'>
Nov 29 17:47:17 user nova-compute[74613]:       <enum name='hostPassthroughMigratable'>
Nov 29 17:47:17 user nova-compute[74613]:         <value>off</value>
Nov 29 17:47:17 user nova-compute[74613]:       </enum>
Nov 29 17:47:17 user nova-compute[74613]:     </mode>
Nov 29 17:47:17 user nova-compute[74613]:     <mode name='maximum' supported='yes'>
Nov 29 17:47:17 user nova-compute[74613]:       <enum name='maximumMigratable'>
Nov 29 17:47:17 user nova-compute[74613]:         <value>on</value>
Nov 29 17:47:17 user nova-compute[74613]:         <value>off</value>
Nov 29 17:47:17 user nova-compute[74613]:       </enum>
Nov 29 17:47:17 user nova-compute[74613]:     </mode>
Nov 29 17:47:17 user nova-compute[74613]:     <mode name='host-model' supported='yes'>
Nov 29 17:47:17 user nova-compute[74613]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Nov 29 17:47:17 user nova-compute[74613]:       <vendor>Intel</vendor>
Nov 29 17:47:17 user nova-compute[74613]:       <feature policy='require' name='ss'/>
Nov 29 17:47:17 user nova-compute[74613]:       <feature policy='require' name='vmx'/>
Nov 29 17:47:17 user nova-compute[74613]:       <feature policy='require' name='pcid'/>
Nov 29 17:47:17 user nova-compute[74613]:       <feature policy='require' name='hypervisor'/>
Nov 29 17:47:17 user nova-compute[74613]:       <feature policy='require' name='arat'/>
Nov 29 17:47:17 user nova-compute[74613]:       <feature policy='require' name='tsc_adjust'/>
Nov 29 17:47:17 user nova-compute[74613]:       <feature policy='require' name='umip'/>
Nov 29 17:47:17 user nova-compute[74613]:       <feature policy='require' name='md-clear'/>
Nov 29 17:47:17 user nova-compute[74613]:       <feature policy='require' name='stibp'/>
Nov 29 17:47:17 user nova-compute[74613]:       <feature policy='require' name='arch-capabilities'/>
Nov 29 17:47:17 user nova-compute[74613]:       <feature policy='require' name='ssbd'/>
Nov 29 17:47:17 user nova-compute[74613]:       <feature policy='require' name='ibpb'/>
Nov 29 17:47:17 user nova-compute[74613]:       <feature policy='require' name='ibrs'/>
Nov 29 17:47:17 user nova-compute[74613]:       <feature policy='require' name='amd-stibp'/>
Nov 29 17:47:17 user nova-compute[74613]:       <feature policy='require' name='amd-ssbd'/>
Nov 29 17:47:17 user nova-compute[74613]:       <feature policy='disable' name='erms'/>
Nov 29 17:47:17 user nova-compute[74613]:       <feature policy='disable' name='xsaveopt'/>
Nov 29 17:47:17 user nova-compute[74613]:       <feature policy='disable' name='lm'/>
Nov 29 17:47:17 user nova-compute[74613]:     </mode>
Nov 29 17:47:17 user nova-compute[74613]:     <mode name='custom' supported='yes'>
Nov 29 17:47:17 user nova-compute[74613]:       <model usable='no'>qemu64</model>
Nov 29 17:47:17 user nova-compute[74613]:       <model usable='yes'>qemu32</model>
Nov 29 17:47:17 user nova-compute[74613]:       <model usable='no'>phenom</model>
Nov 29 17:47:17 user nova-compute[74613]:       <model usable='yes'>pentium3</model>
Nov 29 17:47:17 user nova-compute[74613]:       <model usable='yes'>pentium2</model>
Nov 29 17:47:17 user nova-compute[74613]:       <model usable='yes'>pentium</model>
Nov 29 17:47:17 user nova-compute[74613]:       <model usable='no'>n270</model>
Nov 29 17:47:17 user nova-compute[74613]:       <model usable='no'>kvm64</model>
Nov 29 17:47:17 user nova-compute[74613]:       <model usable='yes'>kvm32</model>
Nov 29 17:47:17 user nova-compute[74613]:       <model usable='yes'>coreduo</model>
Nov 29 17:47:17 user nova-compute[74613]:       <model usable='no'>core2duo</model>
Nov 29 17:47:17 user nova-compute[74613]:       <model usable='no'>athlon</model>
Nov 29 17:47:17 user nova-compute[74613]:       <model usable='no'>Westmere-IBRS</model>
Nov 29 17:47:17 user nova-compute[74613]:       <model usable='no'>Westmere</model>
Nov 29 17:47:17 user nova-compute[74613]:       <model usable='no'>Snowridge</model>
Nov 29 17:47:17 user nova-compute[74613]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Nov 29 17:47:17 user nova-compute[74613]:       <model usable='no'>Skylake-Server-IBRS</model>
Nov 29 17:47:17 user nova-compute[74613]:       <model usable='no'>Skylake-Server</model>
Nov 29 17:47:17 user nova-compute[74613]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Nov 29 17:47:17 user nova-compute[74613]:       <model usable='no'>Skylake-Client-IBRS</model>
Nov 29 17:47:17 user nova-compute[74613]:       <model usable='no'>Skylake-Client</model>
Nov 29 17:47:17 user nova-compute[74613]:       <model usable='no'>SandyBridge-IBRS</model>
Nov 29 17:47:17 user nova-compute[74613]:       <model usable='no'>SandyBridge</model>
Nov 29 17:47:17 user nova-compute[74613]:       <model usable='no'>Penryn</model>
Nov 29 17:47:17 user nova-compute[74613]:       <model usable='no'>Opteron_G5</model>
Nov 29 17:47:17 user nova-compute[74613]:       <model usable='no'>Opteron_G4</model>
Nov 29 17:47:17 user nova-compute[74613]:       <model usable='no'>Opteron_G3</model>
Nov 29 17:47:17 user nova-compute[74613]:       <model usable='no'>Opteron_G2</model>
Nov 29 17:47:17 user nova-compute[74613]:       <model usable='no'>Opteron_G1</model>
Nov 29 17:47:17 user nova-compute[74613]:       <model usable='no'>Nehalem-IBRS</model>
Nov 29 17:47:17 user nova-compute[74613]:       <model usable='no'>Nehalem</model>
Nov 29 17:47:17 user nova-compute[74613]:       <model usable='no'>IvyBridge-IBRS</model>
Nov 29 17:47:17 user nova-compute[74613]:       <model usable='no'>IvyBridge</model>
Nov 29 17:47:17 user nova-compute[74613]:       <model usable='no'>Icelake-Server-noTSX</model>
Nov 29 17:47:17 user nova-compute[74613]:       <model usable='no'>Icelake-Server</model>
Nov 29 17:47:17 user nova-compute[74613]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Nov 29 17:47:17 user nova-compute[74613]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Nov 29 17:47:17 user nova-compute[74613]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Nov 29 17:47:17 user nova-compute[74613]:       <model usable='no'>Haswell-noTSX</model>
Nov 29 17:47:17 user nova-compute[74613]:       <model usable='no'>Haswell-IBRS</model>
Nov 29 17:47:17 user nova-compute[74613]:       <model usable='no'>Haswell</model>
Nov 29 17:47:17 user nova-compute[74613]:       <model usable='no'>EPYC-Rome</model>
Nov 29 17:47:17 user nova-compute[74613]:       <model usable='no'>EPYC-Milan</model>
Nov 29 17:47:17 user nova-compute[74613]:       <model usable='no'>EPYC-IBPB</model>
Nov 29 17:47:17 user nova-compute[74613]:       <model usable='no'>EPYC</model>
Nov 29 17:47:17 user nova-compute[74613]:       <model usable='no'>Dhyana</model>
Nov 29 17:47:17 user nova-compute[74613]:       <model usable='no'>Cooperlake</model>
Nov 29 17:47:17 user nova-compute[74613]:       <model usable='no'>Conroe</model>
Nov 29 17:47:17 user nova-compute[74613]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Nov 29 17:47:17 user nova-compute[74613]:       <model usable='no'>Cascadelake-Server</model>
Nov 29 17:47:17 user nova-compute[74613]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Nov 29 17:47:17 user nova-compute[74613]:       <model usable='no'>Broadwell-noTSX</model>
Nov 29 17:47:17 user nova-compute[74613]:       <model usable='no'>Broadwell-IBRS</model>
Nov 29 17:47:17 user nova-compute[74613]:       <model usable='no'>Broadwell</model>
Nov 29 17:47:17 user nova-compute[74613]:       <model usable='yes'>486</model>
Nov 29 17:47:17 user nova-compute[74613]:     </mode>
Nov 29 17:47:17 user nova-compute[74613]:   </cpu>
Nov 29 17:47:17 user nova-compute[74613]:   <memoryBacking supported='yes'>
Nov 29 17:47:17 user nova-compute[74613]:     <enum name='sourceType'>
Nov 29 17:47:17 user nova-compute[74613]:       <value>file</value>
Nov 29 17:47:17 user nova-compute[74613]:       <value>anonymous</value>
Nov 29 17:47:17 user nova-compute[74613]:       <value>memfd</value>
Nov 29 17:47:17 user nova-compute[74613]:     </enum>
Nov 29 17:47:17 user nova-compute[74613]:   </memoryBacking>
Nov 29 17:47:17 user nova-compute[74613]:   <devices>
Nov 29 17:47:17 user nova-compute[74613]:     <disk supported='yes'>
Nov 29 17:47:17 user nova-compute[74613]:       <enum name='diskDevice'>
Nov 29 17:47:17 user nova-compute[74613]:         <value>disk</value>
Nov 29 17:47:17 user nova-compute[74613]:         <value>cdrom</value>
Nov 29 17:47:17 user nova-compute[74613]:         <value>floppy</value>
Nov 29 17:47:17 user nova-compute[74613]:         <value>lun</value>
Nov 29 17:47:17 user nova-compute[74613]:       </enum>
Nov 29 17:47:17 user nova-compute[74613]:       <enum name='bus'>
Nov 29 17:47:17 user nova-compute[74613]:         <value>fdc</value>
Nov 29 17:47:17 user nova-compute[74613]:         <value>scsi</value>
Nov 29 17:47:17 user nova-compute[74613]:         <value>virtio</value>
Nov 29 17:47:17 user nova-compute[74613]:         <value>usb</value>
Nov 29 17:47:17 user nova-compute[74613]:         <value>sata</value>
Nov 29 17:47:17 user nova-compute[74613]:       </enum>
Nov 29 17:47:17 user nova-compute[74613]:       <enum name='model'>
Nov 29 17:47:17 user nova-compute[74613]:         <value>virtio</value>
Nov 29 17:47:17 user nova-compute[74613]:         <value>virtio-transitional</value>
Nov 29 17:47:17 user nova-compute[74613]:         <value>virtio-non-transitional</value>
Nov 29 17:47:17 user nova-compute[74613]:       </enum>
Nov 29 17:47:17 user nova-compute[74613]:     </disk>
Nov 29 17:47:17 user nova-compute[74613]:     <graphics supported='yes'>
Nov 29 17:47:17 user nova-compute[74613]:       <enum name='type'>
Nov 29 17:47:17 user nova-compute[74613]:         <value>sdl</value>
Nov 29 17:47:17 user nova-compute[74613]:         <value>vnc</value>
Nov 29 17:47:17 user nova-compute[74613]:         <value>spice</value>
Nov 29 17:47:17 user nova-compute[74613]:         <value>egl-headless</value>
Nov 29 17:47:17 user nova-compute[74613]:       </enum>
Nov 29 17:47:17 user nova-compute[74613]:     </graphics>
Nov 29 17:47:17 user nova-compute[74613]:     <video supported='yes'>
Nov 29 17:47:17 user nova-compute[74613]:       <enum name='modelType'>
Nov 29 17:47:17 user nova-compute[74613]:         <value>vga</value>
Nov 29 17:47:17 user nova-compute[74613]:         <value>cirrus</value>
Nov 29 17:47:17 user nova-compute[74613]:         <value>vmvga</value>
Nov 29 17:47:17 user nova-compute[74613]:         <value>qxl</value>
Nov 29 17:47:17 user nova-compute[74613]:         <value>virtio</value>
Nov 29 17:47:17 user nova-compute[74613]:         <value>none</value>
Nov 29 17:47:17 user nova-compute[74613]:         <value>bochs</value>
Nov 29 17:47:17 user nova-compute[74613]:         <value>ramfb</value>
Nov 29 17:47:17 user nova-compute[74613]:       </enum>
Nov 29 17:47:17 user nova-compute[74613]:     </video>
Nov 29 17:47:17 user nova-compute[74613]:     <hostdev supported='yes'>
Nov 29 17:47:17 user nova-compute[74613]:       <enum name='mode'>
Nov 29 17:47:17 user nova-compute[74613]:         <value>subsystem</value>
Nov 29 17:47:17 user nova-compute[74613]:       </enum>
Nov 29 17:47:17 user nova-compute[74613]:       <enum name='startupPolicy'>
Nov 29 17:47:17 user nova-compute[74613]:         <value>default</value>
Nov 29 17:47:17 user nova-compute[74613]:         <value>mandatory</value>
Nov 29 17:47:17 user nova-compute[74613]:         <value>requisite</value>
Nov 29 17:47:17 user nova-compute[74613]:         <value>optional</value>
Nov 29 17:47:17 user nova-compute[74613]:       </enum>
Nov 29 17:47:17 user nova-compute[74613]:       <enum name='subsysType'>
Nov 29 17:47:17 user nova-compute[74613]:         <value>usb</value>
Nov 29 17:47:17 user nova-compute[74613]:         <value>pci</value>
Nov 29 17:47:17 user nova-compute[74613]:         <value>scsi</value>
Nov 29 17:47:17 user nova-compute[74613]:       </enum>
Nov 29 17:47:17 user nova-compute[74613]:       <enum name='capsType'/>
Nov 29 17:47:17 user nova-compute[74613]:       <enum name='pciBackend'/>
Nov 29 17:47:17 user nova-compute[74613]:     </hostdev>
Nov 29 17:47:17 user nova-compute[74613]:     <rng supported='yes'>
Nov 29 17:47:17 user nova-compute[74613]:       <enum name='model'>
Nov 29 17:47:17 user nova-compute[74613]:         <value>virtio</value>
Nov 29 17:47:17 user nova-compute[74613]:         <value>virtio-transitional</value>
Nov 29 17:47:17 user nova-compute[74613]:         <value>virtio-non-transitional</value>
Nov 29 17:47:17 user nova-compute[74613]:       </enum>
Nov 29 17:47:17 user nova-compute[74613]:       <enum name='backendModel'>
Nov 29 17:47:17 user nova-compute[74613]:         <value>random</value>
Nov 29 17:47:17 user nova-compute[74613]:         <value>egd</value>
Nov 29 17:47:17 user nova-compute[74613]:         <value>builtin</value>
Nov 29 17:47:17 user nova-compute[74613]:       </enum>
Nov 29 17:47:17 user nova-compute[74613]:     </rng>
Nov 29 17:47:17 user nova-compute[74613]:     <filesystem supported='yes'>
Nov 29 17:47:17 user nova-compute[74613]:       <enum name='driverType'>
Nov 29 17:47:17 user nova-compute[74613]:         <value>path</value>
Nov 29 17:47:17 user nova-compute[74613]:         <value>handle</value>
Nov 29 17:47:17 user nova-compute[74613]:         <value>virtiofs</value>
Nov 29 17:47:17 user nova-compute[74613]:       </enum>
Nov 29 17:47:17 user nova-compute[74613]:     </filesystem>
Nov 29 17:47:17 user nova-compute[74613]:     <tpm supported='yes'>
Nov 29 17:47:17 user nova-compute[74613]:       <enum name='model'>
Nov 29 17:47:17 user nova-compute[74613]:         <value>tpm-tis</value>
Nov 29 17:47:17 user nova-compute[74613]:         <value>tpm-crb</value>
Nov 29 17:47:17 user nova-compute[74613]:       </enum>
Nov 29 17:47:17 user nova-compute[74613]:       <enum name='backendModel'>
Nov 29 17:47:17 user nova-compute[74613]:         <value>passthrough</value>
Nov 29 17:47:17 user nova-compute[74613]:         <value>emulator</value>
Nov 29 17:47:17 user nova-compute[74613]:       </enum>
Nov 29 17:47:17 user nova-compute[74613]:     </tpm>
Nov 29 17:47:17 user nova-compute[74613]:   </devices>
Nov 29 17:47:17 user nova-compute[74613]:   <features>
Nov 29 17:47:17 user nova-compute[74613]:     <gic supported='no'/>
Nov 29 17:47:17 user nova-compute[74613]:     <vmcoreinfo supported='yes'/>
Nov 29 17:47:17 user nova-compute[74613]:     <genid supported='yes'/>
Nov 29 17:47:17 user nova-compute[74613]:     <backingStoreInput supported='yes'/>
Nov 29 17:47:17 user nova-compute[74613]:     <backup supported='yes'/>
Nov 29 17:47:17 user nova-compute[74613]:     <sev supported='no'/>
Nov 29 17:47:17 user nova-compute[74613]:   </features>
Nov 29 17:47:17 user nova-compute[74613]: </domainCapabilities>
Nov 29 17:47:17 user nova-compute[74613]:  {{(pid=74613) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1039}}
Nov 29 17:47:17 user nova-compute[74613]: DEBUG nova.virt.libvirt.host [None req-ff6a7ff8-5f06-4fe1-9453-c4b85f4805d3 None None] Getting domain capabilities for m68k via machine types: {'virt', None} {{(pid=74613) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:954}}
Nov 29 17:47:17 user nova-compute[74613]: DEBUG nova.virt.libvirt.host [None req-ff6a7ff8-5f06-4fe1-9453-c4b85f4805d3 None None] Error from libvirt when retrieving domain capabilities for arch m68k / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-m68k' on this host {{(pid=74613) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Nov 29 17:47:17 user nova-compute[74613]: DEBUG nova.virt.libvirt.host [None req-ff6a7ff8-5f06-4fe1-9453-c4b85f4805d3 None None] Error from libvirt when retrieving domain capabilities for arch m68k / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-m68k' on this host {{(pid=74613) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Nov 29 17:47:17 user nova-compute[74613]: DEBUG nova.virt.libvirt.host [None req-ff6a7ff8-5f06-4fe1-9453-c4b85f4805d3 None None] Getting domain capabilities for microblaze via machine types: {None} {{(pid=74613) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:954}}
Nov 29 17:47:17 user nova-compute[74613]: DEBUG nova.virt.libvirt.host [None req-ff6a7ff8-5f06-4fe1-9453-c4b85f4805d3 None None] Error from libvirt when retrieving domain capabilities for arch microblaze / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-microblaze' on this host {{(pid=74613) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Nov 29 17:47:17 user nova-compute[74613]: DEBUG nova.virt.libvirt.host [None req-ff6a7ff8-5f06-4fe1-9453-c4b85f4805d3 None None] Getting domain capabilities for microblazeel via machine types: {None} {{(pid=74613) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:954}}
Nov 29 17:47:17 user nova-compute[74613]: DEBUG nova.virt.libvirt.host [None req-ff6a7ff8-5f06-4fe1-9453-c4b85f4805d3 None None] Error from libvirt when retrieving domain capabilities for arch microblazeel / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-microblazeel' on this host {{(pid=74613) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Nov 29 17:47:17 user nova-compute[74613]: DEBUG nova.virt.libvirt.host [None req-ff6a7ff8-5f06-4fe1-9453-c4b85f4805d3 None None] Getting domain capabilities for mips via machine types: {None} {{(pid=74613) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:954}}
Nov 29 17:47:17 user nova-compute[74613]: DEBUG nova.virt.libvirt.host [None req-ff6a7ff8-5f06-4fe1-9453-c4b85f4805d3 None None] Error from libvirt when retrieving domain capabilities for arch mips / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mips' on this host {{(pid=74613) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Nov 29 17:47:17 user nova-compute[74613]: DEBUG nova.virt.libvirt.host [None req-ff6a7ff8-5f06-4fe1-9453-c4b85f4805d3 None None] Getting domain capabilities for mipsel via machine types: {None} {{(pid=74613) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:954}}
Nov 29 17:47:17 user nova-compute[74613]: DEBUG nova.virt.libvirt.host [None req-ff6a7ff8-5f06-4fe1-9453-c4b85f4805d3 None None] Error from libvirt when retrieving domain capabilities for arch mipsel / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mipsel' on this host {{(pid=74613) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Nov 29 17:47:17 user nova-compute[74613]: DEBUG nova.virt.libvirt.host [None req-ff6a7ff8-5f06-4fe1-9453-c4b85f4805d3 None None] Getting domain capabilities for mips64 via machine types: {None} {{(pid=74613) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:954}}
Nov 29 17:47:17 user nova-compute[74613]: DEBUG nova.virt.libvirt.host [None req-ff6a7ff8-5f06-4fe1-9453-c4b85f4805d3 None None] Error from libvirt when retrieving domain capabilities for arch mips64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mips64' on this host {{(pid=74613) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Nov 29 17:47:17 user nova-compute[74613]: DEBUG nova.virt.libvirt.host [None req-ff6a7ff8-5f06-4fe1-9453-c4b85f4805d3 None None] Getting domain capabilities for mips64el via machine types: {None} {{(pid=74613) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:954}}
Nov 29 17:47:17 user nova-compute[74613]: DEBUG nova.virt.libvirt.host [None req-ff6a7ff8-5f06-4fe1-9453-c4b85f4805d3 None None] Error from libvirt when retrieving domain capabilities for arch mips64el / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mips64el' on this host {{(pid=74613) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Nov 29 17:47:17 user nova-compute[74613]: DEBUG nova.virt.libvirt.host [None req-ff6a7ff8-5f06-4fe1-9453-c4b85f4805d3 None None] Getting domain capabilities for ppc via machine types: {None} {{(pid=74613) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:954}}
Nov 29 17:47:17 user nova-compute[74613]: DEBUG nova.virt.libvirt.host [None req-ff6a7ff8-5f06-4fe1-9453-c4b85f4805d3 None None] Error from libvirt when retrieving domain capabilities for arch ppc / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc' on this host {{(pid=74613) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Nov 29 17:47:17 user nova-compute[74613]: DEBUG nova.virt.libvirt.host [None req-ff6a7ff8-5f06-4fe1-9453-c4b85f4805d3 None None] Getting domain capabilities for ppc64 via machine types: {'powernv', 'pseries', None} {{(pid=74613) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:954}}
Nov 29 17:47:17 user nova-compute[74613]: DEBUG nova.virt.libvirt.host [None req-ff6a7ff8-5f06-4fe1-9453-c4b85f4805d3 None None] Error from libvirt when retrieving domain capabilities for arch ppc64 / virt_type kvm / machine_type powernv: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64' on this host {{(pid=74613) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Nov 29 17:47:17 user nova-compute[74613]: DEBUG nova.virt.libvirt.host [None req-ff6a7ff8-5f06-4fe1-9453-c4b85f4805d3 None None] Error from libvirt when retrieving domain capabilities for arch ppc64 / virt_type kvm / machine_type pseries: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64' on this host {{(pid=74613) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Nov 29 17:47:17 user nova-compute[74613]: DEBUG nova.virt.libvirt.host [None req-ff6a7ff8-5f06-4fe1-9453-c4b85f4805d3 None None] Error from libvirt when retrieving domain capabilities for arch ppc64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64' on this host {{(pid=74613) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Nov 29 17:47:17 user nova-compute[74613]: DEBUG nova.virt.libvirt.host [None req-ff6a7ff8-5f06-4fe1-9453-c4b85f4805d3 None None] Getting domain capabilities for ppc64le via machine types: {'powernv', 'pseries'} {{(pid=74613) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:954}}
Nov 29 17:47:17 user nova-compute[74613]: DEBUG nova.virt.libvirt.host [None req-ff6a7ff8-5f06-4fe1-9453-c4b85f4805d3 None None] Error from libvirt when retrieving domain capabilities for arch ppc64le / virt_type kvm / machine_type powernv: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64le' on this host {{(pid=74613) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Nov 29 17:47:17 user nova-compute[74613]: DEBUG nova.virt.libvirt.host [None req-ff6a7ff8-5f06-4fe1-9453-c4b85f4805d3 None None] Error from libvirt when retrieving domain capabilities for arch ppc64le / virt_type kvm / machine_type pseries: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64le' on this host {{(pid=74613) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Nov 29 17:47:17 user nova-compute[74613]: DEBUG nova.virt.libvirt.host [None req-ff6a7ff8-5f06-4fe1-9453-c4b85f4805d3 None None] Getting domain capabilities for riscv32 via machine types: {None} {{(pid=74613) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:954}}
Nov 29 17:47:17 user nova-compute[74613]: DEBUG nova.virt.libvirt.host [None req-ff6a7ff8-5f06-4fe1-9453-c4b85f4805d3 None None] Error from libvirt when retrieving domain capabilities for arch riscv32 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-riscv32' on this host {{(pid=74613) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Nov 29 17:47:17 user nova-compute[74613]: DEBUG nova.virt.libvirt.host [None req-ff6a7ff8-5f06-4fe1-9453-c4b85f4805d3 None None] Getting domain capabilities for riscv64 via machine types: {None} {{(pid=74613) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:954}}
Nov 29 17:47:17 user nova-compute[74613]: DEBUG nova.virt.libvirt.host [None req-ff6a7ff8-5f06-4fe1-9453-c4b85f4805d3 None None] Error from libvirt when retrieving domain capabilities for arch riscv64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-riscv64' on this host {{(pid=74613) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Nov 29 17:47:17 user nova-compute[74613]: DEBUG nova.virt.libvirt.host [None req-ff6a7ff8-5f06-4fe1-9453-c4b85f4805d3 None None] Getting domain capabilities for s390x via machine types: {'s390-ccw-virtio'} {{(pid=74613) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:954}}
Nov 29 17:47:17 user nova-compute[74613]: DEBUG nova.virt.libvirt.host [None req-ff6a7ff8-5f06-4fe1-9453-c4b85f4805d3 None None] Error from libvirt when retrieving domain capabilities for arch s390x / virt_type kvm / machine_type s390-ccw-virtio: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-s390x' on this host {{(pid=74613) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Nov 29 17:47:17 user nova-compute[74613]: DEBUG nova.virt.libvirt.host [None req-ff6a7ff8-5f06-4fe1-9453-c4b85f4805d3 None None] Getting domain capabilities for sh4 via machine types: {None} {{(pid=74613) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:954}}
Nov 29 17:47:17 user nova-compute[74613]: DEBUG nova.virt.libvirt.host [None req-ff6a7ff8-5f06-4fe1-9453-c4b85f4805d3 None None] Error from libvirt when retrieving domain capabilities for arch sh4 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sh4' on this host {{(pid=74613) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Nov 29 17:47:17 user nova-compute[74613]: DEBUG nova.virt.libvirt.host [None req-ff6a7ff8-5f06-4fe1-9453-c4b85f4805d3 None None] Getting domain capabilities for sh4eb via machine types: {None} {{(pid=74613) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:954}}
Nov 29 17:47:17 user nova-compute[74613]: DEBUG nova.virt.libvirt.host [None req-ff6a7ff8-5f06-4fe1-9453-c4b85f4805d3 None None] Error from libvirt when retrieving domain capabilities for arch sh4eb / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sh4eb' on this host {{(pid=74613) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Nov 29 17:47:17 user nova-compute[74613]: DEBUG nova.virt.libvirt.host [None req-ff6a7ff8-5f06-4fe1-9453-c4b85f4805d3 None None] Getting domain capabilities for sparc via machine types: {None} {{(pid=74613) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:954}}
Nov 29 17:47:17 user nova-compute[74613]: DEBUG nova.virt.libvirt.host [None req-ff6a7ff8-5f06-4fe1-9453-c4b85f4805d3 None None] Error from libvirt when retrieving domain capabilities for arch sparc / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sparc' on this host {{(pid=74613) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Nov 29 17:47:17 user nova-compute[74613]: DEBUG nova.virt.libvirt.host [None req-ff6a7ff8-5f06-4fe1-9453-c4b85f4805d3 None None] Getting domain capabilities for sparc64 via machine types: {None} {{(pid=74613) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:954}}
Nov 29 17:47:17 user nova-compute[74613]: DEBUG nova.virt.libvirt.host [None req-ff6a7ff8-5f06-4fe1-9453-c4b85f4805d3 None None] Error from libvirt when retrieving domain capabilities for arch sparc64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sparc64' on this host {{(pid=74613) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Nov 29 17:47:17 user nova-compute[74613]: DEBUG nova.virt.libvirt.host [None req-ff6a7ff8-5f06-4fe1-9453-c4b85f4805d3 None None] Getting domain capabilities for x86_64 via machine types: {'ubuntu-q35', 'pc', 'ubuntu', 'q35'} {{(pid=74613) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:954}}
Nov 29 17:47:17 user nova-compute[74613]: DEBUG nova.virt.libvirt.host [None req-ff6a7ff8-5f06-4fe1-9453-c4b85f4805d3 None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=ubuntu-q35:
Nov 29 17:47:17 user nova-compute[74613]: <domainCapabilities>
Nov 29 17:47:17 user nova-compute[74613]:   <path>/usr/bin/qemu-system-x86_64</path>
Nov 29 17:47:17 user nova-compute[74613]:   <domain>kvm</domain>
Nov 29 17:47:17 user nova-compute[74613]:   <machine>pc-q35-jammy</machine>
Nov 29 17:47:17 user nova-compute[74613]:   <arch>x86_64</arch>
Nov 29 17:47:17 user nova-compute[74613]:   <vcpu max='288'/>
Nov 29 17:47:17 user nova-compute[74613]:   <iothreads supported='yes'/>
Nov 29 17:47:17 user nova-compute[74613]:   <os supported='yes'>
Nov 29 17:47:17 user nova-compute[74613]:     <enum name='firmware'>
Nov 29 17:47:17 user nova-compute[74613]:       <value>efi</value>
Nov 29 17:47:17 user nova-compute[74613]:     </enum>
Nov 29 17:47:17 user nova-compute[74613]:     <loader supported='yes'>
Nov 29 17:47:17 user nova-compute[74613]:       <value>/usr/share/OVMF/OVMF_CODE_4M.ms.fd</value>
Nov 29 17:47:17 user nova-compute[74613]:       <value>/usr/share/OVMF/OVMF_CODE_4M.secboot.fd</value>
Nov 29 17:47:17 user nova-compute[74613]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Nov 29 17:47:17 user nova-compute[74613]:       <enum name='type'>
Nov 29 17:47:17 user nova-compute[74613]:         <value>rom</value>
Nov 29 17:47:17 user nova-compute[74613]:         <value>pflash</value>
Nov 29 17:47:17 user nova-compute[74613]:       </enum>
Nov 29 17:47:17 user nova-compute[74613]:       <enum name='readonly'>
Nov 29 17:47:17 user nova-compute[74613]:         <value>yes</value>
Nov 29 17:47:17 user nova-compute[74613]:         <value>no</value>
Nov 29 17:47:17 user nova-compute[74613]:       </enum>
Nov 29 17:47:17 user nova-compute[74613]:       <enum name='secure'>
Nov 29 17:47:17 user nova-compute[74613]:         <value>yes</value>
Nov 29 17:47:17 user nova-compute[74613]:         <value>no</value>
Nov 29 17:47:17 user nova-compute[74613]:       </enum>
Nov 29 17:47:17 user nova-compute[74613]:     </loader>
Nov 29 17:47:17 user nova-compute[74613]:   </os>
Nov 29 17:47:17 user nova-compute[74613]:   <cpu>
Nov 29 17:47:17 user nova-compute[74613]:     <mode name='host-passthrough' supported='yes'>
Nov 29 17:47:17 user nova-compute[74613]:       <enum name='hostPassthroughMigratable'>
Nov 29 17:47:17 user nova-compute[74613]:         <value>on</value>
Nov 29 17:47:17 user nova-compute[74613]:         <value>off</value>
Nov 29 17:47:17 user nova-compute[74613]:       </enum>
Nov 29 17:47:17 user nova-compute[74613]:     </mode>
Nov 29 17:47:17 user nova-compute[74613]:     <mode name='maximum' supported='yes'>
Nov 29 17:47:17 user nova-compute[74613]:       <enum name='maximumMigratable'>
Nov 29 17:47:17 user nova-compute[74613]:         <value>on</value>
Nov 29 17:47:17 user nova-compute[74613]:         <value>off</value>
Nov 29 17:47:17 user nova-compute[74613]:       </enum>
Nov 29 17:47:17 user nova-compute[74613]:     </mode>
Nov 29 17:47:17 user nova-compute[74613]:     <mode name='host-model' supported='yes'>
Nov 29 17:47:17 user nova-compute[74613]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Nov 29 17:47:17 user nova-compute[74613]:       <vendor>Intel</vendor>
Nov 29 17:47:17 user nova-compute[74613]:       <feature policy='require' name='ss'/>
Nov 29 17:47:17 user nova-compute[74613]:       <feature policy='require' name='vmx'/>
Nov 29 17:47:17 user nova-compute[74613]:       <feature policy='require' name='pcid'/>
Nov 29 17:47:17 user nova-compute[74613]:       <feature policy='require' name='hypervisor'/>
Nov 29 17:47:17 user nova-compute[74613]:       <feature policy='require' name='arat'/>
Nov 29 17:47:17 user nova-compute[74613]:       <feature policy='require' name='tsc_adjust'/>
Nov 29 17:47:17 user nova-compute[74613]:       <feature policy='require' name='umip'/>
Nov 29 17:47:17 user nova-compute[74613]:       <feature policy='require' name='md-clear'/>
Nov 29 17:47:17 user nova-compute[74613]:       <feature policy='require' name='stibp'/>
Nov 29 17:47:17 user nova-compute[74613]:       <feature policy='require' name='arch-capabilities'/>
Nov 29 17:47:17 user nova-compute[74613]:       <feature policy='require' name='ssbd'/>
Nov 29 17:47:17 user nova-compute[74613]:       <feature policy='require' name='invtsc'/>
Nov 29 17:47:17 user nova-compute[74613]:       <feature policy='require' name='ibpb'/>
Nov 29 17:47:17 user nova-compute[74613]:       <feature policy='require' name='ibrs'/>
Nov 29 17:47:17 user nova-compute[74613]:       <feature policy='require' name='amd-stibp'/>
Nov 29 17:47:17 user nova-compute[74613]:       <feature policy='require' name='amd-ssbd'/>
Nov 29 17:47:17 user nova-compute[74613]:       <feature policy='require' name='rsba'/>
Nov 29 17:47:17 user nova-compute[74613]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Nov 29 17:47:17 user nova-compute[74613]:       <feature policy='require' name='pschange-mc-no'/>
Nov 29 17:47:17 user nova-compute[74613]:       <feature policy='disable' name='erms'/>
Nov 29 17:47:17 user nova-compute[74613]:       <feature policy='disable' name='xsaveopt'/>
Nov 29 17:47:17 user nova-compute[74613]:     </mode>
Nov 29 17:47:17 user nova-compute[74613]:     <mode name='custom' supported='yes'>
Nov 29 17:47:17 user nova-compute[74613]:       <model usable='no'>qemu64</model>
Nov 29 17:47:17 user nova-compute[74613]:       <model usable='yes'>qemu32</model>
Nov 29 17:47:17 user nova-compute[74613]:       <model usable='no'>phenom</model>
Nov 29 17:47:17 user nova-compute[74613]:       <model usable='yes'>pentium3</model>
Nov 29 17:47:17 user nova-compute[74613]:       <model usable='yes'>pentium2</model>
Nov 29 17:47:17 user nova-compute[74613]:       <model usable='yes'>pentium</model>
Nov 29 17:47:17 user nova-compute[74613]:       <model usable='no'>n270</model>
Nov 29 17:47:17 user nova-compute[74613]:       <model usable='yes'>kvm64</model>
Nov 29 17:47:17 user nova-compute[74613]:       <model usable='yes'>kvm32</model>
Nov 29 17:47:17 user nova-compute[74613]:       <model usable='yes'>coreduo</model>
Nov 29 17:47:17 user nova-compute[74613]:       <model usable='yes'>core2duo</model>
Nov 29 17:47:17 user nova-compute[74613]:       <model usable='no'>athlon</model>
Nov 29 17:47:17 user nova-compute[74613]:       <model usable='yes'>Westmere-IBRS</model>
Nov 29 17:47:17 user nova-compute[74613]:       <model usable='yes'>Westmere</model>
Nov 29 17:47:17 user nova-compute[74613]:       <model usable='no'>Snowridge</model>
Nov 29 17:47:17 user nova-compute[74613]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Nov 29 17:47:17 user nova-compute[74613]:       <model usable='no'>Skylake-Server-IBRS</model>
Nov 29 17:47:17 user nova-compute[74613]:       <model usable='no'>Skylake-Server</model>
Nov 29 17:47:17 user nova-compute[74613]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Nov 29 17:47:17 user nova-compute[74613]:       <model usable='no'>Skylake-Client-IBRS</model>
Nov 29 17:47:17 user nova-compute[74613]:       <model usable='no'>Skylake-Client</model>
Nov 29 17:47:17 user nova-compute[74613]:       <model usable='no'>SandyBridge-IBRS</model>
Nov 29 17:47:17 user nova-compute[74613]:       <model usable='no'>SandyBridge</model>
Nov 29 17:47:17 user nova-compute[74613]:       <model usable='yes'>Penryn</model>
Nov 29 17:47:17 user nova-compute[74613]:       <model usable='no'>Opteron_G5</model>
Nov 29 17:47:17 user nova-compute[74613]:       <model usable='no'>Opteron_G4</model>
Nov 29 17:47:17 user nova-compute[74613]:       <model usable='no'>Opteron_G3</model>
Nov 29 17:47:17 user nova-compute[74613]:       <model usable='no'>Opteron_G2</model>
Nov 29 17:47:17 user nova-compute[74613]:       <model usable='yes'>Opteron_G1</model>
Nov 29 17:47:17 user nova-compute[74613]:       <model usable='yes'>Nehalem-IBRS</model>
Nov 29 17:47:17 user nova-compute[74613]:       <model usable='yes'>Nehalem</model>
Nov 29 17:47:17 user nova-compute[74613]:       <model usable='no'>IvyBridge-IBRS</model>
Nov 29 17:47:17 user nova-compute[74613]:       <model usable='no'>IvyBridge</model>
Nov 29 17:47:17 user nova-compute[74613]:       <model usable='no'>Icelake-Server-noTSX</model>
Nov 29 17:47:17 user nova-compute[74613]:       <model usable='no'>Icelake-Server</model>
Nov 29 17:47:17 user nova-compute[74613]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Nov 29 17:47:17 user nova-compute[74613]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Nov 29 17:47:17 user nova-compute[74613]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Nov 29 17:47:17 user nova-compute[74613]:       <model usable='no'>Haswell-noTSX</model>
Nov 29 17:47:17 user nova-compute[74613]:       <model usable='no'>Haswell-IBRS</model>
Nov 29 17:47:17 user nova-compute[74613]:       <model usable='no'>Haswell</model>
Nov 29 17:47:17 user nova-compute[74613]:       <model usable='no'>EPYC-Rome</model>
Nov 29 17:47:17 user nova-compute[74613]:       <model usable='no'>EPYC-Milan</model>
Nov 29 17:47:17 user nova-compute[74613]:       <model usable='no'>EPYC-IBPB</model>
Nov 29 17:47:17 user nova-compute[74613]:       <model usable='no'>EPYC</model>
Nov 29 17:47:17 user nova-compute[74613]:       <model usable='no'>Dhyana</model>
Nov 29 17:47:17 user nova-compute[74613]:       <model usable='no'>Cooperlake</model>
Nov 29 17:47:17 user nova-compute[74613]:       <model usable='yes'>Conroe</model>
Nov 29 17:47:17 user nova-compute[74613]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Nov 29 17:47:17 user nova-compute[74613]:       <model usable='no'>Cascadelake-Server</model>
Nov 29 17:47:17 user nova-compute[74613]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Nov 29 17:47:17 user nova-compute[74613]:       <model usable='no'>Broadwell-noTSX</model>
Nov 29 17:47:17 user nova-compute[74613]:       <model usable='no'>Broadwell-IBRS</model>
Nov 29 17:47:17 user nova-compute[74613]:       <model usable='no'>Broadwell</model>
Nov 29 17:47:17 user nova-compute[74613]:       <model usable='yes'>486</model>
Nov 29 17:47:17 user nova-compute[74613]:     </mode>
Nov 29 17:47:17 user nova-compute[74613]:   </cpu>
Nov 29 17:47:17 user nova-compute[74613]:   <memoryBacking supported='yes'>
Nov 29 17:47:17 user nova-compute[74613]:     <enum name='sourceType'>
Nov 29 17:47:17 user nova-compute[74613]:       <value>file</value>
Nov 29 17:47:17 user nova-compute[74613]:       <value>anonymous</value>
Nov 29 17:47:17 user nova-compute[74613]:       <value>memfd</value>
Nov 29 17:47:17 user nova-compute[74613]:     </enum>
Nov 29 17:47:17 user nova-compute[74613]:   </memoryBacking>
Nov 29 17:47:17 user nova-compute[74613]:   <devices>
Nov 29 17:47:17 user nova-compute[74613]:     <disk supported='yes'>
Nov 29 17:47:17 user nova-compute[74613]:       <enum name='diskDevice'>
Nov 29 17:47:17 user nova-compute[74613]:         <value>disk</value>
Nov 29 17:47:17 user nova-compute[74613]:         <value>cdrom</value>
Nov 29 17:47:17 user nova-compute[74613]:         <value>floppy</value>
Nov 29 17:47:17 user nova-compute[74613]:         <value>lun</value>
Nov 29 17:47:17 user nova-compute[74613]:       </enum>
Nov 29 17:47:17 user nova-compute[74613]:       <enum name='bus'>
Nov 29 17:47:17 user nova-compute[74613]:         <value>fdc</value>
Nov 29 17:47:17 user nova-compute[74613]:         <value>scsi</value>
Nov 29 17:47:17 user nova-compute[74613]:         <value>virtio</value>
Nov 29 17:47:17 user nova-compute[74613]:         <value>usb</value>
Nov 29 17:47:17 user nova-compute[74613]:         <value>sata</value>
Nov 29 17:47:17 user nova-compute[74613]:       </enum>
Nov 29 17:47:17 user nova-compute[74613]:       <enum name='model'>
Nov 29 17:47:17 user nova-compute[74613]:         <value>virtio</value>
Nov 29 17:47:17 user nova-compute[74613]:         <value>virtio-transitional</value>
Nov 29 17:47:17 user nova-compute[74613]:         <value>virtio-non-transitional</value>
Nov 29 17:47:17 user nova-compute[74613]:       </enum>
Nov 29 17:47:17 user nova-compute[74613]:     </disk>
Nov 29 17:47:17 user nova-compute[74613]:     <graphics supported='yes'>
Nov 29 17:47:17 user nova-compute[74613]:       <enum name='type'>
Nov 29 17:47:17 user nova-compute[74613]:         <value>sdl</value>
Nov 29 17:47:17 user nova-compute[74613]:         <value>vnc</value>
Nov 29 17:47:17 user nova-compute[74613]:         <value>spice</value>
Nov 29 17:47:17 user nova-compute[74613]:         <value>egl-headless</value>
Nov 29 17:47:17 user nova-compute[74613]:       </enum>
Nov 29 17:47:17 user nova-compute[74613]:     </graphics>
Nov 29 17:47:17 user nova-compute[74613]:     <video supported='yes'>
Nov 29 17:47:17 user nova-compute[74613]:       <enum name='modelType'>
Nov 29 17:47:17 user nova-compute[74613]:         <value>vga</value>
Nov 29 17:47:17 user nova-compute[74613]:         <value>cirrus</value>
Nov 29 17:47:17 user nova-compute[74613]:         <value>vmvga</value>
Nov 29 17:47:17 user nova-compute[74613]:         <value>qxl</value>
Nov 29 17:47:17 user nova-compute[74613]:         <value>virtio</value>
Nov 29 17:47:17 user nova-compute[74613]:         <value>none</value>
Nov 29 17:47:17 user nova-compute[74613]:         <value>bochs</value>
Nov 29 17:47:17 user nova-compute[74613]:         <value>ramfb</value>
Nov 29 17:47:17 user nova-compute[74613]:       </enum>
Nov 29 17:47:17 user nova-compute[74613]:     </video>
Nov 29 17:47:17 user nova-compute[74613]:     <hostdev supported='yes'>
Nov 29 17:47:17 user nova-compute[74613]:       <enum name='mode'>
Nov 29 17:47:17 user nova-compute[74613]:         <value>subsystem</value>
Nov 29 17:47:17 user nova-compute[74613]:       </enum>
Nov 29 17:47:17 user nova-compute[74613]:       <enum name='startupPolicy'>
Nov 29 17:47:17 user nova-compute[74613]:         <value>default</value>
Nov 29 17:47:17 user nova-compute[74613]:         <value>mandatory</value>
Nov 29 17:47:17 user nova-compute[74613]:         <value>requisite</value>
Nov 29 17:47:17 user nova-compute[74613]:         <value>optional</value>
Nov 29 17:47:17 user nova-compute[74613]:       </enum>
Nov 29 17:47:17 user nova-compute[74613]:       <enum name='subsysType'>
Nov 29 17:47:17 user nova-compute[74613]:         <value>usb</value>
Nov 29 17:47:17 user nova-compute[74613]:         <value>pci</value>
Nov 29 17:47:17 user nova-compute[74613]:         <value>scsi</value>
Nov 29 17:47:17 user nova-compute[74613]:       </enum>
Nov 29 17:47:17 user nova-compute[74613]:       <enum name='capsType'/>
Nov 29 17:47:17 user nova-compute[74613]:       <enum name='pciBackend'/>
Nov 29 17:47:17 user nova-compute[74613]:     </hostdev>
Nov 29 17:47:17 user nova-compute[74613]:     <rng supported='yes'>
Nov 29 17:47:17 user nova-compute[74613]:       <enum name='model'>
Nov 29 17:47:17 user nova-compute[74613]:         <value>virtio</value>
Nov 29 17:47:17 user nova-compute[74613]:         <value>virtio-transitional</value>
Nov 29 17:47:17 user nova-compute[74613]:         <value>virtio-non-transitional</value>
Nov 29 17:47:17 user nova-compute[74613]:       </enum>
Nov 29 17:47:17 user nova-compute[74613]:       <enum name='backendModel'>
Nov 29 17:47:17 user nova-compute[74613]:         <value>random</value>
Nov 29 17:47:17 user nova-compute[74613]:         <value>egd</value>
Nov 29 17:47:17 user nova-compute[74613]:         <value>builtin</value>
Nov 29 17:47:17 user nova-compute[74613]:       </enum>
Nov 29 17:47:17 user nova-compute[74613]:     </rng>
Nov 29 17:47:17 user nova-compute[74613]:     <filesystem supported='yes'>
Nov 29 17:47:17 user nova-compute[74613]:       <enum name='driverType'>
Nov 29 17:47:17 user nova-compute[74613]:         <value>path</value>
Nov 29 17:47:17 user nova-compute[74613]:         <value>handle</value>
Nov 29 17:47:17 user nova-compute[74613]:         <value>virtiofs</value>
Nov 29 17:47:17 user nova-compute[74613]:       </enum>
Nov 29 17:47:17 user nova-compute[74613]:     </filesystem>
Nov 29 17:47:17 user nova-compute[74613]:     <tpm supported='yes'>
Nov 29 17:47:17 user nova-compute[74613]:       <enum name='model'>
Nov 29 17:47:17 user nova-compute[74613]:         <value>tpm-tis</value>
Nov 29 17:47:17 user nova-compute[74613]:         <value>tpm-crb</value>
Nov 29 17:47:17 user nova-compute[74613]:       </enum>
Nov 29 17:47:17 user nova-compute[74613]:       <enum name='backendModel'>
Nov 29 17:47:17 user nova-compute[74613]:         <value>passthrough</value>
Nov 29 17:47:17 user nova-compute[74613]:         <value>emulator</value>
Nov 29 17:47:17 user nova-compute[74613]:       </enum>
Nov 29 17:47:17 user nova-compute[74613]:     </tpm>
Nov 29 17:47:17 user nova-compute[74613]:   </devices>
Nov 29 17:47:17 user nova-compute[74613]:   <features>
Nov 29 17:47:17 user nova-compute[74613]:     <gic supported='no'/>
Nov 29 17:47:17 user nova-compute[74613]:     <vmcoreinfo supported='yes'/>
Nov 29 17:47:17 user nova-compute[74613]:     <genid supported='yes'/>
Nov 29 17:47:17 user nova-compute[74613]:     <backingStoreInput supported='yes'/>
Nov 29 17:47:17 user nova-compute[74613]:     <backup supported='yes'/>
Nov 29 17:47:17 user nova-compute[74613]:     <sev supported='no'/>
Nov 29 17:47:17 user nova-compute[74613]:   </features>
Nov 29 17:47:17 user nova-compute[74613]: </domainCapabilities>
Nov 29 17:47:17 user nova-compute[74613]:  {{(pid=74613) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1039}}
Nov 29 17:47:17 user nova-compute[74613]: DEBUG nova.virt.libvirt.host [None req-ff6a7ff8-5f06-4fe1-9453-c4b85f4805d3 None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=pc:
Nov 29 17:47:17 user nova-compute[74613]: <domainCapabilities>
Nov 29 17:47:17 user nova-compute[74613]:   <path>/usr/bin/qemu-system-x86_64</path>
Nov 29 17:47:17 user nova-compute[74613]:   <domain>kvm</domain>
Nov 29 17:47:17 user nova-compute[74613]:   <machine>pc-i440fx-6.2</machine>
Nov 29 17:47:17 user nova-compute[74613]:   <arch>x86_64</arch>
Nov 29 17:47:17 user nova-compute[74613]:   <vcpu max='255'/>
Nov 29 17:47:17 user nova-compute[74613]:   <iothreads supported='yes'/>
Nov 29 17:47:17 user nova-compute[74613]:   <os supported='yes'>
Nov 29 17:47:17 user nova-compute[74613]:     <enum name='firmware'>
Nov 29 17:47:17 user nova-compute[74613]:       <value>efi</value>
Nov 29 17:47:17 user nova-compute[74613]:     </enum>
Nov 29 17:47:17 user nova-compute[74613]:     <loader supported='yes'>
Nov 29 17:47:17 user nova-compute[74613]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Nov 29 17:47:17 user nova-compute[74613]:       <enum name='type'>
Nov 29 17:47:17 user nova-compute[74613]:         <value>rom</value>
Nov 29 17:47:17 user nova-compute[74613]:         <value>pflash</value>
Nov 29 17:47:17 user nova-compute[74613]:       </enum>
Nov 29 17:47:17 user nova-compute[74613]:       <enum name='readonly'>
Nov 29 17:47:17 user nova-compute[74613]:         <value>yes</value>
Nov 29 17:47:17 user nova-compute[74613]:         <value>no</value>
Nov 29 17:47:17 user nova-compute[74613]:       </enum>
Nov 29 17:47:17 user nova-compute[74613]:       <enum name='secure'>
Nov 29 17:47:17 user nova-compute[74613]:         <value>no</value>
Nov 29 17:47:17 user nova-compute[74613]:       </enum>
Nov 29 17:47:17 user nova-compute[74613]:     </loader>
Nov 29 17:47:17 user nova-compute[74613]:   </os>
Nov 29 17:47:17 user nova-compute[74613]:   <cpu>
Nov 29 17:47:17 user nova-compute[74613]:     <mode name='host-passthrough' supported='yes'>
Nov 29 17:47:17 user nova-compute[74613]:       <enum name='hostPassthroughMigratable'>
Nov 29 17:47:17 user nova-compute[74613]:         <value>on</value>
Nov 29 17:47:17 user nova-compute[74613]:         <value>off</value>
Nov 29 17:47:17 user nova-compute[74613]:       </enum>
Nov 29 17:47:17 user nova-compute[74613]:     </mode>
Nov 29 17:47:17 user nova-compute[74613]:     <mode name='maximum' supported='yes'>
Nov 29 17:47:17 user nova-compute[74613]:       <enum name='maximumMigratable'>
Nov 29 17:47:17 user nova-compute[74613]:         <value>on</value>
Nov 29 17:47:17 user nova-compute[74613]:         <value>off</value>
Nov 29 17:47:17 user nova-compute[74613]:       </enum>
Nov 29 17:47:17 user nova-compute[74613]:     </mode>
Nov 29 17:47:17 user nova-compute[74613]:     <mode name='host-model' supported='yes'>
Nov 29 17:47:17 user nova-compute[74613]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Nov 29 17:47:17 user nova-compute[74613]:       <vendor>Intel</vendor>
Nov 29 17:47:17 user nova-compute[74613]:       <feature policy='require' name='ss'/>
Nov 29 17:47:17 user nova-compute[74613]:       <feature policy='require' name='vmx'/>
Nov 29 17:47:17 user nova-compute[74613]:       <feature policy='require' name='pcid'/>
Nov 29 17:47:17 user nova-compute[74613]:       <feature policy='require' name='hypervisor'/>
Nov 29 17:47:17 user nova-compute[74613]:       <feature policy='require' name='arat'/>
Nov 29 17:47:17 user nova-compute[74613]:       <feature policy='require' name='tsc_adjust'/>
Nov 29 17:47:17 user nova-compute[74613]:       <feature policy='require' name='umip'/>
Nov 29 17:47:17 user nova-compute[74613]:       <feature policy='require' name='md-clear'/>
Nov 29 17:47:17 user nova-compute[74613]:       <feature policy='require' name='stibp'/>
Nov 29 17:47:17 user nova-compute[74613]:       <feature policy='require' name='arch-capabilities'/>
Nov 29 17:47:17 user nova-compute[74613]:       <feature policy='require' name='ssbd'/>
Nov 29 17:47:17 user nova-compute[74613]:       <feature policy='require' name='invtsc'/>
Nov 29 17:47:17 user nova-compute[74613]:       <feature policy='require' name='ibpb'/>
Nov 29 17:47:17 user nova-compute[74613]:       <feature policy='require' name='ibrs'/>
Nov 29 17:47:17 user nova-compute[74613]:       <feature policy='require' name='amd-stibp'/>
Nov 29 17:47:17 user nova-compute[74613]:       <feature policy='require' name='amd-ssbd'/>
Nov 29 17:47:17 user nova-compute[74613]:       <feature policy='require' name='rsba'/>
Nov 29 17:47:17 user nova-compute[74613]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Nov 29 17:47:17 user nova-compute[74613]:       <feature policy='require' name='pschange-mc-no'/>
Nov 29 17:47:17 user nova-compute[74613]:       <feature policy='disable' name='erms'/>
Nov 29 17:47:17 user nova-compute[74613]:       <feature policy='disable' name='xsaveopt'/>
Nov 29 17:47:17 user nova-compute[74613]:     </mode>
Nov 29 17:47:17 user nova-compute[74613]:     <mode name='custom' supported='yes'>
Nov 29 17:47:17 user nova-compute[74613]:       <model usable='no'>qemu64</model>
Nov 29 17:47:17 user nova-compute[74613]:       <model usable='yes'>qemu32</model>
Nov 29 17:47:17 user nova-compute[74613]:       <model usable='no'>phenom</model>
Nov 29 17:47:17 user nova-compute[74613]:       <model usable='yes'>pentium3</model>
Nov 29 17:47:17 user nova-compute[74613]:       <model usable='yes'>pentium2</model>
Nov 29 17:47:17 user nova-compute[74613]:       <model usable='yes'>pentium</model>
Nov 29 17:47:17 user nova-compute[74613]:       <model usable='no'>n270</model>
Nov 29 17:47:17 user nova-compute[74613]:       <model usable='yes'>kvm64</model>
Nov 29 17:47:17 user nova-compute[74613]:       <model usable='yes'>kvm32</model>
Nov 29 17:47:17 user nova-compute[74613]:       <model usable='yes'>coreduo</model>
Nov 29 17:47:17 user nova-compute[74613]:       <model usable='yes'>core2duo</model>
Nov 29 17:47:17 user nova-compute[74613]:       <model usable='no'>athlon</model>
Nov 29 17:47:17 user nova-compute[74613]:       <model usable='yes'>Westmere-IBRS</model>
Nov 29 17:47:17 user nova-compute[74613]:       <model usable='yes'>Westmere</model>
Nov 29 17:47:17 user nova-compute[74613]:       <model usable='no'>Snowridge</model>
Nov 29 17:47:17 user nova-compute[74613]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Nov 29 17:47:17 user nova-compute[74613]:       <model usable='no'>Skylake-Server-IBRS</model>
Nov 29 17:47:17 user nova-compute[74613]:       <model usable='no'>Skylake-Server</model>
Nov 29 17:47:17 user nova-compute[74613]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Nov 29 17:47:17 user nova-compute[74613]:       <model usable='no'>Skylake-Client-IBRS</model>
Nov 29 17:47:17 user nova-compute[74613]:       <model usable='no'>Skylake-Client</model>
Nov 29 17:47:17 user nova-compute[74613]:       <model usable='no'>SandyBridge-IBRS</model>
Nov 29 17:47:17 user nova-compute[74613]:       <model usable='no'>SandyBridge</model>
Nov 29 17:47:17 user nova-compute[74613]:       <model usable='yes'>Penryn</model>
Nov 29 17:47:17 user nova-compute[74613]:       <model usable='no'>Opteron_G5</model>
Nov 29 17:47:17 user nova-compute[74613]:       <model usable='no'>Opteron_G4</model>
Nov 29 17:47:17 user nova-compute[74613]:       <model usable='no'>Opteron_G3</model>
Nov 29 17:47:17 user nova-compute[74613]:       <model usable='no'>Opteron_G2</model>
Nov 29 17:47:17 user nova-compute[74613]:       <model usable='yes'>Opteron_G1</model>
Nov 29 17:47:17 user nova-compute[74613]:       <model usable='yes'>Nehalem-IBRS</model>
Nov 29 17:47:17 user nova-compute[74613]:       <model usable='yes'>Nehalem</model>
Nov 29 17:47:17 user nova-compute[74613]:       <model usable='no'>IvyBridge-IBRS</model>
Nov 29 17:47:17 user nova-compute[74613]:       <model usable='no'>IvyBridge</model>
Nov 29 17:47:17 user nova-compute[74613]:       <model usable='no'>Icelake-Server-noTSX</model>
Nov 29 17:47:17 user nova-compute[74613]:       <model usable='no'>Icelake-Server</model>
Nov 29 17:47:17 user nova-compute[74613]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Nov 29 17:47:17 user nova-compute[74613]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Nov 29 17:47:17 user nova-compute[74613]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Nov 29 17:47:17 user nova-compute[74613]:       <model usable='no'>Haswell-noTSX</model>
Nov 29 17:47:17 user nova-compute[74613]:       <model usable='no'>Haswell-IBRS</model>
Nov 29 17:47:17 user nova-compute[74613]:       <model usable='no'>Haswell</model>
Nov 29 17:47:17 user nova-compute[74613]:       <model usable='no'>EPYC-Rome</model>
Nov 29 17:47:17 user nova-compute[74613]:       <model usable='no'>EPYC-Milan</model>
Nov 29 17:47:17 user nova-compute[74613]:       <model usable='no'>EPYC-IBPB</model>
Nov 29 17:47:17 user nova-compute[74613]:       <model usable='no'>EPYC</model>
Nov 29 17:47:17 user nova-compute[74613]:       <model usable='no'>Dhyana</model>
Nov 29 17:47:17 user nova-compute[74613]:       <model usable='no'>Cooperlake</model>
Nov 29 17:47:17 user nova-compute[74613]:       <model usable='yes'>Conroe</model>
Nov 29 17:47:17 user nova-compute[74613]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Nov 29 17:47:17 user nova-compute[74613]:       <model usable='no'>Cascadelake-Server</model>
Nov 29 17:47:17 user nova-compute[74613]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Nov 29 17:47:17 user nova-compute[74613]:       <model usable='no'>Broadwell-noTSX</model>
Nov 29 17:47:17 user nova-compute[74613]:       <model usable='no'>Broadwell-IBRS</model>
Nov 29 17:47:17 user nova-compute[74613]:       <model usable='no'>Broadwell</model>
Nov 29 17:47:17 user nova-compute[74613]:       <model usable='yes'>486</model>
Nov 29 17:47:17 user nova-compute[74613]:     </mode>
Nov 29 17:47:17 user nova-compute[74613]:   </cpu>
Nov 29 17:47:17 user nova-compute[74613]:   <memoryBacking supported='yes'>
Nov 29 17:47:17 user nova-compute[74613]:     <enum name='sourceType'>
Nov 29 17:47:17 user nova-compute[74613]:       <value>file</value>
Nov 29 17:47:17 user nova-compute[74613]:       <value>anonymous</value>
Nov 29 17:47:17 user nova-compute[74613]:       <value>memfd</value>
Nov 29 17:47:17 user nova-compute[74613]:     </enum>
Nov 29 17:47:17 user nova-compute[74613]:   </memoryBacking>
Nov 29 17:47:17 user nova-compute[74613]:   <devices>
Nov 29 17:47:17 user nova-compute[74613]:     <disk supported='yes'>
Nov 29 17:47:17 user nova-compute[74613]:       <enum name='diskDevice'>
Nov 29 17:47:17 user nova-compute[74613]:         <value>disk</value>
Nov 29 17:47:17 user nova-compute[74613]:         <value>cdrom</value>
Nov 29 17:47:17 user nova-compute[74613]:         <value>floppy</value>
Nov 29 17:47:17 user nova-compute[74613]:         <value>lun</value>
Nov 29 17:47:17 user nova-compute[74613]:       </enum>
Nov 29 17:47:17 user nova-compute[74613]:       <enum name='bus'>
Nov 29 17:47:17 user nova-compute[74613]:         <value>ide</value>
Nov 29 17:47:17 user nova-compute[74613]:         <value>fdc</value>
Nov 29 17:47:17 user nova-compute[74613]:         <value>scsi</value>
Nov 29 17:47:17 user nova-compute[74613]:         <value>virtio</value>
Nov 29 17:47:17 user nova-compute[74613]:         <value>usb</value>
Nov 29 17:47:17 user nova-compute[74613]:         <value>sata</value>
Nov 29 17:47:17 user nova-compute[74613]:       </enum>
Nov 29 17:47:17 user nova-compute[74613]:       <enum name='model'>
Nov 29 17:47:17 user nova-compute[74613]:         <value>virtio</value>
Nov 29 17:47:17 user nova-compute[74613]:         <value>virtio-transitional</value>
Nov 29 17:47:17 user nova-compute[74613]:         <value>virtio-non-transitional</value>
Nov 29 17:47:17 user nova-compute[74613]:       </enum>
Nov 29 17:47:17 user nova-compute[74613]:     </disk>
Nov 29 17:47:17 user nova-compute[74613]:     <graphics supported='yes'>
Nov 29 17:47:17 user nova-compute[74613]:       <enum name='type'>
Nov 29 17:47:17 user nova-compute[74613]:         <value>sdl</value>
Nov 29 17:47:17 user nova-compute[74613]:         <value>vnc</value>
Nov 29 17:47:17 user nova-compute[74613]:         <value>spice</value>
Nov 29 17:47:17 user nova-compute[74613]:         <value>egl-headless</value>
Nov 29 17:47:17 user nova-compute[74613]:       </enum>
Nov 29 17:47:17 user nova-compute[74613]:     </graphics>
Nov 29 17:47:17 user nova-compute[74613]:     <video supported='yes'>
Nov 29 17:47:17 user nova-compute[74613]:       <enum name='modelType'>
Nov 29 17:47:17 user nova-compute[74613]:         <value>vga</value>
Nov 29 17:47:17 user nova-compute[74613]:         <value>cirrus</value>
Nov 29 17:47:17 user nova-compute[74613]:         <value>vmvga</value>
Nov 29 17:47:17 user nova-compute[74613]:         <value>qxl</value>
Nov 29 17:47:17 user nova-compute[74613]:         <value>virtio</value>
Nov 29 17:47:17 user nova-compute[74613]:         <value>none</value>
Nov 29 17:47:17 user nova-compute[74613]:         <value>bochs</value>
Nov 29 17:47:17 user nova-compute[74613]:         <value>ramfb</value>
Nov 29 17:47:17 user nova-compute[74613]:       </enum>
Nov 29 17:47:17 user nova-compute[74613]:     </video>
Nov 29 17:47:17 user nova-compute[74613]:     <hostdev supported='yes'>
Nov 29 17:47:17 user nova-compute[74613]:       <enum name='mode'>
Nov 29 17:47:17 user nova-compute[74613]:         <value>subsystem</value>
Nov 29 17:47:17 user nova-compute[74613]:       </enum>
Nov 29 17:47:17 user nova-compute[74613]:       <enum name='startupPolicy'>
Nov 29 17:47:17 user nova-compute[74613]:         <value>default</value>
Nov 29 17:47:17 user nova-compute[74613]:         <value>mandatory</value>
Nov 29 17:47:17 user nova-compute[74613]:         <value>requisite</value>
Nov 29 17:47:17 user nova-compute[74613]:         <value>optional</value>
Nov 29 17:47:17 user nova-compute[74613]:       </enum>
Nov 29 17:47:17 user nova-compute[74613]:       <enum name='subsysType'>
Nov 29 17:47:17 user nova-compute[74613]:         <value>usb</value>
Nov 29 17:47:17 user nova-compute[74613]:         <value>pci</value>
Nov 29 17:47:17 user nova-compute[74613]:         <value>scsi</value>
Nov 29 17:47:17 user nova-compute[74613]:       </enum>
Nov 29 17:47:17 user nova-compute[74613]:       <enum name='capsType'/>
Nov 29 17:47:17 user nova-compute[74613]:       <enum name='pciBackend'/>
Nov 29 17:47:17 user nova-compute[74613]:     </hostdev>
Nov 29 17:47:17 user nova-compute[74613]:     <rng supported='yes'>
Nov 29 17:47:17 user nova-compute[74613]:       <enum name='model'>
Nov 29 17:47:17 user nova-compute[74613]:         <value>virtio</value>
Nov 29 17:47:17 user nova-compute[74613]:         <value>virtio-transitional</value>
Nov 29 17:47:17 user nova-compute[74613]:         <value>virtio-non-transitional</value>
Nov 29 17:47:17 user nova-compute[74613]:       </enum>
Nov 29 17:47:17 user nova-compute[74613]:       <enum name='backendModel'>
Nov 29 17:47:17 user nova-compute[74613]:         <value>random</value>
Nov 29 17:47:17 user nova-compute[74613]:         <value>egd</value>
Nov 29 17:47:17 user nova-compute[74613]:         <value>builtin</value>
Nov 29 17:47:17 user nova-compute[74613]:       </enum>
Nov 29 17:47:17 user nova-compute[74613]:     </rng>
Nov 29 17:47:17 user nova-compute[74613]:     <filesystem supported='yes'>
Nov 29 17:47:17 user nova-compute[74613]:       <enum name='driverType'>
Nov 29 17:47:17 user nova-compute[74613]:         <value>path</value>
Nov 29 17:47:17 user nova-compute[74613]:         <value>handle</value>
Nov 29 17:47:17 user nova-compute[74613]:         <value>virtiofs</value>
Nov 29 17:47:17 user nova-compute[74613]:       </enum>
Nov 29 17:47:17 user nova-compute[74613]:     </filesystem>
Nov 29 17:47:17 user nova-compute[74613]:     <tpm supported='yes'>
Nov 29 17:47:17 user nova-compute[74613]:       <enum name='model'>
Nov 29 17:47:17 user nova-compute[74613]:         <value>tpm-tis</value>
Nov 29 17:47:17 user nova-compute[74613]:         <value>tpm-crb</value>
Nov 29 17:47:17 user nova-compute[74613]:       </enum>
Nov 29 17:47:17 user nova-compute[74613]:       <enum name='backendModel'>
Nov 29 17:47:17 user nova-compute[74613]:         <value>passthrough</value>
Nov 29 17:47:17 user nova-compute[74613]:         <value>emulator</value>
Nov 29 17:47:17 user nova-compute[74613]:       </enum>
Nov 29 17:47:17 user nova-compute[74613]:     </tpm>
Nov 29 17:47:17 user nova-compute[74613]:   </devices>
Nov 29 17:47:17 user nova-compute[74613]:   <features>
Nov 29 17:47:17 user nova-compute[74613]:     <gic supported='no'/>
Nov 29 17:47:17 user nova-compute[74613]:     <vmcoreinfo supported='yes'/>
Nov 29 17:47:17 user nova-compute[74613]:     <genid supported='yes'/>
Nov 29 17:47:17 user nova-compute[74613]:     <backingStoreInput supported='yes'/>
Nov 29 17:47:17 user nova-compute[74613]:     <backup supported='yes'/>
Nov 29 17:47:17 user nova-compute[74613]:     <sev supported='no'/>
Nov 29 17:47:17 user nova-compute[74613]:   </features>
Nov 29 17:47:17 user nova-compute[74613]: </domainCapabilities>
Nov 29 17:47:17 user nova-compute[74613]:  {{(pid=74613) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1039}}
Nov 29 17:47:17 user nova-compute[74613]: DEBUG nova.virt.libvirt.host [None req-ff6a7ff8-5f06-4fe1-9453-c4b85f4805d3 None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=ubuntu:
Nov 29 17:47:17 user nova-compute[74613]: <domainCapabilities>
Nov 29 17:47:17 user nova-compute[74613]:   <path>/usr/bin/qemu-system-x86_64</path>
Nov 29 17:47:17 user nova-compute[74613]:   <domain>kvm</domain>
Nov 29 17:47:17 user nova-compute[74613]:   <machine>pc-i440fx-jammy</machine>
Nov 29 17:47:17 user nova-compute[74613]:   <arch>x86_64</arch>
Nov 29 17:47:17 user nova-compute[74613]:   <vcpu max='255'/>
Nov 29 17:47:17 user nova-compute[74613]:   <iothreads supported='yes'/>
Nov 29 17:47:17 user nova-compute[74613]:   <os supported='yes'>
Nov 29 17:47:17 user nova-compute[74613]:     <enum name='firmware'>
Nov 29 17:47:17 user nova-compute[74613]:       <value>efi</value>
Nov 29 17:47:17 user nova-compute[74613]:     </enum>
Nov 29 17:47:17 user nova-compute[74613]:     <loader supported='yes'>
Nov 29 17:47:17 user nova-compute[74613]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Nov 29 17:47:17 user nova-compute[74613]:       <enum name='type'>
Nov 29 17:47:17 user nova-compute[74613]:         <value>rom</value>
Nov 29 17:47:17 user nova-compute[74613]:         <value>pflash</value>
Nov 29 17:47:17 user nova-compute[74613]:       </enum>
Nov 29 17:47:17 user nova-compute[74613]:       <enum name='readonly'>
Nov 29 17:47:17 user nova-compute[74613]:         <value>yes</value>
Nov 29 17:47:17 user nova-compute[74613]:         <value>no</value>
Nov 29 17:47:17 user nova-compute[74613]:       </enum>
Nov 29 17:47:17 user nova-compute[74613]:       <enum name='secure'>
Nov 29 17:47:17 user nova-compute[74613]:         <value>no</value>
Nov 29 17:47:17 user nova-compute[74613]:       </enum>
Nov 29 17:47:17 user nova-compute[74613]:     </loader>
Nov 29 17:47:17 user nova-compute[74613]:   </os>
Nov 29 17:47:17 user nova-compute[74613]:   <cpu>
Nov 29 17:47:17 user nova-compute[74613]:     <mode name='host-passthrough' supported='yes'>
Nov 29 17:47:17 user nova-compute[74613]:       <enum name='hostPassthroughMigratable'>
Nov 29 17:47:17 user nova-compute[74613]:         <value>on</value>
Nov 29 17:47:17 user nova-compute[74613]:         <value>off</value>
Nov 29 17:47:17 user nova-compute[74613]:       </enum>
Nov 29 17:47:17 user nova-compute[74613]:     </mode>
Nov 29 17:47:17 user nova-compute[74613]:     <mode name='maximum' supported='yes'>
Nov 29 17:47:17 user nova-compute[74613]:       <enum name='maximumMigratable'>
Nov 29 17:47:17 user nova-compute[74613]:         <value>on</value>
Nov 29 17:47:17 user nova-compute[74613]:         <value>off</value>
Nov 29 17:47:17 user nova-compute[74613]:       </enum>
Nov 29 17:47:17 user nova-compute[74613]:     </mode>
Nov 29 17:47:17 user nova-compute[74613]:     <mode name='host-model' supported='yes'>
Nov 29 17:47:17 user nova-compute[74613]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Nov 29 17:47:17 user nova-compute[74613]:       <vendor>Intel</vendor>
Nov 29 17:47:17 user nova-compute[74613]:       <feature policy='require' name='ss'/>
Nov 29 17:47:17 user nova-compute[74613]:       <feature policy='require' name='vmx'/>
Nov 29 17:47:17 user nova-compute[74613]:       <feature policy='require' name='pcid'/>
Nov 29 17:47:17 user nova-compute[74613]:       <feature policy='require' name='hypervisor'/>
Nov 29 17:47:17 user nova-compute[74613]:       <feature policy='require' name='arat'/>
Nov 29 17:47:17 user nova-compute[74613]:       <feature policy='require' name='tsc_adjust'/>
Nov 29 17:47:17 user nova-compute[74613]:       <feature policy='require' name='umip'/>
Nov 29 17:47:17 user nova-compute[74613]:       <feature policy='require' name='md-clear'/>
Nov 29 17:47:17 user nova-compute[74613]:       <feature policy='require' name='stibp'/>
Nov 29 17:47:17 user nova-compute[74613]:       <feature policy='require' name='arch-capabilities'/>
Nov 29 17:47:17 user nova-compute[74613]:       <feature policy='require' name='ssbd'/>
Nov 29 17:47:17 user nova-compute[74613]:       <feature policy='require' name='invtsc'/>
Nov 29 17:47:17 user nova-compute[74613]:       <feature policy='require' name='ibpb'/>
Nov 29 17:47:17 user nova-compute[74613]:       <feature policy='require' name='ibrs'/>
Nov 29 17:47:17 user nova-compute[74613]:       <feature policy='require' name='amd-stibp'/>
Nov 29 17:47:17 user nova-compute[74613]:       <feature policy='require' name='amd-ssbd'/>
Nov 29 17:47:17 user nova-compute[74613]:       <feature policy='require' name='rsba'/>
Nov 29 17:47:17 user nova-compute[74613]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Nov 29 17:47:17 user nova-compute[74613]:       <feature policy='require' name='pschange-mc-no'/>
Nov 29 17:47:17 user nova-compute[74613]:       <feature policy='disable' name='erms'/>
Nov 29 17:47:17 user nova-compute[74613]:       <feature policy='disable' name='xsaveopt'/>
Nov 29 17:47:17 user nova-compute[74613]:     </mode>
Nov 29 17:47:17 user nova-compute[74613]:     <mode name='custom' supported='yes'>
Nov 29 17:47:17 user nova-compute[74613]:       <model usable='no'>qemu64</model>
Nov 29 17:47:17 user nova-compute[74613]:       <model usable='yes'>qemu32</model>
Nov 29 17:47:17 user nova-compute[74613]:       <model usable='no'>phenom</model>
Nov 29 17:47:17 user nova-compute[74613]:       <model usable='yes'>pentium3</model>
Nov 29 17:47:17 user nova-compute[74613]:       <model usable='yes'>pentium2</model>
Nov 29 17:47:17 user nova-compute[74613]:       <model usable='yes'>pentium</model>
Nov 29 17:47:17 user nova-compute[74613]:       <model usable='no'>n270</model>
Nov 29 17:47:17 user nova-compute[74613]:       <model usable='yes'>kvm64</model>
Nov 29 17:47:17 user nova-compute[74613]:       <model usable='yes'>kvm32</model>
Nov 29 17:47:17 user nova-compute[74613]:       <model usable='yes'>coreduo</model>
Nov 29 17:47:17 user nova-compute[74613]:       <model usable='yes'>core2duo</model>
Nov 29 17:47:17 user nova-compute[74613]:       <model usable='no'>athlon</model>
Nov 29 17:47:17 user nova-compute[74613]:       <model usable='yes'>Westmere-IBRS</model>
Nov 29 17:47:17 user nova-compute[74613]:       <model usable='yes'>Westmere</model>
Nov 29 17:47:17 user nova-compute[74613]:       <model usable='no'>Snowridge</model>
Nov 29 17:47:17 user nova-compute[74613]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Nov 29 17:47:17 user nova-compute[74613]:       <model usable='no'>Skylake-Server-IBRS</model>
Nov 29 17:47:17 user nova-compute[74613]:       <model usable='no'>Skylake-Server</model>
Nov 29 17:47:17 user nova-compute[74613]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Nov 29 17:47:17 user nova-compute[74613]:       <model usable='no'>Skylake-Client-IBRS</model>
Nov 29 17:47:17 user nova-compute[74613]:       <model usable='no'>Skylake-Client</model>
Nov 29 17:47:17 user nova-compute[74613]:       <model usable='no'>SandyBridge-IBRS</model>
Nov 29 17:47:17 user nova-compute[74613]:       <model usable='no'>SandyBridge</model>
Nov 29 17:47:17 user nova-compute[74613]:       <model usable='yes'>Penryn</model>
Nov 29 17:47:17 user nova-compute[74613]:       <model usable='no'>Opteron_G5</model>
Nov 29 17:47:17 user nova-compute[74613]:       <model usable='no'>Opteron_G4</model>
Nov 29 17:47:17 user nova-compute[74613]:       <model usable='no'>Opteron_G3</model>
Nov 29 17:47:17 user nova-compute[74613]:       <model usable='no'>Opteron_G2</model>
Nov 29 17:47:17 user nova-compute[74613]:       <model usable='yes'>Opteron_G1</model>
Nov 29 17:47:17 user nova-compute[74613]:       <model usable='yes'>Nehalem-IBRS</model>
Nov 29 17:47:17 user nova-compute[74613]:       <model usable='yes'>Nehalem</model>
Nov 29 17:47:17 user nova-compute[74613]:       <model usable='no'>IvyBridge-IBRS</model>
Nov 29 17:47:17 user nova-compute[74613]:       <model usable='no'>IvyBridge</model>
Nov 29 17:47:17 user nova-compute[74613]:       <model usable='no'>Icelake-Server-noTSX</model>
Nov 29 17:47:17 user nova-compute[74613]:       <model usable='no'>Icelake-Server</model>
Nov 29 17:47:17 user nova-compute[74613]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Nov 29 17:47:17 user nova-compute[74613]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Nov 29 17:47:17 user nova-compute[74613]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Nov 29 17:47:17 user nova-compute[74613]:       <model usable='no'>Haswell-noTSX</model>
Nov 29 17:47:17 user nova-compute[74613]:       <model usable='no'>Haswell-IBRS</model>
Nov 29 17:47:17 user nova-compute[74613]:       <model usable='no'>Haswell</model>
Nov 29 17:47:17 user nova-compute[74613]:       <model usable='no'>EPYC-Rome</model>
Nov 29 17:47:17 user nova-compute[74613]:       <model usable='no'>EPYC-Milan</model>
Nov 29 17:47:17 user nova-compute[74613]:       <model usable='no'>EPYC-IBPB</model>
Nov 29 17:47:17 user nova-compute[74613]:       <model usable='no'>EPYC</model>
Nov 29 17:47:17 user nova-compute[74613]:       <model usable='no'>Dhyana</model>
Nov 29 17:47:17 user nova-compute[74613]:       <model usable='no'>Cooperlake</model>
Nov 29 17:47:17 user nova-compute[74613]:       <model usable='yes'>Conroe</model>
Nov 29 17:47:17 user nova-compute[74613]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Nov 29 17:47:17 user nova-compute[74613]:       <model usable='no'>Cascadelake-Server</model>
Nov 29 17:47:17 user nova-compute[74613]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Nov 29 17:47:17 user nova-compute[74613]:       <model usable='no'>Broadwell-noTSX</model>
Nov 29 17:47:17 user nova-compute[74613]:       <model usable='no'>Broadwell-IBRS</model>
Nov 29 17:47:17 user nova-compute[74613]:       <model usable='no'>Broadwell</model>
Nov 29 17:47:17 user nova-compute[74613]:       <model usable='yes'>486</model>
Nov 29 17:47:17 user nova-compute[74613]:     </mode>
Nov 29 17:47:17 user nova-compute[74613]:   </cpu>
Nov 29 17:47:17 user nova-compute[74613]:   <memoryBacking supported='yes'>
Nov 29 17:47:17 user nova-compute[74613]:     <enum name='sourceType'>
Nov 29 17:47:17 user nova-compute[74613]:       <value>file</value>
Nov 29 17:47:17 user nova-compute[74613]:       <value>anonymous</value>
Nov 29 17:47:17 user nova-compute[74613]:       <value>memfd</value>
Nov 29 17:47:17 user nova-compute[74613]:     </enum>
Nov 29 17:47:17 user nova-compute[74613]:   </memoryBacking>
Nov 29 17:47:17 user nova-compute[74613]:   <devices>
Nov 29 17:47:17 user nova-compute[74613]:     <disk supported='yes'>
Nov 29 17:47:17 user nova-compute[74613]:       <enum name='diskDevice'>
Nov 29 17:47:17 user nova-compute[74613]:         <value>disk</value>
Nov 29 17:47:17 user nova-compute[74613]:         <value>cdrom</value>
Nov 29 17:47:17 user nova-compute[74613]:         <value>floppy</value>
Nov 29 17:47:17 user nova-compute[74613]:         <value>lun</value>
Nov 29 17:47:17 user nova-compute[74613]:       </enum>
Nov 29 17:47:17 user nova-compute[74613]:       <enum name='bus'>
Nov 29 17:47:17 user nova-compute[74613]:         <value>ide</value>
Nov 29 17:47:17 user nova-compute[74613]:         <value>fdc</value>
Nov 29 17:47:17 user nova-compute[74613]:         <value>scsi</value>
Nov 29 17:47:17 user nova-compute[74613]:         <value>virtio</value>
Nov 29 17:47:17 user nova-compute[74613]:         <value>usb</value>
Nov 29 17:47:17 user nova-compute[74613]:         <value>sata</value>
Nov 29 17:47:17 user nova-compute[74613]:       </enum>
Nov 29 17:47:17 user nova-compute[74613]:       <enum name='model'>
Nov 29 17:47:17 user nova-compute[74613]:         <value>virtio</value>
Nov 29 17:47:17 user nova-compute[74613]:         <value>virtio-transitional</value>
Nov 29 17:47:17 user nova-compute[74613]:         <value>virtio-non-transitional</value>
Nov 29 17:47:17 user nova-compute[74613]:       </enum>
Nov 29 17:47:17 user nova-compute[74613]:     </disk>
Nov 29 17:47:17 user nova-compute[74613]:     <graphics supported='yes'>
Nov 29 17:47:17 user nova-compute[74613]:       <enum name='type'>
Nov 29 17:47:17 user nova-compute[74613]:         <value>sdl</value>
Nov 29 17:47:17 user nova-compute[74613]:         <value>vnc</value>
Nov 29 17:47:17 user nova-compute[74613]:         <value>spice</value>
Nov 29 17:47:17 user nova-compute[74613]:         <value>egl-headless</value>
Nov 29 17:47:17 user nova-compute[74613]:       </enum>
Nov 29 17:47:17 user nova-compute[74613]:     </graphics>
Nov 29 17:47:17 user nova-compute[74613]:     <video supported='yes'>
Nov 29 17:47:17 user nova-compute[74613]:       <enum name='modelType'>
Nov 29 17:47:17 user nova-compute[74613]:         <value>vga</value>
Nov 29 17:47:17 user nova-compute[74613]:         <value>cirrus</value>
Nov 29 17:47:17 user nova-compute[74613]:         <value>vmvga</value>
Nov 29 17:47:17 user nova-compute[74613]:         <value>qxl</value>
Nov 29 17:47:17 user nova-compute[74613]:         <value>virtio</value>
Nov 29 17:47:17 user nova-compute[74613]:         <value>none</value>
Nov 29 17:47:17 user nova-compute[74613]:         <value>bochs</value>
Nov 29 17:47:17 user nova-compute[74613]:         <value>ramfb</value>
Nov 29 17:47:17 user nova-compute[74613]:       </enum>
Nov 29 17:47:17 user nova-compute[74613]:     </video>
Nov 29 17:47:17 user nova-compute[74613]:     <hostdev supported='yes'>
Nov 29 17:47:17 user nova-compute[74613]:       <enum name='mode'>
Nov 29 17:47:17 user nova-compute[74613]:         <value>subsystem</value>
Nov 29 17:47:17 user nova-compute[74613]:       </enum>
Nov 29 17:47:17 user nova-compute[74613]:       <enum name='startupPolicy'>
Nov 29 17:47:17 user nova-compute[74613]:         <value>default</value>
Nov 29 17:47:17 user nova-compute[74613]:         <value>mandatory</value>
Nov 29 17:47:17 user nova-compute[74613]:         <value>requisite</value>
Nov 29 17:47:17 user nova-compute[74613]:         <value>optional</value>
Nov 29 17:47:17 user nova-compute[74613]:       </enum>
Nov 29 17:47:17 user nova-compute[74613]:       <enum name='subsysType'>
Nov 29 17:47:17 user nova-compute[74613]:         <value>usb</value>
Nov 29 17:47:17 user nova-compute[74613]:         <value>pci</value>
Nov 29 17:47:17 user nova-compute[74613]:         <value>scsi</value>
Nov 29 17:47:17 user nova-compute[74613]:       </enum>
Nov 29 17:47:17 user nova-compute[74613]:       <enum name='capsType'/>
Nov 29 17:47:17 user nova-compute[74613]:       <enum name='pciBackend'/>
Nov 29 17:47:17 user nova-compute[74613]:     </hostdev>
Nov 29 17:47:17 user nova-compute[74613]:     <rng supported='yes'>
Nov 29 17:47:17 user nova-compute[74613]:       <enum name='model'>
Nov 29 17:47:17 user nova-compute[74613]:         <value>virtio</value>
Nov 29 17:47:17 user nova-compute[74613]:         <value>virtio-transitional</value>
Nov 29 17:47:17 user nova-compute[74613]:         <value>virtio-non-transitional</value>
Nov 29 17:47:17 user nova-compute[74613]:       </enum>
Nov 29 17:47:17 user nova-compute[74613]:       <enum name='backendModel'>
Nov 29 17:47:17 user nova-compute[74613]:         <value>random</value>
Nov 29 17:47:17 user nova-compute[74613]:         <value>egd</value>
Nov 29 17:47:17 user nova-compute[74613]:         <value>builtin</value>
Nov 29 17:47:17 user nova-compute[74613]:       </enum>
Nov 29 17:47:17 user nova-compute[74613]:     </rng>
Nov 29 17:47:17 user nova-compute[74613]:     <filesystem supported='yes'>
Nov 29 17:47:17 user nova-compute[74613]:       <enum name='driverType'>
Nov 29 17:47:17 user nova-compute[74613]:         <value>path</value>
Nov 29 17:47:17 user nova-compute[74613]:         <value>handle</value>
Nov 29 17:47:17 user nova-compute[74613]:         <value>virtiofs</value>
Nov 29 17:47:17 user nova-compute[74613]:       </enum>
Nov 29 17:47:17 user nova-compute[74613]:     </filesystem>
Nov 29 17:47:17 user nova-compute[74613]:     <tpm supported='yes'>
Nov 29 17:47:17 user nova-compute[74613]:       <enum name='model'>
Nov 29 17:47:17 user nova-compute[74613]:         <value>tpm-tis</value>
Nov 29 17:47:17 user nova-compute[74613]:         <value>tpm-crb</value>
Nov 29 17:47:17 user nova-compute[74613]:       </enum>
Nov 29 17:47:17 user nova-compute[74613]:       <enum name='backendModel'>
Nov 29 17:47:17 user nova-compute[74613]:         <value>passthrough</value>
Nov 29 17:47:17 user nova-compute[74613]:         <value>emulator</value>
Nov 29 17:47:17 user nova-compute[74613]:       </enum>
Nov 29 17:47:17 user nova-compute[74613]:     </tpm>
Nov 29 17:47:17 user nova-compute[74613]:   </devices>
Nov 29 17:47:17 user nova-compute[74613]:   <features>
Nov 29 17:47:17 user nova-compute[74613]:     <gic supported='no'/>
Nov 29 17:47:17 user nova-compute[74613]:     <vmcoreinfo supported='yes'/>
Nov 29 17:47:17 user nova-compute[74613]:     <genid supported='yes'/>
Nov 29 17:47:17 user nova-compute[74613]:     <backingStoreInput supported='yes'/>
Nov 29 17:47:17 user nova-compute[74613]:     <backup supported='yes'/>
Nov 29 17:47:17 user nova-compute[74613]:     <sev supported='no'/>
Nov 29 17:47:17 user nova-compute[74613]:   </features>
Nov 29 17:47:17 user nova-compute[74613]: </domainCapabilities>
Nov 29 17:47:17 user nova-compute[74613]:  {{(pid=74613) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1039}}
Nov 29 17:47:17 user nova-compute[74613]: DEBUG nova.virt.libvirt.host [None req-ff6a7ff8-5f06-4fe1-9453-c4b85f4805d3 None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=q35:
Nov 29 17:47:17 user nova-compute[74613]: <domainCapabilities>
Nov 29 17:47:17 user nova-compute[74613]:   <path>/usr/bin/qemu-system-x86_64</path>
Nov 29 17:47:17 user nova-compute[74613]:   <domain>kvm</domain>
Nov 29 17:47:17 user nova-compute[74613]:   <machine>pc-q35-6.2</machine>
Nov 29 17:47:17 user nova-compute[74613]:   <arch>x86_64</arch>
Nov 29 17:47:17 user nova-compute[74613]:   <vcpu max='288'/>
Nov 29 17:47:17 user nova-compute[74613]:   <iothreads supported='yes'/>
Nov 29 17:47:17 user nova-compute[74613]:   <os supported='yes'>
Nov 29 17:47:17 user nova-compute[74613]:     <enum name='firmware'>
Nov 29 17:47:17 user nova-compute[74613]:       <value>efi</value>
Nov 29 17:47:17 user nova-compute[74613]:     </enum>
Nov 29 17:47:17 user nova-compute[74613]:     <loader supported='yes'>
Nov 29 17:47:17 user nova-compute[74613]:       <value>/usr/share/OVMF/OVMF_CODE_4M.ms.fd</value>
Nov 29 17:47:17 user nova-compute[74613]:       <value>/usr/share/OVMF/OVMF_CODE_4M.secboot.fd</value>
Nov 29 17:47:17 user nova-compute[74613]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Nov 29 17:47:17 user nova-compute[74613]:       <enum name='type'>
Nov 29 17:47:17 user nova-compute[74613]:         <value>rom</value>
Nov 29 17:47:17 user nova-compute[74613]:         <value>pflash</value>
Nov 29 17:47:17 user nova-compute[74613]:       </enum>
Nov 29 17:47:17 user nova-compute[74613]:       <enum name='readonly'>
Nov 29 17:47:17 user nova-compute[74613]:         <value>yes</value>
Nov 29 17:47:17 user nova-compute[74613]:         <value>no</value>
Nov 29 17:47:17 user nova-compute[74613]:       </enum>
Nov 29 17:47:17 user nova-compute[74613]:       <enum name='secure'>
Nov 29 17:47:17 user nova-compute[74613]:         <value>yes</value>
Nov 29 17:47:17 user nova-compute[74613]:         <value>no</value>
Nov 29 17:47:17 user nova-compute[74613]:       </enum>
Nov 29 17:47:17 user nova-compute[74613]:     </loader>
Nov 29 17:47:17 user nova-compute[74613]:   </os>
Nov 29 17:47:17 user nova-compute[74613]:   <cpu>
Nov 29 17:47:17 user nova-compute[74613]:     <mode name='host-passthrough' supported='yes'>
Nov 29 17:47:17 user nova-compute[74613]:       <enum name='hostPassthroughMigratable'>
Nov 29 17:47:17 user nova-compute[74613]:         <value>on</value>
Nov 29 17:47:17 user nova-compute[74613]:         <value>off</value>
Nov 29 17:47:17 user nova-compute[74613]:       </enum>
Nov 29 17:47:17 user nova-compute[74613]:     </mode>
Nov 29 17:47:17 user nova-compute[74613]:     <mode name='maximum' supported='yes'>
Nov 29 17:47:17 user nova-compute[74613]:       <enum name='maximumMigratable'>
Nov 29 17:47:17 user nova-compute[74613]:         <value>on</value>
Nov 29 17:47:17 user nova-compute[74613]:         <value>off</value>
Nov 29 17:47:17 user nova-compute[74613]:       </enum>
Nov 29 17:47:17 user nova-compute[74613]:     </mode>
Nov 29 17:47:17 user nova-compute[74613]:     <mode name='host-model' supported='yes'>
Nov 29 17:47:17 user nova-compute[74613]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Nov 29 17:47:17 user nova-compute[74613]:       <vendor>Intel</vendor>
Nov 29 17:47:17 user nova-compute[74613]:       <feature policy='require' name='ss'/>
Nov 29 17:47:17 user nova-compute[74613]:       <feature policy='require' name='vmx'/>
Nov 29 17:47:17 user nova-compute[74613]:       <feature policy='require' name='pcid'/>
Nov 29 17:47:17 user nova-compute[74613]:       <feature policy='require' name='hypervisor'/>
Nov 29 17:47:17 user nova-compute[74613]:       <feature policy='require' name='arat'/>
Nov 29 17:47:17 user nova-compute[74613]:       <feature policy='require' name='tsc_adjust'/>
Nov 29 17:47:17 user nova-compute[74613]:       <feature policy='require' name='umip'/>
Nov 29 17:47:17 user nova-compute[74613]:       <feature policy='require' name='md-clear'/>
Nov 29 17:47:17 user nova-compute[74613]:       <feature policy='require' name='stibp'/>
Nov 29 17:47:17 user nova-compute[74613]:       <feature policy='require' name='arch-capabilities'/>
Nov 29 17:47:17 user nova-compute[74613]:       <feature policy='require' name='ssbd'/>
Nov 29 17:47:17 user nova-compute[74613]:       <feature policy='require' name='invtsc'/>
Nov 29 17:47:17 user nova-compute[74613]:       <feature policy='require' name='ibpb'/>
Nov 29 17:47:17 user nova-compute[74613]:       <feature policy='require' name='ibrs'/>
Nov 29 17:47:17 user nova-compute[74613]:       <feature policy='require' name='amd-stibp'/>
Nov 29 17:47:17 user nova-compute[74613]:       <feature policy='require' name='amd-ssbd'/>
Nov 29 17:47:17 user nova-compute[74613]:       <feature policy='require' name='rsba'/>
Nov 29 17:47:17 user nova-compute[74613]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Nov 29 17:47:17 user nova-compute[74613]:       <feature policy='require' name='pschange-mc-no'/>
Nov 29 17:47:17 user nova-compute[74613]:       <feature policy='disable' name='erms'/>
Nov 29 17:47:17 user nova-compute[74613]:       <feature policy='disable' name='xsaveopt'/>
Nov 29 17:47:17 user nova-compute[74613]:     </mode>
Nov 29 17:47:17 user nova-compute[74613]:     <mode name='custom' supported='yes'>
Nov 29 17:47:17 user nova-compute[74613]:       <model usable='no'>qemu64</model>
Nov 29 17:47:17 user nova-compute[74613]:       <model usable='yes'>qemu32</model>
Nov 29 17:47:17 user nova-compute[74613]:       <model usable='no'>phenom</model>
Nov 29 17:47:17 user nova-compute[74613]:       <model usable='yes'>pentium3</model>
Nov 29 17:47:17 user nova-compute[74613]:       <model usable='yes'>pentium2</model>
Nov 29 17:47:17 user nova-compute[74613]:       <model usable='yes'>pentium</model>
Nov 29 17:47:17 user nova-compute[74613]:       <model usable='no'>n270</model>
Nov 29 17:47:17 user nova-compute[74613]:       <model usable='yes'>kvm64</model>
Nov 29 17:47:17 user nova-compute[74613]:       <model usable='yes'>kvm32</model>
Nov 29 17:47:17 user nova-compute[74613]:       <model usable='yes'>coreduo</model>
Nov 29 17:47:17 user nova-compute[74613]:       <model usable='yes'>core2duo</model>
Nov 29 17:47:17 user nova-compute[74613]:       <model usable='no'>athlon</model>
Nov 29 17:47:17 user nova-compute[74613]:       <model usable='yes'>Westmere-IBRS</model>
Nov 29 17:47:17 user nova-compute[74613]:       <model usable='yes'>Westmere</model>
Nov 29 17:47:17 user nova-compute[74613]:       <model usable='no'>Snowridge</model>
Nov 29 17:47:17 user nova-compute[74613]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Nov 29 17:47:17 user nova-compute[74613]:       <model usable='no'>Skylake-Server-IBRS</model>
Nov 29 17:47:17 user nova-compute[74613]:       <model usable='no'>Skylake-Server</model>
Nov 29 17:47:17 user nova-compute[74613]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Nov 29 17:47:17 user nova-compute[74613]:       <model usable='no'>Skylake-Client-IBRS</model>
Nov 29 17:47:17 user nova-compute[74613]:       <model usable='no'>Skylake-Client</model>
Nov 29 17:47:17 user nova-compute[74613]:       <model usable='no'>SandyBridge-IBRS</model>
Nov 29 17:47:17 user nova-compute[74613]:       <model usable='no'>SandyBridge</model>
Nov 29 17:47:17 user nova-compute[74613]:       <model usable='yes'>Penryn</model>
Nov 29 17:47:17 user nova-compute[74613]:       <model usable='no'>Opteron_G5</model>
Nov 29 17:47:17 user nova-compute[74613]:       <model usable='no'>Opteron_G4</model>
Nov 29 17:47:17 user nova-compute[74613]:       <model usable='no'>Opteron_G3</model>
Nov 29 17:47:17 user nova-compute[74613]:       <model usable='no'>Opteron_G2</model>
Nov 29 17:47:17 user nova-compute[74613]:       <model usable='yes'>Opteron_G1</model>
Nov 29 17:47:17 user nova-compute[74613]:       <model usable='yes'>Nehalem-IBRS</model>
Nov 29 17:47:17 user nova-compute[74613]:       <model usable='yes'>Nehalem</model>
Nov 29 17:47:17 user nova-compute[74613]:       <model usable='no'>IvyBridge-IBRS</model>
Nov 29 17:47:17 user nova-compute[74613]:       <model usable='no'>IvyBridge</model>
Nov 29 17:47:17 user nova-compute[74613]:       <model usable='no'>Icelake-Server-noTSX</model>
Nov 29 17:47:17 user nova-compute[74613]:       <model usable='no'>Icelake-Server</model>
Nov 29 17:47:17 user nova-compute[74613]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Nov 29 17:47:17 user nova-compute[74613]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Nov 29 17:47:17 user nova-compute[74613]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Nov 29 17:47:17 user nova-compute[74613]:       <model usable='no'>Haswell-noTSX</model>
Nov 29 17:47:17 user nova-compute[74613]:       <model usable='no'>Haswell-IBRS</model>
Nov 29 17:47:17 user nova-compute[74613]:       <model usable='no'>Haswell</model>
Nov 29 17:47:17 user nova-compute[74613]:       <model usable='no'>EPYC-Rome</model>
Nov 29 17:47:17 user nova-compute[74613]:       <model usable='no'>EPYC-Milan</model>
Nov 29 17:47:17 user nova-compute[74613]:       <model usable='no'>EPYC-IBPB</model>
Nov 29 17:47:17 user nova-compute[74613]:       <model usable='no'>EPYC</model>
Nov 29 17:47:17 user nova-compute[74613]:       <model usable='no'>Dhyana</model>
Nov 29 17:47:17 user nova-compute[74613]:       <model usable='no'>Cooperlake</model>
Nov 29 17:47:17 user nova-compute[74613]:       <model usable='yes'>Conroe</model>
Nov 29 17:47:17 user nova-compute[74613]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Nov 29 17:47:17 user nova-compute[74613]:       <model usable='no'>Cascadelake-Server</model>
Nov 29 17:47:17 user nova-compute[74613]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Nov 29 17:47:17 user nova-compute[74613]:       <model usable='no'>Broadwell-noTSX</model>
Nov 29 17:47:17 user nova-compute[74613]:       <model usable='no'>Broadwell-IBRS</model>
Nov 29 17:47:17 user nova-compute[74613]:       <model usable='no'>Broadwell</model>
Nov 29 17:47:17 user nova-compute[74613]:       <model usable='yes'>486</model>
Nov 29 17:47:17 user nova-compute[74613]:     </mode>
Nov 29 17:47:17 user nova-compute[74613]:   </cpu>
Nov 29 17:47:17 user nova-compute[74613]:   <memoryBacking supported='yes'>
Nov 29 17:47:17 user nova-compute[74613]:     <enum name='sourceType'>
Nov 29 17:47:17 user nova-compute[74613]:       <value>file</value>
Nov 29 17:47:17 user nova-compute[74613]:       <value>anonymous</value>
Nov 29 17:47:17 user nova-compute[74613]:       <value>memfd</value>
Nov 29 17:47:17 user nova-compute[74613]:     </enum>
Nov 29 17:47:17 user nova-compute[74613]:   </memoryBacking>
Nov 29 17:47:17 user nova-compute[74613]:   <devices>
Nov 29 17:47:17 user nova-compute[74613]:     <disk supported='yes'>
Nov 29 17:47:17 user nova-compute[74613]:       <enum name='diskDevice'>
Nov 29 17:47:17 user nova-compute[74613]:         <value>disk</value>
Nov 29 17:47:17 user nova-compute[74613]:         <value>cdrom</value>
Nov 29 17:47:17 user nova-compute[74613]:         <value>floppy</value>
Nov 29 17:47:17 user nova-compute[74613]:         <value>lun</value>
Nov 29 17:47:17 user nova-compute[74613]:       </enum>
Nov 29 17:47:17 user nova-compute[74613]:       <enum name='bus'>
Nov 29 17:47:17 user nova-compute[74613]:         <value>fdc</value>
Nov 29 17:47:17 user nova-compute[74613]:         <value>scsi</value>
Nov 29 17:47:17 user nova-compute[74613]:         <value>virtio</value>
Nov 29 17:47:17 user nova-compute[74613]:         <value>usb</value>
Nov 29 17:47:17 user nova-compute[74613]:         <value>sata</value>
Nov 29 17:47:17 user nova-compute[74613]:       </enum>
Nov 29 17:47:17 user nova-compute[74613]:       <enum name='model'>
Nov 29 17:47:17 user nova-compute[74613]:         <value>virtio</value>
Nov 29 17:47:17 user nova-compute[74613]:         <value>virtio-transitional</value>
Nov 29 17:47:17 user nova-compute[74613]:         <value>virtio-non-transitional</value>
Nov 29 17:47:17 user nova-compute[74613]:       </enum>
Nov 29 17:47:17 user nova-compute[74613]:     </disk>
Nov 29 17:47:17 user nova-compute[74613]:     <graphics supported='yes'>
Nov 29 17:47:17 user nova-compute[74613]:       <enum name='type'>
Nov 29 17:47:17 user nova-compute[74613]:         <value>sdl</value>
Nov 29 17:47:17 user nova-compute[74613]:         <value>vnc</value>
Nov 29 17:47:17 user nova-compute[74613]:         <value>spice</value>
Nov 29 17:47:17 user nova-compute[74613]:         <value>egl-headless</value>
Nov 29 17:47:17 user nova-compute[74613]:       </enum>
Nov 29 17:47:17 user nova-compute[74613]:     </graphics>
Nov 29 17:47:17 user nova-compute[74613]:     <video supported='yes'>
Nov 29 17:47:17 user nova-compute[74613]:       <enum name='modelType'>
Nov 29 17:47:17 user nova-compute[74613]:         <value>vga</value>
Nov 29 17:47:17 user nova-compute[74613]:         <value>cirrus</value>
Nov 29 17:47:17 user nova-compute[74613]:         <value>vmvga</value>
Nov 29 17:47:17 user nova-compute[74613]:         <value>qxl</value>
Nov 29 17:47:17 user nova-compute[74613]:         <value>virtio</value>
Nov 29 17:47:17 user nova-compute[74613]:         <value>none</value>
Nov 29 17:47:17 user nova-compute[74613]:         <value>bochs</value>
Nov 29 17:47:17 user nova-compute[74613]:         <value>ramfb</value>
Nov 29 17:47:17 user nova-compute[74613]:       </enum>
Nov 29 17:47:17 user nova-compute[74613]:     </video>
Nov 29 17:47:17 user nova-compute[74613]:     <hostdev supported='yes'>
Nov 29 17:47:17 user nova-compute[74613]:       <enum name='mode'>
Nov 29 17:47:17 user nova-compute[74613]:         <value>subsystem</value>
Nov 29 17:47:17 user nova-compute[74613]:       </enum>
Nov 29 17:47:17 user nova-compute[74613]:       <enum name='startupPolicy'>
Nov 29 17:47:17 user nova-compute[74613]:         <value>default</value>
Nov 29 17:47:17 user nova-compute[74613]:         <value>mandatory</value>
Nov 29 17:47:17 user nova-compute[74613]:         <value>requisite</value>
Nov 29 17:47:17 user nova-compute[74613]:         <value>optional</value>
Nov 29 17:47:17 user nova-compute[74613]:       </enum>
Nov 29 17:47:17 user nova-compute[74613]:       <enum name='subsysType'>
Nov 29 17:47:17 user nova-compute[74613]:         <value>usb</value>
Nov 29 17:47:17 user nova-compute[74613]:         <value>pci</value>
Nov 29 17:47:17 user nova-compute[74613]:         <value>scsi</value>
Nov 29 17:47:17 user nova-compute[74613]:       </enum>
Nov 29 17:47:17 user nova-compute[74613]:       <enum name='capsType'/>
Nov 29 17:47:17 user nova-compute[74613]:       <enum name='pciBackend'/>
Nov 29 17:47:17 user nova-compute[74613]:     </hostdev>
Nov 29 17:47:17 user nova-compute[74613]:     <rng supported='yes'>
Nov 29 17:47:17 user nova-compute[74613]:       <enum name='model'>
Nov 29 17:47:17 user nova-compute[74613]:         <value>virtio</value>
Nov 29 17:47:17 user nova-compute[74613]:         <value>virtio-transitional</value>
Nov 29 17:47:17 user nova-compute[74613]:         <value>virtio-non-transitional</value>
Nov 29 17:47:17 user nova-compute[74613]:       </enum>
Nov 29 17:47:17 user nova-compute[74613]:       <enum name='backendModel'>
Nov 29 17:47:17 user nova-compute[74613]:         <value>random</value>
Nov 29 17:47:17 user nova-compute[74613]:         <value>egd</value>
Nov 29 17:47:17 user nova-compute[74613]:         <value>builtin</value>
Nov 29 17:47:17 user nova-compute[74613]:       </enum>
Nov 29 17:47:17 user nova-compute[74613]:     </rng>
Nov 29 17:47:17 user nova-compute[74613]:     <filesystem supported='yes'>
Nov 29 17:47:17 user nova-compute[74613]:       <enum name='driverType'>
Nov 29 17:47:17 user nova-compute[74613]:         <value>path</value>
Nov 29 17:47:17 user nova-compute[74613]:         <value>handle</value>
Nov 29 17:47:17 user nova-compute[74613]:         <value>virtiofs</value>
Nov 29 17:47:17 user nova-compute[74613]:       </enum>
Nov 29 17:47:17 user nova-compute[74613]:     </filesystem>
Nov 29 17:47:17 user nova-compute[74613]:     <tpm supported='yes'>
Nov 29 17:47:17 user nova-compute[74613]:       <enum name='model'>
Nov 29 17:47:17 user nova-compute[74613]:         <value>tpm-tis</value>
Nov 29 17:47:17 user nova-compute[74613]:         <value>tpm-crb</value>
Nov 29 17:47:17 user nova-compute[74613]:       </enum>
Nov 29 17:47:17 user nova-compute[74613]:       <enum name='backendModel'>
Nov 29 17:47:17 user nova-compute[74613]:         <value>passthrough</value>
Nov 29 17:47:17 user nova-compute[74613]:         <value>emulator</value>
Nov 29 17:47:17 user nova-compute[74613]:       </enum>
Nov 29 17:47:17 user nova-compute[74613]:     </tpm>
Nov 29 17:47:17 user nova-compute[74613]:   </devices>
Nov 29 17:47:17 user nova-compute[74613]:   <features>
Nov 29 17:47:17 user nova-compute[74613]:     <gic supported='no'/>
Nov 29 17:47:17 user nova-compute[74613]:     <vmcoreinfo supported='yes'/>
Nov 29 17:47:17 user nova-compute[74613]:     <genid supported='yes'/>
Nov 29 17:47:17 user nova-compute[74613]:     <backingStoreInput supported='yes'/>
Nov 29 17:47:17 user nova-compute[74613]:     <backup supported='yes'/>
Nov 29 17:47:17 user nova-compute[74613]:     <sev supported='no'/>
Nov 29 17:47:17 user nova-compute[74613]:   </features>
Nov 29 17:47:17 user nova-compute[74613]: </domainCapabilities>
Nov 29 17:47:17 user nova-compute[74613]:  {{(pid=74613) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1039}}
Nov 29 17:47:17 user nova-compute[74613]: DEBUG nova.virt.libvirt.host [None req-ff6a7ff8-5f06-4fe1-9453-c4b85f4805d3 None None] Getting domain capabilities for xtensa via machine types: {None} {{(pid=74613) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:954}}
Nov 29 17:47:17 user nova-compute[74613]: DEBUG nova.virt.libvirt.host [None req-ff6a7ff8-5f06-4fe1-9453-c4b85f4805d3 None None] Error from libvirt when retrieving domain capabilities for arch xtensa / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-xtensa' on this host {{(pid=74613) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Nov 29 17:47:17 user nova-compute[74613]: DEBUG nova.virt.libvirt.host [None req-ff6a7ff8-5f06-4fe1-9453-c4b85f4805d3 None None] Getting domain capabilities for xtensaeb via machine types: {None} {{(pid=74613) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:954}}
Nov 29 17:47:17 user nova-compute[74613]: DEBUG nova.virt.libvirt.host [None req-ff6a7ff8-5f06-4fe1-9453-c4b85f4805d3 None None] Error from libvirt when retrieving domain capabilities for arch xtensaeb / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-xtensaeb' on this host {{(pid=74613) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Nov 29 17:47:17 user nova-compute[74613]: DEBUG nova.virt.libvirt.host [None req-ff6a7ff8-5f06-4fe1-9453-c4b85f4805d3 None None] Checking secure boot support for host arch (x86_64) {{(pid=74613) supports_secure_boot /opt/stack/nova/nova/virt/libvirt/host.py:1781}}
Nov 29 17:47:17 user nova-compute[74613]: INFO nova.virt.libvirt.host [None req-ff6a7ff8-5f06-4fe1-9453-c4b85f4805d3 None None] Secure Boot support detected
Nov 29 17:47:17 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-ff6a7ff8-5f06-4fe1-9453-c4b85f4805d3 None None] cpu compare xml: <cpu match="exact">
Nov 29 17:47:17 user nova-compute[74613]:   <model>Nehalem</model>
Nov 29 17:47:17 user nova-compute[74613]: </cpu>
Nov 29 17:47:17 user nova-compute[74613]:  {{(pid=74613) _compare_cpu /opt/stack/nova/nova/virt/libvirt/driver.py:10020}}
Nov 29 17:47:17 user nova-compute[74613]: INFO nova.virt.node [None req-ff6a7ff8-5f06-4fe1-9453-c4b85f4805d3 None None] Generated node identity 639d980e-3b12-44b1-b8f4-1812416fa4dd
Nov 29 17:47:17 user nova-compute[74613]: INFO nova.virt.node [None req-ff6a7ff8-5f06-4fe1-9453-c4b85f4805d3 None None] Wrote node identity 639d980e-3b12-44b1-b8f4-1812416fa4dd to /opt/stack/data/nova/compute_id
Nov 29 17:47:17 user nova-compute[74613]: WARNING nova.compute.manager [None req-ff6a7ff8-5f06-4fe1-9453-c4b85f4805d3 None None] Compute nodes ['639d980e-3b12-44b1-b8f4-1812416fa4dd'] for host user were not found in the database. If this is the first time this service is starting on this host, then you can ignore this warning.
Nov 29 17:47:17 user nova-compute[74613]: INFO nova.compute.manager [None req-ff6a7ff8-5f06-4fe1-9453-c4b85f4805d3 None None] Looking for unclaimed instances stuck in BUILDING status for nodes managed by this host
Nov 29 17:47:17 user nova-compute[74613]: WARNING nova.compute.manager [None req-ff6a7ff8-5f06-4fe1-9453-c4b85f4805d3 None None] No compute node record found for host user. If this is the first time this service is starting on this host, then you can ignore this warning.: nova.exception_Remote.ComputeHostNotFound_Remote: Compute host user could not be found.
Nov 29 17:47:17 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-ff6a7ff8-5f06-4fe1-9453-c4b85f4805d3 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 17:47:17 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-ff6a7ff8-5f06-4fe1-9453-c4b85f4805d3 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 17:47:17 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-ff6a7ff8-5f06-4fe1-9453-c4b85f4805d3 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 17:47:17 user nova-compute[74613]: DEBUG nova.compute.resource_tracker [None req-ff6a7ff8-5f06-4fe1-9453-c4b85f4805d3 None None] Auditing locally available compute resources for user (node: user) {{(pid=74613) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 29 17:47:17 user nova-compute[74613]: WARNING nova.virt.libvirt.driver [None req-ff6a7ff8-5f06-4fe1-9453-c4b85f4805d3 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 17:47:17 user nova-compute[74613]: WARNING nova.virt.libvirt.driver [None req-ff6a7ff8-5f06-4fe1-9453-c4b85f4805d3 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 17:47:17 user nova-compute[74613]: DEBUG nova.compute.resource_tracker [None req-ff6a7ff8-5f06-4fe1-9453-c4b85f4805d3 None None] Hypervisor/Node resource view: name=user free_ram=10956MB free_disk=25.961353302001953GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74613) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 29 17:47:17 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-ff6a7ff8-5f06-4fe1-9453-c4b85f4805d3 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 17:47:17 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-ff6a7ff8-5f06-4fe1-9453-c4b85f4805d3 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 17:47:18 user nova-compute[74613]: WARNING nova.compute.resource_tracker [None req-ff6a7ff8-5f06-4fe1-9453-c4b85f4805d3 None None] No compute node record for user:639d980e-3b12-44b1-b8f4-1812416fa4dd: nova.exception_Remote.ComputeHostNotFound_Remote: Compute host 639d980e-3b12-44b1-b8f4-1812416fa4dd could not be found.
Nov 29 17:47:18 user nova-compute[74613]: INFO nova.compute.resource_tracker [None req-ff6a7ff8-5f06-4fe1-9453-c4b85f4805d3 None None] Compute node record created for user:user with uuid: 639d980e-3b12-44b1-b8f4-1812416fa4dd
Nov 29 17:47:18 user nova-compute[74613]: DEBUG nova.compute.resource_tracker [None req-ff6a7ff8-5f06-4fe1-9453-c4b85f4805d3 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=74613) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 29 17:47:18 user nova-compute[74613]: DEBUG nova.compute.resource_tracker [None req-ff6a7ff8-5f06-4fe1-9453-c4b85f4805d3 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=74613) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 29 17:47:18 user nova-compute[74613]: INFO nova.scheduler.client.report [None req-ff6a7ff8-5f06-4fe1-9453-c4b85f4805d3 None None] [req-d050088f-900e-461d-811e-26d582eaedbd] Created resource provider record via placement API for resource provider with UUID 639d980e-3b12-44b1-b8f4-1812416fa4dd and name user.
Nov 29 17:47:18 user nova-compute[74613]: DEBUG nova.virt.libvirt.host [None req-ff6a7ff8-5f06-4fe1-9453-c4b85f4805d3 None None] /sys/module/kvm_amd/parameters/sev does not exist {{(pid=74613) _kernel_supports_amd_sev /opt/stack/nova/nova/virt/libvirt/host.py:1797}}
Nov 29 17:47:18 user nova-compute[74613]: INFO nova.virt.libvirt.host [None req-ff6a7ff8-5f06-4fe1-9453-c4b85f4805d3 None None] kernel doesn't support AMD SEV
Nov 29 17:47:18 user nova-compute[74613]: DEBUG nova.compute.provider_tree [None req-ff6a7ff8-5f06-4fe1-9453-c4b85f4805d3 None None] Updating inventory in ProviderTree for provider 639d980e-3b12-44b1-b8f4-1812416fa4dd with inventory: {'MEMORY_MB': {'total': 16011, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 512}, 'VCPU': {'total': 12, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0, 'reserved': 0}, 'DISK_GB': {'total': 40, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 0}} {{(pid=74613) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 29 17:47:18 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-ff6a7ff8-5f06-4fe1-9453-c4b85f4805d3 None None] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74613) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 29 17:47:18 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-ff6a7ff8-5f06-4fe1-9453-c4b85f4805d3 None None] Libvirt baseline CPU <cpu>
Nov 29 17:47:18 user nova-compute[74613]:   <arch>x86_64</arch>
Nov 29 17:47:18 user nova-compute[74613]:   <model>Nehalem</model>
Nov 29 17:47:18 user nova-compute[74613]:   <vendor>Intel</vendor>
Nov 29 17:47:18 user nova-compute[74613]:   <topology sockets="6" cores="1" threads="1"/>
Nov 29 17:47:18 user nova-compute[74613]: </cpu>
Nov 29 17:47:18 user nova-compute[74613]:  {{(pid=74613) _get_guest_baseline_cpu_features /opt/stack/nova/nova/virt/libvirt/driver.py:12510}}
Nov 29 17:47:18 user nova-compute[74613]: DEBUG nova.scheduler.client.report [None req-ff6a7ff8-5f06-4fe1-9453-c4b85f4805d3 None None] Updated inventory for provider 639d980e-3b12-44b1-b8f4-1812416fa4dd with generation 0 in Placement from set_inventory_for_provider using data: {'MEMORY_MB': {'total': 16011, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 512}, 'VCPU': {'total': 12, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0, 'reserved': 0}, 'DISK_GB': {'total': 40, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 0}} {{(pid=74613) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:957}}
Nov 29 17:47:18 user nova-compute[74613]: DEBUG nova.compute.provider_tree [None req-ff6a7ff8-5f06-4fe1-9453-c4b85f4805d3 None None] Updating resource provider 639d980e-3b12-44b1-b8f4-1812416fa4dd generation from 0 to 1 during operation: update_inventory {{(pid=74613) _update_generation /opt/stack/nova/nova/compute/provider_tree.py:164}}
Nov 29 17:47:18 user nova-compute[74613]: DEBUG nova.compute.provider_tree [None req-ff6a7ff8-5f06-4fe1-9453-c4b85f4805d3 None None] Updating inventory in ProviderTree for provider 639d980e-3b12-44b1-b8f4-1812416fa4dd with inventory: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74613) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 29 17:47:18 user nova-compute[74613]: DEBUG nova.compute.provider_tree [None req-ff6a7ff8-5f06-4fe1-9453-c4b85f4805d3 None None] Updating resource provider 639d980e-3b12-44b1-b8f4-1812416fa4dd generation from 1 to 2 during operation: update_traits {{(pid=74613) _update_generation /opt/stack/nova/nova/compute/provider_tree.py:164}}
Nov 29 17:47:18 user nova-compute[74613]: DEBUG nova.compute.resource_tracker [None req-ff6a7ff8-5f06-4fe1-9453-c4b85f4805d3 None None] Compute_service record updated for user:user {{(pid=74613) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 29 17:47:18 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-ff6a7ff8-5f06-4fe1-9453-c4b85f4805d3 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.627s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 17:47:18 user nova-compute[74613]: DEBUG nova.service [None req-ff6a7ff8-5f06-4fe1-9453-c4b85f4805d3 None None] Creating RPC server for service compute {{(pid=74613) start /opt/stack/nova/nova/service.py:182}}
Nov 29 17:47:18 user nova-compute[74613]: DEBUG nova.service [None req-ff6a7ff8-5f06-4fe1-9453-c4b85f4805d3 None None] Join ServiceGroup membership for this service compute {{(pid=74613) start /opt/stack/nova/nova/service.py:199}}
Nov 29 17:47:18 user nova-compute[74613]: DEBUG nova.servicegroup.drivers.db [None req-ff6a7ff8-5f06-4fe1-9453-c4b85f4805d3 None None] DB_Driver: join new ServiceGroup member user to the compute group, service = <Service: host=user, binary=nova-compute, manager_class_name=nova.compute.manager.ComputeManager> {{(pid=74613) join /opt/stack/nova/nova/servicegroup/drivers/db.py:44}}
Nov 29 17:47:57 user nova-compute[74613]: DEBUG oslo_service.periodic_task [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Running periodic task ComputeManager._sync_power_states {{(pid=74613) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 17:47:57 user nova-compute[74613]: DEBUG oslo_service.periodic_task [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Running periodic task ComputeManager._cleanup_running_deleted_instances {{(pid=74613) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 17:48:09 user nova-compute[74613]: DEBUG oslo_service.periodic_task [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74613) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 17:48:09 user nova-compute[74613]: DEBUG oslo_service.periodic_task [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74613) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 17:48:09 user nova-compute[74613]: DEBUG nova.compute.manager [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Starting heal instance info cache {{(pid=74613) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 29 17:48:09 user nova-compute[74613]: DEBUG nova.compute.manager [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Rebuilding the list of instances to heal {{(pid=74613) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 29 17:48:09 user nova-compute[74613]: DEBUG nova.compute.manager [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Didn't find any instances for network info cache update. {{(pid=74613) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 29 17:48:09 user nova-compute[74613]: DEBUG oslo_service.periodic_task [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74613) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 17:48:09 user nova-compute[74613]: DEBUG oslo_service.periodic_task [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74613) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 17:48:09 user nova-compute[74613]: DEBUG oslo_service.periodic_task [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74613) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 17:48:09 user nova-compute[74613]: DEBUG oslo_service.periodic_task [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74613) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 17:48:09 user nova-compute[74613]: DEBUG oslo_service.periodic_task [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74613) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 17:48:09 user nova-compute[74613]: DEBUG oslo_service.periodic_task [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74613) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 17:48:09 user nova-compute[74613]: DEBUG nova.compute.manager [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74613) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 29 17:48:09 user nova-compute[74613]: DEBUG oslo_service.periodic_task [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74613) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 17:48:09 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 17:48:09 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 17:48:09 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 17:48:09 user nova-compute[74613]: DEBUG nova.compute.resource_tracker [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Auditing locally available compute resources for user (node: user) {{(pid=74613) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 29 17:48:09 user nova-compute[74613]: WARNING nova.virt.libvirt.driver [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 17:48:09 user nova-compute[74613]: WARNING nova.virt.libvirt.driver [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 17:48:09 user nova-compute[74613]: DEBUG nova.compute.resource_tracker [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Hypervisor/Node resource view: name=user free_ram=10389MB free_disk=25.865097045898438GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74613) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 29 17:48:09 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 17:48:09 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 17:48:10 user nova-compute[74613]: DEBUG nova.compute.resource_tracker [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=74613) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 29 17:48:10 user nova-compute[74613]: DEBUG nova.compute.resource_tracker [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=74613) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 29 17:48:10 user nova-compute[74613]: DEBUG nova.compute.provider_tree [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Inventory has not changed in ProviderTree for provider: 639d980e-3b12-44b1-b8f4-1812416fa4dd {{(pid=74613) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 17:48:10 user nova-compute[74613]: DEBUG nova.scheduler.client.report [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Inventory has not changed for provider 639d980e-3b12-44b1-b8f4-1812416fa4dd based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74613) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 17:48:10 user nova-compute[74613]: DEBUG nova.compute.resource_tracker [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Compute_service record updated for user:user {{(pid=74613) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 29 17:48:10 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.147s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 17:49:10 user nova-compute[74613]: DEBUG oslo_service.periodic_task [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74613) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 17:49:10 user nova-compute[74613]: DEBUG oslo_service.periodic_task [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74613) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 17:49:10 user nova-compute[74613]: DEBUG oslo_service.periodic_task [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74613) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 17:49:10 user nova-compute[74613]: DEBUG oslo_service.periodic_task [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74613) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 17:49:10 user nova-compute[74613]: DEBUG nova.compute.manager [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74613) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 29 17:49:10 user nova-compute[74613]: DEBUG oslo_service.periodic_task [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74613) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 17:49:10 user nova-compute[74613]: DEBUG nova.compute.manager [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Starting heal instance info cache {{(pid=74613) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 29 17:49:10 user nova-compute[74613]: DEBUG nova.compute.manager [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Rebuilding the list of instances to heal {{(pid=74613) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 29 17:49:10 user nova-compute[74613]: DEBUG nova.compute.manager [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Didn't find any instances for network info cache update. {{(pid=74613) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 29 17:49:10 user nova-compute[74613]: DEBUG oslo_service.periodic_task [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74613) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 17:49:10 user nova-compute[74613]: DEBUG oslo_service.periodic_task [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74613) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 17:49:10 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 17:49:10 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 17:49:10 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 17:49:10 user nova-compute[74613]: DEBUG nova.compute.resource_tracker [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Auditing locally available compute resources for user (node: user) {{(pid=74613) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 29 17:49:10 user nova-compute[74613]: WARNING nova.virt.libvirt.driver [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 17:49:10 user nova-compute[74613]: WARNING nova.virt.libvirt.driver [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 17:49:10 user nova-compute[74613]: DEBUG nova.compute.resource_tracker [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Hypervisor/Node resource view: name=user free_ram=10318MB free_disk=25.92963409423828GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74613) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 29 17:49:10 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 17:49:10 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 17:49:11 user nova-compute[74613]: DEBUG nova.compute.resource_tracker [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=74613) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 29 17:49:11 user nova-compute[74613]: DEBUG nova.compute.resource_tracker [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=74613) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 29 17:49:11 user nova-compute[74613]: DEBUG nova.compute.provider_tree [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Inventory has not changed in ProviderTree for provider: 639d980e-3b12-44b1-b8f4-1812416fa4dd {{(pid=74613) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 17:49:11 user nova-compute[74613]: DEBUG nova.scheduler.client.report [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Inventory has not changed for provider 639d980e-3b12-44b1-b8f4-1812416fa4dd based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74613) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 17:49:11 user nova-compute[74613]: DEBUG nova.compute.resource_tracker [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Compute_service record updated for user:user {{(pid=74613) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 29 17:49:11 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.159s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 17:49:12 user nova-compute[74613]: DEBUG oslo_service.periodic_task [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74613) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 17:49:12 user nova-compute[74613]: DEBUG oslo_service.periodic_task [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74613) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 17:49:12 user nova-compute[74613]: DEBUG oslo_service.periodic_task [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74613) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 17:50:10 user nova-compute[74613]: DEBUG oslo_service.periodic_task [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74613) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 17:50:10 user nova-compute[74613]: DEBUG nova.compute.manager [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Starting heal instance info cache {{(pid=74613) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 29 17:50:10 user nova-compute[74613]: DEBUG nova.compute.manager [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Rebuilding the list of instances to heal {{(pid=74613) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 29 17:50:10 user nova-compute[74613]: DEBUG nova.compute.manager [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Didn't find any instances for network info cache update. {{(pid=74613) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 29 17:50:10 user nova-compute[74613]: DEBUG oslo_service.periodic_task [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74613) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 17:50:10 user nova-compute[74613]: DEBUG oslo_service.periodic_task [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74613) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 17:50:10 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 17:50:10 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 17:50:10 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 17:50:10 user nova-compute[74613]: DEBUG nova.compute.resource_tracker [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Auditing locally available compute resources for user (node: user) {{(pid=74613) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 29 17:50:10 user nova-compute[74613]: WARNING nova.virt.libvirt.driver [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 17:50:10 user nova-compute[74613]: WARNING nova.virt.libvirt.driver [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 17:50:10 user nova-compute[74613]: DEBUG nova.compute.resource_tracker [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Hypervisor/Node resource view: name=user free_ram=10317MB free_disk=25.68185806274414GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74613) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 29 17:50:10 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 17:50:10 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 17:50:11 user nova-compute[74613]: DEBUG nova.compute.resource_tracker [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=74613) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 29 17:50:11 user nova-compute[74613]: DEBUG nova.compute.resource_tracker [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=74613) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 29 17:50:11 user nova-compute[74613]: DEBUG nova.compute.provider_tree [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Inventory has not changed in ProviderTree for provider: 639d980e-3b12-44b1-b8f4-1812416fa4dd {{(pid=74613) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 17:50:11 user nova-compute[74613]: DEBUG nova.scheduler.client.report [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Inventory has not changed for provider 639d980e-3b12-44b1-b8f4-1812416fa4dd based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74613) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 17:50:11 user nova-compute[74613]: DEBUG nova.compute.resource_tracker [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Compute_service record updated for user:user {{(pid=74613) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 29 17:50:11 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.113s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 17:50:12 user nova-compute[74613]: DEBUG oslo_service.periodic_task [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74613) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 17:50:12 user nova-compute[74613]: DEBUG oslo_service.periodic_task [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74613) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 17:50:12 user nova-compute[74613]: DEBUG oslo_service.periodic_task [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74613) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 17:50:12 user nova-compute[74613]: DEBUG oslo_service.periodic_task [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74613) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 17:50:12 user nova-compute[74613]: DEBUG nova.compute.manager [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74613) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 29 17:50:12 user nova-compute[74613]: DEBUG oslo_service.periodic_task [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74613) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 17:50:12 user nova-compute[74613]: DEBUG oslo_service.periodic_task [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74613) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 17:51:09 user nova-compute[74613]: DEBUG oslo_service.periodic_task [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74613) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 17:51:10 user nova-compute[74613]: DEBUG oslo_service.periodic_task [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74613) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 17:51:11 user nova-compute[74613]: DEBUG oslo_service.periodic_task [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74613) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 17:51:11 user nova-compute[74613]: DEBUG nova.compute.manager [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Starting heal instance info cache {{(pid=74613) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 29 17:51:11 user nova-compute[74613]: DEBUG nova.compute.manager [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Rebuilding the list of instances to heal {{(pid=74613) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 29 17:51:11 user nova-compute[74613]: DEBUG nova.compute.manager [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Didn't find any instances for network info cache update. {{(pid=74613) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 29 17:51:11 user nova-compute[74613]: DEBUG oslo_service.periodic_task [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74613) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 17:51:11 user nova-compute[74613]: DEBUG oslo_service.periodic_task [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74613) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 17:51:11 user nova-compute[74613]: DEBUG oslo_service.periodic_task [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74613) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 17:51:11 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 17:51:11 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 17:51:11 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 17:51:11 user nova-compute[74613]: DEBUG nova.compute.resource_tracker [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Auditing locally available compute resources for user (node: user) {{(pid=74613) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 29 17:51:11 user nova-compute[74613]: WARNING nova.virt.libvirt.driver [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 17:51:11 user nova-compute[74613]: WARNING nova.virt.libvirt.driver [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 17:51:11 user nova-compute[74613]: DEBUG nova.compute.resource_tracker [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Hypervisor/Node resource view: name=user free_ram=9623MB free_disk=25.702869415283203GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74613) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 29 17:51:11 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 17:51:11 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 17:51:12 user nova-compute[74613]: DEBUG nova.compute.resource_tracker [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=74613) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 29 17:51:12 user nova-compute[74613]: DEBUG nova.compute.resource_tracker [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=74613) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 29 17:51:12 user nova-compute[74613]: DEBUG nova.compute.provider_tree [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Inventory has not changed in ProviderTree for provider: 639d980e-3b12-44b1-b8f4-1812416fa4dd {{(pid=74613) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 17:51:12 user nova-compute[74613]: DEBUG nova.scheduler.client.report [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Inventory has not changed for provider 639d980e-3b12-44b1-b8f4-1812416fa4dd based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74613) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 17:51:12 user nova-compute[74613]: DEBUG nova.compute.resource_tracker [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Compute_service record updated for user:user {{(pid=74613) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 29 17:51:12 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.141s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 17:51:13 user nova-compute[74613]: DEBUG oslo_service.periodic_task [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74613) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 17:51:13 user nova-compute[74613]: DEBUG oslo_service.periodic_task [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74613) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 17:51:13 user nova-compute[74613]: DEBUG nova.compute.manager [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74613) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 29 17:51:13 user nova-compute[74613]: DEBUG oslo_service.periodic_task [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74613) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 17:51:14 user nova-compute[74613]: DEBUG oslo_service.periodic_task [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74613) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 17:51:22 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-c95f4e22-f5b1-4f6e-80dc-83a2ee62815f tempest-ServerStableDeviceRescueTest-1416322546 tempest-ServerStableDeviceRescueTest-1416322546-project-member] Acquiring lock "b6b0ba36-ad89-45f1-9578-8b999567dd25" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 17:51:22 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-c95f4e22-f5b1-4f6e-80dc-83a2ee62815f tempest-ServerStableDeviceRescueTest-1416322546 tempest-ServerStableDeviceRescueTest-1416322546-project-member] Lock "b6b0ba36-ad89-45f1-9578-8b999567dd25" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 17:51:22 user nova-compute[74613]: DEBUG nova.compute.manager [None req-c95f4e22-f5b1-4f6e-80dc-83a2ee62815f tempest-ServerStableDeviceRescueTest-1416322546 tempest-ServerStableDeviceRescueTest-1416322546-project-member] [instance: b6b0ba36-ad89-45f1-9578-8b999567dd25] Starting instance... {{(pid=74613) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 29 17:51:23 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-c95f4e22-f5b1-4f6e-80dc-83a2ee62815f tempest-ServerStableDeviceRescueTest-1416322546 tempest-ServerStableDeviceRescueTest-1416322546-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 17:51:23 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-c95f4e22-f5b1-4f6e-80dc-83a2ee62815f tempest-ServerStableDeviceRescueTest-1416322546 tempest-ServerStableDeviceRescueTest-1416322546-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 17:51:23 user nova-compute[74613]: DEBUG nova.virt.hardware [None req-c95f4e22-f5b1-4f6e-80dc-83a2ee62815f tempest-ServerStableDeviceRescueTest-1416322546 tempest-ServerStableDeviceRescueTest-1416322546-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74613) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 29 17:51:23 user nova-compute[74613]: INFO nova.compute.claims [None req-c95f4e22-f5b1-4f6e-80dc-83a2ee62815f tempest-ServerStableDeviceRescueTest-1416322546 tempest-ServerStableDeviceRescueTest-1416322546-project-member] [instance: b6b0ba36-ad89-45f1-9578-8b999567dd25] Claim successful on node user
Nov 29 17:51:23 user nova-compute[74613]: DEBUG nova.compute.provider_tree [None req-c95f4e22-f5b1-4f6e-80dc-83a2ee62815f tempest-ServerStableDeviceRescueTest-1416322546 tempest-ServerStableDeviceRescueTest-1416322546-project-member] Inventory has not changed in ProviderTree for provider: 639d980e-3b12-44b1-b8f4-1812416fa4dd {{(pid=74613) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 17:51:23 user nova-compute[74613]: DEBUG nova.scheduler.client.report [None req-c95f4e22-f5b1-4f6e-80dc-83a2ee62815f tempest-ServerStableDeviceRescueTest-1416322546 tempest-ServerStableDeviceRescueTest-1416322546-project-member] Inventory has not changed for provider 639d980e-3b12-44b1-b8f4-1812416fa4dd based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74613) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 17:51:23 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-c95f4e22-f5b1-4f6e-80dc-83a2ee62815f tempest-ServerStableDeviceRescueTest-1416322546 tempest-ServerStableDeviceRescueTest-1416322546-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.600s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 17:51:23 user nova-compute[74613]: DEBUG nova.compute.manager [None req-c95f4e22-f5b1-4f6e-80dc-83a2ee62815f tempest-ServerStableDeviceRescueTest-1416322546 tempest-ServerStableDeviceRescueTest-1416322546-project-member] [instance: b6b0ba36-ad89-45f1-9578-8b999567dd25] Start building networks asynchronously for instance. {{(pid=74613) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 29 17:51:23 user nova-compute[74613]: DEBUG nova.compute.manager [None req-c95f4e22-f5b1-4f6e-80dc-83a2ee62815f tempest-ServerStableDeviceRescueTest-1416322546 tempest-ServerStableDeviceRescueTest-1416322546-project-member] [instance: b6b0ba36-ad89-45f1-9578-8b999567dd25] Allocating IP information in the background. {{(pid=74613) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 29 17:51:23 user nova-compute[74613]: DEBUG nova.network.neutron [None req-c95f4e22-f5b1-4f6e-80dc-83a2ee62815f tempest-ServerStableDeviceRescueTest-1416322546 tempest-ServerStableDeviceRescueTest-1416322546-project-member] [instance: b6b0ba36-ad89-45f1-9578-8b999567dd25] allocate_for_instance() {{(pid=74613) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 29 17:51:23 user nova-compute[74613]: INFO nova.virt.libvirt.driver [None req-c95f4e22-f5b1-4f6e-80dc-83a2ee62815f tempest-ServerStableDeviceRescueTest-1416322546 tempest-ServerStableDeviceRescueTest-1416322546-project-member] [instance: b6b0ba36-ad89-45f1-9578-8b999567dd25] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 29 17:51:23 user nova-compute[74613]: DEBUG nova.compute.manager [None req-c95f4e22-f5b1-4f6e-80dc-83a2ee62815f tempest-ServerStableDeviceRescueTest-1416322546 tempest-ServerStableDeviceRescueTest-1416322546-project-member] [instance: b6b0ba36-ad89-45f1-9578-8b999567dd25] Start building block device mappings for instance. {{(pid=74613) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 29 17:51:24 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-d108c1ab-fa43-4e97-b056-065e3528f377 tempest-ServerBootFromVolumeStableRescueTest-414665510 tempest-ServerBootFromVolumeStableRescueTest-414665510-project-member] Acquiring lock "3b828860-5cc5-40b0-b845-8e560211794e" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 17:51:24 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-d108c1ab-fa43-4e97-b056-065e3528f377 tempest-ServerBootFromVolumeStableRescueTest-414665510 tempest-ServerBootFromVolumeStableRescueTest-414665510-project-member] Lock "3b828860-5cc5-40b0-b845-8e560211794e" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 17:51:24 user nova-compute[74613]: DEBUG nova.compute.manager [None req-c95f4e22-f5b1-4f6e-80dc-83a2ee62815f tempest-ServerStableDeviceRescueTest-1416322546 tempest-ServerStableDeviceRescueTest-1416322546-project-member] [instance: b6b0ba36-ad89-45f1-9578-8b999567dd25] Start spawning the instance on the hypervisor. {{(pid=74613) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 29 17:51:24 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-c95f4e22-f5b1-4f6e-80dc-83a2ee62815f tempest-ServerStableDeviceRescueTest-1416322546 tempest-ServerStableDeviceRescueTest-1416322546-project-member] [instance: b6b0ba36-ad89-45f1-9578-8b999567dd25] Creating instance directory {{(pid=74613) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 29 17:51:24 user nova-compute[74613]: INFO nova.virt.libvirt.driver [None req-c95f4e22-f5b1-4f6e-80dc-83a2ee62815f tempest-ServerStableDeviceRescueTest-1416322546 tempest-ServerStableDeviceRescueTest-1416322546-project-member] [instance: b6b0ba36-ad89-45f1-9578-8b999567dd25] Creating image(s)
Nov 29 17:51:24 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-c95f4e22-f5b1-4f6e-80dc-83a2ee62815f tempest-ServerStableDeviceRescueTest-1416322546 tempest-ServerStableDeviceRescueTest-1416322546-project-member] Acquiring lock "/opt/stack/data/nova/instances/b6b0ba36-ad89-45f1-9578-8b999567dd25/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 17:51:24 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-c95f4e22-f5b1-4f6e-80dc-83a2ee62815f tempest-ServerStableDeviceRescueTest-1416322546 tempest-ServerStableDeviceRescueTest-1416322546-project-member] Lock "/opt/stack/data/nova/instances/b6b0ba36-ad89-45f1-9578-8b999567dd25/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 17:51:24 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-c95f4e22-f5b1-4f6e-80dc-83a2ee62815f tempest-ServerStableDeviceRescueTest-1416322546 tempest-ServerStableDeviceRescueTest-1416322546-project-member] Lock "/opt/stack/data/nova/instances/b6b0ba36-ad89-45f1-9578-8b999567dd25/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 17:51:24 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-c95f4e22-f5b1-4f6e-80dc-83a2ee62815f tempest-ServerStableDeviceRescueTest-1416322546 tempest-ServerStableDeviceRescueTest-1416322546-project-member] Acquiring lock "21faea9e6951f3bdd0153b76ac89fe1a60a34758" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 17:51:24 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-c95f4e22-f5b1-4f6e-80dc-83a2ee62815f tempest-ServerStableDeviceRescueTest-1416322546 tempest-ServerStableDeviceRescueTest-1416322546-project-member] Lock "21faea9e6951f3bdd0153b76ac89fe1a60a34758" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 17:51:24 user nova-compute[74613]: DEBUG nova.compute.manager [None req-d108c1ab-fa43-4e97-b056-065e3528f377 tempest-ServerBootFromVolumeStableRescueTest-414665510 tempest-ServerBootFromVolumeStableRescueTest-414665510-project-member] [instance: 3b828860-5cc5-40b0-b845-8e560211794e] Starting instance... {{(pid=74613) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 29 17:51:24 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-31c66816-a579-4fed-917c-5fe116aeddf6 tempest-DeleteServersTestJSON-112443106 tempest-DeleteServersTestJSON-112443106-project-member] Acquiring lock "f3a5f6d2-cadd-485b-a443-1b8f3ed966b9" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 17:51:24 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-31c66816-a579-4fed-917c-5fe116aeddf6 tempest-DeleteServersTestJSON-112443106 tempest-DeleteServersTestJSON-112443106-project-member] Lock "f3a5f6d2-cadd-485b-a443-1b8f3ed966b9" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 17:51:24 user nova-compute[74613]: DEBUG nova.compute.manager [None req-31c66816-a579-4fed-917c-5fe116aeddf6 tempest-DeleteServersTestJSON-112443106 tempest-DeleteServersTestJSON-112443106-project-member] [instance: f3a5f6d2-cadd-485b-a443-1b8f3ed966b9] Starting instance... {{(pid=74613) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 29 17:51:24 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-c95f4e22-f5b1-4f6e-80dc-83a2ee62815f tempest-ServerStableDeviceRescueTest-1416322546 tempest-ServerStableDeviceRescueTest-1416322546-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/21faea9e6951f3bdd0153b76ac89fe1a60a34758.part --force-share --output=json {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 17:51:24 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-3a7ec63d-1bdf-4849-9e6b-4f290ee89c4c tempest-AttachVolumeShelveTestJSON-1452861425 tempest-AttachVolumeShelveTestJSON-1452861425-project-member] Acquiring lock "c19e230e-2e6c-4c20-b15c-ad81a73674b4" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 17:51:24 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-3a7ec63d-1bdf-4849-9e6b-4f290ee89c4c tempest-AttachVolumeShelveTestJSON-1452861425 tempest-AttachVolumeShelveTestJSON-1452861425-project-member] Lock "c19e230e-2e6c-4c20-b15c-ad81a73674b4" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 17:51:24 user nova-compute[74613]: DEBUG nova.policy [None req-c95f4e22-f5b1-4f6e-80dc-83a2ee62815f tempest-ServerStableDeviceRescueTest-1416322546 tempest-ServerStableDeviceRescueTest-1416322546-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '71f13889d23c4ddb9c5e52d7a1a82d47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8f184c16b5348beb2dc9e6359a47651', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74613) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 29 17:51:24 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-d108c1ab-fa43-4e97-b056-065e3528f377 tempest-ServerBootFromVolumeStableRescueTest-414665510 tempest-ServerBootFromVolumeStableRescueTest-414665510-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 17:51:24 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-d108c1ab-fa43-4e97-b056-065e3528f377 tempest-ServerBootFromVolumeStableRescueTest-414665510 tempest-ServerBootFromVolumeStableRescueTest-414665510-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 17:51:24 user nova-compute[74613]: DEBUG nova.compute.manager [None req-3a7ec63d-1bdf-4849-9e6b-4f290ee89c4c tempest-AttachVolumeShelveTestJSON-1452861425 tempest-AttachVolumeShelveTestJSON-1452861425-project-member] [instance: c19e230e-2e6c-4c20-b15c-ad81a73674b4] Starting instance... {{(pid=74613) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 29 17:51:24 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-31c66816-a579-4fed-917c-5fe116aeddf6 tempest-DeleteServersTestJSON-112443106 tempest-DeleteServersTestJSON-112443106-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 17:51:24 user nova-compute[74613]: DEBUG nova.virt.hardware [None req-d108c1ab-fa43-4e97-b056-065e3528f377 tempest-ServerBootFromVolumeStableRescueTest-414665510 tempest-ServerBootFromVolumeStableRescueTest-414665510-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74613) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 29 17:51:24 user nova-compute[74613]: INFO nova.compute.claims [None req-d108c1ab-fa43-4e97-b056-065e3528f377 tempest-ServerBootFromVolumeStableRescueTest-414665510 tempest-ServerBootFromVolumeStableRescueTest-414665510-project-member] [instance: 3b828860-5cc5-40b0-b845-8e560211794e] Claim successful on node user
Nov 29 17:51:24 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-c95f4e22-f5b1-4f6e-80dc-83a2ee62815f tempest-ServerStableDeviceRescueTest-1416322546 tempest-ServerStableDeviceRescueTest-1416322546-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/21faea9e6951f3bdd0153b76ac89fe1a60a34758.part --force-share --output=json" returned: 0 in 0.249s {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 17:51:24 user nova-compute[74613]: DEBUG nova.virt.images [None req-c95f4e22-f5b1-4f6e-80dc-83a2ee62815f tempest-ServerStableDeviceRescueTest-1416322546 tempest-ServerStableDeviceRescueTest-1416322546-project-member] 4217f428-8d9d-4ee1-9614-642d26d90c46 was qcow2, converting to raw {{(pid=74613) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 29 17:51:24 user nova-compute[74613]: DEBUG nova.privsep.utils [None req-c95f4e22-f5b1-4f6e-80dc-83a2ee62815f tempest-ServerStableDeviceRescueTest-1416322546 tempest-ServerStableDeviceRescueTest-1416322546-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74613) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 29 17:51:24 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-c95f4e22-f5b1-4f6e-80dc-83a2ee62815f tempest-ServerStableDeviceRescueTest-1416322546 tempest-ServerStableDeviceRescueTest-1416322546-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/21faea9e6951f3bdd0153b76ac89fe1a60a34758.part /opt/stack/data/nova/instances/_base/21faea9e6951f3bdd0153b76ac89fe1a60a34758.converted {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 17:51:24 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-3a7ec63d-1bdf-4849-9e6b-4f290ee89c4c tempest-AttachVolumeShelveTestJSON-1452861425 tempest-AttachVolumeShelveTestJSON-1452861425-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 17:51:25 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-c95f4e22-f5b1-4f6e-80dc-83a2ee62815f tempest-ServerStableDeviceRescueTest-1416322546 tempest-ServerStableDeviceRescueTest-1416322546-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/21faea9e6951f3bdd0153b76ac89fe1a60a34758.part /opt/stack/data/nova/instances/_base/21faea9e6951f3bdd0153b76ac89fe1a60a34758.converted" returned: 0 in 0.362s {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 17:51:25 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-c95f4e22-f5b1-4f6e-80dc-83a2ee62815f tempest-ServerStableDeviceRescueTest-1416322546 tempest-ServerStableDeviceRescueTest-1416322546-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/21faea9e6951f3bdd0153b76ac89fe1a60a34758.converted --force-share --output=json {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 17:51:25 user nova-compute[74613]: DEBUG nova.compute.provider_tree [None req-d108c1ab-fa43-4e97-b056-065e3528f377 tempest-ServerBootFromVolumeStableRescueTest-414665510 tempest-ServerBootFromVolumeStableRescueTest-414665510-project-member] Inventory has not changed in ProviderTree for provider: 639d980e-3b12-44b1-b8f4-1812416fa4dd {{(pid=74613) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 17:51:25 user nova-compute[74613]: DEBUG nova.scheduler.client.report [None req-d108c1ab-fa43-4e97-b056-065e3528f377 tempest-ServerBootFromVolumeStableRescueTest-414665510 tempest-ServerBootFromVolumeStableRescueTest-414665510-project-member] Inventory has not changed for provider 639d980e-3b12-44b1-b8f4-1812416fa4dd based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74613) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 17:51:25 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-d108c1ab-fa43-4e97-b056-065e3528f377 tempest-ServerBootFromVolumeStableRescueTest-414665510 tempest-ServerBootFromVolumeStableRescueTest-414665510-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.581s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 17:51:25 user nova-compute[74613]: DEBUG nova.compute.manager [None req-d108c1ab-fa43-4e97-b056-065e3528f377 tempest-ServerBootFromVolumeStableRescueTest-414665510 tempest-ServerBootFromVolumeStableRescueTest-414665510-project-member] [instance: 3b828860-5cc5-40b0-b845-8e560211794e] Start building networks asynchronously for instance. {{(pid=74613) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 29 17:51:25 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-31c66816-a579-4fed-917c-5fe116aeddf6 tempest-DeleteServersTestJSON-112443106 tempest-DeleteServersTestJSON-112443106-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.571s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 17:51:25 user nova-compute[74613]: DEBUG nova.virt.hardware [None req-31c66816-a579-4fed-917c-5fe116aeddf6 tempest-DeleteServersTestJSON-112443106 tempest-DeleteServersTestJSON-112443106-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74613) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 29 17:51:25 user nova-compute[74613]: INFO nova.compute.claims [None req-31c66816-a579-4fed-917c-5fe116aeddf6 tempest-DeleteServersTestJSON-112443106 tempest-DeleteServersTestJSON-112443106-project-member] [instance: f3a5f6d2-cadd-485b-a443-1b8f3ed966b9] Claim successful on node user
Nov 29 17:51:25 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-c95f4e22-f5b1-4f6e-80dc-83a2ee62815f tempest-ServerStableDeviceRescueTest-1416322546 tempest-ServerStableDeviceRescueTest-1416322546-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/21faea9e6951f3bdd0153b76ac89fe1a60a34758.converted --force-share --output=json" returned: 0 in 0.185s {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 17:51:25 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-c95f4e22-f5b1-4f6e-80dc-83a2ee62815f tempest-ServerStableDeviceRescueTest-1416322546 tempest-ServerStableDeviceRescueTest-1416322546-project-member] Lock "21faea9e6951f3bdd0153b76ac89fe1a60a34758" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.066s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 17:51:25 user nova-compute[74613]: INFO oslo.privsep.daemon [None req-c95f4e22-f5b1-4f6e-80dc-83a2ee62815f tempest-ServerStableDeviceRescueTest-1416322546 tempest-ServerStableDeviceRescueTest-1416322546-project-member] Running privsep helper: ['sudo', 'nova-rootwrap', '/etc/nova/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/nova/nova-cpu.conf', '--privsep_context', 'nova.privsep.sys_admin_pctxt', '--privsep_sock_path', '/tmp/tmp7e86pmzs/privsep.sock']
Nov 29 17:51:25 user sudo[83901]:    stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/nova-rootwrap /etc/nova/rootwrap.conf privsep-helper --config-file /etc/nova/nova-cpu.conf --privsep_context nova.privsep.sys_admin_pctxt --privsep_sock_path /tmp/tmp7e86pmzs/privsep.sock
Nov 29 17:51:25 user sudo[83901]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1001)
Nov 29 17:51:25 user nova-compute[74613]: DEBUG nova.compute.manager [None req-d108c1ab-fa43-4e97-b056-065e3528f377 tempest-ServerBootFromVolumeStableRescueTest-414665510 tempest-ServerBootFromVolumeStableRescueTest-414665510-project-member] [instance: 3b828860-5cc5-40b0-b845-8e560211794e] Allocating IP information in the background. {{(pid=74613) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 29 17:51:25 user nova-compute[74613]: DEBUG nova.network.neutron [None req-d108c1ab-fa43-4e97-b056-065e3528f377 tempest-ServerBootFromVolumeStableRescueTest-414665510 tempest-ServerBootFromVolumeStableRescueTest-414665510-project-member] [instance: 3b828860-5cc5-40b0-b845-8e560211794e] allocate_for_instance() {{(pid=74613) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 29 17:51:25 user nova-compute[74613]: INFO nova.virt.libvirt.driver [None req-d108c1ab-fa43-4e97-b056-065e3528f377 tempest-ServerBootFromVolumeStableRescueTest-414665510 tempest-ServerBootFromVolumeStableRescueTest-414665510-project-member] [instance: 3b828860-5cc5-40b0-b845-8e560211794e] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 29 17:51:25 user nova-compute[74613]: DEBUG nova.compute.manager [None req-d108c1ab-fa43-4e97-b056-065e3528f377 tempest-ServerBootFromVolumeStableRescueTest-414665510 tempest-ServerBootFromVolumeStableRescueTest-414665510-project-member] [instance: 3b828860-5cc5-40b0-b845-8e560211794e] Start building block device mappings for instance. {{(pid=74613) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 29 17:51:25 user nova-compute[74613]: DEBUG nova.compute.manager [None req-d108c1ab-fa43-4e97-b056-065e3528f377 tempest-ServerBootFromVolumeStableRescueTest-414665510 tempest-ServerBootFromVolumeStableRescueTest-414665510-project-member] [instance: 3b828860-5cc5-40b0-b845-8e560211794e] Start spawning the instance on the hypervisor. {{(pid=74613) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 29 17:51:25 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-d108c1ab-fa43-4e97-b056-065e3528f377 tempest-ServerBootFromVolumeStableRescueTest-414665510 tempest-ServerBootFromVolumeStableRescueTest-414665510-project-member] [instance: 3b828860-5cc5-40b0-b845-8e560211794e] Creating instance directory {{(pid=74613) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 29 17:51:25 user nova-compute[74613]: INFO nova.virt.libvirt.driver [None req-d108c1ab-fa43-4e97-b056-065e3528f377 tempest-ServerBootFromVolumeStableRescueTest-414665510 tempest-ServerBootFromVolumeStableRescueTest-414665510-project-member] [instance: 3b828860-5cc5-40b0-b845-8e560211794e] Creating image(s)
Nov 29 17:51:25 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-d108c1ab-fa43-4e97-b056-065e3528f377 tempest-ServerBootFromVolumeStableRescueTest-414665510 tempest-ServerBootFromVolumeStableRescueTest-414665510-project-member] Acquiring lock "/opt/stack/data/nova/instances/3b828860-5cc5-40b0-b845-8e560211794e/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 17:51:25 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-d108c1ab-fa43-4e97-b056-065e3528f377 tempest-ServerBootFromVolumeStableRescueTest-414665510 tempest-ServerBootFromVolumeStableRescueTest-414665510-project-member] Lock "/opt/stack/data/nova/instances/3b828860-5cc5-40b0-b845-8e560211794e/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 17:51:25 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-d108c1ab-fa43-4e97-b056-065e3528f377 tempest-ServerBootFromVolumeStableRescueTest-414665510 tempest-ServerBootFromVolumeStableRescueTest-414665510-project-member] Lock "/opt/stack/data/nova/instances/3b828860-5cc5-40b0-b845-8e560211794e/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 17:51:25 user nova-compute[74613]: DEBUG nova.compute.provider_tree [None req-31c66816-a579-4fed-917c-5fe116aeddf6 tempest-DeleteServersTestJSON-112443106 tempest-DeleteServersTestJSON-112443106-project-member] Inventory has not changed in ProviderTree for provider: 639d980e-3b12-44b1-b8f4-1812416fa4dd {{(pid=74613) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 17:51:25 user nova-compute[74613]: DEBUG nova.scheduler.client.report [None req-31c66816-a579-4fed-917c-5fe116aeddf6 tempest-DeleteServersTestJSON-112443106 tempest-DeleteServersTestJSON-112443106-project-member] Inventory has not changed for provider 639d980e-3b12-44b1-b8f4-1812416fa4dd based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74613) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 17:51:25 user nova-compute[74613]: DEBUG nova.policy [None req-d108c1ab-fa43-4e97-b056-065e3528f377 tempest-ServerBootFromVolumeStableRescueTest-414665510 tempest-ServerBootFromVolumeStableRescueTest-414665510-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'c65bc922e04d4d1385e48f70c460c441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b820dd795dfe46cd804772f0e71f98e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74613) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 29 17:51:25 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-31c66816-a579-4fed-917c-5fe116aeddf6 tempest-DeleteServersTestJSON-112443106 tempest-DeleteServersTestJSON-112443106-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.357s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 17:51:25 user nova-compute[74613]: DEBUG nova.compute.manager [None req-31c66816-a579-4fed-917c-5fe116aeddf6 tempest-DeleteServersTestJSON-112443106 tempest-DeleteServersTestJSON-112443106-project-member] [instance: f3a5f6d2-cadd-485b-a443-1b8f3ed966b9] Start building networks asynchronously for instance. {{(pid=74613) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 29 17:51:25 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-3a7ec63d-1bdf-4849-9e6b-4f290ee89c4c tempest-AttachVolumeShelveTestJSON-1452861425 tempest-AttachVolumeShelveTestJSON-1452861425-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.767s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 17:51:25 user nova-compute[74613]: DEBUG nova.virt.hardware [None req-3a7ec63d-1bdf-4849-9e6b-4f290ee89c4c tempest-AttachVolumeShelveTestJSON-1452861425 tempest-AttachVolumeShelveTestJSON-1452861425-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74613) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 29 17:51:25 user nova-compute[74613]: INFO nova.compute.claims [None req-3a7ec63d-1bdf-4849-9e6b-4f290ee89c4c tempest-AttachVolumeShelveTestJSON-1452861425 tempest-AttachVolumeShelveTestJSON-1452861425-project-member] [instance: c19e230e-2e6c-4c20-b15c-ad81a73674b4] Claim successful on node user
Nov 29 17:51:25 user nova-compute[74613]: DEBUG nova.compute.manager [None req-31c66816-a579-4fed-917c-5fe116aeddf6 tempest-DeleteServersTestJSON-112443106 tempest-DeleteServersTestJSON-112443106-project-member] [instance: f3a5f6d2-cadd-485b-a443-1b8f3ed966b9] Allocating IP information in the background. {{(pid=74613) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 29 17:51:25 user nova-compute[74613]: DEBUG nova.network.neutron [None req-31c66816-a579-4fed-917c-5fe116aeddf6 tempest-DeleteServersTestJSON-112443106 tempest-DeleteServersTestJSON-112443106-project-member] [instance: f3a5f6d2-cadd-485b-a443-1b8f3ed966b9] allocate_for_instance() {{(pid=74613) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 29 17:51:25 user nova-compute[74613]: INFO nova.virt.libvirt.driver [None req-31c66816-a579-4fed-917c-5fe116aeddf6 tempest-DeleteServersTestJSON-112443106 tempest-DeleteServersTestJSON-112443106-project-member] [instance: f3a5f6d2-cadd-485b-a443-1b8f3ed966b9] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 29 17:51:25 user nova-compute[74613]: DEBUG nova.compute.manager [None req-31c66816-a579-4fed-917c-5fe116aeddf6 tempest-DeleteServersTestJSON-112443106 tempest-DeleteServersTestJSON-112443106-project-member] [instance: f3a5f6d2-cadd-485b-a443-1b8f3ed966b9] Start building block device mappings for instance. {{(pid=74613) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 29 17:51:25 user nova-compute[74613]: DEBUG nova.policy [None req-31c66816-a579-4fed-917c-5fe116aeddf6 tempest-DeleteServersTestJSON-112443106 tempest-DeleteServersTestJSON-112443106-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '9e4a26c0f9d8426cb7ccb5109ef59e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31ff57da724840588bee7c012be00891', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74613) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 29 17:51:26 user nova-compute[74613]: DEBUG nova.compute.manager [None req-31c66816-a579-4fed-917c-5fe116aeddf6 tempest-DeleteServersTestJSON-112443106 tempest-DeleteServersTestJSON-112443106-project-member] [instance: f3a5f6d2-cadd-485b-a443-1b8f3ed966b9] Start spawning the instance on the hypervisor. {{(pid=74613) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 29 17:51:26 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-31c66816-a579-4fed-917c-5fe116aeddf6 tempest-DeleteServersTestJSON-112443106 tempest-DeleteServersTestJSON-112443106-project-member] [instance: f3a5f6d2-cadd-485b-a443-1b8f3ed966b9] Creating instance directory {{(pid=74613) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 29 17:51:26 user nova-compute[74613]: INFO nova.virt.libvirt.driver [None req-31c66816-a579-4fed-917c-5fe116aeddf6 tempest-DeleteServersTestJSON-112443106 tempest-DeleteServersTestJSON-112443106-project-member] [instance: f3a5f6d2-cadd-485b-a443-1b8f3ed966b9] Creating image(s)
Nov 29 17:51:26 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-31c66816-a579-4fed-917c-5fe116aeddf6 tempest-DeleteServersTestJSON-112443106 tempest-DeleteServersTestJSON-112443106-project-member] Acquiring lock "/opt/stack/data/nova/instances/f3a5f6d2-cadd-485b-a443-1b8f3ed966b9/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 17:51:26 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-31c66816-a579-4fed-917c-5fe116aeddf6 tempest-DeleteServersTestJSON-112443106 tempest-DeleteServersTestJSON-112443106-project-member] Lock "/opt/stack/data/nova/instances/f3a5f6d2-cadd-485b-a443-1b8f3ed966b9/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 17:51:26 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-31c66816-a579-4fed-917c-5fe116aeddf6 tempest-DeleteServersTestJSON-112443106 tempest-DeleteServersTestJSON-112443106-project-member] Lock "/opt/stack/data/nova/instances/f3a5f6d2-cadd-485b-a443-1b8f3ed966b9/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 17:51:26 user nova-compute[74613]: DEBUG nova.compute.provider_tree [None req-3a7ec63d-1bdf-4849-9e6b-4f290ee89c4c tempest-AttachVolumeShelveTestJSON-1452861425 tempest-AttachVolumeShelveTestJSON-1452861425-project-member] Inventory has not changed in ProviderTree for provider: 639d980e-3b12-44b1-b8f4-1812416fa4dd {{(pid=74613) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 17:51:26 user nova-compute[74613]: DEBUG nova.scheduler.client.report [None req-3a7ec63d-1bdf-4849-9e6b-4f290ee89c4c tempest-AttachVolumeShelveTestJSON-1452861425 tempest-AttachVolumeShelveTestJSON-1452861425-project-member] Inventory has not changed for provider 639d980e-3b12-44b1-b8f4-1812416fa4dd based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74613) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 17:51:26 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-3a7ec63d-1bdf-4849-9e6b-4f290ee89c4c tempest-AttachVolumeShelveTestJSON-1452861425 tempest-AttachVolumeShelveTestJSON-1452861425-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.499s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 17:51:26 user nova-compute[74613]: DEBUG nova.compute.manager [None req-3a7ec63d-1bdf-4849-9e6b-4f290ee89c4c tempest-AttachVolumeShelveTestJSON-1452861425 tempest-AttachVolumeShelveTestJSON-1452861425-project-member] [instance: c19e230e-2e6c-4c20-b15c-ad81a73674b4] Start building networks asynchronously for instance. {{(pid=74613) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 29 17:51:26 user nova-compute[74613]: DEBUG nova.compute.manager [None req-3a7ec63d-1bdf-4849-9e6b-4f290ee89c4c tempest-AttachVolumeShelveTestJSON-1452861425 tempest-AttachVolumeShelveTestJSON-1452861425-project-member] [instance: c19e230e-2e6c-4c20-b15c-ad81a73674b4] Allocating IP information in the background. {{(pid=74613) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 29 17:51:26 user nova-compute[74613]: DEBUG nova.network.neutron [None req-3a7ec63d-1bdf-4849-9e6b-4f290ee89c4c tempest-AttachVolumeShelveTestJSON-1452861425 tempest-AttachVolumeShelveTestJSON-1452861425-project-member] [instance: c19e230e-2e6c-4c20-b15c-ad81a73674b4] allocate_for_instance() {{(pid=74613) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 29 17:51:26 user nova-compute[74613]: INFO nova.virt.libvirt.driver [None req-3a7ec63d-1bdf-4849-9e6b-4f290ee89c4c tempest-AttachVolumeShelveTestJSON-1452861425 tempest-AttachVolumeShelveTestJSON-1452861425-project-member] [instance: c19e230e-2e6c-4c20-b15c-ad81a73674b4] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 29 17:51:26 user nova-compute[74613]: DEBUG nova.compute.manager [None req-3a7ec63d-1bdf-4849-9e6b-4f290ee89c4c tempest-AttachVolumeShelveTestJSON-1452861425 tempest-AttachVolumeShelveTestJSON-1452861425-project-member] [instance: c19e230e-2e6c-4c20-b15c-ad81a73674b4] Start building block device mappings for instance. {{(pid=74613) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 29 17:51:26 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-c110aa5d-1515-4b7e-988f-f60fba232273 tempest-ServerActionsTestOtherA-1784608629 tempest-ServerActionsTestOtherA-1784608629-project-member] Acquiring lock "abc9e2b8-f467-4cd0-b40f-de511fde1ec1" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 17:51:26 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-c110aa5d-1515-4b7e-988f-f60fba232273 tempest-ServerActionsTestOtherA-1784608629 tempest-ServerActionsTestOtherA-1784608629-project-member] Lock "abc9e2b8-f467-4cd0-b40f-de511fde1ec1" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 17:51:26 user nova-compute[74613]: DEBUG nova.compute.manager [None req-c110aa5d-1515-4b7e-988f-f60fba232273 tempest-ServerActionsTestOtherA-1784608629 tempest-ServerActionsTestOtherA-1784608629-project-member] [instance: abc9e2b8-f467-4cd0-b40f-de511fde1ec1] Starting instance... {{(pid=74613) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 29 17:51:26 user nova-compute[74613]: DEBUG nova.compute.manager [None req-3a7ec63d-1bdf-4849-9e6b-4f290ee89c4c tempest-AttachVolumeShelveTestJSON-1452861425 tempest-AttachVolumeShelveTestJSON-1452861425-project-member] [instance: c19e230e-2e6c-4c20-b15c-ad81a73674b4] Start spawning the instance on the hypervisor. {{(pid=74613) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 29 17:51:26 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-3a7ec63d-1bdf-4849-9e6b-4f290ee89c4c tempest-AttachVolumeShelveTestJSON-1452861425 tempest-AttachVolumeShelveTestJSON-1452861425-project-member] [instance: c19e230e-2e6c-4c20-b15c-ad81a73674b4] Creating instance directory {{(pid=74613) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 29 17:51:26 user nova-compute[74613]: INFO nova.virt.libvirt.driver [None req-3a7ec63d-1bdf-4849-9e6b-4f290ee89c4c tempest-AttachVolumeShelveTestJSON-1452861425 tempest-AttachVolumeShelveTestJSON-1452861425-project-member] [instance: c19e230e-2e6c-4c20-b15c-ad81a73674b4] Creating image(s)
Nov 29 17:51:26 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-3a7ec63d-1bdf-4849-9e6b-4f290ee89c4c tempest-AttachVolumeShelveTestJSON-1452861425 tempest-AttachVolumeShelveTestJSON-1452861425-project-member] Acquiring lock "/opt/stack/data/nova/instances/c19e230e-2e6c-4c20-b15c-ad81a73674b4/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 17:51:26 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-3a7ec63d-1bdf-4849-9e6b-4f290ee89c4c tempest-AttachVolumeShelveTestJSON-1452861425 tempest-AttachVolumeShelveTestJSON-1452861425-project-member] Lock "/opt/stack/data/nova/instances/c19e230e-2e6c-4c20-b15c-ad81a73674b4/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 17:51:26 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-3a7ec63d-1bdf-4849-9e6b-4f290ee89c4c tempest-AttachVolumeShelveTestJSON-1452861425 tempest-AttachVolumeShelveTestJSON-1452861425-project-member] Lock "/opt/stack/data/nova/instances/c19e230e-2e6c-4c20-b15c-ad81a73674b4/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 17:51:26 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-c110aa5d-1515-4b7e-988f-f60fba232273 tempest-ServerActionsTestOtherA-1784608629 tempest-ServerActionsTestOtherA-1784608629-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 17:51:26 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-c110aa5d-1515-4b7e-988f-f60fba232273 tempest-ServerActionsTestOtherA-1784608629 tempest-ServerActionsTestOtherA-1784608629-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 17:51:26 user nova-compute[74613]: DEBUG nova.virt.hardware [None req-c110aa5d-1515-4b7e-988f-f60fba232273 tempest-ServerActionsTestOtherA-1784608629 tempest-ServerActionsTestOtherA-1784608629-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74613) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 29 17:51:26 user nova-compute[74613]: INFO nova.compute.claims [None req-c110aa5d-1515-4b7e-988f-f60fba232273 tempest-ServerActionsTestOtherA-1784608629 tempest-ServerActionsTestOtherA-1784608629-project-member] [instance: abc9e2b8-f467-4cd0-b40f-de511fde1ec1] Claim successful on node user
Nov 29 17:51:26 user nova-compute[74613]: DEBUG nova.policy [None req-3a7ec63d-1bdf-4849-9e6b-4f290ee89c4c tempest-AttachVolumeShelveTestJSON-1452861425 tempest-AttachVolumeShelveTestJSON-1452861425-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '45192488dde84ebfbcacfdbd4f898799', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c0c1c71400549369c1b11ca7d5f43ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74613) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 29 17:51:26 user nova-compute[74613]: DEBUG nova.compute.provider_tree [None req-c110aa5d-1515-4b7e-988f-f60fba232273 tempest-ServerActionsTestOtherA-1784608629 tempest-ServerActionsTestOtherA-1784608629-project-member] Inventory has not changed in ProviderTree for provider: 639d980e-3b12-44b1-b8f4-1812416fa4dd {{(pid=74613) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 17:51:26 user nova-compute[74613]: DEBUG nova.scheduler.client.report [None req-c110aa5d-1515-4b7e-988f-f60fba232273 tempest-ServerActionsTestOtherA-1784608629 tempest-ServerActionsTestOtherA-1784608629-project-member] Inventory has not changed for provider 639d980e-3b12-44b1-b8f4-1812416fa4dd based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74613) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 17:51:26 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-c110aa5d-1515-4b7e-988f-f60fba232273 tempest-ServerActionsTestOtherA-1784608629 tempest-ServerActionsTestOtherA-1784608629-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.359s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 17:51:26 user nova-compute[74613]: DEBUG nova.compute.manager [None req-c110aa5d-1515-4b7e-988f-f60fba232273 tempest-ServerActionsTestOtherA-1784608629 tempest-ServerActionsTestOtherA-1784608629-project-member] [instance: abc9e2b8-f467-4cd0-b40f-de511fde1ec1] Start building networks asynchronously for instance. {{(pid=74613) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 29 17:51:26 user nova-compute[74613]: DEBUG nova.network.neutron [None req-c95f4e22-f5b1-4f6e-80dc-83a2ee62815f tempest-ServerStableDeviceRescueTest-1416322546 tempest-ServerStableDeviceRescueTest-1416322546-project-member] [instance: b6b0ba36-ad89-45f1-9578-8b999567dd25] Successfully created port: 0167e253-42dd-486a-8231-a8b8199f3584 {{(pid=74613) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 29 17:51:26 user sudo[83901]: pam_unix(sudo:session): session closed for user root
Nov 29 17:51:26 user nova-compute[74613]: INFO oslo.privsep.daemon [None req-c95f4e22-f5b1-4f6e-80dc-83a2ee62815f tempest-ServerStableDeviceRescueTest-1416322546 tempest-ServerStableDeviceRescueTest-1416322546-project-member] Spawned new privsep daemon via rootwrap
Nov 29 17:51:26 user nova-compute[74613]: INFO oslo.privsep.daemon [-] privsep daemon starting
Nov 29 17:51:26 user nova-compute[74613]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0
Nov 29 17:51:26 user nova-compute[74613]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/none
Nov 29 17:51:26 user nova-compute[74613]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 83912
Nov 29 17:51:26 user nova-compute[74613]: WARNING oslo_privsep.priv_context [None req-d108c1ab-fa43-4e97-b056-065e3528f377 tempest-ServerBootFromVolumeStableRescueTest-414665510 tempest-ServerBootFromVolumeStableRescueTest-414665510-project-member] privsep daemon already running
Nov 29 17:51:26 user nova-compute[74613]: WARNING oslo_privsep.priv_context [None req-31c66816-a579-4fed-917c-5fe116aeddf6 tempest-DeleteServersTestJSON-112443106 tempest-DeleteServersTestJSON-112443106-project-member] privsep daemon already running
Nov 29 17:51:26 user nova-compute[74613]: WARNING oslo_privsep.priv_context [None req-3a7ec63d-1bdf-4849-9e6b-4f290ee89c4c tempest-AttachVolumeShelveTestJSON-1452861425 tempest-AttachVolumeShelveTestJSON-1452861425-project-member] privsep daemon already running
Nov 29 17:51:26 user nova-compute[74613]: DEBUG nova.compute.manager [None req-c110aa5d-1515-4b7e-988f-f60fba232273 tempest-ServerActionsTestOtherA-1784608629 tempest-ServerActionsTestOtherA-1784608629-project-member] [instance: abc9e2b8-f467-4cd0-b40f-de511fde1ec1] Allocating IP information in the background. {{(pid=74613) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 29 17:51:26 user nova-compute[74613]: DEBUG nova.network.neutron [None req-c110aa5d-1515-4b7e-988f-f60fba232273 tempest-ServerActionsTestOtherA-1784608629 tempest-ServerActionsTestOtherA-1784608629-project-member] [instance: abc9e2b8-f467-4cd0-b40f-de511fde1ec1] allocate_for_instance() {{(pid=74613) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 29 17:51:27 user nova-compute[74613]: INFO nova.virt.libvirt.driver [None req-c110aa5d-1515-4b7e-988f-f60fba232273 tempest-ServerActionsTestOtherA-1784608629 tempest-ServerActionsTestOtherA-1784608629-project-member] [instance: abc9e2b8-f467-4cd0-b40f-de511fde1ec1] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 29 17:51:27 user nova-compute[74613]: DEBUG nova.compute.manager [None req-c110aa5d-1515-4b7e-988f-f60fba232273 tempest-ServerActionsTestOtherA-1784608629 tempest-ServerActionsTestOtherA-1784608629-project-member] [instance: abc9e2b8-f467-4cd0-b40f-de511fde1ec1] Start building block device mappings for instance. {{(pid=74613) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 29 17:51:27 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-c95f4e22-f5b1-4f6e-80dc-83a2ee62815f tempest-ServerStableDeviceRescueTest-1416322546 tempest-ServerStableDeviceRescueTest-1416322546-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/21faea9e6951f3bdd0153b76ac89fe1a60a34758 --force-share --output=json {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 17:51:27 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-31c66816-a579-4fed-917c-5fe116aeddf6 tempest-DeleteServersTestJSON-112443106 tempest-DeleteServersTestJSON-112443106-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/21faea9e6951f3bdd0153b76ac89fe1a60a34758 --force-share --output=json {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 17:51:27 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-d108c1ab-fa43-4e97-b056-065e3528f377 tempest-ServerBootFromVolumeStableRescueTest-414665510 tempest-ServerBootFromVolumeStableRescueTest-414665510-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/21faea9e6951f3bdd0153b76ac89fe1a60a34758 --force-share --output=json {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 17:51:27 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-3a7ec63d-1bdf-4849-9e6b-4f290ee89c4c tempest-AttachVolumeShelveTestJSON-1452861425 tempest-AttachVolumeShelveTestJSON-1452861425-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/21faea9e6951f3bdd0153b76ac89fe1a60a34758 --force-share --output=json {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 17:51:27 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-c95f4e22-f5b1-4f6e-80dc-83a2ee62815f tempest-ServerStableDeviceRescueTest-1416322546 tempest-ServerStableDeviceRescueTest-1416322546-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/21faea9e6951f3bdd0153b76ac89fe1a60a34758 --force-share --output=json" returned: 0 in 0.176s {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 17:51:27 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-c95f4e22-f5b1-4f6e-80dc-83a2ee62815f tempest-ServerStableDeviceRescueTest-1416322546 tempest-ServerStableDeviceRescueTest-1416322546-project-member] Acquiring lock "21faea9e6951f3bdd0153b76ac89fe1a60a34758" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 17:51:27 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-c95f4e22-f5b1-4f6e-80dc-83a2ee62815f tempest-ServerStableDeviceRescueTest-1416322546 tempest-ServerStableDeviceRescueTest-1416322546-project-member] Lock "21faea9e6951f3bdd0153b76ac89fe1a60a34758" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 17:51:27 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-c95f4e22-f5b1-4f6e-80dc-83a2ee62815f tempest-ServerStableDeviceRescueTest-1416322546 tempest-ServerStableDeviceRescueTest-1416322546-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/21faea9e6951f3bdd0153b76ac89fe1a60a34758 --force-share --output=json {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 17:51:27 user nova-compute[74613]: DEBUG nova.policy [None req-c110aa5d-1515-4b7e-988f-f60fba232273 tempest-ServerActionsTestOtherA-1784608629 tempest-ServerActionsTestOtherA-1784608629-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '368555c72103480b82c5c0bf64b07360', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1f70c311d4941c986de21ac458d11ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74613) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 29 17:51:27 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-31c66816-a579-4fed-917c-5fe116aeddf6 tempest-DeleteServersTestJSON-112443106 tempest-DeleteServersTestJSON-112443106-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/21faea9e6951f3bdd0153b76ac89fe1a60a34758 --force-share --output=json" returned: 0 in 0.187s {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 17:51:27 user nova-compute[74613]: DEBUG nova.compute.manager [None req-c110aa5d-1515-4b7e-988f-f60fba232273 tempest-ServerActionsTestOtherA-1784608629 tempest-ServerActionsTestOtherA-1784608629-project-member] [instance: abc9e2b8-f467-4cd0-b40f-de511fde1ec1] Start spawning the instance on the hypervisor. {{(pid=74613) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 29 17:51:27 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-c110aa5d-1515-4b7e-988f-f60fba232273 tempest-ServerActionsTestOtherA-1784608629 tempest-ServerActionsTestOtherA-1784608629-project-member] [instance: abc9e2b8-f467-4cd0-b40f-de511fde1ec1] Creating instance directory {{(pid=74613) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 29 17:51:27 user nova-compute[74613]: INFO nova.virt.libvirt.driver [None req-c110aa5d-1515-4b7e-988f-f60fba232273 tempest-ServerActionsTestOtherA-1784608629 tempest-ServerActionsTestOtherA-1784608629-project-member] [instance: abc9e2b8-f467-4cd0-b40f-de511fde1ec1] Creating image(s)
Nov 29 17:51:27 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-c110aa5d-1515-4b7e-988f-f60fba232273 tempest-ServerActionsTestOtherA-1784608629 tempest-ServerActionsTestOtherA-1784608629-project-member] Acquiring lock "/opt/stack/data/nova/instances/abc9e2b8-f467-4cd0-b40f-de511fde1ec1/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 17:51:27 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-c110aa5d-1515-4b7e-988f-f60fba232273 tempest-ServerActionsTestOtherA-1784608629 tempest-ServerActionsTestOtherA-1784608629-project-member] Lock "/opt/stack/data/nova/instances/abc9e2b8-f467-4cd0-b40f-de511fde1ec1/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 17:51:27 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-c110aa5d-1515-4b7e-988f-f60fba232273 tempest-ServerActionsTestOtherA-1784608629 tempest-ServerActionsTestOtherA-1784608629-project-member] Lock "/opt/stack/data/nova/instances/abc9e2b8-f467-4cd0-b40f-de511fde1ec1/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 17:51:27 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-31c66816-a579-4fed-917c-5fe116aeddf6 tempest-DeleteServersTestJSON-112443106 tempest-DeleteServersTestJSON-112443106-project-member] Acquiring lock "21faea9e6951f3bdd0153b76ac89fe1a60a34758" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 17:51:27 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-d108c1ab-fa43-4e97-b056-065e3528f377 tempest-ServerBootFromVolumeStableRescueTest-414665510 tempest-ServerBootFromVolumeStableRescueTest-414665510-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/21faea9e6951f3bdd0153b76ac89fe1a60a34758 --force-share --output=json" returned: 0 in 0.171s {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 17:51:27 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-d108c1ab-fa43-4e97-b056-065e3528f377 tempest-ServerBootFromVolumeStableRescueTest-414665510 tempest-ServerBootFromVolumeStableRescueTest-414665510-project-member] Acquiring lock "21faea9e6951f3bdd0153b76ac89fe1a60a34758" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 17:51:27 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-c110aa5d-1515-4b7e-988f-f60fba232273 tempest-ServerActionsTestOtherA-1784608629 tempest-ServerActionsTestOtherA-1784608629-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/21faea9e6951f3bdd0153b76ac89fe1a60a34758 --force-share --output=json {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 17:51:27 user nova-compute[74613]: DEBUG nova.network.neutron [None req-d108c1ab-fa43-4e97-b056-065e3528f377 tempest-ServerBootFromVolumeStableRescueTest-414665510 tempest-ServerBootFromVolumeStableRescueTest-414665510-project-member] [instance: 3b828860-5cc5-40b0-b845-8e560211794e] Successfully created port: dfe097e1-192f-47e2-96b7-0e9fe8320758 {{(pid=74613) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 29 17:51:27 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-3a7ec63d-1bdf-4849-9e6b-4f290ee89c4c tempest-AttachVolumeShelveTestJSON-1452861425 tempest-AttachVolumeShelveTestJSON-1452861425-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/21faea9e6951f3bdd0153b76ac89fe1a60a34758 --force-share --output=json" returned: 0 in 0.199s {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 17:51:27 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-3a7ec63d-1bdf-4849-9e6b-4f290ee89c4c tempest-AttachVolumeShelveTestJSON-1452861425 tempest-AttachVolumeShelveTestJSON-1452861425-project-member] Acquiring lock "21faea9e6951f3bdd0153b76ac89fe1a60a34758" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 17:51:27 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-c95f4e22-f5b1-4f6e-80dc-83a2ee62815f tempest-ServerStableDeviceRescueTest-1416322546 tempest-ServerStableDeviceRescueTest-1416322546-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/21faea9e6951f3bdd0153b76ac89fe1a60a34758 --force-share --output=json" returned: 0 in 0.188s {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 17:51:27 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-c95f4e22-f5b1-4f6e-80dc-83a2ee62815f tempest-ServerStableDeviceRescueTest-1416322546 tempest-ServerStableDeviceRescueTest-1416322546-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/21faea9e6951f3bdd0153b76ac89fe1a60a34758,backing_fmt=raw /opt/stack/data/nova/instances/b6b0ba36-ad89-45f1-9578-8b999567dd25/disk 1073741824 {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 17:51:27 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-c110aa5d-1515-4b7e-988f-f60fba232273 tempest-ServerActionsTestOtherA-1784608629 tempest-ServerActionsTestOtherA-1784608629-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/21faea9e6951f3bdd0153b76ac89fe1a60a34758 --force-share --output=json" returned: 0 in 0.180s {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 17:51:27 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-c110aa5d-1515-4b7e-988f-f60fba232273 tempest-ServerActionsTestOtherA-1784608629 tempest-ServerActionsTestOtherA-1784608629-project-member] Acquiring lock "21faea9e6951f3bdd0153b76ac89fe1a60a34758" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 17:51:27 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-c95f4e22-f5b1-4f6e-80dc-83a2ee62815f tempest-ServerStableDeviceRescueTest-1416322546 tempest-ServerStableDeviceRescueTest-1416322546-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/21faea9e6951f3bdd0153b76ac89fe1a60a34758,backing_fmt=raw /opt/stack/data/nova/instances/b6b0ba36-ad89-45f1-9578-8b999567dd25/disk 1073741824" returned: 0 in 0.045s {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 17:51:27 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-c95f4e22-f5b1-4f6e-80dc-83a2ee62815f tempest-ServerStableDeviceRescueTest-1416322546 tempest-ServerStableDeviceRescueTest-1416322546-project-member] Lock "21faea9e6951f3bdd0153b76ac89fe1a60a34758" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.236s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 17:51:27 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-c95f4e22-f5b1-4f6e-80dc-83a2ee62815f tempest-ServerStableDeviceRescueTest-1416322546 tempest-ServerStableDeviceRescueTest-1416322546-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/21faea9e6951f3bdd0153b76ac89fe1a60a34758 --force-share --output=json {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 17:51:27 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-31c66816-a579-4fed-917c-5fe116aeddf6 tempest-DeleteServersTestJSON-112443106 tempest-DeleteServersTestJSON-112443106-project-member] Lock "21faea9e6951f3bdd0153b76ac89fe1a60a34758" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.223s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 17:51:27 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-31c66816-a579-4fed-917c-5fe116aeddf6 tempest-DeleteServersTestJSON-112443106 tempest-DeleteServersTestJSON-112443106-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/21faea9e6951f3bdd0153b76ac89fe1a60a34758 --force-share --output=json {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 17:51:27 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-c95f4e22-f5b1-4f6e-80dc-83a2ee62815f tempest-ServerStableDeviceRescueTest-1416322546 tempest-ServerStableDeviceRescueTest-1416322546-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/21faea9e6951f3bdd0153b76ac89fe1a60a34758 --force-share --output=json" returned: 0 in 0.196s {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 17:51:27 user nova-compute[74613]: DEBUG nova.virt.disk.api [None req-c95f4e22-f5b1-4f6e-80dc-83a2ee62815f tempest-ServerStableDeviceRescueTest-1416322546 tempest-ServerStableDeviceRescueTest-1416322546-project-member] Checking if we can resize image /opt/stack/data/nova/instances/b6b0ba36-ad89-45f1-9578-8b999567dd25/disk. size=1073741824 {{(pid=74613) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 29 17:51:27 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-c95f4e22-f5b1-4f6e-80dc-83a2ee62815f tempest-ServerStableDeviceRescueTest-1416322546 tempest-ServerStableDeviceRescueTest-1416322546-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b6b0ba36-ad89-45f1-9578-8b999567dd25/disk --force-share --output=json {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 17:51:27 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-31c66816-a579-4fed-917c-5fe116aeddf6 tempest-DeleteServersTestJSON-112443106 tempest-DeleteServersTestJSON-112443106-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/21faea9e6951f3bdd0153b76ac89fe1a60a34758 --force-share --output=json" returned: 0 in 0.191s {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 17:51:27 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-31c66816-a579-4fed-917c-5fe116aeddf6 tempest-DeleteServersTestJSON-112443106 tempest-DeleteServersTestJSON-112443106-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/21faea9e6951f3bdd0153b76ac89fe1a60a34758,backing_fmt=raw /opt/stack/data/nova/instances/f3a5f6d2-cadd-485b-a443-1b8f3ed966b9/disk 1073741824 {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 17:51:27 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-31c66816-a579-4fed-917c-5fe116aeddf6 tempest-DeleteServersTestJSON-112443106 tempest-DeleteServersTestJSON-112443106-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/21faea9e6951f3bdd0153b76ac89fe1a60a34758,backing_fmt=raw /opt/stack/data/nova/instances/f3a5f6d2-cadd-485b-a443-1b8f3ed966b9/disk 1073741824" returned: 0 in 0.038s {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 17:51:27 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-31c66816-a579-4fed-917c-5fe116aeddf6 tempest-DeleteServersTestJSON-112443106 tempest-DeleteServersTestJSON-112443106-project-member] Lock "21faea9e6951f3bdd0153b76ac89fe1a60a34758" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.235s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 17:51:27 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-31c66816-a579-4fed-917c-5fe116aeddf6 tempest-DeleteServersTestJSON-112443106 tempest-DeleteServersTestJSON-112443106-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/21faea9e6951f3bdd0153b76ac89fe1a60a34758 --force-share --output=json {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 17:51:27 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-d108c1ab-fa43-4e97-b056-065e3528f377 tempest-ServerBootFromVolumeStableRescueTest-414665510 tempest-ServerBootFromVolumeStableRescueTest-414665510-project-member] Lock "21faea9e6951f3bdd0153b76ac89fe1a60a34758" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.488s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 17:51:27 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-d108c1ab-fa43-4e97-b056-065e3528f377 tempest-ServerBootFromVolumeStableRescueTest-414665510 tempest-ServerBootFromVolumeStableRescueTest-414665510-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/21faea9e6951f3bdd0153b76ac89fe1a60a34758 --force-share --output=json {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 17:51:27 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-c95f4e22-f5b1-4f6e-80dc-83a2ee62815f tempest-ServerStableDeviceRescueTest-1416322546 tempest-ServerStableDeviceRescueTest-1416322546-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b6b0ba36-ad89-45f1-9578-8b999567dd25/disk --force-share --output=json" returned: 0 in 0.227s {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 17:51:27 user nova-compute[74613]: DEBUG nova.virt.disk.api [None req-c95f4e22-f5b1-4f6e-80dc-83a2ee62815f tempest-ServerStableDeviceRescueTest-1416322546 tempest-ServerStableDeviceRescueTest-1416322546-project-member] Cannot resize image /opt/stack/data/nova/instances/b6b0ba36-ad89-45f1-9578-8b999567dd25/disk to a smaller size. {{(pid=74613) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 29 17:51:27 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-c95f4e22-f5b1-4f6e-80dc-83a2ee62815f tempest-ServerStableDeviceRescueTest-1416322546 tempest-ServerStableDeviceRescueTest-1416322546-project-member] [instance: b6b0ba36-ad89-45f1-9578-8b999567dd25] Created local disks {{(pid=74613) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 29 17:51:27 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-c95f4e22-f5b1-4f6e-80dc-83a2ee62815f tempest-ServerStableDeviceRescueTest-1416322546 tempest-ServerStableDeviceRescueTest-1416322546-project-member] [instance: b6b0ba36-ad89-45f1-9578-8b999567dd25] Ensure instance console log exists: /opt/stack/data/nova/instances/b6b0ba36-ad89-45f1-9578-8b999567dd25/console.log {{(pid=74613) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 29 17:51:27 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-c95f4e22-f5b1-4f6e-80dc-83a2ee62815f tempest-ServerStableDeviceRescueTest-1416322546 tempest-ServerStableDeviceRescueTest-1416322546-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 17:51:27 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-c95f4e22-f5b1-4f6e-80dc-83a2ee62815f tempest-ServerStableDeviceRescueTest-1416322546 tempest-ServerStableDeviceRescueTest-1416322546-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 17:51:27 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-c95f4e22-f5b1-4f6e-80dc-83a2ee62815f tempest-ServerStableDeviceRescueTest-1416322546 tempest-ServerStableDeviceRescueTest-1416322546-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 17:51:27 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-31c66816-a579-4fed-917c-5fe116aeddf6 tempest-DeleteServersTestJSON-112443106 tempest-DeleteServersTestJSON-112443106-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/21faea9e6951f3bdd0153b76ac89fe1a60a34758 --force-share --output=json" returned: 0 in 0.166s {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 17:51:27 user nova-compute[74613]: DEBUG nova.virt.disk.api [None req-31c66816-a579-4fed-917c-5fe116aeddf6 tempest-DeleteServersTestJSON-112443106 tempest-DeleteServersTestJSON-112443106-project-member] Checking if we can resize image /opt/stack/data/nova/instances/f3a5f6d2-cadd-485b-a443-1b8f3ed966b9/disk. size=1073741824 {{(pid=74613) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 29 17:51:27 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-31c66816-a579-4fed-917c-5fe116aeddf6 tempest-DeleteServersTestJSON-112443106 tempest-DeleteServersTestJSON-112443106-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f3a5f6d2-cadd-485b-a443-1b8f3ed966b9/disk --force-share --output=json {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 17:51:28 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-d108c1ab-fa43-4e97-b056-065e3528f377 tempest-ServerBootFromVolumeStableRescueTest-414665510 tempest-ServerBootFromVolumeStableRescueTest-414665510-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/21faea9e6951f3bdd0153b76ac89fe1a60a34758 --force-share --output=json" returned: 0 in 0.184s {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 17:51:28 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-d108c1ab-fa43-4e97-b056-065e3528f377 tempest-ServerBootFromVolumeStableRescueTest-414665510 tempest-ServerBootFromVolumeStableRescueTest-414665510-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/21faea9e6951f3bdd0153b76ac89fe1a60a34758,backing_fmt=raw /opt/stack/data/nova/instances/3b828860-5cc5-40b0-b845-8e560211794e/disk 1073741824 {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 17:51:28 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-d108c1ab-fa43-4e97-b056-065e3528f377 tempest-ServerBootFromVolumeStableRescueTest-414665510 tempest-ServerBootFromVolumeStableRescueTest-414665510-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/21faea9e6951f3bdd0153b76ac89fe1a60a34758,backing_fmt=raw /opt/stack/data/nova/instances/3b828860-5cc5-40b0-b845-8e560211794e/disk 1073741824" returned: 0 in 0.050s {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 17:51:28 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-d108c1ab-fa43-4e97-b056-065e3528f377 tempest-ServerBootFromVolumeStableRescueTest-414665510 tempest-ServerBootFromVolumeStableRescueTest-414665510-project-member] Lock "21faea9e6951f3bdd0153b76ac89fe1a60a34758" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.242s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 17:51:28 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-d108c1ab-fa43-4e97-b056-065e3528f377 tempest-ServerBootFromVolumeStableRescueTest-414665510 tempest-ServerBootFromVolumeStableRescueTest-414665510-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/21faea9e6951f3bdd0153b76ac89fe1a60a34758 --force-share --output=json {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 17:51:28 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-3a7ec63d-1bdf-4849-9e6b-4f290ee89c4c tempest-AttachVolumeShelveTestJSON-1452861425 tempest-AttachVolumeShelveTestJSON-1452861425-project-member] Lock "21faea9e6951f3bdd0153b76ac89fe1a60a34758" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.710s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 17:51:28 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-3a7ec63d-1bdf-4849-9e6b-4f290ee89c4c tempest-AttachVolumeShelveTestJSON-1452861425 tempest-AttachVolumeShelveTestJSON-1452861425-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/21faea9e6951f3bdd0153b76ac89fe1a60a34758 --force-share --output=json {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 17:51:28 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-31c66816-a579-4fed-917c-5fe116aeddf6 tempest-DeleteServersTestJSON-112443106 tempest-DeleteServersTestJSON-112443106-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f3a5f6d2-cadd-485b-a443-1b8f3ed966b9/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 17:51:28 user nova-compute[74613]: DEBUG nova.virt.disk.api [None req-31c66816-a579-4fed-917c-5fe116aeddf6 tempest-DeleteServersTestJSON-112443106 tempest-DeleteServersTestJSON-112443106-project-member] Cannot resize image /opt/stack/data/nova/instances/f3a5f6d2-cadd-485b-a443-1b8f3ed966b9/disk to a smaller size. {{(pid=74613) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 29 17:51:28 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-31c66816-a579-4fed-917c-5fe116aeddf6 tempest-DeleteServersTestJSON-112443106 tempest-DeleteServersTestJSON-112443106-project-member] [instance: f3a5f6d2-cadd-485b-a443-1b8f3ed966b9] Created local disks {{(pid=74613) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 29 17:51:28 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-31c66816-a579-4fed-917c-5fe116aeddf6 tempest-DeleteServersTestJSON-112443106 tempest-DeleteServersTestJSON-112443106-project-member] [instance: f3a5f6d2-cadd-485b-a443-1b8f3ed966b9] Ensure instance console log exists: /opt/stack/data/nova/instances/f3a5f6d2-cadd-485b-a443-1b8f3ed966b9/console.log {{(pid=74613) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 29 17:51:28 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-31c66816-a579-4fed-917c-5fe116aeddf6 tempest-DeleteServersTestJSON-112443106 tempest-DeleteServersTestJSON-112443106-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 17:51:28 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-31c66816-a579-4fed-917c-5fe116aeddf6 tempest-DeleteServersTestJSON-112443106 tempest-DeleteServersTestJSON-112443106-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 17:51:28 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-31c66816-a579-4fed-917c-5fe116aeddf6 tempest-DeleteServersTestJSON-112443106 tempest-DeleteServersTestJSON-112443106-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 17:51:28 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-d108c1ab-fa43-4e97-b056-065e3528f377 tempest-ServerBootFromVolumeStableRescueTest-414665510 tempest-ServerBootFromVolumeStableRescueTest-414665510-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/21faea9e6951f3bdd0153b76ac89fe1a60a34758 --force-share --output=json" returned: 0 in 0.205s {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 17:51:28 user nova-compute[74613]: DEBUG nova.virt.disk.api [None req-d108c1ab-fa43-4e97-b056-065e3528f377 tempest-ServerBootFromVolumeStableRescueTest-414665510 tempest-ServerBootFromVolumeStableRescueTest-414665510-project-member] Checking if we can resize image /opt/stack/data/nova/instances/3b828860-5cc5-40b0-b845-8e560211794e/disk. size=1073741824 {{(pid=74613) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 29 17:51:28 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-d108c1ab-fa43-4e97-b056-065e3528f377 tempest-ServerBootFromVolumeStableRescueTest-414665510 tempest-ServerBootFromVolumeStableRescueTest-414665510-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3b828860-5cc5-40b0-b845-8e560211794e/disk --force-share --output=json {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 17:51:28 user nova-compute[74613]: DEBUG nova.network.neutron [None req-31c66816-a579-4fed-917c-5fe116aeddf6 tempest-DeleteServersTestJSON-112443106 tempest-DeleteServersTestJSON-112443106-project-member] [instance: f3a5f6d2-cadd-485b-a443-1b8f3ed966b9] Successfully created port: 49e80b78-004f-457d-aea8-8940ab6d9179 {{(pid=74613) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 29 17:51:28 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-3a7ec63d-1bdf-4849-9e6b-4f290ee89c4c tempest-AttachVolumeShelveTestJSON-1452861425 tempest-AttachVolumeShelveTestJSON-1452861425-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/21faea9e6951f3bdd0153b76ac89fe1a60a34758 --force-share --output=json" returned: 0 in 0.218s {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 17:51:28 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-3a7ec63d-1bdf-4849-9e6b-4f290ee89c4c tempest-AttachVolumeShelveTestJSON-1452861425 tempest-AttachVolumeShelveTestJSON-1452861425-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/21faea9e6951f3bdd0153b76ac89fe1a60a34758,backing_fmt=raw /opt/stack/data/nova/instances/c19e230e-2e6c-4c20-b15c-ad81a73674b4/disk 1073741824 {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 17:51:28 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-3a7ec63d-1bdf-4849-9e6b-4f290ee89c4c tempest-AttachVolumeShelveTestJSON-1452861425 tempest-AttachVolumeShelveTestJSON-1452861425-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/21faea9e6951f3bdd0153b76ac89fe1a60a34758,backing_fmt=raw /opt/stack/data/nova/instances/c19e230e-2e6c-4c20-b15c-ad81a73674b4/disk 1073741824" returned: 0 in 0.045s {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 17:51:28 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-3a7ec63d-1bdf-4849-9e6b-4f290ee89c4c tempest-AttachVolumeShelveTestJSON-1452861425 tempest-AttachVolumeShelveTestJSON-1452861425-project-member] Lock "21faea9e6951f3bdd0153b76ac89fe1a60a34758" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.275s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 17:51:28 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-3a7ec63d-1bdf-4849-9e6b-4f290ee89c4c tempest-AttachVolumeShelveTestJSON-1452861425 tempest-AttachVolumeShelveTestJSON-1452861425-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/21faea9e6951f3bdd0153b76ac89fe1a60a34758 --force-share --output=json {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 17:51:28 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-c110aa5d-1515-4b7e-988f-f60fba232273 tempest-ServerActionsTestOtherA-1784608629 tempest-ServerActionsTestOtherA-1784608629-project-member] Lock "21faea9e6951f3bdd0153b76ac89fe1a60a34758" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.889s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 17:51:28 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-c110aa5d-1515-4b7e-988f-f60fba232273 tempest-ServerActionsTestOtherA-1784608629 tempest-ServerActionsTestOtherA-1784608629-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/21faea9e6951f3bdd0153b76ac89fe1a60a34758 --force-share --output=json {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 17:51:28 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-d108c1ab-fa43-4e97-b056-065e3528f377 tempest-ServerBootFromVolumeStableRescueTest-414665510 tempest-ServerBootFromVolumeStableRescueTest-414665510-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3b828860-5cc5-40b0-b845-8e560211794e/disk --force-share --output=json" returned: 0 in 0.165s {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 17:51:28 user nova-compute[74613]: DEBUG nova.virt.disk.api [None req-d108c1ab-fa43-4e97-b056-065e3528f377 tempest-ServerBootFromVolumeStableRescueTest-414665510 tempest-ServerBootFromVolumeStableRescueTest-414665510-project-member] Cannot resize image /opt/stack/data/nova/instances/3b828860-5cc5-40b0-b845-8e560211794e/disk to a smaller size. {{(pid=74613) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 29 17:51:28 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-d108c1ab-fa43-4e97-b056-065e3528f377 tempest-ServerBootFromVolumeStableRescueTest-414665510 tempest-ServerBootFromVolumeStableRescueTest-414665510-project-member] [instance: 3b828860-5cc5-40b0-b845-8e560211794e] Created local disks {{(pid=74613) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 29 17:51:28 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-d108c1ab-fa43-4e97-b056-065e3528f377 tempest-ServerBootFromVolumeStableRescueTest-414665510 tempest-ServerBootFromVolumeStableRescueTest-414665510-project-member] [instance: 3b828860-5cc5-40b0-b845-8e560211794e] Ensure instance console log exists: /opt/stack/data/nova/instances/3b828860-5cc5-40b0-b845-8e560211794e/console.log {{(pid=74613) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 29 17:51:28 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-d108c1ab-fa43-4e97-b056-065e3528f377 tempest-ServerBootFromVolumeStableRescueTest-414665510 tempest-ServerBootFromVolumeStableRescueTest-414665510-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 17:51:28 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-d108c1ab-fa43-4e97-b056-065e3528f377 tempest-ServerBootFromVolumeStableRescueTest-414665510 tempest-ServerBootFromVolumeStableRescueTest-414665510-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.002s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 17:51:28 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-d108c1ab-fa43-4e97-b056-065e3528f377 tempest-ServerBootFromVolumeStableRescueTest-414665510 tempest-ServerBootFromVolumeStableRescueTest-414665510-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 17:51:28 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-3a7ec63d-1bdf-4849-9e6b-4f290ee89c4c tempest-AttachVolumeShelveTestJSON-1452861425 tempest-AttachVolumeShelveTestJSON-1452861425-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/21faea9e6951f3bdd0153b76ac89fe1a60a34758 --force-share --output=json" returned: 0 in 0.187s {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 17:51:28 user nova-compute[74613]: DEBUG nova.virt.disk.api [None req-3a7ec63d-1bdf-4849-9e6b-4f290ee89c4c tempest-AttachVolumeShelveTestJSON-1452861425 tempest-AttachVolumeShelveTestJSON-1452861425-project-member] Checking if we can resize image /opt/stack/data/nova/instances/c19e230e-2e6c-4c20-b15c-ad81a73674b4/disk. size=1073741824 {{(pid=74613) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 29 17:51:28 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-3a7ec63d-1bdf-4849-9e6b-4f290ee89c4c tempest-AttachVolumeShelveTestJSON-1452861425 tempest-AttachVolumeShelveTestJSON-1452861425-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c19e230e-2e6c-4c20-b15c-ad81a73674b4/disk --force-share --output=json {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 17:51:28 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-c110aa5d-1515-4b7e-988f-f60fba232273 tempest-ServerActionsTestOtherA-1784608629 tempest-ServerActionsTestOtherA-1784608629-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/21faea9e6951f3bdd0153b76ac89fe1a60a34758 --force-share --output=json" returned: 0 in 0.183s {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 17:51:28 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-c110aa5d-1515-4b7e-988f-f60fba232273 tempest-ServerActionsTestOtherA-1784608629 tempest-ServerActionsTestOtherA-1784608629-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/21faea9e6951f3bdd0153b76ac89fe1a60a34758,backing_fmt=raw /opt/stack/data/nova/instances/abc9e2b8-f467-4cd0-b40f-de511fde1ec1/disk 1073741824 {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 17:51:28 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-c110aa5d-1515-4b7e-988f-f60fba232273 tempest-ServerActionsTestOtherA-1784608629 tempest-ServerActionsTestOtherA-1784608629-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/21faea9e6951f3bdd0153b76ac89fe1a60a34758,backing_fmt=raw /opt/stack/data/nova/instances/abc9e2b8-f467-4cd0-b40f-de511fde1ec1/disk 1073741824" returned: 0 in 0.039s {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 17:51:28 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-c110aa5d-1515-4b7e-988f-f60fba232273 tempest-ServerActionsTestOtherA-1784608629 tempest-ServerActionsTestOtherA-1784608629-project-member] Lock "21faea9e6951f3bdd0153b76ac89fe1a60a34758" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.231s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 17:51:28 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-c110aa5d-1515-4b7e-988f-f60fba232273 tempest-ServerActionsTestOtherA-1784608629 tempest-ServerActionsTestOtherA-1784608629-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/21faea9e6951f3bdd0153b76ac89fe1a60a34758 --force-share --output=json {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 17:51:28 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-3a7ec63d-1bdf-4849-9e6b-4f290ee89c4c tempest-AttachVolumeShelveTestJSON-1452861425 tempest-AttachVolumeShelveTestJSON-1452861425-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c19e230e-2e6c-4c20-b15c-ad81a73674b4/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 17:51:28 user nova-compute[74613]: DEBUG nova.virt.disk.api [None req-3a7ec63d-1bdf-4849-9e6b-4f290ee89c4c tempest-AttachVolumeShelveTestJSON-1452861425 tempest-AttachVolumeShelveTestJSON-1452861425-project-member] Cannot resize image /opt/stack/data/nova/instances/c19e230e-2e6c-4c20-b15c-ad81a73674b4/disk to a smaller size. {{(pid=74613) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 29 17:51:28 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-3a7ec63d-1bdf-4849-9e6b-4f290ee89c4c tempest-AttachVolumeShelveTestJSON-1452861425 tempest-AttachVolumeShelveTestJSON-1452861425-project-member] [instance: c19e230e-2e6c-4c20-b15c-ad81a73674b4] Created local disks {{(pid=74613) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 29 17:51:28 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-3a7ec63d-1bdf-4849-9e6b-4f290ee89c4c tempest-AttachVolumeShelveTestJSON-1452861425 tempest-AttachVolumeShelveTestJSON-1452861425-project-member] [instance: c19e230e-2e6c-4c20-b15c-ad81a73674b4] Ensure instance console log exists: /opt/stack/data/nova/instances/c19e230e-2e6c-4c20-b15c-ad81a73674b4/console.log {{(pid=74613) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 29 17:51:28 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-3a7ec63d-1bdf-4849-9e6b-4f290ee89c4c tempest-AttachVolumeShelveTestJSON-1452861425 tempest-AttachVolumeShelveTestJSON-1452861425-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 17:51:28 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-3a7ec63d-1bdf-4849-9e6b-4f290ee89c4c tempest-AttachVolumeShelveTestJSON-1452861425 tempest-AttachVolumeShelveTestJSON-1452861425-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 17:51:28 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-3a7ec63d-1bdf-4849-9e6b-4f290ee89c4c tempest-AttachVolumeShelveTestJSON-1452861425 tempest-AttachVolumeShelveTestJSON-1452861425-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 17:51:28 user nova-compute[74613]: DEBUG nova.network.neutron [None req-3a7ec63d-1bdf-4849-9e6b-4f290ee89c4c tempest-AttachVolumeShelveTestJSON-1452861425 tempest-AttachVolumeShelveTestJSON-1452861425-project-member] [instance: c19e230e-2e6c-4c20-b15c-ad81a73674b4] Successfully created port: a414bce0-6293-4987-9441-46943fe2e877 {{(pid=74613) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 29 17:51:28 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-c110aa5d-1515-4b7e-988f-f60fba232273 tempest-ServerActionsTestOtherA-1784608629 tempest-ServerActionsTestOtherA-1784608629-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/21faea9e6951f3bdd0153b76ac89fe1a60a34758 --force-share --output=json" returned: 0 in 0.151s {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 17:51:28 user nova-compute[74613]: DEBUG nova.virt.disk.api [None req-c110aa5d-1515-4b7e-988f-f60fba232273 tempest-ServerActionsTestOtherA-1784608629 tempest-ServerActionsTestOtherA-1784608629-project-member] Checking if we can resize image /opt/stack/data/nova/instances/abc9e2b8-f467-4cd0-b40f-de511fde1ec1/disk. size=1073741824 {{(pid=74613) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 29 17:51:28 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-c110aa5d-1515-4b7e-988f-f60fba232273 tempest-ServerActionsTestOtherA-1784608629 tempest-ServerActionsTestOtherA-1784608629-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/abc9e2b8-f467-4cd0-b40f-de511fde1ec1/disk --force-share --output=json {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 17:51:28 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-c110aa5d-1515-4b7e-988f-f60fba232273 tempest-ServerActionsTestOtherA-1784608629 tempest-ServerActionsTestOtherA-1784608629-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/abc9e2b8-f467-4cd0-b40f-de511fde1ec1/disk --force-share --output=json" returned: 0 in 0.155s {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 17:51:28 user nova-compute[74613]: DEBUG nova.virt.disk.api [None req-c110aa5d-1515-4b7e-988f-f60fba232273 tempest-ServerActionsTestOtherA-1784608629 tempest-ServerActionsTestOtherA-1784608629-project-member] Cannot resize image /opt/stack/data/nova/instances/abc9e2b8-f467-4cd0-b40f-de511fde1ec1/disk to a smaller size. {{(pid=74613) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 29 17:51:28 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-c110aa5d-1515-4b7e-988f-f60fba232273 tempest-ServerActionsTestOtherA-1784608629 tempest-ServerActionsTestOtherA-1784608629-project-member] [instance: abc9e2b8-f467-4cd0-b40f-de511fde1ec1] Created local disks {{(pid=74613) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 29 17:51:28 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-c110aa5d-1515-4b7e-988f-f60fba232273 tempest-ServerActionsTestOtherA-1784608629 tempest-ServerActionsTestOtherA-1784608629-project-member] [instance: abc9e2b8-f467-4cd0-b40f-de511fde1ec1] Ensure instance console log exists: /opt/stack/data/nova/instances/abc9e2b8-f467-4cd0-b40f-de511fde1ec1/console.log {{(pid=74613) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 29 17:51:28 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-c110aa5d-1515-4b7e-988f-f60fba232273 tempest-ServerActionsTestOtherA-1784608629 tempest-ServerActionsTestOtherA-1784608629-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 17:51:28 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-c110aa5d-1515-4b7e-988f-f60fba232273 tempest-ServerActionsTestOtherA-1784608629 tempest-ServerActionsTestOtherA-1784608629-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 17:51:28 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-c110aa5d-1515-4b7e-988f-f60fba232273 tempest-ServerActionsTestOtherA-1784608629 tempest-ServerActionsTestOtherA-1784608629-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 17:51:29 user nova-compute[74613]: DEBUG nova.network.neutron [None req-c110aa5d-1515-4b7e-988f-f60fba232273 tempest-ServerActionsTestOtherA-1784608629 tempest-ServerActionsTestOtherA-1784608629-project-member] [instance: abc9e2b8-f467-4cd0-b40f-de511fde1ec1] Successfully created port: 59a8bf1b-9fb1-4526-92d5-9ad1897c1ee8 {{(pid=74613) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 29 17:51:30 user nova-compute[74613]: DEBUG nova.network.neutron [None req-c95f4e22-f5b1-4f6e-80dc-83a2ee62815f tempest-ServerStableDeviceRescueTest-1416322546 tempest-ServerStableDeviceRescueTest-1416322546-project-member] [instance: b6b0ba36-ad89-45f1-9578-8b999567dd25] Successfully updated port: 0167e253-42dd-486a-8231-a8b8199f3584 {{(pid=74613) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 29 17:51:30 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-c95f4e22-f5b1-4f6e-80dc-83a2ee62815f tempest-ServerStableDeviceRescueTest-1416322546 tempest-ServerStableDeviceRescueTest-1416322546-project-member] Acquiring lock "refresh_cache-b6b0ba36-ad89-45f1-9578-8b999567dd25" {{(pid=74613) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 17:51:30 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-c95f4e22-f5b1-4f6e-80dc-83a2ee62815f tempest-ServerStableDeviceRescueTest-1416322546 tempest-ServerStableDeviceRescueTest-1416322546-project-member] Acquired lock "refresh_cache-b6b0ba36-ad89-45f1-9578-8b999567dd25" {{(pid=74613) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 17:51:30 user nova-compute[74613]: DEBUG nova.network.neutron [None req-c95f4e22-f5b1-4f6e-80dc-83a2ee62815f tempest-ServerStableDeviceRescueTest-1416322546 tempest-ServerStableDeviceRescueTest-1416322546-project-member] [instance: b6b0ba36-ad89-45f1-9578-8b999567dd25] Building network info cache for instance {{(pid=74613) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 29 17:51:30 user nova-compute[74613]: DEBUG nova.network.neutron [None req-d108c1ab-fa43-4e97-b056-065e3528f377 tempest-ServerBootFromVolumeStableRescueTest-414665510 tempest-ServerBootFromVolumeStableRescueTest-414665510-project-member] [instance: 3b828860-5cc5-40b0-b845-8e560211794e] Successfully updated port: dfe097e1-192f-47e2-96b7-0e9fe8320758 {{(pid=74613) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 29 17:51:30 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-d108c1ab-fa43-4e97-b056-065e3528f377 tempest-ServerBootFromVolumeStableRescueTest-414665510 tempest-ServerBootFromVolumeStableRescueTest-414665510-project-member] Acquiring lock "refresh_cache-3b828860-5cc5-40b0-b845-8e560211794e" {{(pid=74613) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 17:51:30 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-d108c1ab-fa43-4e97-b056-065e3528f377 tempest-ServerBootFromVolumeStableRescueTest-414665510 tempest-ServerBootFromVolumeStableRescueTest-414665510-project-member] Acquired lock "refresh_cache-3b828860-5cc5-40b0-b845-8e560211794e" {{(pid=74613) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 17:51:30 user nova-compute[74613]: DEBUG nova.network.neutron [None req-d108c1ab-fa43-4e97-b056-065e3528f377 tempest-ServerBootFromVolumeStableRescueTest-414665510 tempest-ServerBootFromVolumeStableRescueTest-414665510-project-member] [instance: 3b828860-5cc5-40b0-b845-8e560211794e] Building network info cache for instance {{(pid=74613) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 29 17:51:30 user nova-compute[74613]: DEBUG nova.network.neutron [None req-c95f4e22-f5b1-4f6e-80dc-83a2ee62815f tempest-ServerStableDeviceRescueTest-1416322546 tempest-ServerStableDeviceRescueTest-1416322546-project-member] [instance: b6b0ba36-ad89-45f1-9578-8b999567dd25] Instance cache missing network info. {{(pid=74613) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 29 17:51:30 user nova-compute[74613]: DEBUG nova.network.neutron [None req-d108c1ab-fa43-4e97-b056-065e3528f377 tempest-ServerBootFromVolumeStableRescueTest-414665510 tempest-ServerBootFromVolumeStableRescueTest-414665510-project-member] [instance: 3b828860-5cc5-40b0-b845-8e560211794e] Instance cache missing network info. {{(pid=74613) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 29 17:51:30 user nova-compute[74613]: DEBUG nova.compute.manager [req-e010c327-2c1b-40f7-8b3e-f81483cee9f4 req-56791e93-d04c-4f81-b83f-1856410b16e0 service nova] [instance: b6b0ba36-ad89-45f1-9578-8b999567dd25] Received event network-changed-0167e253-42dd-486a-8231-a8b8199f3584 {{(pid=74613) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 17:51:30 user nova-compute[74613]: DEBUG nova.compute.manager [req-e010c327-2c1b-40f7-8b3e-f81483cee9f4 req-56791e93-d04c-4f81-b83f-1856410b16e0 service nova] [instance: b6b0ba36-ad89-45f1-9578-8b999567dd25] Refreshing instance network info cache due to event network-changed-0167e253-42dd-486a-8231-a8b8199f3584. {{(pid=74613) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 17:51:30 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-e010c327-2c1b-40f7-8b3e-f81483cee9f4 req-56791e93-d04c-4f81-b83f-1856410b16e0 service nova] Acquiring lock "refresh_cache-b6b0ba36-ad89-45f1-9578-8b999567dd25" {{(pid=74613) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 17:51:30 user nova-compute[74613]: DEBUG nova.network.neutron [None req-31c66816-a579-4fed-917c-5fe116aeddf6 tempest-DeleteServersTestJSON-112443106 tempest-DeleteServersTestJSON-112443106-project-member] [instance: f3a5f6d2-cadd-485b-a443-1b8f3ed966b9] Successfully updated port: 49e80b78-004f-457d-aea8-8940ab6d9179 {{(pid=74613) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 29 17:51:30 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-31c66816-a579-4fed-917c-5fe116aeddf6 tempest-DeleteServersTestJSON-112443106 tempest-DeleteServersTestJSON-112443106-project-member] Acquiring lock "refresh_cache-f3a5f6d2-cadd-485b-a443-1b8f3ed966b9" {{(pid=74613) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 17:51:30 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-31c66816-a579-4fed-917c-5fe116aeddf6 tempest-DeleteServersTestJSON-112443106 tempest-DeleteServersTestJSON-112443106-project-member] Acquired lock "refresh_cache-f3a5f6d2-cadd-485b-a443-1b8f3ed966b9" {{(pid=74613) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 17:51:30 user nova-compute[74613]: DEBUG nova.network.neutron [None req-31c66816-a579-4fed-917c-5fe116aeddf6 tempest-DeleteServersTestJSON-112443106 tempest-DeleteServersTestJSON-112443106-project-member] [instance: f3a5f6d2-cadd-485b-a443-1b8f3ed966b9] Building network info cache for instance {{(pid=74613) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 29 17:51:31 user nova-compute[74613]: DEBUG nova.network.neutron [None req-31c66816-a579-4fed-917c-5fe116aeddf6 tempest-DeleteServersTestJSON-112443106 tempest-DeleteServersTestJSON-112443106-project-member] [instance: f3a5f6d2-cadd-485b-a443-1b8f3ed966b9] Instance cache missing network info. {{(pid=74613) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 29 17:51:31 user nova-compute[74613]: DEBUG nova.compute.manager [req-f4683180-0d85-4c63-9f11-920946a8bd80 req-851db68e-7bd8-4a12-ae83-a4eb697bde8c service nova] [instance: f3a5f6d2-cadd-485b-a443-1b8f3ed966b9] Received event network-changed-49e80b78-004f-457d-aea8-8940ab6d9179 {{(pid=74613) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 17:51:31 user nova-compute[74613]: DEBUG nova.compute.manager [req-f4683180-0d85-4c63-9f11-920946a8bd80 req-851db68e-7bd8-4a12-ae83-a4eb697bde8c service nova] [instance: f3a5f6d2-cadd-485b-a443-1b8f3ed966b9] Refreshing instance network info cache due to event network-changed-49e80b78-004f-457d-aea8-8940ab6d9179. {{(pid=74613) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 17:51:31 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-f4683180-0d85-4c63-9f11-920946a8bd80 req-851db68e-7bd8-4a12-ae83-a4eb697bde8c service nova] Acquiring lock "refresh_cache-f3a5f6d2-cadd-485b-a443-1b8f3ed966b9" {{(pid=74613) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 17:51:31 user nova-compute[74613]: DEBUG nova.network.neutron [None req-c95f4e22-f5b1-4f6e-80dc-83a2ee62815f tempest-ServerStableDeviceRescueTest-1416322546 tempest-ServerStableDeviceRescueTest-1416322546-project-member] [instance: b6b0ba36-ad89-45f1-9578-8b999567dd25] Updating instance_info_cache with network_info: [{"id": "0167e253-42dd-486a-8231-a8b8199f3584", "address": "fa:16:3e:3f:ea:5d", "network": {"id": "880ea498-5e4e-4786-a894-bac0f42572f4", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1846928198-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b8f184c16b5348beb2dc9e6359a47651", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0167e253-42", "ovs_interfaceid": "0167e253-42dd-486a-8231-a8b8199f3584", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74613) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 17:51:31 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-c95f4e22-f5b1-4f6e-80dc-83a2ee62815f tempest-ServerStableDeviceRescueTest-1416322546 tempest-ServerStableDeviceRescueTest-1416322546-project-member] Releasing lock "refresh_cache-b6b0ba36-ad89-45f1-9578-8b999567dd25" {{(pid=74613) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 17:51:31 user nova-compute[74613]: DEBUG nova.compute.manager [None req-c95f4e22-f5b1-4f6e-80dc-83a2ee62815f tempest-ServerStableDeviceRescueTest-1416322546 tempest-ServerStableDeviceRescueTest-1416322546-project-member] [instance: b6b0ba36-ad89-45f1-9578-8b999567dd25] Instance network_info: |[{"id": "0167e253-42dd-486a-8231-a8b8199f3584", "address": "fa:16:3e:3f:ea:5d", "network": {"id": "880ea498-5e4e-4786-a894-bac0f42572f4", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1846928198-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b8f184c16b5348beb2dc9e6359a47651", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0167e253-42", "ovs_interfaceid": "0167e253-42dd-486a-8231-a8b8199f3584", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74613) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 29 17:51:31 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-e010c327-2c1b-40f7-8b3e-f81483cee9f4 req-56791e93-d04c-4f81-b83f-1856410b16e0 service nova] Acquired lock "refresh_cache-b6b0ba36-ad89-45f1-9578-8b999567dd25" {{(pid=74613) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 17:51:31 user nova-compute[74613]: DEBUG nova.network.neutron [req-e010c327-2c1b-40f7-8b3e-f81483cee9f4 req-56791e93-d04c-4f81-b83f-1856410b16e0 service nova] [instance: b6b0ba36-ad89-45f1-9578-8b999567dd25] Refreshing network info cache for port 0167e253-42dd-486a-8231-a8b8199f3584 {{(pid=74613) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 17:51:31 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-c95f4e22-f5b1-4f6e-80dc-83a2ee62815f tempest-ServerStableDeviceRescueTest-1416322546 tempest-ServerStableDeviceRescueTest-1416322546-project-member] [instance: b6b0ba36-ad89-45f1-9578-8b999567dd25] Start _get_guest_xml network_info=[{"id": "0167e253-42dd-486a-8231-a8b8199f3584", "address": "fa:16:3e:3f:ea:5d", "network": {"id": "880ea498-5e4e-4786-a894-bac0f42572f4", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1846928198-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b8f184c16b5348beb2dc9e6359a47651", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0167e253-42", "ovs_interfaceid": "0167e253-42dd-486a-8231-a8b8199f3584", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-29T17:47:38Z,direct_url=<?>,disk_format='qcow2',id=4217f428-8d9d-4ee1-9614-642d26d90c46,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='794b07cbd46a44b5865cfda741036bae',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-29T17:47:40Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'size': 0, 'device_type': 'disk', 'boot_index': 0, 'guest_format': None, 'encrypted': False, 'encryption_format': None, 'disk_bus': 'virtio', 'image_id': '4217f428-8d9d-4ee1-9614-642d26d90c46'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74613) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 29 17:51:31 user nova-compute[74613]: WARNING nova.virt.libvirt.driver [None req-c95f4e22-f5b1-4f6e-80dc-83a2ee62815f tempest-ServerStableDeviceRescueTest-1416322546 tempest-ServerStableDeviceRescueTest-1416322546-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 17:51:31 user nova-compute[74613]: WARNING nova.virt.libvirt.driver [None req-c95f4e22-f5b1-4f6e-80dc-83a2ee62815f tempest-ServerStableDeviceRescueTest-1416322546 tempest-ServerStableDeviceRescueTest-1416322546-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 17:51:31 user nova-compute[74613]: DEBUG nova.network.neutron [None req-d108c1ab-fa43-4e97-b056-065e3528f377 tempest-ServerBootFromVolumeStableRescueTest-414665510 tempest-ServerBootFromVolumeStableRescueTest-414665510-project-member] [instance: 3b828860-5cc5-40b0-b845-8e560211794e] Updating instance_info_cache with network_info: [{"id": "dfe097e1-192f-47e2-96b7-0e9fe8320758", "address": "fa:16:3e:c2:a8:2f", "network": {"id": "0722b02d-a357-4360-87e8-580913723985", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-579793494-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b820dd795dfe46cd804772f0e71f98e9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdfe097e1-19", "ovs_interfaceid": "dfe097e1-192f-47e2-96b7-0e9fe8320758", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74613) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 17:51:31 user nova-compute[74613]: DEBUG nova.virt.libvirt.host [None req-c95f4e22-f5b1-4f6e-80dc-83a2ee62815f tempest-ServerStableDeviceRescueTest-1416322546 tempest-ServerStableDeviceRescueTest-1416322546-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74613) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 29 17:51:31 user nova-compute[74613]: DEBUG nova.virt.libvirt.host [None req-c95f4e22-f5b1-4f6e-80dc-83a2ee62815f tempest-ServerStableDeviceRescueTest-1416322546 tempest-ServerStableDeviceRescueTest-1416322546-project-member] CPU controller missing on host. {{(pid=74613) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 29 17:51:31 user nova-compute[74613]: DEBUG nova.virt.libvirt.host [None req-c95f4e22-f5b1-4f6e-80dc-83a2ee62815f tempest-ServerStableDeviceRescueTest-1416322546 tempest-ServerStableDeviceRescueTest-1416322546-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74613) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 29 17:51:31 user nova-compute[74613]: DEBUG nova.virt.libvirt.host [None req-c95f4e22-f5b1-4f6e-80dc-83a2ee62815f tempest-ServerStableDeviceRescueTest-1416322546 tempest-ServerStableDeviceRescueTest-1416322546-project-member] CPU controller found on host. {{(pid=74613) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 29 17:51:31 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-c95f4e22-f5b1-4f6e-80dc-83a2ee62815f tempest-ServerStableDeviceRescueTest-1416322546 tempest-ServerStableDeviceRescueTest-1416322546-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74613) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 29 17:51:31 user nova-compute[74613]: DEBUG nova.virt.hardware [None req-c95f4e22-f5b1-4f6e-80dc-83a2ee62815f tempest-ServerStableDeviceRescueTest-1416322546 tempest-ServerStableDeviceRescueTest-1416322546-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-29T17:47:27Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-29T17:47:38Z,direct_url=<?>,disk_format='qcow2',id=4217f428-8d9d-4ee1-9614-642d26d90c46,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='794b07cbd46a44b5865cfda741036bae',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-29T17:47:40Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74613) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 29 17:51:31 user nova-compute[74613]: DEBUG nova.virt.hardware [None req-c95f4e22-f5b1-4f6e-80dc-83a2ee62815f tempest-ServerStableDeviceRescueTest-1416322546 tempest-ServerStableDeviceRescueTest-1416322546-project-member] Flavor limits 0:0:0 {{(pid=74613) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 29 17:51:31 user nova-compute[74613]: DEBUG nova.virt.hardware [None req-c95f4e22-f5b1-4f6e-80dc-83a2ee62815f tempest-ServerStableDeviceRescueTest-1416322546 tempest-ServerStableDeviceRescueTest-1416322546-project-member] Image limits 0:0:0 {{(pid=74613) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 29 17:51:31 user nova-compute[74613]: DEBUG nova.virt.hardware [None req-c95f4e22-f5b1-4f6e-80dc-83a2ee62815f tempest-ServerStableDeviceRescueTest-1416322546 tempest-ServerStableDeviceRescueTest-1416322546-project-member] Flavor pref 0:0:0 {{(pid=74613) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 29 17:51:31 user nova-compute[74613]: DEBUG nova.virt.hardware [None req-c95f4e22-f5b1-4f6e-80dc-83a2ee62815f tempest-ServerStableDeviceRescueTest-1416322546 tempest-ServerStableDeviceRescueTest-1416322546-project-member] Image pref 0:0:0 {{(pid=74613) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 29 17:51:31 user nova-compute[74613]: DEBUG nova.virt.hardware [None req-c95f4e22-f5b1-4f6e-80dc-83a2ee62815f tempest-ServerStableDeviceRescueTest-1416322546 tempest-ServerStableDeviceRescueTest-1416322546-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74613) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 29 17:51:31 user nova-compute[74613]: DEBUG nova.virt.hardware [None req-c95f4e22-f5b1-4f6e-80dc-83a2ee62815f tempest-ServerStableDeviceRescueTest-1416322546 tempest-ServerStableDeviceRescueTest-1416322546-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74613) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 29 17:51:31 user nova-compute[74613]: DEBUG nova.virt.hardware [None req-c95f4e22-f5b1-4f6e-80dc-83a2ee62815f tempest-ServerStableDeviceRescueTest-1416322546 tempest-ServerStableDeviceRescueTest-1416322546-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74613) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 29 17:51:31 user nova-compute[74613]: DEBUG nova.virt.hardware [None req-c95f4e22-f5b1-4f6e-80dc-83a2ee62815f tempest-ServerStableDeviceRescueTest-1416322546 tempest-ServerStableDeviceRescueTest-1416322546-project-member] Got 1 possible topologies {{(pid=74613) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 29 17:51:31 user nova-compute[74613]: DEBUG nova.virt.hardware [None req-c95f4e22-f5b1-4f6e-80dc-83a2ee62815f tempest-ServerStableDeviceRescueTest-1416322546 tempest-ServerStableDeviceRescueTest-1416322546-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74613) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 29 17:51:31 user nova-compute[74613]: DEBUG nova.virt.hardware [None req-c95f4e22-f5b1-4f6e-80dc-83a2ee62815f tempest-ServerStableDeviceRescueTest-1416322546 tempest-ServerStableDeviceRescueTest-1416322546-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74613) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 29 17:51:31 user nova-compute[74613]: DEBUG nova.privsep.utils [None req-c95f4e22-f5b1-4f6e-80dc-83a2ee62815f tempest-ServerStableDeviceRescueTest-1416322546 tempest-ServerStableDeviceRescueTest-1416322546-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74613) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 29 17:51:31 user nova-compute[74613]: DEBUG nova.virt.libvirt.vif [None req-c95f4e22-f5b1-4f6e-80dc-83a2ee62815f tempest-ServerStableDeviceRescueTest-1416322546 tempest-ServerStableDeviceRescueTest-1416322546-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T17:51:21Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-56030904',display_name='tempest-ServerStableDeviceRescueTest-server-56030904',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-56030904',id=1,image_ref='4217f428-8d9d-4ee1-9614-642d26d90c46',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBI85GZspGma1CfHLklAfK5ROqiFitnBViWC2sBj1qECdxTf0mbQqMsBEY3GHAf3hN5wBoUAnLHRf24tZw5VxrRYKqkyzeutcAUMWWy4Q3HjZLnkFQi82h3okfVi2Mvtpcw==',key_name='tempest-keypair-2003214039',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b8f184c16b5348beb2dc9e6359a47651',ramdisk_id='',reservation_id='r-ywn83s23',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='4217f428-8d9d-4ee1-9614-642d26d90c46',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerStableDeviceRescueTest-1416322546',owner_user_name='tempest-ServerStableDeviceRescueTest-1416322546-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T17:51:24Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='71f13889d23c4ddb9c5e52d7a1a82d47',uuid=b6b0ba36-ad89-45f1-9578-8b999567dd25,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0167e253-42dd-486a-8231-a8b8199f3584", "address": "fa:16:3e:3f:ea:5d", "network": {"id": "880ea498-5e4e-4786-a894-bac0f42572f4", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1846928198-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b8f184c16b5348beb2dc9e6359a47651", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0167e253-42", "ovs_interfaceid": "0167e253-42dd-486a-8231-a8b8199f3584", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74613) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 29 17:51:31 user nova-compute[74613]: DEBUG nova.network.os_vif_util [None req-c95f4e22-f5b1-4f6e-80dc-83a2ee62815f tempest-ServerStableDeviceRescueTest-1416322546 tempest-ServerStableDeviceRescueTest-1416322546-project-member] Converting VIF {"id": "0167e253-42dd-486a-8231-a8b8199f3584", "address": "fa:16:3e:3f:ea:5d", "network": {"id": "880ea498-5e4e-4786-a894-bac0f42572f4", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1846928198-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b8f184c16b5348beb2dc9e6359a47651", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0167e253-42", "ovs_interfaceid": "0167e253-42dd-486a-8231-a8b8199f3584", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74613) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 17:51:31 user nova-compute[74613]: DEBUG nova.network.os_vif_util [None req-c95f4e22-f5b1-4f6e-80dc-83a2ee62815f tempest-ServerStableDeviceRescueTest-1416322546 tempest-ServerStableDeviceRescueTest-1416322546-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3f:ea:5d,bridge_name='br-int',has_traffic_filtering=True,id=0167e253-42dd-486a-8231-a8b8199f3584,network=Network(880ea498-5e4e-4786-a894-bac0f42572f4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0167e253-42') {{(pid=74613) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 17:51:31 user nova-compute[74613]: DEBUG nova.objects.instance [None req-c95f4e22-f5b1-4f6e-80dc-83a2ee62815f tempest-ServerStableDeviceRescueTest-1416322546 tempest-ServerStableDeviceRescueTest-1416322546-project-member] Lazy-loading 'pci_devices' on Instance uuid b6b0ba36-ad89-45f1-9578-8b999567dd25 {{(pid=74613) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 17:51:31 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-d108c1ab-fa43-4e97-b056-065e3528f377 tempest-ServerBootFromVolumeStableRescueTest-414665510 tempest-ServerBootFromVolumeStableRescueTest-414665510-project-member] Releasing lock "refresh_cache-3b828860-5cc5-40b0-b845-8e560211794e" {{(pid=74613) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 17:51:31 user nova-compute[74613]: DEBUG nova.compute.manager [None req-d108c1ab-fa43-4e97-b056-065e3528f377 tempest-ServerBootFromVolumeStableRescueTest-414665510 tempest-ServerBootFromVolumeStableRescueTest-414665510-project-member] [instance: 3b828860-5cc5-40b0-b845-8e560211794e] Instance network_info: |[{"id": "dfe097e1-192f-47e2-96b7-0e9fe8320758", "address": "fa:16:3e:c2:a8:2f", "network": {"id": "0722b02d-a357-4360-87e8-580913723985", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-579793494-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b820dd795dfe46cd804772f0e71f98e9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdfe097e1-19", "ovs_interfaceid": "dfe097e1-192f-47e2-96b7-0e9fe8320758", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74613) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 29 17:51:31 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-d108c1ab-fa43-4e97-b056-065e3528f377 tempest-ServerBootFromVolumeStableRescueTest-414665510 tempest-ServerBootFromVolumeStableRescueTest-414665510-project-member] [instance: 3b828860-5cc5-40b0-b845-8e560211794e] Start _get_guest_xml network_info=[{"id": "dfe097e1-192f-47e2-96b7-0e9fe8320758", "address": "fa:16:3e:c2:a8:2f", "network": {"id": "0722b02d-a357-4360-87e8-580913723985", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-579793494-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b820dd795dfe46cd804772f0e71f98e9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdfe097e1-19", "ovs_interfaceid": "dfe097e1-192f-47e2-96b7-0e9fe8320758", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-29T17:47:38Z,direct_url=<?>,disk_format='qcow2',id=4217f428-8d9d-4ee1-9614-642d26d90c46,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='794b07cbd46a44b5865cfda741036bae',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-29T17:47:40Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'size': 0, 'device_type': 'disk', 'boot_index': 0, 'guest_format': None, 'encrypted': False, 'encryption_format': None, 'disk_bus': 'virtio', 'image_id': '4217f428-8d9d-4ee1-9614-642d26d90c46'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74613) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 29 17:51:31 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-c95f4e22-f5b1-4f6e-80dc-83a2ee62815f tempest-ServerStableDeviceRescueTest-1416322546 tempest-ServerStableDeviceRescueTest-1416322546-project-member] [instance: b6b0ba36-ad89-45f1-9578-8b999567dd25] End _get_guest_xml xml=<domain type="kvm">
Nov 29 17:51:31 user nova-compute[74613]:   <uuid>b6b0ba36-ad89-45f1-9578-8b999567dd25</uuid>
Nov 29 17:51:31 user nova-compute[74613]:   <name>instance-00000001</name>
Nov 29 17:51:31 user nova-compute[74613]:   <memory>524288</memory>
Nov 29 17:51:31 user nova-compute[74613]:   <vcpu>1</vcpu>
Nov 29 17:51:31 user nova-compute[74613]:   <metadata>
Nov 29 17:51:31 user nova-compute[74613]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 29 17:51:31 user nova-compute[74613]:       <nova:package version="0.0.0"/>
Nov 29 17:51:31 user nova-compute[74613]:       <nova:name>tempest-ServerStableDeviceRescueTest-server-56030904</nova:name>
Nov 29 17:51:31 user nova-compute[74613]:       <nova:creationTime>2023-11-29 17:51:31</nova:creationTime>
Nov 29 17:51:31 user nova-compute[74613]:       <nova:flavor name="m1.tiny">
Nov 29 17:51:31 user nova-compute[74613]:         <nova:memory>512</nova:memory>
Nov 29 17:51:31 user nova-compute[74613]:         <nova:disk>1</nova:disk>
Nov 29 17:51:31 user nova-compute[74613]:         <nova:swap>0</nova:swap>
Nov 29 17:51:31 user nova-compute[74613]:         <nova:ephemeral>0</nova:ephemeral>
Nov 29 17:51:31 user nova-compute[74613]:         <nova:vcpus>1</nova:vcpus>
Nov 29 17:51:31 user nova-compute[74613]:       </nova:flavor>
Nov 29 17:51:31 user nova-compute[74613]:       <nova:owner>
Nov 29 17:51:31 user nova-compute[74613]:         <nova:user uuid="71f13889d23c4ddb9c5e52d7a1a82d47">tempest-ServerStableDeviceRescueTest-1416322546-project-member</nova:user>
Nov 29 17:51:31 user nova-compute[74613]:         <nova:project uuid="b8f184c16b5348beb2dc9e6359a47651">tempest-ServerStableDeviceRescueTest-1416322546</nova:project>
Nov 29 17:51:31 user nova-compute[74613]:       </nova:owner>
Nov 29 17:51:31 user nova-compute[74613]:       <nova:root type="image" uuid="4217f428-8d9d-4ee1-9614-642d26d90c46"/>
Nov 29 17:51:31 user nova-compute[74613]:       <nova:ports>
Nov 29 17:51:31 user nova-compute[74613]:         <nova:port uuid="0167e253-42dd-486a-8231-a8b8199f3584">
Nov 29 17:51:31 user nova-compute[74613]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Nov 29 17:51:31 user nova-compute[74613]:         </nova:port>
Nov 29 17:51:31 user nova-compute[74613]:       </nova:ports>
Nov 29 17:51:31 user nova-compute[74613]:     </nova:instance>
Nov 29 17:51:31 user nova-compute[74613]:   </metadata>
Nov 29 17:51:31 user nova-compute[74613]:   <sysinfo type="smbios">
Nov 29 17:51:31 user nova-compute[74613]:     <system>
Nov 29 17:51:31 user nova-compute[74613]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 29 17:51:31 user nova-compute[74613]:       <entry name="product">OpenStack Nova</entry>
Nov 29 17:51:31 user nova-compute[74613]:       <entry name="version">0.0.0</entry>
Nov 29 17:51:31 user nova-compute[74613]:       <entry name="serial">b6b0ba36-ad89-45f1-9578-8b999567dd25</entry>
Nov 29 17:51:31 user nova-compute[74613]:       <entry name="uuid">b6b0ba36-ad89-45f1-9578-8b999567dd25</entry>
Nov 29 17:51:31 user nova-compute[74613]:       <entry name="family">Virtual Machine</entry>
Nov 29 17:51:31 user nova-compute[74613]:     </system>
Nov 29 17:51:31 user nova-compute[74613]:   </sysinfo>
Nov 29 17:51:31 user nova-compute[74613]:   <os>
Nov 29 17:51:31 user nova-compute[74613]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 29 17:51:31 user nova-compute[74613]:     <boot dev="hd"/>
Nov 29 17:51:31 user nova-compute[74613]:     <smbios mode="sysinfo"/>
Nov 29 17:51:31 user nova-compute[74613]:   </os>
Nov 29 17:51:31 user nova-compute[74613]:   <features>
Nov 29 17:51:31 user nova-compute[74613]:     <acpi/>
Nov 29 17:51:31 user nova-compute[74613]:     <apic/>
Nov 29 17:51:31 user nova-compute[74613]:     <vmcoreinfo/>
Nov 29 17:51:31 user nova-compute[74613]:   </features>
Nov 29 17:51:31 user nova-compute[74613]:   <clock offset="utc">
Nov 29 17:51:31 user nova-compute[74613]:     <timer name="pit" tickpolicy="delay"/>
Nov 29 17:51:31 user nova-compute[74613]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 29 17:51:31 user nova-compute[74613]:     <timer name="hpet" present="no"/>
Nov 29 17:51:31 user nova-compute[74613]:   </clock>
Nov 29 17:51:31 user nova-compute[74613]:   <cpu mode="custom" match="exact">
Nov 29 17:51:31 user nova-compute[74613]:     <model>Nehalem</model>
Nov 29 17:51:31 user nova-compute[74613]:     <topology sockets="1" cores="1" threads="1"/>
Nov 29 17:51:31 user nova-compute[74613]:   </cpu>
Nov 29 17:51:31 user nova-compute[74613]:   <devices>
Nov 29 17:51:31 user nova-compute[74613]:     <disk type="file" device="disk">
Nov 29 17:51:31 user nova-compute[74613]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 29 17:51:31 user nova-compute[74613]:       <source file="/opt/stack/data/nova/instances/b6b0ba36-ad89-45f1-9578-8b999567dd25/disk"/>
Nov 29 17:51:31 user nova-compute[74613]:       <target dev="vda" bus="virtio"/>
Nov 29 17:51:31 user nova-compute[74613]:     </disk>
Nov 29 17:51:31 user nova-compute[74613]:     <interface type="ethernet">
Nov 29 17:51:31 user nova-compute[74613]:       <mac address="fa:16:3e:3f:ea:5d"/>
Nov 29 17:51:31 user nova-compute[74613]:       <model type="virtio"/>
Nov 29 17:51:31 user nova-compute[74613]:       <mtu size="1442"/>
Nov 29 17:51:31 user nova-compute[74613]:       <target dev="tap0167e253-42"/>
Nov 29 17:51:31 user nova-compute[74613]:     </interface>
Nov 29 17:51:31 user nova-compute[74613]:     <serial type="pty">
Nov 29 17:51:31 user nova-compute[74613]:       <log file="/opt/stack/data/nova/instances/b6b0ba36-ad89-45f1-9578-8b999567dd25/console.log" append="off"/>
Nov 29 17:51:31 user nova-compute[74613]:     </serial>
Nov 29 17:51:31 user nova-compute[74613]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 29 17:51:31 user nova-compute[74613]:     <video>
Nov 29 17:51:31 user nova-compute[74613]:       <model type="virtio"/>
Nov 29 17:51:31 user nova-compute[74613]:     </video>
Nov 29 17:51:31 user nova-compute[74613]:     <rng model="virtio">
Nov 29 17:51:31 user nova-compute[74613]:       <backend model="random">/dev/urandom</backend>
Nov 29 17:51:31 user nova-compute[74613]:     </rng>
Nov 29 17:51:31 user nova-compute[74613]:     <controller type="usb" index="0" model="none"/>
Nov 29 17:51:31 user nova-compute[74613]:     <memballoon model="virtio">
Nov 29 17:51:31 user nova-compute[74613]:       <stats period="10"/>
Nov 29 17:51:31 user nova-compute[74613]:     </memballoon>
Nov 29 17:51:31 user nova-compute[74613]:   </devices>
Nov 29 17:51:31 user nova-compute[74613]: </domain>
Nov 29 17:51:31 user nova-compute[74613]:  {{(pid=74613) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 29 17:51:31 user nova-compute[74613]: DEBUG nova.virt.libvirt.vif [None req-c95f4e22-f5b1-4f6e-80dc-83a2ee62815f tempest-ServerStableDeviceRescueTest-1416322546 tempest-ServerStableDeviceRescueTest-1416322546-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T17:51:21Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-56030904',display_name='tempest-ServerStableDeviceRescueTest-server-56030904',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-56030904',id=1,image_ref='4217f428-8d9d-4ee1-9614-642d26d90c46',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBI85GZspGma1CfHLklAfK5ROqiFitnBViWC2sBj1qECdxTf0mbQqMsBEY3GHAf3hN5wBoUAnLHRf24tZw5VxrRYKqkyzeutcAUMWWy4Q3HjZLnkFQi82h3okfVi2Mvtpcw==',key_name='tempest-keypair-2003214039',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b8f184c16b5348beb2dc9e6359a47651',ramdisk_id='',reservation_id='r-ywn83s23',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='4217f428-8d9d-4ee1-9614-642d26d90c46',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerStableDeviceRescueTest-1416322546',owner_user_name='tempest-ServerStableDeviceRescueTest-1416322546-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T17:51:24Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='71f13889d23c4ddb9c5e52d7a1a82d47',uuid=b6b0ba36-ad89-45f1-9578-8b999567dd25,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0167e253-42dd-486a-8231-a8b8199f3584", "address": "fa:16:3e:3f:ea:5d", "network": {"id": "880ea498-5e4e-4786-a894-bac0f42572f4", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1846928198-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b8f184c16b5348beb2dc9e6359a47651", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0167e253-42", "ovs_interfaceid": "0167e253-42dd-486a-8231-a8b8199f3584", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74613) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 29 17:51:31 user nova-compute[74613]: DEBUG nova.network.os_vif_util [None req-c95f4e22-f5b1-4f6e-80dc-83a2ee62815f tempest-ServerStableDeviceRescueTest-1416322546 tempest-ServerStableDeviceRescueTest-1416322546-project-member] Converting VIF {"id": "0167e253-42dd-486a-8231-a8b8199f3584", "address": "fa:16:3e:3f:ea:5d", "network": {"id": "880ea498-5e4e-4786-a894-bac0f42572f4", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1846928198-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b8f184c16b5348beb2dc9e6359a47651", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0167e253-42", "ovs_interfaceid": "0167e253-42dd-486a-8231-a8b8199f3584", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74613) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 17:51:31 user nova-compute[74613]: DEBUG nova.network.os_vif_util [None req-c95f4e22-f5b1-4f6e-80dc-83a2ee62815f tempest-ServerStableDeviceRescueTest-1416322546 tempest-ServerStableDeviceRescueTest-1416322546-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3f:ea:5d,bridge_name='br-int',has_traffic_filtering=True,id=0167e253-42dd-486a-8231-a8b8199f3584,network=Network(880ea498-5e4e-4786-a894-bac0f42572f4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0167e253-42') {{(pid=74613) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 17:51:31 user nova-compute[74613]: DEBUG os_vif [None req-c95f4e22-f5b1-4f6e-80dc-83a2ee62815f tempest-ServerStableDeviceRescueTest-1416322546 tempest-ServerStableDeviceRescueTest-1416322546-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:3f:ea:5d,bridge_name='br-int',has_traffic_filtering=True,id=0167e253-42dd-486a-8231-a8b8199f3584,network=Network(880ea498-5e4e-4786-a894-bac0f42572f4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0167e253-42') {{(pid=74613) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 29 17:51:31 user nova-compute[74613]: DEBUG nova.network.neutron [None req-3a7ec63d-1bdf-4849-9e6b-4f290ee89c4c tempest-AttachVolumeShelveTestJSON-1452861425 tempest-AttachVolumeShelveTestJSON-1452861425-project-member] [instance: c19e230e-2e6c-4c20-b15c-ad81a73674b4] Successfully updated port: a414bce0-6293-4987-9441-46943fe2e877 {{(pid=74613) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 29 17:51:31 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl [None req-c95f4e22-f5b1-4f6e-80dc-83a2ee62815f tempest-ServerStableDeviceRescueTest-1416322546 tempest-ServerStableDeviceRescueTest-1416322546-project-member] Created schema index Interface.name {{(pid=74613) autocreate_indices /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/__init__.py:106}}
Nov 29 17:51:31 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl [None req-c95f4e22-f5b1-4f6e-80dc-83a2ee62815f tempest-ServerStableDeviceRescueTest-1416322546 tempest-ServerStableDeviceRescueTest-1416322546-project-member] Created schema index Port.name {{(pid=74613) autocreate_indices /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/__init__.py:106}}
Nov 29 17:51:31 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl [None req-c95f4e22-f5b1-4f6e-80dc-83a2ee62815f tempest-ServerStableDeviceRescueTest-1416322546 tempest-ServerStableDeviceRescueTest-1416322546-project-member] Created schema index Bridge.name {{(pid=74613) autocreate_indices /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/__init__.py:106}}
Nov 29 17:51:31 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-c95f4e22-f5b1-4f6e-80dc-83a2ee62815f tempest-ServerStableDeviceRescueTest-1416322546 tempest-ServerStableDeviceRescueTest-1416322546-project-member] tcp:127.0.0.1:6640: entering CONNECTING {{(pid=74613) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 17:51:31 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-c95f4e22-f5b1-4f6e-80dc-83a2ee62815f tempest-ServerStableDeviceRescueTest-1416322546 tempest-ServerStableDeviceRescueTest-1416322546-project-member] [POLLOUT] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:51:31 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-c95f4e22-f5b1-4f6e-80dc-83a2ee62815f tempest-ServerStableDeviceRescueTest-1416322546 tempest-ServerStableDeviceRescueTest-1416322546-project-member] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74613) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 17:51:31 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-3a7ec63d-1bdf-4849-9e6b-4f290ee89c4c tempest-AttachVolumeShelveTestJSON-1452861425 tempest-AttachVolumeShelveTestJSON-1452861425-project-member] Acquiring lock "refresh_cache-c19e230e-2e6c-4c20-b15c-ad81a73674b4" {{(pid=74613) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 17:51:31 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-3a7ec63d-1bdf-4849-9e6b-4f290ee89c4c tempest-AttachVolumeShelveTestJSON-1452861425 tempest-AttachVolumeShelveTestJSON-1452861425-project-member] Acquired lock "refresh_cache-c19e230e-2e6c-4c20-b15c-ad81a73674b4" {{(pid=74613) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 17:51:31 user nova-compute[74613]: DEBUG nova.network.neutron [None req-3a7ec63d-1bdf-4849-9e6b-4f290ee89c4c tempest-AttachVolumeShelveTestJSON-1452861425 tempest-AttachVolumeShelveTestJSON-1452861425-project-member] [instance: c19e230e-2e6c-4c20-b15c-ad81a73674b4] Building network info cache for instance {{(pid=74613) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 29 17:51:31 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-c95f4e22-f5b1-4f6e-80dc-83a2ee62815f tempest-ServerStableDeviceRescueTest-1416322546 tempest-ServerStableDeviceRescueTest-1416322546-project-member] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:51:31 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-c95f4e22-f5b1-4f6e-80dc-83a2ee62815f tempest-ServerStableDeviceRescueTest-1416322546 tempest-ServerStableDeviceRescueTest-1416322546-project-member] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:51:31 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-c95f4e22-f5b1-4f6e-80dc-83a2ee62815f tempest-ServerStableDeviceRescueTest-1416322546 tempest-ServerStableDeviceRescueTest-1416322546-project-member] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:51:31 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:51:31 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74613) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 17:51:31 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74613) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 29 17:51:31 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:51:31 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '2f96d73c-bad4-57f3-b700-9fedf95b6142', '_type': 'linux-noop'}}, row=False) {{(pid=74613) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 17:51:31 user nova-compute[74613]: WARNING nova.virt.libvirt.driver [None req-d108c1ab-fa43-4e97-b056-065e3528f377 tempest-ServerBootFromVolumeStableRescueTest-414665510 tempest-ServerBootFromVolumeStableRescueTest-414665510-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 17:51:31 user nova-compute[74613]: WARNING nova.virt.libvirt.driver [None req-d108c1ab-fa43-4e97-b056-065e3528f377 tempest-ServerBootFromVolumeStableRescueTest-414665510 tempest-ServerBootFromVolumeStableRescueTest-414665510-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 17:51:31 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:51:31 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 17:51:31 user nova-compute[74613]: INFO oslo.privsep.daemon [None req-c95f4e22-f5b1-4f6e-80dc-83a2ee62815f tempest-ServerStableDeviceRescueTest-1416322546 tempest-ServerStableDeviceRescueTest-1416322546-project-member] Running privsep helper: ['sudo', 'nova-rootwrap', '/etc/nova/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/nova/nova-cpu.conf', '--privsep_context', 'vif_plug_ovs.privsep.vif_plug', '--privsep_sock_path', '/tmp/tmpsk4tysoh/privsep.sock']
Nov 29 17:51:31 user nova-compute[74613]: DEBUG nova.virt.libvirt.host [None req-d108c1ab-fa43-4e97-b056-065e3528f377 tempest-ServerBootFromVolumeStableRescueTest-414665510 tempest-ServerBootFromVolumeStableRescueTest-414665510-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74613) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 29 17:51:31 user nova-compute[74613]: DEBUG nova.virt.libvirt.host [None req-d108c1ab-fa43-4e97-b056-065e3528f377 tempest-ServerBootFromVolumeStableRescueTest-414665510 tempest-ServerBootFromVolumeStableRescueTest-414665510-project-member] CPU controller missing on host. {{(pid=74613) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 29 17:51:31 user nova-compute[74613]: DEBUG nova.virt.libvirt.host [None req-d108c1ab-fa43-4e97-b056-065e3528f377 tempest-ServerBootFromVolumeStableRescueTest-414665510 tempest-ServerBootFromVolumeStableRescueTest-414665510-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74613) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 29 17:51:31 user nova-compute[74613]: DEBUG nova.virt.libvirt.host [None req-d108c1ab-fa43-4e97-b056-065e3528f377 tempest-ServerBootFromVolumeStableRescueTest-414665510 tempest-ServerBootFromVolumeStableRescueTest-414665510-project-member] CPU controller found on host. {{(pid=74613) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 29 17:51:31 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-d108c1ab-fa43-4e97-b056-065e3528f377 tempest-ServerBootFromVolumeStableRescueTest-414665510 tempest-ServerBootFromVolumeStableRescueTest-414665510-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74613) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 29 17:51:31 user nova-compute[74613]: DEBUG nova.virt.hardware [None req-d108c1ab-fa43-4e97-b056-065e3528f377 tempest-ServerBootFromVolumeStableRescueTest-414665510 tempest-ServerBootFromVolumeStableRescueTest-414665510-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-29T17:47:27Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-29T17:47:38Z,direct_url=<?>,disk_format='qcow2',id=4217f428-8d9d-4ee1-9614-642d26d90c46,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='794b07cbd46a44b5865cfda741036bae',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-29T17:47:40Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74613) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 29 17:51:31 user nova-compute[74613]: DEBUG nova.virt.hardware [None req-d108c1ab-fa43-4e97-b056-065e3528f377 tempest-ServerBootFromVolumeStableRescueTest-414665510 tempest-ServerBootFromVolumeStableRescueTest-414665510-project-member] Flavor limits 0:0:0 {{(pid=74613) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 29 17:51:31 user nova-compute[74613]: DEBUG nova.virt.hardware [None req-d108c1ab-fa43-4e97-b056-065e3528f377 tempest-ServerBootFromVolumeStableRescueTest-414665510 tempest-ServerBootFromVolumeStableRescueTest-414665510-project-member] Image limits 0:0:0 {{(pid=74613) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 29 17:51:31 user nova-compute[74613]: DEBUG nova.virt.hardware [None req-d108c1ab-fa43-4e97-b056-065e3528f377 tempest-ServerBootFromVolumeStableRescueTest-414665510 tempest-ServerBootFromVolumeStableRescueTest-414665510-project-member] Flavor pref 0:0:0 {{(pid=74613) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 29 17:51:31 user nova-compute[74613]: DEBUG nova.virt.hardware [None req-d108c1ab-fa43-4e97-b056-065e3528f377 tempest-ServerBootFromVolumeStableRescueTest-414665510 tempest-ServerBootFromVolumeStableRescueTest-414665510-project-member] Image pref 0:0:0 {{(pid=74613) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 29 17:51:31 user nova-compute[74613]: DEBUG nova.virt.hardware [None req-d108c1ab-fa43-4e97-b056-065e3528f377 tempest-ServerBootFromVolumeStableRescueTest-414665510 tempest-ServerBootFromVolumeStableRescueTest-414665510-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74613) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 29 17:51:31 user nova-compute[74613]: DEBUG nova.virt.hardware [None req-d108c1ab-fa43-4e97-b056-065e3528f377 tempest-ServerBootFromVolumeStableRescueTest-414665510 tempest-ServerBootFromVolumeStableRescueTest-414665510-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74613) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 29 17:51:31 user nova-compute[74613]: DEBUG nova.virt.hardware [None req-d108c1ab-fa43-4e97-b056-065e3528f377 tempest-ServerBootFromVolumeStableRescueTest-414665510 tempest-ServerBootFromVolumeStableRescueTest-414665510-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74613) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 29 17:51:31 user nova-compute[74613]: DEBUG nova.virt.hardware [None req-d108c1ab-fa43-4e97-b056-065e3528f377 tempest-ServerBootFromVolumeStableRescueTest-414665510 tempest-ServerBootFromVolumeStableRescueTest-414665510-project-member] Got 1 possible topologies {{(pid=74613) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 29 17:51:31 user nova-compute[74613]: DEBUG nova.virt.hardware [None req-d108c1ab-fa43-4e97-b056-065e3528f377 tempest-ServerBootFromVolumeStableRescueTest-414665510 tempest-ServerBootFromVolumeStableRescueTest-414665510-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74613) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 29 17:51:31 user nova-compute[74613]: DEBUG nova.virt.hardware [None req-d108c1ab-fa43-4e97-b056-065e3528f377 tempest-ServerBootFromVolumeStableRescueTest-414665510 tempest-ServerBootFromVolumeStableRescueTest-414665510-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74613) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 29 17:51:31 user sudo[84008]:    stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/nova-rootwrap /etc/nova/rootwrap.conf privsep-helper --config-file /etc/nova/nova-cpu.conf --privsep_context vif_plug_ovs.privsep.vif_plug --privsep_sock_path /tmp/tmpsk4tysoh/privsep.sock
Nov 29 17:51:31 user sudo[84008]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1001)
Nov 29 17:51:31 user nova-compute[74613]: DEBUG nova.virt.libvirt.vif [None req-d108c1ab-fa43-4e97-b056-065e3528f377 tempest-ServerBootFromVolumeStableRescueTest-414665510 tempest-ServerBootFromVolumeStableRescueTest-414665510-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T17:51:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-209698272',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-209698272',id=2,image_ref='4217f428-8d9d-4ee1-9614-642d26d90c46',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b820dd795dfe46cd804772f0e71f98e9',ramdisk_id='',reservation_id='r-duhpdsex',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='4217f428-8d9d-4ee1-9614-642d26d90c46',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-414665510',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-414665510-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T17:51:26Z,user_data=None,user_id='c65bc922e04d4d1385e48f70c460c441',uuid=3b828860-5cc5-40b0-b845-8e560211794e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "dfe097e1-192f-47e2-96b7-0e9fe8320758", "address": "fa:16:3e:c2:a8:2f", "network": {"id": "0722b02d-a357-4360-87e8-580913723985", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-579793494-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b820dd795dfe46cd804772f0e71f98e9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdfe097e1-19", "ovs_interfaceid": "dfe097e1-192f-47e2-96b7-0e9fe8320758", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74613) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 29 17:51:31 user nova-compute[74613]: DEBUG nova.network.os_vif_util [None req-d108c1ab-fa43-4e97-b056-065e3528f377 tempest-ServerBootFromVolumeStableRescueTest-414665510 tempest-ServerBootFromVolumeStableRescueTest-414665510-project-member] Converting VIF {"id": "dfe097e1-192f-47e2-96b7-0e9fe8320758", "address": "fa:16:3e:c2:a8:2f", "network": {"id": "0722b02d-a357-4360-87e8-580913723985", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-579793494-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b820dd795dfe46cd804772f0e71f98e9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdfe097e1-19", "ovs_interfaceid": "dfe097e1-192f-47e2-96b7-0e9fe8320758", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74613) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 17:51:31 user nova-compute[74613]: DEBUG nova.network.os_vif_util [None req-d108c1ab-fa43-4e97-b056-065e3528f377 tempest-ServerBootFromVolumeStableRescueTest-414665510 tempest-ServerBootFromVolumeStableRescueTest-414665510-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c2:a8:2f,bridge_name='br-int',has_traffic_filtering=True,id=dfe097e1-192f-47e2-96b7-0e9fe8320758,network=Network(0722b02d-a357-4360-87e8-580913723985),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdfe097e1-19') {{(pid=74613) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 17:51:31 user nova-compute[74613]: DEBUG nova.objects.instance [None req-d108c1ab-fa43-4e97-b056-065e3528f377 tempest-ServerBootFromVolumeStableRescueTest-414665510 tempest-ServerBootFromVolumeStableRescueTest-414665510-project-member] Lazy-loading 'pci_devices' on Instance uuid 3b828860-5cc5-40b0-b845-8e560211794e {{(pid=74613) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 17:51:31 user nova-compute[74613]: DEBUG nova.network.neutron [None req-c110aa5d-1515-4b7e-988f-f60fba232273 tempest-ServerActionsTestOtherA-1784608629 tempest-ServerActionsTestOtherA-1784608629-project-member] [instance: abc9e2b8-f467-4cd0-b40f-de511fde1ec1] Successfully updated port: 59a8bf1b-9fb1-4526-92d5-9ad1897c1ee8 {{(pid=74613) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 29 17:51:31 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-d108c1ab-fa43-4e97-b056-065e3528f377 tempest-ServerBootFromVolumeStableRescueTest-414665510 tempest-ServerBootFromVolumeStableRescueTest-414665510-project-member] [instance: 3b828860-5cc5-40b0-b845-8e560211794e] End _get_guest_xml xml=<domain type="kvm">
Nov 29 17:51:31 user nova-compute[74613]:   <uuid>3b828860-5cc5-40b0-b845-8e560211794e</uuid>
Nov 29 17:51:31 user nova-compute[74613]:   <name>instance-00000002</name>
Nov 29 17:51:31 user nova-compute[74613]:   <memory>524288</memory>
Nov 29 17:51:31 user nova-compute[74613]:   <vcpu>1</vcpu>
Nov 29 17:51:31 user nova-compute[74613]:   <metadata>
Nov 29 17:51:31 user nova-compute[74613]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 29 17:51:31 user nova-compute[74613]:       <nova:package version="0.0.0"/>
Nov 29 17:51:31 user nova-compute[74613]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-209698272</nova:name>
Nov 29 17:51:31 user nova-compute[74613]:       <nova:creationTime>2023-11-29 17:51:31</nova:creationTime>
Nov 29 17:51:31 user nova-compute[74613]:       <nova:flavor name="m1.tiny">
Nov 29 17:51:31 user nova-compute[74613]:         <nova:memory>512</nova:memory>
Nov 29 17:51:31 user nova-compute[74613]:         <nova:disk>1</nova:disk>
Nov 29 17:51:31 user nova-compute[74613]:         <nova:swap>0</nova:swap>
Nov 29 17:51:31 user nova-compute[74613]:         <nova:ephemeral>0</nova:ephemeral>
Nov 29 17:51:31 user nova-compute[74613]:         <nova:vcpus>1</nova:vcpus>
Nov 29 17:51:31 user nova-compute[74613]:       </nova:flavor>
Nov 29 17:51:31 user nova-compute[74613]:       <nova:owner>
Nov 29 17:51:31 user nova-compute[74613]:         <nova:user uuid="c65bc922e04d4d1385e48f70c460c441">tempest-ServerBootFromVolumeStableRescueTest-414665510-project-member</nova:user>
Nov 29 17:51:31 user nova-compute[74613]:         <nova:project uuid="b820dd795dfe46cd804772f0e71f98e9">tempest-ServerBootFromVolumeStableRescueTest-414665510</nova:project>
Nov 29 17:51:31 user nova-compute[74613]:       </nova:owner>
Nov 29 17:51:31 user nova-compute[74613]:       <nova:root type="image" uuid="4217f428-8d9d-4ee1-9614-642d26d90c46"/>
Nov 29 17:51:31 user nova-compute[74613]:       <nova:ports>
Nov 29 17:51:31 user nova-compute[74613]:         <nova:port uuid="dfe097e1-192f-47e2-96b7-0e9fe8320758">
Nov 29 17:51:31 user nova-compute[74613]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Nov 29 17:51:31 user nova-compute[74613]:         </nova:port>
Nov 29 17:51:31 user nova-compute[74613]:       </nova:ports>
Nov 29 17:51:31 user nova-compute[74613]:     </nova:instance>
Nov 29 17:51:31 user nova-compute[74613]:   </metadata>
Nov 29 17:51:31 user nova-compute[74613]:   <sysinfo type="smbios">
Nov 29 17:51:31 user nova-compute[74613]:     <system>
Nov 29 17:51:31 user nova-compute[74613]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 29 17:51:31 user nova-compute[74613]:       <entry name="product">OpenStack Nova</entry>
Nov 29 17:51:31 user nova-compute[74613]:       <entry name="version">0.0.0</entry>
Nov 29 17:51:31 user nova-compute[74613]:       <entry name="serial">3b828860-5cc5-40b0-b845-8e560211794e</entry>
Nov 29 17:51:31 user nova-compute[74613]:       <entry name="uuid">3b828860-5cc5-40b0-b845-8e560211794e</entry>
Nov 29 17:51:31 user nova-compute[74613]:       <entry name="family">Virtual Machine</entry>
Nov 29 17:51:31 user nova-compute[74613]:     </system>
Nov 29 17:51:31 user nova-compute[74613]:   </sysinfo>
Nov 29 17:51:31 user nova-compute[74613]:   <os>
Nov 29 17:51:31 user nova-compute[74613]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 29 17:51:31 user nova-compute[74613]:     <boot dev="hd"/>
Nov 29 17:51:31 user nova-compute[74613]:     <smbios mode="sysinfo"/>
Nov 29 17:51:31 user nova-compute[74613]:   </os>
Nov 29 17:51:31 user nova-compute[74613]:   <features>
Nov 29 17:51:31 user nova-compute[74613]:     <acpi/>
Nov 29 17:51:31 user nova-compute[74613]:     <apic/>
Nov 29 17:51:31 user nova-compute[74613]:     <vmcoreinfo/>
Nov 29 17:51:31 user nova-compute[74613]:   </features>
Nov 29 17:51:31 user nova-compute[74613]:   <clock offset="utc">
Nov 29 17:51:31 user nova-compute[74613]:     <timer name="pit" tickpolicy="delay"/>
Nov 29 17:51:31 user nova-compute[74613]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 29 17:51:31 user nova-compute[74613]:     <timer name="hpet" present="no"/>
Nov 29 17:51:31 user nova-compute[74613]:   </clock>
Nov 29 17:51:31 user nova-compute[74613]:   <cpu mode="custom" match="exact">
Nov 29 17:51:31 user nova-compute[74613]:     <model>Nehalem</model>
Nov 29 17:51:31 user nova-compute[74613]:     <topology sockets="1" cores="1" threads="1"/>
Nov 29 17:51:31 user nova-compute[74613]:   </cpu>
Nov 29 17:51:31 user nova-compute[74613]:   <devices>
Nov 29 17:51:31 user nova-compute[74613]:     <disk type="file" device="disk">
Nov 29 17:51:31 user nova-compute[74613]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 29 17:51:31 user nova-compute[74613]:       <source file="/opt/stack/data/nova/instances/3b828860-5cc5-40b0-b845-8e560211794e/disk"/>
Nov 29 17:51:31 user nova-compute[74613]:       <target dev="vda" bus="virtio"/>
Nov 29 17:51:31 user nova-compute[74613]:     </disk>
Nov 29 17:51:31 user nova-compute[74613]:     <interface type="ethernet">
Nov 29 17:51:31 user nova-compute[74613]:       <mac address="fa:16:3e:c2:a8:2f"/>
Nov 29 17:51:31 user nova-compute[74613]:       <model type="virtio"/>
Nov 29 17:51:31 user nova-compute[74613]:       <mtu size="1442"/>
Nov 29 17:51:31 user nova-compute[74613]:       <target dev="tapdfe097e1-19"/>
Nov 29 17:51:31 user nova-compute[74613]:     </interface>
Nov 29 17:51:31 user nova-compute[74613]:     <serial type="pty">
Nov 29 17:51:31 user nova-compute[74613]:       <log file="/opt/stack/data/nova/instances/3b828860-5cc5-40b0-b845-8e560211794e/console.log" append="off"/>
Nov 29 17:51:31 user nova-compute[74613]:     </serial>
Nov 29 17:51:31 user nova-compute[74613]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 29 17:51:31 user nova-compute[74613]:     <video>
Nov 29 17:51:31 user nova-compute[74613]:       <model type="virtio"/>
Nov 29 17:51:31 user nova-compute[74613]:     </video>
Nov 29 17:51:31 user nova-compute[74613]:     <rng model="virtio">
Nov 29 17:51:31 user nova-compute[74613]:       <backend model="random">/dev/urandom</backend>
Nov 29 17:51:31 user nova-compute[74613]:     </rng>
Nov 29 17:51:31 user nova-compute[74613]:     <controller type="usb" index="0" model="none"/>
Nov 29 17:51:31 user nova-compute[74613]:     <memballoon model="virtio">
Nov 29 17:51:31 user nova-compute[74613]:       <stats period="10"/>
Nov 29 17:51:31 user nova-compute[74613]:     </memballoon>
Nov 29 17:51:31 user nova-compute[74613]:   </devices>
Nov 29 17:51:31 user nova-compute[74613]: </domain>
Nov 29 17:51:31 user nova-compute[74613]:  {{(pid=74613) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 29 17:51:31 user nova-compute[74613]: DEBUG nova.virt.libvirt.vif [None req-d108c1ab-fa43-4e97-b056-065e3528f377 tempest-ServerBootFromVolumeStableRescueTest-414665510 tempest-ServerBootFromVolumeStableRescueTest-414665510-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T17:51:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-209698272',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-209698272',id=2,image_ref='4217f428-8d9d-4ee1-9614-642d26d90c46',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b820dd795dfe46cd804772f0e71f98e9',ramdisk_id='',reservation_id='r-duhpdsex',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='4217f428-8d9d-4ee1-9614-642d26d90c46',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-414665510',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-414665510-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T17:51:26Z,user_data=None,user_id='c65bc922e04d4d1385e48f70c460c441',uuid=3b828860-5cc5-40b0-b845-8e560211794e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "dfe097e1-192f-47e2-96b7-0e9fe8320758", "address": "fa:16:3e:c2:a8:2f", "network": {"id": "0722b02d-a357-4360-87e8-580913723985", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-579793494-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b820dd795dfe46cd804772f0e71f98e9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdfe097e1-19", "ovs_interfaceid": "dfe097e1-192f-47e2-96b7-0e9fe8320758", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74613) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 29 17:51:31 user nova-compute[74613]: DEBUG nova.network.os_vif_util [None req-d108c1ab-fa43-4e97-b056-065e3528f377 tempest-ServerBootFromVolumeStableRescueTest-414665510 tempest-ServerBootFromVolumeStableRescueTest-414665510-project-member] Converting VIF {"id": "dfe097e1-192f-47e2-96b7-0e9fe8320758", "address": "fa:16:3e:c2:a8:2f", "network": {"id": "0722b02d-a357-4360-87e8-580913723985", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-579793494-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b820dd795dfe46cd804772f0e71f98e9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdfe097e1-19", "ovs_interfaceid": "dfe097e1-192f-47e2-96b7-0e9fe8320758", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74613) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 17:51:31 user nova-compute[74613]: DEBUG nova.network.os_vif_util [None req-d108c1ab-fa43-4e97-b056-065e3528f377 tempest-ServerBootFromVolumeStableRescueTest-414665510 tempest-ServerBootFromVolumeStableRescueTest-414665510-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c2:a8:2f,bridge_name='br-int',has_traffic_filtering=True,id=dfe097e1-192f-47e2-96b7-0e9fe8320758,network=Network(0722b02d-a357-4360-87e8-580913723985),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdfe097e1-19') {{(pid=74613) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 17:51:31 user nova-compute[74613]: DEBUG os_vif [None req-d108c1ab-fa43-4e97-b056-065e3528f377 tempest-ServerBootFromVolumeStableRescueTest-414665510 tempest-ServerBootFromVolumeStableRescueTest-414665510-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c2:a8:2f,bridge_name='br-int',has_traffic_filtering=True,id=dfe097e1-192f-47e2-96b7-0e9fe8320758,network=Network(0722b02d-a357-4360-87e8-580913723985),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdfe097e1-19') {{(pid=74613) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 29 17:51:31 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:51:31 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74613) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 17:51:31 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74613) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 29 17:51:31 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:51:31 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'c98af0de-802c-5335-897c-65d1e882e881', '_type': 'linux-noop'}}, row=False) {{(pid=74613) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 17:51:31 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:51:31 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:51:31 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-c110aa5d-1515-4b7e-988f-f60fba232273 tempest-ServerActionsTestOtherA-1784608629 tempest-ServerActionsTestOtherA-1784608629-project-member] Acquiring lock "refresh_cache-abc9e2b8-f467-4cd0-b40f-de511fde1ec1" {{(pid=74613) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 17:51:31 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-c110aa5d-1515-4b7e-988f-f60fba232273 tempest-ServerActionsTestOtherA-1784608629 tempest-ServerActionsTestOtherA-1784608629-project-member] Acquired lock "refresh_cache-abc9e2b8-f467-4cd0-b40f-de511fde1ec1" {{(pid=74613) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 17:51:31 user nova-compute[74613]: DEBUG nova.network.neutron [None req-c110aa5d-1515-4b7e-988f-f60fba232273 tempest-ServerActionsTestOtherA-1784608629 tempest-ServerActionsTestOtherA-1784608629-project-member] [instance: abc9e2b8-f467-4cd0-b40f-de511fde1ec1] Building network info cache for instance {{(pid=74613) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 29 17:51:31 user nova-compute[74613]: DEBUG nova.network.neutron [None req-3a7ec63d-1bdf-4849-9e6b-4f290ee89c4c tempest-AttachVolumeShelveTestJSON-1452861425 tempest-AttachVolumeShelveTestJSON-1452861425-project-member] [instance: c19e230e-2e6c-4c20-b15c-ad81a73674b4] Instance cache missing network info. {{(pid=74613) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 29 17:51:31 user nova-compute[74613]: DEBUG nova.compute.manager [req-eafd92b1-a453-40a3-81ef-aeff7446eae9 req-64136c1f-812c-4885-8a9f-85efaf402dde service nova] [instance: c19e230e-2e6c-4c20-b15c-ad81a73674b4] Received event network-changed-a414bce0-6293-4987-9441-46943fe2e877 {{(pid=74613) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 17:51:31 user nova-compute[74613]: DEBUG nova.compute.manager [req-eafd92b1-a453-40a3-81ef-aeff7446eae9 req-64136c1f-812c-4885-8a9f-85efaf402dde service nova] [instance: c19e230e-2e6c-4c20-b15c-ad81a73674b4] Refreshing instance network info cache due to event network-changed-a414bce0-6293-4987-9441-46943fe2e877. {{(pid=74613) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 17:51:31 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-eafd92b1-a453-40a3-81ef-aeff7446eae9 req-64136c1f-812c-4885-8a9f-85efaf402dde service nova] Acquiring lock "refresh_cache-c19e230e-2e6c-4c20-b15c-ad81a73674b4" {{(pid=74613) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 17:51:32 user nova-compute[74613]: DEBUG nova.network.neutron [None req-31c66816-a579-4fed-917c-5fe116aeddf6 tempest-DeleteServersTestJSON-112443106 tempest-DeleteServersTestJSON-112443106-project-member] [instance: f3a5f6d2-cadd-485b-a443-1b8f3ed966b9] Updating instance_info_cache with network_info: [{"id": "49e80b78-004f-457d-aea8-8940ab6d9179", "address": "fa:16:3e:0c:43:fa", "network": {"id": "5a261b7c-1d1a-4bab-917f-f0685fe6b13d", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1710073957-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "31ff57da724840588bee7c012be00891", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap49e80b78-00", "ovs_interfaceid": "49e80b78-004f-457d-aea8-8940ab6d9179", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74613) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 17:51:32 user nova-compute[74613]: DEBUG nova.network.neutron [None req-c110aa5d-1515-4b7e-988f-f60fba232273 tempest-ServerActionsTestOtherA-1784608629 tempest-ServerActionsTestOtherA-1784608629-project-member] [instance: abc9e2b8-f467-4cd0-b40f-de511fde1ec1] Instance cache missing network info. {{(pid=74613) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 29 17:51:32 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:51:32 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-31c66816-a579-4fed-917c-5fe116aeddf6 tempest-DeleteServersTestJSON-112443106 tempest-DeleteServersTestJSON-112443106-project-member] Releasing lock "refresh_cache-f3a5f6d2-cadd-485b-a443-1b8f3ed966b9" {{(pid=74613) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 17:51:32 user nova-compute[74613]: DEBUG nova.compute.manager [None req-31c66816-a579-4fed-917c-5fe116aeddf6 tempest-DeleteServersTestJSON-112443106 tempest-DeleteServersTestJSON-112443106-project-member] [instance: f3a5f6d2-cadd-485b-a443-1b8f3ed966b9] Instance network_info: |[{"id": "49e80b78-004f-457d-aea8-8940ab6d9179", "address": "fa:16:3e:0c:43:fa", "network": {"id": "5a261b7c-1d1a-4bab-917f-f0685fe6b13d", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1710073957-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "31ff57da724840588bee7c012be00891", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap49e80b78-00", "ovs_interfaceid": "49e80b78-004f-457d-aea8-8940ab6d9179", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74613) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 29 17:51:32 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-f4683180-0d85-4c63-9f11-920946a8bd80 req-851db68e-7bd8-4a12-ae83-a4eb697bde8c service nova] Acquired lock "refresh_cache-f3a5f6d2-cadd-485b-a443-1b8f3ed966b9" {{(pid=74613) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 17:51:32 user nova-compute[74613]: DEBUG nova.network.neutron [req-f4683180-0d85-4c63-9f11-920946a8bd80 req-851db68e-7bd8-4a12-ae83-a4eb697bde8c service nova] [instance: f3a5f6d2-cadd-485b-a443-1b8f3ed966b9] Refreshing network info cache for port 49e80b78-004f-457d-aea8-8940ab6d9179 {{(pid=74613) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 17:51:32 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-31c66816-a579-4fed-917c-5fe116aeddf6 tempest-DeleteServersTestJSON-112443106 tempest-DeleteServersTestJSON-112443106-project-member] [instance: f3a5f6d2-cadd-485b-a443-1b8f3ed966b9] Start _get_guest_xml network_info=[{"id": "49e80b78-004f-457d-aea8-8940ab6d9179", "address": "fa:16:3e:0c:43:fa", "network": {"id": "5a261b7c-1d1a-4bab-917f-f0685fe6b13d", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1710073957-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "31ff57da724840588bee7c012be00891", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap49e80b78-00", "ovs_interfaceid": "49e80b78-004f-457d-aea8-8940ab6d9179", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-29T17:47:38Z,direct_url=<?>,disk_format='qcow2',id=4217f428-8d9d-4ee1-9614-642d26d90c46,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='794b07cbd46a44b5865cfda741036bae',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-29T17:47:40Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'size': 0, 'device_type': 'disk', 'boot_index': 0, 'guest_format': None, 'encrypted': False, 'encryption_format': None, 'disk_bus': 'virtio', 'image_id': '4217f428-8d9d-4ee1-9614-642d26d90c46'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74613) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 29 17:51:32 user nova-compute[74613]: WARNING nova.virt.libvirt.driver [None req-31c66816-a579-4fed-917c-5fe116aeddf6 tempest-DeleteServersTestJSON-112443106 tempest-DeleteServersTestJSON-112443106-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 17:51:32 user nova-compute[74613]: WARNING nova.virt.libvirt.driver [None req-31c66816-a579-4fed-917c-5fe116aeddf6 tempest-DeleteServersTestJSON-112443106 tempest-DeleteServersTestJSON-112443106-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 17:51:32 user nova-compute[74613]: DEBUG nova.virt.libvirt.host [None req-31c66816-a579-4fed-917c-5fe116aeddf6 tempest-DeleteServersTestJSON-112443106 tempest-DeleteServersTestJSON-112443106-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74613) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 29 17:51:32 user nova-compute[74613]: DEBUG nova.virt.libvirt.host [None req-31c66816-a579-4fed-917c-5fe116aeddf6 tempest-DeleteServersTestJSON-112443106 tempest-DeleteServersTestJSON-112443106-project-member] CPU controller missing on host. {{(pid=74613) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 29 17:51:32 user nova-compute[74613]: DEBUG nova.virt.libvirt.host [None req-31c66816-a579-4fed-917c-5fe116aeddf6 tempest-DeleteServersTestJSON-112443106 tempest-DeleteServersTestJSON-112443106-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74613) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 29 17:51:32 user nova-compute[74613]: DEBUG nova.virt.libvirt.host [None req-31c66816-a579-4fed-917c-5fe116aeddf6 tempest-DeleteServersTestJSON-112443106 tempest-DeleteServersTestJSON-112443106-project-member] CPU controller found on host. {{(pid=74613) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 29 17:51:32 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-31c66816-a579-4fed-917c-5fe116aeddf6 tempest-DeleteServersTestJSON-112443106 tempest-DeleteServersTestJSON-112443106-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74613) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 29 17:51:32 user nova-compute[74613]: DEBUG nova.virt.hardware [None req-31c66816-a579-4fed-917c-5fe116aeddf6 tempest-DeleteServersTestJSON-112443106 tempest-DeleteServersTestJSON-112443106-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-29T17:47:27Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-29T17:47:38Z,direct_url=<?>,disk_format='qcow2',id=4217f428-8d9d-4ee1-9614-642d26d90c46,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='794b07cbd46a44b5865cfda741036bae',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-29T17:47:40Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74613) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 29 17:51:32 user nova-compute[74613]: DEBUG nova.virt.hardware [None req-31c66816-a579-4fed-917c-5fe116aeddf6 tempest-DeleteServersTestJSON-112443106 tempest-DeleteServersTestJSON-112443106-project-member] Flavor limits 0:0:0 {{(pid=74613) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 29 17:51:32 user nova-compute[74613]: DEBUG nova.virt.hardware [None req-31c66816-a579-4fed-917c-5fe116aeddf6 tempest-DeleteServersTestJSON-112443106 tempest-DeleteServersTestJSON-112443106-project-member] Image limits 0:0:0 {{(pid=74613) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 29 17:51:32 user nova-compute[74613]: DEBUG nova.virt.hardware [None req-31c66816-a579-4fed-917c-5fe116aeddf6 tempest-DeleteServersTestJSON-112443106 tempest-DeleteServersTestJSON-112443106-project-member] Flavor pref 0:0:0 {{(pid=74613) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 29 17:51:32 user nova-compute[74613]: DEBUG nova.virt.hardware [None req-31c66816-a579-4fed-917c-5fe116aeddf6 tempest-DeleteServersTestJSON-112443106 tempest-DeleteServersTestJSON-112443106-project-member] Image pref 0:0:0 {{(pid=74613) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 29 17:51:32 user nova-compute[74613]: DEBUG nova.virt.hardware [None req-31c66816-a579-4fed-917c-5fe116aeddf6 tempest-DeleteServersTestJSON-112443106 tempest-DeleteServersTestJSON-112443106-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74613) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 29 17:51:32 user nova-compute[74613]: DEBUG nova.virt.hardware [None req-31c66816-a579-4fed-917c-5fe116aeddf6 tempest-DeleteServersTestJSON-112443106 tempest-DeleteServersTestJSON-112443106-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74613) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 29 17:51:32 user nova-compute[74613]: DEBUG nova.virt.hardware [None req-31c66816-a579-4fed-917c-5fe116aeddf6 tempest-DeleteServersTestJSON-112443106 tempest-DeleteServersTestJSON-112443106-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74613) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 29 17:51:32 user nova-compute[74613]: DEBUG nova.virt.hardware [None req-31c66816-a579-4fed-917c-5fe116aeddf6 tempest-DeleteServersTestJSON-112443106 tempest-DeleteServersTestJSON-112443106-project-member] Got 1 possible topologies {{(pid=74613) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 29 17:51:32 user nova-compute[74613]: DEBUG nova.virt.hardware [None req-31c66816-a579-4fed-917c-5fe116aeddf6 tempest-DeleteServersTestJSON-112443106 tempest-DeleteServersTestJSON-112443106-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74613) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 29 17:51:32 user nova-compute[74613]: DEBUG nova.virt.hardware [None req-31c66816-a579-4fed-917c-5fe116aeddf6 tempest-DeleteServersTestJSON-112443106 tempest-DeleteServersTestJSON-112443106-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74613) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 29 17:51:32 user nova-compute[74613]: DEBUG nova.virt.libvirt.vif [None req-31c66816-a579-4fed-917c-5fe116aeddf6 tempest-DeleteServersTestJSON-112443106 tempest-DeleteServersTestJSON-112443106-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T17:51:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-DeleteServersTestJSON-server-9988961',display_name='tempest-DeleteServersTestJSON-server-9988961',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-deleteserverstestjson-server-9988961',id=4,image_ref='4217f428-8d9d-4ee1-9614-642d26d90c46',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='31ff57da724840588bee7c012be00891',ramdisk_id='',reservation_id='r-0z836g30',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='4217f428-8d9d-4ee1-9614-642d26d90c46',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-DeleteServersTestJSON-112443106',owner_user_name='tempest-DeleteServersTestJSON-112443106-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T17:51:26Z,user_data=None,user_id='9e4a26c0f9d8426cb7ccb5109ef59e43',uuid=f3a5f6d2-cadd-485b-a443-1b8f3ed966b9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "49e80b78-004f-457d-aea8-8940ab6d9179", "address": "fa:16:3e:0c:43:fa", "network": {"id": "5a261b7c-1d1a-4bab-917f-f0685fe6b13d", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1710073957-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "31ff57da724840588bee7c012be00891", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap49e80b78-00", "ovs_interfaceid": "49e80b78-004f-457d-aea8-8940ab6d9179", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74613) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 29 17:51:32 user nova-compute[74613]: DEBUG nova.network.os_vif_util [None req-31c66816-a579-4fed-917c-5fe116aeddf6 tempest-DeleteServersTestJSON-112443106 tempest-DeleteServersTestJSON-112443106-project-member] Converting VIF {"id": "49e80b78-004f-457d-aea8-8940ab6d9179", "address": "fa:16:3e:0c:43:fa", "network": {"id": "5a261b7c-1d1a-4bab-917f-f0685fe6b13d", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1710073957-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "31ff57da724840588bee7c012be00891", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap49e80b78-00", "ovs_interfaceid": "49e80b78-004f-457d-aea8-8940ab6d9179", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74613) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 17:51:32 user nova-compute[74613]: DEBUG nova.network.os_vif_util [None req-31c66816-a579-4fed-917c-5fe116aeddf6 tempest-DeleteServersTestJSON-112443106 tempest-DeleteServersTestJSON-112443106-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0c:43:fa,bridge_name='br-int',has_traffic_filtering=True,id=49e80b78-004f-457d-aea8-8940ab6d9179,network=Network(5a261b7c-1d1a-4bab-917f-f0685fe6b13d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap49e80b78-00') {{(pid=74613) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 17:51:32 user nova-compute[74613]: DEBUG nova.objects.instance [None req-31c66816-a579-4fed-917c-5fe116aeddf6 tempest-DeleteServersTestJSON-112443106 tempest-DeleteServersTestJSON-112443106-project-member] Lazy-loading 'pci_devices' on Instance uuid f3a5f6d2-cadd-485b-a443-1b8f3ed966b9 {{(pid=74613) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 17:51:32 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-31c66816-a579-4fed-917c-5fe116aeddf6 tempest-DeleteServersTestJSON-112443106 tempest-DeleteServersTestJSON-112443106-project-member] [instance: f3a5f6d2-cadd-485b-a443-1b8f3ed966b9] End _get_guest_xml xml=<domain type="kvm">
Nov 29 17:51:32 user nova-compute[74613]:   <uuid>f3a5f6d2-cadd-485b-a443-1b8f3ed966b9</uuid>
Nov 29 17:51:32 user nova-compute[74613]:   <name>instance-00000004</name>
Nov 29 17:51:32 user nova-compute[74613]:   <memory>524288</memory>
Nov 29 17:51:32 user nova-compute[74613]:   <vcpu>1</vcpu>
Nov 29 17:51:32 user nova-compute[74613]:   <metadata>
Nov 29 17:51:32 user nova-compute[74613]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 29 17:51:32 user nova-compute[74613]:       <nova:package version="0.0.0"/>
Nov 29 17:51:32 user nova-compute[74613]:       <nova:name>tempest-DeleteServersTestJSON-server-9988961</nova:name>
Nov 29 17:51:32 user nova-compute[74613]:       <nova:creationTime>2023-11-29 17:51:32</nova:creationTime>
Nov 29 17:51:32 user nova-compute[74613]:       <nova:flavor name="m1.tiny">
Nov 29 17:51:32 user nova-compute[74613]:         <nova:memory>512</nova:memory>
Nov 29 17:51:32 user nova-compute[74613]:         <nova:disk>1</nova:disk>
Nov 29 17:51:32 user nova-compute[74613]:         <nova:swap>0</nova:swap>
Nov 29 17:51:32 user nova-compute[74613]:         <nova:ephemeral>0</nova:ephemeral>
Nov 29 17:51:32 user nova-compute[74613]:         <nova:vcpus>1</nova:vcpus>
Nov 29 17:51:32 user nova-compute[74613]:       </nova:flavor>
Nov 29 17:51:32 user nova-compute[74613]:       <nova:owner>
Nov 29 17:51:32 user nova-compute[74613]:         <nova:user uuid="9e4a26c0f9d8426cb7ccb5109ef59e43">tempest-DeleteServersTestJSON-112443106-project-member</nova:user>
Nov 29 17:51:32 user nova-compute[74613]:         <nova:project uuid="31ff57da724840588bee7c012be00891">tempest-DeleteServersTestJSON-112443106</nova:project>
Nov 29 17:51:32 user nova-compute[74613]:       </nova:owner>
Nov 29 17:51:32 user nova-compute[74613]:       <nova:root type="image" uuid="4217f428-8d9d-4ee1-9614-642d26d90c46"/>
Nov 29 17:51:32 user nova-compute[74613]:       <nova:ports>
Nov 29 17:51:32 user nova-compute[74613]:         <nova:port uuid="49e80b78-004f-457d-aea8-8940ab6d9179">
Nov 29 17:51:32 user nova-compute[74613]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Nov 29 17:51:32 user nova-compute[74613]:         </nova:port>
Nov 29 17:51:32 user nova-compute[74613]:       </nova:ports>
Nov 29 17:51:32 user nova-compute[74613]:     </nova:instance>
Nov 29 17:51:32 user nova-compute[74613]:   </metadata>
Nov 29 17:51:32 user nova-compute[74613]:   <sysinfo type="smbios">
Nov 29 17:51:32 user nova-compute[74613]:     <system>
Nov 29 17:51:32 user nova-compute[74613]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 29 17:51:32 user nova-compute[74613]:       <entry name="product">OpenStack Nova</entry>
Nov 29 17:51:32 user nova-compute[74613]:       <entry name="version">0.0.0</entry>
Nov 29 17:51:32 user nova-compute[74613]:       <entry name="serial">f3a5f6d2-cadd-485b-a443-1b8f3ed966b9</entry>
Nov 29 17:51:32 user nova-compute[74613]:       <entry name="uuid">f3a5f6d2-cadd-485b-a443-1b8f3ed966b9</entry>
Nov 29 17:51:32 user nova-compute[74613]:       <entry name="family">Virtual Machine</entry>
Nov 29 17:51:32 user nova-compute[74613]:     </system>
Nov 29 17:51:32 user nova-compute[74613]:   </sysinfo>
Nov 29 17:51:32 user nova-compute[74613]:   <os>
Nov 29 17:51:32 user nova-compute[74613]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 29 17:51:32 user nova-compute[74613]:     <boot dev="hd"/>
Nov 29 17:51:32 user nova-compute[74613]:     <smbios mode="sysinfo"/>
Nov 29 17:51:32 user nova-compute[74613]:   </os>
Nov 29 17:51:32 user nova-compute[74613]:   <features>
Nov 29 17:51:32 user nova-compute[74613]:     <acpi/>
Nov 29 17:51:32 user nova-compute[74613]:     <apic/>
Nov 29 17:51:32 user nova-compute[74613]:     <vmcoreinfo/>
Nov 29 17:51:32 user nova-compute[74613]:   </features>
Nov 29 17:51:32 user nova-compute[74613]:   <clock offset="utc">
Nov 29 17:51:32 user nova-compute[74613]:     <timer name="pit" tickpolicy="delay"/>
Nov 29 17:51:32 user nova-compute[74613]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 29 17:51:32 user nova-compute[74613]:     <timer name="hpet" present="no"/>
Nov 29 17:51:32 user nova-compute[74613]:   </clock>
Nov 29 17:51:32 user nova-compute[74613]:   <cpu mode="custom" match="exact">
Nov 29 17:51:32 user nova-compute[74613]:     <model>Nehalem</model>
Nov 29 17:51:32 user nova-compute[74613]:     <topology sockets="1" cores="1" threads="1"/>
Nov 29 17:51:32 user nova-compute[74613]:   </cpu>
Nov 29 17:51:32 user nova-compute[74613]:   <devices>
Nov 29 17:51:32 user nova-compute[74613]:     <disk type="file" device="disk">
Nov 29 17:51:32 user nova-compute[74613]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 29 17:51:32 user nova-compute[74613]:       <source file="/opt/stack/data/nova/instances/f3a5f6d2-cadd-485b-a443-1b8f3ed966b9/disk"/>
Nov 29 17:51:32 user nova-compute[74613]:       <target dev="vda" bus="virtio"/>
Nov 29 17:51:32 user nova-compute[74613]:     </disk>
Nov 29 17:51:32 user nova-compute[74613]:     <interface type="ethernet">
Nov 29 17:51:32 user nova-compute[74613]:       <mac address="fa:16:3e:0c:43:fa"/>
Nov 29 17:51:32 user nova-compute[74613]:       <model type="virtio"/>
Nov 29 17:51:32 user nova-compute[74613]:       <mtu size="1442"/>
Nov 29 17:51:32 user nova-compute[74613]:       <target dev="tap49e80b78-00"/>
Nov 29 17:51:32 user nova-compute[74613]:     </interface>
Nov 29 17:51:32 user nova-compute[74613]:     <serial type="pty">
Nov 29 17:51:32 user nova-compute[74613]:       <log file="/opt/stack/data/nova/instances/f3a5f6d2-cadd-485b-a443-1b8f3ed966b9/console.log" append="off"/>
Nov 29 17:51:32 user nova-compute[74613]:     </serial>
Nov 29 17:51:32 user nova-compute[74613]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 29 17:51:32 user nova-compute[74613]:     <video>
Nov 29 17:51:32 user nova-compute[74613]:       <model type="virtio"/>
Nov 29 17:51:32 user nova-compute[74613]:     </video>
Nov 29 17:51:32 user nova-compute[74613]:     <rng model="virtio">
Nov 29 17:51:32 user nova-compute[74613]:       <backend model="random">/dev/urandom</backend>
Nov 29 17:51:32 user nova-compute[74613]:     </rng>
Nov 29 17:51:32 user nova-compute[74613]:     <controller type="usb" index="0" model="none"/>
Nov 29 17:51:32 user nova-compute[74613]:     <memballoon model="virtio">
Nov 29 17:51:32 user nova-compute[74613]:       <stats period="10"/>
Nov 29 17:51:32 user nova-compute[74613]:     </memballoon>
Nov 29 17:51:32 user nova-compute[74613]:   </devices>
Nov 29 17:51:32 user nova-compute[74613]: </domain>
Nov 29 17:51:32 user nova-compute[74613]:  {{(pid=74613) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 29 17:51:32 user nova-compute[74613]: DEBUG nova.virt.libvirt.vif [None req-31c66816-a579-4fed-917c-5fe116aeddf6 tempest-DeleteServersTestJSON-112443106 tempest-DeleteServersTestJSON-112443106-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T17:51:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-DeleteServersTestJSON-server-9988961',display_name='tempest-DeleteServersTestJSON-server-9988961',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-deleteserverstestjson-server-9988961',id=4,image_ref='4217f428-8d9d-4ee1-9614-642d26d90c46',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='31ff57da724840588bee7c012be00891',ramdisk_id='',reservation_id='r-0z836g30',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='4217f428-8d9d-4ee1-9614-642d26d90c46',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-DeleteServersTestJSON-112443106',owner_user_name='tempest-DeleteServersTestJSON-112443106-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T17:51:26Z,user_data=None,user_id='9e4a26c0f9d8426cb7ccb5109ef59e43',uuid=f3a5f6d2-cadd-485b-a443-1b8f3ed966b9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "49e80b78-004f-457d-aea8-8940ab6d9179", "address": "fa:16:3e:0c:43:fa", "network": {"id": "5a261b7c-1d1a-4bab-917f-f0685fe6b13d", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1710073957-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "31ff57da724840588bee7c012be00891", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap49e80b78-00", "ovs_interfaceid": "49e80b78-004f-457d-aea8-8940ab6d9179", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74613) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 29 17:51:32 user nova-compute[74613]: DEBUG nova.network.os_vif_util [None req-31c66816-a579-4fed-917c-5fe116aeddf6 tempest-DeleteServersTestJSON-112443106 tempest-DeleteServersTestJSON-112443106-project-member] Converting VIF {"id": "49e80b78-004f-457d-aea8-8940ab6d9179", "address": "fa:16:3e:0c:43:fa", "network": {"id": "5a261b7c-1d1a-4bab-917f-f0685fe6b13d", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1710073957-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "31ff57da724840588bee7c012be00891", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap49e80b78-00", "ovs_interfaceid": "49e80b78-004f-457d-aea8-8940ab6d9179", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74613) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 17:51:32 user nova-compute[74613]: DEBUG nova.network.os_vif_util [None req-31c66816-a579-4fed-917c-5fe116aeddf6 tempest-DeleteServersTestJSON-112443106 tempest-DeleteServersTestJSON-112443106-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0c:43:fa,bridge_name='br-int',has_traffic_filtering=True,id=49e80b78-004f-457d-aea8-8940ab6d9179,network=Network(5a261b7c-1d1a-4bab-917f-f0685fe6b13d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap49e80b78-00') {{(pid=74613) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 17:51:32 user nova-compute[74613]: DEBUG os_vif [None req-31c66816-a579-4fed-917c-5fe116aeddf6 tempest-DeleteServersTestJSON-112443106 tempest-DeleteServersTestJSON-112443106-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:0c:43:fa,bridge_name='br-int',has_traffic_filtering=True,id=49e80b78-004f-457d-aea8-8940ab6d9179,network=Network(5a261b7c-1d1a-4bab-917f-f0685fe6b13d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap49e80b78-00') {{(pid=74613) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 29 17:51:32 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:51:32 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74613) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 17:51:32 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74613) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 29 17:51:32 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:51:32 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'a30d68a7-b38d-569f-b834-d49bffa83891', '_type': 'linux-noop'}}, row=False) {{(pid=74613) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 17:51:32 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:51:32 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 17:51:32 user nova-compute[74613]: DEBUG nova.network.neutron [req-e010c327-2c1b-40f7-8b3e-f81483cee9f4 req-56791e93-d04c-4f81-b83f-1856410b16e0 service nova] [instance: b6b0ba36-ad89-45f1-9578-8b999567dd25] Updated VIF entry in instance network info cache for port 0167e253-42dd-486a-8231-a8b8199f3584. {{(pid=74613) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 17:51:32 user nova-compute[74613]: DEBUG nova.network.neutron [req-e010c327-2c1b-40f7-8b3e-f81483cee9f4 req-56791e93-d04c-4f81-b83f-1856410b16e0 service nova] [instance: b6b0ba36-ad89-45f1-9578-8b999567dd25] Updating instance_info_cache with network_info: [{"id": "0167e253-42dd-486a-8231-a8b8199f3584", "address": "fa:16:3e:3f:ea:5d", "network": {"id": "880ea498-5e4e-4786-a894-bac0f42572f4", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1846928198-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b8f184c16b5348beb2dc9e6359a47651", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0167e253-42", "ovs_interfaceid": "0167e253-42dd-486a-8231-a8b8199f3584", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74613) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 17:51:32 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-e010c327-2c1b-40f7-8b3e-f81483cee9f4 req-56791e93-d04c-4f81-b83f-1856410b16e0 service nova] Releasing lock "refresh_cache-b6b0ba36-ad89-45f1-9578-8b999567dd25" {{(pid=74613) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 17:51:32 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:51:32 user nova-compute[74613]: DEBUG nova.compute.manager [req-924b14d8-bced-462f-946d-82861b68fdc8 req-537142e1-1ea9-4cd4-8128-ccf38e7077d4 service nova] [instance: 3b828860-5cc5-40b0-b845-8e560211794e] Received event network-changed-dfe097e1-192f-47e2-96b7-0e9fe8320758 {{(pid=74613) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 17:51:32 user nova-compute[74613]: DEBUG nova.compute.manager [req-924b14d8-bced-462f-946d-82861b68fdc8 req-537142e1-1ea9-4cd4-8128-ccf38e7077d4 service nova] [instance: 3b828860-5cc5-40b0-b845-8e560211794e] Refreshing instance network info cache due to event network-changed-dfe097e1-192f-47e2-96b7-0e9fe8320758. {{(pid=74613) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 17:51:32 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-924b14d8-bced-462f-946d-82861b68fdc8 req-537142e1-1ea9-4cd4-8128-ccf38e7077d4 service nova] Acquiring lock "refresh_cache-3b828860-5cc5-40b0-b845-8e560211794e" {{(pid=74613) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 17:51:32 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-924b14d8-bced-462f-946d-82861b68fdc8 req-537142e1-1ea9-4cd4-8128-ccf38e7077d4 service nova] Acquired lock "refresh_cache-3b828860-5cc5-40b0-b845-8e560211794e" {{(pid=74613) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 17:51:32 user nova-compute[74613]: DEBUG nova.network.neutron [req-924b14d8-bced-462f-946d-82861b68fdc8 req-537142e1-1ea9-4cd4-8128-ccf38e7077d4 service nova] [instance: 3b828860-5cc5-40b0-b845-8e560211794e] Refreshing network info cache for port dfe097e1-192f-47e2-96b7-0e9fe8320758 {{(pid=74613) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 17:51:32 user nova-compute[74613]: DEBUG nova.network.neutron [None req-3a7ec63d-1bdf-4849-9e6b-4f290ee89c4c tempest-AttachVolumeShelveTestJSON-1452861425 tempest-AttachVolumeShelveTestJSON-1452861425-project-member] [instance: c19e230e-2e6c-4c20-b15c-ad81a73674b4] Updating instance_info_cache with network_info: [{"id": "a414bce0-6293-4987-9441-46943fe2e877", "address": "fa:16:3e:8e:94:32", "network": {"id": "4a101f3e-d23e-4198-bc3c-b4f9b4d2b4c4", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-864151424-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1c0c1c71400549369c1b11ca7d5f43ec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa414bce0-62", "ovs_interfaceid": "a414bce0-6293-4987-9441-46943fe2e877", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74613) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 17:51:32 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-3a7ec63d-1bdf-4849-9e6b-4f290ee89c4c tempest-AttachVolumeShelveTestJSON-1452861425 tempest-AttachVolumeShelveTestJSON-1452861425-project-member] Releasing lock "refresh_cache-c19e230e-2e6c-4c20-b15c-ad81a73674b4" {{(pid=74613) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 17:51:32 user nova-compute[74613]: DEBUG nova.compute.manager [None req-3a7ec63d-1bdf-4849-9e6b-4f290ee89c4c tempest-AttachVolumeShelveTestJSON-1452861425 tempest-AttachVolumeShelveTestJSON-1452861425-project-member] [instance: c19e230e-2e6c-4c20-b15c-ad81a73674b4] Instance network_info: |[{"id": "a414bce0-6293-4987-9441-46943fe2e877", "address": "fa:16:3e:8e:94:32", "network": {"id": "4a101f3e-d23e-4198-bc3c-b4f9b4d2b4c4", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-864151424-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1c0c1c71400549369c1b11ca7d5f43ec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa414bce0-62", "ovs_interfaceid": "a414bce0-6293-4987-9441-46943fe2e877", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74613) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 29 17:51:32 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-eafd92b1-a453-40a3-81ef-aeff7446eae9 req-64136c1f-812c-4885-8a9f-85efaf402dde service nova] Acquired lock "refresh_cache-c19e230e-2e6c-4c20-b15c-ad81a73674b4" {{(pid=74613) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 17:51:32 user nova-compute[74613]: DEBUG nova.network.neutron [req-eafd92b1-a453-40a3-81ef-aeff7446eae9 req-64136c1f-812c-4885-8a9f-85efaf402dde service nova] [instance: c19e230e-2e6c-4c20-b15c-ad81a73674b4] Refreshing network info cache for port a414bce0-6293-4987-9441-46943fe2e877 {{(pid=74613) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 17:51:32 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-3a7ec63d-1bdf-4849-9e6b-4f290ee89c4c tempest-AttachVolumeShelveTestJSON-1452861425 tempest-AttachVolumeShelveTestJSON-1452861425-project-member] [instance: c19e230e-2e6c-4c20-b15c-ad81a73674b4] Start _get_guest_xml network_info=[{"id": "a414bce0-6293-4987-9441-46943fe2e877", "address": "fa:16:3e:8e:94:32", "network": {"id": "4a101f3e-d23e-4198-bc3c-b4f9b4d2b4c4", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-864151424-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1c0c1c71400549369c1b11ca7d5f43ec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa414bce0-62", "ovs_interfaceid": "a414bce0-6293-4987-9441-46943fe2e877", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-29T17:47:38Z,direct_url=<?>,disk_format='qcow2',id=4217f428-8d9d-4ee1-9614-642d26d90c46,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='794b07cbd46a44b5865cfda741036bae',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-29T17:47:40Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'size': 0, 'device_type': 'disk', 'boot_index': 0, 'guest_format': None, 'encrypted': False, 'encryption_format': None, 'disk_bus': 'virtio', 'image_id': '4217f428-8d9d-4ee1-9614-642d26d90c46'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74613) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 29 17:51:32 user nova-compute[74613]: WARNING nova.virt.libvirt.driver [None req-3a7ec63d-1bdf-4849-9e6b-4f290ee89c4c tempest-AttachVolumeShelveTestJSON-1452861425 tempest-AttachVolumeShelveTestJSON-1452861425-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 17:51:32 user nova-compute[74613]: WARNING nova.virt.libvirt.driver [None req-3a7ec63d-1bdf-4849-9e6b-4f290ee89c4c tempest-AttachVolumeShelveTestJSON-1452861425 tempest-AttachVolumeShelveTestJSON-1452861425-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 17:51:32 user nova-compute[74613]: DEBUG nova.virt.libvirt.host [None req-3a7ec63d-1bdf-4849-9e6b-4f290ee89c4c tempest-AttachVolumeShelveTestJSON-1452861425 tempest-AttachVolumeShelveTestJSON-1452861425-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74613) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 29 17:51:32 user nova-compute[74613]: DEBUG nova.virt.libvirt.host [None req-3a7ec63d-1bdf-4849-9e6b-4f290ee89c4c tempest-AttachVolumeShelveTestJSON-1452861425 tempest-AttachVolumeShelveTestJSON-1452861425-project-member] CPU controller missing on host. {{(pid=74613) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 29 17:51:32 user nova-compute[74613]: DEBUG nova.virt.libvirt.host [None req-3a7ec63d-1bdf-4849-9e6b-4f290ee89c4c tempest-AttachVolumeShelveTestJSON-1452861425 tempest-AttachVolumeShelveTestJSON-1452861425-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74613) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 29 17:51:32 user nova-compute[74613]: DEBUG nova.virt.libvirt.host [None req-3a7ec63d-1bdf-4849-9e6b-4f290ee89c4c tempest-AttachVolumeShelveTestJSON-1452861425 tempest-AttachVolumeShelveTestJSON-1452861425-project-member] CPU controller found on host. {{(pid=74613) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 29 17:51:32 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-3a7ec63d-1bdf-4849-9e6b-4f290ee89c4c tempest-AttachVolumeShelveTestJSON-1452861425 tempest-AttachVolumeShelveTestJSON-1452861425-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74613) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 29 17:51:32 user nova-compute[74613]: DEBUG nova.virt.hardware [None req-3a7ec63d-1bdf-4849-9e6b-4f290ee89c4c tempest-AttachVolumeShelveTestJSON-1452861425 tempest-AttachVolumeShelveTestJSON-1452861425-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-29T17:47:27Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-29T17:47:38Z,direct_url=<?>,disk_format='qcow2',id=4217f428-8d9d-4ee1-9614-642d26d90c46,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='794b07cbd46a44b5865cfda741036bae',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-29T17:47:40Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74613) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 29 17:51:32 user nova-compute[74613]: DEBUG nova.virt.hardware [None req-3a7ec63d-1bdf-4849-9e6b-4f290ee89c4c tempest-AttachVolumeShelveTestJSON-1452861425 tempest-AttachVolumeShelveTestJSON-1452861425-project-member] Flavor limits 0:0:0 {{(pid=74613) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 29 17:51:32 user nova-compute[74613]: DEBUG nova.virt.hardware [None req-3a7ec63d-1bdf-4849-9e6b-4f290ee89c4c tempest-AttachVolumeShelveTestJSON-1452861425 tempest-AttachVolumeShelveTestJSON-1452861425-project-member] Image limits 0:0:0 {{(pid=74613) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 29 17:51:32 user nova-compute[74613]: DEBUG nova.virt.hardware [None req-3a7ec63d-1bdf-4849-9e6b-4f290ee89c4c tempest-AttachVolumeShelveTestJSON-1452861425 tempest-AttachVolumeShelveTestJSON-1452861425-project-member] Flavor pref 0:0:0 {{(pid=74613) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 29 17:51:32 user nova-compute[74613]: DEBUG nova.virt.hardware [None req-3a7ec63d-1bdf-4849-9e6b-4f290ee89c4c tempest-AttachVolumeShelveTestJSON-1452861425 tempest-AttachVolumeShelveTestJSON-1452861425-project-member] Image pref 0:0:0 {{(pid=74613) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 29 17:51:32 user nova-compute[74613]: DEBUG nova.virt.hardware [None req-3a7ec63d-1bdf-4849-9e6b-4f290ee89c4c tempest-AttachVolumeShelveTestJSON-1452861425 tempest-AttachVolumeShelveTestJSON-1452861425-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74613) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 29 17:51:32 user nova-compute[74613]: DEBUG nova.virt.hardware [None req-3a7ec63d-1bdf-4849-9e6b-4f290ee89c4c tempest-AttachVolumeShelveTestJSON-1452861425 tempest-AttachVolumeShelveTestJSON-1452861425-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74613) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 29 17:51:32 user nova-compute[74613]: DEBUG nova.virt.hardware [None req-3a7ec63d-1bdf-4849-9e6b-4f290ee89c4c tempest-AttachVolumeShelveTestJSON-1452861425 tempest-AttachVolumeShelveTestJSON-1452861425-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74613) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 29 17:51:32 user nova-compute[74613]: DEBUG nova.virt.hardware [None req-3a7ec63d-1bdf-4849-9e6b-4f290ee89c4c tempest-AttachVolumeShelveTestJSON-1452861425 tempest-AttachVolumeShelveTestJSON-1452861425-project-member] Got 1 possible topologies {{(pid=74613) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 29 17:51:32 user nova-compute[74613]: DEBUG nova.virt.hardware [None req-3a7ec63d-1bdf-4849-9e6b-4f290ee89c4c tempest-AttachVolumeShelveTestJSON-1452861425 tempest-AttachVolumeShelveTestJSON-1452861425-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74613) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 29 17:51:32 user nova-compute[74613]: DEBUG nova.virt.hardware [None req-3a7ec63d-1bdf-4849-9e6b-4f290ee89c4c tempest-AttachVolumeShelveTestJSON-1452861425 tempest-AttachVolumeShelveTestJSON-1452861425-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74613) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 29 17:51:32 user nova-compute[74613]: DEBUG nova.virt.libvirt.vif [None req-3a7ec63d-1bdf-4849-9e6b-4f290ee89c4c tempest-AttachVolumeShelveTestJSON-1452861425 tempest-AttachVolumeShelveTestJSON-1452861425-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T17:51:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-705281655',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-705281655',id=3,image_ref='4217f428-8d9d-4ee1-9614-642d26d90c46',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLofinuzL4KIe2/FJI/rOzpr08YCyh/7umJCTHDfb/8b61GmXnBJ32Swg1dTDe95ImRcaYamLXrnnmDILi1vgJuezNA9fzD/sJhWrgADbQSCHdOnl0SlzP290n0Y8JsPZA==',key_name='tempest-keypair-248065239',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1c0c1c71400549369c1b11ca7d5f43ec',ramdisk_id='',reservation_id='r-ab112qsi',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='4217f428-8d9d-4ee1-9614-642d26d90c46',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-1452861425',owner_user_name='tempest-AttachVolumeShelveTestJSON-1452861425-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T17:51:26Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='45192488dde84ebfbcacfdbd4f898799',uuid=c19e230e-2e6c-4c20-b15c-ad81a73674b4,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a414bce0-6293-4987-9441-46943fe2e877", "address": "fa:16:3e:8e:94:32", "network": {"id": "4a101f3e-d23e-4198-bc3c-b4f9b4d2b4c4", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-864151424-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1c0c1c71400549369c1b11ca7d5f43ec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa414bce0-62", "ovs_interfaceid": "a414bce0-6293-4987-9441-46943fe2e877", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74613) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 29 17:51:32 user nova-compute[74613]: DEBUG nova.network.os_vif_util [None req-3a7ec63d-1bdf-4849-9e6b-4f290ee89c4c tempest-AttachVolumeShelveTestJSON-1452861425 tempest-AttachVolumeShelveTestJSON-1452861425-project-member] Converting VIF {"id": "a414bce0-6293-4987-9441-46943fe2e877", "address": "fa:16:3e:8e:94:32", "network": {"id": "4a101f3e-d23e-4198-bc3c-b4f9b4d2b4c4", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-864151424-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1c0c1c71400549369c1b11ca7d5f43ec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa414bce0-62", "ovs_interfaceid": "a414bce0-6293-4987-9441-46943fe2e877", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74613) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 17:51:32 user nova-compute[74613]: DEBUG nova.network.os_vif_util [None req-3a7ec63d-1bdf-4849-9e6b-4f290ee89c4c tempest-AttachVolumeShelveTestJSON-1452861425 tempest-AttachVolumeShelveTestJSON-1452861425-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8e:94:32,bridge_name='br-int',has_traffic_filtering=True,id=a414bce0-6293-4987-9441-46943fe2e877,network=Network(4a101f3e-d23e-4198-bc3c-b4f9b4d2b4c4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa414bce0-62') {{(pid=74613) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 17:51:32 user nova-compute[74613]: DEBUG nova.objects.instance [None req-3a7ec63d-1bdf-4849-9e6b-4f290ee89c4c tempest-AttachVolumeShelveTestJSON-1452861425 tempest-AttachVolumeShelveTestJSON-1452861425-project-member] Lazy-loading 'pci_devices' on Instance uuid c19e230e-2e6c-4c20-b15c-ad81a73674b4 {{(pid=74613) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 17:51:32 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-3a7ec63d-1bdf-4849-9e6b-4f290ee89c4c tempest-AttachVolumeShelveTestJSON-1452861425 tempest-AttachVolumeShelveTestJSON-1452861425-project-member] [instance: c19e230e-2e6c-4c20-b15c-ad81a73674b4] End _get_guest_xml xml=<domain type="kvm">
Nov 29 17:51:32 user nova-compute[74613]:   <uuid>c19e230e-2e6c-4c20-b15c-ad81a73674b4</uuid>
Nov 29 17:51:32 user nova-compute[74613]:   <name>instance-00000003</name>
Nov 29 17:51:32 user nova-compute[74613]:   <memory>524288</memory>
Nov 29 17:51:32 user nova-compute[74613]:   <vcpu>1</vcpu>
Nov 29 17:51:32 user nova-compute[74613]:   <metadata>
Nov 29 17:51:32 user nova-compute[74613]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 29 17:51:32 user nova-compute[74613]:       <nova:package version="0.0.0"/>
Nov 29 17:51:32 user nova-compute[74613]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-705281655</nova:name>
Nov 29 17:51:32 user nova-compute[74613]:       <nova:creationTime>2023-11-29 17:51:32</nova:creationTime>
Nov 29 17:51:32 user nova-compute[74613]:       <nova:flavor name="m1.tiny">
Nov 29 17:51:32 user nova-compute[74613]:         <nova:memory>512</nova:memory>
Nov 29 17:51:32 user nova-compute[74613]:         <nova:disk>1</nova:disk>
Nov 29 17:51:32 user nova-compute[74613]:         <nova:swap>0</nova:swap>
Nov 29 17:51:32 user nova-compute[74613]:         <nova:ephemeral>0</nova:ephemeral>
Nov 29 17:51:32 user nova-compute[74613]:         <nova:vcpus>1</nova:vcpus>
Nov 29 17:51:32 user nova-compute[74613]:       </nova:flavor>
Nov 29 17:51:32 user nova-compute[74613]:       <nova:owner>
Nov 29 17:51:32 user nova-compute[74613]:         <nova:user uuid="45192488dde84ebfbcacfdbd4f898799">tempest-AttachVolumeShelveTestJSON-1452861425-project-member</nova:user>
Nov 29 17:51:32 user nova-compute[74613]:         <nova:project uuid="1c0c1c71400549369c1b11ca7d5f43ec">tempest-AttachVolumeShelveTestJSON-1452861425</nova:project>
Nov 29 17:51:32 user nova-compute[74613]:       </nova:owner>
Nov 29 17:51:32 user nova-compute[74613]:       <nova:root type="image" uuid="4217f428-8d9d-4ee1-9614-642d26d90c46"/>
Nov 29 17:51:32 user nova-compute[74613]:       <nova:ports>
Nov 29 17:51:32 user nova-compute[74613]:         <nova:port uuid="a414bce0-6293-4987-9441-46943fe2e877">
Nov 29 17:51:32 user nova-compute[74613]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Nov 29 17:51:32 user nova-compute[74613]:         </nova:port>
Nov 29 17:51:32 user nova-compute[74613]:       </nova:ports>
Nov 29 17:51:32 user nova-compute[74613]:     </nova:instance>
Nov 29 17:51:32 user nova-compute[74613]:   </metadata>
Nov 29 17:51:32 user nova-compute[74613]:   <sysinfo type="smbios">
Nov 29 17:51:32 user nova-compute[74613]:     <system>
Nov 29 17:51:32 user nova-compute[74613]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 29 17:51:32 user nova-compute[74613]:       <entry name="product">OpenStack Nova</entry>
Nov 29 17:51:32 user nova-compute[74613]:       <entry name="version">0.0.0</entry>
Nov 29 17:51:32 user nova-compute[74613]:       <entry name="serial">c19e230e-2e6c-4c20-b15c-ad81a73674b4</entry>
Nov 29 17:51:32 user nova-compute[74613]:       <entry name="uuid">c19e230e-2e6c-4c20-b15c-ad81a73674b4</entry>
Nov 29 17:51:32 user nova-compute[74613]:       <entry name="family">Virtual Machine</entry>
Nov 29 17:51:32 user nova-compute[74613]:     </system>
Nov 29 17:51:32 user nova-compute[74613]:   </sysinfo>
Nov 29 17:51:32 user nova-compute[74613]:   <os>
Nov 29 17:51:32 user nova-compute[74613]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 29 17:51:32 user nova-compute[74613]:     <boot dev="hd"/>
Nov 29 17:51:32 user nova-compute[74613]:     <smbios mode="sysinfo"/>
Nov 29 17:51:32 user nova-compute[74613]:   </os>
Nov 29 17:51:32 user nova-compute[74613]:   <features>
Nov 29 17:51:32 user nova-compute[74613]:     <acpi/>
Nov 29 17:51:32 user nova-compute[74613]:     <apic/>
Nov 29 17:51:32 user nova-compute[74613]:     <vmcoreinfo/>
Nov 29 17:51:32 user nova-compute[74613]:   </features>
Nov 29 17:51:32 user nova-compute[74613]:   <clock offset="utc">
Nov 29 17:51:32 user nova-compute[74613]:     <timer name="pit" tickpolicy="delay"/>
Nov 29 17:51:32 user nova-compute[74613]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 29 17:51:32 user nova-compute[74613]:     <timer name="hpet" present="no"/>
Nov 29 17:51:32 user nova-compute[74613]:   </clock>
Nov 29 17:51:32 user nova-compute[74613]:   <cpu mode="custom" match="exact">
Nov 29 17:51:32 user nova-compute[74613]:     <model>Nehalem</model>
Nov 29 17:51:32 user nova-compute[74613]:     <topology sockets="1" cores="1" threads="1"/>
Nov 29 17:51:32 user nova-compute[74613]:   </cpu>
Nov 29 17:51:32 user nova-compute[74613]:   <devices>
Nov 29 17:51:32 user nova-compute[74613]:     <disk type="file" device="disk">
Nov 29 17:51:32 user nova-compute[74613]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 29 17:51:32 user nova-compute[74613]:       <source file="/opt/stack/data/nova/instances/c19e230e-2e6c-4c20-b15c-ad81a73674b4/disk"/>
Nov 29 17:51:32 user nova-compute[74613]:       <target dev="vda" bus="virtio"/>
Nov 29 17:51:32 user nova-compute[74613]:     </disk>
Nov 29 17:51:32 user nova-compute[74613]:     <interface type="ethernet">
Nov 29 17:51:32 user nova-compute[74613]:       <mac address="fa:16:3e:8e:94:32"/>
Nov 29 17:51:32 user nova-compute[74613]:       <model type="virtio"/>
Nov 29 17:51:32 user nova-compute[74613]:       <mtu size="1442"/>
Nov 29 17:51:32 user nova-compute[74613]:       <target dev="tapa414bce0-62"/>
Nov 29 17:51:32 user nova-compute[74613]:     </interface>
Nov 29 17:51:32 user nova-compute[74613]:     <serial type="pty">
Nov 29 17:51:32 user nova-compute[74613]:       <log file="/opt/stack/data/nova/instances/c19e230e-2e6c-4c20-b15c-ad81a73674b4/console.log" append="off"/>
Nov 29 17:51:32 user nova-compute[74613]:     </serial>
Nov 29 17:51:32 user nova-compute[74613]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 29 17:51:32 user nova-compute[74613]:     <video>
Nov 29 17:51:32 user nova-compute[74613]:       <model type="virtio"/>
Nov 29 17:51:32 user nova-compute[74613]:     </video>
Nov 29 17:51:32 user nova-compute[74613]:     <rng model="virtio">
Nov 29 17:51:32 user nova-compute[74613]:       <backend model="random">/dev/urandom</backend>
Nov 29 17:51:32 user nova-compute[74613]:     </rng>
Nov 29 17:51:32 user nova-compute[74613]:     <controller type="usb" index="0" model="none"/>
Nov 29 17:51:32 user nova-compute[74613]:     <memballoon model="virtio">
Nov 29 17:51:32 user nova-compute[74613]:       <stats period="10"/>
Nov 29 17:51:32 user nova-compute[74613]:     </memballoon>
Nov 29 17:51:32 user nova-compute[74613]:   </devices>
Nov 29 17:51:32 user nova-compute[74613]: </domain>
Nov 29 17:51:32 user nova-compute[74613]:  {{(pid=74613) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 29 17:51:32 user nova-compute[74613]: DEBUG nova.virt.libvirt.vif [None req-3a7ec63d-1bdf-4849-9e6b-4f290ee89c4c tempest-AttachVolumeShelveTestJSON-1452861425 tempest-AttachVolumeShelveTestJSON-1452861425-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T17:51:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-705281655',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-705281655',id=3,image_ref='4217f428-8d9d-4ee1-9614-642d26d90c46',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLofinuzL4KIe2/FJI/rOzpr08YCyh/7umJCTHDfb/8b61GmXnBJ32Swg1dTDe95ImRcaYamLXrnnmDILi1vgJuezNA9fzD/sJhWrgADbQSCHdOnl0SlzP290n0Y8JsPZA==',key_name='tempest-keypair-248065239',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1c0c1c71400549369c1b11ca7d5f43ec',ramdisk_id='',reservation_id='r-ab112qsi',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='4217f428-8d9d-4ee1-9614-642d26d90c46',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-1452861425',owner_user_name='tempest-AttachVolumeShelveTestJSON-1452861425-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T17:51:26Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='45192488dde84ebfbcacfdbd4f898799',uuid=c19e230e-2e6c-4c20-b15c-ad81a73674b4,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a414bce0-6293-4987-9441-46943fe2e877", "address": "fa:16:3e:8e:94:32", "network": {"id": "4a101f3e-d23e-4198-bc3c-b4f9b4d2b4c4", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-864151424-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1c0c1c71400549369c1b11ca7d5f43ec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa414bce0-62", "ovs_interfaceid": "a414bce0-6293-4987-9441-46943fe2e877", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74613) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 29 17:51:32 user nova-compute[74613]: DEBUG nova.network.os_vif_util [None req-3a7ec63d-1bdf-4849-9e6b-4f290ee89c4c tempest-AttachVolumeShelveTestJSON-1452861425 tempest-AttachVolumeShelveTestJSON-1452861425-project-member] Converting VIF {"id": "a414bce0-6293-4987-9441-46943fe2e877", "address": "fa:16:3e:8e:94:32", "network": {"id": "4a101f3e-d23e-4198-bc3c-b4f9b4d2b4c4", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-864151424-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1c0c1c71400549369c1b11ca7d5f43ec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa414bce0-62", "ovs_interfaceid": "a414bce0-6293-4987-9441-46943fe2e877", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74613) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 17:51:32 user nova-compute[74613]: DEBUG nova.network.os_vif_util [None req-3a7ec63d-1bdf-4849-9e6b-4f290ee89c4c tempest-AttachVolumeShelveTestJSON-1452861425 tempest-AttachVolumeShelveTestJSON-1452861425-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8e:94:32,bridge_name='br-int',has_traffic_filtering=True,id=a414bce0-6293-4987-9441-46943fe2e877,network=Network(4a101f3e-d23e-4198-bc3c-b4f9b4d2b4c4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa414bce0-62') {{(pid=74613) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 17:51:32 user nova-compute[74613]: DEBUG os_vif [None req-3a7ec63d-1bdf-4849-9e6b-4f290ee89c4c tempest-AttachVolumeShelveTestJSON-1452861425 tempest-AttachVolumeShelveTestJSON-1452861425-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:8e:94:32,bridge_name='br-int',has_traffic_filtering=True,id=a414bce0-6293-4987-9441-46943fe2e877,network=Network(4a101f3e-d23e-4198-bc3c-b4f9b4d2b4c4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa414bce0-62') {{(pid=74613) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 29 17:51:32 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:51:32 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74613) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 17:51:32 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74613) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 29 17:51:32 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:51:32 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '3db892ba-62d2-50ff-8169-ae21b5c34694', '_type': 'linux-noop'}}, row=False) {{(pid=74613) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 17:51:32 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:51:32 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 17:51:32 user nova-compute[74613]: DEBUG nova.network.neutron [None req-c110aa5d-1515-4b7e-988f-f60fba232273 tempest-ServerActionsTestOtherA-1784608629 tempest-ServerActionsTestOtherA-1784608629-project-member] [instance: abc9e2b8-f467-4cd0-b40f-de511fde1ec1] Updating instance_info_cache with network_info: [{"id": "59a8bf1b-9fb1-4526-92d5-9ad1897c1ee8", "address": "fa:16:3e:e3:5f:12", "network": {"id": "7c2c368e-4c7d-4d70-9a40-c10fe9541af9", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1287934102-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b1f70c311d4941c986de21ac458d11ab", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap59a8bf1b-9f", "ovs_interfaceid": "59a8bf1b-9fb1-4526-92d5-9ad1897c1ee8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74613) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 17:51:32 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-c110aa5d-1515-4b7e-988f-f60fba232273 tempest-ServerActionsTestOtherA-1784608629 tempest-ServerActionsTestOtherA-1784608629-project-member] Releasing lock "refresh_cache-abc9e2b8-f467-4cd0-b40f-de511fde1ec1" {{(pid=74613) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 17:51:32 user nova-compute[74613]: DEBUG nova.compute.manager [None req-c110aa5d-1515-4b7e-988f-f60fba232273 tempest-ServerActionsTestOtherA-1784608629 tempest-ServerActionsTestOtherA-1784608629-project-member] [instance: abc9e2b8-f467-4cd0-b40f-de511fde1ec1] Instance network_info: |[{"id": "59a8bf1b-9fb1-4526-92d5-9ad1897c1ee8", "address": "fa:16:3e:e3:5f:12", "network": {"id": "7c2c368e-4c7d-4d70-9a40-c10fe9541af9", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1287934102-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b1f70c311d4941c986de21ac458d11ab", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap59a8bf1b-9f", "ovs_interfaceid": "59a8bf1b-9fb1-4526-92d5-9ad1897c1ee8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74613) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 29 17:51:32 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-c110aa5d-1515-4b7e-988f-f60fba232273 tempest-ServerActionsTestOtherA-1784608629 tempest-ServerActionsTestOtherA-1784608629-project-member] [instance: abc9e2b8-f467-4cd0-b40f-de511fde1ec1] Start _get_guest_xml network_info=[{"id": "59a8bf1b-9fb1-4526-92d5-9ad1897c1ee8", "address": "fa:16:3e:e3:5f:12", "network": {"id": "7c2c368e-4c7d-4d70-9a40-c10fe9541af9", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1287934102-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b1f70c311d4941c986de21ac458d11ab", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap59a8bf1b-9f", "ovs_interfaceid": "59a8bf1b-9fb1-4526-92d5-9ad1897c1ee8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-29T17:47:38Z,direct_url=<?>,disk_format='qcow2',id=4217f428-8d9d-4ee1-9614-642d26d90c46,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='794b07cbd46a44b5865cfda741036bae',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-29T17:47:40Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'size': 0, 'device_type': 'disk', 'boot_index': 0, 'guest_format': None, 'encrypted': False, 'encryption_format': None, 'disk_bus': 'virtio', 'image_id': '4217f428-8d9d-4ee1-9614-642d26d90c46'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74613) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 29 17:51:32 user nova-compute[74613]: WARNING nova.virt.libvirt.driver [None req-c110aa5d-1515-4b7e-988f-f60fba232273 tempest-ServerActionsTestOtherA-1784608629 tempest-ServerActionsTestOtherA-1784608629-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 17:51:32 user nova-compute[74613]: WARNING nova.virt.libvirt.driver [None req-c110aa5d-1515-4b7e-988f-f60fba232273 tempest-ServerActionsTestOtherA-1784608629 tempest-ServerActionsTestOtherA-1784608629-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 17:51:32 user nova-compute[74613]: DEBUG nova.virt.libvirt.host [None req-c110aa5d-1515-4b7e-988f-f60fba232273 tempest-ServerActionsTestOtherA-1784608629 tempest-ServerActionsTestOtherA-1784608629-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74613) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 29 17:51:32 user nova-compute[74613]: DEBUG nova.virt.libvirt.host [None req-c110aa5d-1515-4b7e-988f-f60fba232273 tempest-ServerActionsTestOtherA-1784608629 tempest-ServerActionsTestOtherA-1784608629-project-member] CPU controller missing on host. {{(pid=74613) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 29 17:51:32 user nova-compute[74613]: DEBUG nova.virt.libvirt.host [None req-c110aa5d-1515-4b7e-988f-f60fba232273 tempest-ServerActionsTestOtherA-1784608629 tempest-ServerActionsTestOtherA-1784608629-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74613) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 29 17:51:32 user nova-compute[74613]: DEBUG nova.virt.libvirt.host [None req-c110aa5d-1515-4b7e-988f-f60fba232273 tempest-ServerActionsTestOtherA-1784608629 tempest-ServerActionsTestOtherA-1784608629-project-member] CPU controller found on host. {{(pid=74613) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 29 17:51:32 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-c110aa5d-1515-4b7e-988f-f60fba232273 tempest-ServerActionsTestOtherA-1784608629 tempest-ServerActionsTestOtherA-1784608629-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74613) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 29 17:51:32 user nova-compute[74613]: DEBUG nova.virt.hardware [None req-c110aa5d-1515-4b7e-988f-f60fba232273 tempest-ServerActionsTestOtherA-1784608629 tempest-ServerActionsTestOtherA-1784608629-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-29T17:47:27Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-29T17:47:38Z,direct_url=<?>,disk_format='qcow2',id=4217f428-8d9d-4ee1-9614-642d26d90c46,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='794b07cbd46a44b5865cfda741036bae',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-29T17:47:40Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74613) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 29 17:51:32 user nova-compute[74613]: DEBUG nova.virt.hardware [None req-c110aa5d-1515-4b7e-988f-f60fba232273 tempest-ServerActionsTestOtherA-1784608629 tempest-ServerActionsTestOtherA-1784608629-project-member] Flavor limits 0:0:0 {{(pid=74613) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 29 17:51:32 user nova-compute[74613]: DEBUG nova.virt.hardware [None req-c110aa5d-1515-4b7e-988f-f60fba232273 tempest-ServerActionsTestOtherA-1784608629 tempest-ServerActionsTestOtherA-1784608629-project-member] Image limits 0:0:0 {{(pid=74613) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 29 17:51:32 user nova-compute[74613]: DEBUG nova.virt.hardware [None req-c110aa5d-1515-4b7e-988f-f60fba232273 tempest-ServerActionsTestOtherA-1784608629 tempest-ServerActionsTestOtherA-1784608629-project-member] Flavor pref 0:0:0 {{(pid=74613) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 29 17:51:32 user nova-compute[74613]: DEBUG nova.virt.hardware [None req-c110aa5d-1515-4b7e-988f-f60fba232273 tempest-ServerActionsTestOtherA-1784608629 tempest-ServerActionsTestOtherA-1784608629-project-member] Image pref 0:0:0 {{(pid=74613) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 29 17:51:32 user nova-compute[74613]: DEBUG nova.virt.hardware [None req-c110aa5d-1515-4b7e-988f-f60fba232273 tempest-ServerActionsTestOtherA-1784608629 tempest-ServerActionsTestOtherA-1784608629-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74613) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 29 17:51:32 user nova-compute[74613]: DEBUG nova.virt.hardware [None req-c110aa5d-1515-4b7e-988f-f60fba232273 tempest-ServerActionsTestOtherA-1784608629 tempest-ServerActionsTestOtherA-1784608629-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74613) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 29 17:51:32 user nova-compute[74613]: DEBUG nova.virt.hardware [None req-c110aa5d-1515-4b7e-988f-f60fba232273 tempest-ServerActionsTestOtherA-1784608629 tempest-ServerActionsTestOtherA-1784608629-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74613) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 29 17:51:32 user nova-compute[74613]: DEBUG nova.virt.hardware [None req-c110aa5d-1515-4b7e-988f-f60fba232273 tempest-ServerActionsTestOtherA-1784608629 tempest-ServerActionsTestOtherA-1784608629-project-member] Got 1 possible topologies {{(pid=74613) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 29 17:51:32 user nova-compute[74613]: DEBUG nova.virt.hardware [None req-c110aa5d-1515-4b7e-988f-f60fba232273 tempest-ServerActionsTestOtherA-1784608629 tempest-ServerActionsTestOtherA-1784608629-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74613) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 29 17:51:32 user nova-compute[74613]: DEBUG nova.virt.hardware [None req-c110aa5d-1515-4b7e-988f-f60fba232273 tempest-ServerActionsTestOtherA-1784608629 tempest-ServerActionsTestOtherA-1784608629-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74613) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 29 17:51:32 user nova-compute[74613]: DEBUG nova.virt.libvirt.vif [None req-c110aa5d-1515-4b7e-988f-f60fba232273 tempest-ServerActionsTestOtherA-1784608629 tempest-ServerActionsTestOtherA-1784608629-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T17:51:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1839142631',display_name='tempest-ServerActionsTestOtherA-server-1839142631',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-1839142631',id=5,image_ref='4217f428-8d9d-4ee1-9614-642d26d90c46',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIpucl9TdiuMtgo2HD8A0S0XK6/wskQQSBMcoxjyazAtLZUlGJCbAbNEhyc7Esm1yWePtzGTrNFIbg4z5HCtj+7HLtHc8+57P9i9m4iI8l/z1ZnWm+BWBA3bkBkjzP6q3Q==',key_name='tempest-keypair-1839431126',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b1f70c311d4941c986de21ac458d11ab',ramdisk_id='',reservation_id='r-abzkfybc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='4217f428-8d9d-4ee1-9614-642d26d90c46',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-1784608629',owner_user_name='tempest-ServerActionsTestOtherA-1784608629-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T17:51:27Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='368555c72103480b82c5c0bf64b07360',uuid=abc9e2b8-f467-4cd0-b40f-de511fde1ec1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "59a8bf1b-9fb1-4526-92d5-9ad1897c1ee8", "address": "fa:16:3e:e3:5f:12", "network": {"id": "7c2c368e-4c7d-4d70-9a40-c10fe9541af9", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1287934102-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b1f70c311d4941c986de21ac458d11ab", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap59a8bf1b-9f", "ovs_interfaceid": "59a8bf1b-9fb1-4526-92d5-9ad1897c1ee8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74613) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 29 17:51:32 user nova-compute[74613]: DEBUG nova.network.os_vif_util [None req-c110aa5d-1515-4b7e-988f-f60fba232273 tempest-ServerActionsTestOtherA-1784608629 tempest-ServerActionsTestOtherA-1784608629-project-member] Converting VIF {"id": "59a8bf1b-9fb1-4526-92d5-9ad1897c1ee8", "address": "fa:16:3e:e3:5f:12", "network": {"id": "7c2c368e-4c7d-4d70-9a40-c10fe9541af9", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1287934102-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b1f70c311d4941c986de21ac458d11ab", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap59a8bf1b-9f", "ovs_interfaceid": "59a8bf1b-9fb1-4526-92d5-9ad1897c1ee8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74613) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 17:51:32 user nova-compute[74613]: DEBUG nova.network.os_vif_util [None req-c110aa5d-1515-4b7e-988f-f60fba232273 tempest-ServerActionsTestOtherA-1784608629 tempest-ServerActionsTestOtherA-1784608629-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e3:5f:12,bridge_name='br-int',has_traffic_filtering=True,id=59a8bf1b-9fb1-4526-92d5-9ad1897c1ee8,network=Network(7c2c368e-4c7d-4d70-9a40-c10fe9541af9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap59a8bf1b-9f') {{(pid=74613) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 17:51:33 user nova-compute[74613]: DEBUG nova.objects.instance [None req-c110aa5d-1515-4b7e-988f-f60fba232273 tempest-ServerActionsTestOtherA-1784608629 tempest-ServerActionsTestOtherA-1784608629-project-member] Lazy-loading 'pci_devices' on Instance uuid abc9e2b8-f467-4cd0-b40f-de511fde1ec1 {{(pid=74613) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 17:51:33 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-c110aa5d-1515-4b7e-988f-f60fba232273 tempest-ServerActionsTestOtherA-1784608629 tempest-ServerActionsTestOtherA-1784608629-project-member] [instance: abc9e2b8-f467-4cd0-b40f-de511fde1ec1] End _get_guest_xml xml=<domain type="kvm">
Nov 29 17:51:33 user nova-compute[74613]:   <uuid>abc9e2b8-f467-4cd0-b40f-de511fde1ec1</uuid>
Nov 29 17:51:33 user nova-compute[74613]:   <name>instance-00000005</name>
Nov 29 17:51:33 user nova-compute[74613]:   <memory>524288</memory>
Nov 29 17:51:33 user nova-compute[74613]:   <vcpu>1</vcpu>
Nov 29 17:51:33 user nova-compute[74613]:   <metadata>
Nov 29 17:51:33 user nova-compute[74613]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 29 17:51:33 user nova-compute[74613]:       <nova:package version="0.0.0"/>
Nov 29 17:51:33 user nova-compute[74613]:       <nova:name>tempest-ServerActionsTestOtherA-server-1839142631</nova:name>
Nov 29 17:51:33 user nova-compute[74613]:       <nova:creationTime>2023-11-29 17:51:32</nova:creationTime>
Nov 29 17:51:33 user nova-compute[74613]:       <nova:flavor name="m1.tiny">
Nov 29 17:51:33 user nova-compute[74613]:         <nova:memory>512</nova:memory>
Nov 29 17:51:33 user nova-compute[74613]:         <nova:disk>1</nova:disk>
Nov 29 17:51:33 user nova-compute[74613]:         <nova:swap>0</nova:swap>
Nov 29 17:51:33 user nova-compute[74613]:         <nova:ephemeral>0</nova:ephemeral>
Nov 29 17:51:33 user nova-compute[74613]:         <nova:vcpus>1</nova:vcpus>
Nov 29 17:51:33 user nova-compute[74613]:       </nova:flavor>
Nov 29 17:51:33 user nova-compute[74613]:       <nova:owner>
Nov 29 17:51:33 user nova-compute[74613]:         <nova:user uuid="368555c72103480b82c5c0bf64b07360">tempest-ServerActionsTestOtherA-1784608629-project-member</nova:user>
Nov 29 17:51:33 user nova-compute[74613]:         <nova:project uuid="b1f70c311d4941c986de21ac458d11ab">tempest-ServerActionsTestOtherA-1784608629</nova:project>
Nov 29 17:51:33 user nova-compute[74613]:       </nova:owner>
Nov 29 17:51:33 user nova-compute[74613]:       <nova:root type="image" uuid="4217f428-8d9d-4ee1-9614-642d26d90c46"/>
Nov 29 17:51:33 user nova-compute[74613]:       <nova:ports>
Nov 29 17:51:33 user nova-compute[74613]:         <nova:port uuid="59a8bf1b-9fb1-4526-92d5-9ad1897c1ee8">
Nov 29 17:51:33 user nova-compute[74613]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Nov 29 17:51:33 user nova-compute[74613]:         </nova:port>
Nov 29 17:51:33 user nova-compute[74613]:       </nova:ports>
Nov 29 17:51:33 user nova-compute[74613]:     </nova:instance>
Nov 29 17:51:33 user nova-compute[74613]:   </metadata>
Nov 29 17:51:33 user nova-compute[74613]:   <sysinfo type="smbios">
Nov 29 17:51:33 user nova-compute[74613]:     <system>
Nov 29 17:51:33 user nova-compute[74613]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 29 17:51:33 user nova-compute[74613]:       <entry name="product">OpenStack Nova</entry>
Nov 29 17:51:33 user nova-compute[74613]:       <entry name="version">0.0.0</entry>
Nov 29 17:51:33 user nova-compute[74613]:       <entry name="serial">abc9e2b8-f467-4cd0-b40f-de511fde1ec1</entry>
Nov 29 17:51:33 user nova-compute[74613]:       <entry name="uuid">abc9e2b8-f467-4cd0-b40f-de511fde1ec1</entry>
Nov 29 17:51:33 user nova-compute[74613]:       <entry name="family">Virtual Machine</entry>
Nov 29 17:51:33 user nova-compute[74613]:     </system>
Nov 29 17:51:33 user nova-compute[74613]:   </sysinfo>
Nov 29 17:51:33 user nova-compute[74613]:   <os>
Nov 29 17:51:33 user nova-compute[74613]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 29 17:51:33 user nova-compute[74613]:     <boot dev="hd"/>
Nov 29 17:51:33 user nova-compute[74613]:     <smbios mode="sysinfo"/>
Nov 29 17:51:33 user nova-compute[74613]:   </os>
Nov 29 17:51:33 user nova-compute[74613]:   <features>
Nov 29 17:51:33 user nova-compute[74613]:     <acpi/>
Nov 29 17:51:33 user nova-compute[74613]:     <apic/>
Nov 29 17:51:33 user nova-compute[74613]:     <vmcoreinfo/>
Nov 29 17:51:33 user nova-compute[74613]:   </features>
Nov 29 17:51:33 user nova-compute[74613]:   <clock offset="utc">
Nov 29 17:51:33 user nova-compute[74613]:     <timer name="pit" tickpolicy="delay"/>
Nov 29 17:51:33 user nova-compute[74613]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 29 17:51:33 user nova-compute[74613]:     <timer name="hpet" present="no"/>
Nov 29 17:51:33 user nova-compute[74613]:   </clock>
Nov 29 17:51:33 user nova-compute[74613]:   <cpu mode="custom" match="exact">
Nov 29 17:51:33 user nova-compute[74613]:     <model>Nehalem</model>
Nov 29 17:51:33 user nova-compute[74613]:     <topology sockets="1" cores="1" threads="1"/>
Nov 29 17:51:33 user nova-compute[74613]:   </cpu>
Nov 29 17:51:33 user nova-compute[74613]:   <devices>
Nov 29 17:51:33 user nova-compute[74613]:     <disk type="file" device="disk">
Nov 29 17:51:33 user nova-compute[74613]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 29 17:51:33 user nova-compute[74613]:       <source file="/opt/stack/data/nova/instances/abc9e2b8-f467-4cd0-b40f-de511fde1ec1/disk"/>
Nov 29 17:51:33 user nova-compute[74613]:       <target dev="vda" bus="virtio"/>
Nov 29 17:51:33 user nova-compute[74613]:     </disk>
Nov 29 17:51:33 user nova-compute[74613]:     <interface type="ethernet">
Nov 29 17:51:33 user nova-compute[74613]:       <mac address="fa:16:3e:e3:5f:12"/>
Nov 29 17:51:33 user nova-compute[74613]:       <model type="virtio"/>
Nov 29 17:51:33 user nova-compute[74613]:       <mtu size="1442"/>
Nov 29 17:51:33 user nova-compute[74613]:       <target dev="tap59a8bf1b-9f"/>
Nov 29 17:51:33 user nova-compute[74613]:     </interface>
Nov 29 17:51:33 user nova-compute[74613]:     <serial type="pty">
Nov 29 17:51:33 user nova-compute[74613]:       <log file="/opt/stack/data/nova/instances/abc9e2b8-f467-4cd0-b40f-de511fde1ec1/console.log" append="off"/>
Nov 29 17:51:33 user nova-compute[74613]:     </serial>
Nov 29 17:51:33 user nova-compute[74613]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 29 17:51:33 user nova-compute[74613]:     <video>
Nov 29 17:51:33 user nova-compute[74613]:       <model type="virtio"/>
Nov 29 17:51:33 user nova-compute[74613]:     </video>
Nov 29 17:51:33 user nova-compute[74613]:     <rng model="virtio">
Nov 29 17:51:33 user nova-compute[74613]:       <backend model="random">/dev/urandom</backend>
Nov 29 17:51:33 user nova-compute[74613]:     </rng>
Nov 29 17:51:33 user nova-compute[74613]:     <controller type="usb" index="0" model="none"/>
Nov 29 17:51:33 user nova-compute[74613]:     <memballoon model="virtio">
Nov 29 17:51:33 user nova-compute[74613]:       <stats period="10"/>
Nov 29 17:51:33 user nova-compute[74613]:     </memballoon>
Nov 29 17:51:33 user nova-compute[74613]:   </devices>
Nov 29 17:51:33 user nova-compute[74613]: </domain>
Nov 29 17:51:33 user nova-compute[74613]:  {{(pid=74613) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 29 17:51:33 user nova-compute[74613]: DEBUG nova.virt.libvirt.vif [None req-c110aa5d-1515-4b7e-988f-f60fba232273 tempest-ServerActionsTestOtherA-1784608629 tempest-ServerActionsTestOtherA-1784608629-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T17:51:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1839142631',display_name='tempest-ServerActionsTestOtherA-server-1839142631',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-1839142631',id=5,image_ref='4217f428-8d9d-4ee1-9614-642d26d90c46',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIpucl9TdiuMtgo2HD8A0S0XK6/wskQQSBMcoxjyazAtLZUlGJCbAbNEhyc7Esm1yWePtzGTrNFIbg4z5HCtj+7HLtHc8+57P9i9m4iI8l/z1ZnWm+BWBA3bkBkjzP6q3Q==',key_name='tempest-keypair-1839431126',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b1f70c311d4941c986de21ac458d11ab',ramdisk_id='',reservation_id='r-abzkfybc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='4217f428-8d9d-4ee1-9614-642d26d90c46',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-1784608629',owner_user_name='tempest-ServerActionsTestOtherA-1784608629-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T17:51:27Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='368555c72103480b82c5c0bf64b07360',uuid=abc9e2b8-f467-4cd0-b40f-de511fde1ec1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "59a8bf1b-9fb1-4526-92d5-9ad1897c1ee8", "address": "fa:16:3e:e3:5f:12", "network": {"id": "7c2c368e-4c7d-4d70-9a40-c10fe9541af9", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1287934102-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b1f70c311d4941c986de21ac458d11ab", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap59a8bf1b-9f", "ovs_interfaceid": "59a8bf1b-9fb1-4526-92d5-9ad1897c1ee8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74613) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 29 17:51:33 user nova-compute[74613]: DEBUG nova.network.os_vif_util [None req-c110aa5d-1515-4b7e-988f-f60fba232273 tempest-ServerActionsTestOtherA-1784608629 tempest-ServerActionsTestOtherA-1784608629-project-member] Converting VIF {"id": "59a8bf1b-9fb1-4526-92d5-9ad1897c1ee8", "address": "fa:16:3e:e3:5f:12", "network": {"id": "7c2c368e-4c7d-4d70-9a40-c10fe9541af9", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1287934102-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b1f70c311d4941c986de21ac458d11ab", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap59a8bf1b-9f", "ovs_interfaceid": "59a8bf1b-9fb1-4526-92d5-9ad1897c1ee8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74613) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 17:51:33 user nova-compute[74613]: DEBUG nova.network.os_vif_util [None req-c110aa5d-1515-4b7e-988f-f60fba232273 tempest-ServerActionsTestOtherA-1784608629 tempest-ServerActionsTestOtherA-1784608629-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e3:5f:12,bridge_name='br-int',has_traffic_filtering=True,id=59a8bf1b-9fb1-4526-92d5-9ad1897c1ee8,network=Network(7c2c368e-4c7d-4d70-9a40-c10fe9541af9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap59a8bf1b-9f') {{(pid=74613) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 17:51:33 user nova-compute[74613]: DEBUG os_vif [None req-c110aa5d-1515-4b7e-988f-f60fba232273 tempest-ServerActionsTestOtherA-1784608629 tempest-ServerActionsTestOtherA-1784608629-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e3:5f:12,bridge_name='br-int',has_traffic_filtering=True,id=59a8bf1b-9fb1-4526-92d5-9ad1897c1ee8,network=Network(7c2c368e-4c7d-4d70-9a40-c10fe9541af9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap59a8bf1b-9f') {{(pid=74613) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 29 17:51:33 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:51:33 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74613) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 17:51:33 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74613) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 29 17:51:33 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:51:33 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'b71ab6f0-cd7e-5107-8cbb-9a3f9b0b1a0f', '_type': 'linux-noop'}}, row=False) {{(pid=74613) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 17:51:33 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:51:33 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:51:33 user sudo[84008]: pam_unix(sudo:session): session closed for user root
Nov 29 17:51:33 user nova-compute[74613]: INFO oslo.privsep.daemon [None req-c95f4e22-f5b1-4f6e-80dc-83a2ee62815f tempest-ServerStableDeviceRescueTest-1416322546 tempest-ServerStableDeviceRescueTest-1416322546-project-member] Spawned new privsep daemon via rootwrap
Nov 29 17:51:33 user nova-compute[74613]: INFO oslo.privsep.daemon [-] privsep daemon starting
Nov 29 17:51:33 user nova-compute[74613]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0
Nov 29 17:51:33 user nova-compute[74613]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_DAC_OVERRIDE|CAP_NET_ADMIN/CAP_DAC_OVERRIDE|CAP_NET_ADMIN/none
Nov 29 17:51:33 user nova-compute[74613]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 84011
Nov 29 17:51:33 user nova-compute[74613]: WARNING oslo_privsep.priv_context [None req-d108c1ab-fa43-4e97-b056-065e3528f377 tempest-ServerBootFromVolumeStableRescueTest-414665510 tempest-ServerBootFromVolumeStableRescueTest-414665510-project-member] privsep daemon already running
Nov 29 17:51:33 user nova-compute[74613]: WARNING oslo_privsep.priv_context [None req-31c66816-a579-4fed-917c-5fe116aeddf6 tempest-DeleteServersTestJSON-112443106 tempest-DeleteServersTestJSON-112443106-project-member] privsep daemon already running
Nov 29 17:51:33 user nova-compute[74613]: WARNING oslo_privsep.priv_context [None req-3a7ec63d-1bdf-4849-9e6b-4f290ee89c4c tempest-AttachVolumeShelveTestJSON-1452861425 tempest-AttachVolumeShelveTestJSON-1452861425-project-member] privsep daemon already running
Nov 29 17:51:33 user nova-compute[74613]: WARNING oslo_privsep.priv_context [None req-c110aa5d-1515-4b7e-988f-f60fba232273 tempest-ServerActionsTestOtherA-1784608629 tempest-ServerActionsTestOtherA-1784608629-project-member] privsep daemon already running
Nov 29 17:51:33 user nova-compute[74613]: DEBUG nova.network.neutron [req-924b14d8-bced-462f-946d-82861b68fdc8 req-537142e1-1ea9-4cd4-8128-ccf38e7077d4 service nova] [instance: 3b828860-5cc5-40b0-b845-8e560211794e] Updated VIF entry in instance network info cache for port dfe097e1-192f-47e2-96b7-0e9fe8320758. {{(pid=74613) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 17:51:33 user nova-compute[74613]: DEBUG nova.network.neutron [req-924b14d8-bced-462f-946d-82861b68fdc8 req-537142e1-1ea9-4cd4-8128-ccf38e7077d4 service nova] [instance: 3b828860-5cc5-40b0-b845-8e560211794e] Updating instance_info_cache with network_info: [{"id": "dfe097e1-192f-47e2-96b7-0e9fe8320758", "address": "fa:16:3e:c2:a8:2f", "network": {"id": "0722b02d-a357-4360-87e8-580913723985", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-579793494-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b820dd795dfe46cd804772f0e71f98e9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdfe097e1-19", "ovs_interfaceid": "dfe097e1-192f-47e2-96b7-0e9fe8320758", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74613) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 17:51:33 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-924b14d8-bced-462f-946d-82861b68fdc8 req-537142e1-1ea9-4cd4-8128-ccf38e7077d4 service nova] Releasing lock "refresh_cache-3b828860-5cc5-40b0-b845-8e560211794e" {{(pid=74613) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 17:51:33 user nova-compute[74613]: DEBUG nova.network.neutron [req-eafd92b1-a453-40a3-81ef-aeff7446eae9 req-64136c1f-812c-4885-8a9f-85efaf402dde service nova] [instance: c19e230e-2e6c-4c20-b15c-ad81a73674b4] Updated VIF entry in instance network info cache for port a414bce0-6293-4987-9441-46943fe2e877. {{(pid=74613) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 17:51:33 user nova-compute[74613]: DEBUG nova.network.neutron [req-eafd92b1-a453-40a3-81ef-aeff7446eae9 req-64136c1f-812c-4885-8a9f-85efaf402dde service nova] [instance: c19e230e-2e6c-4c20-b15c-ad81a73674b4] Updating instance_info_cache with network_info: [{"id": "a414bce0-6293-4987-9441-46943fe2e877", "address": "fa:16:3e:8e:94:32", "network": {"id": "4a101f3e-d23e-4198-bc3c-b4f9b4d2b4c4", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-864151424-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1c0c1c71400549369c1b11ca7d5f43ec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa414bce0-62", "ovs_interfaceid": "a414bce0-6293-4987-9441-46943fe2e877", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74613) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 17:51:33 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-eafd92b1-a453-40a3-81ef-aeff7446eae9 req-64136c1f-812c-4885-8a9f-85efaf402dde service nova] Releasing lock "refresh_cache-c19e230e-2e6c-4c20-b15c-ad81a73674b4" {{(pid=74613) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 17:51:33 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:51:33 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapdfe097e1-19, may_exist=True, interface_attrs={}) {{(pid=74613) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 17:51:33 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapdfe097e1-19, col_values=(('qos', UUID('043ff774-c2d8-42a1-a4d5-20bcf13d919c')),), if_exists=True) {{(pid=74613) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 17:51:33 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapdfe097e1-19, col_values=(('external_ids', {'iface-id': 'dfe097e1-192f-47e2-96b7-0e9fe8320758', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:c2:a8:2f', 'vm-uuid': '3b828860-5cc5-40b0-b845-8e560211794e'}),), if_exists=True) {{(pid=74613) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 17:51:33 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 17:51:33 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:51:33 user nova-compute[74613]: INFO os_vif [None req-d108c1ab-fa43-4e97-b056-065e3528f377 tempest-ServerBootFromVolumeStableRescueTest-414665510 tempest-ServerBootFromVolumeStableRescueTest-414665510-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c2:a8:2f,bridge_name='br-int',has_traffic_filtering=True,id=dfe097e1-192f-47e2-96b7-0e9fe8320758,network=Network(0722b02d-a357-4360-87e8-580913723985),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdfe097e1-19')
Nov 29 17:51:33 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:51:33 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap49e80b78-00, may_exist=True, interface_attrs={}) {{(pid=74613) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 17:51:33 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap49e80b78-00, col_values=(('qos', UUID('6fcd5dd4-a0b4-49aa-9286-0d926ff137bc')),), if_exists=True) {{(pid=74613) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 17:51:33 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap49e80b78-00, col_values=(('external_ids', {'iface-id': '49e80b78-004f-457d-aea8-8940ab6d9179', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:0c:43:fa', 'vm-uuid': 'f3a5f6d2-cadd-485b-a443-1b8f3ed966b9'}),), if_exists=True) {{(pid=74613) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 17:51:33 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:51:33 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 17:51:33 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:51:33 user nova-compute[74613]: INFO os_vif [None req-31c66816-a579-4fed-917c-5fe116aeddf6 tempest-DeleteServersTestJSON-112443106 tempest-DeleteServersTestJSON-112443106-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:0c:43:fa,bridge_name='br-int',has_traffic_filtering=True,id=49e80b78-004f-457d-aea8-8940ab6d9179,network=Network(5a261b7c-1d1a-4bab-917f-f0685fe6b13d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap49e80b78-00')
Nov 29 17:51:33 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:51:33 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapa414bce0-62, may_exist=True, interface_attrs={}) {{(pid=74613) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 17:51:33 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapa414bce0-62, col_values=(('qos', UUID('888603f9-c768-449d-8ea9-be9b6228e239')),), if_exists=True) {{(pid=74613) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 17:51:33 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapa414bce0-62, col_values=(('external_ids', {'iface-id': 'a414bce0-6293-4987-9441-46943fe2e877', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:8e:94:32', 'vm-uuid': 'c19e230e-2e6c-4c20-b15c-ad81a73674b4'}),), if_exists=True) {{(pid=74613) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 17:51:33 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:51:33 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 17:51:33 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:51:33 user nova-compute[74613]: INFO os_vif [None req-3a7ec63d-1bdf-4849-9e6b-4f290ee89c4c tempest-AttachVolumeShelveTestJSON-1452861425 tempest-AttachVolumeShelveTestJSON-1452861425-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:8e:94:32,bridge_name='br-int',has_traffic_filtering=True,id=a414bce0-6293-4987-9441-46943fe2e877,network=Network(4a101f3e-d23e-4198-bc3c-b4f9b4d2b4c4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa414bce0-62')
Nov 29 17:51:33 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:51:33 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap0167e253-42, may_exist=True, interface_attrs={}) {{(pid=74613) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 17:51:33 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap0167e253-42, col_values=(('qos', UUID('0d107f67-70c0-463b-b623-4c5f1fc3c92d')),), if_exists=True) {{(pid=74613) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 17:51:33 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap0167e253-42, col_values=(('external_ids', {'iface-id': '0167e253-42dd-486a-8231-a8b8199f3584', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:3f:ea:5d', 'vm-uuid': 'b6b0ba36-ad89-45f1-9578-8b999567dd25'}),), if_exists=True) {{(pid=74613) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 17:51:33 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:51:33 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 17:51:33 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-d108c1ab-fa43-4e97-b056-065e3528f377 tempest-ServerBootFromVolumeStableRescueTest-414665510 tempest-ServerBootFromVolumeStableRescueTest-414665510-project-member] No BDM found with device name vda, not building metadata. {{(pid=74613) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 17:51:33 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-d108c1ab-fa43-4e97-b056-065e3528f377 tempest-ServerBootFromVolumeStableRescueTest-414665510 tempest-ServerBootFromVolumeStableRescueTest-414665510-project-member] No VIF found with MAC fa:16:3e:c2:a8:2f, not building metadata {{(pid=74613) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 29 17:51:33 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:51:33 user nova-compute[74613]: INFO os_vif [None req-c95f4e22-f5b1-4f6e-80dc-83a2ee62815f tempest-ServerStableDeviceRescueTest-1416322546 tempest-ServerStableDeviceRescueTest-1416322546-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:3f:ea:5d,bridge_name='br-int',has_traffic_filtering=True,id=0167e253-42dd-486a-8231-a8b8199f3584,network=Network(880ea498-5e4e-4786-a894-bac0f42572f4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0167e253-42')
Nov 29 17:51:33 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:51:33 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap59a8bf1b-9f, may_exist=True, interface_attrs={}) {{(pid=74613) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 17:51:33 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap59a8bf1b-9f, col_values=(('qos', UUID('b19dea82-3c3d-486c-a54c-fab6102e6e98')),), if_exists=True) {{(pid=74613) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 17:51:33 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap59a8bf1b-9f, col_values=(('external_ids', {'iface-id': '59a8bf1b-9fb1-4526-92d5-9ad1897c1ee8', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:e3:5f:12', 'vm-uuid': 'abc9e2b8-f467-4cd0-b40f-de511fde1ec1'}),), if_exists=True) {{(pid=74613) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 17:51:33 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:51:33 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 17:51:33 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-31c66816-a579-4fed-917c-5fe116aeddf6 tempest-DeleteServersTestJSON-112443106 tempest-DeleteServersTestJSON-112443106-project-member] No BDM found with device name vda, not building metadata. {{(pid=74613) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 17:51:33 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-31c66816-a579-4fed-917c-5fe116aeddf6 tempest-DeleteServersTestJSON-112443106 tempest-DeleteServersTestJSON-112443106-project-member] No VIF found with MAC fa:16:3e:0c:43:fa, not building metadata {{(pid=74613) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 29 17:51:33 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-3a7ec63d-1bdf-4849-9e6b-4f290ee89c4c tempest-AttachVolumeShelveTestJSON-1452861425 tempest-AttachVolumeShelveTestJSON-1452861425-project-member] No BDM found with device name vda, not building metadata. {{(pid=74613) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 17:51:33 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-3a7ec63d-1bdf-4849-9e6b-4f290ee89c4c tempest-AttachVolumeShelveTestJSON-1452861425 tempest-AttachVolumeShelveTestJSON-1452861425-project-member] No VIF found with MAC fa:16:3e:8e:94:32, not building metadata {{(pid=74613) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 29 17:51:34 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:51:34 user nova-compute[74613]: INFO os_vif [None req-c110aa5d-1515-4b7e-988f-f60fba232273 tempest-ServerActionsTestOtherA-1784608629 tempest-ServerActionsTestOtherA-1784608629-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e3:5f:12,bridge_name='br-int',has_traffic_filtering=True,id=59a8bf1b-9fb1-4526-92d5-9ad1897c1ee8,network=Network(7c2c368e-4c7d-4d70-9a40-c10fe9541af9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap59a8bf1b-9f')
Nov 29 17:51:34 user nova-compute[74613]: DEBUG nova.compute.manager [req-d59c7532-f20d-40e6-bca0-a5e7aa67712c req-5edfe61d-af4e-4813-b96d-41d7663a52e0 service nova] [instance: abc9e2b8-f467-4cd0-b40f-de511fde1ec1] Received event network-changed-59a8bf1b-9fb1-4526-92d5-9ad1897c1ee8 {{(pid=74613) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 17:51:34 user nova-compute[74613]: DEBUG nova.compute.manager [req-d59c7532-f20d-40e6-bca0-a5e7aa67712c req-5edfe61d-af4e-4813-b96d-41d7663a52e0 service nova] [instance: abc9e2b8-f467-4cd0-b40f-de511fde1ec1] Refreshing instance network info cache due to event network-changed-59a8bf1b-9fb1-4526-92d5-9ad1897c1ee8. {{(pid=74613) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 17:51:34 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-d59c7532-f20d-40e6-bca0-a5e7aa67712c req-5edfe61d-af4e-4813-b96d-41d7663a52e0 service nova] Acquiring lock "refresh_cache-abc9e2b8-f467-4cd0-b40f-de511fde1ec1" {{(pid=74613) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 17:51:34 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-d59c7532-f20d-40e6-bca0-a5e7aa67712c req-5edfe61d-af4e-4813-b96d-41d7663a52e0 service nova] Acquired lock "refresh_cache-abc9e2b8-f467-4cd0-b40f-de511fde1ec1" {{(pid=74613) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 17:51:34 user nova-compute[74613]: DEBUG nova.network.neutron [req-d59c7532-f20d-40e6-bca0-a5e7aa67712c req-5edfe61d-af4e-4813-b96d-41d7663a52e0 service nova] [instance: abc9e2b8-f467-4cd0-b40f-de511fde1ec1] Refreshing network info cache for port 59a8bf1b-9fb1-4526-92d5-9ad1897c1ee8 {{(pid=74613) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 17:51:34 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-c95f4e22-f5b1-4f6e-80dc-83a2ee62815f tempest-ServerStableDeviceRescueTest-1416322546 tempest-ServerStableDeviceRescueTest-1416322546-project-member] No BDM found with device name vda, not building metadata. {{(pid=74613) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 17:51:34 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-c95f4e22-f5b1-4f6e-80dc-83a2ee62815f tempest-ServerStableDeviceRescueTest-1416322546 tempest-ServerStableDeviceRescueTest-1416322546-project-member] No VIF found with MAC fa:16:3e:3f:ea:5d, not building metadata {{(pid=74613) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 29 17:51:34 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-c110aa5d-1515-4b7e-988f-f60fba232273 tempest-ServerActionsTestOtherA-1784608629 tempest-ServerActionsTestOtherA-1784608629-project-member] No BDM found with device name vda, not building metadata. {{(pid=74613) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 17:51:34 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-c110aa5d-1515-4b7e-988f-f60fba232273 tempest-ServerActionsTestOtherA-1784608629 tempest-ServerActionsTestOtherA-1784608629-project-member] No VIF found with MAC fa:16:3e:e3:5f:12, not building metadata {{(pid=74613) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 29 17:51:34 user nova-compute[74613]: DEBUG nova.network.neutron [req-f4683180-0d85-4c63-9f11-920946a8bd80 req-851db68e-7bd8-4a12-ae83-a4eb697bde8c service nova] [instance: f3a5f6d2-cadd-485b-a443-1b8f3ed966b9] Updated VIF entry in instance network info cache for port 49e80b78-004f-457d-aea8-8940ab6d9179. {{(pid=74613) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 17:51:34 user nova-compute[74613]: DEBUG nova.network.neutron [req-f4683180-0d85-4c63-9f11-920946a8bd80 req-851db68e-7bd8-4a12-ae83-a4eb697bde8c service nova] [instance: f3a5f6d2-cadd-485b-a443-1b8f3ed966b9] Updating instance_info_cache with network_info: [{"id": "49e80b78-004f-457d-aea8-8940ab6d9179", "address": "fa:16:3e:0c:43:fa", "network": {"id": "5a261b7c-1d1a-4bab-917f-f0685fe6b13d", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1710073957-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "31ff57da724840588bee7c012be00891", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap49e80b78-00", "ovs_interfaceid": "49e80b78-004f-457d-aea8-8940ab6d9179", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74613) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 17:51:34 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-f4683180-0d85-4c63-9f11-920946a8bd80 req-851db68e-7bd8-4a12-ae83-a4eb697bde8c service nova] Releasing lock "refresh_cache-f3a5f6d2-cadd-485b-a443-1b8f3ed966b9" {{(pid=74613) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 17:51:34 user nova-compute[74613]: DEBUG nova.network.neutron [req-d59c7532-f20d-40e6-bca0-a5e7aa67712c req-5edfe61d-af4e-4813-b96d-41d7663a52e0 service nova] [instance: abc9e2b8-f467-4cd0-b40f-de511fde1ec1] Updated VIF entry in instance network info cache for port 59a8bf1b-9fb1-4526-92d5-9ad1897c1ee8. {{(pid=74613) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 17:51:34 user nova-compute[74613]: DEBUG nova.network.neutron [req-d59c7532-f20d-40e6-bca0-a5e7aa67712c req-5edfe61d-af4e-4813-b96d-41d7663a52e0 service nova] [instance: abc9e2b8-f467-4cd0-b40f-de511fde1ec1] Updating instance_info_cache with network_info: [{"id": "59a8bf1b-9fb1-4526-92d5-9ad1897c1ee8", "address": "fa:16:3e:e3:5f:12", "network": {"id": "7c2c368e-4c7d-4d70-9a40-c10fe9541af9", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1287934102-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b1f70c311d4941c986de21ac458d11ab", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap59a8bf1b-9f", "ovs_interfaceid": "59a8bf1b-9fb1-4526-92d5-9ad1897c1ee8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74613) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 17:51:34 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-d59c7532-f20d-40e6-bca0-a5e7aa67712c req-5edfe61d-af4e-4813-b96d-41d7663a52e0 service nova] Releasing lock "refresh_cache-abc9e2b8-f467-4cd0-b40f-de511fde1ec1" {{(pid=74613) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 17:51:34 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:51:34 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:51:36 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:51:37 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:51:37 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-3f6d5344-1f38-4085-9a6e-d96c8bbaee02 tempest-AttachSCSIVolumeTestJSON-1343397388 tempest-AttachSCSIVolumeTestJSON-1343397388-project-member] Acquiring lock "01c65b16-5dbe-4ad5-a72e-9500a4fa59cf" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 17:51:37 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-3f6d5344-1f38-4085-9a6e-d96c8bbaee02 tempest-AttachSCSIVolumeTestJSON-1343397388 tempest-AttachSCSIVolumeTestJSON-1343397388-project-member] Lock "01c65b16-5dbe-4ad5-a72e-9500a4fa59cf" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 17:51:37 user nova-compute[74613]: DEBUG nova.compute.manager [None req-3f6d5344-1f38-4085-9a6e-d96c8bbaee02 tempest-AttachSCSIVolumeTestJSON-1343397388 tempest-AttachSCSIVolumeTestJSON-1343397388-project-member] [instance: 01c65b16-5dbe-4ad5-a72e-9500a4fa59cf] Starting instance... {{(pid=74613) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 29 17:51:37 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-3f6d5344-1f38-4085-9a6e-d96c8bbaee02 tempest-AttachSCSIVolumeTestJSON-1343397388 tempest-AttachSCSIVolumeTestJSON-1343397388-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 17:51:37 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-3f6d5344-1f38-4085-9a6e-d96c8bbaee02 tempest-AttachSCSIVolumeTestJSON-1343397388 tempest-AttachSCSIVolumeTestJSON-1343397388-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 17:51:38 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:51:38 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:51:39 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:51:39 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:51:39 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:51:39 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:51:39 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:51:39 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:51:39 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:51:40 user nova-compute[74613]: DEBUG nova.compute.manager [req-2a58c9f9-700e-41a7-97ef-a591fc39ac72 req-ff24d008-116e-420f-8d0d-1fc71b4af2bf service nova] [instance: c19e230e-2e6c-4c20-b15c-ad81a73674b4] Received event network-vif-plugged-a414bce0-6293-4987-9441-46943fe2e877 {{(pid=74613) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 17:51:40 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-2a58c9f9-700e-41a7-97ef-a591fc39ac72 req-ff24d008-116e-420f-8d0d-1fc71b4af2bf service nova] Acquiring lock "c19e230e-2e6c-4c20-b15c-ad81a73674b4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 17:51:40 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-2a58c9f9-700e-41a7-97ef-a591fc39ac72 req-ff24d008-116e-420f-8d0d-1fc71b4af2bf service nova] Lock "c19e230e-2e6c-4c20-b15c-ad81a73674b4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 17:51:40 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-2a58c9f9-700e-41a7-97ef-a591fc39ac72 req-ff24d008-116e-420f-8d0d-1fc71b4af2bf service nova] Lock "c19e230e-2e6c-4c20-b15c-ad81a73674b4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 17:51:40 user nova-compute[74613]: DEBUG nova.compute.manager [req-2a58c9f9-700e-41a7-97ef-a591fc39ac72 req-ff24d008-116e-420f-8d0d-1fc71b4af2bf service nova] [instance: c19e230e-2e6c-4c20-b15c-ad81a73674b4] No waiting events found dispatching network-vif-plugged-a414bce0-6293-4987-9441-46943fe2e877 {{(pid=74613) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 17:51:40 user nova-compute[74613]: WARNING nova.compute.manager [req-2a58c9f9-700e-41a7-97ef-a591fc39ac72 req-ff24d008-116e-420f-8d0d-1fc71b4af2bf service nova] [instance: c19e230e-2e6c-4c20-b15c-ad81a73674b4] Received unexpected event network-vif-plugged-a414bce0-6293-4987-9441-46943fe2e877 for instance with vm_state building and task_state spawning.
Nov 29 17:51:40 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:51:40 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:51:40 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:51:41 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:51:41 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:51:41 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:51:41 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:51:41 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:51:41 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:51:41 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:51:42 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:51:42 user nova-compute[74613]: DEBUG nova.compute.manager [req-25c52429-0fea-4d8c-b798-4f1593fe68b9 req-f21ec70b-147a-4aa2-8dd0-f34b6e123638 service nova] [instance: c19e230e-2e6c-4c20-b15c-ad81a73674b4] Received event network-vif-plugged-a414bce0-6293-4987-9441-46943fe2e877 {{(pid=74613) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 17:51:42 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-25c52429-0fea-4d8c-b798-4f1593fe68b9 req-f21ec70b-147a-4aa2-8dd0-f34b6e123638 service nova] Acquiring lock "c19e230e-2e6c-4c20-b15c-ad81a73674b4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 17:51:42 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-25c52429-0fea-4d8c-b798-4f1593fe68b9 req-f21ec70b-147a-4aa2-8dd0-f34b6e123638 service nova] Lock "c19e230e-2e6c-4c20-b15c-ad81a73674b4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 17:51:42 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-25c52429-0fea-4d8c-b798-4f1593fe68b9 req-f21ec70b-147a-4aa2-8dd0-f34b6e123638 service nova] Lock "c19e230e-2e6c-4c20-b15c-ad81a73674b4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 17:51:42 user nova-compute[74613]: DEBUG nova.compute.manager [req-25c52429-0fea-4d8c-b798-4f1593fe68b9 req-f21ec70b-147a-4aa2-8dd0-f34b6e123638 service nova] [instance: c19e230e-2e6c-4c20-b15c-ad81a73674b4] No waiting events found dispatching network-vif-plugged-a414bce0-6293-4987-9441-46943fe2e877 {{(pid=74613) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 17:51:42 user nova-compute[74613]: WARNING nova.compute.manager [req-25c52429-0fea-4d8c-b798-4f1593fe68b9 req-f21ec70b-147a-4aa2-8dd0-f34b6e123638 service nova] [instance: c19e230e-2e6c-4c20-b15c-ad81a73674b4] Received unexpected event network-vif-plugged-a414bce0-6293-4987-9441-46943fe2e877 for instance with vm_state building and task_state spawning.
Nov 29 17:51:42 user nova-compute[74613]: DEBUG nova.compute.manager [req-25c52429-0fea-4d8c-b798-4f1593fe68b9 req-f21ec70b-147a-4aa2-8dd0-f34b6e123638 service nova] [instance: abc9e2b8-f467-4cd0-b40f-de511fde1ec1] Received event network-vif-plugged-59a8bf1b-9fb1-4526-92d5-9ad1897c1ee8 {{(pid=74613) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 17:51:42 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-25c52429-0fea-4d8c-b798-4f1593fe68b9 req-f21ec70b-147a-4aa2-8dd0-f34b6e123638 service nova] Acquiring lock "abc9e2b8-f467-4cd0-b40f-de511fde1ec1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 17:51:42 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-25c52429-0fea-4d8c-b798-4f1593fe68b9 req-f21ec70b-147a-4aa2-8dd0-f34b6e123638 service nova] Lock "abc9e2b8-f467-4cd0-b40f-de511fde1ec1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 17:51:42 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-25c52429-0fea-4d8c-b798-4f1593fe68b9 req-f21ec70b-147a-4aa2-8dd0-f34b6e123638 service nova] Lock "abc9e2b8-f467-4cd0-b40f-de511fde1ec1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 17:51:42 user nova-compute[74613]: DEBUG nova.compute.manager [req-25c52429-0fea-4d8c-b798-4f1593fe68b9 req-f21ec70b-147a-4aa2-8dd0-f34b6e123638 service nova] [instance: abc9e2b8-f467-4cd0-b40f-de511fde1ec1] No waiting events found dispatching network-vif-plugged-59a8bf1b-9fb1-4526-92d5-9ad1897c1ee8 {{(pid=74613) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 17:51:42 user nova-compute[74613]: WARNING nova.compute.manager [req-25c52429-0fea-4d8c-b798-4f1593fe68b9 req-f21ec70b-147a-4aa2-8dd0-f34b6e123638 service nova] [instance: abc9e2b8-f467-4cd0-b40f-de511fde1ec1] Received unexpected event network-vif-plugged-59a8bf1b-9fb1-4526-92d5-9ad1897c1ee8 for instance with vm_state building and task_state spawning.
Nov 29 17:51:42 user nova-compute[74613]: DEBUG nova.compute.manager [req-25c52429-0fea-4d8c-b798-4f1593fe68b9 req-f21ec70b-147a-4aa2-8dd0-f34b6e123638 service nova] [instance: abc9e2b8-f467-4cd0-b40f-de511fde1ec1] Received event network-vif-plugged-59a8bf1b-9fb1-4526-92d5-9ad1897c1ee8 {{(pid=74613) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 17:51:42 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-25c52429-0fea-4d8c-b798-4f1593fe68b9 req-f21ec70b-147a-4aa2-8dd0-f34b6e123638 service nova] Acquiring lock "abc9e2b8-f467-4cd0-b40f-de511fde1ec1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 17:51:42 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-25c52429-0fea-4d8c-b798-4f1593fe68b9 req-f21ec70b-147a-4aa2-8dd0-f34b6e123638 service nova] Lock "abc9e2b8-f467-4cd0-b40f-de511fde1ec1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 17:51:42 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-25c52429-0fea-4d8c-b798-4f1593fe68b9 req-f21ec70b-147a-4aa2-8dd0-f34b6e123638 service nova] Lock "abc9e2b8-f467-4cd0-b40f-de511fde1ec1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 17:51:42 user nova-compute[74613]: DEBUG nova.compute.manager [req-25c52429-0fea-4d8c-b798-4f1593fe68b9 req-f21ec70b-147a-4aa2-8dd0-f34b6e123638 service nova] [instance: abc9e2b8-f467-4cd0-b40f-de511fde1ec1] No waiting events found dispatching network-vif-plugged-59a8bf1b-9fb1-4526-92d5-9ad1897c1ee8 {{(pid=74613) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 17:51:42 user nova-compute[74613]: WARNING nova.compute.manager [req-25c52429-0fea-4d8c-b798-4f1593fe68b9 req-f21ec70b-147a-4aa2-8dd0-f34b6e123638 service nova] [instance: abc9e2b8-f467-4cd0-b40f-de511fde1ec1] Received unexpected event network-vif-plugged-59a8bf1b-9fb1-4526-92d5-9ad1897c1ee8 for instance with vm_state building and task_state spawning.
Nov 29 17:51:43 user nova-compute[74613]: DEBUG nova.compute.manager [None req-d108c1ab-fa43-4e97-b056-065e3528f377 tempest-ServerBootFromVolumeStableRescueTest-414665510 tempest-ServerBootFromVolumeStableRescueTest-414665510-project-member] [instance: 3b828860-5cc5-40b0-b845-8e560211794e] Instance event wait completed in 0 seconds for  {{(pid=74613) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 29 17:51:43 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-d108c1ab-fa43-4e97-b056-065e3528f377 tempest-ServerBootFromVolumeStableRescueTest-414665510 tempest-ServerBootFromVolumeStableRescueTest-414665510-project-member] [instance: 3b828860-5cc5-40b0-b845-8e560211794e] Guest created on hypervisor {{(pid=74613) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 29 17:51:43 user nova-compute[74613]: DEBUG nova.virt.hardware [None req-3f6d5344-1f38-4085-9a6e-d96c8bbaee02 tempest-AttachSCSIVolumeTestJSON-1343397388 tempest-AttachSCSIVolumeTestJSON-1343397388-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74613) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 29 17:51:43 user nova-compute[74613]: INFO nova.compute.claims [None req-3f6d5344-1f38-4085-9a6e-d96c8bbaee02 tempest-AttachSCSIVolumeTestJSON-1343397388 tempest-AttachSCSIVolumeTestJSON-1343397388-project-member] [instance: 01c65b16-5dbe-4ad5-a72e-9500a4fa59cf] Claim successful on node user
Nov 29 17:51:43 user nova-compute[74613]: DEBUG nova.compute.manager [None req-3a7ec63d-1bdf-4849-9e6b-4f290ee89c4c tempest-AttachVolumeShelveTestJSON-1452861425 tempest-AttachVolumeShelveTestJSON-1452861425-project-member] [instance: c19e230e-2e6c-4c20-b15c-ad81a73674b4] Instance event wait completed in 0 seconds for  {{(pid=74613) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 29 17:51:43 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-3a7ec63d-1bdf-4849-9e6b-4f290ee89c4c tempest-AttachVolumeShelveTestJSON-1452861425 tempest-AttachVolumeShelveTestJSON-1452861425-project-member] [instance: c19e230e-2e6c-4c20-b15c-ad81a73674b4] Guest created on hypervisor {{(pid=74613) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 29 17:51:43 user nova-compute[74613]: DEBUG nova.compute.manager [None req-c110aa5d-1515-4b7e-988f-f60fba232273 tempest-ServerActionsTestOtherA-1784608629 tempest-ServerActionsTestOtherA-1784608629-project-member] [instance: abc9e2b8-f467-4cd0-b40f-de511fde1ec1] Instance event wait completed in 0 seconds for  {{(pid=74613) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 29 17:51:43 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-c110aa5d-1515-4b7e-988f-f60fba232273 tempest-ServerActionsTestOtherA-1784608629 tempest-ServerActionsTestOtherA-1784608629-project-member] [instance: abc9e2b8-f467-4cd0-b40f-de511fde1ec1] Guest created on hypervisor {{(pid=74613) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 29 17:51:43 user nova-compute[74613]: INFO nova.virt.libvirt.driver [-] [instance: 3b828860-5cc5-40b0-b845-8e560211794e] Instance spawned successfully.
Nov 29 17:51:43 user nova-compute[74613]: INFO nova.virt.libvirt.driver [-] [instance: c19e230e-2e6c-4c20-b15c-ad81a73674b4] Instance spawned successfully.
Nov 29 17:51:43 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-d108c1ab-fa43-4e97-b056-065e3528f377 tempest-ServerBootFromVolumeStableRescueTest-414665510 tempest-ServerBootFromVolumeStableRescueTest-414665510-project-member] [instance: 3b828860-5cc5-40b0-b845-8e560211794e] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74613) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 29 17:51:43 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-3a7ec63d-1bdf-4849-9e6b-4f290ee89c4c tempest-AttachVolumeShelveTestJSON-1452861425 tempest-AttachVolumeShelveTestJSON-1452861425-project-member] [instance: c19e230e-2e6c-4c20-b15c-ad81a73674b4] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74613) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 29 17:51:43 user nova-compute[74613]: INFO nova.virt.libvirt.driver [-] [instance: abc9e2b8-f467-4cd0-b40f-de511fde1ec1] Instance spawned successfully.
Nov 29 17:51:43 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-c110aa5d-1515-4b7e-988f-f60fba232273 tempest-ServerActionsTestOtherA-1784608629 tempest-ServerActionsTestOtherA-1784608629-project-member] [instance: abc9e2b8-f467-4cd0-b40f-de511fde1ec1] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74613) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 29 17:51:43 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-d108c1ab-fa43-4e97-b056-065e3528f377 tempest-ServerBootFromVolumeStableRescueTest-414665510 tempest-ServerBootFromVolumeStableRescueTest-414665510-project-member] [instance: 3b828860-5cc5-40b0-b845-8e560211794e] Found default for hw_cdrom_bus of ide {{(pid=74613) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 17:51:43 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-d108c1ab-fa43-4e97-b056-065e3528f377 tempest-ServerBootFromVolumeStableRescueTest-414665510 tempest-ServerBootFromVolumeStableRescueTest-414665510-project-member] [instance: 3b828860-5cc5-40b0-b845-8e560211794e] Found default for hw_disk_bus of virtio {{(pid=74613) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 17:51:43 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-d108c1ab-fa43-4e97-b056-065e3528f377 tempest-ServerBootFromVolumeStableRescueTest-414665510 tempest-ServerBootFromVolumeStableRescueTest-414665510-project-member] [instance: 3b828860-5cc5-40b0-b845-8e560211794e] Found default for hw_input_bus of None {{(pid=74613) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 17:51:43 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-d108c1ab-fa43-4e97-b056-065e3528f377 tempest-ServerBootFromVolumeStableRescueTest-414665510 tempest-ServerBootFromVolumeStableRescueTest-414665510-project-member] [instance: 3b828860-5cc5-40b0-b845-8e560211794e] Found default for hw_pointer_model of None {{(pid=74613) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 17:51:43 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-d108c1ab-fa43-4e97-b056-065e3528f377 tempest-ServerBootFromVolumeStableRescueTest-414665510 tempest-ServerBootFromVolumeStableRescueTest-414665510-project-member] [instance: 3b828860-5cc5-40b0-b845-8e560211794e] Found default for hw_video_model of virtio {{(pid=74613) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 17:51:43 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-d108c1ab-fa43-4e97-b056-065e3528f377 tempest-ServerBootFromVolumeStableRescueTest-414665510 tempest-ServerBootFromVolumeStableRescueTest-414665510-project-member] [instance: 3b828860-5cc5-40b0-b845-8e560211794e] Found default for hw_vif_model of virtio {{(pid=74613) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 17:51:43 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-3a7ec63d-1bdf-4849-9e6b-4f290ee89c4c tempest-AttachVolumeShelveTestJSON-1452861425 tempest-AttachVolumeShelveTestJSON-1452861425-project-member] [instance: c19e230e-2e6c-4c20-b15c-ad81a73674b4] Found default for hw_cdrom_bus of ide {{(pid=74613) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 17:51:43 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-3a7ec63d-1bdf-4849-9e6b-4f290ee89c4c tempest-AttachVolumeShelveTestJSON-1452861425 tempest-AttachVolumeShelveTestJSON-1452861425-project-member] [instance: c19e230e-2e6c-4c20-b15c-ad81a73674b4] Found default for hw_disk_bus of virtio {{(pid=74613) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 17:51:43 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-3a7ec63d-1bdf-4849-9e6b-4f290ee89c4c tempest-AttachVolumeShelveTestJSON-1452861425 tempest-AttachVolumeShelveTestJSON-1452861425-project-member] [instance: c19e230e-2e6c-4c20-b15c-ad81a73674b4] Found default for hw_input_bus of None {{(pid=74613) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 17:51:43 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-3a7ec63d-1bdf-4849-9e6b-4f290ee89c4c tempest-AttachVolumeShelveTestJSON-1452861425 tempest-AttachVolumeShelveTestJSON-1452861425-project-member] [instance: c19e230e-2e6c-4c20-b15c-ad81a73674b4] Found default for hw_pointer_model of None {{(pid=74613) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 17:51:43 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-3a7ec63d-1bdf-4849-9e6b-4f290ee89c4c tempest-AttachVolumeShelveTestJSON-1452861425 tempest-AttachVolumeShelveTestJSON-1452861425-project-member] [instance: c19e230e-2e6c-4c20-b15c-ad81a73674b4] Found default for hw_video_model of virtio {{(pid=74613) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 17:51:43 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-3a7ec63d-1bdf-4849-9e6b-4f290ee89c4c tempest-AttachVolumeShelveTestJSON-1452861425 tempest-AttachVolumeShelveTestJSON-1452861425-project-member] [instance: c19e230e-2e6c-4c20-b15c-ad81a73674b4] Found default for hw_vif_model of virtio {{(pid=74613) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 17:51:43 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-c110aa5d-1515-4b7e-988f-f60fba232273 tempest-ServerActionsTestOtherA-1784608629 tempest-ServerActionsTestOtherA-1784608629-project-member] [instance: abc9e2b8-f467-4cd0-b40f-de511fde1ec1] Found default for hw_cdrom_bus of ide {{(pid=74613) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 17:51:43 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-c110aa5d-1515-4b7e-988f-f60fba232273 tempest-ServerActionsTestOtherA-1784608629 tempest-ServerActionsTestOtherA-1784608629-project-member] [instance: abc9e2b8-f467-4cd0-b40f-de511fde1ec1] Found default for hw_disk_bus of virtio {{(pid=74613) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 17:51:43 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-c110aa5d-1515-4b7e-988f-f60fba232273 tempest-ServerActionsTestOtherA-1784608629 tempest-ServerActionsTestOtherA-1784608629-project-member] [instance: abc9e2b8-f467-4cd0-b40f-de511fde1ec1] Found default for hw_input_bus of None {{(pid=74613) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 17:51:43 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-c110aa5d-1515-4b7e-988f-f60fba232273 tempest-ServerActionsTestOtherA-1784608629 tempest-ServerActionsTestOtherA-1784608629-project-member] [instance: abc9e2b8-f467-4cd0-b40f-de511fde1ec1] Found default for hw_pointer_model of None {{(pid=74613) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 17:51:43 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-c110aa5d-1515-4b7e-988f-f60fba232273 tempest-ServerActionsTestOtherA-1784608629 tempest-ServerActionsTestOtherA-1784608629-project-member] [instance: abc9e2b8-f467-4cd0-b40f-de511fde1ec1] Found default for hw_video_model of virtio {{(pid=74613) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 17:51:43 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-c110aa5d-1515-4b7e-988f-f60fba232273 tempest-ServerActionsTestOtherA-1784608629 tempest-ServerActionsTestOtherA-1784608629-project-member] [instance: abc9e2b8-f467-4cd0-b40f-de511fde1ec1] Found default for hw_vif_model of virtio {{(pid=74613) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 17:51:43 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:51:43 user nova-compute[74613]: DEBUG nova.compute.manager [None req-31c66816-a579-4fed-917c-5fe116aeddf6 tempest-DeleteServersTestJSON-112443106 tempest-DeleteServersTestJSON-112443106-project-member] [instance: f3a5f6d2-cadd-485b-a443-1b8f3ed966b9] Instance event wait completed in 0 seconds for  {{(pid=74613) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 29 17:51:43 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-31c66816-a579-4fed-917c-5fe116aeddf6 tempest-DeleteServersTestJSON-112443106 tempest-DeleteServersTestJSON-112443106-project-member] [instance: f3a5f6d2-cadd-485b-a443-1b8f3ed966b9] Guest created on hypervisor {{(pid=74613) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 29 17:51:44 user nova-compute[74613]: INFO nova.virt.libvirt.driver [-] [instance: f3a5f6d2-cadd-485b-a443-1b8f3ed966b9] Instance spawned successfully.
Nov 29 17:51:44 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-31c66816-a579-4fed-917c-5fe116aeddf6 tempest-DeleteServersTestJSON-112443106 tempest-DeleteServersTestJSON-112443106-project-member] [instance: f3a5f6d2-cadd-485b-a443-1b8f3ed966b9] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74613) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 29 17:51:44 user nova-compute[74613]: INFO nova.compute.manager [None req-3a7ec63d-1bdf-4849-9e6b-4f290ee89c4c tempest-AttachVolumeShelveTestJSON-1452861425 tempest-AttachVolumeShelveTestJSON-1452861425-project-member] [instance: c19e230e-2e6c-4c20-b15c-ad81a73674b4] Took 17.52 seconds to spawn the instance on the hypervisor.
Nov 29 17:51:44 user nova-compute[74613]: DEBUG nova.compute.manager [None req-3a7ec63d-1bdf-4849-9e6b-4f290ee89c4c tempest-AttachVolumeShelveTestJSON-1452861425 tempest-AttachVolumeShelveTestJSON-1452861425-project-member] [instance: c19e230e-2e6c-4c20-b15c-ad81a73674b4] Checking state {{(pid=74613) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 29 17:51:44 user nova-compute[74613]: INFO nova.compute.manager [None req-d108c1ab-fa43-4e97-b056-065e3528f377 tempest-ServerBootFromVolumeStableRescueTest-414665510 tempest-ServerBootFromVolumeStableRescueTest-414665510-project-member] [instance: 3b828860-5cc5-40b0-b845-8e560211794e] Took 18.41 seconds to spawn the instance on the hypervisor.
Nov 29 17:51:44 user nova-compute[74613]: DEBUG nova.compute.manager [None req-d108c1ab-fa43-4e97-b056-065e3528f377 tempest-ServerBootFromVolumeStableRescueTest-414665510 tempest-ServerBootFromVolumeStableRescueTest-414665510-project-member] [instance: 3b828860-5cc5-40b0-b845-8e560211794e] Checking state {{(pid=74613) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 29 17:51:44 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-31c66816-a579-4fed-917c-5fe116aeddf6 tempest-DeleteServersTestJSON-112443106 tempest-DeleteServersTestJSON-112443106-project-member] [instance: f3a5f6d2-cadd-485b-a443-1b8f3ed966b9] Found default for hw_cdrom_bus of ide {{(pid=74613) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 17:51:44 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-31c66816-a579-4fed-917c-5fe116aeddf6 tempest-DeleteServersTestJSON-112443106 tempest-DeleteServersTestJSON-112443106-project-member] [instance: f3a5f6d2-cadd-485b-a443-1b8f3ed966b9] Found default for hw_disk_bus of virtio {{(pid=74613) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 17:51:44 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-31c66816-a579-4fed-917c-5fe116aeddf6 tempest-DeleteServersTestJSON-112443106 tempest-DeleteServersTestJSON-112443106-project-member] [instance: f3a5f6d2-cadd-485b-a443-1b8f3ed966b9] Found default for hw_input_bus of None {{(pid=74613) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 17:51:44 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-31c66816-a579-4fed-917c-5fe116aeddf6 tempest-DeleteServersTestJSON-112443106 tempest-DeleteServersTestJSON-112443106-project-member] [instance: f3a5f6d2-cadd-485b-a443-1b8f3ed966b9] Found default for hw_pointer_model of None {{(pid=74613) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 17:51:44 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-31c66816-a579-4fed-917c-5fe116aeddf6 tempest-DeleteServersTestJSON-112443106 tempest-DeleteServersTestJSON-112443106-project-member] [instance: f3a5f6d2-cadd-485b-a443-1b8f3ed966b9] Found default for hw_video_model of virtio {{(pid=74613) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 17:51:44 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-31c66816-a579-4fed-917c-5fe116aeddf6 tempest-DeleteServersTestJSON-112443106 tempest-DeleteServersTestJSON-112443106-project-member] [instance: f3a5f6d2-cadd-485b-a443-1b8f3ed966b9] Found default for hw_vif_model of virtio {{(pid=74613) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 17:51:44 user nova-compute[74613]: INFO nova.compute.manager [None req-c110aa5d-1515-4b7e-988f-f60fba232273 tempest-ServerActionsTestOtherA-1784608629 tempest-ServerActionsTestOtherA-1784608629-project-member] [instance: abc9e2b8-f467-4cd0-b40f-de511fde1ec1] Took 16.84 seconds to spawn the instance on the hypervisor.
Nov 29 17:51:44 user nova-compute[74613]: DEBUG nova.compute.manager [None req-c110aa5d-1515-4b7e-988f-f60fba232273 tempest-ServerActionsTestOtherA-1784608629 tempest-ServerActionsTestOtherA-1784608629-project-member] [instance: abc9e2b8-f467-4cd0-b40f-de511fde1ec1] Checking state {{(pid=74613) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 29 17:51:44 user nova-compute[74613]: DEBUG nova.compute.manager [None req-c95f4e22-f5b1-4f6e-80dc-83a2ee62815f tempest-ServerStableDeviceRescueTest-1416322546 tempest-ServerStableDeviceRescueTest-1416322546-project-member] [instance: b6b0ba36-ad89-45f1-9578-8b999567dd25] Instance event wait completed in 0 seconds for  {{(pid=74613) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 29 17:51:44 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-c95f4e22-f5b1-4f6e-80dc-83a2ee62815f tempest-ServerStableDeviceRescueTest-1416322546 tempest-ServerStableDeviceRescueTest-1416322546-project-member] [instance: b6b0ba36-ad89-45f1-9578-8b999567dd25] Guest created on hypervisor {{(pid=74613) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 29 17:51:44 user nova-compute[74613]: INFO nova.compute.manager [None req-31c66816-a579-4fed-917c-5fe116aeddf6 tempest-DeleteServersTestJSON-112443106 tempest-DeleteServersTestJSON-112443106-project-member] [instance: f3a5f6d2-cadd-485b-a443-1b8f3ed966b9] Took 18.10 seconds to spawn the instance on the hypervisor.
Nov 29 17:51:44 user nova-compute[74613]: DEBUG nova.compute.manager [None req-31c66816-a579-4fed-917c-5fe116aeddf6 tempest-DeleteServersTestJSON-112443106 tempest-DeleteServersTestJSON-112443106-project-member] [instance: f3a5f6d2-cadd-485b-a443-1b8f3ed966b9] Checking state {{(pid=74613) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 29 17:51:44 user nova-compute[74613]: INFO nova.compute.manager [None req-3a7ec63d-1bdf-4849-9e6b-4f290ee89c4c tempest-AttachVolumeShelveTestJSON-1452861425 tempest-AttachVolumeShelveTestJSON-1452861425-project-member] [instance: c19e230e-2e6c-4c20-b15c-ad81a73674b4] Took 19.33 seconds to build instance.
Nov 29 17:51:44 user nova-compute[74613]: INFO nova.compute.manager [None req-d108c1ab-fa43-4e97-b056-065e3528f377 tempest-ServerBootFromVolumeStableRescueTest-414665510 tempest-ServerBootFromVolumeStableRescueTest-414665510-project-member] [instance: 3b828860-5cc5-40b0-b845-8e560211794e] Took 19.65 seconds to build instance.
Nov 29 17:51:44 user nova-compute[74613]: INFO nova.virt.libvirt.driver [-] [instance: b6b0ba36-ad89-45f1-9578-8b999567dd25] Instance spawned successfully.
Nov 29 17:51:44 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-c95f4e22-f5b1-4f6e-80dc-83a2ee62815f tempest-ServerStableDeviceRescueTest-1416322546 tempest-ServerStableDeviceRescueTest-1416322546-project-member] [instance: b6b0ba36-ad89-45f1-9578-8b999567dd25] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74613) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 29 17:51:44 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-3a7ec63d-1bdf-4849-9e6b-4f290ee89c4c tempest-AttachVolumeShelveTestJSON-1452861425 tempest-AttachVolumeShelveTestJSON-1452861425-project-member] Lock "c19e230e-2e6c-4c20-b15c-ad81a73674b4" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 19.624s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 17:51:44 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-d108c1ab-fa43-4e97-b056-065e3528f377 tempest-ServerBootFromVolumeStableRescueTest-414665510 tempest-ServerBootFromVolumeStableRescueTest-414665510-project-member] Lock "3b828860-5cc5-40b0-b845-8e560211794e" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 20.018s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 17:51:44 user nova-compute[74613]: DEBUG nova.compute.provider_tree [None req-3f6d5344-1f38-4085-9a6e-d96c8bbaee02 tempest-AttachSCSIVolumeTestJSON-1343397388 tempest-AttachSCSIVolumeTestJSON-1343397388-project-member] Inventory has not changed in ProviderTree for provider: 639d980e-3b12-44b1-b8f4-1812416fa4dd {{(pid=74613) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 17:51:44 user nova-compute[74613]: INFO nova.compute.manager [None req-c110aa5d-1515-4b7e-988f-f60fba232273 tempest-ServerActionsTestOtherA-1784608629 tempest-ServerActionsTestOtherA-1784608629-project-member] [instance: abc9e2b8-f467-4cd0-b40f-de511fde1ec1] Took 17.89 seconds to build instance.
Nov 29 17:51:44 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-c95f4e22-f5b1-4f6e-80dc-83a2ee62815f tempest-ServerStableDeviceRescueTest-1416322546 tempest-ServerStableDeviceRescueTest-1416322546-project-member] [instance: b6b0ba36-ad89-45f1-9578-8b999567dd25] Found default for hw_cdrom_bus of ide {{(pid=74613) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 17:51:44 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-c95f4e22-f5b1-4f6e-80dc-83a2ee62815f tempest-ServerStableDeviceRescueTest-1416322546 tempest-ServerStableDeviceRescueTest-1416322546-project-member] [instance: b6b0ba36-ad89-45f1-9578-8b999567dd25] Found default for hw_disk_bus of virtio {{(pid=74613) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 17:51:44 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-c95f4e22-f5b1-4f6e-80dc-83a2ee62815f tempest-ServerStableDeviceRescueTest-1416322546 tempest-ServerStableDeviceRescueTest-1416322546-project-member] [instance: b6b0ba36-ad89-45f1-9578-8b999567dd25] Found default for hw_input_bus of None {{(pid=74613) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 17:51:44 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-c95f4e22-f5b1-4f6e-80dc-83a2ee62815f tempest-ServerStableDeviceRescueTest-1416322546 tempest-ServerStableDeviceRescueTest-1416322546-project-member] [instance: b6b0ba36-ad89-45f1-9578-8b999567dd25] Found default for hw_pointer_model of None {{(pid=74613) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 17:51:44 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-c95f4e22-f5b1-4f6e-80dc-83a2ee62815f tempest-ServerStableDeviceRescueTest-1416322546 tempest-ServerStableDeviceRescueTest-1416322546-project-member] [instance: b6b0ba36-ad89-45f1-9578-8b999567dd25] Found default for hw_video_model of virtio {{(pid=74613) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 17:51:44 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-c95f4e22-f5b1-4f6e-80dc-83a2ee62815f tempest-ServerStableDeviceRescueTest-1416322546 tempest-ServerStableDeviceRescueTest-1416322546-project-member] [instance: b6b0ba36-ad89-45f1-9578-8b999567dd25] Found default for hw_vif_model of virtio {{(pid=74613) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 17:51:44 user nova-compute[74613]: DEBUG nova.scheduler.client.report [None req-3f6d5344-1f38-4085-9a6e-d96c8bbaee02 tempest-AttachSCSIVolumeTestJSON-1343397388 tempest-AttachSCSIVolumeTestJSON-1343397388-project-member] Inventory has not changed for provider 639d980e-3b12-44b1-b8f4-1812416fa4dd based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74613) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 17:51:44 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-c110aa5d-1515-4b7e-988f-f60fba232273 tempest-ServerActionsTestOtherA-1784608629 tempest-ServerActionsTestOtherA-1784608629-project-member] Lock "abc9e2b8-f467-4cd0-b40f-de511fde1ec1" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 18.050s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 17:51:44 user nova-compute[74613]: INFO nova.compute.manager [None req-31c66816-a579-4fed-917c-5fe116aeddf6 tempest-DeleteServersTestJSON-112443106 tempest-DeleteServersTestJSON-112443106-project-member] [instance: f3a5f6d2-cadd-485b-a443-1b8f3ed966b9] Took 19.85 seconds to build instance.
Nov 29 17:51:44 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-31c66816-a579-4fed-917c-5fe116aeddf6 tempest-DeleteServersTestJSON-112443106 tempest-DeleteServersTestJSON-112443106-project-member] Lock "f3a5f6d2-cadd-485b-a443-1b8f3ed966b9" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 20.144s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 17:51:44 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-3f6d5344-1f38-4085-9a6e-d96c8bbaee02 tempest-AttachSCSIVolumeTestJSON-1343397388 tempest-AttachSCSIVolumeTestJSON-1343397388-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 6.745s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 17:51:44 user nova-compute[74613]: DEBUG nova.compute.manager [None req-3f6d5344-1f38-4085-9a6e-d96c8bbaee02 tempest-AttachSCSIVolumeTestJSON-1343397388 tempest-AttachSCSIVolumeTestJSON-1343397388-project-member] [instance: 01c65b16-5dbe-4ad5-a72e-9500a4fa59cf] Start building networks asynchronously for instance. {{(pid=74613) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 29 17:51:44 user nova-compute[74613]: DEBUG nova.compute.manager [None req-3f6d5344-1f38-4085-9a6e-d96c8bbaee02 tempest-AttachSCSIVolumeTestJSON-1343397388 tempest-AttachSCSIVolumeTestJSON-1343397388-project-member] [instance: 01c65b16-5dbe-4ad5-a72e-9500a4fa59cf] Allocating IP information in the background. {{(pid=74613) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 29 17:51:44 user nova-compute[74613]: DEBUG nova.network.neutron [None req-3f6d5344-1f38-4085-9a6e-d96c8bbaee02 tempest-AttachSCSIVolumeTestJSON-1343397388 tempest-AttachSCSIVolumeTestJSON-1343397388-project-member] [instance: 01c65b16-5dbe-4ad5-a72e-9500a4fa59cf] allocate_for_instance() {{(pid=74613) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 29 17:51:44 user nova-compute[74613]: INFO nova.compute.manager [None req-c95f4e22-f5b1-4f6e-80dc-83a2ee62815f tempest-ServerStableDeviceRescueTest-1416322546 tempest-ServerStableDeviceRescueTest-1416322546-project-member] [instance: b6b0ba36-ad89-45f1-9578-8b999567dd25] Took 20.39 seconds to spawn the instance on the hypervisor.
Nov 29 17:51:44 user nova-compute[74613]: DEBUG nova.compute.manager [None req-c95f4e22-f5b1-4f6e-80dc-83a2ee62815f tempest-ServerStableDeviceRescueTest-1416322546 tempest-ServerStableDeviceRescueTest-1416322546-project-member] [instance: b6b0ba36-ad89-45f1-9578-8b999567dd25] Checking state {{(pid=74613) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 29 17:51:44 user nova-compute[74613]: INFO nova.virt.libvirt.driver [None req-3f6d5344-1f38-4085-9a6e-d96c8bbaee02 tempest-AttachSCSIVolumeTestJSON-1343397388 tempest-AttachSCSIVolumeTestJSON-1343397388-project-member] [instance: 01c65b16-5dbe-4ad5-a72e-9500a4fa59cf] Ignoring supplied device name: /dev/sda. Libvirt can't honour user-supplied dev names
Nov 29 17:51:44 user nova-compute[74613]: DEBUG nova.compute.manager [None req-3f6d5344-1f38-4085-9a6e-d96c8bbaee02 tempest-AttachSCSIVolumeTestJSON-1343397388 tempest-AttachSCSIVolumeTestJSON-1343397388-project-member] [instance: 01c65b16-5dbe-4ad5-a72e-9500a4fa59cf] Start building block device mappings for instance. {{(pid=74613) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 29 17:51:44 user nova-compute[74613]: INFO nova.compute.manager [None req-c95f4e22-f5b1-4f6e-80dc-83a2ee62815f tempest-ServerStableDeviceRescueTest-1416322546 tempest-ServerStableDeviceRescueTest-1416322546-project-member] [instance: b6b0ba36-ad89-45f1-9578-8b999567dd25] Took 21.66 seconds to build instance.
Nov 29 17:51:44 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-c95f4e22-f5b1-4f6e-80dc-83a2ee62815f tempest-ServerStableDeviceRescueTest-1416322546 tempest-ServerStableDeviceRescueTest-1416322546-project-member] Lock "b6b0ba36-ad89-45f1-9578-8b999567dd25" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 21.888s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 17:51:44 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:51:44 user nova-compute[74613]: DEBUG nova.policy [None req-3f6d5344-1f38-4085-9a6e-d96c8bbaee02 tempest-AttachSCSIVolumeTestJSON-1343397388 tempest-AttachSCSIVolumeTestJSON-1343397388-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '3d3ee0ac41c4402182bb4fdc83f543bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab6d78b5cdf64466914b67f7405aa79f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74613) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 29 17:51:45 user nova-compute[74613]: DEBUG nova.compute.manager [None req-3f6d5344-1f38-4085-9a6e-d96c8bbaee02 tempest-AttachSCSIVolumeTestJSON-1343397388 tempest-AttachSCSIVolumeTestJSON-1343397388-project-member] [instance: 01c65b16-5dbe-4ad5-a72e-9500a4fa59cf] Start spawning the instance on the hypervisor. {{(pid=74613) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 29 17:51:45 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-3f6d5344-1f38-4085-9a6e-d96c8bbaee02 tempest-AttachSCSIVolumeTestJSON-1343397388 tempest-AttachSCSIVolumeTestJSON-1343397388-project-member] [instance: 01c65b16-5dbe-4ad5-a72e-9500a4fa59cf] Creating instance directory {{(pid=74613) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 29 17:51:45 user nova-compute[74613]: INFO nova.virt.libvirt.driver [None req-3f6d5344-1f38-4085-9a6e-d96c8bbaee02 tempest-AttachSCSIVolumeTestJSON-1343397388 tempest-AttachSCSIVolumeTestJSON-1343397388-project-member] [instance: 01c65b16-5dbe-4ad5-a72e-9500a4fa59cf] Creating image(s)
Nov 29 17:51:45 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-3f6d5344-1f38-4085-9a6e-d96c8bbaee02 tempest-AttachSCSIVolumeTestJSON-1343397388 tempest-AttachSCSIVolumeTestJSON-1343397388-project-member] Acquiring lock "/opt/stack/data/nova/instances/01c65b16-5dbe-4ad5-a72e-9500a4fa59cf/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 17:51:45 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-3f6d5344-1f38-4085-9a6e-d96c8bbaee02 tempest-AttachSCSIVolumeTestJSON-1343397388 tempest-AttachSCSIVolumeTestJSON-1343397388-project-member] Lock "/opt/stack/data/nova/instances/01c65b16-5dbe-4ad5-a72e-9500a4fa59cf/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 17:51:45 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-3f6d5344-1f38-4085-9a6e-d96c8bbaee02 tempest-AttachSCSIVolumeTestJSON-1343397388 tempest-AttachSCSIVolumeTestJSON-1343397388-project-member] Lock "/opt/stack/data/nova/instances/01c65b16-5dbe-4ad5-a72e-9500a4fa59cf/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 17:51:45 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-3f6d5344-1f38-4085-9a6e-d96c8bbaee02 tempest-AttachSCSIVolumeTestJSON-1343397388 tempest-AttachSCSIVolumeTestJSON-1343397388-project-member] Acquiring lock "d6570baddb6b0892e26a58acfaba2fc682212e3b" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 17:51:45 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-3f6d5344-1f38-4085-9a6e-d96c8bbaee02 tempest-AttachSCSIVolumeTestJSON-1343397388 tempest-AttachSCSIVolumeTestJSON-1343397388-project-member] Lock "d6570baddb6b0892e26a58acfaba2fc682212e3b" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.003s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 17:51:45 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-3f6d5344-1f38-4085-9a6e-d96c8bbaee02 tempest-AttachSCSIVolumeTestJSON-1343397388 tempest-AttachSCSIVolumeTestJSON-1343397388-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d6570baddb6b0892e26a58acfaba2fc682212e3b.part --force-share --output=json {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 17:51:45 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:51:46 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-3f6d5344-1f38-4085-9a6e-d96c8bbaee02 tempest-AttachSCSIVolumeTestJSON-1343397388 tempest-AttachSCSIVolumeTestJSON-1343397388-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d6570baddb6b0892e26a58acfaba2fc682212e3b.part --force-share --output=json" returned: 0 in 0.299s {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 17:51:46 user nova-compute[74613]: DEBUG nova.virt.images [None req-3f6d5344-1f38-4085-9a6e-d96c8bbaee02 tempest-AttachSCSIVolumeTestJSON-1343397388 tempest-AttachSCSIVolumeTestJSON-1343397388-project-member] 5443c2d3-dc95-4e1c-af07-7f61ae95607d was qcow2, converting to raw {{(pid=74613) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 29 17:51:46 user nova-compute[74613]: DEBUG nova.privsep.utils [None req-3f6d5344-1f38-4085-9a6e-d96c8bbaee02 tempest-AttachSCSIVolumeTestJSON-1343397388 tempest-AttachSCSIVolumeTestJSON-1343397388-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74613) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 29 17:51:46 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-3f6d5344-1f38-4085-9a6e-d96c8bbaee02 tempest-AttachSCSIVolumeTestJSON-1343397388 tempest-AttachSCSIVolumeTestJSON-1343397388-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/d6570baddb6b0892e26a58acfaba2fc682212e3b.part /opt/stack/data/nova/instances/_base/d6570baddb6b0892e26a58acfaba2fc682212e3b.converted {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 17:51:46 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-3f6d5344-1f38-4085-9a6e-d96c8bbaee02 tempest-AttachSCSIVolumeTestJSON-1343397388 tempest-AttachSCSIVolumeTestJSON-1343397388-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/d6570baddb6b0892e26a58acfaba2fc682212e3b.part /opt/stack/data/nova/instances/_base/d6570baddb6b0892e26a58acfaba2fc682212e3b.converted" returned: 0 in 0.297s {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 17:51:46 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-3f6d5344-1f38-4085-9a6e-d96c8bbaee02 tempest-AttachSCSIVolumeTestJSON-1343397388 tempest-AttachSCSIVolumeTestJSON-1343397388-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d6570baddb6b0892e26a58acfaba2fc682212e3b.converted --force-share --output=json {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 17:51:46 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:51:46 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:51:46 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-3f6d5344-1f38-4085-9a6e-d96c8bbaee02 tempest-AttachSCSIVolumeTestJSON-1343397388 tempest-AttachSCSIVolumeTestJSON-1343397388-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d6570baddb6b0892e26a58acfaba2fc682212e3b.converted --force-share --output=json" returned: 0 in 0.213s {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 17:51:46 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-3f6d5344-1f38-4085-9a6e-d96c8bbaee02 tempest-AttachSCSIVolumeTestJSON-1343397388 tempest-AttachSCSIVolumeTestJSON-1343397388-project-member] Lock "d6570baddb6b0892e26a58acfaba2fc682212e3b" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.648s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 17:51:46 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-3f6d5344-1f38-4085-9a6e-d96c8bbaee02 tempest-AttachSCSIVolumeTestJSON-1343397388 tempest-AttachSCSIVolumeTestJSON-1343397388-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d6570baddb6b0892e26a58acfaba2fc682212e3b --force-share --output=json {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 17:51:46 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-3f6d5344-1f38-4085-9a6e-d96c8bbaee02 tempest-AttachSCSIVolumeTestJSON-1343397388 tempest-AttachSCSIVolumeTestJSON-1343397388-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d6570baddb6b0892e26a58acfaba2fc682212e3b --force-share --output=json" returned: 0 in 0.244s {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 17:51:46 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-3f6d5344-1f38-4085-9a6e-d96c8bbaee02 tempest-AttachSCSIVolumeTestJSON-1343397388 tempest-AttachSCSIVolumeTestJSON-1343397388-project-member] Acquiring lock "d6570baddb6b0892e26a58acfaba2fc682212e3b" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 17:51:46 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-3f6d5344-1f38-4085-9a6e-d96c8bbaee02 tempest-AttachSCSIVolumeTestJSON-1343397388 tempest-AttachSCSIVolumeTestJSON-1343397388-project-member] Lock "d6570baddb6b0892e26a58acfaba2fc682212e3b" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 17:51:46 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-3f6d5344-1f38-4085-9a6e-d96c8bbaee02 tempest-AttachSCSIVolumeTestJSON-1343397388 tempest-AttachSCSIVolumeTestJSON-1343397388-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d6570baddb6b0892e26a58acfaba2fc682212e3b --force-share --output=json {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 17:51:47 user nova-compute[74613]: DEBUG nova.network.neutron [None req-3f6d5344-1f38-4085-9a6e-d96c8bbaee02 tempest-AttachSCSIVolumeTestJSON-1343397388 tempest-AttachSCSIVolumeTestJSON-1343397388-project-member] [instance: 01c65b16-5dbe-4ad5-a72e-9500a4fa59cf] Successfully created port: 9441dfc5-c933-4642-b797-494d88a10f8a {{(pid=74613) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 29 17:51:47 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-3f6d5344-1f38-4085-9a6e-d96c8bbaee02 tempest-AttachSCSIVolumeTestJSON-1343397388 tempest-AttachSCSIVolumeTestJSON-1343397388-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d6570baddb6b0892e26a58acfaba2fc682212e3b --force-share --output=json" returned: 0 in 0.312s {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 17:51:47 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-3f6d5344-1f38-4085-9a6e-d96c8bbaee02 tempest-AttachSCSIVolumeTestJSON-1343397388 tempest-AttachSCSIVolumeTestJSON-1343397388-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d6570baddb6b0892e26a58acfaba2fc682212e3b,backing_fmt=raw /opt/stack/data/nova/instances/01c65b16-5dbe-4ad5-a72e-9500a4fa59cf/disk 1073741824 {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 17:51:47 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-3f6d5344-1f38-4085-9a6e-d96c8bbaee02 tempest-AttachSCSIVolumeTestJSON-1343397388 tempest-AttachSCSIVolumeTestJSON-1343397388-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d6570baddb6b0892e26a58acfaba2fc682212e3b,backing_fmt=raw /opt/stack/data/nova/instances/01c65b16-5dbe-4ad5-a72e-9500a4fa59cf/disk 1073741824" returned: 0 in 0.072s {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 17:51:47 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-3f6d5344-1f38-4085-9a6e-d96c8bbaee02 tempest-AttachSCSIVolumeTestJSON-1343397388 tempest-AttachSCSIVolumeTestJSON-1343397388-project-member] Lock "d6570baddb6b0892e26a58acfaba2fc682212e3b" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.393s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 17:51:47 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-3f6d5344-1f38-4085-9a6e-d96c8bbaee02 tempest-AttachSCSIVolumeTestJSON-1343397388 tempest-AttachSCSIVolumeTestJSON-1343397388-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d6570baddb6b0892e26a58acfaba2fc682212e3b --force-share --output=json {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 17:51:47 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-3f6d5344-1f38-4085-9a6e-d96c8bbaee02 tempest-AttachSCSIVolumeTestJSON-1343397388 tempest-AttachSCSIVolumeTestJSON-1343397388-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d6570baddb6b0892e26a58acfaba2fc682212e3b --force-share --output=json" returned: 0 in 0.297s {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 17:51:47 user nova-compute[74613]: DEBUG nova.virt.disk.api [None req-3f6d5344-1f38-4085-9a6e-d96c8bbaee02 tempest-AttachSCSIVolumeTestJSON-1343397388 tempest-AttachSCSIVolumeTestJSON-1343397388-project-member] Checking if we can resize image /opt/stack/data/nova/instances/01c65b16-5dbe-4ad5-a72e-9500a4fa59cf/disk. size=1073741824 {{(pid=74613) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 29 17:51:47 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-3f6d5344-1f38-4085-9a6e-d96c8bbaee02 tempest-AttachSCSIVolumeTestJSON-1343397388 tempest-AttachSCSIVolumeTestJSON-1343397388-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/01c65b16-5dbe-4ad5-a72e-9500a4fa59cf/disk --force-share --output=json {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 17:51:48 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-3f6d5344-1f38-4085-9a6e-d96c8bbaee02 tempest-AttachSCSIVolumeTestJSON-1343397388 tempest-AttachSCSIVolumeTestJSON-1343397388-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/01c65b16-5dbe-4ad5-a72e-9500a4fa59cf/disk --force-share --output=json" returned: 0 in 0.380s {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 17:51:48 user nova-compute[74613]: DEBUG nova.virt.disk.api [None req-3f6d5344-1f38-4085-9a6e-d96c8bbaee02 tempest-AttachSCSIVolumeTestJSON-1343397388 tempest-AttachSCSIVolumeTestJSON-1343397388-project-member] Cannot resize image /opt/stack/data/nova/instances/01c65b16-5dbe-4ad5-a72e-9500a4fa59cf/disk to a smaller size. {{(pid=74613) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 29 17:51:48 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-3f6d5344-1f38-4085-9a6e-d96c8bbaee02 tempest-AttachSCSIVolumeTestJSON-1343397388 tempest-AttachSCSIVolumeTestJSON-1343397388-project-member] [instance: 01c65b16-5dbe-4ad5-a72e-9500a4fa59cf] Created local disks {{(pid=74613) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 29 17:51:48 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-3f6d5344-1f38-4085-9a6e-d96c8bbaee02 tempest-AttachSCSIVolumeTestJSON-1343397388 tempest-AttachSCSIVolumeTestJSON-1343397388-project-member] [instance: 01c65b16-5dbe-4ad5-a72e-9500a4fa59cf] Ensure instance console log exists: /opt/stack/data/nova/instances/01c65b16-5dbe-4ad5-a72e-9500a4fa59cf/console.log {{(pid=74613) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 29 17:51:48 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-3f6d5344-1f38-4085-9a6e-d96c8bbaee02 tempest-AttachSCSIVolumeTestJSON-1343397388 tempest-AttachSCSIVolumeTestJSON-1343397388-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 17:51:48 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-3f6d5344-1f38-4085-9a6e-d96c8bbaee02 tempest-AttachSCSIVolumeTestJSON-1343397388 tempest-AttachSCSIVolumeTestJSON-1343397388-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 17:51:48 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-3f6d5344-1f38-4085-9a6e-d96c8bbaee02 tempest-AttachSCSIVolumeTestJSON-1343397388 tempest-AttachSCSIVolumeTestJSON-1343397388-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 17:51:48 user nova-compute[74613]: DEBUG nova.network.neutron [None req-3f6d5344-1f38-4085-9a6e-d96c8bbaee02 tempest-AttachSCSIVolumeTestJSON-1343397388 tempest-AttachSCSIVolumeTestJSON-1343397388-project-member] [instance: 01c65b16-5dbe-4ad5-a72e-9500a4fa59cf] Successfully updated port: 9441dfc5-c933-4642-b797-494d88a10f8a {{(pid=74613) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 29 17:51:48 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-3f6d5344-1f38-4085-9a6e-d96c8bbaee02 tempest-AttachSCSIVolumeTestJSON-1343397388 tempest-AttachSCSIVolumeTestJSON-1343397388-project-member] Acquiring lock "refresh_cache-01c65b16-5dbe-4ad5-a72e-9500a4fa59cf" {{(pid=74613) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 17:51:48 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-3f6d5344-1f38-4085-9a6e-d96c8bbaee02 tempest-AttachSCSIVolumeTestJSON-1343397388 tempest-AttachSCSIVolumeTestJSON-1343397388-project-member] Acquired lock "refresh_cache-01c65b16-5dbe-4ad5-a72e-9500a4fa59cf" {{(pid=74613) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 17:51:48 user nova-compute[74613]: DEBUG nova.network.neutron [None req-3f6d5344-1f38-4085-9a6e-d96c8bbaee02 tempest-AttachSCSIVolumeTestJSON-1343397388 tempest-AttachSCSIVolumeTestJSON-1343397388-project-member] [instance: 01c65b16-5dbe-4ad5-a72e-9500a4fa59cf] Building network info cache for instance {{(pid=74613) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 29 17:51:48 user nova-compute[74613]: DEBUG nova.compute.manager [req-f1af8013-1b94-4ed6-8811-c1cf3191a83b req-d53ab878-8795-4ee7-867c-b280f0ec365f service nova] [instance: 01c65b16-5dbe-4ad5-a72e-9500a4fa59cf] Received event network-changed-9441dfc5-c933-4642-b797-494d88a10f8a {{(pid=74613) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 17:51:48 user nova-compute[74613]: DEBUG nova.compute.manager [req-f1af8013-1b94-4ed6-8811-c1cf3191a83b req-d53ab878-8795-4ee7-867c-b280f0ec365f service nova] [instance: 01c65b16-5dbe-4ad5-a72e-9500a4fa59cf] Refreshing instance network info cache due to event network-changed-9441dfc5-c933-4642-b797-494d88a10f8a. {{(pid=74613) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 17:51:48 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-f1af8013-1b94-4ed6-8811-c1cf3191a83b req-d53ab878-8795-4ee7-867c-b280f0ec365f service nova] Acquiring lock "refresh_cache-01c65b16-5dbe-4ad5-a72e-9500a4fa59cf" {{(pid=74613) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 17:51:48 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:51:48 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:51:48 user nova-compute[74613]: DEBUG nova.network.neutron [None req-3f6d5344-1f38-4085-9a6e-d96c8bbaee02 tempest-AttachSCSIVolumeTestJSON-1343397388 tempest-AttachSCSIVolumeTestJSON-1343397388-project-member] [instance: 01c65b16-5dbe-4ad5-a72e-9500a4fa59cf] Instance cache missing network info. {{(pid=74613) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 29 17:51:48 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:51:49 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:51:49 user nova-compute[74613]: DEBUG nova.network.neutron [None req-3f6d5344-1f38-4085-9a6e-d96c8bbaee02 tempest-AttachSCSIVolumeTestJSON-1343397388 tempest-AttachSCSIVolumeTestJSON-1343397388-project-member] [instance: 01c65b16-5dbe-4ad5-a72e-9500a4fa59cf] Updating instance_info_cache with network_info: [{"id": "9441dfc5-c933-4642-b797-494d88a10f8a", "address": "fa:16:3e:c7:6c:2d", "network": {"id": "1db277f8-4456-4ba3-8eef-276639086245", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1225625601-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ab6d78b5cdf64466914b67f7405aa79f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9441dfc5-c9", "ovs_interfaceid": "9441dfc5-c933-4642-b797-494d88a10f8a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74613) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 17:51:49 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:51:49 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-3f6d5344-1f38-4085-9a6e-d96c8bbaee02 tempest-AttachSCSIVolumeTestJSON-1343397388 tempest-AttachSCSIVolumeTestJSON-1343397388-project-member] Releasing lock "refresh_cache-01c65b16-5dbe-4ad5-a72e-9500a4fa59cf" {{(pid=74613) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 17:51:49 user nova-compute[74613]: DEBUG nova.compute.manager [None req-3f6d5344-1f38-4085-9a6e-d96c8bbaee02 tempest-AttachSCSIVolumeTestJSON-1343397388 tempest-AttachSCSIVolumeTestJSON-1343397388-project-member] [instance: 01c65b16-5dbe-4ad5-a72e-9500a4fa59cf] Instance network_info: |[{"id": "9441dfc5-c933-4642-b797-494d88a10f8a", "address": "fa:16:3e:c7:6c:2d", "network": {"id": "1db277f8-4456-4ba3-8eef-276639086245", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1225625601-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ab6d78b5cdf64466914b67f7405aa79f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9441dfc5-c9", "ovs_interfaceid": "9441dfc5-c933-4642-b797-494d88a10f8a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74613) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 29 17:51:49 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-f1af8013-1b94-4ed6-8811-c1cf3191a83b req-d53ab878-8795-4ee7-867c-b280f0ec365f service nova] Acquired lock "refresh_cache-01c65b16-5dbe-4ad5-a72e-9500a4fa59cf" {{(pid=74613) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 17:51:49 user nova-compute[74613]: DEBUG nova.network.neutron [req-f1af8013-1b94-4ed6-8811-c1cf3191a83b req-d53ab878-8795-4ee7-867c-b280f0ec365f service nova] [instance: 01c65b16-5dbe-4ad5-a72e-9500a4fa59cf] Refreshing network info cache for port 9441dfc5-c933-4642-b797-494d88a10f8a {{(pid=74613) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 17:51:49 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-3f6d5344-1f38-4085-9a6e-d96c8bbaee02 tempest-AttachSCSIVolumeTestJSON-1343397388 tempest-AttachSCSIVolumeTestJSON-1343397388-project-member] [instance: 01c65b16-5dbe-4ad5-a72e-9500a4fa59cf] Start _get_guest_xml network_info=[{"id": "9441dfc5-c933-4642-b797-494d88a10f8a", "address": "fa:16:3e:c7:6c:2d", "network": {"id": "1db277f8-4456-4ba3-8eef-276639086245", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1225625601-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ab6d78b5cdf64466914b67f7405aa79f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9441dfc5-c9", "ovs_interfaceid": "9441dfc5-c933-4642-b797-494d88a10f8a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'scsi', 'cdrom_bus': 'scsi', 'mapping': {'root': {'bus': 'scsi', 'dev': 'sda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'scsi', 'dev': 'sda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'scsi', 'dev': 'sdb', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-29T17:51:31Z,direct_url=<?>,disk_format='qcow2',id=5443c2d3-dc95-4e1c-af07-7f61ae95607d,min_disk=0,min_ram=0,name='',owner='7ba7c4ff05b94660aaeb6593c0adeb69',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-29T17:51:33Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/sda', 'image': [{'encryption_options': None, 'encryption_secret_uuid': None, 'device_name': '/dev/sda', 'size': 0, 'device_type': 'disk', 'boot_index': 0, 'guest_format': None, 'encrypted': False, 'encryption_format': None, 'disk_bus': 'scsi', 'image_id': '5443c2d3-dc95-4e1c-af07-7f61ae95607d'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74613) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 29 17:51:49 user nova-compute[74613]: WARNING nova.virt.libvirt.driver [None req-3f6d5344-1f38-4085-9a6e-d96c8bbaee02 tempest-AttachSCSIVolumeTestJSON-1343397388 tempest-AttachSCSIVolumeTestJSON-1343397388-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 17:51:49 user nova-compute[74613]: WARNING nova.virt.libvirt.driver [None req-3f6d5344-1f38-4085-9a6e-d96c8bbaee02 tempest-AttachSCSIVolumeTestJSON-1343397388 tempest-AttachSCSIVolumeTestJSON-1343397388-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 17:51:49 user nova-compute[74613]: DEBUG nova.virt.libvirt.host [None req-3f6d5344-1f38-4085-9a6e-d96c8bbaee02 tempest-AttachSCSIVolumeTestJSON-1343397388 tempest-AttachSCSIVolumeTestJSON-1343397388-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74613) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 29 17:51:49 user nova-compute[74613]: DEBUG nova.virt.libvirt.host [None req-3f6d5344-1f38-4085-9a6e-d96c8bbaee02 tempest-AttachSCSIVolumeTestJSON-1343397388 tempest-AttachSCSIVolumeTestJSON-1343397388-project-member] CPU controller missing on host. {{(pid=74613) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 29 17:51:49 user nova-compute[74613]: DEBUG nova.virt.libvirt.host [None req-3f6d5344-1f38-4085-9a6e-d96c8bbaee02 tempest-AttachSCSIVolumeTestJSON-1343397388 tempest-AttachSCSIVolumeTestJSON-1343397388-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74613) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 29 17:51:49 user nova-compute[74613]: DEBUG nova.virt.libvirt.host [None req-3f6d5344-1f38-4085-9a6e-d96c8bbaee02 tempest-AttachSCSIVolumeTestJSON-1343397388 tempest-AttachSCSIVolumeTestJSON-1343397388-project-member] CPU controller found on host. {{(pid=74613) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 29 17:51:49 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-3f6d5344-1f38-4085-9a6e-d96c8bbaee02 tempest-AttachSCSIVolumeTestJSON-1343397388 tempest-AttachSCSIVolumeTestJSON-1343397388-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74613) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 29 17:51:49 user nova-compute[74613]: DEBUG nova.virt.hardware [None req-3f6d5344-1f38-4085-9a6e-d96c8bbaee02 tempest-AttachSCSIVolumeTestJSON-1343397388 tempest-AttachSCSIVolumeTestJSON-1343397388-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-29T17:47:27Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-29T17:51:31Z,direct_url=<?>,disk_format='qcow2',id=5443c2d3-dc95-4e1c-af07-7f61ae95607d,min_disk=0,min_ram=0,name='',owner='7ba7c4ff05b94660aaeb6593c0adeb69',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-29T17:51:33Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74613) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 29 17:51:49 user nova-compute[74613]: DEBUG nova.virt.hardware [None req-3f6d5344-1f38-4085-9a6e-d96c8bbaee02 tempest-AttachSCSIVolumeTestJSON-1343397388 tempest-AttachSCSIVolumeTestJSON-1343397388-project-member] Flavor limits 0:0:0 {{(pid=74613) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 29 17:51:49 user nova-compute[74613]: DEBUG nova.virt.hardware [None req-3f6d5344-1f38-4085-9a6e-d96c8bbaee02 tempest-AttachSCSIVolumeTestJSON-1343397388 tempest-AttachSCSIVolumeTestJSON-1343397388-project-member] Image limits 0:0:0 {{(pid=74613) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 29 17:51:49 user nova-compute[74613]: DEBUG nova.virt.hardware [None req-3f6d5344-1f38-4085-9a6e-d96c8bbaee02 tempest-AttachSCSIVolumeTestJSON-1343397388 tempest-AttachSCSIVolumeTestJSON-1343397388-project-member] Flavor pref 0:0:0 {{(pid=74613) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 29 17:51:49 user nova-compute[74613]: DEBUG nova.virt.hardware [None req-3f6d5344-1f38-4085-9a6e-d96c8bbaee02 tempest-AttachSCSIVolumeTestJSON-1343397388 tempest-AttachSCSIVolumeTestJSON-1343397388-project-member] Image pref 0:0:0 {{(pid=74613) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 29 17:51:49 user nova-compute[74613]: DEBUG nova.virt.hardware [None req-3f6d5344-1f38-4085-9a6e-d96c8bbaee02 tempest-AttachSCSIVolumeTestJSON-1343397388 tempest-AttachSCSIVolumeTestJSON-1343397388-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74613) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 29 17:51:49 user nova-compute[74613]: DEBUG nova.virt.hardware [None req-3f6d5344-1f38-4085-9a6e-d96c8bbaee02 tempest-AttachSCSIVolumeTestJSON-1343397388 tempest-AttachSCSIVolumeTestJSON-1343397388-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74613) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 29 17:51:49 user nova-compute[74613]: DEBUG nova.virt.hardware [None req-3f6d5344-1f38-4085-9a6e-d96c8bbaee02 tempest-AttachSCSIVolumeTestJSON-1343397388 tempest-AttachSCSIVolumeTestJSON-1343397388-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74613) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 29 17:51:49 user nova-compute[74613]: DEBUG nova.virt.hardware [None req-3f6d5344-1f38-4085-9a6e-d96c8bbaee02 tempest-AttachSCSIVolumeTestJSON-1343397388 tempest-AttachSCSIVolumeTestJSON-1343397388-project-member] Got 1 possible topologies {{(pid=74613) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 29 17:51:49 user nova-compute[74613]: DEBUG nova.virt.hardware [None req-3f6d5344-1f38-4085-9a6e-d96c8bbaee02 tempest-AttachSCSIVolumeTestJSON-1343397388 tempest-AttachSCSIVolumeTestJSON-1343397388-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74613) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 29 17:51:49 user nova-compute[74613]: DEBUG nova.virt.hardware [None req-3f6d5344-1f38-4085-9a6e-d96c8bbaee02 tempest-AttachSCSIVolumeTestJSON-1343397388 tempest-AttachSCSIVolumeTestJSON-1343397388-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74613) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 29 17:51:49 user nova-compute[74613]: DEBUG nova.virt.libvirt.vif [None req-3f6d5344-1f38-4085-9a6e-d96c8bbaee02 tempest-AttachSCSIVolumeTestJSON-1343397388 tempest-AttachSCSIVolumeTestJSON-1343397388-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-29T17:51:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachSCSIVolumeTestJSON-server-1485503705',display_name='tempest-AttachSCSIVolumeTestJSON-server-1485503705',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachscsivolumetestjson-server-1485503705',id=6,image_ref='5443c2d3-dc95-4e1c-af07-7f61ae95607d',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLvhn1wEDAFMPzNYFlLPIPr9slY1CRB2Dsg+n+U7WiGKwCIvJ+V1G2F7SsekWZPHD1kZDmbPDUTVnVvwBGNeyKysrtR4DGuueTgSmXFr9qtUG/d3S58HP7qJnro/cCqOLg==',key_name='tempest-keypair-827478183',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ab6d78b5cdf64466914b67f7405aa79f',ramdisk_id='',reservation_id='r-wy0mz1hc',resources=None,root_device_name='/dev/sda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='5443c2d3-dc95-4e1c-af07-7f61ae95607d',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='scsi',image_hw_disk_bus='scsi',image_hw_machine_type='pc',image_hw_scsi_model='virtio-scsi',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-AttachSCSIVolumeTestJSON-1343397388',owner_user_name='tempest-AttachSCSIVolumeTestJSON-1343397388-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T17:51:45Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3d3ee0ac41c4402182bb4fdc83f543bf',uuid=01c65b16-5dbe-4ad5-a72e-9500a4fa59cf,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9441dfc5-c933-4642-b797-494d88a10f8a", "address": "fa:16:3e:c7:6c:2d", "network": {"id": "1db277f8-4456-4ba3-8eef-276639086245", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1225625601-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ab6d78b5cdf64466914b67f7405aa79f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9441dfc5-c9", "ovs_interfaceid": "9441dfc5-c933-4642-b797-494d88a10f8a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74613) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 29 17:51:49 user nova-compute[74613]: DEBUG nova.network.os_vif_util [None req-3f6d5344-1f38-4085-9a6e-d96c8bbaee02 tempest-AttachSCSIVolumeTestJSON-1343397388 tempest-AttachSCSIVolumeTestJSON-1343397388-project-member] Converting VIF {"id": "9441dfc5-c933-4642-b797-494d88a10f8a", "address": "fa:16:3e:c7:6c:2d", "network": {"id": "1db277f8-4456-4ba3-8eef-276639086245", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1225625601-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ab6d78b5cdf64466914b67f7405aa79f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9441dfc5-c9", "ovs_interfaceid": "9441dfc5-c933-4642-b797-494d88a10f8a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74613) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 17:51:49 user nova-compute[74613]: DEBUG nova.network.os_vif_util [None req-3f6d5344-1f38-4085-9a6e-d96c8bbaee02 tempest-AttachSCSIVolumeTestJSON-1343397388 tempest-AttachSCSIVolumeTestJSON-1343397388-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c7:6c:2d,bridge_name='br-int',has_traffic_filtering=True,id=9441dfc5-c933-4642-b797-494d88a10f8a,network=Network(1db277f8-4456-4ba3-8eef-276639086245),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9441dfc5-c9') {{(pid=74613) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 17:51:49 user nova-compute[74613]: DEBUG nova.objects.instance [None req-3f6d5344-1f38-4085-9a6e-d96c8bbaee02 tempest-AttachSCSIVolumeTestJSON-1343397388 tempest-AttachSCSIVolumeTestJSON-1343397388-project-member] Lazy-loading 'pci_devices' on Instance uuid 01c65b16-5dbe-4ad5-a72e-9500a4fa59cf {{(pid=74613) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 17:51:49 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-3f6d5344-1f38-4085-9a6e-d96c8bbaee02 tempest-AttachSCSIVolumeTestJSON-1343397388 tempest-AttachSCSIVolumeTestJSON-1343397388-project-member] [instance: 01c65b16-5dbe-4ad5-a72e-9500a4fa59cf] End _get_guest_xml xml=<domain type="kvm">
Nov 29 17:51:49 user nova-compute[74613]:   <uuid>01c65b16-5dbe-4ad5-a72e-9500a4fa59cf</uuid>
Nov 29 17:51:49 user nova-compute[74613]:   <name>instance-00000006</name>
Nov 29 17:51:49 user nova-compute[74613]:   <memory>524288</memory>
Nov 29 17:51:49 user nova-compute[74613]:   <vcpu>1</vcpu>
Nov 29 17:51:49 user nova-compute[74613]:   <metadata>
Nov 29 17:51:49 user nova-compute[74613]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 29 17:51:49 user nova-compute[74613]:       <nova:package version="0.0.0"/>
Nov 29 17:51:49 user nova-compute[74613]:       <nova:name>tempest-AttachSCSIVolumeTestJSON-server-1485503705</nova:name>
Nov 29 17:51:49 user nova-compute[74613]:       <nova:creationTime>2023-11-29 17:51:49</nova:creationTime>
Nov 29 17:51:49 user nova-compute[74613]:       <nova:flavor name="m1.tiny">
Nov 29 17:51:49 user nova-compute[74613]:         <nova:memory>512</nova:memory>
Nov 29 17:51:49 user nova-compute[74613]:         <nova:disk>1</nova:disk>
Nov 29 17:51:49 user nova-compute[74613]:         <nova:swap>0</nova:swap>
Nov 29 17:51:49 user nova-compute[74613]:         <nova:ephemeral>0</nova:ephemeral>
Nov 29 17:51:49 user nova-compute[74613]:         <nova:vcpus>1</nova:vcpus>
Nov 29 17:51:49 user nova-compute[74613]:       </nova:flavor>
Nov 29 17:51:49 user nova-compute[74613]:       <nova:owner>
Nov 29 17:51:49 user nova-compute[74613]:         <nova:user uuid="3d3ee0ac41c4402182bb4fdc83f543bf">tempest-AttachSCSIVolumeTestJSON-1343397388-project-member</nova:user>
Nov 29 17:51:49 user nova-compute[74613]:         <nova:project uuid="ab6d78b5cdf64466914b67f7405aa79f">tempest-AttachSCSIVolumeTestJSON-1343397388</nova:project>
Nov 29 17:51:49 user nova-compute[74613]:       </nova:owner>
Nov 29 17:51:49 user nova-compute[74613]:       <nova:root type="image" uuid="5443c2d3-dc95-4e1c-af07-7f61ae95607d"/>
Nov 29 17:51:49 user nova-compute[74613]:       <nova:ports>
Nov 29 17:51:49 user nova-compute[74613]:         <nova:port uuid="9441dfc5-c933-4642-b797-494d88a10f8a">
Nov 29 17:51:49 user nova-compute[74613]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Nov 29 17:51:49 user nova-compute[74613]:         </nova:port>
Nov 29 17:51:49 user nova-compute[74613]:       </nova:ports>
Nov 29 17:51:49 user nova-compute[74613]:     </nova:instance>
Nov 29 17:51:49 user nova-compute[74613]:   </metadata>
Nov 29 17:51:49 user nova-compute[74613]:   <sysinfo type="smbios">
Nov 29 17:51:49 user nova-compute[74613]:     <system>
Nov 29 17:51:49 user nova-compute[74613]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 29 17:51:49 user nova-compute[74613]:       <entry name="product">OpenStack Nova</entry>
Nov 29 17:51:49 user nova-compute[74613]:       <entry name="version">0.0.0</entry>
Nov 29 17:51:49 user nova-compute[74613]:       <entry name="serial">01c65b16-5dbe-4ad5-a72e-9500a4fa59cf</entry>
Nov 29 17:51:49 user nova-compute[74613]:       <entry name="uuid">01c65b16-5dbe-4ad5-a72e-9500a4fa59cf</entry>
Nov 29 17:51:49 user nova-compute[74613]:       <entry name="family">Virtual Machine</entry>
Nov 29 17:51:49 user nova-compute[74613]:     </system>
Nov 29 17:51:49 user nova-compute[74613]:   </sysinfo>
Nov 29 17:51:49 user nova-compute[74613]:   <os>
Nov 29 17:51:49 user nova-compute[74613]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 29 17:51:49 user nova-compute[74613]:     <boot dev="hd"/>
Nov 29 17:51:49 user nova-compute[74613]:     <smbios mode="sysinfo"/>
Nov 29 17:51:49 user nova-compute[74613]:   </os>
Nov 29 17:51:49 user nova-compute[74613]:   <features>
Nov 29 17:51:49 user nova-compute[74613]:     <acpi/>
Nov 29 17:51:49 user nova-compute[74613]:     <apic/>
Nov 29 17:51:49 user nova-compute[74613]:     <vmcoreinfo/>
Nov 29 17:51:49 user nova-compute[74613]:   </features>
Nov 29 17:51:49 user nova-compute[74613]:   <clock offset="utc">
Nov 29 17:51:49 user nova-compute[74613]:     <timer name="pit" tickpolicy="delay"/>
Nov 29 17:51:49 user nova-compute[74613]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 29 17:51:49 user nova-compute[74613]:     <timer name="hpet" present="no"/>
Nov 29 17:51:49 user nova-compute[74613]:   </clock>
Nov 29 17:51:49 user nova-compute[74613]:   <cpu mode="custom" match="exact">
Nov 29 17:51:49 user nova-compute[74613]:     <model>Nehalem</model>
Nov 29 17:51:49 user nova-compute[74613]:     <topology sockets="1" cores="1" threads="1"/>
Nov 29 17:51:49 user nova-compute[74613]:   </cpu>
Nov 29 17:51:49 user nova-compute[74613]:   <devices>
Nov 29 17:51:49 user nova-compute[74613]:     <disk type="file" device="disk">
Nov 29 17:51:49 user nova-compute[74613]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 29 17:51:49 user nova-compute[74613]:       <source file="/opt/stack/data/nova/instances/01c65b16-5dbe-4ad5-a72e-9500a4fa59cf/disk"/>
Nov 29 17:51:49 user nova-compute[74613]:       <target dev="sda" bus="scsi"/>
Nov 29 17:51:49 user nova-compute[74613]:       <address type="drive" controller="0" unit="0"/>
Nov 29 17:51:49 user nova-compute[74613]:     </disk>
Nov 29 17:51:49 user nova-compute[74613]:     <disk type="file" device="cdrom">
Nov 29 17:51:49 user nova-compute[74613]:       <driver name="qemu" type="raw" cache="none"/>
Nov 29 17:51:49 user nova-compute[74613]:       <source file="/opt/stack/data/nova/instances/01c65b16-5dbe-4ad5-a72e-9500a4fa59cf/disk.config"/>
Nov 29 17:51:49 user nova-compute[74613]:       <target dev="sdb" bus="scsi"/>
Nov 29 17:51:49 user nova-compute[74613]:       <address type="drive" controller="0" unit="1"/>
Nov 29 17:51:49 user nova-compute[74613]:     </disk>
Nov 29 17:51:49 user nova-compute[74613]:     <controller type="scsi" index="0" model="virtio-scsi"/>
Nov 29 17:51:49 user nova-compute[74613]:     <interface type="ethernet">
Nov 29 17:51:49 user nova-compute[74613]:       <mac address="fa:16:3e:c7:6c:2d"/>
Nov 29 17:51:49 user nova-compute[74613]:       <model type="virtio"/>
Nov 29 17:51:49 user nova-compute[74613]:       <mtu size="1442"/>
Nov 29 17:51:49 user nova-compute[74613]:       <target dev="tap9441dfc5-c9"/>
Nov 29 17:51:49 user nova-compute[74613]:     </interface>
Nov 29 17:51:49 user nova-compute[74613]:     <serial type="pty">
Nov 29 17:51:49 user nova-compute[74613]:       <log file="/opt/stack/data/nova/instances/01c65b16-5dbe-4ad5-a72e-9500a4fa59cf/console.log" append="off"/>
Nov 29 17:51:49 user nova-compute[74613]:     </serial>
Nov 29 17:51:49 user nova-compute[74613]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 29 17:51:49 user nova-compute[74613]:     <video>
Nov 29 17:51:49 user nova-compute[74613]:       <model type="virtio"/>
Nov 29 17:51:49 user nova-compute[74613]:     </video>
Nov 29 17:51:49 user nova-compute[74613]:     <rng model="virtio">
Nov 29 17:51:49 user nova-compute[74613]:       <backend model="random">/dev/urandom</backend>
Nov 29 17:51:49 user nova-compute[74613]:     </rng>
Nov 29 17:51:49 user nova-compute[74613]:     <controller type="usb" index="0" model="none"/>
Nov 29 17:51:49 user nova-compute[74613]:     <memballoon model="virtio">
Nov 29 17:51:49 user nova-compute[74613]:       <stats period="10"/>
Nov 29 17:51:49 user nova-compute[74613]:     </memballoon>
Nov 29 17:51:49 user nova-compute[74613]:   </devices>
Nov 29 17:51:49 user nova-compute[74613]: </domain>
Nov 29 17:51:49 user nova-compute[74613]:  {{(pid=74613) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 29 17:51:49 user nova-compute[74613]: DEBUG nova.virt.libvirt.vif [None req-3f6d5344-1f38-4085-9a6e-d96c8bbaee02 tempest-AttachSCSIVolumeTestJSON-1343397388 tempest-AttachSCSIVolumeTestJSON-1343397388-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-29T17:51:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachSCSIVolumeTestJSON-server-1485503705',display_name='tempest-AttachSCSIVolumeTestJSON-server-1485503705',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachscsivolumetestjson-server-1485503705',id=6,image_ref='5443c2d3-dc95-4e1c-af07-7f61ae95607d',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLvhn1wEDAFMPzNYFlLPIPr9slY1CRB2Dsg+n+U7WiGKwCIvJ+V1G2F7SsekWZPHD1kZDmbPDUTVnVvwBGNeyKysrtR4DGuueTgSmXFr9qtUG/d3S58HP7qJnro/cCqOLg==',key_name='tempest-keypair-827478183',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ab6d78b5cdf64466914b67f7405aa79f',ramdisk_id='',reservation_id='r-wy0mz1hc',resources=None,root_device_name='/dev/sda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='5443c2d3-dc95-4e1c-af07-7f61ae95607d',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='scsi',image_hw_disk_bus='scsi',image_hw_machine_type='pc',image_hw_scsi_model='virtio-scsi',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-AttachSCSIVolumeTestJSON-1343397388',owner_user_name='tempest-AttachSCSIVolumeTestJSON-1343397388-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T17:51:45Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3d3ee0ac41c4402182bb4fdc83f543bf',uuid=01c65b16-5dbe-4ad5-a72e-9500a4fa59cf,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9441dfc5-c933-4642-b797-494d88a10f8a", "address": "fa:16:3e:c7:6c:2d", "network": {"id": "1db277f8-4456-4ba3-8eef-276639086245", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1225625601-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ab6d78b5cdf64466914b67f7405aa79f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9441dfc5-c9", "ovs_interfaceid": "9441dfc5-c933-4642-b797-494d88a10f8a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74613) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 29 17:51:49 user nova-compute[74613]: DEBUG nova.network.os_vif_util [None req-3f6d5344-1f38-4085-9a6e-d96c8bbaee02 tempest-AttachSCSIVolumeTestJSON-1343397388 tempest-AttachSCSIVolumeTestJSON-1343397388-project-member] Converting VIF {"id": "9441dfc5-c933-4642-b797-494d88a10f8a", "address": "fa:16:3e:c7:6c:2d", "network": {"id": "1db277f8-4456-4ba3-8eef-276639086245", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1225625601-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ab6d78b5cdf64466914b67f7405aa79f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9441dfc5-c9", "ovs_interfaceid": "9441dfc5-c933-4642-b797-494d88a10f8a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74613) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 17:51:49 user nova-compute[74613]: DEBUG nova.network.os_vif_util [None req-3f6d5344-1f38-4085-9a6e-d96c8bbaee02 tempest-AttachSCSIVolumeTestJSON-1343397388 tempest-AttachSCSIVolumeTestJSON-1343397388-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c7:6c:2d,bridge_name='br-int',has_traffic_filtering=True,id=9441dfc5-c933-4642-b797-494d88a10f8a,network=Network(1db277f8-4456-4ba3-8eef-276639086245),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9441dfc5-c9') {{(pid=74613) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 17:51:49 user nova-compute[74613]: DEBUG os_vif [None req-3f6d5344-1f38-4085-9a6e-d96c8bbaee02 tempest-AttachSCSIVolumeTestJSON-1343397388 tempest-AttachSCSIVolumeTestJSON-1343397388-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c7:6c:2d,bridge_name='br-int',has_traffic_filtering=True,id=9441dfc5-c933-4642-b797-494d88a10f8a,network=Network(1db277f8-4456-4ba3-8eef-276639086245),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9441dfc5-c9') {{(pid=74613) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 29 17:51:49 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-4aa4794c-e959-4729-883a-7e95b2bf3385 tempest-TestVolumeSwap-281539251 tempest-TestVolumeSwap-281539251-project-member] Acquiring lock "0008521b-5a63-4ff6-8390-d343956900ed" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 17:51:49 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-4aa4794c-e959-4729-883a-7e95b2bf3385 tempest-TestVolumeSwap-281539251 tempest-TestVolumeSwap-281539251-project-member] Lock "0008521b-5a63-4ff6-8390-d343956900ed" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 17:51:49 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:51:49 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74613) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 17:51:49 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74613) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 29 17:51:49 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:51:49 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:51:49 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '16a00f87-838e-5002-bf58-789073c2c45c', '_type': 'linux-noop'}}, row=False) {{(pid=74613) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 17:51:49 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 17:51:49 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:51:49 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap9441dfc5-c9, may_exist=True, interface_attrs={}) {{(pid=74613) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 17:51:49 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap9441dfc5-c9, col_values=(('qos', UUID('b4795e99-f36c-45ac-8660-2c4d6ba184bf')),), if_exists=True) {{(pid=74613) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 17:51:49 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap9441dfc5-c9, col_values=(('external_ids', {'iface-id': '9441dfc5-c933-4642-b797-494d88a10f8a', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:c7:6c:2d', 'vm-uuid': '01c65b16-5dbe-4ad5-a72e-9500a4fa59cf'}),), if_exists=True) {{(pid=74613) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 17:51:49 user nova-compute[74613]: DEBUG nova.compute.manager [None req-4aa4794c-e959-4729-883a-7e95b2bf3385 tempest-TestVolumeSwap-281539251 tempest-TestVolumeSwap-281539251-project-member] [instance: 0008521b-5a63-4ff6-8390-d343956900ed] Starting instance... {{(pid=74613) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 29 17:51:49 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 17:51:49 user nova-compute[74613]: INFO os_vif [None req-3f6d5344-1f38-4085-9a6e-d96c8bbaee02 tempest-AttachSCSIVolumeTestJSON-1343397388 tempest-AttachSCSIVolumeTestJSON-1343397388-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c7:6c:2d,bridge_name='br-int',has_traffic_filtering=True,id=9441dfc5-c933-4642-b797-494d88a10f8a,network=Network(1db277f8-4456-4ba3-8eef-276639086245),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9441dfc5-c9')
Nov 29 17:51:50 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-3f6d5344-1f38-4085-9a6e-d96c8bbaee02 tempest-AttachSCSIVolumeTestJSON-1343397388 tempest-AttachSCSIVolumeTestJSON-1343397388-project-member] No BDM found with device name sda, not building metadata. {{(pid=74613) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 17:51:50 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-3f6d5344-1f38-4085-9a6e-d96c8bbaee02 tempest-AttachSCSIVolumeTestJSON-1343397388 tempest-AttachSCSIVolumeTestJSON-1343397388-project-member] No BDM found with device name sdb, not building metadata. {{(pid=74613) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 17:51:50 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-3f6d5344-1f38-4085-9a6e-d96c8bbaee02 tempest-AttachSCSIVolumeTestJSON-1343397388 tempest-AttachSCSIVolumeTestJSON-1343397388-project-member] No VIF found with MAC fa:16:3e:c7:6c:2d, not building metadata {{(pid=74613) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 29 17:51:50 user nova-compute[74613]: INFO nova.virt.libvirt.driver [None req-3f6d5344-1f38-4085-9a6e-d96c8bbaee02 tempest-AttachSCSIVolumeTestJSON-1343397388 tempest-AttachSCSIVolumeTestJSON-1343397388-project-member] [instance: 01c65b16-5dbe-4ad5-a72e-9500a4fa59cf] Using config drive
Nov 29 17:51:50 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-4aa4794c-e959-4729-883a-7e95b2bf3385 tempest-TestVolumeSwap-281539251 tempest-TestVolumeSwap-281539251-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 17:51:50 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-4aa4794c-e959-4729-883a-7e95b2bf3385 tempest-TestVolumeSwap-281539251 tempest-TestVolumeSwap-281539251-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 17:51:50 user nova-compute[74613]: DEBUG nova.virt.hardware [None req-4aa4794c-e959-4729-883a-7e95b2bf3385 tempest-TestVolumeSwap-281539251 tempest-TestVolumeSwap-281539251-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74613) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 29 17:51:50 user nova-compute[74613]: INFO nova.compute.claims [None req-4aa4794c-e959-4729-883a-7e95b2bf3385 tempest-TestVolumeSwap-281539251 tempest-TestVolumeSwap-281539251-project-member] [instance: 0008521b-5a63-4ff6-8390-d343956900ed] Claim successful on node user
Nov 29 17:51:50 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:51:50 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:51:50 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:51:50 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:51:50 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:51:50 user nova-compute[74613]: DEBUG nova.compute.provider_tree [None req-4aa4794c-e959-4729-883a-7e95b2bf3385 tempest-TestVolumeSwap-281539251 tempest-TestVolumeSwap-281539251-project-member] Inventory has not changed in ProviderTree for provider: 639d980e-3b12-44b1-b8f4-1812416fa4dd {{(pid=74613) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 17:51:50 user nova-compute[74613]: DEBUG nova.scheduler.client.report [None req-4aa4794c-e959-4729-883a-7e95b2bf3385 tempest-TestVolumeSwap-281539251 tempest-TestVolumeSwap-281539251-project-member] Inventory has not changed for provider 639d980e-3b12-44b1-b8f4-1812416fa4dd based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74613) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 17:51:51 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-4aa4794c-e959-4729-883a-7e95b2bf3385 tempest-TestVolumeSwap-281539251 tempest-TestVolumeSwap-281539251-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.856s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 17:51:51 user nova-compute[74613]: DEBUG nova.compute.manager [None req-4aa4794c-e959-4729-883a-7e95b2bf3385 tempest-TestVolumeSwap-281539251 tempest-TestVolumeSwap-281539251-project-member] [instance: 0008521b-5a63-4ff6-8390-d343956900ed] Start building networks asynchronously for instance. {{(pid=74613) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 29 17:51:51 user nova-compute[74613]: INFO nova.virt.libvirt.driver [None req-3f6d5344-1f38-4085-9a6e-d96c8bbaee02 tempest-AttachSCSIVolumeTestJSON-1343397388 tempest-AttachSCSIVolumeTestJSON-1343397388-project-member] [instance: 01c65b16-5dbe-4ad5-a72e-9500a4fa59cf] Creating config drive at /opt/stack/data/nova/instances/01c65b16-5dbe-4ad5-a72e-9500a4fa59cf/disk.config
Nov 29 17:51:51 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-3f6d5344-1f38-4085-9a6e-d96c8bbaee02 tempest-AttachSCSIVolumeTestJSON-1343397388 tempest-AttachSCSIVolumeTestJSON-1343397388-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/01c65b16-5dbe-4ad5-a72e-9500a4fa59cf/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpz1slk4dc {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 17:51:51 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-3f6d5344-1f38-4085-9a6e-d96c8bbaee02 tempest-AttachSCSIVolumeTestJSON-1343397388 tempest-AttachSCSIVolumeTestJSON-1343397388-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/01c65b16-5dbe-4ad5-a72e-9500a4fa59cf/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpz1slk4dc" returned: 0 in 0.060s {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 17:51:51 user nova-compute[74613]: DEBUG nova.compute.manager [None req-4aa4794c-e959-4729-883a-7e95b2bf3385 tempest-TestVolumeSwap-281539251 tempest-TestVolumeSwap-281539251-project-member] [instance: 0008521b-5a63-4ff6-8390-d343956900ed] Allocating IP information in the background. {{(pid=74613) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 29 17:51:51 user nova-compute[74613]: DEBUG nova.network.neutron [None req-4aa4794c-e959-4729-883a-7e95b2bf3385 tempest-TestVolumeSwap-281539251 tempest-TestVolumeSwap-281539251-project-member] [instance: 0008521b-5a63-4ff6-8390-d343956900ed] allocate_for_instance() {{(pid=74613) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 29 17:51:51 user nova-compute[74613]: INFO nova.virt.libvirt.driver [None req-4aa4794c-e959-4729-883a-7e95b2bf3385 tempest-TestVolumeSwap-281539251 tempest-TestVolumeSwap-281539251-project-member] [instance: 0008521b-5a63-4ff6-8390-d343956900ed] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 29 17:51:51 user nova-compute[74613]: DEBUG nova.compute.manager [None req-4aa4794c-e959-4729-883a-7e95b2bf3385 tempest-TestVolumeSwap-281539251 tempest-TestVolumeSwap-281539251-project-member] [instance: 0008521b-5a63-4ff6-8390-d343956900ed] Start building block device mappings for instance. {{(pid=74613) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 29 17:51:51 user nova-compute[74613]: DEBUG nova.policy [None req-4aa4794c-e959-4729-883a-7e95b2bf3385 tempest-TestVolumeSwap-281539251 tempest-TestVolumeSwap-281539251-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '2d81946191fc40fd8909ac93ae862331', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d9f2fb92a21448d9c935927066d5372', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74613) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 29 17:51:51 user nova-compute[74613]: DEBUG nova.compute.manager [None req-4aa4794c-e959-4729-883a-7e95b2bf3385 tempest-TestVolumeSwap-281539251 tempest-TestVolumeSwap-281539251-project-member] [instance: 0008521b-5a63-4ff6-8390-d343956900ed] Start spawning the instance on the hypervisor. {{(pid=74613) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 29 17:51:51 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-4aa4794c-e959-4729-883a-7e95b2bf3385 tempest-TestVolumeSwap-281539251 tempest-TestVolumeSwap-281539251-project-member] [instance: 0008521b-5a63-4ff6-8390-d343956900ed] Creating instance directory {{(pid=74613) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 29 17:51:51 user nova-compute[74613]: INFO nova.virt.libvirt.driver [None req-4aa4794c-e959-4729-883a-7e95b2bf3385 tempest-TestVolumeSwap-281539251 tempest-TestVolumeSwap-281539251-project-member] [instance: 0008521b-5a63-4ff6-8390-d343956900ed] Creating image(s)
Nov 29 17:51:51 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-4aa4794c-e959-4729-883a-7e95b2bf3385 tempest-TestVolumeSwap-281539251 tempest-TestVolumeSwap-281539251-project-member] Acquiring lock "/opt/stack/data/nova/instances/0008521b-5a63-4ff6-8390-d343956900ed/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 17:51:51 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-4aa4794c-e959-4729-883a-7e95b2bf3385 tempest-TestVolumeSwap-281539251 tempest-TestVolumeSwap-281539251-project-member] Lock "/opt/stack/data/nova/instances/0008521b-5a63-4ff6-8390-d343956900ed/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 17:51:51 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-4aa4794c-e959-4729-883a-7e95b2bf3385 tempest-TestVolumeSwap-281539251 tempest-TestVolumeSwap-281539251-project-member] Lock "/opt/stack/data/nova/instances/0008521b-5a63-4ff6-8390-d343956900ed/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.003s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 17:51:51 user nova-compute[74613]: DEBUG nova.network.neutron [req-f1af8013-1b94-4ed6-8811-c1cf3191a83b req-d53ab878-8795-4ee7-867c-b280f0ec365f service nova] [instance: 01c65b16-5dbe-4ad5-a72e-9500a4fa59cf] Updated VIF entry in instance network info cache for port 9441dfc5-c933-4642-b797-494d88a10f8a. {{(pid=74613) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 17:51:51 user nova-compute[74613]: DEBUG nova.network.neutron [req-f1af8013-1b94-4ed6-8811-c1cf3191a83b req-d53ab878-8795-4ee7-867c-b280f0ec365f service nova] [instance: 01c65b16-5dbe-4ad5-a72e-9500a4fa59cf] Updating instance_info_cache with network_info: [{"id": "9441dfc5-c933-4642-b797-494d88a10f8a", "address": "fa:16:3e:c7:6c:2d", "network": {"id": "1db277f8-4456-4ba3-8eef-276639086245", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1225625601-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ab6d78b5cdf64466914b67f7405aa79f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9441dfc5-c9", "ovs_interfaceid": "9441dfc5-c933-4642-b797-494d88a10f8a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74613) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 17:51:51 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-4aa4794c-e959-4729-883a-7e95b2bf3385 tempest-TestVolumeSwap-281539251 tempest-TestVolumeSwap-281539251-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/21faea9e6951f3bdd0153b76ac89fe1a60a34758 --force-share --output=json {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 17:51:51 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-f1af8013-1b94-4ed6-8811-c1cf3191a83b req-d53ab878-8795-4ee7-867c-b280f0ec365f service nova] Releasing lock "refresh_cache-01c65b16-5dbe-4ad5-a72e-9500a4fa59cf" {{(pid=74613) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 17:51:51 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:51:51 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:51:52 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:51:52 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:51:52 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:51:52 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-4aa4794c-e959-4729-883a-7e95b2bf3385 tempest-TestVolumeSwap-281539251 tempest-TestVolumeSwap-281539251-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/21faea9e6951f3bdd0153b76ac89fe1a60a34758 --force-share --output=json" returned: 0 in 0.253s {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 17:51:52 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-4aa4794c-e959-4729-883a-7e95b2bf3385 tempest-TestVolumeSwap-281539251 tempest-TestVolumeSwap-281539251-project-member] Acquiring lock "21faea9e6951f3bdd0153b76ac89fe1a60a34758" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 17:51:52 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-4aa4794c-e959-4729-883a-7e95b2bf3385 tempest-TestVolumeSwap-281539251 tempest-TestVolumeSwap-281539251-project-member] Lock "21faea9e6951f3bdd0153b76ac89fe1a60a34758" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.006s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 17:51:52 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-4aa4794c-e959-4729-883a-7e95b2bf3385 tempest-TestVolumeSwap-281539251 tempest-TestVolumeSwap-281539251-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/21faea9e6951f3bdd0153b76ac89fe1a60a34758 --force-share --output=json {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 17:51:52 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-4aa4794c-e959-4729-883a-7e95b2bf3385 tempest-TestVolumeSwap-281539251 tempest-TestVolumeSwap-281539251-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/21faea9e6951f3bdd0153b76ac89fe1a60a34758 --force-share --output=json" returned: 0 in 0.261s {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 17:51:52 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-4aa4794c-e959-4729-883a-7e95b2bf3385 tempest-TestVolumeSwap-281539251 tempest-TestVolumeSwap-281539251-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/21faea9e6951f3bdd0153b76ac89fe1a60a34758,backing_fmt=raw /opt/stack/data/nova/instances/0008521b-5a63-4ff6-8390-d343956900ed/disk 1073741824 {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 17:51:52 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-4aa4794c-e959-4729-883a-7e95b2bf3385 tempest-TestVolumeSwap-281539251 tempest-TestVolumeSwap-281539251-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/21faea9e6951f3bdd0153b76ac89fe1a60a34758,backing_fmt=raw /opt/stack/data/nova/instances/0008521b-5a63-4ff6-8390-d343956900ed/disk 1073741824" returned: 0 in 0.060s {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 17:51:52 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-4aa4794c-e959-4729-883a-7e95b2bf3385 tempest-TestVolumeSwap-281539251 tempest-TestVolumeSwap-281539251-project-member] Lock "21faea9e6951f3bdd0153b76ac89fe1a60a34758" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.332s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 17:51:52 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-4aa4794c-e959-4729-883a-7e95b2bf3385 tempest-TestVolumeSwap-281539251 tempest-TestVolumeSwap-281539251-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/21faea9e6951f3bdd0153b76ac89fe1a60a34758 --force-share --output=json {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 17:51:52 user nova-compute[74613]: DEBUG nova.network.neutron [None req-4aa4794c-e959-4729-883a-7e95b2bf3385 tempest-TestVolumeSwap-281539251 tempest-TestVolumeSwap-281539251-project-member] [instance: 0008521b-5a63-4ff6-8390-d343956900ed] Successfully created port: 0ab94891-565e-4864-b6ba-565056b40005 {{(pid=74613) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 29 17:51:52 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-4aa4794c-e959-4729-883a-7e95b2bf3385 tempest-TestVolumeSwap-281539251 tempest-TestVolumeSwap-281539251-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/21faea9e6951f3bdd0153b76ac89fe1a60a34758 --force-share --output=json" returned: 0 in 0.335s {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 17:51:52 user nova-compute[74613]: DEBUG nova.virt.disk.api [None req-4aa4794c-e959-4729-883a-7e95b2bf3385 tempest-TestVolumeSwap-281539251 tempest-TestVolumeSwap-281539251-project-member] Checking if we can resize image /opt/stack/data/nova/instances/0008521b-5a63-4ff6-8390-d343956900ed/disk. size=1073741824 {{(pid=74613) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 29 17:51:52 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-4aa4794c-e959-4729-883a-7e95b2bf3385 tempest-TestVolumeSwap-281539251 tempest-TestVolumeSwap-281539251-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0008521b-5a63-4ff6-8390-d343956900ed/disk --force-share --output=json {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 17:51:53 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-4aa4794c-e959-4729-883a-7e95b2bf3385 tempest-TestVolumeSwap-281539251 tempest-TestVolumeSwap-281539251-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0008521b-5a63-4ff6-8390-d343956900ed/disk --force-share --output=json" returned: 0 in 0.301s {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 17:51:53 user nova-compute[74613]: DEBUG nova.virt.disk.api [None req-4aa4794c-e959-4729-883a-7e95b2bf3385 tempest-TestVolumeSwap-281539251 tempest-TestVolumeSwap-281539251-project-member] Cannot resize image /opt/stack/data/nova/instances/0008521b-5a63-4ff6-8390-d343956900ed/disk to a smaller size. {{(pid=74613) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 29 17:51:53 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-4aa4794c-e959-4729-883a-7e95b2bf3385 tempest-TestVolumeSwap-281539251 tempest-TestVolumeSwap-281539251-project-member] [instance: 0008521b-5a63-4ff6-8390-d343956900ed] Created local disks {{(pid=74613) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 29 17:51:53 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-4aa4794c-e959-4729-883a-7e95b2bf3385 tempest-TestVolumeSwap-281539251 tempest-TestVolumeSwap-281539251-project-member] [instance: 0008521b-5a63-4ff6-8390-d343956900ed] Ensure instance console log exists: /opt/stack/data/nova/instances/0008521b-5a63-4ff6-8390-d343956900ed/console.log {{(pid=74613) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 29 17:51:53 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-4aa4794c-e959-4729-883a-7e95b2bf3385 tempest-TestVolumeSwap-281539251 tempest-TestVolumeSwap-281539251-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 17:51:53 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-4aa4794c-e959-4729-883a-7e95b2bf3385 tempest-TestVolumeSwap-281539251 tempest-TestVolumeSwap-281539251-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 17:51:53 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-4aa4794c-e959-4729-883a-7e95b2bf3385 tempest-TestVolumeSwap-281539251 tempest-TestVolumeSwap-281539251-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 17:51:53 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:51:53 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:51:53 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:51:53 user nova-compute[74613]: DEBUG nova.network.neutron [None req-4aa4794c-e959-4729-883a-7e95b2bf3385 tempest-TestVolumeSwap-281539251 tempest-TestVolumeSwap-281539251-project-member] [instance: 0008521b-5a63-4ff6-8390-d343956900ed] Successfully updated port: 0ab94891-565e-4864-b6ba-565056b40005 {{(pid=74613) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 29 17:51:53 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-4aa4794c-e959-4729-883a-7e95b2bf3385 tempest-TestVolumeSwap-281539251 tempest-TestVolumeSwap-281539251-project-member] Acquiring lock "refresh_cache-0008521b-5a63-4ff6-8390-d343956900ed" {{(pid=74613) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 17:51:53 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-4aa4794c-e959-4729-883a-7e95b2bf3385 tempest-TestVolumeSwap-281539251 tempest-TestVolumeSwap-281539251-project-member] Acquired lock "refresh_cache-0008521b-5a63-4ff6-8390-d343956900ed" {{(pid=74613) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 17:51:53 user nova-compute[74613]: DEBUG nova.network.neutron [None req-4aa4794c-e959-4729-883a-7e95b2bf3385 tempest-TestVolumeSwap-281539251 tempest-TestVolumeSwap-281539251-project-member] [instance: 0008521b-5a63-4ff6-8390-d343956900ed] Building network info cache for instance {{(pid=74613) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 29 17:51:53 user nova-compute[74613]: DEBUG nova.compute.manager [req-7d150e2e-8c52-437f-851e-44343974ba5a req-b25b7b60-850e-4dd7-b889-ce2f8c7f51b9 service nova] [instance: 0008521b-5a63-4ff6-8390-d343956900ed] Received event network-changed-0ab94891-565e-4864-b6ba-565056b40005 {{(pid=74613) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 17:51:53 user nova-compute[74613]: DEBUG nova.compute.manager [req-7d150e2e-8c52-437f-851e-44343974ba5a req-b25b7b60-850e-4dd7-b889-ce2f8c7f51b9 service nova] [instance: 0008521b-5a63-4ff6-8390-d343956900ed] Refreshing instance network info cache due to event network-changed-0ab94891-565e-4864-b6ba-565056b40005. {{(pid=74613) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 17:51:53 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-7d150e2e-8c52-437f-851e-44343974ba5a req-b25b7b60-850e-4dd7-b889-ce2f8c7f51b9 service nova] Acquiring lock "refresh_cache-0008521b-5a63-4ff6-8390-d343956900ed" {{(pid=74613) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 17:51:53 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:51:53 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:51:54 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:51:54 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:51:54 user nova-compute[74613]: DEBUG nova.network.neutron [None req-4aa4794c-e959-4729-883a-7e95b2bf3385 tempest-TestVolumeSwap-281539251 tempest-TestVolumeSwap-281539251-project-member] [instance: 0008521b-5a63-4ff6-8390-d343956900ed] Instance cache missing network info. {{(pid=74613) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 29 17:51:54 user nova-compute[74613]: DEBUG nova.network.neutron [None req-4aa4794c-e959-4729-883a-7e95b2bf3385 tempest-TestVolumeSwap-281539251 tempest-TestVolumeSwap-281539251-project-member] [instance: 0008521b-5a63-4ff6-8390-d343956900ed] Updating instance_info_cache with network_info: [{"id": "0ab94891-565e-4864-b6ba-565056b40005", "address": "fa:16:3e:7e:c4:dc", "network": {"id": "8955d6de-e65e-431d-80b4-420aeda27329", "bridge": "br-int", "label": "tempest-TestVolumeSwap-241933908-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6d9f2fb92a21448d9c935927066d5372", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0ab94891-56", "ovs_interfaceid": "0ab94891-565e-4864-b6ba-565056b40005", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74613) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 17:51:54 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-4aa4794c-e959-4729-883a-7e95b2bf3385 tempest-TestVolumeSwap-281539251 tempest-TestVolumeSwap-281539251-project-member] Releasing lock "refresh_cache-0008521b-5a63-4ff6-8390-d343956900ed" {{(pid=74613) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 17:51:54 user nova-compute[74613]: DEBUG nova.compute.manager [None req-4aa4794c-e959-4729-883a-7e95b2bf3385 tempest-TestVolumeSwap-281539251 tempest-TestVolumeSwap-281539251-project-member] [instance: 0008521b-5a63-4ff6-8390-d343956900ed] Instance network_info: |[{"id": "0ab94891-565e-4864-b6ba-565056b40005", "address": "fa:16:3e:7e:c4:dc", "network": {"id": "8955d6de-e65e-431d-80b4-420aeda27329", "bridge": "br-int", "label": "tempest-TestVolumeSwap-241933908-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6d9f2fb92a21448d9c935927066d5372", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0ab94891-56", "ovs_interfaceid": "0ab94891-565e-4864-b6ba-565056b40005", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74613) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 29 17:51:54 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-7d150e2e-8c52-437f-851e-44343974ba5a req-b25b7b60-850e-4dd7-b889-ce2f8c7f51b9 service nova] Acquired lock "refresh_cache-0008521b-5a63-4ff6-8390-d343956900ed" {{(pid=74613) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 17:51:54 user nova-compute[74613]: DEBUG nova.network.neutron [req-7d150e2e-8c52-437f-851e-44343974ba5a req-b25b7b60-850e-4dd7-b889-ce2f8c7f51b9 service nova] [instance: 0008521b-5a63-4ff6-8390-d343956900ed] Refreshing network info cache for port 0ab94891-565e-4864-b6ba-565056b40005 {{(pid=74613) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 17:51:54 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-4aa4794c-e959-4729-883a-7e95b2bf3385 tempest-TestVolumeSwap-281539251 tempest-TestVolumeSwap-281539251-project-member] [instance: 0008521b-5a63-4ff6-8390-d343956900ed] Start _get_guest_xml network_info=[{"id": "0ab94891-565e-4864-b6ba-565056b40005", "address": "fa:16:3e:7e:c4:dc", "network": {"id": "8955d6de-e65e-431d-80b4-420aeda27329", "bridge": "br-int", "label": "tempest-TestVolumeSwap-241933908-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6d9f2fb92a21448d9c935927066d5372", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0ab94891-56", "ovs_interfaceid": "0ab94891-565e-4864-b6ba-565056b40005", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-29T17:47:38Z,direct_url=<?>,disk_format='qcow2',id=4217f428-8d9d-4ee1-9614-642d26d90c46,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='794b07cbd46a44b5865cfda741036bae',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-29T17:47:40Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'size': 0, 'device_type': 'disk', 'boot_index': 0, 'guest_format': None, 'encrypted': False, 'encryption_format': None, 'disk_bus': 'virtio', 'image_id': '4217f428-8d9d-4ee1-9614-642d26d90c46'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74613) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 29 17:51:54 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-fa153cd0-d0ba-4e0d-a20b-86c28a59b05e tempest-TaggedAttachmentsTest-1438740121 tempest-TaggedAttachmentsTest-1438740121-project-member] Acquiring lock "288b8261-8706-4696-879d-d4dd01ab553e" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 17:51:54 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-fa153cd0-d0ba-4e0d-a20b-86c28a59b05e tempest-TaggedAttachmentsTest-1438740121 tempest-TaggedAttachmentsTest-1438740121-project-member] Lock "288b8261-8706-4696-879d-d4dd01ab553e" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 17:51:54 user nova-compute[74613]: WARNING nova.virt.libvirt.driver [None req-4aa4794c-e959-4729-883a-7e95b2bf3385 tempest-TestVolumeSwap-281539251 tempest-TestVolumeSwap-281539251-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 17:51:54 user nova-compute[74613]: WARNING nova.virt.libvirt.driver [None req-4aa4794c-e959-4729-883a-7e95b2bf3385 tempest-TestVolumeSwap-281539251 tempest-TestVolumeSwap-281539251-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 17:51:54 user nova-compute[74613]: DEBUG nova.compute.manager [None req-fa153cd0-d0ba-4e0d-a20b-86c28a59b05e tempest-TaggedAttachmentsTest-1438740121 tempest-TaggedAttachmentsTest-1438740121-project-member] [instance: 288b8261-8706-4696-879d-d4dd01ab553e] Starting instance... {{(pid=74613) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 29 17:51:54 user nova-compute[74613]: DEBUG nova.virt.libvirt.host [None req-4aa4794c-e959-4729-883a-7e95b2bf3385 tempest-TestVolumeSwap-281539251 tempest-TestVolumeSwap-281539251-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74613) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 29 17:51:54 user nova-compute[74613]: DEBUG nova.virt.libvirt.host [None req-4aa4794c-e959-4729-883a-7e95b2bf3385 tempest-TestVolumeSwap-281539251 tempest-TestVolumeSwap-281539251-project-member] CPU controller missing on host. {{(pid=74613) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 29 17:51:54 user nova-compute[74613]: DEBUG nova.virt.libvirt.host [None req-4aa4794c-e959-4729-883a-7e95b2bf3385 tempest-TestVolumeSwap-281539251 tempest-TestVolumeSwap-281539251-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74613) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 29 17:51:54 user nova-compute[74613]: DEBUG nova.virt.libvirt.host [None req-4aa4794c-e959-4729-883a-7e95b2bf3385 tempest-TestVolumeSwap-281539251 tempest-TestVolumeSwap-281539251-project-member] CPU controller found on host. {{(pid=74613) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 29 17:51:54 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-4aa4794c-e959-4729-883a-7e95b2bf3385 tempest-TestVolumeSwap-281539251 tempest-TestVolumeSwap-281539251-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74613) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 29 17:51:54 user nova-compute[74613]: DEBUG nova.virt.hardware [None req-4aa4794c-e959-4729-883a-7e95b2bf3385 tempest-TestVolumeSwap-281539251 tempest-TestVolumeSwap-281539251-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-29T17:47:27Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-29T17:47:38Z,direct_url=<?>,disk_format='qcow2',id=4217f428-8d9d-4ee1-9614-642d26d90c46,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='794b07cbd46a44b5865cfda741036bae',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-29T17:47:40Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74613) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 29 17:51:54 user nova-compute[74613]: DEBUG nova.virt.hardware [None req-4aa4794c-e959-4729-883a-7e95b2bf3385 tempest-TestVolumeSwap-281539251 tempest-TestVolumeSwap-281539251-project-member] Flavor limits 0:0:0 {{(pid=74613) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 29 17:51:54 user nova-compute[74613]: DEBUG nova.virt.hardware [None req-4aa4794c-e959-4729-883a-7e95b2bf3385 tempest-TestVolumeSwap-281539251 tempest-TestVolumeSwap-281539251-project-member] Image limits 0:0:0 {{(pid=74613) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 29 17:51:54 user nova-compute[74613]: DEBUG nova.virt.hardware [None req-4aa4794c-e959-4729-883a-7e95b2bf3385 tempest-TestVolumeSwap-281539251 tempest-TestVolumeSwap-281539251-project-member] Flavor pref 0:0:0 {{(pid=74613) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 29 17:51:54 user nova-compute[74613]: DEBUG nova.virt.hardware [None req-4aa4794c-e959-4729-883a-7e95b2bf3385 tempest-TestVolumeSwap-281539251 tempest-TestVolumeSwap-281539251-project-member] Image pref 0:0:0 {{(pid=74613) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 29 17:51:54 user nova-compute[74613]: DEBUG nova.virt.hardware [None req-4aa4794c-e959-4729-883a-7e95b2bf3385 tempest-TestVolumeSwap-281539251 tempest-TestVolumeSwap-281539251-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74613) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 29 17:51:54 user nova-compute[74613]: DEBUG nova.virt.hardware [None req-4aa4794c-e959-4729-883a-7e95b2bf3385 tempest-TestVolumeSwap-281539251 tempest-TestVolumeSwap-281539251-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74613) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 29 17:51:54 user nova-compute[74613]: DEBUG nova.virt.hardware [None req-4aa4794c-e959-4729-883a-7e95b2bf3385 tempest-TestVolumeSwap-281539251 tempest-TestVolumeSwap-281539251-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74613) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 29 17:51:54 user nova-compute[74613]: DEBUG nova.virt.hardware [None req-4aa4794c-e959-4729-883a-7e95b2bf3385 tempest-TestVolumeSwap-281539251 tempest-TestVolumeSwap-281539251-project-member] Got 1 possible topologies {{(pid=74613) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 29 17:51:54 user nova-compute[74613]: DEBUG nova.virt.hardware [None req-4aa4794c-e959-4729-883a-7e95b2bf3385 tempest-TestVolumeSwap-281539251 tempest-TestVolumeSwap-281539251-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74613) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 29 17:51:54 user nova-compute[74613]: DEBUG nova.virt.hardware [None req-4aa4794c-e959-4729-883a-7e95b2bf3385 tempest-TestVolumeSwap-281539251 tempest-TestVolumeSwap-281539251-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74613) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 29 17:51:54 user nova-compute[74613]: DEBUG nova.virt.libvirt.vif [None req-4aa4794c-e959-4729-883a-7e95b2bf3385 tempest-TestVolumeSwap-281539251 tempest-TestVolumeSwap-281539251-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T17:51:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeSwap-server-218030512',display_name='tempest-TestVolumeSwap-server-218030512',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumeswap-server-218030512',id=7,image_ref='4217f428-8d9d-4ee1-9614-642d26d90c46',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNJQmAnpjs0d7jnHfHx9i2Opr87NGLCiRvOJ25vj2fGFEFNmUf1tkbMQEACJJtcYUkNZVfy7fzdIpSxEwzCQdBpAM1XPa4NsD9C2YvVYIKhrabQUdtfgX59pF1xaGx7MpQ==',key_name='tempest-keypair-1980594367',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6d9f2fb92a21448d9c935927066d5372',ramdisk_id='',reservation_id='r-9djktafb',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='4217f428-8d9d-4ee1-9614-642d26d90c46',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeSwap-281539251',owner_user_name='tempest-TestVolumeSwap-281539251-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T17:51:52Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2d81946191fc40fd8909ac93ae862331',uuid=0008521b-5a63-4ff6-8390-d343956900ed,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0ab94891-565e-4864-b6ba-565056b40005", "address": "fa:16:3e:7e:c4:dc", "network": {"id": "8955d6de-e65e-431d-80b4-420aeda27329", "bridge": "br-int", "label": "tempest-TestVolumeSwap-241933908-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6d9f2fb92a21448d9c935927066d5372", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0ab94891-56", "ovs_interfaceid": "0ab94891-565e-4864-b6ba-565056b40005", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74613) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 29 17:51:54 user nova-compute[74613]: DEBUG nova.network.os_vif_util [None req-4aa4794c-e959-4729-883a-7e95b2bf3385 tempest-TestVolumeSwap-281539251 tempest-TestVolumeSwap-281539251-project-member] Converting VIF {"id": "0ab94891-565e-4864-b6ba-565056b40005", "address": "fa:16:3e:7e:c4:dc", "network": {"id": "8955d6de-e65e-431d-80b4-420aeda27329", "bridge": "br-int", "label": "tempest-TestVolumeSwap-241933908-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6d9f2fb92a21448d9c935927066d5372", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0ab94891-56", "ovs_interfaceid": "0ab94891-565e-4864-b6ba-565056b40005", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74613) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 17:51:54 user nova-compute[74613]: DEBUG nova.network.os_vif_util [None req-4aa4794c-e959-4729-883a-7e95b2bf3385 tempest-TestVolumeSwap-281539251 tempest-TestVolumeSwap-281539251-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7e:c4:dc,bridge_name='br-int',has_traffic_filtering=True,id=0ab94891-565e-4864-b6ba-565056b40005,network=Network(8955d6de-e65e-431d-80b4-420aeda27329),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0ab94891-56') {{(pid=74613) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 17:51:54 user nova-compute[74613]: DEBUG nova.objects.instance [None req-4aa4794c-e959-4729-883a-7e95b2bf3385 tempest-TestVolumeSwap-281539251 tempest-TestVolumeSwap-281539251-project-member] Lazy-loading 'pci_devices' on Instance uuid 0008521b-5a63-4ff6-8390-d343956900ed {{(pid=74613) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 17:51:54 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-4aa4794c-e959-4729-883a-7e95b2bf3385 tempest-TestVolumeSwap-281539251 tempest-TestVolumeSwap-281539251-project-member] [instance: 0008521b-5a63-4ff6-8390-d343956900ed] End _get_guest_xml xml=<domain type="kvm">
Nov 29 17:51:54 user nova-compute[74613]:   <uuid>0008521b-5a63-4ff6-8390-d343956900ed</uuid>
Nov 29 17:51:54 user nova-compute[74613]:   <name>instance-00000007</name>
Nov 29 17:51:54 user nova-compute[74613]:   <memory>524288</memory>
Nov 29 17:51:54 user nova-compute[74613]:   <vcpu>1</vcpu>
Nov 29 17:51:54 user nova-compute[74613]:   <metadata>
Nov 29 17:51:54 user nova-compute[74613]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 29 17:51:54 user nova-compute[74613]:       <nova:package version="0.0.0"/>
Nov 29 17:51:54 user nova-compute[74613]:       <nova:name>tempest-TestVolumeSwap-server-218030512</nova:name>
Nov 29 17:51:54 user nova-compute[74613]:       <nova:creationTime>2023-11-29 17:51:54</nova:creationTime>
Nov 29 17:51:54 user nova-compute[74613]:       <nova:flavor name="m1.tiny">
Nov 29 17:51:54 user nova-compute[74613]:         <nova:memory>512</nova:memory>
Nov 29 17:51:54 user nova-compute[74613]:         <nova:disk>1</nova:disk>
Nov 29 17:51:54 user nova-compute[74613]:         <nova:swap>0</nova:swap>
Nov 29 17:51:54 user nova-compute[74613]:         <nova:ephemeral>0</nova:ephemeral>
Nov 29 17:51:54 user nova-compute[74613]:         <nova:vcpus>1</nova:vcpus>
Nov 29 17:51:54 user nova-compute[74613]:       </nova:flavor>
Nov 29 17:51:54 user nova-compute[74613]:       <nova:owner>
Nov 29 17:51:54 user nova-compute[74613]:         <nova:user uuid="2d81946191fc40fd8909ac93ae862331">tempest-TestVolumeSwap-281539251-project-member</nova:user>
Nov 29 17:51:54 user nova-compute[74613]:         <nova:project uuid="6d9f2fb92a21448d9c935927066d5372">tempest-TestVolumeSwap-281539251</nova:project>
Nov 29 17:51:54 user nova-compute[74613]:       </nova:owner>
Nov 29 17:51:54 user nova-compute[74613]:       <nova:root type="image" uuid="4217f428-8d9d-4ee1-9614-642d26d90c46"/>
Nov 29 17:51:54 user nova-compute[74613]:       <nova:ports>
Nov 29 17:51:54 user nova-compute[74613]:         <nova:port uuid="0ab94891-565e-4864-b6ba-565056b40005">
Nov 29 17:51:54 user nova-compute[74613]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Nov 29 17:51:54 user nova-compute[74613]:         </nova:port>
Nov 29 17:51:54 user nova-compute[74613]:       </nova:ports>
Nov 29 17:51:54 user nova-compute[74613]:     </nova:instance>
Nov 29 17:51:54 user nova-compute[74613]:   </metadata>
Nov 29 17:51:54 user nova-compute[74613]:   <sysinfo type="smbios">
Nov 29 17:51:54 user nova-compute[74613]:     <system>
Nov 29 17:51:54 user nova-compute[74613]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 29 17:51:54 user nova-compute[74613]:       <entry name="product">OpenStack Nova</entry>
Nov 29 17:51:54 user nova-compute[74613]:       <entry name="version">0.0.0</entry>
Nov 29 17:51:54 user nova-compute[74613]:       <entry name="serial">0008521b-5a63-4ff6-8390-d343956900ed</entry>
Nov 29 17:51:54 user nova-compute[74613]:       <entry name="uuid">0008521b-5a63-4ff6-8390-d343956900ed</entry>
Nov 29 17:51:54 user nova-compute[74613]:       <entry name="family">Virtual Machine</entry>
Nov 29 17:51:54 user nova-compute[74613]:     </system>
Nov 29 17:51:54 user nova-compute[74613]:   </sysinfo>
Nov 29 17:51:54 user nova-compute[74613]:   <os>
Nov 29 17:51:54 user nova-compute[74613]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 29 17:51:54 user nova-compute[74613]:     <boot dev="hd"/>
Nov 29 17:51:54 user nova-compute[74613]:     <smbios mode="sysinfo"/>
Nov 29 17:51:54 user nova-compute[74613]:   </os>
Nov 29 17:51:54 user nova-compute[74613]:   <features>
Nov 29 17:51:54 user nova-compute[74613]:     <acpi/>
Nov 29 17:51:54 user nova-compute[74613]:     <apic/>
Nov 29 17:51:54 user nova-compute[74613]:     <vmcoreinfo/>
Nov 29 17:51:54 user nova-compute[74613]:   </features>
Nov 29 17:51:54 user nova-compute[74613]:   <clock offset="utc">
Nov 29 17:51:54 user nova-compute[74613]:     <timer name="pit" tickpolicy="delay"/>
Nov 29 17:51:54 user nova-compute[74613]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 29 17:51:54 user nova-compute[74613]:     <timer name="hpet" present="no"/>
Nov 29 17:51:54 user nova-compute[74613]:   </clock>
Nov 29 17:51:54 user nova-compute[74613]:   <cpu mode="custom" match="exact">
Nov 29 17:51:54 user nova-compute[74613]:     <model>Nehalem</model>
Nov 29 17:51:54 user nova-compute[74613]:     <topology sockets="1" cores="1" threads="1"/>
Nov 29 17:51:54 user nova-compute[74613]:   </cpu>
Nov 29 17:51:54 user nova-compute[74613]:   <devices>
Nov 29 17:51:54 user nova-compute[74613]:     <disk type="file" device="disk">
Nov 29 17:51:54 user nova-compute[74613]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 29 17:51:54 user nova-compute[74613]:       <source file="/opt/stack/data/nova/instances/0008521b-5a63-4ff6-8390-d343956900ed/disk"/>
Nov 29 17:51:54 user nova-compute[74613]:       <target dev="vda" bus="virtio"/>
Nov 29 17:51:54 user nova-compute[74613]:     </disk>
Nov 29 17:51:54 user nova-compute[74613]:     <interface type="ethernet">
Nov 29 17:51:54 user nova-compute[74613]:       <mac address="fa:16:3e:7e:c4:dc"/>
Nov 29 17:51:54 user nova-compute[74613]:       <model type="virtio"/>
Nov 29 17:51:54 user nova-compute[74613]:       <mtu size="1442"/>
Nov 29 17:51:54 user nova-compute[74613]:       <target dev="tap0ab94891-56"/>
Nov 29 17:51:54 user nova-compute[74613]:     </interface>
Nov 29 17:51:54 user nova-compute[74613]:     <serial type="pty">
Nov 29 17:51:54 user nova-compute[74613]:       <log file="/opt/stack/data/nova/instances/0008521b-5a63-4ff6-8390-d343956900ed/console.log" append="off"/>
Nov 29 17:51:54 user nova-compute[74613]:     </serial>
Nov 29 17:51:54 user nova-compute[74613]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 29 17:51:54 user nova-compute[74613]:     <video>
Nov 29 17:51:54 user nova-compute[74613]:       <model type="virtio"/>
Nov 29 17:51:54 user nova-compute[74613]:     </video>
Nov 29 17:51:54 user nova-compute[74613]:     <rng model="virtio">
Nov 29 17:51:54 user nova-compute[74613]:       <backend model="random">/dev/urandom</backend>
Nov 29 17:51:54 user nova-compute[74613]:     </rng>
Nov 29 17:51:54 user nova-compute[74613]:     <controller type="usb" index="0" model="none"/>
Nov 29 17:51:54 user nova-compute[74613]:     <memballoon model="virtio">
Nov 29 17:51:54 user nova-compute[74613]:       <stats period="10"/>
Nov 29 17:51:54 user nova-compute[74613]:     </memballoon>
Nov 29 17:51:54 user nova-compute[74613]:   </devices>
Nov 29 17:51:54 user nova-compute[74613]: </domain>
Nov 29 17:51:54 user nova-compute[74613]:  {{(pid=74613) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 29 17:51:54 user nova-compute[74613]: DEBUG nova.virt.libvirt.vif [None req-4aa4794c-e959-4729-883a-7e95b2bf3385 tempest-TestVolumeSwap-281539251 tempest-TestVolumeSwap-281539251-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T17:51:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeSwap-server-218030512',display_name='tempest-TestVolumeSwap-server-218030512',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumeswap-server-218030512',id=7,image_ref='4217f428-8d9d-4ee1-9614-642d26d90c46',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNJQmAnpjs0d7jnHfHx9i2Opr87NGLCiRvOJ25vj2fGFEFNmUf1tkbMQEACJJtcYUkNZVfy7fzdIpSxEwzCQdBpAM1XPa4NsD9C2YvVYIKhrabQUdtfgX59pF1xaGx7MpQ==',key_name='tempest-keypair-1980594367',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6d9f2fb92a21448d9c935927066d5372',ramdisk_id='',reservation_id='r-9djktafb',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='4217f428-8d9d-4ee1-9614-642d26d90c46',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeSwap-281539251',owner_user_name='tempest-TestVolumeSwap-281539251-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T17:51:52Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2d81946191fc40fd8909ac93ae862331',uuid=0008521b-5a63-4ff6-8390-d343956900ed,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0ab94891-565e-4864-b6ba-565056b40005", "address": "fa:16:3e:7e:c4:dc", "network": {"id": "8955d6de-e65e-431d-80b4-420aeda27329", "bridge": "br-int", "label": "tempest-TestVolumeSwap-241933908-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6d9f2fb92a21448d9c935927066d5372", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0ab94891-56", "ovs_interfaceid": "0ab94891-565e-4864-b6ba-565056b40005", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74613) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 29 17:51:54 user nova-compute[74613]: DEBUG nova.network.os_vif_util [None req-4aa4794c-e959-4729-883a-7e95b2bf3385 tempest-TestVolumeSwap-281539251 tempest-TestVolumeSwap-281539251-project-member] Converting VIF {"id": "0ab94891-565e-4864-b6ba-565056b40005", "address": "fa:16:3e:7e:c4:dc", "network": {"id": "8955d6de-e65e-431d-80b4-420aeda27329", "bridge": "br-int", "label": "tempest-TestVolumeSwap-241933908-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6d9f2fb92a21448d9c935927066d5372", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0ab94891-56", "ovs_interfaceid": "0ab94891-565e-4864-b6ba-565056b40005", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74613) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 17:51:54 user nova-compute[74613]: DEBUG nova.network.os_vif_util [None req-4aa4794c-e959-4729-883a-7e95b2bf3385 tempest-TestVolumeSwap-281539251 tempest-TestVolumeSwap-281539251-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7e:c4:dc,bridge_name='br-int',has_traffic_filtering=True,id=0ab94891-565e-4864-b6ba-565056b40005,network=Network(8955d6de-e65e-431d-80b4-420aeda27329),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0ab94891-56') {{(pid=74613) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 17:51:54 user nova-compute[74613]: DEBUG os_vif [None req-4aa4794c-e959-4729-883a-7e95b2bf3385 tempest-TestVolumeSwap-281539251 tempest-TestVolumeSwap-281539251-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:7e:c4:dc,bridge_name='br-int',has_traffic_filtering=True,id=0ab94891-565e-4864-b6ba-565056b40005,network=Network(8955d6de-e65e-431d-80b4-420aeda27329),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0ab94891-56') {{(pid=74613) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 29 17:51:54 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:51:54 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74613) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 17:51:54 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74613) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 29 17:51:54 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:51:54 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '5a278d2f-6973-55ab-aa19-086733213ffb', '_type': 'linux-noop'}}, row=False) {{(pid=74613) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 17:51:54 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:51:54 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-fa153cd0-d0ba-4e0d-a20b-86c28a59b05e tempest-TaggedAttachmentsTest-1438740121 tempest-TaggedAttachmentsTest-1438740121-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 17:51:54 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-fa153cd0-d0ba-4e0d-a20b-86c28a59b05e tempest-TaggedAttachmentsTest-1438740121 tempest-TaggedAttachmentsTest-1438740121-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 17:51:54 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:51:54 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 17:51:54 user nova-compute[74613]: DEBUG nova.virt.hardware [None req-fa153cd0-d0ba-4e0d-a20b-86c28a59b05e tempest-TaggedAttachmentsTest-1438740121 tempest-TaggedAttachmentsTest-1438740121-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74613) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 29 17:51:54 user nova-compute[74613]: INFO nova.compute.claims [None req-fa153cd0-d0ba-4e0d-a20b-86c28a59b05e tempest-TaggedAttachmentsTest-1438740121 tempest-TaggedAttachmentsTest-1438740121-project-member] [instance: 288b8261-8706-4696-879d-d4dd01ab553e] Claim successful on node user
Nov 29 17:51:54 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:51:54 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap0ab94891-56, may_exist=True, interface_attrs={}) {{(pid=74613) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 17:51:54 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap0ab94891-56, col_values=(('qos', UUID('f6e7e350-4f7e-49d3-9da2-7c4ca2a73420')),), if_exists=True) {{(pid=74613) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 17:51:54 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap0ab94891-56, col_values=(('external_ids', {'iface-id': '0ab94891-565e-4864-b6ba-565056b40005', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:7e:c4:dc', 'vm-uuid': '0008521b-5a63-4ff6-8390-d343956900ed'}),), if_exists=True) {{(pid=74613) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 17:51:54 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:51:54 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 17:51:54 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:51:54 user nova-compute[74613]: INFO os_vif [None req-4aa4794c-e959-4729-883a-7e95b2bf3385 tempest-TestVolumeSwap-281539251 tempest-TestVolumeSwap-281539251-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:7e:c4:dc,bridge_name='br-int',has_traffic_filtering=True,id=0ab94891-565e-4864-b6ba-565056b40005,network=Network(8955d6de-e65e-431d-80b4-420aeda27329),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0ab94891-56')
Nov 29 17:51:55 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-4aa4794c-e959-4729-883a-7e95b2bf3385 tempest-TestVolumeSwap-281539251 tempest-TestVolumeSwap-281539251-project-member] No BDM found with device name vda, not building metadata. {{(pid=74613) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 17:51:55 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-4aa4794c-e959-4729-883a-7e95b2bf3385 tempest-TestVolumeSwap-281539251 tempest-TestVolumeSwap-281539251-project-member] No VIF found with MAC fa:16:3e:7e:c4:dc, not building metadata {{(pid=74613) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 29 17:51:55 user nova-compute[74613]: DEBUG nova.compute.provider_tree [None req-fa153cd0-d0ba-4e0d-a20b-86c28a59b05e tempest-TaggedAttachmentsTest-1438740121 tempest-TaggedAttachmentsTest-1438740121-project-member] Inventory has not changed in ProviderTree for provider: 639d980e-3b12-44b1-b8f4-1812416fa4dd {{(pid=74613) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 17:51:55 user nova-compute[74613]: DEBUG nova.scheduler.client.report [None req-fa153cd0-d0ba-4e0d-a20b-86c28a59b05e tempest-TaggedAttachmentsTest-1438740121 tempest-TaggedAttachmentsTest-1438740121-project-member] Inventory has not changed for provider 639d980e-3b12-44b1-b8f4-1812416fa4dd based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74613) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 17:51:55 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-fa153cd0-d0ba-4e0d-a20b-86c28a59b05e tempest-TaggedAttachmentsTest-1438740121 tempest-TaggedAttachmentsTest-1438740121-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.682s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 17:51:55 user nova-compute[74613]: DEBUG nova.compute.manager [None req-fa153cd0-d0ba-4e0d-a20b-86c28a59b05e tempest-TaggedAttachmentsTest-1438740121 tempest-TaggedAttachmentsTest-1438740121-project-member] [instance: 288b8261-8706-4696-879d-d4dd01ab553e] Start building networks asynchronously for instance. {{(pid=74613) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 29 17:51:55 user nova-compute[74613]: DEBUG nova.network.neutron [req-7d150e2e-8c52-437f-851e-44343974ba5a req-b25b7b60-850e-4dd7-b889-ce2f8c7f51b9 service nova] [instance: 0008521b-5a63-4ff6-8390-d343956900ed] Updated VIF entry in instance network info cache for port 0ab94891-565e-4864-b6ba-565056b40005. {{(pid=74613) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 17:51:55 user nova-compute[74613]: DEBUG nova.network.neutron [req-7d150e2e-8c52-437f-851e-44343974ba5a req-b25b7b60-850e-4dd7-b889-ce2f8c7f51b9 service nova] [instance: 0008521b-5a63-4ff6-8390-d343956900ed] Updating instance_info_cache with network_info: [{"id": "0ab94891-565e-4864-b6ba-565056b40005", "address": "fa:16:3e:7e:c4:dc", "network": {"id": "8955d6de-e65e-431d-80b4-420aeda27329", "bridge": "br-int", "label": "tempest-TestVolumeSwap-241933908-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6d9f2fb92a21448d9c935927066d5372", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0ab94891-56", "ovs_interfaceid": "0ab94891-565e-4864-b6ba-565056b40005", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74613) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 17:51:55 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-7d150e2e-8c52-437f-851e-44343974ba5a req-b25b7b60-850e-4dd7-b889-ce2f8c7f51b9 service nova] Releasing lock "refresh_cache-0008521b-5a63-4ff6-8390-d343956900ed" {{(pid=74613) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 17:51:55 user nova-compute[74613]: DEBUG nova.compute.manager [None req-fa153cd0-d0ba-4e0d-a20b-86c28a59b05e tempest-TaggedAttachmentsTest-1438740121 tempest-TaggedAttachmentsTest-1438740121-project-member] [instance: 288b8261-8706-4696-879d-d4dd01ab553e] Allocating IP information in the background. {{(pid=74613) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 29 17:51:55 user nova-compute[74613]: DEBUG nova.network.neutron [None req-fa153cd0-d0ba-4e0d-a20b-86c28a59b05e tempest-TaggedAttachmentsTest-1438740121 tempest-TaggedAttachmentsTest-1438740121-project-member] [instance: 288b8261-8706-4696-879d-d4dd01ab553e] allocate_for_instance() {{(pid=74613) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 29 17:51:55 user nova-compute[74613]: INFO nova.virt.libvirt.driver [None req-fa153cd0-d0ba-4e0d-a20b-86c28a59b05e tempest-TaggedAttachmentsTest-1438740121 tempest-TaggedAttachmentsTest-1438740121-project-member] [instance: 288b8261-8706-4696-879d-d4dd01ab553e] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 29 17:51:55 user nova-compute[74613]: DEBUG nova.compute.manager [None req-fa153cd0-d0ba-4e0d-a20b-86c28a59b05e tempest-TaggedAttachmentsTest-1438740121 tempest-TaggedAttachmentsTest-1438740121-project-member] [instance: 288b8261-8706-4696-879d-d4dd01ab553e] Start building block device mappings for instance. {{(pid=74613) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 29 17:51:55 user nova-compute[74613]: DEBUG nova.compute.manager [None req-fa153cd0-d0ba-4e0d-a20b-86c28a59b05e tempest-TaggedAttachmentsTest-1438740121 tempest-TaggedAttachmentsTest-1438740121-project-member] [instance: 288b8261-8706-4696-879d-d4dd01ab553e] Start spawning the instance on the hypervisor. {{(pid=74613) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 29 17:51:55 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-fa153cd0-d0ba-4e0d-a20b-86c28a59b05e tempest-TaggedAttachmentsTest-1438740121 tempest-TaggedAttachmentsTest-1438740121-project-member] [instance: 288b8261-8706-4696-879d-d4dd01ab553e] Creating instance directory {{(pid=74613) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 29 17:51:55 user nova-compute[74613]: INFO nova.virt.libvirt.driver [None req-fa153cd0-d0ba-4e0d-a20b-86c28a59b05e tempest-TaggedAttachmentsTest-1438740121 tempest-TaggedAttachmentsTest-1438740121-project-member] [instance: 288b8261-8706-4696-879d-d4dd01ab553e] Creating image(s)
Nov 29 17:51:55 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-fa153cd0-d0ba-4e0d-a20b-86c28a59b05e tempest-TaggedAttachmentsTest-1438740121 tempest-TaggedAttachmentsTest-1438740121-project-member] Acquiring lock "/opt/stack/data/nova/instances/288b8261-8706-4696-879d-d4dd01ab553e/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 17:51:55 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-fa153cd0-d0ba-4e0d-a20b-86c28a59b05e tempest-TaggedAttachmentsTest-1438740121 tempest-TaggedAttachmentsTest-1438740121-project-member] Lock "/opt/stack/data/nova/instances/288b8261-8706-4696-879d-d4dd01ab553e/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 17:51:55 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-fa153cd0-d0ba-4e0d-a20b-86c28a59b05e tempest-TaggedAttachmentsTest-1438740121 tempest-TaggedAttachmentsTest-1438740121-project-member] Lock "/opt/stack/data/nova/instances/288b8261-8706-4696-879d-d4dd01ab553e/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 17:51:55 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-fa153cd0-d0ba-4e0d-a20b-86c28a59b05e tempest-TaggedAttachmentsTest-1438740121 tempest-TaggedAttachmentsTest-1438740121-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/21faea9e6951f3bdd0153b76ac89fe1a60a34758 --force-share --output=json {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 17:51:56 user nova-compute[74613]: DEBUG nova.policy [None req-fa153cd0-d0ba-4e0d-a20b-86c28a59b05e tempest-TaggedAttachmentsTest-1438740121 tempest-TaggedAttachmentsTest-1438740121-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '52aa43eddf17484b9823bf13f548d22b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdebfa0bb4bf45338ce3fa1ded5cd5bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74613) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 29 17:51:56 user nova-compute[74613]: DEBUG nova.compute.manager [None req-3f6d5344-1f38-4085-9a6e-d96c8bbaee02 tempest-AttachSCSIVolumeTestJSON-1343397388 tempest-AttachSCSIVolumeTestJSON-1343397388-project-member] [instance: 01c65b16-5dbe-4ad5-a72e-9500a4fa59cf] Instance event wait completed in 0 seconds for  {{(pid=74613) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 29 17:51:56 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-3f6d5344-1f38-4085-9a6e-d96c8bbaee02 tempest-AttachSCSIVolumeTestJSON-1343397388 tempest-AttachSCSIVolumeTestJSON-1343397388-project-member] [instance: 01c65b16-5dbe-4ad5-a72e-9500a4fa59cf] Guest created on hypervisor {{(pid=74613) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 29 17:51:56 user nova-compute[74613]: INFO nova.virt.libvirt.driver [-] [instance: 01c65b16-5dbe-4ad5-a72e-9500a4fa59cf] Instance spawned successfully.
Nov 29 17:51:56 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-3f6d5344-1f38-4085-9a6e-d96c8bbaee02 tempest-AttachSCSIVolumeTestJSON-1343397388 tempest-AttachSCSIVolumeTestJSON-1343397388-project-member] [instance: 01c65b16-5dbe-4ad5-a72e-9500a4fa59cf] Attempting to register defaults for the following image properties: ['hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74613) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 29 17:51:56 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-3f6d5344-1f38-4085-9a6e-d96c8bbaee02 tempest-AttachSCSIVolumeTestJSON-1343397388 tempest-AttachSCSIVolumeTestJSON-1343397388-project-member] [instance: 01c65b16-5dbe-4ad5-a72e-9500a4fa59cf] Found default for hw_input_bus of None {{(pid=74613) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 17:51:56 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-3f6d5344-1f38-4085-9a6e-d96c8bbaee02 tempest-AttachSCSIVolumeTestJSON-1343397388 tempest-AttachSCSIVolumeTestJSON-1343397388-project-member] [instance: 01c65b16-5dbe-4ad5-a72e-9500a4fa59cf] Found default for hw_pointer_model of None {{(pid=74613) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 17:51:56 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-3f6d5344-1f38-4085-9a6e-d96c8bbaee02 tempest-AttachSCSIVolumeTestJSON-1343397388 tempest-AttachSCSIVolumeTestJSON-1343397388-project-member] [instance: 01c65b16-5dbe-4ad5-a72e-9500a4fa59cf] Found default for hw_video_model of virtio {{(pid=74613) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 17:51:56 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-3f6d5344-1f38-4085-9a6e-d96c8bbaee02 tempest-AttachSCSIVolumeTestJSON-1343397388 tempest-AttachSCSIVolumeTestJSON-1343397388-project-member] [instance: 01c65b16-5dbe-4ad5-a72e-9500a4fa59cf] Found default for hw_vif_model of virtio {{(pid=74613) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 17:51:56 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-fa153cd0-d0ba-4e0d-a20b-86c28a59b05e tempest-TaggedAttachmentsTest-1438740121 tempest-TaggedAttachmentsTest-1438740121-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/21faea9e6951f3bdd0153b76ac89fe1a60a34758 --force-share --output=json" returned: 0 in 0.358s {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 17:51:56 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-fa153cd0-d0ba-4e0d-a20b-86c28a59b05e tempest-TaggedAttachmentsTest-1438740121 tempest-TaggedAttachmentsTest-1438740121-project-member] Acquiring lock "21faea9e6951f3bdd0153b76ac89fe1a60a34758" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 17:51:56 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-fa153cd0-d0ba-4e0d-a20b-86c28a59b05e tempest-TaggedAttachmentsTest-1438740121 tempest-TaggedAttachmentsTest-1438740121-project-member] Lock "21faea9e6951f3bdd0153b76ac89fe1a60a34758" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 17:51:56 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-fa153cd0-d0ba-4e0d-a20b-86c28a59b05e tempest-TaggedAttachmentsTest-1438740121 tempest-TaggedAttachmentsTest-1438740121-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/21faea9e6951f3bdd0153b76ac89fe1a60a34758 --force-share --output=json {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 17:51:56 user nova-compute[74613]: INFO nova.compute.manager [None req-3f6d5344-1f38-4085-9a6e-d96c8bbaee02 tempest-AttachSCSIVolumeTestJSON-1343397388 tempest-AttachSCSIVolumeTestJSON-1343397388-project-member] [instance: 01c65b16-5dbe-4ad5-a72e-9500a4fa59cf] Took 11.37 seconds to spawn the instance on the hypervisor.
Nov 29 17:51:56 user nova-compute[74613]: DEBUG nova.compute.manager [None req-3f6d5344-1f38-4085-9a6e-d96c8bbaee02 tempest-AttachSCSIVolumeTestJSON-1343397388 tempest-AttachSCSIVolumeTestJSON-1343397388-project-member] [instance: 01c65b16-5dbe-4ad5-a72e-9500a4fa59cf] Checking state {{(pid=74613) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 29 17:51:56 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-fa153cd0-d0ba-4e0d-a20b-86c28a59b05e tempest-TaggedAttachmentsTest-1438740121 tempest-TaggedAttachmentsTest-1438740121-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/21faea9e6951f3bdd0153b76ac89fe1a60a34758 --force-share --output=json" returned: 0 in 0.248s {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 17:51:56 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-fa153cd0-d0ba-4e0d-a20b-86c28a59b05e tempest-TaggedAttachmentsTest-1438740121 tempest-TaggedAttachmentsTest-1438740121-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/21faea9e6951f3bdd0153b76ac89fe1a60a34758,backing_fmt=raw /opt/stack/data/nova/instances/288b8261-8706-4696-879d-d4dd01ab553e/disk 1073741824 {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 17:51:56 user nova-compute[74613]: DEBUG nova.compute.manager [req-fea58c13-8364-4977-bc6f-a92118374020 req-0f44db7d-6ebf-4d16-a5ed-1885ffa13b28 service nova] [instance: f3a5f6d2-cadd-485b-a443-1b8f3ed966b9] Received event network-vif-plugged-49e80b78-004f-457d-aea8-8940ab6d9179 {{(pid=74613) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 17:51:56 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-fea58c13-8364-4977-bc6f-a92118374020 req-0f44db7d-6ebf-4d16-a5ed-1885ffa13b28 service nova] Acquiring lock "f3a5f6d2-cadd-485b-a443-1b8f3ed966b9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 17:51:56 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-fea58c13-8364-4977-bc6f-a92118374020 req-0f44db7d-6ebf-4d16-a5ed-1885ffa13b28 service nova] Lock "f3a5f6d2-cadd-485b-a443-1b8f3ed966b9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 17:51:56 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-fea58c13-8364-4977-bc6f-a92118374020 req-0f44db7d-6ebf-4d16-a5ed-1885ffa13b28 service nova] Lock "f3a5f6d2-cadd-485b-a443-1b8f3ed966b9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 17:51:56 user nova-compute[74613]: DEBUG nova.compute.manager [req-fea58c13-8364-4977-bc6f-a92118374020 req-0f44db7d-6ebf-4d16-a5ed-1885ffa13b28 service nova] [instance: f3a5f6d2-cadd-485b-a443-1b8f3ed966b9] No waiting events found dispatching network-vif-plugged-49e80b78-004f-457d-aea8-8940ab6d9179 {{(pid=74613) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 17:51:56 user nova-compute[74613]: WARNING nova.compute.manager [req-fea58c13-8364-4977-bc6f-a92118374020 req-0f44db7d-6ebf-4d16-a5ed-1885ffa13b28 service nova] [instance: f3a5f6d2-cadd-485b-a443-1b8f3ed966b9] Received unexpected event network-vif-plugged-49e80b78-004f-457d-aea8-8940ab6d9179 for instance with vm_state active and task_state None.
Nov 29 17:51:56 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-d6c2deef-a275-4ada-bc8c-287f3c880266 tempest-VolumesAssistedSnapshotsTest-616484375 tempest-VolumesAssistedSnapshotsTest-616484375-project-member] Acquiring lock "d4ecef60-62f9-4969-b57f-3bb45a44cc9f" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 17:51:56 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-d6c2deef-a275-4ada-bc8c-287f3c880266 tempest-VolumesAssistedSnapshotsTest-616484375 tempest-VolumesAssistedSnapshotsTest-616484375-project-member] Lock "d4ecef60-62f9-4969-b57f-3bb45a44cc9f" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.002s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 17:51:56 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-fa153cd0-d0ba-4e0d-a20b-86c28a59b05e tempest-TaggedAttachmentsTest-1438740121 tempest-TaggedAttachmentsTest-1438740121-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/21faea9e6951f3bdd0153b76ac89fe1a60a34758,backing_fmt=raw /opt/stack/data/nova/instances/288b8261-8706-4696-879d-d4dd01ab553e/disk 1073741824" returned: 0 in 0.131s {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 17:51:56 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-fa153cd0-d0ba-4e0d-a20b-86c28a59b05e tempest-TaggedAttachmentsTest-1438740121 tempest-TaggedAttachmentsTest-1438740121-project-member] Lock "21faea9e6951f3bdd0153b76ac89fe1a60a34758" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.383s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 17:51:56 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-fa153cd0-d0ba-4e0d-a20b-86c28a59b05e tempest-TaggedAttachmentsTest-1438740121 tempest-TaggedAttachmentsTest-1438740121-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/21faea9e6951f3bdd0153b76ac89fe1a60a34758 --force-share --output=json {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 17:51:56 user nova-compute[74613]: DEBUG nova.compute.manager [None req-d6c2deef-a275-4ada-bc8c-287f3c880266 tempest-VolumesAssistedSnapshotsTest-616484375 tempest-VolumesAssistedSnapshotsTest-616484375-project-member] [instance: d4ecef60-62f9-4969-b57f-3bb45a44cc9f] Starting instance... {{(pid=74613) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 29 17:51:56 user nova-compute[74613]: INFO nova.compute.manager [None req-3f6d5344-1f38-4085-9a6e-d96c8bbaee02 tempest-AttachSCSIVolumeTestJSON-1343397388 tempest-AttachSCSIVolumeTestJSON-1343397388-project-member] [instance: 01c65b16-5dbe-4ad5-a72e-9500a4fa59cf] Took 18.95 seconds to build instance.
Nov 29 17:51:56 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-3f6d5344-1f38-4085-9a6e-d96c8bbaee02 tempest-AttachSCSIVolumeTestJSON-1343397388 tempest-AttachSCSIVolumeTestJSON-1343397388-project-member] Lock "01c65b16-5dbe-4ad5-a72e-9500a4fa59cf" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 19.062s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 17:51:56 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-d6c2deef-a275-4ada-bc8c-287f3c880266 tempest-VolumesAssistedSnapshotsTest-616484375 tempest-VolumesAssistedSnapshotsTest-616484375-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 17:51:56 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-d6c2deef-a275-4ada-bc8c-287f3c880266 tempest-VolumesAssistedSnapshotsTest-616484375 tempest-VolumesAssistedSnapshotsTest-616484375-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.002s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 17:51:56 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-fa153cd0-d0ba-4e0d-a20b-86c28a59b05e tempest-TaggedAttachmentsTest-1438740121 tempest-TaggedAttachmentsTest-1438740121-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/21faea9e6951f3bdd0153b76ac89fe1a60a34758 --force-share --output=json" returned: 0 in 0.268s {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 17:51:56 user nova-compute[74613]: DEBUG nova.virt.disk.api [None req-fa153cd0-d0ba-4e0d-a20b-86c28a59b05e tempest-TaggedAttachmentsTest-1438740121 tempest-TaggedAttachmentsTest-1438740121-project-member] Checking if we can resize image /opt/stack/data/nova/instances/288b8261-8706-4696-879d-d4dd01ab553e/disk. size=1073741824 {{(pid=74613) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 29 17:51:56 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-fa153cd0-d0ba-4e0d-a20b-86c28a59b05e tempest-TaggedAttachmentsTest-1438740121 tempest-TaggedAttachmentsTest-1438740121-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/288b8261-8706-4696-879d-d4dd01ab553e/disk --force-share --output=json {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 17:51:56 user nova-compute[74613]: DEBUG nova.virt.hardware [None req-d6c2deef-a275-4ada-bc8c-287f3c880266 tempest-VolumesAssistedSnapshotsTest-616484375 tempest-VolumesAssistedSnapshotsTest-616484375-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74613) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 29 17:51:56 user nova-compute[74613]: INFO nova.compute.claims [None req-d6c2deef-a275-4ada-bc8c-287f3c880266 tempest-VolumesAssistedSnapshotsTest-616484375 tempest-VolumesAssistedSnapshotsTest-616484375-project-member] [instance: d4ecef60-62f9-4969-b57f-3bb45a44cc9f] Claim successful on node user
Nov 29 17:51:57 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:51:57 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-fa153cd0-d0ba-4e0d-a20b-86c28a59b05e tempest-TaggedAttachmentsTest-1438740121 tempest-TaggedAttachmentsTest-1438740121-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/288b8261-8706-4696-879d-d4dd01ab553e/disk --force-share --output=json" returned: 0 in 0.414s {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 17:51:57 user nova-compute[74613]: DEBUG nova.virt.disk.api [None req-fa153cd0-d0ba-4e0d-a20b-86c28a59b05e tempest-TaggedAttachmentsTest-1438740121 tempest-TaggedAttachmentsTest-1438740121-project-member] Cannot resize image /opt/stack/data/nova/instances/288b8261-8706-4696-879d-d4dd01ab553e/disk to a smaller size. {{(pid=74613) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 29 17:51:57 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-fa153cd0-d0ba-4e0d-a20b-86c28a59b05e tempest-TaggedAttachmentsTest-1438740121 tempest-TaggedAttachmentsTest-1438740121-project-member] [instance: 288b8261-8706-4696-879d-d4dd01ab553e] Created local disks {{(pid=74613) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 29 17:51:57 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-fa153cd0-d0ba-4e0d-a20b-86c28a59b05e tempest-TaggedAttachmentsTest-1438740121 tempest-TaggedAttachmentsTest-1438740121-project-member] [instance: 288b8261-8706-4696-879d-d4dd01ab553e] Ensure instance console log exists: /opt/stack/data/nova/instances/288b8261-8706-4696-879d-d4dd01ab553e/console.log {{(pid=74613) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 29 17:51:57 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-fa153cd0-d0ba-4e0d-a20b-86c28a59b05e tempest-TaggedAttachmentsTest-1438740121 tempest-TaggedAttachmentsTest-1438740121-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 17:51:57 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-fa153cd0-d0ba-4e0d-a20b-86c28a59b05e tempest-TaggedAttachmentsTest-1438740121 tempest-TaggedAttachmentsTest-1438740121-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 17:51:57 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-fa153cd0-d0ba-4e0d-a20b-86c28a59b05e tempest-TaggedAttachmentsTest-1438740121 tempest-TaggedAttachmentsTest-1438740121-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 17:51:57 user nova-compute[74613]: DEBUG nova.network.neutron [None req-fa153cd0-d0ba-4e0d-a20b-86c28a59b05e tempest-TaggedAttachmentsTest-1438740121 tempest-TaggedAttachmentsTest-1438740121-project-member] [instance: 288b8261-8706-4696-879d-d4dd01ab553e] Successfully created port: abe5d419-60cc-474c-935a-60f5512894e0 {{(pid=74613) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 29 17:51:57 user nova-compute[74613]: DEBUG nova.compute.provider_tree [None req-d6c2deef-a275-4ada-bc8c-287f3c880266 tempest-VolumesAssistedSnapshotsTest-616484375 tempest-VolumesAssistedSnapshotsTest-616484375-project-member] Inventory has not changed in ProviderTree for provider: 639d980e-3b12-44b1-b8f4-1812416fa4dd {{(pid=74613) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 17:51:58 user nova-compute[74613]: DEBUG nova.scheduler.client.report [None req-d6c2deef-a275-4ada-bc8c-287f3c880266 tempest-VolumesAssistedSnapshotsTest-616484375 tempest-VolumesAssistedSnapshotsTest-616484375-project-member] Inventory has not changed for provider 639d980e-3b12-44b1-b8f4-1812416fa4dd based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74613) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 17:51:58 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-d6c2deef-a275-4ada-bc8c-287f3c880266 tempest-VolumesAssistedSnapshotsTest-616484375 tempest-VolumesAssistedSnapshotsTest-616484375-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 1.248s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 17:51:58 user nova-compute[74613]: DEBUG nova.compute.manager [None req-d6c2deef-a275-4ada-bc8c-287f3c880266 tempest-VolumesAssistedSnapshotsTest-616484375 tempest-VolumesAssistedSnapshotsTest-616484375-project-member] [instance: d4ecef60-62f9-4969-b57f-3bb45a44cc9f] Start building networks asynchronously for instance. {{(pid=74613) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 29 17:51:58 user nova-compute[74613]: DEBUG nova.compute.manager [None req-d6c2deef-a275-4ada-bc8c-287f3c880266 tempest-VolumesAssistedSnapshotsTest-616484375 tempest-VolumesAssistedSnapshotsTest-616484375-project-member] [instance: d4ecef60-62f9-4969-b57f-3bb45a44cc9f] Allocating IP information in the background. {{(pid=74613) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 29 17:51:58 user nova-compute[74613]: DEBUG nova.network.neutron [None req-d6c2deef-a275-4ada-bc8c-287f3c880266 tempest-VolumesAssistedSnapshotsTest-616484375 tempest-VolumesAssistedSnapshotsTest-616484375-project-member] [instance: d4ecef60-62f9-4969-b57f-3bb45a44cc9f] allocate_for_instance() {{(pid=74613) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 29 17:51:58 user nova-compute[74613]: INFO nova.virt.libvirt.driver [None req-d6c2deef-a275-4ada-bc8c-287f3c880266 tempest-VolumesAssistedSnapshotsTest-616484375 tempest-VolumesAssistedSnapshotsTest-616484375-project-member] [instance: d4ecef60-62f9-4969-b57f-3bb45a44cc9f] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 29 17:51:58 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:51:58 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:51:58 user nova-compute[74613]: DEBUG nova.compute.manager [None req-d6c2deef-a275-4ada-bc8c-287f3c880266 tempest-VolumesAssistedSnapshotsTest-616484375 tempest-VolumesAssistedSnapshotsTest-616484375-project-member] [instance: d4ecef60-62f9-4969-b57f-3bb45a44cc9f] Start building block device mappings for instance. {{(pid=74613) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 29 17:51:58 user nova-compute[74613]: DEBUG nova.policy [None req-d6c2deef-a275-4ada-bc8c-287f3c880266 tempest-VolumesAssistedSnapshotsTest-616484375 tempest-VolumesAssistedSnapshotsTest-616484375-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '86cabe02b8334bc8b693f0337a602b01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6469439fcd88494f85d31126651f3027', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74613) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 29 17:51:58 user nova-compute[74613]: DEBUG nova.compute.manager [None req-d6c2deef-a275-4ada-bc8c-287f3c880266 tempest-VolumesAssistedSnapshotsTest-616484375 tempest-VolumesAssistedSnapshotsTest-616484375-project-member] [instance: d4ecef60-62f9-4969-b57f-3bb45a44cc9f] Start spawning the instance on the hypervisor. {{(pid=74613) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 29 17:51:58 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-d6c2deef-a275-4ada-bc8c-287f3c880266 tempest-VolumesAssistedSnapshotsTest-616484375 tempest-VolumesAssistedSnapshotsTest-616484375-project-member] [instance: d4ecef60-62f9-4969-b57f-3bb45a44cc9f] Creating instance directory {{(pid=74613) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 29 17:51:58 user nova-compute[74613]: INFO nova.virt.libvirt.driver [None req-d6c2deef-a275-4ada-bc8c-287f3c880266 tempest-VolumesAssistedSnapshotsTest-616484375 tempest-VolumesAssistedSnapshotsTest-616484375-project-member] [instance: d4ecef60-62f9-4969-b57f-3bb45a44cc9f] Creating image(s)
Nov 29 17:51:58 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-d6c2deef-a275-4ada-bc8c-287f3c880266 tempest-VolumesAssistedSnapshotsTest-616484375 tempest-VolumesAssistedSnapshotsTest-616484375-project-member] Acquiring lock "/opt/stack/data/nova/instances/d4ecef60-62f9-4969-b57f-3bb45a44cc9f/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 17:51:58 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-d6c2deef-a275-4ada-bc8c-287f3c880266 tempest-VolumesAssistedSnapshotsTest-616484375 tempest-VolumesAssistedSnapshotsTest-616484375-project-member] Lock "/opt/stack/data/nova/instances/d4ecef60-62f9-4969-b57f-3bb45a44cc9f/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 17:51:58 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-d6c2deef-a275-4ada-bc8c-287f3c880266 tempest-VolumesAssistedSnapshotsTest-616484375 tempest-VolumesAssistedSnapshotsTest-616484375-project-member] Lock "/opt/stack/data/nova/instances/d4ecef60-62f9-4969-b57f-3bb45a44cc9f/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 17:51:58 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-d6c2deef-a275-4ada-bc8c-287f3c880266 tempest-VolumesAssistedSnapshotsTest-616484375 tempest-VolumesAssistedSnapshotsTest-616484375-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/21faea9e6951f3bdd0153b76ac89fe1a60a34758 --force-share --output=json {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 17:51:58 user nova-compute[74613]: DEBUG nova.compute.manager [req-2ec6e571-cd1c-4ef8-9524-1e54670723aa req-80b1a27d-d277-4121-9d98-39004313859b service nova] [instance: f3a5f6d2-cadd-485b-a443-1b8f3ed966b9] Received event network-vif-plugged-49e80b78-004f-457d-aea8-8940ab6d9179 {{(pid=74613) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 17:51:58 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-2ec6e571-cd1c-4ef8-9524-1e54670723aa req-80b1a27d-d277-4121-9d98-39004313859b service nova] Acquiring lock "f3a5f6d2-cadd-485b-a443-1b8f3ed966b9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 17:51:58 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-2ec6e571-cd1c-4ef8-9524-1e54670723aa req-80b1a27d-d277-4121-9d98-39004313859b service nova] Lock "f3a5f6d2-cadd-485b-a443-1b8f3ed966b9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 17:51:58 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-2ec6e571-cd1c-4ef8-9524-1e54670723aa req-80b1a27d-d277-4121-9d98-39004313859b service nova] Lock "f3a5f6d2-cadd-485b-a443-1b8f3ed966b9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 17:51:58 user nova-compute[74613]: DEBUG nova.compute.manager [req-2ec6e571-cd1c-4ef8-9524-1e54670723aa req-80b1a27d-d277-4121-9d98-39004313859b service nova] [instance: f3a5f6d2-cadd-485b-a443-1b8f3ed966b9] No waiting events found dispatching network-vif-plugged-49e80b78-004f-457d-aea8-8940ab6d9179 {{(pid=74613) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 17:51:58 user nova-compute[74613]: WARNING nova.compute.manager [req-2ec6e571-cd1c-4ef8-9524-1e54670723aa req-80b1a27d-d277-4121-9d98-39004313859b service nova] [instance: f3a5f6d2-cadd-485b-a443-1b8f3ed966b9] Received unexpected event network-vif-plugged-49e80b78-004f-457d-aea8-8940ab6d9179 for instance with vm_state active and task_state None.
Nov 29 17:51:58 user nova-compute[74613]: DEBUG nova.compute.manager [req-2ec6e571-cd1c-4ef8-9524-1e54670723aa req-80b1a27d-d277-4121-9d98-39004313859b service nova] [instance: 01c65b16-5dbe-4ad5-a72e-9500a4fa59cf] Received event network-vif-plugged-9441dfc5-c933-4642-b797-494d88a10f8a {{(pid=74613) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 17:51:58 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-2ec6e571-cd1c-4ef8-9524-1e54670723aa req-80b1a27d-d277-4121-9d98-39004313859b service nova] Acquiring lock "01c65b16-5dbe-4ad5-a72e-9500a4fa59cf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 17:51:58 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-2ec6e571-cd1c-4ef8-9524-1e54670723aa req-80b1a27d-d277-4121-9d98-39004313859b service nova] Lock "01c65b16-5dbe-4ad5-a72e-9500a4fa59cf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 17:51:58 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-2ec6e571-cd1c-4ef8-9524-1e54670723aa req-80b1a27d-d277-4121-9d98-39004313859b service nova] Lock "01c65b16-5dbe-4ad5-a72e-9500a4fa59cf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 17:51:58 user nova-compute[74613]: DEBUG nova.compute.manager [req-2ec6e571-cd1c-4ef8-9524-1e54670723aa req-80b1a27d-d277-4121-9d98-39004313859b service nova] [instance: 01c65b16-5dbe-4ad5-a72e-9500a4fa59cf] No waiting events found dispatching network-vif-plugged-9441dfc5-c933-4642-b797-494d88a10f8a {{(pid=74613) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 17:51:58 user nova-compute[74613]: WARNING nova.compute.manager [req-2ec6e571-cd1c-4ef8-9524-1e54670723aa req-80b1a27d-d277-4121-9d98-39004313859b service nova] [instance: 01c65b16-5dbe-4ad5-a72e-9500a4fa59cf] Received unexpected event network-vif-plugged-9441dfc5-c933-4642-b797-494d88a10f8a for instance with vm_state active and task_state None.
Nov 29 17:51:58 user nova-compute[74613]: DEBUG nova.compute.manager [req-2ec6e571-cd1c-4ef8-9524-1e54670723aa req-80b1a27d-d277-4121-9d98-39004313859b service nova] [instance: 01c65b16-5dbe-4ad5-a72e-9500a4fa59cf] Received event network-vif-plugged-9441dfc5-c933-4642-b797-494d88a10f8a {{(pid=74613) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 17:51:58 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-2ec6e571-cd1c-4ef8-9524-1e54670723aa req-80b1a27d-d277-4121-9d98-39004313859b service nova] Acquiring lock "01c65b16-5dbe-4ad5-a72e-9500a4fa59cf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 17:51:58 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-2ec6e571-cd1c-4ef8-9524-1e54670723aa req-80b1a27d-d277-4121-9d98-39004313859b service nova] Lock "01c65b16-5dbe-4ad5-a72e-9500a4fa59cf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 17:51:58 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-2ec6e571-cd1c-4ef8-9524-1e54670723aa req-80b1a27d-d277-4121-9d98-39004313859b service nova] Lock "01c65b16-5dbe-4ad5-a72e-9500a4fa59cf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 17:51:58 user nova-compute[74613]: DEBUG nova.compute.manager [req-2ec6e571-cd1c-4ef8-9524-1e54670723aa req-80b1a27d-d277-4121-9d98-39004313859b service nova] [instance: 01c65b16-5dbe-4ad5-a72e-9500a4fa59cf] No waiting events found dispatching network-vif-plugged-9441dfc5-c933-4642-b797-494d88a10f8a {{(pid=74613) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 17:51:58 user nova-compute[74613]: WARNING nova.compute.manager [req-2ec6e571-cd1c-4ef8-9524-1e54670723aa req-80b1a27d-d277-4121-9d98-39004313859b service nova] [instance: 01c65b16-5dbe-4ad5-a72e-9500a4fa59cf] Received unexpected event network-vif-plugged-9441dfc5-c933-4642-b797-494d88a10f8a for instance with vm_state active and task_state None.
Nov 29 17:51:59 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-d6c2deef-a275-4ada-bc8c-287f3c880266 tempest-VolumesAssistedSnapshotsTest-616484375 tempest-VolumesAssistedSnapshotsTest-616484375-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/21faea9e6951f3bdd0153b76ac89fe1a60a34758 --force-share --output=json" returned: 0 in 0.506s {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 17:51:59 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-d6c2deef-a275-4ada-bc8c-287f3c880266 tempest-VolumesAssistedSnapshotsTest-616484375 tempest-VolumesAssistedSnapshotsTest-616484375-project-member] Acquiring lock "21faea9e6951f3bdd0153b76ac89fe1a60a34758" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 17:51:59 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-d6c2deef-a275-4ada-bc8c-287f3c880266 tempest-VolumesAssistedSnapshotsTest-616484375 tempest-VolumesAssistedSnapshotsTest-616484375-project-member] Lock "21faea9e6951f3bdd0153b76ac89fe1a60a34758" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 17:51:59 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-d6c2deef-a275-4ada-bc8c-287f3c880266 tempest-VolumesAssistedSnapshotsTest-616484375 tempest-VolumesAssistedSnapshotsTest-616484375-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/21faea9e6951f3bdd0153b76ac89fe1a60a34758 --force-share --output=json {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 17:51:59 user nova-compute[74613]: DEBUG nova.network.neutron [None req-fa153cd0-d0ba-4e0d-a20b-86c28a59b05e tempest-TaggedAttachmentsTest-1438740121 tempest-TaggedAttachmentsTest-1438740121-project-member] [instance: 288b8261-8706-4696-879d-d4dd01ab553e] Successfully updated port: abe5d419-60cc-474c-935a-60f5512894e0 {{(pid=74613) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 29 17:51:59 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-fa153cd0-d0ba-4e0d-a20b-86c28a59b05e tempest-TaggedAttachmentsTest-1438740121 tempest-TaggedAttachmentsTest-1438740121-project-member] Acquiring lock "refresh_cache-288b8261-8706-4696-879d-d4dd01ab553e" {{(pid=74613) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 17:51:59 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-fa153cd0-d0ba-4e0d-a20b-86c28a59b05e tempest-TaggedAttachmentsTest-1438740121 tempest-TaggedAttachmentsTest-1438740121-project-member] Acquired lock "refresh_cache-288b8261-8706-4696-879d-d4dd01ab553e" {{(pid=74613) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 17:51:59 user nova-compute[74613]: DEBUG nova.network.neutron [None req-fa153cd0-d0ba-4e0d-a20b-86c28a59b05e tempest-TaggedAttachmentsTest-1438740121 tempest-TaggedAttachmentsTest-1438740121-project-member] [instance: 288b8261-8706-4696-879d-d4dd01ab553e] Building network info cache for instance {{(pid=74613) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 29 17:51:59 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-d6c2deef-a275-4ada-bc8c-287f3c880266 tempest-VolumesAssistedSnapshotsTest-616484375 tempest-VolumesAssistedSnapshotsTest-616484375-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/21faea9e6951f3bdd0153b76ac89fe1a60a34758 --force-share --output=json" returned: 0 in 0.282s {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 17:51:59 user nova-compute[74613]: DEBUG nova.compute.manager [req-8112c155-634e-4d10-9e0e-bec4b97f8518 req-23b178da-d87a-4d88-ac09-8f65464f4a1f service nova] [instance: 288b8261-8706-4696-879d-d4dd01ab553e] Received event network-changed-abe5d419-60cc-474c-935a-60f5512894e0 {{(pid=74613) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 17:51:59 user nova-compute[74613]: DEBUG nova.compute.manager [req-8112c155-634e-4d10-9e0e-bec4b97f8518 req-23b178da-d87a-4d88-ac09-8f65464f4a1f service nova] [instance: 288b8261-8706-4696-879d-d4dd01ab553e] Refreshing instance network info cache due to event network-changed-abe5d419-60cc-474c-935a-60f5512894e0. {{(pid=74613) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 17:51:59 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-8112c155-634e-4d10-9e0e-bec4b97f8518 req-23b178da-d87a-4d88-ac09-8f65464f4a1f service nova] Acquiring lock "refresh_cache-288b8261-8706-4696-879d-d4dd01ab553e" {{(pid=74613) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 17:51:59 user nova-compute[74613]: DEBUG nova.network.neutron [None req-fa153cd0-d0ba-4e0d-a20b-86c28a59b05e tempest-TaggedAttachmentsTest-1438740121 tempest-TaggedAttachmentsTest-1438740121-project-member] [instance: 288b8261-8706-4696-879d-d4dd01ab553e] Instance cache missing network info. {{(pid=74613) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 29 17:51:59 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-d6c2deef-a275-4ada-bc8c-287f3c880266 tempest-VolumesAssistedSnapshotsTest-616484375 tempest-VolumesAssistedSnapshotsTest-616484375-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/21faea9e6951f3bdd0153b76ac89fe1a60a34758,backing_fmt=raw /opt/stack/data/nova/instances/d4ecef60-62f9-4969-b57f-3bb45a44cc9f/disk 1073741824 {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 17:51:59 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-d6c2deef-a275-4ada-bc8c-287f3c880266 tempest-VolumesAssistedSnapshotsTest-616484375 tempest-VolumesAssistedSnapshotsTest-616484375-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/21faea9e6951f3bdd0153b76ac89fe1a60a34758,backing_fmt=raw /opt/stack/data/nova/instances/d4ecef60-62f9-4969-b57f-3bb45a44cc9f/disk 1073741824" returned: 0 in 0.173s {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 17:51:59 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-d6c2deef-a275-4ada-bc8c-287f3c880266 tempest-VolumesAssistedSnapshotsTest-616484375 tempest-VolumesAssistedSnapshotsTest-616484375-project-member] Lock "21faea9e6951f3bdd0153b76ac89fe1a60a34758" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.475s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 17:51:59 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-d6c2deef-a275-4ada-bc8c-287f3c880266 tempest-VolumesAssistedSnapshotsTest-616484375 tempest-VolumesAssistedSnapshotsTest-616484375-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/21faea9e6951f3bdd0153b76ac89fe1a60a34758 --force-share --output=json {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 17:51:59 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-d6c2deef-a275-4ada-bc8c-287f3c880266 tempest-VolumesAssistedSnapshotsTest-616484375 tempest-VolumesAssistedSnapshotsTest-616484375-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/21faea9e6951f3bdd0153b76ac89fe1a60a34758 --force-share --output=json" returned: 0 in 0.340s {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 17:51:59 user nova-compute[74613]: DEBUG nova.virt.disk.api [None req-d6c2deef-a275-4ada-bc8c-287f3c880266 tempest-VolumesAssistedSnapshotsTest-616484375 tempest-VolumesAssistedSnapshotsTest-616484375-project-member] Checking if we can resize image /opt/stack/data/nova/instances/d4ecef60-62f9-4969-b57f-3bb45a44cc9f/disk. size=1073741824 {{(pid=74613) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 29 17:51:59 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-d6c2deef-a275-4ada-bc8c-287f3c880266 tempest-VolumesAssistedSnapshotsTest-616484375 tempest-VolumesAssistedSnapshotsTest-616484375-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d4ecef60-62f9-4969-b57f-3bb45a44cc9f/disk --force-share --output=json {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 17:51:59 user nova-compute[74613]: DEBUG nova.network.neutron [None req-fa153cd0-d0ba-4e0d-a20b-86c28a59b05e tempest-TaggedAttachmentsTest-1438740121 tempest-TaggedAttachmentsTest-1438740121-project-member] [instance: 288b8261-8706-4696-879d-d4dd01ab553e] Updating instance_info_cache with network_info: [{"id": "abe5d419-60cc-474c-935a-60f5512894e0", "address": "fa:16:3e:14:7b:54", "network": {"id": "3a1d6151-a950-475c-af8a-d15174f89822", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1729826224-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fdebfa0bb4bf45338ce3fa1ded5cd5bd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapabe5d419-60", "ovs_interfaceid": "abe5d419-60cc-474c-935a-60f5512894e0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74613) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 17:51:59 user nova-compute[74613]: DEBUG nova.network.neutron [None req-d6c2deef-a275-4ada-bc8c-287f3c880266 tempest-VolumesAssistedSnapshotsTest-616484375 tempest-VolumesAssistedSnapshotsTest-616484375-project-member] [instance: d4ecef60-62f9-4969-b57f-3bb45a44cc9f] Successfully created port: 292029d6-b062-4cdc-8c09-c92693cac658 {{(pid=74613) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 29 17:51:59 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:51:59 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-fa153cd0-d0ba-4e0d-a20b-86c28a59b05e tempest-TaggedAttachmentsTest-1438740121 tempest-TaggedAttachmentsTest-1438740121-project-member] Releasing lock "refresh_cache-288b8261-8706-4696-879d-d4dd01ab553e" {{(pid=74613) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 17:51:59 user nova-compute[74613]: DEBUG nova.compute.manager [None req-fa153cd0-d0ba-4e0d-a20b-86c28a59b05e tempest-TaggedAttachmentsTest-1438740121 tempest-TaggedAttachmentsTest-1438740121-project-member] [instance: 288b8261-8706-4696-879d-d4dd01ab553e] Instance network_info: |[{"id": "abe5d419-60cc-474c-935a-60f5512894e0", "address": "fa:16:3e:14:7b:54", "network": {"id": "3a1d6151-a950-475c-af8a-d15174f89822", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1729826224-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fdebfa0bb4bf45338ce3fa1ded5cd5bd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapabe5d419-60", "ovs_interfaceid": "abe5d419-60cc-474c-935a-60f5512894e0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74613) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 29 17:51:59 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-8112c155-634e-4d10-9e0e-bec4b97f8518 req-23b178da-d87a-4d88-ac09-8f65464f4a1f service nova] Acquired lock "refresh_cache-288b8261-8706-4696-879d-d4dd01ab553e" {{(pid=74613) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 17:51:59 user nova-compute[74613]: DEBUG nova.network.neutron [req-8112c155-634e-4d10-9e0e-bec4b97f8518 req-23b178da-d87a-4d88-ac09-8f65464f4a1f service nova] [instance: 288b8261-8706-4696-879d-d4dd01ab553e] Refreshing network info cache for port abe5d419-60cc-474c-935a-60f5512894e0 {{(pid=74613) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 17:51:59 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-fa153cd0-d0ba-4e0d-a20b-86c28a59b05e tempest-TaggedAttachmentsTest-1438740121 tempest-TaggedAttachmentsTest-1438740121-project-member] [instance: 288b8261-8706-4696-879d-d4dd01ab553e] Start _get_guest_xml network_info=[{"id": "abe5d419-60cc-474c-935a-60f5512894e0", "address": "fa:16:3e:14:7b:54", "network": {"id": "3a1d6151-a950-475c-af8a-d15174f89822", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1729826224-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fdebfa0bb4bf45338ce3fa1ded5cd5bd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapabe5d419-60", "ovs_interfaceid": "abe5d419-60cc-474c-935a-60f5512894e0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-29T17:47:38Z,direct_url=<?>,disk_format='qcow2',id=4217f428-8d9d-4ee1-9614-642d26d90c46,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='794b07cbd46a44b5865cfda741036bae',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-29T17:47:40Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'size': 0, 'device_type': 'disk', 'boot_index': 0, 'guest_format': None, 'encrypted': False, 'encryption_format': None, 'disk_bus': 'virtio', 'image_id': '4217f428-8d9d-4ee1-9614-642d26d90c46'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74613) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 29 17:51:59 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:52:00 user nova-compute[74613]: DEBUG nova.compute.manager [None req-4aa4794c-e959-4729-883a-7e95b2bf3385 tempest-TestVolumeSwap-281539251 tempest-TestVolumeSwap-281539251-project-member] [instance: 0008521b-5a63-4ff6-8390-d343956900ed] Instance event wait completed in 0 seconds for  {{(pid=74613) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 29 17:52:00 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-4aa4794c-e959-4729-883a-7e95b2bf3385 tempest-TestVolumeSwap-281539251 tempest-TestVolumeSwap-281539251-project-member] [instance: 0008521b-5a63-4ff6-8390-d343956900ed] Guest created on hypervisor {{(pid=74613) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 29 17:52:00 user nova-compute[74613]: INFO nova.virt.libvirt.driver [-] [instance: 0008521b-5a63-4ff6-8390-d343956900ed] Instance spawned successfully.
Nov 29 17:52:00 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-4aa4794c-e959-4729-883a-7e95b2bf3385 tempest-TestVolumeSwap-281539251 tempest-TestVolumeSwap-281539251-project-member] [instance: 0008521b-5a63-4ff6-8390-d343956900ed] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74613) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 29 17:52:00 user nova-compute[74613]: WARNING nova.virt.libvirt.driver [None req-fa153cd0-d0ba-4e0d-a20b-86c28a59b05e tempest-TaggedAttachmentsTest-1438740121 tempest-TaggedAttachmentsTest-1438740121-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 17:52:00 user nova-compute[74613]: WARNING nova.virt.libvirt.driver [None req-fa153cd0-d0ba-4e0d-a20b-86c28a59b05e tempest-TaggedAttachmentsTest-1438740121 tempest-TaggedAttachmentsTest-1438740121-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 17:52:00 user nova-compute[74613]: DEBUG nova.virt.libvirt.host [None req-fa153cd0-d0ba-4e0d-a20b-86c28a59b05e tempest-TaggedAttachmentsTest-1438740121 tempest-TaggedAttachmentsTest-1438740121-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74613) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 29 17:52:00 user nova-compute[74613]: DEBUG nova.virt.libvirt.host [None req-fa153cd0-d0ba-4e0d-a20b-86c28a59b05e tempest-TaggedAttachmentsTest-1438740121 tempest-TaggedAttachmentsTest-1438740121-project-member] CPU controller missing on host. {{(pid=74613) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 29 17:52:00 user nova-compute[74613]: DEBUG nova.virt.libvirt.host [None req-fa153cd0-d0ba-4e0d-a20b-86c28a59b05e tempest-TaggedAttachmentsTest-1438740121 tempest-TaggedAttachmentsTest-1438740121-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74613) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 29 17:52:00 user nova-compute[74613]: DEBUG nova.virt.libvirt.host [None req-fa153cd0-d0ba-4e0d-a20b-86c28a59b05e tempest-TaggedAttachmentsTest-1438740121 tempest-TaggedAttachmentsTest-1438740121-project-member] CPU controller found on host. {{(pid=74613) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 29 17:52:00 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-fa153cd0-d0ba-4e0d-a20b-86c28a59b05e tempest-TaggedAttachmentsTest-1438740121 tempest-TaggedAttachmentsTest-1438740121-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74613) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 29 17:52:00 user nova-compute[74613]: DEBUG nova.virt.hardware [None req-fa153cd0-d0ba-4e0d-a20b-86c28a59b05e tempest-TaggedAttachmentsTest-1438740121 tempest-TaggedAttachmentsTest-1438740121-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-29T17:47:27Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-29T17:47:38Z,direct_url=<?>,disk_format='qcow2',id=4217f428-8d9d-4ee1-9614-642d26d90c46,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='794b07cbd46a44b5865cfda741036bae',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-29T17:47:40Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74613) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 29 17:52:00 user nova-compute[74613]: DEBUG nova.virt.hardware [None req-fa153cd0-d0ba-4e0d-a20b-86c28a59b05e tempest-TaggedAttachmentsTest-1438740121 tempest-TaggedAttachmentsTest-1438740121-project-member] Flavor limits 0:0:0 {{(pid=74613) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 29 17:52:00 user nova-compute[74613]: DEBUG nova.virt.hardware [None req-fa153cd0-d0ba-4e0d-a20b-86c28a59b05e tempest-TaggedAttachmentsTest-1438740121 tempest-TaggedAttachmentsTest-1438740121-project-member] Image limits 0:0:0 {{(pid=74613) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 29 17:52:00 user nova-compute[74613]: DEBUG nova.virt.hardware [None req-fa153cd0-d0ba-4e0d-a20b-86c28a59b05e tempest-TaggedAttachmentsTest-1438740121 tempest-TaggedAttachmentsTest-1438740121-project-member] Flavor pref 0:0:0 {{(pid=74613) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 29 17:52:00 user nova-compute[74613]: DEBUG nova.virt.hardware [None req-fa153cd0-d0ba-4e0d-a20b-86c28a59b05e tempest-TaggedAttachmentsTest-1438740121 tempest-TaggedAttachmentsTest-1438740121-project-member] Image pref 0:0:0 {{(pid=74613) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 29 17:52:00 user nova-compute[74613]: DEBUG nova.virt.hardware [None req-fa153cd0-d0ba-4e0d-a20b-86c28a59b05e tempest-TaggedAttachmentsTest-1438740121 tempest-TaggedAttachmentsTest-1438740121-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74613) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 29 17:52:00 user nova-compute[74613]: DEBUG nova.virt.hardware [None req-fa153cd0-d0ba-4e0d-a20b-86c28a59b05e tempest-TaggedAttachmentsTest-1438740121 tempest-TaggedAttachmentsTest-1438740121-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74613) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 29 17:52:00 user nova-compute[74613]: DEBUG nova.virt.hardware [None req-fa153cd0-d0ba-4e0d-a20b-86c28a59b05e tempest-TaggedAttachmentsTest-1438740121 tempest-TaggedAttachmentsTest-1438740121-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74613) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 29 17:52:00 user nova-compute[74613]: DEBUG nova.virt.hardware [None req-fa153cd0-d0ba-4e0d-a20b-86c28a59b05e tempest-TaggedAttachmentsTest-1438740121 tempest-TaggedAttachmentsTest-1438740121-project-member] Got 1 possible topologies {{(pid=74613) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 29 17:52:00 user nova-compute[74613]: DEBUG nova.virt.hardware [None req-fa153cd0-d0ba-4e0d-a20b-86c28a59b05e tempest-TaggedAttachmentsTest-1438740121 tempest-TaggedAttachmentsTest-1438740121-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74613) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 29 17:52:00 user nova-compute[74613]: DEBUG nova.virt.hardware [None req-fa153cd0-d0ba-4e0d-a20b-86c28a59b05e tempest-TaggedAttachmentsTest-1438740121 tempest-TaggedAttachmentsTest-1438740121-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74613) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 29 17:52:00 user nova-compute[74613]: DEBUG nova.virt.libvirt.vif [None req-fa153cd0-d0ba-4e0d-a20b-86c28a59b05e tempest-TaggedAttachmentsTest-1438740121 tempest-TaggedAttachmentsTest-1438740121-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-29T17:51:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-697059192',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-697059192',id=8,image_ref='4217f428-8d9d-4ee1-9614-642d26d90c46',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFUFE7U0lYNK45/HsStCT3AXLpdrJnwoY/KNgsNZxe8b6bxv4jkHRb2DHfVVdKmIkJ56BYNQ81Tfxi8bOx3gLzOij7zz7pkeTvdmFF3bs2gbkvzpJfe42Gy5jL3poiHfSw==',key_name='tempest-keypair-587676949',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='fdebfa0bb4bf45338ce3fa1ded5cd5bd',ramdisk_id='',reservation_id='r-cg74z5d5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='4217f428-8d9d-4ee1-9614-642d26d90c46',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedAttachmentsTest-1438740121',owner_user_name='tempest-TaggedAttachmentsTest-1438740121-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T17:51:56Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='52aa43eddf17484b9823bf13f548d22b',uuid=288b8261-8706-4696-879d-d4dd01ab553e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "abe5d419-60cc-474c-935a-60f5512894e0", "address": "fa:16:3e:14:7b:54", "network": {"id": "3a1d6151-a950-475c-af8a-d15174f89822", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1729826224-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fdebfa0bb4bf45338ce3fa1ded5cd5bd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapabe5d419-60", "ovs_interfaceid": "abe5d419-60cc-474c-935a-60f5512894e0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74613) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 29 17:52:00 user nova-compute[74613]: DEBUG nova.network.os_vif_util [None req-fa153cd0-d0ba-4e0d-a20b-86c28a59b05e tempest-TaggedAttachmentsTest-1438740121 tempest-TaggedAttachmentsTest-1438740121-project-member] Converting VIF {"id": "abe5d419-60cc-474c-935a-60f5512894e0", "address": "fa:16:3e:14:7b:54", "network": {"id": "3a1d6151-a950-475c-af8a-d15174f89822", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1729826224-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fdebfa0bb4bf45338ce3fa1ded5cd5bd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapabe5d419-60", "ovs_interfaceid": "abe5d419-60cc-474c-935a-60f5512894e0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74613) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 17:52:00 user nova-compute[74613]: DEBUG nova.network.os_vif_util [None req-fa153cd0-d0ba-4e0d-a20b-86c28a59b05e tempest-TaggedAttachmentsTest-1438740121 tempest-TaggedAttachmentsTest-1438740121-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:14:7b:54,bridge_name='br-int',has_traffic_filtering=True,id=abe5d419-60cc-474c-935a-60f5512894e0,network=Network(3a1d6151-a950-475c-af8a-d15174f89822),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapabe5d419-60') {{(pid=74613) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 17:52:00 user nova-compute[74613]: DEBUG nova.objects.instance [None req-fa153cd0-d0ba-4e0d-a20b-86c28a59b05e tempest-TaggedAttachmentsTest-1438740121 tempest-TaggedAttachmentsTest-1438740121-project-member] Lazy-loading 'pci_devices' on Instance uuid 288b8261-8706-4696-879d-d4dd01ab553e {{(pid=74613) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 17:52:00 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-d6c2deef-a275-4ada-bc8c-287f3c880266 tempest-VolumesAssistedSnapshotsTest-616484375 tempest-VolumesAssistedSnapshotsTest-616484375-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d4ecef60-62f9-4969-b57f-3bb45a44cc9f/disk --force-share --output=json" returned: 0 in 0.420s {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 17:52:00 user nova-compute[74613]: DEBUG nova.virt.disk.api [None req-d6c2deef-a275-4ada-bc8c-287f3c880266 tempest-VolumesAssistedSnapshotsTest-616484375 tempest-VolumesAssistedSnapshotsTest-616484375-project-member] Cannot resize image /opt/stack/data/nova/instances/d4ecef60-62f9-4969-b57f-3bb45a44cc9f/disk to a smaller size. {{(pid=74613) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 29 17:52:00 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-d6c2deef-a275-4ada-bc8c-287f3c880266 tempest-VolumesAssistedSnapshotsTest-616484375 tempest-VolumesAssistedSnapshotsTest-616484375-project-member] [instance: d4ecef60-62f9-4969-b57f-3bb45a44cc9f] Created local disks {{(pid=74613) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 29 17:52:00 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-d6c2deef-a275-4ada-bc8c-287f3c880266 tempest-VolumesAssistedSnapshotsTest-616484375 tempest-VolumesAssistedSnapshotsTest-616484375-project-member] [instance: d4ecef60-62f9-4969-b57f-3bb45a44cc9f] Ensure instance console log exists: /opt/stack/data/nova/instances/d4ecef60-62f9-4969-b57f-3bb45a44cc9f/console.log {{(pid=74613) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 29 17:52:00 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-d6c2deef-a275-4ada-bc8c-287f3c880266 tempest-VolumesAssistedSnapshotsTest-616484375 tempest-VolumesAssistedSnapshotsTest-616484375-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 17:52:00 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-d6c2deef-a275-4ada-bc8c-287f3c880266 tempest-VolumesAssistedSnapshotsTest-616484375 tempest-VolumesAssistedSnapshotsTest-616484375-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 17:52:00 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-d6c2deef-a275-4ada-bc8c-287f3c880266 tempest-VolumesAssistedSnapshotsTest-616484375 tempest-VolumesAssistedSnapshotsTest-616484375-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 17:52:00 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-4aa4794c-e959-4729-883a-7e95b2bf3385 tempest-TestVolumeSwap-281539251 tempest-TestVolumeSwap-281539251-project-member] [instance: 0008521b-5a63-4ff6-8390-d343956900ed] Found default for hw_cdrom_bus of ide {{(pid=74613) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 17:52:00 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-4aa4794c-e959-4729-883a-7e95b2bf3385 tempest-TestVolumeSwap-281539251 tempest-TestVolumeSwap-281539251-project-member] [instance: 0008521b-5a63-4ff6-8390-d343956900ed] Found default for hw_disk_bus of virtio {{(pid=74613) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 17:52:00 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-4aa4794c-e959-4729-883a-7e95b2bf3385 tempest-TestVolumeSwap-281539251 tempest-TestVolumeSwap-281539251-project-member] [instance: 0008521b-5a63-4ff6-8390-d343956900ed] Found default for hw_input_bus of None {{(pid=74613) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 17:52:00 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-4aa4794c-e959-4729-883a-7e95b2bf3385 tempest-TestVolumeSwap-281539251 tempest-TestVolumeSwap-281539251-project-member] [instance: 0008521b-5a63-4ff6-8390-d343956900ed] Found default for hw_pointer_model of None {{(pid=74613) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 17:52:00 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-4aa4794c-e959-4729-883a-7e95b2bf3385 tempest-TestVolumeSwap-281539251 tempest-TestVolumeSwap-281539251-project-member] [instance: 0008521b-5a63-4ff6-8390-d343956900ed] Found default for hw_video_model of virtio {{(pid=74613) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 17:52:00 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-4aa4794c-e959-4729-883a-7e95b2bf3385 tempest-TestVolumeSwap-281539251 tempest-TestVolumeSwap-281539251-project-member] [instance: 0008521b-5a63-4ff6-8390-d343956900ed] Found default for hw_vif_model of virtio {{(pid=74613) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 17:52:00 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-fa153cd0-d0ba-4e0d-a20b-86c28a59b05e tempest-TaggedAttachmentsTest-1438740121 tempest-TaggedAttachmentsTest-1438740121-project-member] [instance: 288b8261-8706-4696-879d-d4dd01ab553e] End _get_guest_xml xml=<domain type="kvm">
Nov 29 17:52:00 user nova-compute[74613]:   <uuid>288b8261-8706-4696-879d-d4dd01ab553e</uuid>
Nov 29 17:52:00 user nova-compute[74613]:   <name>instance-00000008</name>
Nov 29 17:52:00 user nova-compute[74613]:   <memory>524288</memory>
Nov 29 17:52:00 user nova-compute[74613]:   <vcpu>1</vcpu>
Nov 29 17:52:00 user nova-compute[74613]:   <metadata>
Nov 29 17:52:00 user nova-compute[74613]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 29 17:52:00 user nova-compute[74613]:       <nova:package version="0.0.0"/>
Nov 29 17:52:00 user nova-compute[74613]:       <nova:name>tempest-device-tagging-server-697059192</nova:name>
Nov 29 17:52:00 user nova-compute[74613]:       <nova:creationTime>2023-11-29 17:52:00</nova:creationTime>
Nov 29 17:52:00 user nova-compute[74613]:       <nova:flavor name="m1.tiny">
Nov 29 17:52:00 user nova-compute[74613]:         <nova:memory>512</nova:memory>
Nov 29 17:52:00 user nova-compute[74613]:         <nova:disk>1</nova:disk>
Nov 29 17:52:00 user nova-compute[74613]:         <nova:swap>0</nova:swap>
Nov 29 17:52:00 user nova-compute[74613]:         <nova:ephemeral>0</nova:ephemeral>
Nov 29 17:52:00 user nova-compute[74613]:         <nova:vcpus>1</nova:vcpus>
Nov 29 17:52:00 user nova-compute[74613]:       </nova:flavor>
Nov 29 17:52:00 user nova-compute[74613]:       <nova:owner>
Nov 29 17:52:00 user nova-compute[74613]:         <nova:user uuid="52aa43eddf17484b9823bf13f548d22b">tempest-TaggedAttachmentsTest-1438740121-project-member</nova:user>
Nov 29 17:52:00 user nova-compute[74613]:         <nova:project uuid="fdebfa0bb4bf45338ce3fa1ded5cd5bd">tempest-TaggedAttachmentsTest-1438740121</nova:project>
Nov 29 17:52:00 user nova-compute[74613]:       </nova:owner>
Nov 29 17:52:00 user nova-compute[74613]:       <nova:root type="image" uuid="4217f428-8d9d-4ee1-9614-642d26d90c46"/>
Nov 29 17:52:00 user nova-compute[74613]:       <nova:ports>
Nov 29 17:52:00 user nova-compute[74613]:         <nova:port uuid="abe5d419-60cc-474c-935a-60f5512894e0">
Nov 29 17:52:00 user nova-compute[74613]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Nov 29 17:52:00 user nova-compute[74613]:         </nova:port>
Nov 29 17:52:00 user nova-compute[74613]:       </nova:ports>
Nov 29 17:52:00 user nova-compute[74613]:     </nova:instance>
Nov 29 17:52:00 user nova-compute[74613]:   </metadata>
Nov 29 17:52:00 user nova-compute[74613]:   <sysinfo type="smbios">
Nov 29 17:52:00 user nova-compute[74613]:     <system>
Nov 29 17:52:00 user nova-compute[74613]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 29 17:52:00 user nova-compute[74613]:       <entry name="product">OpenStack Nova</entry>
Nov 29 17:52:00 user nova-compute[74613]:       <entry name="version">0.0.0</entry>
Nov 29 17:52:00 user nova-compute[74613]:       <entry name="serial">288b8261-8706-4696-879d-d4dd01ab553e</entry>
Nov 29 17:52:00 user nova-compute[74613]:       <entry name="uuid">288b8261-8706-4696-879d-d4dd01ab553e</entry>
Nov 29 17:52:00 user nova-compute[74613]:       <entry name="family">Virtual Machine</entry>
Nov 29 17:52:00 user nova-compute[74613]:     </system>
Nov 29 17:52:00 user nova-compute[74613]:   </sysinfo>
Nov 29 17:52:00 user nova-compute[74613]:   <os>
Nov 29 17:52:00 user nova-compute[74613]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 29 17:52:00 user nova-compute[74613]:     <boot dev="hd"/>
Nov 29 17:52:00 user nova-compute[74613]:     <smbios mode="sysinfo"/>
Nov 29 17:52:00 user nova-compute[74613]:   </os>
Nov 29 17:52:00 user nova-compute[74613]:   <features>
Nov 29 17:52:00 user nova-compute[74613]:     <acpi/>
Nov 29 17:52:00 user nova-compute[74613]:     <apic/>
Nov 29 17:52:00 user nova-compute[74613]:     <vmcoreinfo/>
Nov 29 17:52:00 user nova-compute[74613]:   </features>
Nov 29 17:52:00 user nova-compute[74613]:   <clock offset="utc">
Nov 29 17:52:00 user nova-compute[74613]:     <timer name="pit" tickpolicy="delay"/>
Nov 29 17:52:00 user nova-compute[74613]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 29 17:52:00 user nova-compute[74613]:     <timer name="hpet" present="no"/>
Nov 29 17:52:00 user nova-compute[74613]:   </clock>
Nov 29 17:52:00 user nova-compute[74613]:   <cpu mode="custom" match="exact">
Nov 29 17:52:00 user nova-compute[74613]:     <model>Nehalem</model>
Nov 29 17:52:00 user nova-compute[74613]:     <topology sockets="1" cores="1" threads="1"/>
Nov 29 17:52:00 user nova-compute[74613]:   </cpu>
Nov 29 17:52:00 user nova-compute[74613]:   <devices>
Nov 29 17:52:00 user nova-compute[74613]:     <disk type="file" device="disk">
Nov 29 17:52:00 user nova-compute[74613]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 29 17:52:00 user nova-compute[74613]:       <source file="/opt/stack/data/nova/instances/288b8261-8706-4696-879d-d4dd01ab553e/disk"/>
Nov 29 17:52:00 user nova-compute[74613]:       <target dev="vda" bus="virtio"/>
Nov 29 17:52:00 user nova-compute[74613]:     </disk>
Nov 29 17:52:00 user nova-compute[74613]:     <disk type="file" device="cdrom">
Nov 29 17:52:00 user nova-compute[74613]:       <driver name="qemu" type="raw" cache="none"/>
Nov 29 17:52:00 user nova-compute[74613]:       <source file="/opt/stack/data/nova/instances/288b8261-8706-4696-879d-d4dd01ab553e/disk.config"/>
Nov 29 17:52:00 user nova-compute[74613]:       <target dev="hda" bus="ide"/>
Nov 29 17:52:00 user nova-compute[74613]:     </disk>
Nov 29 17:52:00 user nova-compute[74613]:     <interface type="ethernet">
Nov 29 17:52:00 user nova-compute[74613]:       <mac address="fa:16:3e:14:7b:54"/>
Nov 29 17:52:00 user nova-compute[74613]:       <model type="virtio"/>
Nov 29 17:52:00 user nova-compute[74613]:       <mtu size="1442"/>
Nov 29 17:52:00 user nova-compute[74613]:       <target dev="tapabe5d419-60"/>
Nov 29 17:52:00 user nova-compute[74613]:     </interface>
Nov 29 17:52:00 user nova-compute[74613]:     <serial type="pty">
Nov 29 17:52:00 user nova-compute[74613]:       <log file="/opt/stack/data/nova/instances/288b8261-8706-4696-879d-d4dd01ab553e/console.log" append="off"/>
Nov 29 17:52:00 user nova-compute[74613]:     </serial>
Nov 29 17:52:00 user nova-compute[74613]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 29 17:52:00 user nova-compute[74613]:     <video>
Nov 29 17:52:00 user nova-compute[74613]:       <model type="virtio"/>
Nov 29 17:52:00 user nova-compute[74613]:     </video>
Nov 29 17:52:00 user nova-compute[74613]:     <rng model="virtio">
Nov 29 17:52:00 user nova-compute[74613]:       <backend model="random">/dev/urandom</backend>
Nov 29 17:52:00 user nova-compute[74613]:     </rng>
Nov 29 17:52:00 user nova-compute[74613]:     <controller type="usb" index="0" model="none"/>
Nov 29 17:52:00 user nova-compute[74613]:     <memballoon model="virtio">
Nov 29 17:52:00 user nova-compute[74613]:       <stats period="10"/>
Nov 29 17:52:00 user nova-compute[74613]:     </memballoon>
Nov 29 17:52:00 user nova-compute[74613]:   </devices>
Nov 29 17:52:00 user nova-compute[74613]: </domain>
Nov 29 17:52:00 user nova-compute[74613]:  {{(pid=74613) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 29 17:52:00 user nova-compute[74613]: DEBUG nova.virt.libvirt.vif [None req-fa153cd0-d0ba-4e0d-a20b-86c28a59b05e tempest-TaggedAttachmentsTest-1438740121 tempest-TaggedAttachmentsTest-1438740121-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-29T17:51:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-697059192',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-697059192',id=8,image_ref='4217f428-8d9d-4ee1-9614-642d26d90c46',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFUFE7U0lYNK45/HsStCT3AXLpdrJnwoY/KNgsNZxe8b6bxv4jkHRb2DHfVVdKmIkJ56BYNQ81Tfxi8bOx3gLzOij7zz7pkeTvdmFF3bs2gbkvzpJfe42Gy5jL3poiHfSw==',key_name='tempest-keypair-587676949',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='fdebfa0bb4bf45338ce3fa1ded5cd5bd',ramdisk_id='',reservation_id='r-cg74z5d5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='4217f428-8d9d-4ee1-9614-642d26d90c46',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedAttachmentsTest-1438740121',owner_user_name='tempest-TaggedAttachmentsTest-1438740121-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T17:51:56Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='52aa43eddf17484b9823bf13f548d22b',uuid=288b8261-8706-4696-879d-d4dd01ab553e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "abe5d419-60cc-474c-935a-60f5512894e0", "address": "fa:16:3e:14:7b:54", "network": {"id": "3a1d6151-a950-475c-af8a-d15174f89822", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1729826224-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fdebfa0bb4bf45338ce3fa1ded5cd5bd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapabe5d419-60", "ovs_interfaceid": "abe5d419-60cc-474c-935a-60f5512894e0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74613) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 29 17:52:00 user nova-compute[74613]: DEBUG nova.network.os_vif_util [None req-fa153cd0-d0ba-4e0d-a20b-86c28a59b05e tempest-TaggedAttachmentsTest-1438740121 tempest-TaggedAttachmentsTest-1438740121-project-member] Converting VIF {"id": "abe5d419-60cc-474c-935a-60f5512894e0", "address": "fa:16:3e:14:7b:54", "network": {"id": "3a1d6151-a950-475c-af8a-d15174f89822", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1729826224-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fdebfa0bb4bf45338ce3fa1ded5cd5bd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapabe5d419-60", "ovs_interfaceid": "abe5d419-60cc-474c-935a-60f5512894e0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74613) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 17:52:00 user nova-compute[74613]: DEBUG nova.network.os_vif_util [None req-fa153cd0-d0ba-4e0d-a20b-86c28a59b05e tempest-TaggedAttachmentsTest-1438740121 tempest-TaggedAttachmentsTest-1438740121-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:14:7b:54,bridge_name='br-int',has_traffic_filtering=True,id=abe5d419-60cc-474c-935a-60f5512894e0,network=Network(3a1d6151-a950-475c-af8a-d15174f89822),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapabe5d419-60') {{(pid=74613) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 17:52:00 user nova-compute[74613]: DEBUG os_vif [None req-fa153cd0-d0ba-4e0d-a20b-86c28a59b05e tempest-TaggedAttachmentsTest-1438740121 tempest-TaggedAttachmentsTest-1438740121-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:14:7b:54,bridge_name='br-int',has_traffic_filtering=True,id=abe5d419-60cc-474c-935a-60f5512894e0,network=Network(3a1d6151-a950-475c-af8a-d15174f89822),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapabe5d419-60') {{(pid=74613) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 29 17:52:00 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:52:00 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74613) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 17:52:00 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74613) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 29 17:52:00 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:52:00 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '25ca628a-79b9-596f-b26e-8a8b27c7df4d', '_type': 'linux-noop'}}, row=False) {{(pid=74613) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 17:52:00 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:52:00 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 17:52:00 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:52:00 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapabe5d419-60, may_exist=True, interface_attrs={}) {{(pid=74613) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 17:52:00 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapabe5d419-60, col_values=(('qos', UUID('c3fabfe3-bfad-4b26-8945-e80f689cabf9')),), if_exists=True) {{(pid=74613) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 17:52:00 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapabe5d419-60, col_values=(('external_ids', {'iface-id': 'abe5d419-60cc-474c-935a-60f5512894e0', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:14:7b:54', 'vm-uuid': '288b8261-8706-4696-879d-d4dd01ab553e'}),), if_exists=True) {{(pid=74613) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 17:52:00 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:52:00 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-3088e3a8-2114-489e-9c16-32d5b64da4b3 tempest-ServerActionsV293TestJSON-169231013 tempest-ServerActionsV293TestJSON-169231013-project-member] Acquiring lock "8de2ffb3-e264-49f7-8581-6eae21adcaeb" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 17:52:00 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-3088e3a8-2114-489e-9c16-32d5b64da4b3 tempest-ServerActionsV293TestJSON-169231013 tempest-ServerActionsV293TestJSON-169231013-project-member] Lock "8de2ffb3-e264-49f7-8581-6eae21adcaeb" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.002s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 17:52:00 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 17:52:00 user nova-compute[74613]: INFO os_vif [None req-fa153cd0-d0ba-4e0d-a20b-86c28a59b05e tempest-TaggedAttachmentsTest-1438740121 tempest-TaggedAttachmentsTest-1438740121-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:14:7b:54,bridge_name='br-int',has_traffic_filtering=True,id=abe5d419-60cc-474c-935a-60f5512894e0,network=Network(3a1d6151-a950-475c-af8a-d15174f89822),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapabe5d419-60')
Nov 29 17:52:00 user nova-compute[74613]: DEBUG nova.compute.manager [None req-3088e3a8-2114-489e-9c16-32d5b64da4b3 tempest-ServerActionsV293TestJSON-169231013 tempest-ServerActionsV293TestJSON-169231013-project-member] [instance: 8de2ffb3-e264-49f7-8581-6eae21adcaeb] Starting instance... {{(pid=74613) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 29 17:52:00 user nova-compute[74613]: INFO nova.compute.manager [None req-4aa4794c-e959-4729-883a-7e95b2bf3385 tempest-TestVolumeSwap-281539251 tempest-TestVolumeSwap-281539251-project-member] [instance: 0008521b-5a63-4ff6-8390-d343956900ed] Took 8.80 seconds to spawn the instance on the hypervisor.
Nov 29 17:52:00 user nova-compute[74613]: DEBUG nova.compute.manager [None req-4aa4794c-e959-4729-883a-7e95b2bf3385 tempest-TestVolumeSwap-281539251 tempest-TestVolumeSwap-281539251-project-member] [instance: 0008521b-5a63-4ff6-8390-d343956900ed] Checking state {{(pid=74613) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 29 17:52:00 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-fa153cd0-d0ba-4e0d-a20b-86c28a59b05e tempest-TaggedAttachmentsTest-1438740121 tempest-TaggedAttachmentsTest-1438740121-project-member] No BDM found with device name vda, not building metadata. {{(pid=74613) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 17:52:00 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-fa153cd0-d0ba-4e0d-a20b-86c28a59b05e tempest-TaggedAttachmentsTest-1438740121 tempest-TaggedAttachmentsTest-1438740121-project-member] No BDM found with device name hda, not building metadata. {{(pid=74613) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 17:52:00 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-fa153cd0-d0ba-4e0d-a20b-86c28a59b05e tempest-TaggedAttachmentsTest-1438740121 tempest-TaggedAttachmentsTest-1438740121-project-member] No VIF found with MAC fa:16:3e:14:7b:54, not building metadata {{(pid=74613) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 29 17:52:00 user nova-compute[74613]: INFO nova.virt.libvirt.driver [None req-fa153cd0-d0ba-4e0d-a20b-86c28a59b05e tempest-TaggedAttachmentsTest-1438740121 tempest-TaggedAttachmentsTest-1438740121-project-member] [instance: 288b8261-8706-4696-879d-d4dd01ab553e] Using config drive
Nov 29 17:52:00 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-3088e3a8-2114-489e-9c16-32d5b64da4b3 tempest-ServerActionsV293TestJSON-169231013 tempest-ServerActionsV293TestJSON-169231013-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 17:52:00 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-3088e3a8-2114-489e-9c16-32d5b64da4b3 tempest-ServerActionsV293TestJSON-169231013 tempest-ServerActionsV293TestJSON-169231013-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 17:52:00 user nova-compute[74613]: DEBUG nova.virt.hardware [None req-3088e3a8-2114-489e-9c16-32d5b64da4b3 tempest-ServerActionsV293TestJSON-169231013 tempest-ServerActionsV293TestJSON-169231013-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74613) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 29 17:52:00 user nova-compute[74613]: INFO nova.compute.claims [None req-3088e3a8-2114-489e-9c16-32d5b64da4b3 tempest-ServerActionsV293TestJSON-169231013 tempest-ServerActionsV293TestJSON-169231013-project-member] [instance: 8de2ffb3-e264-49f7-8581-6eae21adcaeb] Claim successful on node user
Nov 29 17:52:00 user nova-compute[74613]: INFO nova.virt.libvirt.driver [None req-fa153cd0-d0ba-4e0d-a20b-86c28a59b05e tempest-TaggedAttachmentsTest-1438740121 tempest-TaggedAttachmentsTest-1438740121-project-member] [instance: 288b8261-8706-4696-879d-d4dd01ab553e] Creating config drive at /opt/stack/data/nova/instances/288b8261-8706-4696-879d-d4dd01ab553e/disk.config
Nov 29 17:52:00 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-fa153cd0-d0ba-4e0d-a20b-86c28a59b05e tempest-TaggedAttachmentsTest-1438740121 tempest-TaggedAttachmentsTest-1438740121-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/288b8261-8706-4696-879d-d4dd01ab553e/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmp3ooxo4nt {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 17:52:00 user nova-compute[74613]: INFO nova.compute.manager [None req-4aa4794c-e959-4729-883a-7e95b2bf3385 tempest-TestVolumeSwap-281539251 tempest-TestVolumeSwap-281539251-project-member] [instance: 0008521b-5a63-4ff6-8390-d343956900ed] Took 10.80 seconds to build instance.
Nov 29 17:52:00 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:52:00 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-fa153cd0-d0ba-4e0d-a20b-86c28a59b05e tempest-TaggedAttachmentsTest-1438740121 tempest-TaggedAttachmentsTest-1438740121-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/288b8261-8706-4696-879d-d4dd01ab553e/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmp3ooxo4nt" returned: 0 in 0.117s {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 17:52:01 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-4aa4794c-e959-4729-883a-7e95b2bf3385 tempest-TestVolumeSwap-281539251 tempest-TestVolumeSwap-281539251-project-member] Lock "0008521b-5a63-4ff6-8390-d343956900ed" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 11.098s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 17:52:01 user nova-compute[74613]: DEBUG nova.network.neutron [req-8112c155-634e-4d10-9e0e-bec4b97f8518 req-23b178da-d87a-4d88-ac09-8f65464f4a1f service nova] [instance: 288b8261-8706-4696-879d-d4dd01ab553e] Updated VIF entry in instance network info cache for port abe5d419-60cc-474c-935a-60f5512894e0. {{(pid=74613) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 17:52:01 user nova-compute[74613]: DEBUG nova.network.neutron [req-8112c155-634e-4d10-9e0e-bec4b97f8518 req-23b178da-d87a-4d88-ac09-8f65464f4a1f service nova] [instance: 288b8261-8706-4696-879d-d4dd01ab553e] Updating instance_info_cache with network_info: [{"id": "abe5d419-60cc-474c-935a-60f5512894e0", "address": "fa:16:3e:14:7b:54", "network": {"id": "3a1d6151-a950-475c-af8a-d15174f89822", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1729826224-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fdebfa0bb4bf45338ce3fa1ded5cd5bd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapabe5d419-60", "ovs_interfaceid": "abe5d419-60cc-474c-935a-60f5512894e0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74613) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 17:52:01 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-8112c155-634e-4d10-9e0e-bec4b97f8518 req-23b178da-d87a-4d88-ac09-8f65464f4a1f service nova] Releasing lock "refresh_cache-288b8261-8706-4696-879d-d4dd01ab553e" {{(pid=74613) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 17:52:01 user nova-compute[74613]: DEBUG nova.network.neutron [None req-d6c2deef-a275-4ada-bc8c-287f3c880266 tempest-VolumesAssistedSnapshotsTest-616484375 tempest-VolumesAssistedSnapshotsTest-616484375-project-member] [instance: d4ecef60-62f9-4969-b57f-3bb45a44cc9f] Successfully updated port: 292029d6-b062-4cdc-8c09-c92693cac658 {{(pid=74613) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 29 17:52:01 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-d6c2deef-a275-4ada-bc8c-287f3c880266 tempest-VolumesAssistedSnapshotsTest-616484375 tempest-VolumesAssistedSnapshotsTest-616484375-project-member] Acquiring lock "refresh_cache-d4ecef60-62f9-4969-b57f-3bb45a44cc9f" {{(pid=74613) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 17:52:01 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-d6c2deef-a275-4ada-bc8c-287f3c880266 tempest-VolumesAssistedSnapshotsTest-616484375 tempest-VolumesAssistedSnapshotsTest-616484375-project-member] Acquired lock "refresh_cache-d4ecef60-62f9-4969-b57f-3bb45a44cc9f" {{(pid=74613) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 17:52:01 user nova-compute[74613]: DEBUG nova.network.neutron [None req-d6c2deef-a275-4ada-bc8c-287f3c880266 tempest-VolumesAssistedSnapshotsTest-616484375 tempest-VolumesAssistedSnapshotsTest-616484375-project-member] [instance: d4ecef60-62f9-4969-b57f-3bb45a44cc9f] Building network info cache for instance {{(pid=74613) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 29 17:52:01 user nova-compute[74613]: DEBUG nova.compute.manager [req-0ec0fb0b-1021-4afc-9e3a-0bfa5e29460b req-c6a2e27a-77e2-4345-a695-b8eaca5f67aa service nova] [instance: d4ecef60-62f9-4969-b57f-3bb45a44cc9f] Received event network-changed-292029d6-b062-4cdc-8c09-c92693cac658 {{(pid=74613) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 17:52:01 user nova-compute[74613]: DEBUG nova.compute.manager [req-0ec0fb0b-1021-4afc-9e3a-0bfa5e29460b req-c6a2e27a-77e2-4345-a695-b8eaca5f67aa service nova] [instance: d4ecef60-62f9-4969-b57f-3bb45a44cc9f] Refreshing instance network info cache due to event network-changed-292029d6-b062-4cdc-8c09-c92693cac658. {{(pid=74613) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 17:52:01 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-0ec0fb0b-1021-4afc-9e3a-0bfa5e29460b req-c6a2e27a-77e2-4345-a695-b8eaca5f67aa service nova] Acquiring lock "refresh_cache-d4ecef60-62f9-4969-b57f-3bb45a44cc9f" {{(pid=74613) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 17:52:01 user nova-compute[74613]: DEBUG nova.compute.provider_tree [None req-3088e3a8-2114-489e-9c16-32d5b64da4b3 tempest-ServerActionsV293TestJSON-169231013 tempest-ServerActionsV293TestJSON-169231013-project-member] Inventory has not changed in ProviderTree for provider: 639d980e-3b12-44b1-b8f4-1812416fa4dd {{(pid=74613) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 17:52:01 user nova-compute[74613]: DEBUG nova.scheduler.client.report [None req-3088e3a8-2114-489e-9c16-32d5b64da4b3 tempest-ServerActionsV293TestJSON-169231013 tempest-ServerActionsV293TestJSON-169231013-project-member] Inventory has not changed for provider 639d980e-3b12-44b1-b8f4-1812416fa4dd based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74613) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 17:52:01 user nova-compute[74613]: DEBUG nova.network.neutron [None req-d6c2deef-a275-4ada-bc8c-287f3c880266 tempest-VolumesAssistedSnapshotsTest-616484375 tempest-VolumesAssistedSnapshotsTest-616484375-project-member] [instance: d4ecef60-62f9-4969-b57f-3bb45a44cc9f] Instance cache missing network info. {{(pid=74613) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 29 17:52:01 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-3088e3a8-2114-489e-9c16-32d5b64da4b3 tempest-ServerActionsV293TestJSON-169231013 tempest-ServerActionsV293TestJSON-169231013-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 1.158s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 17:52:01 user nova-compute[74613]: DEBUG nova.compute.manager [None req-3088e3a8-2114-489e-9c16-32d5b64da4b3 tempest-ServerActionsV293TestJSON-169231013 tempest-ServerActionsV293TestJSON-169231013-project-member] [instance: 8de2ffb3-e264-49f7-8581-6eae21adcaeb] Start building networks asynchronously for instance. {{(pid=74613) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 29 17:52:02 user nova-compute[74613]: DEBUG nova.compute.manager [None req-3088e3a8-2114-489e-9c16-32d5b64da4b3 tempest-ServerActionsV293TestJSON-169231013 tempest-ServerActionsV293TestJSON-169231013-project-member] [instance: 8de2ffb3-e264-49f7-8581-6eae21adcaeb] Allocating IP information in the background. {{(pid=74613) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 29 17:52:02 user nova-compute[74613]: DEBUG nova.network.neutron [None req-3088e3a8-2114-489e-9c16-32d5b64da4b3 tempest-ServerActionsV293TestJSON-169231013 tempest-ServerActionsV293TestJSON-169231013-project-member] [instance: 8de2ffb3-e264-49f7-8581-6eae21adcaeb] allocate_for_instance() {{(pid=74613) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 29 17:52:02 user nova-compute[74613]: INFO nova.virt.libvirt.driver [None req-3088e3a8-2114-489e-9c16-32d5b64da4b3 tempest-ServerActionsV293TestJSON-169231013 tempest-ServerActionsV293TestJSON-169231013-project-member] [instance: 8de2ffb3-e264-49f7-8581-6eae21adcaeb] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 29 17:52:02 user nova-compute[74613]: DEBUG nova.policy [None req-3088e3a8-2114-489e-9c16-32d5b64da4b3 tempest-ServerActionsV293TestJSON-169231013 tempest-ServerActionsV293TestJSON-169231013-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '1f67cfc0d0054244b74d7f1d64628db8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d9b3ae2eee040bb84ff5065d07552d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74613) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 29 17:52:02 user nova-compute[74613]: DEBUG nova.compute.manager [None req-3088e3a8-2114-489e-9c16-32d5b64da4b3 tempest-ServerActionsV293TestJSON-169231013 tempest-ServerActionsV293TestJSON-169231013-project-member] [instance: 8de2ffb3-e264-49f7-8581-6eae21adcaeb] Start building block device mappings for instance. {{(pid=74613) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 29 17:52:02 user nova-compute[74613]: DEBUG nova.network.neutron [None req-d6c2deef-a275-4ada-bc8c-287f3c880266 tempest-VolumesAssistedSnapshotsTest-616484375 tempest-VolumesAssistedSnapshotsTest-616484375-project-member] [instance: d4ecef60-62f9-4969-b57f-3bb45a44cc9f] Updating instance_info_cache with network_info: [{"id": "292029d6-b062-4cdc-8c09-c92693cac658", "address": "fa:16:3e:a5:be:95", "network": {"id": "3be4f180-3b53-4069-9ab2-94b1a948986b", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-170006881-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6469439fcd88494f85d31126651f3027", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap292029d6-b0", "ovs_interfaceid": "292029d6-b062-4cdc-8c09-c92693cac658", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74613) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 17:52:02 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-d6c2deef-a275-4ada-bc8c-287f3c880266 tempest-VolumesAssistedSnapshotsTest-616484375 tempest-VolumesAssistedSnapshotsTest-616484375-project-member] Releasing lock "refresh_cache-d4ecef60-62f9-4969-b57f-3bb45a44cc9f" {{(pid=74613) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 17:52:02 user nova-compute[74613]: DEBUG nova.compute.manager [None req-d6c2deef-a275-4ada-bc8c-287f3c880266 tempest-VolumesAssistedSnapshotsTest-616484375 tempest-VolumesAssistedSnapshotsTest-616484375-project-member] [instance: d4ecef60-62f9-4969-b57f-3bb45a44cc9f] Instance network_info: |[{"id": "292029d6-b062-4cdc-8c09-c92693cac658", "address": "fa:16:3e:a5:be:95", "network": {"id": "3be4f180-3b53-4069-9ab2-94b1a948986b", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-170006881-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6469439fcd88494f85d31126651f3027", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap292029d6-b0", "ovs_interfaceid": "292029d6-b062-4cdc-8c09-c92693cac658", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74613) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 29 17:52:02 user nova-compute[74613]: INFO nova.virt.block_device [None req-3088e3a8-2114-489e-9c16-32d5b64da4b3 tempest-ServerActionsV293TestJSON-169231013 tempest-ServerActionsV293TestJSON-169231013-project-member] [instance: 8de2ffb3-e264-49f7-8581-6eae21adcaeb] Booting with volume fbbdc3d2-136d-4fba-b6ba-f27f35a0733b at /dev/vda
Nov 29 17:52:02 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-0ec0fb0b-1021-4afc-9e3a-0bfa5e29460b req-c6a2e27a-77e2-4345-a695-b8eaca5f67aa service nova] Acquired lock "refresh_cache-d4ecef60-62f9-4969-b57f-3bb45a44cc9f" {{(pid=74613) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 17:52:02 user nova-compute[74613]: DEBUG nova.network.neutron [req-0ec0fb0b-1021-4afc-9e3a-0bfa5e29460b req-c6a2e27a-77e2-4345-a695-b8eaca5f67aa service nova] [instance: d4ecef60-62f9-4969-b57f-3bb45a44cc9f] Refreshing network info cache for port 292029d6-b062-4cdc-8c09-c92693cac658 {{(pid=74613) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 17:52:02 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-d6c2deef-a275-4ada-bc8c-287f3c880266 tempest-VolumesAssistedSnapshotsTest-616484375 tempest-VolumesAssistedSnapshotsTest-616484375-project-member] [instance: d4ecef60-62f9-4969-b57f-3bb45a44cc9f] Start _get_guest_xml network_info=[{"id": "292029d6-b062-4cdc-8c09-c92693cac658", "address": "fa:16:3e:a5:be:95", "network": {"id": "3be4f180-3b53-4069-9ab2-94b1a948986b", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-170006881-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6469439fcd88494f85d31126651f3027", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap292029d6-b0", "ovs_interfaceid": "292029d6-b062-4cdc-8c09-c92693cac658", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-29T17:47:38Z,direct_url=<?>,disk_format='qcow2',id=4217f428-8d9d-4ee1-9614-642d26d90c46,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='794b07cbd46a44b5865cfda741036bae',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-29T17:47:40Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'size': 0, 'device_type': 'disk', 'boot_index': 0, 'guest_format': None, 'encrypted': False, 'encryption_format': None, 'disk_bus': 'virtio', 'image_id': '4217f428-8d9d-4ee1-9614-642d26d90c46'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74613) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 29 17:52:02 user nova-compute[74613]: WARNING nova.virt.libvirt.driver [None req-d6c2deef-a275-4ada-bc8c-287f3c880266 tempest-VolumesAssistedSnapshotsTest-616484375 tempest-VolumesAssistedSnapshotsTest-616484375-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 17:52:02 user nova-compute[74613]: WARNING nova.virt.libvirt.driver [None req-d6c2deef-a275-4ada-bc8c-287f3c880266 tempest-VolumesAssistedSnapshotsTest-616484375 tempest-VolumesAssistedSnapshotsTest-616484375-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 17:52:02 user nova-compute[74613]: DEBUG nova.virt.libvirt.host [None req-d6c2deef-a275-4ada-bc8c-287f3c880266 tempest-VolumesAssistedSnapshotsTest-616484375 tempest-VolumesAssistedSnapshotsTest-616484375-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74613) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 29 17:52:02 user nova-compute[74613]: DEBUG nova.virt.libvirt.host [None req-d6c2deef-a275-4ada-bc8c-287f3c880266 tempest-VolumesAssistedSnapshotsTest-616484375 tempest-VolumesAssistedSnapshotsTest-616484375-project-member] CPU controller missing on host. {{(pid=74613) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 29 17:52:02 user nova-compute[74613]: DEBUG nova.virt.libvirt.host [None req-d6c2deef-a275-4ada-bc8c-287f3c880266 tempest-VolumesAssistedSnapshotsTest-616484375 tempest-VolumesAssistedSnapshotsTest-616484375-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74613) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 29 17:52:02 user nova-compute[74613]: DEBUG nova.virt.libvirt.host [None req-d6c2deef-a275-4ada-bc8c-287f3c880266 tempest-VolumesAssistedSnapshotsTest-616484375 tempest-VolumesAssistedSnapshotsTest-616484375-project-member] CPU controller found on host. {{(pid=74613) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 29 17:52:02 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-d6c2deef-a275-4ada-bc8c-287f3c880266 tempest-VolumesAssistedSnapshotsTest-616484375 tempest-VolumesAssistedSnapshotsTest-616484375-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74613) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 29 17:52:02 user nova-compute[74613]: DEBUG nova.virt.hardware [None req-d6c2deef-a275-4ada-bc8c-287f3c880266 tempest-VolumesAssistedSnapshotsTest-616484375 tempest-VolumesAssistedSnapshotsTest-616484375-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-29T17:47:27Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-29T17:47:38Z,direct_url=<?>,disk_format='qcow2',id=4217f428-8d9d-4ee1-9614-642d26d90c46,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='794b07cbd46a44b5865cfda741036bae',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-29T17:47:40Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74613) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 29 17:52:02 user nova-compute[74613]: DEBUG nova.virt.hardware [None req-d6c2deef-a275-4ada-bc8c-287f3c880266 tempest-VolumesAssistedSnapshotsTest-616484375 tempest-VolumesAssistedSnapshotsTest-616484375-project-member] Flavor limits 0:0:0 {{(pid=74613) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 29 17:52:02 user nova-compute[74613]: DEBUG nova.virt.hardware [None req-d6c2deef-a275-4ada-bc8c-287f3c880266 tempest-VolumesAssistedSnapshotsTest-616484375 tempest-VolumesAssistedSnapshotsTest-616484375-project-member] Image limits 0:0:0 {{(pid=74613) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 29 17:52:02 user nova-compute[74613]: DEBUG nova.virt.hardware [None req-d6c2deef-a275-4ada-bc8c-287f3c880266 tempest-VolumesAssistedSnapshotsTest-616484375 tempest-VolumesAssistedSnapshotsTest-616484375-project-member] Flavor pref 0:0:0 {{(pid=74613) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 29 17:52:02 user nova-compute[74613]: DEBUG nova.virt.hardware [None req-d6c2deef-a275-4ada-bc8c-287f3c880266 tempest-VolumesAssistedSnapshotsTest-616484375 tempest-VolumesAssistedSnapshotsTest-616484375-project-member] Image pref 0:0:0 {{(pid=74613) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 29 17:52:02 user nova-compute[74613]: DEBUG nova.virt.hardware [None req-d6c2deef-a275-4ada-bc8c-287f3c880266 tempest-VolumesAssistedSnapshotsTest-616484375 tempest-VolumesAssistedSnapshotsTest-616484375-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74613) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 29 17:52:02 user nova-compute[74613]: DEBUG nova.virt.hardware [None req-d6c2deef-a275-4ada-bc8c-287f3c880266 tempest-VolumesAssistedSnapshotsTest-616484375 tempest-VolumesAssistedSnapshotsTest-616484375-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74613) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 29 17:52:02 user nova-compute[74613]: DEBUG nova.virt.hardware [None req-d6c2deef-a275-4ada-bc8c-287f3c880266 tempest-VolumesAssistedSnapshotsTest-616484375 tempest-VolumesAssistedSnapshotsTest-616484375-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74613) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 29 17:52:02 user nova-compute[74613]: DEBUG nova.virt.hardware [None req-d6c2deef-a275-4ada-bc8c-287f3c880266 tempest-VolumesAssistedSnapshotsTest-616484375 tempest-VolumesAssistedSnapshotsTest-616484375-project-member] Got 1 possible topologies {{(pid=74613) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 29 17:52:02 user nova-compute[74613]: DEBUG nova.virt.hardware [None req-d6c2deef-a275-4ada-bc8c-287f3c880266 tempest-VolumesAssistedSnapshotsTest-616484375 tempest-VolumesAssistedSnapshotsTest-616484375-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74613) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 29 17:52:02 user nova-compute[74613]: DEBUG nova.virt.hardware [None req-d6c2deef-a275-4ada-bc8c-287f3c880266 tempest-VolumesAssistedSnapshotsTest-616484375 tempest-VolumesAssistedSnapshotsTest-616484375-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74613) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 29 17:52:02 user nova-compute[74613]: DEBUG nova.virt.libvirt.vif [None req-d6c2deef-a275-4ada-bc8c-287f3c880266 tempest-VolumesAssistedSnapshotsTest-616484375 tempest-VolumesAssistedSnapshotsTest-616484375-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T17:51:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAssistedSnapshotsTest-server-566809274',display_name='tempest-VolumesAssistedSnapshotsTest-server-566809274',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesassistedsnapshotstest-server-566809274',id=9,image_ref='4217f428-8d9d-4ee1-9614-642d26d90c46',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGqz6XROenUx3qQ8c2wjczUYDD8SPR5dk/9dNMybAm8csJc//z+dpa2N3K2dk+tRO0hnwjqUL/gm8XfiYIEdUQHCOpEcfW6ssTF3vUBJtxGuqzGHJKmBRH65HQL41kvUiA==',key_name='tempest-keypair-1821142204',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6469439fcd88494f85d31126651f3027',ramdisk_id='',reservation_id='r-s969n20y',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='4217f428-8d9d-4ee1-9614-642d26d90c46',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAssistedSnapshotsTest-616484375',owner_user_name='tempest-VolumesAssistedSnapshotsTest-616484375-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T17:51:58Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='86cabe02b8334bc8b693f0337a602b01',uuid=d4ecef60-62f9-4969-b57f-3bb45a44cc9f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "292029d6-b062-4cdc-8c09-c92693cac658", "address": "fa:16:3e:a5:be:95", "network": {"id": "3be4f180-3b53-4069-9ab2-94b1a948986b", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-170006881-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6469439fcd88494f85d31126651f3027", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap292029d6-b0", "ovs_interfaceid": "292029d6-b062-4cdc-8c09-c92693cac658", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74613) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 29 17:52:02 user nova-compute[74613]: DEBUG nova.network.os_vif_util [None req-d6c2deef-a275-4ada-bc8c-287f3c880266 tempest-VolumesAssistedSnapshotsTest-616484375 tempest-VolumesAssistedSnapshotsTest-616484375-project-member] Converting VIF {"id": "292029d6-b062-4cdc-8c09-c92693cac658", "address": "fa:16:3e:a5:be:95", "network": {"id": "3be4f180-3b53-4069-9ab2-94b1a948986b", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-170006881-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6469439fcd88494f85d31126651f3027", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap292029d6-b0", "ovs_interfaceid": "292029d6-b062-4cdc-8c09-c92693cac658", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74613) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 17:52:02 user nova-compute[74613]: DEBUG nova.network.os_vif_util [None req-d6c2deef-a275-4ada-bc8c-287f3c880266 tempest-VolumesAssistedSnapshotsTest-616484375 tempest-VolumesAssistedSnapshotsTest-616484375-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a5:be:95,bridge_name='br-int',has_traffic_filtering=True,id=292029d6-b062-4cdc-8c09-c92693cac658,network=Network(3be4f180-3b53-4069-9ab2-94b1a948986b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap292029d6-b0') {{(pid=74613) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 17:52:02 user nova-compute[74613]: DEBUG nova.objects.instance [None req-d6c2deef-a275-4ada-bc8c-287f3c880266 tempest-VolumesAssistedSnapshotsTest-616484375 tempest-VolumesAssistedSnapshotsTest-616484375-project-member] Lazy-loading 'pci_devices' on Instance uuid d4ecef60-62f9-4969-b57f-3bb45a44cc9f {{(pid=74613) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 17:52:02 user nova-compute[74613]: DEBUG os_brick.utils [None req-3088e3a8-2114-489e-9c16-32d5b64da4b3 tempest-ServerActionsV293TestJSON-169231013 tempest-ServerActionsV293TestJSON-169231013-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74613) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 17:52:02 user nova-compute[74613]: INFO oslo.privsep.daemon [None req-3088e3a8-2114-489e-9c16-32d5b64da4b3 tempest-ServerActionsV293TestJSON-169231013 tempest-ServerActionsV293TestJSON-169231013-project-member] Running privsep helper: ['sudo', 'nova-rootwrap', '/etc/nova/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/nova/nova-cpu.conf', '--privsep_context', 'os_brick.privileged.default', '--privsep_sock_path', '/tmp/tmp1u_rghss/privsep.sock']
Nov 29 17:52:02 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-d6c2deef-a275-4ada-bc8c-287f3c880266 tempest-VolumesAssistedSnapshotsTest-616484375 tempest-VolumesAssistedSnapshotsTest-616484375-project-member] [instance: d4ecef60-62f9-4969-b57f-3bb45a44cc9f] End _get_guest_xml xml=<domain type="kvm">
Nov 29 17:52:02 user nova-compute[74613]:   <uuid>d4ecef60-62f9-4969-b57f-3bb45a44cc9f</uuid>
Nov 29 17:52:02 user nova-compute[74613]:   <name>instance-00000009</name>
Nov 29 17:52:02 user nova-compute[74613]:   <memory>524288</memory>
Nov 29 17:52:02 user nova-compute[74613]:   <vcpu>1</vcpu>
Nov 29 17:52:02 user nova-compute[74613]:   <metadata>
Nov 29 17:52:02 user nova-compute[74613]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 29 17:52:02 user nova-compute[74613]:       <nova:package version="0.0.0"/>
Nov 29 17:52:02 user nova-compute[74613]:       <nova:name>tempest-VolumesAssistedSnapshotsTest-server-566809274</nova:name>
Nov 29 17:52:02 user nova-compute[74613]:       <nova:creationTime>2023-11-29 17:52:02</nova:creationTime>
Nov 29 17:52:02 user nova-compute[74613]:       <nova:flavor name="m1.tiny">
Nov 29 17:52:02 user nova-compute[74613]:         <nova:memory>512</nova:memory>
Nov 29 17:52:02 user nova-compute[74613]:         <nova:disk>1</nova:disk>
Nov 29 17:52:02 user nova-compute[74613]:         <nova:swap>0</nova:swap>
Nov 29 17:52:02 user nova-compute[74613]:         <nova:ephemeral>0</nova:ephemeral>
Nov 29 17:52:02 user nova-compute[74613]:         <nova:vcpus>1</nova:vcpus>
Nov 29 17:52:02 user nova-compute[74613]:       </nova:flavor>
Nov 29 17:52:02 user nova-compute[74613]:       <nova:owner>
Nov 29 17:52:02 user nova-compute[74613]:         <nova:user uuid="86cabe02b8334bc8b693f0337a602b01">tempest-VolumesAssistedSnapshotsTest-616484375-project-member</nova:user>
Nov 29 17:52:02 user nova-compute[74613]:         <nova:project uuid="6469439fcd88494f85d31126651f3027">tempest-VolumesAssistedSnapshotsTest-616484375</nova:project>
Nov 29 17:52:02 user nova-compute[74613]:       </nova:owner>
Nov 29 17:52:02 user nova-compute[74613]:       <nova:root type="image" uuid="4217f428-8d9d-4ee1-9614-642d26d90c46"/>
Nov 29 17:52:02 user nova-compute[74613]:       <nova:ports>
Nov 29 17:52:02 user nova-compute[74613]:         <nova:port uuid="292029d6-b062-4cdc-8c09-c92693cac658">
Nov 29 17:52:02 user nova-compute[74613]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Nov 29 17:52:02 user nova-compute[74613]:         </nova:port>
Nov 29 17:52:02 user nova-compute[74613]:       </nova:ports>
Nov 29 17:52:02 user nova-compute[74613]:     </nova:instance>
Nov 29 17:52:02 user nova-compute[74613]:   </metadata>
Nov 29 17:52:02 user nova-compute[74613]:   <sysinfo type="smbios">
Nov 29 17:52:02 user nova-compute[74613]:     <system>
Nov 29 17:52:02 user nova-compute[74613]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 29 17:52:02 user nova-compute[74613]:       <entry name="product">OpenStack Nova</entry>
Nov 29 17:52:02 user nova-compute[74613]:       <entry name="version">0.0.0</entry>
Nov 29 17:52:02 user nova-compute[74613]:       <entry name="serial">d4ecef60-62f9-4969-b57f-3bb45a44cc9f</entry>
Nov 29 17:52:02 user nova-compute[74613]:       <entry name="uuid">d4ecef60-62f9-4969-b57f-3bb45a44cc9f</entry>
Nov 29 17:52:02 user nova-compute[74613]:       <entry name="family">Virtual Machine</entry>
Nov 29 17:52:02 user nova-compute[74613]:     </system>
Nov 29 17:52:02 user nova-compute[74613]:   </sysinfo>
Nov 29 17:52:02 user nova-compute[74613]:   <os>
Nov 29 17:52:02 user nova-compute[74613]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 29 17:52:02 user nova-compute[74613]:     <boot dev="hd"/>
Nov 29 17:52:02 user nova-compute[74613]:     <smbios mode="sysinfo"/>
Nov 29 17:52:02 user nova-compute[74613]:   </os>
Nov 29 17:52:02 user nova-compute[74613]:   <features>
Nov 29 17:52:02 user nova-compute[74613]:     <acpi/>
Nov 29 17:52:02 user nova-compute[74613]:     <apic/>
Nov 29 17:52:02 user nova-compute[74613]:     <vmcoreinfo/>
Nov 29 17:52:02 user nova-compute[74613]:   </features>
Nov 29 17:52:02 user nova-compute[74613]:   <clock offset="utc">
Nov 29 17:52:02 user nova-compute[74613]:     <timer name="pit" tickpolicy="delay"/>
Nov 29 17:52:02 user nova-compute[74613]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 29 17:52:02 user nova-compute[74613]:     <timer name="hpet" present="no"/>
Nov 29 17:52:02 user nova-compute[74613]:   </clock>
Nov 29 17:52:02 user nova-compute[74613]:   <cpu mode="custom" match="exact">
Nov 29 17:52:02 user nova-compute[74613]:     <model>Nehalem</model>
Nov 29 17:52:02 user nova-compute[74613]:     <topology sockets="1" cores="1" threads="1"/>
Nov 29 17:52:02 user nova-compute[74613]:   </cpu>
Nov 29 17:52:02 user nova-compute[74613]:   <devices>
Nov 29 17:52:02 user nova-compute[74613]:     <disk type="file" device="disk">
Nov 29 17:52:02 user nova-compute[74613]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 29 17:52:02 user nova-compute[74613]:       <source file="/opt/stack/data/nova/instances/d4ecef60-62f9-4969-b57f-3bb45a44cc9f/disk"/>
Nov 29 17:52:02 user nova-compute[74613]:       <target dev="vda" bus="virtio"/>
Nov 29 17:52:02 user nova-compute[74613]:     </disk>
Nov 29 17:52:02 user nova-compute[74613]:     <interface type="ethernet">
Nov 29 17:52:02 user nova-compute[74613]:       <mac address="fa:16:3e:a5:be:95"/>
Nov 29 17:52:02 user nova-compute[74613]:       <model type="virtio"/>
Nov 29 17:52:02 user nova-compute[74613]:       <mtu size="1442"/>
Nov 29 17:52:02 user nova-compute[74613]:       <target dev="tap292029d6-b0"/>
Nov 29 17:52:02 user nova-compute[74613]:     </interface>
Nov 29 17:52:02 user nova-compute[74613]:     <serial type="pty">
Nov 29 17:52:02 user nova-compute[74613]:       <log file="/opt/stack/data/nova/instances/d4ecef60-62f9-4969-b57f-3bb45a44cc9f/console.log" append="off"/>
Nov 29 17:52:02 user nova-compute[74613]:     </serial>
Nov 29 17:52:02 user nova-compute[74613]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 29 17:52:02 user nova-compute[74613]:     <video>
Nov 29 17:52:02 user nova-compute[74613]:       <model type="virtio"/>
Nov 29 17:52:02 user nova-compute[74613]:     </video>
Nov 29 17:52:02 user nova-compute[74613]:     <rng model="virtio">
Nov 29 17:52:02 user nova-compute[74613]:       <backend model="random">/dev/urandom</backend>
Nov 29 17:52:02 user nova-compute[74613]:     </rng>
Nov 29 17:52:02 user nova-compute[74613]:     <controller type="usb" index="0" model="none"/>
Nov 29 17:52:02 user nova-compute[74613]:     <memballoon model="virtio">
Nov 29 17:52:02 user nova-compute[74613]:       <stats period="10"/>
Nov 29 17:52:02 user nova-compute[74613]:     </memballoon>
Nov 29 17:52:02 user nova-compute[74613]:   </devices>
Nov 29 17:52:02 user nova-compute[74613]: </domain>
Nov 29 17:52:02 user nova-compute[74613]:  {{(pid=74613) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 29 17:52:02 user nova-compute[74613]: DEBUG nova.virt.libvirt.vif [None req-d6c2deef-a275-4ada-bc8c-287f3c880266 tempest-VolumesAssistedSnapshotsTest-616484375 tempest-VolumesAssistedSnapshotsTest-616484375-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T17:51:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAssistedSnapshotsTest-server-566809274',display_name='tempest-VolumesAssistedSnapshotsTest-server-566809274',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesassistedsnapshotstest-server-566809274',id=9,image_ref='4217f428-8d9d-4ee1-9614-642d26d90c46',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGqz6XROenUx3qQ8c2wjczUYDD8SPR5dk/9dNMybAm8csJc//z+dpa2N3K2dk+tRO0hnwjqUL/gm8XfiYIEdUQHCOpEcfW6ssTF3vUBJtxGuqzGHJKmBRH65HQL41kvUiA==',key_name='tempest-keypair-1821142204',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6469439fcd88494f85d31126651f3027',ramdisk_id='',reservation_id='r-s969n20y',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='4217f428-8d9d-4ee1-9614-642d26d90c46',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAssistedSnapshotsTest-616484375',owner_user_name='tempest-VolumesAssistedSnapshotsTest-616484375-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T17:51:58Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='86cabe02b8334bc8b693f0337a602b01',uuid=d4ecef60-62f9-4969-b57f-3bb45a44cc9f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "292029d6-b062-4cdc-8c09-c92693cac658", "address": "fa:16:3e:a5:be:95", "network": {"id": "3be4f180-3b53-4069-9ab2-94b1a948986b", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-170006881-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6469439fcd88494f85d31126651f3027", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap292029d6-b0", "ovs_interfaceid": "292029d6-b062-4cdc-8c09-c92693cac658", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74613) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 29 17:52:02 user nova-compute[74613]: DEBUG nova.network.os_vif_util [None req-d6c2deef-a275-4ada-bc8c-287f3c880266 tempest-VolumesAssistedSnapshotsTest-616484375 tempest-VolumesAssistedSnapshotsTest-616484375-project-member] Converting VIF {"id": "292029d6-b062-4cdc-8c09-c92693cac658", "address": "fa:16:3e:a5:be:95", "network": {"id": "3be4f180-3b53-4069-9ab2-94b1a948986b", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-170006881-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6469439fcd88494f85d31126651f3027", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap292029d6-b0", "ovs_interfaceid": "292029d6-b062-4cdc-8c09-c92693cac658", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74613) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 17:52:02 user nova-compute[74613]: DEBUG nova.network.os_vif_util [None req-d6c2deef-a275-4ada-bc8c-287f3c880266 tempest-VolumesAssistedSnapshotsTest-616484375 tempest-VolumesAssistedSnapshotsTest-616484375-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a5:be:95,bridge_name='br-int',has_traffic_filtering=True,id=292029d6-b062-4cdc-8c09-c92693cac658,network=Network(3be4f180-3b53-4069-9ab2-94b1a948986b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap292029d6-b0') {{(pid=74613) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 17:52:02 user nova-compute[74613]: DEBUG os_vif [None req-d6c2deef-a275-4ada-bc8c-287f3c880266 tempest-VolumesAssistedSnapshotsTest-616484375 tempest-VolumesAssistedSnapshotsTest-616484375-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a5:be:95,bridge_name='br-int',has_traffic_filtering=True,id=292029d6-b062-4cdc-8c09-c92693cac658,network=Network(3be4f180-3b53-4069-9ab2-94b1a948986b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap292029d6-b0') {{(pid=74613) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 29 17:52:02 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:52:02 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74613) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 17:52:02 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74613) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 29 17:52:02 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:52:02 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'ce205dab-a264-5825-9f66-5071b3819567', '_type': 'linux-noop'}}, row=False) {{(pid=74613) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 17:52:02 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:52:02 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 17:52:02 user sudo[85201]:    stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/nova-rootwrap /etc/nova/rootwrap.conf privsep-helper --config-file /etc/nova/nova-cpu.conf --privsep_context os_brick.privileged.default --privsep_sock_path /tmp/tmp1u_rghss/privsep.sock
Nov 29 17:52:02 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:52:02 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:52:02 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap292029d6-b0, may_exist=True, interface_attrs={}) {{(pid=74613) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 17:52:02 user sudo[85201]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1001)
Nov 29 17:52:02 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap292029d6-b0, col_values=(('qos', UUID('c35d1c16-892e-4730-a1f5-739dd0517dba')),), if_exists=True) {{(pid=74613) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 17:52:02 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap292029d6-b0, col_values=(('external_ids', {'iface-id': '292029d6-b062-4cdc-8c09-c92693cac658', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:a5:be:95', 'vm-uuid': 'd4ecef60-62f9-4969-b57f-3bb45a44cc9f'}),), if_exists=True) {{(pid=74613) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 17:52:02 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:52:02 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 17:52:02 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:52:02 user nova-compute[74613]: INFO os_vif [None req-d6c2deef-a275-4ada-bc8c-287f3c880266 tempest-VolumesAssistedSnapshotsTest-616484375 tempest-VolumesAssistedSnapshotsTest-616484375-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a5:be:95,bridge_name='br-int',has_traffic_filtering=True,id=292029d6-b062-4cdc-8c09-c92693cac658,network=Network(3be4f180-3b53-4069-9ab2-94b1a948986b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap292029d6-b0')
Nov 29 17:52:02 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:52:02 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:52:03 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-d6c2deef-a275-4ada-bc8c-287f3c880266 tempest-VolumesAssistedSnapshotsTest-616484375 tempest-VolumesAssistedSnapshotsTest-616484375-project-member] No BDM found with device name vda, not building metadata. {{(pid=74613) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 17:52:03 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-d6c2deef-a275-4ada-bc8c-287f3c880266 tempest-VolumesAssistedSnapshotsTest-616484375 tempest-VolumesAssistedSnapshotsTest-616484375-project-member] No VIF found with MAC fa:16:3e:a5:be:95, not building metadata {{(pid=74613) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 29 17:52:03 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:52:03 user nova-compute[74613]: DEBUG nova.network.neutron [req-0ec0fb0b-1021-4afc-9e3a-0bfa5e29460b req-c6a2e27a-77e2-4345-a695-b8eaca5f67aa service nova] [instance: d4ecef60-62f9-4969-b57f-3bb45a44cc9f] Updated VIF entry in instance network info cache for port 292029d6-b062-4cdc-8c09-c92693cac658. {{(pid=74613) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 17:52:03 user nova-compute[74613]: DEBUG nova.network.neutron [req-0ec0fb0b-1021-4afc-9e3a-0bfa5e29460b req-c6a2e27a-77e2-4345-a695-b8eaca5f67aa service nova] [instance: d4ecef60-62f9-4969-b57f-3bb45a44cc9f] Updating instance_info_cache with network_info: [{"id": "292029d6-b062-4cdc-8c09-c92693cac658", "address": "fa:16:3e:a5:be:95", "network": {"id": "3be4f180-3b53-4069-9ab2-94b1a948986b", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-170006881-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6469439fcd88494f85d31126651f3027", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap292029d6-b0", "ovs_interfaceid": "292029d6-b062-4cdc-8c09-c92693cac658", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74613) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 17:52:03 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-0ec0fb0b-1021-4afc-9e3a-0bfa5e29460b req-c6a2e27a-77e2-4345-a695-b8eaca5f67aa service nova] Releasing lock "refresh_cache-d4ecef60-62f9-4969-b57f-3bb45a44cc9f" {{(pid=74613) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 17:52:03 user nova-compute[74613]: DEBUG nova.network.neutron [None req-3088e3a8-2114-489e-9c16-32d5b64da4b3 tempest-ServerActionsV293TestJSON-169231013 tempest-ServerActionsV293TestJSON-169231013-project-member] [instance: 8de2ffb3-e264-49f7-8581-6eae21adcaeb] Successfully created port: 51faf82e-9447-4f14-8724-e7939afb4d98 {{(pid=74613) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 29 17:52:03 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:52:03 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:52:03 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:52:03 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:52:03 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:52:04 user nova-compute[74613]: DEBUG nova.network.neutron [None req-3088e3a8-2114-489e-9c16-32d5b64da4b3 tempest-ServerActionsV293TestJSON-169231013 tempest-ServerActionsV293TestJSON-169231013-project-member] [instance: 8de2ffb3-e264-49f7-8581-6eae21adcaeb] Successfully updated port: 51faf82e-9447-4f14-8724-e7939afb4d98 {{(pid=74613) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 29 17:52:04 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-3088e3a8-2114-489e-9c16-32d5b64da4b3 tempest-ServerActionsV293TestJSON-169231013 tempest-ServerActionsV293TestJSON-169231013-project-member] Acquiring lock "refresh_cache-8de2ffb3-e264-49f7-8581-6eae21adcaeb" {{(pid=74613) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 17:52:04 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-3088e3a8-2114-489e-9c16-32d5b64da4b3 tempest-ServerActionsV293TestJSON-169231013 tempest-ServerActionsV293TestJSON-169231013-project-member] Acquired lock "refresh_cache-8de2ffb3-e264-49f7-8581-6eae21adcaeb" {{(pid=74613) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 17:52:04 user nova-compute[74613]: DEBUG nova.network.neutron [None req-3088e3a8-2114-489e-9c16-32d5b64da4b3 tempest-ServerActionsV293TestJSON-169231013 tempest-ServerActionsV293TestJSON-169231013-project-member] [instance: 8de2ffb3-e264-49f7-8581-6eae21adcaeb] Building network info cache for instance {{(pid=74613) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 29 17:52:04 user nova-compute[74613]: DEBUG nova.compute.manager [req-b11a0785-8421-4f45-aec6-ea4fb3ed67dc req-10421202-cb33-4870-997c-8d93a35b888b service nova] [instance: 8de2ffb3-e264-49f7-8581-6eae21adcaeb] Received event network-changed-51faf82e-9447-4f14-8724-e7939afb4d98 {{(pid=74613) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 17:52:04 user nova-compute[74613]: DEBUG nova.compute.manager [req-b11a0785-8421-4f45-aec6-ea4fb3ed67dc req-10421202-cb33-4870-997c-8d93a35b888b service nova] [instance: 8de2ffb3-e264-49f7-8581-6eae21adcaeb] Refreshing instance network info cache due to event network-changed-51faf82e-9447-4f14-8724-e7939afb4d98. {{(pid=74613) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 17:52:04 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-b11a0785-8421-4f45-aec6-ea4fb3ed67dc req-10421202-cb33-4870-997c-8d93a35b888b service nova] Acquiring lock "refresh_cache-8de2ffb3-e264-49f7-8581-6eae21adcaeb" {{(pid=74613) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 17:52:04 user nova-compute[74613]: DEBUG nova.network.neutron [None req-3088e3a8-2114-489e-9c16-32d5b64da4b3 tempest-ServerActionsV293TestJSON-169231013 tempest-ServerActionsV293TestJSON-169231013-project-member] [instance: 8de2ffb3-e264-49f7-8581-6eae21adcaeb] Instance cache missing network info. {{(pid=74613) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 29 17:52:04 user sudo[85201]: pam_unix(sudo:session): session closed for user root
Nov 29 17:52:04 user nova-compute[74613]: INFO oslo.privsep.daemon [None req-3088e3a8-2114-489e-9c16-32d5b64da4b3 tempest-ServerActionsV293TestJSON-169231013 tempest-ServerActionsV293TestJSON-169231013-project-member] Spawned new privsep daemon via rootwrap
Nov 29 17:52:04 user nova-compute[74613]: INFO oslo.privsep.daemon [-] privsep daemon starting
Nov 29 17:52:04 user nova-compute[74613]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0
Nov 29 17:52:04 user nova-compute[74613]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_SYS_ADMIN/CAP_SYS_ADMIN/none
Nov 29 17:52:04 user nova-compute[74613]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 85376
Nov 29 17:52:04 user nova-compute[74613]: DEBUG nova.network.neutron [None req-3088e3a8-2114-489e-9c16-32d5b64da4b3 tempest-ServerActionsV293TestJSON-169231013 tempest-ServerActionsV293TestJSON-169231013-project-member] [instance: 8de2ffb3-e264-49f7-8581-6eae21adcaeb] Updating instance_info_cache with network_info: [{"id": "51faf82e-9447-4f14-8724-e7939afb4d98", "address": "fa:16:3e:97:b9:00", "network": {"id": "59f09b07-14df-494d-bb8f-3b5d4a7b9711", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-981004620-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8d9b3ae2eee040bb84ff5065d07552d4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap51faf82e-94", "ovs_interfaceid": "51faf82e-9447-4f14-8724-e7939afb4d98", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74613) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 17:52:04 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-3088e3a8-2114-489e-9c16-32d5b64da4b3 tempest-ServerActionsV293TestJSON-169231013 tempest-ServerActionsV293TestJSON-169231013-project-member] Releasing lock "refresh_cache-8de2ffb3-e264-49f7-8581-6eae21adcaeb" {{(pid=74613) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 17:52:04 user nova-compute[74613]: DEBUG nova.compute.manager [None req-3088e3a8-2114-489e-9c16-32d5b64da4b3 tempest-ServerActionsV293TestJSON-169231013 tempest-ServerActionsV293TestJSON-169231013-project-member] [instance: 8de2ffb3-e264-49f7-8581-6eae21adcaeb] Instance network_info: |[{"id": "51faf82e-9447-4f14-8724-e7939afb4d98", "address": "fa:16:3e:97:b9:00", "network": {"id": "59f09b07-14df-494d-bb8f-3b5d4a7b9711", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-981004620-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8d9b3ae2eee040bb84ff5065d07552d4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap51faf82e-94", "ovs_interfaceid": "51faf82e-9447-4f14-8724-e7939afb4d98", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74613) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 29 17:52:04 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-b11a0785-8421-4f45-aec6-ea4fb3ed67dc req-10421202-cb33-4870-997c-8d93a35b888b service nova] Acquired lock "refresh_cache-8de2ffb3-e264-49f7-8581-6eae21adcaeb" {{(pid=74613) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 17:52:04 user nova-compute[74613]: DEBUG nova.network.neutron [req-b11a0785-8421-4f45-aec6-ea4fb3ed67dc req-10421202-cb33-4870-997c-8d93a35b888b service nova] [instance: 8de2ffb3-e264-49f7-8581-6eae21adcaeb] Refreshing network info cache for port 51faf82e-9447-4f14-8724-e7939afb4d98 {{(pid=74613) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 17:52:04 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[5eb7061d-a1c9-4c7a-8c5a-95687e04e7af]: (2,) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 17:52:04 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:52:05 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 17:52:05 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.012s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 17:52:05 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d74ef08-2cd2-40bb-9f57-75ef368e38c4]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:400972819b5\n', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 17:52:05 user nova-compute[74613]: WARNING os_brick.initiator.connectors.nvmeof [None req-3088e3a8-2114-489e-9c16-32d5b64da4b3 tempest-ServerActionsV293TestJSON-169231013 tempest-ServerActionsV293TestJSON-169231013-project-member] Could not find nvme_core/parameters/multipath: FileNotFoundError: [Errno 2] No such file or directory: '/sys/module/nvme_core/parameters/multipath'
Nov 29 17:52:05 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 17:52:05 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.018s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 17:52:05 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[6eb45aec-9440-4499-8553-e349c42d5ddb]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 17:52:05 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 17:52:05 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 17:52:05 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c50c8de-d3d1-4ca1-8a8f-4b0279c3f5c9]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 17:52:05 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[9365b8bd-c68f-4069-8c37-bf1c497c64bf]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 17:52:05 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-3088e3a8-2114-489e-9c16-32d5b64da4b3 tempest-ServerActionsV293TestJSON-169231013 tempest-ServerActionsV293TestJSON-169231013-project-member] Running cmd (subprocess): nvme version {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 17:52:05 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-3088e3a8-2114-489e-9c16-32d5b64da4b3 tempest-ServerActionsV293TestJSON-169231013 tempest-ServerActionsV293TestJSON-169231013-project-member] 'nvme version' failed. Not Retrying. {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 17:52:05 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:52:05 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.nvmeof [None req-3088e3a8-2114-489e-9c16-32d5b64da4b3 tempest-ServerActionsV293TestJSON-169231013 tempest-ServerActionsV293TestJSON-169231013-project-member] nvme not present on system {{(pid=74613) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 29 17:52:05 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 17:52:05 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 17:52:05 user nova-compute[74613]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 29 17:52:05 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[9cbb8be5-e7f1-48e6-87ac-5f4229487486]: (4, '') {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 17:52:05 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.lightos [None req-3088e3a8-2114-489e-9c16-32d5b64da4b3 tempest-ServerActionsV293TestJSON-169231013 tempest-ServerActionsV293TestJSON-169231013-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74613) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 29 17:52:05 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.lightos [None req-3088e3a8-2114-489e-9c16-32d5b64da4b3 tempest-ServerActionsV293TestJSON-169231013 tempest-ServerActionsV293TestJSON-169231013-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74613) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 29 17:52:05 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.lightos [None req-3088e3a8-2114-489e-9c16-32d5b64da4b3 tempest-ServerActionsV293TestJSON-169231013 tempest-ServerActionsV293TestJSON-169231013-project-member] LIGHTOS: no hostnqn found. {{(pid=74613) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 29 17:52:05 user nova-compute[74613]: DEBUG os_brick.utils [None req-3088e3a8-2114-489e-9c16-32d5b64da4b3 tempest-ServerActionsV293TestJSON-169231013 tempest-ServerActionsV293TestJSON-169231013-project-member] <== get_connector_properties: return (2551ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:400972819b5', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74613) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 17:52:05 user nova-compute[74613]: DEBUG nova.virt.block_device [None req-3088e3a8-2114-489e-9c16-32d5b64da4b3 tempest-ServerActionsV293TestJSON-169231013 tempest-ServerActionsV293TestJSON-169231013-project-member] [instance: 8de2ffb3-e264-49f7-8581-6eae21adcaeb] Updating existing volume attachment record: 1fd6915e-b60f-4d7d-a980-94d3ab3d44ff {{(pid=74613) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 29 17:52:05 user nova-compute[74613]: DEBUG nova.network.neutron [req-b11a0785-8421-4f45-aec6-ea4fb3ed67dc req-10421202-cb33-4870-997c-8d93a35b888b service nova] [instance: 8de2ffb3-e264-49f7-8581-6eae21adcaeb] Updated VIF entry in instance network info cache for port 51faf82e-9447-4f14-8724-e7939afb4d98. {{(pid=74613) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 17:52:05 user nova-compute[74613]: DEBUG nova.network.neutron [req-b11a0785-8421-4f45-aec6-ea4fb3ed67dc req-10421202-cb33-4870-997c-8d93a35b888b service nova] [instance: 8de2ffb3-e264-49f7-8581-6eae21adcaeb] Updating instance_info_cache with network_info: [{"id": "51faf82e-9447-4f14-8724-e7939afb4d98", "address": "fa:16:3e:97:b9:00", "network": {"id": "59f09b07-14df-494d-bb8f-3b5d4a7b9711", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-981004620-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8d9b3ae2eee040bb84ff5065d07552d4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap51faf82e-94", "ovs_interfaceid": "51faf82e-9447-4f14-8724-e7939afb4d98", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74613) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 17:52:05 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-b11a0785-8421-4f45-aec6-ea4fb3ed67dc req-10421202-cb33-4870-997c-8d93a35b888b service nova] Releasing lock "refresh_cache-8de2ffb3-e264-49f7-8581-6eae21adcaeb" {{(pid=74613) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 17:52:05 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:52:05 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:52:05 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:52:07 user nova-compute[74613]: DEBUG nova.compute.manager [None req-fa153cd0-d0ba-4e0d-a20b-86c28a59b05e tempest-TaggedAttachmentsTest-1438740121 tempest-TaggedAttachmentsTest-1438740121-project-member] [instance: 288b8261-8706-4696-879d-d4dd01ab553e] Instance event wait completed in 0 seconds for  {{(pid=74613) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 29 17:52:07 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-fa153cd0-d0ba-4e0d-a20b-86c28a59b05e tempest-TaggedAttachmentsTest-1438740121 tempest-TaggedAttachmentsTest-1438740121-project-member] [instance: 288b8261-8706-4696-879d-d4dd01ab553e] Guest created on hypervisor {{(pid=74613) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 29 17:52:07 user nova-compute[74613]: INFO nova.virt.libvirt.driver [-] [instance: 288b8261-8706-4696-879d-d4dd01ab553e] Instance spawned successfully.
Nov 29 17:52:07 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-fa153cd0-d0ba-4e0d-a20b-86c28a59b05e tempest-TaggedAttachmentsTest-1438740121 tempest-TaggedAttachmentsTest-1438740121-project-member] [instance: 288b8261-8706-4696-879d-d4dd01ab553e] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74613) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 29 17:52:07 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-fa153cd0-d0ba-4e0d-a20b-86c28a59b05e tempest-TaggedAttachmentsTest-1438740121 tempest-TaggedAttachmentsTest-1438740121-project-member] [instance: 288b8261-8706-4696-879d-d4dd01ab553e] Found default for hw_cdrom_bus of ide {{(pid=74613) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 17:52:07 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-fa153cd0-d0ba-4e0d-a20b-86c28a59b05e tempest-TaggedAttachmentsTest-1438740121 tempest-TaggedAttachmentsTest-1438740121-project-member] [instance: 288b8261-8706-4696-879d-d4dd01ab553e] Found default for hw_disk_bus of virtio {{(pid=74613) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 17:52:07 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-fa153cd0-d0ba-4e0d-a20b-86c28a59b05e tempest-TaggedAttachmentsTest-1438740121 tempest-TaggedAttachmentsTest-1438740121-project-member] [instance: 288b8261-8706-4696-879d-d4dd01ab553e] Found default for hw_input_bus of None {{(pid=74613) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 17:52:07 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-fa153cd0-d0ba-4e0d-a20b-86c28a59b05e tempest-TaggedAttachmentsTest-1438740121 tempest-TaggedAttachmentsTest-1438740121-project-member] [instance: 288b8261-8706-4696-879d-d4dd01ab553e] Found default for hw_pointer_model of None {{(pid=74613) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 17:52:07 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-fa153cd0-d0ba-4e0d-a20b-86c28a59b05e tempest-TaggedAttachmentsTest-1438740121 tempest-TaggedAttachmentsTest-1438740121-project-member] [instance: 288b8261-8706-4696-879d-d4dd01ab553e] Found default for hw_video_model of virtio {{(pid=74613) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 17:52:07 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-fa153cd0-d0ba-4e0d-a20b-86c28a59b05e tempest-TaggedAttachmentsTest-1438740121 tempest-TaggedAttachmentsTest-1438740121-project-member] [instance: 288b8261-8706-4696-879d-d4dd01ab553e] Found default for hw_vif_model of virtio {{(pid=74613) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 17:52:07 user nova-compute[74613]: INFO nova.compute.manager [None req-fa153cd0-d0ba-4e0d-a20b-86c28a59b05e tempest-TaggedAttachmentsTest-1438740121 tempest-TaggedAttachmentsTest-1438740121-project-member] [instance: 288b8261-8706-4696-879d-d4dd01ab553e] Took 11.42 seconds to spawn the instance on the hypervisor.
Nov 29 17:52:07 user nova-compute[74613]: DEBUG nova.compute.manager [None req-fa153cd0-d0ba-4e0d-a20b-86c28a59b05e tempest-TaggedAttachmentsTest-1438740121 tempest-TaggedAttachmentsTest-1438740121-project-member] [instance: 288b8261-8706-4696-879d-d4dd01ab553e] Checking state {{(pid=74613) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 29 17:52:07 user nova-compute[74613]: INFO nova.compute.manager [None req-fa153cd0-d0ba-4e0d-a20b-86c28a59b05e tempest-TaggedAttachmentsTest-1438740121 tempest-TaggedAttachmentsTest-1438740121-project-member] [instance: 288b8261-8706-4696-879d-d4dd01ab553e] Took 12.59 seconds to build instance.
Nov 29 17:52:07 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-fa153cd0-d0ba-4e0d-a20b-86c28a59b05e tempest-TaggedAttachmentsTest-1438740121 tempest-TaggedAttachmentsTest-1438740121-project-member] Lock "288b8261-8706-4696-879d-d4dd01ab553e" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 12.769s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 17:52:07 user nova-compute[74613]: DEBUG nova.compute.manager [None req-d6c2deef-a275-4ada-bc8c-287f3c880266 tempest-VolumesAssistedSnapshotsTest-616484375 tempest-VolumesAssistedSnapshotsTest-616484375-project-member] [instance: d4ecef60-62f9-4969-b57f-3bb45a44cc9f] Instance event wait completed in 0 seconds for  {{(pid=74613) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 29 17:52:07 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-d6c2deef-a275-4ada-bc8c-287f3c880266 tempest-VolumesAssistedSnapshotsTest-616484375 tempest-VolumesAssistedSnapshotsTest-616484375-project-member] [instance: d4ecef60-62f9-4969-b57f-3bb45a44cc9f] Guest created on hypervisor {{(pid=74613) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 29 17:52:07 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:52:07 user nova-compute[74613]: INFO nova.virt.libvirt.driver [-] [instance: d4ecef60-62f9-4969-b57f-3bb45a44cc9f] Instance spawned successfully.
Nov 29 17:52:07 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-d6c2deef-a275-4ada-bc8c-287f3c880266 tempest-VolumesAssistedSnapshotsTest-616484375 tempest-VolumesAssistedSnapshotsTest-616484375-project-member] [instance: d4ecef60-62f9-4969-b57f-3bb45a44cc9f] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74613) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 29 17:52:07 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-d6c2deef-a275-4ada-bc8c-287f3c880266 tempest-VolumesAssistedSnapshotsTest-616484375 tempest-VolumesAssistedSnapshotsTest-616484375-project-member] [instance: d4ecef60-62f9-4969-b57f-3bb45a44cc9f] Found default for hw_cdrom_bus of ide {{(pid=74613) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 17:52:07 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-d6c2deef-a275-4ada-bc8c-287f3c880266 tempest-VolumesAssistedSnapshotsTest-616484375 tempest-VolumesAssistedSnapshotsTest-616484375-project-member] [instance: d4ecef60-62f9-4969-b57f-3bb45a44cc9f] Found default for hw_disk_bus of virtio {{(pid=74613) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 17:52:07 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-d6c2deef-a275-4ada-bc8c-287f3c880266 tempest-VolumesAssistedSnapshotsTest-616484375 tempest-VolumesAssistedSnapshotsTest-616484375-project-member] [instance: d4ecef60-62f9-4969-b57f-3bb45a44cc9f] Found default for hw_input_bus of None {{(pid=74613) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 17:52:07 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-d6c2deef-a275-4ada-bc8c-287f3c880266 tempest-VolumesAssistedSnapshotsTest-616484375 tempest-VolumesAssistedSnapshotsTest-616484375-project-member] [instance: d4ecef60-62f9-4969-b57f-3bb45a44cc9f] Found default for hw_pointer_model of None {{(pid=74613) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 17:52:07 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-d6c2deef-a275-4ada-bc8c-287f3c880266 tempest-VolumesAssistedSnapshotsTest-616484375 tempest-VolumesAssistedSnapshotsTest-616484375-project-member] [instance: d4ecef60-62f9-4969-b57f-3bb45a44cc9f] Found default for hw_video_model of virtio {{(pid=74613) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 17:52:07 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-d6c2deef-a275-4ada-bc8c-287f3c880266 tempest-VolumesAssistedSnapshotsTest-616484375 tempest-VolumesAssistedSnapshotsTest-616484375-project-member] [instance: d4ecef60-62f9-4969-b57f-3bb45a44cc9f] Found default for hw_vif_model of virtio {{(pid=74613) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 17:52:07 user nova-compute[74613]: INFO nova.compute.manager [None req-d6c2deef-a275-4ada-bc8c-287f3c880266 tempest-VolumesAssistedSnapshotsTest-616484375 tempest-VolumesAssistedSnapshotsTest-616484375-project-member] [instance: d4ecef60-62f9-4969-b57f-3bb45a44cc9f] Took 9.44 seconds to spawn the instance on the hypervisor.
Nov 29 17:52:07 user nova-compute[74613]: DEBUG nova.compute.manager [None req-d6c2deef-a275-4ada-bc8c-287f3c880266 tempest-VolumesAssistedSnapshotsTest-616484375 tempest-VolumesAssistedSnapshotsTest-616484375-project-member] [instance: d4ecef60-62f9-4969-b57f-3bb45a44cc9f] Checking state {{(pid=74613) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 29 17:52:08 user nova-compute[74613]: INFO nova.compute.manager [None req-d6c2deef-a275-4ada-bc8c-287f3c880266 tempest-VolumesAssistedSnapshotsTest-616484375 tempest-VolumesAssistedSnapshotsTest-616484375-project-member] [instance: d4ecef60-62f9-4969-b57f-3bb45a44cc9f] Took 11.30 seconds to build instance.
Nov 29 17:52:08 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-d6c2deef-a275-4ada-bc8c-287f3c880266 tempest-VolumesAssistedSnapshotsTest-616484375 tempest-VolumesAssistedSnapshotsTest-616484375-project-member] Lock "d4ecef60-62f9-4969-b57f-3bb45a44cc9f" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 11.515s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 17:52:09 user nova-compute[74613]: DEBUG oslo_service.periodic_task [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=74613) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 17:52:09 user nova-compute[74613]: DEBUG nova.compute.manager [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Cleaning up deleted instances {{(pid=74613) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 29 17:52:09 user nova-compute[74613]: DEBUG nova.compute.manager [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] There are 0 instances to clean {{(pid=74613) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 29 17:52:09 user nova-compute[74613]: DEBUG oslo_service.periodic_task [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=74613) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 17:52:09 user nova-compute[74613]: DEBUG nova.compute.manager [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Cleaning up deleted instances with incomplete migration  {{(pid=74613) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 29 17:52:09 user nova-compute[74613]: DEBUG oslo_service.periodic_task [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=74613) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 17:52:09 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:52:11 user nova-compute[74613]: DEBUG oslo_service.periodic_task [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74613) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 17:52:11 user nova-compute[74613]: DEBUG oslo_service.periodic_task [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74613) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 17:52:12 user nova-compute[74613]: DEBUG oslo_service.periodic_task [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74613) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 17:52:12 user nova-compute[74613]: DEBUG nova.compute.manager [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Starting heal instance info cache {{(pid=74613) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 29 17:52:12 user nova-compute[74613]: DEBUG nova.compute.manager [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Rebuilding the list of instances to heal {{(pid=74613) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 29 17:52:12 user nova-compute[74613]: DEBUG nova.compute.manager [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] [instance: 8de2ffb3-e264-49f7-8581-6eae21adcaeb] Skipping network cache update for instance because it is Building. {{(pid=74613) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9935}}
Nov 29 17:52:12 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Acquiring lock "refresh_cache-b6b0ba36-ad89-45f1-9578-8b999567dd25" {{(pid=74613) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 17:52:12 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Acquired lock "refresh_cache-b6b0ba36-ad89-45f1-9578-8b999567dd25" {{(pid=74613) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 17:52:12 user nova-compute[74613]: DEBUG nova.network.neutron [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] [instance: b6b0ba36-ad89-45f1-9578-8b999567dd25] Forcefully refreshing network info cache for instance {{(pid=74613) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 29 17:52:12 user nova-compute[74613]: DEBUG nova.objects.instance [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Lazy-loading 'info_cache' on Instance uuid b6b0ba36-ad89-45f1-9578-8b999567dd25 {{(pid=74613) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 17:52:12 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:52:12 user nova-compute[74613]: DEBUG nova.compute.manager [req-c4683dae-8cb0-446d-bcf0-c9495c43bb13 req-1caa94da-66b8-4a9c-9ab9-76b6bbb0f4a6 service nova] [instance: 3b828860-5cc5-40b0-b845-8e560211794e] Received event network-vif-plugged-dfe097e1-192f-47e2-96b7-0e9fe8320758 {{(pid=74613) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 17:52:12 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-c4683dae-8cb0-446d-bcf0-c9495c43bb13 req-1caa94da-66b8-4a9c-9ab9-76b6bbb0f4a6 service nova] Acquiring lock "3b828860-5cc5-40b0-b845-8e560211794e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 17:52:12 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-c4683dae-8cb0-446d-bcf0-c9495c43bb13 req-1caa94da-66b8-4a9c-9ab9-76b6bbb0f4a6 service nova] Lock "3b828860-5cc5-40b0-b845-8e560211794e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 17:52:12 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-c4683dae-8cb0-446d-bcf0-c9495c43bb13 req-1caa94da-66b8-4a9c-9ab9-76b6bbb0f4a6 service nova] Lock "3b828860-5cc5-40b0-b845-8e560211794e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 17:52:12 user nova-compute[74613]: DEBUG nova.compute.manager [req-c4683dae-8cb0-446d-bcf0-c9495c43bb13 req-1caa94da-66b8-4a9c-9ab9-76b6bbb0f4a6 service nova] [instance: 3b828860-5cc5-40b0-b845-8e560211794e] No waiting events found dispatching network-vif-plugged-dfe097e1-192f-47e2-96b7-0e9fe8320758 {{(pid=74613) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 17:52:12 user nova-compute[74613]: WARNING nova.compute.manager [req-c4683dae-8cb0-446d-bcf0-c9495c43bb13 req-1caa94da-66b8-4a9c-9ab9-76b6bbb0f4a6 service nova] [instance: 3b828860-5cc5-40b0-b845-8e560211794e] Received unexpected event network-vif-plugged-dfe097e1-192f-47e2-96b7-0e9fe8320758 for instance with vm_state active and task_state None.
Nov 29 17:52:13 user nova-compute[74613]: DEBUG nova.network.neutron [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] [instance: b6b0ba36-ad89-45f1-9578-8b999567dd25] Updating instance_info_cache with network_info: [{"id": "0167e253-42dd-486a-8231-a8b8199f3584", "address": "fa:16:3e:3f:ea:5d", "network": {"id": "880ea498-5e4e-4786-a894-bac0f42572f4", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1846928198-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b8f184c16b5348beb2dc9e6359a47651", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0167e253-42", "ovs_interfaceid": "0167e253-42dd-486a-8231-a8b8199f3584", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74613) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 17:52:13 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Releasing lock "refresh_cache-b6b0ba36-ad89-45f1-9578-8b999567dd25" {{(pid=74613) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 17:52:13 user nova-compute[74613]: DEBUG nova.compute.manager [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] [instance: b6b0ba36-ad89-45f1-9578-8b999567dd25] Updated the network info_cache for instance {{(pid=74613) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 29 17:52:13 user nova-compute[74613]: DEBUG oslo_service.periodic_task [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74613) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 17:52:13 user nova-compute[74613]: DEBUG oslo_service.periodic_task [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74613) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 17:52:13 user nova-compute[74613]: DEBUG oslo_service.periodic_task [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74613) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 17:52:13 user nova-compute[74613]: DEBUG oslo_service.periodic_task [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74613) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 17:52:13 user nova-compute[74613]: DEBUG nova.compute.manager [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74613) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 29 17:52:13 user nova-compute[74613]: DEBUG oslo_service.periodic_task [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74613) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 17:52:13 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 17:52:13 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 17:52:13 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 17:52:13 user nova-compute[74613]: DEBUG nova.compute.resource_tracker [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Auditing locally available compute resources for user (node: user) {{(pid=74613) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 29 17:52:14 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c19e230e-2e6c-4c20-b15c-ad81a73674b4/disk --force-share --output=json {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 17:52:14 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c19e230e-2e6c-4c20-b15c-ad81a73674b4/disk --force-share --output=json" returned: 0 in 0.300s {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 17:52:14 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c19e230e-2e6c-4c20-b15c-ad81a73674b4/disk --force-share --output=json {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 17:52:14 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c19e230e-2e6c-4c20-b15c-ad81a73674b4/disk --force-share --output=json" returned: 0 in 0.233s {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 17:52:14 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0008521b-5a63-4ff6-8390-d343956900ed/disk --force-share --output=json {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 17:52:14 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:52:14 user nova-compute[74613]: DEBUG nova.compute.manager [req-cbf5f7bf-26c9-4cb0-8115-fd22927777e8 req-e4edad95-1398-4d50-9cce-fa136b86fda6 service nova] [instance: 3b828860-5cc5-40b0-b845-8e560211794e] Received event network-vif-plugged-dfe097e1-192f-47e2-96b7-0e9fe8320758 {{(pid=74613) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 17:52:14 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-cbf5f7bf-26c9-4cb0-8115-fd22927777e8 req-e4edad95-1398-4d50-9cce-fa136b86fda6 service nova] Acquiring lock "3b828860-5cc5-40b0-b845-8e560211794e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 17:52:14 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-cbf5f7bf-26c9-4cb0-8115-fd22927777e8 req-e4edad95-1398-4d50-9cce-fa136b86fda6 service nova] Lock "3b828860-5cc5-40b0-b845-8e560211794e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 17:52:14 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-cbf5f7bf-26c9-4cb0-8115-fd22927777e8 req-e4edad95-1398-4d50-9cce-fa136b86fda6 service nova] Lock "3b828860-5cc5-40b0-b845-8e560211794e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 17:52:14 user nova-compute[74613]: DEBUG nova.compute.manager [req-cbf5f7bf-26c9-4cb0-8115-fd22927777e8 req-e4edad95-1398-4d50-9cce-fa136b86fda6 service nova] [instance: 3b828860-5cc5-40b0-b845-8e560211794e] No waiting events found dispatching network-vif-plugged-dfe097e1-192f-47e2-96b7-0e9fe8320758 {{(pid=74613) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 17:52:14 user nova-compute[74613]: WARNING nova.compute.manager [req-cbf5f7bf-26c9-4cb0-8115-fd22927777e8 req-e4edad95-1398-4d50-9cce-fa136b86fda6 service nova] [instance: 3b828860-5cc5-40b0-b845-8e560211794e] Received unexpected event network-vif-plugged-dfe097e1-192f-47e2-96b7-0e9fe8320758 for instance with vm_state active and task_state None.
Nov 29 17:52:14 user nova-compute[74613]: DEBUG nova.compute.manager [req-cbf5f7bf-26c9-4cb0-8115-fd22927777e8 req-e4edad95-1398-4d50-9cce-fa136b86fda6 service nova] [instance: b6b0ba36-ad89-45f1-9578-8b999567dd25] Received event network-vif-plugged-0167e253-42dd-486a-8231-a8b8199f3584 {{(pid=74613) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 17:52:14 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-cbf5f7bf-26c9-4cb0-8115-fd22927777e8 req-e4edad95-1398-4d50-9cce-fa136b86fda6 service nova] Acquiring lock "b6b0ba36-ad89-45f1-9578-8b999567dd25-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 17:52:14 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-cbf5f7bf-26c9-4cb0-8115-fd22927777e8 req-e4edad95-1398-4d50-9cce-fa136b86fda6 service nova] Lock "b6b0ba36-ad89-45f1-9578-8b999567dd25-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 17:52:14 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-cbf5f7bf-26c9-4cb0-8115-fd22927777e8 req-e4edad95-1398-4d50-9cce-fa136b86fda6 service nova] Lock "b6b0ba36-ad89-45f1-9578-8b999567dd25-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 17:52:14 user nova-compute[74613]: DEBUG nova.compute.manager [req-cbf5f7bf-26c9-4cb0-8115-fd22927777e8 req-e4edad95-1398-4d50-9cce-fa136b86fda6 service nova] [instance: b6b0ba36-ad89-45f1-9578-8b999567dd25] No waiting events found dispatching network-vif-plugged-0167e253-42dd-486a-8231-a8b8199f3584 {{(pid=74613) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 17:52:14 user nova-compute[74613]: WARNING nova.compute.manager [req-cbf5f7bf-26c9-4cb0-8115-fd22927777e8 req-e4edad95-1398-4d50-9cce-fa136b86fda6 service nova] [instance: b6b0ba36-ad89-45f1-9578-8b999567dd25] Received unexpected event network-vif-plugged-0167e253-42dd-486a-8231-a8b8199f3584 for instance with vm_state active and task_state None.
Nov 29 17:52:14 user nova-compute[74613]: DEBUG nova.compute.manager [req-cbf5f7bf-26c9-4cb0-8115-fd22927777e8 req-e4edad95-1398-4d50-9cce-fa136b86fda6 service nova] [instance: b6b0ba36-ad89-45f1-9578-8b999567dd25] Received event network-vif-plugged-0167e253-42dd-486a-8231-a8b8199f3584 {{(pid=74613) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 17:52:14 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-cbf5f7bf-26c9-4cb0-8115-fd22927777e8 req-e4edad95-1398-4d50-9cce-fa136b86fda6 service nova] Acquiring lock "b6b0ba36-ad89-45f1-9578-8b999567dd25-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 17:52:14 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-cbf5f7bf-26c9-4cb0-8115-fd22927777e8 req-e4edad95-1398-4d50-9cce-fa136b86fda6 service nova] Lock "b6b0ba36-ad89-45f1-9578-8b999567dd25-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 17:52:14 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-cbf5f7bf-26c9-4cb0-8115-fd22927777e8 req-e4edad95-1398-4d50-9cce-fa136b86fda6 service nova] Lock "b6b0ba36-ad89-45f1-9578-8b999567dd25-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 17:52:14 user nova-compute[74613]: DEBUG nova.compute.manager [req-cbf5f7bf-26c9-4cb0-8115-fd22927777e8 req-e4edad95-1398-4d50-9cce-fa136b86fda6 service nova] [instance: b6b0ba36-ad89-45f1-9578-8b999567dd25] No waiting events found dispatching network-vif-plugged-0167e253-42dd-486a-8231-a8b8199f3584 {{(pid=74613) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 17:52:14 user nova-compute[74613]: WARNING nova.compute.manager [req-cbf5f7bf-26c9-4cb0-8115-fd22927777e8 req-e4edad95-1398-4d50-9cce-fa136b86fda6 service nova] [instance: b6b0ba36-ad89-45f1-9578-8b999567dd25] Received unexpected event network-vif-plugged-0167e253-42dd-486a-8231-a8b8199f3584 for instance with vm_state active and task_state None.
Nov 29 17:52:14 user nova-compute[74613]: DEBUG nova.compute.manager [req-cbf5f7bf-26c9-4cb0-8115-fd22927777e8 req-e4edad95-1398-4d50-9cce-fa136b86fda6 service nova] [instance: 0008521b-5a63-4ff6-8390-d343956900ed] Received event network-vif-plugged-0ab94891-565e-4864-b6ba-565056b40005 {{(pid=74613) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 17:52:14 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-cbf5f7bf-26c9-4cb0-8115-fd22927777e8 req-e4edad95-1398-4d50-9cce-fa136b86fda6 service nova] Acquiring lock "0008521b-5a63-4ff6-8390-d343956900ed-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 17:52:14 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-cbf5f7bf-26c9-4cb0-8115-fd22927777e8 req-e4edad95-1398-4d50-9cce-fa136b86fda6 service nova] Lock "0008521b-5a63-4ff6-8390-d343956900ed-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 17:52:14 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-cbf5f7bf-26c9-4cb0-8115-fd22927777e8 req-e4edad95-1398-4d50-9cce-fa136b86fda6 service nova] Lock "0008521b-5a63-4ff6-8390-d343956900ed-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 17:52:14 user nova-compute[74613]: DEBUG nova.compute.manager [req-cbf5f7bf-26c9-4cb0-8115-fd22927777e8 req-e4edad95-1398-4d50-9cce-fa136b86fda6 service nova] [instance: 0008521b-5a63-4ff6-8390-d343956900ed] No waiting events found dispatching network-vif-plugged-0ab94891-565e-4864-b6ba-565056b40005 {{(pid=74613) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 17:52:14 user nova-compute[74613]: WARNING nova.compute.manager [req-cbf5f7bf-26c9-4cb0-8115-fd22927777e8 req-e4edad95-1398-4d50-9cce-fa136b86fda6 service nova] [instance: 0008521b-5a63-4ff6-8390-d343956900ed] Received unexpected event network-vif-plugged-0ab94891-565e-4864-b6ba-565056b40005 for instance with vm_state active and task_state None.
Nov 29 17:52:15 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0008521b-5a63-4ff6-8390-d343956900ed/disk --force-share --output=json" returned: 0 in 0.228s {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 17:52:15 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0008521b-5a63-4ff6-8390-d343956900ed/disk --force-share --output=json {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 17:52:15 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0008521b-5a63-4ff6-8390-d343956900ed/disk --force-share --output=json" returned: 0 in 0.212s {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 17:52:15 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b6b0ba36-ad89-45f1-9578-8b999567dd25/disk --force-share --output=json {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 17:52:15 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b6b0ba36-ad89-45f1-9578-8b999567dd25/disk --force-share --output=json" returned: 0 in 0.231s {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 17:52:15 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b6b0ba36-ad89-45f1-9578-8b999567dd25/disk --force-share --output=json {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 17:52:15 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b6b0ba36-ad89-45f1-9578-8b999567dd25/disk --force-share --output=json" returned: 0 in 0.236s {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 17:52:15 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/01c65b16-5dbe-4ad5-a72e-9500a4fa59cf/disk --force-share --output=json {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 17:52:16 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/01c65b16-5dbe-4ad5-a72e-9500a4fa59cf/disk --force-share --output=json" returned: 0 in 0.250s {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 17:52:16 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/01c65b16-5dbe-4ad5-a72e-9500a4fa59cf/disk --force-share --output=json {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 17:52:16 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/01c65b16-5dbe-4ad5-a72e-9500a4fa59cf/disk --force-share --output=json" returned: 0 in 0.265s {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 17:52:16 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d4ecef60-62f9-4969-b57f-3bb45a44cc9f/disk --force-share --output=json {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 17:52:16 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d4ecef60-62f9-4969-b57f-3bb45a44cc9f/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 17:52:16 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d4ecef60-62f9-4969-b57f-3bb45a44cc9f/disk --force-share --output=json {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 17:52:16 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d4ecef60-62f9-4969-b57f-3bb45a44cc9f/disk --force-share --output=json" returned: 0 in 0.167s {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 17:52:16 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f3a5f6d2-cadd-485b-a443-1b8f3ed966b9/disk --force-share --output=json {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 17:52:16 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f3a5f6d2-cadd-485b-a443-1b8f3ed966b9/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 17:52:16 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f3a5f6d2-cadd-485b-a443-1b8f3ed966b9/disk --force-share --output=json {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 17:52:17 user nova-compute[74613]: DEBUG nova.compute.manager [req-629079c9-00ac-4fde-b9c8-6398c980325b req-f455075f-5300-4346-9379-e9947cddfb32 service nova] [instance: 0008521b-5a63-4ff6-8390-d343956900ed] Received event network-vif-plugged-0ab94891-565e-4864-b6ba-565056b40005 {{(pid=74613) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 17:52:17 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-629079c9-00ac-4fde-b9c8-6398c980325b req-f455075f-5300-4346-9379-e9947cddfb32 service nova] Acquiring lock "0008521b-5a63-4ff6-8390-d343956900ed-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 17:52:17 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-629079c9-00ac-4fde-b9c8-6398c980325b req-f455075f-5300-4346-9379-e9947cddfb32 service nova] Lock "0008521b-5a63-4ff6-8390-d343956900ed-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 17:52:17 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-629079c9-00ac-4fde-b9c8-6398c980325b req-f455075f-5300-4346-9379-e9947cddfb32 service nova] Lock "0008521b-5a63-4ff6-8390-d343956900ed-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 17:52:17 user nova-compute[74613]: DEBUG nova.compute.manager [req-629079c9-00ac-4fde-b9c8-6398c980325b req-f455075f-5300-4346-9379-e9947cddfb32 service nova] [instance: 0008521b-5a63-4ff6-8390-d343956900ed] No waiting events found dispatching network-vif-plugged-0ab94891-565e-4864-b6ba-565056b40005 {{(pid=74613) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 17:52:17 user nova-compute[74613]: WARNING nova.compute.manager [req-629079c9-00ac-4fde-b9c8-6398c980325b req-f455075f-5300-4346-9379-e9947cddfb32 service nova] [instance: 0008521b-5a63-4ff6-8390-d343956900ed] Received unexpected event network-vif-plugged-0ab94891-565e-4864-b6ba-565056b40005 for instance with vm_state active and task_state None.
Nov 29 17:52:17 user nova-compute[74613]: DEBUG nova.compute.manager [req-629079c9-00ac-4fde-b9c8-6398c980325b req-f455075f-5300-4346-9379-e9947cddfb32 service nova] [instance: 288b8261-8706-4696-879d-d4dd01ab553e] Received event network-vif-plugged-abe5d419-60cc-474c-935a-60f5512894e0 {{(pid=74613) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 17:52:17 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-629079c9-00ac-4fde-b9c8-6398c980325b req-f455075f-5300-4346-9379-e9947cddfb32 service nova] Acquiring lock "288b8261-8706-4696-879d-d4dd01ab553e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 17:52:17 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-629079c9-00ac-4fde-b9c8-6398c980325b req-f455075f-5300-4346-9379-e9947cddfb32 service nova] Lock "288b8261-8706-4696-879d-d4dd01ab553e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 17:52:17 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-629079c9-00ac-4fde-b9c8-6398c980325b req-f455075f-5300-4346-9379-e9947cddfb32 service nova] Lock "288b8261-8706-4696-879d-d4dd01ab553e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 17:52:17 user nova-compute[74613]: DEBUG nova.compute.manager [req-629079c9-00ac-4fde-b9c8-6398c980325b req-f455075f-5300-4346-9379-e9947cddfb32 service nova] [instance: 288b8261-8706-4696-879d-d4dd01ab553e] No waiting events found dispatching network-vif-plugged-abe5d419-60cc-474c-935a-60f5512894e0 {{(pid=74613) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 17:52:17 user nova-compute[74613]: WARNING nova.compute.manager [req-629079c9-00ac-4fde-b9c8-6398c980325b req-f455075f-5300-4346-9379-e9947cddfb32 service nova] [instance: 288b8261-8706-4696-879d-d4dd01ab553e] Received unexpected event network-vif-plugged-abe5d419-60cc-474c-935a-60f5512894e0 for instance with vm_state active and task_state None.
Nov 29 17:52:17 user nova-compute[74613]: DEBUG nova.compute.manager [req-629079c9-00ac-4fde-b9c8-6398c980325b req-f455075f-5300-4346-9379-e9947cddfb32 service nova] [instance: 288b8261-8706-4696-879d-d4dd01ab553e] Received event network-vif-plugged-abe5d419-60cc-474c-935a-60f5512894e0 {{(pid=74613) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 17:52:17 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-629079c9-00ac-4fde-b9c8-6398c980325b req-f455075f-5300-4346-9379-e9947cddfb32 service nova] Acquiring lock "288b8261-8706-4696-879d-d4dd01ab553e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 17:52:17 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-629079c9-00ac-4fde-b9c8-6398c980325b req-f455075f-5300-4346-9379-e9947cddfb32 service nova] Lock "288b8261-8706-4696-879d-d4dd01ab553e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 17:52:17 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-629079c9-00ac-4fde-b9c8-6398c980325b req-f455075f-5300-4346-9379-e9947cddfb32 service nova] Lock "288b8261-8706-4696-879d-d4dd01ab553e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 17:52:17 user nova-compute[74613]: DEBUG nova.compute.manager [req-629079c9-00ac-4fde-b9c8-6398c980325b req-f455075f-5300-4346-9379-e9947cddfb32 service nova] [instance: 288b8261-8706-4696-879d-d4dd01ab553e] No waiting events found dispatching network-vif-plugged-abe5d419-60cc-474c-935a-60f5512894e0 {{(pid=74613) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 17:52:17 user nova-compute[74613]: WARNING nova.compute.manager [req-629079c9-00ac-4fde-b9c8-6398c980325b req-f455075f-5300-4346-9379-e9947cddfb32 service nova] [instance: 288b8261-8706-4696-879d-d4dd01ab553e] Received unexpected event network-vif-plugged-abe5d419-60cc-474c-935a-60f5512894e0 for instance with vm_state active and task_state None.
Nov 29 17:52:17 user nova-compute[74613]: DEBUG nova.compute.manager [req-629079c9-00ac-4fde-b9c8-6398c980325b req-f455075f-5300-4346-9379-e9947cddfb32 service nova] [instance: d4ecef60-62f9-4969-b57f-3bb45a44cc9f] Received event network-vif-plugged-292029d6-b062-4cdc-8c09-c92693cac658 {{(pid=74613) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 17:52:17 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-629079c9-00ac-4fde-b9c8-6398c980325b req-f455075f-5300-4346-9379-e9947cddfb32 service nova] Acquiring lock "d4ecef60-62f9-4969-b57f-3bb45a44cc9f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 17:52:17 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-629079c9-00ac-4fde-b9c8-6398c980325b req-f455075f-5300-4346-9379-e9947cddfb32 service nova] Lock "d4ecef60-62f9-4969-b57f-3bb45a44cc9f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 17:52:17 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-629079c9-00ac-4fde-b9c8-6398c980325b req-f455075f-5300-4346-9379-e9947cddfb32 service nova] Lock "d4ecef60-62f9-4969-b57f-3bb45a44cc9f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 17:52:17 user nova-compute[74613]: DEBUG nova.compute.manager [req-629079c9-00ac-4fde-b9c8-6398c980325b req-f455075f-5300-4346-9379-e9947cddfb32 service nova] [instance: d4ecef60-62f9-4969-b57f-3bb45a44cc9f] No waiting events found dispatching network-vif-plugged-292029d6-b062-4cdc-8c09-c92693cac658 {{(pid=74613) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 17:52:17 user nova-compute[74613]: WARNING nova.compute.manager [req-629079c9-00ac-4fde-b9c8-6398c980325b req-f455075f-5300-4346-9379-e9947cddfb32 service nova] [instance: d4ecef60-62f9-4969-b57f-3bb45a44cc9f] Received unexpected event network-vif-plugged-292029d6-b062-4cdc-8c09-c92693cac658 for instance with vm_state active and task_state None.
Nov 29 17:52:17 user nova-compute[74613]: DEBUG nova.compute.manager [req-629079c9-00ac-4fde-b9c8-6398c980325b req-f455075f-5300-4346-9379-e9947cddfb32 service nova] [instance: d4ecef60-62f9-4969-b57f-3bb45a44cc9f] Received event network-vif-plugged-292029d6-b062-4cdc-8c09-c92693cac658 {{(pid=74613) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 17:52:17 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-629079c9-00ac-4fde-b9c8-6398c980325b req-f455075f-5300-4346-9379-e9947cddfb32 service nova] Acquiring lock "d4ecef60-62f9-4969-b57f-3bb45a44cc9f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 17:52:17 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-629079c9-00ac-4fde-b9c8-6398c980325b req-f455075f-5300-4346-9379-e9947cddfb32 service nova] Lock "d4ecef60-62f9-4969-b57f-3bb45a44cc9f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 17:52:17 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-629079c9-00ac-4fde-b9c8-6398c980325b req-f455075f-5300-4346-9379-e9947cddfb32 service nova] Lock "d4ecef60-62f9-4969-b57f-3bb45a44cc9f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 17:52:17 user nova-compute[74613]: DEBUG nova.compute.manager [req-629079c9-00ac-4fde-b9c8-6398c980325b req-f455075f-5300-4346-9379-e9947cddfb32 service nova] [instance: d4ecef60-62f9-4969-b57f-3bb45a44cc9f] No waiting events found dispatching network-vif-plugged-292029d6-b062-4cdc-8c09-c92693cac658 {{(pid=74613) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 17:52:17 user nova-compute[74613]: WARNING nova.compute.manager [req-629079c9-00ac-4fde-b9c8-6398c980325b req-f455075f-5300-4346-9379-e9947cddfb32 service nova] [instance: d4ecef60-62f9-4969-b57f-3bb45a44cc9f] Received unexpected event network-vif-plugged-292029d6-b062-4cdc-8c09-c92693cac658 for instance with vm_state active and task_state None.
Nov 29 17:52:17 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f3a5f6d2-cadd-485b-a443-1b8f3ed966b9/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 17:52:17 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3b828860-5cc5-40b0-b845-8e560211794e/disk --force-share --output=json {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 17:52:17 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3b828860-5cc5-40b0-b845-8e560211794e/disk --force-share --output=json" returned: 0 in 0.240s {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 17:52:17 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3b828860-5cc5-40b0-b845-8e560211794e/disk --force-share --output=json {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 17:52:17 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3b828860-5cc5-40b0-b845-8e560211794e/disk --force-share --output=json" returned: 0 in 0.236s {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 17:52:17 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/abc9e2b8-f467-4cd0-b40f-de511fde1ec1/disk --force-share --output=json {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 17:52:17 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:52:17 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/abc9e2b8-f467-4cd0-b40f-de511fde1ec1/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 17:52:17 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/abc9e2b8-f467-4cd0-b40f-de511fde1ec1/disk --force-share --output=json {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 17:52:17 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/abc9e2b8-f467-4cd0-b40f-de511fde1ec1/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 17:52:17 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/288b8261-8706-4696-879d-d4dd01ab553e/disk --force-share --output=json {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 17:52:18 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/288b8261-8706-4696-879d-d4dd01ab553e/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 17:52:18 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/288b8261-8706-4696-879d-d4dd01ab553e/disk --force-share --output=json {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 17:52:18 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/288b8261-8706-4696-879d-d4dd01ab553e/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 17:52:18 user nova-compute[74613]: WARNING nova.virt.libvirt.driver [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 17:52:18 user nova-compute[74613]: WARNING nova.virt.libvirt.driver [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 17:52:18 user nova-compute[74613]: DEBUG nova.compute.resource_tracker [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Hypervisor/Node resource view: name=user free_ram=7470MB free_disk=25.429840087890625GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74613) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 29 17:52:18 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 17:52:18 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 17:52:19 user nova-compute[74613]: DEBUG nova.compute.resource_tracker [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Instance b6b0ba36-ad89-45f1-9578-8b999567dd25 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74613) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 17:52:19 user nova-compute[74613]: DEBUG nova.compute.resource_tracker [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Instance 3b828860-5cc5-40b0-b845-8e560211794e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74613) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 17:52:19 user nova-compute[74613]: DEBUG nova.compute.resource_tracker [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Instance c19e230e-2e6c-4c20-b15c-ad81a73674b4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74613) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 17:52:19 user nova-compute[74613]: DEBUG nova.compute.resource_tracker [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Instance f3a5f6d2-cadd-485b-a443-1b8f3ed966b9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74613) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 17:52:19 user nova-compute[74613]: DEBUG nova.compute.resource_tracker [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Instance abc9e2b8-f467-4cd0-b40f-de511fde1ec1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74613) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 17:52:19 user nova-compute[74613]: DEBUG nova.compute.resource_tracker [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Instance 01c65b16-5dbe-4ad5-a72e-9500a4fa59cf actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74613) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 17:52:19 user nova-compute[74613]: DEBUG nova.compute.resource_tracker [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Instance 0008521b-5a63-4ff6-8390-d343956900ed actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74613) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 17:52:19 user nova-compute[74613]: DEBUG nova.compute.resource_tracker [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Instance 288b8261-8706-4696-879d-d4dd01ab553e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74613) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 17:52:19 user nova-compute[74613]: DEBUG nova.compute.resource_tracker [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Instance d4ecef60-62f9-4969-b57f-3bb45a44cc9f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74613) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 17:52:19 user nova-compute[74613]: DEBUG nova.compute.resource_tracker [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Instance 8de2ffb3-e264-49f7-8581-6eae21adcaeb actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74613) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 17:52:19 user nova-compute[74613]: DEBUG nova.compute.resource_tracker [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Total usable vcpus: 12, total allocated vcpus: 10 {{(pid=74613) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 29 17:52:19 user nova-compute[74613]: DEBUG nova.compute.resource_tracker [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Final resource view: name=user phys_ram=16011MB used_ram=5632MB phys_disk=40GB used_disk=9GB total_vcpus=12 used_vcpus=10 pci_stats=[] {{(pid=74613) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 29 17:52:19 user nova-compute[74613]: DEBUG nova.scheduler.client.report [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Refreshing inventories for resource provider 639d980e-3b12-44b1-b8f4-1812416fa4dd {{(pid=74613) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 29 17:52:19 user nova-compute[74613]: DEBUG nova.scheduler.client.report [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Updating ProviderTree inventory for provider 639d980e-3b12-44b1-b8f4-1812416fa4dd from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74613) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 29 17:52:19 user nova-compute[74613]: DEBUG nova.compute.provider_tree [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Updating inventory in ProviderTree for provider 639d980e-3b12-44b1-b8f4-1812416fa4dd with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74613) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 29 17:52:19 user nova-compute[74613]: DEBUG nova.scheduler.client.report [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Refreshing aggregate associations for resource provider 639d980e-3b12-44b1-b8f4-1812416fa4dd, aggregates: None {{(pid=74613) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 29 17:52:19 user nova-compute[74613]: DEBUG nova.scheduler.client.report [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Refreshing trait associations for resource provider 639d980e-3b12-44b1-b8f4-1812416fa4dd, traits: HW_CPU_X86_SSE,COMPUTE_VOLUME_EXTEND,COMPUTE_ACCELERATORS,HW_CPU_X86_SSE41,COMPUTE_STORAGE_BUS_IDE,COMPUTE_NODE,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,HW_CPU_X86_MMX,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,HW_CPU_X86_SSE2,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_STORAGE_BUS_USB,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_STORAGE_BUS_SATA,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_DEVICE_TAGGING,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_RESCUE_BFV,HW_CPU_X86_SSSE3,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_TRUSTED_CERTS,HW_CPU_X86_SSE42,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_STORAGE_BUS_FDC {{(pid=74613) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 29 17:52:19 user nova-compute[74613]: DEBUG nova.compute.provider_tree [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Inventory has not changed in ProviderTree for provider: 639d980e-3b12-44b1-b8f4-1812416fa4dd {{(pid=74613) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 17:52:19 user nova-compute[74613]: DEBUG nova.scheduler.client.report [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Inventory has not changed for provider 639d980e-3b12-44b1-b8f4-1812416fa4dd based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74613) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 17:52:19 user nova-compute[74613]: DEBUG nova.compute.resource_tracker [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Compute_service record updated for user:user {{(pid=74613) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 29 17:52:19 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.908s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 17:52:19 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:52:20 user nova-compute[74613]: DEBUG nova.compute.manager [None req-3088e3a8-2114-489e-9c16-32d5b64da4b3 tempest-ServerActionsV293TestJSON-169231013 tempest-ServerActionsV293TestJSON-169231013-project-member] [instance: 8de2ffb3-e264-49f7-8581-6eae21adcaeb] Start spawning the instance on the hypervisor. {{(pid=74613) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 29 17:52:20 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-3088e3a8-2114-489e-9c16-32d5b64da4b3 tempest-ServerActionsV293TestJSON-169231013 tempest-ServerActionsV293TestJSON-169231013-project-member] [instance: 8de2ffb3-e264-49f7-8581-6eae21adcaeb] Creating instance directory {{(pid=74613) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 29 17:52:20 user nova-compute[74613]: INFO nova.virt.libvirt.driver [None req-3088e3a8-2114-489e-9c16-32d5b64da4b3 tempest-ServerActionsV293TestJSON-169231013 tempest-ServerActionsV293TestJSON-169231013-project-member] [instance: 8de2ffb3-e264-49f7-8581-6eae21adcaeb] Creating image(s)
Nov 29 17:52:20 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-3088e3a8-2114-489e-9c16-32d5b64da4b3 tempest-ServerActionsV293TestJSON-169231013 tempest-ServerActionsV293TestJSON-169231013-project-member] [instance: 8de2ffb3-e264-49f7-8581-6eae21adcaeb] Did not create local disks {{(pid=74613) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 29 17:52:20 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-3088e3a8-2114-489e-9c16-32d5b64da4b3 tempest-ServerActionsV293TestJSON-169231013 tempest-ServerActionsV293TestJSON-169231013-project-member] [instance: 8de2ffb3-e264-49f7-8581-6eae21adcaeb] Ensure instance console log exists: /opt/stack/data/nova/instances/8de2ffb3-e264-49f7-8581-6eae21adcaeb/console.log {{(pid=74613) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 29 17:52:20 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-3088e3a8-2114-489e-9c16-32d5b64da4b3 tempest-ServerActionsV293TestJSON-169231013 tempest-ServerActionsV293TestJSON-169231013-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 17:52:20 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-3088e3a8-2114-489e-9c16-32d5b64da4b3 tempest-ServerActionsV293TestJSON-169231013 tempest-ServerActionsV293TestJSON-169231013-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 17:52:20 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-3088e3a8-2114-489e-9c16-32d5b64da4b3 tempest-ServerActionsV293TestJSON-169231013 tempest-ServerActionsV293TestJSON-169231013-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 17:52:20 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-3088e3a8-2114-489e-9c16-32d5b64da4b3 tempest-ServerActionsV293TestJSON-169231013 tempest-ServerActionsV293TestJSON-169231013-project-member] [instance: 8de2ffb3-e264-49f7-8581-6eae21adcaeb] Start _get_guest_xml network_info=[{"id": "51faf82e-9447-4f14-8724-e7939afb4d98", "address": "fa:16:3e:97:b9:00", "network": {"id": "59f09b07-14df-494d-bb8f-3b5d4a7b9711", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-981004620-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8d9b3ae2eee040bb84ff5065d07552d4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap51faf82e-94", "ovs_interfaceid": "51faf82e-9447-4f14-8724-e7939afb4d98", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:fbbdc3d2-136d-4fba-b6ba-f27f35a0733b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QpqiVKeo', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '8de2ffb3-e264-49f7-8581-6eae21adcaeb', 'attached_at': '', 'detached_at': '', 'volume_id': 'fbbdc3d2-136d-4fba-b6ba-f27f35a0733b', 'serial': 'fbbdc3d2-136d-4fba-b6ba-f27f35a0733b'}, 'mount_device': '/dev/vda', 'delete_on_termination': True, 'device_type': 'disk', 'boot_index': 0, 'guest_format': None, 'attachment_id': '1fd6915e-b60f-4d7d-a980-94d3ab3d44ff', 'disk_bus': 'virtio', 'volume_type': None} {{(pid=74613) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 29 17:52:20 user nova-compute[74613]: WARNING nova.virt.libvirt.driver [None req-3088e3a8-2114-489e-9c16-32d5b64da4b3 tempest-ServerActionsV293TestJSON-169231013 tempest-ServerActionsV293TestJSON-169231013-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 17:52:20 user nova-compute[74613]: WARNING nova.virt.libvirt.driver [None req-3088e3a8-2114-489e-9c16-32d5b64da4b3 tempest-ServerActionsV293TestJSON-169231013 tempest-ServerActionsV293TestJSON-169231013-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 17:52:20 user nova-compute[74613]: DEBUG nova.virt.libvirt.host [None req-3088e3a8-2114-489e-9c16-32d5b64da4b3 tempest-ServerActionsV293TestJSON-169231013 tempest-ServerActionsV293TestJSON-169231013-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74613) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 29 17:52:20 user nova-compute[74613]: DEBUG nova.virt.libvirt.host [None req-3088e3a8-2114-489e-9c16-32d5b64da4b3 tempest-ServerActionsV293TestJSON-169231013 tempest-ServerActionsV293TestJSON-169231013-project-member] CPU controller missing on host. {{(pid=74613) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 29 17:52:20 user nova-compute[74613]: DEBUG nova.virt.libvirt.host [None req-3088e3a8-2114-489e-9c16-32d5b64da4b3 tempest-ServerActionsV293TestJSON-169231013 tempest-ServerActionsV293TestJSON-169231013-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74613) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 29 17:52:20 user nova-compute[74613]: DEBUG nova.virt.libvirt.host [None req-3088e3a8-2114-489e-9c16-32d5b64da4b3 tempest-ServerActionsV293TestJSON-169231013 tempest-ServerActionsV293TestJSON-169231013-project-member] CPU controller found on host. {{(pid=74613) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 29 17:52:20 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-3088e3a8-2114-489e-9c16-32d5b64da4b3 tempest-ServerActionsV293TestJSON-169231013 tempest-ServerActionsV293TestJSON-169231013-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74613) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 29 17:52:20 user nova-compute[74613]: DEBUG nova.virt.hardware [None req-3088e3a8-2114-489e-9c16-32d5b64da4b3 tempest-ServerActionsV293TestJSON-169231013 tempest-ServerActionsV293TestJSON-169231013-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-29T17:47:27Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74613) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 29 17:52:20 user nova-compute[74613]: DEBUG nova.virt.hardware [None req-3088e3a8-2114-489e-9c16-32d5b64da4b3 tempest-ServerActionsV293TestJSON-169231013 tempest-ServerActionsV293TestJSON-169231013-project-member] Flavor limits 0:0:0 {{(pid=74613) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 29 17:52:20 user nova-compute[74613]: DEBUG nova.virt.hardware [None req-3088e3a8-2114-489e-9c16-32d5b64da4b3 tempest-ServerActionsV293TestJSON-169231013 tempest-ServerActionsV293TestJSON-169231013-project-member] Image limits 0:0:0 {{(pid=74613) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 29 17:52:20 user nova-compute[74613]: DEBUG nova.virt.hardware [None req-3088e3a8-2114-489e-9c16-32d5b64da4b3 tempest-ServerActionsV293TestJSON-169231013 tempest-ServerActionsV293TestJSON-169231013-project-member] Flavor pref 0:0:0 {{(pid=74613) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 29 17:52:20 user nova-compute[74613]: DEBUG nova.virt.hardware [None req-3088e3a8-2114-489e-9c16-32d5b64da4b3 tempest-ServerActionsV293TestJSON-169231013 tempest-ServerActionsV293TestJSON-169231013-project-member] Image pref 0:0:0 {{(pid=74613) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 29 17:52:20 user nova-compute[74613]: DEBUG nova.virt.hardware [None req-3088e3a8-2114-489e-9c16-32d5b64da4b3 tempest-ServerActionsV293TestJSON-169231013 tempest-ServerActionsV293TestJSON-169231013-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74613) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 29 17:52:20 user nova-compute[74613]: DEBUG nova.virt.hardware [None req-3088e3a8-2114-489e-9c16-32d5b64da4b3 tempest-ServerActionsV293TestJSON-169231013 tempest-ServerActionsV293TestJSON-169231013-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74613) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 29 17:52:20 user nova-compute[74613]: DEBUG nova.virt.hardware [None req-3088e3a8-2114-489e-9c16-32d5b64da4b3 tempest-ServerActionsV293TestJSON-169231013 tempest-ServerActionsV293TestJSON-169231013-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74613) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 29 17:52:20 user nova-compute[74613]: DEBUG nova.virt.hardware [None req-3088e3a8-2114-489e-9c16-32d5b64da4b3 tempest-ServerActionsV293TestJSON-169231013 tempest-ServerActionsV293TestJSON-169231013-project-member] Got 1 possible topologies {{(pid=74613) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 29 17:52:20 user nova-compute[74613]: DEBUG nova.virt.hardware [None req-3088e3a8-2114-489e-9c16-32d5b64da4b3 tempest-ServerActionsV293TestJSON-169231013 tempest-ServerActionsV293TestJSON-169231013-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74613) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 29 17:52:20 user nova-compute[74613]: DEBUG nova.virt.hardware [None req-3088e3a8-2114-489e-9c16-32d5b64da4b3 tempest-ServerActionsV293TestJSON-169231013 tempest-ServerActionsV293TestJSON-169231013-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74613) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 29 17:52:20 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-3088e3a8-2114-489e-9c16-32d5b64da4b3 tempest-ServerActionsV293TestJSON-169231013 tempest-ServerActionsV293TestJSON-169231013-project-member] Acquiring lock "cache_volume_driver" by "nova.virt.libvirt.driver.LibvirtDriver._get_volume_driver.<locals>._cache_volume_driver" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 17:52:20 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-3088e3a8-2114-489e-9c16-32d5b64da4b3 tempest-ServerActionsV293TestJSON-169231013 tempest-ServerActionsV293TestJSON-169231013-project-member] Lock "cache_volume_driver" acquired by "nova.virt.libvirt.driver.LibvirtDriver._get_volume_driver.<locals>._cache_volume_driver" :: waited 0.001s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 17:52:20 user nova-compute[74613]: DEBUG os_brick.initiator.connector [None req-3088e3a8-2114-489e-9c16-32d5b64da4b3 tempest-ServerActionsV293TestJSON-169231013 tempest-ServerActionsV293TestJSON-169231013-project-member] Factory for ISCSI on None {{(pid=74613) factory /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connector.py:281}}
Nov 29 17:52:20 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-3088e3a8-2114-489e-9c16-32d5b64da4b3 tempest-ServerActionsV293TestJSON-169231013 tempest-ServerActionsV293TestJSON-169231013-project-member] Lock "cache_volume_driver" "released" by "nova.virt.libvirt.driver.LibvirtDriver._get_volume_driver.<locals>._cache_volume_driver" :: held 0.007s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 17:52:20 user nova-compute[74613]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3088e3a8-2114-489e-9c16-32d5b64da4b3 tempest-ServerActionsV293TestJSON-169231013 tempest-ServerActionsV293TestJSON-169231013-project-member] [instance: 8de2ffb3-e264-49f7-8581-6eae21adcaeb] Calling os-brick to attach iSCSI Volume {{(pid=74613) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 29 17:52:20 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-3088e3a8-2114-489e-9c16-32d5b64da4b3 tempest-ServerActionsV293TestJSON-169231013 tempest-ServerActionsV293TestJSON-169231013-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff828156890>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:fbbdc3d2-136d-4fba-b6ba-f27f35a0733b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QpqiVKeo', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74613) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 17:52:20 user nova-compute[74613]: WARNING os_brick.initiator.connectors.base [None req-3088e3a8-2114-489e-9c16-32d5b64da4b3 tempest-ServerActionsV293TestJSON-169231013 tempest-ServerActionsV293TestJSON-169231013-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 17:52:20 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.base [None req-3088e3a8-2114-489e-9c16-32d5b64da4b3 tempest-ServerActionsV293TestJSON-169231013 tempest-ServerActionsV293TestJSON-169231013-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 17:52:20 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.base [None req-3088e3a8-2114-489e-9c16-32d5b64da4b3 tempest-ServerActionsV293TestJSON-169231013 tempest-ServerActionsV293TestJSON-169231013-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 17:52:20 user nova-compute[74613]: WARNING os_brick.initiator.connectors.base [None req-3088e3a8-2114-489e-9c16-32d5b64da4b3 tempest-ServerActionsV293TestJSON-169231013 tempest-ServerActionsV293TestJSON-169231013-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 17:52:20 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.base [None req-3088e3a8-2114-489e-9c16-32d5b64da4b3 tempest-ServerActionsV293TestJSON-169231013 tempest-ServerActionsV293TestJSON-169231013-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:fbbdc3d2-136d-4fba-b6ba-f27f35a0733b" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 17:52:20 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.base [None req-3088e3a8-2114-489e-9c16-32d5b64da4b3 tempest-ServerActionsV293TestJSON-169231013 tempest-ServerActionsV293TestJSON-169231013-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:fbbdc3d2-136d-4fba-b6ba-f27f35a0733b" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 17:52:20 user nova-compute[74613]: INFO os_brick.initiator.connectors.iscsi [None req-3088e3a8-2114-489e-9c16-32d5b64da4b3 tempest-ServerActionsV293TestJSON-169231013 tempest-ServerActionsV293TestJSON-169231013-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 29 17:52:20 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fbbdc3d2-136d-4fba-b6ba-f27f35a0733b -p 172.16.0.220:3260 {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 17:52:20 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fbbdc3d2-136d-4fba-b6ba-f27f35a0733b -p 172.16.0.220:3260" returned: 21 in 0.015s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 17:52:20 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e1cb7b5-0fcf-4de9-88b3-5bb27f5edf22]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 17:52:20 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-3088e3a8-2114-489e-9c16-32d5b64da4b3 tempest-ServerActionsV293TestJSON-169231013 tempest-ServerActionsV293TestJSON-169231013-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 29 17:52:20 user nova-compute[74613]:  {{(pid=74613) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 17:52:20 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fbbdc3d2-136d-4fba-b6ba-f27f35a0733b -p 172.16.0.220:3260 --interface default --op new {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 17:52:20 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fbbdc3d2-136d-4fba-b6ba-f27f35a0733b -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 17:52:20 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[1fd46dc8-8cfd-49db-9a68-66412d2483b7]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:fbbdc3d2-136d-4fba-b6ba-f27f35a0733b] added\n', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 17:52:20 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-3088e3a8-2114-489e-9c16-32d5b64da4b3 tempest-ServerActionsV293TestJSON-169231013 tempest-ServerActionsV293TestJSON-169231013-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:fbbdc3d2-136d-4fba-b6ba-f27f35a0733b] added
Nov 29 17:52:20 user nova-compute[74613]:  stderr= {{(pid=74613) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 17:52:20 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fbbdc3d2-136d-4fba-b6ba-f27f35a0733b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 17:52:20 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fbbdc3d2-136d-4fba-b6ba-f27f35a0733b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.026s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 17:52:20 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa904fe9-5e02-40d2-a007-fe1f50ac32c5]: (4, ('', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 17:52:20 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-3088e3a8-2114-489e-9c16-32d5b64da4b3 tempest-ServerActionsV293TestJSON-169231013 tempest-ServerActionsV293TestJSON-169231013-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74613) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 17:52:20 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fbbdc3d2-136d-4fba-b6ba-f27f35a0733b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 17:52:20 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fbbdc3d2-136d-4fba-b6ba-f27f35a0733b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 17:52:20 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[b96207c9-5fa1-4fbb-9ad2-ddf95d8122bb]: (4, ('', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 17:52:20 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-3088e3a8-2114-489e-9c16-32d5b64da4b3 tempest-ServerActionsV293TestJSON-169231013 tempest-ServerActionsV293TestJSON-169231013-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74613) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 17:52:20 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fbbdc3d2-136d-4fba-b6ba-f27f35a0733b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v QpqiVKeo {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 17:52:20 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fbbdc3d2-136d-4fba-b6ba-f27f35a0733b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v QpqiVKeo" returned: 0 in 0.017s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 17:52:20 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[46e1af85-affa-49df-8073-595bfa2bebf2]: (4, ('', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 17:52:20 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-3088e3a8-2114-489e-9c16-32d5b64da4b3 tempest-ServerActionsV293TestJSON-169231013 tempest-ServerActionsV293TestJSON-169231013-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'QpqiVKeo'): stdout= stderr= {{(pid=74613) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 17:52:20 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fbbdc3d2-136d-4fba-b6ba-f27f35a0733b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 17:52:20 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fbbdc3d2-136d-4fba-b6ba-f27f35a0733b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 17:52:20 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[44054811-a5a8-4bcc-bdd7-59bc4f8f07fe]: (4, ('', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 17:52:20 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-3088e3a8-2114-489e-9c16-32d5b64da4b3 tempest-ServerActionsV293TestJSON-169231013 tempest-ServerActionsV293TestJSON-169231013-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74613) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 17:52:20 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 17:52:20 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.018s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 17:52:20 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[93f6128e-d1c3-4fb9-803b-a5a933be15ca]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 17:52:20 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-3088e3a8-2114-489e-9c16-32d5b64da4b3 tempest-ServerActionsV293TestJSON-169231013 tempest-ServerActionsV293TestJSON-169231013-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Nov 29 17:52:20 user nova-compute[74613]:  {{(pid=74613) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 17:52:20 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-3088e3a8-2114-489e-9c16-32d5b64da4b3 tempest-ServerActionsV293TestJSON-169231013 tempest-ServerActionsV293TestJSON-169231013-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Nov 29 17:52:20 user nova-compute[74613]:  {{(pid=74613) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 17:52:20 user nova-compute[74613]: WARNING os_brick.initiator.connectors.iscsi [None req-3088e3a8-2114-489e-9c16-32d5b64da4b3 tempest-ServerActionsV293TestJSON-169231013 tempest-ServerActionsV293TestJSON-169231013-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Nov 29 17:52:20 user nova-compute[74613]: 
Nov 29 17:52:20 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fbbdc3d2-136d-4fba-b6ba-f27f35a0733b -p 172.16.0.220:3260 --login {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 17:52:20 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fbbdc3d2-136d-4fba-b6ba-f27f35a0733b -p 172.16.0.220:3260 --login" returned: 0 in 0.054s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 17:52:20 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef38a2dd-2959-4bd8-9cb9-fa3685bf2669]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:fbbdc3d2-136d-4fba-b6ba-f27f35a0733b, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:fbbdc3d2-136d-4fba-b6ba-f27f35a0733b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 17:52:20 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-3088e3a8-2114-489e-9c16-32d5b64da4b3 tempest-ServerActionsV293TestJSON-169231013 tempest-ServerActionsV293TestJSON-169231013-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:fbbdc3d2-136d-4fba-b6ba-f27f35a0733b, portal: 172.16.0.220,3260]
Nov 29 17:52:20 user nova-compute[74613]: Login to [iface: default, target: iqn.2010-10.org.openstack:fbbdc3d2-136d-4fba-b6ba-f27f35a0733b, portal: 172.16.0.220,3260] successful.
Nov 29 17:52:20 user nova-compute[74613]:  stderr= {{(pid=74613) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 17:52:20 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fbbdc3d2-136d-4fba-b6ba-f27f35a0733b -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 17:52:20 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fbbdc3d2-136d-4fba-b6ba-f27f35a0733b -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 17:52:20 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7f05466-05c9-4cb9-adf0-25170e999a7c]: (4, ('', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 17:52:20 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-3088e3a8-2114-489e-9c16-32d5b64da4b3 tempest-ServerActionsV293TestJSON-169231013 tempest-ServerActionsV293TestJSON-169231013-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74613) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 17:52:20 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 17:52:20 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 17:52:20 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9ff4e0d-0ec8-46de-b6a8-efebd0dd2ccd]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fbbdc3d2-136d-4fba-b6ba-f27f35a0733b (non-flash)\n', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 17:52:20 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-3088e3a8-2114-489e-9c16-32d5b64da4b3 tempest-ServerActionsV293TestJSON-169231013 tempest-ServerActionsV293TestJSON-169231013-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fbbdc3d2-136d-4fba-b6ba-f27f35a0733b (non-flash)
Nov 29 17:52:20 user nova-compute[74613]:  stderr= {{(pid=74613) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 17:52:20 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-3088e3a8-2114-489e-9c16-32d5b64da4b3 tempest-ServerActionsV293TestJSON-169231013 tempest-ServerActionsV293TestJSON-169231013-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fbbdc3d2-136d-4fba-b6ba-f27f35a0733b (non-flash)
Nov 29 17:52:20 user nova-compute[74613]:  stderr= {{(pid=74613) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 17:52:20 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.base [None req-3088e3a8-2114-489e-9c16-32d5b64da4b3 tempest-ServerActionsV293TestJSON-169231013 tempest-ServerActionsV293TestJSON-169231013-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:fbbdc3d2-136d-4fba-b6ba-f27f35a0733b" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.274s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 17:52:20 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-3088e3a8-2114-489e-9c16-32d5b64da4b3 tempest-ServerActionsV293TestJSON-169231013 tempest-ServerActionsV293TestJSON-169231013-project-member] Connected to 172.16.0.220:3260 {{(pid=74613) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 29 17:52:20 user nova-compute[74613]: DEBUG os_brick.initiator.linuxscsi [None req-3088e3a8-2114-489e-9c16-32d5b64da4b3 tempest-ServerActionsV293TestJSON-169231013 tempest-ServerActionsV293TestJSON-169231013-project-member] HCTL ('33', '-', '-', 0) found on session 2 with lun 0 {{(pid=74613) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 29 17:52:20 user nova-compute[74613]: DEBUG os_brick.initiator.linuxscsi [None req-3088e3a8-2114-489e-9c16-32d5b64da4b3 tempest-ServerActionsV293TestJSON-169231013 tempest-ServerActionsV293TestJSON-169231013-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74613) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 29 17:52:20 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 17:52:20 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.025s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 17:52:20 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[144110a7-bec9-4d24-816a-ddaea0ef1666]: (4, ('- - 0', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 17:52:20 user nova-compute[74613]: DEBUG os_brick.initiator.linuxscsi [None req-3088e3a8-2114-489e-9c16-32d5b64da4b3 tempest-ServerActionsV293TestJSON-169231013 tempest-ServerActionsV293TestJSON-169231013-project-member] Searching for a device in session 2 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74613) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 29 17:52:20 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-3088e3a8-2114-489e-9c16-32d5b64da4b3 tempest-ServerActionsV293TestJSON-169231013 tempest-ServerActionsV293TestJSON-169231013-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:fbbdc3d2-136d-4fba-b6ba-f27f35a0733b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QpqiVKeo', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74613) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 29 17:52:21 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.base [None req-3088e3a8-2114-489e-9c16-32d5b64da4b3 tempest-ServerActionsV293TestJSON-169231013 tempest-ServerActionsV293TestJSON-169231013-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.322s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 17:52:21 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-3088e3a8-2114-489e-9c16-32d5b64da4b3 tempest-ServerActionsV293TestJSON-169231013 tempest-ServerActionsV293TestJSON-169231013-project-member] <== connect_volume: return (1325ms) {'type': 'block', 'scsi_wwn': '23564663233633866', 'path': '/dev/sdb'} {{(pid=74613) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 17:52:21 user nova-compute[74613]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3088e3a8-2114-489e-9c16-32d5b64da4b3 tempest-ServerActionsV293TestJSON-169231013 tempest-ServerActionsV293TestJSON-169231013-project-member] [instance: 8de2ffb3-e264-49f7-8581-6eae21adcaeb] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23564663233633866', 'path': '/dev/sdb'} {{(pid=74613) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 29 17:52:21 user nova-compute[74613]: DEBUG nova.virt.libvirt.vif [None req-3088e3a8-2114-489e-9c16-32d5b64da4b3 tempest-ServerActionsV293TestJSON-169231013 tempest-ServerActionsV293TestJSON-169231013-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T17:51:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-1066065930',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-1066065930',id=10,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPsifDrYmKd7BdWAgOW/UBypymQ/ZyWR2rXbLuQqhER8jILIr18fIVxVvqAayJ3WqD/9D57nxyUSA2R/v9weZ4t52MHUcMk7woMKaTPaFq53IUB3CUtirmx+f0BtY1qK5A==',key_name='tempest-keypair-1945453411',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='8d9b3ae2eee040bb84ff5065d07552d4',ramdisk_id='',reservation_id='r-nv3xeq3h',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_signature_verified='False',network_allocated='True',owner_project_name='tempest-ServerActionsV293TestJSON-169231013',owner_user_name='tempest-ServerActionsV293TestJSON-169231013-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T17:52:02Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1f67cfc0d0054244b74d7f1d64628db8',uuid=8de2ffb3-e264-49f7-8581-6eae21adcaeb,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "51faf82e-9447-4f14-8724-e7939afb4d98", "address": "fa:16:3e:97:b9:00", "network": {"id": "59f09b07-14df-494d-bb8f-3b5d4a7b9711", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-981004620-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8d9b3ae2eee040bb84ff5065d07552d4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap51faf82e-94", "ovs_interfaceid": "51faf82e-9447-4f14-8724-e7939afb4d98", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74613) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 29 17:52:21 user nova-compute[74613]: DEBUG nova.network.os_vif_util [None req-3088e3a8-2114-489e-9c16-32d5b64da4b3 tempest-ServerActionsV293TestJSON-169231013 tempest-ServerActionsV293TestJSON-169231013-project-member] Converting VIF {"id": "51faf82e-9447-4f14-8724-e7939afb4d98", "address": "fa:16:3e:97:b9:00", "network": {"id": "59f09b07-14df-494d-bb8f-3b5d4a7b9711", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-981004620-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8d9b3ae2eee040bb84ff5065d07552d4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap51faf82e-94", "ovs_interfaceid": "51faf82e-9447-4f14-8724-e7939afb4d98", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74613) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 17:52:21 user nova-compute[74613]: DEBUG nova.network.os_vif_util [None req-3088e3a8-2114-489e-9c16-32d5b64da4b3 tempest-ServerActionsV293TestJSON-169231013 tempest-ServerActionsV293TestJSON-169231013-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:97:b9:00,bridge_name='br-int',has_traffic_filtering=True,id=51faf82e-9447-4f14-8724-e7939afb4d98,network=Network(59f09b07-14df-494d-bb8f-3b5d4a7b9711),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap51faf82e-94') {{(pid=74613) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 17:52:21 user nova-compute[74613]: DEBUG nova.objects.instance [None req-3088e3a8-2114-489e-9c16-32d5b64da4b3 tempest-ServerActionsV293TestJSON-169231013 tempest-ServerActionsV293TestJSON-169231013-project-member] Lazy-loading 'pci_devices' on Instance uuid 8de2ffb3-e264-49f7-8581-6eae21adcaeb {{(pid=74613) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 17:52:21 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-3088e3a8-2114-489e-9c16-32d5b64da4b3 tempest-ServerActionsV293TestJSON-169231013 tempest-ServerActionsV293TestJSON-169231013-project-member] [instance: 8de2ffb3-e264-49f7-8581-6eae21adcaeb] End _get_guest_xml xml=<domain type="kvm">
Nov 29 17:52:21 user nova-compute[74613]:   <uuid>8de2ffb3-e264-49f7-8581-6eae21adcaeb</uuid>
Nov 29 17:52:21 user nova-compute[74613]:   <name>instance-0000000a</name>
Nov 29 17:52:21 user nova-compute[74613]:   <memory>524288</memory>
Nov 29 17:52:21 user nova-compute[74613]:   <vcpu>1</vcpu>
Nov 29 17:52:21 user nova-compute[74613]:   <metadata>
Nov 29 17:52:21 user nova-compute[74613]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 29 17:52:21 user nova-compute[74613]:       <nova:package version="0.0.0"/>
Nov 29 17:52:21 user nova-compute[74613]:       <nova:name>tempest-ServerActionsV293TestJSON-server-1066065930</nova:name>
Nov 29 17:52:21 user nova-compute[74613]:       <nova:creationTime>2023-11-29 17:52:20</nova:creationTime>
Nov 29 17:52:21 user nova-compute[74613]:       <nova:flavor name="m1.tiny">
Nov 29 17:52:21 user nova-compute[74613]:         <nova:memory>512</nova:memory>
Nov 29 17:52:21 user nova-compute[74613]:         <nova:disk>1</nova:disk>
Nov 29 17:52:21 user nova-compute[74613]:         <nova:swap>0</nova:swap>
Nov 29 17:52:21 user nova-compute[74613]:         <nova:ephemeral>0</nova:ephemeral>
Nov 29 17:52:21 user nova-compute[74613]:         <nova:vcpus>1</nova:vcpus>
Nov 29 17:52:21 user nova-compute[74613]:       </nova:flavor>
Nov 29 17:52:21 user nova-compute[74613]:       <nova:owner>
Nov 29 17:52:21 user nova-compute[74613]:         <nova:user uuid="1f67cfc0d0054244b74d7f1d64628db8">tempest-ServerActionsV293TestJSON-169231013-project-member</nova:user>
Nov 29 17:52:21 user nova-compute[74613]:         <nova:project uuid="8d9b3ae2eee040bb84ff5065d07552d4">tempest-ServerActionsV293TestJSON-169231013</nova:project>
Nov 29 17:52:21 user nova-compute[74613]:       </nova:owner>
Nov 29 17:52:21 user nova-compute[74613]:       <nova:ports>
Nov 29 17:52:21 user nova-compute[74613]:         <nova:port uuid="51faf82e-9447-4f14-8724-e7939afb4d98">
Nov 29 17:52:21 user nova-compute[74613]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Nov 29 17:52:21 user nova-compute[74613]:         </nova:port>
Nov 29 17:52:21 user nova-compute[74613]:       </nova:ports>
Nov 29 17:52:21 user nova-compute[74613]:     </nova:instance>
Nov 29 17:52:21 user nova-compute[74613]:   </metadata>
Nov 29 17:52:21 user nova-compute[74613]:   <sysinfo type="smbios">
Nov 29 17:52:21 user nova-compute[74613]:     <system>
Nov 29 17:52:21 user nova-compute[74613]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 29 17:52:21 user nova-compute[74613]:       <entry name="product">OpenStack Nova</entry>
Nov 29 17:52:21 user nova-compute[74613]:       <entry name="version">0.0.0</entry>
Nov 29 17:52:21 user nova-compute[74613]:       <entry name="serial">8de2ffb3-e264-49f7-8581-6eae21adcaeb</entry>
Nov 29 17:52:21 user nova-compute[74613]:       <entry name="uuid">8de2ffb3-e264-49f7-8581-6eae21adcaeb</entry>
Nov 29 17:52:21 user nova-compute[74613]:       <entry name="family">Virtual Machine</entry>
Nov 29 17:52:21 user nova-compute[74613]:     </system>
Nov 29 17:52:21 user nova-compute[74613]:   </sysinfo>
Nov 29 17:52:21 user nova-compute[74613]:   <os>
Nov 29 17:52:21 user nova-compute[74613]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 29 17:52:21 user nova-compute[74613]:     <boot dev="hd"/>
Nov 29 17:52:21 user nova-compute[74613]:     <smbios mode="sysinfo"/>
Nov 29 17:52:21 user nova-compute[74613]:   </os>
Nov 29 17:52:21 user nova-compute[74613]:   <features>
Nov 29 17:52:21 user nova-compute[74613]:     <acpi/>
Nov 29 17:52:21 user nova-compute[74613]:     <apic/>
Nov 29 17:52:21 user nova-compute[74613]:     <vmcoreinfo/>
Nov 29 17:52:21 user nova-compute[74613]:   </features>
Nov 29 17:52:21 user nova-compute[74613]:   <clock offset="utc">
Nov 29 17:52:21 user nova-compute[74613]:     <timer name="pit" tickpolicy="delay"/>
Nov 29 17:52:21 user nova-compute[74613]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 29 17:52:21 user nova-compute[74613]:     <timer name="hpet" present="no"/>
Nov 29 17:52:21 user nova-compute[74613]:   </clock>
Nov 29 17:52:21 user nova-compute[74613]:   <cpu mode="custom" match="exact">
Nov 29 17:52:21 user nova-compute[74613]:     <model>Nehalem</model>
Nov 29 17:52:21 user nova-compute[74613]:     <topology sockets="1" cores="1" threads="1"/>
Nov 29 17:52:21 user nova-compute[74613]:   </cpu>
Nov 29 17:52:21 user nova-compute[74613]:   <devices>
Nov 29 17:52:21 user nova-compute[74613]:     <disk type="block" device="disk">
Nov 29 17:52:21 user nova-compute[74613]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 17:52:21 user nova-compute[74613]:       <source dev="/dev/sdb"/>
Nov 29 17:52:21 user nova-compute[74613]:       <target dev="vda" bus="virtio"/>
Nov 29 17:52:21 user nova-compute[74613]:       <serial>fbbdc3d2-136d-4fba-b6ba-f27f35a0733b</serial>
Nov 29 17:52:21 user nova-compute[74613]:     </disk>
Nov 29 17:52:21 user nova-compute[74613]:     <interface type="ethernet">
Nov 29 17:52:21 user nova-compute[74613]:       <mac address="fa:16:3e:97:b9:00"/>
Nov 29 17:52:21 user nova-compute[74613]:       <model type="virtio"/>
Nov 29 17:52:21 user nova-compute[74613]:       <mtu size="1442"/>
Nov 29 17:52:21 user nova-compute[74613]:       <target dev="tap51faf82e-94"/>
Nov 29 17:52:21 user nova-compute[74613]:     </interface>
Nov 29 17:52:21 user nova-compute[74613]:     <serial type="pty">
Nov 29 17:52:21 user nova-compute[74613]:       <log file="/opt/stack/data/nova/instances/8de2ffb3-e264-49f7-8581-6eae21adcaeb/console.log" append="off"/>
Nov 29 17:52:21 user nova-compute[74613]:     </serial>
Nov 29 17:52:21 user nova-compute[74613]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 29 17:52:21 user nova-compute[74613]:     <video>
Nov 29 17:52:21 user nova-compute[74613]:       <model type="virtio"/>
Nov 29 17:52:21 user nova-compute[74613]:     </video>
Nov 29 17:52:21 user nova-compute[74613]:     <rng model="virtio">
Nov 29 17:52:21 user nova-compute[74613]:       <backend model="random">/dev/urandom</backend>
Nov 29 17:52:21 user nova-compute[74613]:     </rng>
Nov 29 17:52:21 user nova-compute[74613]:     <controller type="usb" index="0" model="none"/>
Nov 29 17:52:21 user nova-compute[74613]:     <memballoon model="virtio">
Nov 29 17:52:21 user nova-compute[74613]:       <stats period="10"/>
Nov 29 17:52:21 user nova-compute[74613]:     </memballoon>
Nov 29 17:52:21 user nova-compute[74613]:   </devices>
Nov 29 17:52:21 user nova-compute[74613]: </domain>
Nov 29 17:52:21 user nova-compute[74613]:  {{(pid=74613) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 29 17:52:21 user nova-compute[74613]: DEBUG nova.virt.libvirt.vif [None req-3088e3a8-2114-489e-9c16-32d5b64da4b3 tempest-ServerActionsV293TestJSON-169231013 tempest-ServerActionsV293TestJSON-169231013-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T17:51:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-1066065930',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-1066065930',id=10,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPsifDrYmKd7BdWAgOW/UBypymQ/ZyWR2rXbLuQqhER8jILIr18fIVxVvqAayJ3WqD/9D57nxyUSA2R/v9weZ4t52MHUcMk7woMKaTPaFq53IUB3CUtirmx+f0BtY1qK5A==',key_name='tempest-keypair-1945453411',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='8d9b3ae2eee040bb84ff5065d07552d4',ramdisk_id='',reservation_id='r-nv3xeq3h',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_signature_verified='False',network_allocated='True',owner_project_name='tempest-ServerActionsV293TestJSON-169231013',owner_user_name='tempest-ServerActionsV293TestJSON-169231013-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T17:52:02Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1f67cfc0d0054244b74d7f1d64628db8',uuid=8de2ffb3-e264-49f7-8581-6eae21adcaeb,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "51faf82e-9447-4f14-8724-e7939afb4d98", "address": "fa:16:3e:97:b9:00", "network": {"id": "59f09b07-14df-494d-bb8f-3b5d4a7b9711", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-981004620-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8d9b3ae2eee040bb84ff5065d07552d4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap51faf82e-94", "ovs_interfaceid": "51faf82e-9447-4f14-8724-e7939afb4d98", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74613) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 29 17:52:21 user nova-compute[74613]: DEBUG nova.network.os_vif_util [None req-3088e3a8-2114-489e-9c16-32d5b64da4b3 tempest-ServerActionsV293TestJSON-169231013 tempest-ServerActionsV293TestJSON-169231013-project-member] Converting VIF {"id": "51faf82e-9447-4f14-8724-e7939afb4d98", "address": "fa:16:3e:97:b9:00", "network": {"id": "59f09b07-14df-494d-bb8f-3b5d4a7b9711", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-981004620-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8d9b3ae2eee040bb84ff5065d07552d4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap51faf82e-94", "ovs_interfaceid": "51faf82e-9447-4f14-8724-e7939afb4d98", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74613) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 17:52:21 user nova-compute[74613]: DEBUG nova.network.os_vif_util [None req-3088e3a8-2114-489e-9c16-32d5b64da4b3 tempest-ServerActionsV293TestJSON-169231013 tempest-ServerActionsV293TestJSON-169231013-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:97:b9:00,bridge_name='br-int',has_traffic_filtering=True,id=51faf82e-9447-4f14-8724-e7939afb4d98,network=Network(59f09b07-14df-494d-bb8f-3b5d4a7b9711),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap51faf82e-94') {{(pid=74613) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 17:52:21 user nova-compute[74613]: DEBUG os_vif [None req-3088e3a8-2114-489e-9c16-32d5b64da4b3 tempest-ServerActionsV293TestJSON-169231013 tempest-ServerActionsV293TestJSON-169231013-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:97:b9:00,bridge_name='br-int',has_traffic_filtering=True,id=51faf82e-9447-4f14-8724-e7939afb4d98,network=Network(59f09b07-14df-494d-bb8f-3b5d4a7b9711),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap51faf82e-94') {{(pid=74613) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 29 17:52:21 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:52:21 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74613) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 17:52:21 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74613) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 29 17:52:21 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:52:21 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'cb862445-97d9-50f1-bca5-de59e3f9ea15', '_type': 'linux-noop'}}, row=False) {{(pid=74613) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 17:52:21 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:52:21 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:52:21 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:52:21 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap51faf82e-94, may_exist=True, interface_attrs={}) {{(pid=74613) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 17:52:21 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap51faf82e-94, col_values=(('qos', UUID('cbaef208-32d1-493d-9435-b7e96725af6c')),), if_exists=True) {{(pid=74613) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 17:52:21 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap51faf82e-94, col_values=(('external_ids', {'iface-id': '51faf82e-9447-4f14-8724-e7939afb4d98', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:97:b9:00', 'vm-uuid': '8de2ffb3-e264-49f7-8581-6eae21adcaeb'}),), if_exists=True) {{(pid=74613) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 17:52:21 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:52:21 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 17:52:21 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:52:21 user nova-compute[74613]: INFO os_vif [None req-3088e3a8-2114-489e-9c16-32d5b64da4b3 tempest-ServerActionsV293TestJSON-169231013 tempest-ServerActionsV293TestJSON-169231013-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:97:b9:00,bridge_name='br-int',has_traffic_filtering=True,id=51faf82e-9447-4f14-8724-e7939afb4d98,network=Network(59f09b07-14df-494d-bb8f-3b5d4a7b9711),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap51faf82e-94')
Nov 29 17:52:21 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-3088e3a8-2114-489e-9c16-32d5b64da4b3 tempest-ServerActionsV293TestJSON-169231013 tempest-ServerActionsV293TestJSON-169231013-project-member] No BDM found with device name vda, not building metadata. {{(pid=74613) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 17:52:21 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-3088e3a8-2114-489e-9c16-32d5b64da4b3 tempest-ServerActionsV293TestJSON-169231013 tempest-ServerActionsV293TestJSON-169231013-project-member] No VIF found with MAC fa:16:3e:97:b9:00, not building metadata {{(pid=74613) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 29 17:52:23 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:52:23 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:52:23 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:52:23 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:52:23 user nova-compute[74613]: DEBUG nova.compute.manager [req-251369fb-59d4-4785-bbf3-f778130c87fb req-9b90cbef-2baa-4c6a-abb6-d26a6f5a243c service nova] [instance: 8de2ffb3-e264-49f7-8581-6eae21adcaeb] Received event network-vif-plugged-51faf82e-9447-4f14-8724-e7939afb4d98 {{(pid=74613) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 17:52:23 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-251369fb-59d4-4785-bbf3-f778130c87fb req-9b90cbef-2baa-4c6a-abb6-d26a6f5a243c service nova] Acquiring lock "8de2ffb3-e264-49f7-8581-6eae21adcaeb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 17:52:23 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-251369fb-59d4-4785-bbf3-f778130c87fb req-9b90cbef-2baa-4c6a-abb6-d26a6f5a243c service nova] Lock "8de2ffb3-e264-49f7-8581-6eae21adcaeb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 17:52:23 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-251369fb-59d4-4785-bbf3-f778130c87fb req-9b90cbef-2baa-4c6a-abb6-d26a6f5a243c service nova] Lock "8de2ffb3-e264-49f7-8581-6eae21adcaeb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.004s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 17:52:23 user nova-compute[74613]: DEBUG nova.compute.manager [req-251369fb-59d4-4785-bbf3-f778130c87fb req-9b90cbef-2baa-4c6a-abb6-d26a6f5a243c service nova] [instance: 8de2ffb3-e264-49f7-8581-6eae21adcaeb] No waiting events found dispatching network-vif-plugged-51faf82e-9447-4f14-8724-e7939afb4d98 {{(pid=74613) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 17:52:23 user nova-compute[74613]: WARNING nova.compute.manager [req-251369fb-59d4-4785-bbf3-f778130c87fb req-9b90cbef-2baa-4c6a-abb6-d26a6f5a243c service nova] [instance: 8de2ffb3-e264-49f7-8581-6eae21adcaeb] Received unexpected event network-vif-plugged-51faf82e-9447-4f14-8724-e7939afb4d98 for instance with vm_state building and task_state spawning.
Nov 29 17:52:23 user nova-compute[74613]: DEBUG oslo_service.periodic_task [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74613) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 17:52:24 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:52:24 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:52:24 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:52:24 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-674e6337-afc0-4f43-9e4e-e7f97f5baa67 tempest-TaggedBootDevicesTest_v242-869407180 tempest-TaggedBootDevicesTest_v242-869407180-project-member] Acquiring lock "3f285832-64a7-48e8-875a-f9e1566a66b6" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 17:52:24 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-674e6337-afc0-4f43-9e4e-e7f97f5baa67 tempest-TaggedBootDevicesTest_v242-869407180 tempest-TaggedBootDevicesTest_v242-869407180-project-member] Lock "3f285832-64a7-48e8-875a-f9e1566a66b6" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 17:52:24 user nova-compute[74613]: DEBUG nova.compute.manager [None req-674e6337-afc0-4f43-9e4e-e7f97f5baa67 tempest-TaggedBootDevicesTest_v242-869407180 tempest-TaggedBootDevicesTest_v242-869407180-project-member] [instance: 3f285832-64a7-48e8-875a-f9e1566a66b6] Starting instance... {{(pid=74613) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 29 17:52:24 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:52:25 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-674e6337-afc0-4f43-9e4e-e7f97f5baa67 tempest-TaggedBootDevicesTest_v242-869407180 tempest-TaggedBootDevicesTest_v242-869407180-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 17:52:25 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-674e6337-afc0-4f43-9e4e-e7f97f5baa67 tempest-TaggedBootDevicesTest_v242-869407180 tempest-TaggedBootDevicesTest_v242-869407180-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 17:52:25 user nova-compute[74613]: DEBUG nova.virt.hardware [None req-674e6337-afc0-4f43-9e4e-e7f97f5baa67 tempest-TaggedBootDevicesTest_v242-869407180 tempest-TaggedBootDevicesTest_v242-869407180-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74613) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 29 17:52:25 user nova-compute[74613]: INFO nova.compute.claims [None req-674e6337-afc0-4f43-9e4e-e7f97f5baa67 tempest-TaggedBootDevicesTest_v242-869407180 tempest-TaggedBootDevicesTest_v242-869407180-project-member] [instance: 3f285832-64a7-48e8-875a-f9e1566a66b6] Claim successful on node user
Nov 29 17:52:25 user nova-compute[74613]: DEBUG nova.compute.provider_tree [None req-674e6337-afc0-4f43-9e4e-e7f97f5baa67 tempest-TaggedBootDevicesTest_v242-869407180 tempest-TaggedBootDevicesTest_v242-869407180-project-member] Inventory has not changed in ProviderTree for provider: 639d980e-3b12-44b1-b8f4-1812416fa4dd {{(pid=74613) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 17:52:25 user nova-compute[74613]: DEBUG nova.scheduler.client.report [None req-674e6337-afc0-4f43-9e4e-e7f97f5baa67 tempest-TaggedBootDevicesTest_v242-869407180 tempest-TaggedBootDevicesTest_v242-869407180-project-member] Inventory has not changed for provider 639d980e-3b12-44b1-b8f4-1812416fa4dd based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74613) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 17:52:25 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-674e6337-afc0-4f43-9e4e-e7f97f5baa67 tempest-TaggedBootDevicesTest_v242-869407180 tempest-TaggedBootDevicesTest_v242-869407180-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.472s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 17:52:25 user nova-compute[74613]: DEBUG nova.compute.manager [None req-674e6337-afc0-4f43-9e4e-e7f97f5baa67 tempest-TaggedBootDevicesTest_v242-869407180 tempest-TaggedBootDevicesTest_v242-869407180-project-member] [instance: 3f285832-64a7-48e8-875a-f9e1566a66b6] Start building networks asynchronously for instance. {{(pid=74613) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 29 17:52:25 user nova-compute[74613]: DEBUG nova.compute.manager [None req-674e6337-afc0-4f43-9e4e-e7f97f5baa67 tempest-TaggedBootDevicesTest_v242-869407180 tempest-TaggedBootDevicesTest_v242-869407180-project-member] [instance: 3f285832-64a7-48e8-875a-f9e1566a66b6] Allocating IP information in the background. {{(pid=74613) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 29 17:52:25 user nova-compute[74613]: DEBUG nova.network.neutron [None req-674e6337-afc0-4f43-9e4e-e7f97f5baa67 tempest-TaggedBootDevicesTest_v242-869407180 tempest-TaggedBootDevicesTest_v242-869407180-project-member] [instance: 3f285832-64a7-48e8-875a-f9e1566a66b6] allocate_for_instance() {{(pid=74613) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 29 17:52:25 user nova-compute[74613]: INFO nova.virt.libvirt.driver [None req-674e6337-afc0-4f43-9e4e-e7f97f5baa67 tempest-TaggedBootDevicesTest_v242-869407180 tempest-TaggedBootDevicesTest_v242-869407180-project-member] [instance: 3f285832-64a7-48e8-875a-f9e1566a66b6] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 29 17:52:25 user nova-compute[74613]: DEBUG nova.compute.manager [req-aaf58661-cfe4-4695-8f21-6a75b0c6ae89 req-1e1e03e9-79bc-4de4-ac41-e06182180424 service nova] [instance: 8de2ffb3-e264-49f7-8581-6eae21adcaeb] Received event network-vif-plugged-51faf82e-9447-4f14-8724-e7939afb4d98 {{(pid=74613) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 17:52:25 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-aaf58661-cfe4-4695-8f21-6a75b0c6ae89 req-1e1e03e9-79bc-4de4-ac41-e06182180424 service nova] Acquiring lock "8de2ffb3-e264-49f7-8581-6eae21adcaeb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 17:52:25 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-aaf58661-cfe4-4695-8f21-6a75b0c6ae89 req-1e1e03e9-79bc-4de4-ac41-e06182180424 service nova] Lock "8de2ffb3-e264-49f7-8581-6eae21adcaeb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 17:52:25 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-aaf58661-cfe4-4695-8f21-6a75b0c6ae89 req-1e1e03e9-79bc-4de4-ac41-e06182180424 service nova] Lock "8de2ffb3-e264-49f7-8581-6eae21adcaeb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 17:52:25 user nova-compute[74613]: DEBUG nova.compute.manager [req-aaf58661-cfe4-4695-8f21-6a75b0c6ae89 req-1e1e03e9-79bc-4de4-ac41-e06182180424 service nova] [instance: 8de2ffb3-e264-49f7-8581-6eae21adcaeb] No waiting events found dispatching network-vif-plugged-51faf82e-9447-4f14-8724-e7939afb4d98 {{(pid=74613) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 17:52:25 user nova-compute[74613]: WARNING nova.compute.manager [req-aaf58661-cfe4-4695-8f21-6a75b0c6ae89 req-1e1e03e9-79bc-4de4-ac41-e06182180424 service nova] [instance: 8de2ffb3-e264-49f7-8581-6eae21adcaeb] Received unexpected event network-vif-plugged-51faf82e-9447-4f14-8724-e7939afb4d98 for instance with vm_state building and task_state spawning.
Nov 29 17:52:25 user nova-compute[74613]: DEBUG nova.compute.manager [None req-3088e3a8-2114-489e-9c16-32d5b64da4b3 tempest-ServerActionsV293TestJSON-169231013 tempest-ServerActionsV293TestJSON-169231013-project-member] [instance: 8de2ffb3-e264-49f7-8581-6eae21adcaeb] Instance event wait completed in 0 seconds for  {{(pid=74613) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 29 17:52:25 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-3088e3a8-2114-489e-9c16-32d5b64da4b3 tempest-ServerActionsV293TestJSON-169231013 tempest-ServerActionsV293TestJSON-169231013-project-member] [instance: 8de2ffb3-e264-49f7-8581-6eae21adcaeb] Guest created on hypervisor {{(pid=74613) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 29 17:52:25 user nova-compute[74613]: INFO nova.virt.libvirt.driver [-] [instance: 8de2ffb3-e264-49f7-8581-6eae21adcaeb] Instance spawned successfully.
Nov 29 17:52:25 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-3088e3a8-2114-489e-9c16-32d5b64da4b3 tempest-ServerActionsV293TestJSON-169231013 tempest-ServerActionsV293TestJSON-169231013-project-member] [instance: 8de2ffb3-e264-49f7-8581-6eae21adcaeb] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74613) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 29 17:52:25 user nova-compute[74613]: DEBUG nova.compute.manager [None req-674e6337-afc0-4f43-9e4e-e7f97f5baa67 tempest-TaggedBootDevicesTest_v242-869407180 tempest-TaggedBootDevicesTest_v242-869407180-project-member] [instance: 3f285832-64a7-48e8-875a-f9e1566a66b6] Start building block device mappings for instance. {{(pid=74613) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 29 17:52:25 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-3088e3a8-2114-489e-9c16-32d5b64da4b3 tempest-ServerActionsV293TestJSON-169231013 tempest-ServerActionsV293TestJSON-169231013-project-member] [instance: 8de2ffb3-e264-49f7-8581-6eae21adcaeb] Found default for hw_cdrom_bus of ide {{(pid=74613) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 17:52:25 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-3088e3a8-2114-489e-9c16-32d5b64da4b3 tempest-ServerActionsV293TestJSON-169231013 tempest-ServerActionsV293TestJSON-169231013-project-member] [instance: 8de2ffb3-e264-49f7-8581-6eae21adcaeb] Found default for hw_disk_bus of virtio {{(pid=74613) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 17:52:25 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-3088e3a8-2114-489e-9c16-32d5b64da4b3 tempest-ServerActionsV293TestJSON-169231013 tempest-ServerActionsV293TestJSON-169231013-project-member] [instance: 8de2ffb3-e264-49f7-8581-6eae21adcaeb] Found default for hw_input_bus of None {{(pid=74613) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 17:52:25 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-3088e3a8-2114-489e-9c16-32d5b64da4b3 tempest-ServerActionsV293TestJSON-169231013 tempest-ServerActionsV293TestJSON-169231013-project-member] [instance: 8de2ffb3-e264-49f7-8581-6eae21adcaeb] Found default for hw_pointer_model of None {{(pid=74613) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 17:52:25 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-3088e3a8-2114-489e-9c16-32d5b64da4b3 tempest-ServerActionsV293TestJSON-169231013 tempest-ServerActionsV293TestJSON-169231013-project-member] [instance: 8de2ffb3-e264-49f7-8581-6eae21adcaeb] Found default for hw_video_model of virtio {{(pid=74613) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 17:52:25 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-3088e3a8-2114-489e-9c16-32d5b64da4b3 tempest-ServerActionsV293TestJSON-169231013 tempest-ServerActionsV293TestJSON-169231013-project-member] [instance: 8de2ffb3-e264-49f7-8581-6eae21adcaeb] Found default for hw_vif_model of virtio {{(pid=74613) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 17:52:25 user nova-compute[74613]: INFO nova.virt.block_device [None req-674e6337-afc0-4f43-9e4e-e7f97f5baa67 tempest-TaggedBootDevicesTest_v242-869407180 tempest-TaggedBootDevicesTest_v242-869407180-project-member] [instance: 3f285832-64a7-48e8-875a-f9e1566a66b6] Booting with volume 24920064-fc81-4408-97d1-d8eff97a7554 at /dev/vda
Nov 29 17:52:25 user nova-compute[74613]: INFO nova.compute.manager [None req-3088e3a8-2114-489e-9c16-32d5b64da4b3 tempest-ServerActionsV293TestJSON-169231013 tempest-ServerActionsV293TestJSON-169231013-project-member] [instance: 8de2ffb3-e264-49f7-8581-6eae21adcaeb] Took 5.79 seconds to spawn the instance on the hypervisor.
Nov 29 17:52:25 user nova-compute[74613]: DEBUG nova.compute.manager [None req-3088e3a8-2114-489e-9c16-32d5b64da4b3 tempest-ServerActionsV293TestJSON-169231013 tempest-ServerActionsV293TestJSON-169231013-project-member] [instance: 8de2ffb3-e264-49f7-8581-6eae21adcaeb] Checking state {{(pid=74613) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 29 17:52:25 user nova-compute[74613]: DEBUG nova.policy [None req-674e6337-afc0-4f43-9e4e-e7f97f5baa67 tempest-TaggedBootDevicesTest_v242-869407180 tempest-TaggedBootDevicesTest_v242-869407180-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'e743f61509f44bcfac1b4baef1fd5c3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f655bcde631c4a839b98695eed5cfa4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74613) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 29 17:52:25 user nova-compute[74613]: DEBUG os_brick.utils [None req-674e6337-afc0-4f43-9e4e-e7f97f5baa67 tempest-TaggedBootDevicesTest_v242-869407180 tempest-TaggedBootDevicesTest_v242-869407180-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74613) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 17:52:25 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 17:52:25 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 17:52:25 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[97089734-4714-4fcc-8324-8505b12c04d7]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:400972819b5\n', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 17:52:25 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 17:52:25 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.018s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 17:52:25 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[20f60676-729d-4c76-8b8f-5abc619443a7]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 17:52:25 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 17:52:25 user nova-compute[74613]: INFO nova.compute.manager [None req-3088e3a8-2114-489e-9c16-32d5b64da4b3 tempest-ServerActionsV293TestJSON-169231013 tempest-ServerActionsV293TestJSON-169231013-project-member] [instance: 8de2ffb3-e264-49f7-8581-6eae21adcaeb] Took 25.34 seconds to build instance.
Nov 29 17:52:25 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 17:52:25 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[ecf23eda-ea84-477c-904a-897c5dc28f59]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 17:52:25 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b6da798-7007-4113-ba77-718e18146991]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 17:52:25 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-674e6337-afc0-4f43-9e4e-e7f97f5baa67 tempest-TaggedBootDevicesTest_v242-869407180 tempest-TaggedBootDevicesTest_v242-869407180-project-member] Running cmd (subprocess): nvme version {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 17:52:26 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-674e6337-afc0-4f43-9e4e-e7f97f5baa67 tempest-TaggedBootDevicesTest_v242-869407180 tempest-TaggedBootDevicesTest_v242-869407180-project-member] 'nvme version' failed. Not Retrying. {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 17:52:26 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.nvmeof [None req-674e6337-afc0-4f43-9e4e-e7f97f5baa67 tempest-TaggedBootDevicesTest_v242-869407180 tempest-TaggedBootDevicesTest_v242-869407180-project-member] nvme not present on system {{(pid=74613) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 29 17:52:26 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-3088e3a8-2114-489e-9c16-32d5b64da4b3 tempest-ServerActionsV293TestJSON-169231013 tempest-ServerActionsV293TestJSON-169231013-project-member] Lock "8de2ffb3-e264-49f7-8581-6eae21adcaeb" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 25.684s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 17:52:26 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 17:52:26 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 17:52:26 user nova-compute[74613]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 29 17:52:26 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f95af80-3a6a-47ea-a83f-ab50d445fc97]: (4, '') {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 17:52:26 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.lightos [None req-674e6337-afc0-4f43-9e4e-e7f97f5baa67 tempest-TaggedBootDevicesTest_v242-869407180 tempest-TaggedBootDevicesTest_v242-869407180-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74613) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 29 17:52:26 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.lightos [None req-674e6337-afc0-4f43-9e4e-e7f97f5baa67 tempest-TaggedBootDevicesTest_v242-869407180 tempest-TaggedBootDevicesTest_v242-869407180-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74613) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 29 17:52:26 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.lightos [None req-674e6337-afc0-4f43-9e4e-e7f97f5baa67 tempest-TaggedBootDevicesTest_v242-869407180 tempest-TaggedBootDevicesTest_v242-869407180-project-member] LIGHTOS: no hostnqn found. {{(pid=74613) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 29 17:52:26 user nova-compute[74613]: DEBUG os_brick.utils [None req-674e6337-afc0-4f43-9e4e-e7f97f5baa67 tempest-TaggedBootDevicesTest_v242-869407180 tempest-TaggedBootDevicesTest_v242-869407180-project-member] <== get_connector_properties: return (138ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:400972819b5', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74613) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 17:52:26 user nova-compute[74613]: DEBUG nova.virt.block_device [None req-674e6337-afc0-4f43-9e4e-e7f97f5baa67 tempest-TaggedBootDevicesTest_v242-869407180 tempest-TaggedBootDevicesTest_v242-869407180-project-member] [instance: 3f285832-64a7-48e8-875a-f9e1566a66b6] Updating existing volume attachment record: 24c91c75-e04a-47d6-8e16-c1bbcc1b0a8b {{(pid=74613) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 29 17:52:26 user nova-compute[74613]: DEBUG nova.network.neutron [None req-674e6337-afc0-4f43-9e4e-e7f97f5baa67 tempest-TaggedBootDevicesTest_v242-869407180 tempest-TaggedBootDevicesTest_v242-869407180-project-member] [instance: 3f285832-64a7-48e8-875a-f9e1566a66b6] Successfully created port: 75aec901-492c-47e1-9621-158f2d11a5e7 {{(pid=74613) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 29 17:52:26 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:52:27 user nova-compute[74613]: DEBUG nova.network.neutron [None req-674e6337-afc0-4f43-9e4e-e7f97f5baa67 tempest-TaggedBootDevicesTest_v242-869407180 tempest-TaggedBootDevicesTest_v242-869407180-project-member] [instance: 3f285832-64a7-48e8-875a-f9e1566a66b6] Successfully created port: 5ea35efd-1b2e-48eb-b8fb-fb15dab703dc {{(pid=74613) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 29 17:52:27 user nova-compute[74613]: DEBUG nova.network.neutron [None req-674e6337-afc0-4f43-9e4e-e7f97f5baa67 tempest-TaggedBootDevicesTest_v242-869407180 tempest-TaggedBootDevicesTest_v242-869407180-project-member] [instance: 3f285832-64a7-48e8-875a-f9e1566a66b6] Successfully created port: 3fe23755-ec08-4b17-87b2-c1eebd36042b {{(pid=74613) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 29 17:52:28 user nova-compute[74613]: DEBUG nova.network.neutron [None req-674e6337-afc0-4f43-9e4e-e7f97f5baa67 tempest-TaggedBootDevicesTest_v242-869407180 tempest-TaggedBootDevicesTest_v242-869407180-project-member] [instance: 3f285832-64a7-48e8-875a-f9e1566a66b6] Successfully created port: bffa705a-58aa-4cbd-9b9d-09c8229cf829 {{(pid=74613) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 29 17:52:28 user nova-compute[74613]: DEBUG nova.network.neutron [None req-674e6337-afc0-4f43-9e4e-e7f97f5baa67 tempest-TaggedBootDevicesTest_v242-869407180 tempest-TaggedBootDevicesTest_v242-869407180-project-member] [instance: 3f285832-64a7-48e8-875a-f9e1566a66b6] Successfully created port: 48d45408-4c70-44b7-a0c3-874ad1049d1a {{(pid=74613) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 29 17:52:29 user nova-compute[74613]: DEBUG nova.network.neutron [None req-674e6337-afc0-4f43-9e4e-e7f97f5baa67 tempest-TaggedBootDevicesTest_v242-869407180 tempest-TaggedBootDevicesTest_v242-869407180-project-member] [instance: 3f285832-64a7-48e8-875a-f9e1566a66b6] Successfully updated port: 75aec901-492c-47e1-9621-158f2d11a5e7 {{(pid=74613) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 29 17:52:29 user nova-compute[74613]: DEBUG nova.compute.manager [req-520134da-c91a-42d7-9536-9b49ce603ed4 req-6b8fbd94-6c5b-4fa9-b5e2-6f8b1f4d124c service nova] [instance: 3f285832-64a7-48e8-875a-f9e1566a66b6] Received event network-changed-75aec901-492c-47e1-9621-158f2d11a5e7 {{(pid=74613) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 17:52:29 user nova-compute[74613]: DEBUG nova.compute.manager [req-520134da-c91a-42d7-9536-9b49ce603ed4 req-6b8fbd94-6c5b-4fa9-b5e2-6f8b1f4d124c service nova] [instance: 3f285832-64a7-48e8-875a-f9e1566a66b6] Refreshing instance network info cache due to event network-changed-75aec901-492c-47e1-9621-158f2d11a5e7. {{(pid=74613) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 17:52:29 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-520134da-c91a-42d7-9536-9b49ce603ed4 req-6b8fbd94-6c5b-4fa9-b5e2-6f8b1f4d124c service nova] Acquiring lock "refresh_cache-3f285832-64a7-48e8-875a-f9e1566a66b6" {{(pid=74613) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 17:52:29 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-520134da-c91a-42d7-9536-9b49ce603ed4 req-6b8fbd94-6c5b-4fa9-b5e2-6f8b1f4d124c service nova] Acquired lock "refresh_cache-3f285832-64a7-48e8-875a-f9e1566a66b6" {{(pid=74613) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 17:52:29 user nova-compute[74613]: DEBUG nova.network.neutron [req-520134da-c91a-42d7-9536-9b49ce603ed4 req-6b8fbd94-6c5b-4fa9-b5e2-6f8b1f4d124c service nova] [instance: 3f285832-64a7-48e8-875a-f9e1566a66b6] Refreshing network info cache for port 75aec901-492c-47e1-9621-158f2d11a5e7 {{(pid=74613) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 17:52:29 user nova-compute[74613]: DEBUG nova.network.neutron [req-520134da-c91a-42d7-9536-9b49ce603ed4 req-6b8fbd94-6c5b-4fa9-b5e2-6f8b1f4d124c service nova] [instance: 3f285832-64a7-48e8-875a-f9e1566a66b6] Instance cache missing network info. {{(pid=74613) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 29 17:52:29 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:52:30 user nova-compute[74613]: DEBUG nova.network.neutron [req-520134da-c91a-42d7-9536-9b49ce603ed4 req-6b8fbd94-6c5b-4fa9-b5e2-6f8b1f4d124c service nova] [instance: 3f285832-64a7-48e8-875a-f9e1566a66b6] Updating instance_info_cache with network_info: [] {{(pid=74613) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 17:52:30 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-520134da-c91a-42d7-9536-9b49ce603ed4 req-6b8fbd94-6c5b-4fa9-b5e2-6f8b1f4d124c service nova] Releasing lock "refresh_cache-3f285832-64a7-48e8-875a-f9e1566a66b6" {{(pid=74613) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 17:52:30 user nova-compute[74613]: DEBUG nova.network.neutron [None req-674e6337-afc0-4f43-9e4e-e7f97f5baa67 tempest-TaggedBootDevicesTest_v242-869407180 tempest-TaggedBootDevicesTest_v242-869407180-project-member] [instance: 3f285832-64a7-48e8-875a-f9e1566a66b6] Successfully updated port: d2631ae0-4218-400c-8da8-cb6d3271579d {{(pid=74613) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 29 17:52:30 user nova-compute[74613]: DEBUG nova.network.neutron [None req-674e6337-afc0-4f43-9e4e-e7f97f5baa67 tempest-TaggedBootDevicesTest_v242-869407180 tempest-TaggedBootDevicesTest_v242-869407180-project-member] [instance: 3f285832-64a7-48e8-875a-f9e1566a66b6] Successfully updated port: 83dc312c-87e6-47a8-b4a5-f7c3cec7ab50 {{(pid=74613) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 29 17:52:31 user nova-compute[74613]: DEBUG nova.network.neutron [None req-674e6337-afc0-4f43-9e4e-e7f97f5baa67 tempest-TaggedBootDevicesTest_v242-869407180 tempest-TaggedBootDevicesTest_v242-869407180-project-member] [instance: 3f285832-64a7-48e8-875a-f9e1566a66b6] Successfully updated port: 5ea35efd-1b2e-48eb-b8fb-fb15dab703dc {{(pid=74613) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 29 17:52:31 user nova-compute[74613]: DEBUG nova.compute.manager [req-2b9055cf-1b4d-4e06-ba28-9379eb4a9d47 req-200b1885-0ba1-474b-864c-17c9715a68b2 service nova] [instance: 3f285832-64a7-48e8-875a-f9e1566a66b6] Received event network-changed-d2631ae0-4218-400c-8da8-cb6d3271579d {{(pid=74613) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 17:52:31 user nova-compute[74613]: DEBUG nova.compute.manager [req-2b9055cf-1b4d-4e06-ba28-9379eb4a9d47 req-200b1885-0ba1-474b-864c-17c9715a68b2 service nova] [instance: 3f285832-64a7-48e8-875a-f9e1566a66b6] Refreshing instance network info cache due to event network-changed-d2631ae0-4218-400c-8da8-cb6d3271579d. {{(pid=74613) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 17:52:31 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-2b9055cf-1b4d-4e06-ba28-9379eb4a9d47 req-200b1885-0ba1-474b-864c-17c9715a68b2 service nova] Acquiring lock "refresh_cache-3f285832-64a7-48e8-875a-f9e1566a66b6" {{(pid=74613) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 17:52:31 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-2b9055cf-1b4d-4e06-ba28-9379eb4a9d47 req-200b1885-0ba1-474b-864c-17c9715a68b2 service nova] Acquired lock "refresh_cache-3f285832-64a7-48e8-875a-f9e1566a66b6" {{(pid=74613) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 17:52:31 user nova-compute[74613]: DEBUG nova.network.neutron [req-2b9055cf-1b4d-4e06-ba28-9379eb4a9d47 req-200b1885-0ba1-474b-864c-17c9715a68b2 service nova] [instance: 3f285832-64a7-48e8-875a-f9e1566a66b6] Refreshing network info cache for port d2631ae0-4218-400c-8da8-cb6d3271579d {{(pid=74613) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 17:52:31 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:52:31 user nova-compute[74613]: DEBUG nova.network.neutron [req-2b9055cf-1b4d-4e06-ba28-9379eb4a9d47 req-200b1885-0ba1-474b-864c-17c9715a68b2 service nova] [instance: 3f285832-64a7-48e8-875a-f9e1566a66b6] Instance cache missing network info. {{(pid=74613) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 29 17:52:31 user nova-compute[74613]: DEBUG nova.network.neutron [req-2b9055cf-1b4d-4e06-ba28-9379eb4a9d47 req-200b1885-0ba1-474b-864c-17c9715a68b2 service nova] [instance: 3f285832-64a7-48e8-875a-f9e1566a66b6] Updating instance_info_cache with network_info: [] {{(pid=74613) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 17:52:31 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-2b9055cf-1b4d-4e06-ba28-9379eb4a9d47 req-200b1885-0ba1-474b-864c-17c9715a68b2 service nova] Releasing lock "refresh_cache-3f285832-64a7-48e8-875a-f9e1566a66b6" {{(pid=74613) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 17:52:31 user nova-compute[74613]: DEBUG nova.compute.manager [req-2b9055cf-1b4d-4e06-ba28-9379eb4a9d47 req-200b1885-0ba1-474b-864c-17c9715a68b2 service nova] [instance: 3f285832-64a7-48e8-875a-f9e1566a66b6] Received event network-changed-83dc312c-87e6-47a8-b4a5-f7c3cec7ab50 {{(pid=74613) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 17:52:31 user nova-compute[74613]: DEBUG nova.compute.manager [req-2b9055cf-1b4d-4e06-ba28-9379eb4a9d47 req-200b1885-0ba1-474b-864c-17c9715a68b2 service nova] [instance: 3f285832-64a7-48e8-875a-f9e1566a66b6] Refreshing instance network info cache due to event network-changed-83dc312c-87e6-47a8-b4a5-f7c3cec7ab50. {{(pid=74613) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 17:52:31 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-2b9055cf-1b4d-4e06-ba28-9379eb4a9d47 req-200b1885-0ba1-474b-864c-17c9715a68b2 service nova] Acquiring lock "refresh_cache-3f285832-64a7-48e8-875a-f9e1566a66b6" {{(pid=74613) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 17:52:31 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-2b9055cf-1b4d-4e06-ba28-9379eb4a9d47 req-200b1885-0ba1-474b-864c-17c9715a68b2 service nova] Acquired lock "refresh_cache-3f285832-64a7-48e8-875a-f9e1566a66b6" {{(pid=74613) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 17:52:31 user nova-compute[74613]: DEBUG nova.network.neutron [req-2b9055cf-1b4d-4e06-ba28-9379eb4a9d47 req-200b1885-0ba1-474b-864c-17c9715a68b2 service nova] [instance: 3f285832-64a7-48e8-875a-f9e1566a66b6] Refreshing network info cache for port 83dc312c-87e6-47a8-b4a5-f7c3cec7ab50 {{(pid=74613) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 17:52:31 user nova-compute[74613]: DEBUG nova.network.neutron [req-2b9055cf-1b4d-4e06-ba28-9379eb4a9d47 req-200b1885-0ba1-474b-864c-17c9715a68b2 service nova] [instance: 3f285832-64a7-48e8-875a-f9e1566a66b6] Instance cache missing network info. {{(pid=74613) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 29 17:52:32 user nova-compute[74613]: DEBUG nova.network.neutron [req-2b9055cf-1b4d-4e06-ba28-9379eb4a9d47 req-200b1885-0ba1-474b-864c-17c9715a68b2 service nova] [instance: 3f285832-64a7-48e8-875a-f9e1566a66b6] Updating instance_info_cache with network_info: [] {{(pid=74613) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 17:52:32 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-2b9055cf-1b4d-4e06-ba28-9379eb4a9d47 req-200b1885-0ba1-474b-864c-17c9715a68b2 service nova] Releasing lock "refresh_cache-3f285832-64a7-48e8-875a-f9e1566a66b6" {{(pid=74613) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 17:52:32 user nova-compute[74613]: DEBUG nova.network.neutron [None req-674e6337-afc0-4f43-9e4e-e7f97f5baa67 tempest-TaggedBootDevicesTest_v242-869407180 tempest-TaggedBootDevicesTest_v242-869407180-project-member] [instance: 3f285832-64a7-48e8-875a-f9e1566a66b6] Successfully updated port: 3fe23755-ec08-4b17-87b2-c1eebd36042b {{(pid=74613) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 29 17:52:32 user nova-compute[74613]: DEBUG nova.network.neutron [None req-674e6337-afc0-4f43-9e4e-e7f97f5baa67 tempest-TaggedBootDevicesTest_v242-869407180 tempest-TaggedBootDevicesTest_v242-869407180-project-member] [instance: 3f285832-64a7-48e8-875a-f9e1566a66b6] Successfully updated port: bffa705a-58aa-4cbd-9b9d-09c8229cf829 {{(pid=74613) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 29 17:52:33 user nova-compute[74613]: DEBUG nova.network.neutron [None req-674e6337-afc0-4f43-9e4e-e7f97f5baa67 tempest-TaggedBootDevicesTest_v242-869407180 tempest-TaggedBootDevicesTest_v242-869407180-project-member] [instance: 3f285832-64a7-48e8-875a-f9e1566a66b6] Successfully updated port: 48d45408-4c70-44b7-a0c3-874ad1049d1a {{(pid=74613) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 29 17:52:33 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-674e6337-afc0-4f43-9e4e-e7f97f5baa67 tempest-TaggedBootDevicesTest_v242-869407180 tempest-TaggedBootDevicesTest_v242-869407180-project-member] Acquiring lock "refresh_cache-3f285832-64a7-48e8-875a-f9e1566a66b6" {{(pid=74613) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 17:52:33 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-674e6337-afc0-4f43-9e4e-e7f97f5baa67 tempest-TaggedBootDevicesTest_v242-869407180 tempest-TaggedBootDevicesTest_v242-869407180-project-member] Acquired lock "refresh_cache-3f285832-64a7-48e8-875a-f9e1566a66b6" {{(pid=74613) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 17:52:33 user nova-compute[74613]: DEBUG nova.network.neutron [None req-674e6337-afc0-4f43-9e4e-e7f97f5baa67 tempest-TaggedBootDevicesTest_v242-869407180 tempest-TaggedBootDevicesTest_v242-869407180-project-member] [instance: 3f285832-64a7-48e8-875a-f9e1566a66b6] Building network info cache for instance {{(pid=74613) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 29 17:52:33 user nova-compute[74613]: DEBUG nova.compute.manager [req-c3c1cbb1-6e37-4ed3-bd71-e751a9d2ba8f req-94756182-4c45-4ce6-bdf8-37ef9a40c4fb service nova] [instance: 3f285832-64a7-48e8-875a-f9e1566a66b6] Received event network-changed-5ea35efd-1b2e-48eb-b8fb-fb15dab703dc {{(pid=74613) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 17:52:33 user nova-compute[74613]: DEBUG nova.compute.manager [req-c3c1cbb1-6e37-4ed3-bd71-e751a9d2ba8f req-94756182-4c45-4ce6-bdf8-37ef9a40c4fb service nova] [instance: 3f285832-64a7-48e8-875a-f9e1566a66b6] Refreshing instance network info cache due to event network-changed-5ea35efd-1b2e-48eb-b8fb-fb15dab703dc. {{(pid=74613) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 17:52:33 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-c3c1cbb1-6e37-4ed3-bd71-e751a9d2ba8f req-94756182-4c45-4ce6-bdf8-37ef9a40c4fb service nova] Acquiring lock "refresh_cache-3f285832-64a7-48e8-875a-f9e1566a66b6" {{(pid=74613) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 17:52:33 user nova-compute[74613]: DEBUG nova.network.neutron [None req-674e6337-afc0-4f43-9e4e-e7f97f5baa67 tempest-TaggedBootDevicesTest_v242-869407180 tempest-TaggedBootDevicesTest_v242-869407180-project-member] [instance: 3f285832-64a7-48e8-875a-f9e1566a66b6] Instance cache missing network info. {{(pid=74613) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 29 17:52:34 user nova-compute[74613]: INFO nova.virt.block_device [None req-674e6337-afc0-4f43-9e4e-e7f97f5baa67 tempest-TaggedBootDevicesTest_v242-869407180 tempest-TaggedBootDevicesTest_v242-869407180-project-member] [instance: 3f285832-64a7-48e8-875a-f9e1566a66b6] Booting with volume 8230f3a2-63d8-46cb-8ec7-ceb89fb04e53 at /dev/vdb
Nov 29 17:52:34 user nova-compute[74613]: DEBUG os_brick.utils [None req-674e6337-afc0-4f43-9e4e-e7f97f5baa67 tempest-TaggedBootDevicesTest_v242-869407180 tempest-TaggedBootDevicesTest_v242-869407180-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74613) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 17:52:34 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 17:52:34 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 17:52:34 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[7018e77b-ed08-405c-a298-12684c0d6402]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:400972819b5\n', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 17:52:34 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 17:52:34 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.024s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 17:52:34 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[77ced887-9109-4639-a249-fb0542d46e46]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 17:52:34 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 17:52:34 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 17:52:34 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[44d4e38a-4e62-4a59-872b-a9692c9e908e]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 17:52:34 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0b8c113-c413-4767-a468-a85984b69113]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 17:52:34 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-674e6337-afc0-4f43-9e4e-e7f97f5baa67 tempest-TaggedBootDevicesTest_v242-869407180 tempest-TaggedBootDevicesTest_v242-869407180-project-member] Running cmd (subprocess): nvme version {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 17:52:34 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-674e6337-afc0-4f43-9e4e-e7f97f5baa67 tempest-TaggedBootDevicesTest_v242-869407180 tempest-TaggedBootDevicesTest_v242-869407180-project-member] 'nvme version' failed. Not Retrying. {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 17:52:34 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.nvmeof [None req-674e6337-afc0-4f43-9e4e-e7f97f5baa67 tempest-TaggedBootDevicesTest_v242-869407180 tempest-TaggedBootDevicesTest_v242-869407180-project-member] nvme not present on system {{(pid=74613) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 29 17:52:34 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 17:52:34 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 17:52:34 user nova-compute[74613]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 29 17:52:34 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d507af3-3794-4a3b-a183-6186ce703460]: (4, '') {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 17:52:34 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.lightos [None req-674e6337-afc0-4f43-9e4e-e7f97f5baa67 tempest-TaggedBootDevicesTest_v242-869407180 tempest-TaggedBootDevicesTest_v242-869407180-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74613) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 29 17:52:34 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.lightos [None req-674e6337-afc0-4f43-9e4e-e7f97f5baa67 tempest-TaggedBootDevicesTest_v242-869407180 tempest-TaggedBootDevicesTest_v242-869407180-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74613) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 29 17:52:34 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.lightos [None req-674e6337-afc0-4f43-9e4e-e7f97f5baa67 tempest-TaggedBootDevicesTest_v242-869407180 tempest-TaggedBootDevicesTest_v242-869407180-project-member] LIGHTOS: no hostnqn found. {{(pid=74613) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 29 17:52:34 user nova-compute[74613]: DEBUG os_brick.utils [None req-674e6337-afc0-4f43-9e4e-e7f97f5baa67 tempest-TaggedBootDevicesTest_v242-869407180 tempest-TaggedBootDevicesTest_v242-869407180-project-member] <== get_connector_properties: return (135ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:400972819b5', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74613) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 17:52:34 user nova-compute[74613]: DEBUG nova.virt.block_device [None req-674e6337-afc0-4f43-9e4e-e7f97f5baa67 tempest-TaggedBootDevicesTest_v242-869407180 tempest-TaggedBootDevicesTest_v242-869407180-project-member] [instance: 3f285832-64a7-48e8-875a-f9e1566a66b6] Updating existing volume attachment record: d986ab7e-4686-4d14-9729-52ef6e9d66a5 {{(pid=74613) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 29 17:52:34 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:52:35 user nova-compute[74613]: DEBUG nova.network.neutron [None req-674e6337-afc0-4f43-9e4e-e7f97f5baa67 tempest-TaggedBootDevicesTest_v242-869407180 tempest-TaggedBootDevicesTest_v242-869407180-project-member] [instance: 3f285832-64a7-48e8-875a-f9e1566a66b6] Updating instance_info_cache with network_info: [{"id": "75aec901-492c-47e1-9621-158f2d11a5e7", "address": "fa:16:3e:78:3a:a6", "network": {"id": "ca76dd55-469c-4d51-a76e-8b160bef1707", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-570657334-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f655bcde631c4a839b98695eed5cfa4e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap75aec901-49", "ovs_interfaceid": "75aec901-492c-47e1-9621-158f2d11a5e7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "d2631ae0-4218-400c-8da8-cb6d3271579d", "address": "fa:16:3e:3a:4c:7e", "network": {"id": "1e109d3b-bb91-4ff7-b16f-d39181436f57", "bridge": "br-int", "label": "tempest-device-tagging-net1-1011700470", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.120", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "f655bcde631c4a839b98695eed5cfa4e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd2631ae0-42", "ovs_interfaceid": "d2631ae0-4218-400c-8da8-cb6d3271579d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "83dc312c-87e6-47a8-b4a5-f7c3cec7ab50", "address": "fa:16:3e:fb:9b:31", "network": {"id": "1e109d3b-bb91-4ff7-b16f-d39181436f57", "bridge": "br-int", "label": "tempest-device-tagging-net1-1011700470", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.134", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "f655bcde631c4a839b98695eed5cfa4e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap83dc312c-87", "ovs_interfaceid": "83dc312c-87e6-47a8-b4a5-f7c3cec7ab50", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "5ea35efd-1b2e-48eb-b8fb-fb15dab703dc", "address": "fa:16:3e:f1:48:4c", "network": {"id": "1e109d3b-bb91-4ff7-b16f-d39181436f57", "bridge": "br-int", "label": "tempest-device-tagging-net1-1011700470", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.157", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "f655bcde631c4a839b98695eed5cfa4e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5ea35efd-1b", "ovs_interfaceid": "5ea35efd-1b2e-48eb-b8fb-fb15dab703dc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "3fe23755-ec08-4b17-87b2-c1eebd36042b", "address": "fa:16:3e:39:7c:dd", "network": {"id": "1e109d3b-bb91-4ff7-b16f-d39181436f57", "bridge": "br-int", "label": "tempest-device-tagging-net1-1011700470", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.66", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "f655bcde631c4a839b98695eed5cfa4e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3fe23755-ec", "ovs_interfaceid": "3fe23755-ec08-4b17-87b2-c1eebd36042b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "bffa705a-58aa-4cbd-9b9d-09c8229cf829", "address": "fa:16:3e:f7:c0:bd", "network": {"id": "6debc132-a947-4fdc-8d04-f10452f6ee9c", "bridge": "br-int", "label": "tempest-device-tagging-net2-597757606", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "f655bcde631c4a839b98695eed5cfa4e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbffa705a-58", "ovs_interfaceid": "bffa705a-58aa-4cbd-9b9d-09c8229cf829", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "48d45408-4c70-44b7-a0c3-874ad1049d1a", "address": "fa:16:3e:a2:2a:db", "network": {"id": "6debc132-a947-4fdc-8d04-f10452f6ee9c", "bridge": "br-int", "label": "tempest-device-tagging-net2-597757606", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "f655bcde631c4a839b98695eed5cfa4e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap48d45408-4c", "ovs_interfaceid": "48d45408-4c70-44b7-a0c3-874ad1049d1a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74613) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 17:52:35 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-674e6337-afc0-4f43-9e4e-e7f97f5baa67 tempest-TaggedBootDevicesTest_v242-869407180 tempest-TaggedBootDevicesTest_v242-869407180-project-member] Releasing lock "refresh_cache-3f285832-64a7-48e8-875a-f9e1566a66b6" {{(pid=74613) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 17:52:35 user nova-compute[74613]: DEBUG nova.compute.manager [None req-674e6337-afc0-4f43-9e4e-e7f97f5baa67 tempest-TaggedBootDevicesTest_v242-869407180 tempest-TaggedBootDevicesTest_v242-869407180-project-member] [instance: 3f285832-64a7-48e8-875a-f9e1566a66b6] Instance network_info: |[{"id": "75aec901-492c-47e1-9621-158f2d11a5e7", "address": "fa:16:3e:78:3a:a6", "network": {"id": "ca76dd55-469c-4d51-a76e-8b160bef1707", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-570657334-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f655bcde631c4a839b98695eed5cfa4e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap75aec901-49", "ovs_interfaceid": "75aec901-492c-47e1-9621-158f2d11a5e7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "d2631ae0-4218-400c-8da8-cb6d3271579d", "address": "fa:16:3e:3a:4c:7e", "network": {"id": "1e109d3b-bb91-4ff7-b16f-d39181436f57", "bridge": "br-int", "label": "tempest-device-tagging-net1-1011700470", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.120", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "f655bcde631c4a839b98695eed5cfa4e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd2631ae0-42", "ovs_interfaceid": "d2631ae0-4218-400c-8da8-cb6d3271579d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "83dc312c-87e6-47a8-b4a5-f7c3cec7ab50", "address": "fa:16:3e:fb:9b:31", "network": {"id": "1e109d3b-bb91-4ff7-b16f-d39181436f57", "bridge": "br-int", "label": "tempest-device-tagging-net1-1011700470", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.134", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "f655bcde631c4a839b98695eed5cfa4e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap83dc312c-87", "ovs_interfaceid": "83dc312c-87e6-47a8-b4a5-f7c3cec7ab50", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "5ea35efd-1b2e-48eb-b8fb-fb15dab703dc", "address": "fa:16:3e:f1:48:4c", "network": {"id": "1e109d3b-bb91-4ff7-b16f-d39181436f57", "bridge": "br-int", "label": "tempest-device-tagging-net1-1011700470", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.157", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "f655bcde631c4a839b98695eed5cfa4e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5ea35efd-1b", "ovs_interfaceid": "5ea35efd-1b2e-48eb-b8fb-fb15dab703dc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "3fe23755-ec08-4b17-87b2-c1eebd36042b", "address": "fa:16:3e:39:7c:dd", "network": {"id": "1e109d3b-bb91-4ff7-b16f-d39181436f57", "bridge": "br-int", "label": "tempest-device-tagging-net1-1011700470", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.66", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "f655bcde631c4a839b98695eed5cfa4e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3fe23755-ec", "ovs_interfaceid": "3fe23755-ec08-4b17-87b2-c1eebd36042b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "bffa705a-58aa-4cbd-9b9d-09c8229cf829", "address": "fa:16:3e:f7:c0:bd", "network": {"id": "6debc132-a947-4fdc-8d04-f10452f6ee9c", "bridge": "br-int", "label": "tempest-device-tagging-net2-597757606", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "f655bcde631c4a839b98695eed5cfa4e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbffa705a-58", "ovs_interfaceid": "bffa705a-58aa-4cbd-9b9d-09c8229cf829", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "48d45408-4c70-44b7-a0c3-874ad1049d1a", "address": "fa:16:3e:a2:2a:db", "network": {"id": "6debc132-a947-4fdc-8d04-f10452f6ee9c", "bridge": "br-int", "label": "tempest-device-tagging-net2-597757606", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "f655bcde631c4a839b98695eed5cfa4e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap48d45408-4c", "ovs_interfaceid": "48d45408-4c70-44b7-a0c3-874ad1049d1a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74613) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 29 17:52:35 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-c3c1cbb1-6e37-4ed3-bd71-e751a9d2ba8f req-94756182-4c45-4ce6-bdf8-37ef9a40c4fb service nova] Acquired lock "refresh_cache-3f285832-64a7-48e8-875a-f9e1566a66b6" {{(pid=74613) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 17:52:35 user nova-compute[74613]: DEBUG nova.network.neutron [req-c3c1cbb1-6e37-4ed3-bd71-e751a9d2ba8f req-94756182-4c45-4ce6-bdf8-37ef9a40c4fb service nova] [instance: 3f285832-64a7-48e8-875a-f9e1566a66b6] Refreshing network info cache for port 5ea35efd-1b2e-48eb-b8fb-fb15dab703dc {{(pid=74613) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 17:52:36 user nova-compute[74613]: DEBUG nova.network.neutron [req-c3c1cbb1-6e37-4ed3-bd71-e751a9d2ba8f req-94756182-4c45-4ce6-bdf8-37ef9a40c4fb service nova] [instance: 3f285832-64a7-48e8-875a-f9e1566a66b6] Updated VIF entry in instance network info cache for port 5ea35efd-1b2e-48eb-b8fb-fb15dab703dc. {{(pid=74613) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 17:52:36 user nova-compute[74613]: DEBUG nova.network.neutron [req-c3c1cbb1-6e37-4ed3-bd71-e751a9d2ba8f req-94756182-4c45-4ce6-bdf8-37ef9a40c4fb service nova] [instance: 3f285832-64a7-48e8-875a-f9e1566a66b6] Updating instance_info_cache with network_info: [{"id": "75aec901-492c-47e1-9621-158f2d11a5e7", "address": "fa:16:3e:78:3a:a6", "network": {"id": "ca76dd55-469c-4d51-a76e-8b160bef1707", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-570657334-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f655bcde631c4a839b98695eed5cfa4e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap75aec901-49", "ovs_interfaceid": "75aec901-492c-47e1-9621-158f2d11a5e7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "d2631ae0-4218-400c-8da8-cb6d3271579d", "address": "fa:16:3e:3a:4c:7e", "network": {"id": "1e109d3b-bb91-4ff7-b16f-d39181436f57", "bridge": "br-int", "label": "tempest-device-tagging-net1-1011700470", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.120", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "f655bcde631c4a839b98695eed5cfa4e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd2631ae0-42", "ovs_interfaceid": "d2631ae0-4218-400c-8da8-cb6d3271579d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "83dc312c-87e6-47a8-b4a5-f7c3cec7ab50", "address": "fa:16:3e:fb:9b:31", "network": {"id": "1e109d3b-bb91-4ff7-b16f-d39181436f57", "bridge": "br-int", "label": "tempest-device-tagging-net1-1011700470", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.134", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "f655bcde631c4a839b98695eed5cfa4e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap83dc312c-87", "ovs_interfaceid": "83dc312c-87e6-47a8-b4a5-f7c3cec7ab50", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "5ea35efd-1b2e-48eb-b8fb-fb15dab703dc", "address": "fa:16:3e:f1:48:4c", "network": {"id": "1e109d3b-bb91-4ff7-b16f-d39181436f57", "bridge": "br-int", "label": "tempest-device-tagging-net1-1011700470", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.157", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "f655bcde631c4a839b98695eed5cfa4e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5ea35efd-1b", "ovs_interfaceid": "5ea35efd-1b2e-48eb-b8fb-fb15dab703dc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "3fe23755-ec08-4b17-87b2-c1eebd36042b", "address": "fa:16:3e:39:7c:dd", "network": {"id": "1e109d3b-bb91-4ff7-b16f-d39181436f57", "bridge": "br-int", "label": "tempest-device-tagging-net1-1011700470", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.66", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "f655bcde631c4a839b98695eed5cfa4e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3fe23755-ec", "ovs_interfaceid": "3fe23755-ec08-4b17-87b2-c1eebd36042b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "bffa705a-58aa-4cbd-9b9d-09c8229cf829", "address": "fa:16:3e:f7:c0:bd", "network": {"id": "6debc132-a947-4fdc-8d04-f10452f6ee9c", "bridge": "br-int", "label": "tempest-device-tagging-net2-597757606", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "f655bcde631c4a839b98695eed5cfa4e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbffa705a-58", "ovs_interfaceid": "bffa705a-58aa-4cbd-9b9d-09c8229cf829", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "48d45408-4c70-44b7-a0c3-874ad1049d1a", "address": "fa:16:3e:a2:2a:db", "network": {"id": "6debc132-a947-4fdc-8d04-f10452f6ee9c", "bridge": "br-int", "label": "tempest-device-tagging-net2-597757606", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "f655bcde631c4a839b98695eed5cfa4e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap48d45408-4c", "ovs_interfaceid": "48d45408-4c70-44b7-a0c3-874ad1049d1a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74613) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 17:52:36 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-c3c1cbb1-6e37-4ed3-bd71-e751a9d2ba8f req-94756182-4c45-4ce6-bdf8-37ef9a40c4fb service nova] Releasing lock "refresh_cache-3f285832-64a7-48e8-875a-f9e1566a66b6" {{(pid=74613) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 17:52:36 user nova-compute[74613]: DEBUG nova.compute.manager [req-c3c1cbb1-6e37-4ed3-bd71-e751a9d2ba8f req-94756182-4c45-4ce6-bdf8-37ef9a40c4fb service nova] [instance: 3f285832-64a7-48e8-875a-f9e1566a66b6] Received event network-changed-3fe23755-ec08-4b17-87b2-c1eebd36042b {{(pid=74613) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 17:52:36 user nova-compute[74613]: DEBUG nova.compute.manager [req-c3c1cbb1-6e37-4ed3-bd71-e751a9d2ba8f req-94756182-4c45-4ce6-bdf8-37ef9a40c4fb service nova] [instance: 3f285832-64a7-48e8-875a-f9e1566a66b6] Refreshing instance network info cache due to event network-changed-3fe23755-ec08-4b17-87b2-c1eebd36042b. {{(pid=74613) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 17:52:36 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-c3c1cbb1-6e37-4ed3-bd71-e751a9d2ba8f req-94756182-4c45-4ce6-bdf8-37ef9a40c4fb service nova] Acquiring lock "refresh_cache-3f285832-64a7-48e8-875a-f9e1566a66b6" {{(pid=74613) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 17:52:36 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-c3c1cbb1-6e37-4ed3-bd71-e751a9d2ba8f req-94756182-4c45-4ce6-bdf8-37ef9a40c4fb service nova] Acquired lock "refresh_cache-3f285832-64a7-48e8-875a-f9e1566a66b6" {{(pid=74613) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 17:52:36 user nova-compute[74613]: DEBUG nova.network.neutron [req-c3c1cbb1-6e37-4ed3-bd71-e751a9d2ba8f req-94756182-4c45-4ce6-bdf8-37ef9a40c4fb service nova] [instance: 3f285832-64a7-48e8-875a-f9e1566a66b6] Refreshing network info cache for port 3fe23755-ec08-4b17-87b2-c1eebd36042b {{(pid=74613) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 17:52:36 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:52:36 user nova-compute[74613]: DEBUG nova.network.neutron [req-c3c1cbb1-6e37-4ed3-bd71-e751a9d2ba8f req-94756182-4c45-4ce6-bdf8-37ef9a40c4fb service nova] [instance: 3f285832-64a7-48e8-875a-f9e1566a66b6] Updated VIF entry in instance network info cache for port 3fe23755-ec08-4b17-87b2-c1eebd36042b. {{(pid=74613) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 17:52:36 user nova-compute[74613]: DEBUG nova.network.neutron [req-c3c1cbb1-6e37-4ed3-bd71-e751a9d2ba8f req-94756182-4c45-4ce6-bdf8-37ef9a40c4fb service nova] [instance: 3f285832-64a7-48e8-875a-f9e1566a66b6] Updating instance_info_cache with network_info: [{"id": "75aec901-492c-47e1-9621-158f2d11a5e7", "address": "fa:16:3e:78:3a:a6", "network": {"id": "ca76dd55-469c-4d51-a76e-8b160bef1707", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-570657334-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f655bcde631c4a839b98695eed5cfa4e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap75aec901-49", "ovs_interfaceid": "75aec901-492c-47e1-9621-158f2d11a5e7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "d2631ae0-4218-400c-8da8-cb6d3271579d", "address": "fa:16:3e:3a:4c:7e", "network": {"id": "1e109d3b-bb91-4ff7-b16f-d39181436f57", "bridge": "br-int", "label": "tempest-device-tagging-net1-1011700470", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.120", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "f655bcde631c4a839b98695eed5cfa4e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd2631ae0-42", "ovs_interfaceid": "d2631ae0-4218-400c-8da8-cb6d3271579d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "83dc312c-87e6-47a8-b4a5-f7c3cec7ab50", "address": "fa:16:3e:fb:9b:31", "network": {"id": "1e109d3b-bb91-4ff7-b16f-d39181436f57", "bridge": "br-int", "label": "tempest-device-tagging-net1-1011700470", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.134", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "f655bcde631c4a839b98695eed5cfa4e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap83dc312c-87", "ovs_interfaceid": "83dc312c-87e6-47a8-b4a5-f7c3cec7ab50", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "5ea35efd-1b2e-48eb-b8fb-fb15dab703dc", "address": "fa:16:3e:f1:48:4c", "network": {"id": "1e109d3b-bb91-4ff7-b16f-d39181436f57", "bridge": "br-int", "label": "tempest-device-tagging-net1-1011700470", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.157", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "f655bcde631c4a839b98695eed5cfa4e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5ea35efd-1b", "ovs_interfaceid": "5ea35efd-1b2e-48eb-b8fb-fb15dab703dc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "3fe23755-ec08-4b17-87b2-c1eebd36042b", "address": "fa:16:3e:39:7c:dd", "network": {"id": "1e109d3b-bb91-4ff7-b16f-d39181436f57", "bridge": "br-int", "label": "tempest-device-tagging-net1-1011700470", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.66", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "f655bcde631c4a839b98695eed5cfa4e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3fe23755-ec", "ovs_interfaceid": "3fe23755-ec08-4b17-87b2-c1eebd36042b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "bffa705a-58aa-4cbd-9b9d-09c8229cf829", "address": "fa:16:3e:f7:c0:bd", "network": {"id": "6debc132-a947-4fdc-8d04-f10452f6ee9c", "bridge": "br-int", "label": "tempest-device-tagging-net2-597757606", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "f655bcde631c4a839b98695eed5cfa4e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbffa705a-58", "ovs_interfaceid": "bffa705a-58aa-4cbd-9b9d-09c8229cf829", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "48d45408-4c70-44b7-a0c3-874ad1049d1a", "address": "fa:16:3e:a2:2a:db", "network": {"id": "6debc132-a947-4fdc-8d04-f10452f6ee9c", "bridge": "br-int", "label": "tempest-device-tagging-net2-597757606", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "f655bcde631c4a839b98695eed5cfa4e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap48d45408-4c", "ovs_interfaceid": "48d45408-4c70-44b7-a0c3-874ad1049d1a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74613) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 17:52:36 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-c3c1cbb1-6e37-4ed3-bd71-e751a9d2ba8f req-94756182-4c45-4ce6-bdf8-37ef9a40c4fb service nova] Releasing lock "refresh_cache-3f285832-64a7-48e8-875a-f9e1566a66b6" {{(pid=74613) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 17:52:36 user nova-compute[74613]: DEBUG nova.compute.manager [req-c3c1cbb1-6e37-4ed3-bd71-e751a9d2ba8f req-94756182-4c45-4ce6-bdf8-37ef9a40c4fb service nova] [instance: 3f285832-64a7-48e8-875a-f9e1566a66b6] Received event network-changed-bffa705a-58aa-4cbd-9b9d-09c8229cf829 {{(pid=74613) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 17:52:36 user nova-compute[74613]: DEBUG nova.compute.manager [req-c3c1cbb1-6e37-4ed3-bd71-e751a9d2ba8f req-94756182-4c45-4ce6-bdf8-37ef9a40c4fb service nova] [instance: 3f285832-64a7-48e8-875a-f9e1566a66b6] Refreshing instance network info cache due to event network-changed-bffa705a-58aa-4cbd-9b9d-09c8229cf829. {{(pid=74613) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 17:52:36 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-c3c1cbb1-6e37-4ed3-bd71-e751a9d2ba8f req-94756182-4c45-4ce6-bdf8-37ef9a40c4fb service nova] Acquiring lock "refresh_cache-3f285832-64a7-48e8-875a-f9e1566a66b6" {{(pid=74613) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 17:52:36 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-c3c1cbb1-6e37-4ed3-bd71-e751a9d2ba8f req-94756182-4c45-4ce6-bdf8-37ef9a40c4fb service nova] Acquired lock "refresh_cache-3f285832-64a7-48e8-875a-f9e1566a66b6" {{(pid=74613) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 17:52:36 user nova-compute[74613]: DEBUG nova.network.neutron [req-c3c1cbb1-6e37-4ed3-bd71-e751a9d2ba8f req-94756182-4c45-4ce6-bdf8-37ef9a40c4fb service nova] [instance: 3f285832-64a7-48e8-875a-f9e1566a66b6] Refreshing network info cache for port bffa705a-58aa-4cbd-9b9d-09c8229cf829 {{(pid=74613) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 17:52:37 user nova-compute[74613]: DEBUG nova.network.neutron [req-c3c1cbb1-6e37-4ed3-bd71-e751a9d2ba8f req-94756182-4c45-4ce6-bdf8-37ef9a40c4fb service nova] [instance: 3f285832-64a7-48e8-875a-f9e1566a66b6] Updated VIF entry in instance network info cache for port bffa705a-58aa-4cbd-9b9d-09c8229cf829. {{(pid=74613) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 17:52:37 user nova-compute[74613]: DEBUG nova.network.neutron [req-c3c1cbb1-6e37-4ed3-bd71-e751a9d2ba8f req-94756182-4c45-4ce6-bdf8-37ef9a40c4fb service nova] [instance: 3f285832-64a7-48e8-875a-f9e1566a66b6] Updating instance_info_cache with network_info: [{"id": "75aec901-492c-47e1-9621-158f2d11a5e7", "address": "fa:16:3e:78:3a:a6", "network": {"id": "ca76dd55-469c-4d51-a76e-8b160bef1707", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-570657334-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f655bcde631c4a839b98695eed5cfa4e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap75aec901-49", "ovs_interfaceid": "75aec901-492c-47e1-9621-158f2d11a5e7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "d2631ae0-4218-400c-8da8-cb6d3271579d", "address": "fa:16:3e:3a:4c:7e", "network": {"id": "1e109d3b-bb91-4ff7-b16f-d39181436f57", "bridge": "br-int", "label": "tempest-device-tagging-net1-1011700470", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.120", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "f655bcde631c4a839b98695eed5cfa4e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd2631ae0-42", "ovs_interfaceid": "d2631ae0-4218-400c-8da8-cb6d3271579d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "83dc312c-87e6-47a8-b4a5-f7c3cec7ab50", "address": "fa:16:3e:fb:9b:31", "network": {"id": "1e109d3b-bb91-4ff7-b16f-d39181436f57", "bridge": "br-int", "label": "tempest-device-tagging-net1-1011700470", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.134", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "f655bcde631c4a839b98695eed5cfa4e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap83dc312c-87", "ovs_interfaceid": "83dc312c-87e6-47a8-b4a5-f7c3cec7ab50", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "5ea35efd-1b2e-48eb-b8fb-fb15dab703dc", "address": "fa:16:3e:f1:48:4c", "network": {"id": "1e109d3b-bb91-4ff7-b16f-d39181436f57", "bridge": "br-int", "label": "tempest-device-tagging-net1-1011700470", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.157", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "f655bcde631c4a839b98695eed5cfa4e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5ea35efd-1b", "ovs_interfaceid": "5ea35efd-1b2e-48eb-b8fb-fb15dab703dc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "3fe23755-ec08-4b17-87b2-c1eebd36042b", "address": "fa:16:3e:39:7c:dd", "network": {"id": "1e109d3b-bb91-4ff7-b16f-d39181436f57", "bridge": "br-int", "label": "tempest-device-tagging-net1-1011700470", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.66", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "f655bcde631c4a839b98695eed5cfa4e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3fe23755-ec", "ovs_interfaceid": "3fe23755-ec08-4b17-87b2-c1eebd36042b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "bffa705a-58aa-4cbd-9b9d-09c8229cf829", "address": "fa:16:3e:f7:c0:bd", "network": {"id": "6debc132-a947-4fdc-8d04-f10452f6ee9c", "bridge": "br-int", "label": "tempest-device-tagging-net2-597757606", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "f655bcde631c4a839b98695eed5cfa4e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbffa705a-58", "ovs_interfaceid": "bffa705a-58aa-4cbd-9b9d-09c8229cf829", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "48d45408-4c70-44b7-a0c3-874ad1049d1a", "address": "fa:16:3e:a2:2a:db", "network": {"id": "6debc132-a947-4fdc-8d04-f10452f6ee9c", "bridge": "br-int", "label": "tempest-device-tagging-net2-597757606", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "f655bcde631c4a839b98695eed5cfa4e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap48d45408-4c", "ovs_interfaceid": "48d45408-4c70-44b7-a0c3-874ad1049d1a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74613) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 17:52:37 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-c3c1cbb1-6e37-4ed3-bd71-e751a9d2ba8f req-94756182-4c45-4ce6-bdf8-37ef9a40c4fb service nova] Releasing lock "refresh_cache-3f285832-64a7-48e8-875a-f9e1566a66b6" {{(pid=74613) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 17:52:37 user nova-compute[74613]: DEBUG nova.compute.manager [req-c3c1cbb1-6e37-4ed3-bd71-e751a9d2ba8f req-94756182-4c45-4ce6-bdf8-37ef9a40c4fb service nova] [instance: 3f285832-64a7-48e8-875a-f9e1566a66b6] Received event network-changed-48d45408-4c70-44b7-a0c3-874ad1049d1a {{(pid=74613) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 17:52:37 user nova-compute[74613]: DEBUG nova.compute.manager [req-c3c1cbb1-6e37-4ed3-bd71-e751a9d2ba8f req-94756182-4c45-4ce6-bdf8-37ef9a40c4fb service nova] [instance: 3f285832-64a7-48e8-875a-f9e1566a66b6] Refreshing instance network info cache due to event network-changed-48d45408-4c70-44b7-a0c3-874ad1049d1a. {{(pid=74613) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 17:52:37 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-c3c1cbb1-6e37-4ed3-bd71-e751a9d2ba8f req-94756182-4c45-4ce6-bdf8-37ef9a40c4fb service nova] Acquiring lock "refresh_cache-3f285832-64a7-48e8-875a-f9e1566a66b6" {{(pid=74613) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 17:52:37 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-c3c1cbb1-6e37-4ed3-bd71-e751a9d2ba8f req-94756182-4c45-4ce6-bdf8-37ef9a40c4fb service nova] Acquired lock "refresh_cache-3f285832-64a7-48e8-875a-f9e1566a66b6" {{(pid=74613) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 17:52:37 user nova-compute[74613]: DEBUG nova.network.neutron [req-c3c1cbb1-6e37-4ed3-bd71-e751a9d2ba8f req-94756182-4c45-4ce6-bdf8-37ef9a40c4fb service nova] [instance: 3f285832-64a7-48e8-875a-f9e1566a66b6] Refreshing network info cache for port 48d45408-4c70-44b7-a0c3-874ad1049d1a {{(pid=74613) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 17:52:37 user nova-compute[74613]: DEBUG nova.network.neutron [req-c3c1cbb1-6e37-4ed3-bd71-e751a9d2ba8f req-94756182-4c45-4ce6-bdf8-37ef9a40c4fb service nova] [instance: 3f285832-64a7-48e8-875a-f9e1566a66b6] Updated VIF entry in instance network info cache for port 48d45408-4c70-44b7-a0c3-874ad1049d1a. {{(pid=74613) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 17:52:37 user nova-compute[74613]: DEBUG nova.network.neutron [req-c3c1cbb1-6e37-4ed3-bd71-e751a9d2ba8f req-94756182-4c45-4ce6-bdf8-37ef9a40c4fb service nova] [instance: 3f285832-64a7-48e8-875a-f9e1566a66b6] Updating instance_info_cache with network_info: [{"id": "75aec901-492c-47e1-9621-158f2d11a5e7", "address": "fa:16:3e:78:3a:a6", "network": {"id": "ca76dd55-469c-4d51-a76e-8b160bef1707", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-570657334-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f655bcde631c4a839b98695eed5cfa4e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap75aec901-49", "ovs_interfaceid": "75aec901-492c-47e1-9621-158f2d11a5e7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "d2631ae0-4218-400c-8da8-cb6d3271579d", "address": "fa:16:3e:3a:4c:7e", "network": {"id": "1e109d3b-bb91-4ff7-b16f-d39181436f57", "bridge": "br-int", "label": "tempest-device-tagging-net1-1011700470", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.120", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "f655bcde631c4a839b98695eed5cfa4e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd2631ae0-42", "ovs_interfaceid": "d2631ae0-4218-400c-8da8-cb6d3271579d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "83dc312c-87e6-47a8-b4a5-f7c3cec7ab50", "address": "fa:16:3e:fb:9b:31", "network": {"id": "1e109d3b-bb91-4ff7-b16f-d39181436f57", "bridge": "br-int", "label": "tempest-device-tagging-net1-1011700470", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.134", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "f655bcde631c4a839b98695eed5cfa4e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap83dc312c-87", "ovs_interfaceid": "83dc312c-87e6-47a8-b4a5-f7c3cec7ab50", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "5ea35efd-1b2e-48eb-b8fb-fb15dab703dc", "address": "fa:16:3e:f1:48:4c", "network": {"id": "1e109d3b-bb91-4ff7-b16f-d39181436f57", "bridge": "br-int", "label": "tempest-device-tagging-net1-1011700470", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.157", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "f655bcde631c4a839b98695eed5cfa4e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5ea35efd-1b", "ovs_interfaceid": "5ea35efd-1b2e-48eb-b8fb-fb15dab703dc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "3fe23755-ec08-4b17-87b2-c1eebd36042b", "address": "fa:16:3e:39:7c:dd", "network": {"id": "1e109d3b-bb91-4ff7-b16f-d39181436f57", "bridge": "br-int", "label": "tempest-device-tagging-net1-1011700470", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.66", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "f655bcde631c4a839b98695eed5cfa4e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3fe23755-ec", "ovs_interfaceid": "3fe23755-ec08-4b17-87b2-c1eebd36042b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "bffa705a-58aa-4cbd-9b9d-09c8229cf829", "address": "fa:16:3e:f7:c0:bd", "network": {"id": "6debc132-a947-4fdc-8d04-f10452f6ee9c", "bridge": "br-int", "label": "tempest-device-tagging-net2-597757606", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "f655bcde631c4a839b98695eed5cfa4e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbffa705a-58", "ovs_interfaceid": "bffa705a-58aa-4cbd-9b9d-09c8229cf829", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "48d45408-4c70-44b7-a0c3-874ad1049d1a", "address": "fa:16:3e:a2:2a:db", "network": {"id": "6debc132-a947-4fdc-8d04-f10452f6ee9c", "bridge": "br-int", "label": "tempest-device-tagging-net2-597757606", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "f655bcde631c4a839b98695eed5cfa4e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap48d45408-4c", "ovs_interfaceid": "48d45408-4c70-44b7-a0c3-874ad1049d1a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74613) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 17:52:37 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-c3c1cbb1-6e37-4ed3-bd71-e751a9d2ba8f req-94756182-4c45-4ce6-bdf8-37ef9a40c4fb service nova] Releasing lock "refresh_cache-3f285832-64a7-48e8-875a-f9e1566a66b6" {{(pid=74613) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 17:52:39 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:52:41 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:52:43 user nova-compute[74613]: INFO nova.virt.block_device [None req-674e6337-afc0-4f43-9e4e-e7f97f5baa67 tempest-TaggedBootDevicesTest_v242-869407180 tempest-TaggedBootDevicesTest_v242-869407180-project-member] [instance: 3f285832-64a7-48e8-875a-f9e1566a66b6] Booting with volume d1f798a1-4f7b-4b9a-8180-fa8f4eb89bf0 at /dev/vdc
Nov 29 17:52:43 user nova-compute[74613]: DEBUG os_brick.utils [None req-674e6337-afc0-4f43-9e4e-e7f97f5baa67 tempest-TaggedBootDevicesTest_v242-869407180 tempest-TaggedBootDevicesTest_v242-869407180-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74613) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 17:52:43 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 17:52:43 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.012s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 17:52:43 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[23137088-18c1-4931-8c62-3168df91c306]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:400972819b5\n', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 17:52:43 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 17:52:43 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.014s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 17:52:43 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d1d29c7-4acf-4031-86f9-b0c1f77dd104]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 17:52:43 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 17:52:43 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.014s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 17:52:43 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[966e0d45-7539-4b8c-9a51-df6b8243353f]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 17:52:43 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2de032c-ab41-4b2a-b1cf-cb9c48d2af6a]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 17:52:43 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-674e6337-afc0-4f43-9e4e-e7f97f5baa67 tempest-TaggedBootDevicesTest_v242-869407180 tempest-TaggedBootDevicesTest_v242-869407180-project-member] Running cmd (subprocess): nvme version {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 17:52:43 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-674e6337-afc0-4f43-9e4e-e7f97f5baa67 tempest-TaggedBootDevicesTest_v242-869407180 tempest-TaggedBootDevicesTest_v242-869407180-project-member] 'nvme version' failed. Not Retrying. {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 17:52:43 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.nvmeof [None req-674e6337-afc0-4f43-9e4e-e7f97f5baa67 tempest-TaggedBootDevicesTest_v242-869407180 tempest-TaggedBootDevicesTest_v242-869407180-project-member] nvme not present on system {{(pid=74613) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 29 17:52:43 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 17:52:43 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 17:52:43 user nova-compute[74613]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 29 17:52:43 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[1111c53c-d136-4605-8507-21238c6c420a]: (4, '') {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 17:52:43 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.lightos [None req-674e6337-afc0-4f43-9e4e-e7f97f5baa67 tempest-TaggedBootDevicesTest_v242-869407180 tempest-TaggedBootDevicesTest_v242-869407180-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74613) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 29 17:52:43 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.lightos [None req-674e6337-afc0-4f43-9e4e-e7f97f5baa67 tempest-TaggedBootDevicesTest_v242-869407180 tempest-TaggedBootDevicesTest_v242-869407180-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74613) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 29 17:52:43 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.lightos [None req-674e6337-afc0-4f43-9e4e-e7f97f5baa67 tempest-TaggedBootDevicesTest_v242-869407180 tempest-TaggedBootDevicesTest_v242-869407180-project-member] LIGHTOS: no hostnqn found. {{(pid=74613) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 29 17:52:43 user nova-compute[74613]: DEBUG os_brick.utils [None req-674e6337-afc0-4f43-9e4e-e7f97f5baa67 tempest-TaggedBootDevicesTest_v242-869407180 tempest-TaggedBootDevicesTest_v242-869407180-project-member] <== get_connector_properties: return (105ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:400972819b5', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74613) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 17:52:43 user nova-compute[74613]: DEBUG nova.virt.block_device [None req-674e6337-afc0-4f43-9e4e-e7f97f5baa67 tempest-TaggedBootDevicesTest_v242-869407180 tempest-TaggedBootDevicesTest_v242-869407180-project-member] [instance: 3f285832-64a7-48e8-875a-f9e1566a66b6] Updating existing volume attachment record: 10b94ec8-d31e-41b1-9836-52b22779b1b8 {{(pid=74613) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 29 17:52:44 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:52:46 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:52:49 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:52:51 user nova-compute[74613]: DEBUG nova.compute.manager [None req-674e6337-afc0-4f43-9e4e-e7f97f5baa67 tempest-TaggedBootDevicesTest_v242-869407180 tempest-TaggedBootDevicesTest_v242-869407180-project-member] [instance: 3f285832-64a7-48e8-875a-f9e1566a66b6] Start spawning the instance on the hypervisor. {{(pid=74613) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 29 17:52:51 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-674e6337-afc0-4f43-9e4e-e7f97f5baa67 tempest-TaggedBootDevicesTest_v242-869407180 tempest-TaggedBootDevicesTest_v242-869407180-project-member] [instance: 3f285832-64a7-48e8-875a-f9e1566a66b6] Creating instance directory {{(pid=74613) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 29 17:52:51 user nova-compute[74613]: INFO nova.virt.libvirt.driver [None req-674e6337-afc0-4f43-9e4e-e7f97f5baa67 tempest-TaggedBootDevicesTest_v242-869407180 tempest-TaggedBootDevicesTest_v242-869407180-project-member] [instance: 3f285832-64a7-48e8-875a-f9e1566a66b6] Creating image(s)
Nov 29 17:52:51 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-674e6337-afc0-4f43-9e4e-e7f97f5baa67 tempest-TaggedBootDevicesTest_v242-869407180 tempest-TaggedBootDevicesTest_v242-869407180-project-member] [instance: 3f285832-64a7-48e8-875a-f9e1566a66b6] Did not create local disks {{(pid=74613) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 29 17:52:51 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-674e6337-afc0-4f43-9e4e-e7f97f5baa67 tempest-TaggedBootDevicesTest_v242-869407180 tempest-TaggedBootDevicesTest_v242-869407180-project-member] [instance: 3f285832-64a7-48e8-875a-f9e1566a66b6] Ensure instance console log exists: /opt/stack/data/nova/instances/3f285832-64a7-48e8-875a-f9e1566a66b6/console.log {{(pid=74613) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 29 17:52:51 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-674e6337-afc0-4f43-9e4e-e7f97f5baa67 tempest-TaggedBootDevicesTest_v242-869407180 tempest-TaggedBootDevicesTest_v242-869407180-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 17:52:51 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-674e6337-afc0-4f43-9e4e-e7f97f5baa67 tempest-TaggedBootDevicesTest_v242-869407180 tempest-TaggedBootDevicesTest_v242-869407180-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 17:52:51 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-674e6337-afc0-4f43-9e4e-e7f97f5baa67 tempest-TaggedBootDevicesTest_v242-869407180 tempest-TaggedBootDevicesTest_v242-869407180-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 17:52:51 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-674e6337-afc0-4f43-9e4e-e7f97f5baa67 tempest-TaggedBootDevicesTest_v242-869407180 tempest-TaggedBootDevicesTest_v242-869407180-project-member] [instance: 3f285832-64a7-48e8-875a-f9e1566a66b6] Start _get_guest_xml network_info=[{"id": "75aec901-492c-47e1-9621-158f2d11a5e7", "address": "fa:16:3e:78:3a:a6", "network": {"id": "ca76dd55-469c-4d51-a76e-8b160bef1707", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-570657334-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f655bcde631c4a839b98695eed5cfa4e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap75aec901-49", "ovs_interfaceid": "75aec901-492c-47e1-9621-158f2d11a5e7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "d2631ae0-4218-400c-8da8-cb6d3271579d", "address": "fa:16:3e:3a:4c:7e", "network": {"id": "1e109d3b-bb91-4ff7-b16f-d39181436f57", "bridge": "br-int", "label": "tempest-device-tagging-net1-1011700470", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.120", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "f655bcde631c4a839b98695eed5cfa4e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd2631ae0-42", "ovs_interfaceid": "d2631ae0-4218-400c-8da8-cb6d3271579d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "83dc312c-87e6-47a8-b4a5-f7c3cec7ab50", "address": "fa:16:3e:fb:9b:31", "network": {"id": "1e109d3b-bb91-4ff7-b16f-d39181436f57", "bridge": "br-int", "label": "tempest-device-tagging-net1-1011700470", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.134", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "f655bcde631c4a839b98695eed5cfa4e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap83dc312c-87", "ovs_interfaceid": "83dc312c-87e6-47a8-b4a5-f7c3cec7ab50", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "5ea35efd-1b2e-48eb-b8fb-fb15dab703dc", "address": "fa:16:3e:f1:48:4c", "network": {"id": "1e109d3b-bb91-4ff7-b16f-d39181436f57", "bridge": "br-int", "label": "tempest-device-tagging-net1-1011700470", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.157", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "f655bcde631c4a839b98695eed5cfa4e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5ea35efd-1b", "ovs_interfaceid": "5ea35efd-1b2e-48eb-b8fb-fb15dab703dc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "3fe23755-ec08-4b17-87b2-c1eebd36042b", "address": "fa:16:3e:39:7c:dd", "network": {"id": "1e109d3b-bb91-4ff7-b16f-d39181436f57", "bridge": "br-int", "label": "tempest-device-tagging-net1-1011700470", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.66", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "f655bcde631c4a839b98695eed5cfa4e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3fe23755-ec", "ovs_interfaceid": "3fe23755-ec08-4b17-87b2-c1eebd36042b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "bffa705a-58aa-4cbd-9b9d-09c8229cf829", "address": "fa:16:3e:f7:c0:bd", "network": {"id": "6debc132-a947-4fdc-8d04-f10452f6ee9c", "bridge": "br-int", "label": "tempest-device-tagging-net2-597757606", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "f655bcde631c4a839b98695eed5cfa4e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbffa705a-58", "ovs_interfaceid": "bffa705a-58aa-4cbd-9b9d-09c8229cf829", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "48d45408-4c70-44b7-a0c3-874ad1049d1a", "address": "fa:16:3e:a2:2a:db", "network": {"id": "6debc132-a947-4fdc-8d04-f10452f6ee9c", "bridge": "br-int", "label": "tempest-device-tagging-net2-597757606", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "f655bcde631c4a839b98695eed5cfa4e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap48d45408-4c", "ovs_interfaceid": "48d45408-4c70-44b7-a0c3-874ad1049d1a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk', 'boot_index': '2'}, '/dev/vdc': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk', 'boot_index': '3'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-29T17:47:38Z,direct_url=<?>,disk_format='qcow2',id=4217f428-8d9d-4ee1-9614-642d26d90c46,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='794b07cbd46a44b5865cfda741036bae',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-29T17:47:40Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:24920064-fc81-4408-97d1-d8eff97a7554', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qdHOcNGk', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '3f285832-64a7-48e8-875a-f9e1566a66b6', 'attached_at': '', 'detached_at': '', 'volume_id': '24920064-fc81-4408-97d1-d8eff97a7554', 'serial': '24920064-fc81-4408-97d1-d8eff97a7554'}, 'mount_device': '/dev/vda', 'delete_on_termination': False, 'device_type': 'disk', 'boot_index': 0, 'guest_format': None, 'attachment_id': '24c91c75-e04a-47d6-8e16-c1bbcc1b0a8b', 'disk_bus': 'virtio', 'volume_type': None}, {'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:8230f3a2-63d8-46cb-8ec7-ceb89fb04e53', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'EmBpVyWq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '3f285832-64a7-48e8-875a-f9e1566a66b6', 'attached_at': '', 'detached_at': '', 'volume_id': '8230f3a2-63d8-46cb-8ec7-ceb89fb04e53', 'serial': '8230f3a2-63d8-46cb-8ec7-ceb89fb04e53'}, 'mount_device': '/dev/vdb', 'delete_on_termination': False, 'device_type': 'disk', 'boot_index': 1, 'guest_format': None, 'attachment_id': 'd986ab7e-4686-4d14-9729-52ef6e9d66a5', 'disk_bus': 'virtio', 'volume_type': None}, {'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:d1f798a1-4f7b-4b9a-8180-fa8f4eb89bf0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'FoOgQJel', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '3f285832-64a7-48e8-875a-f9e1566a66b6', 'attached_at': '', 'detached_at': '', 'volume_id': 'd1f798a1-4f7b-4b9a-8180-fa8f4eb89bf0', 'serial': 'd1f798a1-4f7b-4b9a-8180-fa8f4eb89bf0'}, 'mount_device': '/dev/vdc', 'delete_on_termination': False, 'device_type': 'disk', 'boot_index': 2, 'guest_format': None, 'attachment_id': '10b94ec8-d31e-41b1-9836-52b22779b1b8', 'disk_bus': 'virtio', 'volume_type': None} {{(pid=74613) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 29 17:52:51 user nova-compute[74613]: WARNING nova.virt.libvirt.driver [None req-674e6337-afc0-4f43-9e4e-e7f97f5baa67 tempest-TaggedBootDevicesTest_v242-869407180 tempest-TaggedBootDevicesTest_v242-869407180-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 17:52:51 user nova-compute[74613]: WARNING nova.virt.libvirt.driver [None req-674e6337-afc0-4f43-9e4e-e7f97f5baa67 tempest-TaggedBootDevicesTest_v242-869407180 tempest-TaggedBootDevicesTest_v242-869407180-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 17:52:51 user nova-compute[74613]: DEBUG nova.virt.libvirt.host [None req-674e6337-afc0-4f43-9e4e-e7f97f5baa67 tempest-TaggedBootDevicesTest_v242-869407180 tempest-TaggedBootDevicesTest_v242-869407180-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74613) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 29 17:52:51 user nova-compute[74613]: DEBUG nova.virt.libvirt.host [None req-674e6337-afc0-4f43-9e4e-e7f97f5baa67 tempest-TaggedBootDevicesTest_v242-869407180 tempest-TaggedBootDevicesTest_v242-869407180-project-member] CPU controller missing on host. {{(pid=74613) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 29 17:52:51 user nova-compute[74613]: DEBUG nova.virt.libvirt.host [None req-674e6337-afc0-4f43-9e4e-e7f97f5baa67 tempest-TaggedBootDevicesTest_v242-869407180 tempest-TaggedBootDevicesTest_v242-869407180-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74613) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 29 17:52:51 user nova-compute[74613]: DEBUG nova.virt.libvirt.host [None req-674e6337-afc0-4f43-9e4e-e7f97f5baa67 tempest-TaggedBootDevicesTest_v242-869407180 tempest-TaggedBootDevicesTest_v242-869407180-project-member] CPU controller found on host. {{(pid=74613) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 29 17:52:51 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-674e6337-afc0-4f43-9e4e-e7f97f5baa67 tempest-TaggedBootDevicesTest_v242-869407180 tempest-TaggedBootDevicesTest_v242-869407180-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74613) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 29 17:52:51 user nova-compute[74613]: DEBUG nova.virt.hardware [None req-674e6337-afc0-4f43-9e4e-e7f97f5baa67 tempest-TaggedBootDevicesTest_v242-869407180 tempest-TaggedBootDevicesTest_v242-869407180-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-29T17:47:27Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-29T17:47:38Z,direct_url=<?>,disk_format='qcow2',id=4217f428-8d9d-4ee1-9614-642d26d90c46,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='794b07cbd46a44b5865cfda741036bae',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-29T17:47:40Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74613) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 29 17:52:51 user nova-compute[74613]: DEBUG nova.virt.hardware [None req-674e6337-afc0-4f43-9e4e-e7f97f5baa67 tempest-TaggedBootDevicesTest_v242-869407180 tempest-TaggedBootDevicesTest_v242-869407180-project-member] Flavor limits 0:0:0 {{(pid=74613) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 29 17:52:51 user nova-compute[74613]: DEBUG nova.virt.hardware [None req-674e6337-afc0-4f43-9e4e-e7f97f5baa67 tempest-TaggedBootDevicesTest_v242-869407180 tempest-TaggedBootDevicesTest_v242-869407180-project-member] Image limits 0:0:0 {{(pid=74613) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 29 17:52:51 user nova-compute[74613]: DEBUG nova.virt.hardware [None req-674e6337-afc0-4f43-9e4e-e7f97f5baa67 tempest-TaggedBootDevicesTest_v242-869407180 tempest-TaggedBootDevicesTest_v242-869407180-project-member] Flavor pref 0:0:0 {{(pid=74613) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 29 17:52:51 user nova-compute[74613]: DEBUG nova.virt.hardware [None req-674e6337-afc0-4f43-9e4e-e7f97f5baa67 tempest-TaggedBootDevicesTest_v242-869407180 tempest-TaggedBootDevicesTest_v242-869407180-project-member] Image pref 0:0:0 {{(pid=74613) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 29 17:52:51 user nova-compute[74613]: DEBUG nova.virt.hardware [None req-674e6337-afc0-4f43-9e4e-e7f97f5baa67 tempest-TaggedBootDevicesTest_v242-869407180 tempest-TaggedBootDevicesTest_v242-869407180-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74613) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 29 17:52:51 user nova-compute[74613]: DEBUG nova.virt.hardware [None req-674e6337-afc0-4f43-9e4e-e7f97f5baa67 tempest-TaggedBootDevicesTest_v242-869407180 tempest-TaggedBootDevicesTest_v242-869407180-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74613) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 29 17:52:51 user nova-compute[74613]: DEBUG nova.virt.hardware [None req-674e6337-afc0-4f43-9e4e-e7f97f5baa67 tempest-TaggedBootDevicesTest_v242-869407180 tempest-TaggedBootDevicesTest_v242-869407180-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74613) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 29 17:52:51 user nova-compute[74613]: DEBUG nova.virt.hardware [None req-674e6337-afc0-4f43-9e4e-e7f97f5baa67 tempest-TaggedBootDevicesTest_v242-869407180 tempest-TaggedBootDevicesTest_v242-869407180-project-member] Got 1 possible topologies {{(pid=74613) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 29 17:52:51 user nova-compute[74613]: DEBUG nova.virt.hardware [None req-674e6337-afc0-4f43-9e4e-e7f97f5baa67 tempest-TaggedBootDevicesTest_v242-869407180 tempest-TaggedBootDevicesTest_v242-869407180-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74613) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 29 17:52:51 user nova-compute[74613]: DEBUG nova.virt.hardware [None req-674e6337-afc0-4f43-9e4e-e7f97f5baa67 tempest-TaggedBootDevicesTest_v242-869407180 tempest-TaggedBootDevicesTest_v242-869407180-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74613) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 29 17:52:51 user nova-compute[74613]: DEBUG nova.virt.libvirt.volume.iscsi [None req-674e6337-afc0-4f43-9e4e-e7f97f5baa67 tempest-TaggedBootDevicesTest_v242-869407180 tempest-TaggedBootDevicesTest_v242-869407180-project-member] [instance: 3f285832-64a7-48e8-875a-f9e1566a66b6] Calling os-brick to attach iSCSI Volume {{(pid=74613) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 29 17:52:51 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-674e6337-afc0-4f43-9e4e-e7f97f5baa67 tempest-TaggedBootDevicesTest_v242-869407180 tempest-TaggedBootDevicesTest_v242-869407180-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff828156890>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:24920064-fc81-4408-97d1-d8eff97a7554', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qdHOcNGk', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74613) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 17:52:51 user nova-compute[74613]: WARNING os_brick.initiator.connectors.base [None req-674e6337-afc0-4f43-9e4e-e7f97f5baa67 tempest-TaggedBootDevicesTest_v242-869407180 tempest-TaggedBootDevicesTest_v242-869407180-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 17:52:51 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.base [None req-674e6337-afc0-4f43-9e4e-e7f97f5baa67 tempest-TaggedBootDevicesTest_v242-869407180 tempest-TaggedBootDevicesTest_v242-869407180-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 17:52:51 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.base [None req-674e6337-afc0-4f43-9e4e-e7f97f5baa67 tempest-TaggedBootDevicesTest_v242-869407180 tempest-TaggedBootDevicesTest_v242-869407180-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 17:52:51 user nova-compute[74613]: WARNING os_brick.initiator.connectors.base [None req-674e6337-afc0-4f43-9e4e-e7f97f5baa67 tempest-TaggedBootDevicesTest_v242-869407180 tempest-TaggedBootDevicesTest_v242-869407180-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 17:52:51 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.base [None req-674e6337-afc0-4f43-9e4e-e7f97f5baa67 tempest-TaggedBootDevicesTest_v242-869407180 tempest-TaggedBootDevicesTest_v242-869407180-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:24920064-fc81-4408-97d1-d8eff97a7554" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 17:52:51 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.base [None req-674e6337-afc0-4f43-9e4e-e7f97f5baa67 tempest-TaggedBootDevicesTest_v242-869407180 tempest-TaggedBootDevicesTest_v242-869407180-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:24920064-fc81-4408-97d1-d8eff97a7554" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 17:52:51 user nova-compute[74613]: INFO os_brick.initiator.connectors.iscsi [None req-674e6337-afc0-4f43-9e4e-e7f97f5baa67 tempest-TaggedBootDevicesTest_v242-869407180 tempest-TaggedBootDevicesTest_v242-869407180-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 29 17:52:51 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:24920064-fc81-4408-97d1-d8eff97a7554 -p 172.16.0.220:3260 {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 17:52:51 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:24920064-fc81-4408-97d1-d8eff97a7554 -p 172.16.0.220:3260" returned: 21 in 0.015s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 17:52:51 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[a566db15-f11c-4e34-b936-6aadd81497f5]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 17:52:51 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-674e6337-afc0-4f43-9e4e-e7f97f5baa67 tempest-TaggedBootDevicesTest_v242-869407180 tempest-TaggedBootDevicesTest_v242-869407180-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 29 17:52:51 user nova-compute[74613]:  {{(pid=74613) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 17:52:51 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:24920064-fc81-4408-97d1-d8eff97a7554 -p 172.16.0.220:3260 --interface default --op new {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 17:52:51 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:24920064-fc81-4408-97d1-d8eff97a7554 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 17:52:51 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[c14f0564-32f7-499a-9ec5-5d89fa7bbcd3]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:24920064-fc81-4408-97d1-d8eff97a7554] added\n', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 17:52:51 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-674e6337-afc0-4f43-9e4e-e7f97f5baa67 tempest-TaggedBootDevicesTest_v242-869407180 tempest-TaggedBootDevicesTest_v242-869407180-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:24920064-fc81-4408-97d1-d8eff97a7554] added
Nov 29 17:52:51 user nova-compute[74613]:  stderr= {{(pid=74613) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 17:52:51 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:24920064-fc81-4408-97d1-d8eff97a7554 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 17:52:51 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:24920064-fc81-4408-97d1-d8eff97a7554 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.031s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 17:52:51 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[797e2347-0cd3-45af-b53d-82963d58cadc]: (4, ('', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 17:52:51 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-674e6337-afc0-4f43-9e4e-e7f97f5baa67 tempest-TaggedBootDevicesTest_v242-869407180 tempest-TaggedBootDevicesTest_v242-869407180-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74613) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 17:52:51 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:24920064-fc81-4408-97d1-d8eff97a7554 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 17:52:51 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:24920064-fc81-4408-97d1-d8eff97a7554 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.027s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 17:52:51 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8ca88f0-8217-4733-9214-5121a65d937c]: (4, ('', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 17:52:51 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-674e6337-afc0-4f43-9e4e-e7f97f5baa67 tempest-TaggedBootDevicesTest_v242-869407180 tempest-TaggedBootDevicesTest_v242-869407180-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74613) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 17:52:51 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:24920064-fc81-4408-97d1-d8eff97a7554 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v qdHOcNGk {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 17:52:51 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:24920064-fc81-4408-97d1-d8eff97a7554 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v qdHOcNGk" returned: 0 in 0.021s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 17:52:51 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[926e39cf-20a9-4a27-8285-bdb7fcdc9032]: (4, ('', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 17:52:51 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-674e6337-afc0-4f43-9e4e-e7f97f5baa67 tempest-TaggedBootDevicesTest_v242-869407180 tempest-TaggedBootDevicesTest_v242-869407180-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'qdHOcNGk'): stdout= stderr= {{(pid=74613) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 17:52:51 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:24920064-fc81-4408-97d1-d8eff97a7554 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 17:52:51 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:24920064-fc81-4408-97d1-d8eff97a7554 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 17:52:51 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a4a7b0a-db59-43a7-b5c9-45c79287a406]: (4, ('', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 17:52:51 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-674e6337-afc0-4f43-9e4e-e7f97f5baa67 tempest-TaggedBootDevicesTest_v242-869407180 tempest-TaggedBootDevicesTest_v242-869407180-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74613) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 17:52:51 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 17:52:51 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 17:52:51 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[2196898a-30a9-41b3-8e8e-feb40cb19752]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fbbdc3d2-136d-4fba-b6ba-f27f35a0733b (non-flash)\n', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 17:52:51 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-674e6337-afc0-4f43-9e4e-e7f97f5baa67 tempest-TaggedBootDevicesTest_v242-869407180 tempest-TaggedBootDevicesTest_v242-869407180-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fbbdc3d2-136d-4fba-b6ba-f27f35a0733b (non-flash)
Nov 29 17:52:51 user nova-compute[74613]:  stderr= {{(pid=74613) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 17:52:51 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-674e6337-afc0-4f43-9e4e-e7f97f5baa67 tempest-TaggedBootDevicesTest_v242-869407180 tempest-TaggedBootDevicesTest_v242-869407180-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fbbdc3d2-136d-4fba-b6ba-f27f35a0733b (non-flash)
Nov 29 17:52:51 user nova-compute[74613]:  stderr= {{(pid=74613) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 17:52:51 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:24920064-fc81-4408-97d1-d8eff97a7554 -p 172.16.0.220:3260 --login {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 17:52:51 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:24920064-fc81-4408-97d1-d8eff97a7554 -p 172.16.0.220:3260 --login" returned: 0 in 0.056s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 17:52:51 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[b58c7eee-d7fe-4337-bbf8-0d7365e8b853]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:24920064-fc81-4408-97d1-d8eff97a7554, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:24920064-fc81-4408-97d1-d8eff97a7554, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 17:52:51 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-674e6337-afc0-4f43-9e4e-e7f97f5baa67 tempest-TaggedBootDevicesTest_v242-869407180 tempest-TaggedBootDevicesTest_v242-869407180-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:24920064-fc81-4408-97d1-d8eff97a7554, portal: 172.16.0.220,3260]
Nov 29 17:52:51 user nova-compute[74613]: Login to [iface: default, target: iqn.2010-10.org.openstack:24920064-fc81-4408-97d1-d8eff97a7554, portal: 172.16.0.220,3260] successful.
Nov 29 17:52:51 user nova-compute[74613]:  stderr= {{(pid=74613) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 17:52:51 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:24920064-fc81-4408-97d1-d8eff97a7554 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 17:52:51 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:24920064-fc81-4408-97d1-d8eff97a7554 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 17:52:51 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1b9ccd5-06ae-4354-a346-0954fc3cd168]: (4, ('', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 17:52:51 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-674e6337-afc0-4f43-9e4e-e7f97f5baa67 tempest-TaggedBootDevicesTest_v242-869407180 tempest-TaggedBootDevicesTest_v242-869407180-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74613) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 17:52:51 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 17:52:51 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 17:52:51 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[190e7d53-36ce-4063-806c-5ef9d69d17a1]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fbbdc3d2-136d-4fba-b6ba-f27f35a0733b (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:24920064-fc81-4408-97d1-d8eff97a7554 (non-flash)\n', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 17:52:51 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-674e6337-afc0-4f43-9e4e-e7f97f5baa67 tempest-TaggedBootDevicesTest_v242-869407180 tempest-TaggedBootDevicesTest_v242-869407180-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fbbdc3d2-136d-4fba-b6ba-f27f35a0733b (non-flash)
Nov 29 17:52:51 user nova-compute[74613]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:24920064-fc81-4408-97d1-d8eff97a7554 (non-flash)
Nov 29 17:52:51 user nova-compute[74613]:  stderr= {{(pid=74613) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 17:52:51 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-674e6337-afc0-4f43-9e4e-e7f97f5baa67 tempest-TaggedBootDevicesTest_v242-869407180 tempest-TaggedBootDevicesTest_v242-869407180-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fbbdc3d2-136d-4fba-b6ba-f27f35a0733b (non-flash)
Nov 29 17:52:51 user nova-compute[74613]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:24920064-fc81-4408-97d1-d8eff97a7554 (non-flash)
Nov 29 17:52:51 user nova-compute[74613]:  stderr= {{(pid=74613) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 17:52:51 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.base [None req-674e6337-afc0-4f43-9e4e-e7f97f5baa67 tempest-TaggedBootDevicesTest_v242-869407180 tempest-TaggedBootDevicesTest_v242-869407180-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:24920064-fc81-4408-97d1-d8eff97a7554" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.289s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 17:52:51 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-674e6337-afc0-4f43-9e4e-e7f97f5baa67 tempest-TaggedBootDevicesTest_v242-869407180 tempest-TaggedBootDevicesTest_v242-869407180-project-member] Connected to 172.16.0.220:3260 {{(pid=74613) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 29 17:52:51 user nova-compute[74613]: DEBUG os_brick.initiator.linuxscsi [None req-674e6337-afc0-4f43-9e4e-e7f97f5baa67 tempest-TaggedBootDevicesTest_v242-869407180 tempest-TaggedBootDevicesTest_v242-869407180-project-member] HCTL ('34', '-', '-', 0) found on session 3 with lun 0 {{(pid=74613) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 29 17:52:51 user nova-compute[74613]: DEBUG os_brick.initiator.linuxscsi [None req-674e6337-afc0-4f43-9e4e-e7f97f5baa67 tempest-TaggedBootDevicesTest_v242-869407180 tempest-TaggedBootDevicesTest_v242-869407180-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=74613) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 29 17:52:51 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 17:52:51 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.015s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 17:52:51 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[021a9f29-5394-4e9d-8f05-982f0fa8eeb8]: (4, ('- - 0', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 17:52:51 user nova-compute[74613]: DEBUG os_brick.initiator.linuxscsi [None req-674e6337-afc0-4f43-9e4e-e7f97f5baa67 tempest-TaggedBootDevicesTest_v242-869407180 tempest-TaggedBootDevicesTest_v242-869407180-project-member] Searching for a device in session 3 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=74613) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 29 17:52:51 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-674e6337-afc0-4f43-9e4e-e7f97f5baa67 tempest-TaggedBootDevicesTest_v242-869407180 tempest-TaggedBootDevicesTest_v242-869407180-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:24920064-fc81-4408-97d1-d8eff97a7554', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qdHOcNGk', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74613) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 29 17:52:51 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:52:52 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.base [None req-674e6337-afc0-4f43-9e4e-e7f97f5baa67 tempest-TaggedBootDevicesTest_v242-869407180 tempest-TaggedBootDevicesTest_v242-869407180-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.318s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 17:52:52 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-674e6337-afc0-4f43-9e4e-e7f97f5baa67 tempest-TaggedBootDevicesTest_v242-869407180 tempest-TaggedBootDevicesTest_v242-869407180-project-member] <== connect_volume: return (1320ms) {'type': 'block', 'scsi_wwn': '23033366636303833', 'path': '/dev/sdc'} {{(pid=74613) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 17:52:52 user nova-compute[74613]: DEBUG nova.virt.libvirt.volume.iscsi [None req-674e6337-afc0-4f43-9e4e-e7f97f5baa67 tempest-TaggedBootDevicesTest_v242-869407180 tempest-TaggedBootDevicesTest_v242-869407180-project-member] [instance: 3f285832-64a7-48e8-875a-f9e1566a66b6] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23033366636303833', 'path': '/dev/sdc'} {{(pid=74613) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 29 17:52:52 user nova-compute[74613]: DEBUG nova.virt.libvirt.volume.iscsi [None req-674e6337-afc0-4f43-9e4e-e7f97f5baa67 tempest-TaggedBootDevicesTest_v242-869407180 tempest-TaggedBootDevicesTest_v242-869407180-project-member] [instance: 3f285832-64a7-48e8-875a-f9e1566a66b6] Calling os-brick to attach iSCSI Volume {{(pid=74613) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 29 17:52:52 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-674e6337-afc0-4f43-9e4e-e7f97f5baa67 tempest-TaggedBootDevicesTest_v242-869407180 tempest-TaggedBootDevicesTest_v242-869407180-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff828156890>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:8230f3a2-63d8-46cb-8ec7-ceb89fb04e53', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'EmBpVyWq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74613) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 17:52:52 user nova-compute[74613]: WARNING os_brick.initiator.connectors.base [None req-674e6337-afc0-4f43-9e4e-e7f97f5baa67 tempest-TaggedBootDevicesTest_v242-869407180 tempest-TaggedBootDevicesTest_v242-869407180-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 17:52:52 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.base [None req-674e6337-afc0-4f43-9e4e-e7f97f5baa67 tempest-TaggedBootDevicesTest_v242-869407180 tempest-TaggedBootDevicesTest_v242-869407180-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 17:52:52 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.base [None req-674e6337-afc0-4f43-9e4e-e7f97f5baa67 tempest-TaggedBootDevicesTest_v242-869407180 tempest-TaggedBootDevicesTest_v242-869407180-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 17:52:52 user nova-compute[74613]: WARNING os_brick.initiator.connectors.base [None req-674e6337-afc0-4f43-9e4e-e7f97f5baa67 tempest-TaggedBootDevicesTest_v242-869407180 tempest-TaggedBootDevicesTest_v242-869407180-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 17:52:52 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.base [None req-674e6337-afc0-4f43-9e4e-e7f97f5baa67 tempest-TaggedBootDevicesTest_v242-869407180 tempest-TaggedBootDevicesTest_v242-869407180-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8230f3a2-63d8-46cb-8ec7-ceb89fb04e53" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 17:52:52 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.base [None req-674e6337-afc0-4f43-9e4e-e7f97f5baa67 tempest-TaggedBootDevicesTest_v242-869407180 tempest-TaggedBootDevicesTest_v242-869407180-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8230f3a2-63d8-46cb-8ec7-ceb89fb04e53" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 17:52:52 user nova-compute[74613]: INFO os_brick.initiator.connectors.iscsi [None req-674e6337-afc0-4f43-9e4e-e7f97f5baa67 tempest-TaggedBootDevicesTest_v242-869407180 tempest-TaggedBootDevicesTest_v242-869407180-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 29 17:52:52 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8230f3a2-63d8-46cb-8ec7-ceb89fb04e53 -p 172.16.0.220:3260 {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 17:52:52 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8230f3a2-63d8-46cb-8ec7-ceb89fb04e53 -p 172.16.0.220:3260" returned: 21 in 0.016s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 17:52:52 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d1820ac-78cc-49fa-90fb-5b08e1132496]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 17:52:52 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-674e6337-afc0-4f43-9e4e-e7f97f5baa67 tempest-TaggedBootDevicesTest_v242-869407180 tempest-TaggedBootDevicesTest_v242-869407180-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 29 17:52:52 user nova-compute[74613]:  {{(pid=74613) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 17:52:52 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8230f3a2-63d8-46cb-8ec7-ceb89fb04e53 -p 172.16.0.220:3260 --interface default --op new {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 17:52:52 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8230f3a2-63d8-46cb-8ec7-ceb89fb04e53 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 17:52:52 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb36169d-d80f-4cb2-ada2-15c0a111d443]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:8230f3a2-63d8-46cb-8ec7-ceb89fb04e53] added\n', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 17:52:52 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-674e6337-afc0-4f43-9e4e-e7f97f5baa67 tempest-TaggedBootDevicesTest_v242-869407180 tempest-TaggedBootDevicesTest_v242-869407180-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:8230f3a2-63d8-46cb-8ec7-ceb89fb04e53] added
Nov 29 17:52:52 user nova-compute[74613]:  stderr= {{(pid=74613) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 17:52:52 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8230f3a2-63d8-46cb-8ec7-ceb89fb04e53 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 17:52:52 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8230f3a2-63d8-46cb-8ec7-ceb89fb04e53 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 17:52:52 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3a8b9f1-63ce-46ab-88ed-84c68cc12fed]: (4, ('', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 17:52:52 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-674e6337-afc0-4f43-9e4e-e7f97f5baa67 tempest-TaggedBootDevicesTest_v242-869407180 tempest-TaggedBootDevicesTest_v242-869407180-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74613) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 17:52:52 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8230f3a2-63d8-46cb-8ec7-ceb89fb04e53 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 17:52:52 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8230f3a2-63d8-46cb-8ec7-ceb89fb04e53 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 17:52:52 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[43d5abd6-df51-4961-94f1-84e1b630e8d9]: (4, ('', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 17:52:52 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-674e6337-afc0-4f43-9e4e-e7f97f5baa67 tempest-TaggedBootDevicesTest_v242-869407180 tempest-TaggedBootDevicesTest_v242-869407180-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74613) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 17:52:52 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8230f3a2-63d8-46cb-8ec7-ceb89fb04e53 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v EmBpVyWq {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 17:52:52 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8230f3a2-63d8-46cb-8ec7-ceb89fb04e53 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v EmBpVyWq" returned: 0 in 0.023s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 17:52:52 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[108c1217-b705-4056-9216-6078679947fd]: (4, ('', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 17:52:52 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-674e6337-afc0-4f43-9e4e-e7f97f5baa67 tempest-TaggedBootDevicesTest_v242-869407180 tempest-TaggedBootDevicesTest_v242-869407180-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'EmBpVyWq'): stdout= stderr= {{(pid=74613) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 17:52:52 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8230f3a2-63d8-46cb-8ec7-ceb89fb04e53 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 17:52:52 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8230f3a2-63d8-46cb-8ec7-ceb89fb04e53 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 17:52:52 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[91729ed1-2a1b-489e-8f8f-451bac48030d]: (4, ('', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 17:52:52 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-674e6337-afc0-4f43-9e4e-e7f97f5baa67 tempest-TaggedBootDevicesTest_v242-869407180 tempest-TaggedBootDevicesTest_v242-869407180-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74613) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 17:52:52 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 17:52:52 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 17:52:52 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca2c1627-1422-48be-a1b8-aec1817870c2]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fbbdc3d2-136d-4fba-b6ba-f27f35a0733b (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:24920064-fc81-4408-97d1-d8eff97a7554 (non-flash)\n', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 17:52:52 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-674e6337-afc0-4f43-9e4e-e7f97f5baa67 tempest-TaggedBootDevicesTest_v242-869407180 tempest-TaggedBootDevicesTest_v242-869407180-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fbbdc3d2-136d-4fba-b6ba-f27f35a0733b (non-flash)
Nov 29 17:52:52 user nova-compute[74613]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:24920064-fc81-4408-97d1-d8eff97a7554 (non-flash)
Nov 29 17:52:52 user nova-compute[74613]:  stderr= {{(pid=74613) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 17:52:52 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-674e6337-afc0-4f43-9e4e-e7f97f5baa67 tempest-TaggedBootDevicesTest_v242-869407180 tempest-TaggedBootDevicesTest_v242-869407180-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fbbdc3d2-136d-4fba-b6ba-f27f35a0733b (non-flash)
Nov 29 17:52:52 user nova-compute[74613]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:24920064-fc81-4408-97d1-d8eff97a7554 (non-flash)
Nov 29 17:52:52 user nova-compute[74613]:  stderr= {{(pid=74613) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 17:52:52 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8230f3a2-63d8-46cb-8ec7-ceb89fb04e53 -p 172.16.0.220:3260 --login {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 17:52:52 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8230f3a2-63d8-46cb-8ec7-ceb89fb04e53 -p 172.16.0.220:3260 --login" returned: 0 in 0.058s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 17:52:52 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[2425f5a5-aec8-4a4a-98ec-4a76431c0597]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:8230f3a2-63d8-46cb-8ec7-ceb89fb04e53, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:8230f3a2-63d8-46cb-8ec7-ceb89fb04e53, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 17:52:52 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-674e6337-afc0-4f43-9e4e-e7f97f5baa67 tempest-TaggedBootDevicesTest_v242-869407180 tempest-TaggedBootDevicesTest_v242-869407180-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:8230f3a2-63d8-46cb-8ec7-ceb89fb04e53, portal: 172.16.0.220,3260]
Nov 29 17:52:52 user nova-compute[74613]: Login to [iface: default, target: iqn.2010-10.org.openstack:8230f3a2-63d8-46cb-8ec7-ceb89fb04e53, portal: 172.16.0.220,3260] successful.
Nov 29 17:52:52 user nova-compute[74613]:  stderr= {{(pid=74613) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 17:52:52 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8230f3a2-63d8-46cb-8ec7-ceb89fb04e53 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 17:52:52 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8230f3a2-63d8-46cb-8ec7-ceb89fb04e53 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.017s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 17:52:52 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b7f6065-a235-4fbe-b83e-33d9db0d4879]: (4, ('', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 17:52:52 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-674e6337-afc0-4f43-9e4e-e7f97f5baa67 tempest-TaggedBootDevicesTest_v242-869407180 tempest-TaggedBootDevicesTest_v242-869407180-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74613) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 17:52:52 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 17:52:52 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 17:52:52 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0f2e8f7-f572-43bd-84e6-b5f6b1ed9f07]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fbbdc3d2-136d-4fba-b6ba-f27f35a0733b (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:24920064-fc81-4408-97d1-d8eff97a7554 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8230f3a2-63d8-46cb-8ec7-ceb89fb04e53 (non-flash)\n', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 17:52:52 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-674e6337-afc0-4f43-9e4e-e7f97f5baa67 tempest-TaggedBootDevicesTest_v242-869407180 tempest-TaggedBootDevicesTest_v242-869407180-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fbbdc3d2-136d-4fba-b6ba-f27f35a0733b (non-flash)
Nov 29 17:52:52 user nova-compute[74613]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:24920064-fc81-4408-97d1-d8eff97a7554 (non-flash)
Nov 29 17:52:52 user nova-compute[74613]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8230f3a2-63d8-46cb-8ec7-ceb89fb04e53 (non-flash)
Nov 29 17:52:52 user nova-compute[74613]:  stderr= {{(pid=74613) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 17:52:52 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-674e6337-afc0-4f43-9e4e-e7f97f5baa67 tempest-TaggedBootDevicesTest_v242-869407180 tempest-TaggedBootDevicesTest_v242-869407180-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fbbdc3d2-136d-4fba-b6ba-f27f35a0733b (non-flash)
Nov 29 17:52:52 user nova-compute[74613]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:24920064-fc81-4408-97d1-d8eff97a7554 (non-flash)
Nov 29 17:52:52 user nova-compute[74613]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8230f3a2-63d8-46cb-8ec7-ceb89fb04e53 (non-flash)
Nov 29 17:52:52 user nova-compute[74613]:  stderr= {{(pid=74613) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 17:52:52 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.base [None req-674e6337-afc0-4f43-9e4e-e7f97f5baa67 tempest-TaggedBootDevicesTest_v242-869407180 tempest-TaggedBootDevicesTest_v242-869407180-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8230f3a2-63d8-46cb-8ec7-ceb89fb04e53" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.271s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 17:52:52 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-674e6337-afc0-4f43-9e4e-e7f97f5baa67 tempest-TaggedBootDevicesTest_v242-869407180 tempest-TaggedBootDevicesTest_v242-869407180-project-member] Connected to 172.16.0.220:3260 {{(pid=74613) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 29 17:52:52 user nova-compute[74613]: DEBUG os_brick.initiator.linuxscsi [None req-674e6337-afc0-4f43-9e4e-e7f97f5baa67 tempest-TaggedBootDevicesTest_v242-869407180 tempest-TaggedBootDevicesTest_v242-869407180-project-member] HCTL ('35', '-', '-', 0) found on session 4 with lun 0 {{(pid=74613) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 29 17:52:52 user nova-compute[74613]: DEBUG os_brick.initiator.linuxscsi [None req-674e6337-afc0-4f43-9e4e-e7f97f5baa67 tempest-TaggedBootDevicesTest_v242-869407180 tempest-TaggedBootDevicesTest_v242-869407180-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=74613) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 29 17:52:52 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 17:52:52 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.016s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 17:52:52 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c04f73b-0fd5-48f5-b7e9-a9280e65ce83]: (4, ('- - 0', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 17:52:52 user nova-compute[74613]: DEBUG os_brick.initiator.linuxscsi [None req-674e6337-afc0-4f43-9e4e-e7f97f5baa67 tempest-TaggedBootDevicesTest_v242-869407180 tempest-TaggedBootDevicesTest_v242-869407180-project-member] Searching for a device in session 4 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=74613) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 29 17:52:52 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-674e6337-afc0-4f43-9e4e-e7f97f5baa67 tempest-TaggedBootDevicesTest_v242-869407180 tempest-TaggedBootDevicesTest_v242-869407180-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:8230f3a2-63d8-46cb-8ec7-ceb89fb04e53', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'EmBpVyWq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74613) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 29 17:52:53 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.base [None req-674e6337-afc0-4f43-9e4e-e7f97f5baa67 tempest-TaggedBootDevicesTest_v242-869407180 tempest-TaggedBootDevicesTest_v242-869407180-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.306s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 17:52:53 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-674e6337-afc0-4f43-9e4e-e7f97f5baa67 tempest-TaggedBootDevicesTest_v242-869407180 tempest-TaggedBootDevicesTest_v242-869407180-project-member] <== connect_volume: return (1307ms) {'type': 'block', 'scsi_wwn': '23462633066633131', 'path': '/dev/sdd'} {{(pid=74613) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 17:52:53 user nova-compute[74613]: DEBUG nova.virt.libvirt.volume.iscsi [None req-674e6337-afc0-4f43-9e4e-e7f97f5baa67 tempest-TaggedBootDevicesTest_v242-869407180 tempest-TaggedBootDevicesTest_v242-869407180-project-member] [instance: 3f285832-64a7-48e8-875a-f9e1566a66b6] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23462633066633131', 'path': '/dev/sdd'} {{(pid=74613) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 29 17:52:53 user nova-compute[74613]: DEBUG nova.virt.libvirt.volume.iscsi [None req-674e6337-afc0-4f43-9e4e-e7f97f5baa67 tempest-TaggedBootDevicesTest_v242-869407180 tempest-TaggedBootDevicesTest_v242-869407180-project-member] [instance: 3f285832-64a7-48e8-875a-f9e1566a66b6] Calling os-brick to attach iSCSI Volume {{(pid=74613) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 29 17:52:53 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-674e6337-afc0-4f43-9e4e-e7f97f5baa67 tempest-TaggedBootDevicesTest_v242-869407180 tempest-TaggedBootDevicesTest_v242-869407180-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff828156890>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:d1f798a1-4f7b-4b9a-8180-fa8f4eb89bf0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'FoOgQJel', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74613) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 17:52:53 user nova-compute[74613]: WARNING os_brick.initiator.connectors.base [None req-674e6337-afc0-4f43-9e4e-e7f97f5baa67 tempest-TaggedBootDevicesTest_v242-869407180 tempest-TaggedBootDevicesTest_v242-869407180-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 17:52:53 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.base [None req-674e6337-afc0-4f43-9e4e-e7f97f5baa67 tempest-TaggedBootDevicesTest_v242-869407180 tempest-TaggedBootDevicesTest_v242-869407180-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 17:52:53 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.base [None req-674e6337-afc0-4f43-9e4e-e7f97f5baa67 tempest-TaggedBootDevicesTest_v242-869407180 tempest-TaggedBootDevicesTest_v242-869407180-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 17:52:53 user nova-compute[74613]: WARNING os_brick.initiator.connectors.base [None req-674e6337-afc0-4f43-9e4e-e7f97f5baa67 tempest-TaggedBootDevicesTest_v242-869407180 tempest-TaggedBootDevicesTest_v242-869407180-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 17:52:53 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.base [None req-674e6337-afc0-4f43-9e4e-e7f97f5baa67 tempest-TaggedBootDevicesTest_v242-869407180 tempest-TaggedBootDevicesTest_v242-869407180-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d1f798a1-4f7b-4b9a-8180-fa8f4eb89bf0" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 17:52:53 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.base [None req-674e6337-afc0-4f43-9e4e-e7f97f5baa67 tempest-TaggedBootDevicesTest_v242-869407180 tempest-TaggedBootDevicesTest_v242-869407180-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d1f798a1-4f7b-4b9a-8180-fa8f4eb89bf0" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 17:52:53 user nova-compute[74613]: INFO os_brick.initiator.connectors.iscsi [None req-674e6337-afc0-4f43-9e4e-e7f97f5baa67 tempest-TaggedBootDevicesTest_v242-869407180 tempest-TaggedBootDevicesTest_v242-869407180-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 29 17:52:53 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d1f798a1-4f7b-4b9a-8180-fa8f4eb89bf0 -p 172.16.0.220:3260 {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 17:52:53 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d1f798a1-4f7b-4b9a-8180-fa8f4eb89bf0 -p 172.16.0.220:3260" returned: 21 in 0.016s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 17:52:53 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[16eee762-701b-4611-ba65-6d79c20935ca]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 17:52:53 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-674e6337-afc0-4f43-9e4e-e7f97f5baa67 tempest-TaggedBootDevicesTest_v242-869407180 tempest-TaggedBootDevicesTest_v242-869407180-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 29 17:52:53 user nova-compute[74613]:  {{(pid=74613) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 17:52:53 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d1f798a1-4f7b-4b9a-8180-fa8f4eb89bf0 -p 172.16.0.220:3260 --interface default --op new {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 17:52:53 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d1f798a1-4f7b-4b9a-8180-fa8f4eb89bf0 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.017s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 17:52:53 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[87cb0d39-532d-44f1-ba5b-41269850fe6e]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d1f798a1-4f7b-4b9a-8180-fa8f4eb89bf0] added\n', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 17:52:53 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-674e6337-afc0-4f43-9e4e-e7f97f5baa67 tempest-TaggedBootDevicesTest_v242-869407180 tempest-TaggedBootDevicesTest_v242-869407180-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d1f798a1-4f7b-4b9a-8180-fa8f4eb89bf0] added
Nov 29 17:52:53 user nova-compute[74613]:  stderr= {{(pid=74613) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 17:52:53 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d1f798a1-4f7b-4b9a-8180-fa8f4eb89bf0 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 17:52:53 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d1f798a1-4f7b-4b9a-8180-fa8f4eb89bf0 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 17:52:53 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[a160eed2-a5f4-40cf-a4a1-918b9e74b078]: (4, ('', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 17:52:53 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-674e6337-afc0-4f43-9e4e-e7f97f5baa67 tempest-TaggedBootDevicesTest_v242-869407180 tempest-TaggedBootDevicesTest_v242-869407180-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74613) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 17:52:53 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d1f798a1-4f7b-4b9a-8180-fa8f4eb89bf0 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 17:52:53 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d1f798a1-4f7b-4b9a-8180-fa8f4eb89bf0 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 17:52:53 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[42bf2665-aa56-4ba5-aab9-0f05c3926302]: (4, ('', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 17:52:53 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-674e6337-afc0-4f43-9e4e-e7f97f5baa67 tempest-TaggedBootDevicesTest_v242-869407180 tempest-TaggedBootDevicesTest_v242-869407180-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74613) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 17:52:53 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d1f798a1-4f7b-4b9a-8180-fa8f4eb89bf0 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v FoOgQJel {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 17:52:53 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d1f798a1-4f7b-4b9a-8180-fa8f4eb89bf0 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v FoOgQJel" returned: 0 in 0.016s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 17:52:53 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[91381d69-b0d3-4afa-8abe-fdb7d24aa481]: (4, ('', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 17:52:53 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-674e6337-afc0-4f43-9e4e-e7f97f5baa67 tempest-TaggedBootDevicesTest_v242-869407180 tempest-TaggedBootDevicesTest_v242-869407180-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'FoOgQJel'): stdout= stderr= {{(pid=74613) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 17:52:53 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d1f798a1-4f7b-4b9a-8180-fa8f4eb89bf0 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 17:52:53 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d1f798a1-4f7b-4b9a-8180-fa8f4eb89bf0 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.015s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 17:52:53 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[2cf740a9-b13d-4447-aa3a-71d8e73afa31]: (4, ('', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 17:52:53 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-674e6337-afc0-4f43-9e4e-e7f97f5baa67 tempest-TaggedBootDevicesTest_v242-869407180 tempest-TaggedBootDevicesTest_v242-869407180-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74613) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 17:52:53 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 17:52:53 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 17:52:53 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[100c06f7-fd7d-44d3-9f12-96cc63178687]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fbbdc3d2-136d-4fba-b6ba-f27f35a0733b (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:24920064-fc81-4408-97d1-d8eff97a7554 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8230f3a2-63d8-46cb-8ec7-ceb89fb04e53 (non-flash)\n', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 17:52:53 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-674e6337-afc0-4f43-9e4e-e7f97f5baa67 tempest-TaggedBootDevicesTest_v242-869407180 tempest-TaggedBootDevicesTest_v242-869407180-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fbbdc3d2-136d-4fba-b6ba-f27f35a0733b (non-flash)
Nov 29 17:52:53 user nova-compute[74613]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:24920064-fc81-4408-97d1-d8eff97a7554 (non-flash)
Nov 29 17:52:53 user nova-compute[74613]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8230f3a2-63d8-46cb-8ec7-ceb89fb04e53 (non-flash)
Nov 29 17:52:53 user nova-compute[74613]:  stderr= {{(pid=74613) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 17:52:53 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-674e6337-afc0-4f43-9e4e-e7f97f5baa67 tempest-TaggedBootDevicesTest_v242-869407180 tempest-TaggedBootDevicesTest_v242-869407180-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fbbdc3d2-136d-4fba-b6ba-f27f35a0733b (non-flash)
Nov 29 17:52:53 user nova-compute[74613]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:24920064-fc81-4408-97d1-d8eff97a7554 (non-flash)
Nov 29 17:52:53 user nova-compute[74613]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8230f3a2-63d8-46cb-8ec7-ceb89fb04e53 (non-flash)
Nov 29 17:52:53 user nova-compute[74613]:  stderr= {{(pid=74613) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 17:52:53 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d1f798a1-4f7b-4b9a-8180-fa8f4eb89bf0 -p 172.16.0.220:3260 --login {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 17:52:54 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d1f798a1-4f7b-4b9a-8180-fa8f4eb89bf0 -p 172.16.0.220:3260 --login" returned: 0 in 0.057s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 17:52:54 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[674856f9-514a-4b2b-bcad-a85957704f3e]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:d1f798a1-4f7b-4b9a-8180-fa8f4eb89bf0, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:d1f798a1-4f7b-4b9a-8180-fa8f4eb89bf0, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 17:52:54 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-674e6337-afc0-4f43-9e4e-e7f97f5baa67 tempest-TaggedBootDevicesTest_v242-869407180 tempest-TaggedBootDevicesTest_v242-869407180-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:d1f798a1-4f7b-4b9a-8180-fa8f4eb89bf0, portal: 172.16.0.220,3260]
Nov 29 17:52:54 user nova-compute[74613]: Login to [iface: default, target: iqn.2010-10.org.openstack:d1f798a1-4f7b-4b9a-8180-fa8f4eb89bf0, portal: 172.16.0.220,3260] successful.
Nov 29 17:52:54 user nova-compute[74613]:  stderr= {{(pid=74613) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 17:52:54 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d1f798a1-4f7b-4b9a-8180-fa8f4eb89bf0 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 17:52:54 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d1f798a1-4f7b-4b9a-8180-fa8f4eb89bf0 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 17:52:54 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d7584fa-05fd-4338-b368-a4f9c09848b1]: (4, ('', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 17:52:54 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-674e6337-afc0-4f43-9e4e-e7f97f5baa67 tempest-TaggedBootDevicesTest_v242-869407180 tempest-TaggedBootDevicesTest_v242-869407180-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74613) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 17:52:54 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 17:52:54 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 17:52:54 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[96504e1d-1c1b-44d2-8f6e-3d765c33b171]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fbbdc3d2-136d-4fba-b6ba-f27f35a0733b (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:24920064-fc81-4408-97d1-d8eff97a7554 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8230f3a2-63d8-46cb-8ec7-ceb89fb04e53 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d1f798a1-4f7b-4b9a-8180-fa8f4eb89bf0 (non-flash)\n', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 17:52:54 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-674e6337-afc0-4f43-9e4e-e7f97f5baa67 tempest-TaggedBootDevicesTest_v242-869407180 tempest-TaggedBootDevicesTest_v242-869407180-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fbbdc3d2-136d-4fba-b6ba-f27f35a0733b (non-flash)
Nov 29 17:52:54 user nova-compute[74613]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:24920064-fc81-4408-97d1-d8eff97a7554 (non-flash)
Nov 29 17:52:54 user nova-compute[74613]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8230f3a2-63d8-46cb-8ec7-ceb89fb04e53 (non-flash)
Nov 29 17:52:54 user nova-compute[74613]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d1f798a1-4f7b-4b9a-8180-fa8f4eb89bf0 (non-flash)
Nov 29 17:52:54 user nova-compute[74613]:  stderr= {{(pid=74613) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 17:52:54 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-674e6337-afc0-4f43-9e4e-e7f97f5baa67 tempest-TaggedBootDevicesTest_v242-869407180 tempest-TaggedBootDevicesTest_v242-869407180-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fbbdc3d2-136d-4fba-b6ba-f27f35a0733b (non-flash)
Nov 29 17:52:54 user nova-compute[74613]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:24920064-fc81-4408-97d1-d8eff97a7554 (non-flash)
Nov 29 17:52:54 user nova-compute[74613]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8230f3a2-63d8-46cb-8ec7-ceb89fb04e53 (non-flash)
Nov 29 17:52:54 user nova-compute[74613]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d1f798a1-4f7b-4b9a-8180-fa8f4eb89bf0 (non-flash)
Nov 29 17:52:54 user nova-compute[74613]:  stderr= {{(pid=74613) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 17:52:54 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.base [None req-674e6337-afc0-4f43-9e4e-e7f97f5baa67 tempest-TaggedBootDevicesTest_v242-869407180 tempest-TaggedBootDevicesTest_v242-869407180-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d1f798a1-4f7b-4b9a-8180-fa8f4eb89bf0" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.257s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 17:52:54 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-674e6337-afc0-4f43-9e4e-e7f97f5baa67 tempest-TaggedBootDevicesTest_v242-869407180 tempest-TaggedBootDevicesTest_v242-869407180-project-member] Connected to 172.16.0.220:3260 {{(pid=74613) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 29 17:52:54 user nova-compute[74613]: DEBUG os_brick.initiator.linuxscsi [None req-674e6337-afc0-4f43-9e4e-e7f97f5baa67 tempest-TaggedBootDevicesTest_v242-869407180 tempest-TaggedBootDevicesTest_v242-869407180-project-member] HCTL ('36', '-', '-', 0) found on session 5 with lun 0 {{(pid=74613) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 29 17:52:54 user nova-compute[74613]: DEBUG os_brick.initiator.linuxscsi [None req-674e6337-afc0-4f43-9e4e-e7f97f5baa67 tempest-TaggedBootDevicesTest_v242-869407180 tempest-TaggedBootDevicesTest_v242-869407180-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=74613) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 29 17:52:54 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 17:52:54 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.015s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 17:52:54 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb04499b-0385-4673-a226-53a9f0e6a1eb]: (4, ('- - 0', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 17:52:54 user nova-compute[74613]: DEBUG os_brick.initiator.linuxscsi [None req-674e6337-afc0-4f43-9e4e-e7f97f5baa67 tempest-TaggedBootDevicesTest_v242-869407180 tempest-TaggedBootDevicesTest_v242-869407180-project-member] Searching for a device in session 5 and hctl ['36', '*', '*', 0] yield: None {{(pid=74613) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 29 17:52:54 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:52:55 user nova-compute[74613]: DEBUG os_brick.initiator.linuxscsi [None req-674e6337-afc0-4f43-9e4e-e7f97f5baa67 tempest-TaggedBootDevicesTest_v242-869407180 tempest-TaggedBootDevicesTest_v242-869407180-project-member] Searching for a device in session 5 and hctl ['36', '*', '*', 0] yield: sde {{(pid=74613) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 29 17:52:55 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-674e6337-afc0-4f43-9e4e-e7f97f5baa67 tempest-TaggedBootDevicesTest_v242-869407180 tempest-TaggedBootDevicesTest_v242-869407180-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:d1f798a1-4f7b-4b9a-8180-fa8f4eb89bf0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'FoOgQJel', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74613) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 29 17:52:55 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.base [None req-674e6337-afc0-4f43-9e4e-e7f97f5baa67 tempest-TaggedBootDevicesTest_v242-869407180 tempest-TaggedBootDevicesTest_v242-869407180-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.288s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 17:52:55 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-674e6337-afc0-4f43-9e4e-e7f97f5baa67 tempest-TaggedBootDevicesTest_v242-869407180 tempest-TaggedBootDevicesTest_v242-869407180-project-member] <== connect_volume: return (1289ms) {'type': 'block', 'scsi_wwn': '23265336564363366', 'path': '/dev/sde'} {{(pid=74613) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 17:52:55 user nova-compute[74613]: DEBUG nova.virt.libvirt.volume.iscsi [None req-674e6337-afc0-4f43-9e4e-e7f97f5baa67 tempest-TaggedBootDevicesTest_v242-869407180 tempest-TaggedBootDevicesTest_v242-869407180-project-member] [instance: 3f285832-64a7-48e8-875a-f9e1566a66b6] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23265336564363366', 'path': '/dev/sde'} {{(pid=74613) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 29 17:52:55 user nova-compute[74613]: DEBUG nova.virt.libvirt.vif [None req-674e6337-afc0-4f43-9e4e-e7f97f5baa67 tempest-TaggedBootDevicesTest_v242-869407180 tempest-TaggedBootDevicesTest_v242-869407180-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-29T17:52:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1859666771',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1859666771',id=11,image_ref='4217f428-8d9d-4ee1-9614-642d26d90c46',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKSRsE7CMPATzk0nhGKTXLyRQ2NjVsTAMbCrCKqZWb1yoHTJqXD7QPDDSiibpwgKBka38h6fgCSPKBI9itrRtjEmsKFRLJ9RpUfxeowCr9ERHXHEHuwVFTVkz9FoHnKnPQ==',key_name='tempest-keypair-955747048',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f655bcde631c4a839b98695eed5cfa4e',ramdisk_id='',reservation_id='r-5hebi871',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='4217f428-8d9d-4ee1-9614-642d26d90c46',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-869407180',owner_user_name='tempest-TaggedBootDevicesTest_v242-869407180-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T17:52:26Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e743f61509f44bcfac1b4baef1fd5c3c',uuid=3f285832-64a7-48e8-875a-f9e1566a66b6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "75aec901-492c-47e1-9621-158f2d11a5e7", "address": "fa:16:3e:78:3a:a6", "network": {"id": "ca76dd55-469c-4d51-a76e-8b160bef1707", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-570657334-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f655bcde631c4a839b98695eed5cfa4e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap75aec901-49", "ovs_interfaceid": "75aec901-492c-47e1-9621-158f2d11a5e7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74613) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 29 17:52:55 user nova-compute[74613]: DEBUG nova.network.os_vif_util [None req-674e6337-afc0-4f43-9e4e-e7f97f5baa67 tempest-TaggedBootDevicesTest_v242-869407180 tempest-TaggedBootDevicesTest_v242-869407180-project-member] Converting VIF {"id": "75aec901-492c-47e1-9621-158f2d11a5e7", "address": "fa:16:3e:78:3a:a6", "network": {"id": "ca76dd55-469c-4d51-a76e-8b160bef1707", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-570657334-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f655bcde631c4a839b98695eed5cfa4e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap75aec901-49", "ovs_interfaceid": "75aec901-492c-47e1-9621-158f2d11a5e7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74613) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 17:52:55 user nova-compute[74613]: DEBUG nova.network.os_vif_util [None req-674e6337-afc0-4f43-9e4e-e7f97f5baa67 tempest-TaggedBootDevicesTest_v242-869407180 tempest-TaggedBootDevicesTest_v242-869407180-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:78:3a:a6,bridge_name='br-int',has_traffic_filtering=True,id=75aec901-492c-47e1-9621-158f2d11a5e7,network=Network(ca76dd55-469c-4d51-a76e-8b160bef1707),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap75aec901-49') {{(pid=74613) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 17:52:55 user nova-compute[74613]: DEBUG nova.virt.libvirt.vif [None req-674e6337-afc0-4f43-9e4e-e7f97f5baa67 tempest-TaggedBootDevicesTest_v242-869407180 tempest-TaggedBootDevicesTest_v242-869407180-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-29T17:52:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1859666771',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1859666771',id=11,image_ref='4217f428-8d9d-4ee1-9614-642d26d90c46',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKSRsE7CMPATzk0nhGKTXLyRQ2NjVsTAMbCrCKqZWb1yoHTJqXD7QPDDSiibpwgKBka38h6fgCSPKBI9itrRtjEmsKFRLJ9RpUfxeowCr9ERHXHEHuwVFTVkz9FoHnKnPQ==',key_name='tempest-keypair-955747048',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f655bcde631c4a839b98695eed5cfa4e',ramdisk_id='',reservation_id='r-5hebi871',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='4217f428-8d9d-4ee1-9614-642d26d90c46',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-869407180',owner_user_name='tempest-TaggedBootDevicesTest_v242-869407180-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T17:52:26Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e743f61509f44bcfac1b4baef1fd5c3c',uuid=3f285832-64a7-48e8-875a-f9e1566a66b6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d2631ae0-4218-400c-8da8-cb6d3271579d", "address": "fa:16:3e:3a:4c:7e", "network": {"id": "1e109d3b-bb91-4ff7-b16f-d39181436f57", "bridge": "br-int", "label": "tempest-device-tagging-net1-1011700470", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.120", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "f655bcde631c4a839b98695eed5cfa4e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd2631ae0-42", "ovs_interfaceid": "d2631ae0-4218-400c-8da8-cb6d3271579d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74613) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 29 17:52:55 user nova-compute[74613]: DEBUG nova.network.os_vif_util [None req-674e6337-afc0-4f43-9e4e-e7f97f5baa67 tempest-TaggedBootDevicesTest_v242-869407180 tempest-TaggedBootDevicesTest_v242-869407180-project-member] Converting VIF {"id": "d2631ae0-4218-400c-8da8-cb6d3271579d", "address": "fa:16:3e:3a:4c:7e", "network": {"id": "1e109d3b-bb91-4ff7-b16f-d39181436f57", "bridge": "br-int", "label": "tempest-device-tagging-net1-1011700470", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.120", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "f655bcde631c4a839b98695eed5cfa4e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd2631ae0-42", "ovs_interfaceid": "d2631ae0-4218-400c-8da8-cb6d3271579d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74613) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 17:52:55 user nova-compute[74613]: DEBUG nova.network.os_vif_util [None req-674e6337-afc0-4f43-9e4e-e7f97f5baa67 tempest-TaggedBootDevicesTest_v242-869407180 tempest-TaggedBootDevicesTest_v242-869407180-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3a:4c:7e,bridge_name='br-int',has_traffic_filtering=True,id=d2631ae0-4218-400c-8da8-cb6d3271579d,network=Network(1e109d3b-bb91-4ff7-b16f-d39181436f57),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapd2631ae0-42') {{(pid=74613) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 17:52:55 user nova-compute[74613]: DEBUG nova.virt.libvirt.vif [None req-674e6337-afc0-4f43-9e4e-e7f97f5baa67 tempest-TaggedBootDevicesTest_v242-869407180 tempest-TaggedBootDevicesTest_v242-869407180-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-29T17:52:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1859666771',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1859666771',id=11,image_ref='4217f428-8d9d-4ee1-9614-642d26d90c46',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKSRsE7CMPATzk0nhGKTXLyRQ2NjVsTAMbCrCKqZWb1yoHTJqXD7QPDDSiibpwgKBka38h6fgCSPKBI9itrRtjEmsKFRLJ9RpUfxeowCr9ERHXHEHuwVFTVkz9FoHnKnPQ==',key_name='tempest-keypair-955747048',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f655bcde631c4a839b98695eed5cfa4e',ramdisk_id='',reservation_id='r-5hebi871',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='4217f428-8d9d-4ee1-9614-642d26d90c46',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-869407180',owner_user_name='tempest-TaggedBootDevicesTest_v242-869407180-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T17:52:26Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e743f61509f44bcfac1b4baef1fd5c3c',uuid=3f285832-64a7-48e8-875a-f9e1566a66b6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "83dc312c-87e6-47a8-b4a5-f7c3cec7ab50", "address": "fa:16:3e:fb:9b:31", "network": {"id": "1e109d3b-bb91-4ff7-b16f-d39181436f57", "bridge": "br-int", "label": "tempest-device-tagging-net1-1011700470", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.134", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "f655bcde631c4a839b98695eed5cfa4e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap83dc312c-87", "ovs_interfaceid": "83dc312c-87e6-47a8-b4a5-f7c3cec7ab50", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74613) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 29 17:52:55 user nova-compute[74613]: DEBUG nova.network.os_vif_util [None req-674e6337-afc0-4f43-9e4e-e7f97f5baa67 tempest-TaggedBootDevicesTest_v242-869407180 tempest-TaggedBootDevicesTest_v242-869407180-project-member] Converting VIF {"id": "83dc312c-87e6-47a8-b4a5-f7c3cec7ab50", "address": "fa:16:3e:fb:9b:31", "network": {"id": "1e109d3b-bb91-4ff7-b16f-d39181436f57", "bridge": "br-int", "label": "tempest-device-tagging-net1-1011700470", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.134", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "f655bcde631c4a839b98695eed5cfa4e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap83dc312c-87", "ovs_interfaceid": "83dc312c-87e6-47a8-b4a5-f7c3cec7ab50", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74613) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 17:52:55 user nova-compute[74613]: DEBUG nova.network.os_vif_util [None req-674e6337-afc0-4f43-9e4e-e7f97f5baa67 tempest-TaggedBootDevicesTest_v242-869407180 tempest-TaggedBootDevicesTest_v242-869407180-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:fb:9b:31,bridge_name='br-int',has_traffic_filtering=True,id=83dc312c-87e6-47a8-b4a5-f7c3cec7ab50,network=Network(1e109d3b-bb91-4ff7-b16f-d39181436f57),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap83dc312c-87') {{(pid=74613) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 17:52:55 user nova-compute[74613]: DEBUG nova.virt.libvirt.vif [None req-674e6337-afc0-4f43-9e4e-e7f97f5baa67 tempest-TaggedBootDevicesTest_v242-869407180 tempest-TaggedBootDevicesTest_v242-869407180-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-29T17:52:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1859666771',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1859666771',id=11,image_ref='4217f428-8d9d-4ee1-9614-642d26d90c46',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKSRsE7CMPATzk0nhGKTXLyRQ2NjVsTAMbCrCKqZWb1yoHTJqXD7QPDDSiibpwgKBka38h6fgCSPKBI9itrRtjEmsKFRLJ9RpUfxeowCr9ERHXHEHuwVFTVkz9FoHnKnPQ==',key_name='tempest-keypair-955747048',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f655bcde631c4a839b98695eed5cfa4e',ramdisk_id='',reservation_id='r-5hebi871',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='4217f428-8d9d-4ee1-9614-642d26d90c46',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-869407180',owner_user_name='tempest-TaggedBootDevicesTest_v242-869407180-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T17:52:26Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e743f61509f44bcfac1b4baef1fd5c3c',uuid=3f285832-64a7-48e8-875a-f9e1566a66b6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5ea35efd-1b2e-48eb-b8fb-fb15dab703dc", "address": "fa:16:3e:f1:48:4c", "network": {"id": "1e109d3b-bb91-4ff7-b16f-d39181436f57", "bridge": "br-int", "label": "tempest-device-tagging-net1-1011700470", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.157", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "f655bcde631c4a839b98695eed5cfa4e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5ea35efd-1b", "ovs_interfaceid": "5ea35efd-1b2e-48eb-b8fb-fb15dab703dc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74613) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 29 17:52:55 user nova-compute[74613]: DEBUG nova.network.os_vif_util [None req-674e6337-afc0-4f43-9e4e-e7f97f5baa67 tempest-TaggedBootDevicesTest_v242-869407180 tempest-TaggedBootDevicesTest_v242-869407180-project-member] Converting VIF {"id": "5ea35efd-1b2e-48eb-b8fb-fb15dab703dc", "address": "fa:16:3e:f1:48:4c", "network": {"id": "1e109d3b-bb91-4ff7-b16f-d39181436f57", "bridge": "br-int", "label": "tempest-device-tagging-net1-1011700470", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.157", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "f655bcde631c4a839b98695eed5cfa4e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5ea35efd-1b", "ovs_interfaceid": "5ea35efd-1b2e-48eb-b8fb-fb15dab703dc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74613) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 17:52:55 user nova-compute[74613]: DEBUG nova.network.os_vif_util [None req-674e6337-afc0-4f43-9e4e-e7f97f5baa67 tempest-TaggedBootDevicesTest_v242-869407180 tempest-TaggedBootDevicesTest_v242-869407180-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f1:48:4c,bridge_name='br-int',has_traffic_filtering=True,id=5ea35efd-1b2e-48eb-b8fb-fb15dab703dc,network=Network(1e109d3b-bb91-4ff7-b16f-d39181436f57),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5ea35efd-1b') {{(pid=74613) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 17:52:55 user nova-compute[74613]: DEBUG nova.virt.libvirt.vif [None req-674e6337-afc0-4f43-9e4e-e7f97f5baa67 tempest-TaggedBootDevicesTest_v242-869407180 tempest-TaggedBootDevicesTest_v242-869407180-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-29T17:52:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1859666771',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1859666771',id=11,image_ref='4217f428-8d9d-4ee1-9614-642d26d90c46',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKSRsE7CMPATzk0nhGKTXLyRQ2NjVsTAMbCrCKqZWb1yoHTJqXD7QPDDSiibpwgKBka38h6fgCSPKBI9itrRtjEmsKFRLJ9RpUfxeowCr9ERHXHEHuwVFTVkz9FoHnKnPQ==',key_name='tempest-keypair-955747048',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f655bcde631c4a839b98695eed5cfa4e',ramdisk_id='',reservation_id='r-5hebi871',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='4217f428-8d9d-4ee1-9614-642d26d90c46',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-869407180',owner_user_name='tempest-TaggedBootDevicesTest_v242-869407180-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T17:52:26Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e743f61509f44bcfac1b4baef1fd5c3c',uuid=3f285832-64a7-48e8-875a-f9e1566a66b6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3fe23755-ec08-4b17-87b2-c1eebd36042b", "address": "fa:16:3e:39:7c:dd", "network": {"id": "1e109d3b-bb91-4ff7-b16f-d39181436f57", "bridge": "br-int", "label": "tempest-device-tagging-net1-1011700470", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.66", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "f655bcde631c4a839b98695eed5cfa4e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3fe23755-ec", "ovs_interfaceid": "3fe23755-ec08-4b17-87b2-c1eebd36042b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74613) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 29 17:52:55 user nova-compute[74613]: DEBUG nova.network.os_vif_util [None req-674e6337-afc0-4f43-9e4e-e7f97f5baa67 tempest-TaggedBootDevicesTest_v242-869407180 tempest-TaggedBootDevicesTest_v242-869407180-project-member] Converting VIF {"id": "3fe23755-ec08-4b17-87b2-c1eebd36042b", "address": "fa:16:3e:39:7c:dd", "network": {"id": "1e109d3b-bb91-4ff7-b16f-d39181436f57", "bridge": "br-int", "label": "tempest-device-tagging-net1-1011700470", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.66", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "f655bcde631c4a839b98695eed5cfa4e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3fe23755-ec", "ovs_interfaceid": "3fe23755-ec08-4b17-87b2-c1eebd36042b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74613) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 17:52:55 user nova-compute[74613]: DEBUG nova.network.os_vif_util [None req-674e6337-afc0-4f43-9e4e-e7f97f5baa67 tempest-TaggedBootDevicesTest_v242-869407180 tempest-TaggedBootDevicesTest_v242-869407180-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:39:7c:dd,bridge_name='br-int',has_traffic_filtering=True,id=3fe23755-ec08-4b17-87b2-c1eebd36042b,network=Network(1e109d3b-bb91-4ff7-b16f-d39181436f57),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3fe23755-ec') {{(pid=74613) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 17:52:55 user nova-compute[74613]: DEBUG nova.virt.libvirt.vif [None req-674e6337-afc0-4f43-9e4e-e7f97f5baa67 tempest-TaggedBootDevicesTest_v242-869407180 tempest-TaggedBootDevicesTest_v242-869407180-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-29T17:52:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1859666771',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1859666771',id=11,image_ref='4217f428-8d9d-4ee1-9614-642d26d90c46',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKSRsE7CMPATzk0nhGKTXLyRQ2NjVsTAMbCrCKqZWb1yoHTJqXD7QPDDSiibpwgKBka38h6fgCSPKBI9itrRtjEmsKFRLJ9RpUfxeowCr9ERHXHEHuwVFTVkz9FoHnKnPQ==',key_name='tempest-keypair-955747048',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f655bcde631c4a839b98695eed5cfa4e',ramdisk_id='',reservation_id='r-5hebi871',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='4217f428-8d9d-4ee1-9614-642d26d90c46',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-869407180',owner_user_name='tempest-TaggedBootDevicesTest_v242-869407180-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T17:52:26Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e743f61509f44bcfac1b4baef1fd5c3c',uuid=3f285832-64a7-48e8-875a-f9e1566a66b6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "bffa705a-58aa-4cbd-9b9d-09c8229cf829", "address": "fa:16:3e:f7:c0:bd", "network": {"id": "6debc132-a947-4fdc-8d04-f10452f6ee9c", "bridge": "br-int", "label": "tempest-device-tagging-net2-597757606", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "f655bcde631c4a839b98695eed5cfa4e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbffa705a-58", "ovs_interfaceid": "bffa705a-58aa-4cbd-9b9d-09c8229cf829", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74613) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 29 17:52:55 user nova-compute[74613]: DEBUG nova.network.os_vif_util [None req-674e6337-afc0-4f43-9e4e-e7f97f5baa67 tempest-TaggedBootDevicesTest_v242-869407180 tempest-TaggedBootDevicesTest_v242-869407180-project-member] Converting VIF {"id": "bffa705a-58aa-4cbd-9b9d-09c8229cf829", "address": "fa:16:3e:f7:c0:bd", "network": {"id": "6debc132-a947-4fdc-8d04-f10452f6ee9c", "bridge": "br-int", "label": "tempest-device-tagging-net2-597757606", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "f655bcde631c4a839b98695eed5cfa4e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbffa705a-58", "ovs_interfaceid": "bffa705a-58aa-4cbd-9b9d-09c8229cf829", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74613) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 17:52:55 user nova-compute[74613]: DEBUG nova.network.os_vif_util [None req-674e6337-afc0-4f43-9e4e-e7f97f5baa67 tempest-TaggedBootDevicesTest_v242-869407180 tempest-TaggedBootDevicesTest_v242-869407180-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f7:c0:bd,bridge_name='br-int',has_traffic_filtering=True,id=bffa705a-58aa-4cbd-9b9d-09c8229cf829,network=Network(6debc132-a947-4fdc-8d04-f10452f6ee9c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbffa705a-58') {{(pid=74613) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 17:52:55 user nova-compute[74613]: DEBUG nova.virt.libvirt.vif [None req-674e6337-afc0-4f43-9e4e-e7f97f5baa67 tempest-TaggedBootDevicesTest_v242-869407180 tempest-TaggedBootDevicesTest_v242-869407180-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-29T17:52:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1859666771',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1859666771',id=11,image_ref='4217f428-8d9d-4ee1-9614-642d26d90c46',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKSRsE7CMPATzk0nhGKTXLyRQ2NjVsTAMbCrCKqZWb1yoHTJqXD7QPDDSiibpwgKBka38h6fgCSPKBI9itrRtjEmsKFRLJ9RpUfxeowCr9ERHXHEHuwVFTVkz9FoHnKnPQ==',key_name='tempest-keypair-955747048',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f655bcde631c4a839b98695eed5cfa4e',ramdisk_id='',reservation_id='r-5hebi871',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='4217f428-8d9d-4ee1-9614-642d26d90c46',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-869407180',owner_user_name='tempest-TaggedBootDevicesTest_v242-869407180-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T17:52:26Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e743f61509f44bcfac1b4baef1fd5c3c',uuid=3f285832-64a7-48e8-875a-f9e1566a66b6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "48d45408-4c70-44b7-a0c3-874ad1049d1a", "address": "fa:16:3e:a2:2a:db", "network": {"id": "6debc132-a947-4fdc-8d04-f10452f6ee9c", "bridge": "br-int", "label": "tempest-device-tagging-net2-597757606", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "f655bcde631c4a839b98695eed5cfa4e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap48d45408-4c", "ovs_interfaceid": "48d45408-4c70-44b7-a0c3-874ad1049d1a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74613) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 29 17:52:55 user nova-compute[74613]: DEBUG nova.network.os_vif_util [None req-674e6337-afc0-4f43-9e4e-e7f97f5baa67 tempest-TaggedBootDevicesTest_v242-869407180 tempest-TaggedBootDevicesTest_v242-869407180-project-member] Converting VIF {"id": "48d45408-4c70-44b7-a0c3-874ad1049d1a", "address": "fa:16:3e:a2:2a:db", "network": {"id": "6debc132-a947-4fdc-8d04-f10452f6ee9c", "bridge": "br-int", "label": "tempest-device-tagging-net2-597757606", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "f655bcde631c4a839b98695eed5cfa4e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap48d45408-4c", "ovs_interfaceid": "48d45408-4c70-44b7-a0c3-874ad1049d1a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74613) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 17:52:55 user nova-compute[74613]: DEBUG nova.network.os_vif_util [None req-674e6337-afc0-4f43-9e4e-e7f97f5baa67 tempest-TaggedBootDevicesTest_v242-869407180 tempest-TaggedBootDevicesTest_v242-869407180-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a2:2a:db,bridge_name='br-int',has_traffic_filtering=True,id=48d45408-4c70-44b7-a0c3-874ad1049d1a,network=Network(6debc132-a947-4fdc-8d04-f10452f6ee9c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap48d45408-4c') {{(pid=74613) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 17:52:55 user nova-compute[74613]: DEBUG nova.objects.instance [None req-674e6337-afc0-4f43-9e4e-e7f97f5baa67 tempest-TaggedBootDevicesTest_v242-869407180 tempest-TaggedBootDevicesTest_v242-869407180-project-member] Lazy-loading 'pci_devices' on Instance uuid 3f285832-64a7-48e8-875a-f9e1566a66b6 {{(pid=74613) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 17:52:55 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-674e6337-afc0-4f43-9e4e-e7f97f5baa67 tempest-TaggedBootDevicesTest_v242-869407180 tempest-TaggedBootDevicesTest_v242-869407180-project-member] [instance: 3f285832-64a7-48e8-875a-f9e1566a66b6] End _get_guest_xml xml=<domain type="kvm">
Nov 29 17:52:55 user nova-compute[74613]:   <uuid>3f285832-64a7-48e8-875a-f9e1566a66b6</uuid>
Nov 29 17:52:55 user nova-compute[74613]:   <name>instance-0000000b</name>
Nov 29 17:52:55 user nova-compute[74613]:   <memory>524288</memory>
Nov 29 17:52:55 user nova-compute[74613]:   <vcpu>1</vcpu>
Nov 29 17:52:55 user nova-compute[74613]:   <metadata>
Nov 29 17:52:55 user nova-compute[74613]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 29 17:52:55 user nova-compute[74613]:       <nova:package version="0.0.0"/>
Nov 29 17:52:55 user nova-compute[74613]:       <nova:name>tempest-device-tagging-server-1859666771</nova:name>
Nov 29 17:52:55 user nova-compute[74613]:       <nova:creationTime>2023-11-29 17:52:51</nova:creationTime>
Nov 29 17:52:55 user nova-compute[74613]:       <nova:flavor name="m1.tiny">
Nov 29 17:52:55 user nova-compute[74613]:         <nova:memory>512</nova:memory>
Nov 29 17:52:55 user nova-compute[74613]:         <nova:disk>1</nova:disk>
Nov 29 17:52:55 user nova-compute[74613]:         <nova:swap>0</nova:swap>
Nov 29 17:52:55 user nova-compute[74613]:         <nova:ephemeral>0</nova:ephemeral>
Nov 29 17:52:55 user nova-compute[74613]:         <nova:vcpus>1</nova:vcpus>
Nov 29 17:52:55 user nova-compute[74613]:       </nova:flavor>
Nov 29 17:52:55 user nova-compute[74613]:       <nova:owner>
Nov 29 17:52:55 user nova-compute[74613]:         <nova:user uuid="e743f61509f44bcfac1b4baef1fd5c3c">tempest-TaggedBootDevicesTest_v242-869407180-project-member</nova:user>
Nov 29 17:52:55 user nova-compute[74613]:         <nova:project uuid="f655bcde631c4a839b98695eed5cfa4e">tempest-TaggedBootDevicesTest_v242-869407180</nova:project>
Nov 29 17:52:55 user nova-compute[74613]:       </nova:owner>
Nov 29 17:52:55 user nova-compute[74613]:       <nova:root type="image" uuid="4217f428-8d9d-4ee1-9614-642d26d90c46"/>
Nov 29 17:52:55 user nova-compute[74613]:       <nova:ports>
Nov 29 17:52:55 user nova-compute[74613]:         <nova:port uuid="75aec901-492c-47e1-9621-158f2d11a5e7">
Nov 29 17:52:55 user nova-compute[74613]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Nov 29 17:52:55 user nova-compute[74613]:         </nova:port>
Nov 29 17:52:55 user nova-compute[74613]:         <nova:port uuid="d2631ae0-4218-400c-8da8-cb6d3271579d">
Nov 29 17:52:55 user nova-compute[74613]:           <nova:ip type="fixed" address="10.1.1.120" ipVersion="4"/>
Nov 29 17:52:55 user nova-compute[74613]:         </nova:port>
Nov 29 17:52:55 user nova-compute[74613]:         <nova:port uuid="83dc312c-87e6-47a8-b4a5-f7c3cec7ab50">
Nov 29 17:52:55 user nova-compute[74613]:           <nova:ip type="fixed" address="10.1.1.134" ipVersion="4"/>
Nov 29 17:52:55 user nova-compute[74613]:         </nova:port>
Nov 29 17:52:55 user nova-compute[74613]:         <nova:port uuid="5ea35efd-1b2e-48eb-b8fb-fb15dab703dc">
Nov 29 17:52:55 user nova-compute[74613]:           <nova:ip type="fixed" address="10.1.1.157" ipVersion="4"/>
Nov 29 17:52:55 user nova-compute[74613]:         </nova:port>
Nov 29 17:52:55 user nova-compute[74613]:         <nova:port uuid="3fe23755-ec08-4b17-87b2-c1eebd36042b">
Nov 29 17:52:55 user nova-compute[74613]:           <nova:ip type="fixed" address="10.1.1.66" ipVersion="4"/>
Nov 29 17:52:55 user nova-compute[74613]:         </nova:port>
Nov 29 17:52:55 user nova-compute[74613]:         <nova:port uuid="bffa705a-58aa-4cbd-9b9d-09c8229cf829">
Nov 29 17:52:55 user nova-compute[74613]:           <nova:ip type="fixed" address="10.2.2.100" ipVersion="4"/>
Nov 29 17:52:55 user nova-compute[74613]:         </nova:port>
Nov 29 17:52:55 user nova-compute[74613]:         <nova:port uuid="48d45408-4c70-44b7-a0c3-874ad1049d1a">
Nov 29 17:52:55 user nova-compute[74613]:           <nova:ip type="fixed" address="10.2.2.200" ipVersion="4"/>
Nov 29 17:52:55 user nova-compute[74613]:         </nova:port>
Nov 29 17:52:55 user nova-compute[74613]:       </nova:ports>
Nov 29 17:52:55 user nova-compute[74613]:     </nova:instance>
Nov 29 17:52:55 user nova-compute[74613]:   </metadata>
Nov 29 17:52:55 user nova-compute[74613]:   <sysinfo type="smbios">
Nov 29 17:52:55 user nova-compute[74613]:     <system>
Nov 29 17:52:55 user nova-compute[74613]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 29 17:52:55 user nova-compute[74613]:       <entry name="product">OpenStack Nova</entry>
Nov 29 17:52:55 user nova-compute[74613]:       <entry name="version">0.0.0</entry>
Nov 29 17:52:55 user nova-compute[74613]:       <entry name="serial">3f285832-64a7-48e8-875a-f9e1566a66b6</entry>
Nov 29 17:52:55 user nova-compute[74613]:       <entry name="uuid">3f285832-64a7-48e8-875a-f9e1566a66b6</entry>
Nov 29 17:52:55 user nova-compute[74613]:       <entry name="family">Virtual Machine</entry>
Nov 29 17:52:55 user nova-compute[74613]:     </system>
Nov 29 17:52:55 user nova-compute[74613]:   </sysinfo>
Nov 29 17:52:55 user nova-compute[74613]:   <os>
Nov 29 17:52:55 user nova-compute[74613]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 29 17:52:55 user nova-compute[74613]:     <boot dev="hd"/>
Nov 29 17:52:55 user nova-compute[74613]:     <smbios mode="sysinfo"/>
Nov 29 17:52:55 user nova-compute[74613]:   </os>
Nov 29 17:52:55 user nova-compute[74613]:   <features>
Nov 29 17:52:55 user nova-compute[74613]:     <acpi/>
Nov 29 17:52:55 user nova-compute[74613]:     <apic/>
Nov 29 17:52:55 user nova-compute[74613]:     <vmcoreinfo/>
Nov 29 17:52:55 user nova-compute[74613]:   </features>
Nov 29 17:52:55 user nova-compute[74613]:   <clock offset="utc">
Nov 29 17:52:55 user nova-compute[74613]:     <timer name="pit" tickpolicy="delay"/>
Nov 29 17:52:55 user nova-compute[74613]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 29 17:52:55 user nova-compute[74613]:     <timer name="hpet" present="no"/>
Nov 29 17:52:55 user nova-compute[74613]:   </clock>
Nov 29 17:52:55 user nova-compute[74613]:   <cpu mode="custom" match="exact">
Nov 29 17:52:55 user nova-compute[74613]:     <model>Nehalem</model>
Nov 29 17:52:55 user nova-compute[74613]:     <topology sockets="1" cores="1" threads="1"/>
Nov 29 17:52:55 user nova-compute[74613]:   </cpu>
Nov 29 17:52:55 user nova-compute[74613]:   <devices>
Nov 29 17:52:55 user nova-compute[74613]:     <disk type="file" device="cdrom">
Nov 29 17:52:55 user nova-compute[74613]:       <driver name="qemu" type="raw" cache="none"/>
Nov 29 17:52:55 user nova-compute[74613]:       <source file="/opt/stack/data/nova/instances/3f285832-64a7-48e8-875a-f9e1566a66b6/disk.config"/>
Nov 29 17:52:55 user nova-compute[74613]:       <target dev="hda" bus="ide"/>
Nov 29 17:52:55 user nova-compute[74613]:     </disk>
Nov 29 17:52:55 user nova-compute[74613]:     <disk type="block" device="disk">
Nov 29 17:52:55 user nova-compute[74613]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 17:52:55 user nova-compute[74613]:       <source dev="/dev/sdc"/>
Nov 29 17:52:55 user nova-compute[74613]:       <target dev="vda" bus="virtio"/>
Nov 29 17:52:55 user nova-compute[74613]:       <serial>24920064-fc81-4408-97d1-d8eff97a7554</serial>
Nov 29 17:52:55 user nova-compute[74613]:     </disk>
Nov 29 17:52:55 user nova-compute[74613]:     <disk type="block" device="disk">
Nov 29 17:52:55 user nova-compute[74613]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 17:52:55 user nova-compute[74613]:       <source dev="/dev/sdd"/>
Nov 29 17:52:55 user nova-compute[74613]:       <target dev="vdb" bus="virtio"/>
Nov 29 17:52:55 user nova-compute[74613]:       <serial>8230f3a2-63d8-46cb-8ec7-ceb89fb04e53</serial>
Nov 29 17:52:55 user nova-compute[74613]:     </disk>
Nov 29 17:52:55 user nova-compute[74613]:     <disk type="block" device="disk">
Nov 29 17:52:55 user nova-compute[74613]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 17:52:55 user nova-compute[74613]:       <source dev="/dev/sde"/>
Nov 29 17:52:55 user nova-compute[74613]:       <target dev="vdc" bus="virtio"/>
Nov 29 17:52:55 user nova-compute[74613]:       <serial>d1f798a1-4f7b-4b9a-8180-fa8f4eb89bf0</serial>
Nov 29 17:52:55 user nova-compute[74613]:     </disk>
Nov 29 17:52:55 user nova-compute[74613]:     <interface type="ethernet">
Nov 29 17:52:55 user nova-compute[74613]:       <mac address="fa:16:3e:78:3a:a6"/>
Nov 29 17:52:55 user nova-compute[74613]:       <model type="virtio"/>
Nov 29 17:52:55 user nova-compute[74613]:       <mtu size="1442"/>
Nov 29 17:52:55 user nova-compute[74613]:       <target dev="tap75aec901-49"/>
Nov 29 17:52:55 user nova-compute[74613]:     </interface>
Nov 29 17:52:55 user nova-compute[74613]:     <interface type="ethernet">
Nov 29 17:52:55 user nova-compute[74613]:       <mac address="fa:16:3e:3a:4c:7e"/>
Nov 29 17:52:55 user nova-compute[74613]:       <model type="virtio"/>
Nov 29 17:52:55 user nova-compute[74613]:       <mtu size="1442"/>
Nov 29 17:52:55 user nova-compute[74613]:       <target dev="tapd2631ae0-42"/>
Nov 29 17:52:55 user nova-compute[74613]:     </interface>
Nov 29 17:52:55 user nova-compute[74613]:     <interface type="ethernet">
Nov 29 17:52:55 user nova-compute[74613]:       <mac address="fa:16:3e:fb:9b:31"/>
Nov 29 17:52:55 user nova-compute[74613]:       <model type="virtio"/>
Nov 29 17:52:55 user nova-compute[74613]:       <mtu size="1442"/>
Nov 29 17:52:55 user nova-compute[74613]:       <target dev="tap83dc312c-87"/>
Nov 29 17:52:55 user nova-compute[74613]:     </interface>
Nov 29 17:52:55 user nova-compute[74613]:     <interface type="ethernet">
Nov 29 17:52:55 user nova-compute[74613]:       <mac address="fa:16:3e:f1:48:4c"/>
Nov 29 17:52:55 user nova-compute[74613]:       <model type="virtio"/>
Nov 29 17:52:55 user nova-compute[74613]:       <mtu size="1442"/>
Nov 29 17:52:55 user nova-compute[74613]:       <target dev="tap5ea35efd-1b"/>
Nov 29 17:52:55 user nova-compute[74613]:     </interface>
Nov 29 17:52:55 user nova-compute[74613]:     <interface type="ethernet">
Nov 29 17:52:55 user nova-compute[74613]:       <mac address="fa:16:3e:39:7c:dd"/>
Nov 29 17:52:55 user nova-compute[74613]:       <model type="virtio"/>
Nov 29 17:52:55 user nova-compute[74613]:       <mtu size="1442"/>
Nov 29 17:52:55 user nova-compute[74613]:       <target dev="tap3fe23755-ec"/>
Nov 29 17:52:55 user nova-compute[74613]:     </interface>
Nov 29 17:52:55 user nova-compute[74613]:     <interface type="ethernet">
Nov 29 17:52:55 user nova-compute[74613]:       <mac address="fa:16:3e:f7:c0:bd"/>
Nov 29 17:52:55 user nova-compute[74613]:       <model type="virtio"/>
Nov 29 17:52:55 user nova-compute[74613]:       <mtu size="1442"/>
Nov 29 17:52:55 user nova-compute[74613]:       <target dev="tapbffa705a-58"/>
Nov 29 17:52:55 user nova-compute[74613]:     </interface>
Nov 29 17:52:55 user nova-compute[74613]:     <interface type="ethernet">
Nov 29 17:52:55 user nova-compute[74613]:       <mac address="fa:16:3e:a2:2a:db"/>
Nov 29 17:52:55 user nova-compute[74613]:       <model type="virtio"/>
Nov 29 17:52:55 user nova-compute[74613]:       <mtu size="1442"/>
Nov 29 17:52:55 user nova-compute[74613]:       <target dev="tap48d45408-4c"/>
Nov 29 17:52:55 user nova-compute[74613]:     </interface>
Nov 29 17:52:55 user nova-compute[74613]:     <serial type="pty">
Nov 29 17:52:55 user nova-compute[74613]:       <log file="/opt/stack/data/nova/instances/3f285832-64a7-48e8-875a-f9e1566a66b6/console.log" append="off"/>
Nov 29 17:52:55 user nova-compute[74613]:     </serial>
Nov 29 17:52:55 user nova-compute[74613]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 29 17:52:55 user nova-compute[74613]:     <video>
Nov 29 17:52:55 user nova-compute[74613]:       <model type="virtio"/>
Nov 29 17:52:55 user nova-compute[74613]:     </video>
Nov 29 17:52:55 user nova-compute[74613]:     <rng model="virtio">
Nov 29 17:52:55 user nova-compute[74613]:       <backend model="random">/dev/urandom</backend>
Nov 29 17:52:55 user nova-compute[74613]:     </rng>
Nov 29 17:52:55 user nova-compute[74613]:     <controller type="usb" index="0" model="none"/>
Nov 29 17:52:55 user nova-compute[74613]:     <memballoon model="virtio">
Nov 29 17:52:55 user nova-compute[74613]:       <stats period="10"/>
Nov 29 17:52:55 user nova-compute[74613]:     </memballoon>
Nov 29 17:52:55 user nova-compute[74613]:   </devices>
Nov 29 17:52:55 user nova-compute[74613]: </domain>
Nov 29 17:52:55 user nova-compute[74613]:  {{(pid=74613) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 29 17:52:55 user nova-compute[74613]: DEBUG nova.virt.libvirt.vif [None req-674e6337-afc0-4f43-9e4e-e7f97f5baa67 tempest-TaggedBootDevicesTest_v242-869407180 tempest-TaggedBootDevicesTest_v242-869407180-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-29T17:52:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1859666771',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1859666771',id=11,image_ref='4217f428-8d9d-4ee1-9614-642d26d90c46',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKSRsE7CMPATzk0nhGKTXLyRQ2NjVsTAMbCrCKqZWb1yoHTJqXD7QPDDSiibpwgKBka38h6fgCSPKBI9itrRtjEmsKFRLJ9RpUfxeowCr9ERHXHEHuwVFTVkz9FoHnKnPQ==',key_name='tempest-keypair-955747048',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f655bcde631c4a839b98695eed5cfa4e',ramdisk_id='',reservation_id='r-5hebi871',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='4217f428-8d9d-4ee1-9614-642d26d90c46',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-869407180',owner_user_name='tempest-TaggedBootDevicesTest_v242-869407180-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T17:52:26Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e743f61509f44bcfac1b4baef1fd5c3c',uuid=3f285832-64a7-48e8-875a-f9e1566a66b6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "75aec901-492c-47e1-9621-158f2d11a5e7", "address": "fa:16:3e:78:3a:a6", "network": {"id": "ca76dd55-469c-4d51-a76e-8b160bef1707", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-570657334-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f655bcde631c4a839b98695eed5cfa4e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap75aec901-49", "ovs_interfaceid": "75aec901-492c-47e1-9621-158f2d11a5e7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74613) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 29 17:52:55 user nova-compute[74613]: DEBUG nova.network.os_vif_util [None req-674e6337-afc0-4f43-9e4e-e7f97f5baa67 tempest-TaggedBootDevicesTest_v242-869407180 tempest-TaggedBootDevicesTest_v242-869407180-project-member] Converting VIF {"id": "75aec901-492c-47e1-9621-158f2d11a5e7", "address": "fa:16:3e:78:3a:a6", "network": {"id": "ca76dd55-469c-4d51-a76e-8b160bef1707", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-570657334-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f655bcde631c4a839b98695eed5cfa4e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap75aec901-49", "ovs_interfaceid": "75aec901-492c-47e1-9621-158f2d11a5e7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74613) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 17:52:55 user nova-compute[74613]: DEBUG nova.network.os_vif_util [None req-674e6337-afc0-4f43-9e4e-e7f97f5baa67 tempest-TaggedBootDevicesTest_v242-869407180 tempest-TaggedBootDevicesTest_v242-869407180-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:78:3a:a6,bridge_name='br-int',has_traffic_filtering=True,id=75aec901-492c-47e1-9621-158f2d11a5e7,network=Network(ca76dd55-469c-4d51-a76e-8b160bef1707),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap75aec901-49') {{(pid=74613) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 17:52:55 user nova-compute[74613]: DEBUG os_vif [None req-674e6337-afc0-4f43-9e4e-e7f97f5baa67 tempest-TaggedBootDevicesTest_v242-869407180 tempest-TaggedBootDevicesTest_v242-869407180-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:78:3a:a6,bridge_name='br-int',has_traffic_filtering=True,id=75aec901-492c-47e1-9621-158f2d11a5e7,network=Network(ca76dd55-469c-4d51-a76e-8b160bef1707),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap75aec901-49') {{(pid=74613) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 29 17:52:55 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:52:55 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74613) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 17:52:55 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74613) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 29 17:52:55 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:52:55 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '3492d430-e262-51f7-aeaf-e83106152799', '_type': 'linux-noop'}}, row=False) {{(pid=74613) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 17:52:55 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:52:55 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 17:52:55 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:52:55 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap75aec901-49, may_exist=True, interface_attrs={}) {{(pid=74613) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 17:52:55 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap75aec901-49, col_values=(('qos', UUID('2fdaf5cc-980c-48ee-95b0-fd6c60700a7c')),), if_exists=True) {{(pid=74613) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 17:52:55 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap75aec901-49, col_values=(('external_ids', {'iface-id': '75aec901-492c-47e1-9621-158f2d11a5e7', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:78:3a:a6', 'vm-uuid': '3f285832-64a7-48e8-875a-f9e1566a66b6'}),), if_exists=True) {{(pid=74613) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 17:52:55 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:52:55 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 17:52:55 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:52:55 user nova-compute[74613]: INFO os_vif [None req-674e6337-afc0-4f43-9e4e-e7f97f5baa67 tempest-TaggedBootDevicesTest_v242-869407180 tempest-TaggedBootDevicesTest_v242-869407180-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:78:3a:a6,bridge_name='br-int',has_traffic_filtering=True,id=75aec901-492c-47e1-9621-158f2d11a5e7,network=Network(ca76dd55-469c-4d51-a76e-8b160bef1707),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap75aec901-49')
Nov 29 17:52:55 user nova-compute[74613]: DEBUG nova.virt.libvirt.vif [None req-674e6337-afc0-4f43-9e4e-e7f97f5baa67 tempest-TaggedBootDevicesTest_v242-869407180 tempest-TaggedBootDevicesTest_v242-869407180-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-29T17:52:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1859666771',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1859666771',id=11,image_ref='4217f428-8d9d-4ee1-9614-642d26d90c46',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKSRsE7CMPATzk0nhGKTXLyRQ2NjVsTAMbCrCKqZWb1yoHTJqXD7QPDDSiibpwgKBka38h6fgCSPKBI9itrRtjEmsKFRLJ9RpUfxeowCr9ERHXHEHuwVFTVkz9FoHnKnPQ==',key_name='tempest-keypair-955747048',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f655bcde631c4a839b98695eed5cfa4e',ramdisk_id='',reservation_id='r-5hebi871',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='4217f428-8d9d-4ee1-9614-642d26d90c46',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-869407180',owner_user_name='tempest-TaggedBootDevicesTest_v242-869407180-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T17:52:26Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e743f61509f44bcfac1b4baef1fd5c3c',uuid=3f285832-64a7-48e8-875a-f9e1566a66b6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d2631ae0-4218-400c-8da8-cb6d3271579d", "address": "fa:16:3e:3a:4c:7e", "network": {"id": "1e109d3b-bb91-4ff7-b16f-d39181436f57", "bridge": "br-int", "label": "tempest-device-tagging-net1-1011700470", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.120", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "f655bcde631c4a839b98695eed5cfa4e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd2631ae0-42", "ovs_interfaceid": "d2631ae0-4218-400c-8da8-cb6d3271579d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74613) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 29 17:52:55 user nova-compute[74613]: DEBUG nova.network.os_vif_util [None req-674e6337-afc0-4f43-9e4e-e7f97f5baa67 tempest-TaggedBootDevicesTest_v242-869407180 tempest-TaggedBootDevicesTest_v242-869407180-project-member] Converting VIF {"id": "d2631ae0-4218-400c-8da8-cb6d3271579d", "address": "fa:16:3e:3a:4c:7e", "network": {"id": "1e109d3b-bb91-4ff7-b16f-d39181436f57", "bridge": "br-int", "label": "tempest-device-tagging-net1-1011700470", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.120", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "f655bcde631c4a839b98695eed5cfa4e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd2631ae0-42", "ovs_interfaceid": "d2631ae0-4218-400c-8da8-cb6d3271579d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74613) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 17:52:55 user nova-compute[74613]: DEBUG nova.network.os_vif_util [None req-674e6337-afc0-4f43-9e4e-e7f97f5baa67 tempest-TaggedBootDevicesTest_v242-869407180 tempest-TaggedBootDevicesTest_v242-869407180-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3a:4c:7e,bridge_name='br-int',has_traffic_filtering=True,id=d2631ae0-4218-400c-8da8-cb6d3271579d,network=Network(1e109d3b-bb91-4ff7-b16f-d39181436f57),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapd2631ae0-42') {{(pid=74613) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 17:52:55 user nova-compute[74613]: DEBUG os_vif [None req-674e6337-afc0-4f43-9e4e-e7f97f5baa67 tempest-TaggedBootDevicesTest_v242-869407180 tempest-TaggedBootDevicesTest_v242-869407180-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:3a:4c:7e,bridge_name='br-int',has_traffic_filtering=True,id=d2631ae0-4218-400c-8da8-cb6d3271579d,network=Network(1e109d3b-bb91-4ff7-b16f-d39181436f57),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapd2631ae0-42') {{(pid=74613) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 29 17:52:55 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:52:55 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74613) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 17:52:55 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74613) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 29 17:52:55 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:52:55 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '92c34721-b9bb-54f0-8b8c-d03bd2036c10', '_type': 'linux-noop'}}, row=False) {{(pid=74613) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 17:52:55 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:52:55 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 17:52:55 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:52:55 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:52:55 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapd2631ae0-42, may_exist=True, interface_attrs={}) {{(pid=74613) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 17:52:55 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapd2631ae0-42, col_values=(('qos', UUID('05799114-83ff-4d69-8a05-d20e7c5c4cc7')),), if_exists=True) {{(pid=74613) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 17:52:55 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapd2631ae0-42, col_values=(('external_ids', {'iface-id': 'd2631ae0-4218-400c-8da8-cb6d3271579d', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:3a:4c:7e', 'vm-uuid': '3f285832-64a7-48e8-875a-f9e1566a66b6'}),), if_exists=True) {{(pid=74613) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 17:52:55 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:52:55 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 17:52:55 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:52:55 user nova-compute[74613]: INFO os_vif [None req-674e6337-afc0-4f43-9e4e-e7f97f5baa67 tempest-TaggedBootDevicesTest_v242-869407180 tempest-TaggedBootDevicesTest_v242-869407180-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:3a:4c:7e,bridge_name='br-int',has_traffic_filtering=True,id=d2631ae0-4218-400c-8da8-cb6d3271579d,network=Network(1e109d3b-bb91-4ff7-b16f-d39181436f57),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapd2631ae0-42')
Nov 29 17:52:55 user nova-compute[74613]: DEBUG nova.virt.libvirt.vif [None req-674e6337-afc0-4f43-9e4e-e7f97f5baa67 tempest-TaggedBootDevicesTest_v242-869407180 tempest-TaggedBootDevicesTest_v242-869407180-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-29T17:52:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1859666771',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1859666771',id=11,image_ref='4217f428-8d9d-4ee1-9614-642d26d90c46',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKSRsE7CMPATzk0nhGKTXLyRQ2NjVsTAMbCrCKqZWb1yoHTJqXD7QPDDSiibpwgKBka38h6fgCSPKBI9itrRtjEmsKFRLJ9RpUfxeowCr9ERHXHEHuwVFTVkz9FoHnKnPQ==',key_name='tempest-keypair-955747048',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f655bcde631c4a839b98695eed5cfa4e',ramdisk_id='',reservation_id='r-5hebi871',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='4217f428-8d9d-4ee1-9614-642d26d90c46',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-869407180',owner_user_name='tempest-TaggedBootDevicesTest_v242-869407180-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T17:52:26Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e743f61509f44bcfac1b4baef1fd5c3c',uuid=3f285832-64a7-48e8-875a-f9e1566a66b6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "83dc312c-87e6-47a8-b4a5-f7c3cec7ab50", "address": "fa:16:3e:fb:9b:31", "network": {"id": "1e109d3b-bb91-4ff7-b16f-d39181436f57", "bridge": "br-int", "label": "tempest-device-tagging-net1-1011700470", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.134", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "f655bcde631c4a839b98695eed5cfa4e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap83dc312c-87", "ovs_interfaceid": "83dc312c-87e6-47a8-b4a5-f7c3cec7ab50", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74613) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 29 17:52:55 user nova-compute[74613]: DEBUG nova.network.os_vif_util [None req-674e6337-afc0-4f43-9e4e-e7f97f5baa67 tempest-TaggedBootDevicesTest_v242-869407180 tempest-TaggedBootDevicesTest_v242-869407180-project-member] Converting VIF {"id": "83dc312c-87e6-47a8-b4a5-f7c3cec7ab50", "address": "fa:16:3e:fb:9b:31", "network": {"id": "1e109d3b-bb91-4ff7-b16f-d39181436f57", "bridge": "br-int", "label": "tempest-device-tagging-net1-1011700470", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.134", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "f655bcde631c4a839b98695eed5cfa4e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap83dc312c-87", "ovs_interfaceid": "83dc312c-87e6-47a8-b4a5-f7c3cec7ab50", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74613) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 17:52:55 user nova-compute[74613]: DEBUG nova.network.os_vif_util [None req-674e6337-afc0-4f43-9e4e-e7f97f5baa67 tempest-TaggedBootDevicesTest_v242-869407180 tempest-TaggedBootDevicesTest_v242-869407180-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:fb:9b:31,bridge_name='br-int',has_traffic_filtering=True,id=83dc312c-87e6-47a8-b4a5-f7c3cec7ab50,network=Network(1e109d3b-bb91-4ff7-b16f-d39181436f57),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap83dc312c-87') {{(pid=74613) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 17:52:55 user nova-compute[74613]: DEBUG os_vif [None req-674e6337-afc0-4f43-9e4e-e7f97f5baa67 tempest-TaggedBootDevicesTest_v242-869407180 tempest-TaggedBootDevicesTest_v242-869407180-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:fb:9b:31,bridge_name='br-int',has_traffic_filtering=True,id=83dc312c-87e6-47a8-b4a5-f7c3cec7ab50,network=Network(1e109d3b-bb91-4ff7-b16f-d39181436f57),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap83dc312c-87') {{(pid=74613) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 29 17:52:55 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:52:55 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74613) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 17:52:55 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74613) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 29 17:52:55 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:52:55 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'fd1c011b-9558-54b3-8ac5-fac7b9019655', '_type': 'linux-noop'}}, row=False) {{(pid=74613) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 17:52:55 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:52:55 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 17:52:55 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:52:55 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:52:55 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap83dc312c-87, may_exist=True, interface_attrs={}) {{(pid=74613) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 17:52:55 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap83dc312c-87, col_values=(('qos', UUID('9cea1270-44e7-4271-81b7-658613a72578')),), if_exists=True) {{(pid=74613) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 17:52:55 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap83dc312c-87, col_values=(('external_ids', {'iface-id': '83dc312c-87e6-47a8-b4a5-f7c3cec7ab50', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:fb:9b:31', 'vm-uuid': '3f285832-64a7-48e8-875a-f9e1566a66b6'}),), if_exists=True) {{(pid=74613) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 17:52:55 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:52:55 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 17:52:55 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:52:55 user nova-compute[74613]: INFO os_vif [None req-674e6337-afc0-4f43-9e4e-e7f97f5baa67 tempest-TaggedBootDevicesTest_v242-869407180 tempest-TaggedBootDevicesTest_v242-869407180-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:fb:9b:31,bridge_name='br-int',has_traffic_filtering=True,id=83dc312c-87e6-47a8-b4a5-f7c3cec7ab50,network=Network(1e109d3b-bb91-4ff7-b16f-d39181436f57),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap83dc312c-87')
Nov 29 17:52:55 user nova-compute[74613]: DEBUG nova.virt.libvirt.vif [None req-674e6337-afc0-4f43-9e4e-e7f97f5baa67 tempest-TaggedBootDevicesTest_v242-869407180 tempest-TaggedBootDevicesTest_v242-869407180-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-29T17:52:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1859666771',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1859666771',id=11,image_ref='4217f428-8d9d-4ee1-9614-642d26d90c46',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKSRsE7CMPATzk0nhGKTXLyRQ2NjVsTAMbCrCKqZWb1yoHTJqXD7QPDDSiibpwgKBka38h6fgCSPKBI9itrRtjEmsKFRLJ9RpUfxeowCr9ERHXHEHuwVFTVkz9FoHnKnPQ==',key_name='tempest-keypair-955747048',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f655bcde631c4a839b98695eed5cfa4e',ramdisk_id='',reservation_id='r-5hebi871',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='4217f428-8d9d-4ee1-9614-642d26d90c46',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-869407180',owner_user_name='tempest-TaggedBootDevicesTest_v242-869407180-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T17:52:26Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e743f61509f44bcfac1b4baef1fd5c3c',uuid=3f285832-64a7-48e8-875a-f9e1566a66b6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5ea35efd-1b2e-48eb-b8fb-fb15dab703dc", "address": "fa:16:3e:f1:48:4c", "network": {"id": "1e109d3b-bb91-4ff7-b16f-d39181436f57", "bridge": "br-int", "label": "tempest-device-tagging-net1-1011700470", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.157", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "f655bcde631c4a839b98695eed5cfa4e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5ea35efd-1b", "ovs_interfaceid": "5ea35efd-1b2e-48eb-b8fb-fb15dab703dc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74613) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 29 17:52:55 user nova-compute[74613]: DEBUG nova.network.os_vif_util [None req-674e6337-afc0-4f43-9e4e-e7f97f5baa67 tempest-TaggedBootDevicesTest_v242-869407180 tempest-TaggedBootDevicesTest_v242-869407180-project-member] Converting VIF {"id": "5ea35efd-1b2e-48eb-b8fb-fb15dab703dc", "address": "fa:16:3e:f1:48:4c", "network": {"id": "1e109d3b-bb91-4ff7-b16f-d39181436f57", "bridge": "br-int", "label": "tempest-device-tagging-net1-1011700470", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.157", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "f655bcde631c4a839b98695eed5cfa4e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5ea35efd-1b", "ovs_interfaceid": "5ea35efd-1b2e-48eb-b8fb-fb15dab703dc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74613) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 17:52:55 user nova-compute[74613]: DEBUG nova.network.os_vif_util [None req-674e6337-afc0-4f43-9e4e-e7f97f5baa67 tempest-TaggedBootDevicesTest_v242-869407180 tempest-TaggedBootDevicesTest_v242-869407180-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f1:48:4c,bridge_name='br-int',has_traffic_filtering=True,id=5ea35efd-1b2e-48eb-b8fb-fb15dab703dc,network=Network(1e109d3b-bb91-4ff7-b16f-d39181436f57),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5ea35efd-1b') {{(pid=74613) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 17:52:55 user nova-compute[74613]: DEBUG os_vif [None req-674e6337-afc0-4f43-9e4e-e7f97f5baa67 tempest-TaggedBootDevicesTest_v242-869407180 tempest-TaggedBootDevicesTest_v242-869407180-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f1:48:4c,bridge_name='br-int',has_traffic_filtering=True,id=5ea35efd-1b2e-48eb-b8fb-fb15dab703dc,network=Network(1e109d3b-bb91-4ff7-b16f-d39181436f57),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5ea35efd-1b') {{(pid=74613) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 29 17:52:55 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:52:55 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74613) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 17:52:55 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74613) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 29 17:52:55 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:52:55 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'c719427c-9fd3-5ff9-9aef-67cf2032e003', '_type': 'linux-noop'}}, row=False) {{(pid=74613) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 17:52:55 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:52:55 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 17:52:55 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:52:55 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:52:55 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap5ea35efd-1b, may_exist=True, interface_attrs={}) {{(pid=74613) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 17:52:55 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap5ea35efd-1b, col_values=(('qos', UUID('dbab86ec-d036-46f1-9ec0-4e99091ab995')),), if_exists=True) {{(pid=74613) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 17:52:55 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap5ea35efd-1b, col_values=(('external_ids', {'iface-id': '5ea35efd-1b2e-48eb-b8fb-fb15dab703dc', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:f1:48:4c', 'vm-uuid': '3f285832-64a7-48e8-875a-f9e1566a66b6'}),), if_exists=True) {{(pid=74613) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 17:52:55 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:52:55 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 17:52:55 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:52:55 user nova-compute[74613]: INFO os_vif [None req-674e6337-afc0-4f43-9e4e-e7f97f5baa67 tempest-TaggedBootDevicesTest_v242-869407180 tempest-TaggedBootDevicesTest_v242-869407180-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f1:48:4c,bridge_name='br-int',has_traffic_filtering=True,id=5ea35efd-1b2e-48eb-b8fb-fb15dab703dc,network=Network(1e109d3b-bb91-4ff7-b16f-d39181436f57),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5ea35efd-1b')
Nov 29 17:52:55 user nova-compute[74613]: DEBUG nova.virt.libvirt.vif [None req-674e6337-afc0-4f43-9e4e-e7f97f5baa67 tempest-TaggedBootDevicesTest_v242-869407180 tempest-TaggedBootDevicesTest_v242-869407180-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-29T17:52:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1859666771',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1859666771',id=11,image_ref='4217f428-8d9d-4ee1-9614-642d26d90c46',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKSRsE7CMPATzk0nhGKTXLyRQ2NjVsTAMbCrCKqZWb1yoHTJqXD7QPDDSiibpwgKBka38h6fgCSPKBI9itrRtjEmsKFRLJ9RpUfxeowCr9ERHXHEHuwVFTVkz9FoHnKnPQ==',key_name='tempest-keypair-955747048',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f655bcde631c4a839b98695eed5cfa4e',ramdisk_id='',reservation_id='r-5hebi871',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='4217f428-8d9d-4ee1-9614-642d26d90c46',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-869407180',owner_user_name='tempest-TaggedBootDevicesTest_v242-869407180-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T17:52:26Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e743f61509f44bcfac1b4baef1fd5c3c',uuid=3f285832-64a7-48e8-875a-f9e1566a66b6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3fe23755-ec08-4b17-87b2-c1eebd36042b", "address": "fa:16:3e:39:7c:dd", "network": {"id": "1e109d3b-bb91-4ff7-b16f-d39181436f57", "bridge": "br-int", "label": "tempest-device-tagging-net1-1011700470", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.66", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "f655bcde631c4a839b98695eed5cfa4e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3fe23755-ec", "ovs_interfaceid": "3fe23755-ec08-4b17-87b2-c1eebd36042b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74613) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 29 17:52:55 user nova-compute[74613]: DEBUG nova.network.os_vif_util [None req-674e6337-afc0-4f43-9e4e-e7f97f5baa67 tempest-TaggedBootDevicesTest_v242-869407180 tempest-TaggedBootDevicesTest_v242-869407180-project-member] Converting VIF {"id": "3fe23755-ec08-4b17-87b2-c1eebd36042b", "address": "fa:16:3e:39:7c:dd", "network": {"id": "1e109d3b-bb91-4ff7-b16f-d39181436f57", "bridge": "br-int", "label": "tempest-device-tagging-net1-1011700470", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.66", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "f655bcde631c4a839b98695eed5cfa4e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3fe23755-ec", "ovs_interfaceid": "3fe23755-ec08-4b17-87b2-c1eebd36042b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74613) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 17:52:55 user nova-compute[74613]: DEBUG nova.network.os_vif_util [None req-674e6337-afc0-4f43-9e4e-e7f97f5baa67 tempest-TaggedBootDevicesTest_v242-869407180 tempest-TaggedBootDevicesTest_v242-869407180-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:39:7c:dd,bridge_name='br-int',has_traffic_filtering=True,id=3fe23755-ec08-4b17-87b2-c1eebd36042b,network=Network(1e109d3b-bb91-4ff7-b16f-d39181436f57),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3fe23755-ec') {{(pid=74613) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 17:52:55 user nova-compute[74613]: DEBUG os_vif [None req-674e6337-afc0-4f43-9e4e-e7f97f5baa67 tempest-TaggedBootDevicesTest_v242-869407180 tempest-TaggedBootDevicesTest_v242-869407180-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:39:7c:dd,bridge_name='br-int',has_traffic_filtering=True,id=3fe23755-ec08-4b17-87b2-c1eebd36042b,network=Network(1e109d3b-bb91-4ff7-b16f-d39181436f57),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3fe23755-ec') {{(pid=74613) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 29 17:52:55 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:52:55 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74613) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 17:52:55 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74613) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 29 17:52:55 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:52:55 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '2cb50d5e-dc5d-5f43-9f86-0abfc33f540d', '_type': 'linux-noop'}}, row=False) {{(pid=74613) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 17:52:55 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:52:55 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 17:52:55 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:52:55 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:52:55 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap3fe23755-ec, may_exist=True, interface_attrs={}) {{(pid=74613) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 17:52:55 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap3fe23755-ec, col_values=(('qos', UUID('6b2ea9d3-05fb-4799-a45e-a64307cc70b1')),), if_exists=True) {{(pid=74613) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 17:52:55 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap3fe23755-ec, col_values=(('external_ids', {'iface-id': '3fe23755-ec08-4b17-87b2-c1eebd36042b', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:39:7c:dd', 'vm-uuid': '3f285832-64a7-48e8-875a-f9e1566a66b6'}),), if_exists=True) {{(pid=74613) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 17:52:55 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:52:55 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 17:52:55 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:52:55 user nova-compute[74613]: INFO os_vif [None req-674e6337-afc0-4f43-9e4e-e7f97f5baa67 tempest-TaggedBootDevicesTest_v242-869407180 tempest-TaggedBootDevicesTest_v242-869407180-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:39:7c:dd,bridge_name='br-int',has_traffic_filtering=True,id=3fe23755-ec08-4b17-87b2-c1eebd36042b,network=Network(1e109d3b-bb91-4ff7-b16f-d39181436f57),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3fe23755-ec')
Nov 29 17:52:55 user nova-compute[74613]: DEBUG nova.virt.libvirt.vif [None req-674e6337-afc0-4f43-9e4e-e7f97f5baa67 tempest-TaggedBootDevicesTest_v242-869407180 tempest-TaggedBootDevicesTest_v242-869407180-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-29T17:52:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1859666771',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1859666771',id=11,image_ref='4217f428-8d9d-4ee1-9614-642d26d90c46',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKSRsE7CMPATzk0nhGKTXLyRQ2NjVsTAMbCrCKqZWb1yoHTJqXD7QPDDSiibpwgKBka38h6fgCSPKBI9itrRtjEmsKFRLJ9RpUfxeowCr9ERHXHEHuwVFTVkz9FoHnKnPQ==',key_name='tempest-keypair-955747048',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f655bcde631c4a839b98695eed5cfa4e',ramdisk_id='',reservation_id='r-5hebi871',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='4217f428-8d9d-4ee1-9614-642d26d90c46',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-869407180',owner_user_name='tempest-TaggedBootDevicesTest_v242-869407180-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T17:52:26Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e743f61509f44bcfac1b4baef1fd5c3c',uuid=3f285832-64a7-48e8-875a-f9e1566a66b6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "bffa705a-58aa-4cbd-9b9d-09c8229cf829", "address": "fa:16:3e:f7:c0:bd", "network": {"id": "6debc132-a947-4fdc-8d04-f10452f6ee9c", "bridge": "br-int", "label": "tempest-device-tagging-net2-597757606", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "f655bcde631c4a839b98695eed5cfa4e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbffa705a-58", "ovs_interfaceid": "bffa705a-58aa-4cbd-9b9d-09c8229cf829", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74613) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 29 17:52:55 user nova-compute[74613]: DEBUG nova.network.os_vif_util [None req-674e6337-afc0-4f43-9e4e-e7f97f5baa67 tempest-TaggedBootDevicesTest_v242-869407180 tempest-TaggedBootDevicesTest_v242-869407180-project-member] Converting VIF {"id": "bffa705a-58aa-4cbd-9b9d-09c8229cf829", "address": "fa:16:3e:f7:c0:bd", "network": {"id": "6debc132-a947-4fdc-8d04-f10452f6ee9c", "bridge": "br-int", "label": "tempest-device-tagging-net2-597757606", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "f655bcde631c4a839b98695eed5cfa4e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbffa705a-58", "ovs_interfaceid": "bffa705a-58aa-4cbd-9b9d-09c8229cf829", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74613) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 17:52:55 user nova-compute[74613]: DEBUG nova.network.os_vif_util [None req-674e6337-afc0-4f43-9e4e-e7f97f5baa67 tempest-TaggedBootDevicesTest_v242-869407180 tempest-TaggedBootDevicesTest_v242-869407180-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f7:c0:bd,bridge_name='br-int',has_traffic_filtering=True,id=bffa705a-58aa-4cbd-9b9d-09c8229cf829,network=Network(6debc132-a947-4fdc-8d04-f10452f6ee9c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbffa705a-58') {{(pid=74613) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 17:52:55 user nova-compute[74613]: DEBUG os_vif [None req-674e6337-afc0-4f43-9e4e-e7f97f5baa67 tempest-TaggedBootDevicesTest_v242-869407180 tempest-TaggedBootDevicesTest_v242-869407180-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f7:c0:bd,bridge_name='br-int',has_traffic_filtering=True,id=bffa705a-58aa-4cbd-9b9d-09c8229cf829,network=Network(6debc132-a947-4fdc-8d04-f10452f6ee9c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbffa705a-58') {{(pid=74613) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 29 17:52:55 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:52:55 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74613) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 17:52:55 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74613) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 29 17:52:55 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:52:55 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'bc51cc60-deec-545c-a223-f4948cb1dd8e', '_type': 'linux-noop'}}, row=False) {{(pid=74613) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 17:52:55 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:52:55 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 17:52:55 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:52:55 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:52:55 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapbffa705a-58, may_exist=True, interface_attrs={}) {{(pid=74613) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 17:52:55 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapbffa705a-58, col_values=(('qos', UUID('45c162a2-fef8-46f2-8108-a54b42938788')),), if_exists=True) {{(pid=74613) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 17:52:55 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapbffa705a-58, col_values=(('external_ids', {'iface-id': 'bffa705a-58aa-4cbd-9b9d-09c8229cf829', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:f7:c0:bd', 'vm-uuid': '3f285832-64a7-48e8-875a-f9e1566a66b6'}),), if_exists=True) {{(pid=74613) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 17:52:55 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:52:55 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 17:52:55 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:52:55 user nova-compute[74613]: INFO os_vif [None req-674e6337-afc0-4f43-9e4e-e7f97f5baa67 tempest-TaggedBootDevicesTest_v242-869407180 tempest-TaggedBootDevicesTest_v242-869407180-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f7:c0:bd,bridge_name='br-int',has_traffic_filtering=True,id=bffa705a-58aa-4cbd-9b9d-09c8229cf829,network=Network(6debc132-a947-4fdc-8d04-f10452f6ee9c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbffa705a-58')
Nov 29 17:52:55 user nova-compute[74613]: DEBUG nova.virt.libvirt.vif [None req-674e6337-afc0-4f43-9e4e-e7f97f5baa67 tempest-TaggedBootDevicesTest_v242-869407180 tempest-TaggedBootDevicesTest_v242-869407180-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-29T17:52:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1859666771',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1859666771',id=11,image_ref='4217f428-8d9d-4ee1-9614-642d26d90c46',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKSRsE7CMPATzk0nhGKTXLyRQ2NjVsTAMbCrCKqZWb1yoHTJqXD7QPDDSiibpwgKBka38h6fgCSPKBI9itrRtjEmsKFRLJ9RpUfxeowCr9ERHXHEHuwVFTVkz9FoHnKnPQ==',key_name='tempest-keypair-955747048',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f655bcde631c4a839b98695eed5cfa4e',ramdisk_id='',reservation_id='r-5hebi871',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='4217f428-8d9d-4ee1-9614-642d26d90c46',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-869407180',owner_user_name='tempest-TaggedBootDevicesTest_v242-869407180-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T17:52:26Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e743f61509f44bcfac1b4baef1fd5c3c',uuid=3f285832-64a7-48e8-875a-f9e1566a66b6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "48d45408-4c70-44b7-a0c3-874ad1049d1a", "address": "fa:16:3e:a2:2a:db", "network": {"id": "6debc132-a947-4fdc-8d04-f10452f6ee9c", "bridge": "br-int", "label": "tempest-device-tagging-net2-597757606", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "f655bcde631c4a839b98695eed5cfa4e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap48d45408-4c", "ovs_interfaceid": "48d45408-4c70-44b7-a0c3-874ad1049d1a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74613) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 29 17:52:55 user nova-compute[74613]: DEBUG nova.network.os_vif_util [None req-674e6337-afc0-4f43-9e4e-e7f97f5baa67 tempest-TaggedBootDevicesTest_v242-869407180 tempest-TaggedBootDevicesTest_v242-869407180-project-member] Converting VIF {"id": "48d45408-4c70-44b7-a0c3-874ad1049d1a", "address": "fa:16:3e:a2:2a:db", "network": {"id": "6debc132-a947-4fdc-8d04-f10452f6ee9c", "bridge": "br-int", "label": "tempest-device-tagging-net2-597757606", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "f655bcde631c4a839b98695eed5cfa4e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap48d45408-4c", "ovs_interfaceid": "48d45408-4c70-44b7-a0c3-874ad1049d1a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74613) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 17:52:55 user nova-compute[74613]: DEBUG nova.network.os_vif_util [None req-674e6337-afc0-4f43-9e4e-e7f97f5baa67 tempest-TaggedBootDevicesTest_v242-869407180 tempest-TaggedBootDevicesTest_v242-869407180-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a2:2a:db,bridge_name='br-int',has_traffic_filtering=True,id=48d45408-4c70-44b7-a0c3-874ad1049d1a,network=Network(6debc132-a947-4fdc-8d04-f10452f6ee9c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap48d45408-4c') {{(pid=74613) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 17:52:55 user nova-compute[74613]: DEBUG os_vif [None req-674e6337-afc0-4f43-9e4e-e7f97f5baa67 tempest-TaggedBootDevicesTest_v242-869407180 tempest-TaggedBootDevicesTest_v242-869407180-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a2:2a:db,bridge_name='br-int',has_traffic_filtering=True,id=48d45408-4c70-44b7-a0c3-874ad1049d1a,network=Network(6debc132-a947-4fdc-8d04-f10452f6ee9c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap48d45408-4c') {{(pid=74613) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 29 17:52:55 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:52:55 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74613) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 17:52:55 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74613) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 29 17:52:55 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:52:55 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'df61f8a0-f54c-59f4-a03c-0221591bd66c', '_type': 'linux-noop'}}, row=False) {{(pid=74613) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 17:52:55 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:52:55 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 17:52:55 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:52:55 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:52:55 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap48d45408-4c, may_exist=True, interface_attrs={}) {{(pid=74613) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 17:52:55 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap48d45408-4c, col_values=(('qos', UUID('c2282b79-0910-4a23-8f76-9dcf4ca17160')),), if_exists=True) {{(pid=74613) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 17:52:55 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap48d45408-4c, col_values=(('external_ids', {'iface-id': '48d45408-4c70-44b7-a0c3-874ad1049d1a', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:a2:2a:db', 'vm-uuid': '3f285832-64a7-48e8-875a-f9e1566a66b6'}),), if_exists=True) {{(pid=74613) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 17:52:55 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:52:55 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 17:52:55 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:52:55 user nova-compute[74613]: INFO os_vif [None req-674e6337-afc0-4f43-9e4e-e7f97f5baa67 tempest-TaggedBootDevicesTest_v242-869407180 tempest-TaggedBootDevicesTest_v242-869407180-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a2:2a:db,bridge_name='br-int',has_traffic_filtering=True,id=48d45408-4c70-44b7-a0c3-874ad1049d1a,network=Network(6debc132-a947-4fdc-8d04-f10452f6ee9c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap48d45408-4c')
Nov 29 17:52:55 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-674e6337-afc0-4f43-9e4e-e7f97f5baa67 tempest-TaggedBootDevicesTest_v242-869407180 tempest-TaggedBootDevicesTest_v242-869407180-project-member] No BDM found with device name hda, not building metadata. {{(pid=74613) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 17:52:55 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-674e6337-afc0-4f43-9e4e-e7f97f5baa67 tempest-TaggedBootDevicesTest_v242-869407180 tempest-TaggedBootDevicesTest_v242-869407180-project-member] No BDM found with device name vdc, not building metadata. {{(pid=74613) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 17:52:55 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-674e6337-afc0-4f43-9e4e-e7f97f5baa67 tempest-TaggedBootDevicesTest_v242-869407180 tempest-TaggedBootDevicesTest_v242-869407180-project-member] No VIF found with MAC fa:16:3e:78:3a:a6, not building metadata {{(pid=74613) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 29 17:52:55 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-674e6337-afc0-4f43-9e4e-e7f97f5baa67 tempest-TaggedBootDevicesTest_v242-869407180 tempest-TaggedBootDevicesTest_v242-869407180-project-member] No VIF found with MAC fa:16:3e:39:7c:dd, not building metadata {{(pid=74613) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 29 17:52:55 user nova-compute[74613]: INFO nova.virt.libvirt.driver [None req-674e6337-afc0-4f43-9e4e-e7f97f5baa67 tempest-TaggedBootDevicesTest_v242-869407180 tempest-TaggedBootDevicesTest_v242-869407180-project-member] [instance: 3f285832-64a7-48e8-875a-f9e1566a66b6] Using config drive
Nov 29 17:52:55 user nova-compute[74613]: INFO nova.virt.libvirt.driver [None req-674e6337-afc0-4f43-9e4e-e7f97f5baa67 tempest-TaggedBootDevicesTest_v242-869407180 tempest-TaggedBootDevicesTest_v242-869407180-project-member] [instance: 3f285832-64a7-48e8-875a-f9e1566a66b6] Creating config drive at /opt/stack/data/nova/instances/3f285832-64a7-48e8-875a-f9e1566a66b6/disk.config
Nov 29 17:52:55 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-674e6337-afc0-4f43-9e4e-e7f97f5baa67 tempest-TaggedBootDevicesTest_v242-869407180 tempest-TaggedBootDevicesTest_v242-869407180-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/3f285832-64a7-48e8-875a-f9e1566a66b6/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmplb8mnr4b {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 17:52:56 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-674e6337-afc0-4f43-9e4e-e7f97f5baa67 tempest-TaggedBootDevicesTest_v242-869407180 tempest-TaggedBootDevicesTest_v242-869407180-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/3f285832-64a7-48e8-875a-f9e1566a66b6/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmplb8mnr4b" returned: 0 in 0.050s {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 17:52:57 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:52:57 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:52:57 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:52:57 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:52:57 user nova-compute[74613]: DEBUG nova.compute.manager [req-aa588f4f-6cd4-46da-9103-496c30fbda60 req-19328f48-62e2-4667-b9fd-90e66efa167b service nova] [instance: 3f285832-64a7-48e8-875a-f9e1566a66b6] Received event network-vif-plugged-75aec901-492c-47e1-9621-158f2d11a5e7 {{(pid=74613) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 17:52:57 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-aa588f4f-6cd4-46da-9103-496c30fbda60 req-19328f48-62e2-4667-b9fd-90e66efa167b service nova] Acquiring lock "3f285832-64a7-48e8-875a-f9e1566a66b6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 17:52:57 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-aa588f4f-6cd4-46da-9103-496c30fbda60 req-19328f48-62e2-4667-b9fd-90e66efa167b service nova] Lock "3f285832-64a7-48e8-875a-f9e1566a66b6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 17:52:57 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-aa588f4f-6cd4-46da-9103-496c30fbda60 req-19328f48-62e2-4667-b9fd-90e66efa167b service nova] Lock "3f285832-64a7-48e8-875a-f9e1566a66b6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 17:52:57 user nova-compute[74613]: DEBUG nova.compute.manager [req-aa588f4f-6cd4-46da-9103-496c30fbda60 req-19328f48-62e2-4667-b9fd-90e66efa167b service nova] [instance: 3f285832-64a7-48e8-875a-f9e1566a66b6] No waiting events found dispatching network-vif-plugged-75aec901-492c-47e1-9621-158f2d11a5e7 {{(pid=74613) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 17:52:57 user nova-compute[74613]: WARNING nova.compute.manager [req-aa588f4f-6cd4-46da-9103-496c30fbda60 req-19328f48-62e2-4667-b9fd-90e66efa167b service nova] [instance: 3f285832-64a7-48e8-875a-f9e1566a66b6] Received unexpected event network-vif-plugged-75aec901-492c-47e1-9621-158f2d11a5e7 for instance with vm_state building and task_state spawning.
Nov 29 17:52:57 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:52:57 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:52:58 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:52:58 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:52:58 user nova-compute[74613]: DEBUG nova.compute.manager [req-0fb2f7bf-b87b-4c64-9084-b67293a401e8 req-afeca1c7-664c-43d8-89cf-8e21e377feb8 service nova] [instance: 3f285832-64a7-48e8-875a-f9e1566a66b6] Received event network-vif-plugged-d2631ae0-4218-400c-8da8-cb6d3271579d {{(pid=74613) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 17:52:58 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-0fb2f7bf-b87b-4c64-9084-b67293a401e8 req-afeca1c7-664c-43d8-89cf-8e21e377feb8 service nova] Acquiring lock "3f285832-64a7-48e8-875a-f9e1566a66b6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 17:52:58 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-0fb2f7bf-b87b-4c64-9084-b67293a401e8 req-afeca1c7-664c-43d8-89cf-8e21e377feb8 service nova] Lock "3f285832-64a7-48e8-875a-f9e1566a66b6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 17:52:58 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-0fb2f7bf-b87b-4c64-9084-b67293a401e8 req-afeca1c7-664c-43d8-89cf-8e21e377feb8 service nova] Lock "3f285832-64a7-48e8-875a-f9e1566a66b6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 17:52:58 user nova-compute[74613]: DEBUG nova.compute.manager [req-0fb2f7bf-b87b-4c64-9084-b67293a401e8 req-afeca1c7-664c-43d8-89cf-8e21e377feb8 service nova] [instance: 3f285832-64a7-48e8-875a-f9e1566a66b6] No waiting events found dispatching network-vif-plugged-d2631ae0-4218-400c-8da8-cb6d3271579d {{(pid=74613) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 17:52:58 user nova-compute[74613]: WARNING nova.compute.manager [req-0fb2f7bf-b87b-4c64-9084-b67293a401e8 req-afeca1c7-664c-43d8-89cf-8e21e377feb8 service nova] [instance: 3f285832-64a7-48e8-875a-f9e1566a66b6] Received unexpected event network-vif-plugged-d2631ae0-4218-400c-8da8-cb6d3271579d for instance with vm_state building and task_state spawning.
Nov 29 17:52:58 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:52:58 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:52:58 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:52:58 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:52:58 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:52:58 user nova-compute[74613]: DEBUG nova.compute.manager [req-e4fd41c0-11eb-4748-ac67-924ab5862489 req-56dfe209-724a-4de6-8e82-340de4f33338 service nova] [instance: 3f285832-64a7-48e8-875a-f9e1566a66b6] Received event network-vif-plugged-83dc312c-87e6-47a8-b4a5-f7c3cec7ab50 {{(pid=74613) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 17:52:58 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-e4fd41c0-11eb-4748-ac67-924ab5862489 req-56dfe209-724a-4de6-8e82-340de4f33338 service nova] Acquiring lock "3f285832-64a7-48e8-875a-f9e1566a66b6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 17:52:58 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-e4fd41c0-11eb-4748-ac67-924ab5862489 req-56dfe209-724a-4de6-8e82-340de4f33338 service nova] Lock "3f285832-64a7-48e8-875a-f9e1566a66b6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 17:52:58 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-e4fd41c0-11eb-4748-ac67-924ab5862489 req-56dfe209-724a-4de6-8e82-340de4f33338 service nova] Lock "3f285832-64a7-48e8-875a-f9e1566a66b6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 17:52:58 user nova-compute[74613]: DEBUG nova.compute.manager [req-e4fd41c0-11eb-4748-ac67-924ab5862489 req-56dfe209-724a-4de6-8e82-340de4f33338 service nova] [instance: 3f285832-64a7-48e8-875a-f9e1566a66b6] No waiting events found dispatching network-vif-plugged-83dc312c-87e6-47a8-b4a5-f7c3cec7ab50 {{(pid=74613) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 17:52:58 user nova-compute[74613]: WARNING nova.compute.manager [req-e4fd41c0-11eb-4748-ac67-924ab5862489 req-56dfe209-724a-4de6-8e82-340de4f33338 service nova] [instance: 3f285832-64a7-48e8-875a-f9e1566a66b6] Received unexpected event network-vif-plugged-83dc312c-87e6-47a8-b4a5-f7c3cec7ab50 for instance with vm_state building and task_state spawning.
Nov 29 17:52:58 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:52:58 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:52:58 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:52:58 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:52:58 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:52:58 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:52:58 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:52:58 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:52:58 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:52:58 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:52:58 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:52:59 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:52:59 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:52:59 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:52:59 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:52:59 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:52:59 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:52:59 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:52:59 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:52:59 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:52:59 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:52:59 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:52:59 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:52:59 user nova-compute[74613]: DEBUG nova.compute.manager [req-3d402ebd-e107-4c50-a4ee-4b5fc3030c21 req-2d5ae8e4-d70f-42bb-8cdd-ca7122648ad7 service nova] [instance: 3f285832-64a7-48e8-875a-f9e1566a66b6] Received event network-vif-plugged-75aec901-492c-47e1-9621-158f2d11a5e7 {{(pid=74613) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 17:52:59 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-3d402ebd-e107-4c50-a4ee-4b5fc3030c21 req-2d5ae8e4-d70f-42bb-8cdd-ca7122648ad7 service nova] Acquiring lock "3f285832-64a7-48e8-875a-f9e1566a66b6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 17:52:59 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-3d402ebd-e107-4c50-a4ee-4b5fc3030c21 req-2d5ae8e4-d70f-42bb-8cdd-ca7122648ad7 service nova] Lock "3f285832-64a7-48e8-875a-f9e1566a66b6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 17:52:59 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-3d402ebd-e107-4c50-a4ee-4b5fc3030c21 req-2d5ae8e4-d70f-42bb-8cdd-ca7122648ad7 service nova] Lock "3f285832-64a7-48e8-875a-f9e1566a66b6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 17:52:59 user nova-compute[74613]: DEBUG nova.compute.manager [req-3d402ebd-e107-4c50-a4ee-4b5fc3030c21 req-2d5ae8e4-d70f-42bb-8cdd-ca7122648ad7 service nova] [instance: 3f285832-64a7-48e8-875a-f9e1566a66b6] No waiting events found dispatching network-vif-plugged-75aec901-492c-47e1-9621-158f2d11a5e7 {{(pid=74613) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 17:52:59 user nova-compute[74613]: WARNING nova.compute.manager [req-3d402ebd-e107-4c50-a4ee-4b5fc3030c21 req-2d5ae8e4-d70f-42bb-8cdd-ca7122648ad7 service nova] [instance: 3f285832-64a7-48e8-875a-f9e1566a66b6] Received unexpected event network-vif-plugged-75aec901-492c-47e1-9621-158f2d11a5e7 for instance with vm_state building and task_state spawning.
Nov 29 17:52:59 user nova-compute[74613]: DEBUG nova.compute.manager [req-3d402ebd-e107-4c50-a4ee-4b5fc3030c21 req-2d5ae8e4-d70f-42bb-8cdd-ca7122648ad7 service nova] [instance: 3f285832-64a7-48e8-875a-f9e1566a66b6] Received event network-vif-plugged-3fe23755-ec08-4b17-87b2-c1eebd36042b {{(pid=74613) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 17:52:59 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-3d402ebd-e107-4c50-a4ee-4b5fc3030c21 req-2d5ae8e4-d70f-42bb-8cdd-ca7122648ad7 service nova] Acquiring lock "3f285832-64a7-48e8-875a-f9e1566a66b6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 17:52:59 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-3d402ebd-e107-4c50-a4ee-4b5fc3030c21 req-2d5ae8e4-d70f-42bb-8cdd-ca7122648ad7 service nova] Lock "3f285832-64a7-48e8-875a-f9e1566a66b6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 17:52:59 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-3d402ebd-e107-4c50-a4ee-4b5fc3030c21 req-2d5ae8e4-d70f-42bb-8cdd-ca7122648ad7 service nova] Lock "3f285832-64a7-48e8-875a-f9e1566a66b6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 17:52:59 user nova-compute[74613]: DEBUG nova.compute.manager [req-3d402ebd-e107-4c50-a4ee-4b5fc3030c21 req-2d5ae8e4-d70f-42bb-8cdd-ca7122648ad7 service nova] [instance: 3f285832-64a7-48e8-875a-f9e1566a66b6] No waiting events found dispatching network-vif-plugged-3fe23755-ec08-4b17-87b2-c1eebd36042b {{(pid=74613) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 17:52:59 user nova-compute[74613]: WARNING nova.compute.manager [req-3d402ebd-e107-4c50-a4ee-4b5fc3030c21 req-2d5ae8e4-d70f-42bb-8cdd-ca7122648ad7 service nova] [instance: 3f285832-64a7-48e8-875a-f9e1566a66b6] Received unexpected event network-vif-plugged-3fe23755-ec08-4b17-87b2-c1eebd36042b for instance with vm_state building and task_state spawning.
Nov 29 17:52:59 user nova-compute[74613]: DEBUG nova.compute.manager [req-3d402ebd-e107-4c50-a4ee-4b5fc3030c21 req-2d5ae8e4-d70f-42bb-8cdd-ca7122648ad7 service nova] [instance: 3f285832-64a7-48e8-875a-f9e1566a66b6] Received event network-vif-plugged-3fe23755-ec08-4b17-87b2-c1eebd36042b {{(pid=74613) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 17:52:59 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-3d402ebd-e107-4c50-a4ee-4b5fc3030c21 req-2d5ae8e4-d70f-42bb-8cdd-ca7122648ad7 service nova] Acquiring lock "3f285832-64a7-48e8-875a-f9e1566a66b6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 17:52:59 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-3d402ebd-e107-4c50-a4ee-4b5fc3030c21 req-2d5ae8e4-d70f-42bb-8cdd-ca7122648ad7 service nova] Lock "3f285832-64a7-48e8-875a-f9e1566a66b6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 17:52:59 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-3d402ebd-e107-4c50-a4ee-4b5fc3030c21 req-2d5ae8e4-d70f-42bb-8cdd-ca7122648ad7 service nova] Lock "3f285832-64a7-48e8-875a-f9e1566a66b6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 17:52:59 user nova-compute[74613]: DEBUG nova.compute.manager [req-3d402ebd-e107-4c50-a4ee-4b5fc3030c21 req-2d5ae8e4-d70f-42bb-8cdd-ca7122648ad7 service nova] [instance: 3f285832-64a7-48e8-875a-f9e1566a66b6] No waiting events found dispatching network-vif-plugged-3fe23755-ec08-4b17-87b2-c1eebd36042b {{(pid=74613) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 17:52:59 user nova-compute[74613]: WARNING nova.compute.manager [req-3d402ebd-e107-4c50-a4ee-4b5fc3030c21 req-2d5ae8e4-d70f-42bb-8cdd-ca7122648ad7 service nova] [instance: 3f285832-64a7-48e8-875a-f9e1566a66b6] Received unexpected event network-vif-plugged-3fe23755-ec08-4b17-87b2-c1eebd36042b for instance with vm_state building and task_state spawning.
Nov 29 17:52:59 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:52:59 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:52:59 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:53:00 user nova-compute[74613]: DEBUG nova.compute.manager [req-39a9e9d1-6e11-4833-93e7-d1e03ee37704 req-24ffe9cb-c37b-4925-afff-48b69984ce7a service nova] [instance: 3f285832-64a7-48e8-875a-f9e1566a66b6] Received event network-vif-plugged-d2631ae0-4218-400c-8da8-cb6d3271579d {{(pid=74613) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 17:53:00 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-39a9e9d1-6e11-4833-93e7-d1e03ee37704 req-24ffe9cb-c37b-4925-afff-48b69984ce7a service nova] Acquiring lock "3f285832-64a7-48e8-875a-f9e1566a66b6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 17:53:00 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-39a9e9d1-6e11-4833-93e7-d1e03ee37704 req-24ffe9cb-c37b-4925-afff-48b69984ce7a service nova] Lock "3f285832-64a7-48e8-875a-f9e1566a66b6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 17:53:00 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-39a9e9d1-6e11-4833-93e7-d1e03ee37704 req-24ffe9cb-c37b-4925-afff-48b69984ce7a service nova] Lock "3f285832-64a7-48e8-875a-f9e1566a66b6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 17:53:00 user nova-compute[74613]: DEBUG nova.compute.manager [req-39a9e9d1-6e11-4833-93e7-d1e03ee37704 req-24ffe9cb-c37b-4925-afff-48b69984ce7a service nova] [instance: 3f285832-64a7-48e8-875a-f9e1566a66b6] No waiting events found dispatching network-vif-plugged-d2631ae0-4218-400c-8da8-cb6d3271579d {{(pid=74613) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 17:53:00 user nova-compute[74613]: WARNING nova.compute.manager [req-39a9e9d1-6e11-4833-93e7-d1e03ee37704 req-24ffe9cb-c37b-4925-afff-48b69984ce7a service nova] [instance: 3f285832-64a7-48e8-875a-f9e1566a66b6] Received unexpected event network-vif-plugged-d2631ae0-4218-400c-8da8-cb6d3271579d for instance with vm_state building and task_state spawning.
Nov 29 17:53:00 user nova-compute[74613]: DEBUG nova.compute.manager [req-39a9e9d1-6e11-4833-93e7-d1e03ee37704 req-24ffe9cb-c37b-4925-afff-48b69984ce7a service nova] [instance: 3f285832-64a7-48e8-875a-f9e1566a66b6] Received event network-vif-plugged-5ea35efd-1b2e-48eb-b8fb-fb15dab703dc {{(pid=74613) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 17:53:00 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-39a9e9d1-6e11-4833-93e7-d1e03ee37704 req-24ffe9cb-c37b-4925-afff-48b69984ce7a service nova] Acquiring lock "3f285832-64a7-48e8-875a-f9e1566a66b6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 17:53:00 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-39a9e9d1-6e11-4833-93e7-d1e03ee37704 req-24ffe9cb-c37b-4925-afff-48b69984ce7a service nova] Lock "3f285832-64a7-48e8-875a-f9e1566a66b6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 17:53:00 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-39a9e9d1-6e11-4833-93e7-d1e03ee37704 req-24ffe9cb-c37b-4925-afff-48b69984ce7a service nova] Lock "3f285832-64a7-48e8-875a-f9e1566a66b6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 17:53:00 user nova-compute[74613]: DEBUG nova.compute.manager [req-39a9e9d1-6e11-4833-93e7-d1e03ee37704 req-24ffe9cb-c37b-4925-afff-48b69984ce7a service nova] [instance: 3f285832-64a7-48e8-875a-f9e1566a66b6] No waiting events found dispatching network-vif-plugged-5ea35efd-1b2e-48eb-b8fb-fb15dab703dc {{(pid=74613) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 17:53:00 user nova-compute[74613]: WARNING nova.compute.manager [req-39a9e9d1-6e11-4833-93e7-d1e03ee37704 req-24ffe9cb-c37b-4925-afff-48b69984ce7a service nova] [instance: 3f285832-64a7-48e8-875a-f9e1566a66b6] Received unexpected event network-vif-plugged-5ea35efd-1b2e-48eb-b8fb-fb15dab703dc for instance with vm_state building and task_state spawning.
Nov 29 17:53:00 user nova-compute[74613]: DEBUG nova.compute.manager [req-39a9e9d1-6e11-4833-93e7-d1e03ee37704 req-24ffe9cb-c37b-4925-afff-48b69984ce7a service nova] [instance: 3f285832-64a7-48e8-875a-f9e1566a66b6] Received event network-vif-plugged-5ea35efd-1b2e-48eb-b8fb-fb15dab703dc {{(pid=74613) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 17:53:00 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-39a9e9d1-6e11-4833-93e7-d1e03ee37704 req-24ffe9cb-c37b-4925-afff-48b69984ce7a service nova] Acquiring lock "3f285832-64a7-48e8-875a-f9e1566a66b6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 17:53:00 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-39a9e9d1-6e11-4833-93e7-d1e03ee37704 req-24ffe9cb-c37b-4925-afff-48b69984ce7a service nova] Lock "3f285832-64a7-48e8-875a-f9e1566a66b6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 17:53:00 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-39a9e9d1-6e11-4833-93e7-d1e03ee37704 req-24ffe9cb-c37b-4925-afff-48b69984ce7a service nova] Lock "3f285832-64a7-48e8-875a-f9e1566a66b6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 17:53:00 user nova-compute[74613]: DEBUG nova.compute.manager [req-39a9e9d1-6e11-4833-93e7-d1e03ee37704 req-24ffe9cb-c37b-4925-afff-48b69984ce7a service nova] [instance: 3f285832-64a7-48e8-875a-f9e1566a66b6] No waiting events found dispatching network-vif-plugged-5ea35efd-1b2e-48eb-b8fb-fb15dab703dc {{(pid=74613) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 17:53:00 user nova-compute[74613]: WARNING nova.compute.manager [req-39a9e9d1-6e11-4833-93e7-d1e03ee37704 req-24ffe9cb-c37b-4925-afff-48b69984ce7a service nova] [instance: 3f285832-64a7-48e8-875a-f9e1566a66b6] Received unexpected event network-vif-plugged-5ea35efd-1b2e-48eb-b8fb-fb15dab703dc for instance with vm_state building and task_state spawning.
Nov 29 17:53:00 user nova-compute[74613]: DEBUG nova.compute.manager [req-4f99b908-cfec-42a0-a01d-c37e8f033e0d req-6b492082-3700-4a0e-a2fa-34e27942f87e service nova] [instance: 3f285832-64a7-48e8-875a-f9e1566a66b6] Received event network-vif-plugged-83dc312c-87e6-47a8-b4a5-f7c3cec7ab50 {{(pid=74613) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 17:53:00 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-4f99b908-cfec-42a0-a01d-c37e8f033e0d req-6b492082-3700-4a0e-a2fa-34e27942f87e service nova] Acquiring lock "3f285832-64a7-48e8-875a-f9e1566a66b6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 17:53:00 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-4f99b908-cfec-42a0-a01d-c37e8f033e0d req-6b492082-3700-4a0e-a2fa-34e27942f87e service nova] Lock "3f285832-64a7-48e8-875a-f9e1566a66b6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 17:53:00 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-4f99b908-cfec-42a0-a01d-c37e8f033e0d req-6b492082-3700-4a0e-a2fa-34e27942f87e service nova] Lock "3f285832-64a7-48e8-875a-f9e1566a66b6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 17:53:00 user nova-compute[74613]: DEBUG nova.compute.manager [req-4f99b908-cfec-42a0-a01d-c37e8f033e0d req-6b492082-3700-4a0e-a2fa-34e27942f87e service nova] [instance: 3f285832-64a7-48e8-875a-f9e1566a66b6] No waiting events found dispatching network-vif-plugged-83dc312c-87e6-47a8-b4a5-f7c3cec7ab50 {{(pid=74613) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 17:53:00 user nova-compute[74613]: WARNING nova.compute.manager [req-4f99b908-cfec-42a0-a01d-c37e8f033e0d req-6b492082-3700-4a0e-a2fa-34e27942f87e service nova] [instance: 3f285832-64a7-48e8-875a-f9e1566a66b6] Received unexpected event network-vif-plugged-83dc312c-87e6-47a8-b4a5-f7c3cec7ab50 for instance with vm_state building and task_state spawning.
Nov 29 17:53:00 user nova-compute[74613]: DEBUG nova.compute.manager [req-4f99b908-cfec-42a0-a01d-c37e8f033e0d req-6b492082-3700-4a0e-a2fa-34e27942f87e service nova] [instance: 3f285832-64a7-48e8-875a-f9e1566a66b6] Received event network-vif-plugged-bffa705a-58aa-4cbd-9b9d-09c8229cf829 {{(pid=74613) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 17:53:00 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-4f99b908-cfec-42a0-a01d-c37e8f033e0d req-6b492082-3700-4a0e-a2fa-34e27942f87e service nova] Acquiring lock "3f285832-64a7-48e8-875a-f9e1566a66b6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 17:53:00 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-4f99b908-cfec-42a0-a01d-c37e8f033e0d req-6b492082-3700-4a0e-a2fa-34e27942f87e service nova] Lock "3f285832-64a7-48e8-875a-f9e1566a66b6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 17:53:00 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-4f99b908-cfec-42a0-a01d-c37e8f033e0d req-6b492082-3700-4a0e-a2fa-34e27942f87e service nova] Lock "3f285832-64a7-48e8-875a-f9e1566a66b6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 17:53:00 user nova-compute[74613]: DEBUG nova.compute.manager [req-4f99b908-cfec-42a0-a01d-c37e8f033e0d req-6b492082-3700-4a0e-a2fa-34e27942f87e service nova] [instance: 3f285832-64a7-48e8-875a-f9e1566a66b6] No waiting events found dispatching network-vif-plugged-bffa705a-58aa-4cbd-9b9d-09c8229cf829 {{(pid=74613) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 17:53:00 user nova-compute[74613]: WARNING nova.compute.manager [req-4f99b908-cfec-42a0-a01d-c37e8f033e0d req-6b492082-3700-4a0e-a2fa-34e27942f87e service nova] [instance: 3f285832-64a7-48e8-875a-f9e1566a66b6] Received unexpected event network-vif-plugged-bffa705a-58aa-4cbd-9b9d-09c8229cf829 for instance with vm_state building and task_state spawning.
Nov 29 17:53:00 user nova-compute[74613]: DEBUG nova.compute.manager [req-4f99b908-cfec-42a0-a01d-c37e8f033e0d req-6b492082-3700-4a0e-a2fa-34e27942f87e service nova] [instance: 3f285832-64a7-48e8-875a-f9e1566a66b6] Received event network-vif-plugged-bffa705a-58aa-4cbd-9b9d-09c8229cf829 {{(pid=74613) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 17:53:00 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-4f99b908-cfec-42a0-a01d-c37e8f033e0d req-6b492082-3700-4a0e-a2fa-34e27942f87e service nova] Acquiring lock "3f285832-64a7-48e8-875a-f9e1566a66b6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 17:53:00 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-4f99b908-cfec-42a0-a01d-c37e8f033e0d req-6b492082-3700-4a0e-a2fa-34e27942f87e service nova] Lock "3f285832-64a7-48e8-875a-f9e1566a66b6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 17:53:00 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-4f99b908-cfec-42a0-a01d-c37e8f033e0d req-6b492082-3700-4a0e-a2fa-34e27942f87e service nova] Lock "3f285832-64a7-48e8-875a-f9e1566a66b6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 17:53:00 user nova-compute[74613]: DEBUG nova.compute.manager [req-4f99b908-cfec-42a0-a01d-c37e8f033e0d req-6b492082-3700-4a0e-a2fa-34e27942f87e service nova] [instance: 3f285832-64a7-48e8-875a-f9e1566a66b6] No waiting events found dispatching network-vif-plugged-bffa705a-58aa-4cbd-9b9d-09c8229cf829 {{(pid=74613) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 17:53:00 user nova-compute[74613]: WARNING nova.compute.manager [req-4f99b908-cfec-42a0-a01d-c37e8f033e0d req-6b492082-3700-4a0e-a2fa-34e27942f87e service nova] [instance: 3f285832-64a7-48e8-875a-f9e1566a66b6] Received unexpected event network-vif-plugged-bffa705a-58aa-4cbd-9b9d-09c8229cf829 for instance with vm_state building and task_state spawning.
Nov 29 17:53:00 user nova-compute[74613]: DEBUG nova.compute.manager [req-4f99b908-cfec-42a0-a01d-c37e8f033e0d req-6b492082-3700-4a0e-a2fa-34e27942f87e service nova] [instance: 3f285832-64a7-48e8-875a-f9e1566a66b6] Received event network-vif-plugged-48d45408-4c70-44b7-a0c3-874ad1049d1a {{(pid=74613) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 17:53:00 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-4f99b908-cfec-42a0-a01d-c37e8f033e0d req-6b492082-3700-4a0e-a2fa-34e27942f87e service nova] Acquiring lock "3f285832-64a7-48e8-875a-f9e1566a66b6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 17:53:00 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-4f99b908-cfec-42a0-a01d-c37e8f033e0d req-6b492082-3700-4a0e-a2fa-34e27942f87e service nova] Lock "3f285832-64a7-48e8-875a-f9e1566a66b6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 17:53:00 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-4f99b908-cfec-42a0-a01d-c37e8f033e0d req-6b492082-3700-4a0e-a2fa-34e27942f87e service nova] Lock "3f285832-64a7-48e8-875a-f9e1566a66b6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 17:53:00 user nova-compute[74613]: DEBUG nova.compute.manager [req-4f99b908-cfec-42a0-a01d-c37e8f033e0d req-6b492082-3700-4a0e-a2fa-34e27942f87e service nova] [instance: 3f285832-64a7-48e8-875a-f9e1566a66b6] No waiting events found dispatching network-vif-plugged-48d45408-4c70-44b7-a0c3-874ad1049d1a {{(pid=74613) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 17:53:00 user nova-compute[74613]: WARNING nova.compute.manager [req-4f99b908-cfec-42a0-a01d-c37e8f033e0d req-6b492082-3700-4a0e-a2fa-34e27942f87e service nova] [instance: 3f285832-64a7-48e8-875a-f9e1566a66b6] Received unexpected event network-vif-plugged-48d45408-4c70-44b7-a0c3-874ad1049d1a for instance with vm_state building and task_state spawning.
Nov 29 17:53:00 user nova-compute[74613]: DEBUG nova.compute.manager [req-4f99b908-cfec-42a0-a01d-c37e8f033e0d req-6b492082-3700-4a0e-a2fa-34e27942f87e service nova] [instance: 3f285832-64a7-48e8-875a-f9e1566a66b6] Received event network-vif-plugged-48d45408-4c70-44b7-a0c3-874ad1049d1a {{(pid=74613) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 17:53:00 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-4f99b908-cfec-42a0-a01d-c37e8f033e0d req-6b492082-3700-4a0e-a2fa-34e27942f87e service nova] Acquiring lock "3f285832-64a7-48e8-875a-f9e1566a66b6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 17:53:00 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-4f99b908-cfec-42a0-a01d-c37e8f033e0d req-6b492082-3700-4a0e-a2fa-34e27942f87e service nova] Lock "3f285832-64a7-48e8-875a-f9e1566a66b6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 17:53:00 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-4f99b908-cfec-42a0-a01d-c37e8f033e0d req-6b492082-3700-4a0e-a2fa-34e27942f87e service nova] Lock "3f285832-64a7-48e8-875a-f9e1566a66b6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 17:53:00 user nova-compute[74613]: DEBUG nova.compute.manager [req-4f99b908-cfec-42a0-a01d-c37e8f033e0d req-6b492082-3700-4a0e-a2fa-34e27942f87e service nova] [instance: 3f285832-64a7-48e8-875a-f9e1566a66b6] No waiting events found dispatching network-vif-plugged-48d45408-4c70-44b7-a0c3-874ad1049d1a {{(pid=74613) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 17:53:00 user nova-compute[74613]: WARNING nova.compute.manager [req-4f99b908-cfec-42a0-a01d-c37e8f033e0d req-6b492082-3700-4a0e-a2fa-34e27942f87e service nova] [instance: 3f285832-64a7-48e8-875a-f9e1566a66b6] Received unexpected event network-vif-plugged-48d45408-4c70-44b7-a0c3-874ad1049d1a for instance with vm_state building and task_state spawning.
Nov 29 17:53:00 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:53:00 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:53:00 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:53:00 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:53:00 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:53:00 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:53:00 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:53:01 user nova-compute[74613]: DEBUG nova.compute.manager [None req-674e6337-afc0-4f43-9e4e-e7f97f5baa67 tempest-TaggedBootDevicesTest_v242-869407180 tempest-TaggedBootDevicesTest_v242-869407180-project-member] [instance: 3f285832-64a7-48e8-875a-f9e1566a66b6] Instance event wait completed in 0 seconds for  {{(pid=74613) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 29 17:53:01 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-674e6337-afc0-4f43-9e4e-e7f97f5baa67 tempest-TaggedBootDevicesTest_v242-869407180 tempest-TaggedBootDevicesTest_v242-869407180-project-member] [instance: 3f285832-64a7-48e8-875a-f9e1566a66b6] Guest created on hypervisor {{(pid=74613) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 29 17:53:01 user nova-compute[74613]: INFO nova.virt.libvirt.driver [-] [instance: 3f285832-64a7-48e8-875a-f9e1566a66b6] Instance spawned successfully.
Nov 29 17:53:01 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-674e6337-afc0-4f43-9e4e-e7f97f5baa67 tempest-TaggedBootDevicesTest_v242-869407180 tempest-TaggedBootDevicesTest_v242-869407180-project-member] [instance: 3f285832-64a7-48e8-875a-f9e1566a66b6] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74613) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 29 17:53:01 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-674e6337-afc0-4f43-9e4e-e7f97f5baa67 tempest-TaggedBootDevicesTest_v242-869407180 tempest-TaggedBootDevicesTest_v242-869407180-project-member] [instance: 3f285832-64a7-48e8-875a-f9e1566a66b6] Found default for hw_cdrom_bus of ide {{(pid=74613) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 17:53:01 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-674e6337-afc0-4f43-9e4e-e7f97f5baa67 tempest-TaggedBootDevicesTest_v242-869407180 tempest-TaggedBootDevicesTest_v242-869407180-project-member] [instance: 3f285832-64a7-48e8-875a-f9e1566a66b6] Found default for hw_disk_bus of virtio {{(pid=74613) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 17:53:01 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-674e6337-afc0-4f43-9e4e-e7f97f5baa67 tempest-TaggedBootDevicesTest_v242-869407180 tempest-TaggedBootDevicesTest_v242-869407180-project-member] [instance: 3f285832-64a7-48e8-875a-f9e1566a66b6] Found default for hw_input_bus of None {{(pid=74613) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 17:53:01 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-674e6337-afc0-4f43-9e4e-e7f97f5baa67 tempest-TaggedBootDevicesTest_v242-869407180 tempest-TaggedBootDevicesTest_v242-869407180-project-member] [instance: 3f285832-64a7-48e8-875a-f9e1566a66b6] Found default for hw_pointer_model of None {{(pid=74613) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 17:53:01 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-674e6337-afc0-4f43-9e4e-e7f97f5baa67 tempest-TaggedBootDevicesTest_v242-869407180 tempest-TaggedBootDevicesTest_v242-869407180-project-member] [instance: 3f285832-64a7-48e8-875a-f9e1566a66b6] Found default for hw_video_model of virtio {{(pid=74613) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 17:53:01 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-674e6337-afc0-4f43-9e4e-e7f97f5baa67 tempest-TaggedBootDevicesTest_v242-869407180 tempest-TaggedBootDevicesTest_v242-869407180-project-member] [instance: 3f285832-64a7-48e8-875a-f9e1566a66b6] Found default for hw_vif_model of virtio {{(pid=74613) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 17:53:01 user nova-compute[74613]: INFO nova.compute.manager [None req-674e6337-afc0-4f43-9e4e-e7f97f5baa67 tempest-TaggedBootDevicesTest_v242-869407180 tempest-TaggedBootDevicesTest_v242-869407180-project-member] [instance: 3f285832-64a7-48e8-875a-f9e1566a66b6] Took 10.57 seconds to spawn the instance on the hypervisor.
Nov 29 17:53:01 user nova-compute[74613]: DEBUG nova.compute.manager [None req-674e6337-afc0-4f43-9e4e-e7f97f5baa67 tempest-TaggedBootDevicesTest_v242-869407180 tempest-TaggedBootDevicesTest_v242-869407180-project-member] [instance: 3f285832-64a7-48e8-875a-f9e1566a66b6] Checking state {{(pid=74613) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 29 17:53:01 user nova-compute[74613]: INFO nova.compute.manager [None req-674e6337-afc0-4f43-9e4e-e7f97f5baa67 tempest-TaggedBootDevicesTest_v242-869407180 tempest-TaggedBootDevicesTest_v242-869407180-project-member] [instance: 3f285832-64a7-48e8-875a-f9e1566a66b6] Took 36.68 seconds to build instance.
Nov 29 17:53:01 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-674e6337-afc0-4f43-9e4e-e7f97f5baa67 tempest-TaggedBootDevicesTest_v242-869407180 tempest-TaggedBootDevicesTest_v242-869407180-project-member] Lock "3f285832-64a7-48e8-875a-f9e1566a66b6" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 36.773s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 17:53:04 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:53:05 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:53:10 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 17:53:10 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:53:10 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5004 ms, sending inactivity probe {{(pid=74613) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 29 17:53:10 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74613) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 17:53:10 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74613) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 17:53:10 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:53:12 user nova-compute[74613]: DEBUG oslo_service.periodic_task [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74613) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 17:53:12 user nova-compute[74613]: DEBUG oslo_service.periodic_task [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74613) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 17:53:12 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 17:53:12 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 17:53:12 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 17:53:12 user nova-compute[74613]: DEBUG nova.compute.resource_tracker [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Auditing locally available compute resources for user (node: user) {{(pid=74613) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 29 17:53:12 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c19e230e-2e6c-4c20-b15c-ad81a73674b4/disk --force-share --output=json {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 17:53:12 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c19e230e-2e6c-4c20-b15c-ad81a73674b4/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 17:53:12 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c19e230e-2e6c-4c20-b15c-ad81a73674b4/disk --force-share --output=json {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 17:53:13 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c19e230e-2e6c-4c20-b15c-ad81a73674b4/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 17:53:13 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0008521b-5a63-4ff6-8390-d343956900ed/disk --force-share --output=json {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 17:53:13 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0008521b-5a63-4ff6-8390-d343956900ed/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 17:53:13 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0008521b-5a63-4ff6-8390-d343956900ed/disk --force-share --output=json {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 17:53:13 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0008521b-5a63-4ff6-8390-d343956900ed/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 17:53:13 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b6b0ba36-ad89-45f1-9578-8b999567dd25/disk --force-share --output=json {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 17:53:13 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b6b0ba36-ad89-45f1-9578-8b999567dd25/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 17:53:13 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b6b0ba36-ad89-45f1-9578-8b999567dd25/disk --force-share --output=json {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 17:53:13 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b6b0ba36-ad89-45f1-9578-8b999567dd25/disk --force-share --output=json" returned: 0 in 0.165s {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 17:53:13 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/01c65b16-5dbe-4ad5-a72e-9500a4fa59cf/disk --force-share --output=json {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 17:53:14 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/01c65b16-5dbe-4ad5-a72e-9500a4fa59cf/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 17:53:14 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/01c65b16-5dbe-4ad5-a72e-9500a4fa59cf/disk --force-share --output=json {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 17:53:14 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/01c65b16-5dbe-4ad5-a72e-9500a4fa59cf/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 17:53:14 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74613) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 29 17:53:14 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d4ecef60-62f9-4969-b57f-3bb45a44cc9f/disk --force-share --output=json {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 17:53:14 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d4ecef60-62f9-4969-b57f-3bb45a44cc9f/disk --force-share --output=json" returned: 0 in 0.165s {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 17:53:14 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d4ecef60-62f9-4969-b57f-3bb45a44cc9f/disk --force-share --output=json {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 17:53:14 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d4ecef60-62f9-4969-b57f-3bb45a44cc9f/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 17:53:14 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f3a5f6d2-cadd-485b-a443-1b8f3ed966b9/disk --force-share --output=json {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 17:53:14 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f3a5f6d2-cadd-485b-a443-1b8f3ed966b9/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 17:53:14 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f3a5f6d2-cadd-485b-a443-1b8f3ed966b9/disk --force-share --output=json {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 17:53:14 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f3a5f6d2-cadd-485b-a443-1b8f3ed966b9/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 17:53:15 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3b828860-5cc5-40b0-b845-8e560211794e/disk --force-share --output=json {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 17:53:15 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3b828860-5cc5-40b0-b845-8e560211794e/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 17:53:15 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3b828860-5cc5-40b0-b845-8e560211794e/disk --force-share --output=json {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 17:53:15 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3b828860-5cc5-40b0-b845-8e560211794e/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 17:53:15 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/abc9e2b8-f467-4cd0-b40f-de511fde1ec1/disk --force-share --output=json {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 17:53:15 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/abc9e2b8-f467-4cd0-b40f-de511fde1ec1/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 17:53:15 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/abc9e2b8-f467-4cd0-b40f-de511fde1ec1/disk --force-share --output=json {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 17:53:15 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:53:15 user nova-compute[74613]: DEBUG nova.compute.manager [None req-163b432a-901d-4d6e-a614-26934997ddd9 tempest-ServerBootFromVolumeStableRescueTest-414665510 tempest-ServerBootFromVolumeStableRescueTest-414665510-project-member] [instance: 3b828860-5cc5-40b0-b845-8e560211794e] Checking state {{(pid=74613) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 29 17:53:15 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/abc9e2b8-f467-4cd0-b40f-de511fde1ec1/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 17:53:15 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/288b8261-8706-4696-879d-d4dd01ab553e/disk --force-share --output=json {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 17:53:15 user nova-compute[74613]: INFO nova.compute.manager [None req-163b432a-901d-4d6e-a614-26934997ddd9 tempest-ServerBootFromVolumeStableRescueTest-414665510 tempest-ServerBootFromVolumeStableRescueTest-414665510-project-member] [instance: 3b828860-5cc5-40b0-b845-8e560211794e] instance snapshotting
Nov 29 17:53:15 user nova-compute[74613]: DEBUG nova.compute.manager [req-c78eed05-a1e2-4df9-9101-7292c3e0bd6d req-c2ad8505-e3fd-47a4-ae4c-e384c7850e11 service nova] [instance: c19e230e-2e6c-4c20-b15c-ad81a73674b4] Received event network-changed-a414bce0-6293-4987-9441-46943fe2e877 {{(pid=74613) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 17:53:15 user nova-compute[74613]: DEBUG nova.compute.manager [req-c78eed05-a1e2-4df9-9101-7292c3e0bd6d req-c2ad8505-e3fd-47a4-ae4c-e384c7850e11 service nova] [instance: c19e230e-2e6c-4c20-b15c-ad81a73674b4] Refreshing instance network info cache due to event network-changed-a414bce0-6293-4987-9441-46943fe2e877. {{(pid=74613) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 17:53:15 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-c78eed05-a1e2-4df9-9101-7292c3e0bd6d req-c2ad8505-e3fd-47a4-ae4c-e384c7850e11 service nova] Acquiring lock "refresh_cache-c19e230e-2e6c-4c20-b15c-ad81a73674b4" {{(pid=74613) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 17:53:15 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-c78eed05-a1e2-4df9-9101-7292c3e0bd6d req-c2ad8505-e3fd-47a4-ae4c-e384c7850e11 service nova] Acquired lock "refresh_cache-c19e230e-2e6c-4c20-b15c-ad81a73674b4" {{(pid=74613) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 17:53:15 user nova-compute[74613]: DEBUG nova.network.neutron [req-c78eed05-a1e2-4df9-9101-7292c3e0bd6d req-c2ad8505-e3fd-47a4-ae4c-e384c7850e11 service nova] [instance: c19e230e-2e6c-4c20-b15c-ad81a73674b4] Refreshing network info cache for port a414bce0-6293-4987-9441-46943fe2e877 {{(pid=74613) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 17:53:15 user nova-compute[74613]: INFO nova.virt.libvirt.driver [None req-163b432a-901d-4d6e-a614-26934997ddd9 tempest-ServerBootFromVolumeStableRescueTest-414665510 tempest-ServerBootFromVolumeStableRescueTest-414665510-project-member] [instance: 3b828860-5cc5-40b0-b845-8e560211794e] Beginning live snapshot process
Nov 29 17:53:15 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/288b8261-8706-4696-879d-d4dd01ab553e/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 17:53:15 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/288b8261-8706-4696-879d-d4dd01ab553e/disk --force-share --output=json {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 17:53:16 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/288b8261-8706-4696-879d-d4dd01ab553e/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 17:53:16 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=74613) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 29 17:53:16 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=74613) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 29 17:53:16 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] skipping disk /dev/sde (vdc) as it is a volume {{(pid=74613) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 29 17:53:16 user nova-compute[74613]: DEBUG nova.compute.manager [req-30cda67a-8bea-45b0-b051-b5226777dcd3 req-e8986478-bb6a-41c9-8f2a-f6d54b55a3ed service nova] [instance: b6b0ba36-ad89-45f1-9578-8b999567dd25] Received event network-changed-0167e253-42dd-486a-8231-a8b8199f3584 {{(pid=74613) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 17:53:16 user nova-compute[74613]: DEBUG nova.compute.manager [req-30cda67a-8bea-45b0-b051-b5226777dcd3 req-e8986478-bb6a-41c9-8f2a-f6d54b55a3ed service nova] [instance: b6b0ba36-ad89-45f1-9578-8b999567dd25] Refreshing instance network info cache due to event network-changed-0167e253-42dd-486a-8231-a8b8199f3584. {{(pid=74613) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 17:53:16 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-30cda67a-8bea-45b0-b051-b5226777dcd3 req-e8986478-bb6a-41c9-8f2a-f6d54b55a3ed service nova] Acquiring lock "refresh_cache-b6b0ba36-ad89-45f1-9578-8b999567dd25" {{(pid=74613) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 17:53:16 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-30cda67a-8bea-45b0-b051-b5226777dcd3 req-e8986478-bb6a-41c9-8f2a-f6d54b55a3ed service nova] Acquired lock "refresh_cache-b6b0ba36-ad89-45f1-9578-8b999567dd25" {{(pid=74613) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 17:53:16 user nova-compute[74613]: DEBUG nova.network.neutron [req-30cda67a-8bea-45b0-b051-b5226777dcd3 req-e8986478-bb6a-41c9-8f2a-f6d54b55a3ed service nova] [instance: b6b0ba36-ad89-45f1-9578-8b999567dd25] Refreshing network info cache for port 0167e253-42dd-486a-8231-a8b8199f3584 {{(pid=74613) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 17:53:16 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-163b432a-901d-4d6e-a614-26934997ddd9 tempest-ServerBootFromVolumeStableRescueTest-414665510 tempest-ServerBootFromVolumeStableRescueTest-414665510-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3b828860-5cc5-40b0-b845-8e560211794e/disk --force-share --output=json -f qcow2 {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 17:53:16 user nova-compute[74613]: WARNING nova.virt.libvirt.driver [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 17:53:16 user nova-compute[74613]: WARNING nova.virt.libvirt.driver [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 17:53:16 user nova-compute[74613]: DEBUG nova.compute.resource_tracker [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Hypervisor/Node resource view: name=user free_ram=6856MB free_disk=25.309673309326172GB free_vcpus=1 pci_devices=[{"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74613) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 29 17:53:16 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 17:53:16 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 17:53:17 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-163b432a-901d-4d6e-a614-26934997ddd9 tempest-ServerBootFromVolumeStableRescueTest-414665510 tempest-ServerBootFromVolumeStableRescueTest-414665510-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3b828860-5cc5-40b0-b845-8e560211794e/disk --force-share --output=json -f qcow2" returned: 0 in 0.195s {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 17:53:17 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-163b432a-901d-4d6e-a614-26934997ddd9 tempest-ServerBootFromVolumeStableRescueTest-414665510 tempest-ServerBootFromVolumeStableRescueTest-414665510-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3b828860-5cc5-40b0-b845-8e560211794e/disk --force-share --output=json -f qcow2 {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 17:53:17 user nova-compute[74613]: DEBUG nova.compute.resource_tracker [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Instance b6b0ba36-ad89-45f1-9578-8b999567dd25 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74613) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 17:53:17 user nova-compute[74613]: DEBUG nova.compute.resource_tracker [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Instance 3b828860-5cc5-40b0-b845-8e560211794e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74613) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 17:53:17 user nova-compute[74613]: DEBUG nova.compute.resource_tracker [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Instance c19e230e-2e6c-4c20-b15c-ad81a73674b4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74613) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 17:53:17 user nova-compute[74613]: DEBUG nova.compute.resource_tracker [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Instance f3a5f6d2-cadd-485b-a443-1b8f3ed966b9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74613) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 17:53:17 user nova-compute[74613]: DEBUG nova.compute.resource_tracker [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Instance abc9e2b8-f467-4cd0-b40f-de511fde1ec1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74613) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 17:53:17 user nova-compute[74613]: DEBUG nova.compute.resource_tracker [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Instance 01c65b16-5dbe-4ad5-a72e-9500a4fa59cf actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74613) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 17:53:17 user nova-compute[74613]: DEBUG nova.compute.resource_tracker [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Instance 0008521b-5a63-4ff6-8390-d343956900ed actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74613) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 17:53:17 user nova-compute[74613]: DEBUG nova.compute.resource_tracker [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Instance 288b8261-8706-4696-879d-d4dd01ab553e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74613) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 17:53:17 user nova-compute[74613]: DEBUG nova.compute.resource_tracker [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Instance d4ecef60-62f9-4969-b57f-3bb45a44cc9f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74613) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 17:53:17 user nova-compute[74613]: DEBUG nova.compute.resource_tracker [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Instance 8de2ffb3-e264-49f7-8581-6eae21adcaeb actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74613) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 17:53:17 user nova-compute[74613]: DEBUG nova.compute.resource_tracker [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Instance 3f285832-64a7-48e8-875a-f9e1566a66b6 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74613) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 17:53:17 user nova-compute[74613]: DEBUG nova.compute.resource_tracker [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Total usable vcpus: 12, total allocated vcpus: 11 {{(pid=74613) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 29 17:53:17 user nova-compute[74613]: DEBUG nova.compute.resource_tracker [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Final resource view: name=user phys_ram=16011MB used_ram=6144MB phys_disk=40GB used_disk=9GB total_vcpus=12 used_vcpus=11 pci_stats=[] {{(pid=74613) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 29 17:53:17 user nova-compute[74613]: DEBUG nova.network.neutron [req-c78eed05-a1e2-4df9-9101-7292c3e0bd6d req-c2ad8505-e3fd-47a4-ae4c-e384c7850e11 service nova] [instance: c19e230e-2e6c-4c20-b15c-ad81a73674b4] Updated VIF entry in instance network info cache for port a414bce0-6293-4987-9441-46943fe2e877. {{(pid=74613) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 17:53:17 user nova-compute[74613]: DEBUG nova.network.neutron [req-c78eed05-a1e2-4df9-9101-7292c3e0bd6d req-c2ad8505-e3fd-47a4-ae4c-e384c7850e11 service nova] [instance: c19e230e-2e6c-4c20-b15c-ad81a73674b4] Updating instance_info_cache with network_info: [{"id": "a414bce0-6293-4987-9441-46943fe2e877", "address": "fa:16:3e:8e:94:32", "network": {"id": "4a101f3e-d23e-4198-bc3c-b4f9b4d2b4c4", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-864151424-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.168", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1c0c1c71400549369c1b11ca7d5f43ec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa414bce0-62", "ovs_interfaceid": "a414bce0-6293-4987-9441-46943fe2e877", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74613) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 17:53:17 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-163b432a-901d-4d6e-a614-26934997ddd9 tempest-ServerBootFromVolumeStableRescueTest-414665510 tempest-ServerBootFromVolumeStableRescueTest-414665510-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3b828860-5cc5-40b0-b845-8e560211794e/disk --force-share --output=json -f qcow2" returned: 0 in 0.444s {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 17:53:17 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-163b432a-901d-4d6e-a614-26934997ddd9 tempest-ServerBootFromVolumeStableRescueTest-414665510 tempest-ServerBootFromVolumeStableRescueTest-414665510-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/21faea9e6951f3bdd0153b76ac89fe1a60a34758 --force-share --output=json {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 17:53:17 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-c78eed05-a1e2-4df9-9101-7292c3e0bd6d req-c2ad8505-e3fd-47a4-ae4c-e384c7850e11 service nova] Releasing lock "refresh_cache-c19e230e-2e6c-4c20-b15c-ad81a73674b4" {{(pid=74613) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 17:53:17 user nova-compute[74613]: DEBUG nova.network.neutron [req-30cda67a-8bea-45b0-b051-b5226777dcd3 req-e8986478-bb6a-41c9-8f2a-f6d54b55a3ed service nova] [instance: b6b0ba36-ad89-45f1-9578-8b999567dd25] Updated VIF entry in instance network info cache for port 0167e253-42dd-486a-8231-a8b8199f3584. {{(pid=74613) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 17:53:17 user nova-compute[74613]: DEBUG nova.network.neutron [req-30cda67a-8bea-45b0-b051-b5226777dcd3 req-e8986478-bb6a-41c9-8f2a-f6d54b55a3ed service nova] [instance: b6b0ba36-ad89-45f1-9578-8b999567dd25] Updating instance_info_cache with network_info: [{"id": "0167e253-42dd-486a-8231-a8b8199f3584", "address": "fa:16:3e:3f:ea:5d", "network": {"id": "880ea498-5e4e-4786-a894-bac0f42572f4", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1846928198-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.254", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b8f184c16b5348beb2dc9e6359a47651", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0167e253-42", "ovs_interfaceid": "0167e253-42dd-486a-8231-a8b8199f3584", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74613) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 17:53:17 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-30cda67a-8bea-45b0-b051-b5226777dcd3 req-e8986478-bb6a-41c9-8f2a-f6d54b55a3ed service nova] Releasing lock "refresh_cache-b6b0ba36-ad89-45f1-9578-8b999567dd25" {{(pid=74613) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 17:53:17 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-163b432a-901d-4d6e-a614-26934997ddd9 tempest-ServerBootFromVolumeStableRescueTest-414665510 tempest-ServerBootFromVolumeStableRescueTest-414665510-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/21faea9e6951f3bdd0153b76ac89fe1a60a34758 --force-share --output=json" returned: 0 in 0.246s {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 17:53:17 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-163b432a-901d-4d6e-a614-26934997ddd9 tempest-ServerBootFromVolumeStableRescueTest-414665510 tempest-ServerBootFromVolumeStableRescueTest-414665510-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/21faea9e6951f3bdd0153b76ac89fe1a60a34758,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmp1nbi7517/4e69ddf105384a749026bd1329b3a00f.delta 1073741824 {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 17:53:17 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-163b432a-901d-4d6e-a614-26934997ddd9 tempest-ServerBootFromVolumeStableRescueTest-414665510 tempest-ServerBootFromVolumeStableRescueTest-414665510-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/21faea9e6951f3bdd0153b76ac89fe1a60a34758,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmp1nbi7517/4e69ddf105384a749026bd1329b3a00f.delta 1073741824" returned: 0 in 0.048s {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 17:53:17 user nova-compute[74613]: INFO nova.virt.libvirt.driver [None req-163b432a-901d-4d6e-a614-26934997ddd9 tempest-ServerBootFromVolumeStableRescueTest-414665510 tempest-ServerBootFromVolumeStableRescueTest-414665510-project-member] [instance: 3b828860-5cc5-40b0-b845-8e560211794e] Quiescing instance not available: QEMU guest agent is not enabled.
Nov 29 17:53:17 user nova-compute[74613]: DEBUG nova.virt.libvirt.host [None req-163b432a-901d-4d6e-a614-26934997ddd9 tempest-ServerBootFromVolumeStableRescueTest-414665510 tempest-ServerBootFromVolumeStableRescueTest-414665510-project-member] Checking UEFI support for host arch (x86_64) {{(pid=74613) supports_uefi /opt/stack/nova/nova/virt/libvirt/host.py:1753}}
Nov 29 17:53:17 user nova-compute[74613]: INFO nova.virt.libvirt.host [None req-163b432a-901d-4d6e-a614-26934997ddd9 tempest-ServerBootFromVolumeStableRescueTest-414665510 tempest-ServerBootFromVolumeStableRescueTest-414665510-project-member] UEFI support detected
Nov 29 17:53:17 user nova-compute[74613]: DEBUG nova.compute.provider_tree [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Inventory has not changed in ProviderTree for provider: 639d980e-3b12-44b1-b8f4-1812416fa4dd {{(pid=74613) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 17:53:17 user nova-compute[74613]: DEBUG nova.scheduler.client.report [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Inventory has not changed for provider 639d980e-3b12-44b1-b8f4-1812416fa4dd based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74613) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 17:53:17 user nova-compute[74613]: DEBUG nova.compute.resource_tracker [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Compute_service record updated for user:user {{(pid=74613) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 29 17:53:17 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.971s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 17:53:17 user nova-compute[74613]: DEBUG nova.compute.manager [req-ab6259fa-b283-4819-884a-211751bde2c5 req-41e412ff-a180-49c6-84af-163db5764f51 service nova] [instance: abc9e2b8-f467-4cd0-b40f-de511fde1ec1] Received event network-changed-59a8bf1b-9fb1-4526-92d5-9ad1897c1ee8 {{(pid=74613) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 17:53:17 user nova-compute[74613]: DEBUG nova.compute.manager [req-ab6259fa-b283-4819-884a-211751bde2c5 req-41e412ff-a180-49c6-84af-163db5764f51 service nova] [instance: abc9e2b8-f467-4cd0-b40f-de511fde1ec1] Refreshing instance network info cache due to event network-changed-59a8bf1b-9fb1-4526-92d5-9ad1897c1ee8. {{(pid=74613) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 17:53:17 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-ab6259fa-b283-4819-884a-211751bde2c5 req-41e412ff-a180-49c6-84af-163db5764f51 service nova] Acquiring lock "refresh_cache-abc9e2b8-f467-4cd0-b40f-de511fde1ec1" {{(pid=74613) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 17:53:17 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-ab6259fa-b283-4819-884a-211751bde2c5 req-41e412ff-a180-49c6-84af-163db5764f51 service nova] Acquired lock "refresh_cache-abc9e2b8-f467-4cd0-b40f-de511fde1ec1" {{(pid=74613) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 17:53:17 user nova-compute[74613]: DEBUG nova.network.neutron [req-ab6259fa-b283-4819-884a-211751bde2c5 req-41e412ff-a180-49c6-84af-163db5764f51 service nova] [instance: abc9e2b8-f467-4cd0-b40f-de511fde1ec1] Refreshing network info cache for port 59a8bf1b-9fb1-4526-92d5-9ad1897c1ee8 {{(pid=74613) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 17:53:18 user nova-compute[74613]: DEBUG nova.compute.manager [None req-54782e16-2df7-4526-b4f4-9a2d7ff4db16 tempest-ServerStableDeviceRescueTest-1416322546 tempest-ServerStableDeviceRescueTest-1416322546-project-member] [instance: b6b0ba36-ad89-45f1-9578-8b999567dd25] Checking state {{(pid=74613) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 29 17:53:18 user nova-compute[74613]: INFO nova.compute.manager [None req-54782e16-2df7-4526-b4f4-9a2d7ff4db16 tempest-ServerStableDeviceRescueTest-1416322546 tempest-ServerStableDeviceRescueTest-1416322546-project-member] [instance: b6b0ba36-ad89-45f1-9578-8b999567dd25] instance snapshotting
Nov 29 17:53:18 user nova-compute[74613]: DEBUG nova.network.neutron [req-ab6259fa-b283-4819-884a-211751bde2c5 req-41e412ff-a180-49c6-84af-163db5764f51 service nova] [instance: abc9e2b8-f467-4cd0-b40f-de511fde1ec1] Updated VIF entry in instance network info cache for port 59a8bf1b-9fb1-4526-92d5-9ad1897c1ee8. {{(pid=74613) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 17:53:18 user nova-compute[74613]: DEBUG nova.network.neutron [req-ab6259fa-b283-4819-884a-211751bde2c5 req-41e412ff-a180-49c6-84af-163db5764f51 service nova] [instance: abc9e2b8-f467-4cd0-b40f-de511fde1ec1] Updating instance_info_cache with network_info: [{"id": "59a8bf1b-9fb1-4526-92d5-9ad1897c1ee8", "address": "fa:16:3e:e3:5f:12", "network": {"id": "7c2c368e-4c7d-4d70-9a40-c10fe9541af9", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1287934102-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.103", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b1f70c311d4941c986de21ac458d11ab", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap59a8bf1b-9f", "ovs_interfaceid": "59a8bf1b-9fb1-4526-92d5-9ad1897c1ee8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74613) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 17:53:18 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-ab6259fa-b283-4819-884a-211751bde2c5 req-41e412ff-a180-49c6-84af-163db5764f51 service nova] Releasing lock "refresh_cache-abc9e2b8-f467-4cd0-b40f-de511fde1ec1" {{(pid=74613) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 17:53:18 user nova-compute[74613]: INFO nova.virt.libvirt.driver [None req-54782e16-2df7-4526-b4f4-9a2d7ff4db16 tempest-ServerStableDeviceRescueTest-1416322546 tempest-ServerStableDeviceRescueTest-1416322546-project-member] [instance: b6b0ba36-ad89-45f1-9578-8b999567dd25] Beginning live snapshot process
Nov 29 17:53:18 user nova-compute[74613]: DEBUG nova.virt.libvirt.guest [None req-163b432a-901d-4d6e-a614-26934997ddd9 tempest-ServerBootFromVolumeStableRescueTest-414665510 tempest-ServerBootFromVolumeStableRescueTest-414665510-project-member] COPY block job progress, current cursor: 0 final cursor: 75497472 {{(pid=74613) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 29 17:53:18 user nova-compute[74613]: DEBUG oslo_service.periodic_task [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74613) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 17:53:18 user nova-compute[74613]: DEBUG oslo_service.periodic_task [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74613) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 17:53:18 user nova-compute[74613]: DEBUG oslo_service.periodic_task [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74613) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 17:53:18 user nova-compute[74613]: DEBUG nova.compute.manager [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Starting heal instance info cache {{(pid=74613) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 29 17:53:18 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-54782e16-2df7-4526-b4f4-9a2d7ff4db16 tempest-ServerStableDeviceRescueTest-1416322546 tempest-ServerStableDeviceRescueTest-1416322546-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b6b0ba36-ad89-45f1-9578-8b999567dd25/disk --force-share --output=json -f qcow2 {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 17:53:18 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Acquiring lock "refresh_cache-3b828860-5cc5-40b0-b845-8e560211794e" {{(pid=74613) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 17:53:18 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Acquired lock "refresh_cache-3b828860-5cc5-40b0-b845-8e560211794e" {{(pid=74613) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 17:53:18 user nova-compute[74613]: DEBUG nova.network.neutron [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] [instance: 3b828860-5cc5-40b0-b845-8e560211794e] Forcefully refreshing network info cache for instance {{(pid=74613) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 29 17:53:19 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-54782e16-2df7-4526-b4f4-9a2d7ff4db16 tempest-ServerStableDeviceRescueTest-1416322546 tempest-ServerStableDeviceRescueTest-1416322546-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b6b0ba36-ad89-45f1-9578-8b999567dd25/disk --force-share --output=json -f qcow2" returned: 0 in 0.179s {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 17:53:19 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-54782e16-2df7-4526-b4f4-9a2d7ff4db16 tempest-ServerStableDeviceRescueTest-1416322546 tempest-ServerStableDeviceRescueTest-1416322546-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b6b0ba36-ad89-45f1-9578-8b999567dd25/disk --force-share --output=json -f qcow2 {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 17:53:19 user nova-compute[74613]: DEBUG nova.virt.libvirt.guest [None req-163b432a-901d-4d6e-a614-26934997ddd9 tempest-ServerBootFromVolumeStableRescueTest-414665510 tempest-ServerBootFromVolumeStableRescueTest-414665510-project-member] COPY block job progress, current cursor: 75497472 final cursor: 75497472 {{(pid=74613) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 29 17:53:19 user nova-compute[74613]: INFO nova.virt.libvirt.driver [None req-163b432a-901d-4d6e-a614-26934997ddd9 tempest-ServerBootFromVolumeStableRescueTest-414665510 tempest-ServerBootFromVolumeStableRescueTest-414665510-project-member] [instance: 3b828860-5cc5-40b0-b845-8e560211794e] Skipping quiescing instance: QEMU guest agent is not enabled.
Nov 29 17:53:19 user nova-compute[74613]: DEBUG nova.privsep.utils [None req-163b432a-901d-4d6e-a614-26934997ddd9 tempest-ServerBootFromVolumeStableRescueTest-414665510 tempest-ServerBootFromVolumeStableRescueTest-414665510-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74613) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 29 17:53:19 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-163b432a-901d-4d6e-a614-26934997ddd9 tempest-ServerBootFromVolumeStableRescueTest-414665510 tempest-ServerBootFromVolumeStableRescueTest-414665510-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmp1nbi7517/4e69ddf105384a749026bd1329b3a00f.delta /opt/stack/data/nova/instances/snapshots/tmp1nbi7517/4e69ddf105384a749026bd1329b3a00f {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 17:53:19 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-54782e16-2df7-4526-b4f4-9a2d7ff4db16 tempest-ServerStableDeviceRescueTest-1416322546 tempest-ServerStableDeviceRescueTest-1416322546-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b6b0ba36-ad89-45f1-9578-8b999567dd25/disk --force-share --output=json -f qcow2" returned: 0 in 0.188s {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 17:53:19 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-54782e16-2df7-4526-b4f4-9a2d7ff4db16 tempest-ServerStableDeviceRescueTest-1416322546 tempest-ServerStableDeviceRescueTest-1416322546-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/21faea9e6951f3bdd0153b76ac89fe1a60a34758 --force-share --output=json {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 17:53:19 user nova-compute[74613]: DEBUG nova.network.neutron [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] [instance: 3b828860-5cc5-40b0-b845-8e560211794e] Updating instance_info_cache with network_info: [{"id": "dfe097e1-192f-47e2-96b7-0e9fe8320758", "address": "fa:16:3e:c2:a8:2f", "network": {"id": "0722b02d-a357-4360-87e8-580913723985", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-579793494-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b820dd795dfe46cd804772f0e71f98e9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdfe097e1-19", "ovs_interfaceid": "dfe097e1-192f-47e2-96b7-0e9fe8320758", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74613) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 17:53:19 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-54782e16-2df7-4526-b4f4-9a2d7ff4db16 tempest-ServerStableDeviceRescueTest-1416322546 tempest-ServerStableDeviceRescueTest-1416322546-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/21faea9e6951f3bdd0153b76ac89fe1a60a34758 --force-share --output=json" returned: 0 in 0.218s {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 17:53:19 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-54782e16-2df7-4526-b4f4-9a2d7ff4db16 tempest-ServerStableDeviceRescueTest-1416322546 tempest-ServerStableDeviceRescueTest-1416322546-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/21faea9e6951f3bdd0153b76ac89fe1a60a34758,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpskbusnt_/8cf5b59abf5545e8b5c7b41f79e9b3e0.delta 1073741824 {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 17:53:19 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Releasing lock "refresh_cache-3b828860-5cc5-40b0-b845-8e560211794e" {{(pid=74613) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 17:53:19 user nova-compute[74613]: DEBUG nova.compute.manager [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] [instance: 3b828860-5cc5-40b0-b845-8e560211794e] Updated the network info_cache for instance {{(pid=74613) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 29 17:53:19 user nova-compute[74613]: DEBUG oslo_service.periodic_task [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74613) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 17:53:19 user nova-compute[74613]: DEBUG oslo_service.periodic_task [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74613) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 17:53:19 user nova-compute[74613]: DEBUG oslo_service.periodic_task [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74613) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 17:53:19 user nova-compute[74613]: DEBUG oslo_service.periodic_task [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74613) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 17:53:19 user nova-compute[74613]: DEBUG oslo_service.periodic_task [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74613) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 17:53:19 user nova-compute[74613]: DEBUG nova.compute.manager [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74613) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 29 17:53:19 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-54782e16-2df7-4526-b4f4-9a2d7ff4db16 tempest-ServerStableDeviceRescueTest-1416322546 tempest-ServerStableDeviceRescueTest-1416322546-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/21faea9e6951f3bdd0153b76ac89fe1a60a34758,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpskbusnt_/8cf5b59abf5545e8b5c7b41f79e9b3e0.delta 1073741824" returned: 0 in 0.115s {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 17:53:19 user nova-compute[74613]: INFO nova.virt.libvirt.driver [None req-54782e16-2df7-4526-b4f4-9a2d7ff4db16 tempest-ServerStableDeviceRescueTest-1416322546 tempest-ServerStableDeviceRescueTest-1416322546-project-member] [instance: b6b0ba36-ad89-45f1-9578-8b999567dd25] Quiescing instance not available: QEMU guest agent is not enabled.
Nov 29 17:53:19 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-163b432a-901d-4d6e-a614-26934997ddd9 tempest-ServerBootFromVolumeStableRescueTest-414665510 tempest-ServerBootFromVolumeStableRescueTest-414665510-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmp1nbi7517/4e69ddf105384a749026bd1329b3a00f.delta /opt/stack/data/nova/instances/snapshots/tmp1nbi7517/4e69ddf105384a749026bd1329b3a00f" returned: 0 in 0.538s {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 17:53:19 user nova-compute[74613]: INFO nova.virt.libvirt.driver [None req-163b432a-901d-4d6e-a614-26934997ddd9 tempest-ServerBootFromVolumeStableRescueTest-414665510 tempest-ServerBootFromVolumeStableRescueTest-414665510-project-member] [instance: 3b828860-5cc5-40b0-b845-8e560211794e] Snapshot extracted, beginning image upload
Nov 29 17:53:19 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-6f5690a7-c3e7-4aff-a1af-e32aaceae1bb tempest-DeleteServersTestJSON-112443106 tempest-DeleteServersTestJSON-112443106-project-member] Acquiring lock "f3a5f6d2-cadd-485b-a443-1b8f3ed966b9" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 17:53:19 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-6f5690a7-c3e7-4aff-a1af-e32aaceae1bb tempest-DeleteServersTestJSON-112443106 tempest-DeleteServersTestJSON-112443106-project-member] Lock "f3a5f6d2-cadd-485b-a443-1b8f3ed966b9" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.002s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 17:53:19 user nova-compute[74613]: DEBUG nova.objects.instance [None req-6f5690a7-c3e7-4aff-a1af-e32aaceae1bb tempest-DeleteServersTestJSON-112443106 tempest-DeleteServersTestJSON-112443106-project-member] Lazy-loading 'flavor' on Instance uuid f3a5f6d2-cadd-485b-a443-1b8f3ed966b9 {{(pid=74613) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 17:53:19 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-6f5690a7-c3e7-4aff-a1af-e32aaceae1bb tempest-DeleteServersTestJSON-112443106 tempest-DeleteServersTestJSON-112443106-project-member] Lock "f3a5f6d2-cadd-485b-a443-1b8f3ed966b9" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.089s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 17:53:20 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:53:20 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-6f5690a7-c3e7-4aff-a1af-e32aaceae1bb tempest-DeleteServersTestJSON-112443106 tempest-DeleteServersTestJSON-112443106-project-member] Acquiring lock "f3a5f6d2-cadd-485b-a443-1b8f3ed966b9" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 17:53:20 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-6f5690a7-c3e7-4aff-a1af-e32aaceae1bb tempest-DeleteServersTestJSON-112443106 tempest-DeleteServersTestJSON-112443106-project-member] Lock "f3a5f6d2-cadd-485b-a443-1b8f3ed966b9" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 17:53:20 user nova-compute[74613]: INFO nova.compute.manager [None req-6f5690a7-c3e7-4aff-a1af-e32aaceae1bb tempest-DeleteServersTestJSON-112443106 tempest-DeleteServersTestJSON-112443106-project-member] [instance: f3a5f6d2-cadd-485b-a443-1b8f3ed966b9] Attaching volume 7bc0f024-5b8c-4770-8963-a2420651d328 to /dev/vdb
Nov 29 17:53:20 user nova-compute[74613]: DEBUG os_brick.utils [None req-6f5690a7-c3e7-4aff-a1af-e32aaceae1bb tempest-DeleteServersTestJSON-112443106 tempest-DeleteServersTestJSON-112443106-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74613) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 17:53:20 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 17:53:20 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 17:53:20 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac85a032-125e-442e-b9e5-7fa17acf3692]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:400972819b5\n', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 17:53:20 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 17:53:20 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.022s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 17:53:20 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[94414fd4-e1be-4c70-ba6b-ffda0da10d50]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 17:53:20 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 17:53:20 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 17:53:20 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[857c9087-196e-4fe7-bce6-3ef97103ab5a]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 17:53:20 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[b405b0ed-e323-4c0e-ac36-5d42f753bc45]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 17:53:20 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-6f5690a7-c3e7-4aff-a1af-e32aaceae1bb tempest-DeleteServersTestJSON-112443106 tempest-DeleteServersTestJSON-112443106-project-member] Running cmd (subprocess): nvme version {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 17:53:20 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-6f5690a7-c3e7-4aff-a1af-e32aaceae1bb tempest-DeleteServersTestJSON-112443106 tempest-DeleteServersTestJSON-112443106-project-member] 'nvme version' failed. Not Retrying. {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 17:53:20 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.nvmeof [None req-6f5690a7-c3e7-4aff-a1af-e32aaceae1bb tempest-DeleteServersTestJSON-112443106 tempest-DeleteServersTestJSON-112443106-project-member] nvme not present on system {{(pid=74613) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 29 17:53:20 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 17:53:20 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 17:53:20 user nova-compute[74613]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 29 17:53:20 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7e466c6-b063-4254-8b53-f9a2d246e341]: (4, '') {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 17:53:20 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.lightos [None req-6f5690a7-c3e7-4aff-a1af-e32aaceae1bb tempest-DeleteServersTestJSON-112443106 tempest-DeleteServersTestJSON-112443106-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74613) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 29 17:53:20 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.lightos [None req-6f5690a7-c3e7-4aff-a1af-e32aaceae1bb tempest-DeleteServersTestJSON-112443106 tempest-DeleteServersTestJSON-112443106-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74613) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 29 17:53:20 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.lightos [None req-6f5690a7-c3e7-4aff-a1af-e32aaceae1bb tempest-DeleteServersTestJSON-112443106 tempest-DeleteServersTestJSON-112443106-project-member] LIGHTOS: no hostnqn found. {{(pid=74613) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 29 17:53:20 user nova-compute[74613]: DEBUG os_brick.utils [None req-6f5690a7-c3e7-4aff-a1af-e32aaceae1bb tempest-DeleteServersTestJSON-112443106 tempest-DeleteServersTestJSON-112443106-project-member] <== get_connector_properties: return (131ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:400972819b5', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74613) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 17:53:20 user nova-compute[74613]: DEBUG nova.virt.block_device [None req-6f5690a7-c3e7-4aff-a1af-e32aaceae1bb tempest-DeleteServersTestJSON-112443106 tempest-DeleteServersTestJSON-112443106-project-member] [instance: f3a5f6d2-cadd-485b-a443-1b8f3ed966b9] Updating existing volume attachment record: 53823f75-d445-4ab1-806f-e39e907bbb49 {{(pid=74613) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 29 17:53:20 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:53:20 user nova-compute[74613]: DEBUG nova.virt.libvirt.guest [None req-54782e16-2df7-4526-b4f4-9a2d7ff4db16 tempest-ServerStableDeviceRescueTest-1416322546 tempest-ServerStableDeviceRescueTest-1416322546-project-member] COPY block job progress, current cursor: 0 final cursor: 75497472 {{(pid=74613) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 29 17:53:21 user nova-compute[74613]: DEBUG nova.virt.libvirt.guest [None req-54782e16-2df7-4526-b4f4-9a2d7ff4db16 tempest-ServerStableDeviceRescueTest-1416322546 tempest-ServerStableDeviceRescueTest-1416322546-project-member] COPY block job progress, current cursor: 75497472 final cursor: 75497472 {{(pid=74613) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 29 17:53:21 user nova-compute[74613]: INFO nova.virt.libvirt.driver [None req-54782e16-2df7-4526-b4f4-9a2d7ff4db16 tempest-ServerStableDeviceRescueTest-1416322546 tempest-ServerStableDeviceRescueTest-1416322546-project-member] [instance: b6b0ba36-ad89-45f1-9578-8b999567dd25] Skipping quiescing instance: QEMU guest agent is not enabled.
Nov 29 17:53:21 user nova-compute[74613]: DEBUG nova.privsep.utils [None req-54782e16-2df7-4526-b4f4-9a2d7ff4db16 tempest-ServerStableDeviceRescueTest-1416322546 tempest-ServerStableDeviceRescueTest-1416322546-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74613) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 29 17:53:21 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-54782e16-2df7-4526-b4f4-9a2d7ff4db16 tempest-ServerStableDeviceRescueTest-1416322546 tempest-ServerStableDeviceRescueTest-1416322546-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpskbusnt_/8cf5b59abf5545e8b5c7b41f79e9b3e0.delta /opt/stack/data/nova/instances/snapshots/tmpskbusnt_/8cf5b59abf5545e8b5c7b41f79e9b3e0 {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 17:53:22 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-490d0aa3-58ff-4612-814c-065163c94961 tempest-AttachVolumeShelveTestJSON-1452861425 tempest-AttachVolumeShelveTestJSON-1452861425-project-member] Acquiring lock "c19e230e-2e6c-4c20-b15c-ad81a73674b4" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 17:53:22 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-490d0aa3-58ff-4612-814c-065163c94961 tempest-AttachVolumeShelveTestJSON-1452861425 tempest-AttachVolumeShelveTestJSON-1452861425-project-member] Lock "c19e230e-2e6c-4c20-b15c-ad81a73674b4" acquired by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: waited 0.002s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 17:53:22 user nova-compute[74613]: INFO nova.compute.manager [None req-490d0aa3-58ff-4612-814c-065163c94961 tempest-AttachVolumeShelveTestJSON-1452861425 tempest-AttachVolumeShelveTestJSON-1452861425-project-member] [instance: c19e230e-2e6c-4c20-b15c-ad81a73674b4] Shelving
Nov 29 17:53:22 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-54782e16-2df7-4526-b4f4-9a2d7ff4db16 tempest-ServerStableDeviceRescueTest-1416322546 tempest-ServerStableDeviceRescueTest-1416322546-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpskbusnt_/8cf5b59abf5545e8b5c7b41f79e9b3e0.delta /opt/stack/data/nova/instances/snapshots/tmpskbusnt_/8cf5b59abf5545e8b5c7b41f79e9b3e0" returned: 0 in 0.736s {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 17:53:22 user nova-compute[74613]: INFO nova.virt.libvirt.driver [None req-54782e16-2df7-4526-b4f4-9a2d7ff4db16 tempest-ServerStableDeviceRescueTest-1416322546 tempest-ServerStableDeviceRescueTest-1416322546-project-member] [instance: b6b0ba36-ad89-45f1-9578-8b999567dd25] Snapshot extracted, beginning image upload
Nov 29 17:53:22 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:53:22 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:53:22 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:53:22 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:53:22 user nova-compute[74613]: DEBUG nova.compute.manager [req-36a604a7-7cc6-4685-b8f2-f92b938a9abc req-3344f2cd-88a8-4496-9919-53244b25bb0c service nova] [instance: c19e230e-2e6c-4c20-b15c-ad81a73674b4] Received event network-vif-unplugged-a414bce0-6293-4987-9441-46943fe2e877 {{(pid=74613) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 17:53:22 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-36a604a7-7cc6-4685-b8f2-f92b938a9abc req-3344f2cd-88a8-4496-9919-53244b25bb0c service nova] Acquiring lock "c19e230e-2e6c-4c20-b15c-ad81a73674b4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 17:53:22 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-36a604a7-7cc6-4685-b8f2-f92b938a9abc req-3344f2cd-88a8-4496-9919-53244b25bb0c service nova] Lock "c19e230e-2e6c-4c20-b15c-ad81a73674b4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 17:53:22 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-36a604a7-7cc6-4685-b8f2-f92b938a9abc req-3344f2cd-88a8-4496-9919-53244b25bb0c service nova] Lock "c19e230e-2e6c-4c20-b15c-ad81a73674b4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 17:53:22 user nova-compute[74613]: DEBUG nova.compute.manager [req-36a604a7-7cc6-4685-b8f2-f92b938a9abc req-3344f2cd-88a8-4496-9919-53244b25bb0c service nova] [instance: c19e230e-2e6c-4c20-b15c-ad81a73674b4] No waiting events found dispatching network-vif-unplugged-a414bce0-6293-4987-9441-46943fe2e877 {{(pid=74613) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 17:53:22 user nova-compute[74613]: WARNING nova.compute.manager [req-36a604a7-7cc6-4685-b8f2-f92b938a9abc req-3344f2cd-88a8-4496-9919-53244b25bb0c service nova] [instance: c19e230e-2e6c-4c20-b15c-ad81a73674b4] Received unexpected event network-vif-unplugged-a414bce0-6293-4987-9441-46943fe2e877 for instance with vm_state active and task_state shelving.
Nov 29 17:53:22 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:53:22 user nova-compute[74613]: INFO nova.virt.libvirt.driver [-] [instance: c19e230e-2e6c-4c20-b15c-ad81a73674b4] Instance destroyed successfully.
Nov 29 17:53:23 user nova-compute[74613]: INFO nova.virt.libvirt.driver [None req-490d0aa3-58ff-4612-814c-065163c94961 tempest-AttachVolumeShelveTestJSON-1452861425 tempest-AttachVolumeShelveTestJSON-1452861425-project-member] [instance: c19e230e-2e6c-4c20-b15c-ad81a73674b4] Beginning cold snapshot process
Nov 29 17:53:23 user nova-compute[74613]: DEBUG nova.privsep.utils [None req-490d0aa3-58ff-4612-814c-065163c94961 tempest-AttachVolumeShelveTestJSON-1452861425 tempest-AttachVolumeShelveTestJSON-1452861425-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74613) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 29 17:53:23 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-490d0aa3-58ff-4612-814c-065163c94961 tempest-AttachVolumeShelveTestJSON-1452861425 tempest-AttachVolumeShelveTestJSON-1452861425-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/c19e230e-2e6c-4c20-b15c-ad81a73674b4/disk /opt/stack/data/nova/instances/snapshots/tmptzcnlkm4/590b055f1a5a498fa5fbfec325765caa {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 17:53:23 user nova-compute[74613]: INFO nova.virt.libvirt.driver [None req-163b432a-901d-4d6e-a614-26934997ddd9 tempest-ServerBootFromVolumeStableRescueTest-414665510 tempest-ServerBootFromVolumeStableRescueTest-414665510-project-member] [instance: 3b828860-5cc5-40b0-b845-8e560211794e] Snapshot image upload complete
Nov 29 17:53:23 user nova-compute[74613]: INFO nova.compute.manager [None req-163b432a-901d-4d6e-a614-26934997ddd9 tempest-ServerBootFromVolumeStableRescueTest-414665510 tempest-ServerBootFromVolumeStableRescueTest-414665510-project-member] [instance: 3b828860-5cc5-40b0-b845-8e560211794e] Took 7.50 seconds to snapshot the instance on the hypervisor.
Nov 29 17:53:23 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-490d0aa3-58ff-4612-814c-065163c94961 tempest-AttachVolumeShelveTestJSON-1452861425 tempest-AttachVolumeShelveTestJSON-1452861425-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/c19e230e-2e6c-4c20-b15c-ad81a73674b4/disk /opt/stack/data/nova/instances/snapshots/tmptzcnlkm4/590b055f1a5a498fa5fbfec325765caa" returned: 0 in 0.602s {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 17:53:23 user nova-compute[74613]: INFO nova.virt.libvirt.driver [None req-490d0aa3-58ff-4612-814c-065163c94961 tempest-AttachVolumeShelveTestJSON-1452861425 tempest-AttachVolumeShelveTestJSON-1452861425-project-member] [instance: c19e230e-2e6c-4c20-b15c-ad81a73674b4] Snapshot extracted, beginning image upload
Nov 29 17:53:24 user nova-compute[74613]: DEBUG nova.compute.manager [req-219efff6-1e88-4765-9cf0-e37a9697cb81 req-3173630a-1ccf-43d5-9f58-3a1c918f69ea service nova] [instance: c19e230e-2e6c-4c20-b15c-ad81a73674b4] Received event network-vif-plugged-a414bce0-6293-4987-9441-46943fe2e877 {{(pid=74613) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 17:53:24 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-219efff6-1e88-4765-9cf0-e37a9697cb81 req-3173630a-1ccf-43d5-9f58-3a1c918f69ea service nova] Acquiring lock "c19e230e-2e6c-4c20-b15c-ad81a73674b4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 17:53:24 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-219efff6-1e88-4765-9cf0-e37a9697cb81 req-3173630a-1ccf-43d5-9f58-3a1c918f69ea service nova] Lock "c19e230e-2e6c-4c20-b15c-ad81a73674b4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 17:53:24 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-219efff6-1e88-4765-9cf0-e37a9697cb81 req-3173630a-1ccf-43d5-9f58-3a1c918f69ea service nova] Lock "c19e230e-2e6c-4c20-b15c-ad81a73674b4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 17:53:24 user nova-compute[74613]: DEBUG nova.compute.manager [req-219efff6-1e88-4765-9cf0-e37a9697cb81 req-3173630a-1ccf-43d5-9f58-3a1c918f69ea service nova] [instance: c19e230e-2e6c-4c20-b15c-ad81a73674b4] No waiting events found dispatching network-vif-plugged-a414bce0-6293-4987-9441-46943fe2e877 {{(pid=74613) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 17:53:24 user nova-compute[74613]: WARNING nova.compute.manager [req-219efff6-1e88-4765-9cf0-e37a9697cb81 req-3173630a-1ccf-43d5-9f58-3a1c918f69ea service nova] [instance: c19e230e-2e6c-4c20-b15c-ad81a73674b4] Received unexpected event network-vif-plugged-a414bce0-6293-4987-9441-46943fe2e877 for instance with vm_state active and task_state shelving_image_uploading.
Nov 29 17:53:25 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:53:25 user nova-compute[74613]: INFO nova.virt.libvirt.driver [None req-54782e16-2df7-4526-b4f4-9a2d7ff4db16 tempest-ServerStableDeviceRescueTest-1416322546 tempest-ServerStableDeviceRescueTest-1416322546-project-member] [instance: b6b0ba36-ad89-45f1-9578-8b999567dd25] Snapshot image upload complete
Nov 29 17:53:25 user nova-compute[74613]: INFO nova.compute.manager [None req-54782e16-2df7-4526-b4f4-9a2d7ff4db16 tempest-ServerStableDeviceRescueTest-1416322546 tempest-ServerStableDeviceRescueTest-1416322546-project-member] [instance: b6b0ba36-ad89-45f1-9578-8b999567dd25] Took 6.68 seconds to snapshot the instance on the hypervisor.
Nov 29 17:53:25 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:53:26 user nova-compute[74613]: INFO nova.virt.libvirt.driver [None req-490d0aa3-58ff-4612-814c-065163c94961 tempest-AttachVolumeShelveTestJSON-1452861425 tempest-AttachVolumeShelveTestJSON-1452861425-project-member] [instance: c19e230e-2e6c-4c20-b15c-ad81a73674b4] Snapshot image upload complete
Nov 29 17:53:26 user nova-compute[74613]: DEBUG nova.compute.manager [None req-490d0aa3-58ff-4612-814c-065163c94961 tempest-AttachVolumeShelveTestJSON-1452861425 tempest-AttachVolumeShelveTestJSON-1452861425-project-member] [instance: c19e230e-2e6c-4c20-b15c-ad81a73674b4] Checking state {{(pid=74613) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 29 17:53:26 user nova-compute[74613]: INFO nova.compute.manager [None req-490d0aa3-58ff-4612-814c-065163c94961 tempest-AttachVolumeShelveTestJSON-1452861425 tempest-AttachVolumeShelveTestJSON-1452861425-project-member] [instance: c19e230e-2e6c-4c20-b15c-ad81a73674b4] Shelve offloading
Nov 29 17:53:26 user nova-compute[74613]: INFO nova.virt.libvirt.driver [-] [instance: c19e230e-2e6c-4c20-b15c-ad81a73674b4] Instance destroyed successfully.
Nov 29 17:53:26 user nova-compute[74613]: DEBUG nova.compute.manager [None req-490d0aa3-58ff-4612-814c-065163c94961 tempest-AttachVolumeShelveTestJSON-1452861425 tempest-AttachVolumeShelveTestJSON-1452861425-project-member] [instance: c19e230e-2e6c-4c20-b15c-ad81a73674b4] Checking state {{(pid=74613) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 29 17:53:26 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-490d0aa3-58ff-4612-814c-065163c94961 tempest-AttachVolumeShelveTestJSON-1452861425 tempest-AttachVolumeShelveTestJSON-1452861425-project-member] Acquiring lock "refresh_cache-c19e230e-2e6c-4c20-b15c-ad81a73674b4" {{(pid=74613) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 17:53:26 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-490d0aa3-58ff-4612-814c-065163c94961 tempest-AttachVolumeShelveTestJSON-1452861425 tempest-AttachVolumeShelveTestJSON-1452861425-project-member] Acquired lock "refresh_cache-c19e230e-2e6c-4c20-b15c-ad81a73674b4" {{(pid=74613) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 17:53:26 user nova-compute[74613]: DEBUG nova.network.neutron [None req-490d0aa3-58ff-4612-814c-065163c94961 tempest-AttachVolumeShelveTestJSON-1452861425 tempest-AttachVolumeShelveTestJSON-1452861425-project-member] [instance: c19e230e-2e6c-4c20-b15c-ad81a73674b4] Building network info cache for instance {{(pid=74613) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 29 17:53:27 user nova-compute[74613]: DEBUG nova.network.neutron [None req-490d0aa3-58ff-4612-814c-065163c94961 tempest-AttachVolumeShelveTestJSON-1452861425 tempest-AttachVolumeShelveTestJSON-1452861425-project-member] [instance: c19e230e-2e6c-4c20-b15c-ad81a73674b4] Updating instance_info_cache with network_info: [{"id": "a414bce0-6293-4987-9441-46943fe2e877", "address": "fa:16:3e:8e:94:32", "network": {"id": "4a101f3e-d23e-4198-bc3c-b4f9b4d2b4c4", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-864151424-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.168", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1c0c1c71400549369c1b11ca7d5f43ec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa414bce0-62", "ovs_interfaceid": "a414bce0-6293-4987-9441-46943fe2e877", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74613) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 17:53:27 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-490d0aa3-58ff-4612-814c-065163c94961 tempest-AttachVolumeShelveTestJSON-1452861425 tempest-AttachVolumeShelveTestJSON-1452861425-project-member] Releasing lock "refresh_cache-c19e230e-2e6c-4c20-b15c-ad81a73674b4" {{(pid=74613) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 17:53:28 user nova-compute[74613]: INFO nova.virt.libvirt.driver [-] [instance: c19e230e-2e6c-4c20-b15c-ad81a73674b4] Instance destroyed successfully.
Nov 29 17:53:28 user nova-compute[74613]: DEBUG nova.objects.instance [None req-490d0aa3-58ff-4612-814c-065163c94961 tempest-AttachVolumeShelveTestJSON-1452861425 tempest-AttachVolumeShelveTestJSON-1452861425-project-member] Lazy-loading 'resources' on Instance uuid c19e230e-2e6c-4c20-b15c-ad81a73674b4 {{(pid=74613) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 17:53:28 user nova-compute[74613]: DEBUG nova.virt.libvirt.vif [None req-490d0aa3-58ff-4612-814c-065163c94961 tempest-AttachVolumeShelveTestJSON-1452861425 tempest-AttachVolumeShelveTestJSON-1452861425-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T17:51:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-705281655',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-705281655',id=3,image_ref='4217f428-8d9d-4ee1-9614-642d26d90c46',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLofinuzL4KIe2/FJI/rOzpr08YCyh/7umJCTHDfb/8b61GmXnBJ32Swg1dTDe95ImRcaYamLXrnnmDILi1vgJuezNA9fzD/sJhWrgADbQSCHdOnl0SlzP290n0Y8JsPZA==',key_name='tempest-keypair-248065239',keypairs=<?>,launch_index=0,launched_at=2023-11-29T17:51:44Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='1c0c1c71400549369c1b11ca7d5f43ec',ramdisk_id='',reservation_id='r-ab112qsi',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='4217f428-8d9d-4ee1-9614-642d26d90c46',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1452861425',owner_user_name='tempest-AttachVolumeShelveTestJSON-1452861425-project-member',shelved_at='2023-11-29T17:53:26.879592',shelved_host='user',shelved_image_id='9f45473b-2b66-4071-b129-1f38d43ff99e'},tags=<?>,task_state='shelving_offloading',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-29T17:53:24Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='45192488dde84ebfbcacfdbd4f898799',uuid=c19e230e-2e6c-4c20-b15c-ad81a73674b4,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='shelved') vif={"id": "a414bce0-6293-4987-9441-46943fe2e877", "address": "fa:16:3e:8e:94:32", "network": {"id": "4a101f3e-d23e-4198-bc3c-b4f9b4d2b4c4", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-864151424-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.168", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1c0c1c71400549369c1b11ca7d5f43ec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa414bce0-62", "ovs_interfaceid": "a414bce0-6293-4987-9441-46943fe2e877", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74613) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 29 17:53:28 user nova-compute[74613]: DEBUG nova.network.os_vif_util [None req-490d0aa3-58ff-4612-814c-065163c94961 tempest-AttachVolumeShelveTestJSON-1452861425 tempest-AttachVolumeShelveTestJSON-1452861425-project-member] Converting VIF {"id": "a414bce0-6293-4987-9441-46943fe2e877", "address": "fa:16:3e:8e:94:32", "network": {"id": "4a101f3e-d23e-4198-bc3c-b4f9b4d2b4c4", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-864151424-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.168", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1c0c1c71400549369c1b11ca7d5f43ec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa414bce0-62", "ovs_interfaceid": "a414bce0-6293-4987-9441-46943fe2e877", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74613) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 17:53:28 user nova-compute[74613]: DEBUG nova.network.os_vif_util [None req-490d0aa3-58ff-4612-814c-065163c94961 tempest-AttachVolumeShelveTestJSON-1452861425 tempest-AttachVolumeShelveTestJSON-1452861425-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8e:94:32,bridge_name='br-int',has_traffic_filtering=True,id=a414bce0-6293-4987-9441-46943fe2e877,network=Network(4a101f3e-d23e-4198-bc3c-b4f9b4d2b4c4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa414bce0-62') {{(pid=74613) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 17:53:28 user nova-compute[74613]: DEBUG os_vif [None req-490d0aa3-58ff-4612-814c-065163c94961 tempest-AttachVolumeShelveTestJSON-1452861425 tempest-AttachVolumeShelveTestJSON-1452861425-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:8e:94:32,bridge_name='br-int',has_traffic_filtering=True,id=a414bce0-6293-4987-9441-46943fe2e877,network=Network(4a101f3e-d23e-4198-bc3c-b4f9b4d2b4c4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa414bce0-62') {{(pid=74613) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 29 17:53:28 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:53:28 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapa414bce0-62, bridge=br-int, if_exists=True) {{(pid=74613) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 17:53:28 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:53:28 user nova-compute[74613]: DEBUG nova.compute.manager [req-40bc4a9d-9e58-41d5-af73-de4f8dc5e35e req-abb3f0bf-ca6e-4d79-ad05-c810c952fd72 service nova] [instance: c19e230e-2e6c-4c20-b15c-ad81a73674b4] Received event network-changed-a414bce0-6293-4987-9441-46943fe2e877 {{(pid=74613) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 17:53:28 user nova-compute[74613]: DEBUG nova.compute.manager [req-40bc4a9d-9e58-41d5-af73-de4f8dc5e35e req-abb3f0bf-ca6e-4d79-ad05-c810c952fd72 service nova] [instance: c19e230e-2e6c-4c20-b15c-ad81a73674b4] Refreshing instance network info cache due to event network-changed-a414bce0-6293-4987-9441-46943fe2e877. {{(pid=74613) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 17:53:28 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-40bc4a9d-9e58-41d5-af73-de4f8dc5e35e req-abb3f0bf-ca6e-4d79-ad05-c810c952fd72 service nova] Acquiring lock "refresh_cache-c19e230e-2e6c-4c20-b15c-ad81a73674b4" {{(pid=74613) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 17:53:28 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-40bc4a9d-9e58-41d5-af73-de4f8dc5e35e req-abb3f0bf-ca6e-4d79-ad05-c810c952fd72 service nova] Acquired lock "refresh_cache-c19e230e-2e6c-4c20-b15c-ad81a73674b4" {{(pid=74613) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 17:53:28 user nova-compute[74613]: DEBUG nova.network.neutron [req-40bc4a9d-9e58-41d5-af73-de4f8dc5e35e req-abb3f0bf-ca6e-4d79-ad05-c810c952fd72 service nova] [instance: c19e230e-2e6c-4c20-b15c-ad81a73674b4] Refreshing network info cache for port a414bce0-6293-4987-9441-46943fe2e877 {{(pid=74613) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 17:53:28 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 17:53:28 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:53:28 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=888603f9-c768-449d-8ea9-be9b6228e239) {{(pid=74613) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 17:53:28 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:53:28 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:53:28 user nova-compute[74613]: INFO os_vif [None req-490d0aa3-58ff-4612-814c-065163c94961 tempest-AttachVolumeShelveTestJSON-1452861425 tempest-AttachVolumeShelveTestJSON-1452861425-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:8e:94:32,bridge_name='br-int',has_traffic_filtering=True,id=a414bce0-6293-4987-9441-46943fe2e877,network=Network(4a101f3e-d23e-4198-bc3c-b4f9b4d2b4c4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa414bce0-62')
Nov 29 17:53:28 user nova-compute[74613]: INFO nova.virt.libvirt.driver [None req-490d0aa3-58ff-4612-814c-065163c94961 tempest-AttachVolumeShelveTestJSON-1452861425 tempest-AttachVolumeShelveTestJSON-1452861425-project-member] [instance: c19e230e-2e6c-4c20-b15c-ad81a73674b4] Deleting instance files /opt/stack/data/nova/instances/c19e230e-2e6c-4c20-b15c-ad81a73674b4_del
Nov 29 17:53:28 user nova-compute[74613]: INFO nova.virt.libvirt.driver [None req-490d0aa3-58ff-4612-814c-065163c94961 tempest-AttachVolumeShelveTestJSON-1452861425 tempest-AttachVolumeShelveTestJSON-1452861425-project-member] [instance: c19e230e-2e6c-4c20-b15c-ad81a73674b4] Deletion of /opt/stack/data/nova/instances/c19e230e-2e6c-4c20-b15c-ad81a73674b4_del complete
Nov 29 17:53:28 user nova-compute[74613]: INFO nova.scheduler.client.report [None req-490d0aa3-58ff-4612-814c-065163c94961 tempest-AttachVolumeShelveTestJSON-1452861425 tempest-AttachVolumeShelveTestJSON-1452861425-project-member] Deleted allocations for instance c19e230e-2e6c-4c20-b15c-ad81a73674b4
Nov 29 17:53:28 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-490d0aa3-58ff-4612-814c-065163c94961 tempest-AttachVolumeShelveTestJSON-1452861425 tempest-AttachVolumeShelveTestJSON-1452861425-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 17:53:28 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-490d0aa3-58ff-4612-814c-065163c94961 tempest-AttachVolumeShelveTestJSON-1452861425 tempest-AttachVolumeShelveTestJSON-1452861425-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 17:53:28 user nova-compute[74613]: DEBUG nova.objects.instance [None req-490d0aa3-58ff-4612-814c-065163c94961 tempest-AttachVolumeShelveTestJSON-1452861425 tempest-AttachVolumeShelveTestJSON-1452861425-project-member] Lazy-loading 'numa_topology' on Instance uuid c19e230e-2e6c-4c20-b15c-ad81a73674b4 {{(pid=74613) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 17:53:28 user nova-compute[74613]: DEBUG nova.objects.base [None req-490d0aa3-58ff-4612-814c-065163c94961 tempest-AttachVolumeShelveTestJSON-1452861425 tempest-AttachVolumeShelveTestJSON-1452861425-project-member] Object Instance<c19e230e-2e6c-4c20-b15c-ad81a73674b4> lazy-loaded attributes: resources,numa_topology {{(pid=74613) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 29 17:53:28 user nova-compute[74613]: DEBUG nova.compute.provider_tree [None req-490d0aa3-58ff-4612-814c-065163c94961 tempest-AttachVolumeShelveTestJSON-1452861425 tempest-AttachVolumeShelveTestJSON-1452861425-project-member] Inventory has not changed in ProviderTree for provider: 639d980e-3b12-44b1-b8f4-1812416fa4dd {{(pid=74613) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 17:53:28 user nova-compute[74613]: DEBUG nova.scheduler.client.report [None req-490d0aa3-58ff-4612-814c-065163c94961 tempest-AttachVolumeShelveTestJSON-1452861425 tempest-AttachVolumeShelveTestJSON-1452861425-project-member] Inventory has not changed for provider 639d980e-3b12-44b1-b8f4-1812416fa4dd based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74613) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 17:53:28 user nova-compute[74613]: DEBUG nova.network.neutron [req-40bc4a9d-9e58-41d5-af73-de4f8dc5e35e req-abb3f0bf-ca6e-4d79-ad05-c810c952fd72 service nova] [instance: c19e230e-2e6c-4c20-b15c-ad81a73674b4] Updated VIF entry in instance network info cache for port a414bce0-6293-4987-9441-46943fe2e877. {{(pid=74613) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 17:53:28 user nova-compute[74613]: DEBUG nova.network.neutron [req-40bc4a9d-9e58-41d5-af73-de4f8dc5e35e req-abb3f0bf-ca6e-4d79-ad05-c810c952fd72 service nova] [instance: c19e230e-2e6c-4c20-b15c-ad81a73674b4] Updating instance_info_cache with network_info: [{"id": "a414bce0-6293-4987-9441-46943fe2e877", "address": "fa:16:3e:8e:94:32", "network": {"id": "4a101f3e-d23e-4198-bc3c-b4f9b4d2b4c4", "bridge": null, "label": "tempest-AttachVolumeShelveTestJSON-864151424-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.168", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1c0c1c71400549369c1b11ca7d5f43ec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "unbound", "details": {}, "devname": "tapa414bce0-62", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74613) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 17:53:28 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-490d0aa3-58ff-4612-814c-065163c94961 tempest-AttachVolumeShelveTestJSON-1452861425 tempest-AttachVolumeShelveTestJSON-1452861425-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.367s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 17:53:28 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-40bc4a9d-9e58-41d5-af73-de4f8dc5e35e req-abb3f0bf-ca6e-4d79-ad05-c810c952fd72 service nova] Releasing lock "refresh_cache-c19e230e-2e6c-4c20-b15c-ad81a73674b4" {{(pid=74613) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 17:53:28 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-490d0aa3-58ff-4612-814c-065163c94961 tempest-AttachVolumeShelveTestJSON-1452861425 tempest-AttachVolumeShelveTestJSON-1452861425-project-member] Lock "c19e230e-2e6c-4c20-b15c-ad81a73674b4" "released" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: held 6.466s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 17:53:28 user nova-compute[74613]: DEBUG nova.compute.manager [req-6b09daf8-cfbd-4e4e-a818-baf61dc84843 req-82d758aa-e8b3-4925-b50c-f63f6a16b734 service nova] [instance: 01c65b16-5dbe-4ad5-a72e-9500a4fa59cf] Received event network-changed-9441dfc5-c933-4642-b797-494d88a10f8a {{(pid=74613) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 17:53:28 user nova-compute[74613]: DEBUG nova.compute.manager [req-6b09daf8-cfbd-4e4e-a818-baf61dc84843 req-82d758aa-e8b3-4925-b50c-f63f6a16b734 service nova] [instance: 01c65b16-5dbe-4ad5-a72e-9500a4fa59cf] Refreshing instance network info cache due to event network-changed-9441dfc5-c933-4642-b797-494d88a10f8a. {{(pid=74613) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 17:53:28 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-6b09daf8-cfbd-4e4e-a818-baf61dc84843 req-82d758aa-e8b3-4925-b50c-f63f6a16b734 service nova] Acquiring lock "refresh_cache-01c65b16-5dbe-4ad5-a72e-9500a4fa59cf" {{(pid=74613) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 17:53:28 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-6b09daf8-cfbd-4e4e-a818-baf61dc84843 req-82d758aa-e8b3-4925-b50c-f63f6a16b734 service nova] Acquired lock "refresh_cache-01c65b16-5dbe-4ad5-a72e-9500a4fa59cf" {{(pid=74613) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 17:53:28 user nova-compute[74613]: DEBUG nova.network.neutron [req-6b09daf8-cfbd-4e4e-a818-baf61dc84843 req-82d758aa-e8b3-4925-b50c-f63f6a16b734 service nova] [instance: 01c65b16-5dbe-4ad5-a72e-9500a4fa59cf] Refreshing network info cache for port 9441dfc5-c933-4642-b797-494d88a10f8a {{(pid=74613) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 17:53:28 user nova-compute[74613]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6f5690a7-c3e7-4aff-a1af-e32aaceae1bb tempest-DeleteServersTestJSON-112443106 tempest-DeleteServersTestJSON-112443106-project-member] [instance: f3a5f6d2-cadd-485b-a443-1b8f3ed966b9] Calling os-brick to attach iSCSI Volume {{(pid=74613) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 29 17:53:28 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f5690a7-c3e7-4aff-a1af-e32aaceae1bb tempest-DeleteServersTestJSON-112443106 tempest-DeleteServersTestJSON-112443106-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff828156890>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:7bc0f024-5b8c-4770-8963-a2420651d328', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'oMfAYqGW', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74613) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 17:53:28 user nova-compute[74613]: WARNING os_brick.initiator.connectors.base [None req-6f5690a7-c3e7-4aff-a1af-e32aaceae1bb tempest-DeleteServersTestJSON-112443106 tempest-DeleteServersTestJSON-112443106-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 17:53:28 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.base [None req-6f5690a7-c3e7-4aff-a1af-e32aaceae1bb tempest-DeleteServersTestJSON-112443106 tempest-DeleteServersTestJSON-112443106-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 17:53:28 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.base [None req-6f5690a7-c3e7-4aff-a1af-e32aaceae1bb tempest-DeleteServersTestJSON-112443106 tempest-DeleteServersTestJSON-112443106-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 17:53:28 user nova-compute[74613]: WARNING os_brick.initiator.connectors.base [None req-6f5690a7-c3e7-4aff-a1af-e32aaceae1bb tempest-DeleteServersTestJSON-112443106 tempest-DeleteServersTestJSON-112443106-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 17:53:28 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.base [None req-6f5690a7-c3e7-4aff-a1af-e32aaceae1bb tempest-DeleteServersTestJSON-112443106 tempest-DeleteServersTestJSON-112443106-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7bc0f024-5b8c-4770-8963-a2420651d328" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 17:53:28 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.base [None req-6f5690a7-c3e7-4aff-a1af-e32aaceae1bb tempest-DeleteServersTestJSON-112443106 tempest-DeleteServersTestJSON-112443106-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7bc0f024-5b8c-4770-8963-a2420651d328" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 17:53:28 user nova-compute[74613]: INFO os_brick.initiator.connectors.iscsi [None req-6f5690a7-c3e7-4aff-a1af-e32aaceae1bb tempest-DeleteServersTestJSON-112443106 tempest-DeleteServersTestJSON-112443106-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 29 17:53:28 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7bc0f024-5b8c-4770-8963-a2420651d328 -p 172.16.0.220:3260 {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 17:53:28 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7bc0f024-5b8c-4770-8963-a2420651d328 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 17:53:28 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[c568cecd-30ca-4e4d-a703-467277383d16]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 17:53:28 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f5690a7-c3e7-4aff-a1af-e32aaceae1bb tempest-DeleteServersTestJSON-112443106 tempest-DeleteServersTestJSON-112443106-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 29 17:53:28 user nova-compute[74613]:  {{(pid=74613) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 17:53:28 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7bc0f024-5b8c-4770-8963-a2420651d328 -p 172.16.0.220:3260 --interface default --op new {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 17:53:28 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7bc0f024-5b8c-4770-8963-a2420651d328 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 17:53:28 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[20938fe3-a218-4f2b-ac25-6f273fd8b864]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:7bc0f024-5b8c-4770-8963-a2420651d328] added\n', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 17:53:28 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f5690a7-c3e7-4aff-a1af-e32aaceae1bb tempest-DeleteServersTestJSON-112443106 tempest-DeleteServersTestJSON-112443106-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:7bc0f024-5b8c-4770-8963-a2420651d328] added
Nov 29 17:53:28 user nova-compute[74613]:  stderr= {{(pid=74613) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 17:53:28 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7bc0f024-5b8c-4770-8963-a2420651d328 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 17:53:29 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7bc0f024-5b8c-4770-8963-a2420651d328 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 17:53:29 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[40d7431b-6bb7-4860-a1c1-b07e044090b8]: (4, ('', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 17:53:29 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f5690a7-c3e7-4aff-a1af-e32aaceae1bb tempest-DeleteServersTestJSON-112443106 tempest-DeleteServersTestJSON-112443106-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74613) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 17:53:29 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7bc0f024-5b8c-4770-8963-a2420651d328 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 17:53:29 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7bc0f024-5b8c-4770-8963-a2420651d328 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 17:53:29 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[aef6b0cf-a83f-425e-83f2-db62fb2f76af]: (4, ('', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 17:53:29 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f5690a7-c3e7-4aff-a1af-e32aaceae1bb tempest-DeleteServersTestJSON-112443106 tempest-DeleteServersTestJSON-112443106-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74613) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 17:53:29 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7bc0f024-5b8c-4770-8963-a2420651d328 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v oMfAYqGW {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 17:53:29 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7bc0f024-5b8c-4770-8963-a2420651d328 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v oMfAYqGW" returned: 0 in 0.026s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 17:53:29 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad269034-3367-441b-8d22-61dc92ec73e3]: (4, ('', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 17:53:29 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f5690a7-c3e7-4aff-a1af-e32aaceae1bb tempest-DeleteServersTestJSON-112443106 tempest-DeleteServersTestJSON-112443106-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'oMfAYqGW'): stdout= stderr= {{(pid=74613) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 17:53:29 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7bc0f024-5b8c-4770-8963-a2420651d328 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 17:53:29 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7bc0f024-5b8c-4770-8963-a2420651d328 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 17:53:29 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4ae1442-1bcc-4595-9c5b-521509090797]: (4, ('', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 17:53:29 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f5690a7-c3e7-4aff-a1af-e32aaceae1bb tempest-DeleteServersTestJSON-112443106 tempest-DeleteServersTestJSON-112443106-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74613) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 17:53:29 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 17:53:29 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 17:53:29 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb4933ba-e8bd-4255-bbb1-391d8915e2f7]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fbbdc3d2-136d-4fba-b6ba-f27f35a0733b (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:24920064-fc81-4408-97d1-d8eff97a7554 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8230f3a2-63d8-46cb-8ec7-ceb89fb04e53 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d1f798a1-4f7b-4b9a-8180-fa8f4eb89bf0 (non-flash)\n', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 17:53:29 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f5690a7-c3e7-4aff-a1af-e32aaceae1bb tempest-DeleteServersTestJSON-112443106 tempest-DeleteServersTestJSON-112443106-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fbbdc3d2-136d-4fba-b6ba-f27f35a0733b (non-flash)
Nov 29 17:53:29 user nova-compute[74613]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:24920064-fc81-4408-97d1-d8eff97a7554 (non-flash)
Nov 29 17:53:29 user nova-compute[74613]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8230f3a2-63d8-46cb-8ec7-ceb89fb04e53 (non-flash)
Nov 29 17:53:29 user nova-compute[74613]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d1f798a1-4f7b-4b9a-8180-fa8f4eb89bf0 (non-flash)
Nov 29 17:53:29 user nova-compute[74613]:  stderr= {{(pid=74613) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 17:53:29 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f5690a7-c3e7-4aff-a1af-e32aaceae1bb tempest-DeleteServersTestJSON-112443106 tempest-DeleteServersTestJSON-112443106-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fbbdc3d2-136d-4fba-b6ba-f27f35a0733b (non-flash)
Nov 29 17:53:29 user nova-compute[74613]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:24920064-fc81-4408-97d1-d8eff97a7554 (non-flash)
Nov 29 17:53:29 user nova-compute[74613]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8230f3a2-63d8-46cb-8ec7-ceb89fb04e53 (non-flash)
Nov 29 17:53:29 user nova-compute[74613]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d1f798a1-4f7b-4b9a-8180-fa8f4eb89bf0 (non-flash)
Nov 29 17:53:29 user nova-compute[74613]:  stderr= {{(pid=74613) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 17:53:29 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7bc0f024-5b8c-4770-8963-a2420651d328 -p 172.16.0.220:3260 --login {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 17:53:29 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7bc0f024-5b8c-4770-8963-a2420651d328 -p 172.16.0.220:3260 --login" returned: 0 in 0.068s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 17:53:29 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[316bfc48-4960-4625-aac3-b42dd5989333]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:7bc0f024-5b8c-4770-8963-a2420651d328, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:7bc0f024-5b8c-4770-8963-a2420651d328, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 17:53:29 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f5690a7-c3e7-4aff-a1af-e32aaceae1bb tempest-DeleteServersTestJSON-112443106 tempest-DeleteServersTestJSON-112443106-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:7bc0f024-5b8c-4770-8963-a2420651d328, portal: 172.16.0.220,3260]
Nov 29 17:53:29 user nova-compute[74613]: Login to [iface: default, target: iqn.2010-10.org.openstack:7bc0f024-5b8c-4770-8963-a2420651d328, portal: 172.16.0.220,3260] successful.
Nov 29 17:53:29 user nova-compute[74613]:  stderr= {{(pid=74613) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 17:53:29 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7bc0f024-5b8c-4770-8963-a2420651d328 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 17:53:29 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7bc0f024-5b8c-4770-8963-a2420651d328 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.022s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 17:53:29 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[04f3fa3c-48d2-481f-aab7-15b7a34ae847]: (4, ('', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 17:53:29 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f5690a7-c3e7-4aff-a1af-e32aaceae1bb tempest-DeleteServersTestJSON-112443106 tempest-DeleteServersTestJSON-112443106-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74613) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 17:53:29 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 17:53:29 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 17:53:29 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f38c76a-0c92-47fd-ba93-d678aa2c1d9f]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fbbdc3d2-136d-4fba-b6ba-f27f35a0733b (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:24920064-fc81-4408-97d1-d8eff97a7554 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8230f3a2-63d8-46cb-8ec7-ceb89fb04e53 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d1f798a1-4f7b-4b9a-8180-fa8f4eb89bf0 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7bc0f024-5b8c-4770-8963-a2420651d328 (non-flash)\n', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 17:53:29 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f5690a7-c3e7-4aff-a1af-e32aaceae1bb tempest-DeleteServersTestJSON-112443106 tempest-DeleteServersTestJSON-112443106-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fbbdc3d2-136d-4fba-b6ba-f27f35a0733b (non-flash)
Nov 29 17:53:29 user nova-compute[74613]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:24920064-fc81-4408-97d1-d8eff97a7554 (non-flash)
Nov 29 17:53:29 user nova-compute[74613]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8230f3a2-63d8-46cb-8ec7-ceb89fb04e53 (non-flash)
Nov 29 17:53:29 user nova-compute[74613]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d1f798a1-4f7b-4b9a-8180-fa8f4eb89bf0 (non-flash)
Nov 29 17:53:29 user nova-compute[74613]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7bc0f024-5b8c-4770-8963-a2420651d328 (non-flash)
Nov 29 17:53:29 user nova-compute[74613]:  stderr= {{(pid=74613) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 17:53:29 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f5690a7-c3e7-4aff-a1af-e32aaceae1bb tempest-DeleteServersTestJSON-112443106 tempest-DeleteServersTestJSON-112443106-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fbbdc3d2-136d-4fba-b6ba-f27f35a0733b (non-flash)
Nov 29 17:53:29 user nova-compute[74613]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:24920064-fc81-4408-97d1-d8eff97a7554 (non-flash)
Nov 29 17:53:29 user nova-compute[74613]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8230f3a2-63d8-46cb-8ec7-ceb89fb04e53 (non-flash)
Nov 29 17:53:29 user nova-compute[74613]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d1f798a1-4f7b-4b9a-8180-fa8f4eb89bf0 (non-flash)
Nov 29 17:53:29 user nova-compute[74613]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7bc0f024-5b8c-4770-8963-a2420651d328 (non-flash)
Nov 29 17:53:29 user nova-compute[74613]:  stderr= {{(pid=74613) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 17:53:29 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.base [None req-6f5690a7-c3e7-4aff-a1af-e32aaceae1bb tempest-DeleteServersTestJSON-112443106 tempest-DeleteServersTestJSON-112443106-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7bc0f024-5b8c-4770-8963-a2420651d328" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.309s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 17:53:29 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f5690a7-c3e7-4aff-a1af-e32aaceae1bb tempest-DeleteServersTestJSON-112443106 tempest-DeleteServersTestJSON-112443106-project-member] Connected to 172.16.0.220:3260 {{(pid=74613) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 29 17:53:29 user nova-compute[74613]: DEBUG os_brick.initiator.linuxscsi [None req-6f5690a7-c3e7-4aff-a1af-e32aaceae1bb tempest-DeleteServersTestJSON-112443106 tempest-DeleteServersTestJSON-112443106-project-member] HCTL ('37', '-', '-', 0) found on session 6 with lun 0 {{(pid=74613) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 29 17:53:29 user nova-compute[74613]: DEBUG os_brick.initiator.linuxscsi [None req-6f5690a7-c3e7-4aff-a1af-e32aaceae1bb tempest-DeleteServersTestJSON-112443106 tempest-DeleteServersTestJSON-112443106-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=74613) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 29 17:53:29 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 17:53:29 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.017s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 17:53:29 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[999c1498-4214-49b0-beca-320345969ab5]: (4, ('- - 0', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 17:53:29 user nova-compute[74613]: DEBUG os_brick.initiator.linuxscsi [None req-6f5690a7-c3e7-4aff-a1af-e32aaceae1bb tempest-DeleteServersTestJSON-112443106 tempest-DeleteServersTestJSON-112443106-project-member] Searching for a device in session 6 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=74613) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 29 17:53:29 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f5690a7-c3e7-4aff-a1af-e32aaceae1bb tempest-DeleteServersTestJSON-112443106 tempest-DeleteServersTestJSON-112443106-project-member] Connected to sdf using {'target_iqn': 'iqn.2010-10.org.openstack:7bc0f024-5b8c-4770-8963-a2420651d328', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'oMfAYqGW', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74613) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 29 17:53:29 user nova-compute[74613]: DEBUG nova.network.neutron [req-6b09daf8-cfbd-4e4e-a818-baf61dc84843 req-82d758aa-e8b3-4925-b50c-f63f6a16b734 service nova] [instance: 01c65b16-5dbe-4ad5-a72e-9500a4fa59cf] Updated VIF entry in instance network info cache for port 9441dfc5-c933-4642-b797-494d88a10f8a. {{(pid=74613) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 17:53:29 user nova-compute[74613]: DEBUG nova.network.neutron [req-6b09daf8-cfbd-4e4e-a818-baf61dc84843 req-82d758aa-e8b3-4925-b50c-f63f6a16b734 service nova] [instance: 01c65b16-5dbe-4ad5-a72e-9500a4fa59cf] Updating instance_info_cache with network_info: [{"id": "9441dfc5-c933-4642-b797-494d88a10f8a", "address": "fa:16:3e:c7:6c:2d", "network": {"id": "1db277f8-4456-4ba3-8eef-276639086245", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1225625601-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.249", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ab6d78b5cdf64466914b67f7405aa79f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9441dfc5-c9", "ovs_interfaceid": "9441dfc5-c933-4642-b797-494d88a10f8a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74613) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 17:53:29 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-6b09daf8-cfbd-4e4e-a818-baf61dc84843 req-82d758aa-e8b3-4925-b50c-f63f6a16b734 service nova] Releasing lock "refresh_cache-01c65b16-5dbe-4ad5-a72e-9500a4fa59cf" {{(pid=74613) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 17:53:30 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:53:30 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.base [None req-6f5690a7-c3e7-4aff-a1af-e32aaceae1bb tempest-DeleteServersTestJSON-112443106 tempest-DeleteServersTestJSON-112443106-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.345s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 17:53:30 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f5690a7-c3e7-4aff-a1af-e32aaceae1bb tempest-DeleteServersTestJSON-112443106 tempest-DeleteServersTestJSON-112443106-project-member] <== connect_volume: return (1347ms) {'type': 'block', 'scsi_wwn': '23734313836383939', 'path': '/dev/sdf'} {{(pid=74613) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 17:53:30 user nova-compute[74613]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6f5690a7-c3e7-4aff-a1af-e32aaceae1bb tempest-DeleteServersTestJSON-112443106 tempest-DeleteServersTestJSON-112443106-project-member] [instance: f3a5f6d2-cadd-485b-a443-1b8f3ed966b9] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23734313836383939', 'path': '/dev/sdf'} {{(pid=74613) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 29 17:53:30 user nova-compute[74613]: DEBUG nova.objects.instance [None req-6f5690a7-c3e7-4aff-a1af-e32aaceae1bb tempest-DeleteServersTestJSON-112443106 tempest-DeleteServersTestJSON-112443106-project-member] Lazy-loading 'flavor' on Instance uuid f3a5f6d2-cadd-485b-a443-1b8f3ed966b9 {{(pid=74613) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 17:53:30 user nova-compute[74613]: DEBUG nova.virt.libvirt.guest [None req-6f5690a7-c3e7-4aff-a1af-e32aaceae1bb tempest-DeleteServersTestJSON-112443106 tempest-DeleteServersTestJSON-112443106-project-member] attach device xml: <disk type="block" device="disk">
Nov 29 17:53:30 user nova-compute[74613]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 17:53:30 user nova-compute[74613]:   <source dev="/dev/sdf"/>
Nov 29 17:53:30 user nova-compute[74613]:   <target dev="vdb" bus="virtio"/>
Nov 29 17:53:30 user nova-compute[74613]:   <serial>7bc0f024-5b8c-4770-8963-a2420651d328</serial>
Nov 29 17:53:30 user nova-compute[74613]: </disk>
Nov 29 17:53:30 user nova-compute[74613]:  {{(pid=74613) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 29 17:53:30 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-6f5690a7-c3e7-4aff-a1af-e32aaceae1bb tempest-DeleteServersTestJSON-112443106 tempest-DeleteServersTestJSON-112443106-project-member] No BDM found with device name vda, not building metadata. {{(pid=74613) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 17:53:30 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-6f5690a7-c3e7-4aff-a1af-e32aaceae1bb tempest-DeleteServersTestJSON-112443106 tempest-DeleteServersTestJSON-112443106-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74613) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 17:53:30 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-6f5690a7-c3e7-4aff-a1af-e32aaceae1bb tempest-DeleteServersTestJSON-112443106 tempest-DeleteServersTestJSON-112443106-project-member] No VIF found with MAC fa:16:3e:0c:43:fa, not building metadata {{(pid=74613) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 29 17:53:30 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-6f5690a7-c3e7-4aff-a1af-e32aaceae1bb tempest-DeleteServersTestJSON-112443106 tempest-DeleteServersTestJSON-112443106-project-member] Lock "f3a5f6d2-cadd-485b-a443-1b8f3ed966b9" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 10.522s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 17:53:31 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-5e8215f2-b8b0-4dd5-9fbb-b37d15470088 tempest-DeleteServersTestJSON-112443106 tempest-DeleteServersTestJSON-112443106-project-member] Acquiring lock "f3a5f6d2-cadd-485b-a443-1b8f3ed966b9" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 17:53:31 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-5e8215f2-b8b0-4dd5-9fbb-b37d15470088 tempest-DeleteServersTestJSON-112443106 tempest-DeleteServersTestJSON-112443106-project-member] Lock "f3a5f6d2-cadd-485b-a443-1b8f3ed966b9" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 17:53:31 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-5e8215f2-b8b0-4dd5-9fbb-b37d15470088 tempest-DeleteServersTestJSON-112443106 tempest-DeleteServersTestJSON-112443106-project-member] Acquiring lock "f3a5f6d2-cadd-485b-a443-1b8f3ed966b9-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 17:53:31 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-5e8215f2-b8b0-4dd5-9fbb-b37d15470088 tempest-DeleteServersTestJSON-112443106 tempest-DeleteServersTestJSON-112443106-project-member] Lock "f3a5f6d2-cadd-485b-a443-1b8f3ed966b9-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.004s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 17:53:31 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-5e8215f2-b8b0-4dd5-9fbb-b37d15470088 tempest-DeleteServersTestJSON-112443106 tempest-DeleteServersTestJSON-112443106-project-member] Lock "f3a5f6d2-cadd-485b-a443-1b8f3ed966b9-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 17:53:31 user nova-compute[74613]: INFO nova.compute.manager [None req-5e8215f2-b8b0-4dd5-9fbb-b37d15470088 tempest-DeleteServersTestJSON-112443106 tempest-DeleteServersTestJSON-112443106-project-member] [instance: f3a5f6d2-cadd-485b-a443-1b8f3ed966b9] Terminating instance
Nov 29 17:53:31 user nova-compute[74613]: DEBUG nova.compute.manager [None req-5e8215f2-b8b0-4dd5-9fbb-b37d15470088 tempest-DeleteServersTestJSON-112443106 tempest-DeleteServersTestJSON-112443106-project-member] [instance: f3a5f6d2-cadd-485b-a443-1b8f3ed966b9] Start destroying the instance on the hypervisor. {{(pid=74613) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 29 17:53:31 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:53:31 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:53:31 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:53:31 user nova-compute[74613]: DEBUG nova.compute.manager [req-94f11c38-c29b-44f7-98e2-3b92e7d2a2db req-edd7c584-93a9-4ae5-bc6e-dd4d6bb0ff30 service nova] [instance: f3a5f6d2-cadd-485b-a443-1b8f3ed966b9] Received event network-vif-unplugged-49e80b78-004f-457d-aea8-8940ab6d9179 {{(pid=74613) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 17:53:31 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-94f11c38-c29b-44f7-98e2-3b92e7d2a2db req-edd7c584-93a9-4ae5-bc6e-dd4d6bb0ff30 service nova] Acquiring lock "f3a5f6d2-cadd-485b-a443-1b8f3ed966b9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 17:53:31 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-94f11c38-c29b-44f7-98e2-3b92e7d2a2db req-edd7c584-93a9-4ae5-bc6e-dd4d6bb0ff30 service nova] Lock "f3a5f6d2-cadd-485b-a443-1b8f3ed966b9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 17:53:31 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-94f11c38-c29b-44f7-98e2-3b92e7d2a2db req-edd7c584-93a9-4ae5-bc6e-dd4d6bb0ff30 service nova] Lock "f3a5f6d2-cadd-485b-a443-1b8f3ed966b9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 17:53:31 user nova-compute[74613]: DEBUG nova.compute.manager [req-94f11c38-c29b-44f7-98e2-3b92e7d2a2db req-edd7c584-93a9-4ae5-bc6e-dd4d6bb0ff30 service nova] [instance: f3a5f6d2-cadd-485b-a443-1b8f3ed966b9] No waiting events found dispatching network-vif-unplugged-49e80b78-004f-457d-aea8-8940ab6d9179 {{(pid=74613) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 17:53:31 user nova-compute[74613]: DEBUG nova.compute.manager [req-94f11c38-c29b-44f7-98e2-3b92e7d2a2db req-edd7c584-93a9-4ae5-bc6e-dd4d6bb0ff30 service nova] [instance: f3a5f6d2-cadd-485b-a443-1b8f3ed966b9] Received event network-vif-unplugged-49e80b78-004f-457d-aea8-8940ab6d9179 for instance with task_state deleting. {{(pid=74613) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 29 17:53:31 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:53:31 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-f2b1c362-b536-4064-934c-601e384dc01f tempest-AttachSCSIVolumeTestJSON-1343397388 tempest-AttachSCSIVolumeTestJSON-1343397388-project-member] Acquiring lock "01c65b16-5dbe-4ad5-a72e-9500a4fa59cf" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 17:53:31 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-f2b1c362-b536-4064-934c-601e384dc01f tempest-AttachSCSIVolumeTestJSON-1343397388 tempest-AttachSCSIVolumeTestJSON-1343397388-project-member] Lock "01c65b16-5dbe-4ad5-a72e-9500a4fa59cf" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.000s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 17:53:31 user nova-compute[74613]: DEBUG nova.objects.instance [None req-f2b1c362-b536-4064-934c-601e384dc01f tempest-AttachSCSIVolumeTestJSON-1343397388 tempest-AttachSCSIVolumeTestJSON-1343397388-project-member] Lazy-loading 'flavor' on Instance uuid 01c65b16-5dbe-4ad5-a72e-9500a4fa59cf {{(pid=74613) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 17:53:31 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-f2b1c362-b536-4064-934c-601e384dc01f tempest-AttachSCSIVolumeTestJSON-1343397388 tempest-AttachSCSIVolumeTestJSON-1343397388-project-member] Lock "01c65b16-5dbe-4ad5-a72e-9500a4fa59cf" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.059s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 17:53:31 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-f2b1c362-b536-4064-934c-601e384dc01f tempest-AttachSCSIVolumeTestJSON-1343397388 tempest-AttachSCSIVolumeTestJSON-1343397388-project-member] Acquiring lock "01c65b16-5dbe-4ad5-a72e-9500a4fa59cf" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 17:53:31 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-f2b1c362-b536-4064-934c-601e384dc01f tempest-AttachSCSIVolumeTestJSON-1343397388 tempest-AttachSCSIVolumeTestJSON-1343397388-project-member] Lock "01c65b16-5dbe-4ad5-a72e-9500a4fa59cf" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 17:53:31 user nova-compute[74613]: INFO nova.compute.manager [None req-f2b1c362-b536-4064-934c-601e384dc01f tempest-AttachSCSIVolumeTestJSON-1343397388 tempest-AttachSCSIVolumeTestJSON-1343397388-project-member] [instance: 01c65b16-5dbe-4ad5-a72e-9500a4fa59cf] Attaching volume 850c1226-267c-42c0-945f-bfc219c8e88b to /dev/sdc
Nov 29 17:53:31 user nova-compute[74613]: DEBUG os_brick.utils [None req-f2b1c362-b536-4064-934c-601e384dc01f tempest-AttachSCSIVolumeTestJSON-1343397388 tempest-AttachSCSIVolumeTestJSON-1343397388-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74613) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 17:53:31 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 17:53:31 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.012s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 17:53:31 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[4944f74b-ac21-4f1b-b2df-8bfa5e937b2d]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:400972819b5\n', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 17:53:31 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 17:53:31 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 17:53:31 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a0c9817-640a-4999-83f0-890c378acaa5]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 17:53:31 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 17:53:31 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.014s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 17:53:31 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3768849-b887-4b4e-a67b-20353ff53ff4]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 17:53:31 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5f63ffc-af07-417d-9b29-14f324ae08b9]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 17:53:31 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-f2b1c362-b536-4064-934c-601e384dc01f tempest-AttachSCSIVolumeTestJSON-1343397388 tempest-AttachSCSIVolumeTestJSON-1343397388-project-member] Running cmd (subprocess): nvme version {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 17:53:31 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-f2b1c362-b536-4064-934c-601e384dc01f tempest-AttachSCSIVolumeTestJSON-1343397388 tempest-AttachSCSIVolumeTestJSON-1343397388-project-member] 'nvme version' failed. Not Retrying. {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 17:53:31 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.nvmeof [None req-f2b1c362-b536-4064-934c-601e384dc01f tempest-AttachSCSIVolumeTestJSON-1343397388 tempest-AttachSCSIVolumeTestJSON-1343397388-project-member] nvme not present on system {{(pid=74613) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 29 17:53:32 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 17:53:32 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 17:53:32 user nova-compute[74613]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 29 17:53:32 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b1473f0-0b2e-489b-a74b-23e46018f673]: (4, '') {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 17:53:32 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.lightos [None req-f2b1c362-b536-4064-934c-601e384dc01f tempest-AttachSCSIVolumeTestJSON-1343397388 tempest-AttachSCSIVolumeTestJSON-1343397388-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74613) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 29 17:53:32 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.lightos [None req-f2b1c362-b536-4064-934c-601e384dc01f tempest-AttachSCSIVolumeTestJSON-1343397388 tempest-AttachSCSIVolumeTestJSON-1343397388-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74613) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 29 17:53:32 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.lightos [None req-f2b1c362-b536-4064-934c-601e384dc01f tempest-AttachSCSIVolumeTestJSON-1343397388 tempest-AttachSCSIVolumeTestJSON-1343397388-project-member] LIGHTOS: no hostnqn found. {{(pid=74613) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 29 17:53:32 user nova-compute[74613]: DEBUG os_brick.utils [None req-f2b1c362-b536-4064-934c-601e384dc01f tempest-AttachSCSIVolumeTestJSON-1343397388 tempest-AttachSCSIVolumeTestJSON-1343397388-project-member] <== get_connector_properties: return (110ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:400972819b5', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74613) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 17:53:32 user nova-compute[74613]: DEBUG nova.virt.block_device [None req-f2b1c362-b536-4064-934c-601e384dc01f tempest-AttachSCSIVolumeTestJSON-1343397388 tempest-AttachSCSIVolumeTestJSON-1343397388-project-member] [instance: 01c65b16-5dbe-4ad5-a72e-9500a4fa59cf] Updating existing volume attachment record: 297b6ad3-ebbf-404d-80ae-e961908d40b5 {{(pid=74613) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 29 17:53:32 user nova-compute[74613]: INFO nova.virt.libvirt.driver [-] [instance: f3a5f6d2-cadd-485b-a443-1b8f3ed966b9] Instance destroyed successfully.
Nov 29 17:53:32 user nova-compute[74613]: DEBUG nova.objects.instance [None req-5e8215f2-b8b0-4dd5-9fbb-b37d15470088 tempest-DeleteServersTestJSON-112443106 tempest-DeleteServersTestJSON-112443106-project-member] Lazy-loading 'resources' on Instance uuid f3a5f6d2-cadd-485b-a443-1b8f3ed966b9 {{(pid=74613) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 17:53:32 user nova-compute[74613]: DEBUG nova.virt.libvirt.vif [None req-5e8215f2-b8b0-4dd5-9fbb-b37d15470088 tempest-DeleteServersTestJSON-112443106 tempest-DeleteServersTestJSON-112443106-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T17:51:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-DeleteServersTestJSON-server-9988961',display_name='tempest-DeleteServersTestJSON-server-9988961',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-deleteserverstestjson-server-9988961',id=4,image_ref='4217f428-8d9d-4ee1-9614-642d26d90c46',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-29T17:51:44Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='31ff57da724840588bee7c012be00891',ramdisk_id='',reservation_id='r-0z836g30',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='4217f428-8d9d-4ee1-9614-642d26d90c46',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-DeleteServersTestJSON-112443106',owner_user_name='tempest-DeleteServersTestJSON-112443106-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-29T17:51:44Z,user_data=None,user_id='9e4a26c0f9d8426cb7ccb5109ef59e43',uuid=f3a5f6d2-cadd-485b-a443-1b8f3ed966b9,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "49e80b78-004f-457d-aea8-8940ab6d9179", "address": "fa:16:3e:0c:43:fa", "network": {"id": "5a261b7c-1d1a-4bab-917f-f0685fe6b13d", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1710073957-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "31ff57da724840588bee7c012be00891", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap49e80b78-00", "ovs_interfaceid": "49e80b78-004f-457d-aea8-8940ab6d9179", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74613) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 29 17:53:32 user nova-compute[74613]: DEBUG nova.network.os_vif_util [None req-5e8215f2-b8b0-4dd5-9fbb-b37d15470088 tempest-DeleteServersTestJSON-112443106 tempest-DeleteServersTestJSON-112443106-project-member] Converting VIF {"id": "49e80b78-004f-457d-aea8-8940ab6d9179", "address": "fa:16:3e:0c:43:fa", "network": {"id": "5a261b7c-1d1a-4bab-917f-f0685fe6b13d", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1710073957-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "31ff57da724840588bee7c012be00891", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap49e80b78-00", "ovs_interfaceid": "49e80b78-004f-457d-aea8-8940ab6d9179", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74613) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 17:53:32 user nova-compute[74613]: DEBUG nova.network.os_vif_util [None req-5e8215f2-b8b0-4dd5-9fbb-b37d15470088 tempest-DeleteServersTestJSON-112443106 tempest-DeleteServersTestJSON-112443106-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0c:43:fa,bridge_name='br-int',has_traffic_filtering=True,id=49e80b78-004f-457d-aea8-8940ab6d9179,network=Network(5a261b7c-1d1a-4bab-917f-f0685fe6b13d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap49e80b78-00') {{(pid=74613) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 17:53:32 user nova-compute[74613]: DEBUG os_vif [None req-5e8215f2-b8b0-4dd5-9fbb-b37d15470088 tempest-DeleteServersTestJSON-112443106 tempest-DeleteServersTestJSON-112443106-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:0c:43:fa,bridge_name='br-int',has_traffic_filtering=True,id=49e80b78-004f-457d-aea8-8940ab6d9179,network=Network(5a261b7c-1d1a-4bab-917f-f0685fe6b13d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap49e80b78-00') {{(pid=74613) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 29 17:53:32 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:53:32 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap49e80b78-00, bridge=br-int, if_exists=True) {{(pid=74613) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 17:53:32 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:53:32 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 17:53:32 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:53:32 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=6fcd5dd4-a0b4-49aa-9286-0d926ff137bc) {{(pid=74613) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 17:53:32 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:53:32 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:53:32 user nova-compute[74613]: INFO os_vif [None req-5e8215f2-b8b0-4dd5-9fbb-b37d15470088 tempest-DeleteServersTestJSON-112443106 tempest-DeleteServersTestJSON-112443106-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:0c:43:fa,bridge_name='br-int',has_traffic_filtering=True,id=49e80b78-004f-457d-aea8-8940ab6d9179,network=Network(5a261b7c-1d1a-4bab-917f-f0685fe6b13d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap49e80b78-00')
Nov 29 17:53:32 user nova-compute[74613]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5e8215f2-b8b0-4dd5-9fbb-b37d15470088 tempest-DeleteServersTestJSON-112443106 tempest-DeleteServersTestJSON-112443106-project-member] [instance: f3a5f6d2-cadd-485b-a443-1b8f3ed966b9] calling os-brick to detach iSCSI Volume {{(pid=74613) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 29 17:53:32 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e8215f2-b8b0-4dd5-9fbb-b37d15470088 tempest-DeleteServersTestJSON-112443106 tempest-DeleteServersTestJSON-112443106-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff828156890>, {'target_iqn': 'iqn.2010-10.org.openstack:7bc0f024-5b8c-4770-8963-a2420651d328', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'oMfAYqGW', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, None), 'kwargs': True}}" {{(pid=74613) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 17:53:32 user nova-compute[74613]: WARNING os_brick.initiator.connectors.base [None req-5e8215f2-b8b0-4dd5-9fbb-b37d15470088 tempest-DeleteServersTestJSON-112443106 tempest-DeleteServersTestJSON-112443106-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 17:53:32 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.base [None req-5e8215f2-b8b0-4dd5-9fbb-b37d15470088 tempest-DeleteServersTestJSON-112443106 tempest-DeleteServersTestJSON-112443106-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 17:53:32 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.base [None req-5e8215f2-b8b0-4dd5-9fbb-b37d15470088 tempest-DeleteServersTestJSON-112443106 tempest-DeleteServersTestJSON-112443106-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 17:53:32 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 17:53:32 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 17:53:32 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[4179c9dd-856f-4003-93cc-8d784f62887d]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:24920064-fc81-4408-97d1-d8eff97a7554\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:7bc0f024-5b8c-4770-8963-a2420651d328\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:8230f3a2-63d8-46cb-8ec7-ceb89fb04e53\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:fbbdc3d2-136d-4fba-b6ba-f27f35a0733b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d1f798a1-4f7b-4b9a-8180-fa8f4eb89bf0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 17:53:32 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e8215f2-b8b0-4dd5-9fbb-b37d15470088 tempest-DeleteServersTestJSON-112443106 tempest-DeleteServersTestJSON-112443106-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 29 17:53:32 user nova-compute[74613]: No targets found.
Nov 29 17:53:32 user nova-compute[74613]: iSNS:
Nov 29 17:53:32 user nova-compute[74613]: No targets found.
Nov 29 17:53:32 user nova-compute[74613]: STATIC:
Nov 29 17:53:32 user nova-compute[74613]: Target: iqn.2010-10.org.openstack:24920064-fc81-4408-97d1-d8eff97a7554
Nov 29 17:53:32 user nova-compute[74613]:         Portal: 172.16.0.220:3260,-1
Nov 29 17:53:32 user nova-compute[74613]:                 Iface Name: default
Nov 29 17:53:32 user nova-compute[74613]: Target: iqn.2010-10.org.openstack:7bc0f024-5b8c-4770-8963-a2420651d328
Nov 29 17:53:32 user nova-compute[74613]:         Portal: 172.16.0.220:3260,-1
Nov 29 17:53:32 user nova-compute[74613]:                 Iface Name: default
Nov 29 17:53:32 user nova-compute[74613]: Target: iqn.2010-10.org.openstack:8230f3a2-63d8-46cb-8ec7-ceb89fb04e53
Nov 29 17:53:32 user nova-compute[74613]:         Portal: 172.16.0.220:3260,-1
Nov 29 17:53:32 user nova-compute[74613]:                 Iface Name: default
Nov 29 17:53:32 user nova-compute[74613]: Target: iqn.2010-10.org.openstack:fbbdc3d2-136d-4fba-b6ba-f27f35a0733b
Nov 29 17:53:32 user nova-compute[74613]:         Portal: 172.16.0.220:3260,-1
Nov 29 17:53:32 user nova-compute[74613]:                 Iface Name: default
Nov 29 17:53:32 user nova-compute[74613]: Target: iqn.2010-10.org.openstack:d1f798a1-4f7b-4b9a-8180-fa8f4eb89bf0
Nov 29 17:53:32 user nova-compute[74613]:         Portal: 172.16.0.220:3260,-1
Nov 29 17:53:32 user nova-compute[74613]:                 Iface Name: default
Nov 29 17:53:32 user nova-compute[74613]: FIRMWARE:
Nov 29 17:53:32 user nova-compute[74613]: No targets found.
Nov 29 17:53:32 user nova-compute[74613]:  stderr= {{(pid=74613) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 17:53:32 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e8215f2-b8b0-4dd5-9fbb-b37d15470088 tempest-DeleteServersTestJSON-112443106 tempest-DeleteServersTestJSON-112443106-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 29 17:53:32 user nova-compute[74613]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 29 17:53:32 user nova-compute[74613]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74613) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 29 17:53:32 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e8215f2-b8b0-4dd5-9fbb-b37d15470088 tempest-DeleteServersTestJSON-112443106 tempest-DeleteServersTestJSON-112443106-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7bc0f024-5b8c-4770-8963-a2420651d328', 0)] {{(pid=74613) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 29 17:53:32 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 17:53:32 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 17:53:32 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[d182a57a-5815-4cda-ba6c-7b99d28a7e95]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:24920064-fc81-4408-97d1-d8eff97a7554\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7bc0f024-5b8c-4770-8963-a2420651d328\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8230f3a2-63d8-46cb-8ec7-ceb89fb04e53\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d1f798a1-4f7b-4b9a-8180-fa8f4eb89bf0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fbbdc3d2-136d-4fba-b6ba-f27f35a0733b\n', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 17:53:32 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 17:53:32 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 17:53:32 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[38753d50-19a9-4812-9b4e-7bd68ebe0410]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fbbdc3d2-136d-4fba-b6ba-f27f35a0733b (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:24920064-fc81-4408-97d1-d8eff97a7554 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8230f3a2-63d8-46cb-8ec7-ceb89fb04e53 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d1f798a1-4f7b-4b9a-8180-fa8f4eb89bf0 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7bc0f024-5b8c-4770-8963-a2420651d328 (non-flash)\n', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 17:53:32 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e8215f2-b8b0-4dd5-9fbb-b37d15470088 tempest-DeleteServersTestJSON-112443106 tempest-DeleteServersTestJSON-112443106-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fbbdc3d2-136d-4fba-b6ba-f27f35a0733b (non-flash)
Nov 29 17:53:32 user nova-compute[74613]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:24920064-fc81-4408-97d1-d8eff97a7554 (non-flash)
Nov 29 17:53:32 user nova-compute[74613]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8230f3a2-63d8-46cb-8ec7-ceb89fb04e53 (non-flash)
Nov 29 17:53:32 user nova-compute[74613]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d1f798a1-4f7b-4b9a-8180-fa8f4eb89bf0 (non-flash)
Nov 29 17:53:32 user nova-compute[74613]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7bc0f024-5b8c-4770-8963-a2420651d328 (non-flash)
Nov 29 17:53:32 user nova-compute[74613]:  stderr= {{(pid=74613) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 17:53:32 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e8215f2-b8b0-4dd5-9fbb-b37d15470088 tempest-DeleteServersTestJSON-112443106 tempest-DeleteServersTestJSON-112443106-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fbbdc3d2-136d-4fba-b6ba-f27f35a0733b (non-flash)
Nov 29 17:53:32 user nova-compute[74613]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:24920064-fc81-4408-97d1-d8eff97a7554 (non-flash)
Nov 29 17:53:32 user nova-compute[74613]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8230f3a2-63d8-46cb-8ec7-ceb89fb04e53 (non-flash)
Nov 29 17:53:32 user nova-compute[74613]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d1f798a1-4f7b-4b9a-8180-fa8f4eb89bf0 (non-flash)
Nov 29 17:53:32 user nova-compute[74613]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7bc0f024-5b8c-4770-8963-a2420651d328 (non-flash)
Nov 29 17:53:32 user nova-compute[74613]:  stderr= {{(pid=74613) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 17:53:32 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e8215f2-b8b0-4dd5-9fbb-b37d15470088 tempest-DeleteServersTestJSON-112443106 tempest-DeleteServersTestJSON-112443106-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7ff818520c10>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7bc0f024-5b8c-4770-8963-a2420651d328'): ({'sdf'}, set())}) {{(pid=74613) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 29 17:53:32 user nova-compute[74613]: DEBUG os_brick.initiator.linuxscsi [None req-5e8215f2-b8b0-4dd5-9fbb-b37d15470088 tempest-DeleteServersTestJSON-112443106 tempest-DeleteServersTestJSON-112443106-project-member] Removing single pathed devices sdf {{(pid=74613) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 29 17:53:32 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 17:53:32 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.017s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 17:53:32 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[70840049-339a-4480-88b1-199114bafdf5]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 17:53:32 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 17:53:32 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.017s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 17:53:32 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0ab2220-2b14-4ff1-855a-b4abf6b393b6]: (4, ('ok\n', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 17:53:32 user nova-compute[74613]: DEBUG os_brick.initiator.linuxscsi [None req-5e8215f2-b8b0-4dd5-9fbb-b37d15470088 tempest-DeleteServersTestJSON-112443106 tempest-DeleteServersTestJSON-112443106-project-member] Flushing IO for device /dev/sdf {{(pid=74613) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 29 17:53:32 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 17:53:32 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.011s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 17:53:32 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea88823e-ba68-49eb-b8b6-766cd0fda558]: (4, ('', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 17:53:32 user nova-compute[74613]: DEBUG os_brick.initiator.linuxscsi [None req-5e8215f2-b8b0-4dd5-9fbb-b37d15470088 tempest-DeleteServersTestJSON-112443106 tempest-DeleteServersTestJSON-112443106-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=74613) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 29 17:53:32 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 17:53:32 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.052s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 17:53:32 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c2c7180-dc83-41e2-adad-d745d9c9a7b0]: (4, ('1', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 17:53:32 user nova-compute[74613]: DEBUG os_brick.initiator.linuxscsi [None req-5e8215f2-b8b0-4dd5-9fbb-b37d15470088 tempest-DeleteServersTestJSON-112443106 tempest-DeleteServersTestJSON-112443106-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=74613) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 29 17:53:32 user nova-compute[74613]: DEBUG os_brick.initiator.linuxscsi [None req-5e8215f2-b8b0-4dd5-9fbb-b37d15470088 tempest-DeleteServersTestJSON-112443106 tempest-DeleteServersTestJSON-112443106-project-member] SCSI volumes sdf have been removed. {{(pid=74613) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 29 17:53:32 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e8215f2-b8b0-4dd5-9fbb-b37d15470088 tempest-DeleteServersTestJSON-112443106 tempest-DeleteServersTestJSON-112443106-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7bc0f024-5b8c-4770-8963-a2420651d328')] {{(pid=74613) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 29 17:53:32 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7bc0f024-5b8c-4770-8963-a2420651d328 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 17:53:32 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7bc0f024-5b8c-4770-8963-a2420651d328 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 17:53:32 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[17897c9c-1bf8-47ad-8c83-92afedc2e513]: (4, ('', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 17:53:32 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e8215f2-b8b0-4dd5-9fbb-b37d15470088 tempest-DeleteServersTestJSON-112443106 tempest-DeleteServersTestJSON-112443106-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74613) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 17:53:32 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7bc0f024-5b8c-4770-8963-a2420651d328 -p 172.16.0.220:3260 --logout {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 17:53:32 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7bc0f024-5b8c-4770-8963-a2420651d328 -p 172.16.0.220:3260 --logout" returned: 0 in 0.054s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 17:53:32 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e7c28ad-11d0-4bc7-8248-697df7d995df]: (4, ('Logging out of session [sid: 6, target: iqn.2010-10.org.openstack:7bc0f024-5b8c-4770-8963-a2420651d328, portal: 172.16.0.220,3260]\nLogout of [sid: 6, target: iqn.2010-10.org.openstack:7bc0f024-5b8c-4770-8963-a2420651d328, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 17:53:32 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e8215f2-b8b0-4dd5-9fbb-b37d15470088 tempest-DeleteServersTestJSON-112443106 tempest-DeleteServersTestJSON-112443106-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 6, target: iqn.2010-10.org.openstack:7bc0f024-5b8c-4770-8963-a2420651d328, portal: 172.16.0.220,3260]
Nov 29 17:53:32 user nova-compute[74613]: Logout of [sid: 6, target: iqn.2010-10.org.openstack:7bc0f024-5b8c-4770-8963-a2420651d328, portal: 172.16.0.220,3260] successful.
Nov 29 17:53:32 user nova-compute[74613]:  stderr= {{(pid=74613) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 17:53:32 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7bc0f024-5b8c-4770-8963-a2420651d328 -p 172.16.0.220:3260 --op delete {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 17:53:32 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7bc0f024-5b8c-4770-8963-a2420651d328 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.028s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 17:53:32 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[72e58445-cbdd-497d-b9d6-127b8789bcc7]: (4, ('', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 17:53:32 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e8215f2-b8b0-4dd5-9fbb-b37d15470088 tempest-DeleteServersTestJSON-112443106 tempest-DeleteServersTestJSON-112443106-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74613) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 17:53:32 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.base [None req-5e8215f2-b8b0-4dd5-9fbb-b37d15470088 tempest-DeleteServersTestJSON-112443106 tempest-DeleteServersTestJSON-112443106-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.306s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 17:53:32 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e8215f2-b8b0-4dd5-9fbb-b37d15470088 tempest-DeleteServersTestJSON-112443106 tempest-DeleteServersTestJSON-112443106-project-member] <== disconnect_volume: return (307ms) None {{(pid=74613) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 17:53:32 user nova-compute[74613]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5e8215f2-b8b0-4dd5-9fbb-b37d15470088 tempest-DeleteServersTestJSON-112443106 tempest-DeleteServersTestJSON-112443106-project-member] [instance: f3a5f6d2-cadd-485b-a443-1b8f3ed966b9] Disconnected iSCSI Volume {{(pid=74613) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 29 17:53:32 user nova-compute[74613]: INFO nova.virt.libvirt.driver [None req-5e8215f2-b8b0-4dd5-9fbb-b37d15470088 tempest-DeleteServersTestJSON-112443106 tempest-DeleteServersTestJSON-112443106-project-member] [instance: f3a5f6d2-cadd-485b-a443-1b8f3ed966b9] Deleting instance files /opt/stack/data/nova/instances/f3a5f6d2-cadd-485b-a443-1b8f3ed966b9_del
Nov 29 17:53:32 user nova-compute[74613]: INFO nova.virt.libvirt.driver [None req-5e8215f2-b8b0-4dd5-9fbb-b37d15470088 tempest-DeleteServersTestJSON-112443106 tempest-DeleteServersTestJSON-112443106-project-member] [instance: f3a5f6d2-cadd-485b-a443-1b8f3ed966b9] Deletion of /opt/stack/data/nova/instances/f3a5f6d2-cadd-485b-a443-1b8f3ed966b9_del complete
Nov 29 17:53:32 user nova-compute[74613]: INFO nova.compute.manager [None req-5e8215f2-b8b0-4dd5-9fbb-b37d15470088 tempest-DeleteServersTestJSON-112443106 tempest-DeleteServersTestJSON-112443106-project-member] [instance: f3a5f6d2-cadd-485b-a443-1b8f3ed966b9] Took 1.21 seconds to destroy the instance on the hypervisor.
Nov 29 17:53:32 user nova-compute[74613]: DEBUG oslo.service.loopingcall [None req-5e8215f2-b8b0-4dd5-9fbb-b37d15470088 tempest-DeleteServersTestJSON-112443106 tempest-DeleteServersTestJSON-112443106-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74613) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 29 17:53:32 user nova-compute[74613]: DEBUG nova.compute.manager [-] [instance: f3a5f6d2-cadd-485b-a443-1b8f3ed966b9] Deallocating network for instance {{(pid=74613) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 29 17:53:32 user nova-compute[74613]: DEBUG nova.network.neutron [-] [instance: f3a5f6d2-cadd-485b-a443-1b8f3ed966b9] deallocate_for_instance() {{(pid=74613) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 29 17:53:33 user nova-compute[74613]: DEBUG nova.network.neutron [-] [instance: f3a5f6d2-cadd-485b-a443-1b8f3ed966b9] Updating instance_info_cache with network_info: [] {{(pid=74613) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 17:53:33 user nova-compute[74613]: INFO nova.compute.manager [-] [instance: f3a5f6d2-cadd-485b-a443-1b8f3ed966b9] Took 0.83 seconds to deallocate network for instance.
Nov 29 17:53:33 user nova-compute[74613]: DEBUG nova.compute.manager [req-61662bf2-dd3a-4c35-a6a1-2bb9757aae2b req-3f6233f2-d407-4523-bf6e-f0922ad250ea service nova] [instance: f3a5f6d2-cadd-485b-a443-1b8f3ed966b9] Received event network-vif-deleted-49e80b78-004f-457d-aea8-8940ab6d9179 {{(pid=74613) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 17:53:33 user nova-compute[74613]: INFO nova.compute.manager [req-61662bf2-dd3a-4c35-a6a1-2bb9757aae2b req-3f6233f2-d407-4523-bf6e-f0922ad250ea service nova] [instance: f3a5f6d2-cadd-485b-a443-1b8f3ed966b9] Neutron deleted interface 49e80b78-004f-457d-aea8-8940ab6d9179; detaching it from the instance and deleting it from the info cache
Nov 29 17:53:33 user nova-compute[74613]: DEBUG nova.network.neutron [req-61662bf2-dd3a-4c35-a6a1-2bb9757aae2b req-3f6233f2-d407-4523-bf6e-f0922ad250ea service nova] [instance: f3a5f6d2-cadd-485b-a443-1b8f3ed966b9] Updating instance_info_cache with network_info: [] {{(pid=74613) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 17:53:33 user nova-compute[74613]: DEBUG nova.compute.manager [req-61662bf2-dd3a-4c35-a6a1-2bb9757aae2b req-3f6233f2-d407-4523-bf6e-f0922ad250ea service nova] [instance: f3a5f6d2-cadd-485b-a443-1b8f3ed966b9] Detach interface failed, port_id=49e80b78-004f-457d-aea8-8940ab6d9179, reason: Instance f3a5f6d2-cadd-485b-a443-1b8f3ed966b9 could not be found. {{(pid=74613) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 29 17:53:33 user nova-compute[74613]: DEBUG nova.compute.manager [req-0afd1f68-7ea2-4e75-a191-45c76396017a req-ab7c5eb8-b667-49ed-a40e-7965096f167b service nova] [instance: f3a5f6d2-cadd-485b-a443-1b8f3ed966b9] Received event network-vif-plugged-49e80b78-004f-457d-aea8-8940ab6d9179 {{(pid=74613) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 17:53:33 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-0afd1f68-7ea2-4e75-a191-45c76396017a req-ab7c5eb8-b667-49ed-a40e-7965096f167b service nova] Acquiring lock "f3a5f6d2-cadd-485b-a443-1b8f3ed966b9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 17:53:33 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-0afd1f68-7ea2-4e75-a191-45c76396017a req-ab7c5eb8-b667-49ed-a40e-7965096f167b service nova] Lock "f3a5f6d2-cadd-485b-a443-1b8f3ed966b9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 17:53:33 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-0afd1f68-7ea2-4e75-a191-45c76396017a req-ab7c5eb8-b667-49ed-a40e-7965096f167b service nova] Lock "f3a5f6d2-cadd-485b-a443-1b8f3ed966b9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 17:53:33 user nova-compute[74613]: DEBUG nova.compute.manager [req-0afd1f68-7ea2-4e75-a191-45c76396017a req-ab7c5eb8-b667-49ed-a40e-7965096f167b service nova] [instance: f3a5f6d2-cadd-485b-a443-1b8f3ed966b9] No waiting events found dispatching network-vif-plugged-49e80b78-004f-457d-aea8-8940ab6d9179 {{(pid=74613) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 17:53:33 user nova-compute[74613]: WARNING nova.compute.manager [req-0afd1f68-7ea2-4e75-a191-45c76396017a req-ab7c5eb8-b667-49ed-a40e-7965096f167b service nova] [instance: f3a5f6d2-cadd-485b-a443-1b8f3ed966b9] Received unexpected event network-vif-plugged-49e80b78-004f-457d-aea8-8940ab6d9179 for instance with vm_state active and task_state deleting.
Nov 29 17:53:35 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:53:37 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:53:40 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:53:40 user nova-compute[74613]: INFO nova.compute.manager [None req-5e8215f2-b8b0-4dd5-9fbb-b37d15470088 tempest-DeleteServersTestJSON-112443106 tempest-DeleteServersTestJSON-112443106-project-member] [instance: f3a5f6d2-cadd-485b-a443-1b8f3ed966b9] Took 6.67 seconds to detach 1 volumes for instance.
Nov 29 17:53:40 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-5e8215f2-b8b0-4dd5-9fbb-b37d15470088 tempest-DeleteServersTestJSON-112443106 tempest-DeleteServersTestJSON-112443106-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 17:53:40 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-5e8215f2-b8b0-4dd5-9fbb-b37d15470088 tempest-DeleteServersTestJSON-112443106 tempest-DeleteServersTestJSON-112443106-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 17:53:40 user nova-compute[74613]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f2b1c362-b536-4064-934c-601e384dc01f tempest-AttachSCSIVolumeTestJSON-1343397388 tempest-AttachSCSIVolumeTestJSON-1343397388-project-member] [instance: 01c65b16-5dbe-4ad5-a72e-9500a4fa59cf] Calling os-brick to attach iSCSI Volume {{(pid=74613) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 29 17:53:40 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-f2b1c362-b536-4064-934c-601e384dc01f tempest-AttachSCSIVolumeTestJSON-1343397388 tempest-AttachSCSIVolumeTestJSON-1343397388-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff828156890>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:850c1226-267c-42c0-945f-bfc219c8e88b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PQHdgFeo', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74613) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 17:53:40 user nova-compute[74613]: WARNING os_brick.initiator.connectors.base [None req-f2b1c362-b536-4064-934c-601e384dc01f tempest-AttachSCSIVolumeTestJSON-1343397388 tempest-AttachSCSIVolumeTestJSON-1343397388-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 17:53:40 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.base [None req-f2b1c362-b536-4064-934c-601e384dc01f tempest-AttachSCSIVolumeTestJSON-1343397388 tempest-AttachSCSIVolumeTestJSON-1343397388-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 17:53:40 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.base [None req-f2b1c362-b536-4064-934c-601e384dc01f tempest-AttachSCSIVolumeTestJSON-1343397388 tempest-AttachSCSIVolumeTestJSON-1343397388-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 17:53:40 user nova-compute[74613]: WARNING os_brick.initiator.connectors.base [None req-f2b1c362-b536-4064-934c-601e384dc01f tempest-AttachSCSIVolumeTestJSON-1343397388 tempest-AttachSCSIVolumeTestJSON-1343397388-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 17:53:40 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.base [None req-f2b1c362-b536-4064-934c-601e384dc01f tempest-AttachSCSIVolumeTestJSON-1343397388 tempest-AttachSCSIVolumeTestJSON-1343397388-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:850c1226-267c-42c0-945f-bfc219c8e88b" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 17:53:40 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.base [None req-f2b1c362-b536-4064-934c-601e384dc01f tempest-AttachSCSIVolumeTestJSON-1343397388 tempest-AttachSCSIVolumeTestJSON-1343397388-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:850c1226-267c-42c0-945f-bfc219c8e88b" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 17:53:40 user nova-compute[74613]: INFO os_brick.initiator.connectors.iscsi [None req-f2b1c362-b536-4064-934c-601e384dc01f tempest-AttachSCSIVolumeTestJSON-1343397388 tempest-AttachSCSIVolumeTestJSON-1343397388-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 29 17:53:40 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:850c1226-267c-42c0-945f-bfc219c8e88b -p 172.16.0.220:3260 {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 17:53:40 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:850c1226-267c-42c0-945f-bfc219c8e88b -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 17:53:40 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5b14b4d-db48-4557-b06f-982c9c194c20]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 17:53:40 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-f2b1c362-b536-4064-934c-601e384dc01f tempest-AttachSCSIVolumeTestJSON-1343397388 tempest-AttachSCSIVolumeTestJSON-1343397388-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 29 17:53:40 user nova-compute[74613]:  {{(pid=74613) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 17:53:40 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:850c1226-267c-42c0-945f-bfc219c8e88b -p 172.16.0.220:3260 --interface default --op new {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 17:53:40 user nova-compute[74613]: DEBUG nova.compute.provider_tree [None req-5e8215f2-b8b0-4dd5-9fbb-b37d15470088 tempest-DeleteServersTestJSON-112443106 tempest-DeleteServersTestJSON-112443106-project-member] Inventory has not changed in ProviderTree for provider: 639d980e-3b12-44b1-b8f4-1812416fa4dd {{(pid=74613) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 17:53:40 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:850c1226-267c-42c0-945f-bfc219c8e88b -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.017s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 17:53:40 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[7cf5b4e6-c430-4213-9689-4e954722060f]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:850c1226-267c-42c0-945f-bfc219c8e88b] added\n', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 17:53:40 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-f2b1c362-b536-4064-934c-601e384dc01f tempest-AttachSCSIVolumeTestJSON-1343397388 tempest-AttachSCSIVolumeTestJSON-1343397388-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:850c1226-267c-42c0-945f-bfc219c8e88b] added
Nov 29 17:53:40 user nova-compute[74613]:  stderr= {{(pid=74613) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 17:53:40 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:850c1226-267c-42c0-945f-bfc219c8e88b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 17:53:40 user nova-compute[74613]: DEBUG nova.scheduler.client.report [None req-5e8215f2-b8b0-4dd5-9fbb-b37d15470088 tempest-DeleteServersTestJSON-112443106 tempest-DeleteServersTestJSON-112443106-project-member] Inventory has not changed for provider 639d980e-3b12-44b1-b8f4-1812416fa4dd based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74613) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 17:53:40 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:850c1226-267c-42c0-945f-bfc219c8e88b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.026s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 17:53:40 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[af4592d7-c2dc-4156-a4b7-60fc6bc2fffa]: (4, ('', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 17:53:40 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-f2b1c362-b536-4064-934c-601e384dc01f tempest-AttachSCSIVolumeTestJSON-1343397388 tempest-AttachSCSIVolumeTestJSON-1343397388-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74613) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 17:53:40 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:850c1226-267c-42c0-945f-bfc219c8e88b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 17:53:40 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:850c1226-267c-42c0-945f-bfc219c8e88b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 17:53:40 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-5e8215f2-b8b0-4dd5-9fbb-b37d15470088 tempest-DeleteServersTestJSON-112443106 tempest-DeleteServersTestJSON-112443106-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.324s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 17:53:40 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[0941a087-22a8-4583-b5ce-f82ba6a36e4b]: (4, ('', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 17:53:40 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-f2b1c362-b536-4064-934c-601e384dc01f tempest-AttachSCSIVolumeTestJSON-1343397388 tempest-AttachSCSIVolumeTestJSON-1343397388-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74613) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 17:53:40 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:850c1226-267c-42c0-945f-bfc219c8e88b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v PQHdgFeo {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 17:53:40 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:850c1226-267c-42c0-945f-bfc219c8e88b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v PQHdgFeo" returned: 0 in 0.017s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 17:53:40 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb7be0e5-6127-49c4-8c11-b91c45b33be5]: (4, ('', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 17:53:40 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-f2b1c362-b536-4064-934c-601e384dc01f tempest-AttachSCSIVolumeTestJSON-1343397388 tempest-AttachSCSIVolumeTestJSON-1343397388-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'PQHdgFeo'): stdout= stderr= {{(pid=74613) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 17:53:40 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:850c1226-267c-42c0-945f-bfc219c8e88b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 17:53:40 user nova-compute[74613]: INFO nova.scheduler.client.report [None req-5e8215f2-b8b0-4dd5-9fbb-b37d15470088 tempest-DeleteServersTestJSON-112443106 tempest-DeleteServersTestJSON-112443106-project-member] Deleted allocations for instance f3a5f6d2-cadd-485b-a443-1b8f3ed966b9
Nov 29 17:53:40 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:850c1226-267c-42c0-945f-bfc219c8e88b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 17:53:40 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[053119dd-ebaa-4137-9ccd-1df9ecacdb87]: (4, ('', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 17:53:40 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-f2b1c362-b536-4064-934c-601e384dc01f tempest-AttachSCSIVolumeTestJSON-1343397388 tempest-AttachSCSIVolumeTestJSON-1343397388-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74613) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 17:53:40 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 17:53:40 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 17:53:40 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee8d6821-3aba-446d-a3a0-b297d09e83ef]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fbbdc3d2-136d-4fba-b6ba-f27f35a0733b (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:24920064-fc81-4408-97d1-d8eff97a7554 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8230f3a2-63d8-46cb-8ec7-ceb89fb04e53 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d1f798a1-4f7b-4b9a-8180-fa8f4eb89bf0 (non-flash)\n', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 17:53:40 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-f2b1c362-b536-4064-934c-601e384dc01f tempest-AttachSCSIVolumeTestJSON-1343397388 tempest-AttachSCSIVolumeTestJSON-1343397388-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fbbdc3d2-136d-4fba-b6ba-f27f35a0733b (non-flash)
Nov 29 17:53:40 user nova-compute[74613]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:24920064-fc81-4408-97d1-d8eff97a7554 (non-flash)
Nov 29 17:53:40 user nova-compute[74613]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8230f3a2-63d8-46cb-8ec7-ceb89fb04e53 (non-flash)
Nov 29 17:53:40 user nova-compute[74613]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d1f798a1-4f7b-4b9a-8180-fa8f4eb89bf0 (non-flash)
Nov 29 17:53:40 user nova-compute[74613]:  stderr= {{(pid=74613) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 17:53:40 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-f2b1c362-b536-4064-934c-601e384dc01f tempest-AttachSCSIVolumeTestJSON-1343397388 tempest-AttachSCSIVolumeTestJSON-1343397388-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fbbdc3d2-136d-4fba-b6ba-f27f35a0733b (non-flash)
Nov 29 17:53:40 user nova-compute[74613]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:24920064-fc81-4408-97d1-d8eff97a7554 (non-flash)
Nov 29 17:53:40 user nova-compute[74613]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8230f3a2-63d8-46cb-8ec7-ceb89fb04e53 (non-flash)
Nov 29 17:53:40 user nova-compute[74613]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d1f798a1-4f7b-4b9a-8180-fa8f4eb89bf0 (non-flash)
Nov 29 17:53:40 user nova-compute[74613]:  stderr= {{(pid=74613) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 17:53:40 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:850c1226-267c-42c0-945f-bfc219c8e88b -p 172.16.0.220:3260 --login {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 17:53:40 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-5e8215f2-b8b0-4dd5-9fbb-b37d15470088 tempest-DeleteServersTestJSON-112443106 tempest-DeleteServersTestJSON-112443106-project-member] Lock "f3a5f6d2-cadd-485b-a443-1b8f3ed966b9" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 9.286s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 17:53:40 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:850c1226-267c-42c0-945f-bfc219c8e88b -p 172.16.0.220:3260 --login" returned: 0 in 0.079s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 17:53:40 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[62b5677f-b365-4e0b-8ffc-977a13c99d7b]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:850c1226-267c-42c0-945f-bfc219c8e88b, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:850c1226-267c-42c0-945f-bfc219c8e88b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 17:53:40 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-f2b1c362-b536-4064-934c-601e384dc01f tempest-AttachSCSIVolumeTestJSON-1343397388 tempest-AttachSCSIVolumeTestJSON-1343397388-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:850c1226-267c-42c0-945f-bfc219c8e88b, portal: 172.16.0.220,3260]
Nov 29 17:53:40 user nova-compute[74613]: Login to [iface: default, target: iqn.2010-10.org.openstack:850c1226-267c-42c0-945f-bfc219c8e88b, portal: 172.16.0.220,3260] successful.
Nov 29 17:53:40 user nova-compute[74613]:  stderr= {{(pid=74613) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 17:53:40 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:850c1226-267c-42c0-945f-bfc219c8e88b -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 17:53:40 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:850c1226-267c-42c0-945f-bfc219c8e88b -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.023s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 17:53:40 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[53ea22b8-6478-4dbd-996a-bdf9785f33bd]: (4, ('', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 17:53:40 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-f2b1c362-b536-4064-934c-601e384dc01f tempest-AttachSCSIVolumeTestJSON-1343397388 tempest-AttachSCSIVolumeTestJSON-1343397388-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74613) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 17:53:40 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 17:53:40 user nova-compute[74613]: DEBUG nova.compute.manager [req-af16b7b5-7df3-4ee2-aa94-a91904a04662 req-3ad6f06b-302d-4da4-b33c-7b66e30cbb65 service nova] [instance: 0008521b-5a63-4ff6-8390-d343956900ed] Received event network-changed-0ab94891-565e-4864-b6ba-565056b40005 {{(pid=74613) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 17:53:40 user nova-compute[74613]: DEBUG nova.compute.manager [req-af16b7b5-7df3-4ee2-aa94-a91904a04662 req-3ad6f06b-302d-4da4-b33c-7b66e30cbb65 service nova] [instance: 0008521b-5a63-4ff6-8390-d343956900ed] Refreshing instance network info cache due to event network-changed-0ab94891-565e-4864-b6ba-565056b40005. {{(pid=74613) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 17:53:40 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-af16b7b5-7df3-4ee2-aa94-a91904a04662 req-3ad6f06b-302d-4da4-b33c-7b66e30cbb65 service nova] Acquiring lock "refresh_cache-0008521b-5a63-4ff6-8390-d343956900ed" {{(pid=74613) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 17:53:40 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-af16b7b5-7df3-4ee2-aa94-a91904a04662 req-3ad6f06b-302d-4da4-b33c-7b66e30cbb65 service nova] Acquired lock "refresh_cache-0008521b-5a63-4ff6-8390-d343956900ed" {{(pid=74613) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 17:53:40 user nova-compute[74613]: DEBUG nova.network.neutron [req-af16b7b5-7df3-4ee2-aa94-a91904a04662 req-3ad6f06b-302d-4da4-b33c-7b66e30cbb65 service nova] [instance: 0008521b-5a63-4ff6-8390-d343956900ed] Refreshing network info cache for port 0ab94891-565e-4864-b6ba-565056b40005 {{(pid=74613) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 17:53:40 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 17:53:40 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[3906565d-6838-49f9-8158-ea4386b9ab3e]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fbbdc3d2-136d-4fba-b6ba-f27f35a0733b (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:24920064-fc81-4408-97d1-d8eff97a7554 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8230f3a2-63d8-46cb-8ec7-ceb89fb04e53 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d1f798a1-4f7b-4b9a-8180-fa8f4eb89bf0 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:850c1226-267c-42c0-945f-bfc219c8e88b (non-flash)\n', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 17:53:40 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-f2b1c362-b536-4064-934c-601e384dc01f tempest-AttachSCSIVolumeTestJSON-1343397388 tempest-AttachSCSIVolumeTestJSON-1343397388-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fbbdc3d2-136d-4fba-b6ba-f27f35a0733b (non-flash)
Nov 29 17:53:40 user nova-compute[74613]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:24920064-fc81-4408-97d1-d8eff97a7554 (non-flash)
Nov 29 17:53:40 user nova-compute[74613]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8230f3a2-63d8-46cb-8ec7-ceb89fb04e53 (non-flash)
Nov 29 17:53:40 user nova-compute[74613]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d1f798a1-4f7b-4b9a-8180-fa8f4eb89bf0 (non-flash)
Nov 29 17:53:40 user nova-compute[74613]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:850c1226-267c-42c0-945f-bfc219c8e88b (non-flash)
Nov 29 17:53:40 user nova-compute[74613]:  stderr= {{(pid=74613) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 17:53:40 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-f2b1c362-b536-4064-934c-601e384dc01f tempest-AttachSCSIVolumeTestJSON-1343397388 tempest-AttachSCSIVolumeTestJSON-1343397388-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fbbdc3d2-136d-4fba-b6ba-f27f35a0733b (non-flash)
Nov 29 17:53:40 user nova-compute[74613]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:24920064-fc81-4408-97d1-d8eff97a7554 (non-flash)
Nov 29 17:53:40 user nova-compute[74613]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8230f3a2-63d8-46cb-8ec7-ceb89fb04e53 (non-flash)
Nov 29 17:53:40 user nova-compute[74613]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d1f798a1-4f7b-4b9a-8180-fa8f4eb89bf0 (non-flash)
Nov 29 17:53:40 user nova-compute[74613]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:850c1226-267c-42c0-945f-bfc219c8e88b (non-flash)
Nov 29 17:53:40 user nova-compute[74613]:  stderr= {{(pid=74613) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 17:53:40 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.base [None req-f2b1c362-b536-4064-934c-601e384dc01f tempest-AttachSCSIVolumeTestJSON-1343397388 tempest-AttachSCSIVolumeTestJSON-1343397388-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:850c1226-267c-42c0-945f-bfc219c8e88b" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.312s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 17:53:40 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-f2b1c362-b536-4064-934c-601e384dc01f tempest-AttachSCSIVolumeTestJSON-1343397388 tempest-AttachSCSIVolumeTestJSON-1343397388-project-member] Connected to 172.16.0.220:3260 {{(pid=74613) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 29 17:53:40 user nova-compute[74613]: DEBUG os_brick.initiator.linuxscsi [None req-f2b1c362-b536-4064-934c-601e384dc01f tempest-AttachSCSIVolumeTestJSON-1343397388 tempest-AttachSCSIVolumeTestJSON-1343397388-project-member] HCTL ('37', '-', '-', 0) found on session 7 with lun 0 {{(pid=74613) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 29 17:53:40 user nova-compute[74613]: DEBUG os_brick.initiator.linuxscsi [None req-f2b1c362-b536-4064-934c-601e384dc01f tempest-AttachSCSIVolumeTestJSON-1343397388 tempest-AttachSCSIVolumeTestJSON-1343397388-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=74613) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 29 17:53:40 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 17:53:40 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.019s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 17:53:40 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[00d7cf4b-5c27-464c-84a5-e5b8ca26b417]: (4, ('- - 0', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 17:53:40 user nova-compute[74613]: DEBUG os_brick.initiator.linuxscsi [None req-f2b1c362-b536-4064-934c-601e384dc01f tempest-AttachSCSIVolumeTestJSON-1343397388 tempest-AttachSCSIVolumeTestJSON-1343397388-project-member] Searching for a device in session 7 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=74613) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 29 17:53:40 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-f2b1c362-b536-4064-934c-601e384dc01f tempest-AttachSCSIVolumeTestJSON-1343397388 tempest-AttachSCSIVolumeTestJSON-1343397388-project-member] Connected to sdf using {'target_iqn': 'iqn.2010-10.org.openstack:850c1226-267c-42c0-945f-bfc219c8e88b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PQHdgFeo', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74613) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 29 17:53:40 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-cd1ac709-d1e1-44f0-ae8e-88711e7bde20 tempest-TestVolumeSwap-281539251 tempest-TestVolumeSwap-281539251-project-member] Acquiring lock "0008521b-5a63-4ff6-8390-d343956900ed" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 17:53:40 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-cd1ac709-d1e1-44f0-ae8e-88711e7bde20 tempest-TestVolumeSwap-281539251 tempest-TestVolumeSwap-281539251-project-member] Lock "0008521b-5a63-4ff6-8390-d343956900ed" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 17:53:40 user nova-compute[74613]: DEBUG nova.objects.instance [None req-cd1ac709-d1e1-44f0-ae8e-88711e7bde20 tempest-TestVolumeSwap-281539251 tempest-TestVolumeSwap-281539251-project-member] Lazy-loading 'flavor' on Instance uuid 0008521b-5a63-4ff6-8390-d343956900ed {{(pid=74613) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 17:53:40 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-cd1ac709-d1e1-44f0-ae8e-88711e7bde20 tempest-TestVolumeSwap-281539251 tempest-TestVolumeSwap-281539251-project-member] Lock "0008521b-5a63-4ff6-8390-d343956900ed" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.077s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 17:53:41 user nova-compute[74613]: DEBUG nova.network.neutron [req-af16b7b5-7df3-4ee2-aa94-a91904a04662 req-3ad6f06b-302d-4da4-b33c-7b66e30cbb65 service nova] [instance: 0008521b-5a63-4ff6-8390-d343956900ed] Updated VIF entry in instance network info cache for port 0ab94891-565e-4864-b6ba-565056b40005. {{(pid=74613) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 17:53:41 user nova-compute[74613]: DEBUG nova.network.neutron [req-af16b7b5-7df3-4ee2-aa94-a91904a04662 req-3ad6f06b-302d-4da4-b33c-7b66e30cbb65 service nova] [instance: 0008521b-5a63-4ff6-8390-d343956900ed] Updating instance_info_cache with network_info: [{"id": "0ab94891-565e-4864-b6ba-565056b40005", "address": "fa:16:3e:7e:c4:dc", "network": {"id": "8955d6de-e65e-431d-80b4-420aeda27329", "bridge": "br-int", "label": "tempest-TestVolumeSwap-241933908-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.35", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6d9f2fb92a21448d9c935927066d5372", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0ab94891-56", "ovs_interfaceid": "0ab94891-565e-4864-b6ba-565056b40005", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74613) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 17:53:41 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-af16b7b5-7df3-4ee2-aa94-a91904a04662 req-3ad6f06b-302d-4da4-b33c-7b66e30cbb65 service nova] Releasing lock "refresh_cache-0008521b-5a63-4ff6-8390-d343956900ed" {{(pid=74613) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 17:53:41 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-cd1ac709-d1e1-44f0-ae8e-88711e7bde20 tempest-TestVolumeSwap-281539251 tempest-TestVolumeSwap-281539251-project-member] Acquiring lock "0008521b-5a63-4ff6-8390-d343956900ed" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 17:53:41 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-cd1ac709-d1e1-44f0-ae8e-88711e7bde20 tempest-TestVolumeSwap-281539251 tempest-TestVolumeSwap-281539251-project-member] Lock "0008521b-5a63-4ff6-8390-d343956900ed" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 17:53:41 user nova-compute[74613]: INFO nova.compute.manager [None req-cd1ac709-d1e1-44f0-ae8e-88711e7bde20 tempest-TestVolumeSwap-281539251 tempest-TestVolumeSwap-281539251-project-member] [instance: 0008521b-5a63-4ff6-8390-d343956900ed] Attaching volume a6b34bdb-5c08-4f7c-b3f5-6b68413947a8 to /dev/vdb
Nov 29 17:53:41 user nova-compute[74613]: DEBUG os_brick.utils [None req-cd1ac709-d1e1-44f0-ae8e-88711e7bde20 tempest-TestVolumeSwap-281539251 tempest-TestVolumeSwap-281539251-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74613) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 17:53:41 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 17:53:41 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 17:53:41 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae7f6714-a5f6-4168-b00e-ca168221ff50]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:400972819b5\n', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 17:53:41 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 17:53:41 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.013s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 17:53:41 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[70795028-1f18-4635-b9f4-9e7523b9e856]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 17:53:41 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 17:53:41 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.014s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 17:53:41 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[540f308f-cf20-4eea-9bf4-0ac256179545]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 17:53:41 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e36c9ca-d80d-47c7-a12e-bc5ff56cebbb]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 17:53:41 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-cd1ac709-d1e1-44f0-ae8e-88711e7bde20 tempest-TestVolumeSwap-281539251 tempest-TestVolumeSwap-281539251-project-member] Running cmd (subprocess): nvme version {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 17:53:41 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-cd1ac709-d1e1-44f0-ae8e-88711e7bde20 tempest-TestVolumeSwap-281539251 tempest-TestVolumeSwap-281539251-project-member] 'nvme version' failed. Not Retrying. {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 17:53:41 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.nvmeof [None req-cd1ac709-d1e1-44f0-ae8e-88711e7bde20 tempest-TestVolumeSwap-281539251 tempest-TestVolumeSwap-281539251-project-member] nvme not present on system {{(pid=74613) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 29 17:53:41 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 17:53:41 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 17:53:41 user nova-compute[74613]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 29 17:53:41 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[62ae7936-d48b-460b-9767-efb0ee6889c6]: (4, '') {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 17:53:41 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.lightos [None req-cd1ac709-d1e1-44f0-ae8e-88711e7bde20 tempest-TestVolumeSwap-281539251 tempest-TestVolumeSwap-281539251-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74613) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 29 17:53:41 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.lightos [None req-cd1ac709-d1e1-44f0-ae8e-88711e7bde20 tempest-TestVolumeSwap-281539251 tempest-TestVolumeSwap-281539251-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74613) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 29 17:53:41 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.lightos [None req-cd1ac709-d1e1-44f0-ae8e-88711e7bde20 tempest-TestVolumeSwap-281539251 tempest-TestVolumeSwap-281539251-project-member] LIGHTOS: no hostnqn found. {{(pid=74613) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 29 17:53:41 user nova-compute[74613]: DEBUG os_brick.utils [None req-cd1ac709-d1e1-44f0-ae8e-88711e7bde20 tempest-TestVolumeSwap-281539251 tempest-TestVolumeSwap-281539251-project-member] <== get_connector_properties: return (105ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:400972819b5', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74613) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 17:53:41 user nova-compute[74613]: DEBUG nova.virt.block_device [None req-cd1ac709-d1e1-44f0-ae8e-88711e7bde20 tempest-TestVolumeSwap-281539251 tempest-TestVolumeSwap-281539251-project-member] [instance: 0008521b-5a63-4ff6-8390-d343956900ed] Updating existing volume attachment record: 28d26b2e-7950-479d-809a-2c2c630bc915 {{(pid=74613) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 29 17:53:41 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.base [None req-f2b1c362-b536-4064-934c-601e384dc01f tempest-AttachSCSIVolumeTestJSON-1343397388 tempest-AttachSCSIVolumeTestJSON-1343397388-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.347s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 17:53:41 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-f2b1c362-b536-4064-934c-601e384dc01f tempest-AttachSCSIVolumeTestJSON-1343397388 tempest-AttachSCSIVolumeTestJSON-1343397388-project-member] <== connect_volume: return (1349ms) {'type': 'block', 'scsi_wwn': '23938653139393036', 'path': '/dev/sdf'} {{(pid=74613) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 17:53:41 user nova-compute[74613]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f2b1c362-b536-4064-934c-601e384dc01f tempest-AttachSCSIVolumeTestJSON-1343397388 tempest-AttachSCSIVolumeTestJSON-1343397388-project-member] [instance: 01c65b16-5dbe-4ad5-a72e-9500a4fa59cf] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23938653139393036', 'path': '/dev/sdf'} {{(pid=74613) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 29 17:53:41 user nova-compute[74613]: DEBUG nova.objects.instance [None req-f2b1c362-b536-4064-934c-601e384dc01f tempest-AttachSCSIVolumeTestJSON-1343397388 tempest-AttachSCSIVolumeTestJSON-1343397388-project-member] Lazy-loading 'flavor' on Instance uuid 01c65b16-5dbe-4ad5-a72e-9500a4fa59cf {{(pid=74613) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 17:53:41 user nova-compute[74613]: DEBUG nova.virt.libvirt.guest [None req-f2b1c362-b536-4064-934c-601e384dc01f tempest-AttachSCSIVolumeTestJSON-1343397388 tempest-AttachSCSIVolumeTestJSON-1343397388-project-member] attach device xml: <disk type="block" device="disk">
Nov 29 17:53:41 user nova-compute[74613]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 17:53:41 user nova-compute[74613]:   <source dev="/dev/sdf"/>
Nov 29 17:53:41 user nova-compute[74613]:   <target dev="sdc" bus="scsi"/>
Nov 29 17:53:41 user nova-compute[74613]:   <serial>850c1226-267c-42c0-945f-bfc219c8e88b</serial>
Nov 29 17:53:41 user nova-compute[74613]:   <address type="drive" controller="0" unit="2"/>
Nov 29 17:53:41 user nova-compute[74613]: </disk>
Nov 29 17:53:41 user nova-compute[74613]:  {{(pid=74613) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 29 17:53:42 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:53:42 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-f2b1c362-b536-4064-934c-601e384dc01f tempest-AttachSCSIVolumeTestJSON-1343397388 tempest-AttachSCSIVolumeTestJSON-1343397388-project-member] No BDM found with device name sda, not building metadata. {{(pid=74613) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 17:53:42 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-f2b1c362-b536-4064-934c-601e384dc01f tempest-AttachSCSIVolumeTestJSON-1343397388 tempest-AttachSCSIVolumeTestJSON-1343397388-project-member] No BDM found with device name sdb, not building metadata. {{(pid=74613) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 17:53:42 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-f2b1c362-b536-4064-934c-601e384dc01f tempest-AttachSCSIVolumeTestJSON-1343397388 tempest-AttachSCSIVolumeTestJSON-1343397388-project-member] No BDM found with device name sdc, not building metadata. {{(pid=74613) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 17:53:42 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-f2b1c362-b536-4064-934c-601e384dc01f tempest-AttachSCSIVolumeTestJSON-1343397388 tempest-AttachSCSIVolumeTestJSON-1343397388-project-member] No VIF found with MAC fa:16:3e:c7:6c:2d, not building metadata {{(pid=74613) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 29 17:53:42 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-f2b1c362-b536-4064-934c-601e384dc01f tempest-AttachSCSIVolumeTestJSON-1343397388 tempest-AttachSCSIVolumeTestJSON-1343397388-project-member] Lock "01c65b16-5dbe-4ad5-a72e-9500a4fa59cf" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 10.537s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 17:53:42 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-1028ee96-453b-4d25-ae2d-35538e927ff3 tempest-AttachSCSIVolumeTestJSON-1343397388 tempest-AttachSCSIVolumeTestJSON-1343397388-project-member] Acquiring lock "01c65b16-5dbe-4ad5-a72e-9500a4fa59cf" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 17:53:42 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-1028ee96-453b-4d25-ae2d-35538e927ff3 tempest-AttachSCSIVolumeTestJSON-1343397388 tempest-AttachSCSIVolumeTestJSON-1343397388-project-member] Lock "01c65b16-5dbe-4ad5-a72e-9500a4fa59cf" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 17:53:42 user nova-compute[74613]: INFO nova.compute.manager [None req-1028ee96-453b-4d25-ae2d-35538e927ff3 tempest-AttachSCSIVolumeTestJSON-1343397388 tempest-AttachSCSIVolumeTestJSON-1343397388-project-member] [instance: 01c65b16-5dbe-4ad5-a72e-9500a4fa59cf] Detaching volume 850c1226-267c-42c0-945f-bfc219c8e88b
Nov 29 17:53:43 user nova-compute[74613]: INFO nova.virt.block_device [None req-1028ee96-453b-4d25-ae2d-35538e927ff3 tempest-AttachSCSIVolumeTestJSON-1343397388 tempest-AttachSCSIVolumeTestJSON-1343397388-project-member] [instance: 01c65b16-5dbe-4ad5-a72e-9500a4fa59cf] Attempting to driver detach volume 850c1226-267c-42c0-945f-bfc219c8e88b from mountpoint /dev/sdc
Nov 29 17:53:43 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-1028ee96-453b-4d25-ae2d-35538e927ff3 tempest-AttachSCSIVolumeTestJSON-1343397388 tempest-AttachSCSIVolumeTestJSON-1343397388-project-member] Attempting to detach device sdc from instance 01c65b16-5dbe-4ad5-a72e-9500a4fa59cf from the persistent domain config. {{(pid=74613) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 29 17:53:43 user nova-compute[74613]: DEBUG nova.virt.libvirt.guest [None req-1028ee96-453b-4d25-ae2d-35538e927ff3 tempest-AttachSCSIVolumeTestJSON-1343397388 tempest-AttachSCSIVolumeTestJSON-1343397388-project-member] detach device xml: <disk type="block" device="disk">
Nov 29 17:53:43 user nova-compute[74613]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 17:53:43 user nova-compute[74613]:   <source dev="/dev/sdf"/>
Nov 29 17:53:43 user nova-compute[74613]:   <target dev="sdc" bus="scsi"/>
Nov 29 17:53:43 user nova-compute[74613]:   <serial>850c1226-267c-42c0-945f-bfc219c8e88b</serial>
Nov 29 17:53:43 user nova-compute[74613]:   <address type="drive" controller="0" bus="0" target="0" unit="2"/>
Nov 29 17:53:43 user nova-compute[74613]: </disk>
Nov 29 17:53:43 user nova-compute[74613]:  {{(pid=74613) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 29 17:53:43 user nova-compute[74613]: INFO nova.virt.libvirt.driver [None req-1028ee96-453b-4d25-ae2d-35538e927ff3 tempest-AttachSCSIVolumeTestJSON-1343397388 tempest-AttachSCSIVolumeTestJSON-1343397388-project-member] Successfully detached device sdc from instance 01c65b16-5dbe-4ad5-a72e-9500a4fa59cf from the persistent domain config.
Nov 29 17:53:43 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-1028ee96-453b-4d25-ae2d-35538e927ff3 tempest-AttachSCSIVolumeTestJSON-1343397388 tempest-AttachSCSIVolumeTestJSON-1343397388-project-member] (1/8): Attempting to detach device sdc with device alias scsi0-0-0-2 from instance 01c65b16-5dbe-4ad5-a72e-9500a4fa59cf from the live domain config. {{(pid=74613) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 29 17:53:43 user nova-compute[74613]: DEBUG nova.virt.libvirt.guest [None req-1028ee96-453b-4d25-ae2d-35538e927ff3 tempest-AttachSCSIVolumeTestJSON-1343397388 tempest-AttachSCSIVolumeTestJSON-1343397388-project-member] detach device xml: <disk type="block" device="disk">
Nov 29 17:53:43 user nova-compute[74613]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 17:53:43 user nova-compute[74613]:   <source dev="/dev/sdf"/>
Nov 29 17:53:43 user nova-compute[74613]:   <target dev="sdc" bus="scsi"/>
Nov 29 17:53:43 user nova-compute[74613]:   <serial>850c1226-267c-42c0-945f-bfc219c8e88b</serial>
Nov 29 17:53:43 user nova-compute[74613]:   <address type="drive" controller="0" bus="0" target="0" unit="2"/>
Nov 29 17:53:43 user nova-compute[74613]: </disk>
Nov 29 17:53:43 user nova-compute[74613]:  {{(pid=74613) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 29 17:53:43 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-1028ee96-453b-4d25-ae2d-35538e927ff3 tempest-AttachSCSIVolumeTestJSON-1343397388 tempest-AttachSCSIVolumeTestJSON-1343397388-project-member] Start waiting for the detach event from libvirt for device sdc with device alias scsi0-0-0-2 for instance 01c65b16-5dbe-4ad5-a72e-9500a4fa59cf {{(pid=74613) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 29 17:53:45 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:53:45 user nova-compute[74613]: DEBUG nova.compute.manager [req-9c23f2ae-589e-4ce9-b150-71a756f98111 req-69f70c2c-6470-40fe-ab13-cc0258c60b98 service nova] [instance: 288b8261-8706-4696-879d-d4dd01ab553e] Received event network-changed-abe5d419-60cc-474c-935a-60f5512894e0 {{(pid=74613) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 17:53:45 user nova-compute[74613]: DEBUG nova.compute.manager [req-9c23f2ae-589e-4ce9-b150-71a756f98111 req-69f70c2c-6470-40fe-ab13-cc0258c60b98 service nova] [instance: 288b8261-8706-4696-879d-d4dd01ab553e] Refreshing instance network info cache due to event network-changed-abe5d419-60cc-474c-935a-60f5512894e0. {{(pid=74613) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 17:53:45 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-9c23f2ae-589e-4ce9-b150-71a756f98111 req-69f70c2c-6470-40fe-ab13-cc0258c60b98 service nova] Acquiring lock "refresh_cache-288b8261-8706-4696-879d-d4dd01ab553e" {{(pid=74613) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 17:53:45 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-9c23f2ae-589e-4ce9-b150-71a756f98111 req-69f70c2c-6470-40fe-ab13-cc0258c60b98 service nova] Acquired lock "refresh_cache-288b8261-8706-4696-879d-d4dd01ab553e" {{(pid=74613) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 17:53:45 user nova-compute[74613]: DEBUG nova.network.neutron [req-9c23f2ae-589e-4ce9-b150-71a756f98111 req-69f70c2c-6470-40fe-ab13-cc0258c60b98 service nova] [instance: 288b8261-8706-4696-879d-d4dd01ab553e] Refreshing network info cache for port abe5d419-60cc-474c-935a-60f5512894e0 {{(pid=74613) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 17:53:46 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-8bac3a93-0d37-4b0d-a73c-4acea7b4b15d tempest-TaggedAttachmentsTest-1438740121 tempest-TaggedAttachmentsTest-1438740121-project-member] Acquiring lock "interface-288b8261-8706-4696-879d-d4dd01ab553e-None" by "nova.compute.manager.ComputeManager.attach_interface.<locals>.do_attach_interface" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 17:53:46 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-8bac3a93-0d37-4b0d-a73c-4acea7b4b15d tempest-TaggedAttachmentsTest-1438740121 tempest-TaggedAttachmentsTest-1438740121-project-member] Lock "interface-288b8261-8706-4696-879d-d4dd01ab553e-None" acquired by "nova.compute.manager.ComputeManager.attach_interface.<locals>.do_attach_interface" :: waited 0.001s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 17:53:46 user nova-compute[74613]: DEBUG nova.objects.instance [None req-8bac3a93-0d37-4b0d-a73c-4acea7b4b15d tempest-TaggedAttachmentsTest-1438740121 tempest-TaggedAttachmentsTest-1438740121-project-member] Lazy-loading 'flavor' on Instance uuid 288b8261-8706-4696-879d-d4dd01ab553e {{(pid=74613) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 17:53:46 user nova-compute[74613]: DEBUG nova.network.neutron [req-9c23f2ae-589e-4ce9-b150-71a756f98111 req-69f70c2c-6470-40fe-ab13-cc0258c60b98 service nova] [instance: 288b8261-8706-4696-879d-d4dd01ab553e] Updated VIF entry in instance network info cache for port abe5d419-60cc-474c-935a-60f5512894e0. {{(pid=74613) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 17:53:46 user nova-compute[74613]: DEBUG nova.network.neutron [req-9c23f2ae-589e-4ce9-b150-71a756f98111 req-69f70c2c-6470-40fe-ab13-cc0258c60b98 service nova] [instance: 288b8261-8706-4696-879d-d4dd01ab553e] Updating instance_info_cache with network_info: [{"id": "abe5d419-60cc-474c-935a-60f5512894e0", "address": "fa:16:3e:14:7b:54", "network": {"id": "3a1d6151-a950-475c-af8a-d15174f89822", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1729826224-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.29", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fdebfa0bb4bf45338ce3fa1ded5cd5bd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapabe5d419-60", "ovs_interfaceid": "abe5d419-60cc-474c-935a-60f5512894e0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74613) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 17:53:46 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-9c23f2ae-589e-4ce9-b150-71a756f98111 req-69f70c2c-6470-40fe-ab13-cc0258c60b98 service nova] Releasing lock "refresh_cache-288b8261-8706-4696-879d-d4dd01ab553e" {{(pid=74613) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 17:53:46 user nova-compute[74613]: DEBUG nova.objects.instance [None req-8bac3a93-0d37-4b0d-a73c-4acea7b4b15d tempest-TaggedAttachmentsTest-1438740121 tempest-TaggedAttachmentsTest-1438740121-project-member] Lazy-loading 'pci_requests' on Instance uuid 288b8261-8706-4696-879d-d4dd01ab553e {{(pid=74613) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 17:53:46 user nova-compute[74613]: DEBUG nova.objects.base [None req-8bac3a93-0d37-4b0d-a73c-4acea7b4b15d tempest-TaggedAttachmentsTest-1438740121 tempest-TaggedAttachmentsTest-1438740121-project-member] Object Instance<288b8261-8706-4696-879d-d4dd01ab553e> lazy-loaded attributes: flavor,pci_requests {{(pid=74613) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 29 17:53:46 user nova-compute[74613]: DEBUG nova.network.neutron [None req-8bac3a93-0d37-4b0d-a73c-4acea7b4b15d tempest-TaggedAttachmentsTest-1438740121 tempest-TaggedAttachmentsTest-1438740121-project-member] [instance: 288b8261-8706-4696-879d-d4dd01ab553e] allocate_for_instance() {{(pid=74613) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 29 17:53:46 user nova-compute[74613]: DEBUG nova.policy [None req-8bac3a93-0d37-4b0d-a73c-4acea7b4b15d tempest-TaggedAttachmentsTest-1438740121 tempest-TaggedAttachmentsTest-1438740121-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '52aa43eddf17484b9823bf13f548d22b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdebfa0bb4bf45338ce3fa1ded5cd5bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74613) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 29 17:53:47 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:53:47 user nova-compute[74613]: DEBUG nova.network.neutron [None req-8bac3a93-0d37-4b0d-a73c-4acea7b4b15d tempest-TaggedAttachmentsTest-1438740121 tempest-TaggedAttachmentsTest-1438740121-project-member] [instance: 288b8261-8706-4696-879d-d4dd01ab553e] Successfully created port: 5984be75-0336-4f84-a5f3-52f4e3fbeaa3 {{(pid=74613) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 29 17:53:48 user nova-compute[74613]: DEBUG nova.compute.manager [req-baafb919-babf-45b5-a716-4a3e6f75ae88 req-6d44acc5-f8dc-48cb-ad9e-604e26f71dee service nova] [instance: d4ecef60-62f9-4969-b57f-3bb45a44cc9f] Received event network-changed-292029d6-b062-4cdc-8c09-c92693cac658 {{(pid=74613) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 17:53:48 user nova-compute[74613]: DEBUG nova.compute.manager [req-baafb919-babf-45b5-a716-4a3e6f75ae88 req-6d44acc5-f8dc-48cb-ad9e-604e26f71dee service nova] [instance: d4ecef60-62f9-4969-b57f-3bb45a44cc9f] Refreshing instance network info cache due to event network-changed-292029d6-b062-4cdc-8c09-c92693cac658. {{(pid=74613) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 17:53:48 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-baafb919-babf-45b5-a716-4a3e6f75ae88 req-6d44acc5-f8dc-48cb-ad9e-604e26f71dee service nova] Acquiring lock "refresh_cache-d4ecef60-62f9-4969-b57f-3bb45a44cc9f" {{(pid=74613) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 17:53:48 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-baafb919-babf-45b5-a716-4a3e6f75ae88 req-6d44acc5-f8dc-48cb-ad9e-604e26f71dee service nova] Acquired lock "refresh_cache-d4ecef60-62f9-4969-b57f-3bb45a44cc9f" {{(pid=74613) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 17:53:48 user nova-compute[74613]: DEBUG nova.network.neutron [req-baafb919-babf-45b5-a716-4a3e6f75ae88 req-6d44acc5-f8dc-48cb-ad9e-604e26f71dee service nova] [instance: d4ecef60-62f9-4969-b57f-3bb45a44cc9f] Refreshing network info cache for port 292029d6-b062-4cdc-8c09-c92693cac658 {{(pid=74613) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 17:53:48 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-acb74ace-3246-44e6-bae3-648fd0bbb262 tempest-VolumesAssistedSnapshotsTest-194727756 tempest-VolumesAssistedSnapshotsTest-194727756-project-admin] Acquiring lock "d4ecef60-62f9-4969-b57f-3bb45a44cc9f" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 17:53:48 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-acb74ace-3246-44e6-bae3-648fd0bbb262 tempest-VolumesAssistedSnapshotsTest-194727756 tempest-VolumesAssistedSnapshotsTest-194727756-project-admin] Lock "d4ecef60-62f9-4969-b57f-3bb45a44cc9f" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 17:53:48 user nova-compute[74613]: DEBUG nova.objects.instance [None req-acb74ace-3246-44e6-bae3-648fd0bbb262 tempest-VolumesAssistedSnapshotsTest-194727756 tempest-VolumesAssistedSnapshotsTest-194727756-project-admin] Lazy-loading 'flavor' on Instance uuid d4ecef60-62f9-4969-b57f-3bb45a44cc9f {{(pid=74613) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 17:53:48 user nova-compute[74613]: DEBUG nova.network.neutron [None req-8bac3a93-0d37-4b0d-a73c-4acea7b4b15d tempest-TaggedAttachmentsTest-1438740121 tempest-TaggedAttachmentsTest-1438740121-project-member] [instance: 288b8261-8706-4696-879d-d4dd01ab553e] Successfully updated port: 5984be75-0336-4f84-a5f3-52f4e3fbeaa3 {{(pid=74613) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 29 17:53:48 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-8bac3a93-0d37-4b0d-a73c-4acea7b4b15d tempest-TaggedAttachmentsTest-1438740121 tempest-TaggedAttachmentsTest-1438740121-project-member] Acquiring lock "refresh_cache-288b8261-8706-4696-879d-d4dd01ab553e" {{(pid=74613) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 17:53:48 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-8bac3a93-0d37-4b0d-a73c-4acea7b4b15d tempest-TaggedAttachmentsTest-1438740121 tempest-TaggedAttachmentsTest-1438740121-project-member] Acquired lock "refresh_cache-288b8261-8706-4696-879d-d4dd01ab553e" {{(pid=74613) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 17:53:48 user nova-compute[74613]: DEBUG nova.network.neutron [None req-8bac3a93-0d37-4b0d-a73c-4acea7b4b15d tempest-TaggedAttachmentsTest-1438740121 tempest-TaggedAttachmentsTest-1438740121-project-member] [instance: 288b8261-8706-4696-879d-d4dd01ab553e] Building network info cache for instance {{(pid=74613) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 29 17:53:48 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-acb74ace-3246-44e6-bae3-648fd0bbb262 tempest-VolumesAssistedSnapshotsTest-194727756 tempest-VolumesAssistedSnapshotsTest-194727756-project-admin] Lock "d4ecef60-62f9-4969-b57f-3bb45a44cc9f" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.087s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 17:53:48 user nova-compute[74613]: DEBUG nova.network.neutron [req-baafb919-babf-45b5-a716-4a3e6f75ae88 req-6d44acc5-f8dc-48cb-ad9e-604e26f71dee service nova] [instance: d4ecef60-62f9-4969-b57f-3bb45a44cc9f] Updated VIF entry in instance network info cache for port 292029d6-b062-4cdc-8c09-c92693cac658. {{(pid=74613) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 17:53:48 user nova-compute[74613]: DEBUG nova.network.neutron [req-baafb919-babf-45b5-a716-4a3e6f75ae88 req-6d44acc5-f8dc-48cb-ad9e-604e26f71dee service nova] [instance: d4ecef60-62f9-4969-b57f-3bb45a44cc9f] Updating instance_info_cache with network_info: [{"id": "292029d6-b062-4cdc-8c09-c92693cac658", "address": "fa:16:3e:a5:be:95", "network": {"id": "3be4f180-3b53-4069-9ab2-94b1a948986b", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-170006881-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.110", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6469439fcd88494f85d31126651f3027", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap292029d6-b0", "ovs_interfaceid": "292029d6-b062-4cdc-8c09-c92693cac658", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74613) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 17:53:48 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-baafb919-babf-45b5-a716-4a3e6f75ae88 req-6d44acc5-f8dc-48cb-ad9e-604e26f71dee service nova] Releasing lock "refresh_cache-d4ecef60-62f9-4969-b57f-3bb45a44cc9f" {{(pid=74613) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 17:53:48 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-acb74ace-3246-44e6-bae3-648fd0bbb262 tempest-VolumesAssistedSnapshotsTest-194727756 tempest-VolumesAssistedSnapshotsTest-194727756-project-admin] Acquiring lock "d4ecef60-62f9-4969-b57f-3bb45a44cc9f" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 17:53:48 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-acb74ace-3246-44e6-bae3-648fd0bbb262 tempest-VolumesAssistedSnapshotsTest-194727756 tempest-VolumesAssistedSnapshotsTest-194727756-project-admin] Lock "d4ecef60-62f9-4969-b57f-3bb45a44cc9f" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 17:53:48 user nova-compute[74613]: INFO nova.compute.manager [None req-acb74ace-3246-44e6-bae3-648fd0bbb262 tempest-VolumesAssistedSnapshotsTest-194727756 tempest-VolumesAssistedSnapshotsTest-194727756-project-admin] [instance: d4ecef60-62f9-4969-b57f-3bb45a44cc9f] Attaching volume 17b27fab-6cdb-4820-be62-ffd44e8e2fb5 to /dev/vdb
Nov 29 17:53:48 user nova-compute[74613]: DEBUG os_brick.utils [None req-acb74ace-3246-44e6-bae3-648fd0bbb262 tempest-VolumesAssistedSnapshotsTest-194727756 tempest-VolumesAssistedSnapshotsTest-194727756-project-admin] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74613) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 17:53:48 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 17:53:48 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 17:53:48 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[740605e7-ac1a-400b-afc1-107d27125e07]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:400972819b5\n', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 17:53:48 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 17:53:48 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 17:53:48 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca87049b-3d99-4159-84c2-d1660b7377ed]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 17:53:48 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 17:53:48 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 17:53:48 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[49e60e04-9423-4698-bae6-5e28b342174b]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 17:53:48 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[470333d1-47c6-4ac7-a30f-eb5f43cd4b63]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 17:53:48 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-acb74ace-3246-44e6-bae3-648fd0bbb262 tempest-VolumesAssistedSnapshotsTest-194727756 tempest-VolumesAssistedSnapshotsTest-194727756-project-admin] Running cmd (subprocess): nvme version {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 17:53:48 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-acb74ace-3246-44e6-bae3-648fd0bbb262 tempest-VolumesAssistedSnapshotsTest-194727756 tempest-VolumesAssistedSnapshotsTest-194727756-project-admin] 'nvme version' failed. Not Retrying. {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 17:53:48 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.nvmeof [None req-acb74ace-3246-44e6-bae3-648fd0bbb262 tempest-VolumesAssistedSnapshotsTest-194727756 tempest-VolumesAssistedSnapshotsTest-194727756-project-admin] nvme not present on system {{(pid=74613) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 29 17:53:48 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 17:53:48 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 17:53:48 user nova-compute[74613]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 29 17:53:48 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[b39bc7dc-7f28-476b-9f0c-5aa7f33bd19d]: (4, '') {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 17:53:48 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.lightos [None req-acb74ace-3246-44e6-bae3-648fd0bbb262 tempest-VolumesAssistedSnapshotsTest-194727756 tempest-VolumesAssistedSnapshotsTest-194727756-project-admin] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74613) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 29 17:53:48 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.lightos [None req-acb74ace-3246-44e6-bae3-648fd0bbb262 tempest-VolumesAssistedSnapshotsTest-194727756 tempest-VolumesAssistedSnapshotsTest-194727756-project-admin] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74613) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 29 17:53:48 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.lightos [None req-acb74ace-3246-44e6-bae3-648fd0bbb262 tempest-VolumesAssistedSnapshotsTest-194727756 tempest-VolumesAssistedSnapshotsTest-194727756-project-admin] LIGHTOS: no hostnqn found. {{(pid=74613) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 29 17:53:48 user nova-compute[74613]: DEBUG os_brick.utils [None req-acb74ace-3246-44e6-bae3-648fd0bbb262 tempest-VolumesAssistedSnapshotsTest-194727756 tempest-VolumesAssistedSnapshotsTest-194727756-project-admin] <== get_connector_properties: return (119ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:400972819b5', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74613) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 17:53:48 user nova-compute[74613]: DEBUG nova.virt.block_device [None req-acb74ace-3246-44e6-bae3-648fd0bbb262 tempest-VolumesAssistedSnapshotsTest-194727756 tempest-VolumesAssistedSnapshotsTest-194727756-project-admin] [instance: d4ecef60-62f9-4969-b57f-3bb45a44cc9f] Updating existing volume attachment record: b8151ad9-5d71-4e3e-bd4d-66d1c0acf67a {{(pid=74613) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 29 17:53:49 user nova-compute[74613]: DEBUG nova.network.neutron [None req-8bac3a93-0d37-4b0d-a73c-4acea7b4b15d tempest-TaggedAttachmentsTest-1438740121 tempest-TaggedAttachmentsTest-1438740121-project-member] [instance: 288b8261-8706-4696-879d-d4dd01ab553e] Updating instance_info_cache with network_info: [{"id": "abe5d419-60cc-474c-935a-60f5512894e0", "address": "fa:16:3e:14:7b:54", "network": {"id": "3a1d6151-a950-475c-af8a-d15174f89822", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1729826224-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.29", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fdebfa0bb4bf45338ce3fa1ded5cd5bd", "mtu": null, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapabe5d419-60", "ovs_interfaceid": "abe5d419-60cc-474c-935a-60f5512894e0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "5984be75-0336-4f84-a5f3-52f4e3fbeaa3", "address": "fa:16:3e:3d:db:4e", "network": {"id": "e3b3f364-2bb0-4376-b571-7fa6432b4455", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1115785953", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.185", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "fdebfa0bb4bf45338ce3fa1ded5cd5bd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5984be75-03", "ovs_interfaceid": "5984be75-0336-4f84-a5f3-52f4e3fbeaa3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74613) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 17:53:49 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-8bac3a93-0d37-4b0d-a73c-4acea7b4b15d tempest-TaggedAttachmentsTest-1438740121 tempest-TaggedAttachmentsTest-1438740121-project-member] Releasing lock "refresh_cache-288b8261-8706-4696-879d-d4dd01ab553e" {{(pid=74613) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 17:53:49 user nova-compute[74613]: DEBUG nova.virt.libvirt.vif [None req-8bac3a93-0d37-4b0d-a73c-4acea7b4b15d tempest-TaggedAttachmentsTest-1438740121 tempest-TaggedAttachmentsTest-1438740121-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-29T17:51:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-697059192',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-697059192',id=8,image_ref='4217f428-8d9d-4ee1-9614-642d26d90c46',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFUFE7U0lYNK45/HsStCT3AXLpdrJnwoY/KNgsNZxe8b6bxv4jkHRb2DHfVVdKmIkJ56BYNQ81Tfxi8bOx3gLzOij7zz7pkeTvdmFF3bs2gbkvzpJfe42Gy5jL3poiHfSw==',key_name='tempest-keypair-587676949',keypairs=<?>,launch_index=0,launched_at=2023-11-29T17:52:07Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='fdebfa0bb4bf45338ce3fa1ded5cd5bd',ramdisk_id='',reservation_id='r-cg74z5d5',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='4217f428-8d9d-4ee1-9614-642d26d90c46',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-1438740121',owner_user_name='tempest-TaggedAttachmentsTest-1438740121-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-11-29T17:52:07Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='52aa43eddf17484b9823bf13f548d22b',uuid=288b8261-8706-4696-879d-d4dd01ab553e,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "5984be75-0336-4f84-a5f3-52f4e3fbeaa3", "address": "fa:16:3e:3d:db:4e", "network": {"id": "e3b3f364-2bb0-4376-b571-7fa6432b4455", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1115785953", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.185", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "fdebfa0bb4bf45338ce3fa1ded5cd5bd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5984be75-03", "ovs_interfaceid": "5984be75-0336-4f84-a5f3-52f4e3fbeaa3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74613) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 29 17:53:49 user nova-compute[74613]: DEBUG nova.network.os_vif_util [None req-8bac3a93-0d37-4b0d-a73c-4acea7b4b15d tempest-TaggedAttachmentsTest-1438740121 tempest-TaggedAttachmentsTest-1438740121-project-member] Converting VIF {"id": "5984be75-0336-4f84-a5f3-52f4e3fbeaa3", "address": "fa:16:3e:3d:db:4e", "network": {"id": "e3b3f364-2bb0-4376-b571-7fa6432b4455", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1115785953", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.185", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "fdebfa0bb4bf45338ce3fa1ded5cd5bd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5984be75-03", "ovs_interfaceid": "5984be75-0336-4f84-a5f3-52f4e3fbeaa3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74613) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 17:53:49 user nova-compute[74613]: DEBUG nova.network.os_vif_util [None req-8bac3a93-0d37-4b0d-a73c-4acea7b4b15d tempest-TaggedAttachmentsTest-1438740121 tempest-TaggedAttachmentsTest-1438740121-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3d:db:4e,bridge_name='br-int',has_traffic_filtering=True,id=5984be75-0336-4f84-a5f3-52f4e3fbeaa3,network=Network(e3b3f364-2bb0-4376-b571-7fa6432b4455),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5984be75-03') {{(pid=74613) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 17:53:49 user nova-compute[74613]: DEBUG os_vif [None req-8bac3a93-0d37-4b0d-a73c-4acea7b4b15d tempest-TaggedAttachmentsTest-1438740121 tempest-TaggedAttachmentsTest-1438740121-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:3d:db:4e,bridge_name='br-int',has_traffic_filtering=True,id=5984be75-0336-4f84-a5f3-52f4e3fbeaa3,network=Network(e3b3f364-2bb0-4376-b571-7fa6432b4455),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5984be75-03') {{(pid=74613) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 29 17:53:49 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:53:49 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74613) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 17:53:49 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74613) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 29 17:53:49 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:53:49 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '336f9016-e213-5b67-b8de-1bea0b72faa5', '_type': 'linux-noop'}}, row=False) {{(pid=74613) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 17:53:49 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 17:53:49 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:53:49 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap5984be75-03, may_exist=True, interface_attrs={}) {{(pid=74613) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 17:53:49 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap5984be75-03, col_values=(('qos', UUID('5580e9a0-d184-47f5-9cf6-83bd8b98b3a8')),), if_exists=True) {{(pid=74613) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 17:53:49 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap5984be75-03, col_values=(('external_ids', {'iface-id': '5984be75-0336-4f84-a5f3-52f4e3fbeaa3', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:3d:db:4e', 'vm-uuid': '288b8261-8706-4696-879d-d4dd01ab553e'}),), if_exists=True) {{(pid=74613) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 17:53:49 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 17:53:49 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:53:49 user nova-compute[74613]: INFO os_vif [None req-8bac3a93-0d37-4b0d-a73c-4acea7b4b15d tempest-TaggedAttachmentsTest-1438740121 tempest-TaggedAttachmentsTest-1438740121-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:3d:db:4e,bridge_name='br-int',has_traffic_filtering=True,id=5984be75-0336-4f84-a5f3-52f4e3fbeaa3,network=Network(e3b3f364-2bb0-4376-b571-7fa6432b4455),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5984be75-03')
Nov 29 17:53:49 user nova-compute[74613]: DEBUG nova.virt.libvirt.vif [None req-8bac3a93-0d37-4b0d-a73c-4acea7b4b15d tempest-TaggedAttachmentsTest-1438740121 tempest-TaggedAttachmentsTest-1438740121-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-29T17:51:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-697059192',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-697059192',id=8,image_ref='4217f428-8d9d-4ee1-9614-642d26d90c46',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFUFE7U0lYNK45/HsStCT3AXLpdrJnwoY/KNgsNZxe8b6bxv4jkHRb2DHfVVdKmIkJ56BYNQ81Tfxi8bOx3gLzOij7zz7pkeTvdmFF3bs2gbkvzpJfe42Gy5jL3poiHfSw==',key_name='tempest-keypair-587676949',keypairs=<?>,launch_index=0,launched_at=2023-11-29T17:52:07Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='fdebfa0bb4bf45338ce3fa1ded5cd5bd',ramdisk_id='',reservation_id='r-cg74z5d5',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='4217f428-8d9d-4ee1-9614-642d26d90c46',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-1438740121',owner_user_name='tempest-TaggedAttachmentsTest-1438740121-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-11-29T17:52:07Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='52aa43eddf17484b9823bf13f548d22b',uuid=288b8261-8706-4696-879d-d4dd01ab553e,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "5984be75-0336-4f84-a5f3-52f4e3fbeaa3", "address": "fa:16:3e:3d:db:4e", "network": {"id": "e3b3f364-2bb0-4376-b571-7fa6432b4455", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1115785953", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.185", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "fdebfa0bb4bf45338ce3fa1ded5cd5bd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5984be75-03", "ovs_interfaceid": "5984be75-0336-4f84-a5f3-52f4e3fbeaa3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74613) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 29 17:53:49 user nova-compute[74613]: DEBUG nova.network.os_vif_util [None req-8bac3a93-0d37-4b0d-a73c-4acea7b4b15d tempest-TaggedAttachmentsTest-1438740121 tempest-TaggedAttachmentsTest-1438740121-project-member] Converting VIF {"id": "5984be75-0336-4f84-a5f3-52f4e3fbeaa3", "address": "fa:16:3e:3d:db:4e", "network": {"id": "e3b3f364-2bb0-4376-b571-7fa6432b4455", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1115785953", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.185", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "fdebfa0bb4bf45338ce3fa1ded5cd5bd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5984be75-03", "ovs_interfaceid": "5984be75-0336-4f84-a5f3-52f4e3fbeaa3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74613) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 17:53:49 user nova-compute[74613]: DEBUG nova.network.os_vif_util [None req-8bac3a93-0d37-4b0d-a73c-4acea7b4b15d tempest-TaggedAttachmentsTest-1438740121 tempest-TaggedAttachmentsTest-1438740121-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3d:db:4e,bridge_name='br-int',has_traffic_filtering=True,id=5984be75-0336-4f84-a5f3-52f4e3fbeaa3,network=Network(e3b3f364-2bb0-4376-b571-7fa6432b4455),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5984be75-03') {{(pid=74613) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 17:53:49 user nova-compute[74613]: DEBUG nova.virt.libvirt.guest [None req-8bac3a93-0d37-4b0d-a73c-4acea7b4b15d tempest-TaggedAttachmentsTest-1438740121 tempest-TaggedAttachmentsTest-1438740121-project-member] attach device xml: <interface type="ethernet">
Nov 29 17:53:49 user nova-compute[74613]:   <mac address="fa:16:3e:3d:db:4e"/>
Nov 29 17:53:49 user nova-compute[74613]:   <model type="virtio"/>
Nov 29 17:53:49 user nova-compute[74613]:   <mtu size="1442"/>
Nov 29 17:53:49 user nova-compute[74613]:   <target dev="tap5984be75-03"/>
Nov 29 17:53:49 user nova-compute[74613]: </interface>
Nov 29 17:53:49 user nova-compute[74613]:  {{(pid=74613) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 29 17:53:49 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:53:49 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:53:49 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:53:49 user nova-compute[74613]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cd1ac709-d1e1-44f0-ae8e-88711e7bde20 tempest-TestVolumeSwap-281539251 tempest-TestVolumeSwap-281539251-project-member] [instance: 0008521b-5a63-4ff6-8390-d343956900ed] Calling os-brick to attach iSCSI Volume {{(pid=74613) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 29 17:53:49 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd1ac709-d1e1-44f0-ae8e-88711e7bde20 tempest-TestVolumeSwap-281539251 tempest-TestVolumeSwap-281539251-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff828156890>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:a6b34bdb-5c08-4f7c-b3f5-6b68413947a8', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'SAqnwafp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74613) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 17:53:49 user nova-compute[74613]: WARNING os_brick.initiator.connectors.base [None req-cd1ac709-d1e1-44f0-ae8e-88711e7bde20 tempest-TestVolumeSwap-281539251 tempest-TestVolumeSwap-281539251-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 17:53:49 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.base [None req-cd1ac709-d1e1-44f0-ae8e-88711e7bde20 tempest-TestVolumeSwap-281539251 tempest-TestVolumeSwap-281539251-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 17:53:49 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.base [None req-cd1ac709-d1e1-44f0-ae8e-88711e7bde20 tempest-TestVolumeSwap-281539251 tempest-TestVolumeSwap-281539251-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 17:53:49 user nova-compute[74613]: WARNING os_brick.initiator.connectors.base [None req-cd1ac709-d1e1-44f0-ae8e-88711e7bde20 tempest-TestVolumeSwap-281539251 tempest-TestVolumeSwap-281539251-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 17:53:49 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.base [None req-cd1ac709-d1e1-44f0-ae8e-88711e7bde20 tempest-TestVolumeSwap-281539251 tempest-TestVolumeSwap-281539251-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a6b34bdb-5c08-4f7c-b3f5-6b68413947a8" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 17:53:49 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.base [None req-cd1ac709-d1e1-44f0-ae8e-88711e7bde20 tempest-TestVolumeSwap-281539251 tempest-TestVolumeSwap-281539251-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a6b34bdb-5c08-4f7c-b3f5-6b68413947a8" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 17:53:49 user nova-compute[74613]: INFO os_brick.initiator.connectors.iscsi [None req-cd1ac709-d1e1-44f0-ae8e-88711e7bde20 tempest-TestVolumeSwap-281539251 tempest-TestVolumeSwap-281539251-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 29 17:53:49 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a6b34bdb-5c08-4f7c-b3f5-6b68413947a8 -p 172.16.0.220:3260 {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 17:53:49 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a6b34bdb-5c08-4f7c-b3f5-6b68413947a8 -p 172.16.0.220:3260" returned: 21 in 0.023s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 17:53:49 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[f14bc61c-24d6-4b19-80e5-9b97de3f0636]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 17:53:49 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd1ac709-d1e1-44f0-ae8e-88711e7bde20 tempest-TestVolumeSwap-281539251 tempest-TestVolumeSwap-281539251-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 29 17:53:49 user nova-compute[74613]:  {{(pid=74613) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 17:53:49 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a6b34bdb-5c08-4f7c-b3f5-6b68413947a8 -p 172.16.0.220:3260 --interface default --op new {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 17:53:49 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a6b34bdb-5c08-4f7c-b3f5-6b68413947a8 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 17:53:49 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[65ad6fc9-0dab-4611-a8dc-67b4986d4939]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a6b34bdb-5c08-4f7c-b3f5-6b68413947a8] added\n', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 17:53:49 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd1ac709-d1e1-44f0-ae8e-88711e7bde20 tempest-TestVolumeSwap-281539251 tempest-TestVolumeSwap-281539251-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a6b34bdb-5c08-4f7c-b3f5-6b68413947a8] added
Nov 29 17:53:49 user nova-compute[74613]:  stderr= {{(pid=74613) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 17:53:49 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a6b34bdb-5c08-4f7c-b3f5-6b68413947a8 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 17:53:49 user nova-compute[74613]: DEBUG nova.compute.manager [req-fbd0fa9d-1dae-4365-9067-b9ecf12c2343 req-7684e9c1-0867-4f35-aad0-73f209a31ae1 service nova] [instance: 288b8261-8706-4696-879d-d4dd01ab553e] Received event network-vif-plugged-5984be75-0336-4f84-a5f3-52f4e3fbeaa3 {{(pid=74613) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 17:53:49 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-fbd0fa9d-1dae-4365-9067-b9ecf12c2343 req-7684e9c1-0867-4f35-aad0-73f209a31ae1 service nova] Acquiring lock "288b8261-8706-4696-879d-d4dd01ab553e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 17:53:49 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-fbd0fa9d-1dae-4365-9067-b9ecf12c2343 req-7684e9c1-0867-4f35-aad0-73f209a31ae1 service nova] Lock "288b8261-8706-4696-879d-d4dd01ab553e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 17:53:49 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-fbd0fa9d-1dae-4365-9067-b9ecf12c2343 req-7684e9c1-0867-4f35-aad0-73f209a31ae1 service nova] Lock "288b8261-8706-4696-879d-d4dd01ab553e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 17:53:49 user nova-compute[74613]: DEBUG nova.compute.manager [req-fbd0fa9d-1dae-4365-9067-b9ecf12c2343 req-7684e9c1-0867-4f35-aad0-73f209a31ae1 service nova] [instance: 288b8261-8706-4696-879d-d4dd01ab553e] No waiting events found dispatching network-vif-plugged-5984be75-0336-4f84-a5f3-52f4e3fbeaa3 {{(pid=74613) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 17:53:49 user nova-compute[74613]: WARNING nova.compute.manager [req-fbd0fa9d-1dae-4365-9067-b9ecf12c2343 req-7684e9c1-0867-4f35-aad0-73f209a31ae1 service nova] [instance: 288b8261-8706-4696-879d-d4dd01ab553e] Received unexpected event network-vif-plugged-5984be75-0336-4f84-a5f3-52f4e3fbeaa3 for instance with vm_state active and task_state None.
Nov 29 17:53:49 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a6b34bdb-5c08-4f7c-b3f5-6b68413947a8 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.024s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 17:53:49 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc3c5d77-5ab5-449a-a58b-4160f2321518]: (4, ('', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 17:53:49 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd1ac709-d1e1-44f0-ae8e-88711e7bde20 tempest-TestVolumeSwap-281539251 tempest-TestVolumeSwap-281539251-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74613) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 17:53:49 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a6b34bdb-5c08-4f7c-b3f5-6b68413947a8 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 17:53:49 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a6b34bdb-5c08-4f7c-b3f5-6b68413947a8 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.029s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 17:53:49 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[ecf6ba42-c26b-4805-b77e-56738f2309cf]: (4, ('', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 17:53:49 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd1ac709-d1e1-44f0-ae8e-88711e7bde20 tempest-TestVolumeSwap-281539251 tempest-TestVolumeSwap-281539251-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74613) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 17:53:49 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a6b34bdb-5c08-4f7c-b3f5-6b68413947a8 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v SAqnwafp {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 17:53:49 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a6b34bdb-5c08-4f7c-b3f5-6b68413947a8 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v SAqnwafp" returned: 0 in 0.027s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 17:53:49 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[af7bb8c4-fad6-4823-a13a-e89cbda1da0a]: (4, ('', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 17:53:49 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd1ac709-d1e1-44f0-ae8e-88711e7bde20 tempest-TestVolumeSwap-281539251 tempest-TestVolumeSwap-281539251-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'SAqnwafp'): stdout= stderr= {{(pid=74613) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 17:53:49 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a6b34bdb-5c08-4f7c-b3f5-6b68413947a8 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 17:53:49 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a6b34bdb-5c08-4f7c-b3f5-6b68413947a8 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.026s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 17:53:49 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[d35050b5-0766-4479-af4d-c7d464b85197]: (4, ('', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 17:53:49 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd1ac709-d1e1-44f0-ae8e-88711e7bde20 tempest-TestVolumeSwap-281539251 tempest-TestVolumeSwap-281539251-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74613) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 17:53:49 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 17:53:49 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-8bac3a93-0d37-4b0d-a73c-4acea7b4b15d tempest-TaggedAttachmentsTest-1438740121 tempest-TaggedAttachmentsTest-1438740121-project-member] No BDM found with device name vda, not building metadata. {{(pid=74613) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 17:53:49 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-8bac3a93-0d37-4b0d-a73c-4acea7b4b15d tempest-TaggedAttachmentsTest-1438740121 tempest-TaggedAttachmentsTest-1438740121-project-member] No BDM found with device name hda, not building metadata. {{(pid=74613) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 17:53:49 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-8bac3a93-0d37-4b0d-a73c-4acea7b4b15d tempest-TaggedAttachmentsTest-1438740121 tempest-TaggedAttachmentsTest-1438740121-project-member] No VIF found with MAC fa:16:3e:14:7b:54, not building metadata {{(pid=74613) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 29 17:53:49 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 17:53:49 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b05cde4-68cd-4add-b749-6b490521d878]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fbbdc3d2-136d-4fba-b6ba-f27f35a0733b (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:24920064-fc81-4408-97d1-d8eff97a7554 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8230f3a2-63d8-46cb-8ec7-ceb89fb04e53 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d1f798a1-4f7b-4b9a-8180-fa8f4eb89bf0 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:850c1226-267c-42c0-945f-bfc219c8e88b (non-flash)\n', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 17:53:49 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd1ac709-d1e1-44f0-ae8e-88711e7bde20 tempest-TestVolumeSwap-281539251 tempest-TestVolumeSwap-281539251-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fbbdc3d2-136d-4fba-b6ba-f27f35a0733b (non-flash)
Nov 29 17:53:49 user nova-compute[74613]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:24920064-fc81-4408-97d1-d8eff97a7554 (non-flash)
Nov 29 17:53:49 user nova-compute[74613]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8230f3a2-63d8-46cb-8ec7-ceb89fb04e53 (non-flash)
Nov 29 17:53:49 user nova-compute[74613]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d1f798a1-4f7b-4b9a-8180-fa8f4eb89bf0 (non-flash)
Nov 29 17:53:49 user nova-compute[74613]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:850c1226-267c-42c0-945f-bfc219c8e88b (non-flash)
Nov 29 17:53:49 user nova-compute[74613]:  stderr= {{(pid=74613) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 17:53:49 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd1ac709-d1e1-44f0-ae8e-88711e7bde20 tempest-TestVolumeSwap-281539251 tempest-TestVolumeSwap-281539251-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fbbdc3d2-136d-4fba-b6ba-f27f35a0733b (non-flash)
Nov 29 17:53:49 user nova-compute[74613]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:24920064-fc81-4408-97d1-d8eff97a7554 (non-flash)
Nov 29 17:53:49 user nova-compute[74613]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8230f3a2-63d8-46cb-8ec7-ceb89fb04e53 (non-flash)
Nov 29 17:53:49 user nova-compute[74613]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d1f798a1-4f7b-4b9a-8180-fa8f4eb89bf0 (non-flash)
Nov 29 17:53:49 user nova-compute[74613]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:850c1226-267c-42c0-945f-bfc219c8e88b (non-flash)
Nov 29 17:53:49 user nova-compute[74613]:  stderr= {{(pid=74613) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 17:53:49 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a6b34bdb-5c08-4f7c-b3f5-6b68413947a8 -p 172.16.0.220:3260 --login {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 17:53:49 user nova-compute[74613]: DEBUG nova.virt.libvirt.guest [None req-8bac3a93-0d37-4b0d-a73c-4acea7b4b15d tempest-TaggedAttachmentsTest-1438740121 tempest-TaggedAttachmentsTest-1438740121-project-member] set metadata xml: <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 29 17:53:49 user nova-compute[74613]:   <nova:package version="0.0.0"/>
Nov 29 17:53:49 user nova-compute[74613]:   <nova:name>tempest-device-tagging-server-697059192</nova:name>
Nov 29 17:53:49 user nova-compute[74613]:   <nova:creationTime>2023-11-29 17:53:49</nova:creationTime>
Nov 29 17:53:49 user nova-compute[74613]:   <nova:flavor name="m1.tiny">
Nov 29 17:53:49 user nova-compute[74613]:     <nova:memory>512</nova:memory>
Nov 29 17:53:49 user nova-compute[74613]:     <nova:disk>1</nova:disk>
Nov 29 17:53:49 user nova-compute[74613]:     <nova:swap>0</nova:swap>
Nov 29 17:53:49 user nova-compute[74613]:     <nova:ephemeral>0</nova:ephemeral>
Nov 29 17:53:49 user nova-compute[74613]:     <nova:vcpus>1</nova:vcpus>
Nov 29 17:53:49 user nova-compute[74613]:   </nova:flavor>
Nov 29 17:53:49 user nova-compute[74613]:   <nova:owner>
Nov 29 17:53:49 user nova-compute[74613]:     <nova:user uuid="52aa43eddf17484b9823bf13f548d22b">tempest-TaggedAttachmentsTest-1438740121-project-member</nova:user>
Nov 29 17:53:49 user nova-compute[74613]:     <nova:project uuid="fdebfa0bb4bf45338ce3fa1ded5cd5bd">tempest-TaggedAttachmentsTest-1438740121</nova:project>
Nov 29 17:53:49 user nova-compute[74613]:   </nova:owner>
Nov 29 17:53:49 user nova-compute[74613]:   <nova:root type="image" uuid="4217f428-8d9d-4ee1-9614-642d26d90c46"/>
Nov 29 17:53:49 user nova-compute[74613]:   <nova:ports>
Nov 29 17:53:49 user nova-compute[74613]:     <nova:port uuid="abe5d419-60cc-474c-935a-60f5512894e0">
Nov 29 17:53:49 user nova-compute[74613]:       <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Nov 29 17:53:49 user nova-compute[74613]:     </nova:port>
Nov 29 17:53:49 user nova-compute[74613]:     <nova:port uuid="5984be75-0336-4f84-a5f3-52f4e3fbeaa3">
Nov 29 17:53:49 user nova-compute[74613]:       <nova:ip type="fixed" address="10.10.10.185" ipVersion="4"/>
Nov 29 17:53:49 user nova-compute[74613]:     </nova:port>
Nov 29 17:53:49 user nova-compute[74613]:   </nova:ports>
Nov 29 17:53:49 user nova-compute[74613]: </nova:instance>
Nov 29 17:53:49 user nova-compute[74613]:  {{(pid=74613) set_metadata /opt/stack/nova/nova/virt/libvirt/guest.py:359}}
Nov 29 17:53:49 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-8bac3a93-0d37-4b0d-a73c-4acea7b4b15d tempest-TaggedAttachmentsTest-1438740121 tempest-TaggedAttachmentsTest-1438740121-project-member] Lock "interface-288b8261-8706-4696-879d-d4dd01ab553e-None" "released" by "nova.compute.manager.ComputeManager.attach_interface.<locals>.do_attach_interface" :: held 3.597s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 17:53:49 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a6b34bdb-5c08-4f7c-b3f5-6b68413947a8 -p 172.16.0.220:3260 --login" returned: 0 in 0.083s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 17:53:49 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[760c994c-d709-42ae-b91f-0aaabf90da99]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:a6b34bdb-5c08-4f7c-b3f5-6b68413947a8, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:a6b34bdb-5c08-4f7c-b3f5-6b68413947a8, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 17:53:49 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd1ac709-d1e1-44f0-ae8e-88711e7bde20 tempest-TestVolumeSwap-281539251 tempest-TestVolumeSwap-281539251-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:a6b34bdb-5c08-4f7c-b3f5-6b68413947a8, portal: 172.16.0.220,3260]
Nov 29 17:53:49 user nova-compute[74613]: Login to [iface: default, target: iqn.2010-10.org.openstack:a6b34bdb-5c08-4f7c-b3f5-6b68413947a8, portal: 172.16.0.220,3260] successful.
Nov 29 17:53:49 user nova-compute[74613]:  stderr= {{(pid=74613) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 17:53:49 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a6b34bdb-5c08-4f7c-b3f5-6b68413947a8 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 17:53:49 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a6b34bdb-5c08-4f7c-b3f5-6b68413947a8 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.026s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 17:53:49 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[2eda89bb-d448-4fe9-861a-6002fbac92ec]: (4, ('', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 17:53:49 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd1ac709-d1e1-44f0-ae8e-88711e7bde20 tempest-TestVolumeSwap-281539251 tempest-TestVolumeSwap-281539251-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74613) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 17:53:49 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 17:53:49 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 17:53:49 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[3153dd6d-fef4-48a7-a141-283cc3bcd3d1]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fbbdc3d2-136d-4fba-b6ba-f27f35a0733b (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:24920064-fc81-4408-97d1-d8eff97a7554 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8230f3a2-63d8-46cb-8ec7-ceb89fb04e53 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d1f798a1-4f7b-4b9a-8180-fa8f4eb89bf0 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:850c1226-267c-42c0-945f-bfc219c8e88b (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a6b34bdb-5c08-4f7c-b3f5-6b68413947a8 (non-flash)\n', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 17:53:49 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd1ac709-d1e1-44f0-ae8e-88711e7bde20 tempest-TestVolumeSwap-281539251 tempest-TestVolumeSwap-281539251-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fbbdc3d2-136d-4fba-b6ba-f27f35a0733b (non-flash)
Nov 29 17:53:49 user nova-compute[74613]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:24920064-fc81-4408-97d1-d8eff97a7554 (non-flash)
Nov 29 17:53:49 user nova-compute[74613]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8230f3a2-63d8-46cb-8ec7-ceb89fb04e53 (non-flash)
Nov 29 17:53:49 user nova-compute[74613]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d1f798a1-4f7b-4b9a-8180-fa8f4eb89bf0 (non-flash)
Nov 29 17:53:49 user nova-compute[74613]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:850c1226-267c-42c0-945f-bfc219c8e88b (non-flash)
Nov 29 17:53:49 user nova-compute[74613]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a6b34bdb-5c08-4f7c-b3f5-6b68413947a8 (non-flash)
Nov 29 17:53:49 user nova-compute[74613]:  stderr= {{(pid=74613) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 17:53:49 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd1ac709-d1e1-44f0-ae8e-88711e7bde20 tempest-TestVolumeSwap-281539251 tempest-TestVolumeSwap-281539251-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fbbdc3d2-136d-4fba-b6ba-f27f35a0733b (non-flash)
Nov 29 17:53:49 user nova-compute[74613]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:24920064-fc81-4408-97d1-d8eff97a7554 (non-flash)
Nov 29 17:53:49 user nova-compute[74613]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8230f3a2-63d8-46cb-8ec7-ceb89fb04e53 (non-flash)
Nov 29 17:53:49 user nova-compute[74613]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d1f798a1-4f7b-4b9a-8180-fa8f4eb89bf0 (non-flash)
Nov 29 17:53:49 user nova-compute[74613]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:850c1226-267c-42c0-945f-bfc219c8e88b (non-flash)
Nov 29 17:53:49 user nova-compute[74613]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a6b34bdb-5c08-4f7c-b3f5-6b68413947a8 (non-flash)
Nov 29 17:53:49 user nova-compute[74613]:  stderr= {{(pid=74613) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 17:53:49 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.base [None req-cd1ac709-d1e1-44f0-ae8e-88711e7bde20 tempest-TestVolumeSwap-281539251 tempest-TestVolumeSwap-281539251-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a6b34bdb-5c08-4f7c-b3f5-6b68413947a8" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.357s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 17:53:49 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd1ac709-d1e1-44f0-ae8e-88711e7bde20 tempest-TestVolumeSwap-281539251 tempest-TestVolumeSwap-281539251-project-member] Connected to 172.16.0.220:3260 {{(pid=74613) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 29 17:53:49 user nova-compute[74613]: DEBUG os_brick.initiator.linuxscsi [None req-cd1ac709-d1e1-44f0-ae8e-88711e7bde20 tempest-TestVolumeSwap-281539251 tempest-TestVolumeSwap-281539251-project-member] HCTL ('38', '-', '-', 0) found on session 8 with lun 0 {{(pid=74613) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 29 17:53:49 user nova-compute[74613]: DEBUG os_brick.initiator.linuxscsi [None req-cd1ac709-d1e1-44f0-ae8e-88711e7bde20 tempest-TestVolumeSwap-281539251 tempest-TestVolumeSwap-281539251-project-member] Scanning host 38 c: -, t: -, l: 0) {{(pid=74613) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 29 17:53:49 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host38/scan {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 17:53:49 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host38/scan" returned: 0 in 0.016s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 17:53:49 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[00bedbed-c730-4a82-9ce4-cb4dd6c57e1e]: (4, ('- - 0', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 17:53:49 user nova-compute[74613]: DEBUG os_brick.initiator.linuxscsi [None req-cd1ac709-d1e1-44f0-ae8e-88711e7bde20 tempest-TestVolumeSwap-281539251 tempest-TestVolumeSwap-281539251-project-member] Searching for a device in session 8 and hctl ['38', '*', '*', 0] yield: sdg {{(pid=74613) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 29 17:53:49 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd1ac709-d1e1-44f0-ae8e-88711e7bde20 tempest-TestVolumeSwap-281539251 tempest-TestVolumeSwap-281539251-project-member] Connected to sdg using {'target_iqn': 'iqn.2010-10.org.openstack:a6b34bdb-5c08-4f7c-b3f5-6b68413947a8', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'SAqnwafp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74613) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 29 17:53:49 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:53:49 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:53:49 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:53:49 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:53:50 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:53:50 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-f4a95811-5656-40b2-994e-6d94df01e860 tempest-TaggedAttachmentsTest-1438740121 tempest-TaggedAttachmentsTest-1438740121-project-member] Acquiring lock "288b8261-8706-4696-879d-d4dd01ab553e" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 17:53:50 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-f4a95811-5656-40b2-994e-6d94df01e860 tempest-TaggedAttachmentsTest-1438740121 tempest-TaggedAttachmentsTest-1438740121-project-member] Lock "288b8261-8706-4696-879d-d4dd01ab553e" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 17:53:50 user nova-compute[74613]: DEBUG nova.objects.instance [None req-f4a95811-5656-40b2-994e-6d94df01e860 tempest-TaggedAttachmentsTest-1438740121 tempest-TaggedAttachmentsTest-1438740121-project-member] Lazy-loading 'flavor' on Instance uuid 288b8261-8706-4696-879d-d4dd01ab553e {{(pid=74613) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 17:53:50 user nova-compute[74613]: DEBUG nova.compute.manager [req-769141be-86f8-4655-b096-3b6acfe22fec req-108193fa-ca45-41b2-a06b-4298bd4d6091 service nova] [instance: 288b8261-8706-4696-879d-d4dd01ab553e] Received event network-changed-5984be75-0336-4f84-a5f3-52f4e3fbeaa3 {{(pid=74613) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 17:53:50 user nova-compute[74613]: DEBUG nova.compute.manager [req-769141be-86f8-4655-b096-3b6acfe22fec req-108193fa-ca45-41b2-a06b-4298bd4d6091 service nova] [instance: 288b8261-8706-4696-879d-d4dd01ab553e] Refreshing instance network info cache due to event network-changed-5984be75-0336-4f84-a5f3-52f4e3fbeaa3. {{(pid=74613) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 17:53:50 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-769141be-86f8-4655-b096-3b6acfe22fec req-108193fa-ca45-41b2-a06b-4298bd4d6091 service nova] Acquiring lock "refresh_cache-288b8261-8706-4696-879d-d4dd01ab553e" {{(pid=74613) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 17:53:50 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-769141be-86f8-4655-b096-3b6acfe22fec req-108193fa-ca45-41b2-a06b-4298bd4d6091 service nova] Acquired lock "refresh_cache-288b8261-8706-4696-879d-d4dd01ab553e" {{(pid=74613) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 17:53:50 user nova-compute[74613]: DEBUG nova.network.neutron [req-769141be-86f8-4655-b096-3b6acfe22fec req-108193fa-ca45-41b2-a06b-4298bd4d6091 service nova] [instance: 288b8261-8706-4696-879d-d4dd01ab553e] Refreshing network info cache for port 5984be75-0336-4f84-a5f3-52f4e3fbeaa3 {{(pid=74613) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 17:53:50 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-f4a95811-5656-40b2-994e-6d94df01e860 tempest-TaggedAttachmentsTest-1438740121 tempest-TaggedAttachmentsTest-1438740121-project-member] Lock "288b8261-8706-4696-879d-d4dd01ab553e" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.072s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 17:53:50 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-f4a95811-5656-40b2-994e-6d94df01e860 tempest-TaggedAttachmentsTest-1438740121 tempest-TaggedAttachmentsTest-1438740121-project-member] Acquiring lock "288b8261-8706-4696-879d-d4dd01ab553e" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 17:53:50 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-f4a95811-5656-40b2-994e-6d94df01e860 tempest-TaggedAttachmentsTest-1438740121 tempest-TaggedAttachmentsTest-1438740121-project-member] Lock "288b8261-8706-4696-879d-d4dd01ab553e" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.004s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 17:53:50 user nova-compute[74613]: INFO nova.compute.manager [None req-f4a95811-5656-40b2-994e-6d94df01e860 tempest-TaggedAttachmentsTest-1438740121 tempest-TaggedAttachmentsTest-1438740121-project-member] [instance: 288b8261-8706-4696-879d-d4dd01ab553e] Attaching volume b7efc2d5-5149-408b-980d-58492994fd4f to /dev/vdb
Nov 29 17:53:50 user nova-compute[74613]: DEBUG os_brick.utils [None req-f4a95811-5656-40b2-994e-6d94df01e860 tempest-TaggedAttachmentsTest-1438740121 tempest-TaggedAttachmentsTest-1438740121-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74613) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 17:53:50 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 17:53:50 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 17:53:50 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[11a66a87-0619-42f5-967e-6dcb9954c828]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:400972819b5\n', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 17:53:50 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 17:53:50 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 17:53:50 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[68a09cd9-ae3d-481b-bf8a-362cd8fd780e]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 17:53:50 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 17:53:50 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 17:53:50 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[79b65707-4fbe-40ca-bf86-73c60229069b]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 17:53:50 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[0696b8ed-7bd4-40a1-b5e5-4af79d4359c4]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 17:53:50 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-f4a95811-5656-40b2-994e-6d94df01e860 tempest-TaggedAttachmentsTest-1438740121 tempest-TaggedAttachmentsTest-1438740121-project-member] Running cmd (subprocess): nvme version {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 17:53:50 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-f4a95811-5656-40b2-994e-6d94df01e860 tempest-TaggedAttachmentsTest-1438740121 tempest-TaggedAttachmentsTest-1438740121-project-member] 'nvme version' failed. Not Retrying. {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 17:53:50 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.nvmeof [None req-f4a95811-5656-40b2-994e-6d94df01e860 tempest-TaggedAttachmentsTest-1438740121 tempest-TaggedAttachmentsTest-1438740121-project-member] nvme not present on system {{(pid=74613) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 29 17:53:50 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 17:53:50 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 17:53:50 user nova-compute[74613]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 29 17:53:50 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a956939-4672-4a1d-ad5e-6f405b1d4acf]: (4, '') {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 17:53:50 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.lightos [None req-f4a95811-5656-40b2-994e-6d94df01e860 tempest-TaggedAttachmentsTest-1438740121 tempest-TaggedAttachmentsTest-1438740121-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74613) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 29 17:53:50 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.lightos [None req-f4a95811-5656-40b2-994e-6d94df01e860 tempest-TaggedAttachmentsTest-1438740121 tempest-TaggedAttachmentsTest-1438740121-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74613) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 29 17:53:50 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.lightos [None req-f4a95811-5656-40b2-994e-6d94df01e860 tempest-TaggedAttachmentsTest-1438740121 tempest-TaggedAttachmentsTest-1438740121-project-member] LIGHTOS: no hostnqn found. {{(pid=74613) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 29 17:53:50 user nova-compute[74613]: DEBUG os_brick.utils [None req-f4a95811-5656-40b2-994e-6d94df01e860 tempest-TaggedAttachmentsTest-1438740121 tempest-TaggedAttachmentsTest-1438740121-project-member] <== get_connector_properties: return (129ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:400972819b5', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74613) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 17:53:50 user nova-compute[74613]: DEBUG nova.virt.block_device [None req-f4a95811-5656-40b2-994e-6d94df01e860 tempest-TaggedAttachmentsTest-1438740121 tempest-TaggedAttachmentsTest-1438740121-project-member] [instance: 288b8261-8706-4696-879d-d4dd01ab553e] Updating existing volume attachment record: 79aec4d1-bb4b-4863-8592-82dd42e31259 {{(pid=74613) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 29 17:53:50 user nova-compute[74613]: DEBUG nova.network.neutron [req-769141be-86f8-4655-b096-3b6acfe22fec req-108193fa-ca45-41b2-a06b-4298bd4d6091 service nova] [instance: 288b8261-8706-4696-879d-d4dd01ab553e] Updated VIF entry in instance network info cache for port 5984be75-0336-4f84-a5f3-52f4e3fbeaa3. {{(pid=74613) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 17:53:50 user nova-compute[74613]: DEBUG nova.network.neutron [req-769141be-86f8-4655-b096-3b6acfe22fec req-108193fa-ca45-41b2-a06b-4298bd4d6091 service nova] [instance: 288b8261-8706-4696-879d-d4dd01ab553e] Updating instance_info_cache with network_info: [{"id": "abe5d419-60cc-474c-935a-60f5512894e0", "address": "fa:16:3e:14:7b:54", "network": {"id": "3a1d6151-a950-475c-af8a-d15174f89822", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1729826224-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.29", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fdebfa0bb4bf45338ce3fa1ded5cd5bd", "mtu": null, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapabe5d419-60", "ovs_interfaceid": "abe5d419-60cc-474c-935a-60f5512894e0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "5984be75-0336-4f84-a5f3-52f4e3fbeaa3", "address": "fa:16:3e:3d:db:4e", "network": {"id": "e3b3f364-2bb0-4376-b571-7fa6432b4455", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1115785953", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.185", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "fdebfa0bb4bf45338ce3fa1ded5cd5bd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5984be75-03", "ovs_interfaceid": "5984be75-0336-4f84-a5f3-52f4e3fbeaa3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74613) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 17:53:50 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-769141be-86f8-4655-b096-3b6acfe22fec req-108193fa-ca45-41b2-a06b-4298bd4d6091 service nova] Releasing lock "refresh_cache-288b8261-8706-4696-879d-d4dd01ab553e" {{(pid=74613) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 17:53:50 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.base [None req-cd1ac709-d1e1-44f0-ae8e-88711e7bde20 tempest-TestVolumeSwap-281539251 tempest-TestVolumeSwap-281539251-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.391s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 17:53:50 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd1ac709-d1e1-44f0-ae8e-88711e7bde20 tempest-TestVolumeSwap-281539251 tempest-TestVolumeSwap-281539251-project-member] <== connect_volume: return (1392ms) {'type': 'block', 'scsi_wwn': '26635343864373431', 'path': '/dev/sdg'} {{(pid=74613) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 17:53:50 user nova-compute[74613]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cd1ac709-d1e1-44f0-ae8e-88711e7bde20 tempest-TestVolumeSwap-281539251 tempest-TestVolumeSwap-281539251-project-member] [instance: 0008521b-5a63-4ff6-8390-d343956900ed] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26635343864373431', 'path': '/dev/sdg'} {{(pid=74613) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 29 17:53:50 user nova-compute[74613]: DEBUG nova.objects.instance [None req-cd1ac709-d1e1-44f0-ae8e-88711e7bde20 tempest-TestVolumeSwap-281539251 tempest-TestVolumeSwap-281539251-project-member] Lazy-loading 'flavor' on Instance uuid 0008521b-5a63-4ff6-8390-d343956900ed {{(pid=74613) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 17:53:50 user nova-compute[74613]: DEBUG nova.virt.libvirt.guest [None req-cd1ac709-d1e1-44f0-ae8e-88711e7bde20 tempest-TestVolumeSwap-281539251 tempest-TestVolumeSwap-281539251-project-member] attach device xml: <disk type="block" device="disk">
Nov 29 17:53:50 user nova-compute[74613]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 17:53:50 user nova-compute[74613]:   <source dev="/dev/sdg"/>
Nov 29 17:53:50 user nova-compute[74613]:   <target dev="vdb" bus="virtio"/>
Nov 29 17:53:50 user nova-compute[74613]:   <serial>a6b34bdb-5c08-4f7c-b3f5-6b68413947a8</serial>
Nov 29 17:53:50 user nova-compute[74613]: </disk>
Nov 29 17:53:50 user nova-compute[74613]:  {{(pid=74613) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 29 17:53:51 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-cd1ac709-d1e1-44f0-ae8e-88711e7bde20 tempest-TestVolumeSwap-281539251 tempest-TestVolumeSwap-281539251-project-member] No BDM found with device name vda, not building metadata. {{(pid=74613) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 17:53:51 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-cd1ac709-d1e1-44f0-ae8e-88711e7bde20 tempest-TestVolumeSwap-281539251 tempest-TestVolumeSwap-281539251-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74613) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 17:53:51 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-cd1ac709-d1e1-44f0-ae8e-88711e7bde20 tempest-TestVolumeSwap-281539251 tempest-TestVolumeSwap-281539251-project-member] No VIF found with MAC fa:16:3e:7e:c4:dc, not building metadata {{(pid=74613) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 29 17:53:51 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-cd1ac709-d1e1-44f0-ae8e-88711e7bde20 tempest-TestVolumeSwap-281539251 tempest-TestVolumeSwap-281539251-project-member] Lock "0008521b-5a63-4ff6-8390-d343956900ed" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 10.363s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 17:53:51 user nova-compute[74613]: DEBUG nova.compute.manager [req-e07aea2d-d0e5-4d36-ad71-da85953029e3 req-19ca9845-80e0-45e3-8046-1a8a9550bfef service nova] [instance: 288b8261-8706-4696-879d-d4dd01ab553e] Received event network-vif-plugged-5984be75-0336-4f84-a5f3-52f4e3fbeaa3 {{(pid=74613) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 17:53:51 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-e07aea2d-d0e5-4d36-ad71-da85953029e3 req-19ca9845-80e0-45e3-8046-1a8a9550bfef service nova] Acquiring lock "288b8261-8706-4696-879d-d4dd01ab553e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 17:53:51 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-e07aea2d-d0e5-4d36-ad71-da85953029e3 req-19ca9845-80e0-45e3-8046-1a8a9550bfef service nova] Lock "288b8261-8706-4696-879d-d4dd01ab553e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 17:53:51 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-e07aea2d-d0e5-4d36-ad71-da85953029e3 req-19ca9845-80e0-45e3-8046-1a8a9550bfef service nova] Lock "288b8261-8706-4696-879d-d4dd01ab553e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 17:53:51 user nova-compute[74613]: DEBUG nova.compute.manager [req-e07aea2d-d0e5-4d36-ad71-da85953029e3 req-19ca9845-80e0-45e3-8046-1a8a9550bfef service nova] [instance: 288b8261-8706-4696-879d-d4dd01ab553e] No waiting events found dispatching network-vif-plugged-5984be75-0336-4f84-a5f3-52f4e3fbeaa3 {{(pid=74613) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 17:53:51 user nova-compute[74613]: WARNING nova.compute.manager [req-e07aea2d-d0e5-4d36-ad71-da85953029e3 req-19ca9845-80e0-45e3-8046-1a8a9550bfef service nova] [instance: 288b8261-8706-4696-879d-d4dd01ab553e] Received unexpected event network-vif-plugged-5984be75-0336-4f84-a5f3-52f4e3fbeaa3 for instance with vm_state active and task_state None.
Nov 29 17:53:51 user nova-compute[74613]: DEBUG nova.compute.manager [req-e07aea2d-d0e5-4d36-ad71-da85953029e3 req-19ca9845-80e0-45e3-8046-1a8a9550bfef service nova] [instance: 8de2ffb3-e264-49f7-8581-6eae21adcaeb] Received event network-changed-51faf82e-9447-4f14-8724-e7939afb4d98 {{(pid=74613) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 17:53:51 user nova-compute[74613]: DEBUG nova.compute.manager [req-e07aea2d-d0e5-4d36-ad71-da85953029e3 req-19ca9845-80e0-45e3-8046-1a8a9550bfef service nova] [instance: 8de2ffb3-e264-49f7-8581-6eae21adcaeb] Refreshing instance network info cache due to event network-changed-51faf82e-9447-4f14-8724-e7939afb4d98. {{(pid=74613) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 17:53:51 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-e07aea2d-d0e5-4d36-ad71-da85953029e3 req-19ca9845-80e0-45e3-8046-1a8a9550bfef service nova] Acquiring lock "refresh_cache-8de2ffb3-e264-49f7-8581-6eae21adcaeb" {{(pid=74613) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 17:53:51 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-e07aea2d-d0e5-4d36-ad71-da85953029e3 req-19ca9845-80e0-45e3-8046-1a8a9550bfef service nova] Acquired lock "refresh_cache-8de2ffb3-e264-49f7-8581-6eae21adcaeb" {{(pid=74613) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 17:53:51 user nova-compute[74613]: DEBUG nova.network.neutron [req-e07aea2d-d0e5-4d36-ad71-da85953029e3 req-19ca9845-80e0-45e3-8046-1a8a9550bfef service nova] [instance: 8de2ffb3-e264-49f7-8581-6eae21adcaeb] Refreshing network info cache for port 51faf82e-9447-4f14-8724-e7939afb4d98 {{(pid=74613) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 17:53:52 user nova-compute[74613]: DEBUG nova.network.neutron [req-e07aea2d-d0e5-4d36-ad71-da85953029e3 req-19ca9845-80e0-45e3-8046-1a8a9550bfef service nova] [instance: 8de2ffb3-e264-49f7-8581-6eae21adcaeb] Updated VIF entry in instance network info cache for port 51faf82e-9447-4f14-8724-e7939afb4d98. {{(pid=74613) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 17:53:52 user nova-compute[74613]: DEBUG nova.network.neutron [req-e07aea2d-d0e5-4d36-ad71-da85953029e3 req-19ca9845-80e0-45e3-8046-1a8a9550bfef service nova] [instance: 8de2ffb3-e264-49f7-8581-6eae21adcaeb] Updating instance_info_cache with network_info: [{"id": "51faf82e-9447-4f14-8724-e7939afb4d98", "address": "fa:16:3e:97:b9:00", "network": {"id": "59f09b07-14df-494d-bb8f-3b5d4a7b9711", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-981004620-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.191", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8d9b3ae2eee040bb84ff5065d07552d4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap51faf82e-94", "ovs_interfaceid": "51faf82e-9447-4f14-8724-e7939afb4d98", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74613) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 17:53:52 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-e07aea2d-d0e5-4d36-ad71-da85953029e3 req-19ca9845-80e0-45e3-8046-1a8a9550bfef service nova] Releasing lock "refresh_cache-8de2ffb3-e264-49f7-8581-6eae21adcaeb" {{(pid=74613) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 17:53:52 user nova-compute[74613]: INFO nova.compute.manager [None req-b2e6bae2-6e73-43a2-bae3-85645df54ba9 tempest-ServerActionsV293TestJSON-169231013 tempest-ServerActionsV293TestJSON-169231013-project-member] [instance: 8de2ffb3-e264-49f7-8581-6eae21adcaeb] Rebuilding instance
Nov 29 17:53:52 user nova-compute[74613]: DEBUG nova.compute.manager [None req-b2e6bae2-6e73-43a2-bae3-85645df54ba9 tempest-ServerActionsV293TestJSON-169231013 tempest-ServerActionsV293TestJSON-169231013-project-member] [instance: 8de2ffb3-e264-49f7-8581-6eae21adcaeb] Checking state {{(pid=74613) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 29 17:53:52 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:53:52 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:53:52 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:53:52 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:53:52 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-5489860b-08ae-4311-8a2b-dd8f35fab03e tempest-TestVolumeSwap-1038735411 tempest-TestVolumeSwap-1038735411-project-admin] Acquiring lock "0008521b-5a63-4ff6-8390-d343956900ed" by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 17:53:52 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-5489860b-08ae-4311-8a2b-dd8f35fab03e tempest-TestVolumeSwap-1038735411 tempest-TestVolumeSwap-1038735411-project-admin] Lock "0008521b-5a63-4ff6-8390-d343956900ed" acquired by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" :: waited 0.002s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 17:53:52 user nova-compute[74613]: DEBUG os_brick.utils [None req-5489860b-08ae-4311-8a2b-dd8f35fab03e tempest-TestVolumeSwap-1038735411 tempest-TestVolumeSwap-1038735411-project-admin] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74613) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 17:53:52 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 17:53:52 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.018s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 17:53:52 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2a2f43d-feb2-4e8f-8dce-66a7b1404b32]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:400972819b5\n', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 17:53:52 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 17:53:52 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.020s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 17:53:52 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[42af7934-a31a-4fdc-ba4e-7be282f06cee]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 17:53:52 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 17:53:52 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 17:53:52 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[6add9739-5de2-4448-be0b-d147612dc4cf]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 17:53:52 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[fefedbb2-16d6-44ec-b4e5-02748ac7ab45]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 17:53:52 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-5489860b-08ae-4311-8a2b-dd8f35fab03e tempest-TestVolumeSwap-1038735411 tempest-TestVolumeSwap-1038735411-project-admin] Running cmd (subprocess): nvme version {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 17:53:52 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-5489860b-08ae-4311-8a2b-dd8f35fab03e tempest-TestVolumeSwap-1038735411 tempest-TestVolumeSwap-1038735411-project-admin] 'nvme version' failed. Not Retrying. {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 17:53:52 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.nvmeof [None req-5489860b-08ae-4311-8a2b-dd8f35fab03e tempest-TestVolumeSwap-1038735411 tempest-TestVolumeSwap-1038735411-project-admin] nvme not present on system {{(pid=74613) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 29 17:53:52 user nova-compute[74613]: DEBUG nova.compute.manager [req-8c409b52-318c-462d-b73c-d3a06008ccee req-fae01ab9-8cf5-4296-a15b-02f755f12b77 service nova] [instance: 8de2ffb3-e264-49f7-8581-6eae21adcaeb] Received event network-vif-unplugged-51faf82e-9447-4f14-8724-e7939afb4d98 {{(pid=74613) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 17:53:52 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-8c409b52-318c-462d-b73c-d3a06008ccee req-fae01ab9-8cf5-4296-a15b-02f755f12b77 service nova] Acquiring lock "8de2ffb3-e264-49f7-8581-6eae21adcaeb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 17:53:52 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-8c409b52-318c-462d-b73c-d3a06008ccee req-fae01ab9-8cf5-4296-a15b-02f755f12b77 service nova] Lock "8de2ffb3-e264-49f7-8581-6eae21adcaeb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 17:53:52 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-8c409b52-318c-462d-b73c-d3a06008ccee req-fae01ab9-8cf5-4296-a15b-02f755f12b77 service nova] Lock "8de2ffb3-e264-49f7-8581-6eae21adcaeb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 17:53:52 user nova-compute[74613]: DEBUG nova.compute.manager [req-8c409b52-318c-462d-b73c-d3a06008ccee req-fae01ab9-8cf5-4296-a15b-02f755f12b77 service nova] [instance: 8de2ffb3-e264-49f7-8581-6eae21adcaeb] No waiting events found dispatching network-vif-unplugged-51faf82e-9447-4f14-8724-e7939afb4d98 {{(pid=74613) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 17:53:52 user nova-compute[74613]: WARNING nova.compute.manager [req-8c409b52-318c-462d-b73c-d3a06008ccee req-fae01ab9-8cf5-4296-a15b-02f755f12b77 service nova] [instance: 8de2ffb3-e264-49f7-8581-6eae21adcaeb] Received unexpected event network-vif-unplugged-51faf82e-9447-4f14-8724-e7939afb4d98 for instance with vm_state active and task_state rebuilding.
Nov 29 17:53:52 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 17:53:52 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 17:53:52 user nova-compute[74613]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 29 17:53:52 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[23d2ef98-9eb4-4c61-a200-a48145b03082]: (4, '') {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 17:53:52 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.lightos [None req-5489860b-08ae-4311-8a2b-dd8f35fab03e tempest-TestVolumeSwap-1038735411 tempest-TestVolumeSwap-1038735411-project-admin] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74613) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 29 17:53:52 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.lightos [None req-5489860b-08ae-4311-8a2b-dd8f35fab03e tempest-TestVolumeSwap-1038735411 tempest-TestVolumeSwap-1038735411-project-admin] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74613) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 29 17:53:52 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.lightos [None req-5489860b-08ae-4311-8a2b-dd8f35fab03e tempest-TestVolumeSwap-1038735411 tempest-TestVolumeSwap-1038735411-project-admin] LIGHTOS: no hostnqn found. {{(pid=74613) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 29 17:53:52 user nova-compute[74613]: DEBUG os_brick.utils [None req-5489860b-08ae-4311-8a2b-dd8f35fab03e tempest-TestVolumeSwap-1038735411 tempest-TestVolumeSwap-1038735411-project-admin] <== get_connector_properties: return (151ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:400972819b5', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74613) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 17:53:52 user nova-compute[74613]: INFO nova.compute.manager [None req-5489860b-08ae-4311-8a2b-dd8f35fab03e tempest-TestVolumeSwap-1038735411 tempest-TestVolumeSwap-1038735411-project-admin] [instance: 0008521b-5a63-4ff6-8390-d343956900ed] Swapping volume a6b34bdb-5c08-4f7c-b3f5-6b68413947a8 for 49f19a7e-3b8b-44b4-b289-808ee2a18b91
Nov 29 17:53:53 user nova-compute[74613]: INFO nova.virt.libvirt.driver [-] [instance: 8de2ffb3-e264-49f7-8581-6eae21adcaeb] Instance destroyed successfully.
Nov 29 17:53:53 user nova-compute[74613]: INFO nova.virt.libvirt.driver [-] [instance: 8de2ffb3-e264-49f7-8581-6eae21adcaeb] Instance destroyed successfully.
Nov 29 17:53:53 user nova-compute[74613]: DEBUG nova.virt.libvirt.vif [None req-b2e6bae2-6e73-43a2-bae3-85645df54ba9 tempest-ServerActionsV293TestJSON-169231013 tempest-ServerActionsV293TestJSON-169231013-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T17:51:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-687283411',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-1066065930',id=10,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPsifDrYmKd7BdWAgOW/UBypymQ/ZyWR2rXbLuQqhER8jILIr18fIVxVvqAayJ3WqD/9D57nxyUSA2R/v9weZ4t52MHUcMk7woMKaTPaFq53IUB3CUtirmx+f0BtY1qK5A==',key_name='tempest-keypair-1945453411',keypairs=<?>,launch_index=0,launched_at=2023-11-29T17:52:25Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='8d9b3ae2eee040bb84ff5065d07552d4',ramdisk_id='',reservation_id='r-nv3xeq3h',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='4217f428-8d9d-4ee1-9614-642d26d90c46',image_container_format='bare',image_disk_format='qcow2',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsV293TestJSON-169231013',owner_user_name='tempest-ServerActionsV293TestJSON-169231013-project-member'},tags=<?>,task_state='rebuilding',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T17:53:52Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1f67cfc0d0054244b74d7f1d64628db8',uuid=8de2ffb3-e264-49f7-8581-6eae21adcaeb,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "51faf82e-9447-4f14-8724-e7939afb4d98", "address": "fa:16:3e:97:b9:00", "network": {"id": "59f09b07-14df-494d-bb8f-3b5d4a7b9711", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-981004620-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.191", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8d9b3ae2eee040bb84ff5065d07552d4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap51faf82e-94", "ovs_interfaceid": "51faf82e-9447-4f14-8724-e7939afb4d98", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74613) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 29 17:53:53 user nova-compute[74613]: DEBUG nova.network.os_vif_util [None req-b2e6bae2-6e73-43a2-bae3-85645df54ba9 tempest-ServerActionsV293TestJSON-169231013 tempest-ServerActionsV293TestJSON-169231013-project-member] Converting VIF {"id": "51faf82e-9447-4f14-8724-e7939afb4d98", "address": "fa:16:3e:97:b9:00", "network": {"id": "59f09b07-14df-494d-bb8f-3b5d4a7b9711", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-981004620-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.191", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8d9b3ae2eee040bb84ff5065d07552d4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap51faf82e-94", "ovs_interfaceid": "51faf82e-9447-4f14-8724-e7939afb4d98", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74613) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 17:53:53 user nova-compute[74613]: DEBUG nova.network.os_vif_util [None req-b2e6bae2-6e73-43a2-bae3-85645df54ba9 tempest-ServerActionsV293TestJSON-169231013 tempest-ServerActionsV293TestJSON-169231013-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:97:b9:00,bridge_name='br-int',has_traffic_filtering=True,id=51faf82e-9447-4f14-8724-e7939afb4d98,network=Network(59f09b07-14df-494d-bb8f-3b5d4a7b9711),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap51faf82e-94') {{(pid=74613) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 17:53:53 user nova-compute[74613]: DEBUG os_vif [None req-b2e6bae2-6e73-43a2-bae3-85645df54ba9 tempest-ServerActionsV293TestJSON-169231013 tempest-ServerActionsV293TestJSON-169231013-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:97:b9:00,bridge_name='br-int',has_traffic_filtering=True,id=51faf82e-9447-4f14-8724-e7939afb4d98,network=Network(59f09b07-14df-494d-bb8f-3b5d4a7b9711),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap51faf82e-94') {{(pid=74613) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 29 17:53:53 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:53:53 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap51faf82e-94, bridge=br-int, if_exists=True) {{(pid=74613) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 17:53:53 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:53:53 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:53:53 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:53:53 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=cbaef208-32d1-493d-9435-b7e96725af6c) {{(pid=74613) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 17:53:53 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:53:53 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 17:53:53 user nova-compute[74613]: INFO os_vif [None req-b2e6bae2-6e73-43a2-bae3-85645df54ba9 tempest-ServerActionsV293TestJSON-169231013 tempest-ServerActionsV293TestJSON-169231013-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:97:b9:00,bridge_name='br-int',has_traffic_filtering=True,id=51faf82e-9447-4f14-8724-e7939afb4d98,network=Network(59f09b07-14df-494d-bb8f-3b5d4a7b9711),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap51faf82e-94')
Nov 29 17:53:53 user nova-compute[74613]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b2e6bae2-6e73-43a2-bae3-85645df54ba9 tempest-ServerActionsV293TestJSON-169231013 tempest-ServerActionsV293TestJSON-169231013-project-member] [instance: 8de2ffb3-e264-49f7-8581-6eae21adcaeb] calling os-brick to detach iSCSI Volume {{(pid=74613) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 29 17:53:53 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2e6bae2-6e73-43a2-bae3-85645df54ba9 tempest-ServerActionsV293TestJSON-169231013 tempest-ServerActionsV293TestJSON-169231013-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff828156890>, {'target_iqn': 'iqn.2010-10.org.openstack:fbbdc3d2-136d-4fba-b6ba-f27f35a0733b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QpqiVKeo', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=74613) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 17:53:53 user nova-compute[74613]: WARNING os_brick.initiator.connectors.base [None req-b2e6bae2-6e73-43a2-bae3-85645df54ba9 tempest-ServerActionsV293TestJSON-169231013 tempest-ServerActionsV293TestJSON-169231013-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Nov 29 17:53:53 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.base [None req-b2e6bae2-6e73-43a2-bae3-85645df54ba9 tempest-ServerActionsV293TestJSON-169231013 tempest-ServerActionsV293TestJSON-169231013-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 17:53:53 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.base [None req-b2e6bae2-6e73-43a2-bae3-85645df54ba9 tempest-ServerActionsV293TestJSON-169231013 tempest-ServerActionsV293TestJSON-169231013-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 17:53:53 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 17:53:53 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 17:53:53 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[bae4e74b-316b-4e66-bbe7-9745b120335b]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:24920064-fc81-4408-97d1-d8eff97a7554\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:850c1226-267c-42c0-945f-bfc219c8e88b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:8230f3a2-63d8-46cb-8ec7-ceb89fb04e53\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:fbbdc3d2-136d-4fba-b6ba-f27f35a0733b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a6b34bdb-5c08-4f7c-b3f5-6b68413947a8\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d1f798a1-4f7b-4b9a-8180-fa8f4eb89bf0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 17:53:53 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2e6bae2-6e73-43a2-bae3-85645df54ba9 tempest-ServerActionsV293TestJSON-169231013 tempest-ServerActionsV293TestJSON-169231013-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 29 17:53:53 user nova-compute[74613]: No targets found.
Nov 29 17:53:53 user nova-compute[74613]: iSNS:
Nov 29 17:53:53 user nova-compute[74613]: No targets found.
Nov 29 17:53:53 user nova-compute[74613]: STATIC:
Nov 29 17:53:53 user nova-compute[74613]: Target: iqn.2010-10.org.openstack:24920064-fc81-4408-97d1-d8eff97a7554
Nov 29 17:53:53 user nova-compute[74613]:         Portal: 172.16.0.220:3260,-1
Nov 29 17:53:53 user nova-compute[74613]:                 Iface Name: default
Nov 29 17:53:53 user nova-compute[74613]: Target: iqn.2010-10.org.openstack:850c1226-267c-42c0-945f-bfc219c8e88b
Nov 29 17:53:53 user nova-compute[74613]:         Portal: 172.16.0.220:3260,-1
Nov 29 17:53:53 user nova-compute[74613]:                 Iface Name: default
Nov 29 17:53:53 user nova-compute[74613]: Target: iqn.2010-10.org.openstack:8230f3a2-63d8-46cb-8ec7-ceb89fb04e53
Nov 29 17:53:53 user nova-compute[74613]:         Portal: 172.16.0.220:3260,-1
Nov 29 17:53:53 user nova-compute[74613]:                 Iface Name: default
Nov 29 17:53:53 user nova-compute[74613]: Target: iqn.2010-10.org.openstack:fbbdc3d2-136d-4fba-b6ba-f27f35a0733b
Nov 29 17:53:53 user nova-compute[74613]:         Portal: 172.16.0.220:3260,-1
Nov 29 17:53:53 user nova-compute[74613]:                 Iface Name: default
Nov 29 17:53:53 user nova-compute[74613]: Target: iqn.2010-10.org.openstack:a6b34bdb-5c08-4f7c-b3f5-6b68413947a8
Nov 29 17:53:53 user nova-compute[74613]:         Portal: 172.16.0.220:3260,-1
Nov 29 17:53:53 user nova-compute[74613]:                 Iface Name: default
Nov 29 17:53:53 user nova-compute[74613]: Target: iqn.2010-10.org.openstack:d1f798a1-4f7b-4b9a-8180-fa8f4eb89bf0
Nov 29 17:53:53 user nova-compute[74613]:         Portal: 172.16.0.220:3260,-1
Nov 29 17:53:53 user nova-compute[74613]:                 Iface Name: default
Nov 29 17:53:53 user nova-compute[74613]: FIRMWARE:
Nov 29 17:53:53 user nova-compute[74613]: No targets found.
Nov 29 17:53:53 user nova-compute[74613]:  stderr= {{(pid=74613) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 17:53:53 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2e6bae2-6e73-43a2-bae3-85645df54ba9 tempest-ServerActionsV293TestJSON-169231013 tempest-ServerActionsV293TestJSON-169231013-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 29 17:53:53 user nova-compute[74613]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 29 17:53:53 user nova-compute[74613]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74613) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 29 17:53:53 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2e6bae2-6e73-43a2-bae3-85645df54ba9 tempest-ServerActionsV293TestJSON-169231013 tempest-ServerActionsV293TestJSON-169231013-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:fbbdc3d2-136d-4fba-b6ba-f27f35a0733b', 0)] {{(pid=74613) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 29 17:53:53 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 17:53:53 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 17:53:53 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[df02c75e-9449-46ce-a1a5-a6becd8bc739]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:24920064-fc81-4408-97d1-d8eff97a7554\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8230f3a2-63d8-46cb-8ec7-ceb89fb04e53\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:850c1226-267c-42c0-945f-bfc219c8e88b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a6b34bdb-5c08-4f7c-b3f5-6b68413947a8\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d1f798a1-4f7b-4b9a-8180-fa8f4eb89bf0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fbbdc3d2-136d-4fba-b6ba-f27f35a0733b\n', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 17:53:53 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 17:53:53 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 17:53:53 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[54d1ec0d-598d-41ef-a75f-195471cab9db]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fbbdc3d2-136d-4fba-b6ba-f27f35a0733b (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:24920064-fc81-4408-97d1-d8eff97a7554 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8230f3a2-63d8-46cb-8ec7-ceb89fb04e53 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d1f798a1-4f7b-4b9a-8180-fa8f4eb89bf0 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:850c1226-267c-42c0-945f-bfc219c8e88b (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a6b34bdb-5c08-4f7c-b3f5-6b68413947a8 (non-flash)\n', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 17:53:53 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2e6bae2-6e73-43a2-bae3-85645df54ba9 tempest-ServerActionsV293TestJSON-169231013 tempest-ServerActionsV293TestJSON-169231013-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fbbdc3d2-136d-4fba-b6ba-f27f35a0733b (non-flash)
Nov 29 17:53:53 user nova-compute[74613]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:24920064-fc81-4408-97d1-d8eff97a7554 (non-flash)
Nov 29 17:53:53 user nova-compute[74613]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8230f3a2-63d8-46cb-8ec7-ceb89fb04e53 (non-flash)
Nov 29 17:53:53 user nova-compute[74613]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d1f798a1-4f7b-4b9a-8180-fa8f4eb89bf0 (non-flash)
Nov 29 17:53:53 user nova-compute[74613]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:850c1226-267c-42c0-945f-bfc219c8e88b (non-flash)
Nov 29 17:53:53 user nova-compute[74613]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a6b34bdb-5c08-4f7c-b3f5-6b68413947a8 (non-flash)
Nov 29 17:53:53 user nova-compute[74613]:  stderr= {{(pid=74613) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 17:53:53 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2e6bae2-6e73-43a2-bae3-85645df54ba9 tempest-ServerActionsV293TestJSON-169231013 tempest-ServerActionsV293TestJSON-169231013-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fbbdc3d2-136d-4fba-b6ba-f27f35a0733b (non-flash)
Nov 29 17:53:53 user nova-compute[74613]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:24920064-fc81-4408-97d1-d8eff97a7554 (non-flash)
Nov 29 17:53:53 user nova-compute[74613]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8230f3a2-63d8-46cb-8ec7-ceb89fb04e53 (non-flash)
Nov 29 17:53:53 user nova-compute[74613]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d1f798a1-4f7b-4b9a-8180-fa8f4eb89bf0 (non-flash)
Nov 29 17:53:53 user nova-compute[74613]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:850c1226-267c-42c0-945f-bfc219c8e88b (non-flash)
Nov 29 17:53:53 user nova-compute[74613]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a6b34bdb-5c08-4f7c-b3f5-6b68413947a8 (non-flash)
Nov 29 17:53:53 user nova-compute[74613]:  stderr= {{(pid=74613) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 17:53:53 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2e6bae2-6e73-43a2-bae3-85645df54ba9 tempest-ServerActionsV293TestJSON-169231013 tempest-ServerActionsV293TestJSON-169231013-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7ff828530700>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:fbbdc3d2-136d-4fba-b6ba-f27f35a0733b'): ({'sdb'}, set())}) {{(pid=74613) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 29 17:53:53 user nova-compute[74613]: DEBUG os_brick.initiator.linuxscsi [None req-b2e6bae2-6e73-43a2-bae3-85645df54ba9 tempest-ServerActionsV293TestJSON-169231013 tempest-ServerActionsV293TestJSON-169231013-project-member] Removing single pathed devices sdb {{(pid=74613) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 29 17:53:53 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 17:53:53 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.017s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 17:53:53 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e4656e2-1ffc-466e-aa60-f53f175de2ad]: (4, ('path checker states:\nup                  6\n\npaths: 0\nbusy: False\n', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 17:53:53 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 17:53:53 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.018s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 17:53:53 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4d2481a-81a4-4e3b-b7f2-0549c4bac17d]: (4, ('ok\n', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 17:53:53 user nova-compute[74613]: DEBUG os_brick.initiator.linuxscsi [None req-b2e6bae2-6e73-43a2-bae3-85645df54ba9 tempest-ServerActionsV293TestJSON-169231013 tempest-ServerActionsV293TestJSON-169231013-project-member] Flushing IO for device /dev/sdb {{(pid=74613) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 29 17:53:53 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 17:53:53 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.015s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 17:53:53 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[c189db34-a9de-4748-a234-e571be572ab6]: (4, ('', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 17:53:53 user nova-compute[74613]: DEBUG os_brick.initiator.linuxscsi [None req-b2e6bae2-6e73-43a2-bae3-85645df54ba9 tempest-ServerActionsV293TestJSON-169231013 tempest-ServerActionsV293TestJSON-169231013-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74613) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 29 17:53:53 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 17:53:53 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.046s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 17:53:53 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[54997662-191f-40fe-888f-87411f513282]: (4, ('1', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 17:53:53 user nova-compute[74613]: DEBUG os_brick.initiator.linuxscsi [None req-b2e6bae2-6e73-43a2-bae3-85645df54ba9 tempest-ServerActionsV293TestJSON-169231013 tempest-ServerActionsV293TestJSON-169231013-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74613) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 29 17:53:53 user nova-compute[74613]: DEBUG os_brick.initiator.linuxscsi [None req-b2e6bae2-6e73-43a2-bae3-85645df54ba9 tempest-ServerActionsV293TestJSON-169231013 tempest-ServerActionsV293TestJSON-169231013-project-member] SCSI volumes sdb have been removed. {{(pid=74613) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 29 17:53:53 user nova-compute[74613]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-1SCST_BIO4dbb46b5-5df23c8fd4404f26', '/dev/disk/by-id/scsi-23564663233633866', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_4dbb46b5') {{(pid=85376) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Nov 29 17:53:53 user nova-compute[74613]: WARNING os_brick.exception [-] Unlink failed for /dev/disk/by-id/scsi-1SCST_BIO4dbb46b5-5df23c8fd4404f26
Nov 29 17:53:53 user nova-compute[74613]: WARNING os_brick.exception [-] Unlink failed for /dev/disk/by-id/scsi-23564663233633866
Nov 29 17:53:53 user nova-compute[74613]: WARNING os_brick.exception [-] Unlink failed for /dev/disk/by-id/scsi-SSCST_BIO_Storage_4dbb46b5
Nov 29 17:53:53 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6145770-f974-496b-a871-534af5e8a3c8]: (4, None) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 17:53:53 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2e6bae2-6e73-43a2-bae3-85645df54ba9 tempest-ServerActionsV293TestJSON-169231013 tempest-ServerActionsV293TestJSON-169231013-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:fbbdc3d2-136d-4fba-b6ba-f27f35a0733b')] {{(pid=74613) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 29 17:53:53 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fbbdc3d2-136d-4fba-b6ba-f27f35a0733b -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 17:53:53 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fbbdc3d2-136d-4fba-b6ba-f27f35a0733b -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.017s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 17:53:53 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e2eaa47-8cd9-487d-a68d-aef5eb17b9c3]: (4, ('', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 17:53:53 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2e6bae2-6e73-43a2-bae3-85645df54ba9 tempest-ServerActionsV293TestJSON-169231013 tempest-ServerActionsV293TestJSON-169231013-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74613) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 17:53:53 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fbbdc3d2-136d-4fba-b6ba-f27f35a0733b -p 172.16.0.220:3260 --logout {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 17:53:53 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fbbdc3d2-136d-4fba-b6ba-f27f35a0733b -p 172.16.0.220:3260 --logout" returned: 0 in 0.068s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 17:53:53 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[079a2e96-125b-41ec-972f-7f89541673e4]: (4, ('Logging out of session [sid: 2, target: iqn.2010-10.org.openstack:fbbdc3d2-136d-4fba-b6ba-f27f35a0733b, portal: 172.16.0.220,3260]\nLogout of [sid: 2, target: iqn.2010-10.org.openstack:fbbdc3d2-136d-4fba-b6ba-f27f35a0733b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 17:53:53 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2e6bae2-6e73-43a2-bae3-85645df54ba9 tempest-ServerActionsV293TestJSON-169231013 tempest-ServerActionsV293TestJSON-169231013-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 2, target: iqn.2010-10.org.openstack:fbbdc3d2-136d-4fba-b6ba-f27f35a0733b, portal: 172.16.0.220,3260]
Nov 29 17:53:53 user nova-compute[74613]: Logout of [sid: 2, target: iqn.2010-10.org.openstack:fbbdc3d2-136d-4fba-b6ba-f27f35a0733b, portal: 172.16.0.220,3260] successful.
Nov 29 17:53:53 user nova-compute[74613]:  stderr= {{(pid=74613) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 17:53:53 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fbbdc3d2-136d-4fba-b6ba-f27f35a0733b -p 172.16.0.220:3260 --op delete {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 17:53:53 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fbbdc3d2-136d-4fba-b6ba-f27f35a0733b -p 172.16.0.220:3260 --op delete" returned: 0 in 0.029s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 17:53:53 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b04ef43-1b43-4fc2-b9d1-89318c0180e9]: (4, ('', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 17:53:53 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2e6bae2-6e73-43a2-bae3-85645df54ba9 tempest-ServerActionsV293TestJSON-169231013 tempest-ServerActionsV293TestJSON-169231013-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74613) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 17:53:53 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.base [None req-b2e6bae2-6e73-43a2-bae3-85645df54ba9 tempest-ServerActionsV293TestJSON-169231013 tempest-ServerActionsV293TestJSON-169231013-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.327s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 17:53:53 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2e6bae2-6e73-43a2-bae3-85645df54ba9 tempest-ServerActionsV293TestJSON-169231013 tempest-ServerActionsV293TestJSON-169231013-project-member] <== disconnect_volume: return (329ms) None {{(pid=74613) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 17:53:53 user nova-compute[74613]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b2e6bae2-6e73-43a2-bae3-85645df54ba9 tempest-ServerActionsV293TestJSON-169231013 tempest-ServerActionsV293TestJSON-169231013-project-member] [instance: 8de2ffb3-e264-49f7-8581-6eae21adcaeb] Disconnected iSCSI Volume {{(pid=74613) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 29 17:53:53 user nova-compute[74613]: INFO nova.virt.libvirt.driver [None req-b2e6bae2-6e73-43a2-bae3-85645df54ba9 tempest-ServerActionsV293TestJSON-169231013 tempest-ServerActionsV293TestJSON-169231013-project-member] [instance: 8de2ffb3-e264-49f7-8581-6eae21adcaeb] Deleting instance files /opt/stack/data/nova/instances/8de2ffb3-e264-49f7-8581-6eae21adcaeb_del
Nov 29 17:53:53 user nova-compute[74613]: INFO nova.virt.libvirt.driver [None req-b2e6bae2-6e73-43a2-bae3-85645df54ba9 tempest-ServerActionsV293TestJSON-169231013 tempest-ServerActionsV293TestJSON-169231013-project-member] [instance: 8de2ffb3-e264-49f7-8581-6eae21adcaeb] Deletion of /opt/stack/data/nova/instances/8de2ffb3-e264-49f7-8581-6eae21adcaeb_del complete
Nov 29 17:53:54 user nova-compute[74613]: DEBUG nova.compute.manager [req-020390bc-b6fc-4f77-bbf4-d4745cbbf06a req-9f4e0576-f6cd-44c7-998c-545ef9794d69 service nova] [instance: 8de2ffb3-e264-49f7-8581-6eae21adcaeb] Received event network-vif-plugged-51faf82e-9447-4f14-8724-e7939afb4d98 {{(pid=74613) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 17:53:54 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-020390bc-b6fc-4f77-bbf4-d4745cbbf06a req-9f4e0576-f6cd-44c7-998c-545ef9794d69 service nova] Acquiring lock "8de2ffb3-e264-49f7-8581-6eae21adcaeb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 17:53:54 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-020390bc-b6fc-4f77-bbf4-d4745cbbf06a req-9f4e0576-f6cd-44c7-998c-545ef9794d69 service nova] Lock "8de2ffb3-e264-49f7-8581-6eae21adcaeb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 17:53:54 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-020390bc-b6fc-4f77-bbf4-d4745cbbf06a req-9f4e0576-f6cd-44c7-998c-545ef9794d69 service nova] Lock "8de2ffb3-e264-49f7-8581-6eae21adcaeb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 17:53:54 user nova-compute[74613]: DEBUG nova.compute.manager [req-020390bc-b6fc-4f77-bbf4-d4745cbbf06a req-9f4e0576-f6cd-44c7-998c-545ef9794d69 service nova] [instance: 8de2ffb3-e264-49f7-8581-6eae21adcaeb] No waiting events found dispatching network-vif-plugged-51faf82e-9447-4f14-8724-e7939afb4d98 {{(pid=74613) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 17:53:54 user nova-compute[74613]: WARNING nova.compute.manager [req-020390bc-b6fc-4f77-bbf4-d4745cbbf06a req-9f4e0576-f6cd-44c7-998c-545ef9794d69 service nova] [instance: 8de2ffb3-e264-49f7-8581-6eae21adcaeb] Received unexpected event network-vif-plugged-51faf82e-9447-4f14-8724-e7939afb4d98 for instance with vm_state active and task_state rebuilding.
Nov 29 17:53:55 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:53:57 user nova-compute[74613]: DEBUG nova.virt.libvirt.volume.iscsi [None req-acb74ace-3246-44e6-bae3-648fd0bbb262 tempest-VolumesAssistedSnapshotsTest-194727756 tempest-VolumesAssistedSnapshotsTest-194727756-project-admin] [instance: d4ecef60-62f9-4969-b57f-3bb45a44cc9f] Calling os-brick to attach iSCSI Volume {{(pid=74613) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 29 17:53:57 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-acb74ace-3246-44e6-bae3-648fd0bbb262 tempest-VolumesAssistedSnapshotsTest-194727756 tempest-VolumesAssistedSnapshotsTest-194727756-project-admin] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff828156890>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:17b27fab-6cdb-4820-be62-ffd44e8e2fb5', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NKsebOgY', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74613) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 17:53:57 user nova-compute[74613]: WARNING os_brick.initiator.connectors.base [None req-acb74ace-3246-44e6-bae3-648fd0bbb262 tempest-VolumesAssistedSnapshotsTest-194727756 tempest-VolumesAssistedSnapshotsTest-194727756-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 17:53:57 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.base [None req-acb74ace-3246-44e6-bae3-648fd0bbb262 tempest-VolumesAssistedSnapshotsTest-194727756 tempest-VolumesAssistedSnapshotsTest-194727756-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 17:53:57 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.base [None req-acb74ace-3246-44e6-bae3-648fd0bbb262 tempest-VolumesAssistedSnapshotsTest-194727756 tempest-VolumesAssistedSnapshotsTest-194727756-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 17:53:57 user nova-compute[74613]: WARNING os_brick.initiator.connectors.base [None req-acb74ace-3246-44e6-bae3-648fd0bbb262 tempest-VolumesAssistedSnapshotsTest-194727756 tempest-VolumesAssistedSnapshotsTest-194727756-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 17:53:57 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.base [None req-acb74ace-3246-44e6-bae3-648fd0bbb262 tempest-VolumesAssistedSnapshotsTest-194727756 tempest-VolumesAssistedSnapshotsTest-194727756-project-admin] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:17b27fab-6cdb-4820-be62-ffd44e8e2fb5" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 17:53:57 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.base [None req-acb74ace-3246-44e6-bae3-648fd0bbb262 tempest-VolumesAssistedSnapshotsTest-194727756 tempest-VolumesAssistedSnapshotsTest-194727756-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:17b27fab-6cdb-4820-be62-ffd44e8e2fb5" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 17:53:57 user nova-compute[74613]: INFO os_brick.initiator.connectors.iscsi [None req-acb74ace-3246-44e6-bae3-648fd0bbb262 tempest-VolumesAssistedSnapshotsTest-194727756 tempest-VolumesAssistedSnapshotsTest-194727756-project-admin] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 29 17:53:57 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:17b27fab-6cdb-4820-be62-ffd44e8e2fb5 -p 172.16.0.220:3260 {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 17:53:57 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:17b27fab-6cdb-4820-be62-ffd44e8e2fb5 -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 17:53:57 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[2fa7dc17-f80d-4f26-adf4-ca4bccb2125c]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 17:53:57 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-acb74ace-3246-44e6-bae3-648fd0bbb262 tempest-VolumesAssistedSnapshotsTest-194727756 tempest-VolumesAssistedSnapshotsTest-194727756-project-admin] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 29 17:53:57 user nova-compute[74613]:  {{(pid=74613) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 17:53:57 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:17b27fab-6cdb-4820-be62-ffd44e8e2fb5 -p 172.16.0.220:3260 --interface default --op new {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 17:53:57 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:17b27fab-6cdb-4820-be62-ffd44e8e2fb5 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 17:53:57 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[38c1b215-f408-4e68-9bc7-95b2264f4a8d]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:17b27fab-6cdb-4820-be62-ffd44e8e2fb5] added\n', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 17:53:57 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-acb74ace-3246-44e6-bae3-648fd0bbb262 tempest-VolumesAssistedSnapshotsTest-194727756 tempest-VolumesAssistedSnapshotsTest-194727756-project-admin] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:17b27fab-6cdb-4820-be62-ffd44e8e2fb5] added
Nov 29 17:53:57 user nova-compute[74613]:  stderr= {{(pid=74613) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 17:53:57 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:17b27fab-6cdb-4820-be62-ffd44e8e2fb5 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 17:53:57 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:17b27fab-6cdb-4820-be62-ffd44e8e2fb5 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.027s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 17:53:57 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[da3c8f1a-8c2e-4be8-ba5c-d8782e765f56]: (4, ('', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 17:53:57 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-acb74ace-3246-44e6-bae3-648fd0bbb262 tempest-VolumesAssistedSnapshotsTest-194727756 tempest-VolumesAssistedSnapshotsTest-194727756-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74613) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 17:53:57 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:17b27fab-6cdb-4820-be62-ffd44e8e2fb5 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 17:53:57 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:17b27fab-6cdb-4820-be62-ffd44e8e2fb5 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 17:53:57 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[f49de41a-8ae3-419f-ad16-865187faf951]: (4, ('', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 17:53:57 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-acb74ace-3246-44e6-bae3-648fd0bbb262 tempest-VolumesAssistedSnapshotsTest-194727756 tempest-VolumesAssistedSnapshotsTest-194727756-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74613) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 17:53:57 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:17b27fab-6cdb-4820-be62-ffd44e8e2fb5 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v NKsebOgY {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 17:53:57 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:17b27fab-6cdb-4820-be62-ffd44e8e2fb5 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v NKsebOgY" returned: 0 in 0.017s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 17:53:57 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[752620d9-ba45-4596-b4e1-b64dcc338ed0]: (4, ('', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 17:53:57 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-acb74ace-3246-44e6-bae3-648fd0bbb262 tempest-VolumesAssistedSnapshotsTest-194727756 tempest-VolumesAssistedSnapshotsTest-194727756-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'NKsebOgY'): stdout= stderr= {{(pid=74613) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 17:53:57 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:17b27fab-6cdb-4820-be62-ffd44e8e2fb5 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 17:53:57 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:17b27fab-6cdb-4820-be62-ffd44e8e2fb5 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 17:53:57 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[15e970d2-66a5-4f54-affb-e54924972d55]: (4, ('', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 17:53:57 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-acb74ace-3246-44e6-bae3-648fd0bbb262 tempest-VolumesAssistedSnapshotsTest-194727756 tempest-VolumesAssistedSnapshotsTest-194727756-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74613) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 17:53:57 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 17:53:57 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 17:53:57 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[736d67ef-7346-4768-908d-3f95c4568291]: (4, ('tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:24920064-fc81-4408-97d1-d8eff97a7554 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8230f3a2-63d8-46cb-8ec7-ceb89fb04e53 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d1f798a1-4f7b-4b9a-8180-fa8f4eb89bf0 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:850c1226-267c-42c0-945f-bfc219c8e88b (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a6b34bdb-5c08-4f7c-b3f5-6b68413947a8 (non-flash)\n', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 17:53:57 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-acb74ace-3246-44e6-bae3-648fd0bbb262 tempest-VolumesAssistedSnapshotsTest-194727756 tempest-VolumesAssistedSnapshotsTest-194727756-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:24920064-fc81-4408-97d1-d8eff97a7554 (non-flash)
Nov 29 17:53:57 user nova-compute[74613]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8230f3a2-63d8-46cb-8ec7-ceb89fb04e53 (non-flash)
Nov 29 17:53:57 user nova-compute[74613]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d1f798a1-4f7b-4b9a-8180-fa8f4eb89bf0 (non-flash)
Nov 29 17:53:57 user nova-compute[74613]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:850c1226-267c-42c0-945f-bfc219c8e88b (non-flash)
Nov 29 17:53:57 user nova-compute[74613]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a6b34bdb-5c08-4f7c-b3f5-6b68413947a8 (non-flash)
Nov 29 17:53:57 user nova-compute[74613]:  stderr= {{(pid=74613) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 17:53:57 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-acb74ace-3246-44e6-bae3-648fd0bbb262 tempest-VolumesAssistedSnapshotsTest-194727756 tempest-VolumesAssistedSnapshotsTest-194727756-project-admin] iscsi session list stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:24920064-fc81-4408-97d1-d8eff97a7554 (non-flash)
Nov 29 17:53:57 user nova-compute[74613]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8230f3a2-63d8-46cb-8ec7-ceb89fb04e53 (non-flash)
Nov 29 17:53:57 user nova-compute[74613]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d1f798a1-4f7b-4b9a-8180-fa8f4eb89bf0 (non-flash)
Nov 29 17:53:57 user nova-compute[74613]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:850c1226-267c-42c0-945f-bfc219c8e88b (non-flash)
Nov 29 17:53:57 user nova-compute[74613]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a6b34bdb-5c08-4f7c-b3f5-6b68413947a8 (non-flash)
Nov 29 17:53:57 user nova-compute[74613]:  stderr= {{(pid=74613) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 17:53:57 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:17b27fab-6cdb-4820-be62-ffd44e8e2fb5 -p 172.16.0.220:3260 --login {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 17:53:57 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:17b27fab-6cdb-4820-be62-ffd44e8e2fb5 -p 172.16.0.220:3260 --login" returned: 0 in 0.106s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 17:53:57 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2a514cc-2075-4924-9d9a-5d6febd57c62]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:17b27fab-6cdb-4820-be62-ffd44e8e2fb5, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:17b27fab-6cdb-4820-be62-ffd44e8e2fb5, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 17:53:57 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-acb74ace-3246-44e6-bae3-648fd0bbb262 tempest-VolumesAssistedSnapshotsTest-194727756 tempest-VolumesAssistedSnapshotsTest-194727756-project-admin] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:17b27fab-6cdb-4820-be62-ffd44e8e2fb5, portal: 172.16.0.220,3260]
Nov 29 17:53:57 user nova-compute[74613]: Login to [iface: default, target: iqn.2010-10.org.openstack:17b27fab-6cdb-4820-be62-ffd44e8e2fb5, portal: 172.16.0.220,3260] successful.
Nov 29 17:53:57 user nova-compute[74613]:  stderr= {{(pid=74613) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 17:53:57 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:17b27fab-6cdb-4820-be62-ffd44e8e2fb5 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 17:53:57 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:17b27fab-6cdb-4820-be62-ffd44e8e2fb5 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 17:53:57 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[7bc4476a-56a9-4ea8-829b-ff4552b18fd8]: (4, ('', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 17:53:57 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-acb74ace-3246-44e6-bae3-648fd0bbb262 tempest-VolumesAssistedSnapshotsTest-194727756 tempest-VolumesAssistedSnapshotsTest-194727756-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74613) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 17:53:57 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 17:53:57 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.037s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 17:53:57 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[65988c02-a4ac-4409-a38e-a77bfab0cde8]: (4, ('tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:24920064-fc81-4408-97d1-d8eff97a7554 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8230f3a2-63d8-46cb-8ec7-ceb89fb04e53 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d1f798a1-4f7b-4b9a-8180-fa8f4eb89bf0 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:850c1226-267c-42c0-945f-bfc219c8e88b (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a6b34bdb-5c08-4f7c-b3f5-6b68413947a8 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:17b27fab-6cdb-4820-be62-ffd44e8e2fb5 (non-flash)\n', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 17:53:57 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-acb74ace-3246-44e6-bae3-648fd0bbb262 tempest-VolumesAssistedSnapshotsTest-194727756 tempest-VolumesAssistedSnapshotsTest-194727756-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:24920064-fc81-4408-97d1-d8eff97a7554 (non-flash)
Nov 29 17:53:57 user nova-compute[74613]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8230f3a2-63d8-46cb-8ec7-ceb89fb04e53 (non-flash)
Nov 29 17:53:57 user nova-compute[74613]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d1f798a1-4f7b-4b9a-8180-fa8f4eb89bf0 (non-flash)
Nov 29 17:53:57 user nova-compute[74613]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:850c1226-267c-42c0-945f-bfc219c8e88b (non-flash)
Nov 29 17:53:57 user nova-compute[74613]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a6b34bdb-5c08-4f7c-b3f5-6b68413947a8 (non-flash)
Nov 29 17:53:57 user nova-compute[74613]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:17b27fab-6cdb-4820-be62-ffd44e8e2fb5 (non-flash)
Nov 29 17:53:57 user nova-compute[74613]:  stderr= {{(pid=74613) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 17:53:57 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-acb74ace-3246-44e6-bae3-648fd0bbb262 tempest-VolumesAssistedSnapshotsTest-194727756 tempest-VolumesAssistedSnapshotsTest-194727756-project-admin] iscsi session list stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:24920064-fc81-4408-97d1-d8eff97a7554 (non-flash)
Nov 29 17:53:57 user nova-compute[74613]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8230f3a2-63d8-46cb-8ec7-ceb89fb04e53 (non-flash)
Nov 29 17:53:57 user nova-compute[74613]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d1f798a1-4f7b-4b9a-8180-fa8f4eb89bf0 (non-flash)
Nov 29 17:53:57 user nova-compute[74613]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:850c1226-267c-42c0-945f-bfc219c8e88b (non-flash)
Nov 29 17:53:57 user nova-compute[74613]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a6b34bdb-5c08-4f7c-b3f5-6b68413947a8 (non-flash)
Nov 29 17:53:57 user nova-compute[74613]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:17b27fab-6cdb-4820-be62-ffd44e8e2fb5 (non-flash)
Nov 29 17:53:57 user nova-compute[74613]:  stderr= {{(pid=74613) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 17:53:57 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.base [None req-acb74ace-3246-44e6-bae3-648fd0bbb262 tempest-VolumesAssistedSnapshotsTest-194727756 tempest-VolumesAssistedSnapshotsTest-194727756-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:17b27fab-6cdb-4820-be62-ffd44e8e2fb5" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.350s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 17:53:57 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-acb74ace-3246-44e6-bae3-648fd0bbb262 tempest-VolumesAssistedSnapshotsTest-194727756 tempest-VolumesAssistedSnapshotsTest-194727756-project-admin] Connected to 172.16.0.220:3260 {{(pid=74613) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 29 17:53:57 user nova-compute[74613]: DEBUG os_brick.initiator.linuxscsi [None req-acb74ace-3246-44e6-bae3-648fd0bbb262 tempest-VolumesAssistedSnapshotsTest-194727756 tempest-VolumesAssistedSnapshotsTest-194727756-project-admin] HCTL ('33', '-', '-', 0) found on session 9 with lun 0 {{(pid=74613) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 29 17:53:57 user nova-compute[74613]: DEBUG os_brick.initiator.linuxscsi [None req-acb74ace-3246-44e6-bae3-648fd0bbb262 tempest-VolumesAssistedSnapshotsTest-194727756 tempest-VolumesAssistedSnapshotsTest-194727756-project-admin] Scanning host 33 c: -, t: -, l: 0) {{(pid=74613) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 29 17:53:57 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 17:53:57 user nova-compute[74613]: WARNING nova.virt.libvirt.driver [None req-b2e6bae2-6e73-43a2-bae3-85645df54ba9 tempest-ServerActionsV293TestJSON-169231013 tempest-ServerActionsV293TestJSON-169231013-project-member] [instance: 8de2ffb3-e264-49f7-8581-6eae21adcaeb] During detach_volume, instance disappeared.: nova.exception.InstanceNotFound: Instance 8de2ffb3-e264-49f7-8581-6eae21adcaeb could not be found.
Nov 29 17:53:57 user nova-compute[74613]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b2e6bae2-6e73-43a2-bae3-85645df54ba9 tempest-ServerActionsV293TestJSON-169231013 tempest-ServerActionsV293TestJSON-169231013-project-member] [instance: 8de2ffb3-e264-49f7-8581-6eae21adcaeb] calling os-brick to detach iSCSI Volume {{(pid=74613) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 29 17:53:57 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2e6bae2-6e73-43a2-bae3-85645df54ba9 tempest-ServerActionsV293TestJSON-169231013 tempest-ServerActionsV293TestJSON-169231013-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff828156890>, {'target_iqn': 'iqn.2010-10.org.openstack:fbbdc3d2-136d-4fba-b6ba-f27f35a0733b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QpqiVKeo', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=74613) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 17:53:57 user nova-compute[74613]: WARNING os_brick.initiator.connectors.base [None req-b2e6bae2-6e73-43a2-bae3-85645df54ba9 tempest-ServerActionsV293TestJSON-169231013 tempest-ServerActionsV293TestJSON-169231013-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Nov 29 17:53:57 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.base [None req-b2e6bae2-6e73-43a2-bae3-85645df54ba9 tempest-ServerActionsV293TestJSON-169231013 tempest-ServerActionsV293TestJSON-169231013-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 17:53:57 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.021s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 17:53:57 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3c6043b-9382-4ed1-a6de-dd11917f1b71]: (4, ('- - 0', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 17:53:57 user nova-compute[74613]: DEBUG os_brick.initiator.linuxscsi [None req-acb74ace-3246-44e6-bae3-648fd0bbb262 tempest-VolumesAssistedSnapshotsTest-194727756 tempest-VolumesAssistedSnapshotsTest-194727756-project-admin] Searching for a device in session 9 and hctl ['33', '*', '*', 0] yield: None {{(pid=74613) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 29 17:53:58 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:53:58 user nova-compute[74613]: DEBUG os_brick.initiator.linuxscsi [None req-acb74ace-3246-44e6-bae3-648fd0bbb262 tempest-VolumesAssistedSnapshotsTest-194727756 tempest-VolumesAssistedSnapshotsTest-194727756-project-admin] Searching for a device in session 9 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74613) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 29 17:53:58 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-acb74ace-3246-44e6-bae3-648fd0bbb262 tempest-VolumesAssistedSnapshotsTest-194727756 tempest-VolumesAssistedSnapshotsTest-194727756-project-admin] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:17b27fab-6cdb-4820-be62-ffd44e8e2fb5', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NKsebOgY', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74613) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 29 17:53:58 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.base [None req-acb74ace-3246-44e6-bae3-648fd0bbb262 tempest-VolumesAssistedSnapshotsTest-194727756 tempest-VolumesAssistedSnapshotsTest-194727756-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.383s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 17:53:58 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-acb74ace-3246-44e6-bae3-648fd0bbb262 tempest-VolumesAssistedSnapshotsTest-194727756 tempest-VolumesAssistedSnapshotsTest-194727756-project-admin] <== connect_volume: return (1384ms) {'type': 'block', 'scsi_wwn': '23931646662326666', 'path': '/dev/sdb'} {{(pid=74613) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 17:53:58 user nova-compute[74613]: DEBUG nova.virt.libvirt.volume.iscsi [None req-acb74ace-3246-44e6-bae3-648fd0bbb262 tempest-VolumesAssistedSnapshotsTest-194727756 tempest-VolumesAssistedSnapshotsTest-194727756-project-admin] [instance: d4ecef60-62f9-4969-b57f-3bb45a44cc9f] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23931646662326666', 'path': '/dev/sdb'} {{(pid=74613) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 29 17:53:58 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.base [None req-b2e6bae2-6e73-43a2-bae3-85645df54ba9 tempest-ServerActionsV293TestJSON-169231013 tempest-ServerActionsV293TestJSON-169231013-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 1.011s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 17:53:58 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 17:53:58 user nova-compute[74613]: DEBUG nova.objects.instance [None req-acb74ace-3246-44e6-bae3-648fd0bbb262 tempest-VolumesAssistedSnapshotsTest-194727756 tempest-VolumesAssistedSnapshotsTest-194727756-project-admin] Lazy-loading 'flavor' on Instance uuid d4ecef60-62f9-4969-b57f-3bb45a44cc9f {{(pid=74613) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 17:53:58 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 17:53:58 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa066ee0-a503-41e7-872f-60a2085e239e]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:24920064-fc81-4408-97d1-d8eff97a7554\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:17b27fab-6cdb-4820-be62-ffd44e8e2fb5\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:850c1226-267c-42c0-945f-bfc219c8e88b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:8230f3a2-63d8-46cb-8ec7-ceb89fb04e53\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a6b34bdb-5c08-4f7c-b3f5-6b68413947a8\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d1f798a1-4f7b-4b9a-8180-fa8f4eb89bf0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 17:53:58 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2e6bae2-6e73-43a2-bae3-85645df54ba9 tempest-ServerActionsV293TestJSON-169231013 tempest-ServerActionsV293TestJSON-169231013-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 29 17:53:58 user nova-compute[74613]: No targets found.
Nov 29 17:53:58 user nova-compute[74613]: iSNS:
Nov 29 17:53:58 user nova-compute[74613]: No targets found.
Nov 29 17:53:58 user nova-compute[74613]: STATIC:
Nov 29 17:53:58 user nova-compute[74613]: Target: iqn.2010-10.org.openstack:24920064-fc81-4408-97d1-d8eff97a7554
Nov 29 17:53:58 user nova-compute[74613]:         Portal: 172.16.0.220:3260,-1
Nov 29 17:53:58 user nova-compute[74613]:                 Iface Name: default
Nov 29 17:53:58 user nova-compute[74613]: Target: iqn.2010-10.org.openstack:17b27fab-6cdb-4820-be62-ffd44e8e2fb5
Nov 29 17:53:58 user nova-compute[74613]:         Portal: 172.16.0.220:3260,-1
Nov 29 17:53:58 user nova-compute[74613]:                 Iface Name: default
Nov 29 17:53:58 user nova-compute[74613]: Target: iqn.2010-10.org.openstack:850c1226-267c-42c0-945f-bfc219c8e88b
Nov 29 17:53:58 user nova-compute[74613]:         Portal: 172.16.0.220:3260,-1
Nov 29 17:53:58 user nova-compute[74613]:                 Iface Name: default
Nov 29 17:53:58 user nova-compute[74613]: Target: iqn.2010-10.org.openstack:8230f3a2-63d8-46cb-8ec7-ceb89fb04e53
Nov 29 17:53:58 user nova-compute[74613]:         Portal: 172.16.0.220:3260,-1
Nov 29 17:53:58 user nova-compute[74613]:                 Iface Name: default
Nov 29 17:53:58 user nova-compute[74613]: Target: iqn.2010-10.org.openstack:a6b34bdb-5c08-4f7c-b3f5-6b68413947a8
Nov 29 17:53:58 user nova-compute[74613]:         Portal: 172.16.0.220:3260,-1
Nov 29 17:53:58 user nova-compute[74613]:                 Iface Name: default
Nov 29 17:53:58 user nova-compute[74613]: Target: iqn.2010-10.org.openstack:d1f798a1-4f7b-4b9a-8180-fa8f4eb89bf0
Nov 29 17:53:58 user nova-compute[74613]:         Portal: 172.16.0.220:3260,-1
Nov 29 17:53:58 user nova-compute[74613]:                 Iface Name: default
Nov 29 17:53:58 user nova-compute[74613]: FIRMWARE:
Nov 29 17:53:58 user nova-compute[74613]: No targets found.
Nov 29 17:53:58 user nova-compute[74613]:  stderr= {{(pid=74613) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 17:53:58 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2e6bae2-6e73-43a2-bae3-85645df54ba9 tempest-ServerActionsV293TestJSON-169231013 tempest-ServerActionsV293TestJSON-169231013-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 29 17:53:58 user nova-compute[74613]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 29 17:53:58 user nova-compute[74613]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74613) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 29 17:53:58 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2e6bae2-6e73-43a2-bae3-85645df54ba9 tempest-ServerActionsV293TestJSON-169231013 tempest-ServerActionsV293TestJSON-169231013-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:fbbdc3d2-136d-4fba-b6ba-f27f35a0733b', 0)] {{(pid=74613) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 29 17:53:58 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 17:53:58 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.015s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 17:53:58 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[98a6e732-0b46-41c5-87f9-3c843a86cd3e]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:17b27fab-6cdb-4820-be62-ffd44e8e2fb5\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:24920064-fc81-4408-97d1-d8eff97a7554\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8230f3a2-63d8-46cb-8ec7-ceb89fb04e53\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:850c1226-267c-42c0-945f-bfc219c8e88b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a6b34bdb-5c08-4f7c-b3f5-6b68413947a8\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d1f798a1-4f7b-4b9a-8180-fa8f4eb89bf0\n', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 17:53:58 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 17:53:58 user nova-compute[74613]: DEBUG nova.virt.libvirt.guest [None req-acb74ace-3246-44e6-bae3-648fd0bbb262 tempest-VolumesAssistedSnapshotsTest-194727756 tempest-VolumesAssistedSnapshotsTest-194727756-project-admin] attach device xml: <disk type="block" device="disk">
Nov 29 17:53:58 user nova-compute[74613]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 17:53:58 user nova-compute[74613]:   <source dev="/dev/sdb"/>
Nov 29 17:53:58 user nova-compute[74613]:   <target dev="vdb" bus="virtio"/>
Nov 29 17:53:58 user nova-compute[74613]:   <serial>17b27fab-6cdb-4820-be62-ffd44e8e2fb5</serial>
Nov 29 17:53:58 user nova-compute[74613]: </disk>
Nov 29 17:53:58 user nova-compute[74613]:  {{(pid=74613) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 29 17:53:58 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 17:53:58 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff948f8b-6410-4ffe-9f96-a250ec332230]: (4, ('tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:24920064-fc81-4408-97d1-d8eff97a7554 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8230f3a2-63d8-46cb-8ec7-ceb89fb04e53 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d1f798a1-4f7b-4b9a-8180-fa8f4eb89bf0 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:850c1226-267c-42c0-945f-bfc219c8e88b (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a6b34bdb-5c08-4f7c-b3f5-6b68413947a8 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:17b27fab-6cdb-4820-be62-ffd44e8e2fb5 (non-flash)\n', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 17:53:58 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2e6bae2-6e73-43a2-bae3-85645df54ba9 tempest-ServerActionsV293TestJSON-169231013 tempest-ServerActionsV293TestJSON-169231013-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:24920064-fc81-4408-97d1-d8eff97a7554 (non-flash)
Nov 29 17:53:58 user nova-compute[74613]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8230f3a2-63d8-46cb-8ec7-ceb89fb04e53 (non-flash)
Nov 29 17:53:58 user nova-compute[74613]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d1f798a1-4f7b-4b9a-8180-fa8f4eb89bf0 (non-flash)
Nov 29 17:53:58 user nova-compute[74613]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:850c1226-267c-42c0-945f-bfc219c8e88b (non-flash)
Nov 29 17:53:58 user nova-compute[74613]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a6b34bdb-5c08-4f7c-b3f5-6b68413947a8 (non-flash)
Nov 29 17:53:58 user nova-compute[74613]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:17b27fab-6cdb-4820-be62-ffd44e8e2fb5 (non-flash)
Nov 29 17:53:58 user nova-compute[74613]:  stderr= {{(pid=74613) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 17:53:58 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2e6bae2-6e73-43a2-bae3-85645df54ba9 tempest-ServerActionsV293TestJSON-169231013 tempest-ServerActionsV293TestJSON-169231013-project-member] iscsi session list stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:24920064-fc81-4408-97d1-d8eff97a7554 (non-flash)
Nov 29 17:53:58 user nova-compute[74613]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8230f3a2-63d8-46cb-8ec7-ceb89fb04e53 (non-flash)
Nov 29 17:53:58 user nova-compute[74613]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d1f798a1-4f7b-4b9a-8180-fa8f4eb89bf0 (non-flash)
Nov 29 17:53:58 user nova-compute[74613]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:850c1226-267c-42c0-945f-bfc219c8e88b (non-flash)
Nov 29 17:53:58 user nova-compute[74613]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a6b34bdb-5c08-4f7c-b3f5-6b68413947a8 (non-flash)
Nov 29 17:53:58 user nova-compute[74613]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:17b27fab-6cdb-4820-be62-ffd44e8e2fb5 (non-flash)
Nov 29 17:53:58 user nova-compute[74613]:  stderr= {{(pid=74613) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 17:53:58 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2e6bae2-6e73-43a2-bae3-85645df54ba9 tempest-ServerActionsV293TestJSON-169231013 tempest-ServerActionsV293TestJSON-169231013-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7ff82848f0a0>, {}) {{(pid=74613) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 29 17:53:58 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2e6bae2-6e73-43a2-bae3-85645df54ba9 tempest-ServerActionsV293TestJSON-169231013 tempest-ServerActionsV293TestJSON-169231013-project-member] Disconnecting from: [] {{(pid=74613) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 29 17:53:58 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.base [None req-b2e6bae2-6e73-43a2-bae3-85645df54ba9 tempest-ServerActionsV293TestJSON-169231013 tempest-ServerActionsV293TestJSON-169231013-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.074s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 17:53:58 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2e6bae2-6e73-43a2-bae3-85645df54ba9 tempest-ServerActionsV293TestJSON-169231013 tempest-ServerActionsV293TestJSON-169231013-project-member] <== disconnect_volume: return (1085ms) None {{(pid=74613) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 17:53:58 user nova-compute[74613]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b2e6bae2-6e73-43a2-bae3-85645df54ba9 tempest-ServerActionsV293TestJSON-169231013 tempest-ServerActionsV293TestJSON-169231013-project-member] [instance: 8de2ffb3-e264-49f7-8581-6eae21adcaeb] Disconnected iSCSI Volume {{(pid=74613) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 29 17:53:58 user nova-compute[74613]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f4a95811-5656-40b2-994e-6d94df01e860 tempest-TaggedAttachmentsTest-1438740121 tempest-TaggedAttachmentsTest-1438740121-project-member] [instance: 288b8261-8706-4696-879d-d4dd01ab553e] Calling os-brick to attach iSCSI Volume {{(pid=74613) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 29 17:53:58 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-f4a95811-5656-40b2-994e-6d94df01e860 tempest-TaggedAttachmentsTest-1438740121 tempest-TaggedAttachmentsTest-1438740121-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff828156890>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:b7efc2d5-5149-408b-980d-58492994fd4f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xiEOpyjN', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74613) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 17:53:58 user nova-compute[74613]: WARNING os_brick.initiator.connectors.base [None req-f4a95811-5656-40b2-994e-6d94df01e860 tempest-TaggedAttachmentsTest-1438740121 tempest-TaggedAttachmentsTest-1438740121-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 17:53:58 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.base [None req-f4a95811-5656-40b2-994e-6d94df01e860 tempest-TaggedAttachmentsTest-1438740121 tempest-TaggedAttachmentsTest-1438740121-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 17:53:58 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.base [None req-f4a95811-5656-40b2-994e-6d94df01e860 tempest-TaggedAttachmentsTest-1438740121 tempest-TaggedAttachmentsTest-1438740121-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 17:53:58 user nova-compute[74613]: WARNING os_brick.initiator.connectors.base [None req-f4a95811-5656-40b2-994e-6d94df01e860 tempest-TaggedAttachmentsTest-1438740121 tempest-TaggedAttachmentsTest-1438740121-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 17:53:58 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.base [None req-f4a95811-5656-40b2-994e-6d94df01e860 tempest-TaggedAttachmentsTest-1438740121 tempest-TaggedAttachmentsTest-1438740121-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b7efc2d5-5149-408b-980d-58492994fd4f" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 17:53:58 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.base [None req-f4a95811-5656-40b2-994e-6d94df01e860 tempest-TaggedAttachmentsTest-1438740121 tempest-TaggedAttachmentsTest-1438740121-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b7efc2d5-5149-408b-980d-58492994fd4f" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 17:53:58 user nova-compute[74613]: INFO os_brick.initiator.connectors.iscsi [None req-f4a95811-5656-40b2-994e-6d94df01e860 tempest-TaggedAttachmentsTest-1438740121 tempest-TaggedAttachmentsTest-1438740121-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 29 17:53:58 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b7efc2d5-5149-408b-980d-58492994fd4f -p 172.16.0.220:3260 {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 17:53:58 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b7efc2d5-5149-408b-980d-58492994fd4f -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 17:53:58 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[10caf262-fa85-4087-bbfc-4df4fda3c2de]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 17:53:58 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-f4a95811-5656-40b2-994e-6d94df01e860 tempest-TaggedAttachmentsTest-1438740121 tempest-TaggedAttachmentsTest-1438740121-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 29 17:53:58 user nova-compute[74613]:  {{(pid=74613) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 17:53:58 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b7efc2d5-5149-408b-980d-58492994fd4f -p 172.16.0.220:3260 --interface default --op new {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 17:53:58 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b7efc2d5-5149-408b-980d-58492994fd4f -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 17:53:58 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[98057623-03eb-44ff-86c2-9a8cc3fe9b5e]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b7efc2d5-5149-408b-980d-58492994fd4f] added\n', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 17:53:58 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-f4a95811-5656-40b2-994e-6d94df01e860 tempest-TaggedAttachmentsTest-1438740121 tempest-TaggedAttachmentsTest-1438740121-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b7efc2d5-5149-408b-980d-58492994fd4f] added
Nov 29 17:53:58 user nova-compute[74613]:  stderr= {{(pid=74613) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 17:53:58 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b7efc2d5-5149-408b-980d-58492994fd4f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 17:53:58 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b7efc2d5-5149-408b-980d-58492994fd4f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.026s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 17:53:58 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[395e28e6-93c7-4b89-9b4a-04583cbc31a6]: (4, ('', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 17:53:58 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-f4a95811-5656-40b2-994e-6d94df01e860 tempest-TaggedAttachmentsTest-1438740121 tempest-TaggedAttachmentsTest-1438740121-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74613) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 17:53:58 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b7efc2d5-5149-408b-980d-58492994fd4f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 17:53:58 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b7efc2d5-5149-408b-980d-58492994fd4f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 17:53:58 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0614d38-7618-4827-bceb-d1ae4431f7ee]: (4, ('', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 17:53:58 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-f4a95811-5656-40b2-994e-6d94df01e860 tempest-TaggedAttachmentsTest-1438740121 tempest-TaggedAttachmentsTest-1438740121-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74613) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 17:53:58 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b7efc2d5-5149-408b-980d-58492994fd4f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v xiEOpyjN {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 17:53:58 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b7efc2d5-5149-408b-980d-58492994fd4f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v xiEOpyjN" returned: 0 in 0.017s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 17:53:58 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[4eeafb4e-8ac3-4873-9ef2-75d996a90b85]: (4, ('', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 17:53:58 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-f4a95811-5656-40b2-994e-6d94df01e860 tempest-TaggedAttachmentsTest-1438740121 tempest-TaggedAttachmentsTest-1438740121-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'xiEOpyjN'): stdout= stderr= {{(pid=74613) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 17:53:58 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b7efc2d5-5149-408b-980d-58492994fd4f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 17:53:58 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b7efc2d5-5149-408b-980d-58492994fd4f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 17:53:58 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2221510-9407-42b8-bc23-be1037999a3e]: (4, ('', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 17:53:58 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-f4a95811-5656-40b2-994e-6d94df01e860 tempest-TaggedAttachmentsTest-1438740121 tempest-TaggedAttachmentsTest-1438740121-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74613) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 17:53:58 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 17:53:59 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 17:53:59 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[057bc1cb-cd55-467e-94ae-2e7848879581]: (4, ('tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:24920064-fc81-4408-97d1-d8eff97a7554 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8230f3a2-63d8-46cb-8ec7-ceb89fb04e53 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d1f798a1-4f7b-4b9a-8180-fa8f4eb89bf0 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:850c1226-267c-42c0-945f-bfc219c8e88b (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a6b34bdb-5c08-4f7c-b3f5-6b68413947a8 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:17b27fab-6cdb-4820-be62-ffd44e8e2fb5 (non-flash)\n', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 17:53:59 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-f4a95811-5656-40b2-994e-6d94df01e860 tempest-TaggedAttachmentsTest-1438740121 tempest-TaggedAttachmentsTest-1438740121-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:24920064-fc81-4408-97d1-d8eff97a7554 (non-flash)
Nov 29 17:53:59 user nova-compute[74613]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8230f3a2-63d8-46cb-8ec7-ceb89fb04e53 (non-flash)
Nov 29 17:53:59 user nova-compute[74613]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d1f798a1-4f7b-4b9a-8180-fa8f4eb89bf0 (non-flash)
Nov 29 17:53:59 user nova-compute[74613]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:850c1226-267c-42c0-945f-bfc219c8e88b (non-flash)
Nov 29 17:53:59 user nova-compute[74613]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a6b34bdb-5c08-4f7c-b3f5-6b68413947a8 (non-flash)
Nov 29 17:53:59 user nova-compute[74613]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:17b27fab-6cdb-4820-be62-ffd44e8e2fb5 (non-flash)
Nov 29 17:53:59 user nova-compute[74613]:  stderr= {{(pid=74613) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 17:53:59 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-f4a95811-5656-40b2-994e-6d94df01e860 tempest-TaggedAttachmentsTest-1438740121 tempest-TaggedAttachmentsTest-1438740121-project-member] iscsi session list stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:24920064-fc81-4408-97d1-d8eff97a7554 (non-flash)
Nov 29 17:53:59 user nova-compute[74613]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8230f3a2-63d8-46cb-8ec7-ceb89fb04e53 (non-flash)
Nov 29 17:53:59 user nova-compute[74613]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d1f798a1-4f7b-4b9a-8180-fa8f4eb89bf0 (non-flash)
Nov 29 17:53:59 user nova-compute[74613]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:850c1226-267c-42c0-945f-bfc219c8e88b (non-flash)
Nov 29 17:53:59 user nova-compute[74613]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a6b34bdb-5c08-4f7c-b3f5-6b68413947a8 (non-flash)
Nov 29 17:53:59 user nova-compute[74613]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:17b27fab-6cdb-4820-be62-ffd44e8e2fb5 (non-flash)
Nov 29 17:53:59 user nova-compute[74613]:  stderr= {{(pid=74613) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 17:53:59 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b7efc2d5-5149-408b-980d-58492994fd4f -p 172.16.0.220:3260 --login {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 17:53:59 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-acb74ace-3246-44e6-bae3-648fd0bbb262 tempest-VolumesAssistedSnapshotsTest-194727756 tempest-VolumesAssistedSnapshotsTest-194727756-project-admin] No BDM found with device name vda, not building metadata. {{(pid=74613) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 17:53:59 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-acb74ace-3246-44e6-bae3-648fd0bbb262 tempest-VolumesAssistedSnapshotsTest-194727756 tempest-VolumesAssistedSnapshotsTest-194727756-project-admin] No BDM found with device name vdb, not building metadata. {{(pid=74613) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 17:53:59 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-acb74ace-3246-44e6-bae3-648fd0bbb262 tempest-VolumesAssistedSnapshotsTest-194727756 tempest-VolumesAssistedSnapshotsTest-194727756-project-admin] No VIF found with MAC fa:16:3e:a5:be:95, not building metadata {{(pid=74613) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 29 17:53:59 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b7efc2d5-5149-408b-980d-58492994fd4f -p 172.16.0.220:3260 --login" returned: 0 in 0.082s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 17:53:59 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc485edd-df89-41d0-8cf7-6c5486d09d8b]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:b7efc2d5-5149-408b-980d-58492994fd4f, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:b7efc2d5-5149-408b-980d-58492994fd4f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 17:53:59 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-f4a95811-5656-40b2-994e-6d94df01e860 tempest-TaggedAttachmentsTest-1438740121 tempest-TaggedAttachmentsTest-1438740121-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:b7efc2d5-5149-408b-980d-58492994fd4f, portal: 172.16.0.220,3260]
Nov 29 17:53:59 user nova-compute[74613]: Login to [iface: default, target: iqn.2010-10.org.openstack:b7efc2d5-5149-408b-980d-58492994fd4f, portal: 172.16.0.220,3260] successful.
Nov 29 17:53:59 user nova-compute[74613]:  stderr= {{(pid=74613) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 17:53:59 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b7efc2d5-5149-408b-980d-58492994fd4f -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 17:53:59 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b7efc2d5-5149-408b-980d-58492994fd4f -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.022s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 17:53:59 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[51af6650-fe85-42cb-8c58-efd615291168]: (4, ('', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 17:53:59 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-f4a95811-5656-40b2-994e-6d94df01e860 tempest-TaggedAttachmentsTest-1438740121 tempest-TaggedAttachmentsTest-1438740121-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74613) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 17:53:59 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 17:53:59 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.034s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 17:53:59 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b74e346-c695-43c6-a57c-d60ef71f2123]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7efc2d5-5149-408b-980d-58492994fd4f (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:24920064-fc81-4408-97d1-d8eff97a7554 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8230f3a2-63d8-46cb-8ec7-ceb89fb04e53 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d1f798a1-4f7b-4b9a-8180-fa8f4eb89bf0 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:850c1226-267c-42c0-945f-bfc219c8e88b (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a6b34bdb-5c08-4f7c-b3f5-6b68413947a8 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:17b27fab-6cdb-4820-be62-ffd44e8e2fb5 (non-flash)\n', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 17:53:59 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-f4a95811-5656-40b2-994e-6d94df01e860 tempest-TaggedAttachmentsTest-1438740121 tempest-TaggedAttachmentsTest-1438740121-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7efc2d5-5149-408b-980d-58492994fd4f (non-flash)
Nov 29 17:53:59 user nova-compute[74613]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:24920064-fc81-4408-97d1-d8eff97a7554 (non-flash)
Nov 29 17:53:59 user nova-compute[74613]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8230f3a2-63d8-46cb-8ec7-ceb89fb04e53 (non-flash)
Nov 29 17:53:59 user nova-compute[74613]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d1f798a1-4f7b-4b9a-8180-fa8f4eb89bf0 (non-flash)
Nov 29 17:53:59 user nova-compute[74613]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:850c1226-267c-42c0-945f-bfc219c8e88b (non-flash)
Nov 29 17:53:59 user nova-compute[74613]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a6b34bdb-5c08-4f7c-b3f5-6b68413947a8 (non-flash)
Nov 29 17:53:59 user nova-compute[74613]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:17b27fab-6cdb-4820-be62-ffd44e8e2fb5 (non-flash)
Nov 29 17:53:59 user nova-compute[74613]:  stderr= {{(pid=74613) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 17:53:59 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-f4a95811-5656-40b2-994e-6d94df01e860 tempest-TaggedAttachmentsTest-1438740121 tempest-TaggedAttachmentsTest-1438740121-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7efc2d5-5149-408b-980d-58492994fd4f (non-flash)
Nov 29 17:53:59 user nova-compute[74613]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:24920064-fc81-4408-97d1-d8eff97a7554 (non-flash)
Nov 29 17:53:59 user nova-compute[74613]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8230f3a2-63d8-46cb-8ec7-ceb89fb04e53 (non-flash)
Nov 29 17:53:59 user nova-compute[74613]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d1f798a1-4f7b-4b9a-8180-fa8f4eb89bf0 (non-flash)
Nov 29 17:53:59 user nova-compute[74613]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:850c1226-267c-42c0-945f-bfc219c8e88b (non-flash)
Nov 29 17:53:59 user nova-compute[74613]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a6b34bdb-5c08-4f7c-b3f5-6b68413947a8 (non-flash)
Nov 29 17:53:59 user nova-compute[74613]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:17b27fab-6cdb-4820-be62-ffd44e8e2fb5 (non-flash)
Nov 29 17:53:59 user nova-compute[74613]:  stderr= {{(pid=74613) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 17:53:59 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.base [None req-f4a95811-5656-40b2-994e-6d94df01e860 tempest-TaggedAttachmentsTest-1438740121 tempest-TaggedAttachmentsTest-1438740121-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b7efc2d5-5149-408b-980d-58492994fd4f" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.315s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 17:53:59 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-f4a95811-5656-40b2-994e-6d94df01e860 tempest-TaggedAttachmentsTest-1438740121 tempest-TaggedAttachmentsTest-1438740121-project-member] Connected to 172.16.0.220:3260 {{(pid=74613) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 29 17:53:59 user nova-compute[74613]: DEBUG os_brick.initiator.linuxscsi [None req-f4a95811-5656-40b2-994e-6d94df01e860 tempest-TaggedAttachmentsTest-1438740121 tempest-TaggedAttachmentsTest-1438740121-project-member] HCTL ('39', '-', '-', 0) found on session 10 with lun 0 {{(pid=74613) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 29 17:53:59 user nova-compute[74613]: DEBUG os_brick.initiator.linuxscsi [None req-f4a95811-5656-40b2-994e-6d94df01e860 tempest-TaggedAttachmentsTest-1438740121 tempest-TaggedAttachmentsTest-1438740121-project-member] Scanning host 39 c: -, t: -, l: 0) {{(pid=74613) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 29 17:53:59 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host39/scan {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 17:53:59 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host39/scan" returned: 0 in 0.021s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 17:53:59 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[d114efc8-03f8-407d-b14a-f10b7b1525b7]: (4, ('- - 0', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 17:53:59 user nova-compute[74613]: DEBUG os_brick.initiator.linuxscsi [None req-f4a95811-5656-40b2-994e-6d94df01e860 tempest-TaggedAttachmentsTest-1438740121 tempest-TaggedAttachmentsTest-1438740121-project-member] Searching for a device in session 10 and hctl ['39', '*', '*', 0] yield: sdh {{(pid=74613) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 29 17:53:59 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-f4a95811-5656-40b2-994e-6d94df01e860 tempest-TaggedAttachmentsTest-1438740121 tempest-TaggedAttachmentsTest-1438740121-project-member] Connected to sdh using {'target_iqn': 'iqn.2010-10.org.openstack:b7efc2d5-5149-408b-980d-58492994fd4f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xiEOpyjN', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74613) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 29 17:53:59 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-acb74ace-3246-44e6-bae3-648fd0bbb262 tempest-VolumesAssistedSnapshotsTest-194727756 tempest-VolumesAssistedSnapshotsTest-194727756-project-admin] Lock "d4ecef60-62f9-4969-b57f-3bb45a44cc9f" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 10.543s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 17:53:59 user nova-compute[74613]: DEBUG nova.compute.manager [None req-b2e6bae2-6e73-43a2-bae3-85645df54ba9 tempest-ServerActionsV293TestJSON-169231013 tempest-ServerActionsV293TestJSON-169231013-project-member] [instance: 8de2ffb3-e264-49f7-8581-6eae21adcaeb] Preparing to wait for external event volume-reimaged-fbbdc3d2-136d-4fba-b6ba-f27f35a0733b {{(pid=74613) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:283}}
Nov 29 17:53:59 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-b2e6bae2-6e73-43a2-bae3-85645df54ba9 tempest-ServerActionsV293TestJSON-169231013 tempest-ServerActionsV293TestJSON-169231013-project-member] Acquiring lock "8de2ffb3-e264-49f7-8581-6eae21adcaeb-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 17:53:59 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-b2e6bae2-6e73-43a2-bae3-85645df54ba9 tempest-ServerActionsV293TestJSON-169231013 tempest-ServerActionsV293TestJSON-169231013-project-member] Lock "8de2ffb3-e264-49f7-8581-6eae21adcaeb-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 17:53:59 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-b2e6bae2-6e73-43a2-bae3-85645df54ba9 tempest-ServerActionsV293TestJSON-169231013 tempest-ServerActionsV293TestJSON-169231013-project-member] Lock "8de2ffb3-e264-49f7-8581-6eae21adcaeb-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 17:53:59 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-53cafa6d-29f6-47a0-aab4-0fff72d0c606 tempest-VolumesAssistedSnapshotsTest-339527325 tempest-VolumesAssistedSnapshotsTest-339527325-project] [instance: d4ecef60-62f9-4969-b57f-3bb45a44cc9f] volume_snapshot_create: create_info: {'snapshot_id': '50393072-3fe9-4dbe-9348-a94b6c3499f2', 'type': 'qcow2', 'new_file': 'new_file'} {{(pid=74613) volume_snapshot_create /opt/stack/nova/nova/virt/libvirt/driver.py:3576}}
Nov 29 17:53:59 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-53cafa6d-29f6-47a0-aab4-0fff72d0c606 tempest-VolumesAssistedSnapshotsTest-339527325 tempest-VolumesAssistedSnapshotsTest-339527325-project] [instance: d4ecef60-62f9-4969-b57f-3bb45a44cc9f] snap xml: <domainsnapshot>
Nov 29 17:53:59 user nova-compute[74613]:   <disks>
Nov 29 17:53:59 user nova-compute[74613]:     <disk name="/dev/sdb" snapshot="external" type="file">
Nov 29 17:53:59 user nova-compute[74613]:       <source file="/dev/new_file"/>
Nov 29 17:53:59 user nova-compute[74613]:     </disk>
Nov 29 17:53:59 user nova-compute[74613]:     <disk name="vda" snapshot="no"/>
Nov 29 17:53:59 user nova-compute[74613]:   </disks>
Nov 29 17:53:59 user nova-compute[74613]: </domainsnapshot>
Nov 29 17:53:59 user nova-compute[74613]:  {{(pid=74613) _volume_snapshot_create /opt/stack/nova/nova/virt/libvirt/driver.py:3517}}
Nov 29 17:53:59 user nova-compute[74613]: DEBUG nova.objects.instance [None req-53cafa6d-29f6-47a0-aab4-0fff72d0c606 tempest-VolumesAssistedSnapshotsTest-339527325 tempest-VolumesAssistedSnapshotsTest-339527325-project] Lazy-loading 'system_metadata' on Instance uuid d4ecef60-62f9-4969-b57f-3bb45a44cc9f {{(pid=74613) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 17:53:59 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-a05f1384-14f8-4270-9db7-28b3db7749d9 tempest-VolumesAssistedSnapshotsTest-339527325 tempest-VolumesAssistedSnapshotsTest-339527325-project] [instance: d4ecef60-62f9-4969-b57f-3bb45a44cc9f] volume_snapshot_delete: delete_info: {'volume_id': '17b27fab-6cdb-4820-be62-ffd44e8e2fb5'} {{(pid=74613) _volume_snapshot_delete /opt/stack/nova/nova/virt/libvirt/driver.py:3677}}
Nov 29 17:53:59 user nova-compute[74613]: ERROR nova.virt.libvirt.driver [None req-a05f1384-14f8-4270-9db7-28b3db7749d9 tempest-VolumesAssistedSnapshotsTest-339527325 tempest-VolumesAssistedSnapshotsTest-339527325-project] [instance: d4ecef60-62f9-4969-b57f-3bb45a44cc9f] Error occurred during volume_snapshot_delete, sending error status to Cinder.: KeyError: 'type'
Nov 29 17:53:59 user nova-compute[74613]: ERROR nova.virt.libvirt.driver [instance: d4ecef60-62f9-4969-b57f-3bb45a44cc9f] Traceback (most recent call last):
Nov 29 17:53:59 user nova-compute[74613]: ERROR nova.virt.libvirt.driver [instance: d4ecef60-62f9-4969-b57f-3bb45a44cc9f]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3850, in volume_snapshot_delete
Nov 29 17:53:59 user nova-compute[74613]: ERROR nova.virt.libvirt.driver [instance: d4ecef60-62f9-4969-b57f-3bb45a44cc9f]     self._volume_snapshot_delete(context, instance, volume_id,
Nov 29 17:53:59 user nova-compute[74613]: ERROR nova.virt.libvirt.driver [instance: d4ecef60-62f9-4969-b57f-3bb45a44cc9f]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3680, in _volume_snapshot_delete
Nov 29 17:53:59 user nova-compute[74613]: ERROR nova.virt.libvirt.driver [instance: d4ecef60-62f9-4969-b57f-3bb45a44cc9f]     if delete_info['type'] != 'qcow2':
Nov 29 17:53:59 user nova-compute[74613]: ERROR nova.virt.libvirt.driver [instance: d4ecef60-62f9-4969-b57f-3bb45a44cc9f] KeyError: 'type'
Nov 29 17:53:59 user nova-compute[74613]: ERROR nova.virt.libvirt.driver [instance: d4ecef60-62f9-4969-b57f-3bb45a44cc9f] 
Nov 29 17:53:59 user nova-compute[74613]: INFO nova.virt.libvirt.driver [None req-53cafa6d-29f6-47a0-aab4-0fff72d0c606 tempest-VolumesAssistedSnapshotsTest-339527325 tempest-VolumesAssistedSnapshotsTest-339527325-project] [instance: d4ecef60-62f9-4969-b57f-3bb45a44cc9f] Skipping quiescing instance: QEMU guest agent is not enabled.
Nov 29 17:53:59 user nova-compute[74613]: ERROR nova.virt.libvirt.driver [None req-53cafa6d-29f6-47a0-aab4-0fff72d0c606 tempest-VolumesAssistedSnapshotsTest-339527325 tempest-VolumesAssistedSnapshotsTest-339527325-project] [instance: d4ecef60-62f9-4969-b57f-3bb45a44cc9f] Unable to create VM snapshot, failing volume_snapshot operation.: libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Nov 29 17:53:59 user nova-compute[74613]: ERROR nova.virt.libvirt.driver [instance: d4ecef60-62f9-4969-b57f-3bb45a44cc9f] Traceback (most recent call last):
Nov 29 17:53:59 user nova-compute[74613]: ERROR nova.virt.libvirt.driver [instance: d4ecef60-62f9-4969-b57f-3bb45a44cc9f]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3544, in _volume_snapshot_create
Nov 29 17:53:59 user nova-compute[74613]: ERROR nova.virt.libvirt.driver [instance: d4ecef60-62f9-4969-b57f-3bb45a44cc9f]     guest.snapshot(snapshot, no_metadata=True, disk_only=True,
Nov 29 17:53:59 user nova-compute[74613]: ERROR nova.virt.libvirt.driver [instance: d4ecef60-62f9-4969-b57f-3bb45a44cc9f]   File "/opt/stack/nova/nova/virt/libvirt/guest.py", line 569, in snapshot
Nov 29 17:53:59 user nova-compute[74613]: ERROR nova.virt.libvirt.driver [instance: d4ecef60-62f9-4969-b57f-3bb45a44cc9f]     self._domain.snapshotCreateXML(device_xml, flags=flags)
Nov 29 17:53:59 user nova-compute[74613]: ERROR nova.virt.libvirt.driver [instance: d4ecef60-62f9-4969-b57f-3bb45a44cc9f]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 193, in doit
Nov 29 17:53:59 user nova-compute[74613]: ERROR nova.virt.libvirt.driver [instance: d4ecef60-62f9-4969-b57f-3bb45a44cc9f]     result = proxy_call(self._autowrap, f, *args, **kwargs)
Nov 29 17:53:59 user nova-compute[74613]: ERROR nova.virt.libvirt.driver [instance: d4ecef60-62f9-4969-b57f-3bb45a44cc9f]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 151, in proxy_call
Nov 29 17:53:59 user nova-compute[74613]: ERROR nova.virt.libvirt.driver [instance: d4ecef60-62f9-4969-b57f-3bb45a44cc9f]     rv = execute(f, *args, **kwargs)
Nov 29 17:53:59 user nova-compute[74613]: ERROR nova.virt.libvirt.driver [instance: d4ecef60-62f9-4969-b57f-3bb45a44cc9f]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 132, in execute
Nov 29 17:53:59 user nova-compute[74613]: ERROR nova.virt.libvirt.driver [instance: d4ecef60-62f9-4969-b57f-3bb45a44cc9f]     six.reraise(c, e, tb)
Nov 29 17:53:59 user nova-compute[74613]: ERROR nova.virt.libvirt.driver [instance: d4ecef60-62f9-4969-b57f-3bb45a44cc9f]   File "/usr/lib/python3/dist-packages/six.py", line 719, in reraise
Nov 29 17:53:59 user nova-compute[74613]: ERROR nova.virt.libvirt.driver [instance: d4ecef60-62f9-4969-b57f-3bb45a44cc9f]     raise value
Nov 29 17:53:59 user nova-compute[74613]: ERROR nova.virt.libvirt.driver [instance: d4ecef60-62f9-4969-b57f-3bb45a44cc9f]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 86, in tworker
Nov 29 17:53:59 user nova-compute[74613]: ERROR nova.virt.libvirt.driver [instance: d4ecef60-62f9-4969-b57f-3bb45a44cc9f]     rv = meth(*args, **kwargs)
Nov 29 17:53:59 user nova-compute[74613]: ERROR nova.virt.libvirt.driver [instance: d4ecef60-62f9-4969-b57f-3bb45a44cc9f]   File "/usr/lib/python3/dist-packages/libvirt.py", line 3070, in snapshotCreateXML
Nov 29 17:53:59 user nova-compute[74613]: ERROR nova.virt.libvirt.driver [instance: d4ecef60-62f9-4969-b57f-3bb45a44cc9f]     raise libvirtError('virDomainSnapshotCreateXML() failed')
Nov 29 17:53:59 user nova-compute[74613]: ERROR nova.virt.libvirt.driver [instance: d4ecef60-62f9-4969-b57f-3bb45a44cc9f] libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Nov 29 17:53:59 user nova-compute[74613]: ERROR nova.virt.libvirt.driver [instance: d4ecef60-62f9-4969-b57f-3bb45a44cc9f] 
Nov 29 17:53:59 user nova-compute[74613]: ERROR nova.virt.libvirt.driver [None req-53cafa6d-29f6-47a0-aab4-0fff72d0c606 tempest-VolumesAssistedSnapshotsTest-339527325 tempest-VolumesAssistedSnapshotsTest-339527325-project] [instance: d4ecef60-62f9-4969-b57f-3bb45a44cc9f] Error occurred during volume_snapshot_create, sending error status to Cinder.: libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Nov 29 17:53:59 user nova-compute[74613]: ERROR nova.virt.libvirt.driver [instance: d4ecef60-62f9-4969-b57f-3bb45a44cc9f] Traceback (most recent call last):
Nov 29 17:53:59 user nova-compute[74613]: ERROR nova.virt.libvirt.driver [instance: d4ecef60-62f9-4969-b57f-3bb45a44cc9f]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3594, in volume_snapshot_create
Nov 29 17:53:59 user nova-compute[74613]: ERROR nova.virt.libvirt.driver [instance: d4ecef60-62f9-4969-b57f-3bb45a44cc9f]     self._volume_snapshot_create(context, instance, guest,
Nov 29 17:53:59 user nova-compute[74613]: ERROR nova.virt.libvirt.driver [instance: d4ecef60-62f9-4969-b57f-3bb45a44cc9f]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3544, in _volume_snapshot_create
Nov 29 17:53:59 user nova-compute[74613]: ERROR nova.virt.libvirt.driver [instance: d4ecef60-62f9-4969-b57f-3bb45a44cc9f]     guest.snapshot(snapshot, no_metadata=True, disk_only=True,
Nov 29 17:53:59 user nova-compute[74613]: ERROR nova.virt.libvirt.driver [instance: d4ecef60-62f9-4969-b57f-3bb45a44cc9f]   File "/opt/stack/nova/nova/virt/libvirt/guest.py", line 569, in snapshot
Nov 29 17:53:59 user nova-compute[74613]: ERROR nova.virt.libvirt.driver [instance: d4ecef60-62f9-4969-b57f-3bb45a44cc9f]     self._domain.snapshotCreateXML(device_xml, flags=flags)
Nov 29 17:53:59 user nova-compute[74613]: ERROR nova.virt.libvirt.driver [instance: d4ecef60-62f9-4969-b57f-3bb45a44cc9f]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 193, in doit
Nov 29 17:53:59 user nova-compute[74613]: ERROR nova.virt.libvirt.driver [instance: d4ecef60-62f9-4969-b57f-3bb45a44cc9f]     result = proxy_call(self._autowrap, f, *args, **kwargs)
Nov 29 17:53:59 user nova-compute[74613]: ERROR nova.virt.libvirt.driver [instance: d4ecef60-62f9-4969-b57f-3bb45a44cc9f]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 151, in proxy_call
Nov 29 17:53:59 user nova-compute[74613]: ERROR nova.virt.libvirt.driver [instance: d4ecef60-62f9-4969-b57f-3bb45a44cc9f]     rv = execute(f, *args, **kwargs)
Nov 29 17:53:59 user nova-compute[74613]: ERROR nova.virt.libvirt.driver [instance: d4ecef60-62f9-4969-b57f-3bb45a44cc9f]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 132, in execute
Nov 29 17:53:59 user nova-compute[74613]: ERROR nova.virt.libvirt.driver [instance: d4ecef60-62f9-4969-b57f-3bb45a44cc9f]     six.reraise(c, e, tb)
Nov 29 17:53:59 user nova-compute[74613]: ERROR nova.virt.libvirt.driver [instance: d4ecef60-62f9-4969-b57f-3bb45a44cc9f]   File "/usr/lib/python3/dist-packages/six.py", line 719, in reraise
Nov 29 17:53:59 user nova-compute[74613]: ERROR nova.virt.libvirt.driver [instance: d4ecef60-62f9-4969-b57f-3bb45a44cc9f]     raise value
Nov 29 17:53:59 user nova-compute[74613]: ERROR nova.virt.libvirt.driver [instance: d4ecef60-62f9-4969-b57f-3bb45a44cc9f]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 86, in tworker
Nov 29 17:53:59 user nova-compute[74613]: ERROR nova.virt.libvirt.driver [instance: d4ecef60-62f9-4969-b57f-3bb45a44cc9f]     rv = meth(*args, **kwargs)
Nov 29 17:53:59 user nova-compute[74613]: ERROR nova.virt.libvirt.driver [instance: d4ecef60-62f9-4969-b57f-3bb45a44cc9f]   File "/usr/lib/python3/dist-packages/libvirt.py", line 3070, in snapshotCreateXML
Nov 29 17:53:59 user nova-compute[74613]: ERROR nova.virt.libvirt.driver [instance: d4ecef60-62f9-4969-b57f-3bb45a44cc9f]     raise libvirtError('virDomainSnapshotCreateXML() failed')
Nov 29 17:53:59 user nova-compute[74613]: ERROR nova.virt.libvirt.driver [instance: d4ecef60-62f9-4969-b57f-3bb45a44cc9f] libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Nov 29 17:53:59 user nova-compute[74613]: ERROR nova.virt.libvirt.driver [instance: d4ecef60-62f9-4969-b57f-3bb45a44cc9f] 
Nov 29 17:53:59 user nova-compute[74613]: ERROR nova.virt.libvirt.driver [None req-a05f1384-14f8-4270-9db7-28b3db7749d9 tempest-VolumesAssistedSnapshotsTest-339527325 tempest-VolumesAssistedSnapshotsTest-339527325-project] Failed to send updated snapshot status to volume service.: nova.exception.SnapshotNotFound: Snapshot None could not be found.
Nov 29 17:53:59 user nova-compute[74613]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Nov 29 17:53:59 user nova-compute[74613]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3850, in volume_snapshot_delete
Nov 29 17:53:59 user nova-compute[74613]: ERROR nova.virt.libvirt.driver     self._volume_snapshot_delete(context, instance, volume_id,
Nov 29 17:53:59 user nova-compute[74613]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3680, in _volume_snapshot_delete
Nov 29 17:53:59 user nova-compute[74613]: ERROR nova.virt.libvirt.driver     if delete_info['type'] != 'qcow2':
Nov 29 17:53:59 user nova-compute[74613]: ERROR nova.virt.libvirt.driver KeyError: 'type'
Nov 29 17:53:59 user nova-compute[74613]: ERROR nova.virt.libvirt.driver 
Nov 29 17:53:59 user nova-compute[74613]: ERROR nova.virt.libvirt.driver During handling of the above exception, another exception occurred:
Nov 29 17:53:59 user nova-compute[74613]: ERROR nova.virt.libvirt.driver 
Nov 29 17:53:59 user nova-compute[74613]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Nov 29 17:53:59 user nova-compute[74613]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper
Nov 29 17:53:59 user nova-compute[74613]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, snapshot_id, *args, **kwargs)
Nov 29 17:53:59 user nova-compute[74613]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 761, in update_snapshot_status
Nov 29 17:53:59 user nova-compute[74613]: ERROR nova.virt.libvirt.driver     vs.update_snapshot_status(
Nov 29 17:53:59 user nova-compute[74613]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 225, in update_snapshot_status
Nov 29 17:53:59 user nova-compute[74613]: ERROR nova.virt.libvirt.driver     return self._action('os-update_snapshot_status',
Nov 29 17:53:59 user nova-compute[74613]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 221, in _action
Nov 29 17:53:59 user nova-compute[74613]: ERROR nova.virt.libvirt.driver     resp, body = self.api.client.post(url, body=body)
Nov 29 17:53:59 user nova-compute[74613]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 223, in post
Nov 29 17:53:59 user nova-compute[74613]: ERROR nova.virt.libvirt.driver     return self._cs_request(url, 'POST', **kwargs)
Nov 29 17:53:59 user nova-compute[74613]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Nov 29 17:53:59 user nova-compute[74613]: ERROR nova.virt.libvirt.driver     return self.request(url, method, **kwargs)
Nov 29 17:53:59 user nova-compute[74613]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Nov 29 17:53:59 user nova-compute[74613]: ERROR nova.virt.libvirt.driver     raise exceptions.from_response(resp, body)
Nov 29 17:53:59 user nova-compute[74613]: ERROR nova.virt.libvirt.driver cinderclient.exceptions.NotFound: Snapshot None could not be found. (HTTP 404) (Request-ID: req-5148781c-f018-42dd-9111-1109c09605c7)
Nov 29 17:53:59 user nova-compute[74613]: ERROR nova.virt.libvirt.driver 
Nov 29 17:53:59 user nova-compute[74613]: ERROR nova.virt.libvirt.driver During handling of the above exception, another exception occurred:
Nov 29 17:53:59 user nova-compute[74613]: ERROR nova.virt.libvirt.driver 
Nov 29 17:53:59 user nova-compute[74613]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Nov 29 17:53:59 user nova-compute[74613]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3416, in _volume_snapshot_update_status
Nov 29 17:53:59 user nova-compute[74613]: ERROR nova.virt.libvirt.driver     self._volume_api.update_snapshot_status(context,
Nov 29 17:53:59 user nova-compute[74613]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 397, in wrapper
Nov 29 17:53:59 user nova-compute[74613]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, *args, **kwargs)
Nov 29 17:53:59 user nova-compute[74613]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 468, in wrapper
Nov 29 17:53:59 user nova-compute[74613]: ERROR nova.virt.libvirt.driver     _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id))
Nov 29 17:53:59 user nova-compute[74613]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 488, in _reraise
Nov 29 17:53:59 user nova-compute[74613]: ERROR nova.virt.libvirt.driver     raise desired_exc.with_traceback(sys.exc_info()[2])
Nov 29 17:53:59 user nova-compute[74613]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper
Nov 29 17:53:59 user nova-compute[74613]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, snapshot_id, *args, **kwargs)
Nov 29 17:53:59 user nova-compute[74613]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 761, in update_snapshot_status
Nov 29 17:53:59 user nova-compute[74613]: ERROR nova.virt.libvirt.driver     vs.update_snapshot_status(
Nov 29 17:53:59 user nova-compute[74613]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 225, in update_snapshot_status
Nov 29 17:53:59 user nova-compute[74613]: ERROR nova.virt.libvirt.driver     return self._action('os-update_snapshot_status',
Nov 29 17:53:59 user nova-compute[74613]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 221, in _action
Nov 29 17:53:59 user nova-compute[74613]: ERROR nova.virt.libvirt.driver     resp, body = self.api.client.post(url, body=body)
Nov 29 17:53:59 user nova-compute[74613]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 223, in post
Nov 29 17:53:59 user nova-compute[74613]: ERROR nova.virt.libvirt.driver     return self._cs_request(url, 'POST', **kwargs)
Nov 29 17:53:59 user nova-compute[74613]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Nov 29 17:53:59 user nova-compute[74613]: ERROR nova.virt.libvirt.driver     return self.request(url, method, **kwargs)
Nov 29 17:53:59 user nova-compute[74613]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Nov 29 17:53:59 user nova-compute[74613]: ERROR nova.virt.libvirt.driver     raise exceptions.from_response(resp, body)
Nov 29 17:53:59 user nova-compute[74613]: ERROR nova.virt.libvirt.driver nova.exception.SnapshotNotFound: Snapshot None could not be found.
Nov 29 17:53:59 user nova-compute[74613]: ERROR nova.virt.libvirt.driver 
Nov 29 17:53:59 user nova-compute[74613]: ERROR oslo_messaging.rpc.server [None req-a05f1384-14f8-4270-9db7-28b3db7749d9 tempest-VolumesAssistedSnapshotsTest-339527325 tempest-VolumesAssistedSnapshotsTest-339527325-project] Exception during message handling: KeyError: 'type'
Nov 29 17:53:59 user nova-compute[74613]: ERROR oslo_messaging.rpc.server Traceback (most recent call last):
Nov 29 17:53:59 user nova-compute[74613]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py", line 165, in _process_incoming
Nov 29 17:53:59 user nova-compute[74613]: ERROR oslo_messaging.rpc.server     res = self.dispatcher.dispatch(message)
Nov 29 17:53:59 user nova-compute[74613]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch
Nov 29 17:53:59 user nova-compute[74613]: ERROR oslo_messaging.rpc.server     return self._do_dispatch(endpoint, method, ctxt, args)
Nov 29 17:53:59 user nova-compute[74613]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch
Nov 29 17:53:59 user nova-compute[74613]: ERROR oslo_messaging.rpc.server     result = func(ctxt, **new_args)
Nov 29 17:53:59 user nova-compute[74613]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py", line 244, in inner
Nov 29 17:53:59 user nova-compute[74613]: ERROR oslo_messaging.rpc.server     return func(*args, **kwargs)
Nov 29 17:53:59 user nova-compute[74613]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 65, in wrapped
Nov 29 17:53:59 user nova-compute[74613]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Nov 29 17:53:59 user nova-compute[74613]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Nov 29 17:53:59 user nova-compute[74613]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Nov 29 17:53:59 user nova-compute[74613]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Nov 29 17:53:59 user nova-compute[74613]: ERROR oslo_messaging.rpc.server     raise self.value
Nov 29 17:53:59 user nova-compute[74613]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped
Nov 29 17:53:59 user nova-compute[74613]: ERROR oslo_messaging.rpc.server     return f(self, context, *args, **kw)
Nov 29 17:53:59 user nova-compute[74613]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 4517, in volume_snapshot_delete
Nov 29 17:53:59 user nova-compute[74613]: ERROR oslo_messaging.rpc.server     self.driver.volume_snapshot_delete(context, instance, volume_id,
Nov 29 17:53:59 user nova-compute[74613]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3853, in volume_snapshot_delete
Nov 29 17:53:59 user nova-compute[74613]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Nov 29 17:53:59 user nova-compute[74613]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Nov 29 17:53:59 user nova-compute[74613]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Nov 29 17:53:59 user nova-compute[74613]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Nov 29 17:53:59 user nova-compute[74613]: ERROR oslo_messaging.rpc.server     raise self.value
Nov 29 17:53:59 user nova-compute[74613]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3850, in volume_snapshot_delete
Nov 29 17:53:59 user nova-compute[74613]: ERROR oslo_messaging.rpc.server     self._volume_snapshot_delete(context, instance, volume_id,
Nov 29 17:53:59 user nova-compute[74613]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3680, in _volume_snapshot_delete
Nov 29 17:53:59 user nova-compute[74613]: ERROR oslo_messaging.rpc.server     if delete_info['type'] != 'qcow2':
Nov 29 17:53:59 user nova-compute[74613]: ERROR oslo_messaging.rpc.server KeyError: 'type'
Nov 29 17:53:59 user nova-compute[74613]: ERROR oslo_messaging.rpc.server 
Nov 29 17:53:59 user nova-compute[74613]: ERROR nova.virt.libvirt.driver [None req-53cafa6d-29f6-47a0-aab4-0fff72d0c606 tempest-VolumesAssistedSnapshotsTest-339527325 tempest-VolumesAssistedSnapshotsTest-339527325-project] Failed to send updated snapshot status to volume service.: nova.exception.SnapshotNotFound: Snapshot 50393072-3fe9-4dbe-9348-a94b6c3499f2 could not be found.
Nov 29 17:53:59 user nova-compute[74613]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Nov 29 17:53:59 user nova-compute[74613]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3594, in volume_snapshot_create
Nov 29 17:53:59 user nova-compute[74613]: ERROR nova.virt.libvirt.driver     self._volume_snapshot_create(context, instance, guest,
Nov 29 17:53:59 user nova-compute[74613]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3544, in _volume_snapshot_create
Nov 29 17:53:59 user nova-compute[74613]: ERROR nova.virt.libvirt.driver     guest.snapshot(snapshot, no_metadata=True, disk_only=True,
Nov 29 17:53:59 user nova-compute[74613]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/guest.py", line 569, in snapshot
Nov 29 17:53:59 user nova-compute[74613]: ERROR nova.virt.libvirt.driver     self._domain.snapshotCreateXML(device_xml, flags=flags)
Nov 29 17:53:59 user nova-compute[74613]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 193, in doit
Nov 29 17:53:59 user nova-compute[74613]: ERROR nova.virt.libvirt.driver     result = proxy_call(self._autowrap, f, *args, **kwargs)
Nov 29 17:53:59 user nova-compute[74613]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 151, in proxy_call
Nov 29 17:53:59 user nova-compute[74613]: ERROR nova.virt.libvirt.driver     rv = execute(f, *args, **kwargs)
Nov 29 17:53:59 user nova-compute[74613]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 132, in execute
Nov 29 17:53:59 user nova-compute[74613]: ERROR nova.virt.libvirt.driver     six.reraise(c, e, tb)
Nov 29 17:53:59 user nova-compute[74613]: ERROR nova.virt.libvirt.driver   File "/usr/lib/python3/dist-packages/six.py", line 719, in reraise
Nov 29 17:53:59 user nova-compute[74613]: ERROR nova.virt.libvirt.driver     raise value
Nov 29 17:53:59 user nova-compute[74613]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 86, in tworker
Nov 29 17:53:59 user nova-compute[74613]: ERROR nova.virt.libvirt.driver     rv = meth(*args, **kwargs)
Nov 29 17:53:59 user nova-compute[74613]: ERROR nova.virt.libvirt.driver   File "/usr/lib/python3/dist-packages/libvirt.py", line 3070, in snapshotCreateXML
Nov 29 17:53:59 user nova-compute[74613]: ERROR nova.virt.libvirt.driver     raise libvirtError('virDomainSnapshotCreateXML() failed')
Nov 29 17:53:59 user nova-compute[74613]: ERROR nova.virt.libvirt.driver libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Nov 29 17:53:59 user nova-compute[74613]: ERROR nova.virt.libvirt.driver 
Nov 29 17:53:59 user nova-compute[74613]: ERROR nova.virt.libvirt.driver During handling of the above exception, another exception occurred:
Nov 29 17:53:59 user nova-compute[74613]: ERROR nova.virt.libvirt.driver 
Nov 29 17:53:59 user nova-compute[74613]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Nov 29 17:53:59 user nova-compute[74613]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper
Nov 29 17:53:59 user nova-compute[74613]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, snapshot_id, *args, **kwargs)
Nov 29 17:53:59 user nova-compute[74613]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 761, in update_snapshot_status
Nov 29 17:53:59 user nova-compute[74613]: ERROR nova.virt.libvirt.driver     vs.update_snapshot_status(
Nov 29 17:53:59 user nova-compute[74613]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 225, in update_snapshot_status
Nov 29 17:53:59 user nova-compute[74613]: ERROR nova.virt.libvirt.driver     return self._action('os-update_snapshot_status',
Nov 29 17:53:59 user nova-compute[74613]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 221, in _action
Nov 29 17:53:59 user nova-compute[74613]: ERROR nova.virt.libvirt.driver     resp, body = self.api.client.post(url, body=body)
Nov 29 17:53:59 user nova-compute[74613]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 223, in post
Nov 29 17:53:59 user nova-compute[74613]: ERROR nova.virt.libvirt.driver     return self._cs_request(url, 'POST', **kwargs)
Nov 29 17:53:59 user nova-compute[74613]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Nov 29 17:53:59 user nova-compute[74613]: ERROR nova.virt.libvirt.driver     return self.request(url, method, **kwargs)
Nov 29 17:53:59 user nova-compute[74613]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Nov 29 17:53:59 user nova-compute[74613]: ERROR nova.virt.libvirt.driver     raise exceptions.from_response(resp, body)
Nov 29 17:53:59 user nova-compute[74613]: ERROR nova.virt.libvirt.driver cinderclient.exceptions.NotFound: Snapshot 50393072-3fe9-4dbe-9348-a94b6c3499f2 could not be found. (HTTP 404) (Request-ID: req-d8d99eff-0c67-4fa6-9a17-11617954bd19)
Nov 29 17:53:59 user nova-compute[74613]: ERROR nova.virt.libvirt.driver 
Nov 29 17:53:59 user nova-compute[74613]: ERROR nova.virt.libvirt.driver During handling of the above exception, another exception occurred:
Nov 29 17:53:59 user nova-compute[74613]: ERROR nova.virt.libvirt.driver 
Nov 29 17:53:59 user nova-compute[74613]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Nov 29 17:53:59 user nova-compute[74613]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3416, in _volume_snapshot_update_status
Nov 29 17:53:59 user nova-compute[74613]: ERROR nova.virt.libvirt.driver     self._volume_api.update_snapshot_status(context,
Nov 29 17:53:59 user nova-compute[74613]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 397, in wrapper
Nov 29 17:53:59 user nova-compute[74613]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, *args, **kwargs)
Nov 29 17:53:59 user nova-compute[74613]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 468, in wrapper
Nov 29 17:53:59 user nova-compute[74613]: ERROR nova.virt.libvirt.driver     _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id))
Nov 29 17:53:59 user nova-compute[74613]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 488, in _reraise
Nov 29 17:53:59 user nova-compute[74613]: ERROR nova.virt.libvirt.driver     raise desired_exc.with_traceback(sys.exc_info()[2])
Nov 29 17:53:59 user nova-compute[74613]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper
Nov 29 17:53:59 user nova-compute[74613]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, snapshot_id, *args, **kwargs)
Nov 29 17:53:59 user nova-compute[74613]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 761, in update_snapshot_status
Nov 29 17:53:59 user nova-compute[74613]: ERROR nova.virt.libvirt.driver     vs.update_snapshot_status(
Nov 29 17:53:59 user nova-compute[74613]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 225, in update_snapshot_status
Nov 29 17:53:59 user nova-compute[74613]: ERROR nova.virt.libvirt.driver     return self._action('os-update_snapshot_status',
Nov 29 17:53:59 user nova-compute[74613]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 221, in _action
Nov 29 17:53:59 user nova-compute[74613]: ERROR nova.virt.libvirt.driver     resp, body = self.api.client.post(url, body=body)
Nov 29 17:53:59 user nova-compute[74613]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 223, in post
Nov 29 17:53:59 user nova-compute[74613]: ERROR nova.virt.libvirt.driver     return self._cs_request(url, 'POST', **kwargs)
Nov 29 17:53:59 user nova-compute[74613]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Nov 29 17:53:59 user nova-compute[74613]: ERROR nova.virt.libvirt.driver     return self.request(url, method, **kwargs)
Nov 29 17:53:59 user nova-compute[74613]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Nov 29 17:53:59 user nova-compute[74613]: ERROR nova.virt.libvirt.driver     raise exceptions.from_response(resp, body)
Nov 29 17:53:59 user nova-compute[74613]: ERROR nova.virt.libvirt.driver nova.exception.SnapshotNotFound: Snapshot 50393072-3fe9-4dbe-9348-a94b6c3499f2 could not be found.
Nov 29 17:53:59 user nova-compute[74613]: ERROR nova.virt.libvirt.driver 
Nov 29 17:53:59 user nova-compute[74613]: ERROR oslo_messaging.rpc.server [None req-53cafa6d-29f6-47a0-aab4-0fff72d0c606 tempest-VolumesAssistedSnapshotsTest-339527325 tempest-VolumesAssistedSnapshotsTest-339527325-project] Exception during message handling: libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Nov 29 17:53:59 user nova-compute[74613]: ERROR oslo_messaging.rpc.server Traceback (most recent call last):
Nov 29 17:53:59 user nova-compute[74613]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py", line 165, in _process_incoming
Nov 29 17:53:59 user nova-compute[74613]: ERROR oslo_messaging.rpc.server     res = self.dispatcher.dispatch(message)
Nov 29 17:53:59 user nova-compute[74613]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch
Nov 29 17:53:59 user nova-compute[74613]: ERROR oslo_messaging.rpc.server     return self._do_dispatch(endpoint, method, ctxt, args)
Nov 29 17:53:59 user nova-compute[74613]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch
Nov 29 17:53:59 user nova-compute[74613]: ERROR oslo_messaging.rpc.server     result = func(ctxt, **new_args)
Nov 29 17:53:59 user nova-compute[74613]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py", line 244, in inner
Nov 29 17:53:59 user nova-compute[74613]: ERROR oslo_messaging.rpc.server     return func(*args, **kwargs)
Nov 29 17:53:59 user nova-compute[74613]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 65, in wrapped
Nov 29 17:53:59 user nova-compute[74613]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Nov 29 17:53:59 user nova-compute[74613]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Nov 29 17:53:59 user nova-compute[74613]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Nov 29 17:53:59 user nova-compute[74613]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Nov 29 17:53:59 user nova-compute[74613]: ERROR oslo_messaging.rpc.server     raise self.value
Nov 29 17:53:59 user nova-compute[74613]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped
Nov 29 17:53:59 user nova-compute[74613]: ERROR oslo_messaging.rpc.server     return f(self, context, *args, **kw)
Nov 29 17:53:59 user nova-compute[74613]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 4505, in volume_snapshot_create
Nov 29 17:53:59 user nova-compute[74613]: ERROR oslo_messaging.rpc.server     self.driver.volume_snapshot_create(context, instance, volume_id,
Nov 29 17:53:59 user nova-compute[74613]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3597, in volume_snapshot_create
Nov 29 17:53:59 user nova-compute[74613]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Nov 29 17:53:59 user nova-compute[74613]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Nov 29 17:53:59 user nova-compute[74613]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Nov 29 17:53:59 user nova-compute[74613]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Nov 29 17:53:59 user nova-compute[74613]: ERROR oslo_messaging.rpc.server     raise self.value
Nov 29 17:53:59 user nova-compute[74613]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3594, in volume_snapshot_create
Nov 29 17:53:59 user nova-compute[74613]: ERROR oslo_messaging.rpc.server     self._volume_snapshot_create(context, instance, guest,
Nov 29 17:53:59 user nova-compute[74613]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3544, in _volume_snapshot_create
Nov 29 17:53:59 user nova-compute[74613]: ERROR oslo_messaging.rpc.server     guest.snapshot(snapshot, no_metadata=True, disk_only=True,
Nov 29 17:53:59 user nova-compute[74613]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/guest.py", line 569, in snapshot
Nov 29 17:53:59 user nova-compute[74613]: ERROR oslo_messaging.rpc.server     self._domain.snapshotCreateXML(device_xml, flags=flags)
Nov 29 17:53:59 user nova-compute[74613]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 193, in doit
Nov 29 17:53:59 user nova-compute[74613]: ERROR oslo_messaging.rpc.server     result = proxy_call(self._autowrap, f, *args, **kwargs)
Nov 29 17:53:59 user nova-compute[74613]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 151, in proxy_call
Nov 29 17:53:59 user nova-compute[74613]: ERROR oslo_messaging.rpc.server     rv = execute(f, *args, **kwargs)
Nov 29 17:53:59 user nova-compute[74613]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 132, in execute
Nov 29 17:53:59 user nova-compute[74613]: ERROR oslo_messaging.rpc.server     six.reraise(c, e, tb)
Nov 29 17:53:59 user nova-compute[74613]: ERROR oslo_messaging.rpc.server   File "/usr/lib/python3/dist-packages/six.py", line 719, in reraise
Nov 29 17:53:59 user nova-compute[74613]: ERROR oslo_messaging.rpc.server     raise value
Nov 29 17:53:59 user nova-compute[74613]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 86, in tworker
Nov 29 17:53:59 user nova-compute[74613]: ERROR oslo_messaging.rpc.server     rv = meth(*args, **kwargs)
Nov 29 17:53:59 user nova-compute[74613]: ERROR oslo_messaging.rpc.server   File "/usr/lib/python3/dist-packages/libvirt.py", line 3070, in snapshotCreateXML
Nov 29 17:53:59 user nova-compute[74613]: ERROR oslo_messaging.rpc.server     raise libvirtError('virDomainSnapshotCreateXML() failed')
Nov 29 17:53:59 user nova-compute[74613]: ERROR oslo_messaging.rpc.server libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Nov 29 17:53:59 user nova-compute[74613]: ERROR oslo_messaging.rpc.server 
Nov 29 17:54:00 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:54:00 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-0e68ea8c-7b90-4093-a721-ada659039a25 tempest-VolumesAssistedSnapshotsTest-194727756 tempest-VolumesAssistedSnapshotsTest-194727756-project-admin] Acquiring lock "d4ecef60-62f9-4969-b57f-3bb45a44cc9f" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 17:54:00 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-0e68ea8c-7b90-4093-a721-ada659039a25 tempest-VolumesAssistedSnapshotsTest-194727756 tempest-VolumesAssistedSnapshotsTest-194727756-project-admin] Lock "d4ecef60-62f9-4969-b57f-3bb45a44cc9f" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 17:54:00 user nova-compute[74613]: INFO nova.compute.manager [None req-0e68ea8c-7b90-4093-a721-ada659039a25 tempest-VolumesAssistedSnapshotsTest-194727756 tempest-VolumesAssistedSnapshotsTest-194727756-project-admin] [instance: d4ecef60-62f9-4969-b57f-3bb45a44cc9f] Detaching volume 17b27fab-6cdb-4820-be62-ffd44e8e2fb5
Nov 29 17:54:00 user nova-compute[74613]: INFO nova.virt.block_device [None req-0e68ea8c-7b90-4093-a721-ada659039a25 tempest-VolumesAssistedSnapshotsTest-194727756 tempest-VolumesAssistedSnapshotsTest-194727756-project-admin] [instance: d4ecef60-62f9-4969-b57f-3bb45a44cc9f] Attempting to driver detach volume 17b27fab-6cdb-4820-be62-ffd44e8e2fb5 from mountpoint /dev/vdb
Nov 29 17:54:00 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.base [None req-f4a95811-5656-40b2-994e-6d94df01e860 tempest-TaggedAttachmentsTest-1438740121 tempest-TaggedAttachmentsTest-1438740121-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.351s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 17:54:00 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-f4a95811-5656-40b2-994e-6d94df01e860 tempest-TaggedAttachmentsTest-1438740121 tempest-TaggedAttachmentsTest-1438740121-project-member] <== connect_volume: return (1353ms) {'type': 'block', 'scsi_wwn': '23161646637353934', 'path': '/dev/sdh'} {{(pid=74613) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 17:54:00 user nova-compute[74613]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f4a95811-5656-40b2-994e-6d94df01e860 tempest-TaggedAttachmentsTest-1438740121 tempest-TaggedAttachmentsTest-1438740121-project-member] [instance: 288b8261-8706-4696-879d-d4dd01ab553e] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23161646637353934', 'path': '/dev/sdh'} {{(pid=74613) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 29 17:54:00 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-0e68ea8c-7b90-4093-a721-ada659039a25 tempest-VolumesAssistedSnapshotsTest-194727756 tempest-VolumesAssistedSnapshotsTest-194727756-project-admin] Attempting to detach device vdb from instance d4ecef60-62f9-4969-b57f-3bb45a44cc9f from the persistent domain config. {{(pid=74613) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 29 17:54:00 user nova-compute[74613]: DEBUG nova.virt.libvirt.guest [None req-0e68ea8c-7b90-4093-a721-ada659039a25 tempest-VolumesAssistedSnapshotsTest-194727756 tempest-VolumesAssistedSnapshotsTest-194727756-project-admin] detach device xml: <disk type="block" device="disk">
Nov 29 17:54:00 user nova-compute[74613]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 17:54:00 user nova-compute[74613]:   <source dev="/dev/sdb"/>
Nov 29 17:54:00 user nova-compute[74613]:   <target dev="vdb" bus="virtio"/>
Nov 29 17:54:00 user nova-compute[74613]:   <serial>17b27fab-6cdb-4820-be62-ffd44e8e2fb5</serial>
Nov 29 17:54:00 user nova-compute[74613]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 29 17:54:00 user nova-compute[74613]: </disk>
Nov 29 17:54:00 user nova-compute[74613]:  {{(pid=74613) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 29 17:54:00 user nova-compute[74613]: DEBUG nova.objects.instance [None req-f4a95811-5656-40b2-994e-6d94df01e860 tempest-TaggedAttachmentsTest-1438740121 tempest-TaggedAttachmentsTest-1438740121-project-member] Lazy-loading 'flavor' on Instance uuid 288b8261-8706-4696-879d-d4dd01ab553e {{(pid=74613) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 17:54:00 user nova-compute[74613]: INFO nova.virt.libvirt.driver [None req-0e68ea8c-7b90-4093-a721-ada659039a25 tempest-VolumesAssistedSnapshotsTest-194727756 tempest-VolumesAssistedSnapshotsTest-194727756-project-admin] Successfully detached device vdb from instance d4ecef60-62f9-4969-b57f-3bb45a44cc9f from the persistent domain config.
Nov 29 17:54:00 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-0e68ea8c-7b90-4093-a721-ada659039a25 tempest-VolumesAssistedSnapshotsTest-194727756 tempest-VolumesAssistedSnapshotsTest-194727756-project-admin] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance d4ecef60-62f9-4969-b57f-3bb45a44cc9f from the live domain config. {{(pid=74613) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 29 17:54:00 user nova-compute[74613]: DEBUG nova.virt.libvirt.guest [None req-0e68ea8c-7b90-4093-a721-ada659039a25 tempest-VolumesAssistedSnapshotsTest-194727756 tempest-VolumesAssistedSnapshotsTest-194727756-project-admin] detach device xml: <disk type="block" device="disk">
Nov 29 17:54:00 user nova-compute[74613]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 17:54:00 user nova-compute[74613]:   <source dev="/dev/sdb"/>
Nov 29 17:54:00 user nova-compute[74613]:   <target dev="vdb" bus="virtio"/>
Nov 29 17:54:00 user nova-compute[74613]:   <serial>17b27fab-6cdb-4820-be62-ffd44e8e2fb5</serial>
Nov 29 17:54:00 user nova-compute[74613]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 29 17:54:00 user nova-compute[74613]: </disk>
Nov 29 17:54:00 user nova-compute[74613]:  {{(pid=74613) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 29 17:54:00 user nova-compute[74613]: DEBUG nova.virt.libvirt.guest [None req-f4a95811-5656-40b2-994e-6d94df01e860 tempest-TaggedAttachmentsTest-1438740121 tempest-TaggedAttachmentsTest-1438740121-project-member] attach device xml: <disk type="block" device="disk">
Nov 29 17:54:00 user nova-compute[74613]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 17:54:00 user nova-compute[74613]:   <source dev="/dev/sdh"/>
Nov 29 17:54:00 user nova-compute[74613]:   <target dev="vdb" bus="virtio"/>
Nov 29 17:54:00 user nova-compute[74613]:   <serial>b7efc2d5-5149-408b-980d-58492994fd4f</serial>
Nov 29 17:54:00 user nova-compute[74613]: </disk>
Nov 29 17:54:00 user nova-compute[74613]:  {{(pid=74613) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 29 17:54:00 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-f4a95811-5656-40b2-994e-6d94df01e860 tempest-TaggedAttachmentsTest-1438740121 tempest-TaggedAttachmentsTest-1438740121-project-member] No BDM found with device name vda, not building metadata. {{(pid=74613) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 17:54:00 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-f4a95811-5656-40b2-994e-6d94df01e860 tempest-TaggedAttachmentsTest-1438740121 tempest-TaggedAttachmentsTest-1438740121-project-member] No BDM found with device name hda, not building metadata. {{(pid=74613) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 17:54:00 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-f4a95811-5656-40b2-994e-6d94df01e860 tempest-TaggedAttachmentsTest-1438740121 tempest-TaggedAttachmentsTest-1438740121-project-member] No VIF found with MAC fa:16:3e:14:7b:54, not building metadata {{(pid=74613) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 29 17:54:00 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-f4a95811-5656-40b2-994e-6d94df01e860 tempest-TaggedAttachmentsTest-1438740121 tempest-TaggedAttachmentsTest-1438740121-project-member] Lock "288b8261-8706-4696-879d-d4dd01ab553e" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 10.448s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 17:54:01 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-0e68ea8c-7b90-4093-a721-ada659039a25 tempest-VolumesAssistedSnapshotsTest-194727756 tempest-VolumesAssistedSnapshotsTest-194727756-project-admin] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance d4ecef60-62f9-4969-b57f-3bb45a44cc9f {{(pid=74613) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 29 17:54:01 user nova-compute[74613]: DEBUG nova.compute.manager [None req-5489860b-08ae-4311-8a2b-dd8f35fab03e tempest-TestVolumeSwap-1038735411 tempest-TestVolumeSwap-1038735411-project-admin] [instance: 0008521b-5a63-4ff6-8390-d343956900ed] swap_volume: Calling driver volume swap with connection infos: new: {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:49f19a7e-3b8b-44b4-b289-808ee2a18b91', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'EhqaYVOC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '0008521b-5a63-4ff6-8390-d343956900ed', 'attached_at': '', 'detached_at': '', 'volume_id': '49f19a7e-3b8b-44b4-b289-808ee2a18b91', 'serial': '49f19a7e-3b8b-44b4-b289-808ee2a18b91'}; old: {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:a6b34bdb-5c08-4f7c-b3f5-6b68413947a8', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'SAqnwafp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdg'}, 'status': 'reserved', 'instance': '0008521b-5a63-4ff6-8390-d343956900ed', 'attached_at': '', 'detached_at': '', 'volume_id': 'a6b34bdb-5c08-4f7c-b3f5-6b68413947a8', 'serial'} {{(pid=74613) _swap_volume /opt/stack/nova/nova/compute/manager.py:7782}}
Nov 29 17:54:01 user nova-compute[74613]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5489860b-08ae-4311-8a2b-dd8f35fab03e tempest-TestVolumeSwap-1038735411 tempest-TestVolumeSwap-1038735411-project-admin] [instance: 0008521b-5a63-4ff6-8390-d343956900ed] Calling os-brick to attach iSCSI Volume {{(pid=74613) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 29 17:54:01 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-5489860b-08ae-4311-8a2b-dd8f35fab03e tempest-TestVolumeSwap-1038735411 tempest-TestVolumeSwap-1038735411-project-admin] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff828156890>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:49f19a7e-3b8b-44b4-b289-808ee2a18b91', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'EhqaYVOC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74613) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 17:54:01 user nova-compute[74613]: WARNING os_brick.initiator.connectors.base [None req-5489860b-08ae-4311-8a2b-dd8f35fab03e tempest-TestVolumeSwap-1038735411 tempest-TestVolumeSwap-1038735411-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 17:54:01 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.base [None req-5489860b-08ae-4311-8a2b-dd8f35fab03e tempest-TestVolumeSwap-1038735411 tempest-TestVolumeSwap-1038735411-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 17:54:01 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.base [None req-5489860b-08ae-4311-8a2b-dd8f35fab03e tempest-TestVolumeSwap-1038735411 tempest-TestVolumeSwap-1038735411-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 17:54:01 user nova-compute[74613]: WARNING os_brick.initiator.connectors.base [None req-5489860b-08ae-4311-8a2b-dd8f35fab03e tempest-TestVolumeSwap-1038735411 tempest-TestVolumeSwap-1038735411-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 17:54:01 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.base [None req-5489860b-08ae-4311-8a2b-dd8f35fab03e tempest-TestVolumeSwap-1038735411 tempest-TestVolumeSwap-1038735411-project-admin] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:49f19a7e-3b8b-44b4-b289-808ee2a18b91" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 17:54:01 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.base [None req-5489860b-08ae-4311-8a2b-dd8f35fab03e tempest-TestVolumeSwap-1038735411 tempest-TestVolumeSwap-1038735411-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:49f19a7e-3b8b-44b4-b289-808ee2a18b91" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 17:54:01 user nova-compute[74613]: INFO os_brick.initiator.connectors.iscsi [None req-5489860b-08ae-4311-8a2b-dd8f35fab03e tempest-TestVolumeSwap-1038735411 tempest-TestVolumeSwap-1038735411-project-admin] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 29 17:54:01 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:49f19a7e-3b8b-44b4-b289-808ee2a18b91 -p 172.16.0.220:3260 {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 17:54:01 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:49f19a7e-3b8b-44b4-b289-808ee2a18b91 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 17:54:01 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e24e772-87a8-486e-85ab-8c99432fe53a]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 17:54:01 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-5489860b-08ae-4311-8a2b-dd8f35fab03e tempest-TestVolumeSwap-1038735411 tempest-TestVolumeSwap-1038735411-project-admin] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 29 17:54:01 user nova-compute[74613]:  {{(pid=74613) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 17:54:01 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:49f19a7e-3b8b-44b4-b289-808ee2a18b91 -p 172.16.0.220:3260 --interface default --op new {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 17:54:01 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:49f19a7e-3b8b-44b4-b289-808ee2a18b91 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.017s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 17:54:01 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1987701-5680-40ee-94fe-7d6a970b1986]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:49f19a7e-3b8b-44b4-b289-808ee2a18b91] added\n', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 17:54:01 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-5489860b-08ae-4311-8a2b-dd8f35fab03e tempest-TestVolumeSwap-1038735411 tempest-TestVolumeSwap-1038735411-project-admin] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:49f19a7e-3b8b-44b4-b289-808ee2a18b91] added
Nov 29 17:54:01 user nova-compute[74613]:  stderr= {{(pid=74613) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 17:54:01 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:49f19a7e-3b8b-44b4-b289-808ee2a18b91 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 17:54:01 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:49f19a7e-3b8b-44b4-b289-808ee2a18b91 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 17:54:01 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[82d0d65b-dcf8-4e7a-b77a-762e83550bc2]: (4, ('', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 17:54:01 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-5489860b-08ae-4311-8a2b-dd8f35fab03e tempest-TestVolumeSwap-1038735411 tempest-TestVolumeSwap-1038735411-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74613) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 17:54:01 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:49f19a7e-3b8b-44b4-b289-808ee2a18b91 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 17:54:01 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:49f19a7e-3b8b-44b4-b289-808ee2a18b91 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 17:54:01 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea46b66c-ee86-41bc-b0fd-a03e6cfa2ffc]: (4, ('', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 17:54:01 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-5489860b-08ae-4311-8a2b-dd8f35fab03e tempest-TestVolumeSwap-1038735411 tempest-TestVolumeSwap-1038735411-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74613) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 17:54:01 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:49f19a7e-3b8b-44b4-b289-808ee2a18b91 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v EhqaYVOC {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 17:54:01 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:49f19a7e-3b8b-44b4-b289-808ee2a18b91 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v EhqaYVOC" returned: 0 in 0.017s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 17:54:01 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e46f51a-f232-461d-8ca5-3a935e20f3ae]: (4, ('', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 17:54:01 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-5489860b-08ae-4311-8a2b-dd8f35fab03e tempest-TestVolumeSwap-1038735411 tempest-TestVolumeSwap-1038735411-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'EhqaYVOC'): stdout= stderr= {{(pid=74613) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 17:54:01 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:49f19a7e-3b8b-44b4-b289-808ee2a18b91 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 17:54:01 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:49f19a7e-3b8b-44b4-b289-808ee2a18b91 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 17:54:01 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[7147befb-ee68-4943-954b-c9b9e36eee6b]: (4, ('', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 17:54:01 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-5489860b-08ae-4311-8a2b-dd8f35fab03e tempest-TestVolumeSwap-1038735411 tempest-TestVolumeSwap-1038735411-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74613) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 17:54:01 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 17:54:01 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 17:54:01 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[32f516e8-4f8f-45bb-ace7-55a56235c3a6]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7efc2d5-5149-408b-980d-58492994fd4f (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:24920064-fc81-4408-97d1-d8eff97a7554 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8230f3a2-63d8-46cb-8ec7-ceb89fb04e53 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d1f798a1-4f7b-4b9a-8180-fa8f4eb89bf0 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:850c1226-267c-42c0-945f-bfc219c8e88b (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a6b34bdb-5c08-4f7c-b3f5-6b68413947a8 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:17b27fab-6cdb-4820-be62-ffd44e8e2fb5 (non-flash)\n', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 17:54:01 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-5489860b-08ae-4311-8a2b-dd8f35fab03e tempest-TestVolumeSwap-1038735411 tempest-TestVolumeSwap-1038735411-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7efc2d5-5149-408b-980d-58492994fd4f (non-flash)
Nov 29 17:54:01 user nova-compute[74613]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:24920064-fc81-4408-97d1-d8eff97a7554 (non-flash)
Nov 29 17:54:01 user nova-compute[74613]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8230f3a2-63d8-46cb-8ec7-ceb89fb04e53 (non-flash)
Nov 29 17:54:01 user nova-compute[74613]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d1f798a1-4f7b-4b9a-8180-fa8f4eb89bf0 (non-flash)
Nov 29 17:54:01 user nova-compute[74613]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:850c1226-267c-42c0-945f-bfc219c8e88b (non-flash)
Nov 29 17:54:01 user nova-compute[74613]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a6b34bdb-5c08-4f7c-b3f5-6b68413947a8 (non-flash)
Nov 29 17:54:01 user nova-compute[74613]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:17b27fab-6cdb-4820-be62-ffd44e8e2fb5 (non-flash)
Nov 29 17:54:01 user nova-compute[74613]:  stderr= {{(pid=74613) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 17:54:01 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-5489860b-08ae-4311-8a2b-dd8f35fab03e tempest-TestVolumeSwap-1038735411 tempest-TestVolumeSwap-1038735411-project-admin] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7efc2d5-5149-408b-980d-58492994fd4f (non-flash)
Nov 29 17:54:01 user nova-compute[74613]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:24920064-fc81-4408-97d1-d8eff97a7554 (non-flash)
Nov 29 17:54:01 user nova-compute[74613]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8230f3a2-63d8-46cb-8ec7-ceb89fb04e53 (non-flash)
Nov 29 17:54:01 user nova-compute[74613]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d1f798a1-4f7b-4b9a-8180-fa8f4eb89bf0 (non-flash)
Nov 29 17:54:01 user nova-compute[74613]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:850c1226-267c-42c0-945f-bfc219c8e88b (non-flash)
Nov 29 17:54:01 user nova-compute[74613]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a6b34bdb-5c08-4f7c-b3f5-6b68413947a8 (non-flash)
Nov 29 17:54:01 user nova-compute[74613]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:17b27fab-6cdb-4820-be62-ffd44e8e2fb5 (non-flash)
Nov 29 17:54:01 user nova-compute[74613]:  stderr= {{(pid=74613) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 17:54:01 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:49f19a7e-3b8b-44b4-b289-808ee2a18b91 -p 172.16.0.220:3260 --login {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 17:54:01 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:49f19a7e-3b8b-44b4-b289-808ee2a18b91 -p 172.16.0.220:3260 --login" returned: 0 in 0.081s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 17:54:01 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[eba10d0e-dd53-40db-ad6c-6e9365958c0f]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:49f19a7e-3b8b-44b4-b289-808ee2a18b91, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:49f19a7e-3b8b-44b4-b289-808ee2a18b91, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 17:54:01 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-5489860b-08ae-4311-8a2b-dd8f35fab03e tempest-TestVolumeSwap-1038735411 tempest-TestVolumeSwap-1038735411-project-admin] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:49f19a7e-3b8b-44b4-b289-808ee2a18b91, portal: 172.16.0.220,3260]
Nov 29 17:54:01 user nova-compute[74613]: Login to [iface: default, target: iqn.2010-10.org.openstack:49f19a7e-3b8b-44b4-b289-808ee2a18b91, portal: 172.16.0.220,3260] successful.
Nov 29 17:54:01 user nova-compute[74613]:  stderr= {{(pid=74613) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 17:54:01 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:49f19a7e-3b8b-44b4-b289-808ee2a18b91 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 17:54:01 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:49f19a7e-3b8b-44b4-b289-808ee2a18b91 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 17:54:01 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[c30a1123-b244-45cd-a42c-445907c1bc95]: (4, ('', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 17:54:01 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-5489860b-08ae-4311-8a2b-dd8f35fab03e tempest-TestVolumeSwap-1038735411 tempest-TestVolumeSwap-1038735411-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74613) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 17:54:01 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 17:54:01 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 17:54:01 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[307764e9-3bab-4b65-9e85-5956b1c68a89]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7efc2d5-5149-408b-980d-58492994fd4f (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49f19a7e-3b8b-44b4-b289-808ee2a18b91 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:24920064-fc81-4408-97d1-d8eff97a7554 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8230f3a2-63d8-46cb-8ec7-ceb89fb04e53 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d1f798a1-4f7b-4b9a-8180-fa8f4eb89bf0 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:850c1226-267c-42c0-945f-bfc219c8e88b (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a6b34bdb-5c08-4f7c-b3f5-6b68413947a8 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:17b27fab-6cdb-4820-be62-ffd44e8e2fb5 (non-flash)\n', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 17:54:01 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-5489860b-08ae-4311-8a2b-dd8f35fab03e tempest-TestVolumeSwap-1038735411 tempest-TestVolumeSwap-1038735411-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7efc2d5-5149-408b-980d-58492994fd4f (non-flash)
Nov 29 17:54:01 user nova-compute[74613]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49f19a7e-3b8b-44b4-b289-808ee2a18b91 (non-flash)
Nov 29 17:54:01 user nova-compute[74613]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:24920064-fc81-4408-97d1-d8eff97a7554 (non-flash)
Nov 29 17:54:01 user nova-compute[74613]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8230f3a2-63d8-46cb-8ec7-ceb89fb04e53 (non-flash)
Nov 29 17:54:01 user nova-compute[74613]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d1f798a1-4f7b-4b9a-8180-fa8f4eb89bf0 (non-flash)
Nov 29 17:54:01 user nova-compute[74613]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:850c1226-267c-42c0-945f-bfc219c8e88b (non-flash)
Nov 29 17:54:01 user nova-compute[74613]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a6b34bdb-5c08-4f7c-b3f5-6b68413947a8 (non-flash)
Nov 29 17:54:01 user nova-compute[74613]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:17b27fab-6cdb-4820-be62-ffd44e8e2fb5 (non-flash)
Nov 29 17:54:01 user nova-compute[74613]:  stderr= {{(pid=74613) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 17:54:01 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-5489860b-08ae-4311-8a2b-dd8f35fab03e tempest-TestVolumeSwap-1038735411 tempest-TestVolumeSwap-1038735411-project-admin] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7efc2d5-5149-408b-980d-58492994fd4f (non-flash)
Nov 29 17:54:01 user nova-compute[74613]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49f19a7e-3b8b-44b4-b289-808ee2a18b91 (non-flash)
Nov 29 17:54:01 user nova-compute[74613]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:24920064-fc81-4408-97d1-d8eff97a7554 (non-flash)
Nov 29 17:54:01 user nova-compute[74613]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8230f3a2-63d8-46cb-8ec7-ceb89fb04e53 (non-flash)
Nov 29 17:54:01 user nova-compute[74613]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d1f798a1-4f7b-4b9a-8180-fa8f4eb89bf0 (non-flash)
Nov 29 17:54:01 user nova-compute[74613]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:850c1226-267c-42c0-945f-bfc219c8e88b (non-flash)
Nov 29 17:54:01 user nova-compute[74613]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a6b34bdb-5c08-4f7c-b3f5-6b68413947a8 (non-flash)
Nov 29 17:54:01 user nova-compute[74613]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:17b27fab-6cdb-4820-be62-ffd44e8e2fb5 (non-flash)
Nov 29 17:54:01 user nova-compute[74613]:  stderr= {{(pid=74613) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 17:54:01 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.base [None req-5489860b-08ae-4311-8a2b-dd8f35fab03e tempest-TestVolumeSwap-1038735411 tempest-TestVolumeSwap-1038735411-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:49f19a7e-3b8b-44b4-b289-808ee2a18b91" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.292s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 17:54:01 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-5489860b-08ae-4311-8a2b-dd8f35fab03e tempest-TestVolumeSwap-1038735411 tempest-TestVolumeSwap-1038735411-project-admin] Connected to 172.16.0.220:3260 {{(pid=74613) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 29 17:54:01 user nova-compute[74613]: DEBUG os_brick.initiator.linuxscsi [None req-5489860b-08ae-4311-8a2b-dd8f35fab03e tempest-TestVolumeSwap-1038735411 tempest-TestVolumeSwap-1038735411-project-admin] HCTL ('40', '-', '-', 0) found on session 11 with lun 0 {{(pid=74613) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 29 17:54:01 user nova-compute[74613]: DEBUG os_brick.initiator.linuxscsi [None req-5489860b-08ae-4311-8a2b-dd8f35fab03e tempest-TestVolumeSwap-1038735411 tempest-TestVolumeSwap-1038735411-project-admin] Scanning host 40 c: -, t: -, l: 0) {{(pid=74613) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 29 17:54:01 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host40/scan {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 17:54:01 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host40/scan" returned: 0 in 0.019s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 17:54:01 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[6786409c-a8c7-441b-9857-415b0aba57ea]: (4, ('- - 0', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 17:54:01 user nova-compute[74613]: DEBUG os_brick.initiator.linuxscsi [None req-5489860b-08ae-4311-8a2b-dd8f35fab03e tempest-TestVolumeSwap-1038735411 tempest-TestVolumeSwap-1038735411-project-admin] Searching for a device in session 11 and hctl ['40', '*', '*', 0] yield: sdi {{(pid=74613) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 29 17:54:01 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-5489860b-08ae-4311-8a2b-dd8f35fab03e tempest-TestVolumeSwap-1038735411 tempest-TestVolumeSwap-1038735411-project-admin] Connected to sdi using {'target_iqn': 'iqn.2010-10.org.openstack:49f19a7e-3b8b-44b4-b289-808ee2a18b91', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'EhqaYVOC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74613) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 29 17:54:02 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-8346025d-1b9d-4c86-b9e8-a65bda22b984 tempest-TaggedAttachmentsTest-1438740121 tempest-TaggedAttachmentsTest-1438740121-project-member] Acquiring lock "288b8261-8706-4696-879d-d4dd01ab553e" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 17:54:02 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-8346025d-1b9d-4c86-b9e8-a65bda22b984 tempest-TaggedAttachmentsTest-1438740121 tempest-TaggedAttachmentsTest-1438740121-project-member] Lock "288b8261-8706-4696-879d-d4dd01ab553e" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 17:54:02 user nova-compute[74613]: INFO nova.compute.manager [None req-8346025d-1b9d-4c86-b9e8-a65bda22b984 tempest-TaggedAttachmentsTest-1438740121 tempest-TaggedAttachmentsTest-1438740121-project-member] [instance: 288b8261-8706-4696-879d-d4dd01ab553e] Detaching volume b7efc2d5-5149-408b-980d-58492994fd4f
Nov 29 17:54:02 user nova-compute[74613]: INFO nova.virt.block_device [None req-8346025d-1b9d-4c86-b9e8-a65bda22b984 tempest-TaggedAttachmentsTest-1438740121 tempest-TaggedAttachmentsTest-1438740121-project-member] [instance: 288b8261-8706-4696-879d-d4dd01ab553e] Attempting to driver detach volume b7efc2d5-5149-408b-980d-58492994fd4f from mountpoint /dev/vdb
Nov 29 17:54:02 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-8346025d-1b9d-4c86-b9e8-a65bda22b984 tempest-TaggedAttachmentsTest-1438740121 tempest-TaggedAttachmentsTest-1438740121-project-member] Attempting to detach device vdb from instance 288b8261-8706-4696-879d-d4dd01ab553e from the persistent domain config. {{(pid=74613) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 29 17:54:02 user nova-compute[74613]: DEBUG nova.virt.libvirt.guest [None req-8346025d-1b9d-4c86-b9e8-a65bda22b984 tempest-TaggedAttachmentsTest-1438740121 tempest-TaggedAttachmentsTest-1438740121-project-member] detach device xml: <disk type="block" device="disk">
Nov 29 17:54:02 user nova-compute[74613]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 17:54:02 user nova-compute[74613]:   <source dev="/dev/sdh"/>
Nov 29 17:54:02 user nova-compute[74613]:   <target dev="vdb" bus="virtio"/>
Nov 29 17:54:02 user nova-compute[74613]:   <serial>b7efc2d5-5149-408b-980d-58492994fd4f</serial>
Nov 29 17:54:02 user nova-compute[74613]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Nov 29 17:54:02 user nova-compute[74613]: </disk>
Nov 29 17:54:02 user nova-compute[74613]:  {{(pid=74613) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 29 17:54:02 user nova-compute[74613]: INFO nova.virt.libvirt.driver [None req-8346025d-1b9d-4c86-b9e8-a65bda22b984 tempest-TaggedAttachmentsTest-1438740121 tempest-TaggedAttachmentsTest-1438740121-project-member] Successfully detached device vdb from instance 288b8261-8706-4696-879d-d4dd01ab553e from the persistent domain config.
Nov 29 17:54:02 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-8346025d-1b9d-4c86-b9e8-a65bda22b984 tempest-TaggedAttachmentsTest-1438740121 tempest-TaggedAttachmentsTest-1438740121-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 288b8261-8706-4696-879d-d4dd01ab553e from the live domain config. {{(pid=74613) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 29 17:54:02 user nova-compute[74613]: DEBUG nova.virt.libvirt.guest [None req-8346025d-1b9d-4c86-b9e8-a65bda22b984 tempest-TaggedAttachmentsTest-1438740121 tempest-TaggedAttachmentsTest-1438740121-project-member] detach device xml: <disk type="block" device="disk">
Nov 29 17:54:02 user nova-compute[74613]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 17:54:02 user nova-compute[74613]:   <source dev="/dev/sdh"/>
Nov 29 17:54:02 user nova-compute[74613]:   <target dev="vdb" bus="virtio"/>
Nov 29 17:54:02 user nova-compute[74613]:   <serial>b7efc2d5-5149-408b-980d-58492994fd4f</serial>
Nov 29 17:54:02 user nova-compute[74613]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Nov 29 17:54:02 user nova-compute[74613]: </disk>
Nov 29 17:54:02 user nova-compute[74613]:  {{(pid=74613) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 29 17:54:02 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.base [None req-5489860b-08ae-4311-8a2b-dd8f35fab03e tempest-TestVolumeSwap-1038735411 tempest-TestVolumeSwap-1038735411-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.329s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 17:54:02 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-5489860b-08ae-4311-8a2b-dd8f35fab03e tempest-TestVolumeSwap-1038735411 tempest-TestVolumeSwap-1038735411-project-admin] <== connect_volume: return (1329ms) {'type': 'block', 'scsi_wwn': '23237613932366331', 'path': '/dev/sdi'} {{(pid=74613) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 17:54:02 user nova-compute[74613]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5489860b-08ae-4311-8a2b-dd8f35fab03e tempest-TestVolumeSwap-1038735411 tempest-TestVolumeSwap-1038735411-project-admin] [instance: 0008521b-5a63-4ff6-8390-d343956900ed] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23237613932366331', 'path': '/dev/sdi'} {{(pid=74613) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 29 17:54:02 user nova-compute[74613]: DEBUG nova.objects.instance [None req-5489860b-08ae-4311-8a2b-dd8f35fab03e tempest-TestVolumeSwap-1038735411 tempest-TestVolumeSwap-1038735411-project-admin] Lazy-loading 'flavor' on Instance uuid 0008521b-5a63-4ff6-8390-d343956900ed {{(pid=74613) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 17:54:03 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-8346025d-1b9d-4c86-b9e8-a65bda22b984 tempest-TaggedAttachmentsTest-1438740121 tempest-TaggedAttachmentsTest-1438740121-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 288b8261-8706-4696-879d-d4dd01ab553e {{(pid=74613) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 29 17:54:03 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:54:03 user nova-compute[74613]: DEBUG nova.virt.libvirt.guest [None req-5489860b-08ae-4311-8a2b-dd8f35fab03e tempest-TestVolumeSwap-1038735411 tempest-TestVolumeSwap-1038735411-project-admin] COPY block job progress, current cursor: 0 final cursor: 1073741824 {{(pid=74613) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 29 17:54:03 user nova-compute[74613]: WARNING nova.virt.libvirt.driver [None req-1028ee96-453b-4d25-ae2d-35538e927ff3 tempest-AttachSCSIVolumeTestJSON-1343397388 tempest-AttachSCSIVolumeTestJSON-1343397388-project-member] Waiting for libvirt event about the detach of device sdc with device alias scsi0-0-0-2 from instance 01c65b16-5dbe-4ad5-a72e-9500a4fa59cf is timed out.
Nov 29 17:54:03 user nova-compute[74613]: INFO nova.virt.libvirt.driver [None req-1028ee96-453b-4d25-ae2d-35538e927ff3 tempest-AttachSCSIVolumeTestJSON-1343397388 tempest-AttachSCSIVolumeTestJSON-1343397388-project-member] Successfully detached device sdc from instance 01c65b16-5dbe-4ad5-a72e-9500a4fa59cf from the live domain config.
Nov 29 17:54:03 user nova-compute[74613]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1028ee96-453b-4d25-ae2d-35538e927ff3 tempest-AttachSCSIVolumeTestJSON-1343397388 tempest-AttachSCSIVolumeTestJSON-1343397388-project-member] [instance: 01c65b16-5dbe-4ad5-a72e-9500a4fa59cf] calling os-brick to detach iSCSI Volume {{(pid=74613) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 29 17:54:03 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-1028ee96-453b-4d25-ae2d-35538e927ff3 tempest-AttachSCSIVolumeTestJSON-1343397388 tempest-AttachSCSIVolumeTestJSON-1343397388-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff828156890>, {'target_iqn': 'iqn.2010-10.org.openstack:850c1226-267c-42c0-945f-bfc219c8e88b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PQHdgFeo', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, None), 'kwargs': False}}" {{(pid=74613) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 17:54:03 user nova-compute[74613]: WARNING os_brick.initiator.connectors.base [None req-1028ee96-453b-4d25-ae2d-35538e927ff3 tempest-AttachSCSIVolumeTestJSON-1343397388 tempest-AttachSCSIVolumeTestJSON-1343397388-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 17:54:03 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.base [None req-1028ee96-453b-4d25-ae2d-35538e927ff3 tempest-AttachSCSIVolumeTestJSON-1343397388 tempest-AttachSCSIVolumeTestJSON-1343397388-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 17:54:03 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.base [None req-1028ee96-453b-4d25-ae2d-35538e927ff3 tempest-AttachSCSIVolumeTestJSON-1343397388 tempest-AttachSCSIVolumeTestJSON-1343397388-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 17:54:03 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 17:54:03 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 17:54:03 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad0432db-a765-43f9-b003-2d921f515179]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:24920064-fc81-4408-97d1-d8eff97a7554\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b7efc2d5-5149-408b-980d-58492994fd4f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:17b27fab-6cdb-4820-be62-ffd44e8e2fb5\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:850c1226-267c-42c0-945f-bfc219c8e88b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:8230f3a2-63d8-46cb-8ec7-ceb89fb04e53\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:49f19a7e-3b8b-44b4-b289-808ee2a18b91\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a6b34bdb-5c08-4f7c-b3f5-6b68413947a8\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d1f798a1-4f7b-4b9a-8180-fa8f4eb89bf0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 17:54:03 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-1028ee96-453b-4d25-ae2d-35538e927ff3 tempest-AttachSCSIVolumeTestJSON-1343397388 tempest-AttachSCSIVolumeTestJSON-1343397388-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 29 17:54:03 user nova-compute[74613]: No targets found.
Nov 29 17:54:03 user nova-compute[74613]: iSNS:
Nov 29 17:54:03 user nova-compute[74613]: No targets found.
Nov 29 17:54:03 user nova-compute[74613]: STATIC:
Nov 29 17:54:03 user nova-compute[74613]: Target: iqn.2010-10.org.openstack:24920064-fc81-4408-97d1-d8eff97a7554
Nov 29 17:54:03 user nova-compute[74613]:         Portal: 172.16.0.220:3260,-1
Nov 29 17:54:03 user nova-compute[74613]:                 Iface Name: default
Nov 29 17:54:03 user nova-compute[74613]: Target: iqn.2010-10.org.openstack:b7efc2d5-5149-408b-980d-58492994fd4f
Nov 29 17:54:03 user nova-compute[74613]:         Portal: 172.16.0.220:3260,-1
Nov 29 17:54:03 user nova-compute[74613]:                 Iface Name: default
Nov 29 17:54:03 user nova-compute[74613]: Target: iqn.2010-10.org.openstack:17b27fab-6cdb-4820-be62-ffd44e8e2fb5
Nov 29 17:54:03 user nova-compute[74613]:         Portal: 172.16.0.220:3260,-1
Nov 29 17:54:03 user nova-compute[74613]:                 Iface Name: default
Nov 29 17:54:03 user nova-compute[74613]: Target: iqn.2010-10.org.openstack:850c1226-267c-42c0-945f-bfc219c8e88b
Nov 29 17:54:03 user nova-compute[74613]:         Portal: 172.16.0.220:3260,-1
Nov 29 17:54:03 user nova-compute[74613]:                 Iface Name: default
Nov 29 17:54:03 user nova-compute[74613]: Target: iqn.2010-10.org.openstack:8230f3a2-63d8-46cb-8ec7-ceb89fb04e53
Nov 29 17:54:03 user nova-compute[74613]:         Portal: 172.16.0.220:3260,-1
Nov 29 17:54:03 user nova-compute[74613]:                 Iface Name: default
Nov 29 17:54:03 user nova-compute[74613]: Target: iqn.2010-10.org.openstack:49f19a7e-3b8b-44b4-b289-808ee2a18b91
Nov 29 17:54:03 user nova-compute[74613]:         Portal: 172.16.0.220:3260,-1
Nov 29 17:54:03 user nova-compute[74613]:                 Iface Name: default
Nov 29 17:54:03 user nova-compute[74613]: Target: iqn.2010-10.org.openstack:a6b34bdb-5c08-4f7c-b3f5-6b68413947a8
Nov 29 17:54:03 user nova-compute[74613]:         Portal: 172.16.0.220:3260,-1
Nov 29 17:54:03 user nova-compute[74613]:                 Iface Name: default
Nov 29 17:54:03 user nova-compute[74613]: Target: iqn.2010-10.org.openstack:d1f798a1-4f7b-4b9a-8180-fa8f4eb89bf0
Nov 29 17:54:03 user nova-compute[74613]:         Portal: 172.16.0.220:3260,-1
Nov 29 17:54:03 user nova-compute[74613]:                 Iface Name: default
Nov 29 17:54:03 user nova-compute[74613]: FIRMWARE:
Nov 29 17:54:03 user nova-compute[74613]: No targets found.
Nov 29 17:54:03 user nova-compute[74613]:  stderr= {{(pid=74613) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 17:54:03 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-1028ee96-453b-4d25-ae2d-35538e927ff3 tempest-AttachSCSIVolumeTestJSON-1343397388 tempest-AttachSCSIVolumeTestJSON-1343397388-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 29 17:54:03 user nova-compute[74613]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 29 17:54:03 user nova-compute[74613]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74613) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 29 17:54:03 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-1028ee96-453b-4d25-ae2d-35538e927ff3 tempest-AttachSCSIVolumeTestJSON-1343397388 tempest-AttachSCSIVolumeTestJSON-1343397388-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:850c1226-267c-42c0-945f-bfc219c8e88b', 0)] {{(pid=74613) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 29 17:54:03 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 17:54:03 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 17:54:03 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[bee2c27e-3164-4611-aeaa-1e0e351f9f9c]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:17b27fab-6cdb-4820-be62-ffd44e8e2fb5\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:24920064-fc81-4408-97d1-d8eff97a7554\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:49f19a7e-3b8b-44b4-b289-808ee2a18b91\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8230f3a2-63d8-46cb-8ec7-ceb89fb04e53\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:850c1226-267c-42c0-945f-bfc219c8e88b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a6b34bdb-5c08-4f7c-b3f5-6b68413947a8\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b7efc2d5-5149-408b-980d-58492994fd4f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d1f798a1-4f7b-4b9a-8180-fa8f4eb89bf0\n', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 17:54:03 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 17:54:03 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.036s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 17:54:03 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[637323b0-8752-4d4a-bf43-6f1e0df00f4e]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7efc2d5-5149-408b-980d-58492994fd4f (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49f19a7e-3b8b-44b4-b289-808ee2a18b91 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:24920064-fc81-4408-97d1-d8eff97a7554 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8230f3a2-63d8-46cb-8ec7-ceb89fb04e53 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d1f798a1-4f7b-4b9a-8180-fa8f4eb89bf0 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:850c1226-267c-42c0-945f-bfc219c8e88b (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a6b34bdb-5c08-4f7c-b3f5-6b68413947a8 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:17b27fab-6cdb-4820-be62-ffd44e8e2fb5 (non-flash)\n', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 17:54:03 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-1028ee96-453b-4d25-ae2d-35538e927ff3 tempest-AttachSCSIVolumeTestJSON-1343397388 tempest-AttachSCSIVolumeTestJSON-1343397388-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7efc2d5-5149-408b-980d-58492994fd4f (non-flash)
Nov 29 17:54:03 user nova-compute[74613]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49f19a7e-3b8b-44b4-b289-808ee2a18b91 (non-flash)
Nov 29 17:54:03 user nova-compute[74613]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:24920064-fc81-4408-97d1-d8eff97a7554 (non-flash)
Nov 29 17:54:03 user nova-compute[74613]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8230f3a2-63d8-46cb-8ec7-ceb89fb04e53 (non-flash)
Nov 29 17:54:03 user nova-compute[74613]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d1f798a1-4f7b-4b9a-8180-fa8f4eb89bf0 (non-flash)
Nov 29 17:54:03 user nova-compute[74613]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:850c1226-267c-42c0-945f-bfc219c8e88b (non-flash)
Nov 29 17:54:03 user nova-compute[74613]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a6b34bdb-5c08-4f7c-b3f5-6b68413947a8 (non-flash)
Nov 29 17:54:03 user nova-compute[74613]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:17b27fab-6cdb-4820-be62-ffd44e8e2fb5 (non-flash)
Nov 29 17:54:03 user nova-compute[74613]:  stderr= {{(pid=74613) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 17:54:03 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-1028ee96-453b-4d25-ae2d-35538e927ff3 tempest-AttachSCSIVolumeTestJSON-1343397388 tempest-AttachSCSIVolumeTestJSON-1343397388-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7efc2d5-5149-408b-980d-58492994fd4f (non-flash)
Nov 29 17:54:03 user nova-compute[74613]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49f19a7e-3b8b-44b4-b289-808ee2a18b91 (non-flash)
Nov 29 17:54:03 user nova-compute[74613]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:24920064-fc81-4408-97d1-d8eff97a7554 (non-flash)
Nov 29 17:54:03 user nova-compute[74613]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8230f3a2-63d8-46cb-8ec7-ceb89fb04e53 (non-flash)
Nov 29 17:54:03 user nova-compute[74613]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d1f798a1-4f7b-4b9a-8180-fa8f4eb89bf0 (non-flash)
Nov 29 17:54:03 user nova-compute[74613]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:850c1226-267c-42c0-945f-bfc219c8e88b (non-flash)
Nov 29 17:54:03 user nova-compute[74613]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a6b34bdb-5c08-4f7c-b3f5-6b68413947a8 (non-flash)
Nov 29 17:54:03 user nova-compute[74613]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:17b27fab-6cdb-4820-be62-ffd44e8e2fb5 (non-flash)
Nov 29 17:54:03 user nova-compute[74613]:  stderr= {{(pid=74613) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 17:54:03 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-1028ee96-453b-4d25-ae2d-35538e927ff3 tempest-AttachSCSIVolumeTestJSON-1343397388 tempest-AttachSCSIVolumeTestJSON-1343397388-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7ff818776320>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:850c1226-267c-42c0-945f-bfc219c8e88b'): ({'sdf'}, set())}) {{(pid=74613) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 29 17:54:03 user nova-compute[74613]: DEBUG os_brick.initiator.linuxscsi [None req-1028ee96-453b-4d25-ae2d-35538e927ff3 tempest-AttachSCSIVolumeTestJSON-1343397388 tempest-AttachSCSIVolumeTestJSON-1343397388-project-member] Removing single pathed devices sdf {{(pid=74613) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 29 17:54:03 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 17:54:03 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.027s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 17:54:03 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[36ee52e5-80d9-4137-a9a9-1212c5d59472]: (4, ('path checker states:\nup                  8\n\npaths: 0\nbusy: False\n', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 17:54:03 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 17:54:03 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.019s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 17:54:03 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[709e3a6f-7bbf-43eb-954a-b0969242d937]: (4, ('ok\n', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 17:54:03 user nova-compute[74613]: DEBUG os_brick.initiator.linuxscsi [None req-1028ee96-453b-4d25-ae2d-35538e927ff3 tempest-AttachSCSIVolumeTestJSON-1343397388 tempest-AttachSCSIVolumeTestJSON-1343397388-project-member] Flushing IO for device /dev/sdf {{(pid=74613) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 29 17:54:03 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 17:54:03 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.017s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 17:54:03 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[70903289-22e2-4a38-932b-c8ab3aa31ab1]: (4, ('', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 17:54:03 user nova-compute[74613]: DEBUG os_brick.initiator.linuxscsi [None req-1028ee96-453b-4d25-ae2d-35538e927ff3 tempest-AttachSCSIVolumeTestJSON-1343397388 tempest-AttachSCSIVolumeTestJSON-1343397388-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=74613) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 29 17:54:03 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 17:54:03 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.033s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 17:54:03 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[9bd16dc4-69bb-47ce-a21f-639e054f786b]: (4, ('1', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 17:54:03 user nova-compute[74613]: DEBUG os_brick.initiator.linuxscsi [None req-1028ee96-453b-4d25-ae2d-35538e927ff3 tempest-AttachSCSIVolumeTestJSON-1343397388 tempest-AttachSCSIVolumeTestJSON-1343397388-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=74613) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 29 17:54:03 user nova-compute[74613]: DEBUG os_brick.initiator.linuxscsi [None req-1028ee96-453b-4d25-ae2d-35538e927ff3 tempest-AttachSCSIVolumeTestJSON-1343397388 tempest-AttachSCSIVolumeTestJSON-1343397388-project-member] SCSI volumes sdf have been removed. {{(pid=74613) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 29 17:54:03 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-1028ee96-453b-4d25-ae2d-35538e927ff3 tempest-AttachSCSIVolumeTestJSON-1343397388 tempest-AttachSCSIVolumeTestJSON-1343397388-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:850c1226-267c-42c0-945f-bfc219c8e88b')] {{(pid=74613) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 29 17:54:03 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:850c1226-267c-42c0-945f-bfc219c8e88b -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 17:54:03 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:850c1226-267c-42c0-945f-bfc219c8e88b -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 17:54:03 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[f895941c-dc1a-44f8-a790-178380303a20]: (4, ('', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 17:54:03 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-1028ee96-453b-4d25-ae2d-35538e927ff3 tempest-AttachSCSIVolumeTestJSON-1343397388 tempest-AttachSCSIVolumeTestJSON-1343397388-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74613) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 17:54:03 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:850c1226-267c-42c0-945f-bfc219c8e88b -p 172.16.0.220:3260 --logout {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 17:54:03 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:850c1226-267c-42c0-945f-bfc219c8e88b -p 172.16.0.220:3260 --logout" returned: 0 in 0.063s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 17:54:03 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea99dab7-3c58-408d-9608-a2c9b02e9ae3]: (4, ('Logging out of session [sid: 7, target: iqn.2010-10.org.openstack:850c1226-267c-42c0-945f-bfc219c8e88b, portal: 172.16.0.220,3260]\nLogout of [sid: 7, target: iqn.2010-10.org.openstack:850c1226-267c-42c0-945f-bfc219c8e88b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 17:54:03 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-1028ee96-453b-4d25-ae2d-35538e927ff3 tempest-AttachSCSIVolumeTestJSON-1343397388 tempest-AttachSCSIVolumeTestJSON-1343397388-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 7, target: iqn.2010-10.org.openstack:850c1226-267c-42c0-945f-bfc219c8e88b, portal: 172.16.0.220,3260]
Nov 29 17:54:03 user nova-compute[74613]: Logout of [sid: 7, target: iqn.2010-10.org.openstack:850c1226-267c-42c0-945f-bfc219c8e88b, portal: 172.16.0.220,3260] successful.
Nov 29 17:54:03 user nova-compute[74613]:  stderr= {{(pid=74613) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 17:54:03 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:850c1226-267c-42c0-945f-bfc219c8e88b -p 172.16.0.220:3260 --op delete {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 17:54:03 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:850c1226-267c-42c0-945f-bfc219c8e88b -p 172.16.0.220:3260 --op delete" returned: 0 in 0.037s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 17:54:03 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[0307be99-66a3-4387-87e1-70939a332124]: (4, ('', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 17:54:03 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-1028ee96-453b-4d25-ae2d-35538e927ff3 tempest-AttachSCSIVolumeTestJSON-1343397388 tempest-AttachSCSIVolumeTestJSON-1343397388-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74613) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 17:54:03 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.base [None req-1028ee96-453b-4d25-ae2d-35538e927ff3 tempest-AttachSCSIVolumeTestJSON-1343397388 tempest-AttachSCSIVolumeTestJSON-1343397388-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.345s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 17:54:03 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-1028ee96-453b-4d25-ae2d-35538e927ff3 tempest-AttachSCSIVolumeTestJSON-1343397388 tempest-AttachSCSIVolumeTestJSON-1343397388-project-member] <== disconnect_volume: return (347ms) None {{(pid=74613) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 17:54:03 user nova-compute[74613]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1028ee96-453b-4d25-ae2d-35538e927ff3 tempest-AttachSCSIVolumeTestJSON-1343397388 tempest-AttachSCSIVolumeTestJSON-1343397388-project-member] [instance: 01c65b16-5dbe-4ad5-a72e-9500a4fa59cf] Disconnected iSCSI Volume {{(pid=74613) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 29 17:54:03 user nova-compute[74613]: DEBUG nova.virt.libvirt.guest [None req-5489860b-08ae-4311-8a2b-dd8f35fab03e tempest-TestVolumeSwap-1038735411 tempest-TestVolumeSwap-1038735411-project-admin] COPY block job progress, current cursor: 87031808 final cursor: 1073741824 {{(pid=74613) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 29 17:54:04 user nova-compute[74613]: DEBUG nova.virt.libvirt.guest [None req-5489860b-08ae-4311-8a2b-dd8f35fab03e tempest-TestVolumeSwap-1038735411 tempest-TestVolumeSwap-1038735411-project-admin] COPY block job progress, current cursor: 190840832 final cursor: 1073741824 {{(pid=74613) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 29 17:54:04 user nova-compute[74613]: DEBUG nova.virt.libvirt.guest [None req-5489860b-08ae-4311-8a2b-dd8f35fab03e tempest-TestVolumeSwap-1038735411 tempest-TestVolumeSwap-1038735411-project-admin] COPY block job progress, current cursor: 326107136 final cursor: 1073741824 {{(pid=74613) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 29 17:54:05 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:54:05 user nova-compute[74613]: DEBUG nova.objects.instance [None req-1028ee96-453b-4d25-ae2d-35538e927ff3 tempest-AttachSCSIVolumeTestJSON-1343397388 tempest-AttachSCSIVolumeTestJSON-1343397388-project-member] Lazy-loading 'flavor' on Instance uuid 01c65b16-5dbe-4ad5-a72e-9500a4fa59cf {{(pid=74613) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 17:54:05 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-1028ee96-453b-4d25-ae2d-35538e927ff3 tempest-AttachSCSIVolumeTestJSON-1343397388 tempest-AttachSCSIVolumeTestJSON-1343397388-project-member] Lock "01c65b16-5dbe-4ad5-a72e-9500a4fa59cf" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.264s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 17:54:05 user nova-compute[74613]: DEBUG nova.virt.libvirt.guest [None req-5489860b-08ae-4311-8a2b-dd8f35fab03e tempest-TestVolumeSwap-1038735411 tempest-TestVolumeSwap-1038735411-project-admin] COPY block job progress, current cursor: 510656512 final cursor: 1073741824 {{(pid=74613) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 29 17:54:05 user nova-compute[74613]: DEBUG nova.virt.libvirt.guest [None req-5489860b-08ae-4311-8a2b-dd8f35fab03e tempest-TestVolumeSwap-1038735411 tempest-TestVolumeSwap-1038735411-project-admin] COPY block job progress, current cursor: 656408576 final cursor: 1073741824 {{(pid=74613) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 29 17:54:06 user nova-compute[74613]: DEBUG nova.virt.libvirt.guest [None req-5489860b-08ae-4311-8a2b-dd8f35fab03e tempest-TestVolumeSwap-1038735411 tempest-TestVolumeSwap-1038735411-project-admin] COPY block job progress, current cursor: 812646400 final cursor: 1073741824 {{(pid=74613) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 29 17:54:06 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-52bd93d0-94c7-410f-a4e3-ab0f983733bf tempest-AttachSCSIVolumeTestJSON-1343397388 tempest-AttachSCSIVolumeTestJSON-1343397388-project-member] Acquiring lock "01c65b16-5dbe-4ad5-a72e-9500a4fa59cf" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 17:54:06 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-52bd93d0-94c7-410f-a4e3-ab0f983733bf tempest-AttachSCSIVolumeTestJSON-1343397388 tempest-AttachSCSIVolumeTestJSON-1343397388-project-member] Lock "01c65b16-5dbe-4ad5-a72e-9500a4fa59cf" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 17:54:06 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-52bd93d0-94c7-410f-a4e3-ab0f983733bf tempest-AttachSCSIVolumeTestJSON-1343397388 tempest-AttachSCSIVolumeTestJSON-1343397388-project-member] Acquiring lock "01c65b16-5dbe-4ad5-a72e-9500a4fa59cf-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 17:54:06 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-52bd93d0-94c7-410f-a4e3-ab0f983733bf tempest-AttachSCSIVolumeTestJSON-1343397388 tempest-AttachSCSIVolumeTestJSON-1343397388-project-member] Lock "01c65b16-5dbe-4ad5-a72e-9500a4fa59cf-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 17:54:06 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-52bd93d0-94c7-410f-a4e3-ab0f983733bf tempest-AttachSCSIVolumeTestJSON-1343397388 tempest-AttachSCSIVolumeTestJSON-1343397388-project-member] Lock "01c65b16-5dbe-4ad5-a72e-9500a4fa59cf-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 17:54:06 user nova-compute[74613]: INFO nova.compute.manager [None req-52bd93d0-94c7-410f-a4e3-ab0f983733bf tempest-AttachSCSIVolumeTestJSON-1343397388 tempest-AttachSCSIVolumeTestJSON-1343397388-project-member] [instance: 01c65b16-5dbe-4ad5-a72e-9500a4fa59cf] Terminating instance
Nov 29 17:54:06 user nova-compute[74613]: DEBUG nova.compute.manager [None req-52bd93d0-94c7-410f-a4e3-ab0f983733bf tempest-AttachSCSIVolumeTestJSON-1343397388 tempest-AttachSCSIVolumeTestJSON-1343397388-project-member] [instance: 01c65b16-5dbe-4ad5-a72e-9500a4fa59cf] Start destroying the instance on the hypervisor. {{(pid=74613) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 29 17:54:06 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:54:06 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:54:06 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:54:06 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:54:06 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:54:06 user nova-compute[74613]: DEBUG nova.virt.libvirt.guest [None req-5489860b-08ae-4311-8a2b-dd8f35fab03e tempest-TestVolumeSwap-1038735411 tempest-TestVolumeSwap-1038735411-project-admin] COPY block job progress, current cursor: 973078528 final cursor: 1073741824 {{(pid=74613) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 29 17:54:06 user nova-compute[74613]: DEBUG nova.compute.manager [req-ee1a4b89-3cc0-4c40-8a50-1b6af17bfc84 req-8642e89d-0124-4bfb-b986-d60d43bb3a44 service nova] [instance: 01c65b16-5dbe-4ad5-a72e-9500a4fa59cf] Received event network-vif-unplugged-9441dfc5-c933-4642-b797-494d88a10f8a {{(pid=74613) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 17:54:06 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-ee1a4b89-3cc0-4c40-8a50-1b6af17bfc84 req-8642e89d-0124-4bfb-b986-d60d43bb3a44 service nova] Acquiring lock "01c65b16-5dbe-4ad5-a72e-9500a4fa59cf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 17:54:06 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-ee1a4b89-3cc0-4c40-8a50-1b6af17bfc84 req-8642e89d-0124-4bfb-b986-d60d43bb3a44 service nova] Lock "01c65b16-5dbe-4ad5-a72e-9500a4fa59cf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 17:54:06 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-ee1a4b89-3cc0-4c40-8a50-1b6af17bfc84 req-8642e89d-0124-4bfb-b986-d60d43bb3a44 service nova] Lock "01c65b16-5dbe-4ad5-a72e-9500a4fa59cf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 17:54:06 user nova-compute[74613]: DEBUG nova.compute.manager [req-ee1a4b89-3cc0-4c40-8a50-1b6af17bfc84 req-8642e89d-0124-4bfb-b986-d60d43bb3a44 service nova] [instance: 01c65b16-5dbe-4ad5-a72e-9500a4fa59cf] No waiting events found dispatching network-vif-unplugged-9441dfc5-c933-4642-b797-494d88a10f8a {{(pid=74613) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 17:54:06 user nova-compute[74613]: DEBUG nova.compute.manager [req-ee1a4b89-3cc0-4c40-8a50-1b6af17bfc84 req-8642e89d-0124-4bfb-b986-d60d43bb3a44 service nova] [instance: 01c65b16-5dbe-4ad5-a72e-9500a4fa59cf] Received event network-vif-unplugged-9441dfc5-c933-4642-b797-494d88a10f8a for instance with task_state deleting. {{(pid=74613) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 29 17:54:07 user nova-compute[74613]: INFO nova.virt.libvirt.driver [-] [instance: 01c65b16-5dbe-4ad5-a72e-9500a4fa59cf] Instance destroyed successfully.
Nov 29 17:54:07 user nova-compute[74613]: DEBUG nova.objects.instance [None req-52bd93d0-94c7-410f-a4e3-ab0f983733bf tempest-AttachSCSIVolumeTestJSON-1343397388 tempest-AttachSCSIVolumeTestJSON-1343397388-project-member] Lazy-loading 'resources' on Instance uuid 01c65b16-5dbe-4ad5-a72e-9500a4fa59cf {{(pid=74613) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 17:54:07 user nova-compute[74613]: DEBUG nova.virt.libvirt.vif [None req-52bd93d0-94c7-410f-a4e3-ab0f983733bf tempest-AttachSCSIVolumeTestJSON-1343397388 tempest-AttachSCSIVolumeTestJSON-1343397388-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-29T17:51:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachSCSIVolumeTestJSON-server-1485503705',display_name='tempest-AttachSCSIVolumeTestJSON-server-1485503705',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachscsivolumetestjson-server-1485503705',id=6,image_ref='5443c2d3-dc95-4e1c-af07-7f61ae95607d',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLvhn1wEDAFMPzNYFlLPIPr9slY1CRB2Dsg+n+U7WiGKwCIvJ+V1G2F7SsekWZPHD1kZDmbPDUTVnVvwBGNeyKysrtR4DGuueTgSmXFr9qtUG/d3S58HP7qJnro/cCqOLg==',key_name='tempest-keypair-827478183',keypairs=<?>,launch_index=0,launched_at=2023-11-29T17:51:56Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='ab6d78b5cdf64466914b67f7405aa79f',ramdisk_id='',reservation_id='r-wy0mz1hc',resources=None,root_device_name='/dev/sda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='5443c2d3-dc95-4e1c-af07-7f61ae95607d',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='scsi',image_hw_disk_bus='scsi',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_scsi_model='virtio-scsi',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-AttachSCSIVolumeTestJSON-1343397388',owner_user_name='tempest-AttachSCSIVolumeTestJSON-1343397388-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-29T17:51:57Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3d3ee0ac41c4402182bb4fdc83f543bf',uuid=01c65b16-5dbe-4ad5-a72e-9500a4fa59cf,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "9441dfc5-c933-4642-b797-494d88a10f8a", "address": "fa:16:3e:c7:6c:2d", "network": {"id": "1db277f8-4456-4ba3-8eef-276639086245", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1225625601-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.249", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ab6d78b5cdf64466914b67f7405aa79f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9441dfc5-c9", "ovs_interfaceid": "9441dfc5-c933-4642-b797-494d88a10f8a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74613) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 29 17:54:07 user nova-compute[74613]: DEBUG nova.network.os_vif_util [None req-52bd93d0-94c7-410f-a4e3-ab0f983733bf tempest-AttachSCSIVolumeTestJSON-1343397388 tempest-AttachSCSIVolumeTestJSON-1343397388-project-member] Converting VIF {"id": "9441dfc5-c933-4642-b797-494d88a10f8a", "address": "fa:16:3e:c7:6c:2d", "network": {"id": "1db277f8-4456-4ba3-8eef-276639086245", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1225625601-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.249", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ab6d78b5cdf64466914b67f7405aa79f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9441dfc5-c9", "ovs_interfaceid": "9441dfc5-c933-4642-b797-494d88a10f8a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74613) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 17:54:07 user nova-compute[74613]: DEBUG nova.network.os_vif_util [None req-52bd93d0-94c7-410f-a4e3-ab0f983733bf tempest-AttachSCSIVolumeTestJSON-1343397388 tempest-AttachSCSIVolumeTestJSON-1343397388-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:c7:6c:2d,bridge_name='br-int',has_traffic_filtering=True,id=9441dfc5-c933-4642-b797-494d88a10f8a,network=Network(1db277f8-4456-4ba3-8eef-276639086245),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9441dfc5-c9') {{(pid=74613) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 17:54:07 user nova-compute[74613]: DEBUG os_vif [None req-52bd93d0-94c7-410f-a4e3-ab0f983733bf tempest-AttachSCSIVolumeTestJSON-1343397388 tempest-AttachSCSIVolumeTestJSON-1343397388-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:c7:6c:2d,bridge_name='br-int',has_traffic_filtering=True,id=9441dfc5-c933-4642-b797-494d88a10f8a,network=Network(1db277f8-4456-4ba3-8eef-276639086245),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9441dfc5-c9') {{(pid=74613) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 29 17:54:07 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:54:07 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap9441dfc5-c9, bridge=br-int, if_exists=True) {{(pid=74613) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 17:54:07 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:54:07 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:54:07 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:54:07 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=b4795e99-f36c-45ac-8660-2c4d6ba184bf) {{(pid=74613) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 17:54:07 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:54:07 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:54:07 user nova-compute[74613]: INFO os_vif [None req-52bd93d0-94c7-410f-a4e3-ab0f983733bf tempest-AttachSCSIVolumeTestJSON-1343397388 tempest-AttachSCSIVolumeTestJSON-1343397388-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:c7:6c:2d,bridge_name='br-int',has_traffic_filtering=True,id=9441dfc5-c933-4642-b797-494d88a10f8a,network=Network(1db277f8-4456-4ba3-8eef-276639086245),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9441dfc5-c9')
Nov 29 17:54:07 user nova-compute[74613]: INFO nova.virt.libvirt.driver [None req-52bd93d0-94c7-410f-a4e3-ab0f983733bf tempest-AttachSCSIVolumeTestJSON-1343397388 tempest-AttachSCSIVolumeTestJSON-1343397388-project-member] [instance: 01c65b16-5dbe-4ad5-a72e-9500a4fa59cf] Deleting instance files /opt/stack/data/nova/instances/01c65b16-5dbe-4ad5-a72e-9500a4fa59cf_del
Nov 29 17:54:07 user nova-compute[74613]: INFO nova.virt.libvirt.driver [None req-52bd93d0-94c7-410f-a4e3-ab0f983733bf tempest-AttachSCSIVolumeTestJSON-1343397388 tempest-AttachSCSIVolumeTestJSON-1343397388-project-member] [instance: 01c65b16-5dbe-4ad5-a72e-9500a4fa59cf] Deletion of /opt/stack/data/nova/instances/01c65b16-5dbe-4ad5-a72e-9500a4fa59cf_del complete
Nov 29 17:54:07 user nova-compute[74613]: INFO nova.compute.manager [None req-52bd93d0-94c7-410f-a4e3-ab0f983733bf tempest-AttachSCSIVolumeTestJSON-1343397388 tempest-AttachSCSIVolumeTestJSON-1343397388-project-member] [instance: 01c65b16-5dbe-4ad5-a72e-9500a4fa59cf] Took 0.94 seconds to destroy the instance on the hypervisor.
Nov 29 17:54:07 user nova-compute[74613]: DEBUG oslo.service.loopingcall [None req-52bd93d0-94c7-410f-a4e3-ab0f983733bf tempest-AttachSCSIVolumeTestJSON-1343397388 tempest-AttachSCSIVolumeTestJSON-1343397388-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74613) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 29 17:54:07 user nova-compute[74613]: DEBUG nova.compute.manager [-] [instance: 01c65b16-5dbe-4ad5-a72e-9500a4fa59cf] Deallocating network for instance {{(pid=74613) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 29 17:54:07 user nova-compute[74613]: DEBUG nova.network.neutron [-] [instance: 01c65b16-5dbe-4ad5-a72e-9500a4fa59cf] deallocate_for_instance() {{(pid=74613) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 29 17:54:07 user nova-compute[74613]: DEBUG nova.virt.libvirt.guest [None req-5489860b-08ae-4311-8a2b-dd8f35fab03e tempest-TestVolumeSwap-1038735411 tempest-TestVolumeSwap-1038735411-project-admin] COPY block job progress, current cursor: 1073741824 final cursor: 1073741824 {{(pid=74613) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 29 17:54:07 user nova-compute[74613]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5489860b-08ae-4311-8a2b-dd8f35fab03e tempest-TestVolumeSwap-1038735411 tempest-TestVolumeSwap-1038735411-project-admin] [instance: 0008521b-5a63-4ff6-8390-d343956900ed] calling os-brick to detach iSCSI Volume {{(pid=74613) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 29 17:54:07 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-5489860b-08ae-4311-8a2b-dd8f35fab03e tempest-TestVolumeSwap-1038735411 tempest-TestVolumeSwap-1038735411-project-admin] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff828156890>, {'target_iqn': 'iqn.2010-10.org.openstack:a6b34bdb-5c08-4f7c-b3f5-6b68413947a8', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'SAqnwafp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdg'}, None), 'kwargs': False}}" {{(pid=74613) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 17:54:07 user nova-compute[74613]: WARNING os_brick.initiator.connectors.base [None req-5489860b-08ae-4311-8a2b-dd8f35fab03e tempest-TestVolumeSwap-1038735411 tempest-TestVolumeSwap-1038735411-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 17:54:07 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.base [None req-5489860b-08ae-4311-8a2b-dd8f35fab03e tempest-TestVolumeSwap-1038735411 tempest-TestVolumeSwap-1038735411-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 17:54:07 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.base [None req-5489860b-08ae-4311-8a2b-dd8f35fab03e tempest-TestVolumeSwap-1038735411 tempest-TestVolumeSwap-1038735411-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 17:54:07 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 17:54:07 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 17:54:07 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b9ebd59-1ca3-4245-97bd-a8a2bac21140]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:24920064-fc81-4408-97d1-d8eff97a7554\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b7efc2d5-5149-408b-980d-58492994fd4f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:17b27fab-6cdb-4820-be62-ffd44e8e2fb5\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:8230f3a2-63d8-46cb-8ec7-ceb89fb04e53\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:49f19a7e-3b8b-44b4-b289-808ee2a18b91\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a6b34bdb-5c08-4f7c-b3f5-6b68413947a8\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d1f798a1-4f7b-4b9a-8180-fa8f4eb89bf0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 17:54:07 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-5489860b-08ae-4311-8a2b-dd8f35fab03e tempest-TestVolumeSwap-1038735411 tempest-TestVolumeSwap-1038735411-project-admin] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 29 17:54:07 user nova-compute[74613]: No targets found.
Nov 29 17:54:07 user nova-compute[74613]: iSNS:
Nov 29 17:54:07 user nova-compute[74613]: No targets found.
Nov 29 17:54:07 user nova-compute[74613]: STATIC:
Nov 29 17:54:07 user nova-compute[74613]: Target: iqn.2010-10.org.openstack:24920064-fc81-4408-97d1-d8eff97a7554
Nov 29 17:54:07 user nova-compute[74613]:         Portal: 172.16.0.220:3260,-1
Nov 29 17:54:07 user nova-compute[74613]:                 Iface Name: default
Nov 29 17:54:07 user nova-compute[74613]: Target: iqn.2010-10.org.openstack:b7efc2d5-5149-408b-980d-58492994fd4f
Nov 29 17:54:07 user nova-compute[74613]:         Portal: 172.16.0.220:3260,-1
Nov 29 17:54:07 user nova-compute[74613]:                 Iface Name: default
Nov 29 17:54:07 user nova-compute[74613]: Target: iqn.2010-10.org.openstack:17b27fab-6cdb-4820-be62-ffd44e8e2fb5
Nov 29 17:54:07 user nova-compute[74613]:         Portal: 172.16.0.220:3260,-1
Nov 29 17:54:07 user nova-compute[74613]:                 Iface Name: default
Nov 29 17:54:07 user nova-compute[74613]: Target: iqn.2010-10.org.openstack:8230f3a2-63d8-46cb-8ec7-ceb89fb04e53
Nov 29 17:54:07 user nova-compute[74613]:         Portal: 172.16.0.220:3260,-1
Nov 29 17:54:07 user nova-compute[74613]:                 Iface Name: default
Nov 29 17:54:07 user nova-compute[74613]: Target: iqn.2010-10.org.openstack:49f19a7e-3b8b-44b4-b289-808ee2a18b91
Nov 29 17:54:07 user nova-compute[74613]:         Portal: 172.16.0.220:3260,-1
Nov 29 17:54:07 user nova-compute[74613]:                 Iface Name: default
Nov 29 17:54:07 user nova-compute[74613]: Target: iqn.2010-10.org.openstack:a6b34bdb-5c08-4f7c-b3f5-6b68413947a8
Nov 29 17:54:07 user nova-compute[74613]:         Portal: 172.16.0.220:3260,-1
Nov 29 17:54:07 user nova-compute[74613]:                 Iface Name: default
Nov 29 17:54:07 user nova-compute[74613]: Target: iqn.2010-10.org.openstack:d1f798a1-4f7b-4b9a-8180-fa8f4eb89bf0
Nov 29 17:54:07 user nova-compute[74613]:         Portal: 172.16.0.220:3260,-1
Nov 29 17:54:07 user nova-compute[74613]:                 Iface Name: default
Nov 29 17:54:07 user nova-compute[74613]: FIRMWARE:
Nov 29 17:54:07 user nova-compute[74613]: No targets found.
Nov 29 17:54:07 user nova-compute[74613]:  stderr= {{(pid=74613) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 17:54:07 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-5489860b-08ae-4311-8a2b-dd8f35fab03e tempest-TestVolumeSwap-1038735411 tempest-TestVolumeSwap-1038735411-project-admin] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 29 17:54:07 user nova-compute[74613]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 29 17:54:07 user nova-compute[74613]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74613) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 29 17:54:07 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-5489860b-08ae-4311-8a2b-dd8f35fab03e tempest-TestVolumeSwap-1038735411 tempest-TestVolumeSwap-1038735411-project-admin] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a6b34bdb-5c08-4f7c-b3f5-6b68413947a8', 0)] {{(pid=74613) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 29 17:54:07 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 17:54:07 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 17:54:07 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[09382b79-41ac-4902-b14b-3c1ba06a4e0b]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:17b27fab-6cdb-4820-be62-ffd44e8e2fb5\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:24920064-fc81-4408-97d1-d8eff97a7554\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:49f19a7e-3b8b-44b4-b289-808ee2a18b91\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8230f3a2-63d8-46cb-8ec7-ceb89fb04e53\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a6b34bdb-5c08-4f7c-b3f5-6b68413947a8\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b7efc2d5-5149-408b-980d-58492994fd4f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d1f798a1-4f7b-4b9a-8180-fa8f4eb89bf0\n', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 17:54:07 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 17:54:07 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 17:54:07 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[cdc80c6c-24d6-42d9-9f15-5a8457cfff19]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7efc2d5-5149-408b-980d-58492994fd4f (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49f19a7e-3b8b-44b4-b289-808ee2a18b91 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:24920064-fc81-4408-97d1-d8eff97a7554 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8230f3a2-63d8-46cb-8ec7-ceb89fb04e53 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d1f798a1-4f7b-4b9a-8180-fa8f4eb89bf0 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a6b34bdb-5c08-4f7c-b3f5-6b68413947a8 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:17b27fab-6cdb-4820-be62-ffd44e8e2fb5 (non-flash)\n', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 17:54:07 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-5489860b-08ae-4311-8a2b-dd8f35fab03e tempest-TestVolumeSwap-1038735411 tempest-TestVolumeSwap-1038735411-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7efc2d5-5149-408b-980d-58492994fd4f (non-flash)
Nov 29 17:54:07 user nova-compute[74613]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49f19a7e-3b8b-44b4-b289-808ee2a18b91 (non-flash)
Nov 29 17:54:07 user nova-compute[74613]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:24920064-fc81-4408-97d1-d8eff97a7554 (non-flash)
Nov 29 17:54:07 user nova-compute[74613]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8230f3a2-63d8-46cb-8ec7-ceb89fb04e53 (non-flash)
Nov 29 17:54:07 user nova-compute[74613]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d1f798a1-4f7b-4b9a-8180-fa8f4eb89bf0 (non-flash)
Nov 29 17:54:07 user nova-compute[74613]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a6b34bdb-5c08-4f7c-b3f5-6b68413947a8 (non-flash)
Nov 29 17:54:07 user nova-compute[74613]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:17b27fab-6cdb-4820-be62-ffd44e8e2fb5 (non-flash)
Nov 29 17:54:07 user nova-compute[74613]:  stderr= {{(pid=74613) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 17:54:07 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-5489860b-08ae-4311-8a2b-dd8f35fab03e tempest-TestVolumeSwap-1038735411 tempest-TestVolumeSwap-1038735411-project-admin] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7efc2d5-5149-408b-980d-58492994fd4f (non-flash)
Nov 29 17:54:07 user nova-compute[74613]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49f19a7e-3b8b-44b4-b289-808ee2a18b91 (non-flash)
Nov 29 17:54:07 user nova-compute[74613]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:24920064-fc81-4408-97d1-d8eff97a7554 (non-flash)
Nov 29 17:54:07 user nova-compute[74613]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8230f3a2-63d8-46cb-8ec7-ceb89fb04e53 (non-flash)
Nov 29 17:54:07 user nova-compute[74613]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d1f798a1-4f7b-4b9a-8180-fa8f4eb89bf0 (non-flash)
Nov 29 17:54:07 user nova-compute[74613]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a6b34bdb-5c08-4f7c-b3f5-6b68413947a8 (non-flash)
Nov 29 17:54:07 user nova-compute[74613]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:17b27fab-6cdb-4820-be62-ffd44e8e2fb5 (non-flash)
Nov 29 17:54:07 user nova-compute[74613]:  stderr= {{(pid=74613) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 17:54:07 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-5489860b-08ae-4311-8a2b-dd8f35fab03e tempest-TestVolumeSwap-1038735411 tempest-TestVolumeSwap-1038735411-project-admin] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7ff832b87ac0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a6b34bdb-5c08-4f7c-b3f5-6b68413947a8'): ({'sdg'}, set())}) {{(pid=74613) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 29 17:54:07 user nova-compute[74613]: DEBUG os_brick.initiator.linuxscsi [None req-5489860b-08ae-4311-8a2b-dd8f35fab03e tempest-TestVolumeSwap-1038735411 tempest-TestVolumeSwap-1038735411-project-admin] Removing single pathed devices sdg {{(pid=74613) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 29 17:54:07 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 17:54:07 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 17:54:07 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[b05769a4-d8d2-478f-861d-18449596e7fb]: (4, ('path checker states:\nup                  7\n\npaths: 0\nbusy: False\n', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 17:54:07 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdg {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 17:54:07 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdg" returned: 0 in 0.017s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 17:54:07 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e1d6e50-f0c7-4496-aefa-0abeb7458e13]: (4, ('ok\n', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 17:54:07 user nova-compute[74613]: DEBUG os_brick.initiator.linuxscsi [None req-5489860b-08ae-4311-8a2b-dd8f35fab03e tempest-TestVolumeSwap-1038735411 tempest-TestVolumeSwap-1038735411-project-admin] Flushing IO for device /dev/sdg {{(pid=74613) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 29 17:54:07 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdg {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 17:54:07 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdg" returned: 0 in 0.012s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 17:54:07 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[6dadec7d-e6b8-4cc9-9a5d-56e1b4f79200]: (4, ('', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 17:54:07 user nova-compute[74613]: DEBUG os_brick.initiator.linuxscsi [None req-5489860b-08ae-4311-8a2b-dd8f35fab03e tempest-TestVolumeSwap-1038735411 tempest-TestVolumeSwap-1038735411-project-admin] Remove SCSI device /dev/sdg with /sys/block/sdg/device/delete {{(pid=74613) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 29 17:54:07 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdg/device/delete {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 17:54:07 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdg/device/delete" returned: 0 in 0.045s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 17:54:07 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c2b3ab7-1c9d-4156-b18e-2746a7c2fc1f]: (4, ('1', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 17:54:07 user nova-compute[74613]: DEBUG os_brick.initiator.linuxscsi [None req-5489860b-08ae-4311-8a2b-dd8f35fab03e tempest-TestVolumeSwap-1038735411 tempest-TestVolumeSwap-1038735411-project-admin] Checking to see if SCSI volumes sdg have been removed. {{(pid=74613) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 29 17:54:07 user nova-compute[74613]: DEBUG os_brick.initiator.linuxscsi [None req-5489860b-08ae-4311-8a2b-dd8f35fab03e tempest-TestVolumeSwap-1038735411 tempest-TestVolumeSwap-1038735411-project-admin] SCSI volumes sdg have been removed. {{(pid=74613) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 29 17:54:07 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-5489860b-08ae-4311-8a2b-dd8f35fab03e tempest-TestVolumeSwap-1038735411 tempest-TestVolumeSwap-1038735411-project-admin] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a6b34bdb-5c08-4f7c-b3f5-6b68413947a8')] {{(pid=74613) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 29 17:54:07 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a6b34bdb-5c08-4f7c-b3f5-6b68413947a8 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 17:54:07 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a6b34bdb-5c08-4f7c-b3f5-6b68413947a8 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.017s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 17:54:07 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[078df3ad-afff-49f8-9a86-b06c1f02f7ba]: (4, ('', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 17:54:07 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-5489860b-08ae-4311-8a2b-dd8f35fab03e tempest-TestVolumeSwap-1038735411 tempest-TestVolumeSwap-1038735411-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74613) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 17:54:07 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a6b34bdb-5c08-4f7c-b3f5-6b68413947a8 -p 172.16.0.220:3260 --logout {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 17:54:07 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a6b34bdb-5c08-4f7c-b3f5-6b68413947a8 -p 172.16.0.220:3260 --logout" returned: 0 in 0.067s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 17:54:07 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[978f67be-cbac-4085-b5d6-048f0ddf521c]: (4, ('Logging out of session [sid: 8, target: iqn.2010-10.org.openstack:a6b34bdb-5c08-4f7c-b3f5-6b68413947a8, portal: 172.16.0.220,3260]\nLogout of [sid: 8, target: iqn.2010-10.org.openstack:a6b34bdb-5c08-4f7c-b3f5-6b68413947a8, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 17:54:07 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-5489860b-08ae-4311-8a2b-dd8f35fab03e tempest-TestVolumeSwap-1038735411 tempest-TestVolumeSwap-1038735411-project-admin] iscsiadm ('--logout',): stdout=Logging out of session [sid: 8, target: iqn.2010-10.org.openstack:a6b34bdb-5c08-4f7c-b3f5-6b68413947a8, portal: 172.16.0.220,3260]
Nov 29 17:54:07 user nova-compute[74613]: Logout of [sid: 8, target: iqn.2010-10.org.openstack:a6b34bdb-5c08-4f7c-b3f5-6b68413947a8, portal: 172.16.0.220,3260] successful.
Nov 29 17:54:07 user nova-compute[74613]:  stderr= {{(pid=74613) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 17:54:07 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a6b34bdb-5c08-4f7c-b3f5-6b68413947a8 -p 172.16.0.220:3260 --op delete {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 17:54:07 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a6b34bdb-5c08-4f7c-b3f5-6b68413947a8 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.030s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 17:54:07 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee964514-0ba6-424d-8aac-4aa981a394b8]: (4, ('', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 17:54:07 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-5489860b-08ae-4311-8a2b-dd8f35fab03e tempest-TestVolumeSwap-1038735411 tempest-TestVolumeSwap-1038735411-project-admin] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74613) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 17:54:07 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.base [None req-5489860b-08ae-4311-8a2b-dd8f35fab03e tempest-TestVolumeSwap-1038735411 tempest-TestVolumeSwap-1038735411-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.312s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 17:54:07 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-5489860b-08ae-4311-8a2b-dd8f35fab03e tempest-TestVolumeSwap-1038735411 tempest-TestVolumeSwap-1038735411-project-admin] <== disconnect_volume: return (313ms) None {{(pid=74613) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 17:54:07 user nova-compute[74613]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5489860b-08ae-4311-8a2b-dd8f35fab03e tempest-TestVolumeSwap-1038735411 tempest-TestVolumeSwap-1038735411-project-admin] [instance: 0008521b-5a63-4ff6-8390-d343956900ed] Disconnected iSCSI Volume {{(pid=74613) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 29 17:54:07 user nova-compute[74613]: DEBUG nova.compute.manager [None req-5489860b-08ae-4311-8a2b-dd8f35fab03e tempest-TestVolumeSwap-1038735411 tempest-TestVolumeSwap-1038735411-project-admin] swap_volume: Driver volume swap returned, new connection_info is now : {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:49f19a7e-3b8b-44b4-b289-808ee2a18b91', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'EhqaYVOC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdi'}, 'status': 'reserved', 'instance': '0008521b-5a63-4ff6-8390-d343956900ed', 'attached_at': '', 'detached_at': '', 'volume_id': '49f19a7e-3b8b-44b4-b289-808ee2a18b91', 'serial'} {{(pid=74613) _swap_volume /opt/stack/nova/nova/compute/manager.py:7791}}
Nov 29 17:54:07 user nova-compute[74613]: DEBUG nova.compute.manager [None req-5489860b-08ae-4311-8a2b-dd8f35fab03e tempest-TestVolumeSwap-1038735411 tempest-TestVolumeSwap-1038735411-project-admin] [instance: 0008521b-5a63-4ff6-8390-d343956900ed] swap_volume: removing Cinder connection for volume a6b34bdb-5c08-4f7c-b3f5-6b68413947a8 {{(pid=74613) _swap_volume /opt/stack/nova/nova/compute/manager.py:7836}}
Nov 29 17:54:08 user nova-compute[74613]: DEBUG nova.network.neutron [-] [instance: 01c65b16-5dbe-4ad5-a72e-9500a4fa59cf] Updating instance_info_cache with network_info: [] {{(pid=74613) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 17:54:08 user nova-compute[74613]: INFO nova.compute.manager [-] [instance: 01c65b16-5dbe-4ad5-a72e-9500a4fa59cf] Took 0.89 seconds to deallocate network for instance.
Nov 29 17:54:08 user nova-compute[74613]: DEBUG nova.compute.manager [req-264de15b-a45f-4ef3-91ed-4987744eb655 req-c51eaf8b-12a9-47c4-a473-db714acd25ce service nova] [instance: 01c65b16-5dbe-4ad5-a72e-9500a4fa59cf] Received event network-vif-deleted-9441dfc5-c933-4642-b797-494d88a10f8a {{(pid=74613) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 17:54:08 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-52bd93d0-94c7-410f-a4e3-ab0f983733bf tempest-AttachSCSIVolumeTestJSON-1343397388 tempest-AttachSCSIVolumeTestJSON-1343397388-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 17:54:08 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-52bd93d0-94c7-410f-a4e3-ab0f983733bf tempest-AttachSCSIVolumeTestJSON-1343397388 tempest-AttachSCSIVolumeTestJSON-1343397388-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.002s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 17:54:08 user nova-compute[74613]: DEBUG nova.compute.provider_tree [None req-52bd93d0-94c7-410f-a4e3-ab0f983733bf tempest-AttachSCSIVolumeTestJSON-1343397388 tempest-AttachSCSIVolumeTestJSON-1343397388-project-member] Inventory has not changed in ProviderTree for provider: 639d980e-3b12-44b1-b8f4-1812416fa4dd {{(pid=74613) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 17:54:08 user nova-compute[74613]: DEBUG nova.scheduler.client.report [None req-52bd93d0-94c7-410f-a4e3-ab0f983733bf tempest-AttachSCSIVolumeTestJSON-1343397388 tempest-AttachSCSIVolumeTestJSON-1343397388-project-member] Inventory has not changed for provider 639d980e-3b12-44b1-b8f4-1812416fa4dd based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74613) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 17:54:08 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-52bd93d0-94c7-410f-a4e3-ab0f983733bf tempest-AttachSCSIVolumeTestJSON-1343397388 tempest-AttachSCSIVolumeTestJSON-1343397388-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.322s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 17:54:08 user nova-compute[74613]: INFO nova.scheduler.client.report [None req-52bd93d0-94c7-410f-a4e3-ab0f983733bf tempest-AttachSCSIVolumeTestJSON-1343397388 tempest-AttachSCSIVolumeTestJSON-1343397388-project-member] Deleted allocations for instance 01c65b16-5dbe-4ad5-a72e-9500a4fa59cf
Nov 29 17:54:08 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-52bd93d0-94c7-410f-a4e3-ab0f983733bf tempest-AttachSCSIVolumeTestJSON-1343397388 tempest-AttachSCSIVolumeTestJSON-1343397388-project-member] Lock "01c65b16-5dbe-4ad5-a72e-9500a4fa59cf" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.502s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 17:54:09 user nova-compute[74613]: DEBUG nova.compute.manager [req-f5d4df45-d56b-452d-ab56-cc552b1424dc req-4863a999-198e-47cd-b208-d47a18003101 service nova] [instance: 01c65b16-5dbe-4ad5-a72e-9500a4fa59cf] Received event network-vif-plugged-9441dfc5-c933-4642-b797-494d88a10f8a {{(pid=74613) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 17:54:09 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-f5d4df45-d56b-452d-ab56-cc552b1424dc req-4863a999-198e-47cd-b208-d47a18003101 service nova] Acquiring lock "01c65b16-5dbe-4ad5-a72e-9500a4fa59cf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 17:54:09 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-f5d4df45-d56b-452d-ab56-cc552b1424dc req-4863a999-198e-47cd-b208-d47a18003101 service nova] Lock "01c65b16-5dbe-4ad5-a72e-9500a4fa59cf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 17:54:09 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-f5d4df45-d56b-452d-ab56-cc552b1424dc req-4863a999-198e-47cd-b208-d47a18003101 service nova] Lock "01c65b16-5dbe-4ad5-a72e-9500a4fa59cf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 17:54:09 user nova-compute[74613]: DEBUG nova.compute.manager [req-f5d4df45-d56b-452d-ab56-cc552b1424dc req-4863a999-198e-47cd-b208-d47a18003101 service nova] [instance: 01c65b16-5dbe-4ad5-a72e-9500a4fa59cf] No waiting events found dispatching network-vif-plugged-9441dfc5-c933-4642-b797-494d88a10f8a {{(pid=74613) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 17:54:09 user nova-compute[74613]: WARNING nova.compute.manager [req-f5d4df45-d56b-452d-ab56-cc552b1424dc req-4863a999-198e-47cd-b208-d47a18003101 service nova] [instance: 01c65b16-5dbe-4ad5-a72e-9500a4fa59cf] Received unexpected event network-vif-plugged-9441dfc5-c933-4642-b797-494d88a10f8a for instance with vm_state deleted and task_state None.
Nov 29 17:54:09 user nova-compute[74613]: DEBUG nova.compute.manager [None req-5489860b-08ae-4311-8a2b-dd8f35fab03e tempest-TestVolumeSwap-1038735411 tempest-TestVolumeSwap-1038735411-project-admin] [instance: 0008521b-5a63-4ff6-8390-d343956900ed] swap_volume: Updating volume a6b34bdb-5c08-4f7c-b3f5-6b68413947a8 BDM record with {'connection_info': '{"driver_volume_type": "iscsi", "data": {"target_iqn": "iqn.2010-10.org.openstack:49f19a7e-3b8b-44b4-b289-808ee2a18b91", "target_portal": "172.16.0.220:3260", "target_discovered": false, "auth_method": "CHAP", "auth_username": "EhqaYVOC", "auth_password": "TFQCfWtmAN3Z4M", "target_lun": 0, "qos_specs": null, "access_mode": "rw", "encrypted": false, "cacheable": false, "device_path": "/dev/sdi", "volume_id": "49f19a7e-3b8b-44b4-b289-808ee2a18b91"}, "status": "reserved", "instance": "0008521b-5a63-4ff6-8390-d343956900ed", "attached_at": "", "detached_at": "", "volume_id": "49f19a7e-3b8b-44b4-b289-808ee2a18b91", "serial": "49f19a7e-3b8b-44b4-b289-808ee2a18b91"}', 'source_type': 'volume', 'destination_type': 'volume', 'snapshot_id': None, 'volume_id': '49f19a7e-3b8b-44b4-b289-808ee2a18b91', 'no_device': None, 'attachment_id': '3c9fa563-abf7-47d1-a6e1-21a440974417'} {{(pid=74613) _do_swap_volume /opt/stack/nova/nova/compute/manager.py:7984}}
Nov 29 17:54:09 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-5489860b-08ae-4311-8a2b-dd8f35fab03e tempest-TestVolumeSwap-1038735411 tempest-TestVolumeSwap-1038735411-project-admin] Lock "0008521b-5a63-4ff6-8390-d343956900ed" "released" by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" :: held 16.543s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 17:54:09 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-221e9b1a-1b65-4670-ba37-8036c279e598 tempest-TestVolumeSwap-1038735411 tempest-TestVolumeSwap-1038735411-project-admin] Acquiring lock "0008521b-5a63-4ff6-8390-d343956900ed" by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 17:54:09 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-221e9b1a-1b65-4670-ba37-8036c279e598 tempest-TestVolumeSwap-1038735411 tempest-TestVolumeSwap-1038735411-project-admin] Lock "0008521b-5a63-4ff6-8390-d343956900ed" acquired by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" :: waited 0.001s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 17:54:09 user nova-compute[74613]: DEBUG os_brick.utils [None req-221e9b1a-1b65-4670-ba37-8036c279e598 tempest-TestVolumeSwap-1038735411 tempest-TestVolumeSwap-1038735411-project-admin] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74613) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 17:54:09 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 17:54:09 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.012s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 17:54:09 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b7787e4-0300-4516-9578-e4555baa1078]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:400972819b5\n', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 17:54:09 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 17:54:09 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 17:54:09 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[847c3146-2e54-4669-8b56-824e38bbe5d4]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 17:54:09 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 17:54:09 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 17:54:09 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3893f14-ffda-4c88-af65-b6edd9713ba9]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 17:54:09 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d95096b-8224-4f41-b43e-081af9b7b764]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 17:54:09 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-221e9b1a-1b65-4670-ba37-8036c279e598 tempest-TestVolumeSwap-1038735411 tempest-TestVolumeSwap-1038735411-project-admin] Running cmd (subprocess): nvme version {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 17:54:09 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-221e9b1a-1b65-4670-ba37-8036c279e598 tempest-TestVolumeSwap-1038735411 tempest-TestVolumeSwap-1038735411-project-admin] 'nvme version' failed. Not Retrying. {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 17:54:09 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.nvmeof [None req-221e9b1a-1b65-4670-ba37-8036c279e598 tempest-TestVolumeSwap-1038735411 tempest-TestVolumeSwap-1038735411-project-admin] nvme not present on system {{(pid=74613) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 29 17:54:09 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 17:54:09 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 17:54:09 user nova-compute[74613]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 29 17:54:09 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f1af2f0-f984-4f85-bc15-8babc870e9a3]: (4, '') {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 17:54:09 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.lightos [None req-221e9b1a-1b65-4670-ba37-8036c279e598 tempest-TestVolumeSwap-1038735411 tempest-TestVolumeSwap-1038735411-project-admin] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74613) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 29 17:54:09 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.lightos [None req-221e9b1a-1b65-4670-ba37-8036c279e598 tempest-TestVolumeSwap-1038735411 tempest-TestVolumeSwap-1038735411-project-admin] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74613) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 29 17:54:09 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.lightos [None req-221e9b1a-1b65-4670-ba37-8036c279e598 tempest-TestVolumeSwap-1038735411 tempest-TestVolumeSwap-1038735411-project-admin] LIGHTOS: no hostnqn found. {{(pid=74613) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 29 17:54:09 user nova-compute[74613]: DEBUG os_brick.utils [None req-221e9b1a-1b65-4670-ba37-8036c279e598 tempest-TestVolumeSwap-1038735411 tempest-TestVolumeSwap-1038735411-project-admin] <== get_connector_properties: return (116ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:400972819b5', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74613) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 17:54:09 user nova-compute[74613]: INFO nova.compute.manager [None req-221e9b1a-1b65-4670-ba37-8036c279e598 tempest-TestVolumeSwap-1038735411 tempest-TestVolumeSwap-1038735411-project-admin] [instance: 0008521b-5a63-4ff6-8390-d343956900ed] Swapping volume 49f19a7e-3b8b-44b4-b289-808ee2a18b91 for a6b34bdb-5c08-4f7c-b3f5-6b68413947a8
Nov 29 17:54:10 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:54:12 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:54:13 user nova-compute[74613]: DEBUG oslo_service.periodic_task [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74613) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 17:54:13 user nova-compute[74613]: DEBUG oslo_service.periodic_task [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74613) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 17:54:14 user nova-compute[74613]: DEBUG oslo_service.periodic_task [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74613) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 17:54:14 user nova-compute[74613]: DEBUG nova.compute.manager [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Starting heal instance info cache {{(pid=74613) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 29 17:54:14 user nova-compute[74613]: DEBUG nova.compute.manager [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] [instance: c19e230e-2e6c-4c20-b15c-ad81a73674b4] Skipping network cache update for instance because it has been migrated to another host. {{(pid=74613) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9966}}
Nov 29 17:54:14 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Acquiring lock "refresh_cache-abc9e2b8-f467-4cd0-b40f-de511fde1ec1" {{(pid=74613) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 17:54:14 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Acquired lock "refresh_cache-abc9e2b8-f467-4cd0-b40f-de511fde1ec1" {{(pid=74613) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 17:54:14 user nova-compute[74613]: DEBUG nova.network.neutron [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] [instance: abc9e2b8-f467-4cd0-b40f-de511fde1ec1] Forcefully refreshing network info cache for instance {{(pid=74613) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 29 17:54:15 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:54:15 user nova-compute[74613]: DEBUG nova.network.neutron [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] [instance: abc9e2b8-f467-4cd0-b40f-de511fde1ec1] Updating instance_info_cache with network_info: [{"id": "59a8bf1b-9fb1-4526-92d5-9ad1897c1ee8", "address": "fa:16:3e:e3:5f:12", "network": {"id": "7c2c368e-4c7d-4d70-9a40-c10fe9541af9", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1287934102-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.103", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b1f70c311d4941c986de21ac458d11ab", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap59a8bf1b-9f", "ovs_interfaceid": "59a8bf1b-9fb1-4526-92d5-9ad1897c1ee8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74613) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 17:54:15 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Releasing lock "refresh_cache-abc9e2b8-f467-4cd0-b40f-de511fde1ec1" {{(pid=74613) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 17:54:15 user nova-compute[74613]: DEBUG nova.compute.manager [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] [instance: abc9e2b8-f467-4cd0-b40f-de511fde1ec1] Updated the network info_cache for instance {{(pid=74613) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 29 17:54:15 user nova-compute[74613]: DEBUG oslo_service.periodic_task [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74613) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 17:54:15 user nova-compute[74613]: DEBUG nova.compute.manager [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74613) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 29 17:54:15 user nova-compute[74613]: DEBUG oslo_service.periodic_task [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74613) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 17:54:15 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 17:54:15 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 17:54:15 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.002s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 17:54:15 user nova-compute[74613]: DEBUG nova.compute.resource_tracker [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Auditing locally available compute resources for user (node: user) {{(pid=74613) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 29 17:54:15 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0008521b-5a63-4ff6-8390-d343956900ed/disk --force-share --output=json {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 17:54:15 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0008521b-5a63-4ff6-8390-d343956900ed/disk --force-share --output=json" returned: 0 in 0.212s {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 17:54:15 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0008521b-5a63-4ff6-8390-d343956900ed/disk --force-share --output=json {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 17:54:15 user nova-compute[74613]: DEBUG nova.compute.manager [req-1cc582af-fa5c-4475-bc3d-4c877c9f7ccd req-874362b6-353d-4995-9599-46e28e52952d service nova] [instance: 3f285832-64a7-48e8-875a-f9e1566a66b6] Received event network-changed-75aec901-492c-47e1-9621-158f2d11a5e7 {{(pid=74613) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 17:54:15 user nova-compute[74613]: DEBUG nova.compute.manager [req-1cc582af-fa5c-4475-bc3d-4c877c9f7ccd req-874362b6-353d-4995-9599-46e28e52952d service nova] [instance: 3f285832-64a7-48e8-875a-f9e1566a66b6] Refreshing instance network info cache due to event network-changed-75aec901-492c-47e1-9621-158f2d11a5e7. {{(pid=74613) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 17:54:15 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-1cc582af-fa5c-4475-bc3d-4c877c9f7ccd req-874362b6-353d-4995-9599-46e28e52952d service nova] Acquiring lock "refresh_cache-3f285832-64a7-48e8-875a-f9e1566a66b6" {{(pid=74613) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 17:54:15 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-1cc582af-fa5c-4475-bc3d-4c877c9f7ccd req-874362b6-353d-4995-9599-46e28e52952d service nova] Acquired lock "refresh_cache-3f285832-64a7-48e8-875a-f9e1566a66b6" {{(pid=74613) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 17:54:15 user nova-compute[74613]: DEBUG nova.network.neutron [req-1cc582af-fa5c-4475-bc3d-4c877c9f7ccd req-874362b6-353d-4995-9599-46e28e52952d service nova] [instance: 3f285832-64a7-48e8-875a-f9e1566a66b6] Refreshing network info cache for port 75aec901-492c-47e1-9621-158f2d11a5e7 {{(pid=74613) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 17:54:15 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0008521b-5a63-4ff6-8390-d343956900ed/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 17:54:15 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] skipping disk /dev/sdi (vdb) as it is a volume {{(pid=74613) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 29 17:54:15 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b6b0ba36-ad89-45f1-9578-8b999567dd25/disk --force-share --output=json {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 17:54:15 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b6b0ba36-ad89-45f1-9578-8b999567dd25/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 17:54:15 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b6b0ba36-ad89-45f1-9578-8b999567dd25/disk --force-share --output=json {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 17:54:16 user nova-compute[74613]: DEBUG nova.network.neutron [req-1cc582af-fa5c-4475-bc3d-4c877c9f7ccd req-874362b6-353d-4995-9599-46e28e52952d service nova] [instance: 3f285832-64a7-48e8-875a-f9e1566a66b6] Updated VIF entry in instance network info cache for port 75aec901-492c-47e1-9621-158f2d11a5e7. {{(pid=74613) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 17:54:16 user nova-compute[74613]: DEBUG nova.network.neutron [req-1cc582af-fa5c-4475-bc3d-4c877c9f7ccd req-874362b6-353d-4995-9599-46e28e52952d service nova] [instance: 3f285832-64a7-48e8-875a-f9e1566a66b6] Updating instance_info_cache with network_info: [{"id": "75aec901-492c-47e1-9621-158f2d11a5e7", "address": "fa:16:3e:78:3a:a6", "network": {"id": "ca76dd55-469c-4d51-a76e-8b160bef1707", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-570657334-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.106", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f655bcde631c4a839b98695eed5cfa4e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap75aec901-49", "ovs_interfaceid": "75aec901-492c-47e1-9621-158f2d11a5e7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "d2631ae0-4218-400c-8da8-cb6d3271579d", "address": "fa:16:3e:3a:4c:7e", "network": {"id": "1e109d3b-bb91-4ff7-b16f-d39181436f57", "bridge": "br-int", "label": "tempest-device-tagging-net1-1011700470", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.120", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "f655bcde631c4a839b98695eed5cfa4e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd2631ae0-42", "ovs_interfaceid": "d2631ae0-4218-400c-8da8-cb6d3271579d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "83dc312c-87e6-47a8-b4a5-f7c3cec7ab50", "address": "fa:16:3e:fb:9b:31", "network": {"id": "1e109d3b-bb91-4ff7-b16f-d39181436f57", "bridge": "br-int", "label": "tempest-device-tagging-net1-1011700470", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.134", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "f655bcde631c4a839b98695eed5cfa4e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap83dc312c-87", "ovs_interfaceid": "83dc312c-87e6-47a8-b4a5-f7c3cec7ab50", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "5ea35efd-1b2e-48eb-b8fb-fb15dab703dc", "address": "fa:16:3e:f1:48:4c", "network": {"id": "1e109d3b-bb91-4ff7-b16f-d39181436f57", "bridge": "br-int", "label": "tempest-device-tagging-net1-1011700470", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.157", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "f655bcde631c4a839b98695eed5cfa4e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5ea35efd-1b", "ovs_interfaceid": "5ea35efd-1b2e-48eb-b8fb-fb15dab703dc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "3fe23755-ec08-4b17-87b2-c1eebd36042b", "address": "fa:16:3e:39:7c:dd", "network": {"id": "1e109d3b-bb91-4ff7-b16f-d39181436f57", "bridge": "br-int", "label": "tempest-device-tagging-net1-1011700470", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.66", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "f655bcde631c4a839b98695eed5cfa4e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3fe23755-ec", "ovs_interfaceid": "3fe23755-ec08-4b17-87b2-c1eebd36042b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "bffa705a-58aa-4cbd-9b9d-09c8229cf829", "address": "fa:16:3e:f7:c0:bd", "network": {"id": "6debc132-a947-4fdc-8d04-f10452f6ee9c", "bridge": "br-int", "label": "tempest-device-tagging-net2-597757606", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "f655bcde631c4a839b98695eed5cfa4e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbffa705a-58", "ovs_interfaceid": "bffa705a-58aa-4cbd-9b9d-09c8229cf829", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "48d45408-4c70-44b7-a0c3-874ad1049d1a", "address": "fa:16:3e:a2:2a:db", "network": {"id": "6debc132-a947-4fdc-8d04-f10452f6ee9c", "bridge": "br-int", "label": "tempest-device-tagging-net2-597757606", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "f655bcde631c4a839b98695eed5cfa4e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap48d45408-4c", "ovs_interfaceid": "48d45408-4c70-44b7-a0c3-874ad1049d1a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74613) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 17:54:16 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b6b0ba36-ad89-45f1-9578-8b999567dd25/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 17:54:16 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d4ecef60-62f9-4969-b57f-3bb45a44cc9f/disk --force-share --output=json {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 17:54:16 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-1cc582af-fa5c-4475-bc3d-4c877c9f7ccd req-874362b6-353d-4995-9599-46e28e52952d service nova] Releasing lock "refresh_cache-3f285832-64a7-48e8-875a-f9e1566a66b6" {{(pid=74613) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 17:54:16 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d4ecef60-62f9-4969-b57f-3bb45a44cc9f/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 17:54:16 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d4ecef60-62f9-4969-b57f-3bb45a44cc9f/disk --force-share --output=json {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 17:54:16 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d4ecef60-62f9-4969-b57f-3bb45a44cc9f/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 17:54:16 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3b828860-5cc5-40b0-b845-8e560211794e/disk --force-share --output=json {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 17:54:16 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3b828860-5cc5-40b0-b845-8e560211794e/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 17:54:16 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3b828860-5cc5-40b0-b845-8e560211794e/disk --force-share --output=json {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 17:54:16 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3b828860-5cc5-40b0-b845-8e560211794e/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 17:54:16 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/abc9e2b8-f467-4cd0-b40f-de511fde1ec1/disk --force-share --output=json {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 17:54:17 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/abc9e2b8-f467-4cd0-b40f-de511fde1ec1/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 17:54:17 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/abc9e2b8-f467-4cd0-b40f-de511fde1ec1/disk --force-share --output=json {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 17:54:17 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/abc9e2b8-f467-4cd0-b40f-de511fde1ec1/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 17:54:17 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/288b8261-8706-4696-879d-d4dd01ab553e/disk --force-share --output=json {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 17:54:17 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:54:17 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/288b8261-8706-4696-879d-d4dd01ab553e/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 17:54:17 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/288b8261-8706-4696-879d-d4dd01ab553e/disk --force-share --output=json {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 17:54:17 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/288b8261-8706-4696-879d-d4dd01ab553e/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 17:54:17 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=74613) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 29 17:54:17 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=74613) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 29 17:54:17 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] skipping disk /dev/sde (vdc) as it is a volume {{(pid=74613) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 29 17:54:18 user nova-compute[74613]: DEBUG nova.compute.manager [req-b2e6bae2-6e73-43a2-bae3-85645df54ba9 req-6e530512-16cd-44c2-ae6d-64a69a59d8b5 service nova] [instance: 8de2ffb3-e264-49f7-8581-6eae21adcaeb] Received event volume-reimaged-fbbdc3d2-136d-4fba-b6ba-f27f35a0733b {{(pid=74613) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 17:54:18 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-b2e6bae2-6e73-43a2-bae3-85645df54ba9 req-6e530512-16cd-44c2-ae6d-64a69a59d8b5 service nova] Acquiring lock "8de2ffb3-e264-49f7-8581-6eae21adcaeb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 17:54:18 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-b2e6bae2-6e73-43a2-bae3-85645df54ba9 req-6e530512-16cd-44c2-ae6d-64a69a59d8b5 service nova] Lock "8de2ffb3-e264-49f7-8581-6eae21adcaeb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 17:54:18 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-b2e6bae2-6e73-43a2-bae3-85645df54ba9 req-6e530512-16cd-44c2-ae6d-64a69a59d8b5 service nova] Lock "8de2ffb3-e264-49f7-8581-6eae21adcaeb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 17:54:18 user nova-compute[74613]: DEBUG nova.compute.manager [req-b2e6bae2-6e73-43a2-bae3-85645df54ba9 req-6e530512-16cd-44c2-ae6d-64a69a59d8b5 service nova] [instance: 8de2ffb3-e264-49f7-8581-6eae21adcaeb] Processing event volume-reimaged-fbbdc3d2-136d-4fba-b6ba-f27f35a0733b {{(pid=74613) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10872}}
Nov 29 17:54:18 user nova-compute[74613]: DEBUG nova.compute.manager [None req-b2e6bae2-6e73-43a2-bae3-85645df54ba9 tempest-ServerActionsV293TestJSON-169231013 tempest-ServerActionsV293TestJSON-169231013-project-member] [instance: 8de2ffb3-e264-49f7-8581-6eae21adcaeb] Instance event wait completed in 18 seconds for volume-reimaged {{(pid=74613) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 29 17:54:18 user nova-compute[74613]: WARNING nova.virt.libvirt.driver [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 17:54:18 user nova-compute[74613]: WARNING nova.virt.libvirt.driver [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 17:54:18 user nova-compute[74613]: DEBUG nova.compute.resource_tracker [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Hypervisor/Node resource view: name=user free_ram=7729MB free_disk=25.214397430419922GB free_vcpus=5 pci_devices=[{"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74613) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 29 17:54:18 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 17:54:18 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 17:54:18 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-23a466ec-4c34-4fbf-8a45-ad85d880905e tempest-TaggedBootDevicesTest_v242-869407180 tempest-TaggedBootDevicesTest_v242-869407180-project-member] Acquiring lock "3f285832-64a7-48e8-875a-f9e1566a66b6" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 17:54:18 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-23a466ec-4c34-4fbf-8a45-ad85d880905e tempest-TaggedBootDevicesTest_v242-869407180 tempest-TaggedBootDevicesTest_v242-869407180-project-member] Lock "3f285832-64a7-48e8-875a-f9e1566a66b6" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 17:54:18 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-23a466ec-4c34-4fbf-8a45-ad85d880905e tempest-TaggedBootDevicesTest_v242-869407180 tempest-TaggedBootDevicesTest_v242-869407180-project-member] Acquiring lock "3f285832-64a7-48e8-875a-f9e1566a66b6-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 17:54:18 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-23a466ec-4c34-4fbf-8a45-ad85d880905e tempest-TaggedBootDevicesTest_v242-869407180 tempest-TaggedBootDevicesTest_v242-869407180-project-member] Lock "3f285832-64a7-48e8-875a-f9e1566a66b6-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 17:54:18 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-23a466ec-4c34-4fbf-8a45-ad85d880905e tempest-TaggedBootDevicesTest_v242-869407180 tempest-TaggedBootDevicesTest_v242-869407180-project-member] Lock "3f285832-64a7-48e8-875a-f9e1566a66b6-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 17:54:18 user nova-compute[74613]: INFO nova.compute.manager [None req-23a466ec-4c34-4fbf-8a45-ad85d880905e tempest-TaggedBootDevicesTest_v242-869407180 tempest-TaggedBootDevicesTest_v242-869407180-project-member] [instance: 3f285832-64a7-48e8-875a-f9e1566a66b6] Terminating instance
Nov 29 17:54:18 user nova-compute[74613]: DEBUG nova.compute.manager [None req-23a466ec-4c34-4fbf-8a45-ad85d880905e tempest-TaggedBootDevicesTest_v242-869407180 tempest-TaggedBootDevicesTest_v242-869407180-project-member] [instance: 3f285832-64a7-48e8-875a-f9e1566a66b6] Start destroying the instance on the hypervisor. {{(pid=74613) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 29 17:54:18 user nova-compute[74613]: INFO nova.virt.block_device [None req-b2e6bae2-6e73-43a2-bae3-85645df54ba9 tempest-ServerActionsV293TestJSON-169231013 tempest-ServerActionsV293TestJSON-169231013-project-member] [instance: 8de2ffb3-e264-49f7-8581-6eae21adcaeb] Booting with volume fbbdc3d2-136d-4fba-b6ba-f27f35a0733b at /dev/vda
Nov 29 17:54:18 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:54:18 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:54:18 user nova-compute[74613]: DEBUG nova.compute.resource_tracker [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Instance b6b0ba36-ad89-45f1-9578-8b999567dd25 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74613) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 17:54:18 user nova-compute[74613]: DEBUG nova.compute.resource_tracker [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Instance 3b828860-5cc5-40b0-b845-8e560211794e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74613) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 17:54:18 user nova-compute[74613]: DEBUG nova.compute.resource_tracker [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Instance abc9e2b8-f467-4cd0-b40f-de511fde1ec1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74613) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 17:54:18 user nova-compute[74613]: DEBUG nova.compute.resource_tracker [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Instance 0008521b-5a63-4ff6-8390-d343956900ed actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74613) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 17:54:18 user nova-compute[74613]: DEBUG nova.compute.resource_tracker [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Instance 288b8261-8706-4696-879d-d4dd01ab553e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74613) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 17:54:18 user nova-compute[74613]: DEBUG nova.compute.resource_tracker [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Instance d4ecef60-62f9-4969-b57f-3bb45a44cc9f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74613) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 17:54:18 user nova-compute[74613]: DEBUG nova.compute.resource_tracker [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Instance 8de2ffb3-e264-49f7-8581-6eae21adcaeb actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74613) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 17:54:18 user nova-compute[74613]: DEBUG nova.compute.resource_tracker [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Instance 3f285832-64a7-48e8-875a-f9e1566a66b6 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74613) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 17:54:18 user nova-compute[74613]: DEBUG nova.compute.resource_tracker [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Total usable vcpus: 12, total allocated vcpus: 8 {{(pid=74613) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 29 17:54:18 user nova-compute[74613]: DEBUG nova.compute.resource_tracker [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Final resource view: name=user phys_ram=16011MB used_ram=4608MB phys_disk=40GB used_disk=6GB total_vcpus=12 used_vcpus=8 pci_stats=[] {{(pid=74613) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 29 17:54:18 user nova-compute[74613]: DEBUG os_brick.utils [None req-b2e6bae2-6e73-43a2-bae3-85645df54ba9 tempest-ServerActionsV293TestJSON-169231013 tempest-ServerActionsV293TestJSON-169231013-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74613) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 17:54:18 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:54:18 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 17:54:18 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 17:54:18 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd8e384a-9350-4d32-bd01-a2487dc4c653]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:400972819b5\n', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 17:54:18 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:54:18 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 17:54:18 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:54:18 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.022s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 17:54:18 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe0bb573-4cfb-4e85-b341-b5c7b6ae4def]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 17:54:18 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 17:54:18 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:54:18 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 17:54:18 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d5c2bcb-663c-49a8-a6ca-96f5ff22aaa4]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 17:54:18 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f8393cc-94c6-4ed6-9f6c-a2d3a3aa3813]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 17:54:18 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-b2e6bae2-6e73-43a2-bae3-85645df54ba9 tempest-ServerActionsV293TestJSON-169231013 tempest-ServerActionsV293TestJSON-169231013-project-member] Running cmd (subprocess): nvme version {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 17:54:18 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-b2e6bae2-6e73-43a2-bae3-85645df54ba9 tempest-ServerActionsV293TestJSON-169231013 tempest-ServerActionsV293TestJSON-169231013-project-member] 'nvme version' failed. Not Retrying. {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 17:54:18 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.nvmeof [None req-b2e6bae2-6e73-43a2-bae3-85645df54ba9 tempest-ServerActionsV293TestJSON-169231013 tempest-ServerActionsV293TestJSON-169231013-project-member] nvme not present on system {{(pid=74613) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 29 17:54:18 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:54:18 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 17:54:18 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 17:54:18 user nova-compute[74613]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 29 17:54:18 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[0525c6d6-157a-494f-b3a2-6319702286e5]: (4, '') {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 17:54:18 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.lightos [None req-b2e6bae2-6e73-43a2-bae3-85645df54ba9 tempest-ServerActionsV293TestJSON-169231013 tempest-ServerActionsV293TestJSON-169231013-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74613) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 29 17:54:18 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.lightos [None req-b2e6bae2-6e73-43a2-bae3-85645df54ba9 tempest-ServerActionsV293TestJSON-169231013 tempest-ServerActionsV293TestJSON-169231013-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74613) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 29 17:54:18 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.lightos [None req-b2e6bae2-6e73-43a2-bae3-85645df54ba9 tempest-ServerActionsV293TestJSON-169231013 tempest-ServerActionsV293TestJSON-169231013-project-member] LIGHTOS: no hostnqn found. {{(pid=74613) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 29 17:54:18 user nova-compute[74613]: DEBUG os_brick.utils [None req-b2e6bae2-6e73-43a2-bae3-85645df54ba9 tempest-ServerActionsV293TestJSON-169231013 tempest-ServerActionsV293TestJSON-169231013-project-member] <== get_connector_properties: return (136ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:400972819b5', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74613) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 17:54:18 user nova-compute[74613]: DEBUG nova.virt.block_device [None req-b2e6bae2-6e73-43a2-bae3-85645df54ba9 tempest-ServerActionsV293TestJSON-169231013 tempest-ServerActionsV293TestJSON-169231013-project-member] [instance: 8de2ffb3-e264-49f7-8581-6eae21adcaeb] Updating existing volume attachment record: 4a93af09-2949-427d-be30-0c6ff6b00f86 {{(pid=74613) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 29 17:54:18 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:54:18 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:54:18 user nova-compute[74613]: DEBUG nova.compute.manager [req-a8fa629c-39a6-4af2-bc3d-0020ddea47ae req-cc12533e-b7ee-42cc-9e63-885341675393 service nova] [instance: 3f285832-64a7-48e8-875a-f9e1566a66b6] Received event network-vif-unplugged-75aec901-492c-47e1-9621-158f2d11a5e7 {{(pid=74613) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 17:54:18 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-a8fa629c-39a6-4af2-bc3d-0020ddea47ae req-cc12533e-b7ee-42cc-9e63-885341675393 service nova] Acquiring lock "3f285832-64a7-48e8-875a-f9e1566a66b6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 17:54:18 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-a8fa629c-39a6-4af2-bc3d-0020ddea47ae req-cc12533e-b7ee-42cc-9e63-885341675393 service nova] Lock "3f285832-64a7-48e8-875a-f9e1566a66b6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 17:54:18 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-a8fa629c-39a6-4af2-bc3d-0020ddea47ae req-cc12533e-b7ee-42cc-9e63-885341675393 service nova] Lock "3f285832-64a7-48e8-875a-f9e1566a66b6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 17:54:18 user nova-compute[74613]: DEBUG nova.compute.manager [req-a8fa629c-39a6-4af2-bc3d-0020ddea47ae req-cc12533e-b7ee-42cc-9e63-885341675393 service nova] [instance: 3f285832-64a7-48e8-875a-f9e1566a66b6] No waiting events found dispatching network-vif-unplugged-75aec901-492c-47e1-9621-158f2d11a5e7 {{(pid=74613) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 17:54:18 user nova-compute[74613]: DEBUG nova.compute.manager [req-a8fa629c-39a6-4af2-bc3d-0020ddea47ae req-cc12533e-b7ee-42cc-9e63-885341675393 service nova] [instance: 3f285832-64a7-48e8-875a-f9e1566a66b6] Received event network-vif-unplugged-75aec901-492c-47e1-9621-158f2d11a5e7 for instance with task_state deleting. {{(pid=74613) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 29 17:54:18 user nova-compute[74613]: DEBUG nova.compute.provider_tree [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Inventory has not changed in ProviderTree for provider: 639d980e-3b12-44b1-b8f4-1812416fa4dd {{(pid=74613) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 17:54:18 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:54:18 user nova-compute[74613]: DEBUG nova.scheduler.client.report [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Inventory has not changed for provider 639d980e-3b12-44b1-b8f4-1812416fa4dd based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74613) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 17:54:18 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:54:18 user nova-compute[74613]: DEBUG nova.compute.manager [req-1c78ef01-f327-4c80-b09a-7c2970eff565 req-df2f9899-4d3d-48b3-8f37-916aac6cc5d3 service nova] [instance: 3f285832-64a7-48e8-875a-f9e1566a66b6] Received event network-vif-unplugged-83dc312c-87e6-47a8-b4a5-f7c3cec7ab50 {{(pid=74613) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 17:54:18 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-1c78ef01-f327-4c80-b09a-7c2970eff565 req-df2f9899-4d3d-48b3-8f37-916aac6cc5d3 service nova] Acquiring lock "3f285832-64a7-48e8-875a-f9e1566a66b6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 17:54:18 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-1c78ef01-f327-4c80-b09a-7c2970eff565 req-df2f9899-4d3d-48b3-8f37-916aac6cc5d3 service nova] Lock "3f285832-64a7-48e8-875a-f9e1566a66b6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 17:54:18 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-1c78ef01-f327-4c80-b09a-7c2970eff565 req-df2f9899-4d3d-48b3-8f37-916aac6cc5d3 service nova] Lock "3f285832-64a7-48e8-875a-f9e1566a66b6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 17:54:18 user nova-compute[74613]: DEBUG nova.compute.manager [req-1c78ef01-f327-4c80-b09a-7c2970eff565 req-df2f9899-4d3d-48b3-8f37-916aac6cc5d3 service nova] [instance: 3f285832-64a7-48e8-875a-f9e1566a66b6] No waiting events found dispatching network-vif-unplugged-83dc312c-87e6-47a8-b4a5-f7c3cec7ab50 {{(pid=74613) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 17:54:18 user nova-compute[74613]: DEBUG nova.compute.manager [req-1c78ef01-f327-4c80-b09a-7c2970eff565 req-df2f9899-4d3d-48b3-8f37-916aac6cc5d3 service nova] [instance: 3f285832-64a7-48e8-875a-f9e1566a66b6] Received event network-vif-unplugged-83dc312c-87e6-47a8-b4a5-f7c3cec7ab50 for instance with task_state deleting. {{(pid=74613) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 29 17:54:18 user nova-compute[74613]: DEBUG nova.compute.resource_tracker [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Compute_service record updated for user:user {{(pid=74613) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 29 17:54:18 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.522s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 17:54:18 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:54:18 user nova-compute[74613]: DEBUG nova.compute.manager [req-32695e2a-b7c0-4852-80e6-c069b84eae76 req-3d0aa2e5-6bb9-4d36-852a-ed9a207c081c service nova] [instance: 3f285832-64a7-48e8-875a-f9e1566a66b6] Received event network-vif-unplugged-d2631ae0-4218-400c-8da8-cb6d3271579d {{(pid=74613) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 17:54:18 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-32695e2a-b7c0-4852-80e6-c069b84eae76 req-3d0aa2e5-6bb9-4d36-852a-ed9a207c081c service nova] Acquiring lock "3f285832-64a7-48e8-875a-f9e1566a66b6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 17:54:18 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-32695e2a-b7c0-4852-80e6-c069b84eae76 req-3d0aa2e5-6bb9-4d36-852a-ed9a207c081c service nova] Lock "3f285832-64a7-48e8-875a-f9e1566a66b6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 17:54:18 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-32695e2a-b7c0-4852-80e6-c069b84eae76 req-3d0aa2e5-6bb9-4d36-852a-ed9a207c081c service nova] Lock "3f285832-64a7-48e8-875a-f9e1566a66b6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 17:54:18 user nova-compute[74613]: DEBUG nova.compute.manager [req-32695e2a-b7c0-4852-80e6-c069b84eae76 req-3d0aa2e5-6bb9-4d36-852a-ed9a207c081c service nova] [instance: 3f285832-64a7-48e8-875a-f9e1566a66b6] No waiting events found dispatching network-vif-unplugged-d2631ae0-4218-400c-8da8-cb6d3271579d {{(pid=74613) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 17:54:18 user nova-compute[74613]: DEBUG nova.compute.manager [req-32695e2a-b7c0-4852-80e6-c069b84eae76 req-3d0aa2e5-6bb9-4d36-852a-ed9a207c081c service nova] [instance: 3f285832-64a7-48e8-875a-f9e1566a66b6] Received event network-vif-unplugged-d2631ae0-4218-400c-8da8-cb6d3271579d for instance with task_state deleting. {{(pid=74613) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 29 17:54:18 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:54:18 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:54:18 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:54:18 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:54:18 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:54:18 user nova-compute[74613]: DEBUG nova.compute.manager [None req-221e9b1a-1b65-4670-ba37-8036c279e598 tempest-TestVolumeSwap-1038735411 tempest-TestVolumeSwap-1038735411-project-admin] [instance: 0008521b-5a63-4ff6-8390-d343956900ed] swap_volume: Calling driver volume swap with connection infos: new: {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:a6b34bdb-5c08-4f7c-b3f5-6b68413947a8', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'SAqnwafp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '0008521b-5a63-4ff6-8390-d343956900ed', 'attached_at': '', 'detached_at': '', 'volume_id': 'a6b34bdb-5c08-4f7c-b3f5-6b68413947a8', 'serial': 'a6b34bdb-5c08-4f7c-b3f5-6b68413947a8'}; old: {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:49f19a7e-3b8b-44b4-b289-808ee2a18b91', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'EhqaYVOC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdi', 'volume_id': '49f19a7e-3b8b-44b4-b289-808ee2a18b91'}, 'status': 'reserved', 'instance': '0008521b-5a63-4ff6-8390-d343956900ed', 'attached_at': '', 'detached_at': '', 'volume_id': '49f19a7e-3b8b-44b4-b289-808ee2a18b91', 'serial'} {{(pid=74613) _swap_volume /opt/stack/nova/nova/compute/manager.py:7782}}
Nov 29 17:54:18 user nova-compute[74613]: DEBUG nova.virt.libvirt.volume.iscsi [None req-221e9b1a-1b65-4670-ba37-8036c279e598 tempest-TestVolumeSwap-1038735411 tempest-TestVolumeSwap-1038735411-project-admin] [instance: 0008521b-5a63-4ff6-8390-d343956900ed] Calling os-brick to attach iSCSI Volume {{(pid=74613) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 29 17:54:18 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-221e9b1a-1b65-4670-ba37-8036c279e598 tempest-TestVolumeSwap-1038735411 tempest-TestVolumeSwap-1038735411-project-admin] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff828156890>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:a6b34bdb-5c08-4f7c-b3f5-6b68413947a8', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'SAqnwafp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74613) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 17:54:18 user nova-compute[74613]: WARNING os_brick.initiator.connectors.base [None req-221e9b1a-1b65-4670-ba37-8036c279e598 tempest-TestVolumeSwap-1038735411 tempest-TestVolumeSwap-1038735411-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 17:54:18 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.base [None req-221e9b1a-1b65-4670-ba37-8036c279e598 tempest-TestVolumeSwap-1038735411 tempest-TestVolumeSwap-1038735411-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 17:54:18 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.base [None req-221e9b1a-1b65-4670-ba37-8036c279e598 tempest-TestVolumeSwap-1038735411 tempest-TestVolumeSwap-1038735411-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 17:54:18 user nova-compute[74613]: WARNING os_brick.initiator.connectors.base [None req-221e9b1a-1b65-4670-ba37-8036c279e598 tempest-TestVolumeSwap-1038735411 tempest-TestVolumeSwap-1038735411-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 17:54:18 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.base [None req-221e9b1a-1b65-4670-ba37-8036c279e598 tempest-TestVolumeSwap-1038735411 tempest-TestVolumeSwap-1038735411-project-admin] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a6b34bdb-5c08-4f7c-b3f5-6b68413947a8" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 17:54:18 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.base [None req-221e9b1a-1b65-4670-ba37-8036c279e598 tempest-TestVolumeSwap-1038735411 tempest-TestVolumeSwap-1038735411-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a6b34bdb-5c08-4f7c-b3f5-6b68413947a8" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 17:54:18 user nova-compute[74613]: INFO os_brick.initiator.connectors.iscsi [None req-221e9b1a-1b65-4670-ba37-8036c279e598 tempest-TestVolumeSwap-1038735411 tempest-TestVolumeSwap-1038735411-project-admin] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 29 17:54:18 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a6b34bdb-5c08-4f7c-b3f5-6b68413947a8 -p 172.16.0.220:3260 {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 17:54:18 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:54:18 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a6b34bdb-5c08-4f7c-b3f5-6b68413947a8 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 17:54:18 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9b3d198-2071-42a2-8564-efa074ea52e6]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 17:54:18 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-221e9b1a-1b65-4670-ba37-8036c279e598 tempest-TestVolumeSwap-1038735411 tempest-TestVolumeSwap-1038735411-project-admin] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 29 17:54:18 user nova-compute[74613]:  {{(pid=74613) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 17:54:18 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a6b34bdb-5c08-4f7c-b3f5-6b68413947a8 -p 172.16.0.220:3260 --interface default --op new {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 17:54:18 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a6b34bdb-5c08-4f7c-b3f5-6b68413947a8 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.017s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 17:54:18 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[dee6642c-eaf9-4fb0-8a7a-3fb0a7e78a21]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a6b34bdb-5c08-4f7c-b3f5-6b68413947a8] added\n', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 17:54:18 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-221e9b1a-1b65-4670-ba37-8036c279e598 tempest-TestVolumeSwap-1038735411 tempest-TestVolumeSwap-1038735411-project-admin] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a6b34bdb-5c08-4f7c-b3f5-6b68413947a8] added
Nov 29 17:54:18 user nova-compute[74613]:  stderr= {{(pid=74613) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 17:54:18 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a6b34bdb-5c08-4f7c-b3f5-6b68413947a8 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 17:54:18 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a6b34bdb-5c08-4f7c-b3f5-6b68413947a8 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 17:54:18 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[fbb7e51c-4555-42e3-ba23-7830d0bbee0c]: (4, ('', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 17:54:18 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-221e9b1a-1b65-4670-ba37-8036c279e598 tempest-TestVolumeSwap-1038735411 tempest-TestVolumeSwap-1038735411-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74613) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 17:54:18 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a6b34bdb-5c08-4f7c-b3f5-6b68413947a8 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 17:54:18 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:54:18 user nova-compute[74613]: DEBUG oslo_service.periodic_task [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74613) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 17:54:18 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a6b34bdb-5c08-4f7c-b3f5-6b68413947a8 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.027s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 17:54:18 user nova-compute[74613]: DEBUG oslo_service.periodic_task [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74613) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 17:54:18 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[38b0d7b4-035c-42ce-a2c6-c3181b9b5138]: (4, ('', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 17:54:18 user nova-compute[74613]: DEBUG oslo_service.periodic_task [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74613) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 17:54:18 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-221e9b1a-1b65-4670-ba37-8036c279e598 tempest-TestVolumeSwap-1038735411 tempest-TestVolumeSwap-1038735411-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74613) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 17:54:18 user nova-compute[74613]: DEBUG oslo_service.periodic_task [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74613) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 17:54:18 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a6b34bdb-5c08-4f7c-b3f5-6b68413947a8 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v SAqnwafp {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 17:54:18 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:54:18 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a6b34bdb-5c08-4f7c-b3f5-6b68413947a8 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v SAqnwafp" returned: 0 in 0.024s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 17:54:18 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b6dab49-c88f-46b3-9077-987ac5f53802]: (4, ('', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 17:54:18 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-221e9b1a-1b65-4670-ba37-8036c279e598 tempest-TestVolumeSwap-1038735411 tempest-TestVolumeSwap-1038735411-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'SAqnwafp'): stdout= stderr= {{(pid=74613) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 17:54:18 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a6b34bdb-5c08-4f7c-b3f5-6b68413947a8 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 17:54:19 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a6b34bdb-5c08-4f7c-b3f5-6b68413947a8 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 17:54:19 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f785b03-482f-4873-88d5-d4cbb2338e35]: (4, ('', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 17:54:19 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-221e9b1a-1b65-4670-ba37-8036c279e598 tempest-TestVolumeSwap-1038735411 tempest-TestVolumeSwap-1038735411-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74613) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 17:54:19 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 17:54:19 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 17:54:19 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[176ad866-7d84-49cf-b5cf-344ff0b004b4]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7efc2d5-5149-408b-980d-58492994fd4f (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49f19a7e-3b8b-44b4-b289-808ee2a18b91 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:24920064-fc81-4408-97d1-d8eff97a7554 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8230f3a2-63d8-46cb-8ec7-ceb89fb04e53 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d1f798a1-4f7b-4b9a-8180-fa8f4eb89bf0 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:17b27fab-6cdb-4820-be62-ffd44e8e2fb5 (non-flash)\n', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 17:54:19 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-221e9b1a-1b65-4670-ba37-8036c279e598 tempest-TestVolumeSwap-1038735411 tempest-TestVolumeSwap-1038735411-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7efc2d5-5149-408b-980d-58492994fd4f (non-flash)
Nov 29 17:54:19 user nova-compute[74613]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49f19a7e-3b8b-44b4-b289-808ee2a18b91 (non-flash)
Nov 29 17:54:19 user nova-compute[74613]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:24920064-fc81-4408-97d1-d8eff97a7554 (non-flash)
Nov 29 17:54:19 user nova-compute[74613]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8230f3a2-63d8-46cb-8ec7-ceb89fb04e53 (non-flash)
Nov 29 17:54:19 user nova-compute[74613]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d1f798a1-4f7b-4b9a-8180-fa8f4eb89bf0 (non-flash)
Nov 29 17:54:19 user nova-compute[74613]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:17b27fab-6cdb-4820-be62-ffd44e8e2fb5 (non-flash)
Nov 29 17:54:19 user nova-compute[74613]:  stderr= {{(pid=74613) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 17:54:19 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-221e9b1a-1b65-4670-ba37-8036c279e598 tempest-TestVolumeSwap-1038735411 tempest-TestVolumeSwap-1038735411-project-admin] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7efc2d5-5149-408b-980d-58492994fd4f (non-flash)
Nov 29 17:54:19 user nova-compute[74613]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49f19a7e-3b8b-44b4-b289-808ee2a18b91 (non-flash)
Nov 29 17:54:19 user nova-compute[74613]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:24920064-fc81-4408-97d1-d8eff97a7554 (non-flash)
Nov 29 17:54:19 user nova-compute[74613]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8230f3a2-63d8-46cb-8ec7-ceb89fb04e53 (non-flash)
Nov 29 17:54:19 user nova-compute[74613]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d1f798a1-4f7b-4b9a-8180-fa8f4eb89bf0 (non-flash)
Nov 29 17:54:19 user nova-compute[74613]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:17b27fab-6cdb-4820-be62-ffd44e8e2fb5 (non-flash)
Nov 29 17:54:19 user nova-compute[74613]:  stderr= {{(pid=74613) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 17:54:19 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a6b34bdb-5c08-4f7c-b3f5-6b68413947a8 -p 172.16.0.220:3260 --login {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 17:54:19 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a6b34bdb-5c08-4f7c-b3f5-6b68413947a8 -p 172.16.0.220:3260 --login" returned: 0 in 0.104s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 17:54:19 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[a25e6cef-4fe9-44f3-b597-d872ac10dec9]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:a6b34bdb-5c08-4f7c-b3f5-6b68413947a8, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:a6b34bdb-5c08-4f7c-b3f5-6b68413947a8, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 17:54:19 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-221e9b1a-1b65-4670-ba37-8036c279e598 tempest-TestVolumeSwap-1038735411 tempest-TestVolumeSwap-1038735411-project-admin] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:a6b34bdb-5c08-4f7c-b3f5-6b68413947a8, portal: 172.16.0.220,3260]
Nov 29 17:54:19 user nova-compute[74613]: Login to [iface: default, target: iqn.2010-10.org.openstack:a6b34bdb-5c08-4f7c-b3f5-6b68413947a8, portal: 172.16.0.220,3260] successful.
Nov 29 17:54:19 user nova-compute[74613]:  stderr= {{(pid=74613) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 17:54:19 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a6b34bdb-5c08-4f7c-b3f5-6b68413947a8 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 17:54:19 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:54:19 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a6b34bdb-5c08-4f7c-b3f5-6b68413947a8 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.024s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 17:54:19 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f50b01b-b259-45fd-9833-ee7b92b9accd]: (4, ('', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 17:54:19 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-221e9b1a-1b65-4670-ba37-8036c279e598 tempest-TestVolumeSwap-1038735411 tempest-TestVolumeSwap-1038735411-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74613) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 17:54:19 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 17:54:19 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 17:54:19 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b235a7c-2050-4375-a44e-7f1445a3baad]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7efc2d5-5149-408b-980d-58492994fd4f (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49f19a7e-3b8b-44b4-b289-808ee2a18b91 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a6b34bdb-5c08-4f7c-b3f5-6b68413947a8 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:24920064-fc81-4408-97d1-d8eff97a7554 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8230f3a2-63d8-46cb-8ec7-ceb89fb04e53 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d1f798a1-4f7b-4b9a-8180-fa8f4eb89bf0 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:17b27fab-6cdb-4820-be62-ffd44e8e2fb5 (non-flash)\n', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 17:54:19 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-221e9b1a-1b65-4670-ba37-8036c279e598 tempest-TestVolumeSwap-1038735411 tempest-TestVolumeSwap-1038735411-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7efc2d5-5149-408b-980d-58492994fd4f (non-flash)
Nov 29 17:54:19 user nova-compute[74613]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49f19a7e-3b8b-44b4-b289-808ee2a18b91 (non-flash)
Nov 29 17:54:19 user nova-compute[74613]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a6b34bdb-5c08-4f7c-b3f5-6b68413947a8 (non-flash)
Nov 29 17:54:19 user nova-compute[74613]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:24920064-fc81-4408-97d1-d8eff97a7554 (non-flash)
Nov 29 17:54:19 user nova-compute[74613]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8230f3a2-63d8-46cb-8ec7-ceb89fb04e53 (non-flash)
Nov 29 17:54:19 user nova-compute[74613]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d1f798a1-4f7b-4b9a-8180-fa8f4eb89bf0 (non-flash)
Nov 29 17:54:19 user nova-compute[74613]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:17b27fab-6cdb-4820-be62-ffd44e8e2fb5 (non-flash)
Nov 29 17:54:19 user nova-compute[74613]:  stderr= {{(pid=74613) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 17:54:19 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-221e9b1a-1b65-4670-ba37-8036c279e598 tempest-TestVolumeSwap-1038735411 tempest-TestVolumeSwap-1038735411-project-admin] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7efc2d5-5149-408b-980d-58492994fd4f (non-flash)
Nov 29 17:54:19 user nova-compute[74613]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49f19a7e-3b8b-44b4-b289-808ee2a18b91 (non-flash)
Nov 29 17:54:19 user nova-compute[74613]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a6b34bdb-5c08-4f7c-b3f5-6b68413947a8 (non-flash)
Nov 29 17:54:19 user nova-compute[74613]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:24920064-fc81-4408-97d1-d8eff97a7554 (non-flash)
Nov 29 17:54:19 user nova-compute[74613]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8230f3a2-63d8-46cb-8ec7-ceb89fb04e53 (non-flash)
Nov 29 17:54:19 user nova-compute[74613]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d1f798a1-4f7b-4b9a-8180-fa8f4eb89bf0 (non-flash)
Nov 29 17:54:19 user nova-compute[74613]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:17b27fab-6cdb-4820-be62-ffd44e8e2fb5 (non-flash)
Nov 29 17:54:19 user nova-compute[74613]:  stderr= {{(pid=74613) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 17:54:19 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.base [None req-221e9b1a-1b65-4670-ba37-8036c279e598 tempest-TestVolumeSwap-1038735411 tempest-TestVolumeSwap-1038735411-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a6b34bdb-5c08-4f7c-b3f5-6b68413947a8" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.357s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 17:54:19 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-221e9b1a-1b65-4670-ba37-8036c279e598 tempest-TestVolumeSwap-1038735411 tempest-TestVolumeSwap-1038735411-project-admin] Connected to 172.16.0.220:3260 {{(pid=74613) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 29 17:54:19 user nova-compute[74613]: DEBUG os_brick.initiator.linuxscsi [None req-221e9b1a-1b65-4670-ba37-8036c279e598 tempest-TestVolumeSwap-1038735411 tempest-TestVolumeSwap-1038735411-project-admin] HCTL ('37', '-', '-', 0) found on session 13 with lun 0 {{(pid=74613) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 29 17:54:19 user nova-compute[74613]: DEBUG os_brick.initiator.linuxscsi [None req-221e9b1a-1b65-4670-ba37-8036c279e598 tempest-TestVolumeSwap-1038735411 tempest-TestVolumeSwap-1038735411-project-admin] Scanning host 37 c: -, t: -, l: 0) {{(pid=74613) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 29 17:54:19 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 17:54:19 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.017s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 17:54:19 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[7974e353-3baf-4c7a-873a-862a5424aee2]: (4, ('- - 0', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 17:54:19 user nova-compute[74613]: DEBUG os_brick.initiator.linuxscsi [None req-221e9b1a-1b65-4670-ba37-8036c279e598 tempest-TestVolumeSwap-1038735411 tempest-TestVolumeSwap-1038735411-project-admin] Searching for a device in session 13 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=74613) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 29 17:54:19 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-221e9b1a-1b65-4670-ba37-8036c279e598 tempest-TestVolumeSwap-1038735411 tempest-TestVolumeSwap-1038735411-project-admin] Connected to sdf using {'target_iqn': 'iqn.2010-10.org.openstack:a6b34bdb-5c08-4f7c-b3f5-6b68413947a8', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'SAqnwafp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74613) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 29 17:54:19 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:54:19 user nova-compute[74613]: INFO nova.virt.libvirt.driver [-] [instance: 3f285832-64a7-48e8-875a-f9e1566a66b6] Instance destroyed successfully.
Nov 29 17:54:19 user nova-compute[74613]: DEBUG nova.objects.instance [None req-23a466ec-4c34-4fbf-8a45-ad85d880905e tempest-TaggedBootDevicesTest_v242-869407180 tempest-TaggedBootDevicesTest_v242-869407180-project-member] Lazy-loading 'resources' on Instance uuid 3f285832-64a7-48e8-875a-f9e1566a66b6 {{(pid=74613) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 17:54:19 user nova-compute[74613]: DEBUG nova.virt.libvirt.vif [None req-23a466ec-4c34-4fbf-8a45-ad85d880905e tempest-TaggedBootDevicesTest_v242-869407180 tempest-TaggedBootDevicesTest_v242-869407180-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-29T17:52:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1859666771',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1859666771',id=11,image_ref='4217f428-8d9d-4ee1-9614-642d26d90c46',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKSRsE7CMPATzk0nhGKTXLyRQ2NjVsTAMbCrCKqZWb1yoHTJqXD7QPDDSiibpwgKBka38h6fgCSPKBI9itrRtjEmsKFRLJ9RpUfxeowCr9ERHXHEHuwVFTVkz9FoHnKnPQ==',key_name='tempest-keypair-955747048',keypairs=<?>,launch_index=0,launched_at=2023-11-29T17:53:01Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='f655bcde631c4a839b98695eed5cfa4e',ramdisk_id='',reservation_id='r-5hebi871',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='4217f428-8d9d-4ee1-9614-642d26d90c46',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-869407180',owner_user_name='tempest-TaggedBootDevicesTest_v242-869407180-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-29T17:53:02Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e743f61509f44bcfac1b4baef1fd5c3c',uuid=3f285832-64a7-48e8-875a-f9e1566a66b6,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "75aec901-492c-47e1-9621-158f2d11a5e7", "address": "fa:16:3e:78:3a:a6", "network": {"id": "ca76dd55-469c-4d51-a76e-8b160bef1707", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-570657334-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.106", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f655bcde631c4a839b98695eed5cfa4e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap75aec901-49", "ovs_interfaceid": "75aec901-492c-47e1-9621-158f2d11a5e7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74613) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 29 17:54:19 user nova-compute[74613]: DEBUG nova.network.os_vif_util [None req-23a466ec-4c34-4fbf-8a45-ad85d880905e tempest-TaggedBootDevicesTest_v242-869407180 tempest-TaggedBootDevicesTest_v242-869407180-project-member] Converting VIF {"id": "75aec901-492c-47e1-9621-158f2d11a5e7", "address": "fa:16:3e:78:3a:a6", "network": {"id": "ca76dd55-469c-4d51-a76e-8b160bef1707", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-570657334-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.106", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f655bcde631c4a839b98695eed5cfa4e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap75aec901-49", "ovs_interfaceid": "75aec901-492c-47e1-9621-158f2d11a5e7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74613) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 17:54:19 user nova-compute[74613]: DEBUG nova.network.os_vif_util [None req-23a466ec-4c34-4fbf-8a45-ad85d880905e tempest-TaggedBootDevicesTest_v242-869407180 tempest-TaggedBootDevicesTest_v242-869407180-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:78:3a:a6,bridge_name='br-int',has_traffic_filtering=True,id=75aec901-492c-47e1-9621-158f2d11a5e7,network=Network(ca76dd55-469c-4d51-a76e-8b160bef1707),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap75aec901-49') {{(pid=74613) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 17:54:19 user nova-compute[74613]: DEBUG os_vif [None req-23a466ec-4c34-4fbf-8a45-ad85d880905e tempest-TaggedBootDevicesTest_v242-869407180 tempest-TaggedBootDevicesTest_v242-869407180-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:78:3a:a6,bridge_name='br-int',has_traffic_filtering=True,id=75aec901-492c-47e1-9621-158f2d11a5e7,network=Network(ca76dd55-469c-4d51-a76e-8b160bef1707),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap75aec901-49') {{(pid=74613) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 29 17:54:19 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:54:19 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap75aec901-49, bridge=br-int, if_exists=True) {{(pid=74613) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 17:54:19 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:54:19 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 17:54:19 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:54:19 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:54:19 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=2fdaf5cc-980c-48ee-95b0-fd6c60700a7c) {{(pid=74613) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 17:54:19 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:54:19 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 17:54:19 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:54:20 user nova-compute[74613]: INFO os_vif [None req-23a466ec-4c34-4fbf-8a45-ad85d880905e tempest-TaggedBootDevicesTest_v242-869407180 tempest-TaggedBootDevicesTest_v242-869407180-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:78:3a:a6,bridge_name='br-int',has_traffic_filtering=True,id=75aec901-492c-47e1-9621-158f2d11a5e7,network=Network(ca76dd55-469c-4d51-a76e-8b160bef1707),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap75aec901-49')
Nov 29 17:54:20 user nova-compute[74613]: DEBUG nova.virt.libvirt.vif [None req-23a466ec-4c34-4fbf-8a45-ad85d880905e tempest-TaggedBootDevicesTest_v242-869407180 tempest-TaggedBootDevicesTest_v242-869407180-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-29T17:52:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1859666771',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1859666771',id=11,image_ref='4217f428-8d9d-4ee1-9614-642d26d90c46',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKSRsE7CMPATzk0nhGKTXLyRQ2NjVsTAMbCrCKqZWb1yoHTJqXD7QPDDSiibpwgKBka38h6fgCSPKBI9itrRtjEmsKFRLJ9RpUfxeowCr9ERHXHEHuwVFTVkz9FoHnKnPQ==',key_name='tempest-keypair-955747048',keypairs=<?>,launch_index=0,launched_at=2023-11-29T17:53:01Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='f655bcde631c4a839b98695eed5cfa4e',ramdisk_id='',reservation_id='r-5hebi871',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='4217f428-8d9d-4ee1-9614-642d26d90c46',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-869407180',owner_user_name='tempest-TaggedBootDevicesTest_v242-869407180-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-29T17:53:02Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e743f61509f44bcfac1b4baef1fd5c3c',uuid=3f285832-64a7-48e8-875a-f9e1566a66b6,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "d2631ae0-4218-400c-8da8-cb6d3271579d", "address": "fa:16:3e:3a:4c:7e", "network": {"id": "1e109d3b-bb91-4ff7-b16f-d39181436f57", "bridge": "br-int", "label": "tempest-device-tagging-net1-1011700470", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.120", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "f655bcde631c4a839b98695eed5cfa4e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd2631ae0-42", "ovs_interfaceid": "d2631ae0-4218-400c-8da8-cb6d3271579d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74613) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 29 17:54:20 user nova-compute[74613]: DEBUG nova.network.os_vif_util [None req-23a466ec-4c34-4fbf-8a45-ad85d880905e tempest-TaggedBootDevicesTest_v242-869407180 tempest-TaggedBootDevicesTest_v242-869407180-project-member] Converting VIF {"id": "d2631ae0-4218-400c-8da8-cb6d3271579d", "address": "fa:16:3e:3a:4c:7e", "network": {"id": "1e109d3b-bb91-4ff7-b16f-d39181436f57", "bridge": "br-int", "label": "tempest-device-tagging-net1-1011700470", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.120", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "f655bcde631c4a839b98695eed5cfa4e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd2631ae0-42", "ovs_interfaceid": "d2631ae0-4218-400c-8da8-cb6d3271579d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74613) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 17:54:20 user nova-compute[74613]: DEBUG nova.network.os_vif_util [None req-23a466ec-4c34-4fbf-8a45-ad85d880905e tempest-TaggedBootDevicesTest_v242-869407180 tempest-TaggedBootDevicesTest_v242-869407180-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3a:4c:7e,bridge_name='br-int',has_traffic_filtering=True,id=d2631ae0-4218-400c-8da8-cb6d3271579d,network=Network(1e109d3b-bb91-4ff7-b16f-d39181436f57),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapd2631ae0-42') {{(pid=74613) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 17:54:20 user nova-compute[74613]: DEBUG os_vif [None req-23a466ec-4c34-4fbf-8a45-ad85d880905e tempest-TaggedBootDevicesTest_v242-869407180 tempest-TaggedBootDevicesTest_v242-869407180-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:3a:4c:7e,bridge_name='br-int',has_traffic_filtering=True,id=d2631ae0-4218-400c-8da8-cb6d3271579d,network=Network(1e109d3b-bb91-4ff7-b16f-d39181436f57),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapd2631ae0-42') {{(pid=74613) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 29 17:54:20 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:54:20 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapd2631ae0-42, bridge=br-int, if_exists=True) {{(pid=74613) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 17:54:20 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:54:20 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 17:54:20 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:54:20 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:54:20 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=05799114-83ff-4d69-8a05-d20e7c5c4cc7) {{(pid=74613) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 17:54:20 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:54:20 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 17:54:20 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:54:20 user nova-compute[74613]: INFO os_vif [None req-23a466ec-4c34-4fbf-8a45-ad85d880905e tempest-TaggedBootDevicesTest_v242-869407180 tempest-TaggedBootDevicesTest_v242-869407180-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:3a:4c:7e,bridge_name='br-int',has_traffic_filtering=True,id=d2631ae0-4218-400c-8da8-cb6d3271579d,network=Network(1e109d3b-bb91-4ff7-b16f-d39181436f57),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapd2631ae0-42')
Nov 29 17:54:20 user nova-compute[74613]: DEBUG nova.virt.libvirt.vif [None req-23a466ec-4c34-4fbf-8a45-ad85d880905e tempest-TaggedBootDevicesTest_v242-869407180 tempest-TaggedBootDevicesTest_v242-869407180-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-29T17:52:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1859666771',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1859666771',id=11,image_ref='4217f428-8d9d-4ee1-9614-642d26d90c46',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKSRsE7CMPATzk0nhGKTXLyRQ2NjVsTAMbCrCKqZWb1yoHTJqXD7QPDDSiibpwgKBka38h6fgCSPKBI9itrRtjEmsKFRLJ9RpUfxeowCr9ERHXHEHuwVFTVkz9FoHnKnPQ==',key_name='tempest-keypair-955747048',keypairs=<?>,launch_index=0,launched_at=2023-11-29T17:53:01Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='f655bcde631c4a839b98695eed5cfa4e',ramdisk_id='',reservation_id='r-5hebi871',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='4217f428-8d9d-4ee1-9614-642d26d90c46',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-869407180',owner_user_name='tempest-TaggedBootDevicesTest_v242-869407180-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-29T17:53:02Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e743f61509f44bcfac1b4baef1fd5c3c',uuid=3f285832-64a7-48e8-875a-f9e1566a66b6,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "83dc312c-87e6-47a8-b4a5-f7c3cec7ab50", "address": "fa:16:3e:fb:9b:31", "network": {"id": "1e109d3b-bb91-4ff7-b16f-d39181436f57", "bridge": "br-int", "label": "tempest-device-tagging-net1-1011700470", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.134", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "f655bcde631c4a839b98695eed5cfa4e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap83dc312c-87", "ovs_interfaceid": "83dc312c-87e6-47a8-b4a5-f7c3cec7ab50", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74613) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 29 17:54:20 user nova-compute[74613]: DEBUG nova.network.os_vif_util [None req-23a466ec-4c34-4fbf-8a45-ad85d880905e tempest-TaggedBootDevicesTest_v242-869407180 tempest-TaggedBootDevicesTest_v242-869407180-project-member] Converting VIF {"id": "83dc312c-87e6-47a8-b4a5-f7c3cec7ab50", "address": "fa:16:3e:fb:9b:31", "network": {"id": "1e109d3b-bb91-4ff7-b16f-d39181436f57", "bridge": "br-int", "label": "tempest-device-tagging-net1-1011700470", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.134", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "f655bcde631c4a839b98695eed5cfa4e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap83dc312c-87", "ovs_interfaceid": "83dc312c-87e6-47a8-b4a5-f7c3cec7ab50", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74613) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 17:54:20 user nova-compute[74613]: DEBUG nova.network.os_vif_util [None req-23a466ec-4c34-4fbf-8a45-ad85d880905e tempest-TaggedBootDevicesTest_v242-869407180 tempest-TaggedBootDevicesTest_v242-869407180-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:fb:9b:31,bridge_name='br-int',has_traffic_filtering=True,id=83dc312c-87e6-47a8-b4a5-f7c3cec7ab50,network=Network(1e109d3b-bb91-4ff7-b16f-d39181436f57),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap83dc312c-87') {{(pid=74613) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 17:54:20 user nova-compute[74613]: DEBUG os_vif [None req-23a466ec-4c34-4fbf-8a45-ad85d880905e tempest-TaggedBootDevicesTest_v242-869407180 tempest-TaggedBootDevicesTest_v242-869407180-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:fb:9b:31,bridge_name='br-int',has_traffic_filtering=True,id=83dc312c-87e6-47a8-b4a5-f7c3cec7ab50,network=Network(1e109d3b-bb91-4ff7-b16f-d39181436f57),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap83dc312c-87') {{(pid=74613) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 29 17:54:20 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:54:20 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap83dc312c-87, bridge=br-int, if_exists=True) {{(pid=74613) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 17:54:20 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:54:20 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 17:54:20 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:54:20 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:54:20 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=9cea1270-44e7-4271-81b7-658613a72578) {{(pid=74613) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 17:54:20 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:54:20 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 17:54:20 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:54:20 user nova-compute[74613]: INFO os_vif [None req-23a466ec-4c34-4fbf-8a45-ad85d880905e tempest-TaggedBootDevicesTest_v242-869407180 tempest-TaggedBootDevicesTest_v242-869407180-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:fb:9b:31,bridge_name='br-int',has_traffic_filtering=True,id=83dc312c-87e6-47a8-b4a5-f7c3cec7ab50,network=Network(1e109d3b-bb91-4ff7-b16f-d39181436f57),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap83dc312c-87')
Nov 29 17:54:20 user nova-compute[74613]: DEBUG nova.virt.libvirt.vif [None req-23a466ec-4c34-4fbf-8a45-ad85d880905e tempest-TaggedBootDevicesTest_v242-869407180 tempest-TaggedBootDevicesTest_v242-869407180-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-29T17:52:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1859666771',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1859666771',id=11,image_ref='4217f428-8d9d-4ee1-9614-642d26d90c46',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKSRsE7CMPATzk0nhGKTXLyRQ2NjVsTAMbCrCKqZWb1yoHTJqXD7QPDDSiibpwgKBka38h6fgCSPKBI9itrRtjEmsKFRLJ9RpUfxeowCr9ERHXHEHuwVFTVkz9FoHnKnPQ==',key_name='tempest-keypair-955747048',keypairs=<?>,launch_index=0,launched_at=2023-11-29T17:53:01Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='f655bcde631c4a839b98695eed5cfa4e',ramdisk_id='',reservation_id='r-5hebi871',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='4217f428-8d9d-4ee1-9614-642d26d90c46',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-869407180',owner_user_name='tempest-TaggedBootDevicesTest_v242-869407180-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-29T17:53:02Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e743f61509f44bcfac1b4baef1fd5c3c',uuid=3f285832-64a7-48e8-875a-f9e1566a66b6,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "5ea35efd-1b2e-48eb-b8fb-fb15dab703dc", "address": "fa:16:3e:f1:48:4c", "network": {"id": "1e109d3b-bb91-4ff7-b16f-d39181436f57", "bridge": "br-int", "label": "tempest-device-tagging-net1-1011700470", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.157", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "f655bcde631c4a839b98695eed5cfa4e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5ea35efd-1b", "ovs_interfaceid": "5ea35efd-1b2e-48eb-b8fb-fb15dab703dc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74613) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 29 17:54:20 user nova-compute[74613]: DEBUG nova.network.os_vif_util [None req-23a466ec-4c34-4fbf-8a45-ad85d880905e tempest-TaggedBootDevicesTest_v242-869407180 tempest-TaggedBootDevicesTest_v242-869407180-project-member] Converting VIF {"id": "5ea35efd-1b2e-48eb-b8fb-fb15dab703dc", "address": "fa:16:3e:f1:48:4c", "network": {"id": "1e109d3b-bb91-4ff7-b16f-d39181436f57", "bridge": "br-int", "label": "tempest-device-tagging-net1-1011700470", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.157", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "f655bcde631c4a839b98695eed5cfa4e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5ea35efd-1b", "ovs_interfaceid": "5ea35efd-1b2e-48eb-b8fb-fb15dab703dc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74613) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 17:54:20 user nova-compute[74613]: DEBUG nova.network.os_vif_util [None req-23a466ec-4c34-4fbf-8a45-ad85d880905e tempest-TaggedBootDevicesTest_v242-869407180 tempest-TaggedBootDevicesTest_v242-869407180-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f1:48:4c,bridge_name='br-int',has_traffic_filtering=True,id=5ea35efd-1b2e-48eb-b8fb-fb15dab703dc,network=Network(1e109d3b-bb91-4ff7-b16f-d39181436f57),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5ea35efd-1b') {{(pid=74613) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 17:54:20 user nova-compute[74613]: DEBUG os_vif [None req-23a466ec-4c34-4fbf-8a45-ad85d880905e tempest-TaggedBootDevicesTest_v242-869407180 tempest-TaggedBootDevicesTest_v242-869407180-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f1:48:4c,bridge_name='br-int',has_traffic_filtering=True,id=5ea35efd-1b2e-48eb-b8fb-fb15dab703dc,network=Network(1e109d3b-bb91-4ff7-b16f-d39181436f57),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5ea35efd-1b') {{(pid=74613) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 29 17:54:20 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:54:20 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap5ea35efd-1b, bridge=br-int, if_exists=True) {{(pid=74613) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 17:54:20 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:54:20 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 17:54:20 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:54:20 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:54:20 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=dbab86ec-d036-46f1-9ec0-4e99091ab995) {{(pid=74613) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 17:54:20 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.base [None req-221e9b1a-1b65-4670-ba37-8036c279e598 tempest-TestVolumeSwap-1038735411 tempest-TestVolumeSwap-1038735411-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.396s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 17:54:20 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-221e9b1a-1b65-4670-ba37-8036c279e598 tempest-TestVolumeSwap-1038735411 tempest-TestVolumeSwap-1038735411-project-admin] <== connect_volume: return (1397ms) {'type': 'block', 'scsi_wwn': '26635343864373431', 'path': '/dev/sdf'} {{(pid=74613) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 17:54:20 user nova-compute[74613]: DEBUG nova.virt.libvirt.volume.iscsi [None req-221e9b1a-1b65-4670-ba37-8036c279e598 tempest-TestVolumeSwap-1038735411 tempest-TestVolumeSwap-1038735411-project-admin] [instance: 0008521b-5a63-4ff6-8390-d343956900ed] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26635343864373431', 'path': '/dev/sdf'} {{(pid=74613) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 29 17:54:20 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:54:20 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 17:54:20 user nova-compute[74613]: DEBUG nova.objects.instance [None req-221e9b1a-1b65-4670-ba37-8036c279e598 tempest-TestVolumeSwap-1038735411 tempest-TestVolumeSwap-1038735411-project-admin] Lazy-loading 'flavor' on Instance uuid 0008521b-5a63-4ff6-8390-d343956900ed {{(pid=74613) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 17:54:20 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:54:20 user nova-compute[74613]: INFO os_vif [None req-23a466ec-4c34-4fbf-8a45-ad85d880905e tempest-TaggedBootDevicesTest_v242-869407180 tempest-TaggedBootDevicesTest_v242-869407180-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f1:48:4c,bridge_name='br-int',has_traffic_filtering=True,id=5ea35efd-1b2e-48eb-b8fb-fb15dab703dc,network=Network(1e109d3b-bb91-4ff7-b16f-d39181436f57),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5ea35efd-1b')
Nov 29 17:54:20 user nova-compute[74613]: DEBUG nova.virt.libvirt.vif [None req-23a466ec-4c34-4fbf-8a45-ad85d880905e tempest-TaggedBootDevicesTest_v242-869407180 tempest-TaggedBootDevicesTest_v242-869407180-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-29T17:52:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1859666771',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1859666771',id=11,image_ref='4217f428-8d9d-4ee1-9614-642d26d90c46',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKSRsE7CMPATzk0nhGKTXLyRQ2NjVsTAMbCrCKqZWb1yoHTJqXD7QPDDSiibpwgKBka38h6fgCSPKBI9itrRtjEmsKFRLJ9RpUfxeowCr9ERHXHEHuwVFTVkz9FoHnKnPQ==',key_name='tempest-keypair-955747048',keypairs=<?>,launch_index=0,launched_at=2023-11-29T17:53:01Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='f655bcde631c4a839b98695eed5cfa4e',ramdisk_id='',reservation_id='r-5hebi871',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='4217f428-8d9d-4ee1-9614-642d26d90c46',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-869407180',owner_user_name='tempest-TaggedBootDevicesTest_v242-869407180-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-29T17:53:02Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e743f61509f44bcfac1b4baef1fd5c3c',uuid=3f285832-64a7-48e8-875a-f9e1566a66b6,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "3fe23755-ec08-4b17-87b2-c1eebd36042b", "address": "fa:16:3e:39:7c:dd", "network": {"id": "1e109d3b-bb91-4ff7-b16f-d39181436f57", "bridge": "br-int", "label": "tempest-device-tagging-net1-1011700470", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.66", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "f655bcde631c4a839b98695eed5cfa4e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3fe23755-ec", "ovs_interfaceid": "3fe23755-ec08-4b17-87b2-c1eebd36042b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74613) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 29 17:54:20 user nova-compute[74613]: DEBUG nova.network.os_vif_util [None req-23a466ec-4c34-4fbf-8a45-ad85d880905e tempest-TaggedBootDevicesTest_v242-869407180 tempest-TaggedBootDevicesTest_v242-869407180-project-member] Converting VIF {"id": "3fe23755-ec08-4b17-87b2-c1eebd36042b", "address": "fa:16:3e:39:7c:dd", "network": {"id": "1e109d3b-bb91-4ff7-b16f-d39181436f57", "bridge": "br-int", "label": "tempest-device-tagging-net1-1011700470", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.66", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "f655bcde631c4a839b98695eed5cfa4e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3fe23755-ec", "ovs_interfaceid": "3fe23755-ec08-4b17-87b2-c1eebd36042b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74613) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 17:54:20 user nova-compute[74613]: DEBUG nova.network.os_vif_util [None req-23a466ec-4c34-4fbf-8a45-ad85d880905e tempest-TaggedBootDevicesTest_v242-869407180 tempest-TaggedBootDevicesTest_v242-869407180-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:39:7c:dd,bridge_name='br-int',has_traffic_filtering=True,id=3fe23755-ec08-4b17-87b2-c1eebd36042b,network=Network(1e109d3b-bb91-4ff7-b16f-d39181436f57),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3fe23755-ec') {{(pid=74613) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 17:54:20 user nova-compute[74613]: DEBUG os_vif [None req-23a466ec-4c34-4fbf-8a45-ad85d880905e tempest-TaggedBootDevicesTest_v242-869407180 tempest-TaggedBootDevicesTest_v242-869407180-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:39:7c:dd,bridge_name='br-int',has_traffic_filtering=True,id=3fe23755-ec08-4b17-87b2-c1eebd36042b,network=Network(1e109d3b-bb91-4ff7-b16f-d39181436f57),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3fe23755-ec') {{(pid=74613) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 29 17:54:20 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:54:20 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap3fe23755-ec, bridge=br-int, if_exists=True) {{(pid=74613) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 17:54:20 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 17:54:20 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:54:20 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:54:20 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=6b2ea9d3-05fb-4799-a45e-a64307cc70b1) {{(pid=74613) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 17:54:20 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 17:54:20 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:54:20 user nova-compute[74613]: INFO os_vif [None req-23a466ec-4c34-4fbf-8a45-ad85d880905e tempest-TaggedBootDevicesTest_v242-869407180 tempest-TaggedBootDevicesTest_v242-869407180-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:39:7c:dd,bridge_name='br-int',has_traffic_filtering=True,id=3fe23755-ec08-4b17-87b2-c1eebd36042b,network=Network(1e109d3b-bb91-4ff7-b16f-d39181436f57),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3fe23755-ec')
Nov 29 17:54:20 user nova-compute[74613]: DEBUG nova.virt.libvirt.vif [None req-23a466ec-4c34-4fbf-8a45-ad85d880905e tempest-TaggedBootDevicesTest_v242-869407180 tempest-TaggedBootDevicesTest_v242-869407180-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-29T17:52:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1859666771',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1859666771',id=11,image_ref='4217f428-8d9d-4ee1-9614-642d26d90c46',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKSRsE7CMPATzk0nhGKTXLyRQ2NjVsTAMbCrCKqZWb1yoHTJqXD7QPDDSiibpwgKBka38h6fgCSPKBI9itrRtjEmsKFRLJ9RpUfxeowCr9ERHXHEHuwVFTVkz9FoHnKnPQ==',key_name='tempest-keypair-955747048',keypairs=<?>,launch_index=0,launched_at=2023-11-29T17:53:01Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='f655bcde631c4a839b98695eed5cfa4e',ramdisk_id='',reservation_id='r-5hebi871',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='4217f428-8d9d-4ee1-9614-642d26d90c46',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-869407180',owner_user_name='tempest-TaggedBootDevicesTest_v242-869407180-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-29T17:53:02Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e743f61509f44bcfac1b4baef1fd5c3c',uuid=3f285832-64a7-48e8-875a-f9e1566a66b6,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "bffa705a-58aa-4cbd-9b9d-09c8229cf829", "address": "fa:16:3e:f7:c0:bd", "network": {"id": "6debc132-a947-4fdc-8d04-f10452f6ee9c", "bridge": "br-int", "label": "tempest-device-tagging-net2-597757606", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "f655bcde631c4a839b98695eed5cfa4e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbffa705a-58", "ovs_interfaceid": "bffa705a-58aa-4cbd-9b9d-09c8229cf829", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74613) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 29 17:54:20 user nova-compute[74613]: DEBUG nova.network.os_vif_util [None req-23a466ec-4c34-4fbf-8a45-ad85d880905e tempest-TaggedBootDevicesTest_v242-869407180 tempest-TaggedBootDevicesTest_v242-869407180-project-member] Converting VIF {"id": "bffa705a-58aa-4cbd-9b9d-09c8229cf829", "address": "fa:16:3e:f7:c0:bd", "network": {"id": "6debc132-a947-4fdc-8d04-f10452f6ee9c", "bridge": "br-int", "label": "tempest-device-tagging-net2-597757606", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "f655bcde631c4a839b98695eed5cfa4e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbffa705a-58", "ovs_interfaceid": "bffa705a-58aa-4cbd-9b9d-09c8229cf829", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74613) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 17:54:20 user nova-compute[74613]: DEBUG nova.network.os_vif_util [None req-23a466ec-4c34-4fbf-8a45-ad85d880905e tempest-TaggedBootDevicesTest_v242-869407180 tempest-TaggedBootDevicesTest_v242-869407180-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f7:c0:bd,bridge_name='br-int',has_traffic_filtering=True,id=bffa705a-58aa-4cbd-9b9d-09c8229cf829,network=Network(6debc132-a947-4fdc-8d04-f10452f6ee9c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbffa705a-58') {{(pid=74613) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 17:54:20 user nova-compute[74613]: DEBUG os_vif [None req-23a466ec-4c34-4fbf-8a45-ad85d880905e tempest-TaggedBootDevicesTest_v242-869407180 tempest-TaggedBootDevicesTest_v242-869407180-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f7:c0:bd,bridge_name='br-int',has_traffic_filtering=True,id=bffa705a-58aa-4cbd-9b9d-09c8229cf829,network=Network(6debc132-a947-4fdc-8d04-f10452f6ee9c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbffa705a-58') {{(pid=74613) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 29 17:54:20 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:54:20 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapbffa705a-58, bridge=br-int, if_exists=True) {{(pid=74613) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 17:54:20 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 17:54:20 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:54:20 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:54:20 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=45c162a2-fef8-46f2-8108-a54b42938788) {{(pid=74613) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 17:54:20 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:54:20 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 17:54:20 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:54:20 user nova-compute[74613]: INFO os_vif [None req-23a466ec-4c34-4fbf-8a45-ad85d880905e tempest-TaggedBootDevicesTest_v242-869407180 tempest-TaggedBootDevicesTest_v242-869407180-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f7:c0:bd,bridge_name='br-int',has_traffic_filtering=True,id=bffa705a-58aa-4cbd-9b9d-09c8229cf829,network=Network(6debc132-a947-4fdc-8d04-f10452f6ee9c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbffa705a-58')
Nov 29 17:54:20 user nova-compute[74613]: DEBUG nova.virt.libvirt.vif [None req-23a466ec-4c34-4fbf-8a45-ad85d880905e tempest-TaggedBootDevicesTest_v242-869407180 tempest-TaggedBootDevicesTest_v242-869407180-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-29T17:52:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1859666771',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1859666771',id=11,image_ref='4217f428-8d9d-4ee1-9614-642d26d90c46',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKSRsE7CMPATzk0nhGKTXLyRQ2NjVsTAMbCrCKqZWb1yoHTJqXD7QPDDSiibpwgKBka38h6fgCSPKBI9itrRtjEmsKFRLJ9RpUfxeowCr9ERHXHEHuwVFTVkz9FoHnKnPQ==',key_name='tempest-keypair-955747048',keypairs=<?>,launch_index=0,launched_at=2023-11-29T17:53:01Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='f655bcde631c4a839b98695eed5cfa4e',ramdisk_id='',reservation_id='r-5hebi871',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='4217f428-8d9d-4ee1-9614-642d26d90c46',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-869407180',owner_user_name='tempest-TaggedBootDevicesTest_v242-869407180-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-29T17:53:02Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e743f61509f44bcfac1b4baef1fd5c3c',uuid=3f285832-64a7-48e8-875a-f9e1566a66b6,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "48d45408-4c70-44b7-a0c3-874ad1049d1a", "address": "fa:16:3e:a2:2a:db", "network": {"id": "6debc132-a947-4fdc-8d04-f10452f6ee9c", "bridge": "br-int", "label": "tempest-device-tagging-net2-597757606", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "f655bcde631c4a839b98695eed5cfa4e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap48d45408-4c", "ovs_interfaceid": "48d45408-4c70-44b7-a0c3-874ad1049d1a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74613) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 29 17:54:20 user nova-compute[74613]: DEBUG nova.network.os_vif_util [None req-23a466ec-4c34-4fbf-8a45-ad85d880905e tempest-TaggedBootDevicesTest_v242-869407180 tempest-TaggedBootDevicesTest_v242-869407180-project-member] Converting VIF {"id": "48d45408-4c70-44b7-a0c3-874ad1049d1a", "address": "fa:16:3e:a2:2a:db", "network": {"id": "6debc132-a947-4fdc-8d04-f10452f6ee9c", "bridge": "br-int", "label": "tempest-device-tagging-net2-597757606", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "f655bcde631c4a839b98695eed5cfa4e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap48d45408-4c", "ovs_interfaceid": "48d45408-4c70-44b7-a0c3-874ad1049d1a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74613) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 17:54:20 user nova-compute[74613]: DEBUG nova.network.os_vif_util [None req-23a466ec-4c34-4fbf-8a45-ad85d880905e tempest-TaggedBootDevicesTest_v242-869407180 tempest-TaggedBootDevicesTest_v242-869407180-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a2:2a:db,bridge_name='br-int',has_traffic_filtering=True,id=48d45408-4c70-44b7-a0c3-874ad1049d1a,network=Network(6debc132-a947-4fdc-8d04-f10452f6ee9c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap48d45408-4c') {{(pid=74613) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 17:54:20 user nova-compute[74613]: DEBUG os_vif [None req-23a466ec-4c34-4fbf-8a45-ad85d880905e tempest-TaggedBootDevicesTest_v242-869407180 tempest-TaggedBootDevicesTest_v242-869407180-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a2:2a:db,bridge_name='br-int',has_traffic_filtering=True,id=48d45408-4c70-44b7-a0c3-874ad1049d1a,network=Network(6debc132-a947-4fdc-8d04-f10452f6ee9c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap48d45408-4c') {{(pid=74613) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 29 17:54:20 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:54:20 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap48d45408-4c, bridge=br-int, if_exists=True) {{(pid=74613) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 17:54:20 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:54:20 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 17:54:20 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:54:20 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=c2282b79-0910-4a23-8f76-9dcf4ca17160) {{(pid=74613) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 17:54:20 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:54:20 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:54:20 user nova-compute[74613]: INFO os_vif [None req-23a466ec-4c34-4fbf-8a45-ad85d880905e tempest-TaggedBootDevicesTest_v242-869407180 tempest-TaggedBootDevicesTest_v242-869407180-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a2:2a:db,bridge_name='br-int',has_traffic_filtering=True,id=48d45408-4c70-44b7-a0c3-874ad1049d1a,network=Network(6debc132-a947-4fdc-8d04-f10452f6ee9c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap48d45408-4c')
Nov 29 17:54:20 user nova-compute[74613]: DEBUG nova.virt.libvirt.volume.iscsi [None req-23a466ec-4c34-4fbf-8a45-ad85d880905e tempest-TaggedBootDevicesTest_v242-869407180 tempest-TaggedBootDevicesTest_v242-869407180-project-member] [instance: 3f285832-64a7-48e8-875a-f9e1566a66b6] calling os-brick to detach iSCSI Volume {{(pid=74613) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 29 17:54:20 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-23a466ec-4c34-4fbf-8a45-ad85d880905e tempest-TaggedBootDevicesTest_v242-869407180 tempest-TaggedBootDevicesTest_v242-869407180-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff828156890>, {'target_iqn': 'iqn.2010-10.org.openstack:24920064-fc81-4408-97d1-d8eff97a7554', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qdHOcNGk', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=74613) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 17:54:20 user nova-compute[74613]: WARNING os_brick.initiator.connectors.base [None req-23a466ec-4c34-4fbf-8a45-ad85d880905e tempest-TaggedBootDevicesTest_v242-869407180 tempest-TaggedBootDevicesTest_v242-869407180-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 17:54:20 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.base [None req-23a466ec-4c34-4fbf-8a45-ad85d880905e tempest-TaggedBootDevicesTest_v242-869407180 tempest-TaggedBootDevicesTest_v242-869407180-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 17:54:20 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.base [None req-23a466ec-4c34-4fbf-8a45-ad85d880905e tempest-TaggedBootDevicesTest_v242-869407180 tempest-TaggedBootDevicesTest_v242-869407180-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 17:54:20 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 17:54:20 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.023s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 17:54:20 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe021de2-cb02-448e-be8d-bd2c8c58e9fb]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:24920064-fc81-4408-97d1-d8eff97a7554\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b7efc2d5-5149-408b-980d-58492994fd4f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:17b27fab-6cdb-4820-be62-ffd44e8e2fb5\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:8230f3a2-63d8-46cb-8ec7-ceb89fb04e53\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:49f19a7e-3b8b-44b4-b289-808ee2a18b91\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a6b34bdb-5c08-4f7c-b3f5-6b68413947a8\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d1f798a1-4f7b-4b9a-8180-fa8f4eb89bf0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 17:54:20 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-23a466ec-4c34-4fbf-8a45-ad85d880905e tempest-TaggedBootDevicesTest_v242-869407180 tempest-TaggedBootDevicesTest_v242-869407180-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 29 17:54:20 user nova-compute[74613]: No targets found.
Nov 29 17:54:20 user nova-compute[74613]: iSNS:
Nov 29 17:54:20 user nova-compute[74613]: No targets found.
Nov 29 17:54:20 user nova-compute[74613]: STATIC:
Nov 29 17:54:20 user nova-compute[74613]: Target: iqn.2010-10.org.openstack:24920064-fc81-4408-97d1-d8eff97a7554
Nov 29 17:54:20 user nova-compute[74613]:         Portal: 172.16.0.220:3260,-1
Nov 29 17:54:20 user nova-compute[74613]:                 Iface Name: default
Nov 29 17:54:20 user nova-compute[74613]: Target: iqn.2010-10.org.openstack:b7efc2d5-5149-408b-980d-58492994fd4f
Nov 29 17:54:20 user nova-compute[74613]:         Portal: 172.16.0.220:3260,-1
Nov 29 17:54:20 user nova-compute[74613]:                 Iface Name: default
Nov 29 17:54:20 user nova-compute[74613]: Target: iqn.2010-10.org.openstack:17b27fab-6cdb-4820-be62-ffd44e8e2fb5
Nov 29 17:54:20 user nova-compute[74613]:         Portal: 172.16.0.220:3260,-1
Nov 29 17:54:20 user nova-compute[74613]:                 Iface Name: default
Nov 29 17:54:20 user nova-compute[74613]: Target: iqn.2010-10.org.openstack:8230f3a2-63d8-46cb-8ec7-ceb89fb04e53
Nov 29 17:54:20 user nova-compute[74613]:         Portal: 172.16.0.220:3260,-1
Nov 29 17:54:20 user nova-compute[74613]:                 Iface Name: default
Nov 29 17:54:20 user nova-compute[74613]: Target: iqn.2010-10.org.openstack:49f19a7e-3b8b-44b4-b289-808ee2a18b91
Nov 29 17:54:20 user nova-compute[74613]:         Portal: 172.16.0.220:3260,-1
Nov 29 17:54:20 user nova-compute[74613]:                 Iface Name: default
Nov 29 17:54:20 user nova-compute[74613]: Target: iqn.2010-10.org.openstack:a6b34bdb-5c08-4f7c-b3f5-6b68413947a8
Nov 29 17:54:20 user nova-compute[74613]:         Portal: 172.16.0.220:3260,-1
Nov 29 17:54:20 user nova-compute[74613]:                 Iface Name: default
Nov 29 17:54:20 user nova-compute[74613]: Target: iqn.2010-10.org.openstack:d1f798a1-4f7b-4b9a-8180-fa8f4eb89bf0
Nov 29 17:54:20 user nova-compute[74613]:         Portal: 172.16.0.220:3260,-1
Nov 29 17:54:20 user nova-compute[74613]:                 Iface Name: default
Nov 29 17:54:20 user nova-compute[74613]: FIRMWARE:
Nov 29 17:54:20 user nova-compute[74613]: No targets found.
Nov 29 17:54:20 user nova-compute[74613]:  stderr= {{(pid=74613) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 17:54:20 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-23a466ec-4c34-4fbf-8a45-ad85d880905e tempest-TaggedBootDevicesTest_v242-869407180 tempest-TaggedBootDevicesTest_v242-869407180-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 29 17:54:20 user nova-compute[74613]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 29 17:54:20 user nova-compute[74613]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74613) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 29 17:54:20 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-23a466ec-4c34-4fbf-8a45-ad85d880905e tempest-TaggedBootDevicesTest_v242-869407180 tempest-TaggedBootDevicesTest_v242-869407180-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:24920064-fc81-4408-97d1-d8eff97a7554', 0)] {{(pid=74613) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 29 17:54:20 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 17:54:20 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 17:54:20 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[92cd1e28-f2a8-4fcc-b95f-5103479c3819]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:17b27fab-6cdb-4820-be62-ffd44e8e2fb5\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:24920064-fc81-4408-97d1-d8eff97a7554\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:49f19a7e-3b8b-44b4-b289-808ee2a18b91\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8230f3a2-63d8-46cb-8ec7-ceb89fb04e53\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a6b34bdb-5c08-4f7c-b3f5-6b68413947a8\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b7efc2d5-5149-408b-980d-58492994fd4f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d1f798a1-4f7b-4b9a-8180-fa8f4eb89bf0\n', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 17:54:20 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 17:54:20 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 17:54:20 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[66bdfe10-0feb-443a-85bd-f11fe47571cd]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7efc2d5-5149-408b-980d-58492994fd4f (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49f19a7e-3b8b-44b4-b289-808ee2a18b91 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a6b34bdb-5c08-4f7c-b3f5-6b68413947a8 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:24920064-fc81-4408-97d1-d8eff97a7554 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8230f3a2-63d8-46cb-8ec7-ceb89fb04e53 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d1f798a1-4f7b-4b9a-8180-fa8f4eb89bf0 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:17b27fab-6cdb-4820-be62-ffd44e8e2fb5 (non-flash)\n', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 17:54:20 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-23a466ec-4c34-4fbf-8a45-ad85d880905e tempest-TaggedBootDevicesTest_v242-869407180 tempest-TaggedBootDevicesTest_v242-869407180-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7efc2d5-5149-408b-980d-58492994fd4f (non-flash)
Nov 29 17:54:20 user nova-compute[74613]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49f19a7e-3b8b-44b4-b289-808ee2a18b91 (non-flash)
Nov 29 17:54:20 user nova-compute[74613]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a6b34bdb-5c08-4f7c-b3f5-6b68413947a8 (non-flash)
Nov 29 17:54:20 user nova-compute[74613]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:24920064-fc81-4408-97d1-d8eff97a7554 (non-flash)
Nov 29 17:54:20 user nova-compute[74613]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8230f3a2-63d8-46cb-8ec7-ceb89fb04e53 (non-flash)
Nov 29 17:54:20 user nova-compute[74613]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d1f798a1-4f7b-4b9a-8180-fa8f4eb89bf0 (non-flash)
Nov 29 17:54:20 user nova-compute[74613]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:17b27fab-6cdb-4820-be62-ffd44e8e2fb5 (non-flash)
Nov 29 17:54:20 user nova-compute[74613]:  stderr= {{(pid=74613) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 17:54:20 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-23a466ec-4c34-4fbf-8a45-ad85d880905e tempest-TaggedBootDevicesTest_v242-869407180 tempest-TaggedBootDevicesTest_v242-869407180-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7efc2d5-5149-408b-980d-58492994fd4f (non-flash)
Nov 29 17:54:20 user nova-compute[74613]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49f19a7e-3b8b-44b4-b289-808ee2a18b91 (non-flash)
Nov 29 17:54:20 user nova-compute[74613]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a6b34bdb-5c08-4f7c-b3f5-6b68413947a8 (non-flash)
Nov 29 17:54:20 user nova-compute[74613]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:24920064-fc81-4408-97d1-d8eff97a7554 (non-flash)
Nov 29 17:54:20 user nova-compute[74613]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8230f3a2-63d8-46cb-8ec7-ceb89fb04e53 (non-flash)
Nov 29 17:54:20 user nova-compute[74613]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d1f798a1-4f7b-4b9a-8180-fa8f4eb89bf0 (non-flash)
Nov 29 17:54:20 user nova-compute[74613]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:17b27fab-6cdb-4820-be62-ffd44e8e2fb5 (non-flash)
Nov 29 17:54:20 user nova-compute[74613]:  stderr= {{(pid=74613) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 17:54:20 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-23a466ec-4c34-4fbf-8a45-ad85d880905e tempest-TaggedBootDevicesTest_v242-869407180 tempest-TaggedBootDevicesTest_v242-869407180-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7ff818324700>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:24920064-fc81-4408-97d1-d8eff97a7554'): ({'sdc'}, set())}) {{(pid=74613) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 29 17:54:20 user nova-compute[74613]: DEBUG os_brick.initiator.linuxscsi [None req-23a466ec-4c34-4fbf-8a45-ad85d880905e tempest-TaggedBootDevicesTest_v242-869407180 tempest-TaggedBootDevicesTest_v242-869407180-project-member] Removing single pathed devices sdc {{(pid=74613) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 29 17:54:20 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 17:54:20 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.017s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 17:54:20 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[880c92a5-8cb5-4c5f-9d3f-fe087ff3a1f2]: (4, ('path checker states:\nup                  7\n\npaths: 0\nbusy: False\n', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 17:54:20 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 17:54:20 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.022s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 17:54:20 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[7675c0a8-fe95-446d-92d4-afacecaa0b4b]: (4, ('ok\n', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 17:54:20 user nova-compute[74613]: DEBUG os_brick.initiator.linuxscsi [None req-23a466ec-4c34-4fbf-8a45-ad85d880905e tempest-TaggedBootDevicesTest_v242-869407180 tempest-TaggedBootDevicesTest_v242-869407180-project-member] Flushing IO for device /dev/sdc {{(pid=74613) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 29 17:54:20 user nova-compute[74613]: DEBUG nova.compute.manager [req-3a9a2b57-ebb1-4efa-97bd-5a8e59a07bed req-fae7aa85-c308-4771-92b6-c6c74fdda83f service nova] [instance: 3f285832-64a7-48e8-875a-f9e1566a66b6] Received event network-vif-plugged-75aec901-492c-47e1-9621-158f2d11a5e7 {{(pid=74613) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 17:54:20 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-3a9a2b57-ebb1-4efa-97bd-5a8e59a07bed req-fae7aa85-c308-4771-92b6-c6c74fdda83f service nova] Acquiring lock "3f285832-64a7-48e8-875a-f9e1566a66b6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 17:54:20 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-3a9a2b57-ebb1-4efa-97bd-5a8e59a07bed req-fae7aa85-c308-4771-92b6-c6c74fdda83f service nova] Lock "3f285832-64a7-48e8-875a-f9e1566a66b6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 17:54:20 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-3a9a2b57-ebb1-4efa-97bd-5a8e59a07bed req-fae7aa85-c308-4771-92b6-c6c74fdda83f service nova] Lock "3f285832-64a7-48e8-875a-f9e1566a66b6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 17:54:20 user nova-compute[74613]: DEBUG nova.compute.manager [req-3a9a2b57-ebb1-4efa-97bd-5a8e59a07bed req-fae7aa85-c308-4771-92b6-c6c74fdda83f service nova] [instance: 3f285832-64a7-48e8-875a-f9e1566a66b6] No waiting events found dispatching network-vif-plugged-75aec901-492c-47e1-9621-158f2d11a5e7 {{(pid=74613) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 17:54:20 user nova-compute[74613]: WARNING nova.compute.manager [req-3a9a2b57-ebb1-4efa-97bd-5a8e59a07bed req-fae7aa85-c308-4771-92b6-c6c74fdda83f service nova] [instance: 3f285832-64a7-48e8-875a-f9e1566a66b6] Received unexpected event network-vif-plugged-75aec901-492c-47e1-9621-158f2d11a5e7 for instance with vm_state active and task_state deleting.
Nov 29 17:54:20 user nova-compute[74613]: DEBUG nova.compute.manager [req-3a9a2b57-ebb1-4efa-97bd-5a8e59a07bed req-fae7aa85-c308-4771-92b6-c6c74fdda83f service nova] [instance: 3f285832-64a7-48e8-875a-f9e1566a66b6] Received event network-vif-unplugged-3fe23755-ec08-4b17-87b2-c1eebd36042b {{(pid=74613) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 17:54:20 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-3a9a2b57-ebb1-4efa-97bd-5a8e59a07bed req-fae7aa85-c308-4771-92b6-c6c74fdda83f service nova] Acquiring lock "3f285832-64a7-48e8-875a-f9e1566a66b6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 17:54:20 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-3a9a2b57-ebb1-4efa-97bd-5a8e59a07bed req-fae7aa85-c308-4771-92b6-c6c74fdda83f service nova] Lock "3f285832-64a7-48e8-875a-f9e1566a66b6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 17:54:20 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-3a9a2b57-ebb1-4efa-97bd-5a8e59a07bed req-fae7aa85-c308-4771-92b6-c6c74fdda83f service nova] Lock "3f285832-64a7-48e8-875a-f9e1566a66b6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 17:54:20 user nova-compute[74613]: DEBUG nova.compute.manager [req-3a9a2b57-ebb1-4efa-97bd-5a8e59a07bed req-fae7aa85-c308-4771-92b6-c6c74fdda83f service nova] [instance: 3f285832-64a7-48e8-875a-f9e1566a66b6] No waiting events found dispatching network-vif-unplugged-3fe23755-ec08-4b17-87b2-c1eebd36042b {{(pid=74613) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 17:54:20 user nova-compute[74613]: DEBUG nova.compute.manager [req-3a9a2b57-ebb1-4efa-97bd-5a8e59a07bed req-fae7aa85-c308-4771-92b6-c6c74fdda83f service nova] [instance: 3f285832-64a7-48e8-875a-f9e1566a66b6] Received event network-vif-unplugged-3fe23755-ec08-4b17-87b2-c1eebd36042b for instance with task_state deleting. {{(pid=74613) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 29 17:54:20 user nova-compute[74613]: DEBUG nova.compute.manager [req-3a9a2b57-ebb1-4efa-97bd-5a8e59a07bed req-fae7aa85-c308-4771-92b6-c6c74fdda83f service nova] [instance: 3f285832-64a7-48e8-875a-f9e1566a66b6] Received event network-vif-plugged-3fe23755-ec08-4b17-87b2-c1eebd36042b {{(pid=74613) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 17:54:20 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-3a9a2b57-ebb1-4efa-97bd-5a8e59a07bed req-fae7aa85-c308-4771-92b6-c6c74fdda83f service nova] Acquiring lock "3f285832-64a7-48e8-875a-f9e1566a66b6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 17:54:20 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-3a9a2b57-ebb1-4efa-97bd-5a8e59a07bed req-fae7aa85-c308-4771-92b6-c6c74fdda83f service nova] Lock "3f285832-64a7-48e8-875a-f9e1566a66b6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 17:54:20 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-3a9a2b57-ebb1-4efa-97bd-5a8e59a07bed req-fae7aa85-c308-4771-92b6-c6c74fdda83f service nova] Lock "3f285832-64a7-48e8-875a-f9e1566a66b6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 17:54:20 user nova-compute[74613]: DEBUG nova.compute.manager [req-3a9a2b57-ebb1-4efa-97bd-5a8e59a07bed req-fae7aa85-c308-4771-92b6-c6c74fdda83f service nova] [instance: 3f285832-64a7-48e8-875a-f9e1566a66b6] No waiting events found dispatching network-vif-plugged-3fe23755-ec08-4b17-87b2-c1eebd36042b {{(pid=74613) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 17:54:20 user nova-compute[74613]: WARNING nova.compute.manager [req-3a9a2b57-ebb1-4efa-97bd-5a8e59a07bed req-fae7aa85-c308-4771-92b6-c6c74fdda83f service nova] [instance: 3f285832-64a7-48e8-875a-f9e1566a66b6] Received unexpected event network-vif-plugged-3fe23755-ec08-4b17-87b2-c1eebd36042b for instance with vm_state active and task_state deleting.
Nov 29 17:54:20 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 17:54:20 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.013s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 17:54:20 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3b4bc87-1d63-4293-ae8e-a7f176074d26]: (4, ('', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 17:54:20 user nova-compute[74613]: DEBUG os_brick.initiator.linuxscsi [None req-23a466ec-4c34-4fbf-8a45-ad85d880905e tempest-TaggedBootDevicesTest_v242-869407180 tempest-TaggedBootDevicesTest_v242-869407180-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=74613) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 29 17:54:20 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 17:54:20 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.041s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 17:54:20 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[7cb85dd9-33bd-4973-be63-dd93566dd2b3]: (4, ('1', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 17:54:20 user nova-compute[74613]: DEBUG os_brick.initiator.linuxscsi [None req-23a466ec-4c34-4fbf-8a45-ad85d880905e tempest-TaggedBootDevicesTest_v242-869407180 tempest-TaggedBootDevicesTest_v242-869407180-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=74613) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 29 17:54:20 user nova-compute[74613]: DEBUG os_brick.initiator.linuxscsi [None req-23a466ec-4c34-4fbf-8a45-ad85d880905e tempest-TaggedBootDevicesTest_v242-869407180 tempest-TaggedBootDevicesTest_v242-869407180-project-member] SCSI volumes sdc have been removed. {{(pid=74613) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 29 17:54:20 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-23a466ec-4c34-4fbf-8a45-ad85d880905e tempest-TaggedBootDevicesTest_v242-869407180 tempest-TaggedBootDevicesTest_v242-869407180-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:24920064-fc81-4408-97d1-d8eff97a7554')] {{(pid=74613) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 29 17:54:20 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:24920064-fc81-4408-97d1-d8eff97a7554 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 17:54:20 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:24920064-fc81-4408-97d1-d8eff97a7554 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.017s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 17:54:20 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e2e530e-e2a1-4088-91c5-3b3ed72fc3f9]: (4, ('', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 17:54:20 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-23a466ec-4c34-4fbf-8a45-ad85d880905e tempest-TaggedBootDevicesTest_v242-869407180 tempest-TaggedBootDevicesTest_v242-869407180-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74613) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 17:54:20 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:24920064-fc81-4408-97d1-d8eff97a7554 -p 172.16.0.220:3260 --logout {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 17:54:20 user nova-compute[74613]: DEBUG nova.compute.manager [req-ea67a428-649e-4770-b23c-427d9dafee9d req-f2a640bd-4c9b-4771-bcab-e53f51b9db8b service nova] [instance: 3f285832-64a7-48e8-875a-f9e1566a66b6] Received event network-vif-plugged-83dc312c-87e6-47a8-b4a5-f7c3cec7ab50 {{(pid=74613) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 17:54:20 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-ea67a428-649e-4770-b23c-427d9dafee9d req-f2a640bd-4c9b-4771-bcab-e53f51b9db8b service nova] Acquiring lock "3f285832-64a7-48e8-875a-f9e1566a66b6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 17:54:20 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-ea67a428-649e-4770-b23c-427d9dafee9d req-f2a640bd-4c9b-4771-bcab-e53f51b9db8b service nova] Lock "3f285832-64a7-48e8-875a-f9e1566a66b6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 17:54:20 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-ea67a428-649e-4770-b23c-427d9dafee9d req-f2a640bd-4c9b-4771-bcab-e53f51b9db8b service nova] Lock "3f285832-64a7-48e8-875a-f9e1566a66b6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 17:54:20 user nova-compute[74613]: DEBUG nova.compute.manager [req-ea67a428-649e-4770-b23c-427d9dafee9d req-f2a640bd-4c9b-4771-bcab-e53f51b9db8b service nova] [instance: 3f285832-64a7-48e8-875a-f9e1566a66b6] No waiting events found dispatching network-vif-plugged-83dc312c-87e6-47a8-b4a5-f7c3cec7ab50 {{(pid=74613) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 17:54:20 user nova-compute[74613]: WARNING nova.compute.manager [req-ea67a428-649e-4770-b23c-427d9dafee9d req-f2a640bd-4c9b-4771-bcab-e53f51b9db8b service nova] [instance: 3f285832-64a7-48e8-875a-f9e1566a66b6] Received unexpected event network-vif-plugged-83dc312c-87e6-47a8-b4a5-f7c3cec7ab50 for instance with vm_state active and task_state deleting.
Nov 29 17:54:20 user nova-compute[74613]: DEBUG nova.compute.manager [req-ea67a428-649e-4770-b23c-427d9dafee9d req-f2a640bd-4c9b-4771-bcab-e53f51b9db8b service nova] [instance: 3f285832-64a7-48e8-875a-f9e1566a66b6] Received event network-vif-unplugged-bffa705a-58aa-4cbd-9b9d-09c8229cf829 {{(pid=74613) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 17:54:20 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-ea67a428-649e-4770-b23c-427d9dafee9d req-f2a640bd-4c9b-4771-bcab-e53f51b9db8b service nova] Acquiring lock "3f285832-64a7-48e8-875a-f9e1566a66b6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 17:54:20 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-ea67a428-649e-4770-b23c-427d9dafee9d req-f2a640bd-4c9b-4771-bcab-e53f51b9db8b service nova] Lock "3f285832-64a7-48e8-875a-f9e1566a66b6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 17:54:20 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-ea67a428-649e-4770-b23c-427d9dafee9d req-f2a640bd-4c9b-4771-bcab-e53f51b9db8b service nova] Lock "3f285832-64a7-48e8-875a-f9e1566a66b6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 17:54:20 user nova-compute[74613]: DEBUG nova.compute.manager [req-ea67a428-649e-4770-b23c-427d9dafee9d req-f2a640bd-4c9b-4771-bcab-e53f51b9db8b service nova] [instance: 3f285832-64a7-48e8-875a-f9e1566a66b6] No waiting events found dispatching network-vif-unplugged-bffa705a-58aa-4cbd-9b9d-09c8229cf829 {{(pid=74613) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 17:54:20 user nova-compute[74613]: DEBUG nova.compute.manager [req-ea67a428-649e-4770-b23c-427d9dafee9d req-f2a640bd-4c9b-4771-bcab-e53f51b9db8b service nova] [instance: 3f285832-64a7-48e8-875a-f9e1566a66b6] Received event network-vif-unplugged-bffa705a-58aa-4cbd-9b9d-09c8229cf829 for instance with task_state deleting. {{(pid=74613) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 29 17:54:20 user nova-compute[74613]: DEBUG nova.compute.manager [req-ea67a428-649e-4770-b23c-427d9dafee9d req-f2a640bd-4c9b-4771-bcab-e53f51b9db8b service nova] [instance: 3f285832-64a7-48e8-875a-f9e1566a66b6] Received event network-vif-plugged-bffa705a-58aa-4cbd-9b9d-09c8229cf829 {{(pid=74613) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 17:54:20 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-ea67a428-649e-4770-b23c-427d9dafee9d req-f2a640bd-4c9b-4771-bcab-e53f51b9db8b service nova] Acquiring lock "3f285832-64a7-48e8-875a-f9e1566a66b6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 17:54:20 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-ea67a428-649e-4770-b23c-427d9dafee9d req-f2a640bd-4c9b-4771-bcab-e53f51b9db8b service nova] Lock "3f285832-64a7-48e8-875a-f9e1566a66b6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 17:54:20 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-ea67a428-649e-4770-b23c-427d9dafee9d req-f2a640bd-4c9b-4771-bcab-e53f51b9db8b service nova] Lock "3f285832-64a7-48e8-875a-f9e1566a66b6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 17:54:20 user nova-compute[74613]: DEBUG nova.compute.manager [req-ea67a428-649e-4770-b23c-427d9dafee9d req-f2a640bd-4c9b-4771-bcab-e53f51b9db8b service nova] [instance: 3f285832-64a7-48e8-875a-f9e1566a66b6] No waiting events found dispatching network-vif-plugged-bffa705a-58aa-4cbd-9b9d-09c8229cf829 {{(pid=74613) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 17:54:20 user nova-compute[74613]: WARNING nova.compute.manager [req-ea67a428-649e-4770-b23c-427d9dafee9d req-f2a640bd-4c9b-4771-bcab-e53f51b9db8b service nova] [instance: 3f285832-64a7-48e8-875a-f9e1566a66b6] Received unexpected event network-vif-plugged-bffa705a-58aa-4cbd-9b9d-09c8229cf829 for instance with vm_state active and task_state deleting.
Nov 29 17:54:20 user nova-compute[74613]: DEBUG nova.compute.manager [req-ea67a428-649e-4770-b23c-427d9dafee9d req-f2a640bd-4c9b-4771-bcab-e53f51b9db8b service nova] [instance: 3f285832-64a7-48e8-875a-f9e1566a66b6] Received event network-vif-unplugged-48d45408-4c70-44b7-a0c3-874ad1049d1a {{(pid=74613) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 17:54:20 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-ea67a428-649e-4770-b23c-427d9dafee9d req-f2a640bd-4c9b-4771-bcab-e53f51b9db8b service nova] Acquiring lock "3f285832-64a7-48e8-875a-f9e1566a66b6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 17:54:20 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-ea67a428-649e-4770-b23c-427d9dafee9d req-f2a640bd-4c9b-4771-bcab-e53f51b9db8b service nova] Lock "3f285832-64a7-48e8-875a-f9e1566a66b6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 17:54:20 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-ea67a428-649e-4770-b23c-427d9dafee9d req-f2a640bd-4c9b-4771-bcab-e53f51b9db8b service nova] Lock "3f285832-64a7-48e8-875a-f9e1566a66b6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 17:54:20 user nova-compute[74613]: DEBUG nova.compute.manager [req-ea67a428-649e-4770-b23c-427d9dafee9d req-f2a640bd-4c9b-4771-bcab-e53f51b9db8b service nova] [instance: 3f285832-64a7-48e8-875a-f9e1566a66b6] No waiting events found dispatching network-vif-unplugged-48d45408-4c70-44b7-a0c3-874ad1049d1a {{(pid=74613) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 17:54:20 user nova-compute[74613]: DEBUG nova.compute.manager [req-ea67a428-649e-4770-b23c-427d9dafee9d req-f2a640bd-4c9b-4771-bcab-e53f51b9db8b service nova] [instance: 3f285832-64a7-48e8-875a-f9e1566a66b6] Received event network-vif-unplugged-48d45408-4c70-44b7-a0c3-874ad1049d1a for instance with task_state deleting. {{(pid=74613) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 29 17:54:20 user nova-compute[74613]: DEBUG nova.compute.manager [req-ea67a428-649e-4770-b23c-427d9dafee9d req-f2a640bd-4c9b-4771-bcab-e53f51b9db8b service nova] [instance: 3f285832-64a7-48e8-875a-f9e1566a66b6] Received event network-vif-plugged-48d45408-4c70-44b7-a0c3-874ad1049d1a {{(pid=74613) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 17:54:20 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-ea67a428-649e-4770-b23c-427d9dafee9d req-f2a640bd-4c9b-4771-bcab-e53f51b9db8b service nova] Acquiring lock "3f285832-64a7-48e8-875a-f9e1566a66b6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 17:54:20 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-ea67a428-649e-4770-b23c-427d9dafee9d req-f2a640bd-4c9b-4771-bcab-e53f51b9db8b service nova] Lock "3f285832-64a7-48e8-875a-f9e1566a66b6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 17:54:20 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-ea67a428-649e-4770-b23c-427d9dafee9d req-f2a640bd-4c9b-4771-bcab-e53f51b9db8b service nova] Lock "3f285832-64a7-48e8-875a-f9e1566a66b6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 17:54:20 user nova-compute[74613]: DEBUG nova.compute.manager [req-ea67a428-649e-4770-b23c-427d9dafee9d req-f2a640bd-4c9b-4771-bcab-e53f51b9db8b service nova] [instance: 3f285832-64a7-48e8-875a-f9e1566a66b6] No waiting events found dispatching network-vif-plugged-48d45408-4c70-44b7-a0c3-874ad1049d1a {{(pid=74613) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 17:54:20 user nova-compute[74613]: WARNING nova.compute.manager [req-ea67a428-649e-4770-b23c-427d9dafee9d req-f2a640bd-4c9b-4771-bcab-e53f51b9db8b service nova] [instance: 3f285832-64a7-48e8-875a-f9e1566a66b6] Received unexpected event network-vif-plugged-48d45408-4c70-44b7-a0c3-874ad1049d1a for instance with vm_state active and task_state deleting.
Nov 29 17:54:20 user nova-compute[74613]: DEBUG nova.compute.manager [req-8325dfc8-9e81-4058-8654-8f7643cd3662 req-4f9db806-98f1-455d-9c42-1375bb6b021b service nova] [instance: 3f285832-64a7-48e8-875a-f9e1566a66b6] Received event network-vif-plugged-d2631ae0-4218-400c-8da8-cb6d3271579d {{(pid=74613) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 17:54:20 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-8325dfc8-9e81-4058-8654-8f7643cd3662 req-4f9db806-98f1-455d-9c42-1375bb6b021b service nova] Acquiring lock "3f285832-64a7-48e8-875a-f9e1566a66b6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 17:54:20 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-8325dfc8-9e81-4058-8654-8f7643cd3662 req-4f9db806-98f1-455d-9c42-1375bb6b021b service nova] Lock "3f285832-64a7-48e8-875a-f9e1566a66b6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 17:54:20 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-8325dfc8-9e81-4058-8654-8f7643cd3662 req-4f9db806-98f1-455d-9c42-1375bb6b021b service nova] Lock "3f285832-64a7-48e8-875a-f9e1566a66b6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 17:54:20 user nova-compute[74613]: DEBUG nova.compute.manager [req-8325dfc8-9e81-4058-8654-8f7643cd3662 req-4f9db806-98f1-455d-9c42-1375bb6b021b service nova] [instance: 3f285832-64a7-48e8-875a-f9e1566a66b6] No waiting events found dispatching network-vif-plugged-d2631ae0-4218-400c-8da8-cb6d3271579d {{(pid=74613) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 17:54:20 user nova-compute[74613]: WARNING nova.compute.manager [req-8325dfc8-9e81-4058-8654-8f7643cd3662 req-4f9db806-98f1-455d-9c42-1375bb6b021b service nova] [instance: 3f285832-64a7-48e8-875a-f9e1566a66b6] Received unexpected event network-vif-plugged-d2631ae0-4218-400c-8da8-cb6d3271579d for instance with vm_state active and task_state deleting.
Nov 29 17:54:20 user nova-compute[74613]: DEBUG nova.compute.manager [req-8325dfc8-9e81-4058-8654-8f7643cd3662 req-4f9db806-98f1-455d-9c42-1375bb6b021b service nova] [instance: 3f285832-64a7-48e8-875a-f9e1566a66b6] Received event network-vif-unplugged-5ea35efd-1b2e-48eb-b8fb-fb15dab703dc {{(pid=74613) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 17:54:20 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-8325dfc8-9e81-4058-8654-8f7643cd3662 req-4f9db806-98f1-455d-9c42-1375bb6b021b service nova] Acquiring lock "3f285832-64a7-48e8-875a-f9e1566a66b6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 17:54:20 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-8325dfc8-9e81-4058-8654-8f7643cd3662 req-4f9db806-98f1-455d-9c42-1375bb6b021b service nova] Lock "3f285832-64a7-48e8-875a-f9e1566a66b6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 17:54:20 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-8325dfc8-9e81-4058-8654-8f7643cd3662 req-4f9db806-98f1-455d-9c42-1375bb6b021b service nova] Lock "3f285832-64a7-48e8-875a-f9e1566a66b6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 17:54:20 user nova-compute[74613]: DEBUG nova.compute.manager [req-8325dfc8-9e81-4058-8654-8f7643cd3662 req-4f9db806-98f1-455d-9c42-1375bb6b021b service nova] [instance: 3f285832-64a7-48e8-875a-f9e1566a66b6] No waiting events found dispatching network-vif-unplugged-5ea35efd-1b2e-48eb-b8fb-fb15dab703dc {{(pid=74613) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 17:54:20 user nova-compute[74613]: DEBUG nova.compute.manager [req-8325dfc8-9e81-4058-8654-8f7643cd3662 req-4f9db806-98f1-455d-9c42-1375bb6b021b service nova] [instance: 3f285832-64a7-48e8-875a-f9e1566a66b6] Received event network-vif-unplugged-5ea35efd-1b2e-48eb-b8fb-fb15dab703dc for instance with task_state deleting. {{(pid=74613) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 29 17:54:20 user nova-compute[74613]: DEBUG nova.compute.manager [req-8325dfc8-9e81-4058-8654-8f7643cd3662 req-4f9db806-98f1-455d-9c42-1375bb6b021b service nova] [instance: 3f285832-64a7-48e8-875a-f9e1566a66b6] Received event network-vif-plugged-5ea35efd-1b2e-48eb-b8fb-fb15dab703dc {{(pid=74613) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 17:54:20 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-8325dfc8-9e81-4058-8654-8f7643cd3662 req-4f9db806-98f1-455d-9c42-1375bb6b021b service nova] Acquiring lock "3f285832-64a7-48e8-875a-f9e1566a66b6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 17:54:20 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-8325dfc8-9e81-4058-8654-8f7643cd3662 req-4f9db806-98f1-455d-9c42-1375bb6b021b service nova] Lock "3f285832-64a7-48e8-875a-f9e1566a66b6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 17:54:20 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-8325dfc8-9e81-4058-8654-8f7643cd3662 req-4f9db806-98f1-455d-9c42-1375bb6b021b service nova] Lock "3f285832-64a7-48e8-875a-f9e1566a66b6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 17:54:20 user nova-compute[74613]: DEBUG nova.compute.manager [req-8325dfc8-9e81-4058-8654-8f7643cd3662 req-4f9db806-98f1-455d-9c42-1375bb6b021b service nova] [instance: 3f285832-64a7-48e8-875a-f9e1566a66b6] No waiting events found dispatching network-vif-plugged-5ea35efd-1b2e-48eb-b8fb-fb15dab703dc {{(pid=74613) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 17:54:20 user nova-compute[74613]: WARNING nova.compute.manager [req-8325dfc8-9e81-4058-8654-8f7643cd3662 req-4f9db806-98f1-455d-9c42-1375bb6b021b service nova] [instance: 3f285832-64a7-48e8-875a-f9e1566a66b6] Received unexpected event network-vif-plugged-5ea35efd-1b2e-48eb-b8fb-fb15dab703dc for instance with vm_state active and task_state deleting.
Nov 29 17:54:20 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:24920064-fc81-4408-97d1-d8eff97a7554 -p 172.16.0.220:3260 --logout" returned: 0 in 0.076s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 17:54:20 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[6af1a4b5-b103-4b3e-b564-404571e68523]: (4, ('Logging out of session [sid: 3, target: iqn.2010-10.org.openstack:24920064-fc81-4408-97d1-d8eff97a7554, portal: 172.16.0.220,3260]\nLogout of [sid: 3, target: iqn.2010-10.org.openstack:24920064-fc81-4408-97d1-d8eff97a7554, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 17:54:20 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-23a466ec-4c34-4fbf-8a45-ad85d880905e tempest-TaggedBootDevicesTest_v242-869407180 tempest-TaggedBootDevicesTest_v242-869407180-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 3, target: iqn.2010-10.org.openstack:24920064-fc81-4408-97d1-d8eff97a7554, portal: 172.16.0.220,3260]
Nov 29 17:54:20 user nova-compute[74613]: Logout of [sid: 3, target: iqn.2010-10.org.openstack:24920064-fc81-4408-97d1-d8eff97a7554, portal: 172.16.0.220,3260] successful.
Nov 29 17:54:20 user nova-compute[74613]:  stderr= {{(pid=74613) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 17:54:20 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:24920064-fc81-4408-97d1-d8eff97a7554 -p 172.16.0.220:3260 --op delete {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 17:54:20 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:24920064-fc81-4408-97d1-d8eff97a7554 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.037s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 17:54:20 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd8d0c02-9ff2-445f-a237-fcbb0e84877b]: (4, ('', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 17:54:20 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-23a466ec-4c34-4fbf-8a45-ad85d880905e tempest-TaggedBootDevicesTest_v242-869407180 tempest-TaggedBootDevicesTest_v242-869407180-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74613) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 17:54:20 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.base [None req-23a466ec-4c34-4fbf-8a45-ad85d880905e tempest-TaggedBootDevicesTest_v242-869407180 tempest-TaggedBootDevicesTest_v242-869407180-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.341s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 17:54:20 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-23a466ec-4c34-4fbf-8a45-ad85d880905e tempest-TaggedBootDevicesTest_v242-869407180 tempest-TaggedBootDevicesTest_v242-869407180-project-member] <== disconnect_volume: return (343ms) None {{(pid=74613) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 17:54:20 user nova-compute[74613]: DEBUG nova.virt.libvirt.volume.iscsi [None req-23a466ec-4c34-4fbf-8a45-ad85d880905e tempest-TaggedBootDevicesTest_v242-869407180 tempest-TaggedBootDevicesTest_v242-869407180-project-member] [instance: 3f285832-64a7-48e8-875a-f9e1566a66b6] Disconnected iSCSI Volume {{(pid=74613) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 29 17:54:20 user nova-compute[74613]: DEBUG nova.virt.libvirt.volume.iscsi [None req-23a466ec-4c34-4fbf-8a45-ad85d880905e tempest-TaggedBootDevicesTest_v242-869407180 tempest-TaggedBootDevicesTest_v242-869407180-project-member] [instance: 3f285832-64a7-48e8-875a-f9e1566a66b6] calling os-brick to detach iSCSI Volume {{(pid=74613) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 29 17:54:20 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-23a466ec-4c34-4fbf-8a45-ad85d880905e tempest-TaggedBootDevicesTest_v242-869407180 tempest-TaggedBootDevicesTest_v242-869407180-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff828156890>, {'target_iqn': 'iqn.2010-10.org.openstack:8230f3a2-63d8-46cb-8ec7-ceb89fb04e53', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'EmBpVyWq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': True}}" {{(pid=74613) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 17:54:20 user nova-compute[74613]: WARNING os_brick.initiator.connectors.base [None req-23a466ec-4c34-4fbf-8a45-ad85d880905e tempest-TaggedBootDevicesTest_v242-869407180 tempest-TaggedBootDevicesTest_v242-869407180-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 17:54:20 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.base [None req-23a466ec-4c34-4fbf-8a45-ad85d880905e tempest-TaggedBootDevicesTest_v242-869407180 tempest-TaggedBootDevicesTest_v242-869407180-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 17:54:20 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.base [None req-23a466ec-4c34-4fbf-8a45-ad85d880905e tempest-TaggedBootDevicesTest_v242-869407180 tempest-TaggedBootDevicesTest_v242-869407180-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 17:54:20 user nova-compute[74613]: DEBUG nova.virt.libvirt.guest [None req-221e9b1a-1b65-4670-ba37-8036c279e598 tempest-TestVolumeSwap-1038735411 tempest-TestVolumeSwap-1038735411-project-admin] COPY block job progress, current cursor: 0 final cursor: 1073741824 {{(pid=74613) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 29 17:54:20 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 17:54:20 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.026s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 17:54:20 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e168a6a-fbdf-4e71-9d1e-58d275fe1133]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:b7efc2d5-5149-408b-980d-58492994fd4f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:17b27fab-6cdb-4820-be62-ffd44e8e2fb5\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:8230f3a2-63d8-46cb-8ec7-ceb89fb04e53\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:49f19a7e-3b8b-44b4-b289-808ee2a18b91\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a6b34bdb-5c08-4f7c-b3f5-6b68413947a8\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d1f798a1-4f7b-4b9a-8180-fa8f4eb89bf0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 17:54:20 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-23a466ec-4c34-4fbf-8a45-ad85d880905e tempest-TaggedBootDevicesTest_v242-869407180 tempest-TaggedBootDevicesTest_v242-869407180-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 29 17:54:20 user nova-compute[74613]: No targets found.
Nov 29 17:54:20 user nova-compute[74613]: iSNS:
Nov 29 17:54:20 user nova-compute[74613]: No targets found.
Nov 29 17:54:20 user nova-compute[74613]: STATIC:
Nov 29 17:54:20 user nova-compute[74613]: Target: iqn.2010-10.org.openstack:b7efc2d5-5149-408b-980d-58492994fd4f
Nov 29 17:54:20 user nova-compute[74613]:         Portal: 172.16.0.220:3260,-1
Nov 29 17:54:20 user nova-compute[74613]:                 Iface Name: default
Nov 29 17:54:20 user nova-compute[74613]: Target: iqn.2010-10.org.openstack:17b27fab-6cdb-4820-be62-ffd44e8e2fb5
Nov 29 17:54:20 user nova-compute[74613]:         Portal: 172.16.0.220:3260,-1
Nov 29 17:54:20 user nova-compute[74613]:                 Iface Name: default
Nov 29 17:54:20 user nova-compute[74613]: Target: iqn.2010-10.org.openstack:8230f3a2-63d8-46cb-8ec7-ceb89fb04e53
Nov 29 17:54:20 user nova-compute[74613]:         Portal: 172.16.0.220:3260,-1
Nov 29 17:54:20 user nova-compute[74613]:                 Iface Name: default
Nov 29 17:54:20 user nova-compute[74613]: Target: iqn.2010-10.org.openstack:49f19a7e-3b8b-44b4-b289-808ee2a18b91
Nov 29 17:54:20 user nova-compute[74613]:         Portal: 172.16.0.220:3260,-1
Nov 29 17:54:20 user nova-compute[74613]:                 Iface Name: default
Nov 29 17:54:20 user nova-compute[74613]: Target: iqn.2010-10.org.openstack:a6b34bdb-5c08-4f7c-b3f5-6b68413947a8
Nov 29 17:54:20 user nova-compute[74613]:         Portal: 172.16.0.220:3260,-1
Nov 29 17:54:20 user nova-compute[74613]:                 Iface Name: default
Nov 29 17:54:20 user nova-compute[74613]: Target: iqn.2010-10.org.openstack:d1f798a1-4f7b-4b9a-8180-fa8f4eb89bf0
Nov 29 17:54:20 user nova-compute[74613]:         Portal: 172.16.0.220:3260,-1
Nov 29 17:54:20 user nova-compute[74613]:                 Iface Name: default
Nov 29 17:54:20 user nova-compute[74613]: FIRMWARE:
Nov 29 17:54:20 user nova-compute[74613]: No targets found.
Nov 29 17:54:20 user nova-compute[74613]:  stderr= {{(pid=74613) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 17:54:20 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-23a466ec-4c34-4fbf-8a45-ad85d880905e tempest-TaggedBootDevicesTest_v242-869407180 tempest-TaggedBootDevicesTest_v242-869407180-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 29 17:54:20 user nova-compute[74613]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 29 17:54:20 user nova-compute[74613]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74613) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 29 17:54:20 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-23a466ec-4c34-4fbf-8a45-ad85d880905e tempest-TaggedBootDevicesTest_v242-869407180 tempest-TaggedBootDevicesTest_v242-869407180-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8230f3a2-63d8-46cb-8ec7-ceb89fb04e53', 0)] {{(pid=74613) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 29 17:54:20 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 17:54:20 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 17:54:20 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ab704ee-20c2-4919-b4f1-000ec4abe62c]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:17b27fab-6cdb-4820-be62-ffd44e8e2fb5\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:49f19a7e-3b8b-44b4-b289-808ee2a18b91\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8230f3a2-63d8-46cb-8ec7-ceb89fb04e53\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a6b34bdb-5c08-4f7c-b3f5-6b68413947a8\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b7efc2d5-5149-408b-980d-58492994fd4f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d1f798a1-4f7b-4b9a-8180-fa8f4eb89bf0\n', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 17:54:20 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 17:54:20 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 17:54:20 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[84d84d2f-5848-4985-a412-daa458a85d8d]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7efc2d5-5149-408b-980d-58492994fd4f (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49f19a7e-3b8b-44b4-b289-808ee2a18b91 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a6b34bdb-5c08-4f7c-b3f5-6b68413947a8 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8230f3a2-63d8-46cb-8ec7-ceb89fb04e53 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d1f798a1-4f7b-4b9a-8180-fa8f4eb89bf0 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:17b27fab-6cdb-4820-be62-ffd44e8e2fb5 (non-flash)\n', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 17:54:20 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-23a466ec-4c34-4fbf-8a45-ad85d880905e tempest-TaggedBootDevicesTest_v242-869407180 tempest-TaggedBootDevicesTest_v242-869407180-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7efc2d5-5149-408b-980d-58492994fd4f (non-flash)
Nov 29 17:54:20 user nova-compute[74613]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49f19a7e-3b8b-44b4-b289-808ee2a18b91 (non-flash)
Nov 29 17:54:20 user nova-compute[74613]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a6b34bdb-5c08-4f7c-b3f5-6b68413947a8 (non-flash)
Nov 29 17:54:20 user nova-compute[74613]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8230f3a2-63d8-46cb-8ec7-ceb89fb04e53 (non-flash)
Nov 29 17:54:20 user nova-compute[74613]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d1f798a1-4f7b-4b9a-8180-fa8f4eb89bf0 (non-flash)
Nov 29 17:54:20 user nova-compute[74613]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:17b27fab-6cdb-4820-be62-ffd44e8e2fb5 (non-flash)
Nov 29 17:54:20 user nova-compute[74613]:  stderr= {{(pid=74613) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 17:54:20 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-23a466ec-4c34-4fbf-8a45-ad85d880905e tempest-TaggedBootDevicesTest_v242-869407180 tempest-TaggedBootDevicesTest_v242-869407180-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7efc2d5-5149-408b-980d-58492994fd4f (non-flash)
Nov 29 17:54:20 user nova-compute[74613]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49f19a7e-3b8b-44b4-b289-808ee2a18b91 (non-flash)
Nov 29 17:54:20 user nova-compute[74613]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a6b34bdb-5c08-4f7c-b3f5-6b68413947a8 (non-flash)
Nov 29 17:54:20 user nova-compute[74613]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8230f3a2-63d8-46cb-8ec7-ceb89fb04e53 (non-flash)
Nov 29 17:54:20 user nova-compute[74613]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d1f798a1-4f7b-4b9a-8180-fa8f4eb89bf0 (non-flash)
Nov 29 17:54:20 user nova-compute[74613]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:17b27fab-6cdb-4820-be62-ffd44e8e2fb5 (non-flash)
Nov 29 17:54:20 user nova-compute[74613]:  stderr= {{(pid=74613) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 17:54:20 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-23a466ec-4c34-4fbf-8a45-ad85d880905e tempest-TaggedBootDevicesTest_v242-869407180 tempest-TaggedBootDevicesTest_v242-869407180-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7ff8281cde10>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8230f3a2-63d8-46cb-8ec7-ceb89fb04e53'): ({'sdd'}, set())}) {{(pid=74613) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 29 17:54:20 user nova-compute[74613]: DEBUG os_brick.initiator.linuxscsi [None req-23a466ec-4c34-4fbf-8a45-ad85d880905e tempest-TaggedBootDevicesTest_v242-869407180 tempest-TaggedBootDevicesTest_v242-869407180-project-member] Removing single pathed devices sdd {{(pid=74613) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 29 17:54:20 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 17:54:20 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 17:54:20 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3f81bc2-f776-4106-bddf-fd36998b43fb]: (4, ('path checker states:\nup                  6\n\npaths: 0\nbusy: False\n', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 17:54:20 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 17:54:20 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.024s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 17:54:20 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d1a1e90-daed-4f5e-8cbf-d0da9c55c5d1]: (4, ('ok\n', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 17:54:20 user nova-compute[74613]: DEBUG os_brick.initiator.linuxscsi [None req-23a466ec-4c34-4fbf-8a45-ad85d880905e tempest-TaggedBootDevicesTest_v242-869407180 tempest-TaggedBootDevicesTest_v242-869407180-project-member] Flushing IO for device /dev/sdd {{(pid=74613) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 29 17:54:20 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 17:54:20 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.017s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 17:54:20 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[24545a0b-afbb-43bd-84c1-4e62af481707]: (4, ('', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 17:54:20 user nova-compute[74613]: DEBUG os_brick.initiator.linuxscsi [None req-23a466ec-4c34-4fbf-8a45-ad85d880905e tempest-TaggedBootDevicesTest_v242-869407180 tempest-TaggedBootDevicesTest_v242-869407180-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=74613) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 29 17:54:20 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 17:54:20 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.038s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 17:54:20 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[9db0a1d2-fbbd-4939-93ed-a433bcb19356]: (4, ('1', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 17:54:20 user nova-compute[74613]: DEBUG os_brick.initiator.linuxscsi [None req-23a466ec-4c34-4fbf-8a45-ad85d880905e tempest-TaggedBootDevicesTest_v242-869407180 tempest-TaggedBootDevicesTest_v242-869407180-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=74613) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 29 17:54:20 user nova-compute[74613]: DEBUG os_brick.initiator.linuxscsi [None req-23a466ec-4c34-4fbf-8a45-ad85d880905e tempest-TaggedBootDevicesTest_v242-869407180 tempest-TaggedBootDevicesTest_v242-869407180-project-member] SCSI volumes sdd have been removed. {{(pid=74613) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 29 17:54:20 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-23a466ec-4c34-4fbf-8a45-ad85d880905e tempest-TaggedBootDevicesTest_v242-869407180 tempest-TaggedBootDevicesTest_v242-869407180-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8230f3a2-63d8-46cb-8ec7-ceb89fb04e53')] {{(pid=74613) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 29 17:54:20 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8230f3a2-63d8-46cb-8ec7-ceb89fb04e53 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 17:54:21 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8230f3a2-63d8-46cb-8ec7-ceb89fb04e53 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.023s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 17:54:21 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[93e37a27-cd36-4cbc-83cf-5572876dcd75]: (4, ('', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 17:54:21 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-23a466ec-4c34-4fbf-8a45-ad85d880905e tempest-TaggedBootDevicesTest_v242-869407180 tempest-TaggedBootDevicesTest_v242-869407180-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74613) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 17:54:21 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8230f3a2-63d8-46cb-8ec7-ceb89fb04e53 -p 172.16.0.220:3260 --logout {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 17:54:21 user nova-compute[74613]: WARNING nova.virt.libvirt.driver [None req-0e68ea8c-7b90-4093-a721-ada659039a25 tempest-VolumesAssistedSnapshotsTest-194727756 tempest-VolumesAssistedSnapshotsTest-194727756-project-admin] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance d4ecef60-62f9-4969-b57f-3bb45a44cc9f is timed out.
Nov 29 17:54:21 user nova-compute[74613]: INFO nova.virt.libvirt.driver [None req-0e68ea8c-7b90-4093-a721-ada659039a25 tempest-VolumesAssistedSnapshotsTest-194727756 tempest-VolumesAssistedSnapshotsTest-194727756-project-admin] Successfully detached device vdb from instance d4ecef60-62f9-4969-b57f-3bb45a44cc9f from the live domain config.
Nov 29 17:54:21 user nova-compute[74613]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0e68ea8c-7b90-4093-a721-ada659039a25 tempest-VolumesAssistedSnapshotsTest-194727756 tempest-VolumesAssistedSnapshotsTest-194727756-project-admin] [instance: d4ecef60-62f9-4969-b57f-3bb45a44cc9f] calling os-brick to detach iSCSI Volume {{(pid=74613) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 29 17:54:21 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e68ea8c-7b90-4093-a721-ada659039a25 tempest-VolumesAssistedSnapshotsTest-194727756 tempest-VolumesAssistedSnapshotsTest-194727756-project-admin] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff828156890>, {'target_iqn': 'iqn.2010-10.org.openstack:17b27fab-6cdb-4820-be62-ffd44e8e2fb5', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NKsebOgY', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=74613) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 17:54:21 user nova-compute[74613]: WARNING os_brick.initiator.connectors.base [None req-0e68ea8c-7b90-4093-a721-ada659039a25 tempest-VolumesAssistedSnapshotsTest-194727756 tempest-VolumesAssistedSnapshotsTest-194727756-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 17:54:21 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.base [None req-0e68ea8c-7b90-4093-a721-ada659039a25 tempest-VolumesAssistedSnapshotsTest-194727756 tempest-VolumesAssistedSnapshotsTest-194727756-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 17:54:21 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8230f3a2-63d8-46cb-8ec7-ceb89fb04e53 -p 172.16.0.220:3260 --logout" returned: 0 in 0.079s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 17:54:21 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce82aee4-3476-4be4-88bf-8273ab6b8071]: (4, ('Logging out of session [sid: 4, target: iqn.2010-10.org.openstack:8230f3a2-63d8-46cb-8ec7-ceb89fb04e53, portal: 172.16.0.220,3260]\nLogout of [sid: 4, target: iqn.2010-10.org.openstack:8230f3a2-63d8-46cb-8ec7-ceb89fb04e53, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 17:54:21 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-23a466ec-4c34-4fbf-8a45-ad85d880905e tempest-TaggedBootDevicesTest_v242-869407180 tempest-TaggedBootDevicesTest_v242-869407180-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 4, target: iqn.2010-10.org.openstack:8230f3a2-63d8-46cb-8ec7-ceb89fb04e53, portal: 172.16.0.220,3260]
Nov 29 17:54:21 user nova-compute[74613]: Logout of [sid: 4, target: iqn.2010-10.org.openstack:8230f3a2-63d8-46cb-8ec7-ceb89fb04e53, portal: 172.16.0.220,3260] successful.
Nov 29 17:54:21 user nova-compute[74613]:  stderr= {{(pid=74613) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 17:54:21 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8230f3a2-63d8-46cb-8ec7-ceb89fb04e53 -p 172.16.0.220:3260 --op delete {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 17:54:21 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8230f3a2-63d8-46cb-8ec7-ceb89fb04e53 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.030s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 17:54:21 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[375e25ae-457d-4562-9624-d97833c00b37]: (4, ('', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 17:54:21 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-23a466ec-4c34-4fbf-8a45-ad85d880905e tempest-TaggedBootDevicesTest_v242-869407180 tempest-TaggedBootDevicesTest_v242-869407180-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74613) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 17:54:21 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.base [None req-23a466ec-4c34-4fbf-8a45-ad85d880905e tempest-TaggedBootDevicesTest_v242-869407180 tempest-TaggedBootDevicesTest_v242-869407180-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.360s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 17:54:21 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-23a466ec-4c34-4fbf-8a45-ad85d880905e tempest-TaggedBootDevicesTest_v242-869407180 tempest-TaggedBootDevicesTest_v242-869407180-project-member] <== disconnect_volume: return (362ms) None {{(pid=74613) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 17:54:21 user nova-compute[74613]: DEBUG nova.virt.libvirt.volume.iscsi [None req-23a466ec-4c34-4fbf-8a45-ad85d880905e tempest-TaggedBootDevicesTest_v242-869407180 tempest-TaggedBootDevicesTest_v242-869407180-project-member] [instance: 3f285832-64a7-48e8-875a-f9e1566a66b6] Disconnected iSCSI Volume {{(pid=74613) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 29 17:54:21 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.base [None req-0e68ea8c-7b90-4093-a721-ada659039a25 tempest-VolumesAssistedSnapshotsTest-194727756 tempest-VolumesAssistedSnapshotsTest-194727756-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.091s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 17:54:21 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 17:54:21 user nova-compute[74613]: DEBUG nova.virt.libvirt.volume.iscsi [None req-23a466ec-4c34-4fbf-8a45-ad85d880905e tempest-TaggedBootDevicesTest_v242-869407180 tempest-TaggedBootDevicesTest_v242-869407180-project-member] [instance: 3f285832-64a7-48e8-875a-f9e1566a66b6] calling os-brick to detach iSCSI Volume {{(pid=74613) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 29 17:54:21 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-23a466ec-4c34-4fbf-8a45-ad85d880905e tempest-TaggedBootDevicesTest_v242-869407180 tempest-TaggedBootDevicesTest_v242-869407180-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff828156890>, {'target_iqn': 'iqn.2010-10.org.openstack:d1f798a1-4f7b-4b9a-8180-fa8f4eb89bf0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'FoOgQJel', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': True}}" {{(pid=74613) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 17:54:21 user nova-compute[74613]: WARNING os_brick.initiator.connectors.base [None req-23a466ec-4c34-4fbf-8a45-ad85d880905e tempest-TaggedBootDevicesTest_v242-869407180 tempest-TaggedBootDevicesTest_v242-869407180-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 17:54:21 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.base [None req-23a466ec-4c34-4fbf-8a45-ad85d880905e tempest-TaggedBootDevicesTest_v242-869407180 tempest-TaggedBootDevicesTest_v242-869407180-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 17:54:21 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 17:54:21 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f542c9e-c727-453f-bca5-57e2021d9c91]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:b7efc2d5-5149-408b-980d-58492994fd4f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:17b27fab-6cdb-4820-be62-ffd44e8e2fb5\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:49f19a7e-3b8b-44b4-b289-808ee2a18b91\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a6b34bdb-5c08-4f7c-b3f5-6b68413947a8\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d1f798a1-4f7b-4b9a-8180-fa8f4eb89bf0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 17:54:21 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e68ea8c-7b90-4093-a721-ada659039a25 tempest-VolumesAssistedSnapshotsTest-194727756 tempest-VolumesAssistedSnapshotsTest-194727756-project-admin] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 29 17:54:21 user nova-compute[74613]: No targets found.
Nov 29 17:54:21 user nova-compute[74613]: iSNS:
Nov 29 17:54:21 user nova-compute[74613]: No targets found.
Nov 29 17:54:21 user nova-compute[74613]: STATIC:
Nov 29 17:54:21 user nova-compute[74613]: Target: iqn.2010-10.org.openstack:b7efc2d5-5149-408b-980d-58492994fd4f
Nov 29 17:54:21 user nova-compute[74613]:         Portal: 172.16.0.220:3260,-1
Nov 29 17:54:21 user nova-compute[74613]:                 Iface Name: default
Nov 29 17:54:21 user nova-compute[74613]: Target: iqn.2010-10.org.openstack:17b27fab-6cdb-4820-be62-ffd44e8e2fb5
Nov 29 17:54:21 user nova-compute[74613]:         Portal: 172.16.0.220:3260,-1
Nov 29 17:54:21 user nova-compute[74613]:                 Iface Name: default
Nov 29 17:54:21 user nova-compute[74613]: Target: iqn.2010-10.org.openstack:49f19a7e-3b8b-44b4-b289-808ee2a18b91
Nov 29 17:54:21 user nova-compute[74613]:         Portal: 172.16.0.220:3260,-1
Nov 29 17:54:21 user nova-compute[74613]:                 Iface Name: default
Nov 29 17:54:21 user nova-compute[74613]: Target: iqn.2010-10.org.openstack:a6b34bdb-5c08-4f7c-b3f5-6b68413947a8
Nov 29 17:54:21 user nova-compute[74613]:         Portal: 172.16.0.220:3260,-1
Nov 29 17:54:21 user nova-compute[74613]:                 Iface Name: default
Nov 29 17:54:21 user nova-compute[74613]: Target: iqn.2010-10.org.openstack:d1f798a1-4f7b-4b9a-8180-fa8f4eb89bf0
Nov 29 17:54:21 user nova-compute[74613]:         Portal: 172.16.0.220:3260,-1
Nov 29 17:54:21 user nova-compute[74613]:                 Iface Name: default
Nov 29 17:54:21 user nova-compute[74613]: FIRMWARE:
Nov 29 17:54:21 user nova-compute[74613]: No targets found.
Nov 29 17:54:21 user nova-compute[74613]:  stderr= {{(pid=74613) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 17:54:21 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e68ea8c-7b90-4093-a721-ada659039a25 tempest-VolumesAssistedSnapshotsTest-194727756 tempest-VolumesAssistedSnapshotsTest-194727756-project-admin] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 29 17:54:21 user nova-compute[74613]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 29 17:54:21 user nova-compute[74613]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74613) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 29 17:54:21 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e68ea8c-7b90-4093-a721-ada659039a25 tempest-VolumesAssistedSnapshotsTest-194727756 tempest-VolumesAssistedSnapshotsTest-194727756-project-admin] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:17b27fab-6cdb-4820-be62-ffd44e8e2fb5', 0)] {{(pid=74613) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 29 17:54:21 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 17:54:21 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 17:54:21 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[fee9cc06-19c2-4afd-9c3a-61f79b08e088]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:17b27fab-6cdb-4820-be62-ffd44e8e2fb5\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:49f19a7e-3b8b-44b4-b289-808ee2a18b91\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a6b34bdb-5c08-4f7c-b3f5-6b68413947a8\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b7efc2d5-5149-408b-980d-58492994fd4f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d1f798a1-4f7b-4b9a-8180-fa8f4eb89bf0\n', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 17:54:21 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 17:54:21 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 17:54:21 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[336089a6-2ffe-4267-a203-183e0fd9acfd]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7efc2d5-5149-408b-980d-58492994fd4f (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49f19a7e-3b8b-44b4-b289-808ee2a18b91 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a6b34bdb-5c08-4f7c-b3f5-6b68413947a8 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d1f798a1-4f7b-4b9a-8180-fa8f4eb89bf0 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:17b27fab-6cdb-4820-be62-ffd44e8e2fb5 (non-flash)\n', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 17:54:21 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e68ea8c-7b90-4093-a721-ada659039a25 tempest-VolumesAssistedSnapshotsTest-194727756 tempest-VolumesAssistedSnapshotsTest-194727756-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7efc2d5-5149-408b-980d-58492994fd4f (non-flash)
Nov 29 17:54:21 user nova-compute[74613]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49f19a7e-3b8b-44b4-b289-808ee2a18b91 (non-flash)
Nov 29 17:54:21 user nova-compute[74613]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a6b34bdb-5c08-4f7c-b3f5-6b68413947a8 (non-flash)
Nov 29 17:54:21 user nova-compute[74613]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d1f798a1-4f7b-4b9a-8180-fa8f4eb89bf0 (non-flash)
Nov 29 17:54:21 user nova-compute[74613]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:17b27fab-6cdb-4820-be62-ffd44e8e2fb5 (non-flash)
Nov 29 17:54:21 user nova-compute[74613]:  stderr= {{(pid=74613) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 17:54:21 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e68ea8c-7b90-4093-a721-ada659039a25 tempest-VolumesAssistedSnapshotsTest-194727756 tempest-VolumesAssistedSnapshotsTest-194727756-project-admin] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7efc2d5-5149-408b-980d-58492994fd4f (non-flash)
Nov 29 17:54:21 user nova-compute[74613]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49f19a7e-3b8b-44b4-b289-808ee2a18b91 (non-flash)
Nov 29 17:54:21 user nova-compute[74613]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a6b34bdb-5c08-4f7c-b3f5-6b68413947a8 (non-flash)
Nov 29 17:54:21 user nova-compute[74613]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d1f798a1-4f7b-4b9a-8180-fa8f4eb89bf0 (non-flash)
Nov 29 17:54:21 user nova-compute[74613]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:17b27fab-6cdb-4820-be62-ffd44e8e2fb5 (non-flash)
Nov 29 17:54:21 user nova-compute[74613]:  stderr= {{(pid=74613) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 17:54:21 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e68ea8c-7b90-4093-a721-ada659039a25 tempest-VolumesAssistedSnapshotsTest-194727756 tempest-VolumesAssistedSnapshotsTest-194727756-project-admin] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7ff8281cde10>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:17b27fab-6cdb-4820-be62-ffd44e8e2fb5'): ({'sdb'}, set())}) {{(pid=74613) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 29 17:54:21 user nova-compute[74613]: DEBUG os_brick.initiator.linuxscsi [None req-0e68ea8c-7b90-4093-a721-ada659039a25 tempest-VolumesAssistedSnapshotsTest-194727756 tempest-VolumesAssistedSnapshotsTest-194727756-project-admin] Removing single pathed devices sdb {{(pid=74613) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 29 17:54:21 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 17:54:21 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 17:54:21 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[b14d182d-1e54-41dc-ad8f-4e44d8891ea9]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 17:54:21 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 17:54:21 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.017s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 17:54:21 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[068041e2-b1eb-45c5-8928-a654afe2792d]: (4, ('ok\n', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 17:54:21 user nova-compute[74613]: DEBUG os_brick.initiator.linuxscsi [None req-0e68ea8c-7b90-4093-a721-ada659039a25 tempest-VolumesAssistedSnapshotsTest-194727756 tempest-VolumesAssistedSnapshotsTest-194727756-project-admin] Flushing IO for device /dev/sdb {{(pid=74613) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 29 17:54:21 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 17:54:21 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 17:54:21 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2e5efda-a567-4923-8143-77d1e90cb69e]: (4, ('', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 17:54:21 user nova-compute[74613]: DEBUG os_brick.initiator.linuxscsi [None req-0e68ea8c-7b90-4093-a721-ada659039a25 tempest-VolumesAssistedSnapshotsTest-194727756 tempest-VolumesAssistedSnapshotsTest-194727756-project-admin] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74613) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 29 17:54:21 user nova-compute[74613]: DEBUG nova.virt.libvirt.guest [None req-221e9b1a-1b65-4670-ba37-8036c279e598 tempest-TestVolumeSwap-1038735411 tempest-TestVolumeSwap-1038735411-project-admin] COPY block job progress, current cursor: 92274688 final cursor: 1073741824 {{(pid=74613) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 29 17:54:21 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 17:54:21 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.045s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 17:54:21 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9349d7d-31ff-4bb3-bb3c-dd9d69cdfdfd]: (4, ('1', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 17:54:21 user nova-compute[74613]: DEBUG os_brick.initiator.linuxscsi [None req-0e68ea8c-7b90-4093-a721-ada659039a25 tempest-VolumesAssistedSnapshotsTest-194727756 tempest-VolumesAssistedSnapshotsTest-194727756-project-admin] Checking to see if SCSI volumes sdb have been removed. {{(pid=74613) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 29 17:54:21 user nova-compute[74613]: DEBUG os_brick.initiator.linuxscsi [None req-0e68ea8c-7b90-4093-a721-ada659039a25 tempest-VolumesAssistedSnapshotsTest-194727756 tempest-VolumesAssistedSnapshotsTest-194727756-project-admin] SCSI volumes sdb have been removed. {{(pid=74613) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 29 17:54:21 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e68ea8c-7b90-4093-a721-ada659039a25 tempest-VolumesAssistedSnapshotsTest-194727756 tempest-VolumesAssistedSnapshotsTest-194727756-project-admin] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:17b27fab-6cdb-4820-be62-ffd44e8e2fb5')] {{(pid=74613) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 29 17:54:21 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:17b27fab-6cdb-4820-be62-ffd44e8e2fb5 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 17:54:21 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:17b27fab-6cdb-4820-be62-ffd44e8e2fb5 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 17:54:21 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[9dad8a51-a9c8-4aa9-a637-a9b58332b203]: (4, ('', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 17:54:21 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e68ea8c-7b90-4093-a721-ada659039a25 tempest-VolumesAssistedSnapshotsTest-194727756 tempest-VolumesAssistedSnapshotsTest-194727756-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74613) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 17:54:21 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:17b27fab-6cdb-4820-be62-ffd44e8e2fb5 -p 172.16.0.220:3260 --logout {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 17:54:21 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:17b27fab-6cdb-4820-be62-ffd44e8e2fb5 -p 172.16.0.220:3260 --logout" returned: 0 in 0.063s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 17:54:21 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[473f452a-977c-47ca-b1c5-a8922e100326]: (4, ('Logging out of session [sid: 9, target: iqn.2010-10.org.openstack:17b27fab-6cdb-4820-be62-ffd44e8e2fb5, portal: 172.16.0.220,3260]\nLogout of [sid: 9, target: iqn.2010-10.org.openstack:17b27fab-6cdb-4820-be62-ffd44e8e2fb5, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 17:54:21 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e68ea8c-7b90-4093-a721-ada659039a25 tempest-VolumesAssistedSnapshotsTest-194727756 tempest-VolumesAssistedSnapshotsTest-194727756-project-admin] iscsiadm ('--logout',): stdout=Logging out of session [sid: 9, target: iqn.2010-10.org.openstack:17b27fab-6cdb-4820-be62-ffd44e8e2fb5, portal: 172.16.0.220,3260]
Nov 29 17:54:21 user nova-compute[74613]: Logout of [sid: 9, target: iqn.2010-10.org.openstack:17b27fab-6cdb-4820-be62-ffd44e8e2fb5, portal: 172.16.0.220,3260] successful.
Nov 29 17:54:21 user nova-compute[74613]:  stderr= {{(pid=74613) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 17:54:21 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:17b27fab-6cdb-4820-be62-ffd44e8e2fb5 -p 172.16.0.220:3260 --op delete {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 17:54:21 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:17b27fab-6cdb-4820-be62-ffd44e8e2fb5 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.029s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 17:54:21 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0af30e9-87c6-4c2c-b843-57b87fa0702a]: (4, ('', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 17:54:21 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e68ea8c-7b90-4093-a721-ada659039a25 tempest-VolumesAssistedSnapshotsTest-194727756 tempest-VolumesAssistedSnapshotsTest-194727756-project-admin] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74613) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 17:54:21 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.base [None req-0e68ea8c-7b90-4093-a721-ada659039a25 tempest-VolumesAssistedSnapshotsTest-194727756 tempest-VolumesAssistedSnapshotsTest-194727756-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.321s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 17:54:21 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e68ea8c-7b90-4093-a721-ada659039a25 tempest-VolumesAssistedSnapshotsTest-194727756 tempest-VolumesAssistedSnapshotsTest-194727756-project-admin] <== disconnect_volume: return (413ms) None {{(pid=74613) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 17:54:21 user nova-compute[74613]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0e68ea8c-7b90-4093-a721-ada659039a25 tempest-VolumesAssistedSnapshotsTest-194727756 tempest-VolumesAssistedSnapshotsTest-194727756-project-admin] [instance: d4ecef60-62f9-4969-b57f-3bb45a44cc9f] Disconnected iSCSI Volume {{(pid=74613) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 29 17:54:21 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.base [None req-23a466ec-4c34-4fbf-8a45-ad85d880905e tempest-TaggedBootDevicesTest_v242-869407180 tempest-TaggedBootDevicesTest_v242-869407180-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.327s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 17:54:21 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 17:54:21 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 17:54:21 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a201725-ff5f-4337-8443-1d546223dc39]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:b7efc2d5-5149-408b-980d-58492994fd4f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:49f19a7e-3b8b-44b4-b289-808ee2a18b91\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a6b34bdb-5c08-4f7c-b3f5-6b68413947a8\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d1f798a1-4f7b-4b9a-8180-fa8f4eb89bf0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 17:54:21 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-23a466ec-4c34-4fbf-8a45-ad85d880905e tempest-TaggedBootDevicesTest_v242-869407180 tempest-TaggedBootDevicesTest_v242-869407180-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 29 17:54:21 user nova-compute[74613]: No targets found.
Nov 29 17:54:21 user nova-compute[74613]: iSNS:
Nov 29 17:54:21 user nova-compute[74613]: No targets found.
Nov 29 17:54:21 user nova-compute[74613]: STATIC:
Nov 29 17:54:21 user nova-compute[74613]: Target: iqn.2010-10.org.openstack:b7efc2d5-5149-408b-980d-58492994fd4f
Nov 29 17:54:21 user nova-compute[74613]:         Portal: 172.16.0.220:3260,-1
Nov 29 17:54:21 user nova-compute[74613]:                 Iface Name: default
Nov 29 17:54:21 user nova-compute[74613]: Target: iqn.2010-10.org.openstack:49f19a7e-3b8b-44b4-b289-808ee2a18b91
Nov 29 17:54:21 user nova-compute[74613]:         Portal: 172.16.0.220:3260,-1
Nov 29 17:54:21 user nova-compute[74613]:                 Iface Name: default
Nov 29 17:54:21 user nova-compute[74613]: Target: iqn.2010-10.org.openstack:a6b34bdb-5c08-4f7c-b3f5-6b68413947a8
Nov 29 17:54:21 user nova-compute[74613]:         Portal: 172.16.0.220:3260,-1
Nov 29 17:54:21 user nova-compute[74613]:                 Iface Name: default
Nov 29 17:54:21 user nova-compute[74613]: Target: iqn.2010-10.org.openstack:d1f798a1-4f7b-4b9a-8180-fa8f4eb89bf0
Nov 29 17:54:21 user nova-compute[74613]:         Portal: 172.16.0.220:3260,-1
Nov 29 17:54:21 user nova-compute[74613]:                 Iface Name: default
Nov 29 17:54:21 user nova-compute[74613]: FIRMWARE:
Nov 29 17:54:21 user nova-compute[74613]: No targets found.
Nov 29 17:54:21 user nova-compute[74613]:  stderr= {{(pid=74613) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 17:54:21 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-23a466ec-4c34-4fbf-8a45-ad85d880905e tempest-TaggedBootDevicesTest_v242-869407180 tempest-TaggedBootDevicesTest_v242-869407180-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 29 17:54:21 user nova-compute[74613]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 29 17:54:21 user nova-compute[74613]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74613) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 29 17:54:21 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-23a466ec-4c34-4fbf-8a45-ad85d880905e tempest-TaggedBootDevicesTest_v242-869407180 tempest-TaggedBootDevicesTest_v242-869407180-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d1f798a1-4f7b-4b9a-8180-fa8f4eb89bf0', 0)] {{(pid=74613) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 29 17:54:21 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 17:54:21 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 17:54:21 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b00deba-6b7a-47b6-8688-5ef876fe7d61]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:49f19a7e-3b8b-44b4-b289-808ee2a18b91\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a6b34bdb-5c08-4f7c-b3f5-6b68413947a8\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b7efc2d5-5149-408b-980d-58492994fd4f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d1f798a1-4f7b-4b9a-8180-fa8f4eb89bf0\n', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 17:54:21 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 17:54:21 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 17:54:21 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[016b0308-6d93-43f4-855f-5040f89693c3]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7efc2d5-5149-408b-980d-58492994fd4f (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49f19a7e-3b8b-44b4-b289-808ee2a18b91 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a6b34bdb-5c08-4f7c-b3f5-6b68413947a8 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d1f798a1-4f7b-4b9a-8180-fa8f4eb89bf0 (non-flash)\n', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 17:54:21 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-23a466ec-4c34-4fbf-8a45-ad85d880905e tempest-TaggedBootDevicesTest_v242-869407180 tempest-TaggedBootDevicesTest_v242-869407180-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7efc2d5-5149-408b-980d-58492994fd4f (non-flash)
Nov 29 17:54:21 user nova-compute[74613]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49f19a7e-3b8b-44b4-b289-808ee2a18b91 (non-flash)
Nov 29 17:54:21 user nova-compute[74613]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a6b34bdb-5c08-4f7c-b3f5-6b68413947a8 (non-flash)
Nov 29 17:54:21 user nova-compute[74613]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d1f798a1-4f7b-4b9a-8180-fa8f4eb89bf0 (non-flash)
Nov 29 17:54:21 user nova-compute[74613]:  stderr= {{(pid=74613) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 17:54:21 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-23a466ec-4c34-4fbf-8a45-ad85d880905e tempest-TaggedBootDevicesTest_v242-869407180 tempest-TaggedBootDevicesTest_v242-869407180-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7efc2d5-5149-408b-980d-58492994fd4f (non-flash)
Nov 29 17:54:21 user nova-compute[74613]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49f19a7e-3b8b-44b4-b289-808ee2a18b91 (non-flash)
Nov 29 17:54:21 user nova-compute[74613]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a6b34bdb-5c08-4f7c-b3f5-6b68413947a8 (non-flash)
Nov 29 17:54:21 user nova-compute[74613]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d1f798a1-4f7b-4b9a-8180-fa8f4eb89bf0 (non-flash)
Nov 29 17:54:21 user nova-compute[74613]:  stderr= {{(pid=74613) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 17:54:21 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-23a466ec-4c34-4fbf-8a45-ad85d880905e tempest-TaggedBootDevicesTest_v242-869407180 tempest-TaggedBootDevicesTest_v242-869407180-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7ff818327640>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d1f798a1-4f7b-4b9a-8180-fa8f4eb89bf0'): ({'sde'}, set())}) {{(pid=74613) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 29 17:54:21 user nova-compute[74613]: DEBUG os_brick.initiator.linuxscsi [None req-23a466ec-4c34-4fbf-8a45-ad85d880905e tempest-TaggedBootDevicesTest_v242-869407180 tempest-TaggedBootDevicesTest_v242-869407180-project-member] Removing single pathed devices sde {{(pid=74613) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 29 17:54:21 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 17:54:21 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 17:54:21 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[e545188d-a3c0-40cc-9def-b6dea3fda34c]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 17:54:21 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 17:54:21 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.020s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 17:54:21 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[9196e0a5-bedb-40d3-8dbd-d81e1eb961d2]: (4, ('ok\n', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 17:54:21 user nova-compute[74613]: DEBUG os_brick.initiator.linuxscsi [None req-23a466ec-4c34-4fbf-8a45-ad85d880905e tempest-TaggedBootDevicesTest_v242-869407180 tempest-TaggedBootDevicesTest_v242-869407180-project-member] Flushing IO for device /dev/sde {{(pid=74613) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 29 17:54:21 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 17:54:21 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.016s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 17:54:21 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[23ca27f4-0156-47ab-bf25-60623c8b225e]: (4, ('', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 17:54:21 user nova-compute[74613]: DEBUG os_brick.initiator.linuxscsi [None req-23a466ec-4c34-4fbf-8a45-ad85d880905e tempest-TaggedBootDevicesTest_v242-869407180 tempest-TaggedBootDevicesTest_v242-869407180-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=74613) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 29 17:54:21 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 17:54:21 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.041s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 17:54:21 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[8af7a9b4-ffeb-44d7-9d95-1dfe4e6fdbca]: (4, ('1', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 17:54:21 user nova-compute[74613]: DEBUG os_brick.initiator.linuxscsi [None req-23a466ec-4c34-4fbf-8a45-ad85d880905e tempest-TaggedBootDevicesTest_v242-869407180 tempest-TaggedBootDevicesTest_v242-869407180-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=74613) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 29 17:54:21 user nova-compute[74613]: DEBUG os_brick.initiator.linuxscsi [None req-23a466ec-4c34-4fbf-8a45-ad85d880905e tempest-TaggedBootDevicesTest_v242-869407180 tempest-TaggedBootDevicesTest_v242-869407180-project-member] SCSI volumes sde have been removed. {{(pid=74613) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 29 17:54:21 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-23a466ec-4c34-4fbf-8a45-ad85d880905e tempest-TaggedBootDevicesTest_v242-869407180 tempest-TaggedBootDevicesTest_v242-869407180-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d1f798a1-4f7b-4b9a-8180-fa8f4eb89bf0')] {{(pid=74613) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 29 17:54:21 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d1f798a1-4f7b-4b9a-8180-fa8f4eb89bf0 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 17:54:21 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d1f798a1-4f7b-4b9a-8180-fa8f4eb89bf0 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.039s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 17:54:21 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[10463dd7-b2f5-4f1b-9712-3b082a915089]: (4, ('', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 17:54:21 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-23a466ec-4c34-4fbf-8a45-ad85d880905e tempest-TaggedBootDevicesTest_v242-869407180 tempest-TaggedBootDevicesTest_v242-869407180-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74613) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 17:54:21 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d1f798a1-4f7b-4b9a-8180-fa8f4eb89bf0 -p 172.16.0.220:3260 --logout {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 17:54:21 user nova-compute[74613]: DEBUG nova.virt.libvirt.guest [None req-221e9b1a-1b65-4670-ba37-8036c279e598 tempest-TestVolumeSwap-1038735411 tempest-TestVolumeSwap-1038735411-project-admin] COPY block job progress, current cursor: 218103808 final cursor: 1073741824 {{(pid=74613) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 29 17:54:21 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d1f798a1-4f7b-4b9a-8180-fa8f4eb89bf0 -p 172.16.0.220:3260 --logout" returned: 0 in 0.077s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 17:54:21 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b9a9b1e-e368-4aab-932b-9073b066c8b0]: (4, ('Logging out of session [sid: 5, target: iqn.2010-10.org.openstack:d1f798a1-4f7b-4b9a-8180-fa8f4eb89bf0, portal: 172.16.0.220,3260]\nLogout of [sid: 5, target: iqn.2010-10.org.openstack:d1f798a1-4f7b-4b9a-8180-fa8f4eb89bf0, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 17:54:21 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-23a466ec-4c34-4fbf-8a45-ad85d880905e tempest-TaggedBootDevicesTest_v242-869407180 tempest-TaggedBootDevicesTest_v242-869407180-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 5, target: iqn.2010-10.org.openstack:d1f798a1-4f7b-4b9a-8180-fa8f4eb89bf0, portal: 172.16.0.220,3260]
Nov 29 17:54:21 user nova-compute[74613]: Logout of [sid: 5, target: iqn.2010-10.org.openstack:d1f798a1-4f7b-4b9a-8180-fa8f4eb89bf0, portal: 172.16.0.220,3260] successful.
Nov 29 17:54:21 user nova-compute[74613]:  stderr= {{(pid=74613) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 17:54:21 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d1f798a1-4f7b-4b9a-8180-fa8f4eb89bf0 -p 172.16.0.220:3260 --op delete {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 17:54:21 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d1f798a1-4f7b-4b9a-8180-fa8f4eb89bf0 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.026s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 17:54:21 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8f0fd78-564f-4b8e-a40f-58d6715954bf]: (4, ('', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 17:54:21 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-23a466ec-4c34-4fbf-8a45-ad85d880905e tempest-TaggedBootDevicesTest_v242-869407180 tempest-TaggedBootDevicesTest_v242-869407180-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74613) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 17:54:21 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.base [None req-23a466ec-4c34-4fbf-8a45-ad85d880905e tempest-TaggedBootDevicesTest_v242-869407180 tempest-TaggedBootDevicesTest_v242-869407180-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.365s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 17:54:21 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-23a466ec-4c34-4fbf-8a45-ad85d880905e tempest-TaggedBootDevicesTest_v242-869407180 tempest-TaggedBootDevicesTest_v242-869407180-project-member] <== disconnect_volume: return (692ms) None {{(pid=74613) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 17:54:21 user nova-compute[74613]: DEBUG nova.virt.libvirt.volume.iscsi [None req-23a466ec-4c34-4fbf-8a45-ad85d880905e tempest-TaggedBootDevicesTest_v242-869407180 tempest-TaggedBootDevicesTest_v242-869407180-project-member] [instance: 3f285832-64a7-48e8-875a-f9e1566a66b6] Disconnected iSCSI Volume {{(pid=74613) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 29 17:54:21 user nova-compute[74613]: INFO nova.virt.libvirt.driver [None req-23a466ec-4c34-4fbf-8a45-ad85d880905e tempest-TaggedBootDevicesTest_v242-869407180 tempest-TaggedBootDevicesTest_v242-869407180-project-member] [instance: 3f285832-64a7-48e8-875a-f9e1566a66b6] Deleting instance files /opt/stack/data/nova/instances/3f285832-64a7-48e8-875a-f9e1566a66b6_del
Nov 29 17:54:21 user nova-compute[74613]: INFO nova.virt.libvirt.driver [None req-23a466ec-4c34-4fbf-8a45-ad85d880905e tempest-TaggedBootDevicesTest_v242-869407180 tempest-TaggedBootDevicesTest_v242-869407180-project-member] [instance: 3f285832-64a7-48e8-875a-f9e1566a66b6] Deletion of /opt/stack/data/nova/instances/3f285832-64a7-48e8-875a-f9e1566a66b6_del complete
Nov 29 17:54:21 user nova-compute[74613]: INFO nova.compute.manager [None req-23a466ec-4c34-4fbf-8a45-ad85d880905e tempest-TaggedBootDevicesTest_v242-869407180 tempest-TaggedBootDevicesTest_v242-869407180-project-member] [instance: 3f285832-64a7-48e8-875a-f9e1566a66b6] Took 3.83 seconds to destroy the instance on the hypervisor.
Nov 29 17:54:21 user nova-compute[74613]: DEBUG oslo.service.loopingcall [None req-23a466ec-4c34-4fbf-8a45-ad85d880905e tempest-TaggedBootDevicesTest_v242-869407180 tempest-TaggedBootDevicesTest_v242-869407180-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74613) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 29 17:54:21 user nova-compute[74613]: DEBUG nova.compute.manager [-] [instance: 3f285832-64a7-48e8-875a-f9e1566a66b6] Deallocating network for instance {{(pid=74613) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 29 17:54:21 user nova-compute[74613]: DEBUG nova.network.neutron [-] [instance: 3f285832-64a7-48e8-875a-f9e1566a66b6] deallocate_for_instance() {{(pid=74613) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 29 17:54:22 user nova-compute[74613]: DEBUG nova.virt.libvirt.guest [None req-221e9b1a-1b65-4670-ba37-8036c279e598 tempest-TestVolumeSwap-1038735411 tempest-TestVolumeSwap-1038735411-project-admin] COPY block job progress, current cursor: 256901120 final cursor: 1073741824 {{(pid=74613) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 29 17:54:22 user nova-compute[74613]: DEBUG nova.virt.libvirt.guest [None req-221e9b1a-1b65-4670-ba37-8036c279e598 tempest-TestVolumeSwap-1038735411 tempest-TestVolumeSwap-1038735411-project-admin] COPY block job progress, current cursor: 324009984 final cursor: 1073741824 {{(pid=74613) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 29 17:54:22 user nova-compute[74613]: DEBUG nova.objects.instance [None req-0e68ea8c-7b90-4093-a721-ada659039a25 tempest-VolumesAssistedSnapshotsTest-194727756 tempest-VolumesAssistedSnapshotsTest-194727756-project-admin] Lazy-loading 'flavor' on Instance uuid d4ecef60-62f9-4969-b57f-3bb45a44cc9f {{(pid=74613) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 17:54:23 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-0e68ea8c-7b90-4093-a721-ada659039a25 tempest-VolumesAssistedSnapshotsTest-194727756 tempest-VolumesAssistedSnapshotsTest-194727756-project-admin] Lock "d4ecef60-62f9-4969-b57f-3bb45a44cc9f" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.949s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 17:54:23 user nova-compute[74613]: WARNING nova.virt.libvirt.driver [None req-8346025d-1b9d-4c86-b9e8-a65bda22b984 tempest-TaggedAttachmentsTest-1438740121 tempest-TaggedAttachmentsTest-1438740121-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 288b8261-8706-4696-879d-d4dd01ab553e is timed out.
Nov 29 17:54:23 user nova-compute[74613]: INFO nova.virt.libvirt.driver [None req-8346025d-1b9d-4c86-b9e8-a65bda22b984 tempest-TaggedAttachmentsTest-1438740121 tempest-TaggedAttachmentsTest-1438740121-project-member] Successfully detached device vdb from instance 288b8261-8706-4696-879d-d4dd01ab553e from the live domain config.
Nov 29 17:54:23 user nova-compute[74613]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8346025d-1b9d-4c86-b9e8-a65bda22b984 tempest-TaggedAttachmentsTest-1438740121 tempest-TaggedAttachmentsTest-1438740121-project-member] [instance: 288b8261-8706-4696-879d-d4dd01ab553e] calling os-brick to detach iSCSI Volume {{(pid=74613) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 29 17:54:23 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-8346025d-1b9d-4c86-b9e8-a65bda22b984 tempest-TaggedAttachmentsTest-1438740121 tempest-TaggedAttachmentsTest-1438740121-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff828156890>, {'target_iqn': 'iqn.2010-10.org.openstack:b7efc2d5-5149-408b-980d-58492994fd4f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xiEOpyjN', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdh'}, None), 'kwargs': False}}" {{(pid=74613) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 17:54:23 user nova-compute[74613]: WARNING os_brick.initiator.connectors.base [None req-8346025d-1b9d-4c86-b9e8-a65bda22b984 tempest-TaggedAttachmentsTest-1438740121 tempest-TaggedAttachmentsTest-1438740121-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 17:54:23 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.base [None req-8346025d-1b9d-4c86-b9e8-a65bda22b984 tempest-TaggedAttachmentsTest-1438740121 tempest-TaggedAttachmentsTest-1438740121-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 17:54:23 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.base [None req-8346025d-1b9d-4c86-b9e8-a65bda22b984 tempest-TaggedAttachmentsTest-1438740121 tempest-TaggedAttachmentsTest-1438740121-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 17:54:23 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 17:54:23 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 17:54:23 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[20e71afc-7340-47d4-ab14-e59c5a2c1124]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:b7efc2d5-5149-408b-980d-58492994fd4f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:49f19a7e-3b8b-44b4-b289-808ee2a18b91\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a6b34bdb-5c08-4f7c-b3f5-6b68413947a8\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 17:54:23 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-8346025d-1b9d-4c86-b9e8-a65bda22b984 tempest-TaggedAttachmentsTest-1438740121 tempest-TaggedAttachmentsTest-1438740121-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 29 17:54:23 user nova-compute[74613]: No targets found.
Nov 29 17:54:23 user nova-compute[74613]: iSNS:
Nov 29 17:54:23 user nova-compute[74613]: No targets found.
Nov 29 17:54:23 user nova-compute[74613]: STATIC:
Nov 29 17:54:23 user nova-compute[74613]: Target: iqn.2010-10.org.openstack:b7efc2d5-5149-408b-980d-58492994fd4f
Nov 29 17:54:23 user nova-compute[74613]:         Portal: 172.16.0.220:3260,-1
Nov 29 17:54:23 user nova-compute[74613]:                 Iface Name: default
Nov 29 17:54:23 user nova-compute[74613]: Target: iqn.2010-10.org.openstack:49f19a7e-3b8b-44b4-b289-808ee2a18b91
Nov 29 17:54:23 user nova-compute[74613]:         Portal: 172.16.0.220:3260,-1
Nov 29 17:54:23 user nova-compute[74613]:                 Iface Name: default
Nov 29 17:54:23 user nova-compute[74613]: Target: iqn.2010-10.org.openstack:a6b34bdb-5c08-4f7c-b3f5-6b68413947a8
Nov 29 17:54:23 user nova-compute[74613]:         Portal: 172.16.0.220:3260,-1
Nov 29 17:54:23 user nova-compute[74613]:                 Iface Name: default
Nov 29 17:54:23 user nova-compute[74613]: FIRMWARE:
Nov 29 17:54:23 user nova-compute[74613]: No targets found.
Nov 29 17:54:23 user nova-compute[74613]:  stderr= {{(pid=74613) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 17:54:23 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-8346025d-1b9d-4c86-b9e8-a65bda22b984 tempest-TaggedAttachmentsTest-1438740121 tempest-TaggedAttachmentsTest-1438740121-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 29 17:54:23 user nova-compute[74613]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 29 17:54:23 user nova-compute[74613]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74613) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 29 17:54:23 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-8346025d-1b9d-4c86-b9e8-a65bda22b984 tempest-TaggedAttachmentsTest-1438740121 tempest-TaggedAttachmentsTest-1438740121-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b7efc2d5-5149-408b-980d-58492994fd4f', 0)] {{(pid=74613) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 29 17:54:23 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 17:54:23 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 17:54:23 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[446178db-f69c-4f4f-a8ac-306df3f23621]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:49f19a7e-3b8b-44b4-b289-808ee2a18b91\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a6b34bdb-5c08-4f7c-b3f5-6b68413947a8\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b7efc2d5-5149-408b-980d-58492994fd4f\n', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 17:54:23 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 17:54:23 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 17:54:23 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[8306e183-d63c-48a7-879b-0f2d0bd98821]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7efc2d5-5149-408b-980d-58492994fd4f (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49f19a7e-3b8b-44b4-b289-808ee2a18b91 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a6b34bdb-5c08-4f7c-b3f5-6b68413947a8 (non-flash)\n', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 17:54:23 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-8346025d-1b9d-4c86-b9e8-a65bda22b984 tempest-TaggedAttachmentsTest-1438740121 tempest-TaggedAttachmentsTest-1438740121-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7efc2d5-5149-408b-980d-58492994fd4f (non-flash)
Nov 29 17:54:23 user nova-compute[74613]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49f19a7e-3b8b-44b4-b289-808ee2a18b91 (non-flash)
Nov 29 17:54:23 user nova-compute[74613]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a6b34bdb-5c08-4f7c-b3f5-6b68413947a8 (non-flash)
Nov 29 17:54:23 user nova-compute[74613]:  stderr= {{(pid=74613) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 17:54:23 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-8346025d-1b9d-4c86-b9e8-a65bda22b984 tempest-TaggedAttachmentsTest-1438740121 tempest-TaggedAttachmentsTest-1438740121-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7efc2d5-5149-408b-980d-58492994fd4f (non-flash)
Nov 29 17:54:23 user nova-compute[74613]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49f19a7e-3b8b-44b4-b289-808ee2a18b91 (non-flash)
Nov 29 17:54:23 user nova-compute[74613]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a6b34bdb-5c08-4f7c-b3f5-6b68413947a8 (non-flash)
Nov 29 17:54:23 user nova-compute[74613]:  stderr= {{(pid=74613) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 17:54:23 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-8346025d-1b9d-4c86-b9e8-a65bda22b984 tempest-TaggedAttachmentsTest-1438740121 tempest-TaggedAttachmentsTest-1438740121-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7ff818293b50>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b7efc2d5-5149-408b-980d-58492994fd4f'): ({'sdh'}, set())}) {{(pid=74613) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 29 17:54:23 user nova-compute[74613]: DEBUG os_brick.initiator.linuxscsi [None req-8346025d-1b9d-4c86-b9e8-a65bda22b984 tempest-TaggedAttachmentsTest-1438740121 tempest-TaggedAttachmentsTest-1438740121-project-member] Removing single pathed devices sdh {{(pid=74613) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 29 17:54:23 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 17:54:23 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:54:23 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.036s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 17:54:23 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[11ae1d40-0387-4490-a7fd-3264c5f872fe]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 17:54:23 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdh {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 17:54:23 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdh" returned: 0 in 0.025s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 17:54:23 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[a555ac4a-41a5-4492-a341-c9bb2e21b642]: (4, ('ok\n', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 17:54:23 user nova-compute[74613]: DEBUG os_brick.initiator.linuxscsi [None req-8346025d-1b9d-4c86-b9e8-a65bda22b984 tempest-TaggedAttachmentsTest-1438740121 tempest-TaggedAttachmentsTest-1438740121-project-member] Flushing IO for device /dev/sdh {{(pid=74613) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 29 17:54:23 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdh {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 17:54:23 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdh" returned: 0 in 0.014s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 17:54:23 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[617e7158-6470-4d37-b493-6e39566272f4]: (4, ('', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 17:54:23 user nova-compute[74613]: DEBUG os_brick.initiator.linuxscsi [None req-8346025d-1b9d-4c86-b9e8-a65bda22b984 tempest-TaggedAttachmentsTest-1438740121 tempest-TaggedAttachmentsTest-1438740121-project-member] Remove SCSI device /dev/sdh with /sys/block/sdh/device/delete {{(pid=74613) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 29 17:54:23 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdh/device/delete {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 17:54:23 user nova-compute[74613]: DEBUG nova.virt.libvirt.guest [None req-221e9b1a-1b65-4670-ba37-8036c279e598 tempest-TestVolumeSwap-1038735411 tempest-TestVolumeSwap-1038735411-project-admin] COPY block job progress, current cursor: 427819008 final cursor: 1073741824 {{(pid=74613) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 29 17:54:23 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdh/device/delete" returned: 0 in 0.071s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 17:54:23 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[35fae300-af1e-4e17-a3d6-f2fea77cfac9]: (4, ('1', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 17:54:23 user nova-compute[74613]: DEBUG os_brick.initiator.linuxscsi [None req-8346025d-1b9d-4c86-b9e8-a65bda22b984 tempest-TaggedAttachmentsTest-1438740121 tempest-TaggedAttachmentsTest-1438740121-project-member] Checking to see if SCSI volumes sdh have been removed. {{(pid=74613) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 29 17:54:23 user nova-compute[74613]: DEBUG os_brick.initiator.linuxscsi [None req-8346025d-1b9d-4c86-b9e8-a65bda22b984 tempest-TaggedAttachmentsTest-1438740121 tempest-TaggedAttachmentsTest-1438740121-project-member] SCSI volumes sdh have been removed. {{(pid=74613) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 29 17:54:23 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-8346025d-1b9d-4c86-b9e8-a65bda22b984 tempest-TaggedAttachmentsTest-1438740121 tempest-TaggedAttachmentsTest-1438740121-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b7efc2d5-5149-408b-980d-58492994fd4f')] {{(pid=74613) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 29 17:54:23 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b7efc2d5-5149-408b-980d-58492994fd4f -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 17:54:23 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b7efc2d5-5149-408b-980d-58492994fd4f -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.065s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 17:54:23 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[58319cb8-7bf7-4021-973b-761761bdceeb]: (4, ('', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 17:54:23 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-8346025d-1b9d-4c86-b9e8-a65bda22b984 tempest-TaggedAttachmentsTest-1438740121 tempest-TaggedAttachmentsTest-1438740121-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74613) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 17:54:23 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b7efc2d5-5149-408b-980d-58492994fd4f -p 172.16.0.220:3260 --logout {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 17:54:23 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b7efc2d5-5149-408b-980d-58492994fd4f -p 172.16.0.220:3260 --logout" returned: 0 in 0.071s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 17:54:23 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[77442af2-d3df-42c9-bfee-038268923926]: (4, ('Logging out of session [sid: 10, target: iqn.2010-10.org.openstack:b7efc2d5-5149-408b-980d-58492994fd4f, portal: 172.16.0.220,3260]\nLogout of [sid: 10, target: iqn.2010-10.org.openstack:b7efc2d5-5149-408b-980d-58492994fd4f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 17:54:23 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-8346025d-1b9d-4c86-b9e8-a65bda22b984 tempest-TaggedAttachmentsTest-1438740121 tempest-TaggedAttachmentsTest-1438740121-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 10, target: iqn.2010-10.org.openstack:b7efc2d5-5149-408b-980d-58492994fd4f, portal: 172.16.0.220,3260]
Nov 29 17:54:23 user nova-compute[74613]: Logout of [sid: 10, target: iqn.2010-10.org.openstack:b7efc2d5-5149-408b-980d-58492994fd4f, portal: 172.16.0.220,3260] successful.
Nov 29 17:54:23 user nova-compute[74613]:  stderr= {{(pid=74613) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 17:54:23 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b7efc2d5-5149-408b-980d-58492994fd4f -p 172.16.0.220:3260 --op delete {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 17:54:23 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b7efc2d5-5149-408b-980d-58492994fd4f -p 172.16.0.220:3260 --op delete" returned: 0 in 0.021s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 17:54:23 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac60a8e9-d3c5-480b-8be0-1f9047a26c28]: (4, ('', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 17:54:23 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-8346025d-1b9d-4c86-b9e8-a65bda22b984 tempest-TaggedAttachmentsTest-1438740121 tempest-TaggedAttachmentsTest-1438740121-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74613) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 17:54:23 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.base [None req-8346025d-1b9d-4c86-b9e8-a65bda22b984 tempest-TaggedAttachmentsTest-1438740121 tempest-TaggedAttachmentsTest-1438740121-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.439s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 17:54:23 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-8346025d-1b9d-4c86-b9e8-a65bda22b984 tempest-TaggedAttachmentsTest-1438740121 tempest-TaggedAttachmentsTest-1438740121-project-member] <== disconnect_volume: return (441ms) None {{(pid=74613) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 17:54:23 user nova-compute[74613]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8346025d-1b9d-4c86-b9e8-a65bda22b984 tempest-TaggedAttachmentsTest-1438740121 tempest-TaggedAttachmentsTest-1438740121-project-member] [instance: 288b8261-8706-4696-879d-d4dd01ab553e] Disconnected iSCSI Volume {{(pid=74613) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 29 17:54:23 user nova-compute[74613]: DEBUG nova.virt.libvirt.guest [None req-221e9b1a-1b65-4670-ba37-8036c279e598 tempest-TestVolumeSwap-1038735411 tempest-TestVolumeSwap-1038735411-project-admin] COPY block job progress, current cursor: 514850816 final cursor: 1073741824 {{(pid=74613) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 29 17:54:24 user nova-compute[74613]: DEBUG nova.virt.libvirt.guest [None req-221e9b1a-1b65-4670-ba37-8036c279e598 tempest-TestVolumeSwap-1038735411 tempest-TestVolumeSwap-1038735411-project-admin] COPY block job progress, current cursor: 658505728 final cursor: 1073741824 {{(pid=74613) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 29 17:54:24 user nova-compute[74613]: DEBUG nova.compute.manager [req-dea05852-60ee-41fb-b181-4abbb266b8d8 req-8c54e9ee-6e7d-4d39-8764-6c3340e5ab00 service nova] [instance: 3f285832-64a7-48e8-875a-f9e1566a66b6] Received event network-vif-deleted-48d45408-4c70-44b7-a0c3-874ad1049d1a {{(pid=74613) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 17:54:24 user nova-compute[74613]: INFO nova.compute.manager [req-dea05852-60ee-41fb-b181-4abbb266b8d8 req-8c54e9ee-6e7d-4d39-8764-6c3340e5ab00 service nova] [instance: 3f285832-64a7-48e8-875a-f9e1566a66b6] Neutron deleted interface 48d45408-4c70-44b7-a0c3-874ad1049d1a; detaching it from the instance and deleting it from the info cache
Nov 29 17:54:24 user nova-compute[74613]: DEBUG nova.network.neutron [req-dea05852-60ee-41fb-b181-4abbb266b8d8 req-8c54e9ee-6e7d-4d39-8764-6c3340e5ab00 service nova] [instance: 3f285832-64a7-48e8-875a-f9e1566a66b6] Updating instance_info_cache with network_info: [{"id": "75aec901-492c-47e1-9621-158f2d11a5e7", "address": "fa:16:3e:78:3a:a6", "network": {"id": "ca76dd55-469c-4d51-a76e-8b160bef1707", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-570657334-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.106", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f655bcde631c4a839b98695eed5cfa4e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap75aec901-49", "ovs_interfaceid": "75aec901-492c-47e1-9621-158f2d11a5e7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "d2631ae0-4218-400c-8da8-cb6d3271579d", "address": "fa:16:3e:3a:4c:7e", "network": {"id": "1e109d3b-bb91-4ff7-b16f-d39181436f57", "bridge": "br-int", "label": "tempest-device-tagging-net1-1011700470", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.120", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "f655bcde631c4a839b98695eed5cfa4e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd2631ae0-42", "ovs_interfaceid": "d2631ae0-4218-400c-8da8-cb6d3271579d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "83dc312c-87e6-47a8-b4a5-f7c3cec7ab50", "address": "fa:16:3e:fb:9b:31", "network": {"id": "1e109d3b-bb91-4ff7-b16f-d39181436f57", "bridge": "br-int", "label": "tempest-device-tagging-net1-1011700470", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.134", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "f655bcde631c4a839b98695eed5cfa4e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap83dc312c-87", "ovs_interfaceid": "83dc312c-87e6-47a8-b4a5-f7c3cec7ab50", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "5ea35efd-1b2e-48eb-b8fb-fb15dab703dc", "address": "fa:16:3e:f1:48:4c", "network": {"id": "1e109d3b-bb91-4ff7-b16f-d39181436f57", "bridge": "br-int", "label": "tempest-device-tagging-net1-1011700470", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.157", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "f655bcde631c4a839b98695eed5cfa4e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5ea35efd-1b", "ovs_interfaceid": "5ea35efd-1b2e-48eb-b8fb-fb15dab703dc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "3fe23755-ec08-4b17-87b2-c1eebd36042b", "address": "fa:16:3e:39:7c:dd", "network": {"id": "1e109d3b-bb91-4ff7-b16f-d39181436f57", "bridge": "br-int", "label": "tempest-device-tagging-net1-1011700470", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.66", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "f655bcde631c4a839b98695eed5cfa4e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3fe23755-ec", "ovs_interfaceid": "3fe23755-ec08-4b17-87b2-c1eebd36042b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "bffa705a-58aa-4cbd-9b9d-09c8229cf829", "address": "fa:16:3e:f7:c0:bd", "network": {"id": "6debc132-a947-4fdc-8d04-f10452f6ee9c", "bridge": "br-int", "label": "tempest-device-tagging-net2-597757606", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "f655bcde631c4a839b98695eed5cfa4e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbffa705a-58", "ovs_interfaceid": "bffa705a-58aa-4cbd-9b9d-09c8229cf829", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74613) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 17:54:24 user nova-compute[74613]: DEBUG nova.compute.manager [req-dea05852-60ee-41fb-b181-4abbb266b8d8 req-8c54e9ee-6e7d-4d39-8764-6c3340e5ab00 service nova] [instance: 3f285832-64a7-48e8-875a-f9e1566a66b6] Detach interface failed, port_id=48d45408-4c70-44b7-a0c3-874ad1049d1a, reason: Instance 3f285832-64a7-48e8-875a-f9e1566a66b6 could not be found. {{(pid=74613) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 29 17:54:24 user nova-compute[74613]: DEBUG nova.virt.libvirt.guest [None req-221e9b1a-1b65-4670-ba37-8036c279e598 tempest-TestVolumeSwap-1038735411 tempest-TestVolumeSwap-1038735411-project-admin] COPY block job progress, current cursor: 772800512 final cursor: 1073741824 {{(pid=74613) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 29 17:54:25 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:54:25 user nova-compute[74613]: DEBUG nova.virt.libvirt.guest [None req-221e9b1a-1b65-4670-ba37-8036c279e598 tempest-TestVolumeSwap-1038735411 tempest-TestVolumeSwap-1038735411-project-admin] COPY block job progress, current cursor: 933232640 final cursor: 1073741824 {{(pid=74613) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 29 17:54:25 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:54:25 user nova-compute[74613]: DEBUG nova.virt.libvirt.guest [None req-221e9b1a-1b65-4670-ba37-8036c279e598 tempest-TestVolumeSwap-1038735411 tempest-TestVolumeSwap-1038735411-project-admin] COPY block job progress, current cursor: 1042284544 final cursor: 1073741824 {{(pid=74613) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 29 17:54:26 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-34635a9f-32ad-4d56-b62c-9a4fc2486b5d tempest-ServerBootFromVolumeStableRescueTest-414665510 tempest-ServerBootFromVolumeStableRescueTest-414665510-project-member] Acquiring lock "cd22685a-028c-4e0c-834d-e7b20f6d06ab" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 17:54:26 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-34635a9f-32ad-4d56-b62c-9a4fc2486b5d tempest-ServerBootFromVolumeStableRescueTest-414665510 tempest-ServerBootFromVolumeStableRescueTest-414665510-project-member] Lock "cd22685a-028c-4e0c-834d-e7b20f6d06ab" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 17:54:26 user nova-compute[74613]: DEBUG nova.compute.manager [None req-34635a9f-32ad-4d56-b62c-9a4fc2486b5d tempest-ServerBootFromVolumeStableRescueTest-414665510 tempest-ServerBootFromVolumeStableRescueTest-414665510-project-member] [instance: cd22685a-028c-4e0c-834d-e7b20f6d06ab] Starting instance... {{(pid=74613) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 29 17:54:26 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-34635a9f-32ad-4d56-b62c-9a4fc2486b5d tempest-ServerBootFromVolumeStableRescueTest-414665510 tempest-ServerBootFromVolumeStableRescueTest-414665510-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 17:54:26 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-34635a9f-32ad-4d56-b62c-9a4fc2486b5d tempest-ServerBootFromVolumeStableRescueTest-414665510 tempest-ServerBootFromVolumeStableRescueTest-414665510-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 17:54:26 user nova-compute[74613]: DEBUG nova.virt.hardware [None req-34635a9f-32ad-4d56-b62c-9a4fc2486b5d tempest-ServerBootFromVolumeStableRescueTest-414665510 tempest-ServerBootFromVolumeStableRescueTest-414665510-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74613) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 29 17:54:26 user nova-compute[74613]: INFO nova.compute.claims [None req-34635a9f-32ad-4d56-b62c-9a4fc2486b5d tempest-ServerBootFromVolumeStableRescueTest-414665510 tempest-ServerBootFromVolumeStableRescueTest-414665510-project-member] [instance: cd22685a-028c-4e0c-834d-e7b20f6d06ab] Claim successful on node user
Nov 29 17:54:26 user nova-compute[74613]: DEBUG nova.virt.libvirt.guest [None req-221e9b1a-1b65-4670-ba37-8036c279e598 tempest-TestVolumeSwap-1038735411 tempest-TestVolumeSwap-1038735411-project-admin] COPY block job progress, current cursor: 1073741824 final cursor: 1073741824 {{(pid=74613) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 29 17:54:26 user nova-compute[74613]: DEBUG nova.virt.libvirt.volume.iscsi [None req-221e9b1a-1b65-4670-ba37-8036c279e598 tempest-TestVolumeSwap-1038735411 tempest-TestVolumeSwap-1038735411-project-admin] [instance: 0008521b-5a63-4ff6-8390-d343956900ed] calling os-brick to detach iSCSI Volume {{(pid=74613) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 29 17:54:26 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-221e9b1a-1b65-4670-ba37-8036c279e598 tempest-TestVolumeSwap-1038735411 tempest-TestVolumeSwap-1038735411-project-admin] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff828156890>, {'target_iqn': 'iqn.2010-10.org.openstack:49f19a7e-3b8b-44b4-b289-808ee2a18b91', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'EhqaYVOC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdi', 'volume_id': '49f19a7e-3b8b-44b4-b289-808ee2a18b91'}, None), 'kwargs': False}}" {{(pid=74613) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 17:54:26 user nova-compute[74613]: WARNING os_brick.initiator.connectors.base [None req-221e9b1a-1b65-4670-ba37-8036c279e598 tempest-TestVolumeSwap-1038735411 tempest-TestVolumeSwap-1038735411-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 17:54:26 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.base [None req-221e9b1a-1b65-4670-ba37-8036c279e598 tempest-TestVolumeSwap-1038735411 tempest-TestVolumeSwap-1038735411-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 17:54:26 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.base [None req-221e9b1a-1b65-4670-ba37-8036c279e598 tempest-TestVolumeSwap-1038735411 tempest-TestVolumeSwap-1038735411-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 17:54:26 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 17:54:26 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 17:54:26 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[8547857f-a5d7-4433-9147-b1fd34604fca]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:49f19a7e-3b8b-44b4-b289-808ee2a18b91\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a6b34bdb-5c08-4f7c-b3f5-6b68413947a8\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 17:54:26 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-221e9b1a-1b65-4670-ba37-8036c279e598 tempest-TestVolumeSwap-1038735411 tempest-TestVolumeSwap-1038735411-project-admin] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 29 17:54:26 user nova-compute[74613]: No targets found.
Nov 29 17:54:26 user nova-compute[74613]: iSNS:
Nov 29 17:54:26 user nova-compute[74613]: No targets found.
Nov 29 17:54:26 user nova-compute[74613]: STATIC:
Nov 29 17:54:26 user nova-compute[74613]: Target: iqn.2010-10.org.openstack:49f19a7e-3b8b-44b4-b289-808ee2a18b91
Nov 29 17:54:26 user nova-compute[74613]:         Portal: 172.16.0.220:3260,-1
Nov 29 17:54:26 user nova-compute[74613]:                 Iface Name: default
Nov 29 17:54:26 user nova-compute[74613]: Target: iqn.2010-10.org.openstack:a6b34bdb-5c08-4f7c-b3f5-6b68413947a8
Nov 29 17:54:26 user nova-compute[74613]:         Portal: 172.16.0.220:3260,-1
Nov 29 17:54:26 user nova-compute[74613]:                 Iface Name: default
Nov 29 17:54:26 user nova-compute[74613]: FIRMWARE:
Nov 29 17:54:26 user nova-compute[74613]: No targets found.
Nov 29 17:54:26 user nova-compute[74613]:  stderr= {{(pid=74613) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 17:54:26 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-221e9b1a-1b65-4670-ba37-8036c279e598 tempest-TestVolumeSwap-1038735411 tempest-TestVolumeSwap-1038735411-project-admin] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 29 17:54:26 user nova-compute[74613]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 29 17:54:26 user nova-compute[74613]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74613) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 29 17:54:26 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-221e9b1a-1b65-4670-ba37-8036c279e598 tempest-TestVolumeSwap-1038735411 tempest-TestVolumeSwap-1038735411-project-admin] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:49f19a7e-3b8b-44b4-b289-808ee2a18b91', 0)] {{(pid=74613) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 29 17:54:26 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 17:54:26 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 17:54:26 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[219b72ce-5cff-48f5-a4f1-d3d669c59a08]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:49f19a7e-3b8b-44b4-b289-808ee2a18b91\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a6b34bdb-5c08-4f7c-b3f5-6b68413947a8\n', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 17:54:26 user nova-compute[74613]: DEBUG nova.compute.provider_tree [None req-34635a9f-32ad-4d56-b62c-9a4fc2486b5d tempest-ServerBootFromVolumeStableRescueTest-414665510 tempest-ServerBootFromVolumeStableRescueTest-414665510-project-member] Inventory has not changed in ProviderTree for provider: 639d980e-3b12-44b1-b8f4-1812416fa4dd {{(pid=74613) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 17:54:26 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 17:54:26 user nova-compute[74613]: DEBUG nova.compute.manager [req-f58878d8-1f5d-40b6-8870-d58cb2cbca5a req-a1f3c8fb-1f1c-4562-99f0-c048069204cd service nova] [instance: 3f285832-64a7-48e8-875a-f9e1566a66b6] Received event network-vif-deleted-75aec901-492c-47e1-9621-158f2d11a5e7 {{(pid=74613) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 17:54:26 user nova-compute[74613]: INFO nova.compute.manager [req-f58878d8-1f5d-40b6-8870-d58cb2cbca5a req-a1f3c8fb-1f1c-4562-99f0-c048069204cd service nova] [instance: 3f285832-64a7-48e8-875a-f9e1566a66b6] Neutron deleted interface 75aec901-492c-47e1-9621-158f2d11a5e7; detaching it from the instance and deleting it from the info cache
Nov 29 17:54:26 user nova-compute[74613]: DEBUG nova.network.neutron [req-f58878d8-1f5d-40b6-8870-d58cb2cbca5a req-a1f3c8fb-1f1c-4562-99f0-c048069204cd service nova] [instance: 3f285832-64a7-48e8-875a-f9e1566a66b6] Updating instance_info_cache with network_info: [{"id": "d2631ae0-4218-400c-8da8-cb6d3271579d", "address": "fa:16:3e:3a:4c:7e", "network": {"id": "1e109d3b-bb91-4ff7-b16f-d39181436f57", "bridge": "br-int", "label": "tempest-device-tagging-net1-1011700470", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.120", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "f655bcde631c4a839b98695eed5cfa4e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd2631ae0-42", "ovs_interfaceid": "d2631ae0-4218-400c-8da8-cb6d3271579d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "83dc312c-87e6-47a8-b4a5-f7c3cec7ab50", "address": "fa:16:3e:fb:9b:31", "network": {"id": "1e109d3b-bb91-4ff7-b16f-d39181436f57", "bridge": "br-int", "label": "tempest-device-tagging-net1-1011700470", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.134", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "f655bcde631c4a839b98695eed5cfa4e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap83dc312c-87", "ovs_interfaceid": "83dc312c-87e6-47a8-b4a5-f7c3cec7ab50", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "5ea35efd-1b2e-48eb-b8fb-fb15dab703dc", "address": "fa:16:3e:f1:48:4c", "network": {"id": "1e109d3b-bb91-4ff7-b16f-d39181436f57", "bridge": "br-int", "label": "tempest-device-tagging-net1-1011700470", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.157", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "f655bcde631c4a839b98695eed5cfa4e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5ea35efd-1b", "ovs_interfaceid": "5ea35efd-1b2e-48eb-b8fb-fb15dab703dc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "3fe23755-ec08-4b17-87b2-c1eebd36042b", "address": "fa:16:3e:39:7c:dd", "network": {"id": "1e109d3b-bb91-4ff7-b16f-d39181436f57", "bridge": "br-int", "label": "tempest-device-tagging-net1-1011700470", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.66", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "f655bcde631c4a839b98695eed5cfa4e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3fe23755-ec", "ovs_interfaceid": "3fe23755-ec08-4b17-87b2-c1eebd36042b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "bffa705a-58aa-4cbd-9b9d-09c8229cf829", "address": "fa:16:3e:f7:c0:bd", "network": {"id": "6debc132-a947-4fdc-8d04-f10452f6ee9c", "bridge": "br-int", "label": "tempest-device-tagging-net2-597757606", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "f655bcde631c4a839b98695eed5cfa4e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbffa705a-58", "ovs_interfaceid": "bffa705a-58aa-4cbd-9b9d-09c8229cf829", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74613) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 17:54:26 user nova-compute[74613]: DEBUG nova.scheduler.client.report [None req-34635a9f-32ad-4d56-b62c-9a4fc2486b5d tempest-ServerBootFromVolumeStableRescueTest-414665510 tempest-ServerBootFromVolumeStableRescueTest-414665510-project-member] Inventory has not changed for provider 639d980e-3b12-44b1-b8f4-1812416fa4dd based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74613) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 17:54:26 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 17:54:26 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[b77615a7-9ea5-4ddf-9707-e1f0876693c0]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49f19a7e-3b8b-44b4-b289-808ee2a18b91 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a6b34bdb-5c08-4f7c-b3f5-6b68413947a8 (non-flash)\n', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 17:54:26 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-221e9b1a-1b65-4670-ba37-8036c279e598 tempest-TestVolumeSwap-1038735411 tempest-TestVolumeSwap-1038735411-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49f19a7e-3b8b-44b4-b289-808ee2a18b91 (non-flash)
Nov 29 17:54:26 user nova-compute[74613]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a6b34bdb-5c08-4f7c-b3f5-6b68413947a8 (non-flash)
Nov 29 17:54:26 user nova-compute[74613]:  stderr= {{(pid=74613) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 17:54:26 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-221e9b1a-1b65-4670-ba37-8036c279e598 tempest-TestVolumeSwap-1038735411 tempest-TestVolumeSwap-1038735411-project-admin] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49f19a7e-3b8b-44b4-b289-808ee2a18b91 (non-flash)
Nov 29 17:54:26 user nova-compute[74613]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a6b34bdb-5c08-4f7c-b3f5-6b68413947a8 (non-flash)
Nov 29 17:54:26 user nova-compute[74613]:  stderr= {{(pid=74613) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 17:54:26 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-221e9b1a-1b65-4670-ba37-8036c279e598 tempest-TestVolumeSwap-1038735411 tempest-TestVolumeSwap-1038735411-project-admin] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7ff8185239a0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:49f19a7e-3b8b-44b4-b289-808ee2a18b91'): ({'sdi'}, set())}) {{(pid=74613) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 29 17:54:26 user nova-compute[74613]: DEBUG os_brick.initiator.linuxscsi [None req-221e9b1a-1b65-4670-ba37-8036c279e598 tempest-TestVolumeSwap-1038735411 tempest-TestVolumeSwap-1038735411-project-admin] Removing single pathed devices sdi {{(pid=74613) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 29 17:54:26 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 17:54:26 user nova-compute[74613]: DEBUG nova.compute.manager [req-f58878d8-1f5d-40b6-8870-d58cb2cbca5a req-a1f3c8fb-1f1c-4562-99f0-c048069204cd service nova] [instance: 3f285832-64a7-48e8-875a-f9e1566a66b6] Detach interface failed, port_id=75aec901-492c-47e1-9621-158f2d11a5e7, reason: Instance 3f285832-64a7-48e8-875a-f9e1566a66b6 could not be found. {{(pid=74613) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 29 17:54:26 user nova-compute[74613]: DEBUG nova.compute.manager [req-f58878d8-1f5d-40b6-8870-d58cb2cbca5a req-a1f3c8fb-1f1c-4562-99f0-c048069204cd service nova] [instance: 3f285832-64a7-48e8-875a-f9e1566a66b6] Received event network-vif-deleted-bffa705a-58aa-4cbd-9b9d-09c8229cf829 {{(pid=74613) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 17:54:26 user nova-compute[74613]: INFO nova.compute.manager [req-f58878d8-1f5d-40b6-8870-d58cb2cbca5a req-a1f3c8fb-1f1c-4562-99f0-c048069204cd service nova] [instance: 3f285832-64a7-48e8-875a-f9e1566a66b6] Neutron deleted interface bffa705a-58aa-4cbd-9b9d-09c8229cf829; detaching it from the instance and deleting it from the info cache
Nov 29 17:54:26 user nova-compute[74613]: DEBUG nova.network.neutron [req-f58878d8-1f5d-40b6-8870-d58cb2cbca5a req-a1f3c8fb-1f1c-4562-99f0-c048069204cd service nova] [instance: 3f285832-64a7-48e8-875a-f9e1566a66b6] Updating instance_info_cache with network_info: [{"id": "d2631ae0-4218-400c-8da8-cb6d3271579d", "address": "fa:16:3e:3a:4c:7e", "network": {"id": "1e109d3b-bb91-4ff7-b16f-d39181436f57", "bridge": "br-int", "label": "tempest-device-tagging-net1-1011700470", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.120", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "f655bcde631c4a839b98695eed5cfa4e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd2631ae0-42", "ovs_interfaceid": "d2631ae0-4218-400c-8da8-cb6d3271579d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "83dc312c-87e6-47a8-b4a5-f7c3cec7ab50", "address": "fa:16:3e:fb:9b:31", "network": {"id": "1e109d3b-bb91-4ff7-b16f-d39181436f57", "bridge": "br-int", "label": "tempest-device-tagging-net1-1011700470", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.134", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "f655bcde631c4a839b98695eed5cfa4e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap83dc312c-87", "ovs_interfaceid": "83dc312c-87e6-47a8-b4a5-f7c3cec7ab50", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "5ea35efd-1b2e-48eb-b8fb-fb15dab703dc", "address": "fa:16:3e:f1:48:4c", "network": {"id": "1e109d3b-bb91-4ff7-b16f-d39181436f57", "bridge": "br-int", "label": "tempest-device-tagging-net1-1011700470", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.157", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "f655bcde631c4a839b98695eed5cfa4e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5ea35efd-1b", "ovs_interfaceid": "5ea35efd-1b2e-48eb-b8fb-fb15dab703dc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "3fe23755-ec08-4b17-87b2-c1eebd36042b", "address": "fa:16:3e:39:7c:dd", "network": {"id": "1e109d3b-bb91-4ff7-b16f-d39181436f57", "bridge": "br-int", "label": "tempest-device-tagging-net1-1011700470", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.66", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "f655bcde631c4a839b98695eed5cfa4e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3fe23755-ec", "ovs_interfaceid": "3fe23755-ec08-4b17-87b2-c1eebd36042b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74613) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 17:54:26 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 17:54:26 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f489a29-e96d-4dd3-b950-f6979f588f4c]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 17:54:26 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdi {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 17:54:26 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-34635a9f-32ad-4d56-b62c-9a4fc2486b5d tempest-ServerBootFromVolumeStableRescueTest-414665510 tempest-ServerBootFromVolumeStableRescueTest-414665510-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.443s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 17:54:26 user nova-compute[74613]: DEBUG nova.compute.manager [None req-34635a9f-32ad-4d56-b62c-9a4fc2486b5d tempest-ServerBootFromVolumeStableRescueTest-414665510 tempest-ServerBootFromVolumeStableRescueTest-414665510-project-member] [instance: cd22685a-028c-4e0c-834d-e7b20f6d06ab] Start building networks asynchronously for instance. {{(pid=74613) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 29 17:54:26 user nova-compute[74613]: DEBUG nova.compute.manager [req-f58878d8-1f5d-40b6-8870-d58cb2cbca5a req-a1f3c8fb-1f1c-4562-99f0-c048069204cd service nova] [instance: 3f285832-64a7-48e8-875a-f9e1566a66b6] Detach interface failed, port_id=bffa705a-58aa-4cbd-9b9d-09c8229cf829, reason: Instance 3f285832-64a7-48e8-875a-f9e1566a66b6 could not be found. {{(pid=74613) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 29 17:54:26 user nova-compute[74613]: DEBUG nova.compute.manager [req-f58878d8-1f5d-40b6-8870-d58cb2cbca5a req-a1f3c8fb-1f1c-4562-99f0-c048069204cd service nova] [instance: 3f285832-64a7-48e8-875a-f9e1566a66b6] Received event network-vif-deleted-5ea35efd-1b2e-48eb-b8fb-fb15dab703dc {{(pid=74613) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 17:54:26 user nova-compute[74613]: INFO nova.compute.manager [req-f58878d8-1f5d-40b6-8870-d58cb2cbca5a req-a1f3c8fb-1f1c-4562-99f0-c048069204cd service nova] [instance: 3f285832-64a7-48e8-875a-f9e1566a66b6] Neutron deleted interface 5ea35efd-1b2e-48eb-b8fb-fb15dab703dc; detaching it from the instance and deleting it from the info cache
Nov 29 17:54:26 user nova-compute[74613]: DEBUG nova.network.neutron [req-f58878d8-1f5d-40b6-8870-d58cb2cbca5a req-a1f3c8fb-1f1c-4562-99f0-c048069204cd service nova] [instance: 3f285832-64a7-48e8-875a-f9e1566a66b6] Updating instance_info_cache with network_info: [{"id": "d2631ae0-4218-400c-8da8-cb6d3271579d", "address": "fa:16:3e:3a:4c:7e", "network": {"id": "1e109d3b-bb91-4ff7-b16f-d39181436f57", "bridge": "br-int", "label": "tempest-device-tagging-net1-1011700470", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.120", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "f655bcde631c4a839b98695eed5cfa4e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd2631ae0-42", "ovs_interfaceid": "d2631ae0-4218-400c-8da8-cb6d3271579d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "83dc312c-87e6-47a8-b4a5-f7c3cec7ab50", "address": "fa:16:3e:fb:9b:31", "network": {"id": "1e109d3b-bb91-4ff7-b16f-d39181436f57", "bridge": "br-int", "label": "tempest-device-tagging-net1-1011700470", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.134", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "f655bcde631c4a839b98695eed5cfa4e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap83dc312c-87", "ovs_interfaceid": "83dc312c-87e6-47a8-b4a5-f7c3cec7ab50", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "3fe23755-ec08-4b17-87b2-c1eebd36042b", "address": "fa:16:3e:39:7c:dd", "network": {"id": "1e109d3b-bb91-4ff7-b16f-d39181436f57", "bridge": "br-int", "label": "tempest-device-tagging-net1-1011700470", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.66", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "f655bcde631c4a839b98695eed5cfa4e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3fe23755-ec", "ovs_interfaceid": "3fe23755-ec08-4b17-87b2-c1eebd36042b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74613) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 17:54:26 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdi" returned: 0 in 0.023s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 17:54:26 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[333cc058-6cca-47f4-9e03-bf718f51c951]: (4, ('ok\n', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 17:54:26 user nova-compute[74613]: DEBUG os_brick.initiator.linuxscsi [None req-221e9b1a-1b65-4670-ba37-8036c279e598 tempest-TestVolumeSwap-1038735411 tempest-TestVolumeSwap-1038735411-project-admin] Flushing IO for device /dev/sdi {{(pid=74613) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 29 17:54:26 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdi {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 17:54:26 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdi" returned: 0 in 0.015s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 17:54:26 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[41ba87fe-375f-43f5-866a-ef345f5229a1]: (4, ('', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 17:54:26 user nova-compute[74613]: DEBUG os_brick.initiator.linuxscsi [None req-221e9b1a-1b65-4670-ba37-8036c279e598 tempest-TestVolumeSwap-1038735411 tempest-TestVolumeSwap-1038735411-project-admin] Remove SCSI device /dev/sdi with /sys/block/sdi/device/delete {{(pid=74613) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 29 17:54:26 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdi/device/delete {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 17:54:26 user nova-compute[74613]: DEBUG nova.compute.manager [req-f58878d8-1f5d-40b6-8870-d58cb2cbca5a req-a1f3c8fb-1f1c-4562-99f0-c048069204cd service nova] [instance: 3f285832-64a7-48e8-875a-f9e1566a66b6] Detach interface failed, port_id=5ea35efd-1b2e-48eb-b8fb-fb15dab703dc, reason: Instance 3f285832-64a7-48e8-875a-f9e1566a66b6 could not be found. {{(pid=74613) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 29 17:54:26 user nova-compute[74613]: DEBUG nova.compute.manager [None req-34635a9f-32ad-4d56-b62c-9a4fc2486b5d tempest-ServerBootFromVolumeStableRescueTest-414665510 tempest-ServerBootFromVolumeStableRescueTest-414665510-project-member] [instance: cd22685a-028c-4e0c-834d-e7b20f6d06ab] Allocating IP information in the background. {{(pid=74613) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 29 17:54:26 user nova-compute[74613]: DEBUG nova.network.neutron [None req-34635a9f-32ad-4d56-b62c-9a4fc2486b5d tempest-ServerBootFromVolumeStableRescueTest-414665510 tempest-ServerBootFromVolumeStableRescueTest-414665510-project-member] [instance: cd22685a-028c-4e0c-834d-e7b20f6d06ab] allocate_for_instance() {{(pid=74613) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 29 17:54:26 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdi/device/delete" returned: 0 in 0.035s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 17:54:26 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[de0023cf-f09e-4768-b4bd-af0ca0586040]: (4, ('1', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 17:54:26 user nova-compute[74613]: DEBUG os_brick.initiator.linuxscsi [None req-221e9b1a-1b65-4670-ba37-8036c279e598 tempest-TestVolumeSwap-1038735411 tempest-TestVolumeSwap-1038735411-project-admin] Checking to see if SCSI volumes sdi have been removed. {{(pid=74613) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 29 17:54:26 user nova-compute[74613]: DEBUG os_brick.initiator.linuxscsi [None req-221e9b1a-1b65-4670-ba37-8036c279e598 tempest-TestVolumeSwap-1038735411 tempest-TestVolumeSwap-1038735411-project-admin] SCSI volumes sdi have been removed. {{(pid=74613) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 29 17:54:26 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-221e9b1a-1b65-4670-ba37-8036c279e598 tempest-TestVolumeSwap-1038735411 tempest-TestVolumeSwap-1038735411-project-admin] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:49f19a7e-3b8b-44b4-b289-808ee2a18b91')] {{(pid=74613) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 29 17:54:26 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:49f19a7e-3b8b-44b4-b289-808ee2a18b91 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 17:54:26 user nova-compute[74613]: INFO nova.virt.libvirt.driver [None req-34635a9f-32ad-4d56-b62c-9a4fc2486b5d tempest-ServerBootFromVolumeStableRescueTest-414665510 tempest-ServerBootFromVolumeStableRescueTest-414665510-project-member] [instance: cd22685a-028c-4e0c-834d-e7b20f6d06ab] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 29 17:54:26 user nova-compute[74613]: DEBUG nova.network.neutron [-] [instance: 3f285832-64a7-48e8-875a-f9e1566a66b6] Updating instance_info_cache with network_info: [] {{(pid=74613) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 17:54:26 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:49f19a7e-3b8b-44b4-b289-808ee2a18b91 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 17:54:26 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf47bb67-19b2-4693-9972-a87e92e464f5]: (4, ('', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 17:54:26 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-221e9b1a-1b65-4670-ba37-8036c279e598 tempest-TestVolumeSwap-1038735411 tempest-TestVolumeSwap-1038735411-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74613) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 17:54:26 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:49f19a7e-3b8b-44b4-b289-808ee2a18b91 -p 172.16.0.220:3260 --logout {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 17:54:26 user nova-compute[74613]: DEBUG nova.compute.manager [None req-34635a9f-32ad-4d56-b62c-9a4fc2486b5d tempest-ServerBootFromVolumeStableRescueTest-414665510 tempest-ServerBootFromVolumeStableRescueTest-414665510-project-member] [instance: cd22685a-028c-4e0c-834d-e7b20f6d06ab] Start building block device mappings for instance. {{(pid=74613) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 29 17:54:26 user nova-compute[74613]: INFO nova.compute.manager [-] [instance: 3f285832-64a7-48e8-875a-f9e1566a66b6] Took 4.81 seconds to deallocate network for instance.
Nov 29 17:54:26 user nova-compute[74613]: INFO nova.virt.block_device [None req-34635a9f-32ad-4d56-b62c-9a4fc2486b5d tempest-ServerBootFromVolumeStableRescueTest-414665510 tempest-ServerBootFromVolumeStableRescueTest-414665510-project-member] [instance: cd22685a-028c-4e0c-834d-e7b20f6d06ab] Booting with blank volume at /dev/vda
Nov 29 17:54:26 user nova-compute[74613]: DEBUG nova.policy [None req-34635a9f-32ad-4d56-b62c-9a4fc2486b5d tempest-ServerBootFromVolumeStableRescueTest-414665510 tempest-ServerBootFromVolumeStableRescueTest-414665510-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'c65bc922e04d4d1385e48f70c460c441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b820dd795dfe46cd804772f0e71f98e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74613) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 29 17:54:26 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:49f19a7e-3b8b-44b4-b289-808ee2a18b91 -p 172.16.0.220:3260 --logout" returned: 0 in 0.064s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 17:54:26 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[f192ff73-a8a4-4537-80bc-cb0bc8de9e68]: (4, ('Logging out of session [sid: 11, target: iqn.2010-10.org.openstack:49f19a7e-3b8b-44b4-b289-808ee2a18b91, portal: 172.16.0.220,3260]\nLogout of [sid: 11, target: iqn.2010-10.org.openstack:49f19a7e-3b8b-44b4-b289-808ee2a18b91, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 17:54:26 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-221e9b1a-1b65-4670-ba37-8036c279e598 tempest-TestVolumeSwap-1038735411 tempest-TestVolumeSwap-1038735411-project-admin] iscsiadm ('--logout',): stdout=Logging out of session [sid: 11, target: iqn.2010-10.org.openstack:49f19a7e-3b8b-44b4-b289-808ee2a18b91, portal: 172.16.0.220,3260]
Nov 29 17:54:26 user nova-compute[74613]: Logout of [sid: 11, target: iqn.2010-10.org.openstack:49f19a7e-3b8b-44b4-b289-808ee2a18b91, portal: 172.16.0.220,3260] successful.
Nov 29 17:54:26 user nova-compute[74613]:  stderr= {{(pid=74613) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 17:54:26 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:49f19a7e-3b8b-44b4-b289-808ee2a18b91 -p 172.16.0.220:3260 --op delete {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 17:54:26 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:49f19a7e-3b8b-44b4-b289-808ee2a18b91 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.022s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 17:54:26 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[65102cea-ef03-455b-b97f-2e5572410dc8]: (4, ('', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 17:54:26 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-221e9b1a-1b65-4670-ba37-8036c279e598 tempest-TestVolumeSwap-1038735411 tempest-TestVolumeSwap-1038735411-project-admin] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74613) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 17:54:26 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.base [None req-221e9b1a-1b65-4670-ba37-8036c279e598 tempest-TestVolumeSwap-1038735411 tempest-TestVolumeSwap-1038735411-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.312s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 17:54:26 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-221e9b1a-1b65-4670-ba37-8036c279e598 tempest-TestVolumeSwap-1038735411 tempest-TestVolumeSwap-1038735411-project-admin] <== disconnect_volume: return (313ms) None {{(pid=74613) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 17:54:26 user nova-compute[74613]: DEBUG nova.virt.libvirt.volume.iscsi [None req-221e9b1a-1b65-4670-ba37-8036c279e598 tempest-TestVolumeSwap-1038735411 tempest-TestVolumeSwap-1038735411-project-admin] [instance: 0008521b-5a63-4ff6-8390-d343956900ed] Disconnected iSCSI Volume {{(pid=74613) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 29 17:54:27 user nova-compute[74613]: DEBUG nova.network.neutron [None req-34635a9f-32ad-4d56-b62c-9a4fc2486b5d tempest-ServerBootFromVolumeStableRescueTest-414665510 tempest-ServerBootFromVolumeStableRescueTest-414665510-project-member] [instance: cd22685a-028c-4e0c-834d-e7b20f6d06ab] Successfully created port: 5b08bd65-707e-48a5-800b-dd0670c88d61 {{(pid=74613) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 29 17:54:27 user nova-compute[74613]: DEBUG nova.objects.instance [None req-8346025d-1b9d-4c86-b9e8-a65bda22b984 tempest-TaggedAttachmentsTest-1438740121 tempest-TaggedAttachmentsTest-1438740121-project-member] Lazy-loading 'flavor' on Instance uuid 288b8261-8706-4696-879d-d4dd01ab553e {{(pid=74613) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 17:54:27 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-8346025d-1b9d-4c86-b9e8-a65bda22b984 tempest-TaggedAttachmentsTest-1438740121 tempest-TaggedAttachmentsTest-1438740121-project-member] Lock "288b8261-8706-4696-879d-d4dd01ab553e" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 25.374s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 17:54:27 user nova-compute[74613]: DEBUG nova.compute.manager [None req-221e9b1a-1b65-4670-ba37-8036c279e598 tempest-TestVolumeSwap-1038735411 tempest-TestVolumeSwap-1038735411-project-admin] swap_volume: Driver volume swap returned, new connection_info is now : {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:a6b34bdb-5c08-4f7c-b3f5-6b68413947a8', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'SAqnwafp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, 'status': 'reserved', 'instance': '0008521b-5a63-4ff6-8390-d343956900ed', 'attached_at': '', 'detached_at': '', 'volume_id': 'a6b34bdb-5c08-4f7c-b3f5-6b68413947a8', 'serial'} {{(pid=74613) _swap_volume /opt/stack/nova/nova/compute/manager.py:7791}}
Nov 29 17:54:27 user nova-compute[74613]: DEBUG nova.compute.manager [None req-221e9b1a-1b65-4670-ba37-8036c279e598 tempest-TestVolumeSwap-1038735411 tempest-TestVolumeSwap-1038735411-project-admin] [instance: 0008521b-5a63-4ff6-8390-d343956900ed] swap_volume: removing Cinder connection for volume 49f19a7e-3b8b-44b4-b289-808ee2a18b91 {{(pid=74613) _swap_volume /opt/stack/nova/nova/compute/manager.py:7836}}
Nov 29 17:54:28 user nova-compute[74613]: ERROR nova.volume.cinder [None req-b2e6bae2-6e73-43a2-bae3-85645df54ba9 tempest-ServerActionsV293TestJSON-169231013 tempest-ServerActionsV293TestJSON-169231013-project-member] Update attachment failed for attachment 4a93af09-2949-427d-be30-0c6ff6b00f86. Error: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-6bf24f09-025c-46a8-9234-f6f76c1c498b) Code: 500: cinderclient.exceptions.ClientException: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-6bf24f09-025c-46a8-9234-f6f76c1c498b)
Nov 29 17:54:28 user nova-compute[74613]: ERROR nova.compute.manager [None req-b2e6bae2-6e73-43a2-bae3-85645df54ba9 tempest-ServerActionsV293TestJSON-169231013 tempest-ServerActionsV293TestJSON-169231013-project-member] [instance: 8de2ffb3-e264-49f7-8581-6eae21adcaeb] Instance failed block device setup: cinderclient.exceptions.ClientException: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-6bf24f09-025c-46a8-9234-f6f76c1c498b)
Nov 29 17:54:28 user nova-compute[74613]: ERROR nova.compute.manager [instance: 8de2ffb3-e264-49f7-8581-6eae21adcaeb] Traceback (most recent call last):
Nov 29 17:54:28 user nova-compute[74613]: ERROR nova.compute.manager [instance: 8de2ffb3-e264-49f7-8581-6eae21adcaeb]   File "/opt/stack/nova/nova/compute/manager.py", line 4132, in _do_rebuild_instance
Nov 29 17:54:28 user nova-compute[74613]: ERROR nova.compute.manager [instance: 8de2ffb3-e264-49f7-8581-6eae21adcaeb]     self.driver.rebuild(**kwargs)
Nov 29 17:54:28 user nova-compute[74613]: ERROR nova.compute.manager [instance: 8de2ffb3-e264-49f7-8581-6eae21adcaeb]   File "/opt/stack/nova/nova/virt/driver.py", line 384, in rebuild
Nov 29 17:54:28 user nova-compute[74613]: ERROR nova.compute.manager [instance: 8de2ffb3-e264-49f7-8581-6eae21adcaeb]     raise NotImplementedError()
Nov 29 17:54:28 user nova-compute[74613]: ERROR nova.compute.manager [instance: 8de2ffb3-e264-49f7-8581-6eae21adcaeb] NotImplementedError
Nov 29 17:54:28 user nova-compute[74613]: ERROR nova.compute.manager [instance: 8de2ffb3-e264-49f7-8581-6eae21adcaeb] 
Nov 29 17:54:28 user nova-compute[74613]: ERROR nova.compute.manager [instance: 8de2ffb3-e264-49f7-8581-6eae21adcaeb] During handling of the above exception, another exception occurred:
Nov 29 17:54:28 user nova-compute[74613]: ERROR nova.compute.manager [instance: 8de2ffb3-e264-49f7-8581-6eae21adcaeb] 
Nov 29 17:54:28 user nova-compute[74613]: ERROR nova.compute.manager [instance: 8de2ffb3-e264-49f7-8581-6eae21adcaeb] Traceback (most recent call last):
Nov 29 17:54:28 user nova-compute[74613]: ERROR nova.compute.manager [instance: 8de2ffb3-e264-49f7-8581-6eae21adcaeb]   File "/opt/stack/nova/nova/compute/manager.py", line 2190, in _prep_block_device
Nov 29 17:54:28 user nova-compute[74613]: ERROR nova.compute.manager [instance: 8de2ffb3-e264-49f7-8581-6eae21adcaeb]     driver_block_device.attach_block_devices(
Nov 29 17:54:28 user nova-compute[74613]: ERROR nova.compute.manager [instance: 8de2ffb3-e264-49f7-8581-6eae21adcaeb]   File "/opt/stack/nova/nova/virt/block_device.py", line 936, in attach_block_devices
Nov 29 17:54:28 user nova-compute[74613]: ERROR nova.compute.manager [instance: 8de2ffb3-e264-49f7-8581-6eae21adcaeb]     _log_and_attach(device)
Nov 29 17:54:28 user nova-compute[74613]: ERROR nova.compute.manager [instance: 8de2ffb3-e264-49f7-8581-6eae21adcaeb]   File "/opt/stack/nova/nova/virt/block_device.py", line 933, in _log_and_attach
Nov 29 17:54:28 user nova-compute[74613]: ERROR nova.compute.manager [instance: 8de2ffb3-e264-49f7-8581-6eae21adcaeb]     bdm.attach(*attach_args, **attach_kwargs)
Nov 29 17:54:28 user nova-compute[74613]: ERROR nova.compute.manager [instance: 8de2ffb3-e264-49f7-8581-6eae21adcaeb]   File "/opt/stack/nova/nova/virt/block_device.py", line 46, in wrapped
Nov 29 17:54:28 user nova-compute[74613]: ERROR nova.compute.manager [instance: 8de2ffb3-e264-49f7-8581-6eae21adcaeb]     ret_val = method(obj, context, *args, **kwargs)
Nov 29 17:54:28 user nova-compute[74613]: ERROR nova.compute.manager [instance: 8de2ffb3-e264-49f7-8581-6eae21adcaeb]   File "/opt/stack/nova/nova/virt/block_device.py", line 734, in attach
Nov 29 17:54:28 user nova-compute[74613]: ERROR nova.compute.manager [instance: 8de2ffb3-e264-49f7-8581-6eae21adcaeb]     self._do_attach(context, instance, volume, volume_api,
Nov 29 17:54:28 user nova-compute[74613]: ERROR nova.compute.manager [instance: 8de2ffb3-e264-49f7-8581-6eae21adcaeb]   File "/opt/stack/nova/nova/virt/block_device.py", line 719, in _do_attach
Nov 29 17:54:28 user nova-compute[74613]: ERROR nova.compute.manager [instance: 8de2ffb3-e264-49f7-8581-6eae21adcaeb]     self._volume_attach(context, volume, connector, instance,
Nov 29 17:54:28 user nova-compute[74613]: ERROR nova.compute.manager [instance: 8de2ffb3-e264-49f7-8581-6eae21adcaeb]   File "/opt/stack/nova/nova/virt/block_device.py", line 633, in _volume_attach
Nov 29 17:54:28 user nova-compute[74613]: ERROR nova.compute.manager [instance: 8de2ffb3-e264-49f7-8581-6eae21adcaeb]     connection_info = volume_api.attachment_update(
Nov 29 17:54:28 user nova-compute[74613]: ERROR nova.compute.manager [instance: 8de2ffb3-e264-49f7-8581-6eae21adcaeb]   File "/opt/stack/nova/nova/volume/cinder.py", line 397, in wrapper
Nov 29 17:54:28 user nova-compute[74613]: ERROR nova.compute.manager [instance: 8de2ffb3-e264-49f7-8581-6eae21adcaeb]     res = method(self, ctx, *args, **kwargs)
Nov 29 17:54:28 user nova-compute[74613]: ERROR nova.compute.manager [instance: 8de2ffb3-e264-49f7-8581-6eae21adcaeb]   File "/opt/stack/nova/nova/volume/cinder.py", line 451, in wrapper
Nov 29 17:54:28 user nova-compute[74613]: ERROR nova.compute.manager [instance: 8de2ffb3-e264-49f7-8581-6eae21adcaeb]     res = method(self, ctx, attachment_id, *args, **kwargs)
Nov 29 17:54:28 user nova-compute[74613]: ERROR nova.compute.manager [instance: 8de2ffb3-e264-49f7-8581-6eae21adcaeb]   File "/opt/stack/nova/nova/volume/cinder.py", line 915, in attachment_update
Nov 29 17:54:28 user nova-compute[74613]: ERROR nova.compute.manager [instance: 8de2ffb3-e264-49f7-8581-6eae21adcaeb]     with excutils.save_and_reraise_exception():
Nov 29 17:54:28 user nova-compute[74613]: ERROR nova.compute.manager [instance: 8de2ffb3-e264-49f7-8581-6eae21adcaeb]   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Nov 29 17:54:28 user nova-compute[74613]: ERROR nova.compute.manager [instance: 8de2ffb3-e264-49f7-8581-6eae21adcaeb]     self.force_reraise()
Nov 29 17:54:28 user nova-compute[74613]: ERROR nova.compute.manager [instance: 8de2ffb3-e264-49f7-8581-6eae21adcaeb]   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Nov 29 17:54:28 user nova-compute[74613]: ERROR nova.compute.manager [instance: 8de2ffb3-e264-49f7-8581-6eae21adcaeb]     raise self.value
Nov 29 17:54:28 user nova-compute[74613]: ERROR nova.compute.manager [instance: 8de2ffb3-e264-49f7-8581-6eae21adcaeb]   File "/opt/stack/nova/nova/volume/cinder.py", line 909, in attachment_update
Nov 29 17:54:28 user nova-compute[74613]: ERROR nova.compute.manager [instance: 8de2ffb3-e264-49f7-8581-6eae21adcaeb]     context, '3.44', skip_version_check=True).attachments.update(
Nov 29 17:54:28 user nova-compute[74613]: ERROR nova.compute.manager [instance: 8de2ffb3-e264-49f7-8581-6eae21adcaeb]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/api_versions.py", line 421, in substitution
Nov 29 17:54:28 user nova-compute[74613]: ERROR nova.compute.manager [instance: 8de2ffb3-e264-49f7-8581-6eae21adcaeb]     return method.func(obj, *args, **kwargs)
Nov 29 17:54:28 user nova-compute[74613]: ERROR nova.compute.manager [instance: 8de2ffb3-e264-49f7-8581-6eae21adcaeb]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/attachments.py", line 75, in update
Nov 29 17:54:28 user nova-compute[74613]: ERROR nova.compute.manager [instance: 8de2ffb3-e264-49f7-8581-6eae21adcaeb]     resp = self._update('/attachments/%s' % id, body)
Nov 29 17:54:28 user nova-compute[74613]: ERROR nova.compute.manager [instance: 8de2ffb3-e264-49f7-8581-6eae21adcaeb]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/base.py", line 318, in _update
Nov 29 17:54:28 user nova-compute[74613]: ERROR nova.compute.manager [instance: 8de2ffb3-e264-49f7-8581-6eae21adcaeb]     resp, body = self.api.client.put(url, body=body, **kwargs)
Nov 29 17:54:28 user nova-compute[74613]: ERROR nova.compute.manager [instance: 8de2ffb3-e264-49f7-8581-6eae21adcaeb]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 226, in put
Nov 29 17:54:28 user nova-compute[74613]: ERROR nova.compute.manager [instance: 8de2ffb3-e264-49f7-8581-6eae21adcaeb]     return self._cs_request(url, 'PUT', **kwargs)
Nov 29 17:54:28 user nova-compute[74613]: ERROR nova.compute.manager [instance: 8de2ffb3-e264-49f7-8581-6eae21adcaeb]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Nov 29 17:54:28 user nova-compute[74613]: ERROR nova.compute.manager [instance: 8de2ffb3-e264-49f7-8581-6eae21adcaeb]     return self.request(url, method, **kwargs)
Nov 29 17:54:28 user nova-compute[74613]: ERROR nova.compute.manager [instance: 8de2ffb3-e264-49f7-8581-6eae21adcaeb]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Nov 29 17:54:28 user nova-compute[74613]: ERROR nova.compute.manager [instance: 8de2ffb3-e264-49f7-8581-6eae21adcaeb]     raise exceptions.from_response(resp, body)
Nov 29 17:54:28 user nova-compute[74613]: ERROR nova.compute.manager [instance: 8de2ffb3-e264-49f7-8581-6eae21adcaeb] cinderclient.exceptions.ClientException: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-6bf24f09-025c-46a8-9234-f6f76c1c498b)
Nov 29 17:54:28 user nova-compute[74613]: ERROR nova.compute.manager [instance: 8de2ffb3-e264-49f7-8581-6eae21adcaeb] 
Nov 29 17:54:28 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-671f7534-dbe3-42a5-a209-31786ddcb369 tempest-TaggedAttachmentsTest-1438740121 tempest-TaggedAttachmentsTest-1438740121-project-member] Acquiring lock "interface-288b8261-8706-4696-879d-d4dd01ab553e-5984be75-0336-4f84-a5f3-52f4e3fbeaa3" by "nova.compute.manager.ComputeManager.detach_interface.<locals>.do_detach_interface" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 17:54:28 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-671f7534-dbe3-42a5-a209-31786ddcb369 tempest-TaggedAttachmentsTest-1438740121 tempest-TaggedAttachmentsTest-1438740121-project-member] Lock "interface-288b8261-8706-4696-879d-d4dd01ab553e-5984be75-0336-4f84-a5f3-52f4e3fbeaa3" acquired by "nova.compute.manager.ComputeManager.detach_interface.<locals>.do_detach_interface" :: waited 0.001s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 17:54:28 user nova-compute[74613]: DEBUG nova.objects.instance [None req-671f7534-dbe3-42a5-a209-31786ddcb369 tempest-TaggedAttachmentsTest-1438740121 tempest-TaggedAttachmentsTest-1438740121-project-member] Lazy-loading 'flavor' on Instance uuid 288b8261-8706-4696-879d-d4dd01ab553e {{(pid=74613) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 17:54:28 user nova-compute[74613]: DEBUG nova.virt.libvirt.vif [None req-671f7534-dbe3-42a5-a209-31786ddcb369 tempest-TaggedAttachmentsTest-1438740121 tempest-TaggedAttachmentsTest-1438740121-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-29T17:51:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=InstanceDeviceMetadata,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-697059192',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-697059192',id=8,image_ref='4217f428-8d9d-4ee1-9614-642d26d90c46',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFUFE7U0lYNK45/HsStCT3AXLpdrJnwoY/KNgsNZxe8b6bxv4jkHRb2DHfVVdKmIkJ56BYNQ81Tfxi8bOx3gLzOij7zz7pkeTvdmFF3bs2gbkvzpJfe42Gy5jL3poiHfSw==',key_name='tempest-keypair-587676949',keypairs=<?>,launch_index=0,launched_at=2023-11-29T17:52:07Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='fdebfa0bb4bf45338ce3fa1ded5cd5bd',ramdisk_id='',reservation_id='r-cg74z5d5',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='4217f428-8d9d-4ee1-9614-642d26d90c46',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-1438740121',owner_user_name='tempest-TaggedAttachmentsTest-1438740121-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-11-29T17:52:07Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='52aa43eddf17484b9823bf13f548d22b',uuid=288b8261-8706-4696-879d-d4dd01ab553e,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "5984be75-0336-4f84-a5f3-52f4e3fbeaa3", "address": "fa:16:3e:3d:db:4e", "network": {"id": "e3b3f364-2bb0-4376-b571-7fa6432b4455", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1115785953", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.185", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "fdebfa0bb4bf45338ce3fa1ded5cd5bd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5984be75-03", "ovs_interfaceid": "5984be75-0336-4f84-a5f3-52f4e3fbeaa3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74613) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 29 17:54:28 user nova-compute[74613]: DEBUG nova.network.os_vif_util [None req-671f7534-dbe3-42a5-a209-31786ddcb369 tempest-TaggedAttachmentsTest-1438740121 tempest-TaggedAttachmentsTest-1438740121-project-member] Converting VIF {"id": "5984be75-0336-4f84-a5f3-52f4e3fbeaa3", "address": "fa:16:3e:3d:db:4e", "network": {"id": "e3b3f364-2bb0-4376-b571-7fa6432b4455", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1115785953", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.185", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "fdebfa0bb4bf45338ce3fa1ded5cd5bd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5984be75-03", "ovs_interfaceid": "5984be75-0336-4f84-a5f3-52f4e3fbeaa3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74613) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 17:54:28 user nova-compute[74613]: DEBUG nova.network.os_vif_util [None req-671f7534-dbe3-42a5-a209-31786ddcb369 tempest-TaggedAttachmentsTest-1438740121 tempest-TaggedAttachmentsTest-1438740121-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:3d:db:4e,bridge_name='br-int',has_traffic_filtering=True,id=5984be75-0336-4f84-a5f3-52f4e3fbeaa3,network=Network(e3b3f364-2bb0-4376-b571-7fa6432b4455),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5984be75-03') {{(pid=74613) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 17:54:28 user nova-compute[74613]: DEBUG nova.virt.libvirt.guest [None req-671f7534-dbe3-42a5-a209-31786ddcb369 tempest-TaggedAttachmentsTest-1438740121 tempest-TaggedAttachmentsTest-1438740121-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:3d:db:4e"/><model type="virtio"/><mtu size="1442"/><target dev="tap5984be75-03"/></interface> {{(pid=74613) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Nov 29 17:54:28 user nova-compute[74613]: DEBUG nova.virt.libvirt.guest [None req-671f7534-dbe3-42a5-a209-31786ddcb369 tempest-TaggedAttachmentsTest-1438740121 tempest-TaggedAttachmentsTest-1438740121-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:3d:db:4e"/><model type="virtio"/><mtu size="1442"/><target dev="tap5984be75-03"/></interface> {{(pid=74613) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Nov 29 17:54:28 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-671f7534-dbe3-42a5-a209-31786ddcb369 tempest-TaggedAttachmentsTest-1438740121 tempest-TaggedAttachmentsTest-1438740121-project-member] Attempting to detach device tap5984be75-03 from instance 288b8261-8706-4696-879d-d4dd01ab553e from the persistent domain config. {{(pid=74613) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 29 17:54:28 user nova-compute[74613]: DEBUG nova.virt.libvirt.guest [None req-671f7534-dbe3-42a5-a209-31786ddcb369 tempest-TaggedAttachmentsTest-1438740121 tempest-TaggedAttachmentsTest-1438740121-project-member] detach device xml: <interface type="ethernet">
Nov 29 17:54:28 user nova-compute[74613]:   <mac address="fa:16:3e:3d:db:4e"/>
Nov 29 17:54:28 user nova-compute[74613]:   <model type="virtio"/>
Nov 29 17:54:28 user nova-compute[74613]:   <mtu size="1442"/>
Nov 29 17:54:28 user nova-compute[74613]:   <target dev="tap5984be75-03"/>
Nov 29 17:54:28 user nova-compute[74613]: </interface>
Nov 29 17:54:28 user nova-compute[74613]:  {{(pid=74613) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 29 17:54:28 user nova-compute[74613]: DEBUG nova.network.neutron [None req-34635a9f-32ad-4d56-b62c-9a4fc2486b5d tempest-ServerBootFromVolumeStableRescueTest-414665510 tempest-ServerBootFromVolumeStableRescueTest-414665510-project-member] [instance: cd22685a-028c-4e0c-834d-e7b20f6d06ab] Successfully updated port: 5b08bd65-707e-48a5-800b-dd0670c88d61 {{(pid=74613) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 29 17:54:28 user nova-compute[74613]: DEBUG nova.virt.libvirt.guest [None req-671f7534-dbe3-42a5-a209-31786ddcb369 tempest-TaggedAttachmentsTest-1438740121 tempest-TaggedAttachmentsTest-1438740121-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:3d:db:4e"/><model type="virtio"/><mtu size="1442"/><target dev="tap5984be75-03"/></interface> {{(pid=74613) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Nov 29 17:54:28 user nova-compute[74613]: DEBUG nova.virt.libvirt.guest [None req-671f7534-dbe3-42a5-a209-31786ddcb369 tempest-TaggedAttachmentsTest-1438740121 tempest-TaggedAttachmentsTest-1438740121-project-member] interface for config: <interface type="ethernet"><mac address="fa:16:3e:3d:db:4e"/><model type="virtio"/><mtu size="1442"/><target dev="tap5984be75-03"/></interface>not found in domain: <domain type='kvm' id='8'>
Nov 29 17:54:28 user nova-compute[74613]:   <name>instance-00000008</name>
Nov 29 17:54:28 user nova-compute[74613]:   <uuid>288b8261-8706-4696-879d-d4dd01ab553e</uuid>
Nov 29 17:54:28 user nova-compute[74613]:   <metadata>
Nov 29 17:54:28 user nova-compute[74613]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1" xmlns:instance="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 29 17:54:28 user nova-compute[74613]:   <nova:package version="0.0.0"/>
Nov 29 17:54:28 user nova-compute[74613]:   <nova:name>tempest-device-tagging-server-697059192</nova:name>
Nov 29 17:54:28 user nova-compute[74613]:   <nova:creationTime>2023-11-29 17:53:49</nova:creationTime>
Nov 29 17:54:28 user nova-compute[74613]:   <nova:flavor name="m1.tiny">
Nov 29 17:54:28 user nova-compute[74613]:     <nova:memory>512</nova:memory>
Nov 29 17:54:28 user nova-compute[74613]:     <nova:disk>1</nova:disk>
Nov 29 17:54:28 user nova-compute[74613]:     <nova:swap>0</nova:swap>
Nov 29 17:54:28 user nova-compute[74613]:     <nova:ephemeral>0</nova:ephemeral>
Nov 29 17:54:28 user nova-compute[74613]:     <nova:vcpus>1</nova:vcpus>
Nov 29 17:54:28 user nova-compute[74613]:   </nova:flavor>
Nov 29 17:54:28 user nova-compute[74613]:   <nova:owner>
Nov 29 17:54:28 user nova-compute[74613]:     <nova:user uuid="52aa43eddf17484b9823bf13f548d22b">tempest-TaggedAttachmentsTest-1438740121-project-member</nova:user>
Nov 29 17:54:28 user nova-compute[74613]:     <nova:project uuid="fdebfa0bb4bf45338ce3fa1ded5cd5bd">tempest-TaggedAttachmentsTest-1438740121</nova:project>
Nov 29 17:54:28 user nova-compute[74613]:   </nova:owner>
Nov 29 17:54:28 user nova-compute[74613]:   <nova:root type="image" uuid="4217f428-8d9d-4ee1-9614-642d26d90c46"/>
Nov 29 17:54:28 user nova-compute[74613]:   <nova:ports>
Nov 29 17:54:28 user nova-compute[74613]:     <nova:port uuid="abe5d419-60cc-474c-935a-60f5512894e0">
Nov 29 17:54:28 user nova-compute[74613]:       <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Nov 29 17:54:28 user nova-compute[74613]:     </nova:port>
Nov 29 17:54:28 user nova-compute[74613]:     <nova:port uuid="5984be75-0336-4f84-a5f3-52f4e3fbeaa3">
Nov 29 17:54:28 user nova-compute[74613]:       <nova:ip type="fixed" address="10.10.10.185" ipVersion="4"/>
Nov 29 17:54:28 user nova-compute[74613]:     </nova:port>
Nov 29 17:54:28 user nova-compute[74613]:   </nova:ports>
Nov 29 17:54:28 user nova-compute[74613]: </nova:instance>
Nov 29 17:54:28 user nova-compute[74613]:   </metadata>
Nov 29 17:54:28 user nova-compute[74613]:   <memory unit='KiB'>524288</memory>
Nov 29 17:54:28 user nova-compute[74613]:   <currentMemory unit='KiB'>524288</currentMemory>
Nov 29 17:54:28 user nova-compute[74613]:   <vcpu placement='static'>1</vcpu>
Nov 29 17:54:28 user nova-compute[74613]:   <resource>
Nov 29 17:54:28 user nova-compute[74613]:     <partition>/machine</partition>
Nov 29 17:54:28 user nova-compute[74613]:   </resource>
Nov 29 17:54:28 user nova-compute[74613]:   <sysinfo type='smbios'>
Nov 29 17:54:28 user nova-compute[74613]:     <system>
Nov 29 17:54:28 user nova-compute[74613]:       <entry name='manufacturer'>OpenStack Foundation</entry>
Nov 29 17:54:28 user nova-compute[74613]:       <entry name='product'>OpenStack Nova</entry>
Nov 29 17:54:28 user nova-compute[74613]:       <entry name='version'>0.0.0</entry>
Nov 29 17:54:28 user nova-compute[74613]:       <entry name='serial'>288b8261-8706-4696-879d-d4dd01ab553e</entry>
Nov 29 17:54:28 user nova-compute[74613]:       <entry name='uuid'>288b8261-8706-4696-879d-d4dd01ab553e</entry>
Nov 29 17:54:28 user nova-compute[74613]:       <entry name='family'>Virtual Machine</entry>
Nov 29 17:54:28 user nova-compute[74613]:     </system>
Nov 29 17:54:28 user nova-compute[74613]:   </sysinfo>
Nov 29 17:54:28 user nova-compute[74613]:   <os>
Nov 29 17:54:28 user nova-compute[74613]:     <type arch='x86_64' machine='pc-i440fx-6.2'>hvm</type>
Nov 29 17:54:28 user nova-compute[74613]:     <boot dev='hd'/>
Nov 29 17:54:28 user nova-compute[74613]:     <smbios mode='sysinfo'/>
Nov 29 17:54:28 user nova-compute[74613]:   </os>
Nov 29 17:54:28 user nova-compute[74613]:   <features>
Nov 29 17:54:28 user nova-compute[74613]:     <acpi/>
Nov 29 17:54:28 user nova-compute[74613]:     <apic/>
Nov 29 17:54:28 user nova-compute[74613]:     <vmcoreinfo state='on'/>
Nov 29 17:54:28 user nova-compute[74613]:   </features>
Nov 29 17:54:28 user nova-compute[74613]:   <cpu mode='custom' match='exact' check='full'>
Nov 29 17:54:28 user nova-compute[74613]:     <model fallback='forbid'>Nehalem</model>
Nov 29 17:54:28 user nova-compute[74613]:     <topology sockets='1' dies='1' cores='1' threads='1'/>
Nov 29 17:54:28 user nova-compute[74613]:     <feature policy='require' name='vme'/>
Nov 29 17:54:28 user nova-compute[74613]:     <feature policy='require' name='x2apic'/>
Nov 29 17:54:28 user nova-compute[74613]:     <feature policy='require' name='hypervisor'/>
Nov 29 17:54:28 user nova-compute[74613]:   </cpu>
Nov 29 17:54:28 user nova-compute[74613]:   <clock offset='utc'>
Nov 29 17:54:28 user nova-compute[74613]:     <timer name='pit' tickpolicy='delay'/>
Nov 29 17:54:28 user nova-compute[74613]:     <timer name='rtc' tickpolicy='catchup'/>
Nov 29 17:54:28 user nova-compute[74613]:     <timer name='hpet' present='no'/>
Nov 29 17:54:28 user nova-compute[74613]:   </clock>
Nov 29 17:54:28 user nova-compute[74613]:   <on_poweroff>destroy</on_poweroff>
Nov 29 17:54:28 user nova-compute[74613]:   <on_reboot>restart</on_reboot>
Nov 29 17:54:28 user nova-compute[74613]:   <on_crash>destroy</on_crash>
Nov 29 17:54:28 user nova-compute[74613]:   <devices>
Nov 29 17:54:28 user nova-compute[74613]:     <emulator>/usr/bin/qemu-system-x86_64</emulator>
Nov 29 17:54:28 user nova-compute[74613]:     <disk type='file' device='disk'>
Nov 29 17:54:28 user nova-compute[74613]:       <driver name='qemu' type='qcow2' cache='none'/>
Nov 29 17:54:28 user nova-compute[74613]:       <source file='/opt/stack/data/nova/instances/288b8261-8706-4696-879d-d4dd01ab553e/disk' index='2'/>
Nov 29 17:54:28 user nova-compute[74613]:       <backingStore type='file' index='3'>
Nov 29 17:54:28 user nova-compute[74613]:         <format type='raw'/>
Nov 29 17:54:28 user nova-compute[74613]:         <source file='/opt/stack/data/nova/instances/_base/21faea9e6951f3bdd0153b76ac89fe1a60a34758'/>
Nov 29 17:54:28 user nova-compute[74613]:         <backingStore/>
Nov 29 17:54:28 user nova-compute[74613]:       </backingStore>
Nov 29 17:54:28 user nova-compute[74613]:       <target dev='vda' bus='virtio'/>
Nov 29 17:54:28 user nova-compute[74613]:       <alias name='virtio-disk0'/>
Nov 29 17:54:28 user nova-compute[74613]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x04' function='0x0'/>
Nov 29 17:54:28 user nova-compute[74613]:     </disk>
Nov 29 17:54:28 user nova-compute[74613]:     <disk type='file' device='cdrom'>
Nov 29 17:54:28 user nova-compute[74613]:       <driver name='qemu' type='raw' cache='none'/>
Nov 29 17:54:28 user nova-compute[74613]:       <source file='/opt/stack/data/nova/instances/288b8261-8706-4696-879d-d4dd01ab553e/disk.config' index='1'/>
Nov 29 17:54:28 user nova-compute[74613]:       <backingStore/>
Nov 29 17:54:28 user nova-compute[74613]:       <target dev='hda' bus='ide'/>
Nov 29 17:54:28 user nova-compute[74613]:       <readonly/>
Nov 29 17:54:28 user nova-compute[74613]:       <alias name='ide0-0-0'/>
Nov 29 17:54:28 user nova-compute[74613]:       <address type='drive' controller='0' bus='0' target='0' unit='0'/>
Nov 29 17:54:28 user nova-compute[74613]:     </disk>
Nov 29 17:54:28 user nova-compute[74613]:     <controller type='usb' index='0' model='none'>
Nov 29 17:54:28 user nova-compute[74613]:       <alias name='usb'/>
Nov 29 17:54:28 user nova-compute[74613]:     </controller>
Nov 29 17:54:28 user nova-compute[74613]:     <controller type='pci' index='0' model='pci-root'>
Nov 29 17:54:28 user nova-compute[74613]:       <alias name='pci.0'/>
Nov 29 17:54:28 user nova-compute[74613]:     </controller>
Nov 29 17:54:28 user nova-compute[74613]:     <controller type='ide' index='0'>
Nov 29 17:54:28 user nova-compute[74613]:       <alias name='ide'/>
Nov 29 17:54:28 user nova-compute[74613]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x1'/>
Nov 29 17:54:28 user nova-compute[74613]:     </controller>
Nov 29 17:54:28 user nova-compute[74613]:     <interface type='ethernet'>
Nov 29 17:54:28 user nova-compute[74613]:       <mac address='fa:16:3e:14:7b:54'/>
Nov 29 17:54:28 user nova-compute[74613]:       <target dev='tapabe5d419-60'/>
Nov 29 17:54:28 user nova-compute[74613]:       <model type='virtio'/>
Nov 29 17:54:28 user nova-compute[74613]:       <mtu size='1442'/>
Nov 29 17:54:28 user nova-compute[74613]:       <alias name='net0'/>
Nov 29 17:54:28 user nova-compute[74613]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x03' function='0x0'/>
Nov 29 17:54:28 user nova-compute[74613]:     </interface>
Nov 29 17:54:28 user nova-compute[74613]:     <interface type='ethernet'>
Nov 29 17:54:28 user nova-compute[74613]:       <mac address='fa:16:3e:3d:db:4e'/>
Nov 29 17:54:28 user nova-compute[74613]:       <target dev='tap5984be75-03'/>
Nov 29 17:54:28 user nova-compute[74613]:       <model type='virtio'/>
Nov 29 17:54:28 user nova-compute[74613]:       <mtu size='1442'/>
Nov 29 17:54:28 user nova-compute[74613]:       <alias name='net1'/>
Nov 29 17:54:28 user nova-compute[74613]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x07' function='0x0'/>
Nov 29 17:54:28 user nova-compute[74613]:     </interface>
Nov 29 17:54:28 user nova-compute[74613]:     <serial type='pty'>
Nov 29 17:54:28 user nova-compute[74613]:       <source path='/dev/pts/7'/>
Nov 29 17:54:28 user nova-compute[74613]:       <log file='/opt/stack/data/nova/instances/288b8261-8706-4696-879d-d4dd01ab553e/console.log' append='off'/>
Nov 29 17:54:28 user nova-compute[74613]:       <target type='isa-serial' port='0'>
Nov 29 17:54:28 user nova-compute[74613]:         <model name='isa-serial'/>
Nov 29 17:54:28 user nova-compute[74613]:       </target>
Nov 29 17:54:28 user nova-compute[74613]:       <alias name='serial0'/>
Nov 29 17:54:28 user nova-compute[74613]:     </serial>
Nov 29 17:54:28 user nova-compute[74613]:     <console type='pty' tty='/dev/pts/7'>
Nov 29 17:54:28 user nova-compute[74613]:       <source path='/dev/pts/7'/>
Nov 29 17:54:28 user nova-compute[74613]:       <log file='/opt/stack/data/nova/instances/288b8261-8706-4696-879d-d4dd01ab553e/console.log' append='off'/>
Nov 29 17:54:28 user nova-compute[74613]:       <target type='serial' port='0'/>
Nov 29 17:54:28 user nova-compute[74613]:       <alias name='serial0'/>
Nov 29 17:54:28 user nova-compute[74613]:     </console>
Nov 29 17:54:28 user nova-compute[74613]:     <input type='mouse' bus='ps2'>
Nov 29 17:54:28 user nova-compute[74613]:       <alias name='input0'/>
Nov 29 17:54:28 user nova-compute[74613]:     </input>
Nov 29 17:54:28 user nova-compute[74613]:     <input type='keyboard' bus='ps2'>
Nov 29 17:54:28 user nova-compute[74613]:       <alias name='input1'/>
Nov 29 17:54:28 user nova-compute[74613]:     </input>
Nov 29 17:54:28 user nova-compute[74613]:     <graphics type='vnc' port='5907' autoport='yes' listen='0.0.0.0'>
Nov 29 17:54:28 user nova-compute[74613]:       <listen type='address' address='0.0.0.0'/>
Nov 29 17:54:28 user nova-compute[74613]:     </graphics>
Nov 29 17:54:28 user nova-compute[74613]:     <audio id='1' type='none'/>
Nov 29 17:54:28 user nova-compute[74613]:     <video>
Nov 29 17:54:28 user nova-compute[74613]:       <model type='virtio' heads='1' primary='yes'/>
Nov 29 17:54:28 user nova-compute[74613]:       <alias name='video0'/>
Nov 29 17:54:28 user nova-compute[74613]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x0'/>
Nov 29 17:54:28 user nova-compute[74613]:     </video>
Nov 29 17:54:28 user nova-compute[74613]:     <memballoon model='virtio'>
Nov 29 17:54:28 user nova-compute[74613]:       <stats period='10'/>
Nov 29 17:54:28 user nova-compute[74613]:       <alias name='balloon0'/>
Nov 29 17:54:28 user nova-compute[74613]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x05' function='0x0'/>
Nov 29 17:54:28 user nova-compute[74613]:     </memballoon>
Nov 29 17:54:28 user nova-compute[74613]:     <rng model='virtio'>
Nov 29 17:54:28 user nova-compute[74613]:       <backend model='random'>/dev/urandom</backend>
Nov 29 17:54:28 user nova-compute[74613]:       <alias name='rng0'/>
Nov 29 17:54:28 user nova-compute[74613]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x06' function='0x0'/>
Nov 29 17:54:28 user nova-compute[74613]:     </rng>
Nov 29 17:54:28 user nova-compute[74613]:   </devices>
Nov 29 17:54:28 user nova-compute[74613]:   <seclabel type='dynamic' model='apparmor' relabel='yes'>
Nov 29 17:54:28 user nova-compute[74613]:     <label>libvirt-288b8261-8706-4696-879d-d4dd01ab553e</label>
Nov 29 17:54:28 user nova-compute[74613]:     <imagelabel>libvirt-288b8261-8706-4696-879d-d4dd01ab553e</imagelabel>
Nov 29 17:54:28 user nova-compute[74613]:   </seclabel>
Nov 29 17:54:28 user nova-compute[74613]:   <seclabel type='dynamic' model='dac' relabel='yes'>
Nov 29 17:54:28 user nova-compute[74613]:     <label>+64055:+108</label>
Nov 29 17:54:28 user nova-compute[74613]:     <imagelabel>+64055:+108</imagelabel>
Nov 29 17:54:28 user nova-compute[74613]:   </seclabel>
Nov 29 17:54:28 user nova-compute[74613]: </domain>
Nov 29 17:54:28 user nova-compute[74613]:  {{(pid=74613) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:282}}
Nov 29 17:54:28 user nova-compute[74613]: INFO nova.virt.libvirt.driver [None req-671f7534-dbe3-42a5-a209-31786ddcb369 tempest-TaggedAttachmentsTest-1438740121 tempest-TaggedAttachmentsTest-1438740121-project-member] Successfully detached device tap5984be75-03 from instance 288b8261-8706-4696-879d-d4dd01ab553e from the persistent domain config.
Nov 29 17:54:28 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-671f7534-dbe3-42a5-a209-31786ddcb369 tempest-TaggedAttachmentsTest-1438740121 tempest-TaggedAttachmentsTest-1438740121-project-member] (1/8): Attempting to detach device tap5984be75-03 with device alias net1 from instance 288b8261-8706-4696-879d-d4dd01ab553e from the live domain config. {{(pid=74613) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 29 17:54:28 user nova-compute[74613]: DEBUG nova.virt.libvirt.guest [None req-671f7534-dbe3-42a5-a209-31786ddcb369 tempest-TaggedAttachmentsTest-1438740121 tempest-TaggedAttachmentsTest-1438740121-project-member] detach device xml: <interface type="ethernet">
Nov 29 17:54:28 user nova-compute[74613]:   <mac address="fa:16:3e:3d:db:4e"/>
Nov 29 17:54:28 user nova-compute[74613]:   <model type="virtio"/>
Nov 29 17:54:28 user nova-compute[74613]:   <mtu size="1442"/>
Nov 29 17:54:28 user nova-compute[74613]:   <target dev="tap5984be75-03"/>
Nov 29 17:54:28 user nova-compute[74613]: </interface>
Nov 29 17:54:28 user nova-compute[74613]:  {{(pid=74613) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 29 17:54:28 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-34635a9f-32ad-4d56-b62c-9a4fc2486b5d tempest-ServerBootFromVolumeStableRescueTest-414665510 tempest-ServerBootFromVolumeStableRescueTest-414665510-project-member] Acquiring lock "refresh_cache-cd22685a-028c-4e0c-834d-e7b20f6d06ab" {{(pid=74613) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 17:54:28 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-34635a9f-32ad-4d56-b62c-9a4fc2486b5d tempest-ServerBootFromVolumeStableRescueTest-414665510 tempest-ServerBootFromVolumeStableRescueTest-414665510-project-member] Acquired lock "refresh_cache-cd22685a-028c-4e0c-834d-e7b20f6d06ab" {{(pid=74613) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 17:54:28 user nova-compute[74613]: DEBUG nova.network.neutron [None req-34635a9f-32ad-4d56-b62c-9a4fc2486b5d tempest-ServerBootFromVolumeStableRescueTest-414665510 tempest-ServerBootFromVolumeStableRescueTest-414665510-project-member] [instance: cd22685a-028c-4e0c-834d-e7b20f6d06ab] Building network info cache for instance {{(pid=74613) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 29 17:54:28 user nova-compute[74613]: DEBUG nova.compute.utils [None req-b2e6bae2-6e73-43a2-bae3-85645df54ba9 tempest-ServerActionsV293TestJSON-169231013 tempest-ServerActionsV293TestJSON-169231013-project-member] [instance: 8de2ffb3-e264-49f7-8581-6eae21adcaeb] Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-6bf24f09-025c-46a8-9234-f6f76c1c498b) {{(pid=74613) notify_about_instance_usage /opt/stack/nova/nova/compute/utils.py:430}}
Nov 29 17:54:28 user nova-compute[74613]: ERROR nova.compute.manager [None req-b2e6bae2-6e73-43a2-bae3-85645df54ba9 tempest-ServerActionsV293TestJSON-169231013 tempest-ServerActionsV293TestJSON-169231013-project-member] [instance: 8de2ffb3-e264-49f7-8581-6eae21adcaeb] Setting instance vm_state to ERROR: nova.exception.InvalidBDM: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-6bf24f09-025c-46a8-9234-f6f76c1c498b)
Nov 29 17:54:28 user nova-compute[74613]: ERROR nova.compute.manager [instance: 8de2ffb3-e264-49f7-8581-6eae21adcaeb] Traceback (most recent call last):
Nov 29 17:54:28 user nova-compute[74613]: ERROR nova.compute.manager [instance: 8de2ffb3-e264-49f7-8581-6eae21adcaeb]   File "/opt/stack/nova/nova/compute/manager.py", line 4132, in _do_rebuild_instance
Nov 29 17:54:28 user nova-compute[74613]: ERROR nova.compute.manager [instance: 8de2ffb3-e264-49f7-8581-6eae21adcaeb]     self.driver.rebuild(**kwargs)
Nov 29 17:54:28 user nova-compute[74613]: ERROR nova.compute.manager [instance: 8de2ffb3-e264-49f7-8581-6eae21adcaeb]   File "/opt/stack/nova/nova/virt/driver.py", line 384, in rebuild
Nov 29 17:54:28 user nova-compute[74613]: ERROR nova.compute.manager [instance: 8de2ffb3-e264-49f7-8581-6eae21adcaeb]     raise NotImplementedError()
Nov 29 17:54:28 user nova-compute[74613]: ERROR nova.compute.manager [instance: 8de2ffb3-e264-49f7-8581-6eae21adcaeb] NotImplementedError
Nov 29 17:54:28 user nova-compute[74613]: ERROR nova.compute.manager [instance: 8de2ffb3-e264-49f7-8581-6eae21adcaeb] 
Nov 29 17:54:28 user nova-compute[74613]: ERROR nova.compute.manager [instance: 8de2ffb3-e264-49f7-8581-6eae21adcaeb] During handling of the above exception, another exception occurred:
Nov 29 17:54:28 user nova-compute[74613]: ERROR nova.compute.manager [instance: 8de2ffb3-e264-49f7-8581-6eae21adcaeb] 
Nov 29 17:54:28 user nova-compute[74613]: ERROR nova.compute.manager [instance: 8de2ffb3-e264-49f7-8581-6eae21adcaeb] Traceback (most recent call last):
Nov 29 17:54:28 user nova-compute[74613]: ERROR nova.compute.manager [instance: 8de2ffb3-e264-49f7-8581-6eae21adcaeb]   File "/opt/stack/nova/nova/compute/manager.py", line 2190, in _prep_block_device
Nov 29 17:54:28 user nova-compute[74613]: ERROR nova.compute.manager [instance: 8de2ffb3-e264-49f7-8581-6eae21adcaeb]     driver_block_device.attach_block_devices(
Nov 29 17:54:28 user nova-compute[74613]: ERROR nova.compute.manager [instance: 8de2ffb3-e264-49f7-8581-6eae21adcaeb]   File "/opt/stack/nova/nova/virt/block_device.py", line 936, in attach_block_devices
Nov 29 17:54:28 user nova-compute[74613]: ERROR nova.compute.manager [instance: 8de2ffb3-e264-49f7-8581-6eae21adcaeb]     _log_and_attach(device)
Nov 29 17:54:28 user nova-compute[74613]: ERROR nova.compute.manager [instance: 8de2ffb3-e264-49f7-8581-6eae21adcaeb]   File "/opt/stack/nova/nova/virt/block_device.py", line 933, in _log_and_attach
Nov 29 17:54:28 user nova-compute[74613]: ERROR nova.compute.manager [instance: 8de2ffb3-e264-49f7-8581-6eae21adcaeb]     bdm.attach(*attach_args, **attach_kwargs)
Nov 29 17:54:28 user nova-compute[74613]: ERROR nova.compute.manager [instance: 8de2ffb3-e264-49f7-8581-6eae21adcaeb]   File "/opt/stack/nova/nova/virt/block_device.py", line 46, in wrapped
Nov 29 17:54:28 user nova-compute[74613]: ERROR nova.compute.manager [instance: 8de2ffb3-e264-49f7-8581-6eae21adcaeb]     ret_val = method(obj, context, *args, **kwargs)
Nov 29 17:54:28 user nova-compute[74613]: ERROR nova.compute.manager [instance: 8de2ffb3-e264-49f7-8581-6eae21adcaeb]   File "/opt/stack/nova/nova/virt/block_device.py", line 734, in attach
Nov 29 17:54:28 user nova-compute[74613]: ERROR nova.compute.manager [instance: 8de2ffb3-e264-49f7-8581-6eae21adcaeb]     self._do_attach(context, instance, volume, volume_api,
Nov 29 17:54:28 user nova-compute[74613]: ERROR nova.compute.manager [instance: 8de2ffb3-e264-49f7-8581-6eae21adcaeb]   File "/opt/stack/nova/nova/virt/block_device.py", line 719, in _do_attach
Nov 29 17:54:28 user nova-compute[74613]: ERROR nova.compute.manager [instance: 8de2ffb3-e264-49f7-8581-6eae21adcaeb]     self._volume_attach(context, volume, connector, instance,
Nov 29 17:54:28 user nova-compute[74613]: ERROR nova.compute.manager [instance: 8de2ffb3-e264-49f7-8581-6eae21adcaeb]   File "/opt/stack/nova/nova/virt/block_device.py", line 633, in _volume_attach
Nov 29 17:54:28 user nova-compute[74613]: ERROR nova.compute.manager [instance: 8de2ffb3-e264-49f7-8581-6eae21adcaeb]     connection_info = volume_api.attachment_update(
Nov 29 17:54:28 user nova-compute[74613]: ERROR nova.compute.manager [instance: 8de2ffb3-e264-49f7-8581-6eae21adcaeb]   File "/opt/stack/nova/nova/volume/cinder.py", line 397, in wrapper
Nov 29 17:54:28 user nova-compute[74613]: ERROR nova.compute.manager [instance: 8de2ffb3-e264-49f7-8581-6eae21adcaeb]     res = method(self, ctx, *args, **kwargs)
Nov 29 17:54:28 user nova-compute[74613]: ERROR nova.compute.manager [instance: 8de2ffb3-e264-49f7-8581-6eae21adcaeb]   File "/opt/stack/nova/nova/volume/cinder.py", line 451, in wrapper
Nov 29 17:54:28 user nova-compute[74613]: ERROR nova.compute.manager [instance: 8de2ffb3-e264-49f7-8581-6eae21adcaeb]     res = method(self, ctx, attachment_id, *args, **kwargs)
Nov 29 17:54:28 user nova-compute[74613]: ERROR nova.compute.manager [instance: 8de2ffb3-e264-49f7-8581-6eae21adcaeb]   File "/opt/stack/nova/nova/volume/cinder.py", line 915, in attachment_update
Nov 29 17:54:28 user nova-compute[74613]: ERROR nova.compute.manager [instance: 8de2ffb3-e264-49f7-8581-6eae21adcaeb]     with excutils.save_and_reraise_exception():
Nov 29 17:54:28 user nova-compute[74613]: ERROR nova.compute.manager [instance: 8de2ffb3-e264-49f7-8581-6eae21adcaeb]   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Nov 29 17:54:28 user nova-compute[74613]: ERROR nova.compute.manager [instance: 8de2ffb3-e264-49f7-8581-6eae21adcaeb]     self.force_reraise()
Nov 29 17:54:28 user nova-compute[74613]: ERROR nova.compute.manager [instance: 8de2ffb3-e264-49f7-8581-6eae21adcaeb]   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Nov 29 17:54:28 user nova-compute[74613]: ERROR nova.compute.manager [instance: 8de2ffb3-e264-49f7-8581-6eae21adcaeb]     raise self.value
Nov 29 17:54:28 user nova-compute[74613]: ERROR nova.compute.manager [instance: 8de2ffb3-e264-49f7-8581-6eae21adcaeb]   File "/opt/stack/nova/nova/volume/cinder.py", line 909, in attachment_update
Nov 29 17:54:28 user nova-compute[74613]: ERROR nova.compute.manager [instance: 8de2ffb3-e264-49f7-8581-6eae21adcaeb]     context, '3.44', skip_version_check=True).attachments.update(
Nov 29 17:54:28 user nova-compute[74613]: ERROR nova.compute.manager [instance: 8de2ffb3-e264-49f7-8581-6eae21adcaeb]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/api_versions.py", line 421, in substitution
Nov 29 17:54:28 user nova-compute[74613]: ERROR nova.compute.manager [instance: 8de2ffb3-e264-49f7-8581-6eae21adcaeb]     return method.func(obj, *args, **kwargs)
Nov 29 17:54:28 user nova-compute[74613]: ERROR nova.compute.manager [instance: 8de2ffb3-e264-49f7-8581-6eae21adcaeb]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/attachments.py", line 75, in update
Nov 29 17:54:28 user nova-compute[74613]: ERROR nova.compute.manager [instance: 8de2ffb3-e264-49f7-8581-6eae21adcaeb]     resp = self._update('/attachments/%s' % id, body)
Nov 29 17:54:28 user nova-compute[74613]: ERROR nova.compute.manager [instance: 8de2ffb3-e264-49f7-8581-6eae21adcaeb]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/base.py", line 318, in _update
Nov 29 17:54:28 user nova-compute[74613]: ERROR nova.compute.manager [instance: 8de2ffb3-e264-49f7-8581-6eae21adcaeb]     resp, body = self.api.client.put(url, body=body, **kwargs)
Nov 29 17:54:28 user nova-compute[74613]: ERROR nova.compute.manager [instance: 8de2ffb3-e264-49f7-8581-6eae21adcaeb]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 226, in put
Nov 29 17:54:28 user nova-compute[74613]: ERROR nova.compute.manager [instance: 8de2ffb3-e264-49f7-8581-6eae21adcaeb]     return self._cs_request(url, 'PUT', **kwargs)
Nov 29 17:54:28 user nova-compute[74613]: ERROR nova.compute.manager [instance: 8de2ffb3-e264-49f7-8581-6eae21adcaeb]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Nov 29 17:54:28 user nova-compute[74613]: ERROR nova.compute.manager [instance: 8de2ffb3-e264-49f7-8581-6eae21adcaeb]     return self.request(url, method, **kwargs)
Nov 29 17:54:28 user nova-compute[74613]: ERROR nova.compute.manager [instance: 8de2ffb3-e264-49f7-8581-6eae21adcaeb]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Nov 29 17:54:28 user nova-compute[74613]: ERROR nova.compute.manager [instance: 8de2ffb3-e264-49f7-8581-6eae21adcaeb]     raise exceptions.from_response(resp, body)
Nov 29 17:54:28 user nova-compute[74613]: ERROR nova.compute.manager [instance: 8de2ffb3-e264-49f7-8581-6eae21adcaeb] cinderclient.exceptions.ClientException: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-6bf24f09-025c-46a8-9234-f6f76c1c498b)
Nov 29 17:54:28 user nova-compute[74613]: ERROR nova.compute.manager [instance: 8de2ffb3-e264-49f7-8581-6eae21adcaeb] 
Nov 29 17:54:28 user nova-compute[74613]: ERROR nova.compute.manager [instance: 8de2ffb3-e264-49f7-8581-6eae21adcaeb] During handling of the above exception, another exception occurred:
Nov 29 17:54:28 user nova-compute[74613]: ERROR nova.compute.manager [instance: 8de2ffb3-e264-49f7-8581-6eae21adcaeb] 
Nov 29 17:54:28 user nova-compute[74613]: ERROR nova.compute.manager [instance: 8de2ffb3-e264-49f7-8581-6eae21adcaeb] Traceback (most recent call last):
Nov 29 17:54:28 user nova-compute[74613]: ERROR nova.compute.manager [instance: 8de2ffb3-e264-49f7-8581-6eae21adcaeb]   File "/opt/stack/nova/nova/compute/manager.py", line 10846, in _error_out_instance_on_exception
Nov 29 17:54:28 user nova-compute[74613]: ERROR nova.compute.manager [instance: 8de2ffb3-e264-49f7-8581-6eae21adcaeb]     yield
Nov 29 17:54:28 user nova-compute[74613]: ERROR nova.compute.manager [instance: 8de2ffb3-e264-49f7-8581-6eae21adcaeb]   File "/opt/stack/nova/nova/compute/manager.py", line 3858, in rebuild_instance
Nov 29 17:54:28 user nova-compute[74613]: ERROR nova.compute.manager [instance: 8de2ffb3-e264-49f7-8581-6eae21adcaeb]     self._do_rebuild_instance_with_claim(
Nov 29 17:54:28 user nova-compute[74613]: ERROR nova.compute.manager [instance: 8de2ffb3-e264-49f7-8581-6eae21adcaeb]   File "/opt/stack/nova/nova/compute/manager.py", line 3944, in _do_rebuild_instance_with_claim
Nov 29 17:54:28 user nova-compute[74613]: ERROR nova.compute.manager [instance: 8de2ffb3-e264-49f7-8581-6eae21adcaeb]     self._do_rebuild_instance(
Nov 29 17:54:28 user nova-compute[74613]: ERROR nova.compute.manager [instance: 8de2ffb3-e264-49f7-8581-6eae21adcaeb]   File "/opt/stack/nova/nova/compute/manager.py", line 4136, in _do_rebuild_instance
Nov 29 17:54:28 user nova-compute[74613]: ERROR nova.compute.manager [instance: 8de2ffb3-e264-49f7-8581-6eae21adcaeb]     self._rebuild_default_impl(**kwargs)
Nov 29 17:54:28 user nova-compute[74613]: ERROR nova.compute.manager [instance: 8de2ffb3-e264-49f7-8581-6eae21adcaeb]   File "/opt/stack/nova/nova/compute/manager.py", line 3719, in _rebuild_default_impl
Nov 29 17:54:28 user nova-compute[74613]: ERROR nova.compute.manager [instance: 8de2ffb3-e264-49f7-8581-6eae21adcaeb]     new_block_device_info = attach_block_devices(context, instance, bdms)
Nov 29 17:54:28 user nova-compute[74613]: ERROR nova.compute.manager [instance: 8de2ffb3-e264-49f7-8581-6eae21adcaeb]   File "/opt/stack/nova/nova/compute/manager.py", line 2209, in _prep_block_device
Nov 29 17:54:28 user nova-compute[74613]: ERROR nova.compute.manager [instance: 8de2ffb3-e264-49f7-8581-6eae21adcaeb]     raise exception.InvalidBDM(str(ex))
Nov 29 17:54:28 user nova-compute[74613]: ERROR nova.compute.manager [instance: 8de2ffb3-e264-49f7-8581-6eae21adcaeb] nova.exception.InvalidBDM: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-6bf24f09-025c-46a8-9234-f6f76c1c498b)
Nov 29 17:54:28 user nova-compute[74613]: ERROR nova.compute.manager [instance: 8de2ffb3-e264-49f7-8581-6eae21adcaeb] 
Nov 29 17:54:28 user nova-compute[74613]: DEBUG nova.compute.manager [req-c72e4757-07d2-4bee-adde-b574e3298272 req-570b0475-f617-4105-9542-8e9d4f347d4d service nova] [instance: cd22685a-028c-4e0c-834d-e7b20f6d06ab] Received event network-changed-5b08bd65-707e-48a5-800b-dd0670c88d61 {{(pid=74613) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 17:54:28 user nova-compute[74613]: DEBUG nova.compute.manager [req-c72e4757-07d2-4bee-adde-b574e3298272 req-570b0475-f617-4105-9542-8e9d4f347d4d service nova] [instance: cd22685a-028c-4e0c-834d-e7b20f6d06ab] Refreshing instance network info cache due to event network-changed-5b08bd65-707e-48a5-800b-dd0670c88d61. {{(pid=74613) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 17:54:28 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-c72e4757-07d2-4bee-adde-b574e3298272 req-570b0475-f617-4105-9542-8e9d4f347d4d service nova] Acquiring lock "refresh_cache-cd22685a-028c-4e0c-834d-e7b20f6d06ab" {{(pid=74613) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 17:54:28 user nova-compute[74613]: DEBUG nova.network.neutron [None req-34635a9f-32ad-4d56-b62c-9a4fc2486b5d tempest-ServerBootFromVolumeStableRescueTest-414665510 tempest-ServerBootFromVolumeStableRescueTest-414665510-project-member] [instance: cd22685a-028c-4e0c-834d-e7b20f6d06ab] Instance cache missing network info. {{(pid=74613) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 29 17:54:28 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-b2e6bae2-6e73-43a2-bae3-85645df54ba9 tempest-ServerActionsV293TestJSON-169231013 tempest-ServerActionsV293TestJSON-169231013-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 17:54:28 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-b2e6bae2-6e73-43a2-bae3-85645df54ba9 tempest-ServerActionsV293TestJSON-169231013 tempest-ServerActionsV293TestJSON-169231013-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 17:54:28 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:54:28 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:54:28 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:54:28 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-671f7534-dbe3-42a5-a209-31786ddcb369 tempest-TaggedAttachmentsTest-1438740121 tempest-TaggedAttachmentsTest-1438740121-project-member] Start waiting for the detach event from libvirt for device tap5984be75-03 with device alias net1 for instance 288b8261-8706-4696-879d-d4dd01ab553e {{(pid=74613) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 29 17:54:28 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:54:28 user nova-compute[74613]: DEBUG nova.compute.manager [req-4115377d-c8fe-4e23-b1ef-e53baf9be209 req-8d6a58d3-4fc9-4e81-82a3-b4a308974d46 service nova] [instance: 3f285832-64a7-48e8-875a-f9e1566a66b6] Received event network-vif-deleted-3fe23755-ec08-4b17-87b2-c1eebd36042b {{(pid=74613) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 17:54:28 user nova-compute[74613]: DEBUG nova.network.neutron [None req-34635a9f-32ad-4d56-b62c-9a4fc2486b5d tempest-ServerBootFromVolumeStableRescueTest-414665510 tempest-ServerBootFromVolumeStableRescueTest-414665510-project-member] [instance: cd22685a-028c-4e0c-834d-e7b20f6d06ab] Updating instance_info_cache with network_info: [{"id": "5b08bd65-707e-48a5-800b-dd0670c88d61", "address": "fa:16:3e:28:d8:3d", "network": {"id": "0722b02d-a357-4360-87e8-580913723985", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-579793494-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b820dd795dfe46cd804772f0e71f98e9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5b08bd65-70", "ovs_interfaceid": "5b08bd65-707e-48a5-800b-dd0670c88d61", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74613) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 17:54:28 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-34635a9f-32ad-4d56-b62c-9a4fc2486b5d tempest-ServerBootFromVolumeStableRescueTest-414665510 tempest-ServerBootFromVolumeStableRescueTest-414665510-project-member] Releasing lock "refresh_cache-cd22685a-028c-4e0c-834d-e7b20f6d06ab" {{(pid=74613) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 17:54:28 user nova-compute[74613]: DEBUG nova.compute.manager [None req-34635a9f-32ad-4d56-b62c-9a4fc2486b5d tempest-ServerBootFromVolumeStableRescueTest-414665510 tempest-ServerBootFromVolumeStableRescueTest-414665510-project-member] [instance: cd22685a-028c-4e0c-834d-e7b20f6d06ab] Instance network_info: |[{"id": "5b08bd65-707e-48a5-800b-dd0670c88d61", "address": "fa:16:3e:28:d8:3d", "network": {"id": "0722b02d-a357-4360-87e8-580913723985", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-579793494-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b820dd795dfe46cd804772f0e71f98e9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5b08bd65-70", "ovs_interfaceid": "5b08bd65-707e-48a5-800b-dd0670c88d61", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74613) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 29 17:54:28 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-c72e4757-07d2-4bee-adde-b574e3298272 req-570b0475-f617-4105-9542-8e9d4f347d4d service nova] Acquired lock "refresh_cache-cd22685a-028c-4e0c-834d-e7b20f6d06ab" {{(pid=74613) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 17:54:28 user nova-compute[74613]: DEBUG nova.network.neutron [req-c72e4757-07d2-4bee-adde-b574e3298272 req-570b0475-f617-4105-9542-8e9d4f347d4d service nova] [instance: cd22685a-028c-4e0c-834d-e7b20f6d06ab] Refreshing network info cache for port 5b08bd65-707e-48a5-800b-dd0670c88d61 {{(pid=74613) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 17:54:29 user nova-compute[74613]: DEBUG nova.compute.provider_tree [None req-b2e6bae2-6e73-43a2-bae3-85645df54ba9 tempest-ServerActionsV293TestJSON-169231013 tempest-ServerActionsV293TestJSON-169231013-project-member] Inventory has not changed in ProviderTree for provider: 639d980e-3b12-44b1-b8f4-1812416fa4dd {{(pid=74613) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 17:54:29 user nova-compute[74613]: DEBUG nova.scheduler.client.report [None req-b2e6bae2-6e73-43a2-bae3-85645df54ba9 tempest-ServerActionsV293TestJSON-169231013 tempest-ServerActionsV293TestJSON-169231013-project-member] Inventory has not changed for provider 639d980e-3b12-44b1-b8f4-1812416fa4dd based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74613) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 17:54:29 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-b2e6bae2-6e73-43a2-bae3-85645df54ba9 tempest-ServerActionsV293TestJSON-169231013 tempest-ServerActionsV293TestJSON-169231013-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.857s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 17:54:29 user nova-compute[74613]: INFO nova.compute.manager [None req-b2e6bae2-6e73-43a2-bae3-85645df54ba9 tempest-ServerActionsV293TestJSON-169231013 tempest-ServerActionsV293TestJSON-169231013-project-member] [instance: 8de2ffb3-e264-49f7-8581-6eae21adcaeb] Successfully reverted task state from rebuild_block_device_mapping on failure for instance.
Nov 29 17:54:29 user nova-compute[74613]: ERROR oslo_messaging.rpc.server [None req-b2e6bae2-6e73-43a2-bae3-85645df54ba9 tempest-ServerActionsV293TestJSON-169231013 tempest-ServerActionsV293TestJSON-169231013-project-member] Exception during message handling: nova.exception.InvalidBDM: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-6bf24f09-025c-46a8-9234-f6f76c1c498b)
Nov 29 17:54:29 user nova-compute[74613]: ERROR oslo_messaging.rpc.server Traceback (most recent call last):
Nov 29 17:54:29 user nova-compute[74613]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 4132, in _do_rebuild_instance
Nov 29 17:54:29 user nova-compute[74613]: ERROR oslo_messaging.rpc.server     self.driver.rebuild(**kwargs)
Nov 29 17:54:29 user nova-compute[74613]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/driver.py", line 384, in rebuild
Nov 29 17:54:29 user nova-compute[74613]: ERROR oslo_messaging.rpc.server     raise NotImplementedError()
Nov 29 17:54:29 user nova-compute[74613]: ERROR oslo_messaging.rpc.server NotImplementedError
Nov 29 17:54:29 user nova-compute[74613]: ERROR oslo_messaging.rpc.server 
Nov 29 17:54:29 user nova-compute[74613]: ERROR oslo_messaging.rpc.server During handling of the above exception, another exception occurred:
Nov 29 17:54:29 user nova-compute[74613]: ERROR oslo_messaging.rpc.server 
Nov 29 17:54:29 user nova-compute[74613]: ERROR oslo_messaging.rpc.server Traceback (most recent call last):
Nov 29 17:54:29 user nova-compute[74613]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 2190, in _prep_block_device
Nov 29 17:54:29 user nova-compute[74613]: ERROR oslo_messaging.rpc.server     driver_block_device.attach_block_devices(
Nov 29 17:54:29 user nova-compute[74613]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/block_device.py", line 936, in attach_block_devices
Nov 29 17:54:29 user nova-compute[74613]: ERROR oslo_messaging.rpc.server     _log_and_attach(device)
Nov 29 17:54:29 user nova-compute[74613]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/block_device.py", line 933, in _log_and_attach
Nov 29 17:54:29 user nova-compute[74613]: ERROR oslo_messaging.rpc.server     bdm.attach(*attach_args, **attach_kwargs)
Nov 29 17:54:29 user nova-compute[74613]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/block_device.py", line 46, in wrapped
Nov 29 17:54:29 user nova-compute[74613]: ERROR oslo_messaging.rpc.server     ret_val = method(obj, context, *args, **kwargs)
Nov 29 17:54:29 user nova-compute[74613]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/block_device.py", line 734, in attach
Nov 29 17:54:29 user nova-compute[74613]: ERROR oslo_messaging.rpc.server     self._do_attach(context, instance, volume, volume_api,
Nov 29 17:54:29 user nova-compute[74613]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/block_device.py", line 719, in _do_attach
Nov 29 17:54:29 user nova-compute[74613]: ERROR oslo_messaging.rpc.server     self._volume_attach(context, volume, connector, instance,
Nov 29 17:54:29 user nova-compute[74613]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/block_device.py", line 633, in _volume_attach
Nov 29 17:54:29 user nova-compute[74613]: ERROR oslo_messaging.rpc.server     connection_info = volume_api.attachment_update(
Nov 29 17:54:29 user nova-compute[74613]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/volume/cinder.py", line 397, in wrapper
Nov 29 17:54:29 user nova-compute[74613]: ERROR oslo_messaging.rpc.server     res = method(self, ctx, *args, **kwargs)
Nov 29 17:54:29 user nova-compute[74613]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/volume/cinder.py", line 451, in wrapper
Nov 29 17:54:29 user nova-compute[74613]: ERROR oslo_messaging.rpc.server     res = method(self, ctx, attachment_id, *args, **kwargs)
Nov 29 17:54:29 user nova-compute[74613]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/volume/cinder.py", line 915, in attachment_update
Nov 29 17:54:29 user nova-compute[74613]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Nov 29 17:54:29 user nova-compute[74613]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Nov 29 17:54:29 user nova-compute[74613]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Nov 29 17:54:29 user nova-compute[74613]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Nov 29 17:54:29 user nova-compute[74613]: ERROR oslo_messaging.rpc.server     raise self.value
Nov 29 17:54:29 user nova-compute[74613]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/volume/cinder.py", line 909, in attachment_update
Nov 29 17:54:29 user nova-compute[74613]: ERROR oslo_messaging.rpc.server     context, '3.44', skip_version_check=True).attachments.update(
Nov 29 17:54:29 user nova-compute[74613]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/api_versions.py", line 421, in substitution
Nov 29 17:54:29 user nova-compute[74613]: ERROR oslo_messaging.rpc.server     return method.func(obj, *args, **kwargs)
Nov 29 17:54:29 user nova-compute[74613]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/attachments.py", line 75, in update
Nov 29 17:54:29 user nova-compute[74613]: ERROR oslo_messaging.rpc.server     resp = self._update('/attachments/%s' % id, body)
Nov 29 17:54:29 user nova-compute[74613]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/base.py", line 318, in _update
Nov 29 17:54:29 user nova-compute[74613]: ERROR oslo_messaging.rpc.server     resp, body = self.api.client.put(url, body=body, **kwargs)
Nov 29 17:54:29 user nova-compute[74613]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 226, in put
Nov 29 17:54:29 user nova-compute[74613]: ERROR oslo_messaging.rpc.server     return self._cs_request(url, 'PUT', **kwargs)
Nov 29 17:54:29 user nova-compute[74613]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Nov 29 17:54:29 user nova-compute[74613]: ERROR oslo_messaging.rpc.server     return self.request(url, method, **kwargs)
Nov 29 17:54:29 user nova-compute[74613]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Nov 29 17:54:29 user nova-compute[74613]: ERROR oslo_messaging.rpc.server     raise exceptions.from_response(resp, body)
Nov 29 17:54:29 user nova-compute[74613]: ERROR oslo_messaging.rpc.server cinderclient.exceptions.ClientException: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-6bf24f09-025c-46a8-9234-f6f76c1c498b)
Nov 29 17:54:29 user nova-compute[74613]: ERROR oslo_messaging.rpc.server 
Nov 29 17:54:29 user nova-compute[74613]: ERROR oslo_messaging.rpc.server During handling of the above exception, another exception occurred:
Nov 29 17:54:29 user nova-compute[74613]: ERROR oslo_messaging.rpc.server 
Nov 29 17:54:29 user nova-compute[74613]: ERROR oslo_messaging.rpc.server Traceback (most recent call last):
Nov 29 17:54:29 user nova-compute[74613]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py", line 165, in _process_incoming
Nov 29 17:54:29 user nova-compute[74613]: ERROR oslo_messaging.rpc.server     res = self.dispatcher.dispatch(message)
Nov 29 17:54:29 user nova-compute[74613]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch
Nov 29 17:54:29 user nova-compute[74613]: ERROR oslo_messaging.rpc.server     return self._do_dispatch(endpoint, method, ctxt, args)
Nov 29 17:54:29 user nova-compute[74613]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch
Nov 29 17:54:29 user nova-compute[74613]: ERROR oslo_messaging.rpc.server     result = func(ctxt, **new_args)
Nov 29 17:54:29 user nova-compute[74613]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py", line 244, in inner
Nov 29 17:54:29 user nova-compute[74613]: ERROR oslo_messaging.rpc.server     return func(*args, **kwargs)
Nov 29 17:54:29 user nova-compute[74613]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 65, in wrapped
Nov 29 17:54:29 user nova-compute[74613]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Nov 29 17:54:29 user nova-compute[74613]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Nov 29 17:54:29 user nova-compute[74613]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Nov 29 17:54:29 user nova-compute[74613]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Nov 29 17:54:29 user nova-compute[74613]: ERROR oslo_messaging.rpc.server     raise self.value
Nov 29 17:54:29 user nova-compute[74613]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped
Nov 29 17:54:29 user nova-compute[74613]: ERROR oslo_messaging.rpc.server     return f(self, context, *args, **kw)
Nov 29 17:54:29 user nova-compute[74613]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 166, in decorated_function
Nov 29 17:54:29 user nova-compute[74613]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Nov 29 17:54:29 user nova-compute[74613]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Nov 29 17:54:29 user nova-compute[74613]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Nov 29 17:54:29 user nova-compute[74613]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Nov 29 17:54:29 user nova-compute[74613]: ERROR oslo_messaging.rpc.server     raise self.value
Nov 29 17:54:29 user nova-compute[74613]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 157, in decorated_function
Nov 29 17:54:29 user nova-compute[74613]: ERROR oslo_messaging.rpc.server     return function(self, context, *args, **kwargs)
Nov 29 17:54:29 user nova-compute[74613]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/utils.py", line 1439, in decorated_function
Nov 29 17:54:29 user nova-compute[74613]: ERROR oslo_messaging.rpc.server     return function(self, context, *args, **kwargs)
Nov 29 17:54:29 user nova-compute[74613]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 213, in decorated_function
Nov 29 17:54:29 user nova-compute[74613]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Nov 29 17:54:29 user nova-compute[74613]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Nov 29 17:54:29 user nova-compute[74613]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Nov 29 17:54:29 user nova-compute[74613]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Nov 29 17:54:29 user nova-compute[74613]: ERROR oslo_messaging.rpc.server     raise self.value
Nov 29 17:54:29 user nova-compute[74613]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 203, in decorated_function
Nov 29 17:54:29 user nova-compute[74613]: ERROR oslo_messaging.rpc.server     return function(self, context, *args, **kwargs)
Nov 29 17:54:29 user nova-compute[74613]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 3858, in rebuild_instance
Nov 29 17:54:29 user nova-compute[74613]: ERROR oslo_messaging.rpc.server     self._do_rebuild_instance_with_claim(
Nov 29 17:54:29 user nova-compute[74613]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 3944, in _do_rebuild_instance_with_claim
Nov 29 17:54:29 user nova-compute[74613]: ERROR oslo_messaging.rpc.server     self._do_rebuild_instance(
Nov 29 17:54:29 user nova-compute[74613]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 4136, in _do_rebuild_instance
Nov 29 17:54:29 user nova-compute[74613]: ERROR oslo_messaging.rpc.server     self._rebuild_default_impl(**kwargs)
Nov 29 17:54:29 user nova-compute[74613]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 3719, in _rebuild_default_impl
Nov 29 17:54:29 user nova-compute[74613]: ERROR oslo_messaging.rpc.server     new_block_device_info = attach_block_devices(context, instance, bdms)
Nov 29 17:54:29 user nova-compute[74613]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 2209, in _prep_block_device
Nov 29 17:54:29 user nova-compute[74613]: ERROR oslo_messaging.rpc.server     raise exception.InvalidBDM(str(ex))
Nov 29 17:54:29 user nova-compute[74613]: ERROR oslo_messaging.rpc.server nova.exception.InvalidBDM: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-6bf24f09-025c-46a8-9234-f6f76c1c498b)
Nov 29 17:54:29 user nova-compute[74613]: ERROR oslo_messaging.rpc.server 
Nov 29 17:54:29 user nova-compute[74613]: DEBUG nova.network.neutron [req-c72e4757-07d2-4bee-adde-b574e3298272 req-570b0475-f617-4105-9542-8e9d4f347d4d service nova] [instance: cd22685a-028c-4e0c-834d-e7b20f6d06ab] Updated VIF entry in instance network info cache for port 5b08bd65-707e-48a5-800b-dd0670c88d61. {{(pid=74613) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 17:54:29 user nova-compute[74613]: DEBUG nova.network.neutron [req-c72e4757-07d2-4bee-adde-b574e3298272 req-570b0475-f617-4105-9542-8e9d4f347d4d service nova] [instance: cd22685a-028c-4e0c-834d-e7b20f6d06ab] Updating instance_info_cache with network_info: [{"id": "5b08bd65-707e-48a5-800b-dd0670c88d61", "address": "fa:16:3e:28:d8:3d", "network": {"id": "0722b02d-a357-4360-87e8-580913723985", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-579793494-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b820dd795dfe46cd804772f0e71f98e9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5b08bd65-70", "ovs_interfaceid": "5b08bd65-707e-48a5-800b-dd0670c88d61", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74613) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 17:54:29 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-c72e4757-07d2-4bee-adde-b574e3298272 req-570b0475-f617-4105-9542-8e9d4f347d4d service nova] Releasing lock "refresh_cache-cd22685a-028c-4e0c-834d-e7b20f6d06ab" {{(pid=74613) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 17:54:30 user nova-compute[74613]: DEBUG nova.compute.manager [None req-221e9b1a-1b65-4670-ba37-8036c279e598 tempest-TestVolumeSwap-1038735411 tempest-TestVolumeSwap-1038735411-project-admin] [instance: 0008521b-5a63-4ff6-8390-d343956900ed] swap_volume: Updating volume 49f19a7e-3b8b-44b4-b289-808ee2a18b91 BDM record with {'connection_info': '{"driver_volume_type": "iscsi", "data": {"target_iqn": "iqn.2010-10.org.openstack:a6b34bdb-5c08-4f7c-b3f5-6b68413947a8", "target_portal": "172.16.0.220:3260", "target_discovered": false, "auth_method": "CHAP", "auth_username": "SAqnwafp", "auth_password": "35rUxiayVGJvfb", "target_lun": 0, "qos_specs": null, "access_mode": "rw", "encrypted": false, "cacheable": false, "device_path": "/dev/sdf", "volume_id": "a6b34bdb-5c08-4f7c-b3f5-6b68413947a8"}, "status": "reserved", "instance": "0008521b-5a63-4ff6-8390-d343956900ed", "attached_at": "", "detached_at": "", "volume_id": "a6b34bdb-5c08-4f7c-b3f5-6b68413947a8", "serial": "a6b34bdb-5c08-4f7c-b3f5-6b68413947a8"}', 'source_type': 'volume', 'destination_type': 'volume', 'snapshot_id': None, 'volume_id': 'a6b34bdb-5c08-4f7c-b3f5-6b68413947a8', 'no_device': None, 'attachment_id': '84cf3a8d-7cb6-4c57-84c4-c9992d94b798'} {{(pid=74613) _do_swap_volume /opt/stack/nova/nova/compute/manager.py:7984}}
Nov 29 17:54:30 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-221e9b1a-1b65-4670-ba37-8036c279e598 tempest-TestVolumeSwap-1038735411 tempest-TestVolumeSwap-1038735411-project-admin] Lock "0008521b-5a63-4ff6-8390-d343956900ed" "released" by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" :: held 20.441s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 17:54:30 user nova-compute[74613]: DEBUG nova.compute.manager [req-afbaa2a4-4c05-460c-afc8-bfaa8bd818a4 req-0ab71b53-5da4-4a2c-9e43-e6999aa44c51 service nova] [instance: 288b8261-8706-4696-879d-d4dd01ab553e] Received event network-vif-unplugged-5984be75-0336-4f84-a5f3-52f4e3fbeaa3 {{(pid=74613) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 17:54:30 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-afbaa2a4-4c05-460c-afc8-bfaa8bd818a4 req-0ab71b53-5da4-4a2c-9e43-e6999aa44c51 service nova] Acquiring lock "288b8261-8706-4696-879d-d4dd01ab553e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 17:54:30 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-afbaa2a4-4c05-460c-afc8-bfaa8bd818a4 req-0ab71b53-5da4-4a2c-9e43-e6999aa44c51 service nova] Lock "288b8261-8706-4696-879d-d4dd01ab553e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 17:54:30 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-afbaa2a4-4c05-460c-afc8-bfaa8bd818a4 req-0ab71b53-5da4-4a2c-9e43-e6999aa44c51 service nova] Lock "288b8261-8706-4696-879d-d4dd01ab553e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 17:54:30 user nova-compute[74613]: DEBUG nova.compute.manager [req-afbaa2a4-4c05-460c-afc8-bfaa8bd818a4 req-0ab71b53-5da4-4a2c-9e43-e6999aa44c51 service nova] [instance: 288b8261-8706-4696-879d-d4dd01ab553e] No waiting events found dispatching network-vif-unplugged-5984be75-0336-4f84-a5f3-52f4e3fbeaa3 {{(pid=74613) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 17:54:30 user nova-compute[74613]: WARNING nova.compute.manager [req-afbaa2a4-4c05-460c-afc8-bfaa8bd818a4 req-0ab71b53-5da4-4a2c-9e43-e6999aa44c51 service nova] [instance: 288b8261-8706-4696-879d-d4dd01ab553e] Received unexpected event network-vif-unplugged-5984be75-0336-4f84-a5f3-52f4e3fbeaa3 for instance with vm_state active and task_state None.
Nov 29 17:54:30 user nova-compute[74613]: DEBUG nova.compute.manager [req-afbaa2a4-4c05-460c-afc8-bfaa8bd818a4 req-0ab71b53-5da4-4a2c-9e43-e6999aa44c51 service nova] [instance: 288b8261-8706-4696-879d-d4dd01ab553e] Received event network-vif-plugged-5984be75-0336-4f84-a5f3-52f4e3fbeaa3 {{(pid=74613) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 17:54:30 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-afbaa2a4-4c05-460c-afc8-bfaa8bd818a4 req-0ab71b53-5da4-4a2c-9e43-e6999aa44c51 service nova] Acquiring lock "288b8261-8706-4696-879d-d4dd01ab553e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 17:54:30 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-afbaa2a4-4c05-460c-afc8-bfaa8bd818a4 req-0ab71b53-5da4-4a2c-9e43-e6999aa44c51 service nova] Lock "288b8261-8706-4696-879d-d4dd01ab553e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 17:54:30 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-afbaa2a4-4c05-460c-afc8-bfaa8bd818a4 req-0ab71b53-5da4-4a2c-9e43-e6999aa44c51 service nova] Lock "288b8261-8706-4696-879d-d4dd01ab553e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 17:54:30 user nova-compute[74613]: DEBUG nova.compute.manager [req-afbaa2a4-4c05-460c-afc8-bfaa8bd818a4 req-0ab71b53-5da4-4a2c-9e43-e6999aa44c51 service nova] [instance: 288b8261-8706-4696-879d-d4dd01ab553e] No waiting events found dispatching network-vif-plugged-5984be75-0336-4f84-a5f3-52f4e3fbeaa3 {{(pid=74613) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 17:54:30 user nova-compute[74613]: WARNING nova.compute.manager [req-afbaa2a4-4c05-460c-afc8-bfaa8bd818a4 req-0ab71b53-5da4-4a2c-9e43-e6999aa44c51 service nova] [instance: 288b8261-8706-4696-879d-d4dd01ab553e] Received unexpected event network-vif-plugged-5984be75-0336-4f84-a5f3-52f4e3fbeaa3 for instance with vm_state active and task_state None.
Nov 29 17:54:30 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:54:30 user nova-compute[74613]: INFO nova.compute.manager [None req-23a466ec-4c34-4fbf-8a45-ad85d880905e tempest-TaggedBootDevicesTest_v242-869407180 tempest-TaggedBootDevicesTest_v242-869407180-project-member] [instance: 3f285832-64a7-48e8-875a-f9e1566a66b6] Took 4.21 seconds to detach 3 volumes for instance.
Nov 29 17:54:30 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-23a466ec-4c34-4fbf-8a45-ad85d880905e tempest-TaggedBootDevicesTest_v242-869407180 tempest-TaggedBootDevicesTest_v242-869407180-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 17:54:30 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-23a466ec-4c34-4fbf-8a45-ad85d880905e tempest-TaggedBootDevicesTest_v242-869407180 tempest-TaggedBootDevicesTest_v242-869407180-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 17:54:31 user nova-compute[74613]: DEBUG nova.compute.provider_tree [None req-23a466ec-4c34-4fbf-8a45-ad85d880905e tempest-TaggedBootDevicesTest_v242-869407180 tempest-TaggedBootDevicesTest_v242-869407180-project-member] Inventory has not changed in ProviderTree for provider: 639d980e-3b12-44b1-b8f4-1812416fa4dd {{(pid=74613) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 17:54:31 user nova-compute[74613]: DEBUG nova.scheduler.client.report [None req-23a466ec-4c34-4fbf-8a45-ad85d880905e tempest-TaggedBootDevicesTest_v242-869407180 tempest-TaggedBootDevicesTest_v242-869407180-project-member] Inventory has not changed for provider 639d980e-3b12-44b1-b8f4-1812416fa4dd based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74613) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 17:54:31 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-23a466ec-4c34-4fbf-8a45-ad85d880905e tempest-TaggedBootDevicesTest_v242-869407180 tempest-TaggedBootDevicesTest_v242-869407180-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.270s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 17:54:31 user nova-compute[74613]: INFO nova.scheduler.client.report [None req-23a466ec-4c34-4fbf-8a45-ad85d880905e tempest-TaggedBootDevicesTest_v242-869407180 tempest-TaggedBootDevicesTest_v242-869407180-project-member] Deleted allocations for instance 3f285832-64a7-48e8-875a-f9e1566a66b6
Nov 29 17:54:31 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-23a466ec-4c34-4fbf-8a45-ad85d880905e tempest-TaggedBootDevicesTest_v242-869407180 tempest-TaggedBootDevicesTest_v242-869407180-project-member] Lock "3f285832-64a7-48e8-875a-f9e1566a66b6" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 13.351s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 17:54:31 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-5aac8e71-77b4-4ab8-9d58-8a4bde4c7c35 tempest-TestVolumeSwap-281539251 tempest-TestVolumeSwap-281539251-project-member] Acquiring lock "0008521b-5a63-4ff6-8390-d343956900ed" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 17:54:31 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-5aac8e71-77b4-4ab8-9d58-8a4bde4c7c35 tempest-TestVolumeSwap-281539251 tempest-TestVolumeSwap-281539251-project-member] Lock "0008521b-5a63-4ff6-8390-d343956900ed" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 17:54:31 user nova-compute[74613]: INFO nova.compute.manager [None req-5aac8e71-77b4-4ab8-9d58-8a4bde4c7c35 tempest-TestVolumeSwap-281539251 tempest-TestVolumeSwap-281539251-project-member] [instance: 0008521b-5a63-4ff6-8390-d343956900ed] Detaching volume a6b34bdb-5c08-4f7c-b3f5-6b68413947a8
Nov 29 17:54:31 user nova-compute[74613]: INFO nova.virt.block_device [None req-5aac8e71-77b4-4ab8-9d58-8a4bde4c7c35 tempest-TestVolumeSwap-281539251 tempest-TestVolumeSwap-281539251-project-member] [instance: 0008521b-5a63-4ff6-8390-d343956900ed] Attempting to driver detach volume a6b34bdb-5c08-4f7c-b3f5-6b68413947a8 from mountpoint /dev/vdb
Nov 29 17:54:31 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:54:31 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-5aac8e71-77b4-4ab8-9d58-8a4bde4c7c35 tempest-TestVolumeSwap-281539251 tempest-TestVolumeSwap-281539251-project-member] Attempting to detach device vdb from instance 0008521b-5a63-4ff6-8390-d343956900ed from the persistent domain config. {{(pid=74613) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 29 17:54:31 user nova-compute[74613]: DEBUG nova.virt.libvirt.guest [None req-5aac8e71-77b4-4ab8-9d58-8a4bde4c7c35 tempest-TestVolumeSwap-281539251 tempest-TestVolumeSwap-281539251-project-member] detach device xml: <disk type="block" device="disk">
Nov 29 17:54:31 user nova-compute[74613]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 17:54:31 user nova-compute[74613]:   <source dev="/dev/sdf"/>
Nov 29 17:54:31 user nova-compute[74613]:   <target dev="vdb" bus="virtio"/>
Nov 29 17:54:31 user nova-compute[74613]:   <serial>a6b34bdb-5c08-4f7c-b3f5-6b68413947a8</serial>
Nov 29 17:54:31 user nova-compute[74613]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 29 17:54:31 user nova-compute[74613]: </disk>
Nov 29 17:54:31 user nova-compute[74613]:  {{(pid=74613) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 29 17:54:31 user nova-compute[74613]: INFO nova.virt.libvirt.driver [None req-5aac8e71-77b4-4ab8-9d58-8a4bde4c7c35 tempest-TestVolumeSwap-281539251 tempest-TestVolumeSwap-281539251-project-member] Successfully detached device vdb from instance 0008521b-5a63-4ff6-8390-d343956900ed from the persistent domain config.
Nov 29 17:54:31 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-5aac8e71-77b4-4ab8-9d58-8a4bde4c7c35 tempest-TestVolumeSwap-281539251 tempest-TestVolumeSwap-281539251-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 0008521b-5a63-4ff6-8390-d343956900ed from the live domain config. {{(pid=74613) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 29 17:54:31 user nova-compute[74613]: DEBUG nova.virt.libvirt.guest [None req-5aac8e71-77b4-4ab8-9d58-8a4bde4c7c35 tempest-TestVolumeSwap-281539251 tempest-TestVolumeSwap-281539251-project-member] detach device xml: <disk type="block" device="disk">
Nov 29 17:54:31 user nova-compute[74613]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 17:54:31 user nova-compute[74613]:   <source dev="/dev/sdf"/>
Nov 29 17:54:31 user nova-compute[74613]:   <target dev="vdb" bus="virtio"/>
Nov 29 17:54:31 user nova-compute[74613]:   <serial>a6b34bdb-5c08-4f7c-b3f5-6b68413947a8</serial>
Nov 29 17:54:31 user nova-compute[74613]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 29 17:54:31 user nova-compute[74613]: </disk>
Nov 29 17:54:31 user nova-compute[74613]:  {{(pid=74613) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 29 17:54:32 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-5aac8e71-77b4-4ab8-9d58-8a4bde4c7c35 tempest-TestVolumeSwap-281539251 tempest-TestVolumeSwap-281539251-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 0008521b-5a63-4ff6-8390-d343956900ed {{(pid=74613) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 29 17:54:33 user nova-compute[74613]: DEBUG os_brick.utils [None req-34635a9f-32ad-4d56-b62c-9a4fc2486b5d tempest-ServerBootFromVolumeStableRescueTest-414665510 tempest-ServerBootFromVolumeStableRescueTest-414665510-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74613) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 17:54:33 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 17:54:33 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.012s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 17:54:33 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[a539163d-3a48-4028-ba5d-039ab89c476d]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:400972819b5\n', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 17:54:33 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 17:54:33 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 17:54:33 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4640a8c-05b8-4466-b932-4ed3f2fbf6ae]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 17:54:33 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 17:54:33 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 17:54:33 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[df639318-8e2f-41c1-ac94-e138b406149a]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 17:54:33 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2db73b6-a4f0-41cc-bcee-af9d2e0a83f2]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 17:54:33 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-34635a9f-32ad-4d56-b62c-9a4fc2486b5d tempest-ServerBootFromVolumeStableRescueTest-414665510 tempest-ServerBootFromVolumeStableRescueTest-414665510-project-member] Running cmd (subprocess): nvme version {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 17:54:33 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-34635a9f-32ad-4d56-b62c-9a4fc2486b5d tempest-ServerBootFromVolumeStableRescueTest-414665510 tempest-ServerBootFromVolumeStableRescueTest-414665510-project-member] 'nvme version' failed. Not Retrying. {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 17:54:33 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.nvmeof [None req-34635a9f-32ad-4d56-b62c-9a4fc2486b5d tempest-ServerBootFromVolumeStableRescueTest-414665510 tempest-ServerBootFromVolumeStableRescueTest-414665510-project-member] nvme not present on system {{(pid=74613) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 29 17:54:33 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 17:54:33 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 17:54:33 user nova-compute[74613]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 29 17:54:33 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c15b834-978b-46b1-9302-623a0a6698c9]: (4, '') {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 17:54:33 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.lightos [None req-34635a9f-32ad-4d56-b62c-9a4fc2486b5d tempest-ServerBootFromVolumeStableRescueTest-414665510 tempest-ServerBootFromVolumeStableRescueTest-414665510-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74613) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 29 17:54:33 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.lightos [None req-34635a9f-32ad-4d56-b62c-9a4fc2486b5d tempest-ServerBootFromVolumeStableRescueTest-414665510 tempest-ServerBootFromVolumeStableRescueTest-414665510-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74613) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 29 17:54:33 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.lightos [None req-34635a9f-32ad-4d56-b62c-9a4fc2486b5d tempest-ServerBootFromVolumeStableRescueTest-414665510 tempest-ServerBootFromVolumeStableRescueTest-414665510-project-member] LIGHTOS: no hostnqn found. {{(pid=74613) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 29 17:54:33 user nova-compute[74613]: DEBUG os_brick.utils [None req-34635a9f-32ad-4d56-b62c-9a4fc2486b5d tempest-ServerBootFromVolumeStableRescueTest-414665510 tempest-ServerBootFromVolumeStableRescueTest-414665510-project-member] <== get_connector_properties: return (116ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:400972819b5', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74613) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 17:54:33 user nova-compute[74613]: DEBUG nova.virt.block_device [None req-34635a9f-32ad-4d56-b62c-9a4fc2486b5d tempest-ServerBootFromVolumeStableRescueTest-414665510 tempest-ServerBootFromVolumeStableRescueTest-414665510-project-member] [instance: cd22685a-028c-4e0c-834d-e7b20f6d06ab] Updating existing volume attachment record: eb56d7f0-712e-400e-92a2-18de7926a154 {{(pid=74613) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 29 17:54:35 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:54:40 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 17:54:40 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 17:54:40 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=74613) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 29 17:54:40 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74613) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 17:54:40 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74613) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 17:54:40 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:54:41 user nova-compute[74613]: DEBUG nova.compute.manager [None req-34635a9f-32ad-4d56-b62c-9a4fc2486b5d tempest-ServerBootFromVolumeStableRescueTest-414665510 tempest-ServerBootFromVolumeStableRescueTest-414665510-project-member] [instance: cd22685a-028c-4e0c-834d-e7b20f6d06ab] Start spawning the instance on the hypervisor. {{(pid=74613) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 29 17:54:41 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-34635a9f-32ad-4d56-b62c-9a4fc2486b5d tempest-ServerBootFromVolumeStableRescueTest-414665510 tempest-ServerBootFromVolumeStableRescueTest-414665510-project-member] [instance: cd22685a-028c-4e0c-834d-e7b20f6d06ab] Creating instance directory {{(pid=74613) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 29 17:54:41 user nova-compute[74613]: INFO nova.virt.libvirt.driver [None req-34635a9f-32ad-4d56-b62c-9a4fc2486b5d tempest-ServerBootFromVolumeStableRescueTest-414665510 tempest-ServerBootFromVolumeStableRescueTest-414665510-project-member] [instance: cd22685a-028c-4e0c-834d-e7b20f6d06ab] Creating image(s)
Nov 29 17:54:41 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-34635a9f-32ad-4d56-b62c-9a4fc2486b5d tempest-ServerBootFromVolumeStableRescueTest-414665510 tempest-ServerBootFromVolumeStableRescueTest-414665510-project-member] [instance: cd22685a-028c-4e0c-834d-e7b20f6d06ab] Did not create local disks {{(pid=74613) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 29 17:54:41 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-34635a9f-32ad-4d56-b62c-9a4fc2486b5d tempest-ServerBootFromVolumeStableRescueTest-414665510 tempest-ServerBootFromVolumeStableRescueTest-414665510-project-member] [instance: cd22685a-028c-4e0c-834d-e7b20f6d06ab] Ensure instance console log exists: /opt/stack/data/nova/instances/cd22685a-028c-4e0c-834d-e7b20f6d06ab/console.log {{(pid=74613) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 29 17:54:41 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-34635a9f-32ad-4d56-b62c-9a4fc2486b5d tempest-ServerBootFromVolumeStableRescueTest-414665510 tempest-ServerBootFromVolumeStableRescueTest-414665510-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 17:54:41 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-34635a9f-32ad-4d56-b62c-9a4fc2486b5d tempest-ServerBootFromVolumeStableRescueTest-414665510 tempest-ServerBootFromVolumeStableRescueTest-414665510-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 17:54:41 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-34635a9f-32ad-4d56-b62c-9a4fc2486b5d tempest-ServerBootFromVolumeStableRescueTest-414665510 tempest-ServerBootFromVolumeStableRescueTest-414665510-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 17:54:41 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-34635a9f-32ad-4d56-b62c-9a4fc2486b5d tempest-ServerBootFromVolumeStableRescueTest-414665510 tempest-ServerBootFromVolumeStableRescueTest-414665510-project-member] [instance: cd22685a-028c-4e0c-834d-e7b20f6d06ab] Start _get_guest_xml network_info=[{"id": "5b08bd65-707e-48a5-800b-dd0670c88d61", "address": "fa:16:3e:28:d8:3d", "network": {"id": "0722b02d-a357-4360-87e8-580913723985", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-579793494-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b820dd795dfe46cd804772f0e71f98e9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5b08bd65-70", "ovs_interfaceid": "5b08bd65-707e-48a5-800b-dd0670c88d61", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-29T17:47:38Z,direct_url=<?>,disk_format='qcow2',id=4217f428-8d9d-4ee1-9614-642d26d90c46,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='794b07cbd46a44b5865cfda741036bae',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-29T17:47:40Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:9511387c-8772-40f2-bf2d-6b6387649e9f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XOfkuEgp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'cd22685a-028c-4e0c-834d-e7b20f6d06ab', 'attached_at': '', 'detached_at': '', 'volume_id': '9511387c-8772-40f2-bf2d-6b6387649e9f', 'serial': '9511387c-8772-40f2-bf2d-6b6387649e9f'}, 'mount_device': '/dev/vda', 'delete_on_termination': False, 'device_type': 'disk', 'boot_index': 0, 'guest_format': None, 'attachment_id': 'eb56d7f0-712e-400e-92a2-18de7926a154', 'disk_bus': 'virtio', 'volume_type': None} {{(pid=74613) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 29 17:54:41 user nova-compute[74613]: WARNING nova.virt.libvirt.driver [None req-34635a9f-32ad-4d56-b62c-9a4fc2486b5d tempest-ServerBootFromVolumeStableRescueTest-414665510 tempest-ServerBootFromVolumeStableRescueTest-414665510-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 17:54:41 user nova-compute[74613]: WARNING nova.virt.libvirt.driver [None req-34635a9f-32ad-4d56-b62c-9a4fc2486b5d tempest-ServerBootFromVolumeStableRescueTest-414665510 tempest-ServerBootFromVolumeStableRescueTest-414665510-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 17:54:41 user nova-compute[74613]: DEBUG nova.virt.libvirt.host [None req-34635a9f-32ad-4d56-b62c-9a4fc2486b5d tempest-ServerBootFromVolumeStableRescueTest-414665510 tempest-ServerBootFromVolumeStableRescueTest-414665510-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74613) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 29 17:54:41 user nova-compute[74613]: DEBUG nova.virt.libvirt.host [None req-34635a9f-32ad-4d56-b62c-9a4fc2486b5d tempest-ServerBootFromVolumeStableRescueTest-414665510 tempest-ServerBootFromVolumeStableRescueTest-414665510-project-member] CPU controller missing on host. {{(pid=74613) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 29 17:54:41 user nova-compute[74613]: DEBUG nova.virt.libvirt.host [None req-34635a9f-32ad-4d56-b62c-9a4fc2486b5d tempest-ServerBootFromVolumeStableRescueTest-414665510 tempest-ServerBootFromVolumeStableRescueTest-414665510-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74613) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 29 17:54:41 user nova-compute[74613]: DEBUG nova.virt.libvirt.host [None req-34635a9f-32ad-4d56-b62c-9a4fc2486b5d tempest-ServerBootFromVolumeStableRescueTest-414665510 tempest-ServerBootFromVolumeStableRescueTest-414665510-project-member] CPU controller found on host. {{(pid=74613) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 29 17:54:41 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-34635a9f-32ad-4d56-b62c-9a4fc2486b5d tempest-ServerBootFromVolumeStableRescueTest-414665510 tempest-ServerBootFromVolumeStableRescueTest-414665510-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74613) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 29 17:54:41 user nova-compute[74613]: DEBUG nova.virt.hardware [None req-34635a9f-32ad-4d56-b62c-9a4fc2486b5d tempest-ServerBootFromVolumeStableRescueTest-414665510 tempest-ServerBootFromVolumeStableRescueTest-414665510-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-29T17:47:27Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-29T17:47:38Z,direct_url=<?>,disk_format='qcow2',id=4217f428-8d9d-4ee1-9614-642d26d90c46,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='794b07cbd46a44b5865cfda741036bae',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-29T17:47:40Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74613) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 29 17:54:41 user nova-compute[74613]: DEBUG nova.virt.hardware [None req-34635a9f-32ad-4d56-b62c-9a4fc2486b5d tempest-ServerBootFromVolumeStableRescueTest-414665510 tempest-ServerBootFromVolumeStableRescueTest-414665510-project-member] Flavor limits 0:0:0 {{(pid=74613) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 29 17:54:41 user nova-compute[74613]: DEBUG nova.virt.hardware [None req-34635a9f-32ad-4d56-b62c-9a4fc2486b5d tempest-ServerBootFromVolumeStableRescueTest-414665510 tempest-ServerBootFromVolumeStableRescueTest-414665510-project-member] Image limits 0:0:0 {{(pid=74613) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 29 17:54:41 user nova-compute[74613]: DEBUG nova.virt.hardware [None req-34635a9f-32ad-4d56-b62c-9a4fc2486b5d tempest-ServerBootFromVolumeStableRescueTest-414665510 tempest-ServerBootFromVolumeStableRescueTest-414665510-project-member] Flavor pref 0:0:0 {{(pid=74613) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 29 17:54:41 user nova-compute[74613]: DEBUG nova.virt.hardware [None req-34635a9f-32ad-4d56-b62c-9a4fc2486b5d tempest-ServerBootFromVolumeStableRescueTest-414665510 tempest-ServerBootFromVolumeStableRescueTest-414665510-project-member] Image pref 0:0:0 {{(pid=74613) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 29 17:54:41 user nova-compute[74613]: DEBUG nova.virt.hardware [None req-34635a9f-32ad-4d56-b62c-9a4fc2486b5d tempest-ServerBootFromVolumeStableRescueTest-414665510 tempest-ServerBootFromVolumeStableRescueTest-414665510-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74613) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 29 17:54:41 user nova-compute[74613]: DEBUG nova.virt.hardware [None req-34635a9f-32ad-4d56-b62c-9a4fc2486b5d tempest-ServerBootFromVolumeStableRescueTest-414665510 tempest-ServerBootFromVolumeStableRescueTest-414665510-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74613) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 29 17:54:41 user nova-compute[74613]: DEBUG nova.virt.hardware [None req-34635a9f-32ad-4d56-b62c-9a4fc2486b5d tempest-ServerBootFromVolumeStableRescueTest-414665510 tempest-ServerBootFromVolumeStableRescueTest-414665510-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74613) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 29 17:54:41 user nova-compute[74613]: DEBUG nova.virt.hardware [None req-34635a9f-32ad-4d56-b62c-9a4fc2486b5d tempest-ServerBootFromVolumeStableRescueTest-414665510 tempest-ServerBootFromVolumeStableRescueTest-414665510-project-member] Got 1 possible topologies {{(pid=74613) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 29 17:54:41 user nova-compute[74613]: DEBUG nova.virt.hardware [None req-34635a9f-32ad-4d56-b62c-9a4fc2486b5d tempest-ServerBootFromVolumeStableRescueTest-414665510 tempest-ServerBootFromVolumeStableRescueTest-414665510-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74613) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 29 17:54:41 user nova-compute[74613]: DEBUG nova.virt.hardware [None req-34635a9f-32ad-4d56-b62c-9a4fc2486b5d tempest-ServerBootFromVolumeStableRescueTest-414665510 tempest-ServerBootFromVolumeStableRescueTest-414665510-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74613) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 29 17:54:41 user nova-compute[74613]: DEBUG nova.virt.libvirt.volume.iscsi [None req-34635a9f-32ad-4d56-b62c-9a4fc2486b5d tempest-ServerBootFromVolumeStableRescueTest-414665510 tempest-ServerBootFromVolumeStableRescueTest-414665510-project-member] [instance: cd22685a-028c-4e0c-834d-e7b20f6d06ab] Calling os-brick to attach iSCSI Volume {{(pid=74613) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 29 17:54:41 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-34635a9f-32ad-4d56-b62c-9a4fc2486b5d tempest-ServerBootFromVolumeStableRescueTest-414665510 tempest-ServerBootFromVolumeStableRescueTest-414665510-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff828156890>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:9511387c-8772-40f2-bf2d-6b6387649e9f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XOfkuEgp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74613) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 17:54:41 user nova-compute[74613]: WARNING os_brick.initiator.connectors.base [None req-34635a9f-32ad-4d56-b62c-9a4fc2486b5d tempest-ServerBootFromVolumeStableRescueTest-414665510 tempest-ServerBootFromVolumeStableRescueTest-414665510-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 17:54:41 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.base [None req-34635a9f-32ad-4d56-b62c-9a4fc2486b5d tempest-ServerBootFromVolumeStableRescueTest-414665510 tempest-ServerBootFromVolumeStableRescueTest-414665510-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 17:54:41 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.base [None req-34635a9f-32ad-4d56-b62c-9a4fc2486b5d tempest-ServerBootFromVolumeStableRescueTest-414665510 tempest-ServerBootFromVolumeStableRescueTest-414665510-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 17:54:41 user nova-compute[74613]: WARNING os_brick.initiator.connectors.base [None req-34635a9f-32ad-4d56-b62c-9a4fc2486b5d tempest-ServerBootFromVolumeStableRescueTest-414665510 tempest-ServerBootFromVolumeStableRescueTest-414665510-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 17:54:41 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.base [None req-34635a9f-32ad-4d56-b62c-9a4fc2486b5d tempest-ServerBootFromVolumeStableRescueTest-414665510 tempest-ServerBootFromVolumeStableRescueTest-414665510-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9511387c-8772-40f2-bf2d-6b6387649e9f" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 17:54:41 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.base [None req-34635a9f-32ad-4d56-b62c-9a4fc2486b5d tempest-ServerBootFromVolumeStableRescueTest-414665510 tempest-ServerBootFromVolumeStableRescueTest-414665510-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9511387c-8772-40f2-bf2d-6b6387649e9f" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 17:54:41 user nova-compute[74613]: INFO os_brick.initiator.connectors.iscsi [None req-34635a9f-32ad-4d56-b62c-9a4fc2486b5d tempest-ServerBootFromVolumeStableRescueTest-414665510 tempest-ServerBootFromVolumeStableRescueTest-414665510-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 29 17:54:41 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9511387c-8772-40f2-bf2d-6b6387649e9f -p 172.16.0.220:3260 {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 17:54:41 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9511387c-8772-40f2-bf2d-6b6387649e9f -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 17:54:41 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1574339-305b-431d-839a-7016b4a221f0]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 17:54:41 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-34635a9f-32ad-4d56-b62c-9a4fc2486b5d tempest-ServerBootFromVolumeStableRescueTest-414665510 tempest-ServerBootFromVolumeStableRescueTest-414665510-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 29 17:54:41 user nova-compute[74613]:  {{(pid=74613) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 17:54:41 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9511387c-8772-40f2-bf2d-6b6387649e9f -p 172.16.0.220:3260 --interface default --op new {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 17:54:41 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9511387c-8772-40f2-bf2d-6b6387649e9f -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.017s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 17:54:41 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[19ce9b4d-aed8-4dc5-bf40-9142b795e669]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:9511387c-8772-40f2-bf2d-6b6387649e9f] added\n', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 17:54:41 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-34635a9f-32ad-4d56-b62c-9a4fc2486b5d tempest-ServerBootFromVolumeStableRescueTest-414665510 tempest-ServerBootFromVolumeStableRescueTest-414665510-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:9511387c-8772-40f2-bf2d-6b6387649e9f] added
Nov 29 17:54:41 user nova-compute[74613]:  stderr= {{(pid=74613) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 17:54:41 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9511387c-8772-40f2-bf2d-6b6387649e9f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 17:54:41 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9511387c-8772-40f2-bf2d-6b6387649e9f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 17:54:41 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[773df4c7-08ac-4b79-a129-e6786c48117f]: (4, ('', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 17:54:41 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-34635a9f-32ad-4d56-b62c-9a4fc2486b5d tempest-ServerBootFromVolumeStableRescueTest-414665510 tempest-ServerBootFromVolumeStableRescueTest-414665510-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74613) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 17:54:41 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9511387c-8772-40f2-bf2d-6b6387649e9f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 17:54:41 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9511387c-8772-40f2-bf2d-6b6387649e9f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 17:54:41 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e85e6f6-d15d-4204-93d1-0822cf3953ce]: (4, ('', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 17:54:41 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-34635a9f-32ad-4d56-b62c-9a4fc2486b5d tempest-ServerBootFromVolumeStableRescueTest-414665510 tempest-ServerBootFromVolumeStableRescueTest-414665510-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74613) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 17:54:41 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9511387c-8772-40f2-bf2d-6b6387649e9f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v XOfkuEgp {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 17:54:41 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9511387c-8772-40f2-bf2d-6b6387649e9f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v XOfkuEgp" returned: 0 in 0.016s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 17:54:41 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[37062247-d914-4f69-ab07-59c1e8b597cd]: (4, ('', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 17:54:41 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-34635a9f-32ad-4d56-b62c-9a4fc2486b5d tempest-ServerBootFromVolumeStableRescueTest-414665510 tempest-ServerBootFromVolumeStableRescueTest-414665510-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'XOfkuEgp'): stdout= stderr= {{(pid=74613) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 17:54:41 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9511387c-8772-40f2-bf2d-6b6387649e9f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 17:54:41 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9511387c-8772-40f2-bf2d-6b6387649e9f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.015s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 17:54:41 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[aebbe0d5-ed99-4606-aed7-bcacce66ef16]: (4, ('', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 17:54:41 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-34635a9f-32ad-4d56-b62c-9a4fc2486b5d tempest-ServerBootFromVolumeStableRescueTest-414665510 tempest-ServerBootFromVolumeStableRescueTest-414665510-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74613) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 17:54:41 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 17:54:41 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.017s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 17:54:41 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9b62a53-00f1-4419-905e-d50b25034607]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a6b34bdb-5c08-4f7c-b3f5-6b68413947a8 (non-flash)\n', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 17:54:41 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-34635a9f-32ad-4d56-b62c-9a4fc2486b5d tempest-ServerBootFromVolumeStableRescueTest-414665510 tempest-ServerBootFromVolumeStableRescueTest-414665510-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a6b34bdb-5c08-4f7c-b3f5-6b68413947a8 (non-flash)
Nov 29 17:54:41 user nova-compute[74613]:  stderr= {{(pid=74613) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 17:54:41 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-34635a9f-32ad-4d56-b62c-9a4fc2486b5d tempest-ServerBootFromVolumeStableRescueTest-414665510 tempest-ServerBootFromVolumeStableRescueTest-414665510-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a6b34bdb-5c08-4f7c-b3f5-6b68413947a8 (non-flash)
Nov 29 17:54:41 user nova-compute[74613]:  stderr= {{(pid=74613) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 17:54:41 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9511387c-8772-40f2-bf2d-6b6387649e9f -p 172.16.0.220:3260 --login {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 17:54:41 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9511387c-8772-40f2-bf2d-6b6387649e9f -p 172.16.0.220:3260 --login" returned: 0 in 0.051s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 17:54:41 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff8c855c-4af1-4c1b-9eca-572f4b90bea8]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:9511387c-8772-40f2-bf2d-6b6387649e9f, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:9511387c-8772-40f2-bf2d-6b6387649e9f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 17:54:41 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-34635a9f-32ad-4d56-b62c-9a4fc2486b5d tempest-ServerBootFromVolumeStableRescueTest-414665510 tempest-ServerBootFromVolumeStableRescueTest-414665510-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:9511387c-8772-40f2-bf2d-6b6387649e9f, portal: 172.16.0.220,3260]
Nov 29 17:54:41 user nova-compute[74613]: Login to [iface: default, target: iqn.2010-10.org.openstack:9511387c-8772-40f2-bf2d-6b6387649e9f, portal: 172.16.0.220,3260] successful.
Nov 29 17:54:41 user nova-compute[74613]:  stderr= {{(pid=74613) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 17:54:41 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9511387c-8772-40f2-bf2d-6b6387649e9f -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 17:54:41 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9511387c-8772-40f2-bf2d-6b6387649e9f -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 17:54:41 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[f30b6c54-1532-4061-8ed6-7e27db4d51ec]: (4, ('', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 17:54:41 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-34635a9f-32ad-4d56-b62c-9a4fc2486b5d tempest-ServerBootFromVolumeStableRescueTest-414665510 tempest-ServerBootFromVolumeStableRescueTest-414665510-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74613) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 17:54:41 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 17:54:41 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 17:54:41 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[bec25f52-09cf-4568-9db6-92eb3ab3363a]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a6b34bdb-5c08-4f7c-b3f5-6b68413947a8 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9511387c-8772-40f2-bf2d-6b6387649e9f (non-flash)\n', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 17:54:41 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-34635a9f-32ad-4d56-b62c-9a4fc2486b5d tempest-ServerBootFromVolumeStableRescueTest-414665510 tempest-ServerBootFromVolumeStableRescueTest-414665510-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a6b34bdb-5c08-4f7c-b3f5-6b68413947a8 (non-flash)
Nov 29 17:54:41 user nova-compute[74613]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9511387c-8772-40f2-bf2d-6b6387649e9f (non-flash)
Nov 29 17:54:41 user nova-compute[74613]:  stderr= {{(pid=74613) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 17:54:41 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-34635a9f-32ad-4d56-b62c-9a4fc2486b5d tempest-ServerBootFromVolumeStableRescueTest-414665510 tempest-ServerBootFromVolumeStableRescueTest-414665510-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a6b34bdb-5c08-4f7c-b3f5-6b68413947a8 (non-flash)
Nov 29 17:54:41 user nova-compute[74613]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9511387c-8772-40f2-bf2d-6b6387649e9f (non-flash)
Nov 29 17:54:41 user nova-compute[74613]:  stderr= {{(pid=74613) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 17:54:41 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.base [None req-34635a9f-32ad-4d56-b62c-9a4fc2486b5d tempest-ServerBootFromVolumeStableRescueTest-414665510 tempest-ServerBootFromVolumeStableRescueTest-414665510-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9511387c-8772-40f2-bf2d-6b6387649e9f" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.253s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 17:54:41 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-34635a9f-32ad-4d56-b62c-9a4fc2486b5d tempest-ServerBootFromVolumeStableRescueTest-414665510 tempest-ServerBootFromVolumeStableRescueTest-414665510-project-member] Connected to 172.16.0.220:3260 {{(pid=74613) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 29 17:54:41 user nova-compute[74613]: DEBUG os_brick.initiator.linuxscsi [None req-34635a9f-32ad-4d56-b62c-9a4fc2486b5d tempest-ServerBootFromVolumeStableRescueTest-414665510 tempest-ServerBootFromVolumeStableRescueTest-414665510-project-member] HCTL ('33', '-', '-', 0) found on session 14 with lun 0 {{(pid=74613) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 29 17:54:41 user nova-compute[74613]: DEBUG os_brick.initiator.linuxscsi [None req-34635a9f-32ad-4d56-b62c-9a4fc2486b5d tempest-ServerBootFromVolumeStableRescueTest-414665510 tempest-ServerBootFromVolumeStableRescueTest-414665510-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74613) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 29 17:54:41 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 17:54:41 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.017s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 17:54:41 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[52d48d71-1307-4b0b-bae6-910b4fc7f830]: (4, ('- - 0', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 17:54:41 user nova-compute[74613]: DEBUG os_brick.initiator.linuxscsi [None req-34635a9f-32ad-4d56-b62c-9a4fc2486b5d tempest-ServerBootFromVolumeStableRescueTest-414665510 tempest-ServerBootFromVolumeStableRescueTest-414665510-project-member] Searching for a device in session 14 and hctl ['33', '*', '*', 0] yield: None {{(pid=74613) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 29 17:54:42 user nova-compute[74613]: DEBUG os_brick.initiator.linuxscsi [None req-34635a9f-32ad-4d56-b62c-9a4fc2486b5d tempest-ServerBootFromVolumeStableRescueTest-414665510 tempest-ServerBootFromVolumeStableRescueTest-414665510-project-member] Searching for a device in session 14 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74613) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 29 17:54:42 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-34635a9f-32ad-4d56-b62c-9a4fc2486b5d tempest-ServerBootFromVolumeStableRescueTest-414665510 tempest-ServerBootFromVolumeStableRescueTest-414665510-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:9511387c-8772-40f2-bf2d-6b6387649e9f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XOfkuEgp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74613) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 29 17:54:42 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.base [None req-34635a9f-32ad-4d56-b62c-9a4fc2486b5d tempest-ServerBootFromVolumeStableRescueTest-414665510 tempest-ServerBootFromVolumeStableRescueTest-414665510-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.284s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 17:54:42 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-34635a9f-32ad-4d56-b62c-9a4fc2486b5d tempest-ServerBootFromVolumeStableRescueTest-414665510 tempest-ServerBootFromVolumeStableRescueTest-414665510-project-member] <== connect_volume: return (1285ms) {'type': 'block', 'scsi_wwn': '23631303061663361', 'path': '/dev/sdb'} {{(pid=74613) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 17:54:42 user nova-compute[74613]: DEBUG nova.virt.libvirt.volume.iscsi [None req-34635a9f-32ad-4d56-b62c-9a4fc2486b5d tempest-ServerBootFromVolumeStableRescueTest-414665510 tempest-ServerBootFromVolumeStableRescueTest-414665510-project-member] [instance: cd22685a-028c-4e0c-834d-e7b20f6d06ab] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23631303061663361', 'path': '/dev/sdb'} {{(pid=74613) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 29 17:54:42 user nova-compute[74613]: DEBUG nova.virt.libvirt.vif [None req-34635a9f-32ad-4d56-b62c-9a4fc2486b5d tempest-ServerBootFromVolumeStableRescueTest-414665510 tempest-ServerBootFromVolumeStableRescueTest-414665510-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T17:54:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1015515172',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1015515172',id=12,image_ref='4217f428-8d9d-4ee1-9614-642d26d90c46',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b820dd795dfe46cd804772f0e71f98e9',ramdisk_id='',reservation_id='r-j65rtiu7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='4217f428-8d9d-4ee1-9614-642d26d90c46',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-414665510',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-414665510-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T17:54:27Z,user_data=None,user_id='c65bc922e04d4d1385e48f70c460c441',uuid=cd22685a-028c-4e0c-834d-e7b20f6d06ab,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5b08bd65-707e-48a5-800b-dd0670c88d61", "address": "fa:16:3e:28:d8:3d", "network": {"id": "0722b02d-a357-4360-87e8-580913723985", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-579793494-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b820dd795dfe46cd804772f0e71f98e9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5b08bd65-70", "ovs_interfaceid": "5b08bd65-707e-48a5-800b-dd0670c88d61", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74613) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 29 17:54:42 user nova-compute[74613]: DEBUG nova.network.os_vif_util [None req-34635a9f-32ad-4d56-b62c-9a4fc2486b5d tempest-ServerBootFromVolumeStableRescueTest-414665510 tempest-ServerBootFromVolumeStableRescueTest-414665510-project-member] Converting VIF {"id": "5b08bd65-707e-48a5-800b-dd0670c88d61", "address": "fa:16:3e:28:d8:3d", "network": {"id": "0722b02d-a357-4360-87e8-580913723985", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-579793494-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b820dd795dfe46cd804772f0e71f98e9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5b08bd65-70", "ovs_interfaceid": "5b08bd65-707e-48a5-800b-dd0670c88d61", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74613) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 17:54:42 user nova-compute[74613]: DEBUG nova.network.os_vif_util [None req-34635a9f-32ad-4d56-b62c-9a4fc2486b5d tempest-ServerBootFromVolumeStableRescueTest-414665510 tempest-ServerBootFromVolumeStableRescueTest-414665510-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:28:d8:3d,bridge_name='br-int',has_traffic_filtering=True,id=5b08bd65-707e-48a5-800b-dd0670c88d61,network=Network(0722b02d-a357-4360-87e8-580913723985),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5b08bd65-70') {{(pid=74613) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 17:54:42 user nova-compute[74613]: DEBUG nova.objects.instance [None req-34635a9f-32ad-4d56-b62c-9a4fc2486b5d tempest-ServerBootFromVolumeStableRescueTest-414665510 tempest-ServerBootFromVolumeStableRescueTest-414665510-project-member] Lazy-loading 'pci_devices' on Instance uuid cd22685a-028c-4e0c-834d-e7b20f6d06ab {{(pid=74613) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 17:54:42 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-34635a9f-32ad-4d56-b62c-9a4fc2486b5d tempest-ServerBootFromVolumeStableRescueTest-414665510 tempest-ServerBootFromVolumeStableRescueTest-414665510-project-member] [instance: cd22685a-028c-4e0c-834d-e7b20f6d06ab] End _get_guest_xml xml=<domain type="kvm">
Nov 29 17:54:42 user nova-compute[74613]:   <uuid>cd22685a-028c-4e0c-834d-e7b20f6d06ab</uuid>
Nov 29 17:54:42 user nova-compute[74613]:   <name>instance-0000000c</name>
Nov 29 17:54:42 user nova-compute[74613]:   <memory>524288</memory>
Nov 29 17:54:42 user nova-compute[74613]:   <vcpu>1</vcpu>
Nov 29 17:54:42 user nova-compute[74613]:   <metadata>
Nov 29 17:54:42 user nova-compute[74613]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 29 17:54:42 user nova-compute[74613]:       <nova:package version="0.0.0"/>
Nov 29 17:54:42 user nova-compute[74613]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-1015515172</nova:name>
Nov 29 17:54:42 user nova-compute[74613]:       <nova:creationTime>2023-11-29 17:54:41</nova:creationTime>
Nov 29 17:54:42 user nova-compute[74613]:       <nova:flavor name="m1.tiny">
Nov 29 17:54:42 user nova-compute[74613]:         <nova:memory>512</nova:memory>
Nov 29 17:54:42 user nova-compute[74613]:         <nova:disk>1</nova:disk>
Nov 29 17:54:42 user nova-compute[74613]:         <nova:swap>0</nova:swap>
Nov 29 17:54:42 user nova-compute[74613]:         <nova:ephemeral>0</nova:ephemeral>
Nov 29 17:54:42 user nova-compute[74613]:         <nova:vcpus>1</nova:vcpus>
Nov 29 17:54:42 user nova-compute[74613]:       </nova:flavor>
Nov 29 17:54:42 user nova-compute[74613]:       <nova:owner>
Nov 29 17:54:42 user nova-compute[74613]:         <nova:user uuid="c65bc922e04d4d1385e48f70c460c441">tempest-ServerBootFromVolumeStableRescueTest-414665510-project-member</nova:user>
Nov 29 17:54:42 user nova-compute[74613]:         <nova:project uuid="b820dd795dfe46cd804772f0e71f98e9">tempest-ServerBootFromVolumeStableRescueTest-414665510</nova:project>
Nov 29 17:54:42 user nova-compute[74613]:       </nova:owner>
Nov 29 17:54:42 user nova-compute[74613]:       <nova:root type="image" uuid="4217f428-8d9d-4ee1-9614-642d26d90c46"/>
Nov 29 17:54:42 user nova-compute[74613]:       <nova:ports>
Nov 29 17:54:42 user nova-compute[74613]:         <nova:port uuid="5b08bd65-707e-48a5-800b-dd0670c88d61">
Nov 29 17:54:42 user nova-compute[74613]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Nov 29 17:54:42 user nova-compute[74613]:         </nova:port>
Nov 29 17:54:42 user nova-compute[74613]:       </nova:ports>
Nov 29 17:54:42 user nova-compute[74613]:     </nova:instance>
Nov 29 17:54:42 user nova-compute[74613]:   </metadata>
Nov 29 17:54:42 user nova-compute[74613]:   <sysinfo type="smbios">
Nov 29 17:54:42 user nova-compute[74613]:     <system>
Nov 29 17:54:42 user nova-compute[74613]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 29 17:54:42 user nova-compute[74613]:       <entry name="product">OpenStack Nova</entry>
Nov 29 17:54:42 user nova-compute[74613]:       <entry name="version">0.0.0</entry>
Nov 29 17:54:42 user nova-compute[74613]:       <entry name="serial">cd22685a-028c-4e0c-834d-e7b20f6d06ab</entry>
Nov 29 17:54:42 user nova-compute[74613]:       <entry name="uuid">cd22685a-028c-4e0c-834d-e7b20f6d06ab</entry>
Nov 29 17:54:42 user nova-compute[74613]:       <entry name="family">Virtual Machine</entry>
Nov 29 17:54:42 user nova-compute[74613]:     </system>
Nov 29 17:54:42 user nova-compute[74613]:   </sysinfo>
Nov 29 17:54:42 user nova-compute[74613]:   <os>
Nov 29 17:54:42 user nova-compute[74613]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 29 17:54:42 user nova-compute[74613]:     <boot dev="hd"/>
Nov 29 17:54:42 user nova-compute[74613]:     <smbios mode="sysinfo"/>
Nov 29 17:54:42 user nova-compute[74613]:   </os>
Nov 29 17:54:42 user nova-compute[74613]:   <features>
Nov 29 17:54:42 user nova-compute[74613]:     <acpi/>
Nov 29 17:54:42 user nova-compute[74613]:     <apic/>
Nov 29 17:54:42 user nova-compute[74613]:     <vmcoreinfo/>
Nov 29 17:54:42 user nova-compute[74613]:   </features>
Nov 29 17:54:42 user nova-compute[74613]:   <clock offset="utc">
Nov 29 17:54:42 user nova-compute[74613]:     <timer name="pit" tickpolicy="delay"/>
Nov 29 17:54:42 user nova-compute[74613]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 29 17:54:42 user nova-compute[74613]:     <timer name="hpet" present="no"/>
Nov 29 17:54:42 user nova-compute[74613]:   </clock>
Nov 29 17:54:42 user nova-compute[74613]:   <cpu mode="custom" match="exact">
Nov 29 17:54:42 user nova-compute[74613]:     <model>Nehalem</model>
Nov 29 17:54:42 user nova-compute[74613]:     <topology sockets="1" cores="1" threads="1"/>
Nov 29 17:54:42 user nova-compute[74613]:   </cpu>
Nov 29 17:54:42 user nova-compute[74613]:   <devices>
Nov 29 17:54:42 user nova-compute[74613]:     <disk type="block" device="disk">
Nov 29 17:54:42 user nova-compute[74613]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 17:54:42 user nova-compute[74613]:       <source dev="/dev/sdb"/>
Nov 29 17:54:42 user nova-compute[74613]:       <target dev="vda" bus="virtio"/>
Nov 29 17:54:42 user nova-compute[74613]:       <serial>9511387c-8772-40f2-bf2d-6b6387649e9f</serial>
Nov 29 17:54:42 user nova-compute[74613]:     </disk>
Nov 29 17:54:42 user nova-compute[74613]:     <interface type="ethernet">
Nov 29 17:54:42 user nova-compute[74613]:       <mac address="fa:16:3e:28:d8:3d"/>
Nov 29 17:54:42 user nova-compute[74613]:       <model type="virtio"/>
Nov 29 17:54:42 user nova-compute[74613]:       <mtu size="1442"/>
Nov 29 17:54:42 user nova-compute[74613]:       <target dev="tap5b08bd65-70"/>
Nov 29 17:54:42 user nova-compute[74613]:     </interface>
Nov 29 17:54:42 user nova-compute[74613]:     <serial type="pty">
Nov 29 17:54:42 user nova-compute[74613]:       <log file="/opt/stack/data/nova/instances/cd22685a-028c-4e0c-834d-e7b20f6d06ab/console.log" append="off"/>
Nov 29 17:54:42 user nova-compute[74613]:     </serial>
Nov 29 17:54:42 user nova-compute[74613]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 29 17:54:42 user nova-compute[74613]:     <video>
Nov 29 17:54:42 user nova-compute[74613]:       <model type="virtio"/>
Nov 29 17:54:42 user nova-compute[74613]:     </video>
Nov 29 17:54:42 user nova-compute[74613]:     <rng model="virtio">
Nov 29 17:54:42 user nova-compute[74613]:       <backend model="random">/dev/urandom</backend>
Nov 29 17:54:42 user nova-compute[74613]:     </rng>
Nov 29 17:54:42 user nova-compute[74613]:     <controller type="usb" index="0" model="none"/>
Nov 29 17:54:42 user nova-compute[74613]:     <memballoon model="virtio">
Nov 29 17:54:42 user nova-compute[74613]:       <stats period="10"/>
Nov 29 17:54:42 user nova-compute[74613]:     </memballoon>
Nov 29 17:54:42 user nova-compute[74613]:   </devices>
Nov 29 17:54:42 user nova-compute[74613]: </domain>
Nov 29 17:54:42 user nova-compute[74613]:  {{(pid=74613) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 29 17:54:42 user nova-compute[74613]: DEBUG nova.virt.libvirt.vif [None req-34635a9f-32ad-4d56-b62c-9a4fc2486b5d tempest-ServerBootFromVolumeStableRescueTest-414665510 tempest-ServerBootFromVolumeStableRescueTest-414665510-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T17:54:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1015515172',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1015515172',id=12,image_ref='4217f428-8d9d-4ee1-9614-642d26d90c46',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b820dd795dfe46cd804772f0e71f98e9',ramdisk_id='',reservation_id='r-j65rtiu7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='4217f428-8d9d-4ee1-9614-642d26d90c46',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-414665510',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-414665510-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T17:54:27Z,user_data=None,user_id='c65bc922e04d4d1385e48f70c460c441',uuid=cd22685a-028c-4e0c-834d-e7b20f6d06ab,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5b08bd65-707e-48a5-800b-dd0670c88d61", "address": "fa:16:3e:28:d8:3d", "network": {"id": "0722b02d-a357-4360-87e8-580913723985", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-579793494-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b820dd795dfe46cd804772f0e71f98e9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5b08bd65-70", "ovs_interfaceid": "5b08bd65-707e-48a5-800b-dd0670c88d61", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74613) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 29 17:54:42 user nova-compute[74613]: DEBUG nova.network.os_vif_util [None req-34635a9f-32ad-4d56-b62c-9a4fc2486b5d tempest-ServerBootFromVolumeStableRescueTest-414665510 tempest-ServerBootFromVolumeStableRescueTest-414665510-project-member] Converting VIF {"id": "5b08bd65-707e-48a5-800b-dd0670c88d61", "address": "fa:16:3e:28:d8:3d", "network": {"id": "0722b02d-a357-4360-87e8-580913723985", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-579793494-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b820dd795dfe46cd804772f0e71f98e9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5b08bd65-70", "ovs_interfaceid": "5b08bd65-707e-48a5-800b-dd0670c88d61", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74613) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 17:54:42 user nova-compute[74613]: DEBUG nova.network.os_vif_util [None req-34635a9f-32ad-4d56-b62c-9a4fc2486b5d tempest-ServerBootFromVolumeStableRescueTest-414665510 tempest-ServerBootFromVolumeStableRescueTest-414665510-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:28:d8:3d,bridge_name='br-int',has_traffic_filtering=True,id=5b08bd65-707e-48a5-800b-dd0670c88d61,network=Network(0722b02d-a357-4360-87e8-580913723985),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5b08bd65-70') {{(pid=74613) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 17:54:42 user nova-compute[74613]: DEBUG os_vif [None req-34635a9f-32ad-4d56-b62c-9a4fc2486b5d tempest-ServerBootFromVolumeStableRescueTest-414665510 tempest-ServerBootFromVolumeStableRescueTest-414665510-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:28:d8:3d,bridge_name='br-int',has_traffic_filtering=True,id=5b08bd65-707e-48a5-800b-dd0670c88d61,network=Network(0722b02d-a357-4360-87e8-580913723985),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5b08bd65-70') {{(pid=74613) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 29 17:54:42 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:54:42 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74613) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 17:54:42 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74613) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 29 17:54:42 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:54:42 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '78c4afd3-3e9b-5063-a039-14d85a1e6c47', '_type': 'linux-noop'}}, row=False) {{(pid=74613) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 17:54:42 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:54:42 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 17:54:42 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:54:42 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:54:42 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap5b08bd65-70, may_exist=True, interface_attrs={}) {{(pid=74613) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 17:54:42 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap5b08bd65-70, col_values=(('qos', UUID('df8fe42e-819c-4278-aaa6-4cf117017cf7')),), if_exists=True) {{(pid=74613) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 17:54:42 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap5b08bd65-70, col_values=(('external_ids', {'iface-id': '5b08bd65-707e-48a5-800b-dd0670c88d61', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:28:d8:3d', 'vm-uuid': 'cd22685a-028c-4e0c-834d-e7b20f6d06ab'}),), if_exists=True) {{(pid=74613) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 17:54:42 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:54:42 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 17:54:42 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:54:42 user nova-compute[74613]: INFO os_vif [None req-34635a9f-32ad-4d56-b62c-9a4fc2486b5d tempest-ServerBootFromVolumeStableRescueTest-414665510 tempest-ServerBootFromVolumeStableRescueTest-414665510-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:28:d8:3d,bridge_name='br-int',has_traffic_filtering=True,id=5b08bd65-707e-48a5-800b-dd0670c88d61,network=Network(0722b02d-a357-4360-87e8-580913723985),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5b08bd65-70')
Nov 29 17:54:42 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-34635a9f-32ad-4d56-b62c-9a4fc2486b5d tempest-ServerBootFromVolumeStableRescueTest-414665510 tempest-ServerBootFromVolumeStableRescueTest-414665510-project-member] No BDM found with device name vda, not building metadata. {{(pid=74613) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 17:54:42 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-34635a9f-32ad-4d56-b62c-9a4fc2486b5d tempest-ServerBootFromVolumeStableRescueTest-414665510 tempest-ServerBootFromVolumeStableRescueTest-414665510-project-member] No VIF found with MAC fa:16:3e:28:d8:3d, not building metadata {{(pid=74613) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 29 17:54:43 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-00bfbea5-b6dc-4a64-8add-1ca9586ba248 tempest-ServerActionsV293TestJSON-169231013 tempest-ServerActionsV293TestJSON-169231013-project-member] Acquiring lock "8de2ffb3-e264-49f7-8581-6eae21adcaeb" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 17:54:43 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-00bfbea5-b6dc-4a64-8add-1ca9586ba248 tempest-ServerActionsV293TestJSON-169231013 tempest-ServerActionsV293TestJSON-169231013-project-member] Lock "8de2ffb3-e264-49f7-8581-6eae21adcaeb" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 17:54:43 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-00bfbea5-b6dc-4a64-8add-1ca9586ba248 tempest-ServerActionsV293TestJSON-169231013 tempest-ServerActionsV293TestJSON-169231013-project-member] Acquiring lock "8de2ffb3-e264-49f7-8581-6eae21adcaeb-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 17:54:43 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-00bfbea5-b6dc-4a64-8add-1ca9586ba248 tempest-ServerActionsV293TestJSON-169231013 tempest-ServerActionsV293TestJSON-169231013-project-member] Lock "8de2ffb3-e264-49f7-8581-6eae21adcaeb-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 17:54:43 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-00bfbea5-b6dc-4a64-8add-1ca9586ba248 tempest-ServerActionsV293TestJSON-169231013 tempest-ServerActionsV293TestJSON-169231013-project-member] Lock "8de2ffb3-e264-49f7-8581-6eae21adcaeb-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 17:54:43 user nova-compute[74613]: INFO nova.compute.manager [None req-00bfbea5-b6dc-4a64-8add-1ca9586ba248 tempest-ServerActionsV293TestJSON-169231013 tempest-ServerActionsV293TestJSON-169231013-project-member] [instance: 8de2ffb3-e264-49f7-8581-6eae21adcaeb] Terminating instance
Nov 29 17:54:43 user nova-compute[74613]: DEBUG nova.compute.manager [None req-00bfbea5-b6dc-4a64-8add-1ca9586ba248 tempest-ServerActionsV293TestJSON-169231013 tempest-ServerActionsV293TestJSON-169231013-project-member] [instance: 8de2ffb3-e264-49f7-8581-6eae21adcaeb] Start destroying the instance on the hypervisor. {{(pid=74613) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 29 17:54:43 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [-] [instance: 8de2ffb3-e264-49f7-8581-6eae21adcaeb] During wait destroy, instance disappeared. {{(pid=74613) _wait_for_destroy /opt/stack/nova/nova/virt/libvirt/driver.py:1527}}
Nov 29 17:54:43 user nova-compute[74613]: INFO nova.virt.libvirt.driver [-] [instance: 8de2ffb3-e264-49f7-8581-6eae21adcaeb] Instance destroyed successfully.
Nov 29 17:54:43 user nova-compute[74613]: DEBUG nova.objects.instance [None req-00bfbea5-b6dc-4a64-8add-1ca9586ba248 tempest-ServerActionsV293TestJSON-169231013 tempest-ServerActionsV293TestJSON-169231013-project-member] Lazy-loading 'resources' on Instance uuid 8de2ffb3-e264-49f7-8581-6eae21adcaeb {{(pid=74613) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 17:54:43 user nova-compute[74613]: DEBUG nova.virt.libvirt.vif [None req-00bfbea5-b6dc-4a64-8add-1ca9586ba248 tempest-ServerActionsV293TestJSON-169231013 tempest-ServerActionsV293TestJSON-169231013-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-29T17:51:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-687283411',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-1066065930',id=10,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPsifDrYmKd7BdWAgOW/UBypymQ/ZyWR2rXbLuQqhER8jILIr18fIVxVvqAayJ3WqD/9D57nxyUSA2R/v9weZ4t52MHUcMk7woMKaTPaFq53IUB3CUtirmx+f0BtY1qK5A==',key_name='tempest-keypair-1945453411',keypairs=<?>,launch_index=0,launched_at=2023-11-29T17:52:25Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='8d9b3ae2eee040bb84ff5065d07552d4',ramdisk_id='',reservation_id='r-nv3xeq3h',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='4217f428-8d9d-4ee1-9614-642d26d90c46',image_container_format='bare',image_disk_format='qcow2',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsV293TestJSON-169231013',owner_user_name='tempest-ServerActionsV293TestJSON-169231013-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-29T17:54:28Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1f67cfc0d0054244b74d7f1d64628db8',uuid=8de2ffb3-e264-49f7-8581-6eae21adcaeb,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='error') vif={"id": "51faf82e-9447-4f14-8724-e7939afb4d98", "address": "fa:16:3e:97:b9:00", "network": {"id": "59f09b07-14df-494d-bb8f-3b5d4a7b9711", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-981004620-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.191", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8d9b3ae2eee040bb84ff5065d07552d4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap51faf82e-94", "ovs_interfaceid": "51faf82e-9447-4f14-8724-e7939afb4d98", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74613) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 29 17:54:43 user nova-compute[74613]: DEBUG nova.network.os_vif_util [None req-00bfbea5-b6dc-4a64-8add-1ca9586ba248 tempest-ServerActionsV293TestJSON-169231013 tempest-ServerActionsV293TestJSON-169231013-project-member] Converting VIF {"id": "51faf82e-9447-4f14-8724-e7939afb4d98", "address": "fa:16:3e:97:b9:00", "network": {"id": "59f09b07-14df-494d-bb8f-3b5d4a7b9711", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-981004620-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.191", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8d9b3ae2eee040bb84ff5065d07552d4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap51faf82e-94", "ovs_interfaceid": "51faf82e-9447-4f14-8724-e7939afb4d98", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74613) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 17:54:43 user nova-compute[74613]: DEBUG nova.network.os_vif_util [None req-00bfbea5-b6dc-4a64-8add-1ca9586ba248 tempest-ServerActionsV293TestJSON-169231013 tempest-ServerActionsV293TestJSON-169231013-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:97:b9:00,bridge_name='br-int',has_traffic_filtering=True,id=51faf82e-9447-4f14-8724-e7939afb4d98,network=Network(59f09b07-14df-494d-bb8f-3b5d4a7b9711),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap51faf82e-94') {{(pid=74613) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 17:54:43 user nova-compute[74613]: DEBUG os_vif [None req-00bfbea5-b6dc-4a64-8add-1ca9586ba248 tempest-ServerActionsV293TestJSON-169231013 tempest-ServerActionsV293TestJSON-169231013-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:97:b9:00,bridge_name='br-int',has_traffic_filtering=True,id=51faf82e-9447-4f14-8724-e7939afb4d98,network=Network(59f09b07-14df-494d-bb8f-3b5d4a7b9711),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap51faf82e-94') {{(pid=74613) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 29 17:54:43 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:54:43 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap51faf82e-94, bridge=br-int, if_exists=True) {{(pid=74613) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 17:54:43 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74613) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 29 17:54:43 user nova-compute[74613]: INFO os_vif [None req-00bfbea5-b6dc-4a64-8add-1ca9586ba248 tempest-ServerActionsV293TestJSON-169231013 tempest-ServerActionsV293TestJSON-169231013-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:97:b9:00,bridge_name='br-int',has_traffic_filtering=True,id=51faf82e-9447-4f14-8724-e7939afb4d98,network=Network(59f09b07-14df-494d-bb8f-3b5d4a7b9711),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap51faf82e-94')
Nov 29 17:54:43 user nova-compute[74613]: DEBUG nova.virt.libvirt.volume.iscsi [None req-00bfbea5-b6dc-4a64-8add-1ca9586ba248 tempest-ServerActionsV293TestJSON-169231013 tempest-ServerActionsV293TestJSON-169231013-project-member] [instance: 8de2ffb3-e264-49f7-8581-6eae21adcaeb] calling os-brick to detach iSCSI Volume {{(pid=74613) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 29 17:54:43 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-00bfbea5-b6dc-4a64-8add-1ca9586ba248 tempest-ServerActionsV293TestJSON-169231013 tempest-ServerActionsV293TestJSON-169231013-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff828156890>, {'target_iqn': 'iqn.2010-10.org.openstack:fbbdc3d2-136d-4fba-b6ba-f27f35a0733b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QpqiVKeo', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=74613) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 17:54:43 user nova-compute[74613]: WARNING os_brick.initiator.connectors.base [None req-00bfbea5-b6dc-4a64-8add-1ca9586ba248 tempest-ServerActionsV293TestJSON-169231013 tempest-ServerActionsV293TestJSON-169231013-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 17:54:43 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.base [None req-00bfbea5-b6dc-4a64-8add-1ca9586ba248 tempest-ServerActionsV293TestJSON-169231013 tempest-ServerActionsV293TestJSON-169231013-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 17:54:43 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.base [None req-00bfbea5-b6dc-4a64-8add-1ca9586ba248 tempest-ServerActionsV293TestJSON-169231013 tempest-ServerActionsV293TestJSON-169231013-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 17:54:43 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 17:54:43 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 17:54:43 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[e31897d9-ad02-42d4-8cdf-09d1ed08b205]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:9511387c-8772-40f2-bf2d-6b6387649e9f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a6b34bdb-5c08-4f7c-b3f5-6b68413947a8\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 17:54:43 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-00bfbea5-b6dc-4a64-8add-1ca9586ba248 tempest-ServerActionsV293TestJSON-169231013 tempest-ServerActionsV293TestJSON-169231013-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 29 17:54:43 user nova-compute[74613]: No targets found.
Nov 29 17:54:43 user nova-compute[74613]: iSNS:
Nov 29 17:54:43 user nova-compute[74613]: No targets found.
Nov 29 17:54:43 user nova-compute[74613]: STATIC:
Nov 29 17:54:43 user nova-compute[74613]: Target: iqn.2010-10.org.openstack:9511387c-8772-40f2-bf2d-6b6387649e9f
Nov 29 17:54:43 user nova-compute[74613]:         Portal: 172.16.0.220:3260,-1
Nov 29 17:54:43 user nova-compute[74613]:                 Iface Name: default
Nov 29 17:54:43 user nova-compute[74613]: Target: iqn.2010-10.org.openstack:a6b34bdb-5c08-4f7c-b3f5-6b68413947a8
Nov 29 17:54:43 user nova-compute[74613]:         Portal: 172.16.0.220:3260,-1
Nov 29 17:54:43 user nova-compute[74613]:                 Iface Name: default
Nov 29 17:54:43 user nova-compute[74613]: FIRMWARE:
Nov 29 17:54:43 user nova-compute[74613]: No targets found.
Nov 29 17:54:43 user nova-compute[74613]:  stderr= {{(pid=74613) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 17:54:43 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-00bfbea5-b6dc-4a64-8add-1ca9586ba248 tempest-ServerActionsV293TestJSON-169231013 tempest-ServerActionsV293TestJSON-169231013-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 29 17:54:43 user nova-compute[74613]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 29 17:54:43 user nova-compute[74613]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74613) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 29 17:54:43 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-00bfbea5-b6dc-4a64-8add-1ca9586ba248 tempest-ServerActionsV293TestJSON-169231013 tempest-ServerActionsV293TestJSON-169231013-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:fbbdc3d2-136d-4fba-b6ba-f27f35a0733b', 0)] {{(pid=74613) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 29 17:54:43 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 17:54:43 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.016s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 17:54:43 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa440adf-b093-4785-9247-516f8a7db4b8]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9511387c-8772-40f2-bf2d-6b6387649e9f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a6b34bdb-5c08-4f7c-b3f5-6b68413947a8\n', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 17:54:43 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 17:54:43 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 17:54:43 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[95e190ef-3ed5-4880-a413-0629e682ddcd]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a6b34bdb-5c08-4f7c-b3f5-6b68413947a8 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9511387c-8772-40f2-bf2d-6b6387649e9f (non-flash)\n', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 17:54:43 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-00bfbea5-b6dc-4a64-8add-1ca9586ba248 tempest-ServerActionsV293TestJSON-169231013 tempest-ServerActionsV293TestJSON-169231013-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a6b34bdb-5c08-4f7c-b3f5-6b68413947a8 (non-flash)
Nov 29 17:54:43 user nova-compute[74613]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9511387c-8772-40f2-bf2d-6b6387649e9f (non-flash)
Nov 29 17:54:43 user nova-compute[74613]:  stderr= {{(pid=74613) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 17:54:43 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-00bfbea5-b6dc-4a64-8add-1ca9586ba248 tempest-ServerActionsV293TestJSON-169231013 tempest-ServerActionsV293TestJSON-169231013-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a6b34bdb-5c08-4f7c-b3f5-6b68413947a8 (non-flash)
Nov 29 17:54:43 user nova-compute[74613]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9511387c-8772-40f2-bf2d-6b6387649e9f (non-flash)
Nov 29 17:54:43 user nova-compute[74613]:  stderr= {{(pid=74613) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 17:54:43 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-00bfbea5-b6dc-4a64-8add-1ca9586ba248 tempest-ServerActionsV293TestJSON-169231013 tempest-ServerActionsV293TestJSON-169231013-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7ff818327520>, {}) {{(pid=74613) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 29 17:54:43 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-00bfbea5-b6dc-4a64-8add-1ca9586ba248 tempest-ServerActionsV293TestJSON-169231013 tempest-ServerActionsV293TestJSON-169231013-project-member] Disconnecting from: [] {{(pid=74613) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 29 17:54:43 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.base [None req-00bfbea5-b6dc-4a64-8add-1ca9586ba248 tempest-ServerActionsV293TestJSON-169231013 tempest-ServerActionsV293TestJSON-169231013-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.070s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 17:54:43 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-00bfbea5-b6dc-4a64-8add-1ca9586ba248 tempest-ServerActionsV293TestJSON-169231013 tempest-ServerActionsV293TestJSON-169231013-project-member] <== disconnect_volume: return (71ms) None {{(pid=74613) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 17:54:43 user nova-compute[74613]: DEBUG nova.virt.libvirt.volume.iscsi [None req-00bfbea5-b6dc-4a64-8add-1ca9586ba248 tempest-ServerActionsV293TestJSON-169231013 tempest-ServerActionsV293TestJSON-169231013-project-member] [instance: 8de2ffb3-e264-49f7-8581-6eae21adcaeb] Disconnected iSCSI Volume {{(pid=74613) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 29 17:54:43 user nova-compute[74613]: INFO nova.virt.libvirt.driver [None req-00bfbea5-b6dc-4a64-8add-1ca9586ba248 tempest-ServerActionsV293TestJSON-169231013 tempest-ServerActionsV293TestJSON-169231013-project-member] [instance: 8de2ffb3-e264-49f7-8581-6eae21adcaeb] Deletion of /opt/stack/data/nova/instances/8de2ffb3-e264-49f7-8581-6eae21adcaeb_del complete
Nov 29 17:54:43 user nova-compute[74613]: INFO nova.compute.manager [None req-00bfbea5-b6dc-4a64-8add-1ca9586ba248 tempest-ServerActionsV293TestJSON-169231013 tempest-ServerActionsV293TestJSON-169231013-project-member] [instance: 8de2ffb3-e264-49f7-8581-6eae21adcaeb] Took 0.17 seconds to destroy the instance on the hypervisor.
Nov 29 17:54:43 user nova-compute[74613]: DEBUG oslo.service.loopingcall [None req-00bfbea5-b6dc-4a64-8add-1ca9586ba248 tempest-ServerActionsV293TestJSON-169231013 tempest-ServerActionsV293TestJSON-169231013-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74613) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 29 17:54:43 user nova-compute[74613]: DEBUG nova.compute.manager [-] [instance: 8de2ffb3-e264-49f7-8581-6eae21adcaeb] Deallocating network for instance {{(pid=74613) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 29 17:54:43 user nova-compute[74613]: DEBUG nova.network.neutron [-] [instance: 8de2ffb3-e264-49f7-8581-6eae21adcaeb] deallocate_for_instance() {{(pid=74613) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 29 17:54:44 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:54:44 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:54:44 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:54:44 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:54:44 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:54:44 user nova-compute[74613]: DEBUG nova.compute.manager [req-1a91d384-76f7-4785-9036-757055ae9084 req-cbdf8e73-b12a-4240-a329-3627892a9c97 service nova] [instance: cd22685a-028c-4e0c-834d-e7b20f6d06ab] Received event network-vif-plugged-5b08bd65-707e-48a5-800b-dd0670c88d61 {{(pid=74613) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 17:54:44 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-1a91d384-76f7-4785-9036-757055ae9084 req-cbdf8e73-b12a-4240-a329-3627892a9c97 service nova] Acquiring lock "cd22685a-028c-4e0c-834d-e7b20f6d06ab-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 17:54:44 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-1a91d384-76f7-4785-9036-757055ae9084 req-cbdf8e73-b12a-4240-a329-3627892a9c97 service nova] Lock "cd22685a-028c-4e0c-834d-e7b20f6d06ab-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 17:54:44 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-1a91d384-76f7-4785-9036-757055ae9084 req-cbdf8e73-b12a-4240-a329-3627892a9c97 service nova] Lock "cd22685a-028c-4e0c-834d-e7b20f6d06ab-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 17:54:44 user nova-compute[74613]: DEBUG nova.compute.manager [req-1a91d384-76f7-4785-9036-757055ae9084 req-cbdf8e73-b12a-4240-a329-3627892a9c97 service nova] [instance: cd22685a-028c-4e0c-834d-e7b20f6d06ab] No waiting events found dispatching network-vif-plugged-5b08bd65-707e-48a5-800b-dd0670c88d61 {{(pid=74613) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 17:54:44 user nova-compute[74613]: WARNING nova.compute.manager [req-1a91d384-76f7-4785-9036-757055ae9084 req-cbdf8e73-b12a-4240-a329-3627892a9c97 service nova] [instance: cd22685a-028c-4e0c-834d-e7b20f6d06ab] Received unexpected event network-vif-plugged-5b08bd65-707e-48a5-800b-dd0670c88d61 for instance with vm_state building and task_state spawning.
Nov 29 17:54:44 user nova-compute[74613]: DEBUG nova.network.neutron [-] [instance: 8de2ffb3-e264-49f7-8581-6eae21adcaeb] Updating instance_info_cache with network_info: [] {{(pid=74613) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 17:54:44 user nova-compute[74613]: INFO nova.compute.manager [-] [instance: 8de2ffb3-e264-49f7-8581-6eae21adcaeb] Took 1.08 seconds to deallocate network for instance.
Nov 29 17:54:44 user nova-compute[74613]: INFO nova.compute.manager [None req-00bfbea5-b6dc-4a64-8add-1ca9586ba248 tempest-ServerActionsV293TestJSON-169231013 tempest-ServerActionsV293TestJSON-169231013-project-member] [instance: 8de2ffb3-e264-49f7-8581-6eae21adcaeb] Took 0.11 seconds to detach 1 volumes for instance.
Nov 29 17:54:44 user nova-compute[74613]: DEBUG nova.compute.manager [None req-00bfbea5-b6dc-4a64-8add-1ca9586ba248 tempest-ServerActionsV293TestJSON-169231013 tempest-ServerActionsV293TestJSON-169231013-project-member] [instance: 8de2ffb3-e264-49f7-8581-6eae21adcaeb] Deleting volume: fbbdc3d2-136d-4fba-b6ba-f27f35a0733b {{(pid=74613) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3237}}
Nov 29 17:54:44 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-00bfbea5-b6dc-4a64-8add-1ca9586ba248 tempest-ServerActionsV293TestJSON-169231013 tempest-ServerActionsV293TestJSON-169231013-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 17:54:44 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-00bfbea5-b6dc-4a64-8add-1ca9586ba248 tempest-ServerActionsV293TestJSON-169231013 tempest-ServerActionsV293TestJSON-169231013-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 17:54:44 user nova-compute[74613]: DEBUG nova.compute.provider_tree [None req-00bfbea5-b6dc-4a64-8add-1ca9586ba248 tempest-ServerActionsV293TestJSON-169231013 tempest-ServerActionsV293TestJSON-169231013-project-member] Inventory has not changed in ProviderTree for provider: 639d980e-3b12-44b1-b8f4-1812416fa4dd {{(pid=74613) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 17:54:44 user nova-compute[74613]: DEBUG nova.scheduler.client.report [None req-00bfbea5-b6dc-4a64-8add-1ca9586ba248 tempest-ServerActionsV293TestJSON-169231013 tempest-ServerActionsV293TestJSON-169231013-project-member] Inventory has not changed for provider 639d980e-3b12-44b1-b8f4-1812416fa4dd based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74613) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 17:54:45 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-00bfbea5-b6dc-4a64-8add-1ca9586ba248 tempest-ServerActionsV293TestJSON-169231013 tempest-ServerActionsV293TestJSON-169231013-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.286s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 17:54:45 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:54:45 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-00bfbea5-b6dc-4a64-8add-1ca9586ba248 tempest-ServerActionsV293TestJSON-169231013 tempest-ServerActionsV293TestJSON-169231013-project-member] Lock "8de2ffb3-e264-49f7-8581-6eae21adcaeb" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.947s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 17:54:46 user nova-compute[74613]: DEBUG nova.compute.manager [None req-34635a9f-32ad-4d56-b62c-9a4fc2486b5d tempest-ServerBootFromVolumeStableRescueTest-414665510 tempest-ServerBootFromVolumeStableRescueTest-414665510-project-member] [instance: cd22685a-028c-4e0c-834d-e7b20f6d06ab] Instance event wait completed in 0 seconds for  {{(pid=74613) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 29 17:54:46 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-34635a9f-32ad-4d56-b62c-9a4fc2486b5d tempest-ServerBootFromVolumeStableRescueTest-414665510 tempest-ServerBootFromVolumeStableRescueTest-414665510-project-member] [instance: cd22685a-028c-4e0c-834d-e7b20f6d06ab] Guest created on hypervisor {{(pid=74613) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 29 17:54:46 user nova-compute[74613]: INFO nova.virt.libvirt.driver [-] [instance: cd22685a-028c-4e0c-834d-e7b20f6d06ab] Instance spawned successfully.
Nov 29 17:54:46 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-34635a9f-32ad-4d56-b62c-9a4fc2486b5d tempest-ServerBootFromVolumeStableRescueTest-414665510 tempest-ServerBootFromVolumeStableRescueTest-414665510-project-member] [instance: cd22685a-028c-4e0c-834d-e7b20f6d06ab] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74613) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 29 17:54:46 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-34635a9f-32ad-4d56-b62c-9a4fc2486b5d tempest-ServerBootFromVolumeStableRescueTest-414665510 tempest-ServerBootFromVolumeStableRescueTest-414665510-project-member] [instance: cd22685a-028c-4e0c-834d-e7b20f6d06ab] Found default for hw_cdrom_bus of ide {{(pid=74613) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 17:54:46 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-34635a9f-32ad-4d56-b62c-9a4fc2486b5d tempest-ServerBootFromVolumeStableRescueTest-414665510 tempest-ServerBootFromVolumeStableRescueTest-414665510-project-member] [instance: cd22685a-028c-4e0c-834d-e7b20f6d06ab] Found default for hw_disk_bus of virtio {{(pid=74613) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 17:54:46 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-34635a9f-32ad-4d56-b62c-9a4fc2486b5d tempest-ServerBootFromVolumeStableRescueTest-414665510 tempest-ServerBootFromVolumeStableRescueTest-414665510-project-member] [instance: cd22685a-028c-4e0c-834d-e7b20f6d06ab] Found default for hw_input_bus of None {{(pid=74613) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 17:54:46 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-34635a9f-32ad-4d56-b62c-9a4fc2486b5d tempest-ServerBootFromVolumeStableRescueTest-414665510 tempest-ServerBootFromVolumeStableRescueTest-414665510-project-member] [instance: cd22685a-028c-4e0c-834d-e7b20f6d06ab] Found default for hw_pointer_model of None {{(pid=74613) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 17:54:46 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-34635a9f-32ad-4d56-b62c-9a4fc2486b5d tempest-ServerBootFromVolumeStableRescueTest-414665510 tempest-ServerBootFromVolumeStableRescueTest-414665510-project-member] [instance: cd22685a-028c-4e0c-834d-e7b20f6d06ab] Found default for hw_video_model of virtio {{(pid=74613) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 17:54:46 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-34635a9f-32ad-4d56-b62c-9a4fc2486b5d tempest-ServerBootFromVolumeStableRescueTest-414665510 tempest-ServerBootFromVolumeStableRescueTest-414665510-project-member] [instance: cd22685a-028c-4e0c-834d-e7b20f6d06ab] Found default for hw_vif_model of virtio {{(pid=74613) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 17:54:46 user nova-compute[74613]: INFO nova.compute.manager [None req-34635a9f-32ad-4d56-b62c-9a4fc2486b5d tempest-ServerBootFromVolumeStableRescueTest-414665510 tempest-ServerBootFromVolumeStableRescueTest-414665510-project-member] [instance: cd22685a-028c-4e0c-834d-e7b20f6d06ab] Took 5.16 seconds to spawn the instance on the hypervisor.
Nov 29 17:54:46 user nova-compute[74613]: DEBUG nova.compute.manager [None req-34635a9f-32ad-4d56-b62c-9a4fc2486b5d tempest-ServerBootFromVolumeStableRescueTest-414665510 tempest-ServerBootFromVolumeStableRescueTest-414665510-project-member] [instance: cd22685a-028c-4e0c-834d-e7b20f6d06ab] Checking state {{(pid=74613) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 29 17:54:46 user nova-compute[74613]: DEBUG nova.compute.manager [req-eef5e657-e2ba-4530-8b6c-fdf532370687 req-731d4635-a470-4980-9102-118470931f6c service nova] [instance: 8de2ffb3-e264-49f7-8581-6eae21adcaeb] Received event network-vif-deleted-51faf82e-9447-4f14-8724-e7939afb4d98 {{(pid=74613) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 17:54:46 user nova-compute[74613]: DEBUG nova.compute.manager [req-eef5e657-e2ba-4530-8b6c-fdf532370687 req-731d4635-a470-4980-9102-118470931f6c service nova] [instance: cd22685a-028c-4e0c-834d-e7b20f6d06ab] Received event network-vif-plugged-5b08bd65-707e-48a5-800b-dd0670c88d61 {{(pid=74613) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 17:54:46 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-eef5e657-e2ba-4530-8b6c-fdf532370687 req-731d4635-a470-4980-9102-118470931f6c service nova] Acquiring lock "cd22685a-028c-4e0c-834d-e7b20f6d06ab-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 17:54:46 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-eef5e657-e2ba-4530-8b6c-fdf532370687 req-731d4635-a470-4980-9102-118470931f6c service nova] Lock "cd22685a-028c-4e0c-834d-e7b20f6d06ab-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 17:54:46 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-eef5e657-e2ba-4530-8b6c-fdf532370687 req-731d4635-a470-4980-9102-118470931f6c service nova] Lock "cd22685a-028c-4e0c-834d-e7b20f6d06ab-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 17:54:46 user nova-compute[74613]: DEBUG nova.compute.manager [req-eef5e657-e2ba-4530-8b6c-fdf532370687 req-731d4635-a470-4980-9102-118470931f6c service nova] [instance: cd22685a-028c-4e0c-834d-e7b20f6d06ab] No waiting events found dispatching network-vif-plugged-5b08bd65-707e-48a5-800b-dd0670c88d61 {{(pid=74613) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 17:54:46 user nova-compute[74613]: WARNING nova.compute.manager [req-eef5e657-e2ba-4530-8b6c-fdf532370687 req-731d4635-a470-4980-9102-118470931f6c service nova] [instance: cd22685a-028c-4e0c-834d-e7b20f6d06ab] Received unexpected event network-vif-plugged-5b08bd65-707e-48a5-800b-dd0670c88d61 for instance with vm_state building and task_state spawning.
Nov 29 17:54:46 user nova-compute[74613]: INFO nova.compute.manager [None req-34635a9f-32ad-4d56-b62c-9a4fc2486b5d tempest-ServerBootFromVolumeStableRescueTest-414665510 tempest-ServerBootFromVolumeStableRescueTest-414665510-project-member] [instance: cd22685a-028c-4e0c-834d-e7b20f6d06ab] Took 20.34 seconds to build instance.
Nov 29 17:54:46 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-34635a9f-32ad-4d56-b62c-9a4fc2486b5d tempest-ServerBootFromVolumeStableRescueTest-414665510 tempest-ServerBootFromVolumeStableRescueTest-414665510-project-member] Lock "cd22685a-028c-4e0c-834d-e7b20f6d06ab" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 20.456s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 17:54:47 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:54:48 user nova-compute[74613]: WARNING nova.virt.libvirt.driver [None req-671f7534-dbe3-42a5-a209-31786ddcb369 tempest-TaggedAttachmentsTest-1438740121 tempest-TaggedAttachmentsTest-1438740121-project-member] Waiting for libvirt event about the detach of device tap5984be75-03 with device alias net1 from instance 288b8261-8706-4696-879d-d4dd01ab553e is timed out.
Nov 29 17:54:48 user nova-compute[74613]: DEBUG nova.virt.libvirt.guest [None req-671f7534-dbe3-42a5-a209-31786ddcb369 tempest-TaggedAttachmentsTest-1438740121 tempest-TaggedAttachmentsTest-1438740121-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:3d:db:4e"/><model type="virtio"/><mtu size="1442"/><target dev="tap5984be75-03"/></interface> {{(pid=74613) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Nov 29 17:54:48 user nova-compute[74613]: DEBUG nova.virt.libvirt.guest [None req-671f7534-dbe3-42a5-a209-31786ddcb369 tempest-TaggedAttachmentsTest-1438740121 tempest-TaggedAttachmentsTest-1438740121-project-member] interface for config: <interface type="ethernet"><mac address="fa:16:3e:3d:db:4e"/><model type="virtio"/><mtu size="1442"/><target dev="tap5984be75-03"/></interface>not found in domain: <domain type='kvm' id='8'>
Nov 29 17:54:48 user nova-compute[74613]:   <name>instance-00000008</name>
Nov 29 17:54:48 user nova-compute[74613]:   <uuid>288b8261-8706-4696-879d-d4dd01ab553e</uuid>
Nov 29 17:54:48 user nova-compute[74613]:   <metadata>
Nov 29 17:54:48 user nova-compute[74613]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1" xmlns:instance="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 29 17:54:48 user nova-compute[74613]:   <nova:package version="0.0.0"/>
Nov 29 17:54:48 user nova-compute[74613]:   <nova:name>tempest-device-tagging-server-697059192</nova:name>
Nov 29 17:54:48 user nova-compute[74613]:   <nova:creationTime>2023-11-29 17:53:49</nova:creationTime>
Nov 29 17:54:48 user nova-compute[74613]:   <nova:flavor name="m1.tiny">
Nov 29 17:54:48 user nova-compute[74613]:     <nova:memory>512</nova:memory>
Nov 29 17:54:48 user nova-compute[74613]:     <nova:disk>1</nova:disk>
Nov 29 17:54:48 user nova-compute[74613]:     <nova:swap>0</nova:swap>
Nov 29 17:54:48 user nova-compute[74613]:     <nova:ephemeral>0</nova:ephemeral>
Nov 29 17:54:48 user nova-compute[74613]:     <nova:vcpus>1</nova:vcpus>
Nov 29 17:54:48 user nova-compute[74613]:   </nova:flavor>
Nov 29 17:54:48 user nova-compute[74613]:   <nova:owner>
Nov 29 17:54:48 user nova-compute[74613]:     <nova:user uuid="52aa43eddf17484b9823bf13f548d22b">tempest-TaggedAttachmentsTest-1438740121-project-member</nova:user>
Nov 29 17:54:48 user nova-compute[74613]:     <nova:project uuid="fdebfa0bb4bf45338ce3fa1ded5cd5bd">tempest-TaggedAttachmentsTest-1438740121</nova:project>
Nov 29 17:54:48 user nova-compute[74613]:   </nova:owner>
Nov 29 17:54:48 user nova-compute[74613]:   <nova:root type="image" uuid="4217f428-8d9d-4ee1-9614-642d26d90c46"/>
Nov 29 17:54:48 user nova-compute[74613]:   <nova:ports>
Nov 29 17:54:48 user nova-compute[74613]:     <nova:port uuid="abe5d419-60cc-474c-935a-60f5512894e0">
Nov 29 17:54:48 user nova-compute[74613]:       <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Nov 29 17:54:48 user nova-compute[74613]:     </nova:port>
Nov 29 17:54:48 user nova-compute[74613]:     <nova:port uuid="5984be75-0336-4f84-a5f3-52f4e3fbeaa3">
Nov 29 17:54:48 user nova-compute[74613]:       <nova:ip type="fixed" address="10.10.10.185" ipVersion="4"/>
Nov 29 17:54:48 user nova-compute[74613]:     </nova:port>
Nov 29 17:54:48 user nova-compute[74613]:   </nova:ports>
Nov 29 17:54:48 user nova-compute[74613]: </nova:instance>
Nov 29 17:54:48 user nova-compute[74613]:   </metadata>
Nov 29 17:54:48 user nova-compute[74613]:   <memory unit='KiB'>524288</memory>
Nov 29 17:54:48 user nova-compute[74613]:   <currentMemory unit='KiB'>524288</currentMemory>
Nov 29 17:54:48 user nova-compute[74613]:   <vcpu placement='static'>1</vcpu>
Nov 29 17:54:48 user nova-compute[74613]:   <resource>
Nov 29 17:54:48 user nova-compute[74613]:     <partition>/machine</partition>
Nov 29 17:54:48 user nova-compute[74613]:   </resource>
Nov 29 17:54:48 user nova-compute[74613]:   <sysinfo type='smbios'>
Nov 29 17:54:48 user nova-compute[74613]:     <system>
Nov 29 17:54:48 user nova-compute[74613]:       <entry name='manufacturer'>OpenStack Foundation</entry>
Nov 29 17:54:48 user nova-compute[74613]:       <entry name='product'>OpenStack Nova</entry>
Nov 29 17:54:48 user nova-compute[74613]:       <entry name='version'>0.0.0</entry>
Nov 29 17:54:48 user nova-compute[74613]:       <entry name='serial'>288b8261-8706-4696-879d-d4dd01ab553e</entry>
Nov 29 17:54:48 user nova-compute[74613]:       <entry name='uuid'>288b8261-8706-4696-879d-d4dd01ab553e</entry>
Nov 29 17:54:48 user nova-compute[74613]:       <entry name='family'>Virtual Machine</entry>
Nov 29 17:54:48 user nova-compute[74613]:     </system>
Nov 29 17:54:48 user nova-compute[74613]:   </sysinfo>
Nov 29 17:54:48 user nova-compute[74613]:   <os>
Nov 29 17:54:48 user nova-compute[74613]:     <type arch='x86_64' machine='pc-i440fx-6.2'>hvm</type>
Nov 29 17:54:48 user nova-compute[74613]:     <boot dev='hd'/>
Nov 29 17:54:48 user nova-compute[74613]:     <smbios mode='sysinfo'/>
Nov 29 17:54:48 user nova-compute[74613]:   </os>
Nov 29 17:54:48 user nova-compute[74613]:   <features>
Nov 29 17:54:48 user nova-compute[74613]:     <acpi/>
Nov 29 17:54:48 user nova-compute[74613]:     <apic/>
Nov 29 17:54:48 user nova-compute[74613]:     <vmcoreinfo state='on'/>
Nov 29 17:54:48 user nova-compute[74613]:   </features>
Nov 29 17:54:48 user nova-compute[74613]:   <cpu mode='custom' match='exact' check='full'>
Nov 29 17:54:48 user nova-compute[74613]:     <model fallback='forbid'>Nehalem</model>
Nov 29 17:54:48 user nova-compute[74613]:     <topology sockets='1' dies='1' cores='1' threads='1'/>
Nov 29 17:54:48 user nova-compute[74613]:     <feature policy='require' name='vme'/>
Nov 29 17:54:48 user nova-compute[74613]:     <feature policy='require' name='x2apic'/>
Nov 29 17:54:48 user nova-compute[74613]:     <feature policy='require' name='hypervisor'/>
Nov 29 17:54:48 user nova-compute[74613]:   </cpu>
Nov 29 17:54:48 user nova-compute[74613]:   <clock offset='utc'>
Nov 29 17:54:48 user nova-compute[74613]:     <timer name='pit' tickpolicy='delay'/>
Nov 29 17:54:48 user nova-compute[74613]:     <timer name='rtc' tickpolicy='catchup'/>
Nov 29 17:54:48 user nova-compute[74613]:     <timer name='hpet' present='no'/>
Nov 29 17:54:48 user nova-compute[74613]:   </clock>
Nov 29 17:54:48 user nova-compute[74613]:   <on_poweroff>destroy</on_poweroff>
Nov 29 17:54:48 user nova-compute[74613]:   <on_reboot>restart</on_reboot>
Nov 29 17:54:48 user nova-compute[74613]:   <on_crash>destroy</on_crash>
Nov 29 17:54:48 user nova-compute[74613]:   <devices>
Nov 29 17:54:48 user nova-compute[74613]:     <emulator>/usr/bin/qemu-system-x86_64</emulator>
Nov 29 17:54:48 user nova-compute[74613]:     <disk type='file' device='disk'>
Nov 29 17:54:48 user nova-compute[74613]:       <driver name='qemu' type='qcow2' cache='none'/>
Nov 29 17:54:48 user nova-compute[74613]:       <source file='/opt/stack/data/nova/instances/288b8261-8706-4696-879d-d4dd01ab553e/disk' index='2'/>
Nov 29 17:54:48 user nova-compute[74613]:       <backingStore type='file' index='3'>
Nov 29 17:54:48 user nova-compute[74613]:         <format type='raw'/>
Nov 29 17:54:48 user nova-compute[74613]:         <source file='/opt/stack/data/nova/instances/_base/21faea9e6951f3bdd0153b76ac89fe1a60a34758'/>
Nov 29 17:54:48 user nova-compute[74613]:         <backingStore/>
Nov 29 17:54:48 user nova-compute[74613]:       </backingStore>
Nov 29 17:54:48 user nova-compute[74613]:       <target dev='vda' bus='virtio'/>
Nov 29 17:54:48 user nova-compute[74613]:       <alias name='virtio-disk0'/>
Nov 29 17:54:48 user nova-compute[74613]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x04' function='0x0'/>
Nov 29 17:54:48 user nova-compute[74613]:     </disk>
Nov 29 17:54:48 user nova-compute[74613]:     <disk type='file' device='cdrom'>
Nov 29 17:54:48 user nova-compute[74613]:       <driver name='qemu' type='raw' cache='none'/>
Nov 29 17:54:48 user nova-compute[74613]:       <source file='/opt/stack/data/nova/instances/288b8261-8706-4696-879d-d4dd01ab553e/disk.config' index='1'/>
Nov 29 17:54:48 user nova-compute[74613]:       <backingStore/>
Nov 29 17:54:48 user nova-compute[74613]:       <target dev='hda' bus='ide'/>
Nov 29 17:54:48 user nova-compute[74613]:       <readonly/>
Nov 29 17:54:48 user nova-compute[74613]:       <alias name='ide0-0-0'/>
Nov 29 17:54:48 user nova-compute[74613]:       <address type='drive' controller='0' bus='0' target='0' unit='0'/>
Nov 29 17:54:48 user nova-compute[74613]:     </disk>
Nov 29 17:54:48 user nova-compute[74613]:     <controller type='usb' index='0' model='none'>
Nov 29 17:54:48 user nova-compute[74613]:       <alias name='usb'/>
Nov 29 17:54:48 user nova-compute[74613]:     </controller>
Nov 29 17:54:48 user nova-compute[74613]:     <controller type='pci' index='0' model='pci-root'>
Nov 29 17:54:48 user nova-compute[74613]:       <alias name='pci.0'/>
Nov 29 17:54:48 user nova-compute[74613]:     </controller>
Nov 29 17:54:48 user nova-compute[74613]:     <controller type='ide' index='0'>
Nov 29 17:54:48 user nova-compute[74613]:       <alias name='ide'/>
Nov 29 17:54:48 user nova-compute[74613]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x1'/>
Nov 29 17:54:48 user nova-compute[74613]:     </controller>
Nov 29 17:54:48 user nova-compute[74613]:     <interface type='ethernet'>
Nov 29 17:54:48 user nova-compute[74613]:       <mac address='fa:16:3e:14:7b:54'/>
Nov 29 17:54:48 user nova-compute[74613]:       <target dev='tapabe5d419-60'/>
Nov 29 17:54:48 user nova-compute[74613]:       <model type='virtio'/>
Nov 29 17:54:48 user nova-compute[74613]:       <mtu size='1442'/>
Nov 29 17:54:48 user nova-compute[74613]:       <alias name='net0'/>
Nov 29 17:54:48 user nova-compute[74613]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x03' function='0x0'/>
Nov 29 17:54:48 user nova-compute[74613]:     </interface>
Nov 29 17:54:48 user nova-compute[74613]:     <serial type='pty'>
Nov 29 17:54:48 user nova-compute[74613]:       <source path='/dev/pts/7'/>
Nov 29 17:54:48 user nova-compute[74613]:       <log file='/opt/stack/data/nova/instances/288b8261-8706-4696-879d-d4dd01ab553e/console.log' append='off'/>
Nov 29 17:54:48 user nova-compute[74613]:       <target type='isa-serial' port='0'>
Nov 29 17:54:48 user nova-compute[74613]:         <model name='isa-serial'/>
Nov 29 17:54:48 user nova-compute[74613]:       </target>
Nov 29 17:54:48 user nova-compute[74613]:       <alias name='serial0'/>
Nov 29 17:54:48 user nova-compute[74613]:     </serial>
Nov 29 17:54:48 user nova-compute[74613]:     <console type='pty' tty='/dev/pts/7'>
Nov 29 17:54:48 user nova-compute[74613]:       <source path='/dev/pts/7'/>
Nov 29 17:54:48 user nova-compute[74613]:       <log file='/opt/stack/data/nova/instances/288b8261-8706-4696-879d-d4dd01ab553e/console.log' append='off'/>
Nov 29 17:54:48 user nova-compute[74613]:       <target type='serial' port='0'/>
Nov 29 17:54:48 user nova-compute[74613]:       <alias name='serial0'/>
Nov 29 17:54:48 user nova-compute[74613]:     </console>
Nov 29 17:54:48 user nova-compute[74613]:     <input type='mouse' bus='ps2'>
Nov 29 17:54:48 user nova-compute[74613]:       <alias name='input0'/>
Nov 29 17:54:48 user nova-compute[74613]:     </input>
Nov 29 17:54:48 user nova-compute[74613]:     <input type='keyboard' bus='ps2'>
Nov 29 17:54:48 user nova-compute[74613]:       <alias name='input1'/>
Nov 29 17:54:48 user nova-compute[74613]:     </input>
Nov 29 17:54:48 user nova-compute[74613]:     <graphics type='vnc' port='5907' autoport='yes' listen='0.0.0.0'>
Nov 29 17:54:48 user nova-compute[74613]:       <listen type='address' address='0.0.0.0'/>
Nov 29 17:54:48 user nova-compute[74613]:     </graphics>
Nov 29 17:54:48 user nova-compute[74613]:     <audio id='1' type='none'/>
Nov 29 17:54:48 user nova-compute[74613]:     <video>
Nov 29 17:54:48 user nova-compute[74613]:       <model type='virtio' heads='1' primary='yes'/>
Nov 29 17:54:48 user nova-compute[74613]:       <alias name='video0'/>
Nov 29 17:54:48 user nova-compute[74613]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x0'/>
Nov 29 17:54:48 user nova-compute[74613]:     </video>
Nov 29 17:54:48 user nova-compute[74613]:     <memballoon model='virtio'>
Nov 29 17:54:48 user nova-compute[74613]:       <stats period='10'/>
Nov 29 17:54:48 user nova-compute[74613]:       <alias name='balloon0'/>
Nov 29 17:54:48 user nova-compute[74613]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x05' function='0x0'/>
Nov 29 17:54:48 user nova-compute[74613]:     </memballoon>
Nov 29 17:54:48 user nova-compute[74613]:     <rng model='virtio'>
Nov 29 17:54:48 user nova-compute[74613]:       <backend model='random'>/dev/urandom</backend>
Nov 29 17:54:48 user nova-compute[74613]:       <alias name='rng0'/>
Nov 29 17:54:48 user nova-compute[74613]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x06' function='0x0'/>
Nov 29 17:54:48 user nova-compute[74613]:     </rng>
Nov 29 17:54:48 user nova-compute[74613]:   </devices>
Nov 29 17:54:48 user nova-compute[74613]:   <seclabel type='dynamic' model='apparmor' relabel='yes'>
Nov 29 17:54:48 user nova-compute[74613]:     <label>libvirt-288b8261-8706-4696-879d-d4dd01ab553e</label>
Nov 29 17:54:48 user nova-compute[74613]:     <imagelabel>libvirt-288b8261-8706-4696-879d-d4dd01ab553e</imagelabel>
Nov 29 17:54:48 user nova-compute[74613]:   </seclabel>
Nov 29 17:54:48 user nova-compute[74613]:   <seclabel type='dynamic' model='dac' relabel='yes'>
Nov 29 17:54:48 user nova-compute[74613]:     <label>+64055:+108</label>
Nov 29 17:54:48 user nova-compute[74613]:     <imagelabel>+64055:+108</imagelabel>
Nov 29 17:54:48 user nova-compute[74613]:   </seclabel>
Nov 29 17:54:48 user nova-compute[74613]: </domain>
Nov 29 17:54:48 user nova-compute[74613]:  {{(pid=74613) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:282}}
Nov 29 17:54:48 user nova-compute[74613]: INFO nova.virt.libvirt.driver [None req-671f7534-dbe3-42a5-a209-31786ddcb369 tempest-TaggedAttachmentsTest-1438740121 tempest-TaggedAttachmentsTest-1438740121-project-member] Successfully detached device tap5984be75-03 from instance 288b8261-8706-4696-879d-d4dd01ab553e from the live domain config.
Nov 29 17:54:48 user nova-compute[74613]: DEBUG nova.virt.libvirt.vif [None req-671f7534-dbe3-42a5-a209-31786ddcb369 tempest-TaggedAttachmentsTest-1438740121 tempest-TaggedAttachmentsTest-1438740121-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-29T17:51:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=InstanceDeviceMetadata,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-697059192',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-697059192',id=8,image_ref='4217f428-8d9d-4ee1-9614-642d26d90c46',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFUFE7U0lYNK45/HsStCT3AXLpdrJnwoY/KNgsNZxe8b6bxv4jkHRb2DHfVVdKmIkJ56BYNQ81Tfxi8bOx3gLzOij7zz7pkeTvdmFF3bs2gbkvzpJfe42Gy5jL3poiHfSw==',key_name='tempest-keypair-587676949',keypairs=<?>,launch_index=0,launched_at=2023-11-29T17:52:07Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='fdebfa0bb4bf45338ce3fa1ded5cd5bd',ramdisk_id='',reservation_id='r-cg74z5d5',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='4217f428-8d9d-4ee1-9614-642d26d90c46',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-1438740121',owner_user_name='tempest-TaggedAttachmentsTest-1438740121-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-11-29T17:52:07Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='52aa43eddf17484b9823bf13f548d22b',uuid=288b8261-8706-4696-879d-d4dd01ab553e,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "5984be75-0336-4f84-a5f3-52f4e3fbeaa3", "address": "fa:16:3e:3d:db:4e", "network": {"id": "e3b3f364-2bb0-4376-b571-7fa6432b4455", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1115785953", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.185", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "fdebfa0bb4bf45338ce3fa1ded5cd5bd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5984be75-03", "ovs_interfaceid": "5984be75-0336-4f84-a5f3-52f4e3fbeaa3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74613) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 29 17:54:48 user nova-compute[74613]: DEBUG nova.network.os_vif_util [None req-671f7534-dbe3-42a5-a209-31786ddcb369 tempest-TaggedAttachmentsTest-1438740121 tempest-TaggedAttachmentsTest-1438740121-project-member] Converting VIF {"id": "5984be75-0336-4f84-a5f3-52f4e3fbeaa3", "address": "fa:16:3e:3d:db:4e", "network": {"id": "e3b3f364-2bb0-4376-b571-7fa6432b4455", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1115785953", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.185", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "fdebfa0bb4bf45338ce3fa1ded5cd5bd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5984be75-03", "ovs_interfaceid": "5984be75-0336-4f84-a5f3-52f4e3fbeaa3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74613) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 17:54:48 user nova-compute[74613]: DEBUG nova.network.os_vif_util [None req-671f7534-dbe3-42a5-a209-31786ddcb369 tempest-TaggedAttachmentsTest-1438740121 tempest-TaggedAttachmentsTest-1438740121-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:3d:db:4e,bridge_name='br-int',has_traffic_filtering=True,id=5984be75-0336-4f84-a5f3-52f4e3fbeaa3,network=Network(e3b3f364-2bb0-4376-b571-7fa6432b4455),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5984be75-03') {{(pid=74613) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 17:54:48 user nova-compute[74613]: DEBUG os_vif [None req-671f7534-dbe3-42a5-a209-31786ddcb369 tempest-TaggedAttachmentsTest-1438740121 tempest-TaggedAttachmentsTest-1438740121-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:3d:db:4e,bridge_name='br-int',has_traffic_filtering=True,id=5984be75-0336-4f84-a5f3-52f4e3fbeaa3,network=Network(e3b3f364-2bb0-4376-b571-7fa6432b4455),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5984be75-03') {{(pid=74613) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 29 17:54:48 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:54:48 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap5984be75-03, bridge=br-int, if_exists=True) {{(pid=74613) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 17:54:48 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:54:48 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:54:48 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:54:48 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=5580e9a0-d184-47f5-9cf6-83bd8b98b3a8) {{(pid=74613) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 17:54:48 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:54:48 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:54:48 user nova-compute[74613]: INFO os_vif [None req-671f7534-dbe3-42a5-a209-31786ddcb369 tempest-TaggedAttachmentsTest-1438740121 tempest-TaggedAttachmentsTest-1438740121-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:3d:db:4e,bridge_name='br-int',has_traffic_filtering=True,id=5984be75-0336-4f84-a5f3-52f4e3fbeaa3,network=Network(e3b3f364-2bb0-4376-b571-7fa6432b4455),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5984be75-03')
Nov 29 17:54:48 user nova-compute[74613]: DEBUG nova.virt.libvirt.guest [None req-671f7534-dbe3-42a5-a209-31786ddcb369 tempest-TaggedAttachmentsTest-1438740121 tempest-TaggedAttachmentsTest-1438740121-project-member] set metadata xml: <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 29 17:54:48 user nova-compute[74613]:   <nova:package version="0.0.0"/>
Nov 29 17:54:48 user nova-compute[74613]:   <nova:name>tempest-device-tagging-server-697059192</nova:name>
Nov 29 17:54:48 user nova-compute[74613]:   <nova:creationTime>2023-11-29 17:54:48</nova:creationTime>
Nov 29 17:54:48 user nova-compute[74613]:   <nova:flavor name="m1.tiny">
Nov 29 17:54:48 user nova-compute[74613]:     <nova:memory>512</nova:memory>
Nov 29 17:54:48 user nova-compute[74613]:     <nova:disk>1</nova:disk>
Nov 29 17:54:48 user nova-compute[74613]:     <nova:swap>0</nova:swap>
Nov 29 17:54:48 user nova-compute[74613]:     <nova:ephemeral>0</nova:ephemeral>
Nov 29 17:54:48 user nova-compute[74613]:     <nova:vcpus>1</nova:vcpus>
Nov 29 17:54:48 user nova-compute[74613]:   </nova:flavor>
Nov 29 17:54:48 user nova-compute[74613]:   <nova:owner>
Nov 29 17:54:48 user nova-compute[74613]:     <nova:user uuid="52aa43eddf17484b9823bf13f548d22b">tempest-TaggedAttachmentsTest-1438740121-project-member</nova:user>
Nov 29 17:54:48 user nova-compute[74613]:     <nova:project uuid="fdebfa0bb4bf45338ce3fa1ded5cd5bd">tempest-TaggedAttachmentsTest-1438740121</nova:project>
Nov 29 17:54:48 user nova-compute[74613]:   </nova:owner>
Nov 29 17:54:48 user nova-compute[74613]:   <nova:root type="image" uuid="4217f428-8d9d-4ee1-9614-642d26d90c46"/>
Nov 29 17:54:48 user nova-compute[74613]:   <nova:ports>
Nov 29 17:54:48 user nova-compute[74613]:     <nova:port uuid="abe5d419-60cc-474c-935a-60f5512894e0">
Nov 29 17:54:48 user nova-compute[74613]:       <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Nov 29 17:54:48 user nova-compute[74613]:     </nova:port>
Nov 29 17:54:48 user nova-compute[74613]:   </nova:ports>
Nov 29 17:54:48 user nova-compute[74613]: </nova:instance>
Nov 29 17:54:48 user nova-compute[74613]:  {{(pid=74613) set_metadata /opt/stack/nova/nova/virt/libvirt/guest.py:359}}
Nov 29 17:54:49 user nova-compute[74613]: DEBUG nova.compute.manager [req-215ab0d4-5d44-4db9-9731-68fe9f9934b6 req-77050a81-b8d6-47b8-a146-2cc6588837a9 service nova] [instance: 288b8261-8706-4696-879d-d4dd01ab553e] Received event network-vif-deleted-5984be75-0336-4f84-a5f3-52f4e3fbeaa3 {{(pid=74613) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 17:54:49 user nova-compute[74613]: INFO nova.compute.manager [req-215ab0d4-5d44-4db9-9731-68fe9f9934b6 req-77050a81-b8d6-47b8-a146-2cc6588837a9 service nova] [instance: 288b8261-8706-4696-879d-d4dd01ab553e] Neutron deleted interface 5984be75-0336-4f84-a5f3-52f4e3fbeaa3; detaching it from the instance and deleting it from the info cache
Nov 29 17:54:49 user nova-compute[74613]: DEBUG nova.network.neutron [req-215ab0d4-5d44-4db9-9731-68fe9f9934b6 req-77050a81-b8d6-47b8-a146-2cc6588837a9 service nova] [instance: 288b8261-8706-4696-879d-d4dd01ab553e] Updating instance_info_cache with network_info: [{"id": "abe5d419-60cc-474c-935a-60f5512894e0", "address": "fa:16:3e:14:7b:54", "network": {"id": "3a1d6151-a950-475c-af8a-d15174f89822", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1729826224-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.29", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fdebfa0bb4bf45338ce3fa1ded5cd5bd", "mtu": null, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapabe5d419-60", "ovs_interfaceid": "abe5d419-60cc-474c-935a-60f5512894e0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74613) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 17:54:49 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-671f7534-dbe3-42a5-a209-31786ddcb369 tempest-TaggedAttachmentsTest-1438740121 tempest-TaggedAttachmentsTest-1438740121-project-member] Acquiring lock "refresh_cache-288b8261-8706-4696-879d-d4dd01ab553e" {{(pid=74613) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 17:54:49 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-671f7534-dbe3-42a5-a209-31786ddcb369 tempest-TaggedAttachmentsTest-1438740121 tempest-TaggedAttachmentsTest-1438740121-project-member] Acquired lock "refresh_cache-288b8261-8706-4696-879d-d4dd01ab553e" {{(pid=74613) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 17:54:49 user nova-compute[74613]: DEBUG nova.network.neutron [None req-671f7534-dbe3-42a5-a209-31786ddcb369 tempest-TaggedAttachmentsTest-1438740121 tempest-TaggedAttachmentsTest-1438740121-project-member] [instance: 288b8261-8706-4696-879d-d4dd01ab553e] Building network info cache for instance {{(pid=74613) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 29 17:54:49 user nova-compute[74613]: DEBUG nova.objects.instance [req-215ab0d4-5d44-4db9-9731-68fe9f9934b6 req-77050a81-b8d6-47b8-a146-2cc6588837a9 service nova] Lazy-loading 'system_metadata' on Instance uuid 288b8261-8706-4696-879d-d4dd01ab553e {{(pid=74613) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 17:54:49 user nova-compute[74613]: DEBUG nova.objects.instance [req-215ab0d4-5d44-4db9-9731-68fe9f9934b6 req-77050a81-b8d6-47b8-a146-2cc6588837a9 service nova] Lazy-loading 'flavor' on Instance uuid 288b8261-8706-4696-879d-d4dd01ab553e {{(pid=74613) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 17:54:49 user nova-compute[74613]: DEBUG nova.objects.base [req-215ab0d4-5d44-4db9-9731-68fe9f9934b6 req-77050a81-b8d6-47b8-a146-2cc6588837a9 service nova] Object Instance<288b8261-8706-4696-879d-d4dd01ab553e> lazy-loaded attributes: system_metadata,flavor {{(pid=74613) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 29 17:54:49 user nova-compute[74613]: DEBUG nova.virt.libvirt.vif [req-215ab0d4-5d44-4db9-9731-68fe9f9934b6 req-77050a81-b8d6-47b8-a146-2cc6588837a9 service nova] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-29T17:51:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-697059192',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-697059192',id=8,image_ref='4217f428-8d9d-4ee1-9614-642d26d90c46',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFUFE7U0lYNK45/HsStCT3AXLpdrJnwoY/KNgsNZxe8b6bxv4jkHRb2DHfVVdKmIkJ56BYNQ81Tfxi8bOx3gLzOij7zz7pkeTvdmFF3bs2gbkvzpJfe42Gy5jL3poiHfSw==',key_name='tempest-keypair-587676949',keypairs=<?>,launch_index=0,launched_at=2023-11-29T17:52:07Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata=<?>,migration_context=None,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='fdebfa0bb4bf45338ce3fa1ded5cd5bd',ramdisk_id='',reservation_id='r-cg74z5d5',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='4217f428-8d9d-4ee1-9614-642d26d90c46',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-1438740121',owner_user_name='tempest-TaggedAttachmentsTest-1438740121-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-11-29T17:52:07Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='52aa43eddf17484b9823bf13f548d22b',uuid=288b8261-8706-4696-879d-d4dd01ab553e,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "5984be75-0336-4f84-a5f3-52f4e3fbeaa3", "address": "fa:16:3e:3d:db:4e", "network": {"id": "e3b3f364-2bb0-4376-b571-7fa6432b4455", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1115785953", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.185", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "fdebfa0bb4bf45338ce3fa1ded5cd5bd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5984be75-03", "ovs_interfaceid": "5984be75-0336-4f84-a5f3-52f4e3fbeaa3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74613) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 29 17:54:49 user nova-compute[74613]: DEBUG nova.network.os_vif_util [req-215ab0d4-5d44-4db9-9731-68fe9f9934b6 req-77050a81-b8d6-47b8-a146-2cc6588837a9 service nova] Converting VIF {"id": "5984be75-0336-4f84-a5f3-52f4e3fbeaa3", "address": "fa:16:3e:3d:db:4e", "network": {"id": "e3b3f364-2bb0-4376-b571-7fa6432b4455", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1115785953", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.185", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "fdebfa0bb4bf45338ce3fa1ded5cd5bd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5984be75-03", "ovs_interfaceid": "5984be75-0336-4f84-a5f3-52f4e3fbeaa3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74613) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 17:54:49 user nova-compute[74613]: DEBUG nova.network.os_vif_util [req-215ab0d4-5d44-4db9-9731-68fe9f9934b6 req-77050a81-b8d6-47b8-a146-2cc6588837a9 service nova] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:3d:db:4e,bridge_name='br-int',has_traffic_filtering=True,id=5984be75-0336-4f84-a5f3-52f4e3fbeaa3,network=Network(e3b3f364-2bb0-4376-b571-7fa6432b4455),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5984be75-03') {{(pid=74613) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 17:54:49 user nova-compute[74613]: DEBUG nova.virt.libvirt.guest [req-215ab0d4-5d44-4db9-9731-68fe9f9934b6 req-77050a81-b8d6-47b8-a146-2cc6588837a9 service nova] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:3d:db:4e"/><model type="virtio"/><mtu size="1442"/><target dev="tap5984be75-03"/></interface> {{(pid=74613) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Nov 29 17:54:49 user nova-compute[74613]: DEBUG nova.virt.libvirt.guest [req-215ab0d4-5d44-4db9-9731-68fe9f9934b6 req-77050a81-b8d6-47b8-a146-2cc6588837a9 service nova] interface for config: <interface type="ethernet"><mac address="fa:16:3e:3d:db:4e"/><model type="virtio"/><mtu size="1442"/><target dev="tap5984be75-03"/></interface>not found in domain: <domain type='kvm' id='8'>
Nov 29 17:54:49 user nova-compute[74613]:   <name>instance-00000008</name>
Nov 29 17:54:49 user nova-compute[74613]:   <uuid>288b8261-8706-4696-879d-d4dd01ab553e</uuid>
Nov 29 17:54:49 user nova-compute[74613]:   <metadata>
Nov 29 17:54:49 user nova-compute[74613]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1" xmlns:instance="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 29 17:54:49 user nova-compute[74613]:   <nova:package version="0.0.0"/>
Nov 29 17:54:49 user nova-compute[74613]:   <nova:name>tempest-device-tagging-server-697059192</nova:name>
Nov 29 17:54:49 user nova-compute[74613]:   <nova:creationTime>2023-11-29 17:54:48</nova:creationTime>
Nov 29 17:54:49 user nova-compute[74613]:   <nova:flavor name="m1.tiny">
Nov 29 17:54:49 user nova-compute[74613]:     <nova:memory>512</nova:memory>
Nov 29 17:54:49 user nova-compute[74613]:     <nova:disk>1</nova:disk>
Nov 29 17:54:49 user nova-compute[74613]:     <nova:swap>0</nova:swap>
Nov 29 17:54:49 user nova-compute[74613]:     <nova:ephemeral>0</nova:ephemeral>
Nov 29 17:54:49 user nova-compute[74613]:     <nova:vcpus>1</nova:vcpus>
Nov 29 17:54:49 user nova-compute[74613]:   </nova:flavor>
Nov 29 17:54:49 user nova-compute[74613]:   <nova:owner>
Nov 29 17:54:49 user nova-compute[74613]:     <nova:user uuid="52aa43eddf17484b9823bf13f548d22b">tempest-TaggedAttachmentsTest-1438740121-project-member</nova:user>
Nov 29 17:54:49 user nova-compute[74613]:     <nova:project uuid="fdebfa0bb4bf45338ce3fa1ded5cd5bd">tempest-TaggedAttachmentsTest-1438740121</nova:project>
Nov 29 17:54:49 user nova-compute[74613]:   </nova:owner>
Nov 29 17:54:49 user nova-compute[74613]:   <nova:root type="image" uuid="4217f428-8d9d-4ee1-9614-642d26d90c46"/>
Nov 29 17:54:49 user nova-compute[74613]:   <nova:ports>
Nov 29 17:54:49 user nova-compute[74613]:     <nova:port uuid="abe5d419-60cc-474c-935a-60f5512894e0">
Nov 29 17:54:49 user nova-compute[74613]:       <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Nov 29 17:54:49 user nova-compute[74613]:     </nova:port>
Nov 29 17:54:49 user nova-compute[74613]:   </nova:ports>
Nov 29 17:54:49 user nova-compute[74613]: </nova:instance>
Nov 29 17:54:49 user nova-compute[74613]:   </metadata>
Nov 29 17:54:49 user nova-compute[74613]:   <memory unit='KiB'>524288</memory>
Nov 29 17:54:49 user nova-compute[74613]:   <currentMemory unit='KiB'>524288</currentMemory>
Nov 29 17:54:49 user nova-compute[74613]:   <vcpu placement='static'>1</vcpu>
Nov 29 17:54:49 user nova-compute[74613]:   <resource>
Nov 29 17:54:49 user nova-compute[74613]:     <partition>/machine</partition>
Nov 29 17:54:49 user nova-compute[74613]:   </resource>
Nov 29 17:54:49 user nova-compute[74613]:   <sysinfo type='smbios'>
Nov 29 17:54:49 user nova-compute[74613]:     <system>
Nov 29 17:54:49 user nova-compute[74613]:       <entry name='manufacturer'>OpenStack Foundation</entry>
Nov 29 17:54:49 user nova-compute[74613]:       <entry name='product'>OpenStack Nova</entry>
Nov 29 17:54:49 user nova-compute[74613]:       <entry name='version'>0.0.0</entry>
Nov 29 17:54:49 user nova-compute[74613]:       <entry name='serial'>288b8261-8706-4696-879d-d4dd01ab553e</entry>
Nov 29 17:54:49 user nova-compute[74613]:       <entry name='uuid'>288b8261-8706-4696-879d-d4dd01ab553e</entry>
Nov 29 17:54:49 user nova-compute[74613]:       <entry name='family'>Virtual Machine</entry>
Nov 29 17:54:49 user nova-compute[74613]:     </system>
Nov 29 17:54:49 user nova-compute[74613]:   </sysinfo>
Nov 29 17:54:49 user nova-compute[74613]:   <os>
Nov 29 17:54:49 user nova-compute[74613]:     <type arch='x86_64' machine='pc-i440fx-6.2'>hvm</type>
Nov 29 17:54:49 user nova-compute[74613]:     <boot dev='hd'/>
Nov 29 17:54:49 user nova-compute[74613]:     <smbios mode='sysinfo'/>
Nov 29 17:54:49 user nova-compute[74613]:   </os>
Nov 29 17:54:49 user nova-compute[74613]:   <features>
Nov 29 17:54:49 user nova-compute[74613]:     <acpi/>
Nov 29 17:54:49 user nova-compute[74613]:     <apic/>
Nov 29 17:54:49 user nova-compute[74613]:     <vmcoreinfo state='on'/>
Nov 29 17:54:49 user nova-compute[74613]:   </features>
Nov 29 17:54:49 user nova-compute[74613]:   <cpu mode='custom' match='exact' check='full'>
Nov 29 17:54:49 user nova-compute[74613]:     <model fallback='forbid'>Nehalem</model>
Nov 29 17:54:49 user nova-compute[74613]:     <topology sockets='1' dies='1' cores='1' threads='1'/>
Nov 29 17:54:49 user nova-compute[74613]:     <feature policy='require' name='vme'/>
Nov 29 17:54:49 user nova-compute[74613]:     <feature policy='require' name='x2apic'/>
Nov 29 17:54:49 user nova-compute[74613]:     <feature policy='require' name='hypervisor'/>
Nov 29 17:54:49 user nova-compute[74613]:   </cpu>
Nov 29 17:54:49 user nova-compute[74613]:   <clock offset='utc'>
Nov 29 17:54:49 user nova-compute[74613]:     <timer name='pit' tickpolicy='delay'/>
Nov 29 17:54:49 user nova-compute[74613]:     <timer name='rtc' tickpolicy='catchup'/>
Nov 29 17:54:49 user nova-compute[74613]:     <timer name='hpet' present='no'/>
Nov 29 17:54:49 user nova-compute[74613]:   </clock>
Nov 29 17:54:49 user nova-compute[74613]:   <on_poweroff>destroy</on_poweroff>
Nov 29 17:54:49 user nova-compute[74613]:   <on_reboot>restart</on_reboot>
Nov 29 17:54:49 user nova-compute[74613]:   <on_crash>destroy</on_crash>
Nov 29 17:54:49 user nova-compute[74613]:   <devices>
Nov 29 17:54:49 user nova-compute[74613]:     <emulator>/usr/bin/qemu-system-x86_64</emulator>
Nov 29 17:54:49 user nova-compute[74613]:     <disk type='file' device='disk'>
Nov 29 17:54:49 user nova-compute[74613]:       <driver name='qemu' type='qcow2' cache='none'/>
Nov 29 17:54:49 user nova-compute[74613]:       <source file='/opt/stack/data/nova/instances/288b8261-8706-4696-879d-d4dd01ab553e/disk' index='2'/>
Nov 29 17:54:49 user nova-compute[74613]:       <backingStore type='file' index='3'>
Nov 29 17:54:49 user nova-compute[74613]:         <format type='raw'/>
Nov 29 17:54:49 user nova-compute[74613]:         <source file='/opt/stack/data/nova/instances/_base/21faea9e6951f3bdd0153b76ac89fe1a60a34758'/>
Nov 29 17:54:49 user nova-compute[74613]:         <backingStore/>
Nov 29 17:54:49 user nova-compute[74613]:       </backingStore>
Nov 29 17:54:49 user nova-compute[74613]:       <target dev='vda' bus='virtio'/>
Nov 29 17:54:49 user nova-compute[74613]:       <alias name='virtio-disk0'/>
Nov 29 17:54:49 user nova-compute[74613]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x04' function='0x0'/>
Nov 29 17:54:49 user nova-compute[74613]:     </disk>
Nov 29 17:54:49 user nova-compute[74613]:     <disk type='file' device='cdrom'>
Nov 29 17:54:49 user nova-compute[74613]:       <driver name='qemu' type='raw' cache='none'/>
Nov 29 17:54:49 user nova-compute[74613]:       <source file='/opt/stack/data/nova/instances/288b8261-8706-4696-879d-d4dd01ab553e/disk.config' index='1'/>
Nov 29 17:54:49 user nova-compute[74613]:       <backingStore/>
Nov 29 17:54:49 user nova-compute[74613]:       <target dev='hda' bus='ide'/>
Nov 29 17:54:49 user nova-compute[74613]:       <readonly/>
Nov 29 17:54:49 user nova-compute[74613]:       <alias name='ide0-0-0'/>
Nov 29 17:54:49 user nova-compute[74613]:       <address type='drive' controller='0' bus='0' target='0' unit='0'/>
Nov 29 17:54:49 user nova-compute[74613]:     </disk>
Nov 29 17:54:49 user nova-compute[74613]:     <controller type='usb' index='0' model='none'>
Nov 29 17:54:49 user nova-compute[74613]:       <alias name='usb'/>
Nov 29 17:54:49 user nova-compute[74613]:     </controller>
Nov 29 17:54:49 user nova-compute[74613]:     <controller type='pci' index='0' model='pci-root'>
Nov 29 17:54:49 user nova-compute[74613]:       <alias name='pci.0'/>
Nov 29 17:54:49 user nova-compute[74613]:     </controller>
Nov 29 17:54:49 user nova-compute[74613]:     <controller type='ide' index='0'>
Nov 29 17:54:49 user nova-compute[74613]:       <alias name='ide'/>
Nov 29 17:54:49 user nova-compute[74613]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x1'/>
Nov 29 17:54:49 user nova-compute[74613]:     </controller>
Nov 29 17:54:49 user nova-compute[74613]:     <interface type='ethernet'>
Nov 29 17:54:49 user nova-compute[74613]:       <mac address='fa:16:3e:14:7b:54'/>
Nov 29 17:54:49 user nova-compute[74613]:       <target dev='tapabe5d419-60'/>
Nov 29 17:54:49 user nova-compute[74613]:       <model type='virtio'/>
Nov 29 17:54:49 user nova-compute[74613]:       <mtu size='1442'/>
Nov 29 17:54:49 user nova-compute[74613]:       <alias name='net0'/>
Nov 29 17:54:49 user nova-compute[74613]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x03' function='0x0'/>
Nov 29 17:54:49 user nova-compute[74613]:     </interface>
Nov 29 17:54:49 user nova-compute[74613]:     <serial type='pty'>
Nov 29 17:54:49 user nova-compute[74613]:       <source path='/dev/pts/7'/>
Nov 29 17:54:49 user nova-compute[74613]:       <log file='/opt/stack/data/nova/instances/288b8261-8706-4696-879d-d4dd01ab553e/console.log' append='off'/>
Nov 29 17:54:49 user nova-compute[74613]:       <target type='isa-serial' port='0'>
Nov 29 17:54:49 user nova-compute[74613]:         <model name='isa-serial'/>
Nov 29 17:54:49 user nova-compute[74613]:       </target>
Nov 29 17:54:49 user nova-compute[74613]:       <alias name='serial0'/>
Nov 29 17:54:49 user nova-compute[74613]:     </serial>
Nov 29 17:54:49 user nova-compute[74613]:     <console type='pty' tty='/dev/pts/7'>
Nov 29 17:54:49 user nova-compute[74613]:       <source path='/dev/pts/7'/>
Nov 29 17:54:49 user nova-compute[74613]:       <log file='/opt/stack/data/nova/instances/288b8261-8706-4696-879d-d4dd01ab553e/console.log' append='off'/>
Nov 29 17:54:49 user nova-compute[74613]:       <target type='serial' port='0'/>
Nov 29 17:54:49 user nova-compute[74613]:       <alias name='serial0'/>
Nov 29 17:54:49 user nova-compute[74613]:     </console>
Nov 29 17:54:49 user nova-compute[74613]:     <input type='mouse' bus='ps2'>
Nov 29 17:54:49 user nova-compute[74613]:       <alias name='input0'/>
Nov 29 17:54:49 user nova-compute[74613]:     </input>
Nov 29 17:54:49 user nova-compute[74613]:     <input type='keyboard' bus='ps2'>
Nov 29 17:54:49 user nova-compute[74613]:       <alias name='input1'/>
Nov 29 17:54:49 user nova-compute[74613]:     </input>
Nov 29 17:54:49 user nova-compute[74613]:     <graphics type='vnc' port='5907' autoport='yes' listen='0.0.0.0'>
Nov 29 17:54:49 user nova-compute[74613]:       <listen type='address' address='0.0.0.0'/>
Nov 29 17:54:49 user nova-compute[74613]:     </graphics>
Nov 29 17:54:49 user nova-compute[74613]:     <audio id='1' type='none'/>
Nov 29 17:54:49 user nova-compute[74613]:     <video>
Nov 29 17:54:49 user nova-compute[74613]:       <model type='virtio' heads='1' primary='yes'/>
Nov 29 17:54:49 user nova-compute[74613]:       <alias name='video0'/>
Nov 29 17:54:49 user nova-compute[74613]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x0'/>
Nov 29 17:54:49 user nova-compute[74613]:     </video>
Nov 29 17:54:49 user nova-compute[74613]:     <memballoon model='virtio'>
Nov 29 17:54:49 user nova-compute[74613]:       <stats period='10'/>
Nov 29 17:54:49 user nova-compute[74613]:       <alias name='balloon0'/>
Nov 29 17:54:49 user nova-compute[74613]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x05' function='0x0'/>
Nov 29 17:54:49 user nova-compute[74613]:     </memballoon>
Nov 29 17:54:49 user nova-compute[74613]:     <rng model='virtio'>
Nov 29 17:54:49 user nova-compute[74613]:       <backend model='random'>/dev/urandom</backend>
Nov 29 17:54:49 user nova-compute[74613]:       <alias name='rng0'/>
Nov 29 17:54:49 user nova-compute[74613]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x06' function='0x0'/>
Nov 29 17:54:49 user nova-compute[74613]:     </rng>
Nov 29 17:54:49 user nova-compute[74613]:   </devices>
Nov 29 17:54:49 user nova-compute[74613]:   <seclabel type='dynamic' model='apparmor' relabel='yes'>
Nov 29 17:54:49 user nova-compute[74613]:     <label>libvirt-288b8261-8706-4696-879d-d4dd01ab553e</label>
Nov 29 17:54:49 user nova-compute[74613]:     <imagelabel>libvirt-288b8261-8706-4696-879d-d4dd01ab553e</imagelabel>
Nov 29 17:54:49 user nova-compute[74613]:   </seclabel>
Nov 29 17:54:49 user nova-compute[74613]:   <seclabel type='dynamic' model='dac' relabel='yes'>
Nov 29 17:54:49 user nova-compute[74613]:     <label>+64055:+108</label>
Nov 29 17:54:49 user nova-compute[74613]:     <imagelabel>+64055:+108</imagelabel>
Nov 29 17:54:49 user nova-compute[74613]:   </seclabel>
Nov 29 17:54:49 user nova-compute[74613]: </domain>
Nov 29 17:54:49 user nova-compute[74613]:  {{(pid=74613) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:282}}
Nov 29 17:54:49 user nova-compute[74613]: DEBUG nova.virt.libvirt.guest [req-215ab0d4-5d44-4db9-9731-68fe9f9934b6 req-77050a81-b8d6-47b8-a146-2cc6588837a9 service nova] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:3d:db:4e"/><model type="virtio"/><mtu size="1442"/><target dev="tap5984be75-03"/></interface> {{(pid=74613) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Nov 29 17:54:49 user nova-compute[74613]: DEBUG nova.virt.libvirt.guest [req-215ab0d4-5d44-4db9-9731-68fe9f9934b6 req-77050a81-b8d6-47b8-a146-2cc6588837a9 service nova] interface for config: <interface type="ethernet"><mac address="fa:16:3e:3d:db:4e"/><model type="virtio"/><mtu size="1442"/><target dev="tap5984be75-03"/></interface>not found in domain: <domain type='kvm' id='8'>
Nov 29 17:54:49 user nova-compute[74613]:   <name>instance-00000008</name>
Nov 29 17:54:49 user nova-compute[74613]:   <uuid>288b8261-8706-4696-879d-d4dd01ab553e</uuid>
Nov 29 17:54:49 user nova-compute[74613]:   <metadata>
Nov 29 17:54:49 user nova-compute[74613]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1" xmlns:instance="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 29 17:54:49 user nova-compute[74613]:   <nova:package version="0.0.0"/>
Nov 29 17:54:49 user nova-compute[74613]:   <nova:name>tempest-device-tagging-server-697059192</nova:name>
Nov 29 17:54:49 user nova-compute[74613]:   <nova:creationTime>2023-11-29 17:54:48</nova:creationTime>
Nov 29 17:54:49 user nova-compute[74613]:   <nova:flavor name="m1.tiny">
Nov 29 17:54:49 user nova-compute[74613]:     <nova:memory>512</nova:memory>
Nov 29 17:54:49 user nova-compute[74613]:     <nova:disk>1</nova:disk>
Nov 29 17:54:49 user nova-compute[74613]:     <nova:swap>0</nova:swap>
Nov 29 17:54:49 user nova-compute[74613]:     <nova:ephemeral>0</nova:ephemeral>
Nov 29 17:54:49 user nova-compute[74613]:     <nova:vcpus>1</nova:vcpus>
Nov 29 17:54:49 user nova-compute[74613]:   </nova:flavor>
Nov 29 17:54:49 user nova-compute[74613]:   <nova:owner>
Nov 29 17:54:49 user nova-compute[74613]:     <nova:user uuid="52aa43eddf17484b9823bf13f548d22b">tempest-TaggedAttachmentsTest-1438740121-project-member</nova:user>
Nov 29 17:54:49 user nova-compute[74613]:     <nova:project uuid="fdebfa0bb4bf45338ce3fa1ded5cd5bd">tempest-TaggedAttachmentsTest-1438740121</nova:project>
Nov 29 17:54:49 user nova-compute[74613]:   </nova:owner>
Nov 29 17:54:49 user nova-compute[74613]:   <nova:root type="image" uuid="4217f428-8d9d-4ee1-9614-642d26d90c46"/>
Nov 29 17:54:49 user nova-compute[74613]:   <nova:ports>
Nov 29 17:54:49 user nova-compute[74613]:     <nova:port uuid="abe5d419-60cc-474c-935a-60f5512894e0">
Nov 29 17:54:49 user nova-compute[74613]:       <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Nov 29 17:54:49 user nova-compute[74613]:     </nova:port>
Nov 29 17:54:49 user nova-compute[74613]:   </nova:ports>
Nov 29 17:54:49 user nova-compute[74613]: </nova:instance>
Nov 29 17:54:49 user nova-compute[74613]:   </metadata>
Nov 29 17:54:49 user nova-compute[74613]:   <memory unit='KiB'>524288</memory>
Nov 29 17:54:49 user nova-compute[74613]:   <currentMemory unit='KiB'>524288</currentMemory>
Nov 29 17:54:49 user nova-compute[74613]:   <vcpu placement='static'>1</vcpu>
Nov 29 17:54:49 user nova-compute[74613]:   <resource>
Nov 29 17:54:49 user nova-compute[74613]:     <partition>/machine</partition>
Nov 29 17:54:49 user nova-compute[74613]:   </resource>
Nov 29 17:54:49 user nova-compute[74613]:   <sysinfo type='smbios'>
Nov 29 17:54:49 user nova-compute[74613]:     <system>
Nov 29 17:54:49 user nova-compute[74613]:       <entry name='manufacturer'>OpenStack Foundation</entry>
Nov 29 17:54:49 user nova-compute[74613]:       <entry name='product'>OpenStack Nova</entry>
Nov 29 17:54:49 user nova-compute[74613]:       <entry name='version'>0.0.0</entry>
Nov 29 17:54:49 user nova-compute[74613]:       <entry name='serial'>288b8261-8706-4696-879d-d4dd01ab553e</entry>
Nov 29 17:54:49 user nova-compute[74613]:       <entry name='uuid'>288b8261-8706-4696-879d-d4dd01ab553e</entry>
Nov 29 17:54:49 user nova-compute[74613]:       <entry name='family'>Virtual Machine</entry>
Nov 29 17:54:49 user nova-compute[74613]:     </system>
Nov 29 17:54:49 user nova-compute[74613]:   </sysinfo>
Nov 29 17:54:49 user nova-compute[74613]:   <os>
Nov 29 17:54:49 user nova-compute[74613]:     <type arch='x86_64' machine='pc-i440fx-6.2'>hvm</type>
Nov 29 17:54:49 user nova-compute[74613]:     <boot dev='hd'/>
Nov 29 17:54:49 user nova-compute[74613]:     <smbios mode='sysinfo'/>
Nov 29 17:54:49 user nova-compute[74613]:   </os>
Nov 29 17:54:49 user nova-compute[74613]:   <features>
Nov 29 17:54:49 user nova-compute[74613]:     <acpi/>
Nov 29 17:54:49 user nova-compute[74613]:     <apic/>
Nov 29 17:54:49 user nova-compute[74613]:     <vmcoreinfo state='on'/>
Nov 29 17:54:49 user nova-compute[74613]:   </features>
Nov 29 17:54:49 user nova-compute[74613]:   <cpu mode='custom' match='exact' check='full'>
Nov 29 17:54:49 user nova-compute[74613]:     <model fallback='forbid'>Nehalem</model>
Nov 29 17:54:49 user nova-compute[74613]:     <topology sockets='1' dies='1' cores='1' threads='1'/>
Nov 29 17:54:49 user nova-compute[74613]:     <feature policy='require' name='vme'/>
Nov 29 17:54:49 user nova-compute[74613]:     <feature policy='require' name='x2apic'/>
Nov 29 17:54:49 user nova-compute[74613]:     <feature policy='require' name='hypervisor'/>
Nov 29 17:54:49 user nova-compute[74613]:   </cpu>
Nov 29 17:54:49 user nova-compute[74613]:   <clock offset='utc'>
Nov 29 17:54:49 user nova-compute[74613]:     <timer name='pit' tickpolicy='delay'/>
Nov 29 17:54:49 user nova-compute[74613]:     <timer name='rtc' tickpolicy='catchup'/>
Nov 29 17:54:49 user nova-compute[74613]:     <timer name='hpet' present='no'/>
Nov 29 17:54:49 user nova-compute[74613]:   </clock>
Nov 29 17:54:49 user nova-compute[74613]:   <on_poweroff>destroy</on_poweroff>
Nov 29 17:54:49 user nova-compute[74613]:   <on_reboot>restart</on_reboot>
Nov 29 17:54:49 user nova-compute[74613]:   <on_crash>destroy</on_crash>
Nov 29 17:54:49 user nova-compute[74613]:   <devices>
Nov 29 17:54:49 user nova-compute[74613]:     <emulator>/usr/bin/qemu-system-x86_64</emulator>
Nov 29 17:54:49 user nova-compute[74613]:     <disk type='file' device='disk'>
Nov 29 17:54:49 user nova-compute[74613]:       <driver name='qemu' type='qcow2' cache='none'/>
Nov 29 17:54:49 user nova-compute[74613]:       <source file='/opt/stack/data/nova/instances/288b8261-8706-4696-879d-d4dd01ab553e/disk' index='2'/>
Nov 29 17:54:49 user nova-compute[74613]:       <backingStore type='file' index='3'>
Nov 29 17:54:49 user nova-compute[74613]:         <format type='raw'/>
Nov 29 17:54:49 user nova-compute[74613]:         <source file='/opt/stack/data/nova/instances/_base/21faea9e6951f3bdd0153b76ac89fe1a60a34758'/>
Nov 29 17:54:49 user nova-compute[74613]:         <backingStore/>
Nov 29 17:54:49 user nova-compute[74613]:       </backingStore>
Nov 29 17:54:49 user nova-compute[74613]:       <target dev='vda' bus='virtio'/>
Nov 29 17:54:49 user nova-compute[74613]:       <alias name='virtio-disk0'/>
Nov 29 17:54:49 user nova-compute[74613]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x04' function='0x0'/>
Nov 29 17:54:49 user nova-compute[74613]:     </disk>
Nov 29 17:54:49 user nova-compute[74613]:     <disk type='file' device='cdrom'>
Nov 29 17:54:49 user nova-compute[74613]:       <driver name='qemu' type='raw' cache='none'/>
Nov 29 17:54:49 user nova-compute[74613]:       <source file='/opt/stack/data/nova/instances/288b8261-8706-4696-879d-d4dd01ab553e/disk.config' index='1'/>
Nov 29 17:54:49 user nova-compute[74613]:       <backingStore/>
Nov 29 17:54:49 user nova-compute[74613]:       <target dev='hda' bus='ide'/>
Nov 29 17:54:49 user nova-compute[74613]:       <readonly/>
Nov 29 17:54:49 user nova-compute[74613]:       <alias name='ide0-0-0'/>
Nov 29 17:54:49 user nova-compute[74613]:       <address type='drive' controller='0' bus='0' target='0' unit='0'/>
Nov 29 17:54:49 user nova-compute[74613]:     </disk>
Nov 29 17:54:49 user nova-compute[74613]:     <controller type='usb' index='0' model='none'>
Nov 29 17:54:49 user nova-compute[74613]:       <alias name='usb'/>
Nov 29 17:54:49 user nova-compute[74613]:     </controller>
Nov 29 17:54:49 user nova-compute[74613]:     <controller type='pci' index='0' model='pci-root'>
Nov 29 17:54:49 user nova-compute[74613]:       <alias name='pci.0'/>
Nov 29 17:54:49 user nova-compute[74613]:     </controller>
Nov 29 17:54:49 user nova-compute[74613]:     <controller type='ide' index='0'>
Nov 29 17:54:49 user nova-compute[74613]:       <alias name='ide'/>
Nov 29 17:54:49 user nova-compute[74613]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x1'/>
Nov 29 17:54:49 user nova-compute[74613]:     </controller>
Nov 29 17:54:49 user nova-compute[74613]:     <interface type='ethernet'>
Nov 29 17:54:49 user nova-compute[74613]:       <mac address='fa:16:3e:14:7b:54'/>
Nov 29 17:54:49 user nova-compute[74613]:       <target dev='tapabe5d419-60'/>
Nov 29 17:54:49 user nova-compute[74613]:       <model type='virtio'/>
Nov 29 17:54:49 user nova-compute[74613]:       <mtu size='1442'/>
Nov 29 17:54:49 user nova-compute[74613]:       <alias name='net0'/>
Nov 29 17:54:49 user nova-compute[74613]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x03' function='0x0'/>
Nov 29 17:54:49 user nova-compute[74613]:     </interface>
Nov 29 17:54:49 user nova-compute[74613]:     <serial type='pty'>
Nov 29 17:54:49 user nova-compute[74613]:       <source path='/dev/pts/7'/>
Nov 29 17:54:49 user nova-compute[74613]:       <log file='/opt/stack/data/nova/instances/288b8261-8706-4696-879d-d4dd01ab553e/console.log' append='off'/>
Nov 29 17:54:49 user nova-compute[74613]:       <target type='isa-serial' port='0'>
Nov 29 17:54:49 user nova-compute[74613]:         <model name='isa-serial'/>
Nov 29 17:54:49 user nova-compute[74613]:       </target>
Nov 29 17:54:49 user nova-compute[74613]:       <alias name='serial0'/>
Nov 29 17:54:49 user nova-compute[74613]:     </serial>
Nov 29 17:54:49 user nova-compute[74613]:     <console type='pty' tty='/dev/pts/7'>
Nov 29 17:54:49 user nova-compute[74613]:       <source path='/dev/pts/7'/>
Nov 29 17:54:49 user nova-compute[74613]:       <log file='/opt/stack/data/nova/instances/288b8261-8706-4696-879d-d4dd01ab553e/console.log' append='off'/>
Nov 29 17:54:49 user nova-compute[74613]:       <target type='serial' port='0'/>
Nov 29 17:54:49 user nova-compute[74613]:       <alias name='serial0'/>
Nov 29 17:54:49 user nova-compute[74613]:     </console>
Nov 29 17:54:49 user nova-compute[74613]:     <input type='mouse' bus='ps2'>
Nov 29 17:54:49 user nova-compute[74613]:       <alias name='input0'/>
Nov 29 17:54:49 user nova-compute[74613]:     </input>
Nov 29 17:54:49 user nova-compute[74613]:     <input type='keyboard' bus='ps2'>
Nov 29 17:54:49 user nova-compute[74613]:       <alias name='input1'/>
Nov 29 17:54:49 user nova-compute[74613]:     </input>
Nov 29 17:54:49 user nova-compute[74613]:     <graphics type='vnc' port='5907' autoport='yes' listen='0.0.0.0'>
Nov 29 17:54:49 user nova-compute[74613]:       <listen type='address' address='0.0.0.0'/>
Nov 29 17:54:49 user nova-compute[74613]:     </graphics>
Nov 29 17:54:49 user nova-compute[74613]:     <audio id='1' type='none'/>
Nov 29 17:54:49 user nova-compute[74613]:     <video>
Nov 29 17:54:49 user nova-compute[74613]:       <model type='virtio' heads='1' primary='yes'/>
Nov 29 17:54:49 user nova-compute[74613]:       <alias name='video0'/>
Nov 29 17:54:49 user nova-compute[74613]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x0'/>
Nov 29 17:54:49 user nova-compute[74613]:     </video>
Nov 29 17:54:49 user nova-compute[74613]:     <memballoon model='virtio'>
Nov 29 17:54:49 user nova-compute[74613]:       <stats period='10'/>
Nov 29 17:54:49 user nova-compute[74613]:       <alias name='balloon0'/>
Nov 29 17:54:49 user nova-compute[74613]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x05' function='0x0'/>
Nov 29 17:54:49 user nova-compute[74613]:     </memballoon>
Nov 29 17:54:49 user nova-compute[74613]:     <rng model='virtio'>
Nov 29 17:54:49 user nova-compute[74613]:       <backend model='random'>/dev/urandom</backend>
Nov 29 17:54:49 user nova-compute[74613]:       <alias name='rng0'/>
Nov 29 17:54:49 user nova-compute[74613]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x06' function='0x0'/>
Nov 29 17:54:49 user nova-compute[74613]:     </rng>
Nov 29 17:54:49 user nova-compute[74613]:   </devices>
Nov 29 17:54:49 user nova-compute[74613]:   <seclabel type='dynamic' model='apparmor' relabel='yes'>
Nov 29 17:54:49 user nova-compute[74613]:     <label>libvirt-288b8261-8706-4696-879d-d4dd01ab553e</label>
Nov 29 17:54:49 user nova-compute[74613]:     <imagelabel>libvirt-288b8261-8706-4696-879d-d4dd01ab553e</imagelabel>
Nov 29 17:54:49 user nova-compute[74613]:   </seclabel>
Nov 29 17:54:49 user nova-compute[74613]:   <seclabel type='dynamic' model='dac' relabel='yes'>
Nov 29 17:54:49 user nova-compute[74613]:     <label>+64055:+108</label>
Nov 29 17:54:49 user nova-compute[74613]:     <imagelabel>+64055:+108</imagelabel>
Nov 29 17:54:49 user nova-compute[74613]:   </seclabel>
Nov 29 17:54:49 user nova-compute[74613]: </domain>
Nov 29 17:54:49 user nova-compute[74613]:  {{(pid=74613) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:282}}
Nov 29 17:54:49 user nova-compute[74613]: WARNING nova.virt.libvirt.driver [req-215ab0d4-5d44-4db9-9731-68fe9f9934b6 req-77050a81-b8d6-47b8-a146-2cc6588837a9 service nova] [instance: 288b8261-8706-4696-879d-d4dd01ab553e] Detaching interface fa:16:3e:3d:db:4e failed because the device is no longer found on the guest.: nova.exception.DeviceNotFound: Device 'tap5984be75-03' not found.
Nov 29 17:54:49 user nova-compute[74613]: DEBUG nova.virt.libvirt.vif [req-215ab0d4-5d44-4db9-9731-68fe9f9934b6 req-77050a81-b8d6-47b8-a146-2cc6588837a9 service nova] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-29T17:51:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-697059192',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-697059192',id=8,image_ref='4217f428-8d9d-4ee1-9614-642d26d90c46',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFUFE7U0lYNK45/HsStCT3AXLpdrJnwoY/KNgsNZxe8b6bxv4jkHRb2DHfVVdKmIkJ56BYNQ81Tfxi8bOx3gLzOij7zz7pkeTvdmFF3bs2gbkvzpJfe42Gy5jL3poiHfSw==',key_name='tempest-keypair-587676949',keypairs=<?>,launch_index=0,launched_at=2023-11-29T17:52:07Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata=<?>,migration_context=None,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='fdebfa0bb4bf45338ce3fa1ded5cd5bd',ramdisk_id='',reservation_id='r-cg74z5d5',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='4217f428-8d9d-4ee1-9614-642d26d90c46',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-1438740121',owner_user_name='tempest-TaggedAttachmentsTest-1438740121-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-11-29T17:52:07Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='52aa43eddf17484b9823bf13f548d22b',uuid=288b8261-8706-4696-879d-d4dd01ab553e,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "5984be75-0336-4f84-a5f3-52f4e3fbeaa3", "address": "fa:16:3e:3d:db:4e", "network": {"id": "e3b3f364-2bb0-4376-b571-7fa6432b4455", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1115785953", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.185", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "fdebfa0bb4bf45338ce3fa1ded5cd5bd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5984be75-03", "ovs_interfaceid": "5984be75-0336-4f84-a5f3-52f4e3fbeaa3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74613) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 29 17:54:49 user nova-compute[74613]: DEBUG nova.network.os_vif_util [req-215ab0d4-5d44-4db9-9731-68fe9f9934b6 req-77050a81-b8d6-47b8-a146-2cc6588837a9 service nova] Converting VIF {"id": "5984be75-0336-4f84-a5f3-52f4e3fbeaa3", "address": "fa:16:3e:3d:db:4e", "network": {"id": "e3b3f364-2bb0-4376-b571-7fa6432b4455", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1115785953", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.185", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "fdebfa0bb4bf45338ce3fa1ded5cd5bd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5984be75-03", "ovs_interfaceid": "5984be75-0336-4f84-a5f3-52f4e3fbeaa3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74613) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 17:54:49 user nova-compute[74613]: DEBUG nova.network.os_vif_util [req-215ab0d4-5d44-4db9-9731-68fe9f9934b6 req-77050a81-b8d6-47b8-a146-2cc6588837a9 service nova] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:3d:db:4e,bridge_name='br-int',has_traffic_filtering=True,id=5984be75-0336-4f84-a5f3-52f4e3fbeaa3,network=Network(e3b3f364-2bb0-4376-b571-7fa6432b4455),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5984be75-03') {{(pid=74613) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 17:54:49 user nova-compute[74613]: DEBUG os_vif [req-215ab0d4-5d44-4db9-9731-68fe9f9934b6 req-77050a81-b8d6-47b8-a146-2cc6588837a9 service nova] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:3d:db:4e,bridge_name='br-int',has_traffic_filtering=True,id=5984be75-0336-4f84-a5f3-52f4e3fbeaa3,network=Network(e3b3f364-2bb0-4376-b571-7fa6432b4455),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5984be75-03') {{(pid=74613) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 29 17:54:49 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:54:49 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap5984be75-03, bridge=br-int, if_exists=True) {{(pid=74613) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 17:54:49 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74613) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 29 17:54:49 user nova-compute[74613]: INFO os_vif [req-215ab0d4-5d44-4db9-9731-68fe9f9934b6 req-77050a81-b8d6-47b8-a146-2cc6588837a9 service nova] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:3d:db:4e,bridge_name='br-int',has_traffic_filtering=True,id=5984be75-0336-4f84-a5f3-52f4e3fbeaa3,network=Network(e3b3f364-2bb0-4376-b571-7fa6432b4455),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5984be75-03')
Nov 29 17:54:49 user nova-compute[74613]: DEBUG nova.virt.libvirt.guest [req-215ab0d4-5d44-4db9-9731-68fe9f9934b6 req-77050a81-b8d6-47b8-a146-2cc6588837a9 service nova] set metadata xml: <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 29 17:54:49 user nova-compute[74613]:   <nova:package version="0.0.0"/>
Nov 29 17:54:49 user nova-compute[74613]:   <nova:name>tempest-device-tagging-server-697059192</nova:name>
Nov 29 17:54:49 user nova-compute[74613]:   <nova:creationTime>2023-11-29 17:54:49</nova:creationTime>
Nov 29 17:54:49 user nova-compute[74613]:   <nova:flavor name="m1.tiny">
Nov 29 17:54:49 user nova-compute[74613]:     <nova:memory>512</nova:memory>
Nov 29 17:54:49 user nova-compute[74613]:     <nova:disk>1</nova:disk>
Nov 29 17:54:49 user nova-compute[74613]:     <nova:swap>0</nova:swap>
Nov 29 17:54:49 user nova-compute[74613]:     <nova:ephemeral>0</nova:ephemeral>
Nov 29 17:54:49 user nova-compute[74613]:     <nova:vcpus>1</nova:vcpus>
Nov 29 17:54:49 user nova-compute[74613]:   </nova:flavor>
Nov 29 17:54:49 user nova-compute[74613]:   <nova:owner>
Nov 29 17:54:49 user nova-compute[74613]:     <nova:user uuid="52aa43eddf17484b9823bf13f548d22b">tempest-TaggedAttachmentsTest-1438740121-project-member</nova:user>
Nov 29 17:54:49 user nova-compute[74613]:     <nova:project uuid="fdebfa0bb4bf45338ce3fa1ded5cd5bd">tempest-TaggedAttachmentsTest-1438740121</nova:project>
Nov 29 17:54:49 user nova-compute[74613]:   </nova:owner>
Nov 29 17:54:49 user nova-compute[74613]:   <nova:root type="image" uuid="4217f428-8d9d-4ee1-9614-642d26d90c46"/>
Nov 29 17:54:49 user nova-compute[74613]:   <nova:ports>
Nov 29 17:54:49 user nova-compute[74613]:     <nova:port uuid="abe5d419-60cc-474c-935a-60f5512894e0">
Nov 29 17:54:49 user nova-compute[74613]:       <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Nov 29 17:54:49 user nova-compute[74613]:     </nova:port>
Nov 29 17:54:49 user nova-compute[74613]:   </nova:ports>
Nov 29 17:54:49 user nova-compute[74613]: </nova:instance>
Nov 29 17:54:49 user nova-compute[74613]:  {{(pid=74613) set_metadata /opt/stack/nova/nova/virt/libvirt/guest.py:359}}
Nov 29 17:54:49 user nova-compute[74613]: DEBUG nova.network.neutron [None req-671f7534-dbe3-42a5-a209-31786ddcb369 tempest-TaggedAttachmentsTest-1438740121 tempest-TaggedAttachmentsTest-1438740121-project-member] [instance: 288b8261-8706-4696-879d-d4dd01ab553e] Updating instance_info_cache with network_info: [{"id": "abe5d419-60cc-474c-935a-60f5512894e0", "address": "fa:16:3e:14:7b:54", "network": {"id": "3a1d6151-a950-475c-af8a-d15174f89822", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1729826224-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.29", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fdebfa0bb4bf45338ce3fa1ded5cd5bd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapabe5d419-60", "ovs_interfaceid": "abe5d419-60cc-474c-935a-60f5512894e0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74613) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 17:54:49 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-671f7534-dbe3-42a5-a209-31786ddcb369 tempest-TaggedAttachmentsTest-1438740121 tempest-TaggedAttachmentsTest-1438740121-project-member] Releasing lock "refresh_cache-288b8261-8706-4696-879d-d4dd01ab553e" {{(pid=74613) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 17:54:49 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-671f7534-dbe3-42a5-a209-31786ddcb369 tempest-TaggedAttachmentsTest-1438740121 tempest-TaggedAttachmentsTest-1438740121-project-member] Lock "interface-288b8261-8706-4696-879d-d4dd01ab553e-5984be75-0336-4f84-a5f3-52f4e3fbeaa3" "released" by "nova.compute.manager.ComputeManager.detach_interface.<locals>.do_detach_interface" :: held 21.438s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 17:54:52 user nova-compute[74613]: WARNING nova.virt.libvirt.driver [None req-5aac8e71-77b4-4ab8-9d58-8a4bde4c7c35 tempest-TestVolumeSwap-281539251 tempest-TestVolumeSwap-281539251-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 0008521b-5a63-4ff6-8390-d343956900ed is timed out.
Nov 29 17:54:52 user nova-compute[74613]: INFO nova.virt.libvirt.driver [None req-5aac8e71-77b4-4ab8-9d58-8a4bde4c7c35 tempest-TestVolumeSwap-281539251 tempest-TestVolumeSwap-281539251-project-member] Successfully detached device vdb from instance 0008521b-5a63-4ff6-8390-d343956900ed from the live domain config.
Nov 29 17:54:52 user nova-compute[74613]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5aac8e71-77b4-4ab8-9d58-8a4bde4c7c35 tempest-TestVolumeSwap-281539251 tempest-TestVolumeSwap-281539251-project-member] [instance: 0008521b-5a63-4ff6-8390-d343956900ed] calling os-brick to detach iSCSI Volume {{(pid=74613) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 29 17:54:52 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-5aac8e71-77b4-4ab8-9d58-8a4bde4c7c35 tempest-TestVolumeSwap-281539251 tempest-TestVolumeSwap-281539251-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff828156890>, {'target_iqn': 'iqn.2010-10.org.openstack:a6b34bdb-5c08-4f7c-b3f5-6b68413947a8', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'SAqnwafp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf', 'volume_id': 'a6b34bdb-5c08-4f7c-b3f5-6b68413947a8'}, None), 'kwargs': False}}" {{(pid=74613) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 17:54:52 user nova-compute[74613]: WARNING os_brick.initiator.connectors.base [None req-5aac8e71-77b4-4ab8-9d58-8a4bde4c7c35 tempest-TestVolumeSwap-281539251 tempest-TestVolumeSwap-281539251-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 17:54:52 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.base [None req-5aac8e71-77b4-4ab8-9d58-8a4bde4c7c35 tempest-TestVolumeSwap-281539251 tempest-TestVolumeSwap-281539251-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 17:54:52 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.base [None req-5aac8e71-77b4-4ab8-9d58-8a4bde4c7c35 tempest-TestVolumeSwap-281539251 tempest-TestVolumeSwap-281539251-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 17:54:52 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 17:54:52 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 17:54:52 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[db41ef8c-bf79-42f4-8184-480e5d8a4250]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:9511387c-8772-40f2-bf2d-6b6387649e9f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a6b34bdb-5c08-4f7c-b3f5-6b68413947a8\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 17:54:52 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-5aac8e71-77b4-4ab8-9d58-8a4bde4c7c35 tempest-TestVolumeSwap-281539251 tempest-TestVolumeSwap-281539251-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 29 17:54:52 user nova-compute[74613]: No targets found.
Nov 29 17:54:52 user nova-compute[74613]: iSNS:
Nov 29 17:54:52 user nova-compute[74613]: No targets found.
Nov 29 17:54:52 user nova-compute[74613]: STATIC:
Nov 29 17:54:52 user nova-compute[74613]: Target: iqn.2010-10.org.openstack:9511387c-8772-40f2-bf2d-6b6387649e9f
Nov 29 17:54:52 user nova-compute[74613]:         Portal: 172.16.0.220:3260,-1
Nov 29 17:54:52 user nova-compute[74613]:                 Iface Name: default
Nov 29 17:54:52 user nova-compute[74613]: Target: iqn.2010-10.org.openstack:a6b34bdb-5c08-4f7c-b3f5-6b68413947a8
Nov 29 17:54:52 user nova-compute[74613]:         Portal: 172.16.0.220:3260,-1
Nov 29 17:54:52 user nova-compute[74613]:                 Iface Name: default
Nov 29 17:54:52 user nova-compute[74613]: FIRMWARE:
Nov 29 17:54:52 user nova-compute[74613]: No targets found.
Nov 29 17:54:52 user nova-compute[74613]:  stderr= {{(pid=74613) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 17:54:52 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-5aac8e71-77b4-4ab8-9d58-8a4bde4c7c35 tempest-TestVolumeSwap-281539251 tempest-TestVolumeSwap-281539251-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 29 17:54:52 user nova-compute[74613]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 29 17:54:52 user nova-compute[74613]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74613) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 29 17:54:52 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-5aac8e71-77b4-4ab8-9d58-8a4bde4c7c35 tempest-TestVolumeSwap-281539251 tempest-TestVolumeSwap-281539251-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a6b34bdb-5c08-4f7c-b3f5-6b68413947a8', 0)] {{(pid=74613) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 29 17:54:52 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 17:54:52 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 17:54:52 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a4ed6ea-2085-45d6-845e-9ff2cff35d21]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9511387c-8772-40f2-bf2d-6b6387649e9f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a6b34bdb-5c08-4f7c-b3f5-6b68413947a8\n', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 17:54:52 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 17:54:52 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 17:54:52 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6aadc3b-c242-4b7a-b13b-77839d6d06f7]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a6b34bdb-5c08-4f7c-b3f5-6b68413947a8 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9511387c-8772-40f2-bf2d-6b6387649e9f (non-flash)\n', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 17:54:52 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-5aac8e71-77b4-4ab8-9d58-8a4bde4c7c35 tempest-TestVolumeSwap-281539251 tempest-TestVolumeSwap-281539251-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a6b34bdb-5c08-4f7c-b3f5-6b68413947a8 (non-flash)
Nov 29 17:54:52 user nova-compute[74613]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9511387c-8772-40f2-bf2d-6b6387649e9f (non-flash)
Nov 29 17:54:52 user nova-compute[74613]:  stderr= {{(pid=74613) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 17:54:52 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-5aac8e71-77b4-4ab8-9d58-8a4bde4c7c35 tempest-TestVolumeSwap-281539251 tempest-TestVolumeSwap-281539251-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a6b34bdb-5c08-4f7c-b3f5-6b68413947a8 (non-flash)
Nov 29 17:54:52 user nova-compute[74613]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9511387c-8772-40f2-bf2d-6b6387649e9f (non-flash)
Nov 29 17:54:52 user nova-compute[74613]:  stderr= {{(pid=74613) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 17:54:52 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-5aac8e71-77b4-4ab8-9d58-8a4bde4c7c35 tempest-TestVolumeSwap-281539251 tempest-TestVolumeSwap-281539251-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7ff8182e3f40>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a6b34bdb-5c08-4f7c-b3f5-6b68413947a8'): ({'sdf'}, set())}) {{(pid=74613) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 29 17:54:52 user nova-compute[74613]: DEBUG os_brick.initiator.linuxscsi [None req-5aac8e71-77b4-4ab8-9d58-8a4bde4c7c35 tempest-TestVolumeSwap-281539251 tempest-TestVolumeSwap-281539251-project-member] Removing single pathed devices sdf {{(pid=74613) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 29 17:54:52 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 17:54:52 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 17:54:52 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e9479a6-507e-459f-814c-1efbdf3d83ba]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 17:54:52 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 17:54:52 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.017s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 17:54:52 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b00b8a1-6233-46f1-a3c3-4c43fd06ab93]: (4, ('ok\n', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 17:54:52 user nova-compute[74613]: DEBUG os_brick.initiator.linuxscsi [None req-5aac8e71-77b4-4ab8-9d58-8a4bde4c7c35 tempest-TestVolumeSwap-281539251 tempest-TestVolumeSwap-281539251-project-member] Flushing IO for device /dev/sdf {{(pid=74613) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 29 17:54:52 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 17:54:52 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.013s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 17:54:52 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[29876c3f-dc2e-4d2a-991c-49284ddd364a]: (4, ('', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 17:54:52 user nova-compute[74613]: DEBUG os_brick.initiator.linuxscsi [None req-5aac8e71-77b4-4ab8-9d58-8a4bde4c7c35 tempest-TestVolumeSwap-281539251 tempest-TestVolumeSwap-281539251-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=74613) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 29 17:54:52 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 17:54:52 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.031s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 17:54:52 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[92dcf1a3-43d8-475a-b97b-f550d6a7cca7]: (4, ('1', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 17:54:52 user nova-compute[74613]: DEBUG os_brick.initiator.linuxscsi [None req-5aac8e71-77b4-4ab8-9d58-8a4bde4c7c35 tempest-TestVolumeSwap-281539251 tempest-TestVolumeSwap-281539251-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=74613) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 29 17:54:52 user nova-compute[74613]: DEBUG os_brick.initiator.linuxscsi [None req-5aac8e71-77b4-4ab8-9d58-8a4bde4c7c35 tempest-TestVolumeSwap-281539251 tempest-TestVolumeSwap-281539251-project-member] SCSI volumes sdf have been removed. {{(pid=74613) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 29 17:54:52 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-5aac8e71-77b4-4ab8-9d58-8a4bde4c7c35 tempest-TestVolumeSwap-281539251 tempest-TestVolumeSwap-281539251-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a6b34bdb-5c08-4f7c-b3f5-6b68413947a8')] {{(pid=74613) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 29 17:54:52 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a6b34bdb-5c08-4f7c-b3f5-6b68413947a8 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 17:54:52 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a6b34bdb-5c08-4f7c-b3f5-6b68413947a8 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.023s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 17:54:52 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[432992dd-3626-4471-a9c5-71a77bede834]: (4, ('', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 17:54:52 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-5aac8e71-77b4-4ab8-9d58-8a4bde4c7c35 tempest-TestVolumeSwap-281539251 tempest-TestVolumeSwap-281539251-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74613) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 17:54:52 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a6b34bdb-5c08-4f7c-b3f5-6b68413947a8 -p 172.16.0.220:3260 --logout {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 17:54:52 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a6b34bdb-5c08-4f7c-b3f5-6b68413947a8 -p 172.16.0.220:3260 --logout" returned: 0 in 0.072s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 17:54:52 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[701139a0-3d0b-45a1-9082-86b2a275f305]: (4, ('Logging out of session [sid: 13, target: iqn.2010-10.org.openstack:a6b34bdb-5c08-4f7c-b3f5-6b68413947a8, portal: 172.16.0.220,3260]\nLogout of [sid: 13, target: iqn.2010-10.org.openstack:a6b34bdb-5c08-4f7c-b3f5-6b68413947a8, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 17:54:52 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-5aac8e71-77b4-4ab8-9d58-8a4bde4c7c35 tempest-TestVolumeSwap-281539251 tempest-TestVolumeSwap-281539251-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 13, target: iqn.2010-10.org.openstack:a6b34bdb-5c08-4f7c-b3f5-6b68413947a8, portal: 172.16.0.220,3260]
Nov 29 17:54:52 user nova-compute[74613]: Logout of [sid: 13, target: iqn.2010-10.org.openstack:a6b34bdb-5c08-4f7c-b3f5-6b68413947a8, portal: 172.16.0.220,3260] successful.
Nov 29 17:54:52 user nova-compute[74613]:  stderr= {{(pid=74613) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 17:54:52 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a6b34bdb-5c08-4f7c-b3f5-6b68413947a8 -p 172.16.0.220:3260 --op delete {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 17:54:52 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a6b34bdb-5c08-4f7c-b3f5-6b68413947a8 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.020s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 17:54:52 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a4e372d-d03e-42af-b763-6bb13fc270ee]: (4, ('', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 17:54:52 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-5aac8e71-77b4-4ab8-9d58-8a4bde4c7c35 tempest-TestVolumeSwap-281539251 tempest-TestVolumeSwap-281539251-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74613) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 17:54:52 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.base [None req-5aac8e71-77b4-4ab8-9d58-8a4bde4c7c35 tempest-TestVolumeSwap-281539251 tempest-TestVolumeSwap-281539251-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.300s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 17:54:52 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-5aac8e71-77b4-4ab8-9d58-8a4bde4c7c35 tempest-TestVolumeSwap-281539251 tempest-TestVolumeSwap-281539251-project-member] <== disconnect_volume: return (300ms) None {{(pid=74613) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 17:54:52 user nova-compute[74613]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5aac8e71-77b4-4ab8-9d58-8a4bde4c7c35 tempest-TestVolumeSwap-281539251 tempest-TestVolumeSwap-281539251-project-member] [instance: 0008521b-5a63-4ff6-8390-d343956900ed] Disconnected iSCSI Volume {{(pid=74613) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 29 17:54:53 user nova-compute[74613]: DEBUG nova.objects.instance [None req-5aac8e71-77b4-4ab8-9d58-8a4bde4c7c35 tempest-TestVolumeSwap-281539251 tempest-TestVolumeSwap-281539251-project-member] Lazy-loading 'flavor' on Instance uuid 0008521b-5a63-4ff6-8390-d343956900ed {{(pid=74613) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 17:54:53 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-5aac8e71-77b4-4ab8-9d58-8a4bde4c7c35 tempest-TestVolumeSwap-281539251 tempest-TestVolumeSwap-281539251-project-member] Lock "0008521b-5a63-4ff6-8390-d343956900ed" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.735s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 17:54:53 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:54:54 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-6bc176d9-db4e-4224-90ce-46fa075027ac tempest-VolumesAssistedSnapshotsTest-616484375 tempest-VolumesAssistedSnapshotsTest-616484375-project-member] Acquiring lock "d4ecef60-62f9-4969-b57f-3bb45a44cc9f" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 17:54:54 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-6bc176d9-db4e-4224-90ce-46fa075027ac tempest-VolumesAssistedSnapshotsTest-616484375 tempest-VolumesAssistedSnapshotsTest-616484375-project-member] Lock "d4ecef60-62f9-4969-b57f-3bb45a44cc9f" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 17:54:54 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-6bc176d9-db4e-4224-90ce-46fa075027ac tempest-VolumesAssistedSnapshotsTest-616484375 tempest-VolumesAssistedSnapshotsTest-616484375-project-member] Acquiring lock "d4ecef60-62f9-4969-b57f-3bb45a44cc9f-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 17:54:54 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-6bc176d9-db4e-4224-90ce-46fa075027ac tempest-VolumesAssistedSnapshotsTest-616484375 tempest-VolumesAssistedSnapshotsTest-616484375-project-member] Lock "d4ecef60-62f9-4969-b57f-3bb45a44cc9f-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 17:54:54 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-6bc176d9-db4e-4224-90ce-46fa075027ac tempest-VolumesAssistedSnapshotsTest-616484375 tempest-VolumesAssistedSnapshotsTest-616484375-project-member] Lock "d4ecef60-62f9-4969-b57f-3bb45a44cc9f-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 17:54:54 user nova-compute[74613]: INFO nova.compute.manager [None req-6bc176d9-db4e-4224-90ce-46fa075027ac tempest-VolumesAssistedSnapshotsTest-616484375 tempest-VolumesAssistedSnapshotsTest-616484375-project-member] [instance: d4ecef60-62f9-4969-b57f-3bb45a44cc9f] Terminating instance
Nov 29 17:54:54 user nova-compute[74613]: DEBUG nova.compute.manager [None req-6bc176d9-db4e-4224-90ce-46fa075027ac tempest-VolumesAssistedSnapshotsTest-616484375 tempest-VolumesAssistedSnapshotsTest-616484375-project-member] [instance: d4ecef60-62f9-4969-b57f-3bb45a44cc9f] Start destroying the instance on the hypervisor. {{(pid=74613) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 29 17:54:55 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:54:55 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:54:55 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:54:55 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:54:55 user nova-compute[74613]: DEBUG nova.compute.manager [req-c1dac35b-7ceb-4594-a6bc-3cf5da0cfe32 req-7a28831f-41ae-44ec-b7fb-c7b53bcb70f4 service nova] [instance: d4ecef60-62f9-4969-b57f-3bb45a44cc9f] Received event network-vif-unplugged-292029d6-b062-4cdc-8c09-c92693cac658 {{(pid=74613) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 17:54:55 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-c1dac35b-7ceb-4594-a6bc-3cf5da0cfe32 req-7a28831f-41ae-44ec-b7fb-c7b53bcb70f4 service nova] Acquiring lock "d4ecef60-62f9-4969-b57f-3bb45a44cc9f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 17:54:55 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-c1dac35b-7ceb-4594-a6bc-3cf5da0cfe32 req-7a28831f-41ae-44ec-b7fb-c7b53bcb70f4 service nova] Lock "d4ecef60-62f9-4969-b57f-3bb45a44cc9f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 17:54:55 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-c1dac35b-7ceb-4594-a6bc-3cf5da0cfe32 req-7a28831f-41ae-44ec-b7fb-c7b53bcb70f4 service nova] Lock "d4ecef60-62f9-4969-b57f-3bb45a44cc9f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 17:54:55 user nova-compute[74613]: DEBUG nova.compute.manager [req-c1dac35b-7ceb-4594-a6bc-3cf5da0cfe32 req-7a28831f-41ae-44ec-b7fb-c7b53bcb70f4 service nova] [instance: d4ecef60-62f9-4969-b57f-3bb45a44cc9f] No waiting events found dispatching network-vif-unplugged-292029d6-b062-4cdc-8c09-c92693cac658 {{(pid=74613) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 17:54:55 user nova-compute[74613]: DEBUG nova.compute.manager [req-c1dac35b-7ceb-4594-a6bc-3cf5da0cfe32 req-7a28831f-41ae-44ec-b7fb-c7b53bcb70f4 service nova] [instance: d4ecef60-62f9-4969-b57f-3bb45a44cc9f] Received event network-vif-unplugged-292029d6-b062-4cdc-8c09-c92693cac658 for instance with task_state deleting. {{(pid=74613) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 29 17:54:55 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:54:55 user nova-compute[74613]: INFO nova.virt.libvirt.driver [-] [instance: d4ecef60-62f9-4969-b57f-3bb45a44cc9f] Instance destroyed successfully.
Nov 29 17:54:55 user nova-compute[74613]: DEBUG nova.objects.instance [None req-6bc176d9-db4e-4224-90ce-46fa075027ac tempest-VolumesAssistedSnapshotsTest-616484375 tempest-VolumesAssistedSnapshotsTest-616484375-project-member] Lazy-loading 'resources' on Instance uuid d4ecef60-62f9-4969-b57f-3bb45a44cc9f {{(pid=74613) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 17:54:56 user nova-compute[74613]: DEBUG nova.virt.libvirt.vif [None req-6bc176d9-db4e-4224-90ce-46fa075027ac tempest-VolumesAssistedSnapshotsTest-616484375 tempest-VolumesAssistedSnapshotsTest-616484375-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T17:51:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesAssistedSnapshotsTest-server-566809274',display_name='tempest-VolumesAssistedSnapshotsTest-server-566809274',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesassistedsnapshotstest-server-566809274',id=9,image_ref='4217f428-8d9d-4ee1-9614-642d26d90c46',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGqz6XROenUx3qQ8c2wjczUYDD8SPR5dk/9dNMybAm8csJc//z+dpa2N3K2dk+tRO0hnwjqUL/gm8XfiYIEdUQHCOpEcfW6ssTF3vUBJtxGuqzGHJKmBRH65HQL41kvUiA==',key_name='tempest-keypair-1821142204',keypairs=<?>,launch_index=0,launched_at=2023-11-29T17:52:07Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='6469439fcd88494f85d31126651f3027',ramdisk_id='',reservation_id='r-s969n20y',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='4217f428-8d9d-4ee1-9614-642d26d90c46',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesAssistedSnapshotsTest-616484375',owner_user_name='tempest-VolumesAssistedSnapshotsTest-616484375-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-29T17:52:08Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='86cabe02b8334bc8b693f0337a602b01',uuid=d4ecef60-62f9-4969-b57f-3bb45a44cc9f,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "292029d6-b062-4cdc-8c09-c92693cac658", "address": "fa:16:3e:a5:be:95", "network": {"id": "3be4f180-3b53-4069-9ab2-94b1a948986b", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-170006881-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.110", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6469439fcd88494f85d31126651f3027", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap292029d6-b0", "ovs_interfaceid": "292029d6-b062-4cdc-8c09-c92693cac658", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74613) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 29 17:54:56 user nova-compute[74613]: DEBUG nova.network.os_vif_util [None req-6bc176d9-db4e-4224-90ce-46fa075027ac tempest-VolumesAssistedSnapshotsTest-616484375 tempest-VolumesAssistedSnapshotsTest-616484375-project-member] Converting VIF {"id": "292029d6-b062-4cdc-8c09-c92693cac658", "address": "fa:16:3e:a5:be:95", "network": {"id": "3be4f180-3b53-4069-9ab2-94b1a948986b", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-170006881-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.110", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6469439fcd88494f85d31126651f3027", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap292029d6-b0", "ovs_interfaceid": "292029d6-b062-4cdc-8c09-c92693cac658", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74613) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 17:54:56 user nova-compute[74613]: DEBUG nova.network.os_vif_util [None req-6bc176d9-db4e-4224-90ce-46fa075027ac tempest-VolumesAssistedSnapshotsTest-616484375 tempest-VolumesAssistedSnapshotsTest-616484375-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:a5:be:95,bridge_name='br-int',has_traffic_filtering=True,id=292029d6-b062-4cdc-8c09-c92693cac658,network=Network(3be4f180-3b53-4069-9ab2-94b1a948986b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap292029d6-b0') {{(pid=74613) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 17:54:56 user nova-compute[74613]: DEBUG os_vif [None req-6bc176d9-db4e-4224-90ce-46fa075027ac tempest-VolumesAssistedSnapshotsTest-616484375 tempest-VolumesAssistedSnapshotsTest-616484375-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:a5:be:95,bridge_name='br-int',has_traffic_filtering=True,id=292029d6-b062-4cdc-8c09-c92693cac658,network=Network(3be4f180-3b53-4069-9ab2-94b1a948986b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap292029d6-b0') {{(pid=74613) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 29 17:54:56 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:54:56 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap292029d6-b0, bridge=br-int, if_exists=True) {{(pid=74613) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 17:54:56 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:54:56 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 17:54:56 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:54:56 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=c35d1c16-892e-4730-a1f5-739dd0517dba) {{(pid=74613) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 17:54:56 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:54:56 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 17:54:56 user nova-compute[74613]: INFO os_vif [None req-6bc176d9-db4e-4224-90ce-46fa075027ac tempest-VolumesAssistedSnapshotsTest-616484375 tempest-VolumesAssistedSnapshotsTest-616484375-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:a5:be:95,bridge_name='br-int',has_traffic_filtering=True,id=292029d6-b062-4cdc-8c09-c92693cac658,network=Network(3be4f180-3b53-4069-9ab2-94b1a948986b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap292029d6-b0')
Nov 29 17:54:56 user nova-compute[74613]: INFO nova.virt.libvirt.driver [None req-6bc176d9-db4e-4224-90ce-46fa075027ac tempest-VolumesAssistedSnapshotsTest-616484375 tempest-VolumesAssistedSnapshotsTest-616484375-project-member] [instance: d4ecef60-62f9-4969-b57f-3bb45a44cc9f] Deleting instance files /opt/stack/data/nova/instances/d4ecef60-62f9-4969-b57f-3bb45a44cc9f_del
Nov 29 17:54:56 user nova-compute[74613]: INFO nova.virt.libvirt.driver [None req-6bc176d9-db4e-4224-90ce-46fa075027ac tempest-VolumesAssistedSnapshotsTest-616484375 tempest-VolumesAssistedSnapshotsTest-616484375-project-member] [instance: d4ecef60-62f9-4969-b57f-3bb45a44cc9f] Deletion of /opt/stack/data/nova/instances/d4ecef60-62f9-4969-b57f-3bb45a44cc9f_del complete
Nov 29 17:54:56 user nova-compute[74613]: INFO nova.compute.manager [None req-6bc176d9-db4e-4224-90ce-46fa075027ac tempest-VolumesAssistedSnapshotsTest-616484375 tempest-VolumesAssistedSnapshotsTest-616484375-project-member] [instance: d4ecef60-62f9-4969-b57f-3bb45a44cc9f] Took 1.18 seconds to destroy the instance on the hypervisor.
Nov 29 17:54:56 user nova-compute[74613]: DEBUG oslo.service.loopingcall [None req-6bc176d9-db4e-4224-90ce-46fa075027ac tempest-VolumesAssistedSnapshotsTest-616484375 tempest-VolumesAssistedSnapshotsTest-616484375-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74613) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 29 17:54:56 user nova-compute[74613]: DEBUG nova.compute.manager [-] [instance: d4ecef60-62f9-4969-b57f-3bb45a44cc9f] Deallocating network for instance {{(pid=74613) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 29 17:54:56 user nova-compute[74613]: DEBUG nova.network.neutron [-] [instance: d4ecef60-62f9-4969-b57f-3bb45a44cc9f] deallocate_for_instance() {{(pid=74613) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 29 17:54:56 user nova-compute[74613]: DEBUG nova.network.neutron [-] [instance: d4ecef60-62f9-4969-b57f-3bb45a44cc9f] Updating instance_info_cache with network_info: [] {{(pid=74613) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 17:54:56 user nova-compute[74613]: INFO nova.compute.manager [-] [instance: d4ecef60-62f9-4969-b57f-3bb45a44cc9f] Took 0.82 seconds to deallocate network for instance.
Nov 29 17:54:57 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-6bc176d9-db4e-4224-90ce-46fa075027ac tempest-VolumesAssistedSnapshotsTest-616484375 tempest-VolumesAssistedSnapshotsTest-616484375-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 17:54:57 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-6bc176d9-db4e-4224-90ce-46fa075027ac tempest-VolumesAssistedSnapshotsTest-616484375 tempest-VolumesAssistedSnapshotsTest-616484375-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 17:54:57 user nova-compute[74613]: DEBUG nova.compute.provider_tree [None req-6bc176d9-db4e-4224-90ce-46fa075027ac tempest-VolumesAssistedSnapshotsTest-616484375 tempest-VolumesAssistedSnapshotsTest-616484375-project-member] Inventory has not changed in ProviderTree for provider: 639d980e-3b12-44b1-b8f4-1812416fa4dd {{(pid=74613) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 17:54:57 user nova-compute[74613]: DEBUG nova.scheduler.client.report [None req-6bc176d9-db4e-4224-90ce-46fa075027ac tempest-VolumesAssistedSnapshotsTest-616484375 tempest-VolumesAssistedSnapshotsTest-616484375-project-member] Inventory has not changed for provider 639d980e-3b12-44b1-b8f4-1812416fa4dd based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74613) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 17:54:57 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-6bc176d9-db4e-4224-90ce-46fa075027ac tempest-VolumesAssistedSnapshotsTest-616484375 tempest-VolumesAssistedSnapshotsTest-616484375-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.368s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 17:54:57 user nova-compute[74613]: INFO nova.scheduler.client.report [None req-6bc176d9-db4e-4224-90ce-46fa075027ac tempest-VolumesAssistedSnapshotsTest-616484375 tempest-VolumesAssistedSnapshotsTest-616484375-project-member] Deleted allocations for instance d4ecef60-62f9-4969-b57f-3bb45a44cc9f
Nov 29 17:54:57 user nova-compute[74613]: DEBUG nova.compute.manager [req-164f3e0b-b328-4a66-a1c8-4821cb4462ca req-5392b792-c718-40c5-8225-2a283431be1b service nova] [instance: d4ecef60-62f9-4969-b57f-3bb45a44cc9f] Received event network-vif-plugged-292029d6-b062-4cdc-8c09-c92693cac658 {{(pid=74613) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 17:54:57 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-164f3e0b-b328-4a66-a1c8-4821cb4462ca req-5392b792-c718-40c5-8225-2a283431be1b service nova] Acquiring lock "d4ecef60-62f9-4969-b57f-3bb45a44cc9f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 17:54:57 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-164f3e0b-b328-4a66-a1c8-4821cb4462ca req-5392b792-c718-40c5-8225-2a283431be1b service nova] Lock "d4ecef60-62f9-4969-b57f-3bb45a44cc9f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 17:54:57 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-164f3e0b-b328-4a66-a1c8-4821cb4462ca req-5392b792-c718-40c5-8225-2a283431be1b service nova] Lock "d4ecef60-62f9-4969-b57f-3bb45a44cc9f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 17:54:57 user nova-compute[74613]: DEBUG nova.compute.manager [req-164f3e0b-b328-4a66-a1c8-4821cb4462ca req-5392b792-c718-40c5-8225-2a283431be1b service nova] [instance: d4ecef60-62f9-4969-b57f-3bb45a44cc9f] No waiting events found dispatching network-vif-plugged-292029d6-b062-4cdc-8c09-c92693cac658 {{(pid=74613) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 17:54:57 user nova-compute[74613]: WARNING nova.compute.manager [req-164f3e0b-b328-4a66-a1c8-4821cb4462ca req-5392b792-c718-40c5-8225-2a283431be1b service nova] [instance: d4ecef60-62f9-4969-b57f-3bb45a44cc9f] Received unexpected event network-vif-plugged-292029d6-b062-4cdc-8c09-c92693cac658 for instance with vm_state deleted and task_state None.
Nov 29 17:54:57 user nova-compute[74613]: DEBUG nova.compute.manager [req-164f3e0b-b328-4a66-a1c8-4821cb4462ca req-5392b792-c718-40c5-8225-2a283431be1b service nova] [instance: d4ecef60-62f9-4969-b57f-3bb45a44cc9f] Received event network-vif-deleted-292029d6-b062-4cdc-8c09-c92693cac658 {{(pid=74613) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 17:54:57 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-6bc176d9-db4e-4224-90ce-46fa075027ac tempest-VolumesAssistedSnapshotsTest-616484375 tempest-VolumesAssistedSnapshotsTest-616484375-project-member] Lock "d4ecef60-62f9-4969-b57f-3bb45a44cc9f" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.547s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 17:55:01 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:55:05 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:55:06 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:55:08 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:55:09 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-6255ed7d-7f14-4473-bf21-c934bf93044b tempest-ServerStableDeviceRescueTest-1416322546 tempest-ServerStableDeviceRescueTest-1416322546-project-member] Acquiring lock "b6b0ba36-ad89-45f1-9578-8b999567dd25" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 17:55:09 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-6255ed7d-7f14-4473-bf21-c934bf93044b tempest-ServerStableDeviceRescueTest-1416322546 tempest-ServerStableDeviceRescueTest-1416322546-project-member] Lock "b6b0ba36-ad89-45f1-9578-8b999567dd25" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 17:55:09 user nova-compute[74613]: DEBUG nova.objects.instance [None req-6255ed7d-7f14-4473-bf21-c934bf93044b tempest-ServerStableDeviceRescueTest-1416322546 tempest-ServerStableDeviceRescueTest-1416322546-project-member] Lazy-loading 'flavor' on Instance uuid b6b0ba36-ad89-45f1-9578-8b999567dd25 {{(pid=74613) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 17:55:09 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-6255ed7d-7f14-4473-bf21-c934bf93044b tempest-ServerStableDeviceRescueTest-1416322546 tempest-ServerStableDeviceRescueTest-1416322546-project-member] Lock "b6b0ba36-ad89-45f1-9578-8b999567dd25" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.065s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 17:55:09 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-6255ed7d-7f14-4473-bf21-c934bf93044b tempest-ServerStableDeviceRescueTest-1416322546 tempest-ServerStableDeviceRescueTest-1416322546-project-member] Acquiring lock "b6b0ba36-ad89-45f1-9578-8b999567dd25" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 17:55:09 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-6255ed7d-7f14-4473-bf21-c934bf93044b tempest-ServerStableDeviceRescueTest-1416322546 tempest-ServerStableDeviceRescueTest-1416322546-project-member] Lock "b6b0ba36-ad89-45f1-9578-8b999567dd25" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 17:55:09 user nova-compute[74613]: INFO nova.compute.manager [None req-6255ed7d-7f14-4473-bf21-c934bf93044b tempest-ServerStableDeviceRescueTest-1416322546 tempest-ServerStableDeviceRescueTest-1416322546-project-member] [instance: b6b0ba36-ad89-45f1-9578-8b999567dd25] Attaching volume 070b1031-e105-4cba-a039-2286e23727c5 to /dev/vdb
Nov 29 17:55:09 user nova-compute[74613]: DEBUG os_brick.utils [None req-6255ed7d-7f14-4473-bf21-c934bf93044b tempest-ServerStableDeviceRescueTest-1416322546 tempest-ServerStableDeviceRescueTest-1416322546-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74613) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 17:55:09 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 17:55:09 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.020s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 17:55:09 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[13dc4920-b39c-4667-a1e8-071efe53e45c]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:400972819b5\n', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 17:55:09 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 17:55:09 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 17:55:09 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[24f7e378-6986-4975-93e5-99f144903986]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 17:55:09 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 17:55:09 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 17:55:09 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed4ac620-cb07-44bd-838d-18179d6128ea]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 17:55:09 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[e178124b-5ea1-4cde-9aeb-d159d377ff53]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 17:55:09 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-6255ed7d-7f14-4473-bf21-c934bf93044b tempest-ServerStableDeviceRescueTest-1416322546 tempest-ServerStableDeviceRescueTest-1416322546-project-member] Running cmd (subprocess): nvme version {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 17:55:09 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-6255ed7d-7f14-4473-bf21-c934bf93044b tempest-ServerStableDeviceRescueTest-1416322546 tempest-ServerStableDeviceRescueTest-1416322546-project-member] 'nvme version' failed. Not Retrying. {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 17:55:09 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.nvmeof [None req-6255ed7d-7f14-4473-bf21-c934bf93044b tempest-ServerStableDeviceRescueTest-1416322546 tempest-ServerStableDeviceRescueTest-1416322546-project-member] nvme not present on system {{(pid=74613) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 29 17:55:09 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 17:55:09 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 17:55:09 user nova-compute[74613]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 29 17:55:09 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[47a6116c-9263-466b-bf8a-632d7bb07ad1]: (4, '') {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 17:55:09 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.lightos [None req-6255ed7d-7f14-4473-bf21-c934bf93044b tempest-ServerStableDeviceRescueTest-1416322546 tempest-ServerStableDeviceRescueTest-1416322546-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74613) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 29 17:55:09 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.lightos [None req-6255ed7d-7f14-4473-bf21-c934bf93044b tempest-ServerStableDeviceRescueTest-1416322546 tempest-ServerStableDeviceRescueTest-1416322546-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74613) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 29 17:55:09 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.lightos [None req-6255ed7d-7f14-4473-bf21-c934bf93044b tempest-ServerStableDeviceRescueTest-1416322546 tempest-ServerStableDeviceRescueTest-1416322546-project-member] LIGHTOS: no hostnqn found. {{(pid=74613) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 29 17:55:09 user nova-compute[74613]: DEBUG os_brick.utils [None req-6255ed7d-7f14-4473-bf21-c934bf93044b tempest-ServerStableDeviceRescueTest-1416322546 tempest-ServerStableDeviceRescueTest-1416322546-project-member] <== get_connector_properties: return (129ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:400972819b5', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74613) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 17:55:09 user nova-compute[74613]: DEBUG nova.virt.block_device [None req-6255ed7d-7f14-4473-bf21-c934bf93044b tempest-ServerStableDeviceRescueTest-1416322546 tempest-ServerStableDeviceRescueTest-1416322546-project-member] [instance: b6b0ba36-ad89-45f1-9578-8b999567dd25] Updating existing volume attachment record: ddb48b00-05c0-43cd-ac76-c7d0b0355fca {{(pid=74613) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 29 17:55:11 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:55:12 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-dcf270e4-a3fe-4006-8488-d0e309d133ba tempest-ServerActionsTestOtherA-1784608629 tempest-ServerActionsTestOtherA-1784608629-project-member] Acquiring lock "71f2a1ab-3df7-411c-93fa-b0a1a5a44f0a" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 17:55:12 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-dcf270e4-a3fe-4006-8488-d0e309d133ba tempest-ServerActionsTestOtherA-1784608629 tempest-ServerActionsTestOtherA-1784608629-project-member] Lock "71f2a1ab-3df7-411c-93fa-b0a1a5a44f0a" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 17:55:12 user nova-compute[74613]: DEBUG nova.compute.manager [None req-dcf270e4-a3fe-4006-8488-d0e309d133ba tempest-ServerActionsTestOtherA-1784608629 tempest-ServerActionsTestOtherA-1784608629-project-member] [instance: 71f2a1ab-3df7-411c-93fa-b0a1a5a44f0a] Starting instance... {{(pid=74613) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 29 17:55:12 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-dcf270e4-a3fe-4006-8488-d0e309d133ba tempest-ServerActionsTestOtherA-1784608629 tempest-ServerActionsTestOtherA-1784608629-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 17:55:12 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-dcf270e4-a3fe-4006-8488-d0e309d133ba tempest-ServerActionsTestOtherA-1784608629 tempest-ServerActionsTestOtherA-1784608629-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 17:55:12 user nova-compute[74613]: DEBUG nova.virt.hardware [None req-dcf270e4-a3fe-4006-8488-d0e309d133ba tempest-ServerActionsTestOtherA-1784608629 tempest-ServerActionsTestOtherA-1784608629-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74613) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 29 17:55:12 user nova-compute[74613]: INFO nova.compute.claims [None req-dcf270e4-a3fe-4006-8488-d0e309d133ba tempest-ServerActionsTestOtherA-1784608629 tempest-ServerActionsTestOtherA-1784608629-project-member] [instance: 71f2a1ab-3df7-411c-93fa-b0a1a5a44f0a] Claim successful on node user
Nov 29 17:55:12 user nova-compute[74613]: DEBUG nova.compute.provider_tree [None req-dcf270e4-a3fe-4006-8488-d0e309d133ba tempest-ServerActionsTestOtherA-1784608629 tempest-ServerActionsTestOtherA-1784608629-project-member] Inventory has not changed in ProviderTree for provider: 639d980e-3b12-44b1-b8f4-1812416fa4dd {{(pid=74613) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 17:55:12 user nova-compute[74613]: DEBUG nova.scheduler.client.report [None req-dcf270e4-a3fe-4006-8488-d0e309d133ba tempest-ServerActionsTestOtherA-1784608629 tempest-ServerActionsTestOtherA-1784608629-project-member] Inventory has not changed for provider 639d980e-3b12-44b1-b8f4-1812416fa4dd based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74613) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 17:55:12 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-dcf270e4-a3fe-4006-8488-d0e309d133ba tempest-ServerActionsTestOtherA-1784608629 tempest-ServerActionsTestOtherA-1784608629-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.363s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 17:55:12 user nova-compute[74613]: DEBUG nova.compute.manager [None req-dcf270e4-a3fe-4006-8488-d0e309d133ba tempest-ServerActionsTestOtherA-1784608629 tempest-ServerActionsTestOtherA-1784608629-project-member] [instance: 71f2a1ab-3df7-411c-93fa-b0a1a5a44f0a] Start building networks asynchronously for instance. {{(pid=74613) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 29 17:55:12 user nova-compute[74613]: DEBUG nova.compute.manager [None req-dcf270e4-a3fe-4006-8488-d0e309d133ba tempest-ServerActionsTestOtherA-1784608629 tempest-ServerActionsTestOtherA-1784608629-project-member] [instance: 71f2a1ab-3df7-411c-93fa-b0a1a5a44f0a] Allocating IP information in the background. {{(pid=74613) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 29 17:55:12 user nova-compute[74613]: DEBUG nova.network.neutron [None req-dcf270e4-a3fe-4006-8488-d0e309d133ba tempest-ServerActionsTestOtherA-1784608629 tempest-ServerActionsTestOtherA-1784608629-project-member] [instance: 71f2a1ab-3df7-411c-93fa-b0a1a5a44f0a] allocate_for_instance() {{(pid=74613) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 29 17:55:13 user nova-compute[74613]: INFO nova.virt.libvirt.driver [None req-dcf270e4-a3fe-4006-8488-d0e309d133ba tempest-ServerActionsTestOtherA-1784608629 tempest-ServerActionsTestOtherA-1784608629-project-member] [instance: 71f2a1ab-3df7-411c-93fa-b0a1a5a44f0a] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 29 17:55:13 user nova-compute[74613]: DEBUG nova.compute.manager [None req-dcf270e4-a3fe-4006-8488-d0e309d133ba tempest-ServerActionsTestOtherA-1784608629 tempest-ServerActionsTestOtherA-1784608629-project-member] [instance: 71f2a1ab-3df7-411c-93fa-b0a1a5a44f0a] Start building block device mappings for instance. {{(pid=74613) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 29 17:55:13 user nova-compute[74613]: DEBUG nova.policy [None req-dcf270e4-a3fe-4006-8488-d0e309d133ba tempest-ServerActionsTestOtherA-1784608629 tempest-ServerActionsTestOtherA-1784608629-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '368555c72103480b82c5c0bf64b07360', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1f70c311d4941c986de21ac458d11ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74613) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 29 17:55:13 user nova-compute[74613]: DEBUG nova.compute.manager [None req-dcf270e4-a3fe-4006-8488-d0e309d133ba tempest-ServerActionsTestOtherA-1784608629 tempest-ServerActionsTestOtherA-1784608629-project-member] [instance: 71f2a1ab-3df7-411c-93fa-b0a1a5a44f0a] Start spawning the instance on the hypervisor. {{(pid=74613) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 29 17:55:13 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-dcf270e4-a3fe-4006-8488-d0e309d133ba tempest-ServerActionsTestOtherA-1784608629 tempest-ServerActionsTestOtherA-1784608629-project-member] [instance: 71f2a1ab-3df7-411c-93fa-b0a1a5a44f0a] Creating instance directory {{(pid=74613) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 29 17:55:13 user nova-compute[74613]: INFO nova.virt.libvirt.driver [None req-dcf270e4-a3fe-4006-8488-d0e309d133ba tempest-ServerActionsTestOtherA-1784608629 tempest-ServerActionsTestOtherA-1784608629-project-member] [instance: 71f2a1ab-3df7-411c-93fa-b0a1a5a44f0a] Creating image(s)
Nov 29 17:55:13 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-dcf270e4-a3fe-4006-8488-d0e309d133ba tempest-ServerActionsTestOtherA-1784608629 tempest-ServerActionsTestOtherA-1784608629-project-member] Acquiring lock "/opt/stack/data/nova/instances/71f2a1ab-3df7-411c-93fa-b0a1a5a44f0a/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 17:55:13 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-dcf270e4-a3fe-4006-8488-d0e309d133ba tempest-ServerActionsTestOtherA-1784608629 tempest-ServerActionsTestOtherA-1784608629-project-member] Lock "/opt/stack/data/nova/instances/71f2a1ab-3df7-411c-93fa-b0a1a5a44f0a/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 17:55:13 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-dcf270e4-a3fe-4006-8488-d0e309d133ba tempest-ServerActionsTestOtherA-1784608629 tempest-ServerActionsTestOtherA-1784608629-project-member] Lock "/opt/stack/data/nova/instances/71f2a1ab-3df7-411c-93fa-b0a1a5a44f0a/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.006s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 17:55:13 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-dcf270e4-a3fe-4006-8488-d0e309d133ba tempest-ServerActionsTestOtherA-1784608629 tempest-ServerActionsTestOtherA-1784608629-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/21faea9e6951f3bdd0153b76ac89fe1a60a34758 --force-share --output=json {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 17:55:13 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-dcf270e4-a3fe-4006-8488-d0e309d133ba tempest-ServerActionsTestOtherA-1784608629 tempest-ServerActionsTestOtherA-1784608629-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/21faea9e6951f3bdd0153b76ac89fe1a60a34758 --force-share --output=json" returned: 0 in 0.223s {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 17:55:13 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-dcf270e4-a3fe-4006-8488-d0e309d133ba tempest-ServerActionsTestOtherA-1784608629 tempest-ServerActionsTestOtherA-1784608629-project-member] Acquiring lock "21faea9e6951f3bdd0153b76ac89fe1a60a34758" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 17:55:13 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-dcf270e4-a3fe-4006-8488-d0e309d133ba tempest-ServerActionsTestOtherA-1784608629 tempest-ServerActionsTestOtherA-1784608629-project-member] Lock "21faea9e6951f3bdd0153b76ac89fe1a60a34758" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 17:55:13 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-dcf270e4-a3fe-4006-8488-d0e309d133ba tempest-ServerActionsTestOtherA-1784608629 tempest-ServerActionsTestOtherA-1784608629-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/21faea9e6951f3bdd0153b76ac89fe1a60a34758 --force-share --output=json {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 17:55:13 user nova-compute[74613]: DEBUG oslo_service.periodic_task [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74613) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 17:55:13 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-dcf270e4-a3fe-4006-8488-d0e309d133ba tempest-ServerActionsTestOtherA-1784608629 tempest-ServerActionsTestOtherA-1784608629-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/21faea9e6951f3bdd0153b76ac89fe1a60a34758 --force-share --output=json" returned: 0 in 0.191s {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 17:55:13 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-dcf270e4-a3fe-4006-8488-d0e309d133ba tempest-ServerActionsTestOtherA-1784608629 tempest-ServerActionsTestOtherA-1784608629-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/21faea9e6951f3bdd0153b76ac89fe1a60a34758,backing_fmt=raw /opt/stack/data/nova/instances/71f2a1ab-3df7-411c-93fa-b0a1a5a44f0a/disk 1073741824 {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 17:55:13 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-dcf270e4-a3fe-4006-8488-d0e309d133ba tempest-ServerActionsTestOtherA-1784608629 tempest-ServerActionsTestOtherA-1784608629-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/21faea9e6951f3bdd0153b76ac89fe1a60a34758,backing_fmt=raw /opt/stack/data/nova/instances/71f2a1ab-3df7-411c-93fa-b0a1a5a44f0a/disk 1073741824" returned: 0 in 0.083s {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 17:55:13 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-dcf270e4-a3fe-4006-8488-d0e309d133ba tempest-ServerActionsTestOtherA-1784608629 tempest-ServerActionsTestOtherA-1784608629-project-member] Lock "21faea9e6951f3bdd0153b76ac89fe1a60a34758" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.283s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 17:55:13 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-dcf270e4-a3fe-4006-8488-d0e309d133ba tempest-ServerActionsTestOtherA-1784608629 tempest-ServerActionsTestOtherA-1784608629-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/21faea9e6951f3bdd0153b76ac89fe1a60a34758 --force-share --output=json {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 17:55:13 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-dcf270e4-a3fe-4006-8488-d0e309d133ba tempest-ServerActionsTestOtherA-1784608629 tempest-ServerActionsTestOtherA-1784608629-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/21faea9e6951f3bdd0153b76ac89fe1a60a34758 --force-share --output=json" returned: 0 in 0.177s {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 17:55:13 user nova-compute[74613]: DEBUG nova.virt.disk.api [None req-dcf270e4-a3fe-4006-8488-d0e309d133ba tempest-ServerActionsTestOtherA-1784608629 tempest-ServerActionsTestOtherA-1784608629-project-member] Checking if we can resize image /opt/stack/data/nova/instances/71f2a1ab-3df7-411c-93fa-b0a1a5a44f0a/disk. size=1073741824 {{(pid=74613) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 29 17:55:13 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-dcf270e4-a3fe-4006-8488-d0e309d133ba tempest-ServerActionsTestOtherA-1784608629 tempest-ServerActionsTestOtherA-1784608629-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/71f2a1ab-3df7-411c-93fa-b0a1a5a44f0a/disk --force-share --output=json {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 17:55:14 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-dcf270e4-a3fe-4006-8488-d0e309d133ba tempest-ServerActionsTestOtherA-1784608629 tempest-ServerActionsTestOtherA-1784608629-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/71f2a1ab-3df7-411c-93fa-b0a1a5a44f0a/disk --force-share --output=json" returned: 0 in 0.212s {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 17:55:14 user nova-compute[74613]: DEBUG nova.virt.disk.api [None req-dcf270e4-a3fe-4006-8488-d0e309d133ba tempest-ServerActionsTestOtherA-1784608629 tempest-ServerActionsTestOtherA-1784608629-project-member] Cannot resize image /opt/stack/data/nova/instances/71f2a1ab-3df7-411c-93fa-b0a1a5a44f0a/disk to a smaller size. {{(pid=74613) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 29 17:55:14 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-dcf270e4-a3fe-4006-8488-d0e309d133ba tempest-ServerActionsTestOtherA-1784608629 tempest-ServerActionsTestOtherA-1784608629-project-member] [instance: 71f2a1ab-3df7-411c-93fa-b0a1a5a44f0a] Created local disks {{(pid=74613) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 29 17:55:14 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-dcf270e4-a3fe-4006-8488-d0e309d133ba tempest-ServerActionsTestOtherA-1784608629 tempest-ServerActionsTestOtherA-1784608629-project-member] [instance: 71f2a1ab-3df7-411c-93fa-b0a1a5a44f0a] Ensure instance console log exists: /opt/stack/data/nova/instances/71f2a1ab-3df7-411c-93fa-b0a1a5a44f0a/console.log {{(pid=74613) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 29 17:55:14 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-dcf270e4-a3fe-4006-8488-d0e309d133ba tempest-ServerActionsTestOtherA-1784608629 tempest-ServerActionsTestOtherA-1784608629-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 17:55:14 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-dcf270e4-a3fe-4006-8488-d0e309d133ba tempest-ServerActionsTestOtherA-1784608629 tempest-ServerActionsTestOtherA-1784608629-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 17:55:14 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-dcf270e4-a3fe-4006-8488-d0e309d133ba tempest-ServerActionsTestOtherA-1784608629 tempest-ServerActionsTestOtherA-1784608629-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 17:55:14 user nova-compute[74613]: DEBUG oslo_service.periodic_task [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74613) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 17:55:14 user nova-compute[74613]: DEBUG nova.compute.manager [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Starting heal instance info cache {{(pid=74613) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 29 17:55:14 user nova-compute[74613]: DEBUG nova.network.neutron [None req-dcf270e4-a3fe-4006-8488-d0e309d133ba tempest-ServerActionsTestOtherA-1784608629 tempest-ServerActionsTestOtherA-1784608629-project-member] [instance: 71f2a1ab-3df7-411c-93fa-b0a1a5a44f0a] Successfully created port: d40a5800-7391-4206-a661-fbce50c35a65 {{(pid=74613) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 29 17:55:14 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Acquiring lock "refresh_cache-0008521b-5a63-4ff6-8390-d343956900ed" {{(pid=74613) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 17:55:14 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Acquired lock "refresh_cache-0008521b-5a63-4ff6-8390-d343956900ed" {{(pid=74613) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 17:55:14 user nova-compute[74613]: DEBUG nova.network.neutron [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] [instance: 0008521b-5a63-4ff6-8390-d343956900ed] Forcefully refreshing network info cache for instance {{(pid=74613) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 29 17:55:14 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-c91e8417-5b0e-455b-9678-f8e7727a2128 tempest-AttachVolumeShelveTestJSON-1452861425 tempest-AttachVolumeShelveTestJSON-1452861425-project-member] Acquiring lock "c19e230e-2e6c-4c20-b15c-ad81a73674b4" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 17:55:14 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-c91e8417-5b0e-455b-9678-f8e7727a2128 tempest-AttachVolumeShelveTestJSON-1452861425 tempest-AttachVolumeShelveTestJSON-1452861425-project-member] Lock "c19e230e-2e6c-4c20-b15c-ad81a73674b4" acquired by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: waited 0.001s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 17:55:14 user nova-compute[74613]: INFO nova.compute.manager [None req-c91e8417-5b0e-455b-9678-f8e7727a2128 tempest-AttachVolumeShelveTestJSON-1452861425 tempest-AttachVolumeShelveTestJSON-1452861425-project-member] [instance: c19e230e-2e6c-4c20-b15c-ad81a73674b4] Unshelving
Nov 29 17:55:14 user nova-compute[74613]: INFO nova.virt.block_device [None req-c91e8417-5b0e-455b-9678-f8e7727a2128 tempest-AttachVolumeShelveTestJSON-1452861425 tempest-AttachVolumeShelveTestJSON-1452861425-project-member] [instance: c19e230e-2e6c-4c20-b15c-ad81a73674b4] Booting with volume 00ec83b4-5d84-416a-bad9-7511171a9da0 at /dev/vdc
Nov 29 17:55:15 user nova-compute[74613]: DEBUG os_brick.utils [None req-c91e8417-5b0e-455b-9678-f8e7727a2128 tempest-AttachVolumeShelveTestJSON-1452861425 tempest-AttachVolumeShelveTestJSON-1452861425-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74613) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 17:55:15 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 17:55:15 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 17:55:15 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d90a792-3ed5-46ae-acbd-4b97c5f9fb75]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:400972819b5\n', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 17:55:15 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 17:55:15 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.022s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 17:55:15 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[18e3775f-8e77-49ca-a789-d7eb79c83f01]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 17:55:15 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 17:55:15 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.020s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 17:55:15 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[40a2542b-5c9c-42e0-b94b-b05c702e43e4]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 17:55:15 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[579e341a-b072-4d1c-ae3a-426d9fe3cd55]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 17:55:15 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-c91e8417-5b0e-455b-9678-f8e7727a2128 tempest-AttachVolumeShelveTestJSON-1452861425 tempest-AttachVolumeShelveTestJSON-1452861425-project-member] Running cmd (subprocess): nvme version {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 17:55:15 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-c91e8417-5b0e-455b-9678-f8e7727a2128 tempest-AttachVolumeShelveTestJSON-1452861425 tempest-AttachVolumeShelveTestJSON-1452861425-project-member] 'nvme version' failed. Not Retrying. {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 17:55:15 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.nvmeof [None req-c91e8417-5b0e-455b-9678-f8e7727a2128 tempest-AttachVolumeShelveTestJSON-1452861425 tempest-AttachVolumeShelveTestJSON-1452861425-project-member] nvme not present on system {{(pid=74613) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 29 17:55:15 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 17:55:15 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 17:55:15 user nova-compute[74613]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 29 17:55:15 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd2046dd-dcf0-4d9e-8de6-32461ad3309f]: (4, '') {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 17:55:15 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.lightos [None req-c91e8417-5b0e-455b-9678-f8e7727a2128 tempest-AttachVolumeShelveTestJSON-1452861425 tempest-AttachVolumeShelveTestJSON-1452861425-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74613) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 29 17:55:15 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.lightos [None req-c91e8417-5b0e-455b-9678-f8e7727a2128 tempest-AttachVolumeShelveTestJSON-1452861425 tempest-AttachVolumeShelveTestJSON-1452861425-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74613) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 29 17:55:15 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.lightos [None req-c91e8417-5b0e-455b-9678-f8e7727a2128 tempest-AttachVolumeShelveTestJSON-1452861425 tempest-AttachVolumeShelveTestJSON-1452861425-project-member] LIGHTOS: no hostnqn found. {{(pid=74613) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 29 17:55:15 user nova-compute[74613]: DEBUG os_brick.utils [None req-c91e8417-5b0e-455b-9678-f8e7727a2128 tempest-AttachVolumeShelveTestJSON-1452861425 tempest-AttachVolumeShelveTestJSON-1452861425-project-member] <== get_connector_properties: return (159ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:400972819b5', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74613) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 17:55:15 user nova-compute[74613]: DEBUG nova.virt.block_device [None req-c91e8417-5b0e-455b-9678-f8e7727a2128 tempest-AttachVolumeShelveTestJSON-1452861425 tempest-AttachVolumeShelveTestJSON-1452861425-project-member] [instance: c19e230e-2e6c-4c20-b15c-ad81a73674b4] Updating existing volume attachment record: 54c9b96a-eb93-49f6-becd-bbf66ae3b2d9 {{(pid=74613) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 29 17:55:15 user nova-compute[74613]: DEBUG nova.network.neutron [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] [instance: 0008521b-5a63-4ff6-8390-d343956900ed] Updating instance_info_cache with network_info: [{"id": "0ab94891-565e-4864-b6ba-565056b40005", "address": "fa:16:3e:7e:c4:dc", "network": {"id": "8955d6de-e65e-431d-80b4-420aeda27329", "bridge": "br-int", "label": "tempest-TestVolumeSwap-241933908-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.35", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6d9f2fb92a21448d9c935927066d5372", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0ab94891-56", "ovs_interfaceid": "0ab94891-565e-4864-b6ba-565056b40005", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74613) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 17:55:15 user nova-compute[74613]: DEBUG nova.network.neutron [None req-dcf270e4-a3fe-4006-8488-d0e309d133ba tempest-ServerActionsTestOtherA-1784608629 tempest-ServerActionsTestOtherA-1784608629-project-member] [instance: 71f2a1ab-3df7-411c-93fa-b0a1a5a44f0a] Successfully updated port: d40a5800-7391-4206-a661-fbce50c35a65 {{(pid=74613) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 29 17:55:15 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Releasing lock "refresh_cache-0008521b-5a63-4ff6-8390-d343956900ed" {{(pid=74613) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 17:55:15 user nova-compute[74613]: DEBUG nova.compute.manager [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] [instance: 0008521b-5a63-4ff6-8390-d343956900ed] Updated the network info_cache for instance {{(pid=74613) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 29 17:55:15 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-dcf270e4-a3fe-4006-8488-d0e309d133ba tempest-ServerActionsTestOtherA-1784608629 tempest-ServerActionsTestOtherA-1784608629-project-member] Acquiring lock "refresh_cache-71f2a1ab-3df7-411c-93fa-b0a1a5a44f0a" {{(pid=74613) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 17:55:15 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-dcf270e4-a3fe-4006-8488-d0e309d133ba tempest-ServerActionsTestOtherA-1784608629 tempest-ServerActionsTestOtherA-1784608629-project-member] Acquired lock "refresh_cache-71f2a1ab-3df7-411c-93fa-b0a1a5a44f0a" {{(pid=74613) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 17:55:15 user nova-compute[74613]: DEBUG nova.network.neutron [None req-dcf270e4-a3fe-4006-8488-d0e309d133ba tempest-ServerActionsTestOtherA-1784608629 tempest-ServerActionsTestOtherA-1784608629-project-member] [instance: 71f2a1ab-3df7-411c-93fa-b0a1a5a44f0a] Building network info cache for instance {{(pid=74613) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 29 17:55:15 user nova-compute[74613]: DEBUG nova.compute.manager [req-136a4efc-75d3-4cbe-807b-1f4f7e2b7f06 req-8118f3d7-f9b4-4e56-bd6e-b92acd86e646 service nova] [instance: 71f2a1ab-3df7-411c-93fa-b0a1a5a44f0a] Received event network-changed-d40a5800-7391-4206-a661-fbce50c35a65 {{(pid=74613) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 17:55:15 user nova-compute[74613]: DEBUG nova.compute.manager [req-136a4efc-75d3-4cbe-807b-1f4f7e2b7f06 req-8118f3d7-f9b4-4e56-bd6e-b92acd86e646 service nova] [instance: 71f2a1ab-3df7-411c-93fa-b0a1a5a44f0a] Refreshing instance network info cache due to event network-changed-d40a5800-7391-4206-a661-fbce50c35a65. {{(pid=74613) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 17:55:15 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-136a4efc-75d3-4cbe-807b-1f4f7e2b7f06 req-8118f3d7-f9b4-4e56-bd6e-b92acd86e646 service nova] Acquiring lock "refresh_cache-71f2a1ab-3df7-411c-93fa-b0a1a5a44f0a" {{(pid=74613) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 17:55:15 user nova-compute[74613]: DEBUG nova.network.neutron [None req-dcf270e4-a3fe-4006-8488-d0e309d133ba tempest-ServerActionsTestOtherA-1784608629 tempest-ServerActionsTestOtherA-1784608629-project-member] [instance: 71f2a1ab-3df7-411c-93fa-b0a1a5a44f0a] Instance cache missing network info. {{(pid=74613) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 29 17:55:15 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:55:15 user nova-compute[74613]: DEBUG oslo_service.periodic_task [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74613) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 17:55:15 user nova-compute[74613]: DEBUG oslo_service.periodic_task [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74613) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 17:55:15 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 17:55:15 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 17:55:15 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 17:55:15 user nova-compute[74613]: DEBUG nova.compute.resource_tracker [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Auditing locally available compute resources for user (node: user) {{(pid=74613) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 29 17:55:15 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0008521b-5a63-4ff6-8390-d343956900ed/disk --force-share --output=json {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 17:55:15 user nova-compute[74613]: DEBUG nova.network.neutron [None req-dcf270e4-a3fe-4006-8488-d0e309d133ba tempest-ServerActionsTestOtherA-1784608629 tempest-ServerActionsTestOtherA-1784608629-project-member] [instance: 71f2a1ab-3df7-411c-93fa-b0a1a5a44f0a] Updating instance_info_cache with network_info: [{"id": "d40a5800-7391-4206-a661-fbce50c35a65", "address": "fa:16:3e:1a:53:06", "network": {"id": "7c2c368e-4c7d-4d70-9a40-c10fe9541af9", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1287934102-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b1f70c311d4941c986de21ac458d11ab", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd40a5800-73", "ovs_interfaceid": "d40a5800-7391-4206-a661-fbce50c35a65", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74613) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 17:55:15 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-dcf270e4-a3fe-4006-8488-d0e309d133ba tempest-ServerActionsTestOtherA-1784608629 tempest-ServerActionsTestOtherA-1784608629-project-member] Releasing lock "refresh_cache-71f2a1ab-3df7-411c-93fa-b0a1a5a44f0a" {{(pid=74613) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 17:55:15 user nova-compute[74613]: DEBUG nova.compute.manager [None req-dcf270e4-a3fe-4006-8488-d0e309d133ba tempest-ServerActionsTestOtherA-1784608629 tempest-ServerActionsTestOtherA-1784608629-project-member] [instance: 71f2a1ab-3df7-411c-93fa-b0a1a5a44f0a] Instance network_info: |[{"id": "d40a5800-7391-4206-a661-fbce50c35a65", "address": "fa:16:3e:1a:53:06", "network": {"id": "7c2c368e-4c7d-4d70-9a40-c10fe9541af9", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1287934102-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b1f70c311d4941c986de21ac458d11ab", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd40a5800-73", "ovs_interfaceid": "d40a5800-7391-4206-a661-fbce50c35a65", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74613) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 29 17:55:15 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-136a4efc-75d3-4cbe-807b-1f4f7e2b7f06 req-8118f3d7-f9b4-4e56-bd6e-b92acd86e646 service nova] Acquired lock "refresh_cache-71f2a1ab-3df7-411c-93fa-b0a1a5a44f0a" {{(pid=74613) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 17:55:15 user nova-compute[74613]: DEBUG nova.network.neutron [req-136a4efc-75d3-4cbe-807b-1f4f7e2b7f06 req-8118f3d7-f9b4-4e56-bd6e-b92acd86e646 service nova] [instance: 71f2a1ab-3df7-411c-93fa-b0a1a5a44f0a] Refreshing network info cache for port d40a5800-7391-4206-a661-fbce50c35a65 {{(pid=74613) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 17:55:15 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-dcf270e4-a3fe-4006-8488-d0e309d133ba tempest-ServerActionsTestOtherA-1784608629 tempest-ServerActionsTestOtherA-1784608629-project-member] [instance: 71f2a1ab-3df7-411c-93fa-b0a1a5a44f0a] Start _get_guest_xml network_info=[{"id": "d40a5800-7391-4206-a661-fbce50c35a65", "address": "fa:16:3e:1a:53:06", "network": {"id": "7c2c368e-4c7d-4d70-9a40-c10fe9541af9", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1287934102-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b1f70c311d4941c986de21ac458d11ab", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd40a5800-73", "ovs_interfaceid": "d40a5800-7391-4206-a661-fbce50c35a65", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-29T17:47:38Z,direct_url=<?>,disk_format='qcow2',id=4217f428-8d9d-4ee1-9614-642d26d90c46,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='794b07cbd46a44b5865cfda741036bae',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-29T17:47:40Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'size': 0, 'device_type': 'disk', 'boot_index': 0, 'guest_format': None, 'encrypted': False, 'encryption_format': None, 'disk_bus': 'virtio', 'image_id': '4217f428-8d9d-4ee1-9614-642d26d90c46'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74613) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 29 17:55:15 user nova-compute[74613]: WARNING nova.virt.libvirt.driver [None req-dcf270e4-a3fe-4006-8488-d0e309d133ba tempest-ServerActionsTestOtherA-1784608629 tempest-ServerActionsTestOtherA-1784608629-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 17:55:15 user nova-compute[74613]: WARNING nova.virt.libvirt.driver [None req-dcf270e4-a3fe-4006-8488-d0e309d133ba tempest-ServerActionsTestOtherA-1784608629 tempest-ServerActionsTestOtherA-1784608629-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 17:55:15 user nova-compute[74613]: DEBUG nova.virt.libvirt.host [None req-dcf270e4-a3fe-4006-8488-d0e309d133ba tempest-ServerActionsTestOtherA-1784608629 tempest-ServerActionsTestOtherA-1784608629-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74613) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 29 17:55:15 user nova-compute[74613]: DEBUG nova.virt.libvirt.host [None req-dcf270e4-a3fe-4006-8488-d0e309d133ba tempest-ServerActionsTestOtherA-1784608629 tempest-ServerActionsTestOtherA-1784608629-project-member] CPU controller missing on host. {{(pid=74613) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 29 17:55:15 user nova-compute[74613]: DEBUG nova.virt.libvirt.host [None req-dcf270e4-a3fe-4006-8488-d0e309d133ba tempest-ServerActionsTestOtherA-1784608629 tempest-ServerActionsTestOtherA-1784608629-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74613) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 29 17:55:15 user nova-compute[74613]: DEBUG nova.virt.libvirt.host [None req-dcf270e4-a3fe-4006-8488-d0e309d133ba tempest-ServerActionsTestOtherA-1784608629 tempest-ServerActionsTestOtherA-1784608629-project-member] CPU controller found on host. {{(pid=74613) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 29 17:55:15 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-dcf270e4-a3fe-4006-8488-d0e309d133ba tempest-ServerActionsTestOtherA-1784608629 tempest-ServerActionsTestOtherA-1784608629-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74613) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 29 17:55:15 user nova-compute[74613]: DEBUG nova.virt.hardware [None req-dcf270e4-a3fe-4006-8488-d0e309d133ba tempest-ServerActionsTestOtherA-1784608629 tempest-ServerActionsTestOtherA-1784608629-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-29T17:47:27Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-29T17:47:38Z,direct_url=<?>,disk_format='qcow2',id=4217f428-8d9d-4ee1-9614-642d26d90c46,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='794b07cbd46a44b5865cfda741036bae',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-29T17:47:40Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74613) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 29 17:55:15 user nova-compute[74613]: DEBUG nova.virt.hardware [None req-dcf270e4-a3fe-4006-8488-d0e309d133ba tempest-ServerActionsTestOtherA-1784608629 tempest-ServerActionsTestOtherA-1784608629-project-member] Flavor limits 0:0:0 {{(pid=74613) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 29 17:55:15 user nova-compute[74613]: DEBUG nova.virt.hardware [None req-dcf270e4-a3fe-4006-8488-d0e309d133ba tempest-ServerActionsTestOtherA-1784608629 tempest-ServerActionsTestOtherA-1784608629-project-member] Image limits 0:0:0 {{(pid=74613) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 29 17:55:15 user nova-compute[74613]: DEBUG nova.virt.hardware [None req-dcf270e4-a3fe-4006-8488-d0e309d133ba tempest-ServerActionsTestOtherA-1784608629 tempest-ServerActionsTestOtherA-1784608629-project-member] Flavor pref 0:0:0 {{(pid=74613) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 29 17:55:15 user nova-compute[74613]: DEBUG nova.virt.hardware [None req-dcf270e4-a3fe-4006-8488-d0e309d133ba tempest-ServerActionsTestOtherA-1784608629 tempest-ServerActionsTestOtherA-1784608629-project-member] Image pref 0:0:0 {{(pid=74613) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 29 17:55:15 user nova-compute[74613]: DEBUG nova.virt.hardware [None req-dcf270e4-a3fe-4006-8488-d0e309d133ba tempest-ServerActionsTestOtherA-1784608629 tempest-ServerActionsTestOtherA-1784608629-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74613) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 29 17:55:15 user nova-compute[74613]: DEBUG nova.virt.hardware [None req-dcf270e4-a3fe-4006-8488-d0e309d133ba tempest-ServerActionsTestOtherA-1784608629 tempest-ServerActionsTestOtherA-1784608629-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74613) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 29 17:55:15 user nova-compute[74613]: DEBUG nova.virt.hardware [None req-dcf270e4-a3fe-4006-8488-d0e309d133ba tempest-ServerActionsTestOtherA-1784608629 tempest-ServerActionsTestOtherA-1784608629-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74613) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 29 17:55:15 user nova-compute[74613]: DEBUG nova.virt.hardware [None req-dcf270e4-a3fe-4006-8488-d0e309d133ba tempest-ServerActionsTestOtherA-1784608629 tempest-ServerActionsTestOtherA-1784608629-project-member] Got 1 possible topologies {{(pid=74613) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 29 17:55:15 user nova-compute[74613]: DEBUG nova.virt.hardware [None req-dcf270e4-a3fe-4006-8488-d0e309d133ba tempest-ServerActionsTestOtherA-1784608629 tempest-ServerActionsTestOtherA-1784608629-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74613) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 29 17:55:15 user nova-compute[74613]: DEBUG nova.virt.hardware [None req-dcf270e4-a3fe-4006-8488-d0e309d133ba tempest-ServerActionsTestOtherA-1784608629 tempest-ServerActionsTestOtherA-1784608629-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74613) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 29 17:55:15 user nova-compute[74613]: DEBUG nova.virt.libvirt.vif [None req-dcf270e4-a3fe-4006-8488-d0e309d133ba tempest-ServerActionsTestOtherA-1784608629 tempest-ServerActionsTestOtherA-1784608629-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T17:55:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-767391492',display_name='tempest-tempest.common.compute-instance-767391492',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-767391492',id=13,image_ref='4217f428-8d9d-4ee1-9614-642d26d90c46',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBoePbDdVpJCaWjh90UecUnwFAFq/eT9sMeustkjBwKAq8nn0Q72xeUImjY1HRKXOBeHYZZlO4bbO6ME7GeXyIhuiGXR5A0ys2izZvXx2IXQIIRGKFd1AzRXZiys4DgmVA==',key_name='tempest-keypair-218978152',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b1f70c311d4941c986de21ac458d11ab',ramdisk_id='',reservation_id='r-adqmslmn',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='4217f428-8d9d-4ee1-9614-642d26d90c46',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-1784608629',owner_user_name='tempest-ServerActionsTestOtherA-1784608629-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T17:55:13Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='368555c72103480b82c5c0bf64b07360',uuid=71f2a1ab-3df7-411c-93fa-b0a1a5a44f0a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d40a5800-7391-4206-a661-fbce50c35a65", "address": "fa:16:3e:1a:53:06", "network": {"id": "7c2c368e-4c7d-4d70-9a40-c10fe9541af9", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1287934102-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b1f70c311d4941c986de21ac458d11ab", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd40a5800-73", "ovs_interfaceid": "d40a5800-7391-4206-a661-fbce50c35a65", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74613) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 29 17:55:15 user nova-compute[74613]: DEBUG nova.network.os_vif_util [None req-dcf270e4-a3fe-4006-8488-d0e309d133ba tempest-ServerActionsTestOtherA-1784608629 tempest-ServerActionsTestOtherA-1784608629-project-member] Converting VIF {"id": "d40a5800-7391-4206-a661-fbce50c35a65", "address": "fa:16:3e:1a:53:06", "network": {"id": "7c2c368e-4c7d-4d70-9a40-c10fe9541af9", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1287934102-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b1f70c311d4941c986de21ac458d11ab", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd40a5800-73", "ovs_interfaceid": "d40a5800-7391-4206-a661-fbce50c35a65", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74613) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 17:55:15 user nova-compute[74613]: DEBUG nova.network.os_vif_util [None req-dcf270e4-a3fe-4006-8488-d0e309d133ba tempest-ServerActionsTestOtherA-1784608629 tempest-ServerActionsTestOtherA-1784608629-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1a:53:06,bridge_name='br-int',has_traffic_filtering=True,id=d40a5800-7391-4206-a661-fbce50c35a65,network=Network(7c2c368e-4c7d-4d70-9a40-c10fe9541af9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd40a5800-73') {{(pid=74613) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 17:55:15 user nova-compute[74613]: DEBUG nova.objects.instance [None req-dcf270e4-a3fe-4006-8488-d0e309d133ba tempest-ServerActionsTestOtherA-1784608629 tempest-ServerActionsTestOtherA-1784608629-project-member] Lazy-loading 'pci_devices' on Instance uuid 71f2a1ab-3df7-411c-93fa-b0a1a5a44f0a {{(pid=74613) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 17:55:16 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-dcf270e4-a3fe-4006-8488-d0e309d133ba tempest-ServerActionsTestOtherA-1784608629 tempest-ServerActionsTestOtherA-1784608629-project-member] [instance: 71f2a1ab-3df7-411c-93fa-b0a1a5a44f0a] End _get_guest_xml xml=<domain type="kvm">
Nov 29 17:55:16 user nova-compute[74613]:   <uuid>71f2a1ab-3df7-411c-93fa-b0a1a5a44f0a</uuid>
Nov 29 17:55:16 user nova-compute[74613]:   <name>instance-0000000d</name>
Nov 29 17:55:16 user nova-compute[74613]:   <memory>524288</memory>
Nov 29 17:55:16 user nova-compute[74613]:   <vcpu>1</vcpu>
Nov 29 17:55:16 user nova-compute[74613]:   <metadata>
Nov 29 17:55:16 user nova-compute[74613]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 29 17:55:16 user nova-compute[74613]:       <nova:package version="0.0.0"/>
Nov 29 17:55:16 user nova-compute[74613]:       <nova:name>tempest-tempest.common.compute-instance-767391492</nova:name>
Nov 29 17:55:16 user nova-compute[74613]:       <nova:creationTime>2023-11-29 17:55:15</nova:creationTime>
Nov 29 17:55:16 user nova-compute[74613]:       <nova:flavor name="m1.tiny">
Nov 29 17:55:16 user nova-compute[74613]:         <nova:memory>512</nova:memory>
Nov 29 17:55:16 user nova-compute[74613]:         <nova:disk>1</nova:disk>
Nov 29 17:55:16 user nova-compute[74613]:         <nova:swap>0</nova:swap>
Nov 29 17:55:16 user nova-compute[74613]:         <nova:ephemeral>0</nova:ephemeral>
Nov 29 17:55:16 user nova-compute[74613]:         <nova:vcpus>1</nova:vcpus>
Nov 29 17:55:16 user nova-compute[74613]:       </nova:flavor>
Nov 29 17:55:16 user nova-compute[74613]:       <nova:owner>
Nov 29 17:55:16 user nova-compute[74613]:         <nova:user uuid="368555c72103480b82c5c0bf64b07360">tempest-ServerActionsTestOtherA-1784608629-project-member</nova:user>
Nov 29 17:55:16 user nova-compute[74613]:         <nova:project uuid="b1f70c311d4941c986de21ac458d11ab">tempest-ServerActionsTestOtherA-1784608629</nova:project>
Nov 29 17:55:16 user nova-compute[74613]:       </nova:owner>
Nov 29 17:55:16 user nova-compute[74613]:       <nova:root type="image" uuid="4217f428-8d9d-4ee1-9614-642d26d90c46"/>
Nov 29 17:55:16 user nova-compute[74613]:       <nova:ports>
Nov 29 17:55:16 user nova-compute[74613]:         <nova:port uuid="d40a5800-7391-4206-a661-fbce50c35a65">
Nov 29 17:55:16 user nova-compute[74613]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Nov 29 17:55:16 user nova-compute[74613]:         </nova:port>
Nov 29 17:55:16 user nova-compute[74613]:       </nova:ports>
Nov 29 17:55:16 user nova-compute[74613]:     </nova:instance>
Nov 29 17:55:16 user nova-compute[74613]:   </metadata>
Nov 29 17:55:16 user nova-compute[74613]:   <sysinfo type="smbios">
Nov 29 17:55:16 user nova-compute[74613]:     <system>
Nov 29 17:55:16 user nova-compute[74613]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 29 17:55:16 user nova-compute[74613]:       <entry name="product">OpenStack Nova</entry>
Nov 29 17:55:16 user nova-compute[74613]:       <entry name="version">0.0.0</entry>
Nov 29 17:55:16 user nova-compute[74613]:       <entry name="serial">71f2a1ab-3df7-411c-93fa-b0a1a5a44f0a</entry>
Nov 29 17:55:16 user nova-compute[74613]:       <entry name="uuid">71f2a1ab-3df7-411c-93fa-b0a1a5a44f0a</entry>
Nov 29 17:55:16 user nova-compute[74613]:       <entry name="family">Virtual Machine</entry>
Nov 29 17:55:16 user nova-compute[74613]:     </system>
Nov 29 17:55:16 user nova-compute[74613]:   </sysinfo>
Nov 29 17:55:16 user nova-compute[74613]:   <os>
Nov 29 17:55:16 user nova-compute[74613]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 29 17:55:16 user nova-compute[74613]:     <boot dev="hd"/>
Nov 29 17:55:16 user nova-compute[74613]:     <smbios mode="sysinfo"/>
Nov 29 17:55:16 user nova-compute[74613]:   </os>
Nov 29 17:55:16 user nova-compute[74613]:   <features>
Nov 29 17:55:16 user nova-compute[74613]:     <acpi/>
Nov 29 17:55:16 user nova-compute[74613]:     <apic/>
Nov 29 17:55:16 user nova-compute[74613]:     <vmcoreinfo/>
Nov 29 17:55:16 user nova-compute[74613]:   </features>
Nov 29 17:55:16 user nova-compute[74613]:   <clock offset="utc">
Nov 29 17:55:16 user nova-compute[74613]:     <timer name="pit" tickpolicy="delay"/>
Nov 29 17:55:16 user nova-compute[74613]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 29 17:55:16 user nova-compute[74613]:     <timer name="hpet" present="no"/>
Nov 29 17:55:16 user nova-compute[74613]:   </clock>
Nov 29 17:55:16 user nova-compute[74613]:   <cpu mode="custom" match="exact">
Nov 29 17:55:16 user nova-compute[74613]:     <model>Nehalem</model>
Nov 29 17:55:16 user nova-compute[74613]:     <topology sockets="1" cores="1" threads="1"/>
Nov 29 17:55:16 user nova-compute[74613]:   </cpu>
Nov 29 17:55:16 user nova-compute[74613]:   <devices>
Nov 29 17:55:16 user nova-compute[74613]:     <disk type="file" device="disk">
Nov 29 17:55:16 user nova-compute[74613]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 29 17:55:16 user nova-compute[74613]:       <source file="/opt/stack/data/nova/instances/71f2a1ab-3df7-411c-93fa-b0a1a5a44f0a/disk"/>
Nov 29 17:55:16 user nova-compute[74613]:       <target dev="vda" bus="virtio"/>
Nov 29 17:55:16 user nova-compute[74613]:     </disk>
Nov 29 17:55:16 user nova-compute[74613]:     <interface type="ethernet">
Nov 29 17:55:16 user nova-compute[74613]:       <mac address="fa:16:3e:1a:53:06"/>
Nov 29 17:55:16 user nova-compute[74613]:       <model type="virtio"/>
Nov 29 17:55:16 user nova-compute[74613]:       <mtu size="1442"/>
Nov 29 17:55:16 user nova-compute[74613]:       <target dev="tapd40a5800-73"/>
Nov 29 17:55:16 user nova-compute[74613]:     </interface>
Nov 29 17:55:16 user nova-compute[74613]:     <serial type="pty">
Nov 29 17:55:16 user nova-compute[74613]:       <log file="/opt/stack/data/nova/instances/71f2a1ab-3df7-411c-93fa-b0a1a5a44f0a/console.log" append="off"/>
Nov 29 17:55:16 user nova-compute[74613]:     </serial>
Nov 29 17:55:16 user nova-compute[74613]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 29 17:55:16 user nova-compute[74613]:     <video>
Nov 29 17:55:16 user nova-compute[74613]:       <model type="virtio"/>
Nov 29 17:55:16 user nova-compute[74613]:     </video>
Nov 29 17:55:16 user nova-compute[74613]:     <rng model="virtio">
Nov 29 17:55:16 user nova-compute[74613]:       <backend model="random">/dev/urandom</backend>
Nov 29 17:55:16 user nova-compute[74613]:     </rng>
Nov 29 17:55:16 user nova-compute[74613]:     <controller type="usb" index="0" model="none"/>
Nov 29 17:55:16 user nova-compute[74613]:     <memballoon model="virtio">
Nov 29 17:55:16 user nova-compute[74613]:       <stats period="10"/>
Nov 29 17:55:16 user nova-compute[74613]:     </memballoon>
Nov 29 17:55:16 user nova-compute[74613]:   </devices>
Nov 29 17:55:16 user nova-compute[74613]: </domain>
Nov 29 17:55:16 user nova-compute[74613]:  {{(pid=74613) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 29 17:55:16 user nova-compute[74613]: DEBUG nova.virt.libvirt.vif [None req-dcf270e4-a3fe-4006-8488-d0e309d133ba tempest-ServerActionsTestOtherA-1784608629 tempest-ServerActionsTestOtherA-1784608629-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T17:55:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-767391492',display_name='tempest-tempest.common.compute-instance-767391492',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-767391492',id=13,image_ref='4217f428-8d9d-4ee1-9614-642d26d90c46',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBoePbDdVpJCaWjh90UecUnwFAFq/eT9sMeustkjBwKAq8nn0Q72xeUImjY1HRKXOBeHYZZlO4bbO6ME7GeXyIhuiGXR5A0ys2izZvXx2IXQIIRGKFd1AzRXZiys4DgmVA==',key_name='tempest-keypair-218978152',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b1f70c311d4941c986de21ac458d11ab',ramdisk_id='',reservation_id='r-adqmslmn',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='4217f428-8d9d-4ee1-9614-642d26d90c46',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-1784608629',owner_user_name='tempest-ServerActionsTestOtherA-1784608629-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T17:55:13Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='368555c72103480b82c5c0bf64b07360',uuid=71f2a1ab-3df7-411c-93fa-b0a1a5a44f0a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d40a5800-7391-4206-a661-fbce50c35a65", "address": "fa:16:3e:1a:53:06", "network": {"id": "7c2c368e-4c7d-4d70-9a40-c10fe9541af9", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1287934102-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b1f70c311d4941c986de21ac458d11ab", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd40a5800-73", "ovs_interfaceid": "d40a5800-7391-4206-a661-fbce50c35a65", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74613) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 29 17:55:16 user nova-compute[74613]: DEBUG nova.network.os_vif_util [None req-dcf270e4-a3fe-4006-8488-d0e309d133ba tempest-ServerActionsTestOtherA-1784608629 tempest-ServerActionsTestOtherA-1784608629-project-member] Converting VIF {"id": "d40a5800-7391-4206-a661-fbce50c35a65", "address": "fa:16:3e:1a:53:06", "network": {"id": "7c2c368e-4c7d-4d70-9a40-c10fe9541af9", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1287934102-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b1f70c311d4941c986de21ac458d11ab", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd40a5800-73", "ovs_interfaceid": "d40a5800-7391-4206-a661-fbce50c35a65", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74613) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 17:55:16 user nova-compute[74613]: DEBUG nova.network.os_vif_util [None req-dcf270e4-a3fe-4006-8488-d0e309d133ba tempest-ServerActionsTestOtherA-1784608629 tempest-ServerActionsTestOtherA-1784608629-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1a:53:06,bridge_name='br-int',has_traffic_filtering=True,id=d40a5800-7391-4206-a661-fbce50c35a65,network=Network(7c2c368e-4c7d-4d70-9a40-c10fe9541af9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd40a5800-73') {{(pid=74613) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 17:55:16 user nova-compute[74613]: DEBUG os_vif [None req-dcf270e4-a3fe-4006-8488-d0e309d133ba tempest-ServerActionsTestOtherA-1784608629 tempest-ServerActionsTestOtherA-1784608629-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:1a:53:06,bridge_name='br-int',has_traffic_filtering=True,id=d40a5800-7391-4206-a661-fbce50c35a65,network=Network(7c2c368e-4c7d-4d70-9a40-c10fe9541af9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd40a5800-73') {{(pid=74613) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 29 17:55:16 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:55:16 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74613) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 17:55:16 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74613) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 29 17:55:16 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:55:16 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '3e6b8a25-7cb8-591d-a307-733d3db208c6', '_type': 'linux-noop'}}, row=False) {{(pid=74613) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 17:55:16 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:55:16 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 17:55:16 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:55:16 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapd40a5800-73, may_exist=True, interface_attrs={}) {{(pid=74613) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 17:55:16 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapd40a5800-73, col_values=(('qos', UUID('e91e8df0-2a48-4b81-8cc5-edcc4c8bc823')),), if_exists=True) {{(pid=74613) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 17:55:16 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapd40a5800-73, col_values=(('external_ids', {'iface-id': 'd40a5800-7391-4206-a661-fbce50c35a65', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:1a:53:06', 'vm-uuid': '71f2a1ab-3df7-411c-93fa-b0a1a5a44f0a'}),), if_exists=True) {{(pid=74613) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 17:55:16 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:55:16 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0008521b-5a63-4ff6-8390-d343956900ed/disk --force-share --output=json" returned: 0 in 0.217s {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 17:55:16 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0008521b-5a63-4ff6-8390-d343956900ed/disk --force-share --output=json {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 17:55:16 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:55:16 user nova-compute[74613]: INFO os_vif [None req-dcf270e4-a3fe-4006-8488-d0e309d133ba tempest-ServerActionsTestOtherA-1784608629 tempest-ServerActionsTestOtherA-1784608629-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:1a:53:06,bridge_name='br-int',has_traffic_filtering=True,id=d40a5800-7391-4206-a661-fbce50c35a65,network=Network(7c2c368e-4c7d-4d70-9a40-c10fe9541af9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd40a5800-73')
Nov 29 17:55:16 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-dcf270e4-a3fe-4006-8488-d0e309d133ba tempest-ServerActionsTestOtherA-1784608629 tempest-ServerActionsTestOtherA-1784608629-project-member] No BDM found with device name vda, not building metadata. {{(pid=74613) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 17:55:16 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-dcf270e4-a3fe-4006-8488-d0e309d133ba tempest-ServerActionsTestOtherA-1784608629 tempest-ServerActionsTestOtherA-1784608629-project-member] No VIF found with MAC fa:16:3e:1a:53:06, not building metadata {{(pid=74613) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 29 17:55:16 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0008521b-5a63-4ff6-8390-d343956900ed/disk --force-share --output=json" returned: 0 in 0.222s {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 17:55:16 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b6b0ba36-ad89-45f1-9578-8b999567dd25/disk --force-share --output=json {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 17:55:16 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b6b0ba36-ad89-45f1-9578-8b999567dd25/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 17:55:16 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b6b0ba36-ad89-45f1-9578-8b999567dd25/disk --force-share --output=json {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 17:55:16 user nova-compute[74613]: DEBUG nova.network.neutron [req-136a4efc-75d3-4cbe-807b-1f4f7e2b7f06 req-8118f3d7-f9b4-4e56-bd6e-b92acd86e646 service nova] [instance: 71f2a1ab-3df7-411c-93fa-b0a1a5a44f0a] Updated VIF entry in instance network info cache for port d40a5800-7391-4206-a661-fbce50c35a65. {{(pid=74613) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 17:55:16 user nova-compute[74613]: DEBUG nova.network.neutron [req-136a4efc-75d3-4cbe-807b-1f4f7e2b7f06 req-8118f3d7-f9b4-4e56-bd6e-b92acd86e646 service nova] [instance: 71f2a1ab-3df7-411c-93fa-b0a1a5a44f0a] Updating instance_info_cache with network_info: [{"id": "d40a5800-7391-4206-a661-fbce50c35a65", "address": "fa:16:3e:1a:53:06", "network": {"id": "7c2c368e-4c7d-4d70-9a40-c10fe9541af9", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1287934102-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b1f70c311d4941c986de21ac458d11ab", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd40a5800-73", "ovs_interfaceid": "d40a5800-7391-4206-a661-fbce50c35a65", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74613) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 17:55:16 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-136a4efc-75d3-4cbe-807b-1f4f7e2b7f06 req-8118f3d7-f9b4-4e56-bd6e-b92acd86e646 service nova] Releasing lock "refresh_cache-71f2a1ab-3df7-411c-93fa-b0a1a5a44f0a" {{(pid=74613) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 17:55:16 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b6b0ba36-ad89-45f1-9578-8b999567dd25/disk --force-share --output=json" returned: 0 in 0.212s {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 17:55:16 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3b828860-5cc5-40b0-b845-8e560211794e/disk --force-share --output=json {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 17:55:16 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3b828860-5cc5-40b0-b845-8e560211794e/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 17:55:16 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3b828860-5cc5-40b0-b845-8e560211794e/disk --force-share --output=json {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 17:55:17 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3b828860-5cc5-40b0-b845-8e560211794e/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 17:55:17 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/abc9e2b8-f467-4cd0-b40f-de511fde1ec1/disk --force-share --output=json {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 17:55:17 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/abc9e2b8-f467-4cd0-b40f-de511fde1ec1/disk --force-share --output=json" returned: 0 in 0.211s {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 17:55:17 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/abc9e2b8-f467-4cd0-b40f-de511fde1ec1/disk --force-share --output=json {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 17:55:17 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/abc9e2b8-f467-4cd0-b40f-de511fde1ec1/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 17:55:17 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/288b8261-8706-4696-879d-d4dd01ab553e/disk --force-share --output=json {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 17:55:17 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/288b8261-8706-4696-879d-d4dd01ab553e/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 17:55:17 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/288b8261-8706-4696-879d-d4dd01ab553e/disk --force-share --output=json {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 17:55:17 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:55:17 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:55:17 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:55:17 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:55:17 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/288b8261-8706-4696-879d-d4dd01ab553e/disk --force-share --output=json" returned: 0 in 0.240s {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 17:55:17 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74613) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 29 17:55:20 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:55:20 user nova-compute[74613]: DEBUG nova.compute.manager [req-bcfc66d3-6829-418f-841a-b3bfdbcb1e7a req-798dff79-375d-4779-ba86-8a9d6c85f74d service nova] [instance: 71f2a1ab-3df7-411c-93fa-b0a1a5a44f0a] Received event network-vif-plugged-d40a5800-7391-4206-a661-fbce50c35a65 {{(pid=74613) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 17:55:20 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-bcfc66d3-6829-418f-841a-b3bfdbcb1e7a req-798dff79-375d-4779-ba86-8a9d6c85f74d service nova] Acquiring lock "71f2a1ab-3df7-411c-93fa-b0a1a5a44f0a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 17:55:20 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-bcfc66d3-6829-418f-841a-b3bfdbcb1e7a req-798dff79-375d-4779-ba86-8a9d6c85f74d service nova] Lock "71f2a1ab-3df7-411c-93fa-b0a1a5a44f0a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 17:55:20 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-bcfc66d3-6829-418f-841a-b3bfdbcb1e7a req-798dff79-375d-4779-ba86-8a9d6c85f74d service nova] Lock "71f2a1ab-3df7-411c-93fa-b0a1a5a44f0a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 17:55:20 user nova-compute[74613]: DEBUG nova.compute.manager [req-bcfc66d3-6829-418f-841a-b3bfdbcb1e7a req-798dff79-375d-4779-ba86-8a9d6c85f74d service nova] [instance: 71f2a1ab-3df7-411c-93fa-b0a1a5a44f0a] No waiting events found dispatching network-vif-plugged-d40a5800-7391-4206-a661-fbce50c35a65 {{(pid=74613) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 17:55:20 user nova-compute[74613]: WARNING nova.compute.manager [req-bcfc66d3-6829-418f-841a-b3bfdbcb1e7a req-798dff79-375d-4779-ba86-8a9d6c85f74d service nova] [instance: 71f2a1ab-3df7-411c-93fa-b0a1a5a44f0a] Received unexpected event network-vif-plugged-d40a5800-7391-4206-a661-fbce50c35a65 for instance with vm_state building and task_state spawning.
Nov 29 17:55:20 user nova-compute[74613]: DEBUG nova.compute.manager [None req-dcf270e4-a3fe-4006-8488-d0e309d133ba tempest-ServerActionsTestOtherA-1784608629 tempest-ServerActionsTestOtherA-1784608629-project-member] [instance: 71f2a1ab-3df7-411c-93fa-b0a1a5a44f0a] Instance event wait completed in 0 seconds for  {{(pid=74613) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 29 17:55:20 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-dcf270e4-a3fe-4006-8488-d0e309d133ba tempest-ServerActionsTestOtherA-1784608629 tempest-ServerActionsTestOtherA-1784608629-project-member] [instance: 71f2a1ab-3df7-411c-93fa-b0a1a5a44f0a] Guest created on hypervisor {{(pid=74613) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 29 17:55:20 user nova-compute[74613]: INFO nova.virt.libvirt.driver [-] [instance: 71f2a1ab-3df7-411c-93fa-b0a1a5a44f0a] Instance spawned successfully.
Nov 29 17:55:20 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-dcf270e4-a3fe-4006-8488-d0e309d133ba tempest-ServerActionsTestOtherA-1784608629 tempest-ServerActionsTestOtherA-1784608629-project-member] [instance: 71f2a1ab-3df7-411c-93fa-b0a1a5a44f0a] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74613) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 29 17:55:20 user nova-compute[74613]: WARNING nova.virt.libvirt.driver [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 17:55:20 user nova-compute[74613]: WARNING nova.virt.libvirt.driver [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 17:55:20 user nova-compute[74613]: DEBUG nova.compute.resource_tracker [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Hypervisor/Node resource view: name=user free_ram=8295MB free_disk=25.270870208740234GB free_vcpus=6 pci_devices=[{"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74613) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 29 17:55:20 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 17:55:20 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 17:55:20 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-ce4e517a-1c71-4dab-8e8a-c3a4433244bb tempest-TaggedAttachmentsTest-1438740121 tempest-TaggedAttachmentsTest-1438740121-project-member] Acquiring lock "288b8261-8706-4696-879d-d4dd01ab553e" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 17:55:20 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-ce4e517a-1c71-4dab-8e8a-c3a4433244bb tempest-TaggedAttachmentsTest-1438740121 tempest-TaggedAttachmentsTest-1438740121-project-member] Lock "288b8261-8706-4696-879d-d4dd01ab553e" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 17:55:20 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-ce4e517a-1c71-4dab-8e8a-c3a4433244bb tempest-TaggedAttachmentsTest-1438740121 tempest-TaggedAttachmentsTest-1438740121-project-member] Acquiring lock "288b8261-8706-4696-879d-d4dd01ab553e-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 17:55:20 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-ce4e517a-1c71-4dab-8e8a-c3a4433244bb tempest-TaggedAttachmentsTest-1438740121 tempest-TaggedAttachmentsTest-1438740121-project-member] Lock "288b8261-8706-4696-879d-d4dd01ab553e-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 17:55:20 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-ce4e517a-1c71-4dab-8e8a-c3a4433244bb tempest-TaggedAttachmentsTest-1438740121 tempest-TaggedAttachmentsTest-1438740121-project-member] Lock "288b8261-8706-4696-879d-d4dd01ab553e-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 17:55:20 user nova-compute[74613]: INFO nova.compute.manager [None req-ce4e517a-1c71-4dab-8e8a-c3a4433244bb tempest-TaggedAttachmentsTest-1438740121 tempest-TaggedAttachmentsTest-1438740121-project-member] [instance: 288b8261-8706-4696-879d-d4dd01ab553e] Terminating instance
Nov 29 17:55:20 user nova-compute[74613]: DEBUG nova.compute.manager [None req-ce4e517a-1c71-4dab-8e8a-c3a4433244bb tempest-TaggedAttachmentsTest-1438740121 tempest-TaggedAttachmentsTest-1438740121-project-member] [instance: 288b8261-8706-4696-879d-d4dd01ab553e] Start destroying the instance on the hypervisor. {{(pid=74613) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 29 17:55:20 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-dcf270e4-a3fe-4006-8488-d0e309d133ba tempest-ServerActionsTestOtherA-1784608629 tempest-ServerActionsTestOtherA-1784608629-project-member] [instance: 71f2a1ab-3df7-411c-93fa-b0a1a5a44f0a] Found default for hw_cdrom_bus of ide {{(pid=74613) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 17:55:20 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-dcf270e4-a3fe-4006-8488-d0e309d133ba tempest-ServerActionsTestOtherA-1784608629 tempest-ServerActionsTestOtherA-1784608629-project-member] [instance: 71f2a1ab-3df7-411c-93fa-b0a1a5a44f0a] Found default for hw_disk_bus of virtio {{(pid=74613) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 17:55:20 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-dcf270e4-a3fe-4006-8488-d0e309d133ba tempest-ServerActionsTestOtherA-1784608629 tempest-ServerActionsTestOtherA-1784608629-project-member] [instance: 71f2a1ab-3df7-411c-93fa-b0a1a5a44f0a] Found default for hw_input_bus of None {{(pid=74613) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 17:55:20 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-dcf270e4-a3fe-4006-8488-d0e309d133ba tempest-ServerActionsTestOtherA-1784608629 tempest-ServerActionsTestOtherA-1784608629-project-member] [instance: 71f2a1ab-3df7-411c-93fa-b0a1a5a44f0a] Found default for hw_pointer_model of None {{(pid=74613) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 17:55:20 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-dcf270e4-a3fe-4006-8488-d0e309d133ba tempest-ServerActionsTestOtherA-1784608629 tempest-ServerActionsTestOtherA-1784608629-project-member] [instance: 71f2a1ab-3df7-411c-93fa-b0a1a5a44f0a] Found default for hw_video_model of virtio {{(pid=74613) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 17:55:20 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-dcf270e4-a3fe-4006-8488-d0e309d133ba tempest-ServerActionsTestOtherA-1784608629 tempest-ServerActionsTestOtherA-1784608629-project-member] [instance: 71f2a1ab-3df7-411c-93fa-b0a1a5a44f0a] Found default for hw_vif_model of virtio {{(pid=74613) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 17:55:20 user nova-compute[74613]: DEBUG nova.compute.manager [req-dfc2b6b2-39c6-4640-a725-33b14a50a9fe req-0800113c-20ae-491d-a1c5-3ef2890b53ee service nova] [instance: 71f2a1ab-3df7-411c-93fa-b0a1a5a44f0a] Received event network-vif-plugged-d40a5800-7391-4206-a661-fbce50c35a65 {{(pid=74613) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 17:55:20 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-dfc2b6b2-39c6-4640-a725-33b14a50a9fe req-0800113c-20ae-491d-a1c5-3ef2890b53ee service nova] Acquiring lock "71f2a1ab-3df7-411c-93fa-b0a1a5a44f0a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 17:55:20 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-dfc2b6b2-39c6-4640-a725-33b14a50a9fe req-0800113c-20ae-491d-a1c5-3ef2890b53ee service nova] Lock "71f2a1ab-3df7-411c-93fa-b0a1a5a44f0a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 17:55:20 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-dfc2b6b2-39c6-4640-a725-33b14a50a9fe req-0800113c-20ae-491d-a1c5-3ef2890b53ee service nova] Lock "71f2a1ab-3df7-411c-93fa-b0a1a5a44f0a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 17:55:20 user nova-compute[74613]: DEBUG nova.compute.manager [req-dfc2b6b2-39c6-4640-a725-33b14a50a9fe req-0800113c-20ae-491d-a1c5-3ef2890b53ee service nova] [instance: 71f2a1ab-3df7-411c-93fa-b0a1a5a44f0a] No waiting events found dispatching network-vif-plugged-d40a5800-7391-4206-a661-fbce50c35a65 {{(pid=74613) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 17:55:20 user nova-compute[74613]: WARNING nova.compute.manager [req-dfc2b6b2-39c6-4640-a725-33b14a50a9fe req-0800113c-20ae-491d-a1c5-3ef2890b53ee service nova] [instance: 71f2a1ab-3df7-411c-93fa-b0a1a5a44f0a] Received unexpected event network-vif-plugged-d40a5800-7391-4206-a661-fbce50c35a65 for instance with vm_state building and task_state spawning.
Nov 29 17:55:20 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:55:20 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:55:20 user nova-compute[74613]: INFO nova.compute.manager [None req-dcf270e4-a3fe-4006-8488-d0e309d133ba tempest-ServerActionsTestOtherA-1784608629 tempest-ServerActionsTestOtherA-1784608629-project-member] [instance: 71f2a1ab-3df7-411c-93fa-b0a1a5a44f0a] Took 7.54 seconds to spawn the instance on the hypervisor.
Nov 29 17:55:20 user nova-compute[74613]: DEBUG nova.compute.manager [None req-dcf270e4-a3fe-4006-8488-d0e309d133ba tempest-ServerActionsTestOtherA-1784608629 tempest-ServerActionsTestOtherA-1784608629-project-member] [instance: 71f2a1ab-3df7-411c-93fa-b0a1a5a44f0a] Checking state {{(pid=74613) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 29 17:55:20 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:55:20 user nova-compute[74613]: DEBUG nova.compute.resource_tracker [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Instance b6b0ba36-ad89-45f1-9578-8b999567dd25 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74613) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 17:55:20 user nova-compute[74613]: DEBUG nova.compute.resource_tracker [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Instance 3b828860-5cc5-40b0-b845-8e560211794e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74613) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 17:55:20 user nova-compute[74613]: DEBUG nova.compute.resource_tracker [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Instance abc9e2b8-f467-4cd0-b40f-de511fde1ec1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74613) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 17:55:20 user nova-compute[74613]: DEBUG nova.compute.resource_tracker [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Instance 0008521b-5a63-4ff6-8390-d343956900ed actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74613) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 17:55:20 user nova-compute[74613]: DEBUG nova.compute.resource_tracker [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Instance 288b8261-8706-4696-879d-d4dd01ab553e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74613) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 17:55:20 user nova-compute[74613]: DEBUG nova.compute.resource_tracker [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Instance cd22685a-028c-4e0c-834d-e7b20f6d06ab actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74613) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 17:55:20 user nova-compute[74613]: DEBUG nova.compute.resource_tracker [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Instance 71f2a1ab-3df7-411c-93fa-b0a1a5a44f0a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74613) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 17:55:20 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:55:20 user nova-compute[74613]: DEBUG nova.compute.resource_tracker [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Instance c19e230e-2e6c-4c20-b15c-ad81a73674b4 has been scheduled to this compute host, the scheduler has made an allocation against this compute node but the instance has yet to start. Skipping heal of allocation: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74613) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1761}}
Nov 29 17:55:20 user nova-compute[74613]: DEBUG nova.compute.resource_tracker [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Total usable vcpus: 12, total allocated vcpus: 7 {{(pid=74613) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 29 17:55:20 user nova-compute[74613]: DEBUG nova.compute.resource_tracker [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Final resource view: name=user phys_ram=16011MB used_ram=4096MB phys_disk=40GB used_disk=6GB total_vcpus=12 used_vcpus=7 pci_stats=[] {{(pid=74613) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 29 17:55:20 user nova-compute[74613]: INFO nova.compute.manager [None req-dcf270e4-a3fe-4006-8488-d0e309d133ba tempest-ServerActionsTestOtherA-1784608629 tempest-ServerActionsTestOtherA-1784608629-project-member] [instance: 71f2a1ab-3df7-411c-93fa-b0a1a5a44f0a] Took 8.39 seconds to build instance.
Nov 29 17:55:20 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-dcf270e4-a3fe-4006-8488-d0e309d133ba tempest-ServerActionsTestOtherA-1784608629 tempest-ServerActionsTestOtherA-1784608629-project-member] Lock "71f2a1ab-3df7-411c-93fa-b0a1a5a44f0a" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.487s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 17:55:20 user nova-compute[74613]: DEBUG nova.compute.manager [req-5c5f79c4-5f58-4ac8-8176-024ed24cfe84 req-ce3ac085-2f68-4f86-95c5-fa6de84c3f2a service nova] [instance: 288b8261-8706-4696-879d-d4dd01ab553e] Received event network-vif-unplugged-abe5d419-60cc-474c-935a-60f5512894e0 {{(pid=74613) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 17:55:20 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-5c5f79c4-5f58-4ac8-8176-024ed24cfe84 req-ce3ac085-2f68-4f86-95c5-fa6de84c3f2a service nova] Acquiring lock "288b8261-8706-4696-879d-d4dd01ab553e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 17:55:20 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-5c5f79c4-5f58-4ac8-8176-024ed24cfe84 req-ce3ac085-2f68-4f86-95c5-fa6de84c3f2a service nova] Lock "288b8261-8706-4696-879d-d4dd01ab553e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 17:55:20 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-5c5f79c4-5f58-4ac8-8176-024ed24cfe84 req-ce3ac085-2f68-4f86-95c5-fa6de84c3f2a service nova] Lock "288b8261-8706-4696-879d-d4dd01ab553e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 17:55:20 user nova-compute[74613]: DEBUG nova.compute.manager [req-5c5f79c4-5f58-4ac8-8176-024ed24cfe84 req-ce3ac085-2f68-4f86-95c5-fa6de84c3f2a service nova] [instance: 288b8261-8706-4696-879d-d4dd01ab553e] No waiting events found dispatching network-vif-unplugged-abe5d419-60cc-474c-935a-60f5512894e0 {{(pid=74613) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 17:55:20 user nova-compute[74613]: DEBUG nova.compute.manager [req-5c5f79c4-5f58-4ac8-8176-024ed24cfe84 req-ce3ac085-2f68-4f86-95c5-fa6de84c3f2a service nova] [instance: 288b8261-8706-4696-879d-d4dd01ab553e] Received event network-vif-unplugged-abe5d419-60cc-474c-935a-60f5512894e0 for instance with task_state deleting. {{(pid=74613) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 29 17:55:21 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:55:21 user nova-compute[74613]: DEBUG nova.compute.provider_tree [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Inventory has not changed in ProviderTree for provider: 639d980e-3b12-44b1-b8f4-1812416fa4dd {{(pid=74613) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 17:55:21 user nova-compute[74613]: DEBUG nova.scheduler.client.report [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Inventory has not changed for provider 639d980e-3b12-44b1-b8f4-1812416fa4dd based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74613) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 17:55:21 user nova-compute[74613]: DEBUG nova.compute.resource_tracker [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Compute_service record updated for user:user {{(pid=74613) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 29 17:55:21 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.886s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 17:55:21 user nova-compute[74613]: INFO nova.virt.libvirt.driver [-] [instance: 288b8261-8706-4696-879d-d4dd01ab553e] Instance destroyed successfully.
Nov 29 17:55:21 user nova-compute[74613]: DEBUG nova.objects.instance [None req-ce4e517a-1c71-4dab-8e8a-c3a4433244bb tempest-TaggedAttachmentsTest-1438740121 tempest-TaggedAttachmentsTest-1438740121-project-member] Lazy-loading 'resources' on Instance uuid 288b8261-8706-4696-879d-d4dd01ab553e {{(pid=74613) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 17:55:21 user nova-compute[74613]: DEBUG nova.virt.libvirt.vif [None req-ce4e517a-1c71-4dab-8e8a-c3a4433244bb tempest-TaggedAttachmentsTest-1438740121 tempest-TaggedAttachmentsTest-1438740121-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-29T17:51:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-697059192',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-697059192',id=8,image_ref='4217f428-8d9d-4ee1-9614-642d26d90c46',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFUFE7U0lYNK45/HsStCT3AXLpdrJnwoY/KNgsNZxe8b6bxv4jkHRb2DHfVVdKmIkJ56BYNQ81Tfxi8bOx3gLzOij7zz7pkeTvdmFF3bs2gbkvzpJfe42Gy5jL3poiHfSw==',key_name='tempest-keypair-587676949',keypairs=<?>,launch_index=0,launched_at=2023-11-29T17:52:07Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='fdebfa0bb4bf45338ce3fa1ded5cd5bd',ramdisk_id='',reservation_id='r-cg74z5d5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='4217f428-8d9d-4ee1-9614-642d26d90c46',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-1438740121',owner_user_name='tempest-TaggedAttachmentsTest-1438740121-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-29T17:52:07Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='52aa43eddf17484b9823bf13f548d22b',uuid=288b8261-8706-4696-879d-d4dd01ab553e,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "abe5d419-60cc-474c-935a-60f5512894e0", "address": "fa:16:3e:14:7b:54", "network": {"id": "3a1d6151-a950-475c-af8a-d15174f89822", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1729826224-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.29", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fdebfa0bb4bf45338ce3fa1ded5cd5bd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapabe5d419-60", "ovs_interfaceid": "abe5d419-60cc-474c-935a-60f5512894e0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74613) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 29 17:55:21 user nova-compute[74613]: DEBUG nova.network.os_vif_util [None req-ce4e517a-1c71-4dab-8e8a-c3a4433244bb tempest-TaggedAttachmentsTest-1438740121 tempest-TaggedAttachmentsTest-1438740121-project-member] Converting VIF {"id": "abe5d419-60cc-474c-935a-60f5512894e0", "address": "fa:16:3e:14:7b:54", "network": {"id": "3a1d6151-a950-475c-af8a-d15174f89822", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1729826224-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.29", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fdebfa0bb4bf45338ce3fa1ded5cd5bd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapabe5d419-60", "ovs_interfaceid": "abe5d419-60cc-474c-935a-60f5512894e0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74613) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 17:55:21 user nova-compute[74613]: DEBUG nova.network.os_vif_util [None req-ce4e517a-1c71-4dab-8e8a-c3a4433244bb tempest-TaggedAttachmentsTest-1438740121 tempest-TaggedAttachmentsTest-1438740121-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:14:7b:54,bridge_name='br-int',has_traffic_filtering=True,id=abe5d419-60cc-474c-935a-60f5512894e0,network=Network(3a1d6151-a950-475c-af8a-d15174f89822),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapabe5d419-60') {{(pid=74613) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 17:55:21 user nova-compute[74613]: DEBUG os_vif [None req-ce4e517a-1c71-4dab-8e8a-c3a4433244bb tempest-TaggedAttachmentsTest-1438740121 tempest-TaggedAttachmentsTest-1438740121-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:14:7b:54,bridge_name='br-int',has_traffic_filtering=True,id=abe5d419-60cc-474c-935a-60f5512894e0,network=Network(3a1d6151-a950-475c-af8a-d15174f89822),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapabe5d419-60') {{(pid=74613) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 29 17:55:21 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:55:21 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapabe5d419-60, bridge=br-int, if_exists=True) {{(pid=74613) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 17:55:21 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:55:21 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 17:55:21 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:55:21 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=c3fabfe3-bfad-4b26-8945-e80f689cabf9) {{(pid=74613) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 17:55:21 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:55:21 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 17:55:21 user nova-compute[74613]: INFO os_vif [None req-ce4e517a-1c71-4dab-8e8a-c3a4433244bb tempest-TaggedAttachmentsTest-1438740121 tempest-TaggedAttachmentsTest-1438740121-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:14:7b:54,bridge_name='br-int',has_traffic_filtering=True,id=abe5d419-60cc-474c-935a-60f5512894e0,network=Network(3a1d6151-a950-475c-af8a-d15174f89822),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapabe5d419-60')
Nov 29 17:55:21 user nova-compute[74613]: INFO nova.virt.libvirt.driver [None req-ce4e517a-1c71-4dab-8e8a-c3a4433244bb tempest-TaggedAttachmentsTest-1438740121 tempest-TaggedAttachmentsTest-1438740121-project-member] [instance: 288b8261-8706-4696-879d-d4dd01ab553e] Deleting instance files /opt/stack/data/nova/instances/288b8261-8706-4696-879d-d4dd01ab553e_del
Nov 29 17:55:21 user nova-compute[74613]: INFO nova.virt.libvirt.driver [None req-ce4e517a-1c71-4dab-8e8a-c3a4433244bb tempest-TaggedAttachmentsTest-1438740121 tempest-TaggedAttachmentsTest-1438740121-project-member] [instance: 288b8261-8706-4696-879d-d4dd01ab553e] Deletion of /opt/stack/data/nova/instances/288b8261-8706-4696-879d-d4dd01ab553e_del complete
Nov 29 17:55:21 user nova-compute[74613]: INFO nova.compute.manager [None req-ce4e517a-1c71-4dab-8e8a-c3a4433244bb tempest-TaggedAttachmentsTest-1438740121 tempest-TaggedAttachmentsTest-1438740121-project-member] [instance: 288b8261-8706-4696-879d-d4dd01ab553e] Took 1.05 seconds to destroy the instance on the hypervisor.
Nov 29 17:55:21 user nova-compute[74613]: DEBUG oslo.service.loopingcall [None req-ce4e517a-1c71-4dab-8e8a-c3a4433244bb tempest-TaggedAttachmentsTest-1438740121 tempest-TaggedAttachmentsTest-1438740121-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74613) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 29 17:55:21 user nova-compute[74613]: DEBUG nova.compute.manager [-] [instance: 288b8261-8706-4696-879d-d4dd01ab553e] Deallocating network for instance {{(pid=74613) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 29 17:55:21 user nova-compute[74613]: DEBUG nova.network.neutron [-] [instance: 288b8261-8706-4696-879d-d4dd01ab553e] deallocate_for_instance() {{(pid=74613) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 29 17:55:22 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-c178e9e6-c6d5-411d-bfbb-37bcd739f153 tempest-TestVolumeSwap-281539251 tempest-TestVolumeSwap-281539251-project-member] Acquiring lock "0008521b-5a63-4ff6-8390-d343956900ed" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 17:55:22 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-c178e9e6-c6d5-411d-bfbb-37bcd739f153 tempest-TestVolumeSwap-281539251 tempest-TestVolumeSwap-281539251-project-member] Lock "0008521b-5a63-4ff6-8390-d343956900ed" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 17:55:22 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-c178e9e6-c6d5-411d-bfbb-37bcd739f153 tempest-TestVolumeSwap-281539251 tempest-TestVolumeSwap-281539251-project-member] Acquiring lock "0008521b-5a63-4ff6-8390-d343956900ed-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 17:55:22 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-c178e9e6-c6d5-411d-bfbb-37bcd739f153 tempest-TestVolumeSwap-281539251 tempest-TestVolumeSwap-281539251-project-member] Lock "0008521b-5a63-4ff6-8390-d343956900ed-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 17:55:22 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-c178e9e6-c6d5-411d-bfbb-37bcd739f153 tempest-TestVolumeSwap-281539251 tempest-TestVolumeSwap-281539251-project-member] Lock "0008521b-5a63-4ff6-8390-d343956900ed-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 17:55:22 user nova-compute[74613]: INFO nova.compute.manager [None req-c178e9e6-c6d5-411d-bfbb-37bcd739f153 tempest-TestVolumeSwap-281539251 tempest-TestVolumeSwap-281539251-project-member] [instance: 0008521b-5a63-4ff6-8390-d343956900ed] Terminating instance
Nov 29 17:55:22 user nova-compute[74613]: DEBUG nova.compute.manager [None req-c178e9e6-c6d5-411d-bfbb-37bcd739f153 tempest-TestVolumeSwap-281539251 tempest-TestVolumeSwap-281539251-project-member] [instance: 0008521b-5a63-4ff6-8390-d343956900ed] Start destroying the instance on the hypervisor. {{(pid=74613) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 29 17:55:22 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:55:22 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:55:22 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:55:22 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:55:22 user nova-compute[74613]: DEBUG oslo_service.periodic_task [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74613) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 17:55:22 user nova-compute[74613]: DEBUG oslo_service.periodic_task [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74613) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 17:55:22 user nova-compute[74613]: DEBUG oslo_service.periodic_task [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74613) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 17:55:22 user nova-compute[74613]: DEBUG oslo_service.periodic_task [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74613) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 17:55:22 user nova-compute[74613]: DEBUG oslo_service.periodic_task [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74613) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 17:55:22 user nova-compute[74613]: DEBUG oslo_service.periodic_task [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74613) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 17:55:22 user nova-compute[74613]: DEBUG nova.compute.manager [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74613) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 29 17:55:22 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:55:22 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:55:22 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:55:22 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:55:22 user nova-compute[74613]: INFO nova.virt.libvirt.driver [-] [instance: 0008521b-5a63-4ff6-8390-d343956900ed] Instance destroyed successfully.
Nov 29 17:55:22 user nova-compute[74613]: DEBUG nova.objects.instance [None req-c178e9e6-c6d5-411d-bfbb-37bcd739f153 tempest-TestVolumeSwap-281539251 tempest-TestVolumeSwap-281539251-project-member] Lazy-loading 'resources' on Instance uuid 0008521b-5a63-4ff6-8390-d343956900ed {{(pid=74613) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 17:55:22 user nova-compute[74613]: DEBUG nova.virt.libvirt.vif [None req-c178e9e6-c6d5-411d-bfbb-37bcd739f153 tempest-TestVolumeSwap-281539251 tempest-TestVolumeSwap-281539251-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T17:51:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeSwap-server-218030512',display_name='tempest-TestVolumeSwap-server-218030512',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumeswap-server-218030512',id=7,image_ref='4217f428-8d9d-4ee1-9614-642d26d90c46',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNJQmAnpjs0d7jnHfHx9i2Opr87NGLCiRvOJ25vj2fGFEFNmUf1tkbMQEACJJtcYUkNZVfy7fzdIpSxEwzCQdBpAM1XPa4NsD9C2YvVYIKhrabQUdtfgX59pF1xaGx7MpQ==',key_name='tempest-keypair-1980594367',keypairs=<?>,launch_index=0,launched_at=2023-11-29T17:52:00Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='6d9f2fb92a21448d9c935927066d5372',ramdisk_id='',reservation_id='r-9djktafb',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='4217f428-8d9d-4ee1-9614-642d26d90c46',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeSwap-281539251',owner_user_name='tempest-TestVolumeSwap-281539251-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-29T17:52:01Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2d81946191fc40fd8909ac93ae862331',uuid=0008521b-5a63-4ff6-8390-d343956900ed,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "0ab94891-565e-4864-b6ba-565056b40005", "address": "fa:16:3e:7e:c4:dc", "network": {"id": "8955d6de-e65e-431d-80b4-420aeda27329", "bridge": "br-int", "label": "tempest-TestVolumeSwap-241933908-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.35", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6d9f2fb92a21448d9c935927066d5372", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0ab94891-56", "ovs_interfaceid": "0ab94891-565e-4864-b6ba-565056b40005", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74613) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 29 17:55:22 user nova-compute[74613]: DEBUG nova.network.os_vif_util [None req-c178e9e6-c6d5-411d-bfbb-37bcd739f153 tempest-TestVolumeSwap-281539251 tempest-TestVolumeSwap-281539251-project-member] Converting VIF {"id": "0ab94891-565e-4864-b6ba-565056b40005", "address": "fa:16:3e:7e:c4:dc", "network": {"id": "8955d6de-e65e-431d-80b4-420aeda27329", "bridge": "br-int", "label": "tempest-TestVolumeSwap-241933908-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.35", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6d9f2fb92a21448d9c935927066d5372", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0ab94891-56", "ovs_interfaceid": "0ab94891-565e-4864-b6ba-565056b40005", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74613) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 17:55:22 user nova-compute[74613]: DEBUG nova.network.os_vif_util [None req-c178e9e6-c6d5-411d-bfbb-37bcd739f153 tempest-TestVolumeSwap-281539251 tempest-TestVolumeSwap-281539251-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:7e:c4:dc,bridge_name='br-int',has_traffic_filtering=True,id=0ab94891-565e-4864-b6ba-565056b40005,network=Network(8955d6de-e65e-431d-80b4-420aeda27329),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0ab94891-56') {{(pid=74613) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 17:55:22 user nova-compute[74613]: DEBUG os_vif [None req-c178e9e6-c6d5-411d-bfbb-37bcd739f153 tempest-TestVolumeSwap-281539251 tempest-TestVolumeSwap-281539251-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:7e:c4:dc,bridge_name='br-int',has_traffic_filtering=True,id=0ab94891-565e-4864-b6ba-565056b40005,network=Network(8955d6de-e65e-431d-80b4-420aeda27329),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0ab94891-56') {{(pid=74613) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 29 17:55:22 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:55:22 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap0ab94891-56, bridge=br-int, if_exists=True) {{(pid=74613) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 17:55:22 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:55:22 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 17:55:22 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:55:22 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=f6e7e350-4f7e-49d3-9da2-7c4ca2a73420) {{(pid=74613) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 17:55:22 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:55:22 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:55:22 user nova-compute[74613]: INFO os_vif [None req-c178e9e6-c6d5-411d-bfbb-37bcd739f153 tempest-TestVolumeSwap-281539251 tempest-TestVolumeSwap-281539251-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:7e:c4:dc,bridge_name='br-int',has_traffic_filtering=True,id=0ab94891-565e-4864-b6ba-565056b40005,network=Network(8955d6de-e65e-431d-80b4-420aeda27329),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0ab94891-56')
Nov 29 17:55:22 user nova-compute[74613]: INFO nova.virt.libvirt.driver [None req-c178e9e6-c6d5-411d-bfbb-37bcd739f153 tempest-TestVolumeSwap-281539251 tempest-TestVolumeSwap-281539251-project-member] [instance: 0008521b-5a63-4ff6-8390-d343956900ed] Deleting instance files /opt/stack/data/nova/instances/0008521b-5a63-4ff6-8390-d343956900ed_del
Nov 29 17:55:22 user nova-compute[74613]: INFO nova.virt.libvirt.driver [None req-c178e9e6-c6d5-411d-bfbb-37bcd739f153 tempest-TestVolumeSwap-281539251 tempest-TestVolumeSwap-281539251-project-member] [instance: 0008521b-5a63-4ff6-8390-d343956900ed] Deletion of /opt/stack/data/nova/instances/0008521b-5a63-4ff6-8390-d343956900ed_del complete
Nov 29 17:55:22 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:55:23 user nova-compute[74613]: DEBUG nova.network.neutron [-] [instance: 288b8261-8706-4696-879d-d4dd01ab553e] Updating instance_info_cache with network_info: [] {{(pid=74613) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 17:55:23 user nova-compute[74613]: INFO nova.compute.manager [-] [instance: 288b8261-8706-4696-879d-d4dd01ab553e] Took 1.42 seconds to deallocate network for instance.
Nov 29 17:55:23 user nova-compute[74613]: INFO nova.compute.manager [None req-c178e9e6-c6d5-411d-bfbb-37bcd739f153 tempest-TestVolumeSwap-281539251 tempest-TestVolumeSwap-281539251-project-member] [instance: 0008521b-5a63-4ff6-8390-d343956900ed] Took 1.06 seconds to destroy the instance on the hypervisor.
Nov 29 17:55:23 user nova-compute[74613]: DEBUG oslo.service.loopingcall [None req-c178e9e6-c6d5-411d-bfbb-37bcd739f153 tempest-TestVolumeSwap-281539251 tempest-TestVolumeSwap-281539251-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74613) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 29 17:55:23 user nova-compute[74613]: DEBUG nova.compute.manager [-] [instance: 0008521b-5a63-4ff6-8390-d343956900ed] Deallocating network for instance {{(pid=74613) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 29 17:55:23 user nova-compute[74613]: DEBUG nova.network.neutron [-] [instance: 0008521b-5a63-4ff6-8390-d343956900ed] deallocate_for_instance() {{(pid=74613) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 29 17:55:23 user nova-compute[74613]: DEBUG nova.compute.manager [req-d146ba9f-b138-432a-bbe1-706052c8f732 req-1b34b127-75fd-44d0-a614-c5e4f8afcbf5 service nova] [instance: 288b8261-8706-4696-879d-d4dd01ab553e] Received event network-vif-plugged-abe5d419-60cc-474c-935a-60f5512894e0 {{(pid=74613) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 17:55:23 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-d146ba9f-b138-432a-bbe1-706052c8f732 req-1b34b127-75fd-44d0-a614-c5e4f8afcbf5 service nova] Acquiring lock "288b8261-8706-4696-879d-d4dd01ab553e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 17:55:23 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-d146ba9f-b138-432a-bbe1-706052c8f732 req-1b34b127-75fd-44d0-a614-c5e4f8afcbf5 service nova] Lock "288b8261-8706-4696-879d-d4dd01ab553e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 17:55:23 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-d146ba9f-b138-432a-bbe1-706052c8f732 req-1b34b127-75fd-44d0-a614-c5e4f8afcbf5 service nova] Lock "288b8261-8706-4696-879d-d4dd01ab553e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 17:55:23 user nova-compute[74613]: DEBUG nova.compute.manager [req-d146ba9f-b138-432a-bbe1-706052c8f732 req-1b34b127-75fd-44d0-a614-c5e4f8afcbf5 service nova] [instance: 288b8261-8706-4696-879d-d4dd01ab553e] No waiting events found dispatching network-vif-plugged-abe5d419-60cc-474c-935a-60f5512894e0 {{(pid=74613) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 17:55:23 user nova-compute[74613]: WARNING nova.compute.manager [req-d146ba9f-b138-432a-bbe1-706052c8f732 req-1b34b127-75fd-44d0-a614-c5e4f8afcbf5 service nova] [instance: 288b8261-8706-4696-879d-d4dd01ab553e] Received unexpected event network-vif-plugged-abe5d419-60cc-474c-935a-60f5512894e0 for instance with vm_state active and task_state deleting.
Nov 29 17:55:23 user nova-compute[74613]: DEBUG nova.compute.manager [req-d146ba9f-b138-432a-bbe1-706052c8f732 req-1b34b127-75fd-44d0-a614-c5e4f8afcbf5 service nova] [instance: 0008521b-5a63-4ff6-8390-d343956900ed] Received event network-vif-unplugged-0ab94891-565e-4864-b6ba-565056b40005 {{(pid=74613) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 17:55:23 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-d146ba9f-b138-432a-bbe1-706052c8f732 req-1b34b127-75fd-44d0-a614-c5e4f8afcbf5 service nova] Acquiring lock "0008521b-5a63-4ff6-8390-d343956900ed-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 17:55:23 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-d146ba9f-b138-432a-bbe1-706052c8f732 req-1b34b127-75fd-44d0-a614-c5e4f8afcbf5 service nova] Lock "0008521b-5a63-4ff6-8390-d343956900ed-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 17:55:23 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-d146ba9f-b138-432a-bbe1-706052c8f732 req-1b34b127-75fd-44d0-a614-c5e4f8afcbf5 service nova] Lock "0008521b-5a63-4ff6-8390-d343956900ed-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 17:55:23 user nova-compute[74613]: DEBUG nova.compute.manager [req-d146ba9f-b138-432a-bbe1-706052c8f732 req-1b34b127-75fd-44d0-a614-c5e4f8afcbf5 service nova] [instance: 0008521b-5a63-4ff6-8390-d343956900ed] No waiting events found dispatching network-vif-unplugged-0ab94891-565e-4864-b6ba-565056b40005 {{(pid=74613) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 17:55:23 user nova-compute[74613]: DEBUG nova.compute.manager [req-d146ba9f-b138-432a-bbe1-706052c8f732 req-1b34b127-75fd-44d0-a614-c5e4f8afcbf5 service nova] [instance: 0008521b-5a63-4ff6-8390-d343956900ed] Received event network-vif-unplugged-0ab94891-565e-4864-b6ba-565056b40005 for instance with task_state deleting. {{(pid=74613) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 29 17:55:23 user nova-compute[74613]: DEBUG nova.compute.manager [req-d146ba9f-b138-432a-bbe1-706052c8f732 req-1b34b127-75fd-44d0-a614-c5e4f8afcbf5 service nova] [instance: 288b8261-8706-4696-879d-d4dd01ab553e] Received event network-vif-deleted-abe5d419-60cc-474c-935a-60f5512894e0 {{(pid=74613) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 17:55:23 user nova-compute[74613]: DEBUG nova.compute.manager [req-d146ba9f-b138-432a-bbe1-706052c8f732 req-1b34b127-75fd-44d0-a614-c5e4f8afcbf5 service nova] [instance: 0008521b-5a63-4ff6-8390-d343956900ed] Received event network-vif-plugged-0ab94891-565e-4864-b6ba-565056b40005 {{(pid=74613) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 17:55:23 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-d146ba9f-b138-432a-bbe1-706052c8f732 req-1b34b127-75fd-44d0-a614-c5e4f8afcbf5 service nova] Acquiring lock "0008521b-5a63-4ff6-8390-d343956900ed-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 17:55:23 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-d146ba9f-b138-432a-bbe1-706052c8f732 req-1b34b127-75fd-44d0-a614-c5e4f8afcbf5 service nova] Lock "0008521b-5a63-4ff6-8390-d343956900ed-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 17:55:23 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-d146ba9f-b138-432a-bbe1-706052c8f732 req-1b34b127-75fd-44d0-a614-c5e4f8afcbf5 service nova] Lock "0008521b-5a63-4ff6-8390-d343956900ed-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 17:55:23 user nova-compute[74613]: DEBUG nova.compute.manager [req-d146ba9f-b138-432a-bbe1-706052c8f732 req-1b34b127-75fd-44d0-a614-c5e4f8afcbf5 service nova] [instance: 0008521b-5a63-4ff6-8390-d343956900ed] No waiting events found dispatching network-vif-plugged-0ab94891-565e-4864-b6ba-565056b40005 {{(pid=74613) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 17:55:23 user nova-compute[74613]: WARNING nova.compute.manager [req-d146ba9f-b138-432a-bbe1-706052c8f732 req-1b34b127-75fd-44d0-a614-c5e4f8afcbf5 service nova] [instance: 0008521b-5a63-4ff6-8390-d343956900ed] Received unexpected event network-vif-plugged-0ab94891-565e-4864-b6ba-565056b40005 for instance with vm_state active and task_state deleting.
Nov 29 17:55:23 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-ce4e517a-1c71-4dab-8e8a-c3a4433244bb tempest-TaggedAttachmentsTest-1438740121 tempest-TaggedAttachmentsTest-1438740121-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 17:55:23 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-ce4e517a-1c71-4dab-8e8a-c3a4433244bb tempest-TaggedAttachmentsTest-1438740121 tempest-TaggedAttachmentsTest-1438740121-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 17:55:23 user nova-compute[74613]: DEBUG nova.compute.provider_tree [None req-ce4e517a-1c71-4dab-8e8a-c3a4433244bb tempest-TaggedAttachmentsTest-1438740121 tempest-TaggedAttachmentsTest-1438740121-project-member] Inventory has not changed in ProviderTree for provider: 639d980e-3b12-44b1-b8f4-1812416fa4dd {{(pid=74613) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 17:55:23 user nova-compute[74613]: DEBUG nova.scheduler.client.report [None req-ce4e517a-1c71-4dab-8e8a-c3a4433244bb tempest-TaggedAttachmentsTest-1438740121 tempest-TaggedAttachmentsTest-1438740121-project-member] Inventory has not changed for provider 639d980e-3b12-44b1-b8f4-1812416fa4dd based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74613) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 17:55:23 user nova-compute[74613]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6255ed7d-7f14-4473-bf21-c934bf93044b tempest-ServerStableDeviceRescueTest-1416322546 tempest-ServerStableDeviceRescueTest-1416322546-project-member] [instance: b6b0ba36-ad89-45f1-9578-8b999567dd25] Calling os-brick to attach iSCSI Volume {{(pid=74613) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 29 17:55:23 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-6255ed7d-7f14-4473-bf21-c934bf93044b tempest-ServerStableDeviceRescueTest-1416322546 tempest-ServerStableDeviceRescueTest-1416322546-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff828156890>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:070b1031-e105-4cba-a039-2286e23727c5', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NfwgLEhX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74613) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 17:55:23 user nova-compute[74613]: WARNING os_brick.initiator.connectors.base [None req-6255ed7d-7f14-4473-bf21-c934bf93044b tempest-ServerStableDeviceRescueTest-1416322546 tempest-ServerStableDeviceRescueTest-1416322546-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 17:55:23 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.base [None req-6255ed7d-7f14-4473-bf21-c934bf93044b tempest-ServerStableDeviceRescueTest-1416322546 tempest-ServerStableDeviceRescueTest-1416322546-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 17:55:23 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.base [None req-6255ed7d-7f14-4473-bf21-c934bf93044b tempest-ServerStableDeviceRescueTest-1416322546 tempest-ServerStableDeviceRescueTest-1416322546-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 17:55:23 user nova-compute[74613]: WARNING os_brick.initiator.connectors.base [None req-6255ed7d-7f14-4473-bf21-c934bf93044b tempest-ServerStableDeviceRescueTest-1416322546 tempest-ServerStableDeviceRescueTest-1416322546-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 17:55:23 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.base [None req-6255ed7d-7f14-4473-bf21-c934bf93044b tempest-ServerStableDeviceRescueTest-1416322546 tempest-ServerStableDeviceRescueTest-1416322546-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:070b1031-e105-4cba-a039-2286e23727c5" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 17:55:23 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.base [None req-6255ed7d-7f14-4473-bf21-c934bf93044b tempest-ServerStableDeviceRescueTest-1416322546 tempest-ServerStableDeviceRescueTest-1416322546-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:070b1031-e105-4cba-a039-2286e23727c5" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 17:55:23 user nova-compute[74613]: INFO os_brick.initiator.connectors.iscsi [None req-6255ed7d-7f14-4473-bf21-c934bf93044b tempest-ServerStableDeviceRescueTest-1416322546 tempest-ServerStableDeviceRescueTest-1416322546-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 29 17:55:23 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:55:23 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:070b1031-e105-4cba-a039-2286e23727c5 -p 172.16.0.220:3260 {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 17:55:23 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-ce4e517a-1c71-4dab-8e8a-c3a4433244bb tempest-TaggedAttachmentsTest-1438740121 tempest-TaggedAttachmentsTest-1438740121-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.449s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 17:55:23 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:070b1031-e105-4cba-a039-2286e23727c5 -p 172.16.0.220:3260" returned: 21 in 0.027s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 17:55:23 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[f982f44f-aaaa-4b8c-948f-191376206875]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 17:55:23 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-6255ed7d-7f14-4473-bf21-c934bf93044b tempest-ServerStableDeviceRescueTest-1416322546 tempest-ServerStableDeviceRescueTest-1416322546-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 29 17:55:23 user nova-compute[74613]:  {{(pid=74613) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 17:55:23 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:55:23 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:070b1031-e105-4cba-a039-2286e23727c5 -p 172.16.0.220:3260 --interface default --op new {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 17:55:23 user nova-compute[74613]: INFO nova.scheduler.client.report [None req-ce4e517a-1c71-4dab-8e8a-c3a4433244bb tempest-TaggedAttachmentsTest-1438740121 tempest-TaggedAttachmentsTest-1438740121-project-member] Deleted allocations for instance 288b8261-8706-4696-879d-d4dd01ab553e
Nov 29 17:55:23 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:070b1031-e105-4cba-a039-2286e23727c5 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.024s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 17:55:23 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd79fba5-019b-407b-a0da-e6ed0027f7a6]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:070b1031-e105-4cba-a039-2286e23727c5] added\n', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 17:55:23 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-6255ed7d-7f14-4473-bf21-c934bf93044b tempest-ServerStableDeviceRescueTest-1416322546 tempest-ServerStableDeviceRescueTest-1416322546-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:070b1031-e105-4cba-a039-2286e23727c5] added
Nov 29 17:55:23 user nova-compute[74613]:  stderr= {{(pid=74613) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 17:55:23 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:070b1031-e105-4cba-a039-2286e23727c5 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 17:55:23 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:070b1031-e105-4cba-a039-2286e23727c5 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.023s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 17:55:23 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[419842ee-7c4e-43ef-88cd-60414179cebb]: (4, ('', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 17:55:23 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-6255ed7d-7f14-4473-bf21-c934bf93044b tempest-ServerStableDeviceRescueTest-1416322546 tempest-ServerStableDeviceRescueTest-1416322546-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74613) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 17:55:23 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:070b1031-e105-4cba-a039-2286e23727c5 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 17:55:23 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:070b1031-e105-4cba-a039-2286e23727c5 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 17:55:23 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[680165da-02f1-4620-be44-c209e4b0cf42]: (4, ('', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 17:55:23 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-6255ed7d-7f14-4473-bf21-c934bf93044b tempest-ServerStableDeviceRescueTest-1416322546 tempest-ServerStableDeviceRescueTest-1416322546-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74613) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 17:55:23 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:070b1031-e105-4cba-a039-2286e23727c5 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v NfwgLEhX {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 17:55:23 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:55:23 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:55:23 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:070b1031-e105-4cba-a039-2286e23727c5 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v NfwgLEhX" returned: 0 in 0.021s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 17:55:23 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[76e9459c-1061-42ff-9483-dcbbb66e7cb2]: (4, ('', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 17:55:23 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-6255ed7d-7f14-4473-bf21-c934bf93044b tempest-ServerStableDeviceRescueTest-1416322546 tempest-ServerStableDeviceRescueTest-1416322546-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'NfwgLEhX'): stdout= stderr= {{(pid=74613) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 17:55:23 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:070b1031-e105-4cba-a039-2286e23727c5 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 17:55:23 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-ce4e517a-1c71-4dab-8e8a-c3a4433244bb tempest-TaggedAttachmentsTest-1438740121 tempest-TaggedAttachmentsTest-1438740121-project-member] Lock "288b8261-8706-4696-879d-d4dd01ab553e" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.216s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 17:55:23 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:55:23 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:070b1031-e105-4cba-a039-2286e23727c5 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.026s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 17:55:23 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9f7fa90-ee86-4300-ab4a-9d26f04f6268]: (4, ('', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 17:55:23 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-6255ed7d-7f14-4473-bf21-c934bf93044b tempest-ServerStableDeviceRescueTest-1416322546 tempest-ServerStableDeviceRescueTest-1416322546-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74613) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 17:55:23 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 17:55:23 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 17:55:23 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7ae8868-bd8c-456d-b5e1-b4655aaa3175]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9511387c-8772-40f2-bf2d-6b6387649e9f (non-flash)\n', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 17:55:23 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-6255ed7d-7f14-4473-bf21-c934bf93044b tempest-ServerStableDeviceRescueTest-1416322546 tempest-ServerStableDeviceRescueTest-1416322546-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9511387c-8772-40f2-bf2d-6b6387649e9f (non-flash)
Nov 29 17:55:23 user nova-compute[74613]:  stderr= {{(pid=74613) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 17:55:23 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-6255ed7d-7f14-4473-bf21-c934bf93044b tempest-ServerStableDeviceRescueTest-1416322546 tempest-ServerStableDeviceRescueTest-1416322546-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9511387c-8772-40f2-bf2d-6b6387649e9f (non-flash)
Nov 29 17:55:23 user nova-compute[74613]:  stderr= {{(pid=74613) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 17:55:23 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:070b1031-e105-4cba-a039-2286e23727c5 -p 172.16.0.220:3260 --login {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 17:55:23 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:070b1031-e105-4cba-a039-2286e23727c5 -p 172.16.0.220:3260 --login" returned: 0 in 0.081s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 17:55:23 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[9320f0ae-02b5-4831-b036-65636740228f]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:070b1031-e105-4cba-a039-2286e23727c5, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:070b1031-e105-4cba-a039-2286e23727c5, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 17:55:23 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-6255ed7d-7f14-4473-bf21-c934bf93044b tempest-ServerStableDeviceRescueTest-1416322546 tempest-ServerStableDeviceRescueTest-1416322546-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:070b1031-e105-4cba-a039-2286e23727c5, portal: 172.16.0.220,3260]
Nov 29 17:55:23 user nova-compute[74613]: Login to [iface: default, target: iqn.2010-10.org.openstack:070b1031-e105-4cba-a039-2286e23727c5, portal: 172.16.0.220,3260] successful.
Nov 29 17:55:23 user nova-compute[74613]:  stderr= {{(pid=74613) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 17:55:23 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:070b1031-e105-4cba-a039-2286e23727c5 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 17:55:23 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:070b1031-e105-4cba-a039-2286e23727c5 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.027s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 17:55:23 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[cdf3ac57-3efb-477f-8b6b-d8528ef05216]: (4, ('', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 17:55:23 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-6255ed7d-7f14-4473-bf21-c934bf93044b tempest-ServerStableDeviceRescueTest-1416322546 tempest-ServerStableDeviceRescueTest-1416322546-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74613) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 17:55:23 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 17:55:23 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 17:55:23 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[85c9e566-4c60-470d-8275-55e039e58552]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9511387c-8772-40f2-bf2d-6b6387649e9f (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:070b1031-e105-4cba-a039-2286e23727c5 (non-flash)\n', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 17:55:23 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-6255ed7d-7f14-4473-bf21-c934bf93044b tempest-ServerStableDeviceRescueTest-1416322546 tempest-ServerStableDeviceRescueTest-1416322546-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9511387c-8772-40f2-bf2d-6b6387649e9f (non-flash)
Nov 29 17:55:23 user nova-compute[74613]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:070b1031-e105-4cba-a039-2286e23727c5 (non-flash)
Nov 29 17:55:23 user nova-compute[74613]:  stderr= {{(pid=74613) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 17:55:23 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-6255ed7d-7f14-4473-bf21-c934bf93044b tempest-ServerStableDeviceRescueTest-1416322546 tempest-ServerStableDeviceRescueTest-1416322546-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9511387c-8772-40f2-bf2d-6b6387649e9f (non-flash)
Nov 29 17:55:23 user nova-compute[74613]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:070b1031-e105-4cba-a039-2286e23727c5 (non-flash)
Nov 29 17:55:23 user nova-compute[74613]:  stderr= {{(pid=74613) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 17:55:23 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.base [None req-6255ed7d-7f14-4473-bf21-c934bf93044b tempest-ServerStableDeviceRescueTest-1416322546 tempest-ServerStableDeviceRescueTest-1416322546-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:070b1031-e105-4cba-a039-2286e23727c5" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.369s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 17:55:23 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-6255ed7d-7f14-4473-bf21-c934bf93044b tempest-ServerStableDeviceRescueTest-1416322546 tempest-ServerStableDeviceRescueTest-1416322546-project-member] Connected to 172.16.0.220:3260 {{(pid=74613) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 29 17:55:23 user nova-compute[74613]: DEBUG os_brick.initiator.linuxscsi [None req-6255ed7d-7f14-4473-bf21-c934bf93044b tempest-ServerStableDeviceRescueTest-1416322546 tempest-ServerStableDeviceRescueTest-1416322546-project-member] HCTL ('34', '-', '-', 0) found on session 15 with lun 0 {{(pid=74613) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 29 17:55:23 user nova-compute[74613]: DEBUG os_brick.initiator.linuxscsi [None req-6255ed7d-7f14-4473-bf21-c934bf93044b tempest-ServerStableDeviceRescueTest-1416322546 tempest-ServerStableDeviceRescueTest-1416322546-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=74613) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 29 17:55:23 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 17:55:24 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.026s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 17:55:24 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ec4ff09-53db-45fb-8e7c-1e805a70e6b0]: (4, ('- - 0', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 17:55:24 user nova-compute[74613]: DEBUG os_brick.initiator.linuxscsi [None req-6255ed7d-7f14-4473-bf21-c934bf93044b tempest-ServerStableDeviceRescueTest-1416322546 tempest-ServerStableDeviceRescueTest-1416322546-project-member] Searching for a device in session 15 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=74613) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 29 17:55:24 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-6255ed7d-7f14-4473-bf21-c934bf93044b tempest-ServerStableDeviceRescueTest-1416322546 tempest-ServerStableDeviceRescueTest-1416322546-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:070b1031-e105-4cba-a039-2286e23727c5', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NfwgLEhX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74613) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 29 17:55:24 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-176e853b-89a1-45dc-8294-c527328264ba tempest-ServerActionsTestOtherB-894551005 tempest-ServerActionsTestOtherB-894551005-project-member] Acquiring lock "74ac9703-1cd7-4983-b7d4-c69b01fec7b2" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 17:55:24 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-176e853b-89a1-45dc-8294-c527328264ba tempest-ServerActionsTestOtherB-894551005 tempest-ServerActionsTestOtherB-894551005-project-member] Lock "74ac9703-1cd7-4983-b7d4-c69b01fec7b2" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 17:55:24 user nova-compute[74613]: DEBUG nova.compute.manager [None req-176e853b-89a1-45dc-8294-c527328264ba tempest-ServerActionsTestOtherB-894551005 tempest-ServerActionsTestOtherB-894551005-project-member] [instance: 74ac9703-1cd7-4983-b7d4-c69b01fec7b2] Starting instance... {{(pid=74613) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 29 17:55:24 user nova-compute[74613]: DEBUG nova.network.neutron [-] [instance: 0008521b-5a63-4ff6-8390-d343956900ed] Updating instance_info_cache with network_info: [] {{(pid=74613) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 17:55:24 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-176e853b-89a1-45dc-8294-c527328264ba tempest-ServerActionsTestOtherB-894551005 tempest-ServerActionsTestOtherB-894551005-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 17:55:24 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-176e853b-89a1-45dc-8294-c527328264ba tempest-ServerActionsTestOtherB-894551005 tempest-ServerActionsTestOtherB-894551005-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 17:55:24 user nova-compute[74613]: INFO nova.compute.manager [-] [instance: 0008521b-5a63-4ff6-8390-d343956900ed] Took 1.49 seconds to deallocate network for instance.
Nov 29 17:55:24 user nova-compute[74613]: DEBUG nova.virt.hardware [None req-176e853b-89a1-45dc-8294-c527328264ba tempest-ServerActionsTestOtherB-894551005 tempest-ServerActionsTestOtherB-894551005-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74613) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 29 17:55:24 user nova-compute[74613]: INFO nova.compute.claims [None req-176e853b-89a1-45dc-8294-c527328264ba tempest-ServerActionsTestOtherB-894551005 tempest-ServerActionsTestOtherB-894551005-project-member] [instance: 74ac9703-1cd7-4983-b7d4-c69b01fec7b2] Claim successful on node user
Nov 29 17:55:24 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-c178e9e6-c6d5-411d-bfbb-37bcd739f153 tempest-TestVolumeSwap-281539251 tempest-TestVolumeSwap-281539251-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 17:55:24 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-c91e8417-5b0e-455b-9678-f8e7727a2128 tempest-AttachVolumeShelveTestJSON-1452861425 tempest-AttachVolumeShelveTestJSON-1452861425-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 17:55:24 user nova-compute[74613]: DEBUG nova.compute.provider_tree [None req-176e853b-89a1-45dc-8294-c527328264ba tempest-ServerActionsTestOtherB-894551005 tempest-ServerActionsTestOtherB-894551005-project-member] Inventory has not changed in ProviderTree for provider: 639d980e-3b12-44b1-b8f4-1812416fa4dd {{(pid=74613) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 17:55:24 user nova-compute[74613]: DEBUG nova.scheduler.client.report [None req-176e853b-89a1-45dc-8294-c527328264ba tempest-ServerActionsTestOtherB-894551005 tempest-ServerActionsTestOtherB-894551005-project-member] Inventory has not changed for provider 639d980e-3b12-44b1-b8f4-1812416fa4dd based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74613) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 17:55:25 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-176e853b-89a1-45dc-8294-c527328264ba tempest-ServerActionsTestOtherB-894551005 tempest-ServerActionsTestOtherB-894551005-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.437s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 17:55:25 user nova-compute[74613]: DEBUG nova.compute.manager [None req-176e853b-89a1-45dc-8294-c527328264ba tempest-ServerActionsTestOtherB-894551005 tempest-ServerActionsTestOtherB-894551005-project-member] [instance: 74ac9703-1cd7-4983-b7d4-c69b01fec7b2] Start building networks asynchronously for instance. {{(pid=74613) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 29 17:55:25 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-c178e9e6-c6d5-411d-bfbb-37bcd739f153 tempest-TestVolumeSwap-281539251 tempest-TestVolumeSwap-281539251-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.368s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 17:55:25 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.base [None req-6255ed7d-7f14-4473-bf21-c934bf93044b tempest-ServerStableDeviceRescueTest-1416322546 tempest-ServerStableDeviceRescueTest-1416322546-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.417s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 17:55:25 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-6255ed7d-7f14-4473-bf21-c934bf93044b tempest-ServerStableDeviceRescueTest-1416322546 tempest-ServerStableDeviceRescueTest-1416322546-project-member] <== connect_volume: return (1418ms) {'type': 'block', 'scsi_wwn': '23162393938626439', 'path': '/dev/sdc'} {{(pid=74613) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 17:55:25 user nova-compute[74613]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6255ed7d-7f14-4473-bf21-c934bf93044b tempest-ServerStableDeviceRescueTest-1416322546 tempest-ServerStableDeviceRescueTest-1416322546-project-member] [instance: b6b0ba36-ad89-45f1-9578-8b999567dd25] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23162393938626439', 'path': '/dev/sdc'} {{(pid=74613) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 29 17:55:25 user nova-compute[74613]: DEBUG nova.objects.instance [None req-6255ed7d-7f14-4473-bf21-c934bf93044b tempest-ServerStableDeviceRescueTest-1416322546 tempest-ServerStableDeviceRescueTest-1416322546-project-member] Lazy-loading 'flavor' on Instance uuid b6b0ba36-ad89-45f1-9578-8b999567dd25 {{(pid=74613) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 17:55:25 user nova-compute[74613]: DEBUG nova.compute.manager [None req-176e853b-89a1-45dc-8294-c527328264ba tempest-ServerActionsTestOtherB-894551005 tempest-ServerActionsTestOtherB-894551005-project-member] [instance: 74ac9703-1cd7-4983-b7d4-c69b01fec7b2] Allocating IP information in the background. {{(pid=74613) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 29 17:55:25 user nova-compute[74613]: DEBUG nova.network.neutron [None req-176e853b-89a1-45dc-8294-c527328264ba tempest-ServerActionsTestOtherB-894551005 tempest-ServerActionsTestOtherB-894551005-project-member] [instance: 74ac9703-1cd7-4983-b7d4-c69b01fec7b2] allocate_for_instance() {{(pid=74613) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 29 17:55:25 user nova-compute[74613]: DEBUG nova.virt.libvirt.guest [None req-6255ed7d-7f14-4473-bf21-c934bf93044b tempest-ServerStableDeviceRescueTest-1416322546 tempest-ServerStableDeviceRescueTest-1416322546-project-member] attach device xml: <disk type="block" device="disk">
Nov 29 17:55:25 user nova-compute[74613]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 17:55:25 user nova-compute[74613]:   <source dev="/dev/sdc"/>
Nov 29 17:55:25 user nova-compute[74613]:   <target dev="vdb" bus="virtio"/>
Nov 29 17:55:25 user nova-compute[74613]:   <serial>070b1031-e105-4cba-a039-2286e23727c5</serial>
Nov 29 17:55:25 user nova-compute[74613]: </disk>
Nov 29 17:55:25 user nova-compute[74613]:  {{(pid=74613) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 29 17:55:25 user nova-compute[74613]: INFO nova.virt.libvirt.driver [None req-176e853b-89a1-45dc-8294-c527328264ba tempest-ServerActionsTestOtherB-894551005 tempest-ServerActionsTestOtherB-894551005-project-member] [instance: 74ac9703-1cd7-4983-b7d4-c69b01fec7b2] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 29 17:55:25 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:55:25 user nova-compute[74613]: DEBUG nova.compute.manager [None req-176e853b-89a1-45dc-8294-c527328264ba tempest-ServerActionsTestOtherB-894551005 tempest-ServerActionsTestOtherB-894551005-project-member] [instance: 74ac9703-1cd7-4983-b7d4-c69b01fec7b2] Start building block device mappings for instance. {{(pid=74613) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 29 17:55:25 user nova-compute[74613]: DEBUG nova.compute.manager [req-40bb04b3-b228-41cf-8747-3568cde06a1b req-7c7e0b51-d4a4-4e44-88f8-f6c6af391b6b service nova] [instance: 0008521b-5a63-4ff6-8390-d343956900ed] Received event network-vif-plugged-0ab94891-565e-4864-b6ba-565056b40005 {{(pid=74613) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 17:55:25 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-40bb04b3-b228-41cf-8747-3568cde06a1b req-7c7e0b51-d4a4-4e44-88f8-f6c6af391b6b service nova] Acquiring lock "0008521b-5a63-4ff6-8390-d343956900ed-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 17:55:25 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-40bb04b3-b228-41cf-8747-3568cde06a1b req-7c7e0b51-d4a4-4e44-88f8-f6c6af391b6b service nova] Lock "0008521b-5a63-4ff6-8390-d343956900ed-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 17:55:25 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-40bb04b3-b228-41cf-8747-3568cde06a1b req-7c7e0b51-d4a4-4e44-88f8-f6c6af391b6b service nova] Lock "0008521b-5a63-4ff6-8390-d343956900ed-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 17:55:25 user nova-compute[74613]: DEBUG nova.compute.manager [req-40bb04b3-b228-41cf-8747-3568cde06a1b req-7c7e0b51-d4a4-4e44-88f8-f6c6af391b6b service nova] [instance: 0008521b-5a63-4ff6-8390-d343956900ed] No waiting events found dispatching network-vif-plugged-0ab94891-565e-4864-b6ba-565056b40005 {{(pid=74613) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 17:55:25 user nova-compute[74613]: WARNING nova.compute.manager [req-40bb04b3-b228-41cf-8747-3568cde06a1b req-7c7e0b51-d4a4-4e44-88f8-f6c6af391b6b service nova] [instance: 0008521b-5a63-4ff6-8390-d343956900ed] Received unexpected event network-vif-plugged-0ab94891-565e-4864-b6ba-565056b40005 for instance with vm_state deleted and task_state None.
Nov 29 17:55:25 user nova-compute[74613]: DEBUG nova.compute.manager [req-40bb04b3-b228-41cf-8747-3568cde06a1b req-7c7e0b51-d4a4-4e44-88f8-f6c6af391b6b service nova] [instance: 0008521b-5a63-4ff6-8390-d343956900ed] Received event network-vif-plugged-0ab94891-565e-4864-b6ba-565056b40005 {{(pid=74613) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 17:55:25 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-40bb04b3-b228-41cf-8747-3568cde06a1b req-7c7e0b51-d4a4-4e44-88f8-f6c6af391b6b service nova] Acquiring lock "0008521b-5a63-4ff6-8390-d343956900ed-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 17:55:25 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-40bb04b3-b228-41cf-8747-3568cde06a1b req-7c7e0b51-d4a4-4e44-88f8-f6c6af391b6b service nova] Lock "0008521b-5a63-4ff6-8390-d343956900ed-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 17:55:25 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-40bb04b3-b228-41cf-8747-3568cde06a1b req-7c7e0b51-d4a4-4e44-88f8-f6c6af391b6b service nova] Lock "0008521b-5a63-4ff6-8390-d343956900ed-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 17:55:25 user nova-compute[74613]: DEBUG nova.compute.manager [req-40bb04b3-b228-41cf-8747-3568cde06a1b req-7c7e0b51-d4a4-4e44-88f8-f6c6af391b6b service nova] [instance: 0008521b-5a63-4ff6-8390-d343956900ed] No waiting events found dispatching network-vif-plugged-0ab94891-565e-4864-b6ba-565056b40005 {{(pid=74613) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 17:55:25 user nova-compute[74613]: WARNING nova.compute.manager [req-40bb04b3-b228-41cf-8747-3568cde06a1b req-7c7e0b51-d4a4-4e44-88f8-f6c6af391b6b service nova] [instance: 0008521b-5a63-4ff6-8390-d343956900ed] Received unexpected event network-vif-plugged-0ab94891-565e-4864-b6ba-565056b40005 for instance with vm_state deleted and task_state None.
Nov 29 17:55:25 user nova-compute[74613]: DEBUG nova.compute.manager [req-40bb04b3-b228-41cf-8747-3568cde06a1b req-7c7e0b51-d4a4-4e44-88f8-f6c6af391b6b service nova] [instance: 0008521b-5a63-4ff6-8390-d343956900ed] Received event network-vif-unplugged-0ab94891-565e-4864-b6ba-565056b40005 {{(pid=74613) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 17:55:25 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-40bb04b3-b228-41cf-8747-3568cde06a1b req-7c7e0b51-d4a4-4e44-88f8-f6c6af391b6b service nova] Acquiring lock "0008521b-5a63-4ff6-8390-d343956900ed-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 17:55:25 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-40bb04b3-b228-41cf-8747-3568cde06a1b req-7c7e0b51-d4a4-4e44-88f8-f6c6af391b6b service nova] Lock "0008521b-5a63-4ff6-8390-d343956900ed-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 17:55:25 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-40bb04b3-b228-41cf-8747-3568cde06a1b req-7c7e0b51-d4a4-4e44-88f8-f6c6af391b6b service nova] Lock "0008521b-5a63-4ff6-8390-d343956900ed-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 17:55:25 user nova-compute[74613]: DEBUG nova.compute.manager [req-40bb04b3-b228-41cf-8747-3568cde06a1b req-7c7e0b51-d4a4-4e44-88f8-f6c6af391b6b service nova] [instance: 0008521b-5a63-4ff6-8390-d343956900ed] No waiting events found dispatching network-vif-unplugged-0ab94891-565e-4864-b6ba-565056b40005 {{(pid=74613) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 17:55:25 user nova-compute[74613]: WARNING nova.compute.manager [req-40bb04b3-b228-41cf-8747-3568cde06a1b req-7c7e0b51-d4a4-4e44-88f8-f6c6af391b6b service nova] [instance: 0008521b-5a63-4ff6-8390-d343956900ed] Received unexpected event network-vif-unplugged-0ab94891-565e-4864-b6ba-565056b40005 for instance with vm_state deleted and task_state None.
Nov 29 17:55:25 user nova-compute[74613]: DEBUG nova.compute.manager [req-40bb04b3-b228-41cf-8747-3568cde06a1b req-7c7e0b51-d4a4-4e44-88f8-f6c6af391b6b service nova] [instance: 0008521b-5a63-4ff6-8390-d343956900ed] Received event network-vif-plugged-0ab94891-565e-4864-b6ba-565056b40005 {{(pid=74613) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 17:55:25 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-40bb04b3-b228-41cf-8747-3568cde06a1b req-7c7e0b51-d4a4-4e44-88f8-f6c6af391b6b service nova] Acquiring lock "0008521b-5a63-4ff6-8390-d343956900ed-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 17:55:25 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-40bb04b3-b228-41cf-8747-3568cde06a1b req-7c7e0b51-d4a4-4e44-88f8-f6c6af391b6b service nova] Lock "0008521b-5a63-4ff6-8390-d343956900ed-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 17:55:25 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-40bb04b3-b228-41cf-8747-3568cde06a1b req-7c7e0b51-d4a4-4e44-88f8-f6c6af391b6b service nova] Lock "0008521b-5a63-4ff6-8390-d343956900ed-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.003s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 17:55:25 user nova-compute[74613]: DEBUG nova.compute.manager [req-40bb04b3-b228-41cf-8747-3568cde06a1b req-7c7e0b51-d4a4-4e44-88f8-f6c6af391b6b service nova] [instance: 0008521b-5a63-4ff6-8390-d343956900ed] No waiting events found dispatching network-vif-plugged-0ab94891-565e-4864-b6ba-565056b40005 {{(pid=74613) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 17:55:25 user nova-compute[74613]: WARNING nova.compute.manager [req-40bb04b3-b228-41cf-8747-3568cde06a1b req-7c7e0b51-d4a4-4e44-88f8-f6c6af391b6b service nova] [instance: 0008521b-5a63-4ff6-8390-d343956900ed] Received unexpected event network-vif-plugged-0ab94891-565e-4864-b6ba-565056b40005 for instance with vm_state deleted and task_state None.
Nov 29 17:55:25 user nova-compute[74613]: DEBUG nova.compute.manager [req-40bb04b3-b228-41cf-8747-3568cde06a1b req-7c7e0b51-d4a4-4e44-88f8-f6c6af391b6b service nova] [instance: 0008521b-5a63-4ff6-8390-d343956900ed] Received event network-vif-deleted-0ab94891-565e-4864-b6ba-565056b40005 {{(pid=74613) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 17:55:25 user nova-compute[74613]: DEBUG nova.policy [None req-176e853b-89a1-45dc-8294-c527328264ba tempest-ServerActionsTestOtherB-894551005 tempest-ServerActionsTestOtherB-894551005-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '1a6eb590fed440729b45b8db79eb7c2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b392ca87608940c0ae467318b66453b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74613) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 29 17:55:25 user nova-compute[74613]: DEBUG nova.compute.provider_tree [None req-c178e9e6-c6d5-411d-bfbb-37bcd739f153 tempest-TestVolumeSwap-281539251 tempest-TestVolumeSwap-281539251-project-member] Inventory has not changed in ProviderTree for provider: 639d980e-3b12-44b1-b8f4-1812416fa4dd {{(pid=74613) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 17:55:25 user nova-compute[74613]: DEBUG nova.compute.manager [None req-176e853b-89a1-45dc-8294-c527328264ba tempest-ServerActionsTestOtherB-894551005 tempest-ServerActionsTestOtherB-894551005-project-member] [instance: 74ac9703-1cd7-4983-b7d4-c69b01fec7b2] Start spawning the instance on the hypervisor. {{(pid=74613) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 29 17:55:25 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-176e853b-89a1-45dc-8294-c527328264ba tempest-ServerActionsTestOtherB-894551005 tempest-ServerActionsTestOtherB-894551005-project-member] [instance: 74ac9703-1cd7-4983-b7d4-c69b01fec7b2] Creating instance directory {{(pid=74613) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 29 17:55:25 user nova-compute[74613]: INFO nova.virt.libvirt.driver [None req-176e853b-89a1-45dc-8294-c527328264ba tempest-ServerActionsTestOtherB-894551005 tempest-ServerActionsTestOtherB-894551005-project-member] [instance: 74ac9703-1cd7-4983-b7d4-c69b01fec7b2] Creating image(s)
Nov 29 17:55:25 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-176e853b-89a1-45dc-8294-c527328264ba tempest-ServerActionsTestOtherB-894551005 tempest-ServerActionsTestOtherB-894551005-project-member] Acquiring lock "/opt/stack/data/nova/instances/74ac9703-1cd7-4983-b7d4-c69b01fec7b2/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 17:55:25 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-176e853b-89a1-45dc-8294-c527328264ba tempest-ServerActionsTestOtherB-894551005 tempest-ServerActionsTestOtherB-894551005-project-member] Lock "/opt/stack/data/nova/instances/74ac9703-1cd7-4983-b7d4-c69b01fec7b2/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 17:55:25 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-176e853b-89a1-45dc-8294-c527328264ba tempest-ServerActionsTestOtherB-894551005 tempest-ServerActionsTestOtherB-894551005-project-member] Lock "/opt/stack/data/nova/instances/74ac9703-1cd7-4983-b7d4-c69b01fec7b2/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.004s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 17:55:25 user nova-compute[74613]: DEBUG nova.scheduler.client.report [None req-c178e9e6-c6d5-411d-bfbb-37bcd739f153 tempest-TestVolumeSwap-281539251 tempest-TestVolumeSwap-281539251-project-member] Inventory has not changed for provider 639d980e-3b12-44b1-b8f4-1812416fa4dd based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74613) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 17:55:25 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-176e853b-89a1-45dc-8294-c527328264ba tempest-ServerActionsTestOtherB-894551005 tempest-ServerActionsTestOtherB-894551005-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/21faea9e6951f3bdd0153b76ac89fe1a60a34758 --force-share --output=json {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 17:55:25 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-c178e9e6-c6d5-411d-bfbb-37bcd739f153 tempest-TestVolumeSwap-281539251 tempest-TestVolumeSwap-281539251-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.430s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 17:55:25 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-c91e8417-5b0e-455b-9678-f8e7727a2128 tempest-AttachVolumeShelveTestJSON-1452861425 tempest-AttachVolumeShelveTestJSON-1452861425-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.541s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 17:55:25 user nova-compute[74613]: DEBUG nova.objects.instance [None req-c91e8417-5b0e-455b-9678-f8e7727a2128 tempest-AttachVolumeShelveTestJSON-1452861425 tempest-AttachVolumeShelveTestJSON-1452861425-project-member] Lazy-loading 'pci_requests' on Instance uuid c19e230e-2e6c-4c20-b15c-ad81a73674b4 {{(pid=74613) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 17:55:25 user nova-compute[74613]: DEBUG nova.objects.instance [None req-c91e8417-5b0e-455b-9678-f8e7727a2128 tempest-AttachVolumeShelveTestJSON-1452861425 tempest-AttachVolumeShelveTestJSON-1452861425-project-member] Lazy-loading 'numa_topology' on Instance uuid c19e230e-2e6c-4c20-b15c-ad81a73674b4 {{(pid=74613) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 17:55:25 user nova-compute[74613]: INFO nova.scheduler.client.report [None req-c178e9e6-c6d5-411d-bfbb-37bcd739f153 tempest-TestVolumeSwap-281539251 tempest-TestVolumeSwap-281539251-project-member] Deleted allocations for instance 0008521b-5a63-4ff6-8390-d343956900ed
Nov 29 17:55:25 user nova-compute[74613]: DEBUG nova.virt.hardware [None req-c91e8417-5b0e-455b-9678-f8e7727a2128 tempest-AttachVolumeShelveTestJSON-1452861425 tempest-AttachVolumeShelveTestJSON-1452861425-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74613) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 29 17:55:25 user nova-compute[74613]: INFO nova.compute.claims [None req-c91e8417-5b0e-455b-9678-f8e7727a2128 tempest-AttachVolumeShelveTestJSON-1452861425 tempest-AttachVolumeShelveTestJSON-1452861425-project-member] [instance: c19e230e-2e6c-4c20-b15c-ad81a73674b4] Claim successful on node user
Nov 29 17:55:25 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-176e853b-89a1-45dc-8294-c527328264ba tempest-ServerActionsTestOtherB-894551005 tempest-ServerActionsTestOtherB-894551005-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/21faea9e6951f3bdd0153b76ac89fe1a60a34758 --force-share --output=json" returned: 0 in 0.215s {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 17:55:25 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-176e853b-89a1-45dc-8294-c527328264ba tempest-ServerActionsTestOtherB-894551005 tempest-ServerActionsTestOtherB-894551005-project-member] Acquiring lock "21faea9e6951f3bdd0153b76ac89fe1a60a34758" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 17:55:25 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-176e853b-89a1-45dc-8294-c527328264ba tempest-ServerActionsTestOtherB-894551005 tempest-ServerActionsTestOtherB-894551005-project-member] Lock "21faea9e6951f3bdd0153b76ac89fe1a60a34758" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 17:55:25 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-176e853b-89a1-45dc-8294-c527328264ba tempest-ServerActionsTestOtherB-894551005 tempest-ServerActionsTestOtherB-894551005-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/21faea9e6951f3bdd0153b76ac89fe1a60a34758 --force-share --output=json {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 17:55:25 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-c178e9e6-c6d5-411d-bfbb-37bcd739f153 tempest-TestVolumeSwap-281539251 tempest-TestVolumeSwap-281539251-project-member] Lock "0008521b-5a63-4ff6-8390-d343956900ed" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.682s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 17:55:25 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-6255ed7d-7f14-4473-bf21-c934bf93044b tempest-ServerStableDeviceRescueTest-1416322546 tempest-ServerStableDeviceRescueTest-1416322546-project-member] No BDM found with device name vda, not building metadata. {{(pid=74613) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 17:55:25 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-6255ed7d-7f14-4473-bf21-c934bf93044b tempest-ServerStableDeviceRescueTest-1416322546 tempest-ServerStableDeviceRescueTest-1416322546-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74613) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 17:55:25 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-6255ed7d-7f14-4473-bf21-c934bf93044b tempest-ServerStableDeviceRescueTest-1416322546 tempest-ServerStableDeviceRescueTest-1416322546-project-member] No VIF found with MAC fa:16:3e:3f:ea:5d, not building metadata {{(pid=74613) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 29 17:55:25 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-176e853b-89a1-45dc-8294-c527328264ba tempest-ServerActionsTestOtherB-894551005 tempest-ServerActionsTestOtherB-894551005-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/21faea9e6951f3bdd0153b76ac89fe1a60a34758 --force-share --output=json" returned: 0 in 0.228s {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 17:55:25 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-176e853b-89a1-45dc-8294-c527328264ba tempest-ServerActionsTestOtherB-894551005 tempest-ServerActionsTestOtherB-894551005-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/21faea9e6951f3bdd0153b76ac89fe1a60a34758,backing_fmt=raw /opt/stack/data/nova/instances/74ac9703-1cd7-4983-b7d4-c69b01fec7b2/disk 1073741824 {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 17:55:25 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-176e853b-89a1-45dc-8294-c527328264ba tempest-ServerActionsTestOtherB-894551005 tempest-ServerActionsTestOtherB-894551005-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/21faea9e6951f3bdd0153b76ac89fe1a60a34758,backing_fmt=raw /opt/stack/data/nova/instances/74ac9703-1cd7-4983-b7d4-c69b01fec7b2/disk 1073741824" returned: 0 in 0.058s {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 17:55:25 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-176e853b-89a1-45dc-8294-c527328264ba tempest-ServerActionsTestOtherB-894551005 tempest-ServerActionsTestOtherB-894551005-project-member] Lock "21faea9e6951f3bdd0153b76ac89fe1a60a34758" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.290s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 17:55:25 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-176e853b-89a1-45dc-8294-c527328264ba tempest-ServerActionsTestOtherB-894551005 tempest-ServerActionsTestOtherB-894551005-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/21faea9e6951f3bdd0153b76ac89fe1a60a34758 --force-share --output=json {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 17:55:25 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-6255ed7d-7f14-4473-bf21-c934bf93044b tempest-ServerStableDeviceRescueTest-1416322546 tempest-ServerStableDeviceRescueTest-1416322546-project-member] Lock "b6b0ba36-ad89-45f1-9578-8b999567dd25" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 16.214s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 17:55:26 user nova-compute[74613]: DEBUG nova.compute.provider_tree [None req-c91e8417-5b0e-455b-9678-f8e7727a2128 tempest-AttachVolumeShelveTestJSON-1452861425 tempest-AttachVolumeShelveTestJSON-1452861425-project-member] Inventory has not changed in ProviderTree for provider: 639d980e-3b12-44b1-b8f4-1812416fa4dd {{(pid=74613) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 17:55:26 user nova-compute[74613]: DEBUG nova.scheduler.client.report [None req-c91e8417-5b0e-455b-9678-f8e7727a2128 tempest-AttachVolumeShelveTestJSON-1452861425 tempest-AttachVolumeShelveTestJSON-1452861425-project-member] Inventory has not changed for provider 639d980e-3b12-44b1-b8f4-1812416fa4dd based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74613) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 17:55:26 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-c91e8417-5b0e-455b-9678-f8e7727a2128 tempest-AttachVolumeShelveTestJSON-1452861425 tempest-AttachVolumeShelveTestJSON-1452861425-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.672s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 17:55:26 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-176e853b-89a1-45dc-8294-c527328264ba tempest-ServerActionsTestOtherB-894551005 tempest-ServerActionsTestOtherB-894551005-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/21faea9e6951f3bdd0153b76ac89fe1a60a34758 --force-share --output=json" returned: 0 in 0.225s {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 17:55:26 user nova-compute[74613]: DEBUG nova.virt.disk.api [None req-176e853b-89a1-45dc-8294-c527328264ba tempest-ServerActionsTestOtherB-894551005 tempest-ServerActionsTestOtherB-894551005-project-member] Checking if we can resize image /opt/stack/data/nova/instances/74ac9703-1cd7-4983-b7d4-c69b01fec7b2/disk. size=1073741824 {{(pid=74613) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 29 17:55:26 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-176e853b-89a1-45dc-8294-c527328264ba tempest-ServerActionsTestOtherB-894551005 tempest-ServerActionsTestOtherB-894551005-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/74ac9703-1cd7-4983-b7d4-c69b01fec7b2/disk --force-share --output=json {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 17:55:26 user nova-compute[74613]: DEBUG nova.network.neutron [None req-176e853b-89a1-45dc-8294-c527328264ba tempest-ServerActionsTestOtherB-894551005 tempest-ServerActionsTestOtherB-894551005-project-member] [instance: 74ac9703-1cd7-4983-b7d4-c69b01fec7b2] Successfully created port: c63b6577-fb46-437a-95b3-8321fab45d0c {{(pid=74613) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 29 17:55:26 user nova-compute[74613]: INFO nova.network.neutron [None req-c91e8417-5b0e-455b-9678-f8e7727a2128 tempest-AttachVolumeShelveTestJSON-1452861425 tempest-AttachVolumeShelveTestJSON-1452861425-project-member] [instance: c19e230e-2e6c-4c20-b15c-ad81a73674b4] Updating port a414bce0-6293-4987-9441-46943fe2e877 with attributes {'binding:host_id': 'user', 'device_owner': 'compute:nova'}
Nov 29 17:55:26 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-176e853b-89a1-45dc-8294-c527328264ba tempest-ServerActionsTestOtherB-894551005 tempest-ServerActionsTestOtherB-894551005-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/74ac9703-1cd7-4983-b7d4-c69b01fec7b2/disk --force-share --output=json" returned: 0 in 0.252s {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 17:55:26 user nova-compute[74613]: DEBUG nova.virt.disk.api [None req-176e853b-89a1-45dc-8294-c527328264ba tempest-ServerActionsTestOtherB-894551005 tempest-ServerActionsTestOtherB-894551005-project-member] Cannot resize image /opt/stack/data/nova/instances/74ac9703-1cd7-4983-b7d4-c69b01fec7b2/disk to a smaller size. {{(pid=74613) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 29 17:55:26 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-176e853b-89a1-45dc-8294-c527328264ba tempest-ServerActionsTestOtherB-894551005 tempest-ServerActionsTestOtherB-894551005-project-member] [instance: 74ac9703-1cd7-4983-b7d4-c69b01fec7b2] Created local disks {{(pid=74613) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 29 17:55:26 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-176e853b-89a1-45dc-8294-c527328264ba tempest-ServerActionsTestOtherB-894551005 tempest-ServerActionsTestOtherB-894551005-project-member] [instance: 74ac9703-1cd7-4983-b7d4-c69b01fec7b2] Ensure instance console log exists: /opt/stack/data/nova/instances/74ac9703-1cd7-4983-b7d4-c69b01fec7b2/console.log {{(pid=74613) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 29 17:55:26 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-176e853b-89a1-45dc-8294-c527328264ba tempest-ServerActionsTestOtherB-894551005 tempest-ServerActionsTestOtherB-894551005-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 17:55:26 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-176e853b-89a1-45dc-8294-c527328264ba tempest-ServerActionsTestOtherB-894551005 tempest-ServerActionsTestOtherB-894551005-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 17:55:26 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-176e853b-89a1-45dc-8294-c527328264ba tempest-ServerActionsTestOtherB-894551005 tempest-ServerActionsTestOtherB-894551005-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 17:55:26 user nova-compute[74613]: INFO nova.compute.manager [None req-0e88c997-e820-43a6-96c7-7a0a2006fbc3 tempest-ServerStableDeviceRescueTest-1416322546 tempest-ServerStableDeviceRescueTest-1416322546-project-member] [instance: b6b0ba36-ad89-45f1-9578-8b999567dd25] Rescuing
Nov 29 17:55:26 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-0e88c997-e820-43a6-96c7-7a0a2006fbc3 tempest-ServerStableDeviceRescueTest-1416322546 tempest-ServerStableDeviceRescueTest-1416322546-project-member] Acquiring lock "refresh_cache-b6b0ba36-ad89-45f1-9578-8b999567dd25" {{(pid=74613) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 17:55:26 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-0e88c997-e820-43a6-96c7-7a0a2006fbc3 tempest-ServerStableDeviceRescueTest-1416322546 tempest-ServerStableDeviceRescueTest-1416322546-project-member] Acquired lock "refresh_cache-b6b0ba36-ad89-45f1-9578-8b999567dd25" {{(pid=74613) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 17:55:26 user nova-compute[74613]: DEBUG nova.network.neutron [None req-0e88c997-e820-43a6-96c7-7a0a2006fbc3 tempest-ServerStableDeviceRescueTest-1416322546 tempest-ServerStableDeviceRescueTest-1416322546-project-member] [instance: b6b0ba36-ad89-45f1-9578-8b999567dd25] Building network info cache for instance {{(pid=74613) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 29 17:55:27 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:55:27 user nova-compute[74613]: DEBUG nova.network.neutron [None req-176e853b-89a1-45dc-8294-c527328264ba tempest-ServerActionsTestOtherB-894551005 tempest-ServerActionsTestOtherB-894551005-project-member] [instance: 74ac9703-1cd7-4983-b7d4-c69b01fec7b2] Successfully updated port: c63b6577-fb46-437a-95b3-8321fab45d0c {{(pid=74613) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 29 17:55:27 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-176e853b-89a1-45dc-8294-c527328264ba tempest-ServerActionsTestOtherB-894551005 tempest-ServerActionsTestOtherB-894551005-project-member] Acquiring lock "refresh_cache-74ac9703-1cd7-4983-b7d4-c69b01fec7b2" {{(pid=74613) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 17:55:27 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-176e853b-89a1-45dc-8294-c527328264ba tempest-ServerActionsTestOtherB-894551005 tempest-ServerActionsTestOtherB-894551005-project-member] Acquired lock "refresh_cache-74ac9703-1cd7-4983-b7d4-c69b01fec7b2" {{(pid=74613) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 17:55:27 user nova-compute[74613]: DEBUG nova.network.neutron [None req-176e853b-89a1-45dc-8294-c527328264ba tempest-ServerActionsTestOtherB-894551005 tempest-ServerActionsTestOtherB-894551005-project-member] [instance: 74ac9703-1cd7-4983-b7d4-c69b01fec7b2] Building network info cache for instance {{(pid=74613) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 29 17:55:27 user nova-compute[74613]: DEBUG nova.network.neutron [None req-0e88c997-e820-43a6-96c7-7a0a2006fbc3 tempest-ServerStableDeviceRescueTest-1416322546 tempest-ServerStableDeviceRescueTest-1416322546-project-member] [instance: b6b0ba36-ad89-45f1-9578-8b999567dd25] Updating instance_info_cache with network_info: [{"id": "0167e253-42dd-486a-8231-a8b8199f3584", "address": "fa:16:3e:3f:ea:5d", "network": {"id": "880ea498-5e4e-4786-a894-bac0f42572f4", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1846928198-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.254", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b8f184c16b5348beb2dc9e6359a47651", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0167e253-42", "ovs_interfaceid": "0167e253-42dd-486a-8231-a8b8199f3584", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74613) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 17:55:27 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-0e88c997-e820-43a6-96c7-7a0a2006fbc3 tempest-ServerStableDeviceRescueTest-1416322546 tempest-ServerStableDeviceRescueTest-1416322546-project-member] Releasing lock "refresh_cache-b6b0ba36-ad89-45f1-9578-8b999567dd25" {{(pid=74613) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 17:55:27 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:55:27 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:55:27 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-c91e8417-5b0e-455b-9678-f8e7727a2128 tempest-AttachVolumeShelveTestJSON-1452861425 tempest-AttachVolumeShelveTestJSON-1452861425-project-member] Acquiring lock "refresh_cache-c19e230e-2e6c-4c20-b15c-ad81a73674b4" {{(pid=74613) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 17:55:27 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-c91e8417-5b0e-455b-9678-f8e7727a2128 tempest-AttachVolumeShelveTestJSON-1452861425 tempest-AttachVolumeShelveTestJSON-1452861425-project-member] Acquired lock "refresh_cache-c19e230e-2e6c-4c20-b15c-ad81a73674b4" {{(pid=74613) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 17:55:27 user nova-compute[74613]: DEBUG nova.network.neutron [None req-c91e8417-5b0e-455b-9678-f8e7727a2128 tempest-AttachVolumeShelveTestJSON-1452861425 tempest-AttachVolumeShelveTestJSON-1452861425-project-member] [instance: c19e230e-2e6c-4c20-b15c-ad81a73674b4] Building network info cache for instance {{(pid=74613) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 29 17:55:27 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:55:27 user nova-compute[74613]: DEBUG nova.compute.manager [req-4ecfe9fc-6f16-4eaa-9628-34b54683b6ee req-69ab626c-6499-4d7d-865d-9dd118c3ece9 service nova] [instance: c19e230e-2e6c-4c20-b15c-ad81a73674b4] Received event network-changed-a414bce0-6293-4987-9441-46943fe2e877 {{(pid=74613) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 17:55:27 user nova-compute[74613]: DEBUG nova.compute.manager [req-4ecfe9fc-6f16-4eaa-9628-34b54683b6ee req-69ab626c-6499-4d7d-865d-9dd118c3ece9 service nova] [instance: c19e230e-2e6c-4c20-b15c-ad81a73674b4] Refreshing instance network info cache due to event network-changed-a414bce0-6293-4987-9441-46943fe2e877. {{(pid=74613) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 17:55:27 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-4ecfe9fc-6f16-4eaa-9628-34b54683b6ee req-69ab626c-6499-4d7d-865d-9dd118c3ece9 service nova] Acquiring lock "refresh_cache-c19e230e-2e6c-4c20-b15c-ad81a73674b4" {{(pid=74613) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 17:55:27 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:55:27 user nova-compute[74613]: DEBUG nova.compute.manager [req-30854a44-353c-4b35-a666-b88a63db5d89 req-5b83a57d-2abe-4f58-bce9-ec720b4add0a service nova] [instance: 74ac9703-1cd7-4983-b7d4-c69b01fec7b2] Received event network-changed-c63b6577-fb46-437a-95b3-8321fab45d0c {{(pid=74613) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 17:55:27 user nova-compute[74613]: DEBUG nova.compute.manager [req-30854a44-353c-4b35-a666-b88a63db5d89 req-5b83a57d-2abe-4f58-bce9-ec720b4add0a service nova] [instance: 74ac9703-1cd7-4983-b7d4-c69b01fec7b2] Refreshing instance network info cache due to event network-changed-c63b6577-fb46-437a-95b3-8321fab45d0c. {{(pid=74613) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 17:55:27 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-30854a44-353c-4b35-a666-b88a63db5d89 req-5b83a57d-2abe-4f58-bce9-ec720b4add0a service nova] Acquiring lock "refresh_cache-74ac9703-1cd7-4983-b7d4-c69b01fec7b2" {{(pid=74613) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 17:55:27 user nova-compute[74613]: DEBUG nova.network.neutron [None req-176e853b-89a1-45dc-8294-c527328264ba tempest-ServerActionsTestOtherB-894551005 tempest-ServerActionsTestOtherB-894551005-project-member] [instance: 74ac9703-1cd7-4983-b7d4-c69b01fec7b2] Instance cache missing network info. {{(pid=74613) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 29 17:55:27 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:55:28 user nova-compute[74613]: INFO nova.virt.libvirt.driver [-] [instance: b6b0ba36-ad89-45f1-9578-8b999567dd25] Instance destroyed successfully.
Nov 29 17:55:28 user nova-compute[74613]: INFO nova.virt.libvirt.driver [None req-0e88c997-e820-43a6-96c7-7a0a2006fbc3 tempest-ServerStableDeviceRescueTest-1416322546 tempest-ServerStableDeviceRescueTest-1416322546-project-member] [instance: b6b0ba36-ad89-45f1-9578-8b999567dd25] Attempting a stable device rescue
Nov 29 17:55:28 user nova-compute[74613]: DEBUG nova.network.neutron [None req-176e853b-89a1-45dc-8294-c527328264ba tempest-ServerActionsTestOtherB-894551005 tempest-ServerActionsTestOtherB-894551005-project-member] [instance: 74ac9703-1cd7-4983-b7d4-c69b01fec7b2] Updating instance_info_cache with network_info: [{"id": "c63b6577-fb46-437a-95b3-8321fab45d0c", "address": "fa:16:3e:c3:2e:71", "network": {"id": "e687ed60-2592-4836-b97e-0828527b1b9f", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1938956411-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b392ca87608940c0ae467318b66453b2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc63b6577-fb", "ovs_interfaceid": "c63b6577-fb46-437a-95b3-8321fab45d0c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74613) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 17:55:28 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-176e853b-89a1-45dc-8294-c527328264ba tempest-ServerActionsTestOtherB-894551005 tempest-ServerActionsTestOtherB-894551005-project-member] Releasing lock "refresh_cache-74ac9703-1cd7-4983-b7d4-c69b01fec7b2" {{(pid=74613) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 17:55:28 user nova-compute[74613]: DEBUG nova.compute.manager [None req-176e853b-89a1-45dc-8294-c527328264ba tempest-ServerActionsTestOtherB-894551005 tempest-ServerActionsTestOtherB-894551005-project-member] [instance: 74ac9703-1cd7-4983-b7d4-c69b01fec7b2] Instance network_info: |[{"id": "c63b6577-fb46-437a-95b3-8321fab45d0c", "address": "fa:16:3e:c3:2e:71", "network": {"id": "e687ed60-2592-4836-b97e-0828527b1b9f", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1938956411-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b392ca87608940c0ae467318b66453b2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc63b6577-fb", "ovs_interfaceid": "c63b6577-fb46-437a-95b3-8321fab45d0c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74613) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 29 17:55:28 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-30854a44-353c-4b35-a666-b88a63db5d89 req-5b83a57d-2abe-4f58-bce9-ec720b4add0a service nova] Acquired lock "refresh_cache-74ac9703-1cd7-4983-b7d4-c69b01fec7b2" {{(pid=74613) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 17:55:28 user nova-compute[74613]: DEBUG nova.network.neutron [req-30854a44-353c-4b35-a666-b88a63db5d89 req-5b83a57d-2abe-4f58-bce9-ec720b4add0a service nova] [instance: 74ac9703-1cd7-4983-b7d4-c69b01fec7b2] Refreshing network info cache for port c63b6577-fb46-437a-95b3-8321fab45d0c {{(pid=74613) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 17:55:28 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-176e853b-89a1-45dc-8294-c527328264ba tempest-ServerActionsTestOtherB-894551005 tempest-ServerActionsTestOtherB-894551005-project-member] [instance: 74ac9703-1cd7-4983-b7d4-c69b01fec7b2] Start _get_guest_xml network_info=[{"id": "c63b6577-fb46-437a-95b3-8321fab45d0c", "address": "fa:16:3e:c3:2e:71", "network": {"id": "e687ed60-2592-4836-b97e-0828527b1b9f", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1938956411-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b392ca87608940c0ae467318b66453b2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc63b6577-fb", "ovs_interfaceid": "c63b6577-fb46-437a-95b3-8321fab45d0c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-29T17:47:38Z,direct_url=<?>,disk_format='qcow2',id=4217f428-8d9d-4ee1-9614-642d26d90c46,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='794b07cbd46a44b5865cfda741036bae',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-29T17:47:40Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'size': 0, 'device_type': 'disk', 'boot_index': 0, 'guest_format': None, 'encrypted': False, 'encryption_format': None, 'disk_bus': 'virtio', 'image_id': '4217f428-8d9d-4ee1-9614-642d26d90c46'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74613) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 29 17:55:28 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-0e88c997-e820-43a6-96c7-7a0a2006fbc3 tempest-ServerStableDeviceRescueTest-1416322546 tempest-ServerStableDeviceRescueTest-1416322546-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk'}}} {{(pid=74613) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4318}}
Nov 29 17:55:28 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-0e88c997-e820-43a6-96c7-7a0a2006fbc3 tempest-ServerStableDeviceRescueTest-1416322546 tempest-ServerStableDeviceRescueTest-1416322546-project-member] [instance: b6b0ba36-ad89-45f1-9578-8b999567dd25] Instance directory exists: not creating {{(pid=74613) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Nov 29 17:55:28 user nova-compute[74613]: INFO nova.virt.libvirt.driver [None req-0e88c997-e820-43a6-96c7-7a0a2006fbc3 tempest-ServerStableDeviceRescueTest-1416322546 tempest-ServerStableDeviceRescueTest-1416322546-project-member] [instance: b6b0ba36-ad89-45f1-9578-8b999567dd25] Creating image(s)
Nov 29 17:55:28 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-0e88c997-e820-43a6-96c7-7a0a2006fbc3 tempest-ServerStableDeviceRescueTest-1416322546 tempest-ServerStableDeviceRescueTest-1416322546-project-member] Acquiring lock "/opt/stack/data/nova/instances/b6b0ba36-ad89-45f1-9578-8b999567dd25/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 17:55:28 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-0e88c997-e820-43a6-96c7-7a0a2006fbc3 tempest-ServerStableDeviceRescueTest-1416322546 tempest-ServerStableDeviceRescueTest-1416322546-project-member] Lock "/opt/stack/data/nova/instances/b6b0ba36-ad89-45f1-9578-8b999567dd25/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 17:55:28 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-0e88c997-e820-43a6-96c7-7a0a2006fbc3 tempest-ServerStableDeviceRescueTest-1416322546 tempest-ServerStableDeviceRescueTest-1416322546-project-member] Lock "/opt/stack/data/nova/instances/b6b0ba36-ad89-45f1-9578-8b999567dd25/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 17:55:28 user nova-compute[74613]: DEBUG nova.objects.instance [None req-0e88c997-e820-43a6-96c7-7a0a2006fbc3 tempest-ServerStableDeviceRescueTest-1416322546 tempest-ServerStableDeviceRescueTest-1416322546-project-member] Lazy-loading 'trusted_certs' on Instance uuid b6b0ba36-ad89-45f1-9578-8b999567dd25 {{(pid=74613) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 17:55:28 user nova-compute[74613]: WARNING nova.virt.libvirt.driver [None req-176e853b-89a1-45dc-8294-c527328264ba tempest-ServerActionsTestOtherB-894551005 tempest-ServerActionsTestOtherB-894551005-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 17:55:28 user nova-compute[74613]: WARNING nova.virt.libvirt.driver [None req-176e853b-89a1-45dc-8294-c527328264ba tempest-ServerActionsTestOtherB-894551005 tempest-ServerActionsTestOtherB-894551005-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 17:55:28 user nova-compute[74613]: DEBUG nova.virt.libvirt.host [None req-176e853b-89a1-45dc-8294-c527328264ba tempest-ServerActionsTestOtherB-894551005 tempest-ServerActionsTestOtherB-894551005-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74613) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 29 17:55:28 user nova-compute[74613]: DEBUG nova.virt.libvirt.host [None req-176e853b-89a1-45dc-8294-c527328264ba tempest-ServerActionsTestOtherB-894551005 tempest-ServerActionsTestOtherB-894551005-project-member] CPU controller missing on host. {{(pid=74613) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 29 17:55:28 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-0e88c997-e820-43a6-96c7-7a0a2006fbc3 tempest-ServerStableDeviceRescueTest-1416322546 tempest-ServerStableDeviceRescueTest-1416322546-project-member] Acquiring lock "f555a336fa02620cd7ad8eb02d7ee22fe12aadf5" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 17:55:28 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-0e88c997-e820-43a6-96c7-7a0a2006fbc3 tempest-ServerStableDeviceRescueTest-1416322546 tempest-ServerStableDeviceRescueTest-1416322546-project-member] Lock "f555a336fa02620cd7ad8eb02d7ee22fe12aadf5" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 17:55:28 user nova-compute[74613]: DEBUG nova.virt.libvirt.host [None req-176e853b-89a1-45dc-8294-c527328264ba tempest-ServerActionsTestOtherB-894551005 tempest-ServerActionsTestOtherB-894551005-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74613) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 29 17:55:28 user nova-compute[74613]: DEBUG nova.virt.libvirt.host [None req-176e853b-89a1-45dc-8294-c527328264ba tempest-ServerActionsTestOtherB-894551005 tempest-ServerActionsTestOtherB-894551005-project-member] CPU controller found on host. {{(pid=74613) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 29 17:55:28 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-176e853b-89a1-45dc-8294-c527328264ba tempest-ServerActionsTestOtherB-894551005 tempest-ServerActionsTestOtherB-894551005-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74613) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 29 17:55:28 user nova-compute[74613]: DEBUG nova.virt.hardware [None req-176e853b-89a1-45dc-8294-c527328264ba tempest-ServerActionsTestOtherB-894551005 tempest-ServerActionsTestOtherB-894551005-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-29T17:47:27Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-29T17:47:38Z,direct_url=<?>,disk_format='qcow2',id=4217f428-8d9d-4ee1-9614-642d26d90c46,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='794b07cbd46a44b5865cfda741036bae',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-29T17:47:40Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74613) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 29 17:55:28 user nova-compute[74613]: DEBUG nova.virt.hardware [None req-176e853b-89a1-45dc-8294-c527328264ba tempest-ServerActionsTestOtherB-894551005 tempest-ServerActionsTestOtherB-894551005-project-member] Flavor limits 0:0:0 {{(pid=74613) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 29 17:55:28 user nova-compute[74613]: DEBUG nova.virt.hardware [None req-176e853b-89a1-45dc-8294-c527328264ba tempest-ServerActionsTestOtherB-894551005 tempest-ServerActionsTestOtherB-894551005-project-member] Image limits 0:0:0 {{(pid=74613) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 29 17:55:28 user nova-compute[74613]: DEBUG nova.virt.hardware [None req-176e853b-89a1-45dc-8294-c527328264ba tempest-ServerActionsTestOtherB-894551005 tempest-ServerActionsTestOtherB-894551005-project-member] Flavor pref 0:0:0 {{(pid=74613) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 29 17:55:28 user nova-compute[74613]: DEBUG nova.virt.hardware [None req-176e853b-89a1-45dc-8294-c527328264ba tempest-ServerActionsTestOtherB-894551005 tempest-ServerActionsTestOtherB-894551005-project-member] Image pref 0:0:0 {{(pid=74613) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 29 17:55:28 user nova-compute[74613]: DEBUG nova.virt.hardware [None req-176e853b-89a1-45dc-8294-c527328264ba tempest-ServerActionsTestOtherB-894551005 tempest-ServerActionsTestOtherB-894551005-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74613) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 29 17:55:28 user nova-compute[74613]: DEBUG nova.virt.hardware [None req-176e853b-89a1-45dc-8294-c527328264ba tempest-ServerActionsTestOtherB-894551005 tempest-ServerActionsTestOtherB-894551005-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74613) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 29 17:55:28 user nova-compute[74613]: DEBUG nova.virt.hardware [None req-176e853b-89a1-45dc-8294-c527328264ba tempest-ServerActionsTestOtherB-894551005 tempest-ServerActionsTestOtherB-894551005-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74613) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 29 17:55:28 user nova-compute[74613]: DEBUG nova.virt.hardware [None req-176e853b-89a1-45dc-8294-c527328264ba tempest-ServerActionsTestOtherB-894551005 tempest-ServerActionsTestOtherB-894551005-project-member] Got 1 possible topologies {{(pid=74613) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 29 17:55:28 user nova-compute[74613]: DEBUG nova.virt.hardware [None req-176e853b-89a1-45dc-8294-c527328264ba tempest-ServerActionsTestOtherB-894551005 tempest-ServerActionsTestOtherB-894551005-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74613) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 29 17:55:28 user nova-compute[74613]: DEBUG nova.virt.hardware [None req-176e853b-89a1-45dc-8294-c527328264ba tempest-ServerActionsTestOtherB-894551005 tempest-ServerActionsTestOtherB-894551005-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74613) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 29 17:55:28 user nova-compute[74613]: DEBUG nova.virt.libvirt.vif [None req-176e853b-89a1-45dc-8294-c527328264ba tempest-ServerActionsTestOtherB-894551005 tempest-ServerActionsTestOtherB-894551005-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T17:55:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-931769463',display_name='tempest-ServerActionsTestOtherB-server-931769463',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-931769463',id=14,image_ref='4217f428-8d9d-4ee1-9614-642d26d90c46',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBE0p3wmKXoOCABzKEPJ0MsHfAtC1JQfzjVn7a3OeQC65p309Te6g/AbiDIZbrFAX7j9aAJfq/HNC8gx1yP/V9/PHfR3o28o9EgbHEcoTtW/dEJGkpFGjjy+hrqfOfHYCnA==',key_name='tempest-keypair-464492783',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b392ca87608940c0ae467318b66453b2',ramdisk_id='',reservation_id='r-0wzexjb0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='4217f428-8d9d-4ee1-9614-642d26d90c46',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherB-894551005',owner_user_name='tempest-ServerActionsTestOtherB-894551005-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T17:55:25Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1a6eb590fed440729b45b8db79eb7c2f',uuid=74ac9703-1cd7-4983-b7d4-c69b01fec7b2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c63b6577-fb46-437a-95b3-8321fab45d0c", "address": "fa:16:3e:c3:2e:71", "network": {"id": "e687ed60-2592-4836-b97e-0828527b1b9f", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1938956411-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b392ca87608940c0ae467318b66453b2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc63b6577-fb", "ovs_interfaceid": "c63b6577-fb46-437a-95b3-8321fab45d0c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74613) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 29 17:55:28 user nova-compute[74613]: DEBUG nova.network.os_vif_util [None req-176e853b-89a1-45dc-8294-c527328264ba tempest-ServerActionsTestOtherB-894551005 tempest-ServerActionsTestOtherB-894551005-project-member] Converting VIF {"id": "c63b6577-fb46-437a-95b3-8321fab45d0c", "address": "fa:16:3e:c3:2e:71", "network": {"id": "e687ed60-2592-4836-b97e-0828527b1b9f", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1938956411-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b392ca87608940c0ae467318b66453b2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc63b6577-fb", "ovs_interfaceid": "c63b6577-fb46-437a-95b3-8321fab45d0c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74613) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 17:55:28 user nova-compute[74613]: DEBUG nova.network.os_vif_util [None req-176e853b-89a1-45dc-8294-c527328264ba tempest-ServerActionsTestOtherB-894551005 tempest-ServerActionsTestOtherB-894551005-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c3:2e:71,bridge_name='br-int',has_traffic_filtering=True,id=c63b6577-fb46-437a-95b3-8321fab45d0c,network=Network(e687ed60-2592-4836-b97e-0828527b1b9f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc63b6577-fb') {{(pid=74613) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 17:55:28 user nova-compute[74613]: DEBUG nova.objects.instance [None req-176e853b-89a1-45dc-8294-c527328264ba tempest-ServerActionsTestOtherB-894551005 tempest-ServerActionsTestOtherB-894551005-project-member] Lazy-loading 'pci_devices' on Instance uuid 74ac9703-1cd7-4983-b7d4-c69b01fec7b2 {{(pid=74613) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 17:55:28 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-176e853b-89a1-45dc-8294-c527328264ba tempest-ServerActionsTestOtherB-894551005 tempest-ServerActionsTestOtherB-894551005-project-member] [instance: 74ac9703-1cd7-4983-b7d4-c69b01fec7b2] End _get_guest_xml xml=<domain type="kvm">
Nov 29 17:55:28 user nova-compute[74613]:   <uuid>74ac9703-1cd7-4983-b7d4-c69b01fec7b2</uuid>
Nov 29 17:55:28 user nova-compute[74613]:   <name>instance-0000000e</name>
Nov 29 17:55:28 user nova-compute[74613]:   <memory>524288</memory>
Nov 29 17:55:28 user nova-compute[74613]:   <vcpu>1</vcpu>
Nov 29 17:55:28 user nova-compute[74613]:   <metadata>
Nov 29 17:55:28 user nova-compute[74613]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 29 17:55:28 user nova-compute[74613]:       <nova:package version="0.0.0"/>
Nov 29 17:55:28 user nova-compute[74613]:       <nova:name>tempest-ServerActionsTestOtherB-server-931769463</nova:name>
Nov 29 17:55:28 user nova-compute[74613]:       <nova:creationTime>2023-11-29 17:55:28</nova:creationTime>
Nov 29 17:55:28 user nova-compute[74613]:       <nova:flavor name="m1.tiny">
Nov 29 17:55:28 user nova-compute[74613]:         <nova:memory>512</nova:memory>
Nov 29 17:55:28 user nova-compute[74613]:         <nova:disk>1</nova:disk>
Nov 29 17:55:28 user nova-compute[74613]:         <nova:swap>0</nova:swap>
Nov 29 17:55:28 user nova-compute[74613]:         <nova:ephemeral>0</nova:ephemeral>
Nov 29 17:55:28 user nova-compute[74613]:         <nova:vcpus>1</nova:vcpus>
Nov 29 17:55:28 user nova-compute[74613]:       </nova:flavor>
Nov 29 17:55:28 user nova-compute[74613]:       <nova:owner>
Nov 29 17:55:28 user nova-compute[74613]:         <nova:user uuid="1a6eb590fed440729b45b8db79eb7c2f">tempest-ServerActionsTestOtherB-894551005-project-member</nova:user>
Nov 29 17:55:28 user nova-compute[74613]:         <nova:project uuid="b392ca87608940c0ae467318b66453b2">tempest-ServerActionsTestOtherB-894551005</nova:project>
Nov 29 17:55:28 user nova-compute[74613]:       </nova:owner>
Nov 29 17:55:28 user nova-compute[74613]:       <nova:root type="image" uuid="4217f428-8d9d-4ee1-9614-642d26d90c46"/>
Nov 29 17:55:28 user nova-compute[74613]:       <nova:ports>
Nov 29 17:55:28 user nova-compute[74613]:         <nova:port uuid="c63b6577-fb46-437a-95b3-8321fab45d0c">
Nov 29 17:55:28 user nova-compute[74613]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Nov 29 17:55:28 user nova-compute[74613]:         </nova:port>
Nov 29 17:55:28 user nova-compute[74613]:       </nova:ports>
Nov 29 17:55:28 user nova-compute[74613]:     </nova:instance>
Nov 29 17:55:28 user nova-compute[74613]:   </metadata>
Nov 29 17:55:28 user nova-compute[74613]:   <sysinfo type="smbios">
Nov 29 17:55:28 user nova-compute[74613]:     <system>
Nov 29 17:55:28 user nova-compute[74613]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 29 17:55:28 user nova-compute[74613]:       <entry name="product">OpenStack Nova</entry>
Nov 29 17:55:28 user nova-compute[74613]:       <entry name="version">0.0.0</entry>
Nov 29 17:55:28 user nova-compute[74613]:       <entry name="serial">74ac9703-1cd7-4983-b7d4-c69b01fec7b2</entry>
Nov 29 17:55:28 user nova-compute[74613]:       <entry name="uuid">74ac9703-1cd7-4983-b7d4-c69b01fec7b2</entry>
Nov 29 17:55:28 user nova-compute[74613]:       <entry name="family">Virtual Machine</entry>
Nov 29 17:55:28 user nova-compute[74613]:     </system>
Nov 29 17:55:28 user nova-compute[74613]:   </sysinfo>
Nov 29 17:55:28 user nova-compute[74613]:   <os>
Nov 29 17:55:28 user nova-compute[74613]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 29 17:55:28 user nova-compute[74613]:     <boot dev="hd"/>
Nov 29 17:55:28 user nova-compute[74613]:     <smbios mode="sysinfo"/>
Nov 29 17:55:28 user nova-compute[74613]:   </os>
Nov 29 17:55:28 user nova-compute[74613]:   <features>
Nov 29 17:55:28 user nova-compute[74613]:     <acpi/>
Nov 29 17:55:28 user nova-compute[74613]:     <apic/>
Nov 29 17:55:28 user nova-compute[74613]:     <vmcoreinfo/>
Nov 29 17:55:28 user nova-compute[74613]:   </features>
Nov 29 17:55:28 user nova-compute[74613]:   <clock offset="utc">
Nov 29 17:55:28 user nova-compute[74613]:     <timer name="pit" tickpolicy="delay"/>
Nov 29 17:55:28 user nova-compute[74613]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 29 17:55:28 user nova-compute[74613]:     <timer name="hpet" present="no"/>
Nov 29 17:55:28 user nova-compute[74613]:   </clock>
Nov 29 17:55:28 user nova-compute[74613]:   <cpu mode="custom" match="exact">
Nov 29 17:55:28 user nova-compute[74613]:     <model>Nehalem</model>
Nov 29 17:55:28 user nova-compute[74613]:     <topology sockets="1" cores="1" threads="1"/>
Nov 29 17:55:28 user nova-compute[74613]:   </cpu>
Nov 29 17:55:28 user nova-compute[74613]:   <devices>
Nov 29 17:55:28 user nova-compute[74613]:     <disk type="file" device="disk">
Nov 29 17:55:28 user nova-compute[74613]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 29 17:55:28 user nova-compute[74613]:       <source file="/opt/stack/data/nova/instances/74ac9703-1cd7-4983-b7d4-c69b01fec7b2/disk"/>
Nov 29 17:55:28 user nova-compute[74613]:       <target dev="vda" bus="virtio"/>
Nov 29 17:55:28 user nova-compute[74613]:     </disk>
Nov 29 17:55:28 user nova-compute[74613]:     <interface type="ethernet">
Nov 29 17:55:28 user nova-compute[74613]:       <mac address="fa:16:3e:c3:2e:71"/>
Nov 29 17:55:28 user nova-compute[74613]:       <model type="virtio"/>
Nov 29 17:55:28 user nova-compute[74613]:       <mtu size="1442"/>
Nov 29 17:55:28 user nova-compute[74613]:       <target dev="tapc63b6577-fb"/>
Nov 29 17:55:28 user nova-compute[74613]:     </interface>
Nov 29 17:55:28 user nova-compute[74613]:     <serial type="pty">
Nov 29 17:55:28 user nova-compute[74613]:       <log file="/opt/stack/data/nova/instances/74ac9703-1cd7-4983-b7d4-c69b01fec7b2/console.log" append="off"/>
Nov 29 17:55:28 user nova-compute[74613]:     </serial>
Nov 29 17:55:28 user nova-compute[74613]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 29 17:55:28 user nova-compute[74613]:     <video>
Nov 29 17:55:28 user nova-compute[74613]:       <model type="virtio"/>
Nov 29 17:55:28 user nova-compute[74613]:     </video>
Nov 29 17:55:28 user nova-compute[74613]:     <rng model="virtio">
Nov 29 17:55:28 user nova-compute[74613]:       <backend model="random">/dev/urandom</backend>
Nov 29 17:55:28 user nova-compute[74613]:     </rng>
Nov 29 17:55:28 user nova-compute[74613]:     <controller type="usb" index="0" model="none"/>
Nov 29 17:55:28 user nova-compute[74613]:     <memballoon model="virtio">
Nov 29 17:55:28 user nova-compute[74613]:       <stats period="10"/>
Nov 29 17:55:28 user nova-compute[74613]:     </memballoon>
Nov 29 17:55:28 user nova-compute[74613]:   </devices>
Nov 29 17:55:28 user nova-compute[74613]: </domain>
Nov 29 17:55:28 user nova-compute[74613]:  {{(pid=74613) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 29 17:55:28 user nova-compute[74613]: DEBUG nova.virt.libvirt.vif [None req-176e853b-89a1-45dc-8294-c527328264ba tempest-ServerActionsTestOtherB-894551005 tempest-ServerActionsTestOtherB-894551005-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T17:55:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-931769463',display_name='tempest-ServerActionsTestOtherB-server-931769463',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-931769463',id=14,image_ref='4217f428-8d9d-4ee1-9614-642d26d90c46',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBE0p3wmKXoOCABzKEPJ0MsHfAtC1JQfzjVn7a3OeQC65p309Te6g/AbiDIZbrFAX7j9aAJfq/HNC8gx1yP/V9/PHfR3o28o9EgbHEcoTtW/dEJGkpFGjjy+hrqfOfHYCnA==',key_name='tempest-keypair-464492783',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b392ca87608940c0ae467318b66453b2',ramdisk_id='',reservation_id='r-0wzexjb0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='4217f428-8d9d-4ee1-9614-642d26d90c46',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherB-894551005',owner_user_name='tempest-ServerActionsTestOtherB-894551005-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T17:55:25Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1a6eb590fed440729b45b8db79eb7c2f',uuid=74ac9703-1cd7-4983-b7d4-c69b01fec7b2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c63b6577-fb46-437a-95b3-8321fab45d0c", "address": "fa:16:3e:c3:2e:71", "network": {"id": "e687ed60-2592-4836-b97e-0828527b1b9f", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1938956411-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b392ca87608940c0ae467318b66453b2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc63b6577-fb", "ovs_interfaceid": "c63b6577-fb46-437a-95b3-8321fab45d0c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74613) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 29 17:55:28 user nova-compute[74613]: DEBUG nova.network.os_vif_util [None req-176e853b-89a1-45dc-8294-c527328264ba tempest-ServerActionsTestOtherB-894551005 tempest-ServerActionsTestOtherB-894551005-project-member] Converting VIF {"id": "c63b6577-fb46-437a-95b3-8321fab45d0c", "address": "fa:16:3e:c3:2e:71", "network": {"id": "e687ed60-2592-4836-b97e-0828527b1b9f", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1938956411-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b392ca87608940c0ae467318b66453b2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc63b6577-fb", "ovs_interfaceid": "c63b6577-fb46-437a-95b3-8321fab45d0c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74613) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 17:55:28 user nova-compute[74613]: DEBUG nova.network.os_vif_util [None req-176e853b-89a1-45dc-8294-c527328264ba tempest-ServerActionsTestOtherB-894551005 tempest-ServerActionsTestOtherB-894551005-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c3:2e:71,bridge_name='br-int',has_traffic_filtering=True,id=c63b6577-fb46-437a-95b3-8321fab45d0c,network=Network(e687ed60-2592-4836-b97e-0828527b1b9f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc63b6577-fb') {{(pid=74613) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 17:55:28 user nova-compute[74613]: DEBUG os_vif [None req-176e853b-89a1-45dc-8294-c527328264ba tempest-ServerActionsTestOtherB-894551005 tempest-ServerActionsTestOtherB-894551005-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c3:2e:71,bridge_name='br-int',has_traffic_filtering=True,id=c63b6577-fb46-437a-95b3-8321fab45d0c,network=Network(e687ed60-2592-4836-b97e-0828527b1b9f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc63b6577-fb') {{(pid=74613) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 29 17:55:28 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:55:28 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74613) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 17:55:28 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74613) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 29 17:55:28 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:55:28 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '0a1a518d-0115-5f9b-8d7d-237989c4884e', '_type': 'linux-noop'}}, row=False) {{(pid=74613) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 17:55:28 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:55:28 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 17:55:28 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:55:28 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:55:28 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapc63b6577-fb, may_exist=True, interface_attrs={}) {{(pid=74613) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 17:55:28 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapc63b6577-fb, col_values=(('qos', UUID('624a98ed-84b4-4206-9aef-c4f7baa58c74')),), if_exists=True) {{(pid=74613) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 17:55:28 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapc63b6577-fb, col_values=(('external_ids', {'iface-id': 'c63b6577-fb46-437a-95b3-8321fab45d0c', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:c3:2e:71', 'vm-uuid': '74ac9703-1cd7-4983-b7d4-c69b01fec7b2'}),), if_exists=True) {{(pid=74613) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 17:55:28 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:55:28 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 17:55:28 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:55:28 user nova-compute[74613]: INFO os_vif [None req-176e853b-89a1-45dc-8294-c527328264ba tempest-ServerActionsTestOtherB-894551005 tempest-ServerActionsTestOtherB-894551005-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c3:2e:71,bridge_name='br-int',has_traffic_filtering=True,id=c63b6577-fb46-437a-95b3-8321fab45d0c,network=Network(e687ed60-2592-4836-b97e-0828527b1b9f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc63b6577-fb')
Nov 29 17:55:29 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-0e88c997-e820-43a6-96c7-7a0a2006fbc3 tempest-ServerStableDeviceRescueTest-1416322546 tempest-ServerStableDeviceRescueTest-1416322546-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f555a336fa02620cd7ad8eb02d7ee22fe12aadf5.part --force-share --output=json {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 17:55:29 user nova-compute[74613]: DEBUG nova.network.neutron [None req-c91e8417-5b0e-455b-9678-f8e7727a2128 tempest-AttachVolumeShelveTestJSON-1452861425 tempest-AttachVolumeShelveTestJSON-1452861425-project-member] [instance: c19e230e-2e6c-4c20-b15c-ad81a73674b4] Updating instance_info_cache with network_info: [{"id": "a414bce0-6293-4987-9441-46943fe2e877", "address": "fa:16:3e:8e:94:32", "network": {"id": "4a101f3e-d23e-4198-bc3c-b4f9b4d2b4c4", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-864151424-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.168", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1c0c1c71400549369c1b11ca7d5f43ec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa414bce0-62", "ovs_interfaceid": "a414bce0-6293-4987-9441-46943fe2e877", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74613) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 17:55:29 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-0e88c997-e820-43a6-96c7-7a0a2006fbc3 tempest-ServerStableDeviceRescueTest-1416322546 tempest-ServerStableDeviceRescueTest-1416322546-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f555a336fa02620cd7ad8eb02d7ee22fe12aadf5.part --force-share --output=json" returned: 0 in 0.175s {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 17:55:29 user nova-compute[74613]: DEBUG nova.virt.images [None req-0e88c997-e820-43a6-96c7-7a0a2006fbc3 tempest-ServerStableDeviceRescueTest-1416322546 tempest-ServerStableDeviceRescueTest-1416322546-project-member] 31c05962-a152-463c-b6e8-6acca8cf5aa2 was qcow2, converting to raw {{(pid=74613) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 29 17:55:29 user nova-compute[74613]: DEBUG nova.privsep.utils [None req-0e88c997-e820-43a6-96c7-7a0a2006fbc3 tempest-ServerStableDeviceRescueTest-1416322546 tempest-ServerStableDeviceRescueTest-1416322546-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74613) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 29 17:55:29 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-0e88c997-e820-43a6-96c7-7a0a2006fbc3 tempest-ServerStableDeviceRescueTest-1416322546 tempest-ServerStableDeviceRescueTest-1416322546-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/f555a336fa02620cd7ad8eb02d7ee22fe12aadf5.part /opt/stack/data/nova/instances/_base/f555a336fa02620cd7ad8eb02d7ee22fe12aadf5.converted {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 17:55:29 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-c91e8417-5b0e-455b-9678-f8e7727a2128 tempest-AttachVolumeShelveTestJSON-1452861425 tempest-AttachVolumeShelveTestJSON-1452861425-project-member] Releasing lock "refresh_cache-c19e230e-2e6c-4c20-b15c-ad81a73674b4" {{(pid=74613) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 17:55:29 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-c91e8417-5b0e-455b-9678-f8e7727a2128 tempest-AttachVolumeShelveTestJSON-1452861425 tempest-AttachVolumeShelveTestJSON-1452861425-project-member] [instance: c19e230e-2e6c-4c20-b15c-ad81a73674b4] Creating instance directory {{(pid=74613) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 29 17:55:29 user nova-compute[74613]: INFO nova.virt.libvirt.driver [None req-c91e8417-5b0e-455b-9678-f8e7727a2128 tempest-AttachVolumeShelveTestJSON-1452861425 tempest-AttachVolumeShelveTestJSON-1452861425-project-member] [instance: c19e230e-2e6c-4c20-b15c-ad81a73674b4] Creating image(s)
Nov 29 17:55:29 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-c91e8417-5b0e-455b-9678-f8e7727a2128 tempest-AttachVolumeShelveTestJSON-1452861425 tempest-AttachVolumeShelveTestJSON-1452861425-project-member] Acquiring lock "/opt/stack/data/nova/instances/c19e230e-2e6c-4c20-b15c-ad81a73674b4/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 17:55:29 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-c91e8417-5b0e-455b-9678-f8e7727a2128 tempest-AttachVolumeShelveTestJSON-1452861425 tempest-AttachVolumeShelveTestJSON-1452861425-project-member] Lock "/opt/stack/data/nova/instances/c19e230e-2e6c-4c20-b15c-ad81a73674b4/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 17:55:29 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-c91e8417-5b0e-455b-9678-f8e7727a2128 tempest-AttachVolumeShelveTestJSON-1452861425 tempest-AttachVolumeShelveTestJSON-1452861425-project-member] Lock "/opt/stack/data/nova/instances/c19e230e-2e6c-4c20-b15c-ad81a73674b4/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.005s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 17:55:29 user nova-compute[74613]: DEBUG nova.objects.instance [None req-c91e8417-5b0e-455b-9678-f8e7727a2128 tempest-AttachVolumeShelveTestJSON-1452861425 tempest-AttachVolumeShelveTestJSON-1452861425-project-member] Lazy-loading 'trusted_certs' on Instance uuid c19e230e-2e6c-4c20-b15c-ad81a73674b4 {{(pid=74613) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 17:55:29 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:55:29 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-4ecfe9fc-6f16-4eaa-9628-34b54683b6ee req-69ab626c-6499-4d7d-865d-9dd118c3ece9 service nova] Acquired lock "refresh_cache-c19e230e-2e6c-4c20-b15c-ad81a73674b4" {{(pid=74613) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 17:55:29 user nova-compute[74613]: DEBUG nova.network.neutron [req-4ecfe9fc-6f16-4eaa-9628-34b54683b6ee req-69ab626c-6499-4d7d-865d-9dd118c3ece9 service nova] [instance: c19e230e-2e6c-4c20-b15c-ad81a73674b4] Refreshing network info cache for port a414bce0-6293-4987-9441-46943fe2e877 {{(pid=74613) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 17:55:29 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-176e853b-89a1-45dc-8294-c527328264ba tempest-ServerActionsTestOtherB-894551005 tempest-ServerActionsTestOtherB-894551005-project-member] No BDM found with device name vda, not building metadata. {{(pid=74613) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 17:55:29 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-176e853b-89a1-45dc-8294-c527328264ba tempest-ServerActionsTestOtherB-894551005 tempest-ServerActionsTestOtherB-894551005-project-member] No VIF found with MAC fa:16:3e:c3:2e:71, not building metadata {{(pid=74613) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 29 17:55:29 user nova-compute[74613]: DEBUG nova.objects.base [None req-c91e8417-5b0e-455b-9678-f8e7727a2128 tempest-AttachVolumeShelveTestJSON-1452861425 tempest-AttachVolumeShelveTestJSON-1452861425-project-member] Object Instance<c19e230e-2e6c-4c20-b15c-ad81a73674b4> lazy-loaded attributes: pci_requests,trusted_certs {{(pid=74613) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 29 17:55:29 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-c91e8417-5b0e-455b-9678-f8e7727a2128 tempest-AttachVolumeShelveTestJSON-1452861425 tempest-AttachVolumeShelveTestJSON-1452861425-project-member] Acquiring lock "4b1d3c6e93f4177d81652a25f8bdb62406dd0afd" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 17:55:29 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-c91e8417-5b0e-455b-9678-f8e7727a2128 tempest-AttachVolumeShelveTestJSON-1452861425 tempest-AttachVolumeShelveTestJSON-1452861425-project-member] Lock "4b1d3c6e93f4177d81652a25f8bdb62406dd0afd" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 17:55:29 user nova-compute[74613]: DEBUG nova.compute.manager [req-ea960931-a105-4574-93e3-236a334d7542 req-c6c05e98-b331-4fa7-ad4b-14f7149a97d4 service nova] [instance: b6b0ba36-ad89-45f1-9578-8b999567dd25] Received event network-vif-unplugged-0167e253-42dd-486a-8231-a8b8199f3584 {{(pid=74613) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 17:55:29 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-ea960931-a105-4574-93e3-236a334d7542 req-c6c05e98-b331-4fa7-ad4b-14f7149a97d4 service nova] Acquiring lock "b6b0ba36-ad89-45f1-9578-8b999567dd25-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 17:55:29 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-ea960931-a105-4574-93e3-236a334d7542 req-c6c05e98-b331-4fa7-ad4b-14f7149a97d4 service nova] Lock "b6b0ba36-ad89-45f1-9578-8b999567dd25-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 17:55:29 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-ea960931-a105-4574-93e3-236a334d7542 req-c6c05e98-b331-4fa7-ad4b-14f7149a97d4 service nova] Lock "b6b0ba36-ad89-45f1-9578-8b999567dd25-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 17:55:29 user nova-compute[74613]: DEBUG nova.compute.manager [req-ea960931-a105-4574-93e3-236a334d7542 req-c6c05e98-b331-4fa7-ad4b-14f7149a97d4 service nova] [instance: b6b0ba36-ad89-45f1-9578-8b999567dd25] No waiting events found dispatching network-vif-unplugged-0167e253-42dd-486a-8231-a8b8199f3584 {{(pid=74613) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 17:55:29 user nova-compute[74613]: WARNING nova.compute.manager [req-ea960931-a105-4574-93e3-236a334d7542 req-c6c05e98-b331-4fa7-ad4b-14f7149a97d4 service nova] [instance: b6b0ba36-ad89-45f1-9578-8b999567dd25] Received unexpected event network-vif-unplugged-0167e253-42dd-486a-8231-a8b8199f3584 for instance with vm_state active and task_state rescuing.
Nov 29 17:55:29 user nova-compute[74613]: DEBUG nova.compute.manager [req-ea960931-a105-4574-93e3-236a334d7542 req-c6c05e98-b331-4fa7-ad4b-14f7149a97d4 service nova] [instance: b6b0ba36-ad89-45f1-9578-8b999567dd25] Received event network-vif-plugged-0167e253-42dd-486a-8231-a8b8199f3584 {{(pid=74613) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 17:55:29 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-ea960931-a105-4574-93e3-236a334d7542 req-c6c05e98-b331-4fa7-ad4b-14f7149a97d4 service nova] Acquiring lock "b6b0ba36-ad89-45f1-9578-8b999567dd25-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 17:55:29 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-ea960931-a105-4574-93e3-236a334d7542 req-c6c05e98-b331-4fa7-ad4b-14f7149a97d4 service nova] Lock "b6b0ba36-ad89-45f1-9578-8b999567dd25-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 17:55:29 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-ea960931-a105-4574-93e3-236a334d7542 req-c6c05e98-b331-4fa7-ad4b-14f7149a97d4 service nova] Lock "b6b0ba36-ad89-45f1-9578-8b999567dd25-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 17:55:29 user nova-compute[74613]: DEBUG nova.compute.manager [req-ea960931-a105-4574-93e3-236a334d7542 req-c6c05e98-b331-4fa7-ad4b-14f7149a97d4 service nova] [instance: b6b0ba36-ad89-45f1-9578-8b999567dd25] No waiting events found dispatching network-vif-plugged-0167e253-42dd-486a-8231-a8b8199f3584 {{(pid=74613) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 17:55:29 user nova-compute[74613]: WARNING nova.compute.manager [req-ea960931-a105-4574-93e3-236a334d7542 req-c6c05e98-b331-4fa7-ad4b-14f7149a97d4 service nova] [instance: b6b0ba36-ad89-45f1-9578-8b999567dd25] Received unexpected event network-vif-plugged-0167e253-42dd-486a-8231-a8b8199f3584 for instance with vm_state active and task_state rescuing.
Nov 29 17:55:29 user nova-compute[74613]: DEBUG nova.network.neutron [req-30854a44-353c-4b35-a666-b88a63db5d89 req-5b83a57d-2abe-4f58-bce9-ec720b4add0a service nova] [instance: 74ac9703-1cd7-4983-b7d4-c69b01fec7b2] Updated VIF entry in instance network info cache for port c63b6577-fb46-437a-95b3-8321fab45d0c. {{(pid=74613) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 17:55:29 user nova-compute[74613]: DEBUG nova.network.neutron [req-30854a44-353c-4b35-a666-b88a63db5d89 req-5b83a57d-2abe-4f58-bce9-ec720b4add0a service nova] [instance: 74ac9703-1cd7-4983-b7d4-c69b01fec7b2] Updating instance_info_cache with network_info: [{"id": "c63b6577-fb46-437a-95b3-8321fab45d0c", "address": "fa:16:3e:c3:2e:71", "network": {"id": "e687ed60-2592-4836-b97e-0828527b1b9f", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1938956411-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b392ca87608940c0ae467318b66453b2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc63b6577-fb", "ovs_interfaceid": "c63b6577-fb46-437a-95b3-8321fab45d0c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74613) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 17:55:30 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-30854a44-353c-4b35-a666-b88a63db5d89 req-5b83a57d-2abe-4f58-bce9-ec720b4add0a service nova] Releasing lock "refresh_cache-74ac9703-1cd7-4983-b7d4-c69b01fec7b2" {{(pid=74613) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 17:55:31 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-c91e8417-5b0e-455b-9678-f8e7727a2128 tempest-AttachVolumeShelveTestJSON-1452861425 tempest-AttachVolumeShelveTestJSON-1452861425-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4b1d3c6e93f4177d81652a25f8bdb62406dd0afd.part --force-share --output=json {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 17:55:31 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-0e88c997-e820-43a6-96c7-7a0a2006fbc3 tempest-ServerStableDeviceRescueTest-1416322546 tempest-ServerStableDeviceRescueTest-1416322546-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/f555a336fa02620cd7ad8eb02d7ee22fe12aadf5.part /opt/stack/data/nova/instances/_base/f555a336fa02620cd7ad8eb02d7ee22fe12aadf5.converted" returned: 0 in 1.430s {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 17:55:31 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-0e88c997-e820-43a6-96c7-7a0a2006fbc3 tempest-ServerStableDeviceRescueTest-1416322546 tempest-ServerStableDeviceRescueTest-1416322546-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f555a336fa02620cd7ad8eb02d7ee22fe12aadf5.converted --force-share --output=json {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 17:55:31 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-c91e8417-5b0e-455b-9678-f8e7727a2128 tempest-AttachVolumeShelveTestJSON-1452861425 tempest-AttachVolumeShelveTestJSON-1452861425-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4b1d3c6e93f4177d81652a25f8bdb62406dd0afd.part --force-share --output=json" returned: 0 in 0.203s {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 17:55:31 user nova-compute[74613]: DEBUG nova.virt.images [None req-c91e8417-5b0e-455b-9678-f8e7727a2128 tempest-AttachVolumeShelveTestJSON-1452861425 tempest-AttachVolumeShelveTestJSON-1452861425-project-member] 9f45473b-2b66-4071-b129-1f38d43ff99e was qcow2, converting to raw {{(pid=74613) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 29 17:55:31 user nova-compute[74613]: DEBUG nova.privsep.utils [None req-c91e8417-5b0e-455b-9678-f8e7727a2128 tempest-AttachVolumeShelveTestJSON-1452861425 tempest-AttachVolumeShelveTestJSON-1452861425-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74613) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 29 17:55:31 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-c91e8417-5b0e-455b-9678-f8e7727a2128 tempest-AttachVolumeShelveTestJSON-1452861425 tempest-AttachVolumeShelveTestJSON-1452861425-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/4b1d3c6e93f4177d81652a25f8bdb62406dd0afd.part /opt/stack/data/nova/instances/_base/4b1d3c6e93f4177d81652a25f8bdb62406dd0afd.converted {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 17:55:31 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-0e88c997-e820-43a6-96c7-7a0a2006fbc3 tempest-ServerStableDeviceRescueTest-1416322546 tempest-ServerStableDeviceRescueTest-1416322546-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f555a336fa02620cd7ad8eb02d7ee22fe12aadf5.converted --force-share --output=json" returned: 0 in 0.204s {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 17:55:31 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-0e88c997-e820-43a6-96c7-7a0a2006fbc3 tempest-ServerStableDeviceRescueTest-1416322546 tempest-ServerStableDeviceRescueTest-1416322546-project-member] Lock "f555a336fa02620cd7ad8eb02d7ee22fe12aadf5" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 2.934s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 17:55:31 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-0e88c997-e820-43a6-96c7-7a0a2006fbc3 tempest-ServerStableDeviceRescueTest-1416322546 tempest-ServerStableDeviceRescueTest-1416322546-project-member] Acquiring lock "f555a336fa02620cd7ad8eb02d7ee22fe12aadf5" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 17:55:31 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-0e88c997-e820-43a6-96c7-7a0a2006fbc3 tempest-ServerStableDeviceRescueTest-1416322546 tempest-ServerStableDeviceRescueTest-1416322546-project-member] Lock "f555a336fa02620cd7ad8eb02d7ee22fe12aadf5" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 17:55:31 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-0e88c997-e820-43a6-96c7-7a0a2006fbc3 tempest-ServerStableDeviceRescueTest-1416322546 tempest-ServerStableDeviceRescueTest-1416322546-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f555a336fa02620cd7ad8eb02d7ee22fe12aadf5 --force-share --output=json {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 17:55:31 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:55:31 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:55:31 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:55:31 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-c91e8417-5b0e-455b-9678-f8e7727a2128 tempest-AttachVolumeShelveTestJSON-1452861425 tempest-AttachVolumeShelveTestJSON-1452861425-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/4b1d3c6e93f4177d81652a25f8bdb62406dd0afd.part /opt/stack/data/nova/instances/_base/4b1d3c6e93f4177d81652a25f8bdb62406dd0afd.converted" returned: 0 in 0.248s {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 17:55:31 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-c91e8417-5b0e-455b-9678-f8e7727a2128 tempest-AttachVolumeShelveTestJSON-1452861425 tempest-AttachVolumeShelveTestJSON-1452861425-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4b1d3c6e93f4177d81652a25f8bdb62406dd0afd.converted --force-share --output=json {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 17:55:31 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-0e88c997-e820-43a6-96c7-7a0a2006fbc3 tempest-ServerStableDeviceRescueTest-1416322546 tempest-ServerStableDeviceRescueTest-1416322546-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f555a336fa02620cd7ad8eb02d7ee22fe12aadf5 --force-share --output=json" returned: 0 in 0.258s {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 17:55:31 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-0e88c997-e820-43a6-96c7-7a0a2006fbc3 tempest-ServerStableDeviceRescueTest-1416322546 tempest-ServerStableDeviceRescueTest-1416322546-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f555a336fa02620cd7ad8eb02d7ee22fe12aadf5,backing_fmt=raw /opt/stack/data/nova/instances/b6b0ba36-ad89-45f1-9578-8b999567dd25/disk.rescue {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 17:55:31 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-0e88c997-e820-43a6-96c7-7a0a2006fbc3 tempest-ServerStableDeviceRescueTest-1416322546 tempest-ServerStableDeviceRescueTest-1416322546-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f555a336fa02620cd7ad8eb02d7ee22fe12aadf5,backing_fmt=raw /opt/stack/data/nova/instances/b6b0ba36-ad89-45f1-9578-8b999567dd25/disk.rescue" returned: 0 in 0.077s {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 17:55:31 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-0e88c997-e820-43a6-96c7-7a0a2006fbc3 tempest-ServerStableDeviceRescueTest-1416322546 tempest-ServerStableDeviceRescueTest-1416322546-project-member] Lock "f555a336fa02620cd7ad8eb02d7ee22fe12aadf5" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.343s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 17:55:31 user nova-compute[74613]: DEBUG nova.objects.instance [None req-0e88c997-e820-43a6-96c7-7a0a2006fbc3 tempest-ServerStableDeviceRescueTest-1416322546 tempest-ServerStableDeviceRescueTest-1416322546-project-member] Lazy-loading 'migration_context' on Instance uuid b6b0ba36-ad89-45f1-9578-8b999567dd25 {{(pid=74613) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 17:55:31 user nova-compute[74613]: DEBUG nova.objects.base [None req-0e88c997-e820-43a6-96c7-7a0a2006fbc3 tempest-ServerStableDeviceRescueTest-1416322546 tempest-ServerStableDeviceRescueTest-1416322546-project-member] Object Instance<b6b0ba36-ad89-45f1-9578-8b999567dd25> lazy-loaded attributes: trusted_certs,migration_context {{(pid=74613) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 29 17:55:31 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-0e88c997-e820-43a6-96c7-7a0a2006fbc3 tempest-ServerStableDeviceRescueTest-1416322546 tempest-ServerStableDeviceRescueTest-1416322546-project-member] [instance: b6b0ba36-ad89-45f1-9578-8b999567dd25] Created local disks {{(pid=74613) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 29 17:55:31 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-0e88c997-e820-43a6-96c7-7a0a2006fbc3 tempest-ServerStableDeviceRescueTest-1416322546 tempest-ServerStableDeviceRescueTest-1416322546-project-member] [instance: b6b0ba36-ad89-45f1-9578-8b999567dd25] Start _get_guest_xml network_info=[{"id": "0167e253-42dd-486a-8231-a8b8199f3584", "address": "fa:16:3e:3f:ea:5d", "network": {"id": "880ea498-5e4e-4786-a894-bac0f42572f4", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1846928198-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.254", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerStableDeviceRescueTest-1846928198-network", "vif_mac": "fa:16:3e:3f:ea:5d"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b8f184c16b5348beb2dc9e6359a47651", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0167e253-42", "ovs_interfaceid": "0167e253-42dd-486a-8231-a8b8199f3584", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-29T17:47:38Z,direct_url=<?>,disk_format='qcow2',id=4217f428-8d9d-4ee1-9614-642d26d90c46,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='794b07cbd46a44b5865cfda741036bae',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-29T17:47:40Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': '31c05962-a152-463c-b6e8-6acca8cf5aa2', 'kernel_id': '', 'ramdisk_id': ''} block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'size': 0, 'device_type': 'disk', 'boot_index': 0, 'guest_format': None, 'encrypted': False, 'encryption_format': None, 'disk_bus': 'virtio', 'image_id': '4217f428-8d9d-4ee1-9614-642d26d90c46'}], 'ephemerals': [], 'block_device_mapping': [{'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:070b1031-e105-4cba-a039-2286e23727c5', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NfwgLEhX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, 'status': 'reserved', 'instance': 'b6b0ba36-ad89-45f1-9578-8b999567dd25', 'attached_at': '', 'detached_at': '', 'volume_id': '070b1031-e105-4cba-a039-2286e23727c5', 'serial': '070b1031-e105-4cba-a039-2286e23727c5'}, 'mount_device': '/dev/vdb', 'delete_on_termination': False, 'device_type': 'disk', 'boot_index': None, 'guest_format': None, 'attachment_id': 'ddb48b00-05c0-43cd-ac76-c7d0b0355fca', 'disk_bus': 'virtio', 'volume_type': None} {{(pid=74613) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 29 17:55:31 user nova-compute[74613]: DEBUG nova.objects.instance [None req-0e88c997-e820-43a6-96c7-7a0a2006fbc3 tempest-ServerStableDeviceRescueTest-1416322546 tempest-ServerStableDeviceRescueTest-1416322546-project-member] Lazy-loading 'resources' on Instance uuid b6b0ba36-ad89-45f1-9578-8b999567dd25 {{(pid=74613) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 17:55:31 user nova-compute[74613]: DEBUG nova.objects.base [None req-0e88c997-e820-43a6-96c7-7a0a2006fbc3 tempest-ServerStableDeviceRescueTest-1416322546 tempest-ServerStableDeviceRescueTest-1416322546-project-member] Object Instance<b6b0ba36-ad89-45f1-9578-8b999567dd25> lazy-loaded attributes: trusted_certs,migration_context,resources {{(pid=74613) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 29 17:55:31 user nova-compute[74613]: DEBUG nova.objects.instance [None req-0e88c997-e820-43a6-96c7-7a0a2006fbc3 tempest-ServerStableDeviceRescueTest-1416322546 tempest-ServerStableDeviceRescueTest-1416322546-project-member] Lazy-loading 'numa_topology' on Instance uuid b6b0ba36-ad89-45f1-9578-8b999567dd25 {{(pid=74613) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 17:55:31 user nova-compute[74613]: DEBUG nova.objects.base [None req-0e88c997-e820-43a6-96c7-7a0a2006fbc3 tempest-ServerStableDeviceRescueTest-1416322546 tempest-ServerStableDeviceRescueTest-1416322546-project-member] Object Instance<b6b0ba36-ad89-45f1-9578-8b999567dd25> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology {{(pid=74613) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 29 17:55:31 user nova-compute[74613]: WARNING nova.virt.libvirt.driver [None req-0e88c997-e820-43a6-96c7-7a0a2006fbc3 tempest-ServerStableDeviceRescueTest-1416322546 tempest-ServerStableDeviceRescueTest-1416322546-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 17:55:31 user nova-compute[74613]: WARNING nova.virt.libvirt.driver [None req-0e88c997-e820-43a6-96c7-7a0a2006fbc3 tempest-ServerStableDeviceRescueTest-1416322546 tempest-ServerStableDeviceRescueTest-1416322546-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 17:55:31 user nova-compute[74613]: DEBUG nova.network.neutron [req-4ecfe9fc-6f16-4eaa-9628-34b54683b6ee req-69ab626c-6499-4d7d-865d-9dd118c3ece9 service nova] [instance: c19e230e-2e6c-4c20-b15c-ad81a73674b4] Updated VIF entry in instance network info cache for port a414bce0-6293-4987-9441-46943fe2e877. {{(pid=74613) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 17:55:31 user nova-compute[74613]: DEBUG nova.network.neutron [req-4ecfe9fc-6f16-4eaa-9628-34b54683b6ee req-69ab626c-6499-4d7d-865d-9dd118c3ece9 service nova] [instance: c19e230e-2e6c-4c20-b15c-ad81a73674b4] Updating instance_info_cache with network_info: [{"id": "a414bce0-6293-4987-9441-46943fe2e877", "address": "fa:16:3e:8e:94:32", "network": {"id": "4a101f3e-d23e-4198-bc3c-b4f9b4d2b4c4", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-864151424-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.168", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1c0c1c71400549369c1b11ca7d5f43ec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa414bce0-62", "ovs_interfaceid": "a414bce0-6293-4987-9441-46943fe2e877", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74613) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 17:55:31 user nova-compute[74613]: DEBUG nova.virt.libvirt.host [None req-0e88c997-e820-43a6-96c7-7a0a2006fbc3 tempest-ServerStableDeviceRescueTest-1416322546 tempest-ServerStableDeviceRescueTest-1416322546-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74613) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 29 17:55:31 user nova-compute[74613]: DEBUG nova.virt.libvirt.host [None req-0e88c997-e820-43a6-96c7-7a0a2006fbc3 tempest-ServerStableDeviceRescueTest-1416322546 tempest-ServerStableDeviceRescueTest-1416322546-project-member] CPU controller missing on host. {{(pid=74613) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 29 17:55:31 user nova-compute[74613]: DEBUG nova.virt.libvirt.host [None req-0e88c997-e820-43a6-96c7-7a0a2006fbc3 tempest-ServerStableDeviceRescueTest-1416322546 tempest-ServerStableDeviceRescueTest-1416322546-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74613) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 29 17:55:31 user nova-compute[74613]: DEBUG nova.virt.libvirt.host [None req-0e88c997-e820-43a6-96c7-7a0a2006fbc3 tempest-ServerStableDeviceRescueTest-1416322546 tempest-ServerStableDeviceRescueTest-1416322546-project-member] CPU controller found on host. {{(pid=74613) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 29 17:55:31 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-0e88c997-e820-43a6-96c7-7a0a2006fbc3 tempest-ServerStableDeviceRescueTest-1416322546 tempest-ServerStableDeviceRescueTest-1416322546-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74613) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 29 17:55:31 user nova-compute[74613]: DEBUG nova.virt.hardware [None req-0e88c997-e820-43a6-96c7-7a0a2006fbc3 tempest-ServerStableDeviceRescueTest-1416322546 tempest-ServerStableDeviceRescueTest-1416322546-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-29T17:47:27Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-29T17:47:38Z,direct_url=<?>,disk_format='qcow2',id=4217f428-8d9d-4ee1-9614-642d26d90c46,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='794b07cbd46a44b5865cfda741036bae',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-29T17:47:40Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74613) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 29 17:55:31 user nova-compute[74613]: DEBUG nova.virt.hardware [None req-0e88c997-e820-43a6-96c7-7a0a2006fbc3 tempest-ServerStableDeviceRescueTest-1416322546 tempest-ServerStableDeviceRescueTest-1416322546-project-member] Flavor limits 0:0:0 {{(pid=74613) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 29 17:55:31 user nova-compute[74613]: DEBUG nova.virt.hardware [None req-0e88c997-e820-43a6-96c7-7a0a2006fbc3 tempest-ServerStableDeviceRescueTest-1416322546 tempest-ServerStableDeviceRescueTest-1416322546-project-member] Image limits 0:0:0 {{(pid=74613) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 29 17:55:31 user nova-compute[74613]: DEBUG nova.virt.hardware [None req-0e88c997-e820-43a6-96c7-7a0a2006fbc3 tempest-ServerStableDeviceRescueTest-1416322546 tempest-ServerStableDeviceRescueTest-1416322546-project-member] Flavor pref 0:0:0 {{(pid=74613) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 29 17:55:31 user nova-compute[74613]: DEBUG nova.virt.hardware [None req-0e88c997-e820-43a6-96c7-7a0a2006fbc3 tempest-ServerStableDeviceRescueTest-1416322546 tempest-ServerStableDeviceRescueTest-1416322546-project-member] Image pref 0:0:0 {{(pid=74613) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 29 17:55:31 user nova-compute[74613]: DEBUG nova.virt.hardware [None req-0e88c997-e820-43a6-96c7-7a0a2006fbc3 tempest-ServerStableDeviceRescueTest-1416322546 tempest-ServerStableDeviceRescueTest-1416322546-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74613) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 29 17:55:31 user nova-compute[74613]: DEBUG nova.virt.hardware [None req-0e88c997-e820-43a6-96c7-7a0a2006fbc3 tempest-ServerStableDeviceRescueTest-1416322546 tempest-ServerStableDeviceRescueTest-1416322546-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74613) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 29 17:55:31 user nova-compute[74613]: DEBUG nova.virt.hardware [None req-0e88c997-e820-43a6-96c7-7a0a2006fbc3 tempest-ServerStableDeviceRescueTest-1416322546 tempest-ServerStableDeviceRescueTest-1416322546-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74613) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 29 17:55:31 user nova-compute[74613]: DEBUG nova.virt.hardware [None req-0e88c997-e820-43a6-96c7-7a0a2006fbc3 tempest-ServerStableDeviceRescueTest-1416322546 tempest-ServerStableDeviceRescueTest-1416322546-project-member] Got 1 possible topologies {{(pid=74613) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 29 17:55:31 user nova-compute[74613]: DEBUG nova.virt.hardware [None req-0e88c997-e820-43a6-96c7-7a0a2006fbc3 tempest-ServerStableDeviceRescueTest-1416322546 tempest-ServerStableDeviceRescueTest-1416322546-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74613) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 29 17:55:31 user nova-compute[74613]: DEBUG nova.virt.hardware [None req-0e88c997-e820-43a6-96c7-7a0a2006fbc3 tempest-ServerStableDeviceRescueTest-1416322546 tempest-ServerStableDeviceRescueTest-1416322546-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74613) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 29 17:55:31 user nova-compute[74613]: DEBUG nova.objects.instance [None req-0e88c997-e820-43a6-96c7-7a0a2006fbc3 tempest-ServerStableDeviceRescueTest-1416322546 tempest-ServerStableDeviceRescueTest-1416322546-project-member] Lazy-loading 'vcpu_model' on Instance uuid b6b0ba36-ad89-45f1-9578-8b999567dd25 {{(pid=74613) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 17:55:31 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-4ecfe9fc-6f16-4eaa-9628-34b54683b6ee req-69ab626c-6499-4d7d-865d-9dd118c3ece9 service nova] Releasing lock "refresh_cache-c19e230e-2e6c-4c20-b15c-ad81a73674b4" {{(pid=74613) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 17:55:31 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-c91e8417-5b0e-455b-9678-f8e7727a2128 tempest-AttachVolumeShelveTestJSON-1452861425 tempest-AttachVolumeShelveTestJSON-1452861425-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4b1d3c6e93f4177d81652a25f8bdb62406dd0afd.converted --force-share --output=json" returned: 0 in 0.263s {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 17:55:31 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-c91e8417-5b0e-455b-9678-f8e7727a2128 tempest-AttachVolumeShelveTestJSON-1452861425 tempest-AttachVolumeShelveTestJSON-1452861425-project-member] Lock "4b1d3c6e93f4177d81652a25f8bdb62406dd0afd" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.941s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 17:55:31 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-c91e8417-5b0e-455b-9678-f8e7727a2128 tempest-AttachVolumeShelveTestJSON-1452861425 tempest-AttachVolumeShelveTestJSON-1452861425-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4b1d3c6e93f4177d81652a25f8bdb62406dd0afd --force-share --output=json {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 17:55:31 user nova-compute[74613]: DEBUG nova.objects.base [None req-0e88c997-e820-43a6-96c7-7a0a2006fbc3 tempest-ServerStableDeviceRescueTest-1416322546 tempest-ServerStableDeviceRescueTest-1416322546-project-member] Object Instance<b6b0ba36-ad89-45f1-9578-8b999567dd25> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model {{(pid=74613) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 29 17:55:31 user nova-compute[74613]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0e88c997-e820-43a6-96c7-7a0a2006fbc3 tempest-ServerStableDeviceRescueTest-1416322546 tempest-ServerStableDeviceRescueTest-1416322546-project-member] [instance: b6b0ba36-ad89-45f1-9578-8b999567dd25] Calling os-brick to attach iSCSI Volume {{(pid=74613) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 29 17:55:31 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e88c997-e820-43a6-96c7-7a0a2006fbc3 tempest-ServerStableDeviceRescueTest-1416322546 tempest-ServerStableDeviceRescueTest-1416322546-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff828156890>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:070b1031-e105-4cba-a039-2286e23727c5', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NfwgLEhX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=74613) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 17:55:31 user nova-compute[74613]: WARNING os_brick.initiator.connectors.base [None req-0e88c997-e820-43a6-96c7-7a0a2006fbc3 tempest-ServerStableDeviceRescueTest-1416322546 tempest-ServerStableDeviceRescueTest-1416322546-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 17:55:31 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.base [None req-0e88c997-e820-43a6-96c7-7a0a2006fbc3 tempest-ServerStableDeviceRescueTest-1416322546 tempest-ServerStableDeviceRescueTest-1416322546-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 17:55:31 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.base [None req-0e88c997-e820-43a6-96c7-7a0a2006fbc3 tempest-ServerStableDeviceRescueTest-1416322546 tempest-ServerStableDeviceRescueTest-1416322546-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 17:55:31 user nova-compute[74613]: WARNING os_brick.initiator.connectors.base [None req-0e88c997-e820-43a6-96c7-7a0a2006fbc3 tempest-ServerStableDeviceRescueTest-1416322546 tempest-ServerStableDeviceRescueTest-1416322546-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 17:55:31 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.base [None req-0e88c997-e820-43a6-96c7-7a0a2006fbc3 tempest-ServerStableDeviceRescueTest-1416322546 tempest-ServerStableDeviceRescueTest-1416322546-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:070b1031-e105-4cba-a039-2286e23727c5" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 17:55:31 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.base [None req-0e88c997-e820-43a6-96c7-7a0a2006fbc3 tempest-ServerStableDeviceRescueTest-1416322546 tempest-ServerStableDeviceRescueTest-1416322546-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:070b1031-e105-4cba-a039-2286e23727c5" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 17:55:31 user nova-compute[74613]: INFO os_brick.initiator.connectors.iscsi [None req-0e88c997-e820-43a6-96c7-7a0a2006fbc3 tempest-ServerStableDeviceRescueTest-1416322546 tempest-ServerStableDeviceRescueTest-1416322546-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 29 17:55:31 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:070b1031-e105-4cba-a039-2286e23727c5 -p 172.16.0.220:3260 {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 17:55:31 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:070b1031-e105-4cba-a039-2286e23727c5 -p 172.16.0.220:3260" returned: 0 in 0.029s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 17:55:31 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b18a96d-be76-4de5-b81b-9b37d9be1d96]: (4, ('# BEGIN RECORD 2.1.5\nnode.name = iqn.2010-10.org.openstack:070b1031-e105-4cba-a039-2286e23727c5\nnode.tpgt = -1\nnode.startup = automatic\nnode.leading_login = No\niface.iscsi_ifacename = default\niface.net_ifacename = <empty>\niface.ipaddress = <empty>\niface.prefix_len = 0\niface.hwaddress = <empty>\niface.transport_name = tcp\niface.initiatorname = <empty>\niface.state = <empty>\niface.vlan_id = 0\niface.vlan_priority = 0\niface.vlan_state = <empty>\niface.iface_num = 0\niface.mtu = 0\niface.port = 0\niface.bootproto = <empty>\niface.subnet_mask = <empty>\niface.gateway = <empty>\niface.dhcp_alt_client_id_state = <empty>\niface.dhcp_alt_client_id = <empty>\niface.dhcp_dns = <empty>\niface.dhcp_learn_iqn = <empty>\niface.dhcp_req_vendor_id_state = <empty>\niface.dhcp_vendor_id_state = <empty>\niface.dhcp_vendor_id = <empty>\niface.dhcp_slp_da = <empty>\niface.fragmentation = <empty>\niface.gratuitous_arp = <empty>\niface.incoming_forwarding = <empty>\niface.tos_state = <empty>\niface.tos = 0\niface.ttl = 0\niface.delayed_ack = <empty>\niface.tcp_nagle = <empty>\niface.tcp_wsf_state = <empty>\niface.tcp_wsf = 0\niface.tcp_timer_scale = 0\niface.tcp_timestamp = <empty>\niface.redirect = <empty>\niface.def_task_mgmt_timeout = 0\niface.header_digest = <empty>\niface.data_digest = <empty>\niface.immediate_data = <empty>\niface.initial_r2t = <empty>\niface.data_seq_inorder = <empty>\niface.data_pdu_inorder = <empty>\niface.erl = 0\niface.max_receive_data_len = 0\niface.first_burst_len = 0\niface.max_outstanding_r2t = 0\niface.max_burst_len = 0\niface.chap_auth = <empty>\niface.bidi_chap = <empty>\niface.strict_login_compliance = <empty>\niface.discovery_auth = <empty>\niface.discovery_logout = <empty>\nnode.discovery_address = <empty>\nnode.discovery_port = 0\nnode.discovery_type = static\nnode.session.initial_cmdsn = 0\nnode.session.initial_login_retry_max = 8\nnode.session.xmit_thread_priority = -20\nnode.session.cmds_max = 128\nnode.session.queue_depth = 32\nnode.session.nr_sessions = 1\nnode.session.auth.authmethod = CHAP\nnode.session.auth.username = NfwgLEhX\nnode.session.auth.password = ********\nnode.session.auth.username_in = <empty>\nnode.session.auth.password_in = <empty>\nnode.session.auth.chap_algs = MD5\nnode.session.timeo.replacement_timeout = 120\nnode.session.err_timeo.abort_timeout = 15\nnode.session.err_timeo.lu_reset_timeout = 30\nnode.session.err_timeo.tgt_reset_timeout = 30\nnode.session.err_timeo.host_reset_timeout = 60\nnode.session.iscsi.FastAbort = Yes\nnode.session.iscsi.InitialR2T = No\nnode.session.iscsi.ImmediateData = Yes\nnode.session.iscsi.FirstBurstLength = 262144\nnode.session.iscsi.MaxBurstLength = 16776192\nnode.session.iscsi.DefaultTime2Retain = 0\nnode.session.iscsi.DefaultTime2Wait = 2\nnode.session.iscsi.MaxConnections = 1\nnode.session.iscsi.MaxOutstandingR2T = 1\nnode.session.iscsi.ERL = 0\nnode.session.scan = manual\nnode.session.reopen_max = 0\nnode.conn[0].address = 172.16.0.220\nnode.conn[0].port = 3260\nnode.conn[0].startup = manual\nnode.conn[0].tcp.window_size = 524288\nnode.conn[0].tcp.type_of_service = 0\nnode.conn[0].timeo.logout_timeout = 15\nnode.conn[0].timeo.login_timeout = 15\nnode.conn[0].timeo.auth_timeout = 45\nnode.conn[0].timeo.noop_out_interval = 5\nnode.conn[0].timeo.noop_out_timeout = 5\nnode.conn[0].iscsi.MaxXmitDataSegmentLength = 0\nnode.conn[0].iscsi.MaxRecvDataSegmentLength = 262144\nnode.conn[0].iscsi.HeaderDigest = None\nnode.conn[0].iscsi.DataDigest = None\nnode.conn[0].iscsi.IFMarker = No\nnode.conn[0].iscsi.OFMarker = No\n# END RECORD\n', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 17:55:31 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e88c997-e820-43a6-96c7-7a0a2006fbc3 tempest-ServerStableDeviceRescueTest-1416322546 tempest-ServerStableDeviceRescueTest-1416322546-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.5
Nov 29 17:55:31 user nova-compute[74613]: node.name = iqn.2010-10.org.openstack:070b1031-e105-4cba-a039-2286e23727c5
Nov 29 17:55:31 user nova-compute[74613]: node.tpgt = -1
Nov 29 17:55:31 user nova-compute[74613]: node.startup = automatic
Nov 29 17:55:31 user nova-compute[74613]: node.leading_login = No
Nov 29 17:55:31 user nova-compute[74613]: iface.iscsi_ifacename = default
Nov 29 17:55:31 user nova-compute[74613]: iface.net_ifacename = <empty>
Nov 29 17:55:31 user nova-compute[74613]: iface.ipaddress = <empty>
Nov 29 17:55:31 user nova-compute[74613]: iface.prefix_len = 0
Nov 29 17:55:31 user nova-compute[74613]: iface.hwaddress = <empty>
Nov 29 17:55:31 user nova-compute[74613]: iface.transport_name = tcp
Nov 29 17:55:31 user nova-compute[74613]: iface.initiatorname = <empty>
Nov 29 17:55:31 user nova-compute[74613]: iface.state = <empty>
Nov 29 17:55:31 user nova-compute[74613]: iface.vlan_id = 0
Nov 29 17:55:31 user nova-compute[74613]: iface.vlan_priority = 0
Nov 29 17:55:31 user nova-compute[74613]: iface.vlan_state = <empty>
Nov 29 17:55:31 user nova-compute[74613]: iface.iface_num = 0
Nov 29 17:55:31 user nova-compute[74613]: iface.mtu = 0
Nov 29 17:55:31 user nova-compute[74613]: iface.port = 0
Nov 29 17:55:31 user nova-compute[74613]: iface.bootproto = <empty>
Nov 29 17:55:31 user nova-compute[74613]: iface.subnet_mask = <empty>
Nov 29 17:55:31 user nova-compute[74613]: iface.gateway = <empty>
Nov 29 17:55:31 user nova-compute[74613]: iface.dhcp_alt_client_id_state = <empty>
Nov 29 17:55:31 user nova-compute[74613]: iface.dhcp_alt_client_id = <empty>
Nov 29 17:55:31 user nova-compute[74613]: iface.dhcp_dns = <empty>
Nov 29 17:55:31 user nova-compute[74613]: iface.dhcp_learn_iqn = <empty>
Nov 29 17:55:31 user nova-compute[74613]: iface.dhcp_req_vendor_id_state = <empty>
Nov 29 17:55:31 user nova-compute[74613]: iface.dhcp_vendor_id_state = <empty>
Nov 29 17:55:31 user nova-compute[74613]: iface.dhcp_vendor_id = <empty>
Nov 29 17:55:31 user nova-compute[74613]: iface.dhcp_slp_da = <empty>
Nov 29 17:55:31 user nova-compute[74613]: iface.fragmentation = <empty>
Nov 29 17:55:31 user nova-compute[74613]: iface.gratuitous_arp = <empty>
Nov 29 17:55:31 user nova-compute[74613]: iface.incoming_forwarding = <empty>
Nov 29 17:55:31 user nova-compute[74613]: iface.tos_state = <empty>
Nov 29 17:55:31 user nova-compute[74613]: iface.tos = 0
Nov 29 17:55:31 user nova-compute[74613]: iface.ttl = 0
Nov 29 17:55:31 user nova-compute[74613]: iface.delayed_ack = <empty>
Nov 29 17:55:31 user nova-compute[74613]: iface.tcp_nagle = <empty>
Nov 29 17:55:31 user nova-compute[74613]: iface.tcp_wsf_state = <empty>
Nov 29 17:55:31 user nova-compute[74613]: iface.tcp_wsf = 0
Nov 29 17:55:31 user nova-compute[74613]: iface.tcp_timer_scale = 0
Nov 29 17:55:31 user nova-compute[74613]: iface.tcp_timestamp = <empty>
Nov 29 17:55:31 user nova-compute[74613]: iface.redirect = <empty>
Nov 29 17:55:31 user nova-compute[74613]: iface.def_task_mgmt_timeout = 0
Nov 29 17:55:31 user nova-compute[74613]: iface.header_digest = <empty>
Nov 29 17:55:31 user nova-compute[74613]: iface.data_digest = <empty>
Nov 29 17:55:31 user nova-compute[74613]: iface.immediate_data = <empty>
Nov 29 17:55:31 user nova-compute[74613]: iface.initial_r2t = <empty>
Nov 29 17:55:31 user nova-compute[74613]: iface.data_seq_inorder = <empty>
Nov 29 17:55:31 user nova-compute[74613]: iface.data_pdu_inorder = <empty>
Nov 29 17:55:31 user nova-compute[74613]: iface.erl = 0
Nov 29 17:55:31 user nova-compute[74613]: iface.max_receive_data_len = 0
Nov 29 17:55:31 user nova-compute[74613]: iface.first_burst_len = 0
Nov 29 17:55:31 user nova-compute[74613]: iface.max_outstanding_r2t = 0
Nov 29 17:55:31 user nova-compute[74613]: iface.max_burst_len = 0
Nov 29 17:55:31 user nova-compute[74613]: iface.chap_auth = <empty>
Nov 29 17:55:31 user nova-compute[74613]: iface.bidi_chap = <empty>
Nov 29 17:55:31 user nova-compute[74613]: iface.strict_login_compliance = <empty>
Nov 29 17:55:31 user nova-compute[74613]: iface.discovery_auth = <empty>
Nov 29 17:55:31 user nova-compute[74613]: iface.discovery_logout = <empty>
Nov 29 17:55:31 user nova-compute[74613]: node.discovery_address = <empty>
Nov 29 17:55:31 user nova-compute[74613]: node.discovery_port = 0
Nov 29 17:55:31 user nova-compute[74613]: node.discovery_type = static
Nov 29 17:55:31 user nova-compute[74613]: node.session.initial_cmdsn = 0
Nov 29 17:55:31 user nova-compute[74613]: node.session.initial_login_retry_max = 8
Nov 29 17:55:31 user nova-compute[74613]: node.session.xmit_thread_priority = -20
Nov 29 17:55:31 user nova-compute[74613]: node.session.cmds_max = 128
Nov 29 17:55:31 user nova-compute[74613]: node.session.queue_depth = 32
Nov 29 17:55:31 user nova-compute[74613]: node.session.nr_sessions = 1
Nov 29 17:55:31 user nova-compute[74613]: node.session.auth.authmethod = CHAP
Nov 29 17:55:31 user nova-compute[74613]: node.session.auth.username = NfwgLEhX
Nov 29 17:55:31 user nova-compute[74613]: node.session.auth.password = ***
Nov 29 17:55:31 user nova-compute[74613]: node.session.auth.username_in = <empty>
Nov 29 17:55:31 user nova-compute[74613]: node.session.auth.password_in = <empty>
Nov 29 17:55:31 user nova-compute[74613]: node.session.auth.chap_algs = MD5
Nov 29 17:55:31 user nova-compute[74613]: node.session.timeo.replacement_timeout = 120
Nov 29 17:55:31 user nova-compute[74613]: node.session.err_timeo.abort_timeout = 15
Nov 29 17:55:31 user nova-compute[74613]: node.session.err_timeo.lu_reset_timeout = 30
Nov 29 17:55:31 user nova-compute[74613]: node.session.err_timeo.tgt_reset_timeout = 30
Nov 29 17:55:31 user nova-compute[74613]: node.session.err_timeo.host_reset_timeout = 60
Nov 29 17:55:31 user nova-compute[74613]: node.session.iscsi.FastAbort = Yes
Nov 29 17:55:31 user nova-compute[74613]: node.session.iscsi.InitialR2T = No
Nov 29 17:55:31 user nova-compute[74613]: node.session.iscsi.ImmediateData = Yes
Nov 29 17:55:31 user nova-compute[74613]: node.session.iscsi.FirstBurstLength = 262144
Nov 29 17:55:31 user nova-compute[74613]: node.session.iscsi.MaxBurstLength = 16776192
Nov 29 17:55:31 user nova-compute[74613]: node.session.iscsi.DefaultTime2Retain = 0
Nov 29 17:55:31 user nova-compute[74613]: node.session.iscsi.DefaultTime2Wait = 2
Nov 29 17:55:31 user nova-compute[74613]: node.session.iscsi.MaxConnections = 1
Nov 29 17:55:31 user nova-compute[74613]: node.session.iscsi.MaxOutstandingR2T = 1
Nov 29 17:55:31 user nova-compute[74613]: node.session.iscsi.ERL = 0
Nov 29 17:55:31 user nova-compute[74613]: node.session.scan = manual
Nov 29 17:55:31 user nova-compute[74613]: node.session.reopen_max = 0
Nov 29 17:55:31 user nova-compute[74613]: node.conn[0].address = 172.16.0.220
Nov 29 17:55:31 user nova-compute[74613]: node.conn[0].port = 3260
Nov 29 17:55:31 user nova-compute[74613]: node.conn[0].startup = manual
Nov 29 17:55:31 user nova-compute[74613]: node.conn[0].tcp.window_size = 524288
Nov 29 17:55:31 user nova-compute[74613]: node.conn[0].tcp.type_of_service = 0
Nov 29 17:55:31 user nova-compute[74613]: node.conn[0].timeo.logout_timeout = 15
Nov 29 17:55:31 user nova-compute[74613]: node.conn[0].timeo.login_timeout = 15
Nov 29 17:55:31 user nova-compute[74613]: node.conn[0].timeo.auth_timeout = 45
Nov 29 17:55:31 user nova-compute[74613]: node.conn[0].timeo.noop_out_interval = 5
Nov 29 17:55:31 user nova-compute[74613]: node.conn[0].timeo.noop_out_timeout = 5
Nov 29 17:55:31 user nova-compute[74613]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Nov 29 17:55:31 user nova-compute[74613]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Nov 29 17:55:31 user nova-compute[74613]: node.conn[0].iscsi.HeaderDigest = None
Nov 29 17:55:31 user nova-compute[74613]: node.conn[0].iscsi.DataDigest = None
Nov 29 17:55:31 user nova-compute[74613]: node.conn[0].iscsi.IFMarker = No
Nov 29 17:55:31 user nova-compute[74613]: node.conn[0].iscsi.OFMarker = No
Nov 29 17:55:31 user nova-compute[74613]: # END RECORD
Nov 29 17:55:31 user nova-compute[74613]:  stderr= {{(pid=74613) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 17:55:31 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:070b1031-e105-4cba-a039-2286e23727c5 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 17:55:31 user nova-compute[74613]: DEBUG nova.compute.manager [req-ec045d3f-a6d1-438a-973d-da7d165d6417 req-4c7e107e-f169-4c5c-aad4-b98cfd0233bf service nova] [instance: 74ac9703-1cd7-4983-b7d4-c69b01fec7b2] Received event network-vif-plugged-c63b6577-fb46-437a-95b3-8321fab45d0c {{(pid=74613) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 17:55:31 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-ec045d3f-a6d1-438a-973d-da7d165d6417 req-4c7e107e-f169-4c5c-aad4-b98cfd0233bf service nova] Acquiring lock "74ac9703-1cd7-4983-b7d4-c69b01fec7b2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 17:55:31 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-ec045d3f-a6d1-438a-973d-da7d165d6417 req-4c7e107e-f169-4c5c-aad4-b98cfd0233bf service nova] Lock "74ac9703-1cd7-4983-b7d4-c69b01fec7b2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 17:55:31 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-ec045d3f-a6d1-438a-973d-da7d165d6417 req-4c7e107e-f169-4c5c-aad4-b98cfd0233bf service nova] Lock "74ac9703-1cd7-4983-b7d4-c69b01fec7b2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 17:55:31 user nova-compute[74613]: DEBUG nova.compute.manager [req-ec045d3f-a6d1-438a-973d-da7d165d6417 req-4c7e107e-f169-4c5c-aad4-b98cfd0233bf service nova] [instance: 74ac9703-1cd7-4983-b7d4-c69b01fec7b2] No waiting events found dispatching network-vif-plugged-c63b6577-fb46-437a-95b3-8321fab45d0c {{(pid=74613) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 17:55:31 user nova-compute[74613]: WARNING nova.compute.manager [req-ec045d3f-a6d1-438a-973d-da7d165d6417 req-4c7e107e-f169-4c5c-aad4-b98cfd0233bf service nova] [instance: 74ac9703-1cd7-4983-b7d4-c69b01fec7b2] Received unexpected event network-vif-plugged-c63b6577-fb46-437a-95b3-8321fab45d0c for instance with vm_state building and task_state spawning.
Nov 29 17:55:31 user nova-compute[74613]: DEBUG nova.compute.manager [req-ec045d3f-a6d1-438a-973d-da7d165d6417 req-4c7e107e-f169-4c5c-aad4-b98cfd0233bf service nova] [instance: 74ac9703-1cd7-4983-b7d4-c69b01fec7b2] Received event network-vif-plugged-c63b6577-fb46-437a-95b3-8321fab45d0c {{(pid=74613) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 17:55:31 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-ec045d3f-a6d1-438a-973d-da7d165d6417 req-4c7e107e-f169-4c5c-aad4-b98cfd0233bf service nova] Acquiring lock "74ac9703-1cd7-4983-b7d4-c69b01fec7b2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 17:55:31 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-ec045d3f-a6d1-438a-973d-da7d165d6417 req-4c7e107e-f169-4c5c-aad4-b98cfd0233bf service nova] Lock "74ac9703-1cd7-4983-b7d4-c69b01fec7b2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 17:55:31 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-ec045d3f-a6d1-438a-973d-da7d165d6417 req-4c7e107e-f169-4c5c-aad4-b98cfd0233bf service nova] Lock "74ac9703-1cd7-4983-b7d4-c69b01fec7b2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 17:55:31 user nova-compute[74613]: DEBUG nova.compute.manager [req-ec045d3f-a6d1-438a-973d-da7d165d6417 req-4c7e107e-f169-4c5c-aad4-b98cfd0233bf service nova] [instance: 74ac9703-1cd7-4983-b7d4-c69b01fec7b2] No waiting events found dispatching network-vif-plugged-c63b6577-fb46-437a-95b3-8321fab45d0c {{(pid=74613) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 17:55:31 user nova-compute[74613]: WARNING nova.compute.manager [req-ec045d3f-a6d1-438a-973d-da7d165d6417 req-4c7e107e-f169-4c5c-aad4-b98cfd0233bf service nova] [instance: 74ac9703-1cd7-4983-b7d4-c69b01fec7b2] Received unexpected event network-vif-plugged-c63b6577-fb46-437a-95b3-8321fab45d0c for instance with vm_state building and task_state spawning.
Nov 29 17:55:31 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:070b1031-e105-4cba-a039-2286e23727c5 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.032s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 17:55:31 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[823bdd48-b285-4f53-bd16-895b76e0f475]: (4, ('', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 17:55:31 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e88c997-e820-43a6-96c7-7a0a2006fbc3 tempest-ServerStableDeviceRescueTest-1416322546 tempest-ServerStableDeviceRescueTest-1416322546-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74613) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 17:55:31 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:070b1031-e105-4cba-a039-2286e23727c5 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 17:55:32 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-c91e8417-5b0e-455b-9678-f8e7727a2128 tempest-AttachVolumeShelveTestJSON-1452861425 tempest-AttachVolumeShelveTestJSON-1452861425-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4b1d3c6e93f4177d81652a25f8bdb62406dd0afd --force-share --output=json" returned: 0 in 0.187s {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 17:55:32 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-c91e8417-5b0e-455b-9678-f8e7727a2128 tempest-AttachVolumeShelveTestJSON-1452861425 tempest-AttachVolumeShelveTestJSON-1452861425-project-member] Acquiring lock "4b1d3c6e93f4177d81652a25f8bdb62406dd0afd" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 17:55:32 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-c91e8417-5b0e-455b-9678-f8e7727a2128 tempest-AttachVolumeShelveTestJSON-1452861425 tempest-AttachVolumeShelveTestJSON-1452861425-project-member] Lock "4b1d3c6e93f4177d81652a25f8bdb62406dd0afd" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 17:55:32 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-c91e8417-5b0e-455b-9678-f8e7727a2128 tempest-AttachVolumeShelveTestJSON-1452861425 tempest-AttachVolumeShelveTestJSON-1452861425-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4b1d3c6e93f4177d81652a25f8bdb62406dd0afd --force-share --output=json {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 17:55:32 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:070b1031-e105-4cba-a039-2286e23727c5 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.025s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 17:55:32 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d5ff1be-012b-420d-975c-f5ebaf1c982d]: (4, ('', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 17:55:32 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e88c997-e820-43a6-96c7-7a0a2006fbc3 tempest-ServerStableDeviceRescueTest-1416322546 tempest-ServerStableDeviceRescueTest-1416322546-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74613) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 17:55:32 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:070b1031-e105-4cba-a039-2286e23727c5 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v NfwgLEhX {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 17:55:32 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:070b1031-e105-4cba-a039-2286e23727c5 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v NfwgLEhX" returned: 0 in 0.017s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 17:55:32 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7229bca-6715-412e-8a1d-732446e97442]: (4, ('', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 17:55:32 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e88c997-e820-43a6-96c7-7a0a2006fbc3 tempest-ServerStableDeviceRescueTest-1416322546 tempest-ServerStableDeviceRescueTest-1416322546-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'NfwgLEhX'): stdout= stderr= {{(pid=74613) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 17:55:32 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:070b1031-e105-4cba-a039-2286e23727c5 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 17:55:32 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:070b1031-e105-4cba-a039-2286e23727c5 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 17:55:32 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[01bbeff7-2211-46b1-b8fa-c02f1574258d]: (4, ('', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 17:55:32 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e88c997-e820-43a6-96c7-7a0a2006fbc3 tempest-ServerStableDeviceRescueTest-1416322546 tempest-ServerStableDeviceRescueTest-1416322546-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74613) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 17:55:32 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 17:55:32 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 17:55:32 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8138614-7bb2-4a48-bfaa-8f3868f9bfbd]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9511387c-8772-40f2-bf2d-6b6387649e9f (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:070b1031-e105-4cba-a039-2286e23727c5 (non-flash)\n', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 17:55:32 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e88c997-e820-43a6-96c7-7a0a2006fbc3 tempest-ServerStableDeviceRescueTest-1416322546 tempest-ServerStableDeviceRescueTest-1416322546-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9511387c-8772-40f2-bf2d-6b6387649e9f (non-flash)
Nov 29 17:55:32 user nova-compute[74613]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:070b1031-e105-4cba-a039-2286e23727c5 (non-flash)
Nov 29 17:55:32 user nova-compute[74613]:  stderr= {{(pid=74613) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 17:55:32 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e88c997-e820-43a6-96c7-7a0a2006fbc3 tempest-ServerStableDeviceRescueTest-1416322546 tempest-ServerStableDeviceRescueTest-1416322546-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9511387c-8772-40f2-bf2d-6b6387649e9f (non-flash)
Nov 29 17:55:32 user nova-compute[74613]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:070b1031-e105-4cba-a039-2286e23727c5 (non-flash)
Nov 29 17:55:32 user nova-compute[74613]:  stderr= {{(pid=74613) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 17:55:32 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.base [None req-0e88c997-e820-43a6-96c7-7a0a2006fbc3 tempest-ServerStableDeviceRescueTest-1416322546 tempest-ServerStableDeviceRescueTest-1416322546-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:070b1031-e105-4cba-a039-2286e23727c5" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.216s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 17:55:32 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e88c997-e820-43a6-96c7-7a0a2006fbc3 tempest-ServerStableDeviceRescueTest-1416322546 tempest-ServerStableDeviceRescueTest-1416322546-project-member] Connected to 172.16.0.220:3260 {{(pid=74613) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 29 17:55:32 user nova-compute[74613]: DEBUG os_brick.initiator.linuxscsi [None req-0e88c997-e820-43a6-96c7-7a0a2006fbc3 tempest-ServerStableDeviceRescueTest-1416322546 tempest-ServerStableDeviceRescueTest-1416322546-project-member] HCTL ('34', '0', '0', 0) found on session 15 with lun 0 {{(pid=74613) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 29 17:55:32 user nova-compute[74613]: DEBUG os_brick.initiator.linuxscsi [None req-0e88c997-e820-43a6-96c7-7a0a2006fbc3 tempest-ServerStableDeviceRescueTest-1416322546 tempest-ServerStableDeviceRescueTest-1416322546-project-member] Scanning host 34 c: 0, t: 0, l: 0) {{(pid=74613) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 29 17:55:32 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 17:55:32 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.014s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 17:55:32 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[b33511ba-8175-4cdd-9789-2190402e7852]: (4, ('0 0 0', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 17:55:32 user nova-compute[74613]: DEBUG os_brick.initiator.linuxscsi [None req-0e88c997-e820-43a6-96c7-7a0a2006fbc3 tempest-ServerStableDeviceRescueTest-1416322546 tempest-ServerStableDeviceRescueTest-1416322546-project-member] Searching for a device in session 15 and hctl ('34', '0', '0', 0) yield: sdc {{(pid=74613) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 29 17:55:32 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e88c997-e820-43a6-96c7-7a0a2006fbc3 tempest-ServerStableDeviceRescueTest-1416322546 tempest-ServerStableDeviceRescueTest-1416322546-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:070b1031-e105-4cba-a039-2286e23727c5', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NfwgLEhX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'} {{(pid=74613) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 29 17:55:32 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.base [None req-0e88c997-e820-43a6-96c7-7a0a2006fbc3 tempest-ServerStableDeviceRescueTest-1416322546 tempest-ServerStableDeviceRescueTest-1416322546-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 0.242s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 17:55:32 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e88c997-e820-43a6-96c7-7a0a2006fbc3 tempest-ServerStableDeviceRescueTest-1416322546 tempest-ServerStableDeviceRescueTest-1416322546-project-member] <== connect_volume: return (244ms) {'type': 'block', 'scsi_wwn': '23162393938626439', 'path': '/dev/sdc'} {{(pid=74613) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 17:55:32 user nova-compute[74613]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0e88c997-e820-43a6-96c7-7a0a2006fbc3 tempest-ServerStableDeviceRescueTest-1416322546 tempest-ServerStableDeviceRescueTest-1416322546-project-member] [instance: b6b0ba36-ad89-45f1-9578-8b999567dd25] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23162393938626439', 'path': '/dev/sdc'} {{(pid=74613) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 29 17:55:32 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:55:32 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-c91e8417-5b0e-455b-9678-f8e7727a2128 tempest-AttachVolumeShelveTestJSON-1452861425 tempest-AttachVolumeShelveTestJSON-1452861425-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4b1d3c6e93f4177d81652a25f8bdb62406dd0afd --force-share --output=json" returned: 0 in 0.174s {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 17:55:32 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-c91e8417-5b0e-455b-9678-f8e7727a2128 tempest-AttachVolumeShelveTestJSON-1452861425 tempest-AttachVolumeShelveTestJSON-1452861425-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/4b1d3c6e93f4177d81652a25f8bdb62406dd0afd,backing_fmt=raw /opt/stack/data/nova/instances/c19e230e-2e6c-4c20-b15c-ad81a73674b4/disk 1073741824 {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 17:55:32 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:55:32 user nova-compute[74613]: DEBUG nova.virt.libvirt.vif [None req-0e88c997-e820-43a6-96c7-7a0a2006fbc3 tempest-ServerStableDeviceRescueTest-1416322546 tempest-ServerStableDeviceRescueTest-1416322546-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T17:51:21Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-56030904',display_name='tempest-ServerStableDeviceRescueTest-server-56030904',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-56030904',id=1,image_ref='4217f428-8d9d-4ee1-9614-642d26d90c46',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBI85GZspGma1CfHLklAfK5ROqiFitnBViWC2sBj1qECdxTf0mbQqMsBEY3GHAf3hN5wBoUAnLHRf24tZw5VxrRYKqkyzeutcAUMWWy4Q3HjZLnkFQi82h3okfVi2Mvtpcw==',key_name='tempest-keypair-2003214039',keypairs=<?>,launch_index=0,launched_at=2023-11-29T17:51:44Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='b8f184c16b5348beb2dc9e6359a47651',ramdisk_id='',reservation_id='r-ywn83s23',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='4217f428-8d9d-4ee1-9614-642d26d90c46',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerStableDeviceRescueTest-1416322546',owner_user_name='tempest-ServerStableDeviceRescueTest-1416322546-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T17:53:25Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='71f13889d23c4ddb9c5e52d7a1a82d47',uuid=b6b0ba36-ad89-45f1-9578-8b999567dd25,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "0167e253-42dd-486a-8231-a8b8199f3584", "address": "fa:16:3e:3f:ea:5d", "network": {"id": "880ea498-5e4e-4786-a894-bac0f42572f4", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1846928198-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.254", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerStableDeviceRescueTest-1846928198-network", "vif_mac": "fa:16:3e:3f:ea:5d"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b8f184c16b5348beb2dc9e6359a47651", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0167e253-42", "ovs_interfaceid": "0167e253-42dd-486a-8231-a8b8199f3584", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74613) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 29 17:55:32 user nova-compute[74613]: DEBUG nova.network.os_vif_util [None req-0e88c997-e820-43a6-96c7-7a0a2006fbc3 tempest-ServerStableDeviceRescueTest-1416322546 tempest-ServerStableDeviceRescueTest-1416322546-project-member] Converting VIF {"id": "0167e253-42dd-486a-8231-a8b8199f3584", "address": "fa:16:3e:3f:ea:5d", "network": {"id": "880ea498-5e4e-4786-a894-bac0f42572f4", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1846928198-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.254", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerStableDeviceRescueTest-1846928198-network", "vif_mac": "fa:16:3e:3f:ea:5d"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b8f184c16b5348beb2dc9e6359a47651", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0167e253-42", "ovs_interfaceid": "0167e253-42dd-486a-8231-a8b8199f3584", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74613) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 17:55:32 user nova-compute[74613]: DEBUG nova.network.os_vif_util [None req-0e88c997-e820-43a6-96c7-7a0a2006fbc3 tempest-ServerStableDeviceRescueTest-1416322546 tempest-ServerStableDeviceRescueTest-1416322546-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:3f:ea:5d,bridge_name='br-int',has_traffic_filtering=True,id=0167e253-42dd-486a-8231-a8b8199f3584,network=Network(880ea498-5e4e-4786-a894-bac0f42572f4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0167e253-42') {{(pid=74613) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 17:55:32 user nova-compute[74613]: DEBUG nova.objects.instance [None req-0e88c997-e820-43a6-96c7-7a0a2006fbc3 tempest-ServerStableDeviceRescueTest-1416322546 tempest-ServerStableDeviceRescueTest-1416322546-project-member] Lazy-loading 'pci_devices' on Instance uuid b6b0ba36-ad89-45f1-9578-8b999567dd25 {{(pid=74613) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 17:55:32 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:55:32 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-c91e8417-5b0e-455b-9678-f8e7727a2128 tempest-AttachVolumeShelveTestJSON-1452861425 tempest-AttachVolumeShelveTestJSON-1452861425-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/4b1d3c6e93f4177d81652a25f8bdb62406dd0afd,backing_fmt=raw /opt/stack/data/nova/instances/c19e230e-2e6c-4c20-b15c-ad81a73674b4/disk 1073741824" returned: 0 in 0.079s {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 17:55:32 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-c91e8417-5b0e-455b-9678-f8e7727a2128 tempest-AttachVolumeShelveTestJSON-1452861425 tempest-AttachVolumeShelveTestJSON-1452861425-project-member] Lock "4b1d3c6e93f4177d81652a25f8bdb62406dd0afd" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.256s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 17:55:32 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-c91e8417-5b0e-455b-9678-f8e7727a2128 tempest-AttachVolumeShelveTestJSON-1452861425 tempest-AttachVolumeShelveTestJSON-1452861425-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4b1d3c6e93f4177d81652a25f8bdb62406dd0afd --force-share --output=json {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 17:55:32 user nova-compute[74613]: DEBUG nova.objects.base [None req-0e88c997-e820-43a6-96c7-7a0a2006fbc3 tempest-ServerStableDeviceRescueTest-1416322546 tempest-ServerStableDeviceRescueTest-1416322546-project-member] Object Instance<b6b0ba36-ad89-45f1-9578-8b999567dd25> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model,pci_devices {{(pid=74613) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 29 17:55:32 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-0e88c997-e820-43a6-96c7-7a0a2006fbc3 tempest-ServerStableDeviceRescueTest-1416322546 tempest-ServerStableDeviceRescueTest-1416322546-project-member] [instance: b6b0ba36-ad89-45f1-9578-8b999567dd25] End _get_guest_xml xml=<domain type="kvm">
Nov 29 17:55:32 user nova-compute[74613]:   <uuid>b6b0ba36-ad89-45f1-9578-8b999567dd25</uuid>
Nov 29 17:55:32 user nova-compute[74613]:   <name>instance-00000001</name>
Nov 29 17:55:32 user nova-compute[74613]:   <memory>524288</memory>
Nov 29 17:55:32 user nova-compute[74613]:   <vcpu>1</vcpu>
Nov 29 17:55:32 user nova-compute[74613]:   <metadata>
Nov 29 17:55:32 user nova-compute[74613]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 29 17:55:32 user nova-compute[74613]:       <nova:package version="0.0.0"/>
Nov 29 17:55:32 user nova-compute[74613]:       <nova:name>tempest-ServerStableDeviceRescueTest-server-56030904</nova:name>
Nov 29 17:55:32 user nova-compute[74613]:       <nova:creationTime>2023-11-29 17:55:31</nova:creationTime>
Nov 29 17:55:32 user nova-compute[74613]:       <nova:flavor name="m1.tiny">
Nov 29 17:55:32 user nova-compute[74613]:         <nova:memory>512</nova:memory>
Nov 29 17:55:32 user nova-compute[74613]:         <nova:disk>1</nova:disk>
Nov 29 17:55:32 user nova-compute[74613]:         <nova:swap>0</nova:swap>
Nov 29 17:55:32 user nova-compute[74613]:         <nova:ephemeral>0</nova:ephemeral>
Nov 29 17:55:32 user nova-compute[74613]:         <nova:vcpus>1</nova:vcpus>
Nov 29 17:55:32 user nova-compute[74613]:       </nova:flavor>
Nov 29 17:55:32 user nova-compute[74613]:       <nova:owner>
Nov 29 17:55:32 user nova-compute[74613]:         <nova:user uuid="71f13889d23c4ddb9c5e52d7a1a82d47">tempest-ServerStableDeviceRescueTest-1416322546-project-member</nova:user>
Nov 29 17:55:32 user nova-compute[74613]:         <nova:project uuid="b8f184c16b5348beb2dc9e6359a47651">tempest-ServerStableDeviceRescueTest-1416322546</nova:project>
Nov 29 17:55:32 user nova-compute[74613]:       </nova:owner>
Nov 29 17:55:32 user nova-compute[74613]:       <nova:root type="image" uuid="4217f428-8d9d-4ee1-9614-642d26d90c46"/>
Nov 29 17:55:32 user nova-compute[74613]:       <nova:ports>
Nov 29 17:55:32 user nova-compute[74613]:         <nova:port uuid="0167e253-42dd-486a-8231-a8b8199f3584">
Nov 29 17:55:32 user nova-compute[74613]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Nov 29 17:55:32 user nova-compute[74613]:         </nova:port>
Nov 29 17:55:32 user nova-compute[74613]:       </nova:ports>
Nov 29 17:55:32 user nova-compute[74613]:     </nova:instance>
Nov 29 17:55:32 user nova-compute[74613]:   </metadata>
Nov 29 17:55:32 user nova-compute[74613]:   <sysinfo type="smbios">
Nov 29 17:55:32 user nova-compute[74613]:     <system>
Nov 29 17:55:32 user nova-compute[74613]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 29 17:55:32 user nova-compute[74613]:       <entry name="product">OpenStack Nova</entry>
Nov 29 17:55:32 user nova-compute[74613]:       <entry name="version">0.0.0</entry>
Nov 29 17:55:32 user nova-compute[74613]:       <entry name="serial">b6b0ba36-ad89-45f1-9578-8b999567dd25</entry>
Nov 29 17:55:32 user nova-compute[74613]:       <entry name="uuid">b6b0ba36-ad89-45f1-9578-8b999567dd25</entry>
Nov 29 17:55:32 user nova-compute[74613]:       <entry name="family">Virtual Machine</entry>
Nov 29 17:55:32 user nova-compute[74613]:     </system>
Nov 29 17:55:32 user nova-compute[74613]:   </sysinfo>
Nov 29 17:55:32 user nova-compute[74613]:   <os>
Nov 29 17:55:32 user nova-compute[74613]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 29 17:55:32 user nova-compute[74613]:     <smbios mode="sysinfo"/>
Nov 29 17:55:32 user nova-compute[74613]:   </os>
Nov 29 17:55:32 user nova-compute[74613]:   <features>
Nov 29 17:55:32 user nova-compute[74613]:     <acpi/>
Nov 29 17:55:32 user nova-compute[74613]:     <apic/>
Nov 29 17:55:32 user nova-compute[74613]:     <vmcoreinfo/>
Nov 29 17:55:32 user nova-compute[74613]:   </features>
Nov 29 17:55:32 user nova-compute[74613]:   <clock offset="utc">
Nov 29 17:55:32 user nova-compute[74613]:     <timer name="pit" tickpolicy="delay"/>
Nov 29 17:55:32 user nova-compute[74613]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 29 17:55:32 user nova-compute[74613]:     <timer name="hpet" present="no"/>
Nov 29 17:55:32 user nova-compute[74613]:   </clock>
Nov 29 17:55:32 user nova-compute[74613]:   <cpu mode="custom" match="exact">
Nov 29 17:55:32 user nova-compute[74613]:     <model>Nehalem</model>
Nov 29 17:55:32 user nova-compute[74613]:     <topology sockets="1" cores="1" threads="1"/>
Nov 29 17:55:32 user nova-compute[74613]:   </cpu>
Nov 29 17:55:32 user nova-compute[74613]:   <devices>
Nov 29 17:55:32 user nova-compute[74613]:     <disk type="file" device="disk">
Nov 29 17:55:32 user nova-compute[74613]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 29 17:55:32 user nova-compute[74613]:       <source file="/opt/stack/data/nova/instances/b6b0ba36-ad89-45f1-9578-8b999567dd25/disk"/>
Nov 29 17:55:32 user nova-compute[74613]:       <target dev="vda" bus="virtio"/>
Nov 29 17:55:32 user nova-compute[74613]:     </disk>
Nov 29 17:55:32 user nova-compute[74613]:     <disk type="block" device="disk">
Nov 29 17:55:32 user nova-compute[74613]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 17:55:32 user nova-compute[74613]:       <source dev="/dev/sdc"/>
Nov 29 17:55:32 user nova-compute[74613]:       <target dev="vdb" bus="virtio"/>
Nov 29 17:55:32 user nova-compute[74613]:       <serial>070b1031-e105-4cba-a039-2286e23727c5</serial>
Nov 29 17:55:32 user nova-compute[74613]:     </disk>
Nov 29 17:55:32 user nova-compute[74613]:     <disk type="file" device="disk">
Nov 29 17:55:32 user nova-compute[74613]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 29 17:55:32 user nova-compute[74613]:       <source file="/opt/stack/data/nova/instances/b6b0ba36-ad89-45f1-9578-8b999567dd25/disk.rescue"/>
Nov 29 17:55:32 user nova-compute[74613]:       <target dev="vdc" bus="virtio"/>
Nov 29 17:55:32 user nova-compute[74613]:       <boot order="1"/>
Nov 29 17:55:32 user nova-compute[74613]:     </disk>
Nov 29 17:55:32 user nova-compute[74613]:     <interface type="ethernet">
Nov 29 17:55:32 user nova-compute[74613]:       <mac address="fa:16:3e:3f:ea:5d"/>
Nov 29 17:55:32 user nova-compute[74613]:       <model type="virtio"/>
Nov 29 17:55:32 user nova-compute[74613]:       <mtu size="1442"/>
Nov 29 17:55:32 user nova-compute[74613]:       <target dev="tap0167e253-42"/>
Nov 29 17:55:32 user nova-compute[74613]:     </interface>
Nov 29 17:55:32 user nova-compute[74613]:     <serial type="pty">
Nov 29 17:55:32 user nova-compute[74613]:       <log file="/opt/stack/data/nova/instances/b6b0ba36-ad89-45f1-9578-8b999567dd25/console.log" append="off"/>
Nov 29 17:55:32 user nova-compute[74613]:     </serial>
Nov 29 17:55:32 user nova-compute[74613]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 29 17:55:32 user nova-compute[74613]:     <video>
Nov 29 17:55:32 user nova-compute[74613]:       <model type="virtio"/>
Nov 29 17:55:32 user nova-compute[74613]:     </video>
Nov 29 17:55:32 user nova-compute[74613]:     <rng model="virtio">
Nov 29 17:55:32 user nova-compute[74613]:       <backend model="random">/dev/urandom</backend>
Nov 29 17:55:32 user nova-compute[74613]:     </rng>
Nov 29 17:55:32 user nova-compute[74613]:     <controller type="usb" index="0" model="none"/>
Nov 29 17:55:32 user nova-compute[74613]:     <memballoon model="virtio">
Nov 29 17:55:32 user nova-compute[74613]:       <stats period="10"/>
Nov 29 17:55:32 user nova-compute[74613]:     </memballoon>
Nov 29 17:55:32 user nova-compute[74613]:   </devices>
Nov 29 17:55:32 user nova-compute[74613]: </domain>
Nov 29 17:55:32 user nova-compute[74613]:  {{(pid=74613) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 29 17:55:32 user nova-compute[74613]: INFO nova.virt.libvirt.driver [-] [instance: b6b0ba36-ad89-45f1-9578-8b999567dd25] Instance destroyed successfully.
Nov 29 17:55:32 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-0e88c997-e820-43a6-96c7-7a0a2006fbc3 tempest-ServerStableDeviceRescueTest-1416322546 tempest-ServerStableDeviceRescueTest-1416322546-project-member] No BDM found with device name vda, not building metadata. {{(pid=74613) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 17:55:32 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-0e88c997-e820-43a6-96c7-7a0a2006fbc3 tempest-ServerStableDeviceRescueTest-1416322546 tempest-ServerStableDeviceRescueTest-1416322546-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74613) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 17:55:32 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-0e88c997-e820-43a6-96c7-7a0a2006fbc3 tempest-ServerStableDeviceRescueTest-1416322546 tempest-ServerStableDeviceRescueTest-1416322546-project-member] No BDM found with device name vdc, not building metadata. {{(pid=74613) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 17:55:32 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-0e88c997-e820-43a6-96c7-7a0a2006fbc3 tempest-ServerStableDeviceRescueTest-1416322546 tempest-ServerStableDeviceRescueTest-1416322546-project-member] No VIF found with MAC fa:16:3e:3f:ea:5d, not building metadata {{(pid=74613) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 29 17:55:32 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-c91e8417-5b0e-455b-9678-f8e7727a2128 tempest-AttachVolumeShelveTestJSON-1452861425 tempest-AttachVolumeShelveTestJSON-1452861425-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4b1d3c6e93f4177d81652a25f8bdb62406dd0afd --force-share --output=json" returned: 0 in 0.186s {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 17:55:32 user nova-compute[74613]: DEBUG nova.objects.instance [None req-c91e8417-5b0e-455b-9678-f8e7727a2128 tempest-AttachVolumeShelveTestJSON-1452861425 tempest-AttachVolumeShelveTestJSON-1452861425-project-member] Lazy-loading 'migration_context' on Instance uuid c19e230e-2e6c-4c20-b15c-ad81a73674b4 {{(pid=74613) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 17:55:32 user nova-compute[74613]: DEBUG nova.objects.base [None req-c91e8417-5b0e-455b-9678-f8e7727a2128 tempest-AttachVolumeShelveTestJSON-1452861425 tempest-AttachVolumeShelveTestJSON-1452861425-project-member] Object Instance<c19e230e-2e6c-4c20-b15c-ad81a73674b4> lazy-loaded attributes: pci_requests,trusted_certs,migration_context {{(pid=74613) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 29 17:55:32 user nova-compute[74613]: INFO nova.virt.libvirt.driver [None req-c91e8417-5b0e-455b-9678-f8e7727a2128 tempest-AttachVolumeShelveTestJSON-1452861425 tempest-AttachVolumeShelveTestJSON-1452861425-project-member] [instance: c19e230e-2e6c-4c20-b15c-ad81a73674b4] Rebasing disk image.
Nov 29 17:55:32 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-c91e8417-5b0e-455b-9678-f8e7727a2128 tempest-AttachVolumeShelveTestJSON-1452861425 tempest-AttachVolumeShelveTestJSON-1452861425-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/21faea9e6951f3bdd0153b76ac89fe1a60a34758 --force-share --output=json {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 17:55:32 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-c91e8417-5b0e-455b-9678-f8e7727a2128 tempest-AttachVolumeShelveTestJSON-1452861425 tempest-AttachVolumeShelveTestJSON-1452861425-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/21faea9e6951f3bdd0153b76ac89fe1a60a34758 --force-share --output=json" returned: 0 in 0.204s {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 17:55:32 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-c91e8417-5b0e-455b-9678-f8e7727a2128 tempest-AttachVolumeShelveTestJSON-1452861425 tempest-AttachVolumeShelveTestJSON-1452861425-project-member] Running cmd (subprocess): qemu-img rebase -b /opt/stack/data/nova/instances/_base/21faea9e6951f3bdd0153b76ac89fe1a60a34758 -F raw /opt/stack/data/nova/instances/c19e230e-2e6c-4c20-b15c-ad81a73674b4/disk {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 17:55:33 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:55:34 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:55:34 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:55:34 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:55:34 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:55:35 user nova-compute[74613]: DEBUG nova.compute.manager [req-8f457285-6c05-48b0-bfb7-ad1c20507039 req-ad80cafd-3413-463c-a5d2-833e8d2f07b2 service nova] [instance: b6b0ba36-ad89-45f1-9578-8b999567dd25] Received event network-vif-plugged-0167e253-42dd-486a-8231-a8b8199f3584 {{(pid=74613) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 17:55:35 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-8f457285-6c05-48b0-bfb7-ad1c20507039 req-ad80cafd-3413-463c-a5d2-833e8d2f07b2 service nova] Acquiring lock "b6b0ba36-ad89-45f1-9578-8b999567dd25-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 17:55:35 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-8f457285-6c05-48b0-bfb7-ad1c20507039 req-ad80cafd-3413-463c-a5d2-833e8d2f07b2 service nova] Lock "b6b0ba36-ad89-45f1-9578-8b999567dd25-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 17:55:35 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-8f457285-6c05-48b0-bfb7-ad1c20507039 req-ad80cafd-3413-463c-a5d2-833e8d2f07b2 service nova] Lock "b6b0ba36-ad89-45f1-9578-8b999567dd25-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 17:55:35 user nova-compute[74613]: DEBUG nova.compute.manager [req-8f457285-6c05-48b0-bfb7-ad1c20507039 req-ad80cafd-3413-463c-a5d2-833e8d2f07b2 service nova] [instance: b6b0ba36-ad89-45f1-9578-8b999567dd25] No waiting events found dispatching network-vif-plugged-0167e253-42dd-486a-8231-a8b8199f3584 {{(pid=74613) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 17:55:35 user nova-compute[74613]: WARNING nova.compute.manager [req-8f457285-6c05-48b0-bfb7-ad1c20507039 req-ad80cafd-3413-463c-a5d2-833e8d2f07b2 service nova] [instance: b6b0ba36-ad89-45f1-9578-8b999567dd25] Received unexpected event network-vif-plugged-0167e253-42dd-486a-8231-a8b8199f3584 for instance with vm_state active and task_state rescuing.
Nov 29 17:55:35 user nova-compute[74613]: DEBUG nova.compute.manager [None req-176e853b-89a1-45dc-8294-c527328264ba tempest-ServerActionsTestOtherB-894551005 tempest-ServerActionsTestOtherB-894551005-project-member] [instance: 74ac9703-1cd7-4983-b7d4-c69b01fec7b2] Instance event wait completed in 0 seconds for  {{(pid=74613) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 29 17:55:35 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-176e853b-89a1-45dc-8294-c527328264ba tempest-ServerActionsTestOtherB-894551005 tempest-ServerActionsTestOtherB-894551005-project-member] [instance: 74ac9703-1cd7-4983-b7d4-c69b01fec7b2] Guest created on hypervisor {{(pid=74613) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 29 17:55:35 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:55:35 user nova-compute[74613]: INFO nova.virt.libvirt.driver [-] [instance: 74ac9703-1cd7-4983-b7d4-c69b01fec7b2] Instance spawned successfully.
Nov 29 17:55:35 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-176e853b-89a1-45dc-8294-c527328264ba tempest-ServerActionsTestOtherB-894551005 tempest-ServerActionsTestOtherB-894551005-project-member] [instance: 74ac9703-1cd7-4983-b7d4-c69b01fec7b2] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74613) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 29 17:55:35 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-176e853b-89a1-45dc-8294-c527328264ba tempest-ServerActionsTestOtherB-894551005 tempest-ServerActionsTestOtherB-894551005-project-member] [instance: 74ac9703-1cd7-4983-b7d4-c69b01fec7b2] Found default for hw_cdrom_bus of ide {{(pid=74613) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 17:55:35 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-176e853b-89a1-45dc-8294-c527328264ba tempest-ServerActionsTestOtherB-894551005 tempest-ServerActionsTestOtherB-894551005-project-member] [instance: 74ac9703-1cd7-4983-b7d4-c69b01fec7b2] Found default for hw_disk_bus of virtio {{(pid=74613) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 17:55:35 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-176e853b-89a1-45dc-8294-c527328264ba tempest-ServerActionsTestOtherB-894551005 tempest-ServerActionsTestOtherB-894551005-project-member] [instance: 74ac9703-1cd7-4983-b7d4-c69b01fec7b2] Found default for hw_input_bus of None {{(pid=74613) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 17:55:35 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-176e853b-89a1-45dc-8294-c527328264ba tempest-ServerActionsTestOtherB-894551005 tempest-ServerActionsTestOtherB-894551005-project-member] [instance: 74ac9703-1cd7-4983-b7d4-c69b01fec7b2] Found default for hw_pointer_model of None {{(pid=74613) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 17:55:35 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-176e853b-89a1-45dc-8294-c527328264ba tempest-ServerActionsTestOtherB-894551005 tempest-ServerActionsTestOtherB-894551005-project-member] [instance: 74ac9703-1cd7-4983-b7d4-c69b01fec7b2] Found default for hw_video_model of virtio {{(pid=74613) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 17:55:35 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-176e853b-89a1-45dc-8294-c527328264ba tempest-ServerActionsTestOtherB-894551005 tempest-ServerActionsTestOtherB-894551005-project-member] [instance: 74ac9703-1cd7-4983-b7d4-c69b01fec7b2] Found default for hw_vif_model of virtio {{(pid=74613) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 17:55:35 user nova-compute[74613]: INFO nova.compute.manager [None req-176e853b-89a1-45dc-8294-c527328264ba tempest-ServerActionsTestOtherB-894551005 tempest-ServerActionsTestOtherB-894551005-project-member] [instance: 74ac9703-1cd7-4983-b7d4-c69b01fec7b2] Took 9.99 seconds to spawn the instance on the hypervisor.
Nov 29 17:55:35 user nova-compute[74613]: DEBUG nova.compute.manager [None req-176e853b-89a1-45dc-8294-c527328264ba tempest-ServerActionsTestOtherB-894551005 tempest-ServerActionsTestOtherB-894551005-project-member] [instance: 74ac9703-1cd7-4983-b7d4-c69b01fec7b2] Checking state {{(pid=74613) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 29 17:55:35 user nova-compute[74613]: INFO nova.compute.manager [None req-176e853b-89a1-45dc-8294-c527328264ba tempest-ServerActionsTestOtherB-894551005 tempest-ServerActionsTestOtherB-894551005-project-member] [instance: 74ac9703-1cd7-4983-b7d4-c69b01fec7b2] Took 10.99 seconds to build instance.
Nov 29 17:55:35 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:55:35 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-176e853b-89a1-45dc-8294-c527328264ba tempest-ServerActionsTestOtherB-894551005 tempest-ServerActionsTestOtherB-894551005-project-member] Lock "74ac9703-1cd7-4983-b7d4-c69b01fec7b2" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 11.108s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 17:55:35 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:55:35 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:55:35 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-c91e8417-5b0e-455b-9678-f8e7727a2128 tempest-AttachVolumeShelveTestJSON-1452861425 tempest-AttachVolumeShelveTestJSON-1452861425-project-member] CMD "qemu-img rebase -b /opt/stack/data/nova/instances/_base/21faea9e6951f3bdd0153b76ac89fe1a60a34758 -F raw /opt/stack/data/nova/instances/c19e230e-2e6c-4c20-b15c-ad81a73674b4/disk" returned: 0 in 3.213s {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 17:55:35 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-c91e8417-5b0e-455b-9678-f8e7727a2128 tempest-AttachVolumeShelveTestJSON-1452861425 tempest-AttachVolumeShelveTestJSON-1452861425-project-member] [instance: c19e230e-2e6c-4c20-b15c-ad81a73674b4] Created local disks {{(pid=74613) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 29 17:55:35 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-c91e8417-5b0e-455b-9678-f8e7727a2128 tempest-AttachVolumeShelveTestJSON-1452861425 tempest-AttachVolumeShelveTestJSON-1452861425-project-member] [instance: c19e230e-2e6c-4c20-b15c-ad81a73674b4] Ensure instance console log exists: /opt/stack/data/nova/instances/c19e230e-2e6c-4c20-b15c-ad81a73674b4/console.log {{(pid=74613) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 29 17:55:35 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-c91e8417-5b0e-455b-9678-f8e7727a2128 tempest-AttachVolumeShelveTestJSON-1452861425 tempest-AttachVolumeShelveTestJSON-1452861425-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 17:55:35 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-c91e8417-5b0e-455b-9678-f8e7727a2128 tempest-AttachVolumeShelveTestJSON-1452861425 tempest-AttachVolumeShelveTestJSON-1452861425-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 17:55:35 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-c91e8417-5b0e-455b-9678-f8e7727a2128 tempest-AttachVolumeShelveTestJSON-1452861425 tempest-AttachVolumeShelveTestJSON-1452861425-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 17:55:35 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-c91e8417-5b0e-455b-9678-f8e7727a2128 tempest-AttachVolumeShelveTestJSON-1452861425 tempest-AttachVolumeShelveTestJSON-1452861425-project-member] [instance: c19e230e-2e6c-4c20-b15c-ad81a73674b4] Start _get_guest_xml network_info=[{"id": "a414bce0-6293-4987-9441-46943fe2e877", "address": "fa:16:3e:8e:94:32", "network": {"id": "4a101f3e-d23e-4198-bc3c-b4f9b4d2b4c4", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-864151424-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.168", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1c0c1c71400549369c1b11ca7d5f43ec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa414bce0-62", "ovs_interfaceid": "a414bce0-6293-4987-9441-46943fe2e877", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdc': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk'}}} image_meta=ImageMeta(checksum='8c747eeb20dc03f647693f2a1df59667',container_format='bare',created_at=2023-11-29T17:53:22Z,direct_url=<?>,disk_format='qcow2',id=9f45473b-2b66-4071-b129-1f38d43ff99e,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-705281655-shelved',owner='1c0c1c71400549369c1b11ca7d5f43ec',properties=ImageMetaProps,protected=<?>,size=52363264,status='active',tags=<?>,updated_at=2023-11-29T17:53:27Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'size': 0, 'device_type': 'disk', 'boot_index': 0, 'guest_format': None, 'encrypted': False, 'encryption_format': None, 'disk_bus': 'virtio', 'image_id': '4217f428-8d9d-4ee1-9614-642d26d90c46'}], 'ephemerals': [], 'block_device_mapping': [{'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:00ec83b4-5d84-416a-bad9-7511171a9da0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VTYFxodf', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'attached', 'instance': 'c19e230e-2e6c-4c20-b15c-ad81a73674b4', 'attached_at': '', 'detached_at': '', 'volume_id': '00ec83b4-5d84-416a-bad9-7511171a9da0', 'serial': '00ec83b4-5d84-416a-bad9-7511171a9da0'}, 'mount_device': '/dev/vdc', 'delete_on_termination': False, 'device_type': 'disk', 'boot_index': None, 'guest_format': None, 'attachment_id': '54c9b96a-eb93-49f6-becd-bbf66ae3b2d9', 'disk_bus': 'virtio', 'volume_type': None} {{(pid=74613) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 29 17:55:35 user nova-compute[74613]: WARNING nova.virt.libvirt.driver [None req-c91e8417-5b0e-455b-9678-f8e7727a2128 tempest-AttachVolumeShelveTestJSON-1452861425 tempest-AttachVolumeShelveTestJSON-1452861425-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 17:55:35 user nova-compute[74613]: WARNING nova.virt.libvirt.driver [None req-c91e8417-5b0e-455b-9678-f8e7727a2128 tempest-AttachVolumeShelveTestJSON-1452861425 tempest-AttachVolumeShelveTestJSON-1452861425-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 17:55:35 user nova-compute[74613]: DEBUG nova.virt.libvirt.host [None req-c91e8417-5b0e-455b-9678-f8e7727a2128 tempest-AttachVolumeShelveTestJSON-1452861425 tempest-AttachVolumeShelveTestJSON-1452861425-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74613) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 29 17:55:35 user nova-compute[74613]: DEBUG nova.virt.libvirt.host [None req-c91e8417-5b0e-455b-9678-f8e7727a2128 tempest-AttachVolumeShelveTestJSON-1452861425 tempest-AttachVolumeShelveTestJSON-1452861425-project-member] CPU controller missing on host. {{(pid=74613) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 29 17:55:35 user nova-compute[74613]: DEBUG nova.virt.libvirt.host [None req-c91e8417-5b0e-455b-9678-f8e7727a2128 tempest-AttachVolumeShelveTestJSON-1452861425 tempest-AttachVolumeShelveTestJSON-1452861425-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74613) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 29 17:55:35 user nova-compute[74613]: DEBUG nova.virt.libvirt.host [None req-c91e8417-5b0e-455b-9678-f8e7727a2128 tempest-AttachVolumeShelveTestJSON-1452861425 tempest-AttachVolumeShelveTestJSON-1452861425-project-member] CPU controller found on host. {{(pid=74613) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 29 17:55:35 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-c91e8417-5b0e-455b-9678-f8e7727a2128 tempest-AttachVolumeShelveTestJSON-1452861425 tempest-AttachVolumeShelveTestJSON-1452861425-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74613) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 29 17:55:35 user nova-compute[74613]: DEBUG nova.virt.hardware [None req-c91e8417-5b0e-455b-9678-f8e7727a2128 tempest-AttachVolumeShelveTestJSON-1452861425 tempest-AttachVolumeShelveTestJSON-1452861425-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-29T17:47:27Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='8c747eeb20dc03f647693f2a1df59667',container_format='bare',created_at=2023-11-29T17:53:22Z,direct_url=<?>,disk_format='qcow2',id=9f45473b-2b66-4071-b129-1f38d43ff99e,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-705281655-shelved',owner='1c0c1c71400549369c1b11ca7d5f43ec',properties=ImageMetaProps,protected=<?>,size=52363264,status='active',tags=<?>,updated_at=2023-11-29T17:53:27Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74613) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 29 17:55:35 user nova-compute[74613]: DEBUG nova.virt.hardware [None req-c91e8417-5b0e-455b-9678-f8e7727a2128 tempest-AttachVolumeShelveTestJSON-1452861425 tempest-AttachVolumeShelveTestJSON-1452861425-project-member] Flavor limits 0:0:0 {{(pid=74613) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 29 17:55:35 user nova-compute[74613]: DEBUG nova.virt.hardware [None req-c91e8417-5b0e-455b-9678-f8e7727a2128 tempest-AttachVolumeShelveTestJSON-1452861425 tempest-AttachVolumeShelveTestJSON-1452861425-project-member] Image limits 0:0:0 {{(pid=74613) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 29 17:55:35 user nova-compute[74613]: DEBUG nova.virt.hardware [None req-c91e8417-5b0e-455b-9678-f8e7727a2128 tempest-AttachVolumeShelveTestJSON-1452861425 tempest-AttachVolumeShelveTestJSON-1452861425-project-member] Flavor pref 0:0:0 {{(pid=74613) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 29 17:55:35 user nova-compute[74613]: DEBUG nova.virt.hardware [None req-c91e8417-5b0e-455b-9678-f8e7727a2128 tempest-AttachVolumeShelveTestJSON-1452861425 tempest-AttachVolumeShelveTestJSON-1452861425-project-member] Image pref 0:0:0 {{(pid=74613) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 29 17:55:35 user nova-compute[74613]: DEBUG nova.virt.hardware [None req-c91e8417-5b0e-455b-9678-f8e7727a2128 tempest-AttachVolumeShelveTestJSON-1452861425 tempest-AttachVolumeShelveTestJSON-1452861425-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74613) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 29 17:55:35 user nova-compute[74613]: DEBUG nova.virt.hardware [None req-c91e8417-5b0e-455b-9678-f8e7727a2128 tempest-AttachVolumeShelveTestJSON-1452861425 tempest-AttachVolumeShelveTestJSON-1452861425-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74613) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 29 17:55:35 user nova-compute[74613]: DEBUG nova.virt.hardware [None req-c91e8417-5b0e-455b-9678-f8e7727a2128 tempest-AttachVolumeShelveTestJSON-1452861425 tempest-AttachVolumeShelveTestJSON-1452861425-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74613) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 29 17:55:35 user nova-compute[74613]: DEBUG nova.virt.hardware [None req-c91e8417-5b0e-455b-9678-f8e7727a2128 tempest-AttachVolumeShelveTestJSON-1452861425 tempest-AttachVolumeShelveTestJSON-1452861425-project-member] Got 1 possible topologies {{(pid=74613) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 29 17:55:35 user nova-compute[74613]: DEBUG nova.virt.hardware [None req-c91e8417-5b0e-455b-9678-f8e7727a2128 tempest-AttachVolumeShelveTestJSON-1452861425 tempest-AttachVolumeShelveTestJSON-1452861425-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74613) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 29 17:55:35 user nova-compute[74613]: DEBUG nova.virt.hardware [None req-c91e8417-5b0e-455b-9678-f8e7727a2128 tempest-AttachVolumeShelveTestJSON-1452861425 tempest-AttachVolumeShelveTestJSON-1452861425-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74613) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 29 17:55:35 user nova-compute[74613]: DEBUG nova.objects.instance [None req-c91e8417-5b0e-455b-9678-f8e7727a2128 tempest-AttachVolumeShelveTestJSON-1452861425 tempest-AttachVolumeShelveTestJSON-1452861425-project-member] Lazy-loading 'vcpu_model' on Instance uuid c19e230e-2e6c-4c20-b15c-ad81a73674b4 {{(pid=74613) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 17:55:35 user nova-compute[74613]: DEBUG nova.objects.base [None req-c91e8417-5b0e-455b-9678-f8e7727a2128 tempest-AttachVolumeShelveTestJSON-1452861425 tempest-AttachVolumeShelveTestJSON-1452861425-project-member] Object Instance<c19e230e-2e6c-4c20-b15c-ad81a73674b4> lazy-loaded attributes: pci_requests,trusted_certs,migration_context,vcpu_model {{(pid=74613) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 29 17:55:35 user nova-compute[74613]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c91e8417-5b0e-455b-9678-f8e7727a2128 tempest-AttachVolumeShelveTestJSON-1452861425 tempest-AttachVolumeShelveTestJSON-1452861425-project-member] [instance: c19e230e-2e6c-4c20-b15c-ad81a73674b4] Calling os-brick to attach iSCSI Volume {{(pid=74613) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 29 17:55:35 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-c91e8417-5b0e-455b-9678-f8e7727a2128 tempest-AttachVolumeShelveTestJSON-1452861425 tempest-AttachVolumeShelveTestJSON-1452861425-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff828156890>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:00ec83b4-5d84-416a-bad9-7511171a9da0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VTYFxodf', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74613) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 17:55:35 user nova-compute[74613]: WARNING os_brick.initiator.connectors.base [None req-c91e8417-5b0e-455b-9678-f8e7727a2128 tempest-AttachVolumeShelveTestJSON-1452861425 tempest-AttachVolumeShelveTestJSON-1452861425-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 17:55:35 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.base [None req-c91e8417-5b0e-455b-9678-f8e7727a2128 tempest-AttachVolumeShelveTestJSON-1452861425 tempest-AttachVolumeShelveTestJSON-1452861425-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 17:55:35 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.base [None req-c91e8417-5b0e-455b-9678-f8e7727a2128 tempest-AttachVolumeShelveTestJSON-1452861425 tempest-AttachVolumeShelveTestJSON-1452861425-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 17:55:36 user nova-compute[74613]: WARNING os_brick.initiator.connectors.base [None req-c91e8417-5b0e-455b-9678-f8e7727a2128 tempest-AttachVolumeShelveTestJSON-1452861425 tempest-AttachVolumeShelveTestJSON-1452861425-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 17:55:36 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.base [None req-c91e8417-5b0e-455b-9678-f8e7727a2128 tempest-AttachVolumeShelveTestJSON-1452861425 tempest-AttachVolumeShelveTestJSON-1452861425-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:00ec83b4-5d84-416a-bad9-7511171a9da0" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 17:55:36 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.base [None req-c91e8417-5b0e-455b-9678-f8e7727a2128 tempest-AttachVolumeShelveTestJSON-1452861425 tempest-AttachVolumeShelveTestJSON-1452861425-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:00ec83b4-5d84-416a-bad9-7511171a9da0" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 17:55:36 user nova-compute[74613]: INFO os_brick.initiator.connectors.iscsi [None req-c91e8417-5b0e-455b-9678-f8e7727a2128 tempest-AttachVolumeShelveTestJSON-1452861425 tempest-AttachVolumeShelveTestJSON-1452861425-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 29 17:55:36 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:00ec83b4-5d84-416a-bad9-7511171a9da0 -p 172.16.0.220:3260 {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 17:55:36 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:00ec83b4-5d84-416a-bad9-7511171a9da0 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 17:55:36 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1de4632-decb-455c-adb5-4e7657296a06]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 17:55:36 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-c91e8417-5b0e-455b-9678-f8e7727a2128 tempest-AttachVolumeShelveTestJSON-1452861425 tempest-AttachVolumeShelveTestJSON-1452861425-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 29 17:55:36 user nova-compute[74613]:  {{(pid=74613) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 17:55:36 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:00ec83b4-5d84-416a-bad9-7511171a9da0 -p 172.16.0.220:3260 --interface default --op new {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 17:55:36 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:00ec83b4-5d84-416a-bad9-7511171a9da0 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 17:55:36 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[bdfb7528-5230-4d87-9354-43ff51c230fd]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:00ec83b4-5d84-416a-bad9-7511171a9da0] added\n', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 17:55:36 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-c91e8417-5b0e-455b-9678-f8e7727a2128 tempest-AttachVolumeShelveTestJSON-1452861425 tempest-AttachVolumeShelveTestJSON-1452861425-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:00ec83b4-5d84-416a-bad9-7511171a9da0] added
Nov 29 17:55:36 user nova-compute[74613]:  stderr= {{(pid=74613) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 17:55:36 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:00ec83b4-5d84-416a-bad9-7511171a9da0 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 17:55:36 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:00ec83b4-5d84-416a-bad9-7511171a9da0 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.025s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 17:55:36 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[674f8cb4-193d-4156-91b4-176bcb4782df]: (4, ('', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 17:55:36 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-c91e8417-5b0e-455b-9678-f8e7727a2128 tempest-AttachVolumeShelveTestJSON-1452861425 tempest-AttachVolumeShelveTestJSON-1452861425-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74613) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 17:55:36 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:00ec83b4-5d84-416a-bad9-7511171a9da0 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 17:55:36 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:00ec83b4-5d84-416a-bad9-7511171a9da0 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.042s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 17:55:36 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad9cfd82-ab2e-453c-b8d3-c62362b469fb]: (4, ('', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 17:55:36 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-c91e8417-5b0e-455b-9678-f8e7727a2128 tempest-AttachVolumeShelveTestJSON-1452861425 tempest-AttachVolumeShelveTestJSON-1452861425-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74613) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 17:55:36 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:00ec83b4-5d84-416a-bad9-7511171a9da0 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v VTYFxodf {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 17:55:36 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:00ec83b4-5d84-416a-bad9-7511171a9da0 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v VTYFxodf" returned: 0 in 0.039s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 17:55:36 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[93c85464-56b7-45f9-949f-3ad37fed32de]: (4, ('', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 17:55:36 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-c91e8417-5b0e-455b-9678-f8e7727a2128 tempest-AttachVolumeShelveTestJSON-1452861425 tempest-AttachVolumeShelveTestJSON-1452861425-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'VTYFxodf'): stdout= stderr= {{(pid=74613) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 17:55:36 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:00ec83b4-5d84-416a-bad9-7511171a9da0 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 17:55:36 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:00ec83b4-5d84-416a-bad9-7511171a9da0 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.033s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 17:55:36 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0ecb897-7d61-4515-bb19-3fc4fda8f468]: (4, ('', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 17:55:36 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-c91e8417-5b0e-455b-9678-f8e7727a2128 tempest-AttachVolumeShelveTestJSON-1452861425 tempest-AttachVolumeShelveTestJSON-1452861425-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74613) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 17:55:36 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 17:55:36 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 17:55:36 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[00b36a52-e236-433c-b7b5-c6066bad0889]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9511387c-8772-40f2-bf2d-6b6387649e9f (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:070b1031-e105-4cba-a039-2286e23727c5 (non-flash)\n', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 17:55:36 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-c91e8417-5b0e-455b-9678-f8e7727a2128 tempest-AttachVolumeShelveTestJSON-1452861425 tempest-AttachVolumeShelveTestJSON-1452861425-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9511387c-8772-40f2-bf2d-6b6387649e9f (non-flash)
Nov 29 17:55:36 user nova-compute[74613]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:070b1031-e105-4cba-a039-2286e23727c5 (non-flash)
Nov 29 17:55:36 user nova-compute[74613]:  stderr= {{(pid=74613) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 17:55:36 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-c91e8417-5b0e-455b-9678-f8e7727a2128 tempest-AttachVolumeShelveTestJSON-1452861425 tempest-AttachVolumeShelveTestJSON-1452861425-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9511387c-8772-40f2-bf2d-6b6387649e9f (non-flash)
Nov 29 17:55:36 user nova-compute[74613]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:070b1031-e105-4cba-a039-2286e23727c5 (non-flash)
Nov 29 17:55:36 user nova-compute[74613]:  stderr= {{(pid=74613) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 17:55:36 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:00ec83b4-5d84-416a-bad9-7511171a9da0 -p 172.16.0.220:3260 --login {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 17:55:36 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:00ec83b4-5d84-416a-bad9-7511171a9da0 -p 172.16.0.220:3260 --login" returned: 0 in 0.085s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 17:55:36 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[2bd427ce-35dd-41fe-b067-b8a10cfb2cb2]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:00ec83b4-5d84-416a-bad9-7511171a9da0, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:00ec83b4-5d84-416a-bad9-7511171a9da0, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 17:55:36 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-c91e8417-5b0e-455b-9678-f8e7727a2128 tempest-AttachVolumeShelveTestJSON-1452861425 tempest-AttachVolumeShelveTestJSON-1452861425-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:00ec83b4-5d84-416a-bad9-7511171a9da0, portal: 172.16.0.220,3260]
Nov 29 17:55:36 user nova-compute[74613]: Login to [iface: default, target: iqn.2010-10.org.openstack:00ec83b4-5d84-416a-bad9-7511171a9da0, portal: 172.16.0.220,3260] successful.
Nov 29 17:55:36 user nova-compute[74613]:  stderr= {{(pid=74613) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 17:55:36 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:00ec83b4-5d84-416a-bad9-7511171a9da0 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 17:55:36 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:00ec83b4-5d84-416a-bad9-7511171a9da0 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.034s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 17:55:36 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[fbb4fd4a-4fb3-409b-be26-23ac38de84cb]: (4, ('', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 17:55:36 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-c91e8417-5b0e-455b-9678-f8e7727a2128 tempest-AttachVolumeShelveTestJSON-1452861425 tempest-AttachVolumeShelveTestJSON-1452861425-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74613) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 17:55:36 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 17:55:36 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.042s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 17:55:36 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d4ae2bc-b190-4e46-bea4-1e1d574915a8]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9511387c-8772-40f2-bf2d-6b6387649e9f (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:070b1031-e105-4cba-a039-2286e23727c5 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00ec83b4-5d84-416a-bad9-7511171a9da0 (non-flash)\n', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 17:55:36 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-c91e8417-5b0e-455b-9678-f8e7727a2128 tempest-AttachVolumeShelveTestJSON-1452861425 tempest-AttachVolumeShelveTestJSON-1452861425-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9511387c-8772-40f2-bf2d-6b6387649e9f (non-flash)
Nov 29 17:55:36 user nova-compute[74613]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:070b1031-e105-4cba-a039-2286e23727c5 (non-flash)
Nov 29 17:55:36 user nova-compute[74613]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00ec83b4-5d84-416a-bad9-7511171a9da0 (non-flash)
Nov 29 17:55:36 user nova-compute[74613]:  stderr= {{(pid=74613) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 17:55:36 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-c91e8417-5b0e-455b-9678-f8e7727a2128 tempest-AttachVolumeShelveTestJSON-1452861425 tempest-AttachVolumeShelveTestJSON-1452861425-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9511387c-8772-40f2-bf2d-6b6387649e9f (non-flash)
Nov 29 17:55:36 user nova-compute[74613]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:070b1031-e105-4cba-a039-2286e23727c5 (non-flash)
Nov 29 17:55:36 user nova-compute[74613]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00ec83b4-5d84-416a-bad9-7511171a9da0 (non-flash)
Nov 29 17:55:36 user nova-compute[74613]:  stderr= {{(pid=74613) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 17:55:36 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.base [None req-c91e8417-5b0e-455b-9678-f8e7727a2128 tempest-AttachVolumeShelveTestJSON-1452861425 tempest-AttachVolumeShelveTestJSON-1452861425-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:00ec83b4-5d84-416a-bad9-7511171a9da0" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.468s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 17:55:36 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-c91e8417-5b0e-455b-9678-f8e7727a2128 tempest-AttachVolumeShelveTestJSON-1452861425 tempest-AttachVolumeShelveTestJSON-1452861425-project-member] Connected to 172.16.0.220:3260 {{(pid=74613) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 29 17:55:36 user nova-compute[74613]: DEBUG os_brick.initiator.linuxscsi [None req-c91e8417-5b0e-455b-9678-f8e7727a2128 tempest-AttachVolumeShelveTestJSON-1452861425 tempest-AttachVolumeShelveTestJSON-1452861425-project-member] HCTL ('35', '-', '-', 0) found on session 16 with lun 0 {{(pid=74613) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 29 17:55:36 user nova-compute[74613]: DEBUG os_brick.initiator.linuxscsi [None req-c91e8417-5b0e-455b-9678-f8e7727a2128 tempest-AttachVolumeShelveTestJSON-1452861425 tempest-AttachVolumeShelveTestJSON-1452861425-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=74613) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 29 17:55:36 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 17:55:36 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.028s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 17:55:36 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a4af60a-1cdc-417f-b009-6c6866928a4c]: (4, ('- - 0', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 17:55:36 user nova-compute[74613]: DEBUG os_brick.initiator.linuxscsi [None req-c91e8417-5b0e-455b-9678-f8e7727a2128 tempest-AttachVolumeShelveTestJSON-1452861425 tempest-AttachVolumeShelveTestJSON-1452861425-project-member] Searching for a device in session 16 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=74613) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 29 17:55:36 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-c91e8417-5b0e-455b-9678-f8e7727a2128 tempest-AttachVolumeShelveTestJSON-1452861425 tempest-AttachVolumeShelveTestJSON-1452861425-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:00ec83b4-5d84-416a-bad9-7511171a9da0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VTYFxodf', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74613) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 29 17:55:37 user nova-compute[74613]: DEBUG nova.compute.manager [req-3c1e9309-643b-430c-a0a1-700dd7c1833d req-01a0e408-d0ce-4cc9-861a-25ec13a666d4 service nova] [instance: b6b0ba36-ad89-45f1-9578-8b999567dd25] Received event network-vif-plugged-0167e253-42dd-486a-8231-a8b8199f3584 {{(pid=74613) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 17:55:37 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-3c1e9309-643b-430c-a0a1-700dd7c1833d req-01a0e408-d0ce-4cc9-861a-25ec13a666d4 service nova] Acquiring lock "b6b0ba36-ad89-45f1-9578-8b999567dd25-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 17:55:37 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-3c1e9309-643b-430c-a0a1-700dd7c1833d req-01a0e408-d0ce-4cc9-861a-25ec13a666d4 service nova] Lock "b6b0ba36-ad89-45f1-9578-8b999567dd25-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 17:55:37 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-3c1e9309-643b-430c-a0a1-700dd7c1833d req-01a0e408-d0ce-4cc9-861a-25ec13a666d4 service nova] Lock "b6b0ba36-ad89-45f1-9578-8b999567dd25-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 17:55:37 user nova-compute[74613]: DEBUG nova.compute.manager [req-3c1e9309-643b-430c-a0a1-700dd7c1833d req-01a0e408-d0ce-4cc9-861a-25ec13a666d4 service nova] [instance: b6b0ba36-ad89-45f1-9578-8b999567dd25] No waiting events found dispatching network-vif-plugged-0167e253-42dd-486a-8231-a8b8199f3584 {{(pid=74613) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 17:55:37 user nova-compute[74613]: WARNING nova.compute.manager [req-3c1e9309-643b-430c-a0a1-700dd7c1833d req-01a0e408-d0ce-4cc9-861a-25ec13a666d4 service nova] [instance: b6b0ba36-ad89-45f1-9578-8b999567dd25] Received unexpected event network-vif-plugged-0167e253-42dd-486a-8231-a8b8199f3584 for instance with vm_state active and task_state rescuing.
Nov 29 17:55:37 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.base [None req-c91e8417-5b0e-455b-9678-f8e7727a2128 tempest-AttachVolumeShelveTestJSON-1452861425 tempest-AttachVolumeShelveTestJSON-1452861425-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.518s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 17:55:37 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-c91e8417-5b0e-455b-9678-f8e7727a2128 tempest-AttachVolumeShelveTestJSON-1452861425 tempest-AttachVolumeShelveTestJSON-1452861425-project-member] <== connect_volume: return (1519ms) {'type': 'block', 'scsi_wwn': '23131306464626237', 'path': '/dev/sdd'} {{(pid=74613) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 17:55:37 user nova-compute[74613]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c91e8417-5b0e-455b-9678-f8e7727a2128 tempest-AttachVolumeShelveTestJSON-1452861425 tempest-AttachVolumeShelveTestJSON-1452861425-project-member] [instance: c19e230e-2e6c-4c20-b15c-ad81a73674b4] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23131306464626237', 'path': '/dev/sdd'} {{(pid=74613) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 29 17:55:37 user nova-compute[74613]: DEBUG nova.virt.libvirt.vif [None req-c91e8417-5b0e-455b-9678-f8e7727a2128 tempest-AttachVolumeShelveTestJSON-1452861425 tempest-AttachVolumeShelveTestJSON-1452861425-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-29T17:51:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-705281655',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-705281655',id=3,image_ref='9f45473b-2b66-4071-b129-1f38d43ff99e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-keypair-248065239',keypairs=<?>,launch_index=0,launched_at=2023-11-29T17:51:44Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='1c0c1c71400549369c1b11ca7d5f43ec',ramdisk_id='',reservation_id='r-ab112qsi',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='4217f428-8d9d-4ee1-9614-642d26d90c46',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1452861425',owner_user_name='tempest-AttachVolumeShelveTestJSON-1452861425-project-member',shelved_at='2023-11-29T17:53:26.879592',shelved_host='user',shelved_image_id='9f45473b-2b66-4071-b129-1f38d43ff99e'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T17:55:15Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='45192488dde84ebfbcacfdbd4f898799',uuid=c19e230e-2e6c-4c20-b15c-ad81a73674b4,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "a414bce0-6293-4987-9441-46943fe2e877", "address": "fa:16:3e:8e:94:32", "network": {"id": "4a101f3e-d23e-4198-bc3c-b4f9b4d2b4c4", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-864151424-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.168", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1c0c1c71400549369c1b11ca7d5f43ec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa414bce0-62", "ovs_interfaceid": "a414bce0-6293-4987-9441-46943fe2e877", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74613) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 29 17:55:37 user nova-compute[74613]: DEBUG nova.network.os_vif_util [None req-c91e8417-5b0e-455b-9678-f8e7727a2128 tempest-AttachVolumeShelveTestJSON-1452861425 tempest-AttachVolumeShelveTestJSON-1452861425-project-member] Converting VIF {"id": "a414bce0-6293-4987-9441-46943fe2e877", "address": "fa:16:3e:8e:94:32", "network": {"id": "4a101f3e-d23e-4198-bc3c-b4f9b4d2b4c4", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-864151424-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.168", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1c0c1c71400549369c1b11ca7d5f43ec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa414bce0-62", "ovs_interfaceid": "a414bce0-6293-4987-9441-46943fe2e877", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74613) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 17:55:37 user nova-compute[74613]: DEBUG nova.network.os_vif_util [None req-c91e8417-5b0e-455b-9678-f8e7727a2128 tempest-AttachVolumeShelveTestJSON-1452861425 tempest-AttachVolumeShelveTestJSON-1452861425-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8e:94:32,bridge_name='br-int',has_traffic_filtering=True,id=a414bce0-6293-4987-9441-46943fe2e877,network=Network(4a101f3e-d23e-4198-bc3c-b4f9b4d2b4c4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa414bce0-62') {{(pid=74613) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 17:55:37 user nova-compute[74613]: DEBUG nova.objects.instance [None req-c91e8417-5b0e-455b-9678-f8e7727a2128 tempest-AttachVolumeShelveTestJSON-1452861425 tempest-AttachVolumeShelveTestJSON-1452861425-project-member] Lazy-loading 'pci_devices' on Instance uuid c19e230e-2e6c-4c20-b15c-ad81a73674b4 {{(pid=74613) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 17:55:37 user nova-compute[74613]: DEBUG nova.objects.base [None req-c91e8417-5b0e-455b-9678-f8e7727a2128 tempest-AttachVolumeShelveTestJSON-1452861425 tempest-AttachVolumeShelveTestJSON-1452861425-project-member] Object Instance<c19e230e-2e6c-4c20-b15c-ad81a73674b4> lazy-loaded attributes: pci_requests,trusted_certs,migration_context,vcpu_model,pci_devices {{(pid=74613) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 29 17:55:37 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-c91e8417-5b0e-455b-9678-f8e7727a2128 tempest-AttachVolumeShelveTestJSON-1452861425 tempest-AttachVolumeShelveTestJSON-1452861425-project-member] [instance: c19e230e-2e6c-4c20-b15c-ad81a73674b4] End _get_guest_xml xml=<domain type="kvm">
Nov 29 17:55:37 user nova-compute[74613]:   <uuid>c19e230e-2e6c-4c20-b15c-ad81a73674b4</uuid>
Nov 29 17:55:37 user nova-compute[74613]:   <name>instance-00000003</name>
Nov 29 17:55:37 user nova-compute[74613]:   <memory>524288</memory>
Nov 29 17:55:37 user nova-compute[74613]:   <vcpu>1</vcpu>
Nov 29 17:55:37 user nova-compute[74613]:   <metadata>
Nov 29 17:55:37 user nova-compute[74613]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 29 17:55:37 user nova-compute[74613]:       <nova:package version="0.0.0"/>
Nov 29 17:55:37 user nova-compute[74613]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-705281655</nova:name>
Nov 29 17:55:37 user nova-compute[74613]:       <nova:creationTime>2023-11-29 17:55:35</nova:creationTime>
Nov 29 17:55:37 user nova-compute[74613]:       <nova:flavor name="m1.tiny">
Nov 29 17:55:37 user nova-compute[74613]:         <nova:memory>512</nova:memory>
Nov 29 17:55:37 user nova-compute[74613]:         <nova:disk>1</nova:disk>
Nov 29 17:55:37 user nova-compute[74613]:         <nova:swap>0</nova:swap>
Nov 29 17:55:37 user nova-compute[74613]:         <nova:ephemeral>0</nova:ephemeral>
Nov 29 17:55:37 user nova-compute[74613]:         <nova:vcpus>1</nova:vcpus>
Nov 29 17:55:37 user nova-compute[74613]:       </nova:flavor>
Nov 29 17:55:37 user nova-compute[74613]:       <nova:owner>
Nov 29 17:55:37 user nova-compute[74613]:         <nova:user uuid="45192488dde84ebfbcacfdbd4f898799">tempest-AttachVolumeShelveTestJSON-1452861425-project-member</nova:user>
Nov 29 17:55:37 user nova-compute[74613]:         <nova:project uuid="1c0c1c71400549369c1b11ca7d5f43ec">tempest-AttachVolumeShelveTestJSON-1452861425</nova:project>
Nov 29 17:55:37 user nova-compute[74613]:       </nova:owner>
Nov 29 17:55:37 user nova-compute[74613]:       <nova:root type="image" uuid="9f45473b-2b66-4071-b129-1f38d43ff99e"/>
Nov 29 17:55:37 user nova-compute[74613]:       <nova:ports>
Nov 29 17:55:37 user nova-compute[74613]:         <nova:port uuid="a414bce0-6293-4987-9441-46943fe2e877">
Nov 29 17:55:37 user nova-compute[74613]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Nov 29 17:55:37 user nova-compute[74613]:         </nova:port>
Nov 29 17:55:37 user nova-compute[74613]:       </nova:ports>
Nov 29 17:55:37 user nova-compute[74613]:     </nova:instance>
Nov 29 17:55:37 user nova-compute[74613]:   </metadata>
Nov 29 17:55:37 user nova-compute[74613]:   <sysinfo type="smbios">
Nov 29 17:55:37 user nova-compute[74613]:     <system>
Nov 29 17:55:37 user nova-compute[74613]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 29 17:55:37 user nova-compute[74613]:       <entry name="product">OpenStack Nova</entry>
Nov 29 17:55:37 user nova-compute[74613]:       <entry name="version">0.0.0</entry>
Nov 29 17:55:37 user nova-compute[74613]:       <entry name="serial">c19e230e-2e6c-4c20-b15c-ad81a73674b4</entry>
Nov 29 17:55:37 user nova-compute[74613]:       <entry name="uuid">c19e230e-2e6c-4c20-b15c-ad81a73674b4</entry>
Nov 29 17:55:37 user nova-compute[74613]:       <entry name="family">Virtual Machine</entry>
Nov 29 17:55:37 user nova-compute[74613]:     </system>
Nov 29 17:55:37 user nova-compute[74613]:   </sysinfo>
Nov 29 17:55:37 user nova-compute[74613]:   <os>
Nov 29 17:55:37 user nova-compute[74613]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 29 17:55:37 user nova-compute[74613]:     <boot dev="hd"/>
Nov 29 17:55:37 user nova-compute[74613]:     <smbios mode="sysinfo"/>
Nov 29 17:55:37 user nova-compute[74613]:   </os>
Nov 29 17:55:37 user nova-compute[74613]:   <features>
Nov 29 17:55:37 user nova-compute[74613]:     <acpi/>
Nov 29 17:55:37 user nova-compute[74613]:     <apic/>
Nov 29 17:55:37 user nova-compute[74613]:     <vmcoreinfo/>
Nov 29 17:55:37 user nova-compute[74613]:   </features>
Nov 29 17:55:37 user nova-compute[74613]:   <clock offset="utc">
Nov 29 17:55:37 user nova-compute[74613]:     <timer name="pit" tickpolicy="delay"/>
Nov 29 17:55:37 user nova-compute[74613]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 29 17:55:37 user nova-compute[74613]:     <timer name="hpet" present="no"/>
Nov 29 17:55:37 user nova-compute[74613]:   </clock>
Nov 29 17:55:37 user nova-compute[74613]:   <cpu mode="custom" match="exact">
Nov 29 17:55:37 user nova-compute[74613]:     <model>Nehalem</model>
Nov 29 17:55:37 user nova-compute[74613]:     <topology sockets="1" cores="1" threads="1"/>
Nov 29 17:55:37 user nova-compute[74613]:   </cpu>
Nov 29 17:55:37 user nova-compute[74613]:   <devices>
Nov 29 17:55:37 user nova-compute[74613]:     <disk type="file" device="disk">
Nov 29 17:55:37 user nova-compute[74613]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 29 17:55:37 user nova-compute[74613]:       <source file="/opt/stack/data/nova/instances/c19e230e-2e6c-4c20-b15c-ad81a73674b4/disk"/>
Nov 29 17:55:37 user nova-compute[74613]:       <target dev="vda" bus="virtio"/>
Nov 29 17:55:37 user nova-compute[74613]:     </disk>
Nov 29 17:55:37 user nova-compute[74613]:     <disk type="block" device="disk">
Nov 29 17:55:37 user nova-compute[74613]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 17:55:37 user nova-compute[74613]:       <source dev="/dev/sdd"/>
Nov 29 17:55:37 user nova-compute[74613]:       <target dev="vdc" bus="virtio"/>
Nov 29 17:55:37 user nova-compute[74613]:       <serial>00ec83b4-5d84-416a-bad9-7511171a9da0</serial>
Nov 29 17:55:37 user nova-compute[74613]:     </disk>
Nov 29 17:55:37 user nova-compute[74613]:     <interface type="ethernet">
Nov 29 17:55:37 user nova-compute[74613]:       <mac address="fa:16:3e:8e:94:32"/>
Nov 29 17:55:37 user nova-compute[74613]:       <model type="virtio"/>
Nov 29 17:55:37 user nova-compute[74613]:       <mtu size="1442"/>
Nov 29 17:55:37 user nova-compute[74613]:       <target dev="tapa414bce0-62"/>
Nov 29 17:55:37 user nova-compute[74613]:     </interface>
Nov 29 17:55:37 user nova-compute[74613]:     <serial type="pty">
Nov 29 17:55:37 user nova-compute[74613]:       <log file="/opt/stack/data/nova/instances/c19e230e-2e6c-4c20-b15c-ad81a73674b4/console.log" append="off"/>
Nov 29 17:55:37 user nova-compute[74613]:     </serial>
Nov 29 17:55:37 user nova-compute[74613]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 29 17:55:37 user nova-compute[74613]:     <video>
Nov 29 17:55:37 user nova-compute[74613]:       <model type="virtio"/>
Nov 29 17:55:37 user nova-compute[74613]:     </video>
Nov 29 17:55:37 user nova-compute[74613]:     <rng model="virtio">
Nov 29 17:55:37 user nova-compute[74613]:       <backend model="random">/dev/urandom</backend>
Nov 29 17:55:37 user nova-compute[74613]:     </rng>
Nov 29 17:55:37 user nova-compute[74613]:     <controller type="usb" index="0" model="none"/>
Nov 29 17:55:37 user nova-compute[74613]:     <memballoon model="virtio">
Nov 29 17:55:37 user nova-compute[74613]:       <stats period="10"/>
Nov 29 17:55:37 user nova-compute[74613]:     </memballoon>
Nov 29 17:55:37 user nova-compute[74613]:   </devices>
Nov 29 17:55:37 user nova-compute[74613]: </domain>
Nov 29 17:55:37 user nova-compute[74613]:  {{(pid=74613) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 29 17:55:37 user nova-compute[74613]: DEBUG nova.virt.libvirt.vif [None req-c91e8417-5b0e-455b-9678-f8e7727a2128 tempest-AttachVolumeShelveTestJSON-1452861425 tempest-AttachVolumeShelveTestJSON-1452861425-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-29T17:51:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-705281655',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-705281655',id=3,image_ref='9f45473b-2b66-4071-b129-1f38d43ff99e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-keypair-248065239',keypairs=<?>,launch_index=0,launched_at=2023-11-29T17:51:44Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='1c0c1c71400549369c1b11ca7d5f43ec',ramdisk_id='',reservation_id='r-ab112qsi',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='4217f428-8d9d-4ee1-9614-642d26d90c46',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1452861425',owner_user_name='tempest-AttachVolumeShelveTestJSON-1452861425-project-member',shelved_at='2023-11-29T17:53:26.879592',shelved_host='user',shelved_image_id='9f45473b-2b66-4071-b129-1f38d43ff99e'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T17:55:15Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='45192488dde84ebfbcacfdbd4f898799',uuid=c19e230e-2e6c-4c20-b15c-ad81a73674b4,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "a414bce0-6293-4987-9441-46943fe2e877", "address": "fa:16:3e:8e:94:32", "network": {"id": "4a101f3e-d23e-4198-bc3c-b4f9b4d2b4c4", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-864151424-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.168", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1c0c1c71400549369c1b11ca7d5f43ec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa414bce0-62", "ovs_interfaceid": "a414bce0-6293-4987-9441-46943fe2e877", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74613) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 29 17:55:37 user nova-compute[74613]: DEBUG nova.network.os_vif_util [None req-c91e8417-5b0e-455b-9678-f8e7727a2128 tempest-AttachVolumeShelveTestJSON-1452861425 tempest-AttachVolumeShelveTestJSON-1452861425-project-member] Converting VIF {"id": "a414bce0-6293-4987-9441-46943fe2e877", "address": "fa:16:3e:8e:94:32", "network": {"id": "4a101f3e-d23e-4198-bc3c-b4f9b4d2b4c4", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-864151424-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.168", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1c0c1c71400549369c1b11ca7d5f43ec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa414bce0-62", "ovs_interfaceid": "a414bce0-6293-4987-9441-46943fe2e877", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74613) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 17:55:37 user nova-compute[74613]: DEBUG nova.network.os_vif_util [None req-c91e8417-5b0e-455b-9678-f8e7727a2128 tempest-AttachVolumeShelveTestJSON-1452861425 tempest-AttachVolumeShelveTestJSON-1452861425-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8e:94:32,bridge_name='br-int',has_traffic_filtering=True,id=a414bce0-6293-4987-9441-46943fe2e877,network=Network(4a101f3e-d23e-4198-bc3c-b4f9b4d2b4c4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa414bce0-62') {{(pid=74613) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 17:55:37 user nova-compute[74613]: DEBUG os_vif [None req-c91e8417-5b0e-455b-9678-f8e7727a2128 tempest-AttachVolumeShelveTestJSON-1452861425 tempest-AttachVolumeShelveTestJSON-1452861425-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:8e:94:32,bridge_name='br-int',has_traffic_filtering=True,id=a414bce0-6293-4987-9441-46943fe2e877,network=Network(4a101f3e-d23e-4198-bc3c-b4f9b4d2b4c4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa414bce0-62') {{(pid=74613) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 29 17:55:37 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:55:37 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74613) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 17:55:37 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74613) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 29 17:55:37 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:55:37 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '3db892ba-62d2-50ff-8169-ae21b5c34694', '_type': 'linux-noop'}}, row=False) {{(pid=74613) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 17:55:37 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:55:37 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:55:37 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:55:37 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapa414bce0-62, may_exist=True, interface_attrs={}) {{(pid=74613) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 17:55:37 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapa414bce0-62, col_values=(('qos', UUID('454d5dbf-4e83-4618-9f40-f1f2f9cb6628')),), if_exists=True) {{(pid=74613) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 17:55:37 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapa414bce0-62, col_values=(('external_ids', {'iface-id': 'a414bce0-6293-4987-9441-46943fe2e877', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:8e:94:32', 'vm-uuid': 'c19e230e-2e6c-4c20-b15c-ad81a73674b4'}),), if_exists=True) {{(pid=74613) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 17:55:37 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:55:37 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 17:55:37 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:55:37 user nova-compute[74613]: INFO os_vif [None req-c91e8417-5b0e-455b-9678-f8e7727a2128 tempest-AttachVolumeShelveTestJSON-1452861425 tempest-AttachVolumeShelveTestJSON-1452861425-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:8e:94:32,bridge_name='br-int',has_traffic_filtering=True,id=a414bce0-6293-4987-9441-46943fe2e877,network=Network(4a101f3e-d23e-4198-bc3c-b4f9b4d2b4c4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa414bce0-62')
Nov 29 17:55:37 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-c91e8417-5b0e-455b-9678-f8e7727a2128 tempest-AttachVolumeShelveTestJSON-1452861425 tempest-AttachVolumeShelveTestJSON-1452861425-project-member] No BDM found with device name vda, not building metadata. {{(pid=74613) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 17:55:37 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-c91e8417-5b0e-455b-9678-f8e7727a2128 tempest-AttachVolumeShelveTestJSON-1452861425 tempest-AttachVolumeShelveTestJSON-1452861425-project-member] No BDM found with device name vdc, not building metadata. {{(pid=74613) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 17:55:37 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-c91e8417-5b0e-455b-9678-f8e7727a2128 tempest-AttachVolumeShelveTestJSON-1452861425 tempest-AttachVolumeShelveTestJSON-1452861425-project-member] No VIF found with MAC fa:16:3e:8e:94:32, not building metadata {{(pid=74613) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 29 17:55:38 user nova-compute[74613]: DEBUG nova.compute.manager [None req-0e88c997-e820-43a6-96c7-7a0a2006fbc3 tempest-ServerStableDeviceRescueTest-1416322546 tempest-ServerStableDeviceRescueTest-1416322546-project-member] [instance: b6b0ba36-ad89-45f1-9578-8b999567dd25] Checking state {{(pid=74613) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 29 17:55:39 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:55:39 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:55:39 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:55:39 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:55:39 user nova-compute[74613]: DEBUG nova.compute.manager [req-70dcf083-10a2-4a87-9bb0-22d993276706 req-74ed01bb-03b0-41a7-92c6-eeea34f655b7 service nova] [instance: c19e230e-2e6c-4c20-b15c-ad81a73674b4] Received event network-vif-plugged-a414bce0-6293-4987-9441-46943fe2e877 {{(pid=74613) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 17:55:39 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-70dcf083-10a2-4a87-9bb0-22d993276706 req-74ed01bb-03b0-41a7-92c6-eeea34f655b7 service nova] Acquiring lock "c19e230e-2e6c-4c20-b15c-ad81a73674b4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 17:55:39 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-70dcf083-10a2-4a87-9bb0-22d993276706 req-74ed01bb-03b0-41a7-92c6-eeea34f655b7 service nova] Lock "c19e230e-2e6c-4c20-b15c-ad81a73674b4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 17:55:39 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-70dcf083-10a2-4a87-9bb0-22d993276706 req-74ed01bb-03b0-41a7-92c6-eeea34f655b7 service nova] Lock "c19e230e-2e6c-4c20-b15c-ad81a73674b4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 17:55:39 user nova-compute[74613]: DEBUG nova.compute.manager [req-70dcf083-10a2-4a87-9bb0-22d993276706 req-74ed01bb-03b0-41a7-92c6-eeea34f655b7 service nova] [instance: c19e230e-2e6c-4c20-b15c-ad81a73674b4] No waiting events found dispatching network-vif-plugged-a414bce0-6293-4987-9441-46943fe2e877 {{(pid=74613) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 17:55:39 user nova-compute[74613]: WARNING nova.compute.manager [req-70dcf083-10a2-4a87-9bb0-22d993276706 req-74ed01bb-03b0-41a7-92c6-eeea34f655b7 service nova] [instance: c19e230e-2e6c-4c20-b15c-ad81a73674b4] Received unexpected event network-vif-plugged-a414bce0-6293-4987-9441-46943fe2e877 for instance with vm_state shelved_offloaded and task_state spawning.
Nov 29 17:55:40 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:55:40 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:55:40 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:55:40 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:55:40 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:55:40 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:55:41 user nova-compute[74613]: DEBUG nova.compute.manager [req-2ddc4a0d-add1-489e-8d17-d7271bd8bc69 req-129b56aa-fbb5-4440-886d-625ebe7f9f7d service nova] [instance: c19e230e-2e6c-4c20-b15c-ad81a73674b4] Received event network-vif-plugged-a414bce0-6293-4987-9441-46943fe2e877 {{(pid=74613) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 17:55:41 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-2ddc4a0d-add1-489e-8d17-d7271bd8bc69 req-129b56aa-fbb5-4440-886d-625ebe7f9f7d service nova] Acquiring lock "c19e230e-2e6c-4c20-b15c-ad81a73674b4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 17:55:41 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-2ddc4a0d-add1-489e-8d17-d7271bd8bc69 req-129b56aa-fbb5-4440-886d-625ebe7f9f7d service nova] Lock "c19e230e-2e6c-4c20-b15c-ad81a73674b4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 17:55:41 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-2ddc4a0d-add1-489e-8d17-d7271bd8bc69 req-129b56aa-fbb5-4440-886d-625ebe7f9f7d service nova] Lock "c19e230e-2e6c-4c20-b15c-ad81a73674b4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 17:55:41 user nova-compute[74613]: DEBUG nova.compute.manager [req-2ddc4a0d-add1-489e-8d17-d7271bd8bc69 req-129b56aa-fbb5-4440-886d-625ebe7f9f7d service nova] [instance: c19e230e-2e6c-4c20-b15c-ad81a73674b4] No waiting events found dispatching network-vif-plugged-a414bce0-6293-4987-9441-46943fe2e877 {{(pid=74613) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 17:55:41 user nova-compute[74613]: WARNING nova.compute.manager [req-2ddc4a0d-add1-489e-8d17-d7271bd8bc69 req-129b56aa-fbb5-4440-886d-625ebe7f9f7d service nova] [instance: c19e230e-2e6c-4c20-b15c-ad81a73674b4] Received unexpected event network-vif-plugged-a414bce0-6293-4987-9441-46943fe2e877 for instance with vm_state shelved_offloaded and task_state spawning.
Nov 29 17:55:42 user nova-compute[74613]: DEBUG nova.compute.manager [None req-c91e8417-5b0e-455b-9678-f8e7727a2128 tempest-AttachVolumeShelveTestJSON-1452861425 tempest-AttachVolumeShelveTestJSON-1452861425-project-member] [instance: c19e230e-2e6c-4c20-b15c-ad81a73674b4] Instance event wait completed in 0 seconds for  {{(pid=74613) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 29 17:55:42 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-c91e8417-5b0e-455b-9678-f8e7727a2128 tempest-AttachVolumeShelveTestJSON-1452861425 tempest-AttachVolumeShelveTestJSON-1452861425-project-member] [instance: c19e230e-2e6c-4c20-b15c-ad81a73674b4] Guest created on hypervisor {{(pid=74613) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 29 17:55:42 user nova-compute[74613]: INFO nova.virt.libvirt.driver [-] [instance: c19e230e-2e6c-4c20-b15c-ad81a73674b4] Instance spawned successfully.
Nov 29 17:55:42 user nova-compute[74613]: DEBUG nova.compute.manager [None req-c91e8417-5b0e-455b-9678-f8e7727a2128 tempest-AttachVolumeShelveTestJSON-1452861425 tempest-AttachVolumeShelveTestJSON-1452861425-project-member] [instance: c19e230e-2e6c-4c20-b15c-ad81a73674b4] Checking state {{(pid=74613) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 29 17:55:42 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:55:42 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-c91e8417-5b0e-455b-9678-f8e7727a2128 tempest-AttachVolumeShelveTestJSON-1452861425 tempest-AttachVolumeShelveTestJSON-1452861425-project-member] Lock "c19e230e-2e6c-4c20-b15c-ad81a73674b4" "released" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: held 27.795s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 17:55:43 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:55:45 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:55:45 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:55:47 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-22b62f6d-e3f2-427a-b102-fd2f13e24f3f tempest-ServersNegativeTestJSON-1631676891 tempest-ServersNegativeTestJSON-1631676891-project-member] Acquiring lock "c4bdb712-e1f9-4fc0-b527-87088d7eddf8" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 17:55:47 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-22b62f6d-e3f2-427a-b102-fd2f13e24f3f tempest-ServersNegativeTestJSON-1631676891 tempest-ServersNegativeTestJSON-1631676891-project-member] Lock "c4bdb712-e1f9-4fc0-b527-87088d7eddf8" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 17:55:47 user nova-compute[74613]: DEBUG nova.compute.manager [None req-22b62f6d-e3f2-427a-b102-fd2f13e24f3f tempest-ServersNegativeTestJSON-1631676891 tempest-ServersNegativeTestJSON-1631676891-project-member] [instance: c4bdb712-e1f9-4fc0-b527-87088d7eddf8] Starting instance... {{(pid=74613) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 29 17:55:47 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:55:47 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-22b62f6d-e3f2-427a-b102-fd2f13e24f3f tempest-ServersNegativeTestJSON-1631676891 tempest-ServersNegativeTestJSON-1631676891-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 17:55:47 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-22b62f6d-e3f2-427a-b102-fd2f13e24f3f tempest-ServersNegativeTestJSON-1631676891 tempest-ServersNegativeTestJSON-1631676891-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 17:55:47 user nova-compute[74613]: DEBUG nova.virt.hardware [None req-22b62f6d-e3f2-427a-b102-fd2f13e24f3f tempest-ServersNegativeTestJSON-1631676891 tempest-ServersNegativeTestJSON-1631676891-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74613) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 29 17:55:47 user nova-compute[74613]: INFO nova.compute.claims [None req-22b62f6d-e3f2-427a-b102-fd2f13e24f3f tempest-ServersNegativeTestJSON-1631676891 tempest-ServersNegativeTestJSON-1631676891-project-member] [instance: c4bdb712-e1f9-4fc0-b527-87088d7eddf8] Claim successful on node user
Nov 29 17:55:48 user nova-compute[74613]: DEBUG nova.compute.provider_tree [None req-22b62f6d-e3f2-427a-b102-fd2f13e24f3f tempest-ServersNegativeTestJSON-1631676891 tempest-ServersNegativeTestJSON-1631676891-project-member] Inventory has not changed in ProviderTree for provider: 639d980e-3b12-44b1-b8f4-1812416fa4dd {{(pid=74613) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 17:55:48 user nova-compute[74613]: DEBUG nova.scheduler.client.report [None req-22b62f6d-e3f2-427a-b102-fd2f13e24f3f tempest-ServersNegativeTestJSON-1631676891 tempest-ServersNegativeTestJSON-1631676891-project-member] Inventory has not changed for provider 639d980e-3b12-44b1-b8f4-1812416fa4dd based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74613) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 17:55:48 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-22b62f6d-e3f2-427a-b102-fd2f13e24f3f tempest-ServersNegativeTestJSON-1631676891 tempest-ServersNegativeTestJSON-1631676891-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.493s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 17:55:48 user nova-compute[74613]: DEBUG nova.compute.manager [None req-22b62f6d-e3f2-427a-b102-fd2f13e24f3f tempest-ServersNegativeTestJSON-1631676891 tempest-ServersNegativeTestJSON-1631676891-project-member] [instance: c4bdb712-e1f9-4fc0-b527-87088d7eddf8] Start building networks asynchronously for instance. {{(pid=74613) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 29 17:55:48 user nova-compute[74613]: DEBUG nova.compute.manager [None req-22b62f6d-e3f2-427a-b102-fd2f13e24f3f tempest-ServersNegativeTestJSON-1631676891 tempest-ServersNegativeTestJSON-1631676891-project-member] [instance: c4bdb712-e1f9-4fc0-b527-87088d7eddf8] Allocating IP information in the background. {{(pid=74613) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 29 17:55:48 user nova-compute[74613]: DEBUG nova.network.neutron [None req-22b62f6d-e3f2-427a-b102-fd2f13e24f3f tempest-ServersNegativeTestJSON-1631676891 tempest-ServersNegativeTestJSON-1631676891-project-member] [instance: c4bdb712-e1f9-4fc0-b527-87088d7eddf8] allocate_for_instance() {{(pid=74613) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 29 17:55:48 user nova-compute[74613]: INFO nova.virt.libvirt.driver [None req-22b62f6d-e3f2-427a-b102-fd2f13e24f3f tempest-ServersNegativeTestJSON-1631676891 tempest-ServersNegativeTestJSON-1631676891-project-member] [instance: c4bdb712-e1f9-4fc0-b527-87088d7eddf8] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 29 17:55:48 user nova-compute[74613]: DEBUG nova.compute.manager [None req-22b62f6d-e3f2-427a-b102-fd2f13e24f3f tempest-ServersNegativeTestJSON-1631676891 tempest-ServersNegativeTestJSON-1631676891-project-member] [instance: c4bdb712-e1f9-4fc0-b527-87088d7eddf8] Start building block device mappings for instance. {{(pid=74613) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 29 17:55:48 user nova-compute[74613]: DEBUG nova.policy [None req-22b62f6d-e3f2-427a-b102-fd2f13e24f3f tempest-ServersNegativeTestJSON-1631676891 tempest-ServersNegativeTestJSON-1631676891-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '4b4c259dfbf244c6b48374ab04e6d694', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68aabefe0c4340ce8408e386748fa0cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74613) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 29 17:55:48 user nova-compute[74613]: DEBUG nova.compute.manager [None req-22b62f6d-e3f2-427a-b102-fd2f13e24f3f tempest-ServersNegativeTestJSON-1631676891 tempest-ServersNegativeTestJSON-1631676891-project-member] [instance: c4bdb712-e1f9-4fc0-b527-87088d7eddf8] Start spawning the instance on the hypervisor. {{(pid=74613) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 29 17:55:48 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-22b62f6d-e3f2-427a-b102-fd2f13e24f3f tempest-ServersNegativeTestJSON-1631676891 tempest-ServersNegativeTestJSON-1631676891-project-member] [instance: c4bdb712-e1f9-4fc0-b527-87088d7eddf8] Creating instance directory {{(pid=74613) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 29 17:55:48 user nova-compute[74613]: INFO nova.virt.libvirt.driver [None req-22b62f6d-e3f2-427a-b102-fd2f13e24f3f tempest-ServersNegativeTestJSON-1631676891 tempest-ServersNegativeTestJSON-1631676891-project-member] [instance: c4bdb712-e1f9-4fc0-b527-87088d7eddf8] Creating image(s)
Nov 29 17:55:48 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-22b62f6d-e3f2-427a-b102-fd2f13e24f3f tempest-ServersNegativeTestJSON-1631676891 tempest-ServersNegativeTestJSON-1631676891-project-member] Acquiring lock "/opt/stack/data/nova/instances/c4bdb712-e1f9-4fc0-b527-87088d7eddf8/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 17:55:48 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-22b62f6d-e3f2-427a-b102-fd2f13e24f3f tempest-ServersNegativeTestJSON-1631676891 tempest-ServersNegativeTestJSON-1631676891-project-member] Lock "/opt/stack/data/nova/instances/c4bdb712-e1f9-4fc0-b527-87088d7eddf8/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 17:55:48 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-22b62f6d-e3f2-427a-b102-fd2f13e24f3f tempest-ServersNegativeTestJSON-1631676891 tempest-ServersNegativeTestJSON-1631676891-project-member] Lock "/opt/stack/data/nova/instances/c4bdb712-e1f9-4fc0-b527-87088d7eddf8/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 17:55:48 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-22b62f6d-e3f2-427a-b102-fd2f13e24f3f tempest-ServersNegativeTestJSON-1631676891 tempest-ServersNegativeTestJSON-1631676891-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/21faea9e6951f3bdd0153b76ac89fe1a60a34758 --force-share --output=json {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 17:55:48 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-22b62f6d-e3f2-427a-b102-fd2f13e24f3f tempest-ServersNegativeTestJSON-1631676891 tempest-ServersNegativeTestJSON-1631676891-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/21faea9e6951f3bdd0153b76ac89fe1a60a34758 --force-share --output=json" returned: 0 in 0.283s {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 17:55:48 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-22b62f6d-e3f2-427a-b102-fd2f13e24f3f tempest-ServersNegativeTestJSON-1631676891 tempest-ServersNegativeTestJSON-1631676891-project-member] Acquiring lock "21faea9e6951f3bdd0153b76ac89fe1a60a34758" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 17:55:48 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-22b62f6d-e3f2-427a-b102-fd2f13e24f3f tempest-ServersNegativeTestJSON-1631676891 tempest-ServersNegativeTestJSON-1631676891-project-member] Lock "21faea9e6951f3bdd0153b76ac89fe1a60a34758" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 17:55:48 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-22b62f6d-e3f2-427a-b102-fd2f13e24f3f tempest-ServersNegativeTestJSON-1631676891 tempest-ServersNegativeTestJSON-1631676891-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/21faea9e6951f3bdd0153b76ac89fe1a60a34758 --force-share --output=json {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 17:55:49 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-22b62f6d-e3f2-427a-b102-fd2f13e24f3f tempest-ServersNegativeTestJSON-1631676891 tempest-ServersNegativeTestJSON-1631676891-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/21faea9e6951f3bdd0153b76ac89fe1a60a34758 --force-share --output=json" returned: 0 in 0.218s {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 17:55:49 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-22b62f6d-e3f2-427a-b102-fd2f13e24f3f tempest-ServersNegativeTestJSON-1631676891 tempest-ServersNegativeTestJSON-1631676891-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/21faea9e6951f3bdd0153b76ac89fe1a60a34758,backing_fmt=raw /opt/stack/data/nova/instances/c4bdb712-e1f9-4fc0-b527-87088d7eddf8/disk 1073741824 {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 17:55:49 user nova-compute[74613]: DEBUG nova.network.neutron [None req-22b62f6d-e3f2-427a-b102-fd2f13e24f3f tempest-ServersNegativeTestJSON-1631676891 tempest-ServersNegativeTestJSON-1631676891-project-member] [instance: c4bdb712-e1f9-4fc0-b527-87088d7eddf8] Successfully created port: 1261dd8b-2514-475b-bbbc-7a83ce22c7c0 {{(pid=74613) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 29 17:55:49 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-22b62f6d-e3f2-427a-b102-fd2f13e24f3f tempest-ServersNegativeTestJSON-1631676891 tempest-ServersNegativeTestJSON-1631676891-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/21faea9e6951f3bdd0153b76ac89fe1a60a34758,backing_fmt=raw /opt/stack/data/nova/instances/c4bdb712-e1f9-4fc0-b527-87088d7eddf8/disk 1073741824" returned: 0 in 0.079s {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 17:55:49 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-22b62f6d-e3f2-427a-b102-fd2f13e24f3f tempest-ServersNegativeTestJSON-1631676891 tempest-ServersNegativeTestJSON-1631676891-project-member] Lock "21faea9e6951f3bdd0153b76ac89fe1a60a34758" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.305s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 17:55:49 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-22b62f6d-e3f2-427a-b102-fd2f13e24f3f tempest-ServersNegativeTestJSON-1631676891 tempest-ServersNegativeTestJSON-1631676891-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/21faea9e6951f3bdd0153b76ac89fe1a60a34758 --force-share --output=json {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 17:55:49 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-22b62f6d-e3f2-427a-b102-fd2f13e24f3f tempest-ServersNegativeTestJSON-1631676891 tempest-ServersNegativeTestJSON-1631676891-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/21faea9e6951f3bdd0153b76ac89fe1a60a34758 --force-share --output=json" returned: 0 in 0.188s {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 17:55:49 user nova-compute[74613]: DEBUG nova.virt.disk.api [None req-22b62f6d-e3f2-427a-b102-fd2f13e24f3f tempest-ServersNegativeTestJSON-1631676891 tempest-ServersNegativeTestJSON-1631676891-project-member] Checking if we can resize image /opt/stack/data/nova/instances/c4bdb712-e1f9-4fc0-b527-87088d7eddf8/disk. size=1073741824 {{(pid=74613) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 29 17:55:49 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-22b62f6d-e3f2-427a-b102-fd2f13e24f3f tempest-ServersNegativeTestJSON-1631676891 tempest-ServersNegativeTestJSON-1631676891-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c4bdb712-e1f9-4fc0-b527-87088d7eddf8/disk --force-share --output=json {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 17:55:49 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-22b62f6d-e3f2-427a-b102-fd2f13e24f3f tempest-ServersNegativeTestJSON-1631676891 tempest-ServersNegativeTestJSON-1631676891-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c4bdb712-e1f9-4fc0-b527-87088d7eddf8/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 17:55:49 user nova-compute[74613]: DEBUG nova.virt.disk.api [None req-22b62f6d-e3f2-427a-b102-fd2f13e24f3f tempest-ServersNegativeTestJSON-1631676891 tempest-ServersNegativeTestJSON-1631676891-project-member] Cannot resize image /opt/stack/data/nova/instances/c4bdb712-e1f9-4fc0-b527-87088d7eddf8/disk to a smaller size. {{(pid=74613) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 29 17:55:49 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-22b62f6d-e3f2-427a-b102-fd2f13e24f3f tempest-ServersNegativeTestJSON-1631676891 tempest-ServersNegativeTestJSON-1631676891-project-member] [instance: c4bdb712-e1f9-4fc0-b527-87088d7eddf8] Created local disks {{(pid=74613) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 29 17:55:49 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-22b62f6d-e3f2-427a-b102-fd2f13e24f3f tempest-ServersNegativeTestJSON-1631676891 tempest-ServersNegativeTestJSON-1631676891-project-member] [instance: c4bdb712-e1f9-4fc0-b527-87088d7eddf8] Ensure instance console log exists: /opt/stack/data/nova/instances/c4bdb712-e1f9-4fc0-b527-87088d7eddf8/console.log {{(pid=74613) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 29 17:55:49 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-22b62f6d-e3f2-427a-b102-fd2f13e24f3f tempest-ServersNegativeTestJSON-1631676891 tempest-ServersNegativeTestJSON-1631676891-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 17:55:49 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-22b62f6d-e3f2-427a-b102-fd2f13e24f3f tempest-ServersNegativeTestJSON-1631676891 tempest-ServersNegativeTestJSON-1631676891-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 17:55:49 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-22b62f6d-e3f2-427a-b102-fd2f13e24f3f tempest-ServersNegativeTestJSON-1631676891 tempest-ServersNegativeTestJSON-1631676891-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 17:55:50 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:55:50 user nova-compute[74613]: DEBUG nova.network.neutron [None req-22b62f6d-e3f2-427a-b102-fd2f13e24f3f tempest-ServersNegativeTestJSON-1631676891 tempest-ServersNegativeTestJSON-1631676891-project-member] [instance: c4bdb712-e1f9-4fc0-b527-87088d7eddf8] Successfully updated port: 1261dd8b-2514-475b-bbbc-7a83ce22c7c0 {{(pid=74613) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 29 17:55:50 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-22b62f6d-e3f2-427a-b102-fd2f13e24f3f tempest-ServersNegativeTestJSON-1631676891 tempest-ServersNegativeTestJSON-1631676891-project-member] Acquiring lock "refresh_cache-c4bdb712-e1f9-4fc0-b527-87088d7eddf8" {{(pid=74613) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 17:55:50 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-22b62f6d-e3f2-427a-b102-fd2f13e24f3f tempest-ServersNegativeTestJSON-1631676891 tempest-ServersNegativeTestJSON-1631676891-project-member] Acquired lock "refresh_cache-c4bdb712-e1f9-4fc0-b527-87088d7eddf8" {{(pid=74613) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 17:55:50 user nova-compute[74613]: DEBUG nova.network.neutron [None req-22b62f6d-e3f2-427a-b102-fd2f13e24f3f tempest-ServersNegativeTestJSON-1631676891 tempest-ServersNegativeTestJSON-1631676891-project-member] [instance: c4bdb712-e1f9-4fc0-b527-87088d7eddf8] Building network info cache for instance {{(pid=74613) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 29 17:55:50 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:55:50 user nova-compute[74613]: DEBUG nova.compute.manager [req-cd9b0bcf-97b3-4023-a05e-2198398e417b req-81f15292-3d98-4259-aa81-e25c7eb207d1 service nova] [instance: c4bdb712-e1f9-4fc0-b527-87088d7eddf8] Received event network-changed-1261dd8b-2514-475b-bbbc-7a83ce22c7c0 {{(pid=74613) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 17:55:50 user nova-compute[74613]: DEBUG nova.compute.manager [req-cd9b0bcf-97b3-4023-a05e-2198398e417b req-81f15292-3d98-4259-aa81-e25c7eb207d1 service nova] [instance: c4bdb712-e1f9-4fc0-b527-87088d7eddf8] Refreshing instance network info cache due to event network-changed-1261dd8b-2514-475b-bbbc-7a83ce22c7c0. {{(pid=74613) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 17:55:50 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-cd9b0bcf-97b3-4023-a05e-2198398e417b req-81f15292-3d98-4259-aa81-e25c7eb207d1 service nova] Acquiring lock "refresh_cache-c4bdb712-e1f9-4fc0-b527-87088d7eddf8" {{(pid=74613) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 17:55:50 user nova-compute[74613]: DEBUG nova.network.neutron [None req-22b62f6d-e3f2-427a-b102-fd2f13e24f3f tempest-ServersNegativeTestJSON-1631676891 tempest-ServersNegativeTestJSON-1631676891-project-member] [instance: c4bdb712-e1f9-4fc0-b527-87088d7eddf8] Instance cache missing network info. {{(pid=74613) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 29 17:55:50 user nova-compute[74613]: DEBUG nova.network.neutron [None req-22b62f6d-e3f2-427a-b102-fd2f13e24f3f tempest-ServersNegativeTestJSON-1631676891 tempest-ServersNegativeTestJSON-1631676891-project-member] [instance: c4bdb712-e1f9-4fc0-b527-87088d7eddf8] Updating instance_info_cache with network_info: [{"id": "1261dd8b-2514-475b-bbbc-7a83ce22c7c0", "address": "fa:16:3e:7f:98:93", "network": {"id": "4d31e03e-697a-44c2-a03e-77eed3dbce43", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-629140279-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "68aabefe0c4340ce8408e386748fa0cf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1261dd8b-25", "ovs_interfaceid": "1261dd8b-2514-475b-bbbc-7a83ce22c7c0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74613) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 17:55:50 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-22b62f6d-e3f2-427a-b102-fd2f13e24f3f tempest-ServersNegativeTestJSON-1631676891 tempest-ServersNegativeTestJSON-1631676891-project-member] Releasing lock "refresh_cache-c4bdb712-e1f9-4fc0-b527-87088d7eddf8" {{(pid=74613) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 17:55:50 user nova-compute[74613]: DEBUG nova.compute.manager [None req-22b62f6d-e3f2-427a-b102-fd2f13e24f3f tempest-ServersNegativeTestJSON-1631676891 tempest-ServersNegativeTestJSON-1631676891-project-member] [instance: c4bdb712-e1f9-4fc0-b527-87088d7eddf8] Instance network_info: |[{"id": "1261dd8b-2514-475b-bbbc-7a83ce22c7c0", "address": "fa:16:3e:7f:98:93", "network": {"id": "4d31e03e-697a-44c2-a03e-77eed3dbce43", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-629140279-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "68aabefe0c4340ce8408e386748fa0cf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1261dd8b-25", "ovs_interfaceid": "1261dd8b-2514-475b-bbbc-7a83ce22c7c0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74613) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 29 17:55:50 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-cd9b0bcf-97b3-4023-a05e-2198398e417b req-81f15292-3d98-4259-aa81-e25c7eb207d1 service nova] Acquired lock "refresh_cache-c4bdb712-e1f9-4fc0-b527-87088d7eddf8" {{(pid=74613) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 17:55:50 user nova-compute[74613]: DEBUG nova.network.neutron [req-cd9b0bcf-97b3-4023-a05e-2198398e417b req-81f15292-3d98-4259-aa81-e25c7eb207d1 service nova] [instance: c4bdb712-e1f9-4fc0-b527-87088d7eddf8] Refreshing network info cache for port 1261dd8b-2514-475b-bbbc-7a83ce22c7c0 {{(pid=74613) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 17:55:50 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-22b62f6d-e3f2-427a-b102-fd2f13e24f3f tempest-ServersNegativeTestJSON-1631676891 tempest-ServersNegativeTestJSON-1631676891-project-member] [instance: c4bdb712-e1f9-4fc0-b527-87088d7eddf8] Start _get_guest_xml network_info=[{"id": "1261dd8b-2514-475b-bbbc-7a83ce22c7c0", "address": "fa:16:3e:7f:98:93", "network": {"id": "4d31e03e-697a-44c2-a03e-77eed3dbce43", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-629140279-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "68aabefe0c4340ce8408e386748fa0cf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1261dd8b-25", "ovs_interfaceid": "1261dd8b-2514-475b-bbbc-7a83ce22c7c0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-29T17:47:38Z,direct_url=<?>,disk_format='qcow2',id=4217f428-8d9d-4ee1-9614-642d26d90c46,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='794b07cbd46a44b5865cfda741036bae',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-29T17:47:40Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'size': 0, 'device_type': 'disk', 'boot_index': 0, 'guest_format': None, 'encrypted': False, 'encryption_format': None, 'disk_bus': 'virtio', 'image_id': '4217f428-8d9d-4ee1-9614-642d26d90c46'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74613) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 29 17:55:50 user nova-compute[74613]: WARNING nova.virt.libvirt.driver [None req-22b62f6d-e3f2-427a-b102-fd2f13e24f3f tempest-ServersNegativeTestJSON-1631676891 tempest-ServersNegativeTestJSON-1631676891-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 17:55:50 user nova-compute[74613]: WARNING nova.virt.libvirt.driver [None req-22b62f6d-e3f2-427a-b102-fd2f13e24f3f tempest-ServersNegativeTestJSON-1631676891 tempest-ServersNegativeTestJSON-1631676891-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 17:55:50 user nova-compute[74613]: DEBUG nova.virt.libvirt.host [None req-22b62f6d-e3f2-427a-b102-fd2f13e24f3f tempest-ServersNegativeTestJSON-1631676891 tempest-ServersNegativeTestJSON-1631676891-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74613) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 29 17:55:50 user nova-compute[74613]: DEBUG nova.virt.libvirt.host [None req-22b62f6d-e3f2-427a-b102-fd2f13e24f3f tempest-ServersNegativeTestJSON-1631676891 tempest-ServersNegativeTestJSON-1631676891-project-member] CPU controller missing on host. {{(pid=74613) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 29 17:55:50 user nova-compute[74613]: DEBUG nova.virt.libvirt.host [None req-22b62f6d-e3f2-427a-b102-fd2f13e24f3f tempest-ServersNegativeTestJSON-1631676891 tempest-ServersNegativeTestJSON-1631676891-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74613) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 29 17:55:50 user nova-compute[74613]: DEBUG nova.virt.libvirt.host [None req-22b62f6d-e3f2-427a-b102-fd2f13e24f3f tempest-ServersNegativeTestJSON-1631676891 tempest-ServersNegativeTestJSON-1631676891-project-member] CPU controller found on host. {{(pid=74613) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 29 17:55:50 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-22b62f6d-e3f2-427a-b102-fd2f13e24f3f tempest-ServersNegativeTestJSON-1631676891 tempest-ServersNegativeTestJSON-1631676891-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74613) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 29 17:55:50 user nova-compute[74613]: DEBUG nova.virt.hardware [None req-22b62f6d-e3f2-427a-b102-fd2f13e24f3f tempest-ServersNegativeTestJSON-1631676891 tempest-ServersNegativeTestJSON-1631676891-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-29T17:47:27Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-29T17:47:38Z,direct_url=<?>,disk_format='qcow2',id=4217f428-8d9d-4ee1-9614-642d26d90c46,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='794b07cbd46a44b5865cfda741036bae',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-29T17:47:40Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74613) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 29 17:55:50 user nova-compute[74613]: DEBUG nova.virt.hardware [None req-22b62f6d-e3f2-427a-b102-fd2f13e24f3f tempest-ServersNegativeTestJSON-1631676891 tempest-ServersNegativeTestJSON-1631676891-project-member] Flavor limits 0:0:0 {{(pid=74613) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 29 17:55:50 user nova-compute[74613]: DEBUG nova.virt.hardware [None req-22b62f6d-e3f2-427a-b102-fd2f13e24f3f tempest-ServersNegativeTestJSON-1631676891 tempest-ServersNegativeTestJSON-1631676891-project-member] Image limits 0:0:0 {{(pid=74613) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 29 17:55:50 user nova-compute[74613]: DEBUG nova.virt.hardware [None req-22b62f6d-e3f2-427a-b102-fd2f13e24f3f tempest-ServersNegativeTestJSON-1631676891 tempest-ServersNegativeTestJSON-1631676891-project-member] Flavor pref 0:0:0 {{(pid=74613) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 29 17:55:50 user nova-compute[74613]: DEBUG nova.virt.hardware [None req-22b62f6d-e3f2-427a-b102-fd2f13e24f3f tempest-ServersNegativeTestJSON-1631676891 tempest-ServersNegativeTestJSON-1631676891-project-member] Image pref 0:0:0 {{(pid=74613) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 29 17:55:50 user nova-compute[74613]: DEBUG nova.virt.hardware [None req-22b62f6d-e3f2-427a-b102-fd2f13e24f3f tempest-ServersNegativeTestJSON-1631676891 tempest-ServersNegativeTestJSON-1631676891-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74613) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 29 17:55:50 user nova-compute[74613]: DEBUG nova.virt.hardware [None req-22b62f6d-e3f2-427a-b102-fd2f13e24f3f tempest-ServersNegativeTestJSON-1631676891 tempest-ServersNegativeTestJSON-1631676891-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74613) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 29 17:55:50 user nova-compute[74613]: DEBUG nova.virt.hardware [None req-22b62f6d-e3f2-427a-b102-fd2f13e24f3f tempest-ServersNegativeTestJSON-1631676891 tempest-ServersNegativeTestJSON-1631676891-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74613) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 29 17:55:50 user nova-compute[74613]: DEBUG nova.virt.hardware [None req-22b62f6d-e3f2-427a-b102-fd2f13e24f3f tempest-ServersNegativeTestJSON-1631676891 tempest-ServersNegativeTestJSON-1631676891-project-member] Got 1 possible topologies {{(pid=74613) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 29 17:55:50 user nova-compute[74613]: DEBUG nova.virt.hardware [None req-22b62f6d-e3f2-427a-b102-fd2f13e24f3f tempest-ServersNegativeTestJSON-1631676891 tempest-ServersNegativeTestJSON-1631676891-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74613) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 29 17:55:50 user nova-compute[74613]: DEBUG nova.virt.hardware [None req-22b62f6d-e3f2-427a-b102-fd2f13e24f3f tempest-ServersNegativeTestJSON-1631676891 tempest-ServersNegativeTestJSON-1631676891-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74613) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 29 17:55:50 user nova-compute[74613]: DEBUG nova.virt.libvirt.vif [None req-22b62f6d-e3f2-427a-b102-fd2f13e24f3f tempest-ServersNegativeTestJSON-1631676891 tempest-ServersNegativeTestJSON-1631676891-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T17:55:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-611902795',display_name='tempest-ServersNegativeTestJSON-server-611902795',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-611902795',id=15,image_ref='4217f428-8d9d-4ee1-9614-642d26d90c46',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='68aabefe0c4340ce8408e386748fa0cf',ramdisk_id='',reservation_id='r-61eegonr',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='4217f428-8d9d-4ee1-9614-642d26d90c46',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-1631676891',owner_user_name='tempest-ServersNegativeTestJSON-1631676891-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T17:55:49Z,user_data=None,user_id='4b4c259dfbf244c6b48374ab04e6d694',uuid=c4bdb712-e1f9-4fc0-b527-87088d7eddf8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1261dd8b-2514-475b-bbbc-7a83ce22c7c0", "address": "fa:16:3e:7f:98:93", "network": {"id": "4d31e03e-697a-44c2-a03e-77eed3dbce43", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-629140279-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "68aabefe0c4340ce8408e386748fa0cf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1261dd8b-25", "ovs_interfaceid": "1261dd8b-2514-475b-bbbc-7a83ce22c7c0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74613) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 29 17:55:50 user nova-compute[74613]: DEBUG nova.network.os_vif_util [None req-22b62f6d-e3f2-427a-b102-fd2f13e24f3f tempest-ServersNegativeTestJSON-1631676891 tempest-ServersNegativeTestJSON-1631676891-project-member] Converting VIF {"id": "1261dd8b-2514-475b-bbbc-7a83ce22c7c0", "address": "fa:16:3e:7f:98:93", "network": {"id": "4d31e03e-697a-44c2-a03e-77eed3dbce43", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-629140279-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "68aabefe0c4340ce8408e386748fa0cf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1261dd8b-25", "ovs_interfaceid": "1261dd8b-2514-475b-bbbc-7a83ce22c7c0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74613) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 17:55:50 user nova-compute[74613]: DEBUG nova.network.os_vif_util [None req-22b62f6d-e3f2-427a-b102-fd2f13e24f3f tempest-ServersNegativeTestJSON-1631676891 tempest-ServersNegativeTestJSON-1631676891-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7f:98:93,bridge_name='br-int',has_traffic_filtering=True,id=1261dd8b-2514-475b-bbbc-7a83ce22c7c0,network=Network(4d31e03e-697a-44c2-a03e-77eed3dbce43),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1261dd8b-25') {{(pid=74613) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 17:55:50 user nova-compute[74613]: DEBUG nova.objects.instance [None req-22b62f6d-e3f2-427a-b102-fd2f13e24f3f tempest-ServersNegativeTestJSON-1631676891 tempest-ServersNegativeTestJSON-1631676891-project-member] Lazy-loading 'pci_devices' on Instance uuid c4bdb712-e1f9-4fc0-b527-87088d7eddf8 {{(pid=74613) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 17:55:50 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-22b62f6d-e3f2-427a-b102-fd2f13e24f3f tempest-ServersNegativeTestJSON-1631676891 tempest-ServersNegativeTestJSON-1631676891-project-member] [instance: c4bdb712-e1f9-4fc0-b527-87088d7eddf8] End _get_guest_xml xml=<domain type="kvm">
Nov 29 17:55:50 user nova-compute[74613]:   <uuid>c4bdb712-e1f9-4fc0-b527-87088d7eddf8</uuid>
Nov 29 17:55:50 user nova-compute[74613]:   <name>instance-0000000f</name>
Nov 29 17:55:50 user nova-compute[74613]:   <memory>524288</memory>
Nov 29 17:55:50 user nova-compute[74613]:   <vcpu>1</vcpu>
Nov 29 17:55:50 user nova-compute[74613]:   <metadata>
Nov 29 17:55:50 user nova-compute[74613]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 29 17:55:50 user nova-compute[74613]:       <nova:package version="0.0.0"/>
Nov 29 17:55:50 user nova-compute[74613]:       <nova:name>tempest-ServersNegativeTestJSON-server-611902795</nova:name>
Nov 29 17:55:50 user nova-compute[74613]:       <nova:creationTime>2023-11-29 17:55:50</nova:creationTime>
Nov 29 17:55:50 user nova-compute[74613]:       <nova:flavor name="m1.tiny">
Nov 29 17:55:50 user nova-compute[74613]:         <nova:memory>512</nova:memory>
Nov 29 17:55:50 user nova-compute[74613]:         <nova:disk>1</nova:disk>
Nov 29 17:55:50 user nova-compute[74613]:         <nova:swap>0</nova:swap>
Nov 29 17:55:50 user nova-compute[74613]:         <nova:ephemeral>0</nova:ephemeral>
Nov 29 17:55:50 user nova-compute[74613]:         <nova:vcpus>1</nova:vcpus>
Nov 29 17:55:50 user nova-compute[74613]:       </nova:flavor>
Nov 29 17:55:50 user nova-compute[74613]:       <nova:owner>
Nov 29 17:55:50 user nova-compute[74613]:         <nova:user uuid="4b4c259dfbf244c6b48374ab04e6d694">tempest-ServersNegativeTestJSON-1631676891-project-member</nova:user>
Nov 29 17:55:50 user nova-compute[74613]:         <nova:project uuid="68aabefe0c4340ce8408e386748fa0cf">tempest-ServersNegativeTestJSON-1631676891</nova:project>
Nov 29 17:55:50 user nova-compute[74613]:       </nova:owner>
Nov 29 17:55:50 user nova-compute[74613]:       <nova:root type="image" uuid="4217f428-8d9d-4ee1-9614-642d26d90c46"/>
Nov 29 17:55:50 user nova-compute[74613]:       <nova:ports>
Nov 29 17:55:50 user nova-compute[74613]:         <nova:port uuid="1261dd8b-2514-475b-bbbc-7a83ce22c7c0">
Nov 29 17:55:50 user nova-compute[74613]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Nov 29 17:55:50 user nova-compute[74613]:         </nova:port>
Nov 29 17:55:50 user nova-compute[74613]:       </nova:ports>
Nov 29 17:55:50 user nova-compute[74613]:     </nova:instance>
Nov 29 17:55:50 user nova-compute[74613]:   </metadata>
Nov 29 17:55:50 user nova-compute[74613]:   <sysinfo type="smbios">
Nov 29 17:55:50 user nova-compute[74613]:     <system>
Nov 29 17:55:50 user nova-compute[74613]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 29 17:55:50 user nova-compute[74613]:       <entry name="product">OpenStack Nova</entry>
Nov 29 17:55:50 user nova-compute[74613]:       <entry name="version">0.0.0</entry>
Nov 29 17:55:50 user nova-compute[74613]:       <entry name="serial">c4bdb712-e1f9-4fc0-b527-87088d7eddf8</entry>
Nov 29 17:55:50 user nova-compute[74613]:       <entry name="uuid">c4bdb712-e1f9-4fc0-b527-87088d7eddf8</entry>
Nov 29 17:55:50 user nova-compute[74613]:       <entry name="family">Virtual Machine</entry>
Nov 29 17:55:50 user nova-compute[74613]:     </system>
Nov 29 17:55:50 user nova-compute[74613]:   </sysinfo>
Nov 29 17:55:50 user nova-compute[74613]:   <os>
Nov 29 17:55:50 user nova-compute[74613]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 29 17:55:50 user nova-compute[74613]:     <boot dev="hd"/>
Nov 29 17:55:50 user nova-compute[74613]:     <smbios mode="sysinfo"/>
Nov 29 17:55:50 user nova-compute[74613]:   </os>
Nov 29 17:55:50 user nova-compute[74613]:   <features>
Nov 29 17:55:50 user nova-compute[74613]:     <acpi/>
Nov 29 17:55:50 user nova-compute[74613]:     <apic/>
Nov 29 17:55:50 user nova-compute[74613]:     <vmcoreinfo/>
Nov 29 17:55:50 user nova-compute[74613]:   </features>
Nov 29 17:55:50 user nova-compute[74613]:   <clock offset="utc">
Nov 29 17:55:50 user nova-compute[74613]:     <timer name="pit" tickpolicy="delay"/>
Nov 29 17:55:50 user nova-compute[74613]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 29 17:55:50 user nova-compute[74613]:     <timer name="hpet" present="no"/>
Nov 29 17:55:50 user nova-compute[74613]:   </clock>
Nov 29 17:55:50 user nova-compute[74613]:   <cpu mode="custom" match="exact">
Nov 29 17:55:50 user nova-compute[74613]:     <model>Nehalem</model>
Nov 29 17:55:50 user nova-compute[74613]:     <topology sockets="1" cores="1" threads="1"/>
Nov 29 17:55:50 user nova-compute[74613]:   </cpu>
Nov 29 17:55:50 user nova-compute[74613]:   <devices>
Nov 29 17:55:50 user nova-compute[74613]:     <disk type="file" device="disk">
Nov 29 17:55:50 user nova-compute[74613]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 29 17:55:50 user nova-compute[74613]:       <source file="/opt/stack/data/nova/instances/c4bdb712-e1f9-4fc0-b527-87088d7eddf8/disk"/>
Nov 29 17:55:50 user nova-compute[74613]:       <target dev="vda" bus="virtio"/>
Nov 29 17:55:50 user nova-compute[74613]:     </disk>
Nov 29 17:55:50 user nova-compute[74613]:     <interface type="ethernet">
Nov 29 17:55:50 user nova-compute[74613]:       <mac address="fa:16:3e:7f:98:93"/>
Nov 29 17:55:50 user nova-compute[74613]:       <model type="virtio"/>
Nov 29 17:55:50 user nova-compute[74613]:       <mtu size="1442"/>
Nov 29 17:55:50 user nova-compute[74613]:       <target dev="tap1261dd8b-25"/>
Nov 29 17:55:50 user nova-compute[74613]:     </interface>
Nov 29 17:55:50 user nova-compute[74613]:     <serial type="pty">
Nov 29 17:55:50 user nova-compute[74613]:       <log file="/opt/stack/data/nova/instances/c4bdb712-e1f9-4fc0-b527-87088d7eddf8/console.log" append="off"/>
Nov 29 17:55:50 user nova-compute[74613]:     </serial>
Nov 29 17:55:50 user nova-compute[74613]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 29 17:55:50 user nova-compute[74613]:     <video>
Nov 29 17:55:50 user nova-compute[74613]:       <model type="virtio"/>
Nov 29 17:55:50 user nova-compute[74613]:     </video>
Nov 29 17:55:50 user nova-compute[74613]:     <rng model="virtio">
Nov 29 17:55:50 user nova-compute[74613]:       <backend model="random">/dev/urandom</backend>
Nov 29 17:55:50 user nova-compute[74613]:     </rng>
Nov 29 17:55:50 user nova-compute[74613]:     <controller type="usb" index="0" model="none"/>
Nov 29 17:55:50 user nova-compute[74613]:     <memballoon model="virtio">
Nov 29 17:55:50 user nova-compute[74613]:       <stats period="10"/>
Nov 29 17:55:50 user nova-compute[74613]:     </memballoon>
Nov 29 17:55:50 user nova-compute[74613]:   </devices>
Nov 29 17:55:50 user nova-compute[74613]: </domain>
Nov 29 17:55:50 user nova-compute[74613]:  {{(pid=74613) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 29 17:55:50 user nova-compute[74613]: DEBUG nova.virt.libvirt.vif [None req-22b62f6d-e3f2-427a-b102-fd2f13e24f3f tempest-ServersNegativeTestJSON-1631676891 tempest-ServersNegativeTestJSON-1631676891-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T17:55:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-611902795',display_name='tempest-ServersNegativeTestJSON-server-611902795',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-611902795',id=15,image_ref='4217f428-8d9d-4ee1-9614-642d26d90c46',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='68aabefe0c4340ce8408e386748fa0cf',ramdisk_id='',reservation_id='r-61eegonr',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='4217f428-8d9d-4ee1-9614-642d26d90c46',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-1631676891',owner_user_name='tempest-ServersNegativeTestJSON-1631676891-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T17:55:49Z,user_data=None,user_id='4b4c259dfbf244c6b48374ab04e6d694',uuid=c4bdb712-e1f9-4fc0-b527-87088d7eddf8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1261dd8b-2514-475b-bbbc-7a83ce22c7c0", "address": "fa:16:3e:7f:98:93", "network": {"id": "4d31e03e-697a-44c2-a03e-77eed3dbce43", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-629140279-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "68aabefe0c4340ce8408e386748fa0cf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1261dd8b-25", "ovs_interfaceid": "1261dd8b-2514-475b-bbbc-7a83ce22c7c0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74613) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 29 17:55:50 user nova-compute[74613]: DEBUG nova.network.os_vif_util [None req-22b62f6d-e3f2-427a-b102-fd2f13e24f3f tempest-ServersNegativeTestJSON-1631676891 tempest-ServersNegativeTestJSON-1631676891-project-member] Converting VIF {"id": "1261dd8b-2514-475b-bbbc-7a83ce22c7c0", "address": "fa:16:3e:7f:98:93", "network": {"id": "4d31e03e-697a-44c2-a03e-77eed3dbce43", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-629140279-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "68aabefe0c4340ce8408e386748fa0cf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1261dd8b-25", "ovs_interfaceid": "1261dd8b-2514-475b-bbbc-7a83ce22c7c0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74613) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 17:55:50 user nova-compute[74613]: DEBUG nova.network.os_vif_util [None req-22b62f6d-e3f2-427a-b102-fd2f13e24f3f tempest-ServersNegativeTestJSON-1631676891 tempest-ServersNegativeTestJSON-1631676891-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7f:98:93,bridge_name='br-int',has_traffic_filtering=True,id=1261dd8b-2514-475b-bbbc-7a83ce22c7c0,network=Network(4d31e03e-697a-44c2-a03e-77eed3dbce43),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1261dd8b-25') {{(pid=74613) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 17:55:50 user nova-compute[74613]: DEBUG os_vif [None req-22b62f6d-e3f2-427a-b102-fd2f13e24f3f tempest-ServersNegativeTestJSON-1631676891 tempest-ServersNegativeTestJSON-1631676891-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:7f:98:93,bridge_name='br-int',has_traffic_filtering=True,id=1261dd8b-2514-475b-bbbc-7a83ce22c7c0,network=Network(4d31e03e-697a-44c2-a03e-77eed3dbce43),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1261dd8b-25') {{(pid=74613) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 29 17:55:50 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:55:50 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74613) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 17:55:50 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74613) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 29 17:55:50 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:55:50 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '96c864a1-b7f4-5faf-932d-5bad3871ffce', '_type': 'linux-noop'}}, row=False) {{(pid=74613) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 17:55:50 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:55:50 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 17:55:50 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:55:50 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap1261dd8b-25, may_exist=True, interface_attrs={}) {{(pid=74613) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 17:55:50 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap1261dd8b-25, col_values=(('qos', UUID('a6c2dbdb-753d-4b2c-9479-539fecf79f71')),), if_exists=True) {{(pid=74613) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 17:55:50 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap1261dd8b-25, col_values=(('external_ids', {'iface-id': '1261dd8b-2514-475b-bbbc-7a83ce22c7c0', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:7f:98:93', 'vm-uuid': 'c4bdb712-e1f9-4fc0-b527-87088d7eddf8'}),), if_exists=True) {{(pid=74613) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 17:55:50 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:55:50 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 17:55:50 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:55:50 user nova-compute[74613]: INFO os_vif [None req-22b62f6d-e3f2-427a-b102-fd2f13e24f3f tempest-ServersNegativeTestJSON-1631676891 tempest-ServersNegativeTestJSON-1631676891-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:7f:98:93,bridge_name='br-int',has_traffic_filtering=True,id=1261dd8b-2514-475b-bbbc-7a83ce22c7c0,network=Network(4d31e03e-697a-44c2-a03e-77eed3dbce43),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1261dd8b-25')
Nov 29 17:55:50 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-22b62f6d-e3f2-427a-b102-fd2f13e24f3f tempest-ServersNegativeTestJSON-1631676891 tempest-ServersNegativeTestJSON-1631676891-project-member] No BDM found with device name vda, not building metadata. {{(pid=74613) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 17:55:50 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-22b62f6d-e3f2-427a-b102-fd2f13e24f3f tempest-ServersNegativeTestJSON-1631676891 tempest-ServersNegativeTestJSON-1631676891-project-member] No VIF found with MAC fa:16:3e:7f:98:93, not building metadata {{(pid=74613) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 29 17:55:51 user nova-compute[74613]: DEBUG nova.network.neutron [req-cd9b0bcf-97b3-4023-a05e-2198398e417b req-81f15292-3d98-4259-aa81-e25c7eb207d1 service nova] [instance: c4bdb712-e1f9-4fc0-b527-87088d7eddf8] Updated VIF entry in instance network info cache for port 1261dd8b-2514-475b-bbbc-7a83ce22c7c0. {{(pid=74613) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 17:55:51 user nova-compute[74613]: DEBUG nova.network.neutron [req-cd9b0bcf-97b3-4023-a05e-2198398e417b req-81f15292-3d98-4259-aa81-e25c7eb207d1 service nova] [instance: c4bdb712-e1f9-4fc0-b527-87088d7eddf8] Updating instance_info_cache with network_info: [{"id": "1261dd8b-2514-475b-bbbc-7a83ce22c7c0", "address": "fa:16:3e:7f:98:93", "network": {"id": "4d31e03e-697a-44c2-a03e-77eed3dbce43", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-629140279-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "68aabefe0c4340ce8408e386748fa0cf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1261dd8b-25", "ovs_interfaceid": "1261dd8b-2514-475b-bbbc-7a83ce22c7c0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74613) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 17:55:51 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-cd9b0bcf-97b3-4023-a05e-2198398e417b req-81f15292-3d98-4259-aa81-e25c7eb207d1 service nova] Releasing lock "refresh_cache-c4bdb712-e1f9-4fc0-b527-87088d7eddf8" {{(pid=74613) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 17:55:52 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:55:52 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:55:52 user nova-compute[74613]: DEBUG nova.compute.manager [req-56e0b38f-c368-4e09-85eb-662fe2541bd6 req-31a34696-f531-47b3-9d03-094b9cb57b4e service nova] [instance: c4bdb712-e1f9-4fc0-b527-87088d7eddf8] Received event network-vif-plugged-1261dd8b-2514-475b-bbbc-7a83ce22c7c0 {{(pid=74613) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 17:55:52 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-56e0b38f-c368-4e09-85eb-662fe2541bd6 req-31a34696-f531-47b3-9d03-094b9cb57b4e service nova] Acquiring lock "c4bdb712-e1f9-4fc0-b527-87088d7eddf8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 17:55:52 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-56e0b38f-c368-4e09-85eb-662fe2541bd6 req-31a34696-f531-47b3-9d03-094b9cb57b4e service nova] Lock "c4bdb712-e1f9-4fc0-b527-87088d7eddf8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 17:55:52 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-56e0b38f-c368-4e09-85eb-662fe2541bd6 req-31a34696-f531-47b3-9d03-094b9cb57b4e service nova] Lock "c4bdb712-e1f9-4fc0-b527-87088d7eddf8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 17:55:52 user nova-compute[74613]: DEBUG nova.compute.manager [req-56e0b38f-c368-4e09-85eb-662fe2541bd6 req-31a34696-f531-47b3-9d03-094b9cb57b4e service nova] [instance: c4bdb712-e1f9-4fc0-b527-87088d7eddf8] No waiting events found dispatching network-vif-plugged-1261dd8b-2514-475b-bbbc-7a83ce22c7c0 {{(pid=74613) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 17:55:52 user nova-compute[74613]: WARNING nova.compute.manager [req-56e0b38f-c368-4e09-85eb-662fe2541bd6 req-31a34696-f531-47b3-9d03-094b9cb57b4e service nova] [instance: c4bdb712-e1f9-4fc0-b527-87088d7eddf8] Received unexpected event network-vif-plugged-1261dd8b-2514-475b-bbbc-7a83ce22c7c0 for instance with vm_state building and task_state spawning.
Nov 29 17:55:53 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:55:53 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:55:53 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:55:53 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:55:54 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:55:54 user nova-compute[74613]: DEBUG nova.compute.manager [None req-22b62f6d-e3f2-427a-b102-fd2f13e24f3f tempest-ServersNegativeTestJSON-1631676891 tempest-ServersNegativeTestJSON-1631676891-project-member] [instance: c4bdb712-e1f9-4fc0-b527-87088d7eddf8] Instance event wait completed in 0 seconds for  {{(pid=74613) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 29 17:55:54 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-22b62f6d-e3f2-427a-b102-fd2f13e24f3f tempest-ServersNegativeTestJSON-1631676891 tempest-ServersNegativeTestJSON-1631676891-project-member] [instance: c4bdb712-e1f9-4fc0-b527-87088d7eddf8] Guest created on hypervisor {{(pid=74613) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 29 17:55:54 user nova-compute[74613]: DEBUG nova.compute.manager [req-97a23cfd-a406-4607-b9f6-d57bc12d4f17 req-43bd1299-3584-4d0b-9bd9-698c3b8744d8 service nova] [instance: c4bdb712-e1f9-4fc0-b527-87088d7eddf8] Received event network-vif-plugged-1261dd8b-2514-475b-bbbc-7a83ce22c7c0 {{(pid=74613) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 17:55:54 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-97a23cfd-a406-4607-b9f6-d57bc12d4f17 req-43bd1299-3584-4d0b-9bd9-698c3b8744d8 service nova] Acquiring lock "c4bdb712-e1f9-4fc0-b527-87088d7eddf8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 17:55:54 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-97a23cfd-a406-4607-b9f6-d57bc12d4f17 req-43bd1299-3584-4d0b-9bd9-698c3b8744d8 service nova] Lock "c4bdb712-e1f9-4fc0-b527-87088d7eddf8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 17:55:54 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-97a23cfd-a406-4607-b9f6-d57bc12d4f17 req-43bd1299-3584-4d0b-9bd9-698c3b8744d8 service nova] Lock "c4bdb712-e1f9-4fc0-b527-87088d7eddf8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 17:55:54 user nova-compute[74613]: DEBUG nova.compute.manager [req-97a23cfd-a406-4607-b9f6-d57bc12d4f17 req-43bd1299-3584-4d0b-9bd9-698c3b8744d8 service nova] [instance: c4bdb712-e1f9-4fc0-b527-87088d7eddf8] No waiting events found dispatching network-vif-plugged-1261dd8b-2514-475b-bbbc-7a83ce22c7c0 {{(pid=74613) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 17:55:54 user nova-compute[74613]: WARNING nova.compute.manager [req-97a23cfd-a406-4607-b9f6-d57bc12d4f17 req-43bd1299-3584-4d0b-9bd9-698c3b8744d8 service nova] [instance: c4bdb712-e1f9-4fc0-b527-87088d7eddf8] Received unexpected event network-vif-plugged-1261dd8b-2514-475b-bbbc-7a83ce22c7c0 for instance with vm_state building and task_state spawning.
Nov 29 17:55:54 user nova-compute[74613]: INFO nova.virt.libvirt.driver [-] [instance: c4bdb712-e1f9-4fc0-b527-87088d7eddf8] Instance spawned successfully.
Nov 29 17:55:54 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-22b62f6d-e3f2-427a-b102-fd2f13e24f3f tempest-ServersNegativeTestJSON-1631676891 tempest-ServersNegativeTestJSON-1631676891-project-member] [instance: c4bdb712-e1f9-4fc0-b527-87088d7eddf8] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74613) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 29 17:55:54 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-22b62f6d-e3f2-427a-b102-fd2f13e24f3f tempest-ServersNegativeTestJSON-1631676891 tempest-ServersNegativeTestJSON-1631676891-project-member] [instance: c4bdb712-e1f9-4fc0-b527-87088d7eddf8] Found default for hw_cdrom_bus of ide {{(pid=74613) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 17:55:54 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-22b62f6d-e3f2-427a-b102-fd2f13e24f3f tempest-ServersNegativeTestJSON-1631676891 tempest-ServersNegativeTestJSON-1631676891-project-member] [instance: c4bdb712-e1f9-4fc0-b527-87088d7eddf8] Found default for hw_disk_bus of virtio {{(pid=74613) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 17:55:54 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-22b62f6d-e3f2-427a-b102-fd2f13e24f3f tempest-ServersNegativeTestJSON-1631676891 tempest-ServersNegativeTestJSON-1631676891-project-member] [instance: c4bdb712-e1f9-4fc0-b527-87088d7eddf8] Found default for hw_input_bus of None {{(pid=74613) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 17:55:54 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-22b62f6d-e3f2-427a-b102-fd2f13e24f3f tempest-ServersNegativeTestJSON-1631676891 tempest-ServersNegativeTestJSON-1631676891-project-member] [instance: c4bdb712-e1f9-4fc0-b527-87088d7eddf8] Found default for hw_pointer_model of None {{(pid=74613) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 17:55:54 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-22b62f6d-e3f2-427a-b102-fd2f13e24f3f tempest-ServersNegativeTestJSON-1631676891 tempest-ServersNegativeTestJSON-1631676891-project-member] [instance: c4bdb712-e1f9-4fc0-b527-87088d7eddf8] Found default for hw_video_model of virtio {{(pid=74613) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 17:55:54 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-22b62f6d-e3f2-427a-b102-fd2f13e24f3f tempest-ServersNegativeTestJSON-1631676891 tempest-ServersNegativeTestJSON-1631676891-project-member] [instance: c4bdb712-e1f9-4fc0-b527-87088d7eddf8] Found default for hw_vif_model of virtio {{(pid=74613) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 17:55:55 user nova-compute[74613]: INFO nova.compute.manager [None req-22b62f6d-e3f2-427a-b102-fd2f13e24f3f tempest-ServersNegativeTestJSON-1631676891 tempest-ServersNegativeTestJSON-1631676891-project-member] [instance: c4bdb712-e1f9-4fc0-b527-87088d7eddf8] Took 6.39 seconds to spawn the instance on the hypervisor.
Nov 29 17:55:55 user nova-compute[74613]: DEBUG nova.compute.manager [None req-22b62f6d-e3f2-427a-b102-fd2f13e24f3f tempest-ServersNegativeTestJSON-1631676891 tempest-ServersNegativeTestJSON-1631676891-project-member] [instance: c4bdb712-e1f9-4fc0-b527-87088d7eddf8] Checking state {{(pid=74613) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 29 17:55:55 user nova-compute[74613]: INFO nova.compute.manager [None req-22b62f6d-e3f2-427a-b102-fd2f13e24f3f tempest-ServersNegativeTestJSON-1631676891 tempest-ServersNegativeTestJSON-1631676891-project-member] [instance: c4bdb712-e1f9-4fc0-b527-87088d7eddf8] Took 7.38 seconds to build instance.
Nov 29 17:55:55 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:55:55 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-22b62f6d-e3f2-427a-b102-fd2f13e24f3f tempest-ServersNegativeTestJSON-1631676891 tempest-ServersNegativeTestJSON-1631676891-project-member] Lock "c4bdb712-e1f9-4fc0-b527-87088d7eddf8" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.561s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 17:55:55 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:55:58 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:56:00 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:56:00 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:56:05 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:56:05 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:56:05 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:56:06 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:56:07 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:56:08 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:56:10 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:56:10 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:56:13 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:56:13 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:56:15 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:56:15 user nova-compute[74613]: DEBUG oslo_service.periodic_task [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74613) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 17:56:15 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:56:15 user nova-compute[74613]: DEBUG oslo_service.periodic_task [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74613) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 17:56:15 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 17:56:15 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 17:56:15 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 17:56:15 user nova-compute[74613]: DEBUG nova.compute.resource_tracker [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Auditing locally available compute resources for user (node: user) {{(pid=74613) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 29 17:56:15 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c19e230e-2e6c-4c20-b15c-ad81a73674b4/disk --force-share --output=json {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 17:56:15 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:56:16 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c19e230e-2e6c-4c20-b15c-ad81a73674b4/disk --force-share --output=json" returned: 0 in 0.206s {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 17:56:16 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c19e230e-2e6c-4c20-b15c-ad81a73674b4/disk --force-share --output=json {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 17:56:16 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c19e230e-2e6c-4c20-b15c-ad81a73674b4/disk --force-share --output=json" returned: 0 in 0.227s {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 17:56:16 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] skipping disk /dev/sdd (vdc) as it is a volume {{(pid=74613) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 29 17:56:16 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c4bdb712-e1f9-4fc0-b527-87088d7eddf8/disk --force-share --output=json {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 17:56:16 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:56:16 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c4bdb712-e1f9-4fc0-b527-87088d7eddf8/disk --force-share --output=json" returned: 0 in 0.252s {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 17:56:16 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c4bdb712-e1f9-4fc0-b527-87088d7eddf8/disk --force-share --output=json {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 17:56:16 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c4bdb712-e1f9-4fc0-b527-87088d7eddf8/disk --force-share --output=json" returned: 0 in 0.250s {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 17:56:16 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b6b0ba36-ad89-45f1-9578-8b999567dd25/disk --force-share --output=json {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 17:56:16 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b6b0ba36-ad89-45f1-9578-8b999567dd25/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 17:56:16 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b6b0ba36-ad89-45f1-9578-8b999567dd25/disk --force-share --output=json {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 17:56:17 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b6b0ba36-ad89-45f1-9578-8b999567dd25/disk --force-share --output=json" returned: 0 in 0.256s {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 17:56:17 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=74613) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 29 17:56:17 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b6b0ba36-ad89-45f1-9578-8b999567dd25/disk.rescue --force-share --output=json {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 17:56:17 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b6b0ba36-ad89-45f1-9578-8b999567dd25/disk.rescue --force-share --output=json" returned: 0 in 0.243s {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 17:56:17 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b6b0ba36-ad89-45f1-9578-8b999567dd25/disk.rescue --force-share --output=json {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 17:56:17 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b6b0ba36-ad89-45f1-9578-8b999567dd25/disk.rescue --force-share --output=json" returned: 0 in 0.223s {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 17:56:17 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/71f2a1ab-3df7-411c-93fa-b0a1a5a44f0a/disk --force-share --output=json {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 17:56:17 user nova-compute[74613]: INFO nova.compute.manager [None req-36693ddb-be8e-4239-91a2-83088b58153a tempest-ServerBootFromVolumeStableRescueTest-414665510 tempest-ServerBootFromVolumeStableRescueTest-414665510-project-member] [instance: cd22685a-028c-4e0c-834d-e7b20f6d06ab] Rescuing
Nov 29 17:56:17 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-36693ddb-be8e-4239-91a2-83088b58153a tempest-ServerBootFromVolumeStableRescueTest-414665510 tempest-ServerBootFromVolumeStableRescueTest-414665510-project-member] Acquiring lock "refresh_cache-cd22685a-028c-4e0c-834d-e7b20f6d06ab" {{(pid=74613) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 17:56:17 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-36693ddb-be8e-4239-91a2-83088b58153a tempest-ServerBootFromVolumeStableRescueTest-414665510 tempest-ServerBootFromVolumeStableRescueTest-414665510-project-member] Acquired lock "refresh_cache-cd22685a-028c-4e0c-834d-e7b20f6d06ab" {{(pid=74613) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 17:56:17 user nova-compute[74613]: DEBUG nova.network.neutron [None req-36693ddb-be8e-4239-91a2-83088b58153a tempest-ServerBootFromVolumeStableRescueTest-414665510 tempest-ServerBootFromVolumeStableRescueTest-414665510-project-member] [instance: cd22685a-028c-4e0c-834d-e7b20f6d06ab] Building network info cache for instance {{(pid=74613) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 29 17:56:17 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/71f2a1ab-3df7-411c-93fa-b0a1a5a44f0a/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 17:56:17 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/71f2a1ab-3df7-411c-93fa-b0a1a5a44f0a/disk --force-share --output=json {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 17:56:18 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/71f2a1ab-3df7-411c-93fa-b0a1a5a44f0a/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 17:56:18 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3b828860-5cc5-40b0-b845-8e560211794e/disk --force-share --output=json {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 17:56:18 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3b828860-5cc5-40b0-b845-8e560211794e/disk --force-share --output=json" returned: 0 in 0.217s {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 17:56:18 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3b828860-5cc5-40b0-b845-8e560211794e/disk --force-share --output=json {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 17:56:18 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3b828860-5cc5-40b0-b845-8e560211794e/disk --force-share --output=json" returned: 0 in 0.223s {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 17:56:18 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/abc9e2b8-f467-4cd0-b40f-de511fde1ec1/disk --force-share --output=json {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 17:56:18 user nova-compute[74613]: DEBUG nova.network.neutron [None req-36693ddb-be8e-4239-91a2-83088b58153a tempest-ServerBootFromVolumeStableRescueTest-414665510 tempest-ServerBootFromVolumeStableRescueTest-414665510-project-member] [instance: cd22685a-028c-4e0c-834d-e7b20f6d06ab] Updating instance_info_cache with network_info: [{"id": "5b08bd65-707e-48a5-800b-dd0670c88d61", "address": "fa:16:3e:28:d8:3d", "network": {"id": "0722b02d-a357-4360-87e8-580913723985", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-579793494-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b820dd795dfe46cd804772f0e71f98e9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5b08bd65-70", "ovs_interfaceid": "5b08bd65-707e-48a5-800b-dd0670c88d61", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74613) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 17:56:18 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-36693ddb-be8e-4239-91a2-83088b58153a tempest-ServerBootFromVolumeStableRescueTest-414665510 tempest-ServerBootFromVolumeStableRescueTest-414665510-project-member] Releasing lock "refresh_cache-cd22685a-028c-4e0c-834d-e7b20f6d06ab" {{(pid=74613) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 17:56:18 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/abc9e2b8-f467-4cd0-b40f-de511fde1ec1/disk --force-share --output=json" returned: 0 in 0.232s {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 17:56:18 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/abc9e2b8-f467-4cd0-b40f-de511fde1ec1/disk --force-share --output=json {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 17:56:18 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:56:18 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:56:19 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/abc9e2b8-f467-4cd0-b40f-de511fde1ec1/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 17:56:19 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:56:19 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:56:19 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74613) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 29 17:56:19 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/74ac9703-1cd7-4983-b7d4-c69b01fec7b2/disk --force-share --output=json {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 17:56:19 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/74ac9703-1cd7-4983-b7d4-c69b01fec7b2/disk --force-share --output=json" returned: 0 in 0.230s {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 17:56:19 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/74ac9703-1cd7-4983-b7d4-c69b01fec7b2/disk --force-share --output=json {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 17:56:19 user nova-compute[74613]: INFO nova.virt.libvirt.driver [-] [instance: cd22685a-028c-4e0c-834d-e7b20f6d06ab] Instance destroyed successfully.
Nov 29 17:56:19 user nova-compute[74613]: INFO nova.virt.libvirt.driver [None req-36693ddb-be8e-4239-91a2-83088b58153a tempest-ServerBootFromVolumeStableRescueTest-414665510 tempest-ServerBootFromVolumeStableRescueTest-414665510-project-member] [instance: cd22685a-028c-4e0c-834d-e7b20f6d06ab] Attempting a stable device rescue
Nov 29 17:56:19 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/74ac9703-1cd7-4983-b7d4-c69b01fec7b2/disk --force-share --output=json" returned: 0 in 0.227s {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 17:56:20 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:56:20 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-36693ddb-be8e-4239-91a2-83088b58153a tempest-ServerBootFromVolumeStableRescueTest-414665510 tempest-ServerBootFromVolumeStableRescueTest-414665510-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=74613) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4318}}
Nov 29 17:56:20 user nova-compute[74613]: WARNING nova.virt.libvirt.driver [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 17:56:20 user nova-compute[74613]: WARNING nova.virt.libvirt.driver [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 17:56:20 user nova-compute[74613]: DEBUG nova.compute.resource_tracker [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Hypervisor/Node resource view: name=user free_ram=7800MB free_disk=25.098148345947266GB free_vcpus=4 pci_devices=[{"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74613) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 29 17:56:20 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 17:56:20 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 17:56:20 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-36693ddb-be8e-4239-91a2-83088b58153a tempest-ServerBootFromVolumeStableRescueTest-414665510 tempest-ServerBootFromVolumeStableRescueTest-414665510-project-member] [instance: cd22685a-028c-4e0c-834d-e7b20f6d06ab] Instance directory exists: not creating {{(pid=74613) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Nov 29 17:56:20 user nova-compute[74613]: INFO nova.virt.libvirt.driver [None req-36693ddb-be8e-4239-91a2-83088b58153a tempest-ServerBootFromVolumeStableRescueTest-414665510 tempest-ServerBootFromVolumeStableRescueTest-414665510-project-member] [instance: cd22685a-028c-4e0c-834d-e7b20f6d06ab] Creating image(s)
Nov 29 17:56:20 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-36693ddb-be8e-4239-91a2-83088b58153a tempest-ServerBootFromVolumeStableRescueTest-414665510 tempest-ServerBootFromVolumeStableRescueTest-414665510-project-member] Acquiring lock "/opt/stack/data/nova/instances/cd22685a-028c-4e0c-834d-e7b20f6d06ab/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 17:56:20 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-36693ddb-be8e-4239-91a2-83088b58153a tempest-ServerBootFromVolumeStableRescueTest-414665510 tempest-ServerBootFromVolumeStableRescueTest-414665510-project-member] Lock "/opt/stack/data/nova/instances/cd22685a-028c-4e0c-834d-e7b20f6d06ab/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 17:56:20 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-36693ddb-be8e-4239-91a2-83088b58153a tempest-ServerBootFromVolumeStableRescueTest-414665510 tempest-ServerBootFromVolumeStableRescueTest-414665510-project-member] Lock "/opt/stack/data/nova/instances/cd22685a-028c-4e0c-834d-e7b20f6d06ab/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 17:56:20 user nova-compute[74613]: DEBUG nova.objects.instance [None req-36693ddb-be8e-4239-91a2-83088b58153a tempest-ServerBootFromVolumeStableRescueTest-414665510 tempest-ServerBootFromVolumeStableRescueTest-414665510-project-member] Lazy-loading 'trusted_certs' on Instance uuid cd22685a-028c-4e0c-834d-e7b20f6d06ab {{(pid=74613) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 17:56:20 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-36693ddb-be8e-4239-91a2-83088b58153a tempest-ServerBootFromVolumeStableRescueTest-414665510 tempest-ServerBootFromVolumeStableRescueTest-414665510-project-member] Acquiring lock "36147db75febd28c17568c36a5e1593865890afd" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 17:56:20 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-36693ddb-be8e-4239-91a2-83088b58153a tempest-ServerBootFromVolumeStableRescueTest-414665510 tempest-ServerBootFromVolumeStableRescueTest-414665510-project-member] Lock "36147db75febd28c17568c36a5e1593865890afd" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 17:56:20 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:56:20 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-1c35b467-29da-44e4-ab94-456aaf4a0f3f tempest-VolumesAdminNegativeTest-636556351 tempest-VolumesAdminNegativeTest-636556351-project-member] Acquiring lock "0aa463c6-01e7-48e5-b082-e083558342e3" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 17:56:20 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-1c35b467-29da-44e4-ab94-456aaf4a0f3f tempest-VolumesAdminNegativeTest-636556351 tempest-VolumesAdminNegativeTest-636556351-project-member] Lock "0aa463c6-01e7-48e5-b082-e083558342e3" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 17:56:20 user nova-compute[74613]: DEBUG nova.compute.manager [None req-1c35b467-29da-44e4-ab94-456aaf4a0f3f tempest-VolumesAdminNegativeTest-636556351 tempest-VolumesAdminNegativeTest-636556351-project-member] [instance: 0aa463c6-01e7-48e5-b082-e083558342e3] Starting instance... {{(pid=74613) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 29 17:56:21 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-36693ddb-be8e-4239-91a2-83088b58153a tempest-ServerBootFromVolumeStableRescueTest-414665510 tempest-ServerBootFromVolumeStableRescueTest-414665510-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/36147db75febd28c17568c36a5e1593865890afd.part --force-share --output=json {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 17:56:21 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:56:21 user nova-compute[74613]: DEBUG nova.compute.resource_tracker [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Instance b6b0ba36-ad89-45f1-9578-8b999567dd25 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74613) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 17:56:21 user nova-compute[74613]: DEBUG nova.compute.resource_tracker [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Instance 3b828860-5cc5-40b0-b845-8e560211794e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74613) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 17:56:21 user nova-compute[74613]: DEBUG nova.compute.resource_tracker [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Instance abc9e2b8-f467-4cd0-b40f-de511fde1ec1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74613) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 17:56:21 user nova-compute[74613]: DEBUG nova.compute.resource_tracker [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Instance cd22685a-028c-4e0c-834d-e7b20f6d06ab actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74613) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 17:56:21 user nova-compute[74613]: DEBUG nova.compute.resource_tracker [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Instance 71f2a1ab-3df7-411c-93fa-b0a1a5a44f0a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74613) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 17:56:21 user nova-compute[74613]: DEBUG nova.compute.resource_tracker [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Instance c19e230e-2e6c-4c20-b15c-ad81a73674b4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74613) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 17:56:21 user nova-compute[74613]: DEBUG nova.compute.resource_tracker [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Instance 74ac9703-1cd7-4983-b7d4-c69b01fec7b2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74613) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 17:56:21 user nova-compute[74613]: DEBUG nova.compute.resource_tracker [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Instance c4bdb712-e1f9-4fc0-b527-87088d7eddf8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74613) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 17:56:21 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-1c35b467-29da-44e4-ab94-456aaf4a0f3f tempest-VolumesAdminNegativeTest-636556351 tempest-VolumesAdminNegativeTest-636556351-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 17:56:21 user nova-compute[74613]: DEBUG nova.compute.resource_tracker [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Instance 0aa463c6-01e7-48e5-b082-e083558342e3 has been scheduled to this compute host, the scheduler has made an allocation against this compute node but the instance has yet to start. Skipping heal of allocation: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74613) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1761}}
Nov 29 17:56:21 user nova-compute[74613]: DEBUG nova.compute.resource_tracker [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Total usable vcpus: 12, total allocated vcpus: 8 {{(pid=74613) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 29 17:56:21 user nova-compute[74613]: DEBUG nova.compute.resource_tracker [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Final resource view: name=user phys_ram=16011MB used_ram=4608MB phys_disk=40GB used_disk=7GB total_vcpus=12 used_vcpus=8 pci_stats=[] {{(pid=74613) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 29 17:56:22 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-36693ddb-be8e-4239-91a2-83088b58153a tempest-ServerBootFromVolumeStableRescueTest-414665510 tempest-ServerBootFromVolumeStableRescueTest-414665510-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/36147db75febd28c17568c36a5e1593865890afd.part --force-share --output=json" returned: 0 in 0.181s {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 17:56:22 user nova-compute[74613]: DEBUG nova.virt.images [None req-36693ddb-be8e-4239-91a2-83088b58153a tempest-ServerBootFromVolumeStableRescueTest-414665510 tempest-ServerBootFromVolumeStableRescueTest-414665510-project-member] be84db6e-7462-4e09-8423-1852d2792774 was qcow2, converting to raw {{(pid=74613) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 29 17:56:22 user nova-compute[74613]: DEBUG nova.privsep.utils [None req-36693ddb-be8e-4239-91a2-83088b58153a tempest-ServerBootFromVolumeStableRescueTest-414665510 tempest-ServerBootFromVolumeStableRescueTest-414665510-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74613) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 29 17:56:22 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-36693ddb-be8e-4239-91a2-83088b58153a tempest-ServerBootFromVolumeStableRescueTest-414665510 tempest-ServerBootFromVolumeStableRescueTest-414665510-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/36147db75febd28c17568c36a5e1593865890afd.part /opt/stack/data/nova/instances/_base/36147db75febd28c17568c36a5e1593865890afd.converted {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 17:56:22 user nova-compute[74613]: DEBUG nova.compute.provider_tree [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Inventory has not changed in ProviderTree for provider: 639d980e-3b12-44b1-b8f4-1812416fa4dd {{(pid=74613) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 17:56:22 user nova-compute[74613]: DEBUG nova.scheduler.client.report [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Inventory has not changed for provider 639d980e-3b12-44b1-b8f4-1812416fa4dd based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74613) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 17:56:22 user nova-compute[74613]: DEBUG nova.compute.resource_tracker [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Compute_service record updated for user:user {{(pid=74613) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 29 17:56:22 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 2.377s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 17:56:22 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-1c35b467-29da-44e4-ab94-456aaf4a0f3f tempest-VolumesAdminNegativeTest-636556351 tempest-VolumesAdminNegativeTest-636556351-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.718s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 17:56:22 user nova-compute[74613]: DEBUG nova.virt.hardware [None req-1c35b467-29da-44e4-ab94-456aaf4a0f3f tempest-VolumesAdminNegativeTest-636556351 tempest-VolumesAdminNegativeTest-636556351-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74613) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 29 17:56:22 user nova-compute[74613]: INFO nova.compute.claims [None req-1c35b467-29da-44e4-ab94-456aaf4a0f3f tempest-VolumesAdminNegativeTest-636556351 tempest-VolumesAdminNegativeTest-636556351-project-member] [instance: 0aa463c6-01e7-48e5-b082-e083558342e3] Claim successful on node user
Nov 29 17:56:22 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-36693ddb-be8e-4239-91a2-83088b58153a tempest-ServerBootFromVolumeStableRescueTest-414665510 tempest-ServerBootFromVolumeStableRescueTest-414665510-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/36147db75febd28c17568c36a5e1593865890afd.part /opt/stack/data/nova/instances/_base/36147db75febd28c17568c36a5e1593865890afd.converted" returned: 0 in 0.774s {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 17:56:22 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-36693ddb-be8e-4239-91a2-83088b58153a tempest-ServerBootFromVolumeStableRescueTest-414665510 tempest-ServerBootFromVolumeStableRescueTest-414665510-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/36147db75febd28c17568c36a5e1593865890afd.converted --force-share --output=json {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 17:56:23 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-36693ddb-be8e-4239-91a2-83088b58153a tempest-ServerBootFromVolumeStableRescueTest-414665510 tempest-ServerBootFromVolumeStableRescueTest-414665510-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/36147db75febd28c17568c36a5e1593865890afd.converted --force-share --output=json" returned: 0 in 0.178s {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 17:56:23 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-36693ddb-be8e-4239-91a2-83088b58153a tempest-ServerBootFromVolumeStableRescueTest-414665510 tempest-ServerBootFromVolumeStableRescueTest-414665510-project-member] Lock "36147db75febd28c17568c36a5e1593865890afd" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 2.665s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 17:56:23 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-36693ddb-be8e-4239-91a2-83088b58153a tempest-ServerBootFromVolumeStableRescueTest-414665510 tempest-ServerBootFromVolumeStableRescueTest-414665510-project-member] Acquiring lock "36147db75febd28c17568c36a5e1593865890afd" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 17:56:23 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-36693ddb-be8e-4239-91a2-83088b58153a tempest-ServerBootFromVolumeStableRescueTest-414665510 tempest-ServerBootFromVolumeStableRescueTest-414665510-project-member] Lock "36147db75febd28c17568c36a5e1593865890afd" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 17:56:23 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-36693ddb-be8e-4239-91a2-83088b58153a tempest-ServerBootFromVolumeStableRescueTest-414665510 tempest-ServerBootFromVolumeStableRescueTest-414665510-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/36147db75febd28c17568c36a5e1593865890afd --force-share --output=json {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 17:56:23 user nova-compute[74613]: DEBUG nova.compute.provider_tree [None req-1c35b467-29da-44e4-ab94-456aaf4a0f3f tempest-VolumesAdminNegativeTest-636556351 tempest-VolumesAdminNegativeTest-636556351-project-member] Inventory has not changed in ProviderTree for provider: 639d980e-3b12-44b1-b8f4-1812416fa4dd {{(pid=74613) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 17:56:23 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-36693ddb-be8e-4239-91a2-83088b58153a tempest-ServerBootFromVolumeStableRescueTest-414665510 tempest-ServerBootFromVolumeStableRescueTest-414665510-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/36147db75febd28c17568c36a5e1593865890afd --force-share --output=json" returned: 0 in 0.185s {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 17:56:23 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-36693ddb-be8e-4239-91a2-83088b58153a tempest-ServerBootFromVolumeStableRescueTest-414665510 tempest-ServerBootFromVolumeStableRescueTest-414665510-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/36147db75febd28c17568c36a5e1593865890afd,backing_fmt=raw /opt/stack/data/nova/instances/cd22685a-028c-4e0c-834d-e7b20f6d06ab/disk.rescue {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 17:56:23 user nova-compute[74613]: DEBUG nova.scheduler.client.report [None req-1c35b467-29da-44e4-ab94-456aaf4a0f3f tempest-VolumesAdminNegativeTest-636556351 tempest-VolumesAdminNegativeTest-636556351-project-member] Inventory has not changed for provider 639d980e-3b12-44b1-b8f4-1812416fa4dd based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74613) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 17:56:23 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-36693ddb-be8e-4239-91a2-83088b58153a tempest-ServerBootFromVolumeStableRescueTest-414665510 tempest-ServerBootFromVolumeStableRescueTest-414665510-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/36147db75febd28c17568c36a5e1593865890afd,backing_fmt=raw /opt/stack/data/nova/instances/cd22685a-028c-4e0c-834d-e7b20f6d06ab/disk.rescue" returned: 0 in 0.059s {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 17:56:23 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-36693ddb-be8e-4239-91a2-83088b58153a tempest-ServerBootFromVolumeStableRescueTest-414665510 tempest-ServerBootFromVolumeStableRescueTest-414665510-project-member] Lock "36147db75febd28c17568c36a5e1593865890afd" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.248s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 17:56:23 user nova-compute[74613]: DEBUG nova.objects.instance [None req-36693ddb-be8e-4239-91a2-83088b58153a tempest-ServerBootFromVolumeStableRescueTest-414665510 tempest-ServerBootFromVolumeStableRescueTest-414665510-project-member] Lazy-loading 'migration_context' on Instance uuid cd22685a-028c-4e0c-834d-e7b20f6d06ab {{(pid=74613) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 17:56:23 user nova-compute[74613]: DEBUG nova.objects.base [None req-36693ddb-be8e-4239-91a2-83088b58153a tempest-ServerBootFromVolumeStableRescueTest-414665510 tempest-ServerBootFromVolumeStableRescueTest-414665510-project-member] Object Instance<cd22685a-028c-4e0c-834d-e7b20f6d06ab> lazy-loaded attributes: trusted_certs,migration_context {{(pid=74613) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 29 17:56:23 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-36693ddb-be8e-4239-91a2-83088b58153a tempest-ServerBootFromVolumeStableRescueTest-414665510 tempest-ServerBootFromVolumeStableRescueTest-414665510-project-member] [instance: cd22685a-028c-4e0c-834d-e7b20f6d06ab] Created local disks {{(pid=74613) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 29 17:56:23 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-36693ddb-be8e-4239-91a2-83088b58153a tempest-ServerBootFromVolumeStableRescueTest-414665510 tempest-ServerBootFromVolumeStableRescueTest-414665510-project-member] [instance: cd22685a-028c-4e0c-834d-e7b20f6d06ab] Start _get_guest_xml network_info=[{"id": "5b08bd65-707e-48a5-800b-dd0670c88d61", "address": "fa:16:3e:28:d8:3d", "network": {"id": "0722b02d-a357-4360-87e8-580913723985", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-579793494-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-579793494-network", "vif_mac": "fa:16:3e:28:d8:3d"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b820dd795dfe46cd804772f0e71f98e9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5b08bd65-70", "ovs_interfaceid": "5b08bd65-707e-48a5-800b-dd0670c88d61", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-29T17:47:38Z,direct_url=<?>,disk_format='qcow2',id=4217f428-8d9d-4ee1-9614-642d26d90c46,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='794b07cbd46a44b5865cfda741036bae',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-29T17:47:40Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': 'be84db6e-7462-4e09-8423-1852d2792774', 'kernel_id': '', 'ramdisk_id': ''} block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:9511387c-8772-40f2-bf2d-6b6387649e9f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XOfkuEgp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, 'status': 'reserved', 'instance': 'cd22685a-028c-4e0c-834d-e7b20f6d06ab', 'attached_at': '', 'detached_at': '', 'volume_id': '9511387c-8772-40f2-bf2d-6b6387649e9f', 'serial': '9511387c-8772-40f2-bf2d-6b6387649e9f'}, 'mount_device': '/dev/vda', 'delete_on_termination': False, 'device_type': 'disk', 'boot_index': 0, 'guest_format': None, 'attachment_id': 'eb56d7f0-712e-400e-92a2-18de7926a154', 'disk_bus': 'virtio', 'volume_type': None} {{(pid=74613) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 29 17:56:23 user nova-compute[74613]: DEBUG nova.objects.instance [None req-36693ddb-be8e-4239-91a2-83088b58153a tempest-ServerBootFromVolumeStableRescueTest-414665510 tempest-ServerBootFromVolumeStableRescueTest-414665510-project-member] Lazy-loading 'resources' on Instance uuid cd22685a-028c-4e0c-834d-e7b20f6d06ab {{(pid=74613) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 17:56:23 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-1c35b467-29da-44e4-ab94-456aaf4a0f3f tempest-VolumesAdminNegativeTest-636556351 tempest-VolumesAdminNegativeTest-636556351-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.629s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 17:56:23 user nova-compute[74613]: DEBUG nova.compute.manager [None req-1c35b467-29da-44e4-ab94-456aaf4a0f3f tempest-VolumesAdminNegativeTest-636556351 tempest-VolumesAdminNegativeTest-636556351-project-member] [instance: 0aa463c6-01e7-48e5-b082-e083558342e3] Start building networks asynchronously for instance. {{(pid=74613) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 29 17:56:23 user nova-compute[74613]: DEBUG nova.objects.base [None req-36693ddb-be8e-4239-91a2-83088b58153a tempest-ServerBootFromVolumeStableRescueTest-414665510 tempest-ServerBootFromVolumeStableRescueTest-414665510-project-member] Object Instance<cd22685a-028c-4e0c-834d-e7b20f6d06ab> lazy-loaded attributes: trusted_certs,migration_context,resources {{(pid=74613) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 29 17:56:23 user nova-compute[74613]: DEBUG nova.objects.instance [None req-36693ddb-be8e-4239-91a2-83088b58153a tempest-ServerBootFromVolumeStableRescueTest-414665510 tempest-ServerBootFromVolumeStableRescueTest-414665510-project-member] Lazy-loading 'numa_topology' on Instance uuid cd22685a-028c-4e0c-834d-e7b20f6d06ab {{(pid=74613) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 17:56:23 user nova-compute[74613]: DEBUG nova.objects.base [None req-36693ddb-be8e-4239-91a2-83088b58153a tempest-ServerBootFromVolumeStableRescueTest-414665510 tempest-ServerBootFromVolumeStableRescueTest-414665510-project-member] Object Instance<cd22685a-028c-4e0c-834d-e7b20f6d06ab> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology {{(pid=74613) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 29 17:56:23 user nova-compute[74613]: WARNING nova.virt.libvirt.driver [None req-36693ddb-be8e-4239-91a2-83088b58153a tempest-ServerBootFromVolumeStableRescueTest-414665510 tempest-ServerBootFromVolumeStableRescueTest-414665510-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 17:56:23 user nova-compute[74613]: WARNING nova.virt.libvirt.driver [None req-36693ddb-be8e-4239-91a2-83088b58153a tempest-ServerBootFromVolumeStableRescueTest-414665510 tempest-ServerBootFromVolumeStableRescueTest-414665510-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 17:56:23 user nova-compute[74613]: DEBUG nova.virt.libvirt.host [None req-36693ddb-be8e-4239-91a2-83088b58153a tempest-ServerBootFromVolumeStableRescueTest-414665510 tempest-ServerBootFromVolumeStableRescueTest-414665510-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74613) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 29 17:56:23 user nova-compute[74613]: DEBUG nova.virt.libvirt.host [None req-36693ddb-be8e-4239-91a2-83088b58153a tempest-ServerBootFromVolumeStableRescueTest-414665510 tempest-ServerBootFromVolumeStableRescueTest-414665510-project-member] CPU controller missing on host. {{(pid=74613) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 29 17:56:23 user nova-compute[74613]: DEBUG nova.virt.libvirt.host [None req-36693ddb-be8e-4239-91a2-83088b58153a tempest-ServerBootFromVolumeStableRescueTest-414665510 tempest-ServerBootFromVolumeStableRescueTest-414665510-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74613) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 29 17:56:23 user nova-compute[74613]: DEBUG nova.virt.libvirt.host [None req-36693ddb-be8e-4239-91a2-83088b58153a tempest-ServerBootFromVolumeStableRescueTest-414665510 tempest-ServerBootFromVolumeStableRescueTest-414665510-project-member] CPU controller found on host. {{(pid=74613) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 29 17:56:23 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-36693ddb-be8e-4239-91a2-83088b58153a tempest-ServerBootFromVolumeStableRescueTest-414665510 tempest-ServerBootFromVolumeStableRescueTest-414665510-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74613) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 29 17:56:23 user nova-compute[74613]: DEBUG nova.virt.hardware [None req-36693ddb-be8e-4239-91a2-83088b58153a tempest-ServerBootFromVolumeStableRescueTest-414665510 tempest-ServerBootFromVolumeStableRescueTest-414665510-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-29T17:47:27Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-29T17:47:38Z,direct_url=<?>,disk_format='qcow2',id=4217f428-8d9d-4ee1-9614-642d26d90c46,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='794b07cbd46a44b5865cfda741036bae',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-29T17:47:40Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74613) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 29 17:56:23 user nova-compute[74613]: DEBUG nova.virt.hardware [None req-36693ddb-be8e-4239-91a2-83088b58153a tempest-ServerBootFromVolumeStableRescueTest-414665510 tempest-ServerBootFromVolumeStableRescueTest-414665510-project-member] Flavor limits 0:0:0 {{(pid=74613) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 29 17:56:23 user nova-compute[74613]: DEBUG nova.virt.hardware [None req-36693ddb-be8e-4239-91a2-83088b58153a tempest-ServerBootFromVolumeStableRescueTest-414665510 tempest-ServerBootFromVolumeStableRescueTest-414665510-project-member] Image limits 0:0:0 {{(pid=74613) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 29 17:56:23 user nova-compute[74613]: DEBUG nova.virt.hardware [None req-36693ddb-be8e-4239-91a2-83088b58153a tempest-ServerBootFromVolumeStableRescueTest-414665510 tempest-ServerBootFromVolumeStableRescueTest-414665510-project-member] Flavor pref 0:0:0 {{(pid=74613) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 29 17:56:23 user nova-compute[74613]: DEBUG nova.virt.hardware [None req-36693ddb-be8e-4239-91a2-83088b58153a tempest-ServerBootFromVolumeStableRescueTest-414665510 tempest-ServerBootFromVolumeStableRescueTest-414665510-project-member] Image pref 0:0:0 {{(pid=74613) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 29 17:56:23 user nova-compute[74613]: DEBUG nova.virt.hardware [None req-36693ddb-be8e-4239-91a2-83088b58153a tempest-ServerBootFromVolumeStableRescueTest-414665510 tempest-ServerBootFromVolumeStableRescueTest-414665510-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74613) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 29 17:56:23 user nova-compute[74613]: DEBUG nova.virt.hardware [None req-36693ddb-be8e-4239-91a2-83088b58153a tempest-ServerBootFromVolumeStableRescueTest-414665510 tempest-ServerBootFromVolumeStableRescueTest-414665510-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74613) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 29 17:56:23 user nova-compute[74613]: DEBUG nova.virt.hardware [None req-36693ddb-be8e-4239-91a2-83088b58153a tempest-ServerBootFromVolumeStableRescueTest-414665510 tempest-ServerBootFromVolumeStableRescueTest-414665510-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74613) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 29 17:56:23 user nova-compute[74613]: DEBUG nova.virt.hardware [None req-36693ddb-be8e-4239-91a2-83088b58153a tempest-ServerBootFromVolumeStableRescueTest-414665510 tempest-ServerBootFromVolumeStableRescueTest-414665510-project-member] Got 1 possible topologies {{(pid=74613) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 29 17:56:23 user nova-compute[74613]: DEBUG nova.virt.hardware [None req-36693ddb-be8e-4239-91a2-83088b58153a tempest-ServerBootFromVolumeStableRescueTest-414665510 tempest-ServerBootFromVolumeStableRescueTest-414665510-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74613) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 29 17:56:23 user nova-compute[74613]: DEBUG nova.virt.hardware [None req-36693ddb-be8e-4239-91a2-83088b58153a tempest-ServerBootFromVolumeStableRescueTest-414665510 tempest-ServerBootFromVolumeStableRescueTest-414665510-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74613) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 29 17:56:23 user nova-compute[74613]: DEBUG nova.objects.instance [None req-36693ddb-be8e-4239-91a2-83088b58153a tempest-ServerBootFromVolumeStableRescueTest-414665510 tempest-ServerBootFromVolumeStableRescueTest-414665510-project-member] Lazy-loading 'vcpu_model' on Instance uuid cd22685a-028c-4e0c-834d-e7b20f6d06ab {{(pid=74613) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 17:56:23 user nova-compute[74613]: DEBUG nova.objects.base [None req-36693ddb-be8e-4239-91a2-83088b58153a tempest-ServerBootFromVolumeStableRescueTest-414665510 tempest-ServerBootFromVolumeStableRescueTest-414665510-project-member] Object Instance<cd22685a-028c-4e0c-834d-e7b20f6d06ab> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model {{(pid=74613) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 29 17:56:23 user nova-compute[74613]: DEBUG nova.virt.libvirt.volume.iscsi [None req-36693ddb-be8e-4239-91a2-83088b58153a tempest-ServerBootFromVolumeStableRescueTest-414665510 tempest-ServerBootFromVolumeStableRescueTest-414665510-project-member] [instance: cd22685a-028c-4e0c-834d-e7b20f6d06ab] Calling os-brick to attach iSCSI Volume {{(pid=74613) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 29 17:56:23 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-36693ddb-be8e-4239-91a2-83088b58153a tempest-ServerBootFromVolumeStableRescueTest-414665510 tempest-ServerBootFromVolumeStableRescueTest-414665510-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff828156890>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:9511387c-8772-40f2-bf2d-6b6387649e9f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XOfkuEgp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=74613) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 17:56:23 user nova-compute[74613]: WARNING os_brick.initiator.connectors.base [None req-36693ddb-be8e-4239-91a2-83088b58153a tempest-ServerBootFromVolumeStableRescueTest-414665510 tempest-ServerBootFromVolumeStableRescueTest-414665510-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 17:56:23 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.base [None req-36693ddb-be8e-4239-91a2-83088b58153a tempest-ServerBootFromVolumeStableRescueTest-414665510 tempest-ServerBootFromVolumeStableRescueTest-414665510-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 17:56:23 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.base [None req-36693ddb-be8e-4239-91a2-83088b58153a tempest-ServerBootFromVolumeStableRescueTest-414665510 tempest-ServerBootFromVolumeStableRescueTest-414665510-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 17:56:23 user nova-compute[74613]: WARNING os_brick.initiator.connectors.base [None req-36693ddb-be8e-4239-91a2-83088b58153a tempest-ServerBootFromVolumeStableRescueTest-414665510 tempest-ServerBootFromVolumeStableRescueTest-414665510-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 17:56:23 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.base [None req-36693ddb-be8e-4239-91a2-83088b58153a tempest-ServerBootFromVolumeStableRescueTest-414665510 tempest-ServerBootFromVolumeStableRescueTest-414665510-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9511387c-8772-40f2-bf2d-6b6387649e9f" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 17:56:23 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.base [None req-36693ddb-be8e-4239-91a2-83088b58153a tempest-ServerBootFromVolumeStableRescueTest-414665510 tempest-ServerBootFromVolumeStableRescueTest-414665510-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9511387c-8772-40f2-bf2d-6b6387649e9f" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 17:56:23 user nova-compute[74613]: INFO os_brick.initiator.connectors.iscsi [None req-36693ddb-be8e-4239-91a2-83088b58153a tempest-ServerBootFromVolumeStableRescueTest-414665510 tempest-ServerBootFromVolumeStableRescueTest-414665510-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 29 17:56:23 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9511387c-8772-40f2-bf2d-6b6387649e9f -p 172.16.0.220:3260 {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 17:56:23 user nova-compute[74613]: DEBUG nova.compute.manager [None req-1c35b467-29da-44e4-ab94-456aaf4a0f3f tempest-VolumesAdminNegativeTest-636556351 tempest-VolumesAdminNegativeTest-636556351-project-member] [instance: 0aa463c6-01e7-48e5-b082-e083558342e3] Allocating IP information in the background. {{(pid=74613) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 29 17:56:23 user nova-compute[74613]: DEBUG nova.network.neutron [None req-1c35b467-29da-44e4-ab94-456aaf4a0f3f tempest-VolumesAdminNegativeTest-636556351 tempest-VolumesAdminNegativeTest-636556351-project-member] [instance: 0aa463c6-01e7-48e5-b082-e083558342e3] allocate_for_instance() {{(pid=74613) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 29 17:56:23 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9511387c-8772-40f2-bf2d-6b6387649e9f -p 172.16.0.220:3260" returned: 0 in 0.017s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 17:56:23 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[888e91f5-a23f-4cd2-8230-7b8ba757c96c]: (4, ('# BEGIN RECORD 2.1.5\nnode.name = iqn.2010-10.org.openstack:9511387c-8772-40f2-bf2d-6b6387649e9f\nnode.tpgt = -1\nnode.startup = automatic\nnode.leading_login = No\niface.iscsi_ifacename = default\niface.net_ifacename = <empty>\niface.ipaddress = <empty>\niface.prefix_len = 0\niface.hwaddress = <empty>\niface.transport_name = tcp\niface.initiatorname = <empty>\niface.state = <empty>\niface.vlan_id = 0\niface.vlan_priority = 0\niface.vlan_state = <empty>\niface.iface_num = 0\niface.mtu = 0\niface.port = 0\niface.bootproto = <empty>\niface.subnet_mask = <empty>\niface.gateway = <empty>\niface.dhcp_alt_client_id_state = <empty>\niface.dhcp_alt_client_id = <empty>\niface.dhcp_dns = <empty>\niface.dhcp_learn_iqn = <empty>\niface.dhcp_req_vendor_id_state = <empty>\niface.dhcp_vendor_id_state = <empty>\niface.dhcp_vendor_id = <empty>\niface.dhcp_slp_da = <empty>\niface.fragmentation = <empty>\niface.gratuitous_arp = <empty>\niface.incoming_forwarding = <empty>\niface.tos_state = <empty>\niface.tos = 0\niface.ttl = 0\niface.delayed_ack = <empty>\niface.tcp_nagle = <empty>\niface.tcp_wsf_state = <empty>\niface.tcp_wsf = 0\niface.tcp_timer_scale = 0\niface.tcp_timestamp = <empty>\niface.redirect = <empty>\niface.def_task_mgmt_timeout = 0\niface.header_digest = <empty>\niface.data_digest = <empty>\niface.immediate_data = <empty>\niface.initial_r2t = <empty>\niface.data_seq_inorder = <empty>\niface.data_pdu_inorder = <empty>\niface.erl = 0\niface.max_receive_data_len = 0\niface.first_burst_len = 0\niface.max_outstanding_r2t = 0\niface.max_burst_len = 0\niface.chap_auth = <empty>\niface.bidi_chap = <empty>\niface.strict_login_compliance = <empty>\niface.discovery_auth = <empty>\niface.discovery_logout = <empty>\nnode.discovery_address = <empty>\nnode.discovery_port = 0\nnode.discovery_type = static\nnode.session.initial_cmdsn = 0\nnode.session.initial_login_retry_max = 8\nnode.session.xmit_thread_priority = -20\nnode.session.cmds_max = 128\nnode.session.queue_depth = 32\nnode.session.nr_sessions = 1\nnode.session.auth.authmethod = CHAP\nnode.session.auth.username = XOfkuEgp\nnode.session.auth.password = ********\nnode.session.auth.username_in = <empty>\nnode.session.auth.password_in = <empty>\nnode.session.auth.chap_algs = MD5\nnode.session.timeo.replacement_timeout = 120\nnode.session.err_timeo.abort_timeout = 15\nnode.session.err_timeo.lu_reset_timeout = 30\nnode.session.err_timeo.tgt_reset_timeout = 30\nnode.session.err_timeo.host_reset_timeout = 60\nnode.session.iscsi.FastAbort = Yes\nnode.session.iscsi.InitialR2T = No\nnode.session.iscsi.ImmediateData = Yes\nnode.session.iscsi.FirstBurstLength = 262144\nnode.session.iscsi.MaxBurstLength = 16776192\nnode.session.iscsi.DefaultTime2Retain = 0\nnode.session.iscsi.DefaultTime2Wait = 2\nnode.session.iscsi.MaxConnections = 1\nnode.session.iscsi.MaxOutstandingR2T = 1\nnode.session.iscsi.ERL = 0\nnode.session.scan = manual\nnode.session.reopen_max = 0\nnode.conn[0].address = 172.16.0.220\nnode.conn[0].port = 3260\nnode.conn[0].startup = manual\nnode.conn[0].tcp.window_size = 524288\nnode.conn[0].tcp.type_of_service = 0\nnode.conn[0].timeo.logout_timeout = 15\nnode.conn[0].timeo.login_timeout = 15\nnode.conn[0].timeo.auth_timeout = 45\nnode.conn[0].timeo.noop_out_interval = 5\nnode.conn[0].timeo.noop_out_timeout = 5\nnode.conn[0].iscsi.MaxXmitDataSegmentLength = 0\nnode.conn[0].iscsi.MaxRecvDataSegmentLength = 262144\nnode.conn[0].iscsi.HeaderDigest = None\nnode.conn[0].iscsi.DataDigest = None\nnode.conn[0].iscsi.IFMarker = No\nnode.conn[0].iscsi.OFMarker = No\n# END RECORD\n', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 17:56:23 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-36693ddb-be8e-4239-91a2-83088b58153a tempest-ServerBootFromVolumeStableRescueTest-414665510 tempest-ServerBootFromVolumeStableRescueTest-414665510-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.5
Nov 29 17:56:23 user nova-compute[74613]: node.name = iqn.2010-10.org.openstack:9511387c-8772-40f2-bf2d-6b6387649e9f
Nov 29 17:56:23 user nova-compute[74613]: node.tpgt = -1
Nov 29 17:56:23 user nova-compute[74613]: node.startup = automatic
Nov 29 17:56:23 user nova-compute[74613]: node.leading_login = No
Nov 29 17:56:23 user nova-compute[74613]: iface.iscsi_ifacename = default
Nov 29 17:56:23 user nova-compute[74613]: iface.net_ifacename = <empty>
Nov 29 17:56:23 user nova-compute[74613]: iface.ipaddress = <empty>
Nov 29 17:56:23 user nova-compute[74613]: iface.prefix_len = 0
Nov 29 17:56:23 user nova-compute[74613]: iface.hwaddress = <empty>
Nov 29 17:56:23 user nova-compute[74613]: iface.transport_name = tcp
Nov 29 17:56:23 user nova-compute[74613]: iface.initiatorname = <empty>
Nov 29 17:56:23 user nova-compute[74613]: iface.state = <empty>
Nov 29 17:56:23 user nova-compute[74613]: iface.vlan_id = 0
Nov 29 17:56:23 user nova-compute[74613]: iface.vlan_priority = 0
Nov 29 17:56:23 user nova-compute[74613]: iface.vlan_state = <empty>
Nov 29 17:56:23 user nova-compute[74613]: iface.iface_num = 0
Nov 29 17:56:23 user nova-compute[74613]: iface.mtu = 0
Nov 29 17:56:23 user nova-compute[74613]: iface.port = 0
Nov 29 17:56:23 user nova-compute[74613]: iface.bootproto = <empty>
Nov 29 17:56:23 user nova-compute[74613]: iface.subnet_mask = <empty>
Nov 29 17:56:23 user nova-compute[74613]: iface.gateway = <empty>
Nov 29 17:56:23 user nova-compute[74613]: iface.dhcp_alt_client_id_state = <empty>
Nov 29 17:56:23 user nova-compute[74613]: iface.dhcp_alt_client_id = <empty>
Nov 29 17:56:23 user nova-compute[74613]: iface.dhcp_dns = <empty>
Nov 29 17:56:23 user nova-compute[74613]: iface.dhcp_learn_iqn = <empty>
Nov 29 17:56:23 user nova-compute[74613]: iface.dhcp_req_vendor_id_state = <empty>
Nov 29 17:56:23 user nova-compute[74613]: iface.dhcp_vendor_id_state = <empty>
Nov 29 17:56:23 user nova-compute[74613]: iface.dhcp_vendor_id = <empty>
Nov 29 17:56:23 user nova-compute[74613]: iface.dhcp_slp_da = <empty>
Nov 29 17:56:23 user nova-compute[74613]: iface.fragmentation = <empty>
Nov 29 17:56:23 user nova-compute[74613]: iface.gratuitous_arp = <empty>
Nov 29 17:56:23 user nova-compute[74613]: iface.incoming_forwarding = <empty>
Nov 29 17:56:23 user nova-compute[74613]: iface.tos_state = <empty>
Nov 29 17:56:23 user nova-compute[74613]: iface.tos = 0
Nov 29 17:56:23 user nova-compute[74613]: iface.ttl = 0
Nov 29 17:56:23 user nova-compute[74613]: iface.delayed_ack = <empty>
Nov 29 17:56:23 user nova-compute[74613]: iface.tcp_nagle = <empty>
Nov 29 17:56:23 user nova-compute[74613]: iface.tcp_wsf_state = <empty>
Nov 29 17:56:23 user nova-compute[74613]: iface.tcp_wsf = 0
Nov 29 17:56:23 user nova-compute[74613]: iface.tcp_timer_scale = 0
Nov 29 17:56:23 user nova-compute[74613]: iface.tcp_timestamp = <empty>
Nov 29 17:56:23 user nova-compute[74613]: iface.redirect = <empty>
Nov 29 17:56:23 user nova-compute[74613]: iface.def_task_mgmt_timeout = 0
Nov 29 17:56:23 user nova-compute[74613]: iface.header_digest = <empty>
Nov 29 17:56:23 user nova-compute[74613]: iface.data_digest = <empty>
Nov 29 17:56:23 user nova-compute[74613]: iface.immediate_data = <empty>
Nov 29 17:56:23 user nova-compute[74613]: iface.initial_r2t = <empty>
Nov 29 17:56:23 user nova-compute[74613]: iface.data_seq_inorder = <empty>
Nov 29 17:56:23 user nova-compute[74613]: iface.data_pdu_inorder = <empty>
Nov 29 17:56:23 user nova-compute[74613]: iface.erl = 0
Nov 29 17:56:23 user nova-compute[74613]: iface.max_receive_data_len = 0
Nov 29 17:56:23 user nova-compute[74613]: iface.first_burst_len = 0
Nov 29 17:56:23 user nova-compute[74613]: iface.max_outstanding_r2t = 0
Nov 29 17:56:23 user nova-compute[74613]: iface.max_burst_len = 0
Nov 29 17:56:23 user nova-compute[74613]: iface.chap_auth = <empty>
Nov 29 17:56:23 user nova-compute[74613]: iface.bidi_chap = <empty>
Nov 29 17:56:23 user nova-compute[74613]: iface.strict_login_compliance = <empty>
Nov 29 17:56:23 user nova-compute[74613]: iface.discovery_auth = <empty>
Nov 29 17:56:23 user nova-compute[74613]: iface.discovery_logout = <empty>
Nov 29 17:56:23 user nova-compute[74613]: node.discovery_address = <empty>
Nov 29 17:56:23 user nova-compute[74613]: node.discovery_port = 0
Nov 29 17:56:23 user nova-compute[74613]: node.discovery_type = static
Nov 29 17:56:23 user nova-compute[74613]: node.session.initial_cmdsn = 0
Nov 29 17:56:23 user nova-compute[74613]: node.session.initial_login_retry_max = 8
Nov 29 17:56:23 user nova-compute[74613]: node.session.xmit_thread_priority = -20
Nov 29 17:56:23 user nova-compute[74613]: node.session.cmds_max = 128
Nov 29 17:56:23 user nova-compute[74613]: node.session.queue_depth = 32
Nov 29 17:56:23 user nova-compute[74613]: node.session.nr_sessions = 1
Nov 29 17:56:23 user nova-compute[74613]: node.session.auth.authmethod = CHAP
Nov 29 17:56:23 user nova-compute[74613]: node.session.auth.username = XOfkuEgp
Nov 29 17:56:23 user nova-compute[74613]: node.session.auth.password = ***
Nov 29 17:56:23 user nova-compute[74613]: node.session.auth.username_in = <empty>
Nov 29 17:56:23 user nova-compute[74613]: node.session.auth.password_in = <empty>
Nov 29 17:56:23 user nova-compute[74613]: node.session.auth.chap_algs = MD5
Nov 29 17:56:23 user nova-compute[74613]: node.session.timeo.replacement_timeout = 120
Nov 29 17:56:23 user nova-compute[74613]: node.session.err_timeo.abort_timeout = 15
Nov 29 17:56:23 user nova-compute[74613]: node.session.err_timeo.lu_reset_timeout = 30
Nov 29 17:56:23 user nova-compute[74613]: node.session.err_timeo.tgt_reset_timeout = 30
Nov 29 17:56:23 user nova-compute[74613]: node.session.err_timeo.host_reset_timeout = 60
Nov 29 17:56:23 user nova-compute[74613]: node.session.iscsi.FastAbort = Yes
Nov 29 17:56:23 user nova-compute[74613]: node.session.iscsi.InitialR2T = No
Nov 29 17:56:23 user nova-compute[74613]: node.session.iscsi.ImmediateData = Yes
Nov 29 17:56:23 user nova-compute[74613]: node.session.iscsi.FirstBurstLength = 262144
Nov 29 17:56:23 user nova-compute[74613]: node.session.iscsi.MaxBurstLength = 16776192
Nov 29 17:56:23 user nova-compute[74613]: node.session.iscsi.DefaultTime2Retain = 0
Nov 29 17:56:23 user nova-compute[74613]: node.session.iscsi.DefaultTime2Wait = 2
Nov 29 17:56:23 user nova-compute[74613]: node.session.iscsi.MaxConnections = 1
Nov 29 17:56:23 user nova-compute[74613]: node.session.iscsi.MaxOutstandingR2T = 1
Nov 29 17:56:23 user nova-compute[74613]: node.session.iscsi.ERL = 0
Nov 29 17:56:23 user nova-compute[74613]: node.session.scan = manual
Nov 29 17:56:23 user nova-compute[74613]: node.session.reopen_max = 0
Nov 29 17:56:23 user nova-compute[74613]: node.conn[0].address = 172.16.0.220
Nov 29 17:56:23 user nova-compute[74613]: node.conn[0].port = 3260
Nov 29 17:56:23 user nova-compute[74613]: node.conn[0].startup = manual
Nov 29 17:56:23 user nova-compute[74613]: node.conn[0].tcp.window_size = 524288
Nov 29 17:56:23 user nova-compute[74613]: node.conn[0].tcp.type_of_service = 0
Nov 29 17:56:23 user nova-compute[74613]: node.conn[0].timeo.logout_timeout = 15
Nov 29 17:56:23 user nova-compute[74613]: node.conn[0].timeo.login_timeout = 15
Nov 29 17:56:23 user nova-compute[74613]: node.conn[0].timeo.auth_timeout = 45
Nov 29 17:56:23 user nova-compute[74613]: node.conn[0].timeo.noop_out_interval = 5
Nov 29 17:56:23 user nova-compute[74613]: node.conn[0].timeo.noop_out_timeout = 5
Nov 29 17:56:23 user nova-compute[74613]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Nov 29 17:56:23 user nova-compute[74613]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Nov 29 17:56:23 user nova-compute[74613]: node.conn[0].iscsi.HeaderDigest = None
Nov 29 17:56:23 user nova-compute[74613]: node.conn[0].iscsi.DataDigest = None
Nov 29 17:56:23 user nova-compute[74613]: node.conn[0].iscsi.IFMarker = No
Nov 29 17:56:23 user nova-compute[74613]: node.conn[0].iscsi.OFMarker = No
Nov 29 17:56:23 user nova-compute[74613]: # END RECORD
Nov 29 17:56:23 user nova-compute[74613]:  stderr= {{(pid=74613) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 17:56:23 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9511387c-8772-40f2-bf2d-6b6387649e9f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 17:56:23 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9511387c-8772-40f2-bf2d-6b6387649e9f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.146s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 17:56:23 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[f42d9fd1-e2fa-4343-97f0-72ec9d5d0d83]: (4, ('', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 17:56:23 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-36693ddb-be8e-4239-91a2-83088b58153a tempest-ServerBootFromVolumeStableRescueTest-414665510 tempest-ServerBootFromVolumeStableRescueTest-414665510-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74613) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 17:56:23 user nova-compute[74613]: INFO nova.virt.libvirt.driver [None req-1c35b467-29da-44e4-ab94-456aaf4a0f3f tempest-VolumesAdminNegativeTest-636556351 tempest-VolumesAdminNegativeTest-636556351-project-member] [instance: 0aa463c6-01e7-48e5-b082-e083558342e3] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 29 17:56:23 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9511387c-8772-40f2-bf2d-6b6387649e9f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 17:56:23 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9511387c-8772-40f2-bf2d-6b6387649e9f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 17:56:23 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e706dd4-7776-4158-a627-6844389fcc38]: (4, ('', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 17:56:23 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-36693ddb-be8e-4239-91a2-83088b58153a tempest-ServerBootFromVolumeStableRescueTest-414665510 tempest-ServerBootFromVolumeStableRescueTest-414665510-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74613) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 17:56:23 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9511387c-8772-40f2-bf2d-6b6387649e9f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v XOfkuEgp {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 17:56:23 user nova-compute[74613]: DEBUG nova.compute.manager [None req-1c35b467-29da-44e4-ab94-456aaf4a0f3f tempest-VolumesAdminNegativeTest-636556351 tempest-VolumesAdminNegativeTest-636556351-project-member] [instance: 0aa463c6-01e7-48e5-b082-e083558342e3] Start building block device mappings for instance. {{(pid=74613) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 29 17:56:23 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9511387c-8772-40f2-bf2d-6b6387649e9f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v XOfkuEgp" returned: 0 in 0.032s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 17:56:23 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c4e3424-4bb4-44b2-8f0a-7edeaf281acc]: (4, ('', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 17:56:23 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-36693ddb-be8e-4239-91a2-83088b58153a tempest-ServerBootFromVolumeStableRescueTest-414665510 tempest-ServerBootFromVolumeStableRescueTest-414665510-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'XOfkuEgp'): stdout= stderr= {{(pid=74613) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 17:56:23 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9511387c-8772-40f2-bf2d-6b6387649e9f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 17:56:23 user nova-compute[74613]: DEBUG oslo_service.periodic_task [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74613) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 17:56:23 user nova-compute[74613]: DEBUG oslo_service.periodic_task [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74613) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 17:56:23 user nova-compute[74613]: DEBUG nova.compute.manager [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Starting heal instance info cache {{(pid=74613) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 29 17:56:23 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9511387c-8772-40f2-bf2d-6b6387649e9f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.031s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 17:56:23 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[6bfe8ec4-16db-4cb2-bcd5-28d3ffc83ee4]: (4, ('', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 17:56:23 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-36693ddb-be8e-4239-91a2-83088b58153a tempest-ServerBootFromVolumeStableRescueTest-414665510 tempest-ServerBootFromVolumeStableRescueTest-414665510-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74613) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 17:56:23 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 17:56:23 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 17:56:23 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[75b61e0a-db5e-41b1-93f9-1e895cc82f72]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9511387c-8772-40f2-bf2d-6b6387649e9f (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:070b1031-e105-4cba-a039-2286e23727c5 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00ec83b4-5d84-416a-bad9-7511171a9da0 (non-flash)\n', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 17:56:23 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-36693ddb-be8e-4239-91a2-83088b58153a tempest-ServerBootFromVolumeStableRescueTest-414665510 tempest-ServerBootFromVolumeStableRescueTest-414665510-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9511387c-8772-40f2-bf2d-6b6387649e9f (non-flash)
Nov 29 17:56:23 user nova-compute[74613]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:070b1031-e105-4cba-a039-2286e23727c5 (non-flash)
Nov 29 17:56:23 user nova-compute[74613]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00ec83b4-5d84-416a-bad9-7511171a9da0 (non-flash)
Nov 29 17:56:23 user nova-compute[74613]:  stderr= {{(pid=74613) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 17:56:23 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-36693ddb-be8e-4239-91a2-83088b58153a tempest-ServerBootFromVolumeStableRescueTest-414665510 tempest-ServerBootFromVolumeStableRescueTest-414665510-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9511387c-8772-40f2-bf2d-6b6387649e9f (non-flash)
Nov 29 17:56:23 user nova-compute[74613]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:070b1031-e105-4cba-a039-2286e23727c5 (non-flash)
Nov 29 17:56:23 user nova-compute[74613]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00ec83b4-5d84-416a-bad9-7511171a9da0 (non-flash)
Nov 29 17:56:23 user nova-compute[74613]:  stderr= {{(pid=74613) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 17:56:23 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.base [None req-36693ddb-be8e-4239-91a2-83088b58153a tempest-ServerBootFromVolumeStableRescueTest-414665510 tempest-ServerBootFromVolumeStableRescueTest-414665510-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9511387c-8772-40f2-bf2d-6b6387649e9f" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.308s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 17:56:23 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-36693ddb-be8e-4239-91a2-83088b58153a tempest-ServerBootFromVolumeStableRescueTest-414665510 tempest-ServerBootFromVolumeStableRescueTest-414665510-project-member] Connected to 172.16.0.220:3260 {{(pid=74613) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 29 17:56:23 user nova-compute[74613]: DEBUG os_brick.initiator.linuxscsi [None req-36693ddb-be8e-4239-91a2-83088b58153a tempest-ServerBootFromVolumeStableRescueTest-414665510 tempest-ServerBootFromVolumeStableRescueTest-414665510-project-member] HCTL ('33', '0', '0', 0) found on session 14 with lun 0 {{(pid=74613) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 29 17:56:23 user nova-compute[74613]: DEBUG os_brick.initiator.linuxscsi [None req-36693ddb-be8e-4239-91a2-83088b58153a tempest-ServerBootFromVolumeStableRescueTest-414665510 tempest-ServerBootFromVolumeStableRescueTest-414665510-project-member] Scanning host 33 c: 0, t: 0, l: 0) {{(pid=74613) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 29 17:56:23 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 17:56:23 user nova-compute[74613]: DEBUG nova.compute.manager [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Didn't find any instances for network info cache update. {{(pid=74613) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 29 17:56:23 user nova-compute[74613]: DEBUG oslo_service.periodic_task [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74613) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 17:56:23 user nova-compute[74613]: DEBUG oslo_service.periodic_task [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74613) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 17:56:23 user nova-compute[74613]: DEBUG oslo_service.periodic_task [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74613) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 17:56:23 user nova-compute[74613]: DEBUG oslo_service.periodic_task [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74613) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 17:56:23 user nova-compute[74613]: DEBUG oslo_service.periodic_task [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74613) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 17:56:23 user nova-compute[74613]: DEBUG nova.compute.manager [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74613) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 29 17:56:23 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.020s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 17:56:23 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[83281564-9a6c-4b8c-aa39-cd4908368df3]: (4, ('0 0 0', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 17:56:23 user nova-compute[74613]: DEBUG os_brick.initiator.linuxscsi [None req-36693ddb-be8e-4239-91a2-83088b58153a tempest-ServerBootFromVolumeStableRescueTest-414665510 tempest-ServerBootFromVolumeStableRescueTest-414665510-project-member] Searching for a device in session 14 and hctl ('33', '0', '0', 0) yield: sdb {{(pid=74613) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 29 17:56:23 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-36693ddb-be8e-4239-91a2-83088b58153a tempest-ServerBootFromVolumeStableRescueTest-414665510 tempest-ServerBootFromVolumeStableRescueTest-414665510-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:9511387c-8772-40f2-bf2d-6b6387649e9f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XOfkuEgp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'} {{(pid=74613) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 29 17:56:23 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.base [None req-36693ddb-be8e-4239-91a2-83088b58153a tempest-ServerBootFromVolumeStableRescueTest-414665510 tempest-ServerBootFromVolumeStableRescueTest-414665510-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 0.342s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 17:56:23 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-36693ddb-be8e-4239-91a2-83088b58153a tempest-ServerBootFromVolumeStableRescueTest-414665510 tempest-ServerBootFromVolumeStableRescueTest-414665510-project-member] <== connect_volume: return (344ms) {'type': 'block', 'scsi_wwn': '23631303061663361', 'path': '/dev/sdb'} {{(pid=74613) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 17:56:23 user nova-compute[74613]: DEBUG nova.virt.libvirt.volume.iscsi [None req-36693ddb-be8e-4239-91a2-83088b58153a tempest-ServerBootFromVolumeStableRescueTest-414665510 tempest-ServerBootFromVolumeStableRescueTest-414665510-project-member] [instance: cd22685a-028c-4e0c-834d-e7b20f6d06ab] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23631303061663361', 'path': '/dev/sdb'} {{(pid=74613) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 29 17:56:23 user nova-compute[74613]: DEBUG nova.virt.libvirt.vif [None req-36693ddb-be8e-4239-91a2-83088b58153a tempest-ServerBootFromVolumeStableRescueTest-414665510 tempest-ServerBootFromVolumeStableRescueTest-414665510-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T17:54:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1015515172',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1015515172',id=12,image_ref='4217f428-8d9d-4ee1-9614-642d26d90c46',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-29T17:54:46Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='b820dd795dfe46cd804772f0e71f98e9',ramdisk_id='',reservation_id='r-j65rtiu7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='4217f428-8d9d-4ee1-9614-642d26d90c46',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-414665510',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-414665510-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T17:54:46Z,user_data=None,user_id='c65bc922e04d4d1385e48f70c460c441',uuid=cd22685a-028c-4e0c-834d-e7b20f6d06ab,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "5b08bd65-707e-48a5-800b-dd0670c88d61", "address": "fa:16:3e:28:d8:3d", "network": {"id": "0722b02d-a357-4360-87e8-580913723985", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-579793494-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-579793494-network", "vif_mac": "fa:16:3e:28:d8:3d"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b820dd795dfe46cd804772f0e71f98e9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5b08bd65-70", "ovs_interfaceid": "5b08bd65-707e-48a5-800b-dd0670c88d61", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74613) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 29 17:56:23 user nova-compute[74613]: DEBUG nova.network.os_vif_util [None req-36693ddb-be8e-4239-91a2-83088b58153a tempest-ServerBootFromVolumeStableRescueTest-414665510 tempest-ServerBootFromVolumeStableRescueTest-414665510-project-member] Converting VIF {"id": "5b08bd65-707e-48a5-800b-dd0670c88d61", "address": "fa:16:3e:28:d8:3d", "network": {"id": "0722b02d-a357-4360-87e8-580913723985", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-579793494-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-579793494-network", "vif_mac": "fa:16:3e:28:d8:3d"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b820dd795dfe46cd804772f0e71f98e9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5b08bd65-70", "ovs_interfaceid": "5b08bd65-707e-48a5-800b-dd0670c88d61", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74613) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 17:56:23 user nova-compute[74613]: DEBUG nova.network.os_vif_util [None req-36693ddb-be8e-4239-91a2-83088b58153a tempest-ServerBootFromVolumeStableRescueTest-414665510 tempest-ServerBootFromVolumeStableRescueTest-414665510-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:28:d8:3d,bridge_name='br-int',has_traffic_filtering=True,id=5b08bd65-707e-48a5-800b-dd0670c88d61,network=Network(0722b02d-a357-4360-87e8-580913723985),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5b08bd65-70') {{(pid=74613) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 17:56:23 user nova-compute[74613]: DEBUG nova.objects.instance [None req-36693ddb-be8e-4239-91a2-83088b58153a tempest-ServerBootFromVolumeStableRescueTest-414665510 tempest-ServerBootFromVolumeStableRescueTest-414665510-project-member] Lazy-loading 'pci_devices' on Instance uuid cd22685a-028c-4e0c-834d-e7b20f6d06ab {{(pid=74613) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 17:56:23 user nova-compute[74613]: DEBUG nova.policy [None req-1c35b467-29da-44e4-ab94-456aaf4a0f3f tempest-VolumesAdminNegativeTest-636556351 tempest-VolumesAdminNegativeTest-636556351-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '30b382b3a0c44bdf8ea91ea3ae780243', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3832a80aaabc42ba8400823aa6b76c29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74613) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 29 17:56:23 user nova-compute[74613]: DEBUG nova.objects.base [None req-36693ddb-be8e-4239-91a2-83088b58153a tempest-ServerBootFromVolumeStableRescueTest-414665510 tempest-ServerBootFromVolumeStableRescueTest-414665510-project-member] Object Instance<cd22685a-028c-4e0c-834d-e7b20f6d06ab> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model,pci_devices {{(pid=74613) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 29 17:56:23 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-36693ddb-be8e-4239-91a2-83088b58153a tempest-ServerBootFromVolumeStableRescueTest-414665510 tempest-ServerBootFromVolumeStableRescueTest-414665510-project-member] [instance: cd22685a-028c-4e0c-834d-e7b20f6d06ab] End _get_guest_xml xml=<domain type="kvm">
Nov 29 17:56:23 user nova-compute[74613]:   <uuid>cd22685a-028c-4e0c-834d-e7b20f6d06ab</uuid>
Nov 29 17:56:23 user nova-compute[74613]:   <name>instance-0000000c</name>
Nov 29 17:56:23 user nova-compute[74613]:   <memory>524288</memory>
Nov 29 17:56:23 user nova-compute[74613]:   <vcpu>1</vcpu>
Nov 29 17:56:23 user nova-compute[74613]:   <metadata>
Nov 29 17:56:23 user nova-compute[74613]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 29 17:56:23 user nova-compute[74613]:       <nova:package version="0.0.0"/>
Nov 29 17:56:23 user nova-compute[74613]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-1015515172</nova:name>
Nov 29 17:56:23 user nova-compute[74613]:       <nova:creationTime>2023-11-29 17:56:23</nova:creationTime>
Nov 29 17:56:23 user nova-compute[74613]:       <nova:flavor name="m1.tiny">
Nov 29 17:56:23 user nova-compute[74613]:         <nova:memory>512</nova:memory>
Nov 29 17:56:23 user nova-compute[74613]:         <nova:disk>1</nova:disk>
Nov 29 17:56:23 user nova-compute[74613]:         <nova:swap>0</nova:swap>
Nov 29 17:56:23 user nova-compute[74613]:         <nova:ephemeral>0</nova:ephemeral>
Nov 29 17:56:23 user nova-compute[74613]:         <nova:vcpus>1</nova:vcpus>
Nov 29 17:56:23 user nova-compute[74613]:       </nova:flavor>
Nov 29 17:56:23 user nova-compute[74613]:       <nova:owner>
Nov 29 17:56:23 user nova-compute[74613]:         <nova:user uuid="c65bc922e04d4d1385e48f70c460c441">tempest-ServerBootFromVolumeStableRescueTest-414665510-project-member</nova:user>
Nov 29 17:56:23 user nova-compute[74613]:         <nova:project uuid="b820dd795dfe46cd804772f0e71f98e9">tempest-ServerBootFromVolumeStableRescueTest-414665510</nova:project>
Nov 29 17:56:23 user nova-compute[74613]:       </nova:owner>
Nov 29 17:56:23 user nova-compute[74613]:       <nova:root type="image" uuid="4217f428-8d9d-4ee1-9614-642d26d90c46"/>
Nov 29 17:56:23 user nova-compute[74613]:       <nova:ports>
Nov 29 17:56:23 user nova-compute[74613]:         <nova:port uuid="5b08bd65-707e-48a5-800b-dd0670c88d61">
Nov 29 17:56:23 user nova-compute[74613]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Nov 29 17:56:23 user nova-compute[74613]:         </nova:port>
Nov 29 17:56:23 user nova-compute[74613]:       </nova:ports>
Nov 29 17:56:23 user nova-compute[74613]:     </nova:instance>
Nov 29 17:56:23 user nova-compute[74613]:   </metadata>
Nov 29 17:56:23 user nova-compute[74613]:   <sysinfo type="smbios">
Nov 29 17:56:23 user nova-compute[74613]:     <system>
Nov 29 17:56:23 user nova-compute[74613]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 29 17:56:23 user nova-compute[74613]:       <entry name="product">OpenStack Nova</entry>
Nov 29 17:56:23 user nova-compute[74613]:       <entry name="version">0.0.0</entry>
Nov 29 17:56:23 user nova-compute[74613]:       <entry name="serial">cd22685a-028c-4e0c-834d-e7b20f6d06ab</entry>
Nov 29 17:56:23 user nova-compute[74613]:       <entry name="uuid">cd22685a-028c-4e0c-834d-e7b20f6d06ab</entry>
Nov 29 17:56:23 user nova-compute[74613]:       <entry name="family">Virtual Machine</entry>
Nov 29 17:56:23 user nova-compute[74613]:     </system>
Nov 29 17:56:23 user nova-compute[74613]:   </sysinfo>
Nov 29 17:56:23 user nova-compute[74613]:   <os>
Nov 29 17:56:23 user nova-compute[74613]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 29 17:56:23 user nova-compute[74613]:     <smbios mode="sysinfo"/>
Nov 29 17:56:23 user nova-compute[74613]:   </os>
Nov 29 17:56:23 user nova-compute[74613]:   <features>
Nov 29 17:56:23 user nova-compute[74613]:     <acpi/>
Nov 29 17:56:23 user nova-compute[74613]:     <apic/>
Nov 29 17:56:23 user nova-compute[74613]:     <vmcoreinfo/>
Nov 29 17:56:23 user nova-compute[74613]:   </features>
Nov 29 17:56:23 user nova-compute[74613]:   <clock offset="utc">
Nov 29 17:56:23 user nova-compute[74613]:     <timer name="pit" tickpolicy="delay"/>
Nov 29 17:56:23 user nova-compute[74613]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 29 17:56:23 user nova-compute[74613]:     <timer name="hpet" present="no"/>
Nov 29 17:56:23 user nova-compute[74613]:   </clock>
Nov 29 17:56:23 user nova-compute[74613]:   <cpu mode="custom" match="exact">
Nov 29 17:56:23 user nova-compute[74613]:     <model>Nehalem</model>
Nov 29 17:56:23 user nova-compute[74613]:     <topology sockets="1" cores="1" threads="1"/>
Nov 29 17:56:23 user nova-compute[74613]:   </cpu>
Nov 29 17:56:23 user nova-compute[74613]:   <devices>
Nov 29 17:56:23 user nova-compute[74613]:     <disk type="block" device="disk">
Nov 29 17:56:23 user nova-compute[74613]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 17:56:23 user nova-compute[74613]:       <source dev="/dev/sdb"/>
Nov 29 17:56:23 user nova-compute[74613]:       <target dev="vda" bus="virtio"/>
Nov 29 17:56:23 user nova-compute[74613]:       <serial>9511387c-8772-40f2-bf2d-6b6387649e9f</serial>
Nov 29 17:56:23 user nova-compute[74613]:     </disk>
Nov 29 17:56:23 user nova-compute[74613]:     <disk type="file" device="disk">
Nov 29 17:56:23 user nova-compute[74613]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 29 17:56:23 user nova-compute[74613]:       <source file="/opt/stack/data/nova/instances/cd22685a-028c-4e0c-834d-e7b20f6d06ab/disk.rescue"/>
Nov 29 17:56:23 user nova-compute[74613]:       <target dev="vdb" bus="virtio"/>
Nov 29 17:56:23 user nova-compute[74613]:       <boot order="1"/>
Nov 29 17:56:23 user nova-compute[74613]:     </disk>
Nov 29 17:56:23 user nova-compute[74613]:     <interface type="ethernet">
Nov 29 17:56:23 user nova-compute[74613]:       <mac address="fa:16:3e:28:d8:3d"/>
Nov 29 17:56:23 user nova-compute[74613]:       <model type="virtio"/>
Nov 29 17:56:23 user nova-compute[74613]:       <mtu size="1442"/>
Nov 29 17:56:23 user nova-compute[74613]:       <target dev="tap5b08bd65-70"/>
Nov 29 17:56:23 user nova-compute[74613]:     </interface>
Nov 29 17:56:23 user nova-compute[74613]:     <serial type="pty">
Nov 29 17:56:23 user nova-compute[74613]:       <log file="/opt/stack/data/nova/instances/cd22685a-028c-4e0c-834d-e7b20f6d06ab/console.log" append="off"/>
Nov 29 17:56:23 user nova-compute[74613]:     </serial>
Nov 29 17:56:23 user nova-compute[74613]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 29 17:56:23 user nova-compute[74613]:     <video>
Nov 29 17:56:23 user nova-compute[74613]:       <model type="virtio"/>
Nov 29 17:56:23 user nova-compute[74613]:     </video>
Nov 29 17:56:23 user nova-compute[74613]:     <rng model="virtio">
Nov 29 17:56:23 user nova-compute[74613]:       <backend model="random">/dev/urandom</backend>
Nov 29 17:56:23 user nova-compute[74613]:     </rng>
Nov 29 17:56:23 user nova-compute[74613]:     <controller type="usb" index="0" model="none"/>
Nov 29 17:56:23 user nova-compute[74613]:     <memballoon model="virtio">
Nov 29 17:56:23 user nova-compute[74613]:       <stats period="10"/>
Nov 29 17:56:23 user nova-compute[74613]:     </memballoon>
Nov 29 17:56:23 user nova-compute[74613]:   </devices>
Nov 29 17:56:23 user nova-compute[74613]: </domain>
Nov 29 17:56:23 user nova-compute[74613]:  {{(pid=74613) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 29 17:56:23 user nova-compute[74613]: INFO nova.virt.libvirt.driver [-] [instance: cd22685a-028c-4e0c-834d-e7b20f6d06ab] Instance destroyed successfully.
Nov 29 17:56:23 user nova-compute[74613]: DEBUG nova.compute.manager [None req-1c35b467-29da-44e4-ab94-456aaf4a0f3f tempest-VolumesAdminNegativeTest-636556351 tempest-VolumesAdminNegativeTest-636556351-project-member] [instance: 0aa463c6-01e7-48e5-b082-e083558342e3] Start spawning the instance on the hypervisor. {{(pid=74613) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 29 17:56:23 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-1c35b467-29da-44e4-ab94-456aaf4a0f3f tempest-VolumesAdminNegativeTest-636556351 tempest-VolumesAdminNegativeTest-636556351-project-member] [instance: 0aa463c6-01e7-48e5-b082-e083558342e3] Creating instance directory {{(pid=74613) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 29 17:56:23 user nova-compute[74613]: INFO nova.virt.libvirt.driver [None req-1c35b467-29da-44e4-ab94-456aaf4a0f3f tempest-VolumesAdminNegativeTest-636556351 tempest-VolumesAdminNegativeTest-636556351-project-member] [instance: 0aa463c6-01e7-48e5-b082-e083558342e3] Creating image(s)
Nov 29 17:56:23 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-1c35b467-29da-44e4-ab94-456aaf4a0f3f tempest-VolumesAdminNegativeTest-636556351 tempest-VolumesAdminNegativeTest-636556351-project-member] Acquiring lock "/opt/stack/data/nova/instances/0aa463c6-01e7-48e5-b082-e083558342e3/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 17:56:23 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-1c35b467-29da-44e4-ab94-456aaf4a0f3f tempest-VolumesAdminNegativeTest-636556351 tempest-VolumesAdminNegativeTest-636556351-project-member] Lock "/opt/stack/data/nova/instances/0aa463c6-01e7-48e5-b082-e083558342e3/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 17:56:23 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-1c35b467-29da-44e4-ab94-456aaf4a0f3f tempest-VolumesAdminNegativeTest-636556351 tempest-VolumesAdminNegativeTest-636556351-project-member] Lock "/opt/stack/data/nova/instances/0aa463c6-01e7-48e5-b082-e083558342e3/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 17:56:23 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-1c35b467-29da-44e4-ab94-456aaf4a0f3f tempest-VolumesAdminNegativeTest-636556351 tempest-VolumesAdminNegativeTest-636556351-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/21faea9e6951f3bdd0153b76ac89fe1a60a34758 --force-share --output=json {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 17:56:23 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-36693ddb-be8e-4239-91a2-83088b58153a tempest-ServerBootFromVolumeStableRescueTest-414665510 tempest-ServerBootFromVolumeStableRescueTest-414665510-project-member] No BDM found with device name vda, not building metadata. {{(pid=74613) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 17:56:23 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-36693ddb-be8e-4239-91a2-83088b58153a tempest-ServerBootFromVolumeStableRescueTest-414665510 tempest-ServerBootFromVolumeStableRescueTest-414665510-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74613) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 17:56:23 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-36693ddb-be8e-4239-91a2-83088b58153a tempest-ServerBootFromVolumeStableRescueTest-414665510 tempest-ServerBootFromVolumeStableRescueTest-414665510-project-member] No VIF found with MAC fa:16:3e:28:d8:3d, not building metadata {{(pid=74613) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 29 17:56:24 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-1c35b467-29da-44e4-ab94-456aaf4a0f3f tempest-VolumesAdminNegativeTest-636556351 tempest-VolumesAdminNegativeTest-636556351-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/21faea9e6951f3bdd0153b76ac89fe1a60a34758 --force-share --output=json" returned: 0 in 0.208s {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 17:56:24 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-1c35b467-29da-44e4-ab94-456aaf4a0f3f tempest-VolumesAdminNegativeTest-636556351 tempest-VolumesAdminNegativeTest-636556351-project-member] Acquiring lock "21faea9e6951f3bdd0153b76ac89fe1a60a34758" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 17:56:24 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-1c35b467-29da-44e4-ab94-456aaf4a0f3f tempest-VolumesAdminNegativeTest-636556351 tempest-VolumesAdminNegativeTest-636556351-project-member] Lock "21faea9e6951f3bdd0153b76ac89fe1a60a34758" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 17:56:24 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-1c35b467-29da-44e4-ab94-456aaf4a0f3f tempest-VolumesAdminNegativeTest-636556351 tempest-VolumesAdminNegativeTest-636556351-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/21faea9e6951f3bdd0153b76ac89fe1a60a34758 --force-share --output=json {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 17:56:24 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-1c35b467-29da-44e4-ab94-456aaf4a0f3f tempest-VolumesAdminNegativeTest-636556351 tempest-VolumesAdminNegativeTest-636556351-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/21faea9e6951f3bdd0153b76ac89fe1a60a34758 --force-share --output=json" returned: 0 in 0.170s {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 17:56:24 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-1c35b467-29da-44e4-ab94-456aaf4a0f3f tempest-VolumesAdminNegativeTest-636556351 tempest-VolumesAdminNegativeTest-636556351-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/21faea9e6951f3bdd0153b76ac89fe1a60a34758,backing_fmt=raw /opt/stack/data/nova/instances/0aa463c6-01e7-48e5-b082-e083558342e3/disk 1073741824 {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 17:56:24 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-1c35b467-29da-44e4-ab94-456aaf4a0f3f tempest-VolumesAdminNegativeTest-636556351 tempest-VolumesAdminNegativeTest-636556351-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/21faea9e6951f3bdd0153b76ac89fe1a60a34758,backing_fmt=raw /opt/stack/data/nova/instances/0aa463c6-01e7-48e5-b082-e083558342e3/disk 1073741824" returned: 0 in 0.047s {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 17:56:24 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-1c35b467-29da-44e4-ab94-456aaf4a0f3f tempest-VolumesAdminNegativeTest-636556351 tempest-VolumesAdminNegativeTest-636556351-project-member] Lock "21faea9e6951f3bdd0153b76ac89fe1a60a34758" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.225s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 17:56:24 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-1c35b467-29da-44e4-ab94-456aaf4a0f3f tempest-VolumesAdminNegativeTest-636556351 tempest-VolumesAdminNegativeTest-636556351-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/21faea9e6951f3bdd0153b76ac89fe1a60a34758 --force-share --output=json {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 17:56:24 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-1c35b467-29da-44e4-ab94-456aaf4a0f3f tempest-VolumesAdminNegativeTest-636556351 tempest-VolumesAdminNegativeTest-636556351-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/21faea9e6951f3bdd0153b76ac89fe1a60a34758 --force-share --output=json" returned: 0 in 0.187s {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 17:56:24 user nova-compute[74613]: DEBUG nova.virt.disk.api [None req-1c35b467-29da-44e4-ab94-456aaf4a0f3f tempest-VolumesAdminNegativeTest-636556351 tempest-VolumesAdminNegativeTest-636556351-project-member] Checking if we can resize image /opt/stack/data/nova/instances/0aa463c6-01e7-48e5-b082-e083558342e3/disk. size=1073741824 {{(pid=74613) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 29 17:56:24 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-1c35b467-29da-44e4-ab94-456aaf4a0f3f tempest-VolumesAdminNegativeTest-636556351 tempest-VolumesAdminNegativeTest-636556351-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0aa463c6-01e7-48e5-b082-e083558342e3/disk --force-share --output=json {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 17:56:24 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-1c35b467-29da-44e4-ab94-456aaf4a0f3f tempest-VolumesAdminNegativeTest-636556351 tempest-VolumesAdminNegativeTest-636556351-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0aa463c6-01e7-48e5-b082-e083558342e3/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 17:56:24 user nova-compute[74613]: DEBUG nova.virt.disk.api [None req-1c35b467-29da-44e4-ab94-456aaf4a0f3f tempest-VolumesAdminNegativeTest-636556351 tempest-VolumesAdminNegativeTest-636556351-project-member] Cannot resize image /opt/stack/data/nova/instances/0aa463c6-01e7-48e5-b082-e083558342e3/disk to a smaller size. {{(pid=74613) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 29 17:56:24 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-1c35b467-29da-44e4-ab94-456aaf4a0f3f tempest-VolumesAdminNegativeTest-636556351 tempest-VolumesAdminNegativeTest-636556351-project-member] [instance: 0aa463c6-01e7-48e5-b082-e083558342e3] Created local disks {{(pid=74613) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 29 17:56:24 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-1c35b467-29da-44e4-ab94-456aaf4a0f3f tempest-VolumesAdminNegativeTest-636556351 tempest-VolumesAdminNegativeTest-636556351-project-member] [instance: 0aa463c6-01e7-48e5-b082-e083558342e3] Ensure instance console log exists: /opt/stack/data/nova/instances/0aa463c6-01e7-48e5-b082-e083558342e3/console.log {{(pid=74613) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 29 17:56:24 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-1c35b467-29da-44e4-ab94-456aaf4a0f3f tempest-VolumesAdminNegativeTest-636556351 tempest-VolumesAdminNegativeTest-636556351-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 17:56:24 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-1c35b467-29da-44e4-ab94-456aaf4a0f3f tempest-VolumesAdminNegativeTest-636556351 tempest-VolumesAdminNegativeTest-636556351-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.006s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 17:56:24 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-1c35b467-29da-44e4-ab94-456aaf4a0f3f tempest-VolumesAdminNegativeTest-636556351 tempest-VolumesAdminNegativeTest-636556351-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.002s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 17:56:24 user nova-compute[74613]: DEBUG nova.network.neutron [None req-1c35b467-29da-44e4-ab94-456aaf4a0f3f tempest-VolumesAdminNegativeTest-636556351 tempest-VolumesAdminNegativeTest-636556351-project-member] [instance: 0aa463c6-01e7-48e5-b082-e083558342e3] Successfully created port: 9e74da09-a403-40b9-aad1-3cba1f7bd9d5 {{(pid=74613) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 29 17:56:25 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:56:25 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:56:25 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:56:25 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:56:25 user nova-compute[74613]: DEBUG nova.network.neutron [None req-1c35b467-29da-44e4-ab94-456aaf4a0f3f tempest-VolumesAdminNegativeTest-636556351 tempest-VolumesAdminNegativeTest-636556351-project-member] [instance: 0aa463c6-01e7-48e5-b082-e083558342e3] Successfully updated port: 9e74da09-a403-40b9-aad1-3cba1f7bd9d5 {{(pid=74613) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 29 17:56:25 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-1c35b467-29da-44e4-ab94-456aaf4a0f3f tempest-VolumesAdminNegativeTest-636556351 tempest-VolumesAdminNegativeTest-636556351-project-member] Acquiring lock "refresh_cache-0aa463c6-01e7-48e5-b082-e083558342e3" {{(pid=74613) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 17:56:25 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-1c35b467-29da-44e4-ab94-456aaf4a0f3f tempest-VolumesAdminNegativeTest-636556351 tempest-VolumesAdminNegativeTest-636556351-project-member] Acquired lock "refresh_cache-0aa463c6-01e7-48e5-b082-e083558342e3" {{(pid=74613) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 17:56:25 user nova-compute[74613]: DEBUG nova.network.neutron [None req-1c35b467-29da-44e4-ab94-456aaf4a0f3f tempest-VolumesAdminNegativeTest-636556351 tempest-VolumesAdminNegativeTest-636556351-project-member] [instance: 0aa463c6-01e7-48e5-b082-e083558342e3] Building network info cache for instance {{(pid=74613) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 29 17:56:25 user nova-compute[74613]: DEBUG nova.compute.manager [req-42f53dd1-7152-4196-a9c6-142c8b155e1e req-8d0a99fa-8bb9-4ab7-a7f3-2eca15f0ac28 service nova] [instance: 0aa463c6-01e7-48e5-b082-e083558342e3] Received event network-changed-9e74da09-a403-40b9-aad1-3cba1f7bd9d5 {{(pid=74613) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 17:56:25 user nova-compute[74613]: DEBUG nova.compute.manager [req-42f53dd1-7152-4196-a9c6-142c8b155e1e req-8d0a99fa-8bb9-4ab7-a7f3-2eca15f0ac28 service nova] [instance: 0aa463c6-01e7-48e5-b082-e083558342e3] Refreshing instance network info cache due to event network-changed-9e74da09-a403-40b9-aad1-3cba1f7bd9d5. {{(pid=74613) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 17:56:25 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-42f53dd1-7152-4196-a9c6-142c8b155e1e req-8d0a99fa-8bb9-4ab7-a7f3-2eca15f0ac28 service nova] Acquiring lock "refresh_cache-0aa463c6-01e7-48e5-b082-e083558342e3" {{(pid=74613) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 17:56:25 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:56:25 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:56:25 user nova-compute[74613]: DEBUG nova.network.neutron [None req-1c35b467-29da-44e4-ab94-456aaf4a0f3f tempest-VolumesAdminNegativeTest-636556351 tempest-VolumesAdminNegativeTest-636556351-project-member] [instance: 0aa463c6-01e7-48e5-b082-e083558342e3] Instance cache missing network info. {{(pid=74613) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 29 17:56:26 user nova-compute[74613]: DEBUG nova.network.neutron [None req-1c35b467-29da-44e4-ab94-456aaf4a0f3f tempest-VolumesAdminNegativeTest-636556351 tempest-VolumesAdminNegativeTest-636556351-project-member] [instance: 0aa463c6-01e7-48e5-b082-e083558342e3] Updating instance_info_cache with network_info: [{"id": "9e74da09-a403-40b9-aad1-3cba1f7bd9d5", "address": "fa:16:3e:78:6a:83", "network": {"id": "485e1e0d-aa2c-47c2-a010-c84e83dbcc9c", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-686908926-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3832a80aaabc42ba8400823aa6b76c29", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9e74da09-a4", "ovs_interfaceid": "9e74da09-a403-40b9-aad1-3cba1f7bd9d5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74613) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 17:56:26 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-1c35b467-29da-44e4-ab94-456aaf4a0f3f tempest-VolumesAdminNegativeTest-636556351 tempest-VolumesAdminNegativeTest-636556351-project-member] Releasing lock "refresh_cache-0aa463c6-01e7-48e5-b082-e083558342e3" {{(pid=74613) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 17:56:26 user nova-compute[74613]: DEBUG nova.compute.manager [None req-1c35b467-29da-44e4-ab94-456aaf4a0f3f tempest-VolumesAdminNegativeTest-636556351 tempest-VolumesAdminNegativeTest-636556351-project-member] [instance: 0aa463c6-01e7-48e5-b082-e083558342e3] Instance network_info: |[{"id": "9e74da09-a403-40b9-aad1-3cba1f7bd9d5", "address": "fa:16:3e:78:6a:83", "network": {"id": "485e1e0d-aa2c-47c2-a010-c84e83dbcc9c", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-686908926-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3832a80aaabc42ba8400823aa6b76c29", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9e74da09-a4", "ovs_interfaceid": "9e74da09-a403-40b9-aad1-3cba1f7bd9d5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74613) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 29 17:56:26 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-42f53dd1-7152-4196-a9c6-142c8b155e1e req-8d0a99fa-8bb9-4ab7-a7f3-2eca15f0ac28 service nova] Acquired lock "refresh_cache-0aa463c6-01e7-48e5-b082-e083558342e3" {{(pid=74613) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 17:56:26 user nova-compute[74613]: DEBUG nova.network.neutron [req-42f53dd1-7152-4196-a9c6-142c8b155e1e req-8d0a99fa-8bb9-4ab7-a7f3-2eca15f0ac28 service nova] [instance: 0aa463c6-01e7-48e5-b082-e083558342e3] Refreshing network info cache for port 9e74da09-a403-40b9-aad1-3cba1f7bd9d5 {{(pid=74613) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 17:56:26 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-1c35b467-29da-44e4-ab94-456aaf4a0f3f tempest-VolumesAdminNegativeTest-636556351 tempest-VolumesAdminNegativeTest-636556351-project-member] [instance: 0aa463c6-01e7-48e5-b082-e083558342e3] Start _get_guest_xml network_info=[{"id": "9e74da09-a403-40b9-aad1-3cba1f7bd9d5", "address": "fa:16:3e:78:6a:83", "network": {"id": "485e1e0d-aa2c-47c2-a010-c84e83dbcc9c", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-686908926-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3832a80aaabc42ba8400823aa6b76c29", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9e74da09-a4", "ovs_interfaceid": "9e74da09-a403-40b9-aad1-3cba1f7bd9d5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-29T17:47:38Z,direct_url=<?>,disk_format='qcow2',id=4217f428-8d9d-4ee1-9614-642d26d90c46,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='794b07cbd46a44b5865cfda741036bae',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-29T17:47:40Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'size': 0, 'device_type': 'disk', 'boot_index': 0, 'guest_format': None, 'encrypted': False, 'encryption_format': None, 'disk_bus': 'virtio', 'image_id': '4217f428-8d9d-4ee1-9614-642d26d90c46'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74613) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 29 17:56:26 user nova-compute[74613]: WARNING nova.virt.libvirt.driver [None req-1c35b467-29da-44e4-ab94-456aaf4a0f3f tempest-VolumesAdminNegativeTest-636556351 tempest-VolumesAdminNegativeTest-636556351-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 17:56:26 user nova-compute[74613]: WARNING nova.virt.libvirt.driver [None req-1c35b467-29da-44e4-ab94-456aaf4a0f3f tempest-VolumesAdminNegativeTest-636556351 tempest-VolumesAdminNegativeTest-636556351-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 17:56:26 user nova-compute[74613]: DEBUG nova.virt.libvirt.host [None req-1c35b467-29da-44e4-ab94-456aaf4a0f3f tempest-VolumesAdminNegativeTest-636556351 tempest-VolumesAdminNegativeTest-636556351-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74613) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 29 17:56:26 user nova-compute[74613]: DEBUG nova.virt.libvirt.host [None req-1c35b467-29da-44e4-ab94-456aaf4a0f3f tempest-VolumesAdminNegativeTest-636556351 tempest-VolumesAdminNegativeTest-636556351-project-member] CPU controller missing on host. {{(pid=74613) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 29 17:56:26 user nova-compute[74613]: DEBUG nova.virt.libvirt.host [None req-1c35b467-29da-44e4-ab94-456aaf4a0f3f tempest-VolumesAdminNegativeTest-636556351 tempest-VolumesAdminNegativeTest-636556351-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74613) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 29 17:56:26 user nova-compute[74613]: DEBUG nova.virt.libvirt.host [None req-1c35b467-29da-44e4-ab94-456aaf4a0f3f tempest-VolumesAdminNegativeTest-636556351 tempest-VolumesAdminNegativeTest-636556351-project-member] CPU controller found on host. {{(pid=74613) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 29 17:56:26 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-1c35b467-29da-44e4-ab94-456aaf4a0f3f tempest-VolumesAdminNegativeTest-636556351 tempest-VolumesAdminNegativeTest-636556351-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74613) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 29 17:56:26 user nova-compute[74613]: DEBUG nova.virt.hardware [None req-1c35b467-29da-44e4-ab94-456aaf4a0f3f tempest-VolumesAdminNegativeTest-636556351 tempest-VolumesAdminNegativeTest-636556351-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-29T17:47:27Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-29T17:47:38Z,direct_url=<?>,disk_format='qcow2',id=4217f428-8d9d-4ee1-9614-642d26d90c46,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='794b07cbd46a44b5865cfda741036bae',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-29T17:47:40Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74613) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 29 17:56:26 user nova-compute[74613]: DEBUG nova.virt.hardware [None req-1c35b467-29da-44e4-ab94-456aaf4a0f3f tempest-VolumesAdminNegativeTest-636556351 tempest-VolumesAdminNegativeTest-636556351-project-member] Flavor limits 0:0:0 {{(pid=74613) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 29 17:56:26 user nova-compute[74613]: DEBUG nova.virt.hardware [None req-1c35b467-29da-44e4-ab94-456aaf4a0f3f tempest-VolumesAdminNegativeTest-636556351 tempest-VolumesAdminNegativeTest-636556351-project-member] Image limits 0:0:0 {{(pid=74613) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 29 17:56:26 user nova-compute[74613]: DEBUG nova.virt.hardware [None req-1c35b467-29da-44e4-ab94-456aaf4a0f3f tempest-VolumesAdminNegativeTest-636556351 tempest-VolumesAdminNegativeTest-636556351-project-member] Flavor pref 0:0:0 {{(pid=74613) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 29 17:56:26 user nova-compute[74613]: DEBUG nova.virt.hardware [None req-1c35b467-29da-44e4-ab94-456aaf4a0f3f tempest-VolumesAdminNegativeTest-636556351 tempest-VolumesAdminNegativeTest-636556351-project-member] Image pref 0:0:0 {{(pid=74613) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 29 17:56:26 user nova-compute[74613]: DEBUG nova.virt.hardware [None req-1c35b467-29da-44e4-ab94-456aaf4a0f3f tempest-VolumesAdminNegativeTest-636556351 tempest-VolumesAdminNegativeTest-636556351-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74613) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 29 17:56:26 user nova-compute[74613]: DEBUG nova.virt.hardware [None req-1c35b467-29da-44e4-ab94-456aaf4a0f3f tempest-VolumesAdminNegativeTest-636556351 tempest-VolumesAdminNegativeTest-636556351-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74613) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 29 17:56:26 user nova-compute[74613]: DEBUG nova.virt.hardware [None req-1c35b467-29da-44e4-ab94-456aaf4a0f3f tempest-VolumesAdminNegativeTest-636556351 tempest-VolumesAdminNegativeTest-636556351-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74613) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 29 17:56:26 user nova-compute[74613]: DEBUG nova.virt.hardware [None req-1c35b467-29da-44e4-ab94-456aaf4a0f3f tempest-VolumesAdminNegativeTest-636556351 tempest-VolumesAdminNegativeTest-636556351-project-member] Got 1 possible topologies {{(pid=74613) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 29 17:56:26 user nova-compute[74613]: DEBUG nova.virt.hardware [None req-1c35b467-29da-44e4-ab94-456aaf4a0f3f tempest-VolumesAdminNegativeTest-636556351 tempest-VolumesAdminNegativeTest-636556351-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74613) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 29 17:56:26 user nova-compute[74613]: DEBUG nova.virt.hardware [None req-1c35b467-29da-44e4-ab94-456aaf4a0f3f tempest-VolumesAdminNegativeTest-636556351 tempest-VolumesAdminNegativeTest-636556351-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74613) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 29 17:56:26 user nova-compute[74613]: DEBUG nova.virt.libvirt.vif [None req-1c35b467-29da-44e4-ab94-456aaf4a0f3f tempest-VolumesAdminNegativeTest-636556351 tempest-VolumesAdminNegativeTest-636556351-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T17:56:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-1171036164',display_name='tempest-VolumesAdminNegativeTest-server-1171036164',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-1171036164',id=16,image_ref='4217f428-8d9d-4ee1-9614-642d26d90c46',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJzEcx+pvIzWz9B0zsP6HNvpl08xJtvEPhXbMpRmrj+5h08SDzgAu/NTTVld6GHJalJRL6Fv8WGccfo6wX6sGwc1fKKi6HWbUjd0peJDc6RTT1Q4FQVNIPosU9KceOmOgg==',key_name='tempest-keypair-1561426885',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3832a80aaabc42ba8400823aa6b76c29',ramdisk_id='',reservation_id='r-ty4441no',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='4217f428-8d9d-4ee1-9614-642d26d90c46',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-636556351',owner_user_name='tempest-VolumesAdminNegativeTest-636556351-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T17:56:24Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='30b382b3a0c44bdf8ea91ea3ae780243',uuid=0aa463c6-01e7-48e5-b082-e083558342e3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9e74da09-a403-40b9-aad1-3cba1f7bd9d5", "address": "fa:16:3e:78:6a:83", "network": {"id": "485e1e0d-aa2c-47c2-a010-c84e83dbcc9c", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-686908926-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3832a80aaabc42ba8400823aa6b76c29", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9e74da09-a4", "ovs_interfaceid": "9e74da09-a403-40b9-aad1-3cba1f7bd9d5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74613) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 29 17:56:26 user nova-compute[74613]: DEBUG nova.network.os_vif_util [None req-1c35b467-29da-44e4-ab94-456aaf4a0f3f tempest-VolumesAdminNegativeTest-636556351 tempest-VolumesAdminNegativeTest-636556351-project-member] Converting VIF {"id": "9e74da09-a403-40b9-aad1-3cba1f7bd9d5", "address": "fa:16:3e:78:6a:83", "network": {"id": "485e1e0d-aa2c-47c2-a010-c84e83dbcc9c", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-686908926-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3832a80aaabc42ba8400823aa6b76c29", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9e74da09-a4", "ovs_interfaceid": "9e74da09-a403-40b9-aad1-3cba1f7bd9d5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74613) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 17:56:26 user nova-compute[74613]: DEBUG nova.network.os_vif_util [None req-1c35b467-29da-44e4-ab94-456aaf4a0f3f tempest-VolumesAdminNegativeTest-636556351 tempest-VolumesAdminNegativeTest-636556351-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:78:6a:83,bridge_name='br-int',has_traffic_filtering=True,id=9e74da09-a403-40b9-aad1-3cba1f7bd9d5,network=Network(485e1e0d-aa2c-47c2-a010-c84e83dbcc9c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9e74da09-a4') {{(pid=74613) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 17:56:26 user nova-compute[74613]: DEBUG nova.objects.instance [None req-1c35b467-29da-44e4-ab94-456aaf4a0f3f tempest-VolumesAdminNegativeTest-636556351 tempest-VolumesAdminNegativeTest-636556351-project-member] Lazy-loading 'pci_devices' on Instance uuid 0aa463c6-01e7-48e5-b082-e083558342e3 {{(pid=74613) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 17:56:26 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-1c35b467-29da-44e4-ab94-456aaf4a0f3f tempest-VolumesAdminNegativeTest-636556351 tempest-VolumesAdminNegativeTest-636556351-project-member] [instance: 0aa463c6-01e7-48e5-b082-e083558342e3] End _get_guest_xml xml=<domain type="kvm">
Nov 29 17:56:26 user nova-compute[74613]:   <uuid>0aa463c6-01e7-48e5-b082-e083558342e3</uuid>
Nov 29 17:56:26 user nova-compute[74613]:   <name>instance-00000010</name>
Nov 29 17:56:26 user nova-compute[74613]:   <memory>524288</memory>
Nov 29 17:56:26 user nova-compute[74613]:   <vcpu>1</vcpu>
Nov 29 17:56:26 user nova-compute[74613]:   <metadata>
Nov 29 17:56:26 user nova-compute[74613]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 29 17:56:26 user nova-compute[74613]:       <nova:package version="0.0.0"/>
Nov 29 17:56:26 user nova-compute[74613]:       <nova:name>tempest-VolumesAdminNegativeTest-server-1171036164</nova:name>
Nov 29 17:56:26 user nova-compute[74613]:       <nova:creationTime>2023-11-29 17:56:26</nova:creationTime>
Nov 29 17:56:26 user nova-compute[74613]:       <nova:flavor name="m1.tiny">
Nov 29 17:56:26 user nova-compute[74613]:         <nova:memory>512</nova:memory>
Nov 29 17:56:26 user nova-compute[74613]:         <nova:disk>1</nova:disk>
Nov 29 17:56:26 user nova-compute[74613]:         <nova:swap>0</nova:swap>
Nov 29 17:56:26 user nova-compute[74613]:         <nova:ephemeral>0</nova:ephemeral>
Nov 29 17:56:26 user nova-compute[74613]:         <nova:vcpus>1</nova:vcpus>
Nov 29 17:56:26 user nova-compute[74613]:       </nova:flavor>
Nov 29 17:56:26 user nova-compute[74613]:       <nova:owner>
Nov 29 17:56:26 user nova-compute[74613]:         <nova:user uuid="30b382b3a0c44bdf8ea91ea3ae780243">tempest-VolumesAdminNegativeTest-636556351-project-member</nova:user>
Nov 29 17:56:26 user nova-compute[74613]:         <nova:project uuid="3832a80aaabc42ba8400823aa6b76c29">tempest-VolumesAdminNegativeTest-636556351</nova:project>
Nov 29 17:56:26 user nova-compute[74613]:       </nova:owner>
Nov 29 17:56:26 user nova-compute[74613]:       <nova:root type="image" uuid="4217f428-8d9d-4ee1-9614-642d26d90c46"/>
Nov 29 17:56:26 user nova-compute[74613]:       <nova:ports>
Nov 29 17:56:26 user nova-compute[74613]:         <nova:port uuid="9e74da09-a403-40b9-aad1-3cba1f7bd9d5">
Nov 29 17:56:26 user nova-compute[74613]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Nov 29 17:56:26 user nova-compute[74613]:         </nova:port>
Nov 29 17:56:26 user nova-compute[74613]:       </nova:ports>
Nov 29 17:56:26 user nova-compute[74613]:     </nova:instance>
Nov 29 17:56:26 user nova-compute[74613]:   </metadata>
Nov 29 17:56:26 user nova-compute[74613]:   <sysinfo type="smbios">
Nov 29 17:56:26 user nova-compute[74613]:     <system>
Nov 29 17:56:26 user nova-compute[74613]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 29 17:56:26 user nova-compute[74613]:       <entry name="product">OpenStack Nova</entry>
Nov 29 17:56:26 user nova-compute[74613]:       <entry name="version">0.0.0</entry>
Nov 29 17:56:26 user nova-compute[74613]:       <entry name="serial">0aa463c6-01e7-48e5-b082-e083558342e3</entry>
Nov 29 17:56:26 user nova-compute[74613]:       <entry name="uuid">0aa463c6-01e7-48e5-b082-e083558342e3</entry>
Nov 29 17:56:26 user nova-compute[74613]:       <entry name="family">Virtual Machine</entry>
Nov 29 17:56:26 user nova-compute[74613]:     </system>
Nov 29 17:56:26 user nova-compute[74613]:   </sysinfo>
Nov 29 17:56:26 user nova-compute[74613]:   <os>
Nov 29 17:56:26 user nova-compute[74613]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 29 17:56:26 user nova-compute[74613]:     <boot dev="hd"/>
Nov 29 17:56:26 user nova-compute[74613]:     <smbios mode="sysinfo"/>
Nov 29 17:56:26 user nova-compute[74613]:   </os>
Nov 29 17:56:26 user nova-compute[74613]:   <features>
Nov 29 17:56:26 user nova-compute[74613]:     <acpi/>
Nov 29 17:56:26 user nova-compute[74613]:     <apic/>
Nov 29 17:56:26 user nova-compute[74613]:     <vmcoreinfo/>
Nov 29 17:56:26 user nova-compute[74613]:   </features>
Nov 29 17:56:26 user nova-compute[74613]:   <clock offset="utc">
Nov 29 17:56:26 user nova-compute[74613]:     <timer name="pit" tickpolicy="delay"/>
Nov 29 17:56:26 user nova-compute[74613]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 29 17:56:26 user nova-compute[74613]:     <timer name="hpet" present="no"/>
Nov 29 17:56:26 user nova-compute[74613]:   </clock>
Nov 29 17:56:26 user nova-compute[74613]:   <cpu mode="custom" match="exact">
Nov 29 17:56:26 user nova-compute[74613]:     <model>Nehalem</model>
Nov 29 17:56:26 user nova-compute[74613]:     <topology sockets="1" cores="1" threads="1"/>
Nov 29 17:56:26 user nova-compute[74613]:   </cpu>
Nov 29 17:56:26 user nova-compute[74613]:   <devices>
Nov 29 17:56:26 user nova-compute[74613]:     <disk type="file" device="disk">
Nov 29 17:56:26 user nova-compute[74613]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 29 17:56:26 user nova-compute[74613]:       <source file="/opt/stack/data/nova/instances/0aa463c6-01e7-48e5-b082-e083558342e3/disk"/>
Nov 29 17:56:26 user nova-compute[74613]:       <target dev="vda" bus="virtio"/>
Nov 29 17:56:26 user nova-compute[74613]:     </disk>
Nov 29 17:56:26 user nova-compute[74613]:     <interface type="ethernet">
Nov 29 17:56:26 user nova-compute[74613]:       <mac address="fa:16:3e:78:6a:83"/>
Nov 29 17:56:26 user nova-compute[74613]:       <model type="virtio"/>
Nov 29 17:56:26 user nova-compute[74613]:       <mtu size="1442"/>
Nov 29 17:56:26 user nova-compute[74613]:       <target dev="tap9e74da09-a4"/>
Nov 29 17:56:26 user nova-compute[74613]:     </interface>
Nov 29 17:56:26 user nova-compute[74613]:     <serial type="pty">
Nov 29 17:56:26 user nova-compute[74613]:       <log file="/opt/stack/data/nova/instances/0aa463c6-01e7-48e5-b082-e083558342e3/console.log" append="off"/>
Nov 29 17:56:26 user nova-compute[74613]:     </serial>
Nov 29 17:56:26 user nova-compute[74613]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 29 17:56:26 user nova-compute[74613]:     <video>
Nov 29 17:56:26 user nova-compute[74613]:       <model type="virtio"/>
Nov 29 17:56:26 user nova-compute[74613]:     </video>
Nov 29 17:56:26 user nova-compute[74613]:     <rng model="virtio">
Nov 29 17:56:26 user nova-compute[74613]:       <backend model="random">/dev/urandom</backend>
Nov 29 17:56:26 user nova-compute[74613]:     </rng>
Nov 29 17:56:26 user nova-compute[74613]:     <controller type="usb" index="0" model="none"/>
Nov 29 17:56:26 user nova-compute[74613]:     <memballoon model="virtio">
Nov 29 17:56:26 user nova-compute[74613]:       <stats period="10"/>
Nov 29 17:56:26 user nova-compute[74613]:     </memballoon>
Nov 29 17:56:26 user nova-compute[74613]:   </devices>
Nov 29 17:56:26 user nova-compute[74613]: </domain>
Nov 29 17:56:26 user nova-compute[74613]:  {{(pid=74613) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 29 17:56:26 user nova-compute[74613]: DEBUG nova.virt.libvirt.vif [None req-1c35b467-29da-44e4-ab94-456aaf4a0f3f tempest-VolumesAdminNegativeTest-636556351 tempest-VolumesAdminNegativeTest-636556351-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T17:56:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-1171036164',display_name='tempest-VolumesAdminNegativeTest-server-1171036164',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-1171036164',id=16,image_ref='4217f428-8d9d-4ee1-9614-642d26d90c46',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJzEcx+pvIzWz9B0zsP6HNvpl08xJtvEPhXbMpRmrj+5h08SDzgAu/NTTVld6GHJalJRL6Fv8WGccfo6wX6sGwc1fKKi6HWbUjd0peJDc6RTT1Q4FQVNIPosU9KceOmOgg==',key_name='tempest-keypair-1561426885',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3832a80aaabc42ba8400823aa6b76c29',ramdisk_id='',reservation_id='r-ty4441no',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='4217f428-8d9d-4ee1-9614-642d26d90c46',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-636556351',owner_user_name='tempest-VolumesAdminNegativeTest-636556351-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T17:56:24Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='30b382b3a0c44bdf8ea91ea3ae780243',uuid=0aa463c6-01e7-48e5-b082-e083558342e3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9e74da09-a403-40b9-aad1-3cba1f7bd9d5", "address": "fa:16:3e:78:6a:83", "network": {"id": "485e1e0d-aa2c-47c2-a010-c84e83dbcc9c", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-686908926-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3832a80aaabc42ba8400823aa6b76c29", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9e74da09-a4", "ovs_interfaceid": "9e74da09-a403-40b9-aad1-3cba1f7bd9d5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74613) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 29 17:56:26 user nova-compute[74613]: DEBUG nova.network.os_vif_util [None req-1c35b467-29da-44e4-ab94-456aaf4a0f3f tempest-VolumesAdminNegativeTest-636556351 tempest-VolumesAdminNegativeTest-636556351-project-member] Converting VIF {"id": "9e74da09-a403-40b9-aad1-3cba1f7bd9d5", "address": "fa:16:3e:78:6a:83", "network": {"id": "485e1e0d-aa2c-47c2-a010-c84e83dbcc9c", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-686908926-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3832a80aaabc42ba8400823aa6b76c29", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9e74da09-a4", "ovs_interfaceid": "9e74da09-a403-40b9-aad1-3cba1f7bd9d5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74613) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 17:56:26 user nova-compute[74613]: DEBUG nova.network.os_vif_util [None req-1c35b467-29da-44e4-ab94-456aaf4a0f3f tempest-VolumesAdminNegativeTest-636556351 tempest-VolumesAdminNegativeTest-636556351-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:78:6a:83,bridge_name='br-int',has_traffic_filtering=True,id=9e74da09-a403-40b9-aad1-3cba1f7bd9d5,network=Network(485e1e0d-aa2c-47c2-a010-c84e83dbcc9c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9e74da09-a4') {{(pid=74613) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 17:56:26 user nova-compute[74613]: DEBUG os_vif [None req-1c35b467-29da-44e4-ab94-456aaf4a0f3f tempest-VolumesAdminNegativeTest-636556351 tempest-VolumesAdminNegativeTest-636556351-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:78:6a:83,bridge_name='br-int',has_traffic_filtering=True,id=9e74da09-a403-40b9-aad1-3cba1f7bd9d5,network=Network(485e1e0d-aa2c-47c2-a010-c84e83dbcc9c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9e74da09-a4') {{(pid=74613) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 29 17:56:26 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:56:26 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74613) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 17:56:26 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74613) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 29 17:56:26 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:56:26 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'b1a381b4-5ba9-5730-9df1-7cda0f05ef41', '_type': 'linux-noop'}}, row=False) {{(pid=74613) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 17:56:26 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 17:56:26 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:56:26 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:56:26 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:56:26 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap9e74da09-a4, may_exist=True, interface_attrs={}) {{(pid=74613) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 17:56:26 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap9e74da09-a4, col_values=(('qos', UUID('babeb884-fd37-42cc-8346-cb1284f10d35')),), if_exists=True) {{(pid=74613) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 17:56:26 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap9e74da09-a4, col_values=(('external_ids', {'iface-id': '9e74da09-a403-40b9-aad1-3cba1f7bd9d5', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:78:6a:83', 'vm-uuid': '0aa463c6-01e7-48e5-b082-e083558342e3'}),), if_exists=True) {{(pid=74613) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 17:56:26 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:56:26 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 17:56:26 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:56:26 user nova-compute[74613]: INFO os_vif [None req-1c35b467-29da-44e4-ab94-456aaf4a0f3f tempest-VolumesAdminNegativeTest-636556351 tempest-VolumesAdminNegativeTest-636556351-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:78:6a:83,bridge_name='br-int',has_traffic_filtering=True,id=9e74da09-a403-40b9-aad1-3cba1f7bd9d5,network=Network(485e1e0d-aa2c-47c2-a010-c84e83dbcc9c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9e74da09-a4')
Nov 29 17:56:26 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-1c35b467-29da-44e4-ab94-456aaf4a0f3f tempest-VolumesAdminNegativeTest-636556351 tempest-VolumesAdminNegativeTest-636556351-project-member] No BDM found with device name vda, not building metadata. {{(pid=74613) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 17:56:26 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-1c35b467-29da-44e4-ab94-456aaf4a0f3f tempest-VolumesAdminNegativeTest-636556351 tempest-VolumesAdminNegativeTest-636556351-project-member] No VIF found with MAC fa:16:3e:78:6a:83, not building metadata {{(pid=74613) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 29 17:56:26 user nova-compute[74613]: DEBUG nova.network.neutron [req-42f53dd1-7152-4196-a9c6-142c8b155e1e req-8d0a99fa-8bb9-4ab7-a7f3-2eca15f0ac28 service nova] [instance: 0aa463c6-01e7-48e5-b082-e083558342e3] Updated VIF entry in instance network info cache for port 9e74da09-a403-40b9-aad1-3cba1f7bd9d5. {{(pid=74613) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 17:56:26 user nova-compute[74613]: DEBUG nova.network.neutron [req-42f53dd1-7152-4196-a9c6-142c8b155e1e req-8d0a99fa-8bb9-4ab7-a7f3-2eca15f0ac28 service nova] [instance: 0aa463c6-01e7-48e5-b082-e083558342e3] Updating instance_info_cache with network_info: [{"id": "9e74da09-a403-40b9-aad1-3cba1f7bd9d5", "address": "fa:16:3e:78:6a:83", "network": {"id": "485e1e0d-aa2c-47c2-a010-c84e83dbcc9c", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-686908926-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3832a80aaabc42ba8400823aa6b76c29", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9e74da09-a4", "ovs_interfaceid": "9e74da09-a403-40b9-aad1-3cba1f7bd9d5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74613) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 17:56:26 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-42f53dd1-7152-4196-a9c6-142c8b155e1e req-8d0a99fa-8bb9-4ab7-a7f3-2eca15f0ac28 service nova] Releasing lock "refresh_cache-0aa463c6-01e7-48e5-b082-e083558342e3" {{(pid=74613) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 17:56:27 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:56:27 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-f37f09ab-78b9-4ace-9102-3428f80ad0b3 tempest-TestShelveInstance-765407413 tempest-TestShelveInstance-765407413-project-member] Acquiring lock "fae10c60-f989-4c99-bde4-60cd9f3e2055" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 17:56:27 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-f37f09ab-78b9-4ace-9102-3428f80ad0b3 tempest-TestShelveInstance-765407413 tempest-TestShelveInstance-765407413-project-member] Lock "fae10c60-f989-4c99-bde4-60cd9f3e2055" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 17:56:27 user nova-compute[74613]: DEBUG nova.compute.manager [None req-f37f09ab-78b9-4ace-9102-3428f80ad0b3 tempest-TestShelveInstance-765407413 tempest-TestShelveInstance-765407413-project-member] [instance: fae10c60-f989-4c99-bde4-60cd9f3e2055] Starting instance... {{(pid=74613) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 29 17:56:27 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-f37f09ab-78b9-4ace-9102-3428f80ad0b3 tempest-TestShelveInstance-765407413 tempest-TestShelveInstance-765407413-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 17:56:27 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-f37f09ab-78b9-4ace-9102-3428f80ad0b3 tempest-TestShelveInstance-765407413 tempest-TestShelveInstance-765407413-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 17:56:27 user nova-compute[74613]: DEBUG nova.virt.hardware [None req-f37f09ab-78b9-4ace-9102-3428f80ad0b3 tempest-TestShelveInstance-765407413 tempest-TestShelveInstance-765407413-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74613) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 29 17:56:27 user nova-compute[74613]: INFO nova.compute.claims [None req-f37f09ab-78b9-4ace-9102-3428f80ad0b3 tempest-TestShelveInstance-765407413 tempest-TestShelveInstance-765407413-project-member] [instance: fae10c60-f989-4c99-bde4-60cd9f3e2055] Claim successful on node user
Nov 29 17:56:27 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:56:27 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:56:27 user nova-compute[74613]: DEBUG nova.compute.manager [None req-36693ddb-be8e-4239-91a2-83088b58153a tempest-ServerBootFromVolumeStableRescueTest-414665510 tempest-ServerBootFromVolumeStableRescueTest-414665510-project-member] [instance: cd22685a-028c-4e0c-834d-e7b20f6d06ab] Checking state {{(pid=74613) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 29 17:56:28 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:56:28 user nova-compute[74613]: DEBUG nova.compute.provider_tree [None req-f37f09ab-78b9-4ace-9102-3428f80ad0b3 tempest-TestShelveInstance-765407413 tempest-TestShelveInstance-765407413-project-member] Inventory has not changed in ProviderTree for provider: 639d980e-3b12-44b1-b8f4-1812416fa4dd {{(pid=74613) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 17:56:28 user nova-compute[74613]: DEBUG nova.scheduler.client.report [None req-f37f09ab-78b9-4ace-9102-3428f80ad0b3 tempest-TestShelveInstance-765407413 tempest-TestShelveInstance-765407413-project-member] Inventory has not changed for provider 639d980e-3b12-44b1-b8f4-1812416fa4dd based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74613) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 17:56:28 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-f37f09ab-78b9-4ace-9102-3428f80ad0b3 tempest-TestShelveInstance-765407413 tempest-TestShelveInstance-765407413-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.805s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 17:56:28 user nova-compute[74613]: DEBUG nova.compute.manager [None req-f37f09ab-78b9-4ace-9102-3428f80ad0b3 tempest-TestShelveInstance-765407413 tempest-TestShelveInstance-765407413-project-member] [instance: fae10c60-f989-4c99-bde4-60cd9f3e2055] Start building networks asynchronously for instance. {{(pid=74613) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 29 17:56:28 user nova-compute[74613]: DEBUG nova.compute.manager [None req-f37f09ab-78b9-4ace-9102-3428f80ad0b3 tempest-TestShelveInstance-765407413 tempest-TestShelveInstance-765407413-project-member] [instance: fae10c60-f989-4c99-bde4-60cd9f3e2055] Allocating IP information in the background. {{(pid=74613) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 29 17:56:28 user nova-compute[74613]: DEBUG nova.network.neutron [None req-f37f09ab-78b9-4ace-9102-3428f80ad0b3 tempest-TestShelveInstance-765407413 tempest-TestShelveInstance-765407413-project-member] [instance: fae10c60-f989-4c99-bde4-60cd9f3e2055] allocate_for_instance() {{(pid=74613) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 29 17:56:28 user nova-compute[74613]: INFO nova.virt.libvirt.driver [None req-f37f09ab-78b9-4ace-9102-3428f80ad0b3 tempest-TestShelveInstance-765407413 tempest-TestShelveInstance-765407413-project-member] [instance: fae10c60-f989-4c99-bde4-60cd9f3e2055] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 29 17:56:28 user nova-compute[74613]: DEBUG nova.compute.manager [None req-f37f09ab-78b9-4ace-9102-3428f80ad0b3 tempest-TestShelveInstance-765407413 tempest-TestShelveInstance-765407413-project-member] [instance: fae10c60-f989-4c99-bde4-60cd9f3e2055] Start building block device mappings for instance. {{(pid=74613) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 29 17:56:28 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:56:28 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:56:28 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:56:28 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:56:28 user nova-compute[74613]: INFO nova.virt.block_device [None req-f37f09ab-78b9-4ace-9102-3428f80ad0b3 tempest-TestShelveInstance-765407413 tempest-TestShelveInstance-765407413-project-member] [instance: fae10c60-f989-4c99-bde4-60cd9f3e2055] Booting with volume 6a07b572-6430-4d0f-9aaf-8a8dbc39831e at /dev/vda
Nov 29 17:56:28 user nova-compute[74613]: DEBUG nova.compute.manager [req-efe107dc-3a01-4342-a744-977610cb8b28 req-cdb17d5b-b2da-4592-9e4f-49cf35ee43a2 service nova] [instance: 0aa463c6-01e7-48e5-b082-e083558342e3] Received event network-vif-plugged-9e74da09-a403-40b9-aad1-3cba1f7bd9d5 {{(pid=74613) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 17:56:28 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-efe107dc-3a01-4342-a744-977610cb8b28 req-cdb17d5b-b2da-4592-9e4f-49cf35ee43a2 service nova] Acquiring lock "0aa463c6-01e7-48e5-b082-e083558342e3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 17:56:28 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-efe107dc-3a01-4342-a744-977610cb8b28 req-cdb17d5b-b2da-4592-9e4f-49cf35ee43a2 service nova] Lock "0aa463c6-01e7-48e5-b082-e083558342e3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 17:56:28 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-efe107dc-3a01-4342-a744-977610cb8b28 req-cdb17d5b-b2da-4592-9e4f-49cf35ee43a2 service nova] Lock "0aa463c6-01e7-48e5-b082-e083558342e3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 17:56:28 user nova-compute[74613]: DEBUG nova.compute.manager [req-efe107dc-3a01-4342-a744-977610cb8b28 req-cdb17d5b-b2da-4592-9e4f-49cf35ee43a2 service nova] [instance: 0aa463c6-01e7-48e5-b082-e083558342e3] No waiting events found dispatching network-vif-plugged-9e74da09-a403-40b9-aad1-3cba1f7bd9d5 {{(pid=74613) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 17:56:28 user nova-compute[74613]: WARNING nova.compute.manager [req-efe107dc-3a01-4342-a744-977610cb8b28 req-cdb17d5b-b2da-4592-9e4f-49cf35ee43a2 service nova] [instance: 0aa463c6-01e7-48e5-b082-e083558342e3] Received unexpected event network-vif-plugged-9e74da09-a403-40b9-aad1-3cba1f7bd9d5 for instance with vm_state building and task_state spawning.
Nov 29 17:56:28 user nova-compute[74613]: DEBUG os_brick.utils [None req-f37f09ab-78b9-4ace-9102-3428f80ad0b3 tempest-TestShelveInstance-765407413 tempest-TestShelveInstance-765407413-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74613) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 17:56:28 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 17:56:28 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.025s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 17:56:28 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[dbaad972-746e-401d-a315-1fa6954d2e51]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:400972819b5\n', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 17:56:28 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 17:56:28 user nova-compute[74613]: DEBUG nova.policy [None req-f37f09ab-78b9-4ace-9102-3428f80ad0b3 tempest-TestShelveInstance-765407413 tempest-TestShelveInstance-765407413-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'b4bdd0503dbb42e3a9fc3c7d3cfe3b08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c079293283c4f248bc8bae125dcfbe9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74613) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 29 17:56:28 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.018s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 17:56:28 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[707c2092-d432-4540-91c0-67130251cf31]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 17:56:28 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 17:56:28 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.020s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 17:56:28 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[f915b47d-94d3-4082-a16e-469ef8b78389]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 17:56:28 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc87103b-65c1-4453-9f9b-7fc56b7f166e]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 17:56:28 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-f37f09ab-78b9-4ace-9102-3428f80ad0b3 tempest-TestShelveInstance-765407413 tempest-TestShelveInstance-765407413-project-member] Running cmd (subprocess): nvme version {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 17:56:28 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-f37f09ab-78b9-4ace-9102-3428f80ad0b3 tempest-TestShelveInstance-765407413 tempest-TestShelveInstance-765407413-project-member] 'nvme version' failed. Not Retrying. {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 17:56:28 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.nvmeof [None req-f37f09ab-78b9-4ace-9102-3428f80ad0b3 tempest-TestShelveInstance-765407413 tempest-TestShelveInstance-765407413-project-member] nvme not present on system {{(pid=74613) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 29 17:56:28 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 17:56:28 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 17:56:28 user nova-compute[74613]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 29 17:56:28 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[598b34a9-6a7e-4b77-b561-983c7543a24b]: (4, '') {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 17:56:28 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.lightos [None req-f37f09ab-78b9-4ace-9102-3428f80ad0b3 tempest-TestShelveInstance-765407413 tempest-TestShelveInstance-765407413-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74613) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 29 17:56:28 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.lightos [None req-f37f09ab-78b9-4ace-9102-3428f80ad0b3 tempest-TestShelveInstance-765407413 tempest-TestShelveInstance-765407413-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74613) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 29 17:56:28 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.lightos [None req-f37f09ab-78b9-4ace-9102-3428f80ad0b3 tempest-TestShelveInstance-765407413 tempest-TestShelveInstance-765407413-project-member] LIGHTOS: no hostnqn found. {{(pid=74613) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 29 17:56:28 user nova-compute[74613]: DEBUG os_brick.utils [None req-f37f09ab-78b9-4ace-9102-3428f80ad0b3 tempest-TestShelveInstance-765407413 tempest-TestShelveInstance-765407413-project-member] <== get_connector_properties: return (155ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:400972819b5', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74613) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 17:56:28 user nova-compute[74613]: DEBUG nova.virt.block_device [None req-f37f09ab-78b9-4ace-9102-3428f80ad0b3 tempest-TestShelveInstance-765407413 tempest-TestShelveInstance-765407413-project-member] [instance: fae10c60-f989-4c99-bde4-60cd9f3e2055] Updating existing volume attachment record: 9a0c4b5c-4278-42b0-9747-006553d0beaf {{(pid=74613) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 29 17:56:29 user nova-compute[74613]: DEBUG nova.network.neutron [None req-f37f09ab-78b9-4ace-9102-3428f80ad0b3 tempest-TestShelveInstance-765407413 tempest-TestShelveInstance-765407413-project-member] [instance: fae10c60-f989-4c99-bde4-60cd9f3e2055] Successfully created port: 435f55bd-6b68-4466-96d8-7ca838b0a594 {{(pid=74613) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 29 17:56:30 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:56:30 user nova-compute[74613]: DEBUG nova.compute.manager [None req-1c35b467-29da-44e4-ab94-456aaf4a0f3f tempest-VolumesAdminNegativeTest-636556351 tempest-VolumesAdminNegativeTest-636556351-project-member] [instance: 0aa463c6-01e7-48e5-b082-e083558342e3] Instance event wait completed in 0 seconds for  {{(pid=74613) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 29 17:56:30 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-1c35b467-29da-44e4-ab94-456aaf4a0f3f tempest-VolumesAdminNegativeTest-636556351 tempest-VolumesAdminNegativeTest-636556351-project-member] [instance: 0aa463c6-01e7-48e5-b082-e083558342e3] Guest created on hypervisor {{(pid=74613) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 29 17:56:30 user nova-compute[74613]: INFO nova.virt.libvirt.driver [-] [instance: 0aa463c6-01e7-48e5-b082-e083558342e3] Instance spawned successfully.
Nov 29 17:56:30 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-1c35b467-29da-44e4-ab94-456aaf4a0f3f tempest-VolumesAdminNegativeTest-636556351 tempest-VolumesAdminNegativeTest-636556351-project-member] [instance: 0aa463c6-01e7-48e5-b082-e083558342e3] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74613) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 29 17:56:30 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-1c35b467-29da-44e4-ab94-456aaf4a0f3f tempest-VolumesAdminNegativeTest-636556351 tempest-VolumesAdminNegativeTest-636556351-project-member] [instance: 0aa463c6-01e7-48e5-b082-e083558342e3] Found default for hw_cdrom_bus of ide {{(pid=74613) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 17:56:30 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-1c35b467-29da-44e4-ab94-456aaf4a0f3f tempest-VolumesAdminNegativeTest-636556351 tempest-VolumesAdminNegativeTest-636556351-project-member] [instance: 0aa463c6-01e7-48e5-b082-e083558342e3] Found default for hw_disk_bus of virtio {{(pid=74613) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 17:56:30 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-1c35b467-29da-44e4-ab94-456aaf4a0f3f tempest-VolumesAdminNegativeTest-636556351 tempest-VolumesAdminNegativeTest-636556351-project-member] [instance: 0aa463c6-01e7-48e5-b082-e083558342e3] Found default for hw_input_bus of None {{(pid=74613) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 17:56:30 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-1c35b467-29da-44e4-ab94-456aaf4a0f3f tempest-VolumesAdminNegativeTest-636556351 tempest-VolumesAdminNegativeTest-636556351-project-member] [instance: 0aa463c6-01e7-48e5-b082-e083558342e3] Found default for hw_pointer_model of None {{(pid=74613) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 17:56:30 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-1c35b467-29da-44e4-ab94-456aaf4a0f3f tempest-VolumesAdminNegativeTest-636556351 tempest-VolumesAdminNegativeTest-636556351-project-member] [instance: 0aa463c6-01e7-48e5-b082-e083558342e3] Found default for hw_video_model of virtio {{(pid=74613) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 17:56:30 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-1c35b467-29da-44e4-ab94-456aaf4a0f3f tempest-VolumesAdminNegativeTest-636556351 tempest-VolumesAdminNegativeTest-636556351-project-member] [instance: 0aa463c6-01e7-48e5-b082-e083558342e3] Found default for hw_vif_model of virtio {{(pid=74613) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 17:56:30 user nova-compute[74613]: INFO nova.compute.manager [None req-1c35b467-29da-44e4-ab94-456aaf4a0f3f tempest-VolumesAdminNegativeTest-636556351 tempest-VolumesAdminNegativeTest-636556351-project-member] [instance: 0aa463c6-01e7-48e5-b082-e083558342e3] Took 6.68 seconds to spawn the instance on the hypervisor.
Nov 29 17:56:30 user nova-compute[74613]: DEBUG nova.compute.manager [None req-1c35b467-29da-44e4-ab94-456aaf4a0f3f tempest-VolumesAdminNegativeTest-636556351 tempest-VolumesAdminNegativeTest-636556351-project-member] [instance: 0aa463c6-01e7-48e5-b082-e083558342e3] Checking state {{(pid=74613) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 29 17:56:30 user nova-compute[74613]: INFO nova.compute.manager [None req-1c35b467-29da-44e4-ab94-456aaf4a0f3f tempest-VolumesAdminNegativeTest-636556351 tempest-VolumesAdminNegativeTest-636556351-project-member] [instance: 0aa463c6-01e7-48e5-b082-e083558342e3] Took 8.70 seconds to build instance.
Nov 29 17:56:30 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-1c35b467-29da-44e4-ab94-456aaf4a0f3f tempest-VolumesAdminNegativeTest-636556351 tempest-VolumesAdminNegativeTest-636556351-project-member] Lock "0aa463c6-01e7-48e5-b082-e083558342e3" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 10.258s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 17:56:30 user nova-compute[74613]: DEBUG nova.compute.manager [req-2fb4a3ad-bbb3-45fd-8b7b-c68632abaf33 req-f9c6847f-1560-49ed-98e8-71bf3a679991 service nova] [instance: 0aa463c6-01e7-48e5-b082-e083558342e3] Received event network-vif-plugged-9e74da09-a403-40b9-aad1-3cba1f7bd9d5 {{(pid=74613) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 17:56:30 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-2fb4a3ad-bbb3-45fd-8b7b-c68632abaf33 req-f9c6847f-1560-49ed-98e8-71bf3a679991 service nova] Acquiring lock "0aa463c6-01e7-48e5-b082-e083558342e3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 17:56:30 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-2fb4a3ad-bbb3-45fd-8b7b-c68632abaf33 req-f9c6847f-1560-49ed-98e8-71bf3a679991 service nova] Lock "0aa463c6-01e7-48e5-b082-e083558342e3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 17:56:30 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-2fb4a3ad-bbb3-45fd-8b7b-c68632abaf33 req-f9c6847f-1560-49ed-98e8-71bf3a679991 service nova] Lock "0aa463c6-01e7-48e5-b082-e083558342e3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 17:56:30 user nova-compute[74613]: DEBUG nova.compute.manager [req-2fb4a3ad-bbb3-45fd-8b7b-c68632abaf33 req-f9c6847f-1560-49ed-98e8-71bf3a679991 service nova] [instance: 0aa463c6-01e7-48e5-b082-e083558342e3] No waiting events found dispatching network-vif-plugged-9e74da09-a403-40b9-aad1-3cba1f7bd9d5 {{(pid=74613) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 17:56:30 user nova-compute[74613]: WARNING nova.compute.manager [req-2fb4a3ad-bbb3-45fd-8b7b-c68632abaf33 req-f9c6847f-1560-49ed-98e8-71bf3a679991 service nova] [instance: 0aa463c6-01e7-48e5-b082-e083558342e3] Received unexpected event network-vif-plugged-9e74da09-a403-40b9-aad1-3cba1f7bd9d5 for instance with vm_state active and task_state None.
Nov 29 17:56:30 user nova-compute[74613]: DEBUG nova.network.neutron [None req-f37f09ab-78b9-4ace-9102-3428f80ad0b3 tempest-TestShelveInstance-765407413 tempest-TestShelveInstance-765407413-project-member] [instance: fae10c60-f989-4c99-bde4-60cd9f3e2055] Successfully updated port: 435f55bd-6b68-4466-96d8-7ca838b0a594 {{(pid=74613) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 29 17:56:31 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-f37f09ab-78b9-4ace-9102-3428f80ad0b3 tempest-TestShelveInstance-765407413 tempest-TestShelveInstance-765407413-project-member] Acquiring lock "refresh_cache-fae10c60-f989-4c99-bde4-60cd9f3e2055" {{(pid=74613) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 17:56:31 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-f37f09ab-78b9-4ace-9102-3428f80ad0b3 tempest-TestShelveInstance-765407413 tempest-TestShelveInstance-765407413-project-member] Acquired lock "refresh_cache-fae10c60-f989-4c99-bde4-60cd9f3e2055" {{(pid=74613) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 17:56:31 user nova-compute[74613]: DEBUG nova.network.neutron [None req-f37f09ab-78b9-4ace-9102-3428f80ad0b3 tempest-TestShelveInstance-765407413 tempest-TestShelveInstance-765407413-project-member] [instance: fae10c60-f989-4c99-bde4-60cd9f3e2055] Building network info cache for instance {{(pid=74613) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 29 17:56:31 user nova-compute[74613]: DEBUG nova.network.neutron [None req-f37f09ab-78b9-4ace-9102-3428f80ad0b3 tempest-TestShelveInstance-765407413 tempest-TestShelveInstance-765407413-project-member] [instance: fae10c60-f989-4c99-bde4-60cd9f3e2055] Instance cache missing network info. {{(pid=74613) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 29 17:56:31 user nova-compute[74613]: DEBUG nova.compute.manager [req-c7ef2f4b-e72e-4676-b6d0-d8af2904d634 req-30e750f8-c772-4c1f-b196-5f35f89ad003 service nova] [instance: cd22685a-028c-4e0c-834d-e7b20f6d06ab] Received event network-vif-unplugged-5b08bd65-707e-48a5-800b-dd0670c88d61 {{(pid=74613) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 17:56:31 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-c7ef2f4b-e72e-4676-b6d0-d8af2904d634 req-30e750f8-c772-4c1f-b196-5f35f89ad003 service nova] Acquiring lock "cd22685a-028c-4e0c-834d-e7b20f6d06ab-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 17:56:31 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-c7ef2f4b-e72e-4676-b6d0-d8af2904d634 req-30e750f8-c772-4c1f-b196-5f35f89ad003 service nova] Lock "cd22685a-028c-4e0c-834d-e7b20f6d06ab-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 17:56:31 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-c7ef2f4b-e72e-4676-b6d0-d8af2904d634 req-30e750f8-c772-4c1f-b196-5f35f89ad003 service nova] Lock "cd22685a-028c-4e0c-834d-e7b20f6d06ab-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 17:56:31 user nova-compute[74613]: DEBUG nova.compute.manager [req-c7ef2f4b-e72e-4676-b6d0-d8af2904d634 req-30e750f8-c772-4c1f-b196-5f35f89ad003 service nova] [instance: cd22685a-028c-4e0c-834d-e7b20f6d06ab] No waiting events found dispatching network-vif-unplugged-5b08bd65-707e-48a5-800b-dd0670c88d61 {{(pid=74613) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 17:56:31 user nova-compute[74613]: WARNING nova.compute.manager [req-c7ef2f4b-e72e-4676-b6d0-d8af2904d634 req-30e750f8-c772-4c1f-b196-5f35f89ad003 service nova] [instance: cd22685a-028c-4e0c-834d-e7b20f6d06ab] Received unexpected event network-vif-unplugged-5b08bd65-707e-48a5-800b-dd0670c88d61 for instance with vm_state rescued and task_state None.
Nov 29 17:56:31 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:56:31 user nova-compute[74613]: DEBUG nova.network.neutron [None req-f37f09ab-78b9-4ace-9102-3428f80ad0b3 tempest-TestShelveInstance-765407413 tempest-TestShelveInstance-765407413-project-member] [instance: fae10c60-f989-4c99-bde4-60cd9f3e2055] Updating instance_info_cache with network_info: [{"id": "435f55bd-6b68-4466-96d8-7ca838b0a594", "address": "fa:16:3e:d5:66:27", "network": {"id": "3f3e011f-3d5c-4e32-bcae-cc1424ebf2d7", "bridge": "br-int", "label": "tempest-TestShelveInstance-1657844818-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5c079293283c4f248bc8bae125dcfbe9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap435f55bd-6b", "ovs_interfaceid": "435f55bd-6b68-4466-96d8-7ca838b0a594", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74613) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 17:56:31 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-f37f09ab-78b9-4ace-9102-3428f80ad0b3 tempest-TestShelveInstance-765407413 tempest-TestShelveInstance-765407413-project-member] Releasing lock "refresh_cache-fae10c60-f989-4c99-bde4-60cd9f3e2055" {{(pid=74613) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 17:56:31 user nova-compute[74613]: DEBUG nova.compute.manager [None req-f37f09ab-78b9-4ace-9102-3428f80ad0b3 tempest-TestShelveInstance-765407413 tempest-TestShelveInstance-765407413-project-member] [instance: fae10c60-f989-4c99-bde4-60cd9f3e2055] Instance network_info: |[{"id": "435f55bd-6b68-4466-96d8-7ca838b0a594", "address": "fa:16:3e:d5:66:27", "network": {"id": "3f3e011f-3d5c-4e32-bcae-cc1424ebf2d7", "bridge": "br-int", "label": "tempest-TestShelveInstance-1657844818-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5c079293283c4f248bc8bae125dcfbe9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap435f55bd-6b", "ovs_interfaceid": "435f55bd-6b68-4466-96d8-7ca838b0a594", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74613) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 29 17:56:32 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:56:33 user nova-compute[74613]: DEBUG nova.compute.manager [req-4f51eff5-1627-4700-91d7-fed4a5491061 req-ceb4c08e-787e-48ab-a168-c15d566b7d71 service nova] [instance: fae10c60-f989-4c99-bde4-60cd9f3e2055] Received event network-changed-435f55bd-6b68-4466-96d8-7ca838b0a594 {{(pid=74613) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 17:56:33 user nova-compute[74613]: DEBUG nova.compute.manager [req-4f51eff5-1627-4700-91d7-fed4a5491061 req-ceb4c08e-787e-48ab-a168-c15d566b7d71 service nova] [instance: fae10c60-f989-4c99-bde4-60cd9f3e2055] Refreshing instance network info cache due to event network-changed-435f55bd-6b68-4466-96d8-7ca838b0a594. {{(pid=74613) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 17:56:33 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-4f51eff5-1627-4700-91d7-fed4a5491061 req-ceb4c08e-787e-48ab-a168-c15d566b7d71 service nova] Acquiring lock "refresh_cache-fae10c60-f989-4c99-bde4-60cd9f3e2055" {{(pid=74613) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 17:56:33 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-4f51eff5-1627-4700-91d7-fed4a5491061 req-ceb4c08e-787e-48ab-a168-c15d566b7d71 service nova] Acquired lock "refresh_cache-fae10c60-f989-4c99-bde4-60cd9f3e2055" {{(pid=74613) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 17:56:33 user nova-compute[74613]: DEBUG nova.network.neutron [req-4f51eff5-1627-4700-91d7-fed4a5491061 req-ceb4c08e-787e-48ab-a168-c15d566b7d71 service nova] [instance: fae10c60-f989-4c99-bde4-60cd9f3e2055] Refreshing network info cache for port 435f55bd-6b68-4466-96d8-7ca838b0a594 {{(pid=74613) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 17:56:33 user nova-compute[74613]: DEBUG nova.compute.manager [req-2ebab0a3-3aa9-49c9-8ff6-2185e3870fa6 req-e8acbd01-1bab-42c9-844f-8018595f11f4 service nova] [instance: cd22685a-028c-4e0c-834d-e7b20f6d06ab] Received event network-vif-plugged-5b08bd65-707e-48a5-800b-dd0670c88d61 {{(pid=74613) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 17:56:33 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-2ebab0a3-3aa9-49c9-8ff6-2185e3870fa6 req-e8acbd01-1bab-42c9-844f-8018595f11f4 service nova] Acquiring lock "cd22685a-028c-4e0c-834d-e7b20f6d06ab-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 17:56:33 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-2ebab0a3-3aa9-49c9-8ff6-2185e3870fa6 req-e8acbd01-1bab-42c9-844f-8018595f11f4 service nova] Lock "cd22685a-028c-4e0c-834d-e7b20f6d06ab-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 17:56:33 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-2ebab0a3-3aa9-49c9-8ff6-2185e3870fa6 req-e8acbd01-1bab-42c9-844f-8018595f11f4 service nova] Lock "cd22685a-028c-4e0c-834d-e7b20f6d06ab-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 17:56:33 user nova-compute[74613]: DEBUG nova.compute.manager [req-2ebab0a3-3aa9-49c9-8ff6-2185e3870fa6 req-e8acbd01-1bab-42c9-844f-8018595f11f4 service nova] [instance: cd22685a-028c-4e0c-834d-e7b20f6d06ab] No waiting events found dispatching network-vif-plugged-5b08bd65-707e-48a5-800b-dd0670c88d61 {{(pid=74613) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 17:56:33 user nova-compute[74613]: WARNING nova.compute.manager [req-2ebab0a3-3aa9-49c9-8ff6-2185e3870fa6 req-e8acbd01-1bab-42c9-844f-8018595f11f4 service nova] [instance: cd22685a-028c-4e0c-834d-e7b20f6d06ab] Received unexpected event network-vif-plugged-5b08bd65-707e-48a5-800b-dd0670c88d61 for instance with vm_state rescued and task_state None.
Nov 29 17:56:33 user nova-compute[74613]: DEBUG nova.compute.manager [req-2ebab0a3-3aa9-49c9-8ff6-2185e3870fa6 req-e8acbd01-1bab-42c9-844f-8018595f11f4 service nova] [instance: cd22685a-028c-4e0c-834d-e7b20f6d06ab] Received event network-vif-plugged-5b08bd65-707e-48a5-800b-dd0670c88d61 {{(pid=74613) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 17:56:33 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-2ebab0a3-3aa9-49c9-8ff6-2185e3870fa6 req-e8acbd01-1bab-42c9-844f-8018595f11f4 service nova] Acquiring lock "cd22685a-028c-4e0c-834d-e7b20f6d06ab-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 17:56:33 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-2ebab0a3-3aa9-49c9-8ff6-2185e3870fa6 req-e8acbd01-1bab-42c9-844f-8018595f11f4 service nova] Lock "cd22685a-028c-4e0c-834d-e7b20f6d06ab-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 17:56:33 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-2ebab0a3-3aa9-49c9-8ff6-2185e3870fa6 req-e8acbd01-1bab-42c9-844f-8018595f11f4 service nova] Lock "cd22685a-028c-4e0c-834d-e7b20f6d06ab-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.002s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 17:56:33 user nova-compute[74613]: DEBUG nova.compute.manager [req-2ebab0a3-3aa9-49c9-8ff6-2185e3870fa6 req-e8acbd01-1bab-42c9-844f-8018595f11f4 service nova] [instance: cd22685a-028c-4e0c-834d-e7b20f6d06ab] No waiting events found dispatching network-vif-plugged-5b08bd65-707e-48a5-800b-dd0670c88d61 {{(pid=74613) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 17:56:33 user nova-compute[74613]: WARNING nova.compute.manager [req-2ebab0a3-3aa9-49c9-8ff6-2185e3870fa6 req-e8acbd01-1bab-42c9-844f-8018595f11f4 service nova] [instance: cd22685a-028c-4e0c-834d-e7b20f6d06ab] Received unexpected event network-vif-plugged-5b08bd65-707e-48a5-800b-dd0670c88d61 for instance with vm_state rescued and task_state None.
Nov 29 17:56:33 user nova-compute[74613]: DEBUG nova.compute.manager [req-2ebab0a3-3aa9-49c9-8ff6-2185e3870fa6 req-e8acbd01-1bab-42c9-844f-8018595f11f4 service nova] [instance: cd22685a-028c-4e0c-834d-e7b20f6d06ab] Received event network-vif-plugged-5b08bd65-707e-48a5-800b-dd0670c88d61 {{(pid=74613) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 17:56:33 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-2ebab0a3-3aa9-49c9-8ff6-2185e3870fa6 req-e8acbd01-1bab-42c9-844f-8018595f11f4 service nova] Acquiring lock "cd22685a-028c-4e0c-834d-e7b20f6d06ab-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 17:56:33 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-2ebab0a3-3aa9-49c9-8ff6-2185e3870fa6 req-e8acbd01-1bab-42c9-844f-8018595f11f4 service nova] Lock "cd22685a-028c-4e0c-834d-e7b20f6d06ab-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 17:56:33 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-2ebab0a3-3aa9-49c9-8ff6-2185e3870fa6 req-e8acbd01-1bab-42c9-844f-8018595f11f4 service nova] Lock "cd22685a-028c-4e0c-834d-e7b20f6d06ab-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 17:56:33 user nova-compute[74613]: DEBUG nova.compute.manager [req-2ebab0a3-3aa9-49c9-8ff6-2185e3870fa6 req-e8acbd01-1bab-42c9-844f-8018595f11f4 service nova] [instance: cd22685a-028c-4e0c-834d-e7b20f6d06ab] No waiting events found dispatching network-vif-plugged-5b08bd65-707e-48a5-800b-dd0670c88d61 {{(pid=74613) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 17:56:33 user nova-compute[74613]: WARNING nova.compute.manager [req-2ebab0a3-3aa9-49c9-8ff6-2185e3870fa6 req-e8acbd01-1bab-42c9-844f-8018595f11f4 service nova] [instance: cd22685a-028c-4e0c-834d-e7b20f6d06ab] Received unexpected event network-vif-plugged-5b08bd65-707e-48a5-800b-dd0670c88d61 for instance with vm_state rescued and task_state None.
Nov 29 17:56:33 user nova-compute[74613]: DEBUG nova.network.neutron [req-4f51eff5-1627-4700-91d7-fed4a5491061 req-ceb4c08e-787e-48ab-a168-c15d566b7d71 service nova] [instance: fae10c60-f989-4c99-bde4-60cd9f3e2055] Updated VIF entry in instance network info cache for port 435f55bd-6b68-4466-96d8-7ca838b0a594. {{(pid=74613) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 17:56:33 user nova-compute[74613]: DEBUG nova.network.neutron [req-4f51eff5-1627-4700-91d7-fed4a5491061 req-ceb4c08e-787e-48ab-a168-c15d566b7d71 service nova] [instance: fae10c60-f989-4c99-bde4-60cd9f3e2055] Updating instance_info_cache with network_info: [{"id": "435f55bd-6b68-4466-96d8-7ca838b0a594", "address": "fa:16:3e:d5:66:27", "network": {"id": "3f3e011f-3d5c-4e32-bcae-cc1424ebf2d7", "bridge": "br-int", "label": "tempest-TestShelveInstance-1657844818-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5c079293283c4f248bc8bae125dcfbe9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap435f55bd-6b", "ovs_interfaceid": "435f55bd-6b68-4466-96d8-7ca838b0a594", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74613) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 17:56:33 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-4f51eff5-1627-4700-91d7-fed4a5491061 req-ceb4c08e-787e-48ab-a168-c15d566b7d71 service nova] Releasing lock "refresh_cache-fae10c60-f989-4c99-bde4-60cd9f3e2055" {{(pid=74613) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 17:56:35 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:56:36 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:56:38 user nova-compute[74613]: DEBUG nova.compute.manager [None req-f37f09ab-78b9-4ace-9102-3428f80ad0b3 tempest-TestShelveInstance-765407413 tempest-TestShelveInstance-765407413-project-member] [instance: fae10c60-f989-4c99-bde4-60cd9f3e2055] Start spawning the instance on the hypervisor. {{(pid=74613) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 29 17:56:38 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-f37f09ab-78b9-4ace-9102-3428f80ad0b3 tempest-TestShelveInstance-765407413 tempest-TestShelveInstance-765407413-project-member] [instance: fae10c60-f989-4c99-bde4-60cd9f3e2055] Creating instance directory {{(pid=74613) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 29 17:56:38 user nova-compute[74613]: INFO nova.virt.libvirt.driver [None req-f37f09ab-78b9-4ace-9102-3428f80ad0b3 tempest-TestShelveInstance-765407413 tempest-TestShelveInstance-765407413-project-member] [instance: fae10c60-f989-4c99-bde4-60cd9f3e2055] Creating image(s)
Nov 29 17:56:38 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-f37f09ab-78b9-4ace-9102-3428f80ad0b3 tempest-TestShelveInstance-765407413 tempest-TestShelveInstance-765407413-project-member] [instance: fae10c60-f989-4c99-bde4-60cd9f3e2055] Did not create local disks {{(pid=74613) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 29 17:56:38 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-f37f09ab-78b9-4ace-9102-3428f80ad0b3 tempest-TestShelveInstance-765407413 tempest-TestShelveInstance-765407413-project-member] [instance: fae10c60-f989-4c99-bde4-60cd9f3e2055] Ensure instance console log exists: /opt/stack/data/nova/instances/fae10c60-f989-4c99-bde4-60cd9f3e2055/console.log {{(pid=74613) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 29 17:56:38 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-f37f09ab-78b9-4ace-9102-3428f80ad0b3 tempest-TestShelveInstance-765407413 tempest-TestShelveInstance-765407413-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 17:56:38 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-f37f09ab-78b9-4ace-9102-3428f80ad0b3 tempest-TestShelveInstance-765407413 tempest-TestShelveInstance-765407413-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 17:56:38 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-f37f09ab-78b9-4ace-9102-3428f80ad0b3 tempest-TestShelveInstance-765407413 tempest-TestShelveInstance-765407413-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 17:56:38 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-f37f09ab-78b9-4ace-9102-3428f80ad0b3 tempest-TestShelveInstance-765407413 tempest-TestShelveInstance-765407413-project-member] [instance: fae10c60-f989-4c99-bde4-60cd9f3e2055] Start _get_guest_xml network_info=[{"id": "435f55bd-6b68-4466-96d8-7ca838b0a594", "address": "fa:16:3e:d5:66:27", "network": {"id": "3f3e011f-3d5c-4e32-bcae-cc1424ebf2d7", "bridge": "br-int", "label": "tempest-TestShelveInstance-1657844818-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5c079293283c4f248bc8bae125dcfbe9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap435f55bd-6b", "ovs_interfaceid": "435f55bd-6b68-4466-96d8-7ca838b0a594", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:6a07b572-6430-4d0f-9aaf-8a8dbc39831e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BZedJSro', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'fae10c60-f989-4c99-bde4-60cd9f3e2055', 'attached_at': '', 'detached_at': '', 'volume_id': '6a07b572-6430-4d0f-9aaf-8a8dbc39831e', 'serial': '6a07b572-6430-4d0f-9aaf-8a8dbc39831e'}, 'mount_device': '/dev/vda', 'delete_on_termination': True, 'device_type': 'disk', 'boot_index': 0, 'guest_format': None, 'attachment_id': '9a0c4b5c-4278-42b0-9747-006553d0beaf', 'disk_bus': 'virtio', 'volume_type': None} {{(pid=74613) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 29 17:56:38 user nova-compute[74613]: WARNING nova.virt.libvirt.driver [None req-f37f09ab-78b9-4ace-9102-3428f80ad0b3 tempest-TestShelveInstance-765407413 tempest-TestShelveInstance-765407413-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 17:56:38 user nova-compute[74613]: WARNING nova.virt.libvirt.driver [None req-f37f09ab-78b9-4ace-9102-3428f80ad0b3 tempest-TestShelveInstance-765407413 tempest-TestShelveInstance-765407413-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 17:56:38 user nova-compute[74613]: DEBUG nova.virt.libvirt.host [None req-f37f09ab-78b9-4ace-9102-3428f80ad0b3 tempest-TestShelveInstance-765407413 tempest-TestShelveInstance-765407413-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74613) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 29 17:56:38 user nova-compute[74613]: DEBUG nova.virt.libvirt.host [None req-f37f09ab-78b9-4ace-9102-3428f80ad0b3 tempest-TestShelveInstance-765407413 tempest-TestShelveInstance-765407413-project-member] CPU controller missing on host. {{(pid=74613) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 29 17:56:38 user nova-compute[74613]: DEBUG nova.virt.libvirt.host [None req-f37f09ab-78b9-4ace-9102-3428f80ad0b3 tempest-TestShelveInstance-765407413 tempest-TestShelveInstance-765407413-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74613) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 29 17:56:38 user nova-compute[74613]: DEBUG nova.virt.libvirt.host [None req-f37f09ab-78b9-4ace-9102-3428f80ad0b3 tempest-TestShelveInstance-765407413 tempest-TestShelveInstance-765407413-project-member] CPU controller found on host. {{(pid=74613) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 29 17:56:38 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-f37f09ab-78b9-4ace-9102-3428f80ad0b3 tempest-TestShelveInstance-765407413 tempest-TestShelveInstance-765407413-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74613) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 29 17:56:38 user nova-compute[74613]: DEBUG nova.virt.hardware [None req-f37f09ab-78b9-4ace-9102-3428f80ad0b3 tempest-TestShelveInstance-765407413 tempest-TestShelveInstance-765407413-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-29T17:47:27Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74613) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 29 17:56:38 user nova-compute[74613]: DEBUG nova.virt.hardware [None req-f37f09ab-78b9-4ace-9102-3428f80ad0b3 tempest-TestShelveInstance-765407413 tempest-TestShelveInstance-765407413-project-member] Flavor limits 0:0:0 {{(pid=74613) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 29 17:56:38 user nova-compute[74613]: DEBUG nova.virt.hardware [None req-f37f09ab-78b9-4ace-9102-3428f80ad0b3 tempest-TestShelveInstance-765407413 tempest-TestShelveInstance-765407413-project-member] Image limits 0:0:0 {{(pid=74613) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 29 17:56:38 user nova-compute[74613]: DEBUG nova.virt.hardware [None req-f37f09ab-78b9-4ace-9102-3428f80ad0b3 tempest-TestShelveInstance-765407413 tempest-TestShelveInstance-765407413-project-member] Flavor pref 0:0:0 {{(pid=74613) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 29 17:56:38 user nova-compute[74613]: DEBUG nova.virt.hardware [None req-f37f09ab-78b9-4ace-9102-3428f80ad0b3 tempest-TestShelveInstance-765407413 tempest-TestShelveInstance-765407413-project-member] Image pref 0:0:0 {{(pid=74613) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 29 17:56:38 user nova-compute[74613]: DEBUG nova.virt.hardware [None req-f37f09ab-78b9-4ace-9102-3428f80ad0b3 tempest-TestShelveInstance-765407413 tempest-TestShelveInstance-765407413-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74613) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 29 17:56:38 user nova-compute[74613]: DEBUG nova.virt.hardware [None req-f37f09ab-78b9-4ace-9102-3428f80ad0b3 tempest-TestShelveInstance-765407413 tempest-TestShelveInstance-765407413-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74613) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 29 17:56:38 user nova-compute[74613]: DEBUG nova.virt.hardware [None req-f37f09ab-78b9-4ace-9102-3428f80ad0b3 tempest-TestShelveInstance-765407413 tempest-TestShelveInstance-765407413-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74613) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 29 17:56:38 user nova-compute[74613]: DEBUG nova.virt.hardware [None req-f37f09ab-78b9-4ace-9102-3428f80ad0b3 tempest-TestShelveInstance-765407413 tempest-TestShelveInstance-765407413-project-member] Got 1 possible topologies {{(pid=74613) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 29 17:56:38 user nova-compute[74613]: DEBUG nova.virt.hardware [None req-f37f09ab-78b9-4ace-9102-3428f80ad0b3 tempest-TestShelveInstance-765407413 tempest-TestShelveInstance-765407413-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74613) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 29 17:56:38 user nova-compute[74613]: DEBUG nova.virt.hardware [None req-f37f09ab-78b9-4ace-9102-3428f80ad0b3 tempest-TestShelveInstance-765407413 tempest-TestShelveInstance-765407413-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74613) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 29 17:56:38 user nova-compute[74613]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f37f09ab-78b9-4ace-9102-3428f80ad0b3 tempest-TestShelveInstance-765407413 tempest-TestShelveInstance-765407413-project-member] [instance: fae10c60-f989-4c99-bde4-60cd9f3e2055] Calling os-brick to attach iSCSI Volume {{(pid=74613) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 29 17:56:38 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-f37f09ab-78b9-4ace-9102-3428f80ad0b3 tempest-TestShelveInstance-765407413 tempest-TestShelveInstance-765407413-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff828156890>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:6a07b572-6430-4d0f-9aaf-8a8dbc39831e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BZedJSro', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74613) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 17:56:38 user nova-compute[74613]: WARNING os_brick.initiator.connectors.base [None req-f37f09ab-78b9-4ace-9102-3428f80ad0b3 tempest-TestShelveInstance-765407413 tempest-TestShelveInstance-765407413-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 17:56:38 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.base [None req-f37f09ab-78b9-4ace-9102-3428f80ad0b3 tempest-TestShelveInstance-765407413 tempest-TestShelveInstance-765407413-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 17:56:38 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.base [None req-f37f09ab-78b9-4ace-9102-3428f80ad0b3 tempest-TestShelveInstance-765407413 tempest-TestShelveInstance-765407413-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 17:56:38 user nova-compute[74613]: WARNING os_brick.initiator.connectors.base [None req-f37f09ab-78b9-4ace-9102-3428f80ad0b3 tempest-TestShelveInstance-765407413 tempest-TestShelveInstance-765407413-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 17:56:38 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.base [None req-f37f09ab-78b9-4ace-9102-3428f80ad0b3 tempest-TestShelveInstance-765407413 tempest-TestShelveInstance-765407413-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6a07b572-6430-4d0f-9aaf-8a8dbc39831e" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 17:56:38 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.base [None req-f37f09ab-78b9-4ace-9102-3428f80ad0b3 tempest-TestShelveInstance-765407413 tempest-TestShelveInstance-765407413-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6a07b572-6430-4d0f-9aaf-8a8dbc39831e" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 17:56:38 user nova-compute[74613]: INFO os_brick.initiator.connectors.iscsi [None req-f37f09ab-78b9-4ace-9102-3428f80ad0b3 tempest-TestShelveInstance-765407413 tempest-TestShelveInstance-765407413-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 29 17:56:38 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6a07b572-6430-4d0f-9aaf-8a8dbc39831e -p 172.16.0.220:3260 {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 17:56:38 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6a07b572-6430-4d0f-9aaf-8a8dbc39831e -p 172.16.0.220:3260" returned: 21 in 0.099s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 17:56:38 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d20e4e0-733a-459d-88b6-a96399b4cc77]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 17:56:38 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-f37f09ab-78b9-4ace-9102-3428f80ad0b3 tempest-TestShelveInstance-765407413 tempest-TestShelveInstance-765407413-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 29 17:56:38 user nova-compute[74613]:  {{(pid=74613) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 17:56:38 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6a07b572-6430-4d0f-9aaf-8a8dbc39831e -p 172.16.0.220:3260 --interface default --op new {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 17:56:38 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6a07b572-6430-4d0f-9aaf-8a8dbc39831e -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 17:56:38 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[c29257ea-aed5-44fb-9f18-d1a16fc8a11f]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:6a07b572-6430-4d0f-9aaf-8a8dbc39831e] added\n', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 17:56:38 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-f37f09ab-78b9-4ace-9102-3428f80ad0b3 tempest-TestShelveInstance-765407413 tempest-TestShelveInstance-765407413-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:6a07b572-6430-4d0f-9aaf-8a8dbc39831e] added
Nov 29 17:56:38 user nova-compute[74613]:  stderr= {{(pid=74613) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 17:56:38 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6a07b572-6430-4d0f-9aaf-8a8dbc39831e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 17:56:38 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6a07b572-6430-4d0f-9aaf-8a8dbc39831e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.065s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 17:56:38 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5d4569b-2104-4d68-99c4-c2f828c056fa]: (4, ('', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 17:56:38 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-f37f09ab-78b9-4ace-9102-3428f80ad0b3 tempest-TestShelveInstance-765407413 tempest-TestShelveInstance-765407413-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74613) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 17:56:38 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6a07b572-6430-4d0f-9aaf-8a8dbc39831e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 17:56:38 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6a07b572-6430-4d0f-9aaf-8a8dbc39831e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.068s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 17:56:38 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[290d46b0-4f63-4d40-b766-5577b98e34e7]: (4, ('', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 17:56:38 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-f37f09ab-78b9-4ace-9102-3428f80ad0b3 tempest-TestShelveInstance-765407413 tempest-TestShelveInstance-765407413-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74613) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 17:56:38 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6a07b572-6430-4d0f-9aaf-8a8dbc39831e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v BZedJSro {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 17:56:39 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6a07b572-6430-4d0f-9aaf-8a8dbc39831e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v BZedJSro" returned: 0 in 0.056s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 17:56:39 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[5eb92cac-eb3f-43ea-8d25-f0c5c85d18bc]: (4, ('', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 17:56:39 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-f37f09ab-78b9-4ace-9102-3428f80ad0b3 tempest-TestShelveInstance-765407413 tempest-TestShelveInstance-765407413-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'BZedJSro'): stdout= stderr= {{(pid=74613) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 17:56:39 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6a07b572-6430-4d0f-9aaf-8a8dbc39831e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 17:56:39 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6a07b572-6430-4d0f-9aaf-8a8dbc39831e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.026s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 17:56:39 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[21ac7621-c142-460c-85dd-f240b5dd57ea]: (4, ('', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 17:56:39 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-f37f09ab-78b9-4ace-9102-3428f80ad0b3 tempest-TestShelveInstance-765407413 tempest-TestShelveInstance-765407413-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74613) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 17:56:39 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 17:56:39 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 17:56:39 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a9be767-dfd0-465b-bc3e-38521744b0a0]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9511387c-8772-40f2-bf2d-6b6387649e9f (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:070b1031-e105-4cba-a039-2286e23727c5 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00ec83b4-5d84-416a-bad9-7511171a9da0 (non-flash)\n', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 17:56:39 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-f37f09ab-78b9-4ace-9102-3428f80ad0b3 tempest-TestShelveInstance-765407413 tempest-TestShelveInstance-765407413-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9511387c-8772-40f2-bf2d-6b6387649e9f (non-flash)
Nov 29 17:56:39 user nova-compute[74613]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:070b1031-e105-4cba-a039-2286e23727c5 (non-flash)
Nov 29 17:56:39 user nova-compute[74613]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00ec83b4-5d84-416a-bad9-7511171a9da0 (non-flash)
Nov 29 17:56:39 user nova-compute[74613]:  stderr= {{(pid=74613) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 17:56:39 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-f37f09ab-78b9-4ace-9102-3428f80ad0b3 tempest-TestShelveInstance-765407413 tempest-TestShelveInstance-765407413-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9511387c-8772-40f2-bf2d-6b6387649e9f (non-flash)
Nov 29 17:56:39 user nova-compute[74613]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:070b1031-e105-4cba-a039-2286e23727c5 (non-flash)
Nov 29 17:56:39 user nova-compute[74613]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00ec83b4-5d84-416a-bad9-7511171a9da0 (non-flash)
Nov 29 17:56:39 user nova-compute[74613]:  stderr= {{(pid=74613) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 17:56:39 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6a07b572-6430-4d0f-9aaf-8a8dbc39831e -p 172.16.0.220:3260 --login {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 17:56:39 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6a07b572-6430-4d0f-9aaf-8a8dbc39831e -p 172.16.0.220:3260 --login" returned: 0 in 0.068s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 17:56:39 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[93bd5c47-4769-4ea5-a1a8-861793631b25]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:6a07b572-6430-4d0f-9aaf-8a8dbc39831e, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:6a07b572-6430-4d0f-9aaf-8a8dbc39831e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 17:56:39 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-f37f09ab-78b9-4ace-9102-3428f80ad0b3 tempest-TestShelveInstance-765407413 tempest-TestShelveInstance-765407413-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:6a07b572-6430-4d0f-9aaf-8a8dbc39831e, portal: 172.16.0.220,3260]
Nov 29 17:56:39 user nova-compute[74613]: Login to [iface: default, target: iqn.2010-10.org.openstack:6a07b572-6430-4d0f-9aaf-8a8dbc39831e, portal: 172.16.0.220,3260] successful.
Nov 29 17:56:39 user nova-compute[74613]:  stderr= {{(pid=74613) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 17:56:39 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6a07b572-6430-4d0f-9aaf-8a8dbc39831e -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 17:56:39 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6a07b572-6430-4d0f-9aaf-8a8dbc39831e -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.025s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 17:56:39 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[4897740e-1b14-4219-b9ef-9d7f219c72ba]: (4, ('', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 17:56:39 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-f37f09ab-78b9-4ace-9102-3428f80ad0b3 tempest-TestShelveInstance-765407413 tempest-TestShelveInstance-765407413-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74613) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 17:56:39 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 17:56:39 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 17:56:39 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[abbdad53-f005-43d0-8c48-9505c8390f1d]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9511387c-8772-40f2-bf2d-6b6387649e9f (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:070b1031-e105-4cba-a039-2286e23727c5 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00ec83b4-5d84-416a-bad9-7511171a9da0 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a07b572-6430-4d0f-9aaf-8a8dbc39831e (non-flash)\n', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 17:56:39 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-f37f09ab-78b9-4ace-9102-3428f80ad0b3 tempest-TestShelveInstance-765407413 tempest-TestShelveInstance-765407413-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9511387c-8772-40f2-bf2d-6b6387649e9f (non-flash)
Nov 29 17:56:39 user nova-compute[74613]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:070b1031-e105-4cba-a039-2286e23727c5 (non-flash)
Nov 29 17:56:39 user nova-compute[74613]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00ec83b4-5d84-416a-bad9-7511171a9da0 (non-flash)
Nov 29 17:56:39 user nova-compute[74613]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a07b572-6430-4d0f-9aaf-8a8dbc39831e (non-flash)
Nov 29 17:56:39 user nova-compute[74613]:  stderr= {{(pid=74613) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 17:56:39 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-f37f09ab-78b9-4ace-9102-3428f80ad0b3 tempest-TestShelveInstance-765407413 tempest-TestShelveInstance-765407413-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9511387c-8772-40f2-bf2d-6b6387649e9f (non-flash)
Nov 29 17:56:39 user nova-compute[74613]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:070b1031-e105-4cba-a039-2286e23727c5 (non-flash)
Nov 29 17:56:39 user nova-compute[74613]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00ec83b4-5d84-416a-bad9-7511171a9da0 (non-flash)
Nov 29 17:56:39 user nova-compute[74613]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a07b572-6430-4d0f-9aaf-8a8dbc39831e (non-flash)
Nov 29 17:56:39 user nova-compute[74613]:  stderr= {{(pid=74613) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 17:56:39 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.base [None req-f37f09ab-78b9-4ace-9102-3428f80ad0b3 tempest-TestShelveInstance-765407413 tempest-TestShelveInstance-765407413-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6a07b572-6430-4d0f-9aaf-8a8dbc39831e" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.562s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 17:56:39 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-f37f09ab-78b9-4ace-9102-3428f80ad0b3 tempest-TestShelveInstance-765407413 tempest-TestShelveInstance-765407413-project-member] Connected to 172.16.0.220:3260 {{(pid=74613) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 29 17:56:39 user nova-compute[74613]: DEBUG os_brick.initiator.linuxscsi [None req-f37f09ab-78b9-4ace-9102-3428f80ad0b3 tempest-TestShelveInstance-765407413 tempest-TestShelveInstance-765407413-project-member] HCTL ('36', '-', '-', 0) found on session 17 with lun 0 {{(pid=74613) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 29 17:56:39 user nova-compute[74613]: DEBUG os_brick.initiator.linuxscsi [None req-f37f09ab-78b9-4ace-9102-3428f80ad0b3 tempest-TestShelveInstance-765407413 tempest-TestShelveInstance-765407413-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=74613) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 29 17:56:39 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 17:56:39 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.019s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 17:56:39 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[1cc2e4b3-b47c-45e3-89cf-58b669f1bf96]: (4, ('- - 0', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 17:56:39 user nova-compute[74613]: DEBUG os_brick.initiator.linuxscsi [None req-f37f09ab-78b9-4ace-9102-3428f80ad0b3 tempest-TestShelveInstance-765407413 tempest-TestShelveInstance-765407413-project-member] Searching for a device in session 17 and hctl ['36', '*', '*', 0] yield: None {{(pid=74613) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 29 17:56:40 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:56:40 user nova-compute[74613]: DEBUG os_brick.initiator.linuxscsi [None req-f37f09ab-78b9-4ace-9102-3428f80ad0b3 tempest-TestShelveInstance-765407413 tempest-TestShelveInstance-765407413-project-member] Searching for a device in session 17 and hctl ['36', '*', '*', 0] yield: sde {{(pid=74613) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 29 17:56:40 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-f37f09ab-78b9-4ace-9102-3428f80ad0b3 tempest-TestShelveInstance-765407413 tempest-TestShelveInstance-765407413-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:6a07b572-6430-4d0f-9aaf-8a8dbc39831e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BZedJSro', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74613) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 29 17:56:40 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.base [None req-f37f09ab-78b9-4ace-9102-3428f80ad0b3 tempest-TestShelveInstance-765407413 tempest-TestShelveInstance-765407413-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.595s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 17:56:40 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-f37f09ab-78b9-4ace-9102-3428f80ad0b3 tempest-TestShelveInstance-765407413 tempest-TestShelveInstance-765407413-project-member] <== connect_volume: return (1597ms) {'type': 'block', 'scsi_wwn': '23739313463633162', 'path': '/dev/sde'} {{(pid=74613) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 17:56:40 user nova-compute[74613]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f37f09ab-78b9-4ace-9102-3428f80ad0b3 tempest-TestShelveInstance-765407413 tempest-TestShelveInstance-765407413-project-member] [instance: fae10c60-f989-4c99-bde4-60cd9f3e2055] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23739313463633162', 'path': '/dev/sde'} {{(pid=74613) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 29 17:56:40 user nova-compute[74613]: DEBUG nova.virt.libvirt.vif [None req-f37f09ab-78b9-4ace-9102-3428f80ad0b3 tempest-TestShelveInstance-765407413 tempest-TestShelveInstance-765407413-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T17:56:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestShelveInstance-server-1000519643',display_name='tempest-TestShelveInstance-server-1000519643',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-1000519643',id=17,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIf0ckq9VTzT5zGxHlDNferoBY2qwcYhFAXkrikI+NkgwSPctxoKzz9bP5zmVCPOQOOhQGndx3fZHEpLC6hFyIVKKa+ebw7eRNhm0TtBMSe+I3x4HRsQTY3UyYkb58qQfQ==',key_name='tempest-TestShelveInstance-195591000',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5c079293283c4f248bc8bae125dcfbe9',ramdisk_id='',reservation_id='r-a58ey1iu',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestShelveInstance-765407413',owner_user_name='tempest-TestShelveInstance-765407413-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T17:56:29Z,user_data=None,user_id='b4bdd0503dbb42e3a9fc3c7d3cfe3b08',uuid=fae10c60-f989-4c99-bde4-60cd9f3e2055,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "435f55bd-6b68-4466-96d8-7ca838b0a594", "address": "fa:16:3e:d5:66:27", "network": {"id": "3f3e011f-3d5c-4e32-bcae-cc1424ebf2d7", "bridge": "br-int", "label": "tempest-TestShelveInstance-1657844818-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5c079293283c4f248bc8bae125dcfbe9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap435f55bd-6b", "ovs_interfaceid": "435f55bd-6b68-4466-96d8-7ca838b0a594", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74613) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 29 17:56:40 user nova-compute[74613]: DEBUG nova.network.os_vif_util [None req-f37f09ab-78b9-4ace-9102-3428f80ad0b3 tempest-TestShelveInstance-765407413 tempest-TestShelveInstance-765407413-project-member] Converting VIF {"id": "435f55bd-6b68-4466-96d8-7ca838b0a594", "address": "fa:16:3e:d5:66:27", "network": {"id": "3f3e011f-3d5c-4e32-bcae-cc1424ebf2d7", "bridge": "br-int", "label": "tempest-TestShelveInstance-1657844818-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5c079293283c4f248bc8bae125dcfbe9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap435f55bd-6b", "ovs_interfaceid": "435f55bd-6b68-4466-96d8-7ca838b0a594", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74613) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 17:56:40 user nova-compute[74613]: DEBUG nova.network.os_vif_util [None req-f37f09ab-78b9-4ace-9102-3428f80ad0b3 tempest-TestShelveInstance-765407413 tempest-TestShelveInstance-765407413-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d5:66:27,bridge_name='br-int',has_traffic_filtering=True,id=435f55bd-6b68-4466-96d8-7ca838b0a594,network=Network(3f3e011f-3d5c-4e32-bcae-cc1424ebf2d7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap435f55bd-6b') {{(pid=74613) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 17:56:40 user nova-compute[74613]: DEBUG nova.objects.instance [None req-f37f09ab-78b9-4ace-9102-3428f80ad0b3 tempest-TestShelveInstance-765407413 tempest-TestShelveInstance-765407413-project-member] Lazy-loading 'pci_devices' on Instance uuid fae10c60-f989-4c99-bde4-60cd9f3e2055 {{(pid=74613) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 17:56:40 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-f37f09ab-78b9-4ace-9102-3428f80ad0b3 tempest-TestShelveInstance-765407413 tempest-TestShelveInstance-765407413-project-member] [instance: fae10c60-f989-4c99-bde4-60cd9f3e2055] End _get_guest_xml xml=<domain type="kvm">
Nov 29 17:56:40 user nova-compute[74613]:   <uuid>fae10c60-f989-4c99-bde4-60cd9f3e2055</uuid>
Nov 29 17:56:40 user nova-compute[74613]:   <name>instance-00000011</name>
Nov 29 17:56:40 user nova-compute[74613]:   <memory>524288</memory>
Nov 29 17:56:40 user nova-compute[74613]:   <vcpu>1</vcpu>
Nov 29 17:56:40 user nova-compute[74613]:   <metadata>
Nov 29 17:56:40 user nova-compute[74613]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 29 17:56:40 user nova-compute[74613]:       <nova:package version="0.0.0"/>
Nov 29 17:56:40 user nova-compute[74613]:       <nova:name>tempest-TestShelveInstance-server-1000519643</nova:name>
Nov 29 17:56:40 user nova-compute[74613]:       <nova:creationTime>2023-11-29 17:56:38</nova:creationTime>
Nov 29 17:56:40 user nova-compute[74613]:       <nova:flavor name="m1.tiny">
Nov 29 17:56:40 user nova-compute[74613]:         <nova:memory>512</nova:memory>
Nov 29 17:56:40 user nova-compute[74613]:         <nova:disk>1</nova:disk>
Nov 29 17:56:40 user nova-compute[74613]:         <nova:swap>0</nova:swap>
Nov 29 17:56:40 user nova-compute[74613]:         <nova:ephemeral>0</nova:ephemeral>
Nov 29 17:56:40 user nova-compute[74613]:         <nova:vcpus>1</nova:vcpus>
Nov 29 17:56:40 user nova-compute[74613]:       </nova:flavor>
Nov 29 17:56:40 user nova-compute[74613]:       <nova:owner>
Nov 29 17:56:40 user nova-compute[74613]:         <nova:user uuid="b4bdd0503dbb42e3a9fc3c7d3cfe3b08">tempest-TestShelveInstance-765407413-project-member</nova:user>
Nov 29 17:56:40 user nova-compute[74613]:         <nova:project uuid="5c079293283c4f248bc8bae125dcfbe9">tempest-TestShelveInstance-765407413</nova:project>
Nov 29 17:56:40 user nova-compute[74613]:       </nova:owner>
Nov 29 17:56:40 user nova-compute[74613]:       <nova:ports>
Nov 29 17:56:40 user nova-compute[74613]:         <nova:port uuid="435f55bd-6b68-4466-96d8-7ca838b0a594">
Nov 29 17:56:40 user nova-compute[74613]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Nov 29 17:56:40 user nova-compute[74613]:         </nova:port>
Nov 29 17:56:40 user nova-compute[74613]:       </nova:ports>
Nov 29 17:56:40 user nova-compute[74613]:     </nova:instance>
Nov 29 17:56:40 user nova-compute[74613]:   </metadata>
Nov 29 17:56:40 user nova-compute[74613]:   <sysinfo type="smbios">
Nov 29 17:56:40 user nova-compute[74613]:     <system>
Nov 29 17:56:40 user nova-compute[74613]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 29 17:56:40 user nova-compute[74613]:       <entry name="product">OpenStack Nova</entry>
Nov 29 17:56:40 user nova-compute[74613]:       <entry name="version">0.0.0</entry>
Nov 29 17:56:40 user nova-compute[74613]:       <entry name="serial">fae10c60-f989-4c99-bde4-60cd9f3e2055</entry>
Nov 29 17:56:40 user nova-compute[74613]:       <entry name="uuid">fae10c60-f989-4c99-bde4-60cd9f3e2055</entry>
Nov 29 17:56:40 user nova-compute[74613]:       <entry name="family">Virtual Machine</entry>
Nov 29 17:56:40 user nova-compute[74613]:     </system>
Nov 29 17:56:40 user nova-compute[74613]:   </sysinfo>
Nov 29 17:56:40 user nova-compute[74613]:   <os>
Nov 29 17:56:40 user nova-compute[74613]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 29 17:56:40 user nova-compute[74613]:     <boot dev="hd"/>
Nov 29 17:56:40 user nova-compute[74613]:     <smbios mode="sysinfo"/>
Nov 29 17:56:40 user nova-compute[74613]:   </os>
Nov 29 17:56:40 user nova-compute[74613]:   <features>
Nov 29 17:56:40 user nova-compute[74613]:     <acpi/>
Nov 29 17:56:40 user nova-compute[74613]:     <apic/>
Nov 29 17:56:40 user nova-compute[74613]:     <vmcoreinfo/>
Nov 29 17:56:40 user nova-compute[74613]:   </features>
Nov 29 17:56:40 user nova-compute[74613]:   <clock offset="utc">
Nov 29 17:56:40 user nova-compute[74613]:     <timer name="pit" tickpolicy="delay"/>
Nov 29 17:56:40 user nova-compute[74613]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 29 17:56:40 user nova-compute[74613]:     <timer name="hpet" present="no"/>
Nov 29 17:56:40 user nova-compute[74613]:   </clock>
Nov 29 17:56:40 user nova-compute[74613]:   <cpu mode="custom" match="exact">
Nov 29 17:56:40 user nova-compute[74613]:     <model>Nehalem</model>
Nov 29 17:56:40 user nova-compute[74613]:     <topology sockets="1" cores="1" threads="1"/>
Nov 29 17:56:40 user nova-compute[74613]:   </cpu>
Nov 29 17:56:40 user nova-compute[74613]:   <devices>
Nov 29 17:56:40 user nova-compute[74613]:     <disk type="block" device="disk">
Nov 29 17:56:40 user nova-compute[74613]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 17:56:40 user nova-compute[74613]:       <source dev="/dev/sde"/>
Nov 29 17:56:40 user nova-compute[74613]:       <target dev="vda" bus="virtio"/>
Nov 29 17:56:40 user nova-compute[74613]:       <serial>6a07b572-6430-4d0f-9aaf-8a8dbc39831e</serial>
Nov 29 17:56:40 user nova-compute[74613]:     </disk>
Nov 29 17:56:40 user nova-compute[74613]:     <interface type="ethernet">
Nov 29 17:56:40 user nova-compute[74613]:       <mac address="fa:16:3e:d5:66:27"/>
Nov 29 17:56:40 user nova-compute[74613]:       <model type="virtio"/>
Nov 29 17:56:40 user nova-compute[74613]:       <mtu size="1442"/>
Nov 29 17:56:40 user nova-compute[74613]:       <target dev="tap435f55bd-6b"/>
Nov 29 17:56:40 user nova-compute[74613]:     </interface>
Nov 29 17:56:40 user nova-compute[74613]:     <serial type="pty">
Nov 29 17:56:40 user nova-compute[74613]:       <log file="/opt/stack/data/nova/instances/fae10c60-f989-4c99-bde4-60cd9f3e2055/console.log" append="off"/>
Nov 29 17:56:40 user nova-compute[74613]:     </serial>
Nov 29 17:56:40 user nova-compute[74613]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 29 17:56:40 user nova-compute[74613]:     <video>
Nov 29 17:56:40 user nova-compute[74613]:       <model type="virtio"/>
Nov 29 17:56:40 user nova-compute[74613]:     </video>
Nov 29 17:56:40 user nova-compute[74613]:     <rng model="virtio">
Nov 29 17:56:40 user nova-compute[74613]:       <backend model="random">/dev/urandom</backend>
Nov 29 17:56:40 user nova-compute[74613]:     </rng>
Nov 29 17:56:40 user nova-compute[74613]:     <controller type="usb" index="0" model="none"/>
Nov 29 17:56:40 user nova-compute[74613]:     <memballoon model="virtio">
Nov 29 17:56:40 user nova-compute[74613]:       <stats period="10"/>
Nov 29 17:56:40 user nova-compute[74613]:     </memballoon>
Nov 29 17:56:40 user nova-compute[74613]:   </devices>
Nov 29 17:56:40 user nova-compute[74613]: </domain>
Nov 29 17:56:40 user nova-compute[74613]:  {{(pid=74613) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 29 17:56:40 user nova-compute[74613]: DEBUG nova.virt.libvirt.vif [None req-f37f09ab-78b9-4ace-9102-3428f80ad0b3 tempest-TestShelveInstance-765407413 tempest-TestShelveInstance-765407413-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T17:56:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestShelveInstance-server-1000519643',display_name='tempest-TestShelveInstance-server-1000519643',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-1000519643',id=17,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIf0ckq9VTzT5zGxHlDNferoBY2qwcYhFAXkrikI+NkgwSPctxoKzz9bP5zmVCPOQOOhQGndx3fZHEpLC6hFyIVKKa+ebw7eRNhm0TtBMSe+I3x4HRsQTY3UyYkb58qQfQ==',key_name='tempest-TestShelveInstance-195591000',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5c079293283c4f248bc8bae125dcfbe9',ramdisk_id='',reservation_id='r-a58ey1iu',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestShelveInstance-765407413',owner_user_name='tempest-TestShelveInstance-765407413-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T17:56:29Z,user_data=None,user_id='b4bdd0503dbb42e3a9fc3c7d3cfe3b08',uuid=fae10c60-f989-4c99-bde4-60cd9f3e2055,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "435f55bd-6b68-4466-96d8-7ca838b0a594", "address": "fa:16:3e:d5:66:27", "network": {"id": "3f3e011f-3d5c-4e32-bcae-cc1424ebf2d7", "bridge": "br-int", "label": "tempest-TestShelveInstance-1657844818-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5c079293283c4f248bc8bae125dcfbe9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap435f55bd-6b", "ovs_interfaceid": "435f55bd-6b68-4466-96d8-7ca838b0a594", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74613) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 29 17:56:40 user nova-compute[74613]: DEBUG nova.network.os_vif_util [None req-f37f09ab-78b9-4ace-9102-3428f80ad0b3 tempest-TestShelveInstance-765407413 tempest-TestShelveInstance-765407413-project-member] Converting VIF {"id": "435f55bd-6b68-4466-96d8-7ca838b0a594", "address": "fa:16:3e:d5:66:27", "network": {"id": "3f3e011f-3d5c-4e32-bcae-cc1424ebf2d7", "bridge": "br-int", "label": "tempest-TestShelveInstance-1657844818-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5c079293283c4f248bc8bae125dcfbe9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap435f55bd-6b", "ovs_interfaceid": "435f55bd-6b68-4466-96d8-7ca838b0a594", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74613) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 17:56:40 user nova-compute[74613]: DEBUG nova.network.os_vif_util [None req-f37f09ab-78b9-4ace-9102-3428f80ad0b3 tempest-TestShelveInstance-765407413 tempest-TestShelveInstance-765407413-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d5:66:27,bridge_name='br-int',has_traffic_filtering=True,id=435f55bd-6b68-4466-96d8-7ca838b0a594,network=Network(3f3e011f-3d5c-4e32-bcae-cc1424ebf2d7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap435f55bd-6b') {{(pid=74613) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 17:56:40 user nova-compute[74613]: DEBUG os_vif [None req-f37f09ab-78b9-4ace-9102-3428f80ad0b3 tempest-TestShelveInstance-765407413 tempest-TestShelveInstance-765407413-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d5:66:27,bridge_name='br-int',has_traffic_filtering=True,id=435f55bd-6b68-4466-96d8-7ca838b0a594,network=Network(3f3e011f-3d5c-4e32-bcae-cc1424ebf2d7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap435f55bd-6b') {{(pid=74613) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 29 17:56:40 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:56:40 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74613) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 17:56:40 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74613) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 29 17:56:40 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:56:40 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '81c689ce-ad1f-577d-adfc-c08fb241bfc7', '_type': 'linux-noop'}}, row=False) {{(pid=74613) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 17:56:40 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:56:40 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 17:56:40 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:56:40 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap435f55bd-6b, may_exist=True, interface_attrs={}) {{(pid=74613) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 17:56:40 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap435f55bd-6b, col_values=(('qos', UUID('cbf83aa8-c07f-400f-bbf0-021357a36cc0')),), if_exists=True) {{(pid=74613) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 17:56:40 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap435f55bd-6b, col_values=(('external_ids', {'iface-id': '435f55bd-6b68-4466-96d8-7ca838b0a594', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:d5:66:27', 'vm-uuid': 'fae10c60-f989-4c99-bde4-60cd9f3e2055'}),), if_exists=True) {{(pid=74613) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 17:56:40 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:56:40 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 17:56:40 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:56:40 user nova-compute[74613]: INFO os_vif [None req-f37f09ab-78b9-4ace-9102-3428f80ad0b3 tempest-TestShelveInstance-765407413 tempest-TestShelveInstance-765407413-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d5:66:27,bridge_name='br-int',has_traffic_filtering=True,id=435f55bd-6b68-4466-96d8-7ca838b0a594,network=Network(3f3e011f-3d5c-4e32-bcae-cc1424ebf2d7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap435f55bd-6b')
Nov 29 17:56:40 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-f37f09ab-78b9-4ace-9102-3428f80ad0b3 tempest-TestShelveInstance-765407413 tempest-TestShelveInstance-765407413-project-member] No BDM found with device name vda, not building metadata. {{(pid=74613) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 17:56:40 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-f37f09ab-78b9-4ace-9102-3428f80ad0b3 tempest-TestShelveInstance-765407413 tempest-TestShelveInstance-765407413-project-member] No VIF found with MAC fa:16:3e:d5:66:27, not building metadata {{(pid=74613) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 29 17:56:41 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:56:41 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:56:41 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:56:42 user nova-compute[74613]: DEBUG nova.compute.manager [req-95bf55fe-418b-4bd3-bfd6-a3bbf0ebf7b5 req-037e71c9-2152-48db-96de-56f5a2f2bbe9 service nova] [instance: fae10c60-f989-4c99-bde4-60cd9f3e2055] Received event network-vif-plugged-435f55bd-6b68-4466-96d8-7ca838b0a594 {{(pid=74613) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 17:56:42 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-95bf55fe-418b-4bd3-bfd6-a3bbf0ebf7b5 req-037e71c9-2152-48db-96de-56f5a2f2bbe9 service nova] Acquiring lock "fae10c60-f989-4c99-bde4-60cd9f3e2055-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 17:56:42 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-95bf55fe-418b-4bd3-bfd6-a3bbf0ebf7b5 req-037e71c9-2152-48db-96de-56f5a2f2bbe9 service nova] Lock "fae10c60-f989-4c99-bde4-60cd9f3e2055-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 17:56:42 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-95bf55fe-418b-4bd3-bfd6-a3bbf0ebf7b5 req-037e71c9-2152-48db-96de-56f5a2f2bbe9 service nova] Lock "fae10c60-f989-4c99-bde4-60cd9f3e2055-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 17:56:42 user nova-compute[74613]: DEBUG nova.compute.manager [req-95bf55fe-418b-4bd3-bfd6-a3bbf0ebf7b5 req-037e71c9-2152-48db-96de-56f5a2f2bbe9 service nova] [instance: fae10c60-f989-4c99-bde4-60cd9f3e2055] No waiting events found dispatching network-vif-plugged-435f55bd-6b68-4466-96d8-7ca838b0a594 {{(pid=74613) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 17:56:42 user nova-compute[74613]: WARNING nova.compute.manager [req-95bf55fe-418b-4bd3-bfd6-a3bbf0ebf7b5 req-037e71c9-2152-48db-96de-56f5a2f2bbe9 service nova] [instance: fae10c60-f989-4c99-bde4-60cd9f3e2055] Received unexpected event network-vif-plugged-435f55bd-6b68-4466-96d8-7ca838b0a594 for instance with vm_state building and task_state spawning.
Nov 29 17:56:42 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:56:42 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:56:42 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:56:42 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:56:44 user nova-compute[74613]: DEBUG nova.compute.manager [None req-f37f09ab-78b9-4ace-9102-3428f80ad0b3 tempest-TestShelveInstance-765407413 tempest-TestShelveInstance-765407413-project-member] [instance: fae10c60-f989-4c99-bde4-60cd9f3e2055] Instance event wait completed in 0 seconds for  {{(pid=74613) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 29 17:56:44 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-f37f09ab-78b9-4ace-9102-3428f80ad0b3 tempest-TestShelveInstance-765407413 tempest-TestShelveInstance-765407413-project-member] [instance: fae10c60-f989-4c99-bde4-60cd9f3e2055] Guest created on hypervisor {{(pid=74613) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 29 17:56:44 user nova-compute[74613]: INFO nova.virt.libvirt.driver [-] [instance: fae10c60-f989-4c99-bde4-60cd9f3e2055] Instance spawned successfully.
Nov 29 17:56:44 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-f37f09ab-78b9-4ace-9102-3428f80ad0b3 tempest-TestShelveInstance-765407413 tempest-TestShelveInstance-765407413-project-member] [instance: fae10c60-f989-4c99-bde4-60cd9f3e2055] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74613) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 29 17:56:44 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-f37f09ab-78b9-4ace-9102-3428f80ad0b3 tempest-TestShelveInstance-765407413 tempest-TestShelveInstance-765407413-project-member] [instance: fae10c60-f989-4c99-bde4-60cd9f3e2055] Found default for hw_cdrom_bus of ide {{(pid=74613) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 17:56:44 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-f37f09ab-78b9-4ace-9102-3428f80ad0b3 tempest-TestShelveInstance-765407413 tempest-TestShelveInstance-765407413-project-member] [instance: fae10c60-f989-4c99-bde4-60cd9f3e2055] Found default for hw_disk_bus of virtio {{(pid=74613) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 17:56:44 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-f37f09ab-78b9-4ace-9102-3428f80ad0b3 tempest-TestShelveInstance-765407413 tempest-TestShelveInstance-765407413-project-member] [instance: fae10c60-f989-4c99-bde4-60cd9f3e2055] Found default for hw_input_bus of None {{(pid=74613) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 17:56:44 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-f37f09ab-78b9-4ace-9102-3428f80ad0b3 tempest-TestShelveInstance-765407413 tempest-TestShelveInstance-765407413-project-member] [instance: fae10c60-f989-4c99-bde4-60cd9f3e2055] Found default for hw_pointer_model of None {{(pid=74613) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 17:56:44 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-f37f09ab-78b9-4ace-9102-3428f80ad0b3 tempest-TestShelveInstance-765407413 tempest-TestShelveInstance-765407413-project-member] [instance: fae10c60-f989-4c99-bde4-60cd9f3e2055] Found default for hw_video_model of virtio {{(pid=74613) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 17:56:44 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-f37f09ab-78b9-4ace-9102-3428f80ad0b3 tempest-TestShelveInstance-765407413 tempest-TestShelveInstance-765407413-project-member] [instance: fae10c60-f989-4c99-bde4-60cd9f3e2055] Found default for hw_vif_model of virtio {{(pid=74613) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 17:56:44 user nova-compute[74613]: INFO nova.compute.manager [None req-f37f09ab-78b9-4ace-9102-3428f80ad0b3 tempest-TestShelveInstance-765407413 tempest-TestShelveInstance-765407413-project-member] [instance: fae10c60-f989-4c99-bde4-60cd9f3e2055] Took 6.20 seconds to spawn the instance on the hypervisor.
Nov 29 17:56:44 user nova-compute[74613]: DEBUG nova.compute.manager [None req-f37f09ab-78b9-4ace-9102-3428f80ad0b3 tempest-TestShelveInstance-765407413 tempest-TestShelveInstance-765407413-project-member] [instance: fae10c60-f989-4c99-bde4-60cd9f3e2055] Checking state {{(pid=74613) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 29 17:56:44 user nova-compute[74613]: DEBUG nova.compute.manager [req-738530b9-6e1e-4da3-9881-f172a0249307 req-751772ff-4a87-4cf0-ba2b-c597f29b8e1f service nova] [instance: fae10c60-f989-4c99-bde4-60cd9f3e2055] Received event network-vif-plugged-435f55bd-6b68-4466-96d8-7ca838b0a594 {{(pid=74613) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 17:56:44 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-738530b9-6e1e-4da3-9881-f172a0249307 req-751772ff-4a87-4cf0-ba2b-c597f29b8e1f service nova] Acquiring lock "fae10c60-f989-4c99-bde4-60cd9f3e2055-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 17:56:44 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-738530b9-6e1e-4da3-9881-f172a0249307 req-751772ff-4a87-4cf0-ba2b-c597f29b8e1f service nova] Lock "fae10c60-f989-4c99-bde4-60cd9f3e2055-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 17:56:44 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-738530b9-6e1e-4da3-9881-f172a0249307 req-751772ff-4a87-4cf0-ba2b-c597f29b8e1f service nova] Lock "fae10c60-f989-4c99-bde4-60cd9f3e2055-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 17:56:44 user nova-compute[74613]: DEBUG nova.compute.manager [req-738530b9-6e1e-4da3-9881-f172a0249307 req-751772ff-4a87-4cf0-ba2b-c597f29b8e1f service nova] [instance: fae10c60-f989-4c99-bde4-60cd9f3e2055] No waiting events found dispatching network-vif-plugged-435f55bd-6b68-4466-96d8-7ca838b0a594 {{(pid=74613) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 17:56:44 user nova-compute[74613]: WARNING nova.compute.manager [req-738530b9-6e1e-4da3-9881-f172a0249307 req-751772ff-4a87-4cf0-ba2b-c597f29b8e1f service nova] [instance: fae10c60-f989-4c99-bde4-60cd9f3e2055] Received unexpected event network-vif-plugged-435f55bd-6b68-4466-96d8-7ca838b0a594 for instance with vm_state building and task_state spawning.
Nov 29 17:56:44 user nova-compute[74613]: INFO nova.compute.manager [None req-f37f09ab-78b9-4ace-9102-3428f80ad0b3 tempest-TestShelveInstance-765407413 tempest-TestShelveInstance-765407413-project-member] [instance: fae10c60-f989-4c99-bde4-60cd9f3e2055] Took 17.26 seconds to build instance.
Nov 29 17:56:44 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-f37f09ab-78b9-4ace-9102-3428f80ad0b3 tempest-TestShelveInstance-765407413 tempest-TestShelveInstance-765407413-project-member] Lock "fae10c60-f989-4c99-bde4-60cd9f3e2055" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 17.382s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 17:56:45 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:56:45 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:56:49 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:56:50 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:56:50 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:56:51 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:56:55 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:56:55 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:57:00 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:57:00 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:57:03 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-4777801b-7829-4b8e-96af-62d077021d11 tempest-VolumesSnapshotTestJSON-1388493826 tempest-VolumesSnapshotTestJSON-1388493826-project-member] Acquiring lock "356478b0-e233-46aa-a1bd-45ce1f9eca8f" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 17:57:03 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-4777801b-7829-4b8e-96af-62d077021d11 tempest-VolumesSnapshotTestJSON-1388493826 tempest-VolumesSnapshotTestJSON-1388493826-project-member] Lock "356478b0-e233-46aa-a1bd-45ce1f9eca8f" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 17:57:03 user nova-compute[74613]: DEBUG nova.compute.manager [None req-4777801b-7829-4b8e-96af-62d077021d11 tempest-VolumesSnapshotTestJSON-1388493826 tempest-VolumesSnapshotTestJSON-1388493826-project-member] [instance: 356478b0-e233-46aa-a1bd-45ce1f9eca8f] Starting instance... {{(pid=74613) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 29 17:57:03 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-4777801b-7829-4b8e-96af-62d077021d11 tempest-VolumesSnapshotTestJSON-1388493826 tempest-VolumesSnapshotTestJSON-1388493826-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 17:57:03 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-4777801b-7829-4b8e-96af-62d077021d11 tempest-VolumesSnapshotTestJSON-1388493826 tempest-VolumesSnapshotTestJSON-1388493826-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.003s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 17:57:03 user nova-compute[74613]: DEBUG nova.virt.hardware [None req-4777801b-7829-4b8e-96af-62d077021d11 tempest-VolumesSnapshotTestJSON-1388493826 tempest-VolumesSnapshotTestJSON-1388493826-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74613) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 29 17:57:03 user nova-compute[74613]: INFO nova.compute.claims [None req-4777801b-7829-4b8e-96af-62d077021d11 tempest-VolumesSnapshotTestJSON-1388493826 tempest-VolumesSnapshotTestJSON-1388493826-project-member] [instance: 356478b0-e233-46aa-a1bd-45ce1f9eca8f] Claim successful on node user
Nov 29 17:57:03 user nova-compute[74613]: DEBUG nova.compute.manager [req-a7422cb9-0a3e-4eda-b281-d2168dbff00a req-324aa494-691e-40ef-b3f0-b63ab60912f7 service nova] [instance: 71f2a1ab-3df7-411c-93fa-b0a1a5a44f0a] Received event network-changed-d40a5800-7391-4206-a661-fbce50c35a65 {{(pid=74613) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 17:57:03 user nova-compute[74613]: DEBUG nova.compute.manager [req-a7422cb9-0a3e-4eda-b281-d2168dbff00a req-324aa494-691e-40ef-b3f0-b63ab60912f7 service nova] [instance: 71f2a1ab-3df7-411c-93fa-b0a1a5a44f0a] Refreshing instance network info cache due to event network-changed-d40a5800-7391-4206-a661-fbce50c35a65. {{(pid=74613) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 17:57:03 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-a7422cb9-0a3e-4eda-b281-d2168dbff00a req-324aa494-691e-40ef-b3f0-b63ab60912f7 service nova] Acquiring lock "refresh_cache-71f2a1ab-3df7-411c-93fa-b0a1a5a44f0a" {{(pid=74613) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 17:57:03 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-a7422cb9-0a3e-4eda-b281-d2168dbff00a req-324aa494-691e-40ef-b3f0-b63ab60912f7 service nova] Acquired lock "refresh_cache-71f2a1ab-3df7-411c-93fa-b0a1a5a44f0a" {{(pid=74613) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 17:57:03 user nova-compute[74613]: DEBUG nova.network.neutron [req-a7422cb9-0a3e-4eda-b281-d2168dbff00a req-324aa494-691e-40ef-b3f0-b63ab60912f7 service nova] [instance: 71f2a1ab-3df7-411c-93fa-b0a1a5a44f0a] Refreshing network info cache for port d40a5800-7391-4206-a661-fbce50c35a65 {{(pid=74613) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 17:57:03 user nova-compute[74613]: DEBUG nova.compute.provider_tree [None req-4777801b-7829-4b8e-96af-62d077021d11 tempest-VolumesSnapshotTestJSON-1388493826 tempest-VolumesSnapshotTestJSON-1388493826-project-member] Inventory has not changed in ProviderTree for provider: 639d980e-3b12-44b1-b8f4-1812416fa4dd {{(pid=74613) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 17:57:03 user nova-compute[74613]: DEBUG nova.scheduler.client.report [None req-4777801b-7829-4b8e-96af-62d077021d11 tempest-VolumesSnapshotTestJSON-1388493826 tempest-VolumesSnapshotTestJSON-1388493826-project-member] Inventory has not changed for provider 639d980e-3b12-44b1-b8f4-1812416fa4dd based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74613) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 17:57:03 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-4777801b-7829-4b8e-96af-62d077021d11 tempest-VolumesSnapshotTestJSON-1388493826 tempest-VolumesSnapshotTestJSON-1388493826-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.557s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 17:57:03 user nova-compute[74613]: DEBUG nova.compute.manager [None req-4777801b-7829-4b8e-96af-62d077021d11 tempest-VolumesSnapshotTestJSON-1388493826 tempest-VolumesSnapshotTestJSON-1388493826-project-member] [instance: 356478b0-e233-46aa-a1bd-45ce1f9eca8f] Start building networks asynchronously for instance. {{(pid=74613) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 29 17:57:03 user nova-compute[74613]: DEBUG nova.compute.manager [None req-4777801b-7829-4b8e-96af-62d077021d11 tempest-VolumesSnapshotTestJSON-1388493826 tempest-VolumesSnapshotTestJSON-1388493826-project-member] [instance: 356478b0-e233-46aa-a1bd-45ce1f9eca8f] Allocating IP information in the background. {{(pid=74613) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 29 17:57:03 user nova-compute[74613]: DEBUG nova.network.neutron [None req-4777801b-7829-4b8e-96af-62d077021d11 tempest-VolumesSnapshotTestJSON-1388493826 tempest-VolumesSnapshotTestJSON-1388493826-project-member] [instance: 356478b0-e233-46aa-a1bd-45ce1f9eca8f] allocate_for_instance() {{(pid=74613) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 29 17:57:03 user nova-compute[74613]: INFO nova.virt.libvirt.driver [None req-4777801b-7829-4b8e-96af-62d077021d11 tempest-VolumesSnapshotTestJSON-1388493826 tempest-VolumesSnapshotTestJSON-1388493826-project-member] [instance: 356478b0-e233-46aa-a1bd-45ce1f9eca8f] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 29 17:57:03 user nova-compute[74613]: DEBUG nova.network.neutron [req-a7422cb9-0a3e-4eda-b281-d2168dbff00a req-324aa494-691e-40ef-b3f0-b63ab60912f7 service nova] [instance: 71f2a1ab-3df7-411c-93fa-b0a1a5a44f0a] Updated VIF entry in instance network info cache for port d40a5800-7391-4206-a661-fbce50c35a65. {{(pid=74613) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 17:57:03 user nova-compute[74613]: DEBUG nova.network.neutron [req-a7422cb9-0a3e-4eda-b281-d2168dbff00a req-324aa494-691e-40ef-b3f0-b63ab60912f7 service nova] [instance: 71f2a1ab-3df7-411c-93fa-b0a1a5a44f0a] Updating instance_info_cache with network_info: [{"id": "d40a5800-7391-4206-a661-fbce50c35a65", "address": "fa:16:3e:1a:53:06", "network": {"id": "7c2c368e-4c7d-4d70-9a40-c10fe9541af9", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1287934102-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.120", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b1f70c311d4941c986de21ac458d11ab", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd40a5800-73", "ovs_interfaceid": "d40a5800-7391-4206-a661-fbce50c35a65", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74613) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 17:57:03 user nova-compute[74613]: DEBUG nova.compute.manager [None req-4777801b-7829-4b8e-96af-62d077021d11 tempest-VolumesSnapshotTestJSON-1388493826 tempest-VolumesSnapshotTestJSON-1388493826-project-member] [instance: 356478b0-e233-46aa-a1bd-45ce1f9eca8f] Start building block device mappings for instance. {{(pid=74613) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 29 17:57:03 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-a7422cb9-0a3e-4eda-b281-d2168dbff00a req-324aa494-691e-40ef-b3f0-b63ab60912f7 service nova] Releasing lock "refresh_cache-71f2a1ab-3df7-411c-93fa-b0a1a5a44f0a" {{(pid=74613) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 17:57:03 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-ba7bfefb-a233-474d-a8fa-c3fdfb8b2472 tempest-ServerActionsTestOtherA-1784608629 tempest-ServerActionsTestOtherA-1784608629-project-member] Acquiring lock "71f2a1ab-3df7-411c-93fa-b0a1a5a44f0a" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 17:57:03 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-ba7bfefb-a233-474d-a8fa-c3fdfb8b2472 tempest-ServerActionsTestOtherA-1784608629 tempest-ServerActionsTestOtherA-1784608629-project-member] Lock "71f2a1ab-3df7-411c-93fa-b0a1a5a44f0a" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.000s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 17:57:04 user nova-compute[74613]: DEBUG nova.objects.instance [None req-ba7bfefb-a233-474d-a8fa-c3fdfb8b2472 tempest-ServerActionsTestOtherA-1784608629 tempest-ServerActionsTestOtherA-1784608629-project-member] Lazy-loading 'flavor' on Instance uuid 71f2a1ab-3df7-411c-93fa-b0a1a5a44f0a {{(pid=74613) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 17:57:04 user nova-compute[74613]: DEBUG nova.policy [None req-4777801b-7829-4b8e-96af-62d077021d11 tempest-VolumesSnapshotTestJSON-1388493826 tempest-VolumesSnapshotTestJSON-1388493826-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '5fd84795e6684327998b0f52f5941f86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9ec113a97bd40c4b68d3738c64ece01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74613) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 29 17:57:04 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-ba7bfefb-a233-474d-a8fa-c3fdfb8b2472 tempest-ServerActionsTestOtherA-1784608629 tempest-ServerActionsTestOtherA-1784608629-project-member] Lock "71f2a1ab-3df7-411c-93fa-b0a1a5a44f0a" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.157s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 17:57:04 user nova-compute[74613]: DEBUG nova.compute.manager [None req-4777801b-7829-4b8e-96af-62d077021d11 tempest-VolumesSnapshotTestJSON-1388493826 tempest-VolumesSnapshotTestJSON-1388493826-project-member] [instance: 356478b0-e233-46aa-a1bd-45ce1f9eca8f] Start spawning the instance on the hypervisor. {{(pid=74613) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 29 17:57:04 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-4777801b-7829-4b8e-96af-62d077021d11 tempest-VolumesSnapshotTestJSON-1388493826 tempest-VolumesSnapshotTestJSON-1388493826-project-member] [instance: 356478b0-e233-46aa-a1bd-45ce1f9eca8f] Creating instance directory {{(pid=74613) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 29 17:57:04 user nova-compute[74613]: INFO nova.virt.libvirt.driver [None req-4777801b-7829-4b8e-96af-62d077021d11 tempest-VolumesSnapshotTestJSON-1388493826 tempest-VolumesSnapshotTestJSON-1388493826-project-member] [instance: 356478b0-e233-46aa-a1bd-45ce1f9eca8f] Creating image(s)
Nov 29 17:57:04 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-4777801b-7829-4b8e-96af-62d077021d11 tempest-VolumesSnapshotTestJSON-1388493826 tempest-VolumesSnapshotTestJSON-1388493826-project-member] Acquiring lock "/opt/stack/data/nova/instances/356478b0-e233-46aa-a1bd-45ce1f9eca8f/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 17:57:04 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-4777801b-7829-4b8e-96af-62d077021d11 tempest-VolumesSnapshotTestJSON-1388493826 tempest-VolumesSnapshotTestJSON-1388493826-project-member] Lock "/opt/stack/data/nova/instances/356478b0-e233-46aa-a1bd-45ce1f9eca8f/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 17:57:04 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-4777801b-7829-4b8e-96af-62d077021d11 tempest-VolumesSnapshotTestJSON-1388493826 tempest-VolumesSnapshotTestJSON-1388493826-project-member] Lock "/opt/stack/data/nova/instances/356478b0-e233-46aa-a1bd-45ce1f9eca8f/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 17:57:04 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-4777801b-7829-4b8e-96af-62d077021d11 tempest-VolumesSnapshotTestJSON-1388493826 tempest-VolumesSnapshotTestJSON-1388493826-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/21faea9e6951f3bdd0153b76ac89fe1a60a34758 --force-share --output=json {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 17:57:04 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-ba7bfefb-a233-474d-a8fa-c3fdfb8b2472 tempest-ServerActionsTestOtherA-1784608629 tempest-ServerActionsTestOtherA-1784608629-project-member] Acquiring lock "71f2a1ab-3df7-411c-93fa-b0a1a5a44f0a" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 17:57:04 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-ba7bfefb-a233-474d-a8fa-c3fdfb8b2472 tempest-ServerActionsTestOtherA-1784608629 tempest-ServerActionsTestOtherA-1784608629-project-member] Lock "71f2a1ab-3df7-411c-93fa-b0a1a5a44f0a" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.002s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 17:57:04 user nova-compute[74613]: INFO nova.compute.manager [None req-ba7bfefb-a233-474d-a8fa-c3fdfb8b2472 tempest-ServerActionsTestOtherA-1784608629 tempest-ServerActionsTestOtherA-1784608629-project-member] [instance: 71f2a1ab-3df7-411c-93fa-b0a1a5a44f0a] Attaching volume 72d22ffa-f425-4575-86a5-afbd8bb9cdd6 to /dev/vdb
Nov 29 17:57:04 user nova-compute[74613]: DEBUG os_brick.utils [None req-ba7bfefb-a233-474d-a8fa-c3fdfb8b2472 tempest-ServerActionsTestOtherA-1784608629 tempest-ServerActionsTestOtherA-1784608629-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74613) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 17:57:04 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 17:57:04 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.019s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 17:57:04 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e46dacf-7441-4ab7-bb8d-cc84382daa32]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:400972819b5\n', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 17:57:04 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 17:57:04 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 17:57:04 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[71453e2f-44d2-4bc3-a535-e18c30c44a3d]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 17:57:04 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 17:57:04 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 17:57:04 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[4586435d-2674-48b4-8364-9782998e2404]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 17:57:04 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[74b767f3-85d5-4ea0-9c0c-c8c4c811aa02]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 17:57:04 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-ba7bfefb-a233-474d-a8fa-c3fdfb8b2472 tempest-ServerActionsTestOtherA-1784608629 tempest-ServerActionsTestOtherA-1784608629-project-member] Running cmd (subprocess): nvme version {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 17:57:04 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-ba7bfefb-a233-474d-a8fa-c3fdfb8b2472 tempest-ServerActionsTestOtherA-1784608629 tempest-ServerActionsTestOtherA-1784608629-project-member] 'nvme version' failed. Not Retrying. {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 17:57:04 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.nvmeof [None req-ba7bfefb-a233-474d-a8fa-c3fdfb8b2472 tempest-ServerActionsTestOtherA-1784608629 tempest-ServerActionsTestOtherA-1784608629-project-member] nvme not present on system {{(pid=74613) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 29 17:57:04 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 17:57:04 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 17:57:04 user nova-compute[74613]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 29 17:57:04 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[621ae1a8-1865-4a85-967a-2c013997d2fb]: (4, '') {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 17:57:04 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.lightos [None req-ba7bfefb-a233-474d-a8fa-c3fdfb8b2472 tempest-ServerActionsTestOtherA-1784608629 tempest-ServerActionsTestOtherA-1784608629-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74613) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 29 17:57:04 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.lightos [None req-ba7bfefb-a233-474d-a8fa-c3fdfb8b2472 tempest-ServerActionsTestOtherA-1784608629 tempest-ServerActionsTestOtherA-1784608629-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74613) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 29 17:57:04 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.lightos [None req-ba7bfefb-a233-474d-a8fa-c3fdfb8b2472 tempest-ServerActionsTestOtherA-1784608629 tempest-ServerActionsTestOtherA-1784608629-project-member] LIGHTOS: no hostnqn found. {{(pid=74613) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 29 17:57:04 user nova-compute[74613]: DEBUG os_brick.utils [None req-ba7bfefb-a233-474d-a8fa-c3fdfb8b2472 tempest-ServerActionsTestOtherA-1784608629 tempest-ServerActionsTestOtherA-1784608629-project-member] <== get_connector_properties: return (127ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:400972819b5', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74613) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 17:57:04 user nova-compute[74613]: DEBUG nova.virt.block_device [None req-ba7bfefb-a233-474d-a8fa-c3fdfb8b2472 tempest-ServerActionsTestOtherA-1784608629 tempest-ServerActionsTestOtherA-1784608629-project-member] [instance: 71f2a1ab-3df7-411c-93fa-b0a1a5a44f0a] Updating existing volume attachment record: 77e3d717-06a4-4b56-b1ad-257e9176b42e {{(pid=74613) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 29 17:57:04 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-4777801b-7829-4b8e-96af-62d077021d11 tempest-VolumesSnapshotTestJSON-1388493826 tempest-VolumesSnapshotTestJSON-1388493826-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/21faea9e6951f3bdd0153b76ac89fe1a60a34758 --force-share --output=json" returned: 0 in 0.422s {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 17:57:04 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-4777801b-7829-4b8e-96af-62d077021d11 tempest-VolumesSnapshotTestJSON-1388493826 tempest-VolumesSnapshotTestJSON-1388493826-project-member] Acquiring lock "21faea9e6951f3bdd0153b76ac89fe1a60a34758" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 17:57:04 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-4777801b-7829-4b8e-96af-62d077021d11 tempest-VolumesSnapshotTestJSON-1388493826 tempest-VolumesSnapshotTestJSON-1388493826-project-member] Lock "21faea9e6951f3bdd0153b76ac89fe1a60a34758" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 17:57:04 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-4777801b-7829-4b8e-96af-62d077021d11 tempest-VolumesSnapshotTestJSON-1388493826 tempest-VolumesSnapshotTestJSON-1388493826-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/21faea9e6951f3bdd0153b76ac89fe1a60a34758 --force-share --output=json {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 17:57:04 user nova-compute[74613]: DEBUG nova.network.neutron [None req-4777801b-7829-4b8e-96af-62d077021d11 tempest-VolumesSnapshotTestJSON-1388493826 tempest-VolumesSnapshotTestJSON-1388493826-project-member] [instance: 356478b0-e233-46aa-a1bd-45ce1f9eca8f] Successfully created port: 22b97a14-1376-4183-a2ef-27a98a891bb9 {{(pid=74613) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 29 17:57:04 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-4777801b-7829-4b8e-96af-62d077021d11 tempest-VolumesSnapshotTestJSON-1388493826 tempest-VolumesSnapshotTestJSON-1388493826-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/21faea9e6951f3bdd0153b76ac89fe1a60a34758 --force-share --output=json" returned: 0 in 0.176s {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 17:57:04 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-4777801b-7829-4b8e-96af-62d077021d11 tempest-VolumesSnapshotTestJSON-1388493826 tempest-VolumesSnapshotTestJSON-1388493826-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/21faea9e6951f3bdd0153b76ac89fe1a60a34758,backing_fmt=raw /opt/stack/data/nova/instances/356478b0-e233-46aa-a1bd-45ce1f9eca8f/disk 1073741824 {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 17:57:04 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-4777801b-7829-4b8e-96af-62d077021d11 tempest-VolumesSnapshotTestJSON-1388493826 tempest-VolumesSnapshotTestJSON-1388493826-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/21faea9e6951f3bdd0153b76ac89fe1a60a34758,backing_fmt=raw /opt/stack/data/nova/instances/356478b0-e233-46aa-a1bd-45ce1f9eca8f/disk 1073741824" returned: 0 in 0.047s {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 17:57:04 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-4777801b-7829-4b8e-96af-62d077021d11 tempest-VolumesSnapshotTestJSON-1388493826 tempest-VolumesSnapshotTestJSON-1388493826-project-member] Lock "21faea9e6951f3bdd0153b76ac89fe1a60a34758" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.229s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 17:57:04 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-4777801b-7829-4b8e-96af-62d077021d11 tempest-VolumesSnapshotTestJSON-1388493826 tempest-VolumesSnapshotTestJSON-1388493826-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/21faea9e6951f3bdd0153b76ac89fe1a60a34758 --force-share --output=json {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 17:57:05 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-4777801b-7829-4b8e-96af-62d077021d11 tempest-VolumesSnapshotTestJSON-1388493826 tempest-VolumesSnapshotTestJSON-1388493826-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/21faea9e6951f3bdd0153b76ac89fe1a60a34758 --force-share --output=json" returned: 0 in 0.168s {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 17:57:05 user nova-compute[74613]: DEBUG nova.virt.disk.api [None req-4777801b-7829-4b8e-96af-62d077021d11 tempest-VolumesSnapshotTestJSON-1388493826 tempest-VolumesSnapshotTestJSON-1388493826-project-member] Checking if we can resize image /opt/stack/data/nova/instances/356478b0-e233-46aa-a1bd-45ce1f9eca8f/disk. size=1073741824 {{(pid=74613) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 29 17:57:05 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-4777801b-7829-4b8e-96af-62d077021d11 tempest-VolumesSnapshotTestJSON-1388493826 tempest-VolumesSnapshotTestJSON-1388493826-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/356478b0-e233-46aa-a1bd-45ce1f9eca8f/disk --force-share --output=json {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 17:57:05 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:57:05 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-4777801b-7829-4b8e-96af-62d077021d11 tempest-VolumesSnapshotTestJSON-1388493826 tempest-VolumesSnapshotTestJSON-1388493826-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/356478b0-e233-46aa-a1bd-45ce1f9eca8f/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 17:57:05 user nova-compute[74613]: DEBUG nova.virt.disk.api [None req-4777801b-7829-4b8e-96af-62d077021d11 tempest-VolumesSnapshotTestJSON-1388493826 tempest-VolumesSnapshotTestJSON-1388493826-project-member] Cannot resize image /opt/stack/data/nova/instances/356478b0-e233-46aa-a1bd-45ce1f9eca8f/disk to a smaller size. {{(pid=74613) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 29 17:57:05 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-4777801b-7829-4b8e-96af-62d077021d11 tempest-VolumesSnapshotTestJSON-1388493826 tempest-VolumesSnapshotTestJSON-1388493826-project-member] [instance: 356478b0-e233-46aa-a1bd-45ce1f9eca8f] Created local disks {{(pid=74613) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 29 17:57:05 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-4777801b-7829-4b8e-96af-62d077021d11 tempest-VolumesSnapshotTestJSON-1388493826 tempest-VolumesSnapshotTestJSON-1388493826-project-member] [instance: 356478b0-e233-46aa-a1bd-45ce1f9eca8f] Ensure instance console log exists: /opt/stack/data/nova/instances/356478b0-e233-46aa-a1bd-45ce1f9eca8f/console.log {{(pid=74613) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 29 17:57:05 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-4777801b-7829-4b8e-96af-62d077021d11 tempest-VolumesSnapshotTestJSON-1388493826 tempest-VolumesSnapshotTestJSON-1388493826-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 17:57:05 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-4777801b-7829-4b8e-96af-62d077021d11 tempest-VolumesSnapshotTestJSON-1388493826 tempest-VolumesSnapshotTestJSON-1388493826-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 17:57:05 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-4777801b-7829-4b8e-96af-62d077021d11 tempest-VolumesSnapshotTestJSON-1388493826 tempest-VolumesSnapshotTestJSON-1388493826-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 17:57:05 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-8475fd58-e80d-4854-a489-ccd5cedbc8f9 tempest-AttachVolumeShelveTestJSON-1452861425 tempest-AttachVolumeShelveTestJSON-1452861425-project-member] Acquiring lock "c19e230e-2e6c-4c20-b15c-ad81a73674b4" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 17:57:05 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-8475fd58-e80d-4854-a489-ccd5cedbc8f9 tempest-AttachVolumeShelveTestJSON-1452861425 tempest-AttachVolumeShelveTestJSON-1452861425-project-member] Lock "c19e230e-2e6c-4c20-b15c-ad81a73674b4" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 17:57:05 user nova-compute[74613]: INFO nova.compute.manager [None req-8475fd58-e80d-4854-a489-ccd5cedbc8f9 tempest-AttachVolumeShelveTestJSON-1452861425 tempest-AttachVolumeShelveTestJSON-1452861425-project-member] [instance: c19e230e-2e6c-4c20-b15c-ad81a73674b4] Detaching volume 00ec83b4-5d84-416a-bad9-7511171a9da0
Nov 29 17:57:05 user nova-compute[74613]: DEBUG nova.network.neutron [None req-4777801b-7829-4b8e-96af-62d077021d11 tempest-VolumesSnapshotTestJSON-1388493826 tempest-VolumesSnapshotTestJSON-1388493826-project-member] [instance: 356478b0-e233-46aa-a1bd-45ce1f9eca8f] Successfully updated port: 22b97a14-1376-4183-a2ef-27a98a891bb9 {{(pid=74613) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 29 17:57:05 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-4777801b-7829-4b8e-96af-62d077021d11 tempest-VolumesSnapshotTestJSON-1388493826 tempest-VolumesSnapshotTestJSON-1388493826-project-member] Acquiring lock "refresh_cache-356478b0-e233-46aa-a1bd-45ce1f9eca8f" {{(pid=74613) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 17:57:05 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-4777801b-7829-4b8e-96af-62d077021d11 tempest-VolumesSnapshotTestJSON-1388493826 tempest-VolumesSnapshotTestJSON-1388493826-project-member] Acquired lock "refresh_cache-356478b0-e233-46aa-a1bd-45ce1f9eca8f" {{(pid=74613) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 17:57:05 user nova-compute[74613]: DEBUG nova.network.neutron [None req-4777801b-7829-4b8e-96af-62d077021d11 tempest-VolumesSnapshotTestJSON-1388493826 tempest-VolumesSnapshotTestJSON-1388493826-project-member] [instance: 356478b0-e233-46aa-a1bd-45ce1f9eca8f] Building network info cache for instance {{(pid=74613) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 29 17:57:05 user nova-compute[74613]: INFO nova.virt.block_device [None req-8475fd58-e80d-4854-a489-ccd5cedbc8f9 tempest-AttachVolumeShelveTestJSON-1452861425 tempest-AttachVolumeShelveTestJSON-1452861425-project-member] [instance: c19e230e-2e6c-4c20-b15c-ad81a73674b4] Attempting to driver detach volume 00ec83b4-5d84-416a-bad9-7511171a9da0 from mountpoint /dev/vdc
Nov 29 17:57:05 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:57:05 user nova-compute[74613]: DEBUG nova.compute.manager [req-ef73c4e2-ebaa-4ea1-8b1f-eee1b1d52e3a req-701dd5ef-950d-44b1-80e5-3a344c8ff386 service nova] [instance: 356478b0-e233-46aa-a1bd-45ce1f9eca8f] Received event network-changed-22b97a14-1376-4183-a2ef-27a98a891bb9 {{(pid=74613) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 17:57:05 user nova-compute[74613]: DEBUG nova.compute.manager [req-ef73c4e2-ebaa-4ea1-8b1f-eee1b1d52e3a req-701dd5ef-950d-44b1-80e5-3a344c8ff386 service nova] [instance: 356478b0-e233-46aa-a1bd-45ce1f9eca8f] Refreshing instance network info cache due to event network-changed-22b97a14-1376-4183-a2ef-27a98a891bb9. {{(pid=74613) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 17:57:05 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-ef73c4e2-ebaa-4ea1-8b1f-eee1b1d52e3a req-701dd5ef-950d-44b1-80e5-3a344c8ff386 service nova] Acquiring lock "refresh_cache-356478b0-e233-46aa-a1bd-45ce1f9eca8f" {{(pid=74613) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 17:57:05 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-8475fd58-e80d-4854-a489-ccd5cedbc8f9 tempest-AttachVolumeShelveTestJSON-1452861425 tempest-AttachVolumeShelveTestJSON-1452861425-project-member] Attempting to detach device vdc from instance c19e230e-2e6c-4c20-b15c-ad81a73674b4 from the persistent domain config. {{(pid=74613) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 29 17:57:05 user nova-compute[74613]: DEBUG nova.virt.libvirt.guest [None req-8475fd58-e80d-4854-a489-ccd5cedbc8f9 tempest-AttachVolumeShelveTestJSON-1452861425 tempest-AttachVolumeShelveTestJSON-1452861425-project-member] detach device xml: <disk type="block" device="disk">
Nov 29 17:57:05 user nova-compute[74613]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 17:57:05 user nova-compute[74613]:   <source dev="/dev/sdd"/>
Nov 29 17:57:05 user nova-compute[74613]:   <target dev="vdc" bus="virtio"/>
Nov 29 17:57:05 user nova-compute[74613]:   <serial>00ec83b4-5d84-416a-bad9-7511171a9da0</serial>
Nov 29 17:57:05 user nova-compute[74613]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Nov 29 17:57:05 user nova-compute[74613]: </disk>
Nov 29 17:57:05 user nova-compute[74613]:  {{(pid=74613) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 29 17:57:05 user nova-compute[74613]: INFO nova.virt.libvirt.driver [None req-8475fd58-e80d-4854-a489-ccd5cedbc8f9 tempest-AttachVolumeShelveTestJSON-1452861425 tempest-AttachVolumeShelveTestJSON-1452861425-project-member] Successfully detached device vdc from instance c19e230e-2e6c-4c20-b15c-ad81a73674b4 from the persistent domain config.
Nov 29 17:57:05 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-8475fd58-e80d-4854-a489-ccd5cedbc8f9 tempest-AttachVolumeShelveTestJSON-1452861425 tempest-AttachVolumeShelveTestJSON-1452861425-project-member] (1/8): Attempting to detach device vdc with device alias virtio-disk2 from instance c19e230e-2e6c-4c20-b15c-ad81a73674b4 from the live domain config. {{(pid=74613) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 29 17:57:05 user nova-compute[74613]: DEBUG nova.virt.libvirt.guest [None req-8475fd58-e80d-4854-a489-ccd5cedbc8f9 tempest-AttachVolumeShelveTestJSON-1452861425 tempest-AttachVolumeShelveTestJSON-1452861425-project-member] detach device xml: <disk type="block" device="disk">
Nov 29 17:57:05 user nova-compute[74613]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 17:57:05 user nova-compute[74613]:   <source dev="/dev/sdd"/>
Nov 29 17:57:05 user nova-compute[74613]:   <target dev="vdc" bus="virtio"/>
Nov 29 17:57:05 user nova-compute[74613]:   <serial>00ec83b4-5d84-416a-bad9-7511171a9da0</serial>
Nov 29 17:57:05 user nova-compute[74613]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Nov 29 17:57:05 user nova-compute[74613]: </disk>
Nov 29 17:57:05 user nova-compute[74613]:  {{(pid=74613) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 29 17:57:05 user nova-compute[74613]: DEBUG nova.network.neutron [None req-4777801b-7829-4b8e-96af-62d077021d11 tempest-VolumesSnapshotTestJSON-1388493826 tempest-VolumesSnapshotTestJSON-1388493826-project-member] [instance: 356478b0-e233-46aa-a1bd-45ce1f9eca8f] Instance cache missing network info. {{(pid=74613) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 29 17:57:05 user nova-compute[74613]: DEBUG nova.network.neutron [None req-4777801b-7829-4b8e-96af-62d077021d11 tempest-VolumesSnapshotTestJSON-1388493826 tempest-VolumesSnapshotTestJSON-1388493826-project-member] [instance: 356478b0-e233-46aa-a1bd-45ce1f9eca8f] Updating instance_info_cache with network_info: [{"id": "22b97a14-1376-4183-a2ef-27a98a891bb9", "address": "fa:16:3e:42:a7:9e", "network": {"id": "4cc7e4ab-28a3-431a-9855-22009278b949", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1066409623-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a9ec113a97bd40c4b68d3738c64ece01", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap22b97a14-13", "ovs_interfaceid": "22b97a14-1376-4183-a2ef-27a98a891bb9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74613) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 17:57:05 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-4777801b-7829-4b8e-96af-62d077021d11 tempest-VolumesSnapshotTestJSON-1388493826 tempest-VolumesSnapshotTestJSON-1388493826-project-member] Releasing lock "refresh_cache-356478b0-e233-46aa-a1bd-45ce1f9eca8f" {{(pid=74613) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 17:57:05 user nova-compute[74613]: DEBUG nova.compute.manager [None req-4777801b-7829-4b8e-96af-62d077021d11 tempest-VolumesSnapshotTestJSON-1388493826 tempest-VolumesSnapshotTestJSON-1388493826-project-member] [instance: 356478b0-e233-46aa-a1bd-45ce1f9eca8f] Instance network_info: |[{"id": "22b97a14-1376-4183-a2ef-27a98a891bb9", "address": "fa:16:3e:42:a7:9e", "network": {"id": "4cc7e4ab-28a3-431a-9855-22009278b949", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1066409623-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a9ec113a97bd40c4b68d3738c64ece01", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap22b97a14-13", "ovs_interfaceid": "22b97a14-1376-4183-a2ef-27a98a891bb9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74613) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 29 17:57:05 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-ef73c4e2-ebaa-4ea1-8b1f-eee1b1d52e3a req-701dd5ef-950d-44b1-80e5-3a344c8ff386 service nova] Acquired lock "refresh_cache-356478b0-e233-46aa-a1bd-45ce1f9eca8f" {{(pid=74613) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 17:57:05 user nova-compute[74613]: DEBUG nova.network.neutron [req-ef73c4e2-ebaa-4ea1-8b1f-eee1b1d52e3a req-701dd5ef-950d-44b1-80e5-3a344c8ff386 service nova] [instance: 356478b0-e233-46aa-a1bd-45ce1f9eca8f] Refreshing network info cache for port 22b97a14-1376-4183-a2ef-27a98a891bb9 {{(pid=74613) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 17:57:05 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-4777801b-7829-4b8e-96af-62d077021d11 tempest-VolumesSnapshotTestJSON-1388493826 tempest-VolumesSnapshotTestJSON-1388493826-project-member] [instance: 356478b0-e233-46aa-a1bd-45ce1f9eca8f] Start _get_guest_xml network_info=[{"id": "22b97a14-1376-4183-a2ef-27a98a891bb9", "address": "fa:16:3e:42:a7:9e", "network": {"id": "4cc7e4ab-28a3-431a-9855-22009278b949", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1066409623-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a9ec113a97bd40c4b68d3738c64ece01", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap22b97a14-13", "ovs_interfaceid": "22b97a14-1376-4183-a2ef-27a98a891bb9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-29T17:47:38Z,direct_url=<?>,disk_format='qcow2',id=4217f428-8d9d-4ee1-9614-642d26d90c46,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='794b07cbd46a44b5865cfda741036bae',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-29T17:47:40Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'size': 0, 'device_type': 'disk', 'boot_index': 0, 'guest_format': None, 'encrypted': False, 'encryption_format': None, 'disk_bus': 'virtio', 'image_id': '4217f428-8d9d-4ee1-9614-642d26d90c46'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74613) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 29 17:57:05 user nova-compute[74613]: WARNING nova.virt.libvirt.driver [None req-4777801b-7829-4b8e-96af-62d077021d11 tempest-VolumesSnapshotTestJSON-1388493826 tempest-VolumesSnapshotTestJSON-1388493826-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 17:57:05 user nova-compute[74613]: WARNING nova.virt.libvirt.driver [None req-4777801b-7829-4b8e-96af-62d077021d11 tempest-VolumesSnapshotTestJSON-1388493826 tempest-VolumesSnapshotTestJSON-1388493826-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 17:57:05 user nova-compute[74613]: DEBUG nova.virt.libvirt.host [None req-4777801b-7829-4b8e-96af-62d077021d11 tempest-VolumesSnapshotTestJSON-1388493826 tempest-VolumesSnapshotTestJSON-1388493826-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74613) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 29 17:57:05 user nova-compute[74613]: DEBUG nova.virt.libvirt.host [None req-4777801b-7829-4b8e-96af-62d077021d11 tempest-VolumesSnapshotTestJSON-1388493826 tempest-VolumesSnapshotTestJSON-1388493826-project-member] CPU controller missing on host. {{(pid=74613) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 29 17:57:05 user nova-compute[74613]: DEBUG nova.virt.libvirt.host [None req-4777801b-7829-4b8e-96af-62d077021d11 tempest-VolumesSnapshotTestJSON-1388493826 tempest-VolumesSnapshotTestJSON-1388493826-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74613) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 29 17:57:05 user nova-compute[74613]: DEBUG nova.virt.libvirt.host [None req-4777801b-7829-4b8e-96af-62d077021d11 tempest-VolumesSnapshotTestJSON-1388493826 tempest-VolumesSnapshotTestJSON-1388493826-project-member] CPU controller found on host. {{(pid=74613) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 29 17:57:05 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-4777801b-7829-4b8e-96af-62d077021d11 tempest-VolumesSnapshotTestJSON-1388493826 tempest-VolumesSnapshotTestJSON-1388493826-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74613) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 29 17:57:05 user nova-compute[74613]: DEBUG nova.virt.hardware [None req-4777801b-7829-4b8e-96af-62d077021d11 tempest-VolumesSnapshotTestJSON-1388493826 tempest-VolumesSnapshotTestJSON-1388493826-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-29T17:47:27Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-29T17:47:38Z,direct_url=<?>,disk_format='qcow2',id=4217f428-8d9d-4ee1-9614-642d26d90c46,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='794b07cbd46a44b5865cfda741036bae',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-29T17:47:40Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74613) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 29 17:57:05 user nova-compute[74613]: DEBUG nova.virt.hardware [None req-4777801b-7829-4b8e-96af-62d077021d11 tempest-VolumesSnapshotTestJSON-1388493826 tempest-VolumesSnapshotTestJSON-1388493826-project-member] Flavor limits 0:0:0 {{(pid=74613) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 29 17:57:05 user nova-compute[74613]: DEBUG nova.virt.hardware [None req-4777801b-7829-4b8e-96af-62d077021d11 tempest-VolumesSnapshotTestJSON-1388493826 tempest-VolumesSnapshotTestJSON-1388493826-project-member] Image limits 0:0:0 {{(pid=74613) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 29 17:57:05 user nova-compute[74613]: DEBUG nova.virt.hardware [None req-4777801b-7829-4b8e-96af-62d077021d11 tempest-VolumesSnapshotTestJSON-1388493826 tempest-VolumesSnapshotTestJSON-1388493826-project-member] Flavor pref 0:0:0 {{(pid=74613) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 29 17:57:05 user nova-compute[74613]: DEBUG nova.virt.hardware [None req-4777801b-7829-4b8e-96af-62d077021d11 tempest-VolumesSnapshotTestJSON-1388493826 tempest-VolumesSnapshotTestJSON-1388493826-project-member] Image pref 0:0:0 {{(pid=74613) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 29 17:57:05 user nova-compute[74613]: DEBUG nova.virt.hardware [None req-4777801b-7829-4b8e-96af-62d077021d11 tempest-VolumesSnapshotTestJSON-1388493826 tempest-VolumesSnapshotTestJSON-1388493826-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74613) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 29 17:57:05 user nova-compute[74613]: DEBUG nova.virt.hardware [None req-4777801b-7829-4b8e-96af-62d077021d11 tempest-VolumesSnapshotTestJSON-1388493826 tempest-VolumesSnapshotTestJSON-1388493826-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74613) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 29 17:57:05 user nova-compute[74613]: DEBUG nova.virt.hardware [None req-4777801b-7829-4b8e-96af-62d077021d11 tempest-VolumesSnapshotTestJSON-1388493826 tempest-VolumesSnapshotTestJSON-1388493826-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74613) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 29 17:57:05 user nova-compute[74613]: DEBUG nova.virt.hardware [None req-4777801b-7829-4b8e-96af-62d077021d11 tempest-VolumesSnapshotTestJSON-1388493826 tempest-VolumesSnapshotTestJSON-1388493826-project-member] Got 1 possible topologies {{(pid=74613) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 29 17:57:05 user nova-compute[74613]: DEBUG nova.virt.hardware [None req-4777801b-7829-4b8e-96af-62d077021d11 tempest-VolumesSnapshotTestJSON-1388493826 tempest-VolumesSnapshotTestJSON-1388493826-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74613) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 29 17:57:05 user nova-compute[74613]: DEBUG nova.virt.hardware [None req-4777801b-7829-4b8e-96af-62d077021d11 tempest-VolumesSnapshotTestJSON-1388493826 tempest-VolumesSnapshotTestJSON-1388493826-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74613) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 29 17:57:05 user nova-compute[74613]: DEBUG nova.virt.libvirt.vif [None req-4777801b-7829-4b8e-96af-62d077021d11 tempest-VolumesSnapshotTestJSON-1388493826 tempest-VolumesSnapshotTestJSON-1388493826-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T17:57:02Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-1467786171',display_name='tempest-VolumesSnapshotTestJSON-instance-1467786171',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-1467786171',id=18,image_ref='4217f428-8d9d-4ee1-9614-642d26d90c46',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBItcjyQv5JE5O5Bk4IFr8DNRQUnKsWBNks6GyV9R8gRqwRwhS6Bnv5C1qXLJC8jbTDF7hA1uMgoah1kQfiVWn2WhmC5JGbECo8euuya+VYnBksW+a3r58TXU1UJ4eIp9wg==',key_name='tempest-keypair-1251454955',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a9ec113a97bd40c4b68d3738c64ece01',ramdisk_id='',reservation_id='r-jx9w3kac',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='4217f428-8d9d-4ee1-9614-642d26d90c46',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-1388493826',owner_user_name='tempest-VolumesSnapshotTestJSON-1388493826-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T17:57:04Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5fd84795e6684327998b0f52f5941f86',uuid=356478b0-e233-46aa-a1bd-45ce1f9eca8f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "22b97a14-1376-4183-a2ef-27a98a891bb9", "address": "fa:16:3e:42:a7:9e", "network": {"id": "4cc7e4ab-28a3-431a-9855-22009278b949", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1066409623-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a9ec113a97bd40c4b68d3738c64ece01", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap22b97a14-13", "ovs_interfaceid": "22b97a14-1376-4183-a2ef-27a98a891bb9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74613) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 29 17:57:05 user nova-compute[74613]: DEBUG nova.network.os_vif_util [None req-4777801b-7829-4b8e-96af-62d077021d11 tempest-VolumesSnapshotTestJSON-1388493826 tempest-VolumesSnapshotTestJSON-1388493826-project-member] Converting VIF {"id": "22b97a14-1376-4183-a2ef-27a98a891bb9", "address": "fa:16:3e:42:a7:9e", "network": {"id": "4cc7e4ab-28a3-431a-9855-22009278b949", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1066409623-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a9ec113a97bd40c4b68d3738c64ece01", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap22b97a14-13", "ovs_interfaceid": "22b97a14-1376-4183-a2ef-27a98a891bb9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74613) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 17:57:05 user nova-compute[74613]: DEBUG nova.network.os_vif_util [None req-4777801b-7829-4b8e-96af-62d077021d11 tempest-VolumesSnapshotTestJSON-1388493826 tempest-VolumesSnapshotTestJSON-1388493826-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:42:a7:9e,bridge_name='br-int',has_traffic_filtering=True,id=22b97a14-1376-4183-a2ef-27a98a891bb9,network=Network(4cc7e4ab-28a3-431a-9855-22009278b949),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap22b97a14-13') {{(pid=74613) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 17:57:05 user nova-compute[74613]: DEBUG nova.objects.instance [None req-4777801b-7829-4b8e-96af-62d077021d11 tempest-VolumesSnapshotTestJSON-1388493826 tempest-VolumesSnapshotTestJSON-1388493826-project-member] Lazy-loading 'pci_devices' on Instance uuid 356478b0-e233-46aa-a1bd-45ce1f9eca8f {{(pid=74613) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 17:57:05 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-4777801b-7829-4b8e-96af-62d077021d11 tempest-VolumesSnapshotTestJSON-1388493826 tempest-VolumesSnapshotTestJSON-1388493826-project-member] [instance: 356478b0-e233-46aa-a1bd-45ce1f9eca8f] End _get_guest_xml xml=<domain type="kvm">
Nov 29 17:57:05 user nova-compute[74613]:   <uuid>356478b0-e233-46aa-a1bd-45ce1f9eca8f</uuid>
Nov 29 17:57:05 user nova-compute[74613]:   <name>instance-00000012</name>
Nov 29 17:57:05 user nova-compute[74613]:   <memory>524288</memory>
Nov 29 17:57:05 user nova-compute[74613]:   <vcpu>1</vcpu>
Nov 29 17:57:05 user nova-compute[74613]:   <metadata>
Nov 29 17:57:05 user nova-compute[74613]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 29 17:57:05 user nova-compute[74613]:       <nova:package version="0.0.0"/>
Nov 29 17:57:05 user nova-compute[74613]:       <nova:name>tempest-VolumesSnapshotTestJSON-instance-1467786171</nova:name>
Nov 29 17:57:05 user nova-compute[74613]:       <nova:creationTime>2023-11-29 17:57:05</nova:creationTime>
Nov 29 17:57:05 user nova-compute[74613]:       <nova:flavor name="m1.tiny">
Nov 29 17:57:05 user nova-compute[74613]:         <nova:memory>512</nova:memory>
Nov 29 17:57:05 user nova-compute[74613]:         <nova:disk>1</nova:disk>
Nov 29 17:57:05 user nova-compute[74613]:         <nova:swap>0</nova:swap>
Nov 29 17:57:05 user nova-compute[74613]:         <nova:ephemeral>0</nova:ephemeral>
Nov 29 17:57:05 user nova-compute[74613]:         <nova:vcpus>1</nova:vcpus>
Nov 29 17:57:05 user nova-compute[74613]:       </nova:flavor>
Nov 29 17:57:05 user nova-compute[74613]:       <nova:owner>
Nov 29 17:57:05 user nova-compute[74613]:         <nova:user uuid="5fd84795e6684327998b0f52f5941f86">tempest-VolumesSnapshotTestJSON-1388493826-project-member</nova:user>
Nov 29 17:57:05 user nova-compute[74613]:         <nova:project uuid="a9ec113a97bd40c4b68d3738c64ece01">tempest-VolumesSnapshotTestJSON-1388493826</nova:project>
Nov 29 17:57:05 user nova-compute[74613]:       </nova:owner>
Nov 29 17:57:05 user nova-compute[74613]:       <nova:root type="image" uuid="4217f428-8d9d-4ee1-9614-642d26d90c46"/>
Nov 29 17:57:05 user nova-compute[74613]:       <nova:ports>
Nov 29 17:57:05 user nova-compute[74613]:         <nova:port uuid="22b97a14-1376-4183-a2ef-27a98a891bb9">
Nov 29 17:57:05 user nova-compute[74613]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Nov 29 17:57:05 user nova-compute[74613]:         </nova:port>
Nov 29 17:57:05 user nova-compute[74613]:       </nova:ports>
Nov 29 17:57:05 user nova-compute[74613]:     </nova:instance>
Nov 29 17:57:05 user nova-compute[74613]:   </metadata>
Nov 29 17:57:05 user nova-compute[74613]:   <sysinfo type="smbios">
Nov 29 17:57:05 user nova-compute[74613]:     <system>
Nov 29 17:57:05 user nova-compute[74613]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 29 17:57:05 user nova-compute[74613]:       <entry name="product">OpenStack Nova</entry>
Nov 29 17:57:05 user nova-compute[74613]:       <entry name="version">0.0.0</entry>
Nov 29 17:57:05 user nova-compute[74613]:       <entry name="serial">356478b0-e233-46aa-a1bd-45ce1f9eca8f</entry>
Nov 29 17:57:05 user nova-compute[74613]:       <entry name="uuid">356478b0-e233-46aa-a1bd-45ce1f9eca8f</entry>
Nov 29 17:57:05 user nova-compute[74613]:       <entry name="family">Virtual Machine</entry>
Nov 29 17:57:05 user nova-compute[74613]:     </system>
Nov 29 17:57:05 user nova-compute[74613]:   </sysinfo>
Nov 29 17:57:05 user nova-compute[74613]:   <os>
Nov 29 17:57:05 user nova-compute[74613]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 29 17:57:05 user nova-compute[74613]:     <boot dev="hd"/>
Nov 29 17:57:05 user nova-compute[74613]:     <smbios mode="sysinfo"/>
Nov 29 17:57:05 user nova-compute[74613]:   </os>
Nov 29 17:57:05 user nova-compute[74613]:   <features>
Nov 29 17:57:05 user nova-compute[74613]:     <acpi/>
Nov 29 17:57:05 user nova-compute[74613]:     <apic/>
Nov 29 17:57:05 user nova-compute[74613]:     <vmcoreinfo/>
Nov 29 17:57:05 user nova-compute[74613]:   </features>
Nov 29 17:57:05 user nova-compute[74613]:   <clock offset="utc">
Nov 29 17:57:05 user nova-compute[74613]:     <timer name="pit" tickpolicy="delay"/>
Nov 29 17:57:05 user nova-compute[74613]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 29 17:57:05 user nova-compute[74613]:     <timer name="hpet" present="no"/>
Nov 29 17:57:05 user nova-compute[74613]:   </clock>
Nov 29 17:57:05 user nova-compute[74613]:   <cpu mode="custom" match="exact">
Nov 29 17:57:05 user nova-compute[74613]:     <model>Nehalem</model>
Nov 29 17:57:05 user nova-compute[74613]:     <topology sockets="1" cores="1" threads="1"/>
Nov 29 17:57:05 user nova-compute[74613]:   </cpu>
Nov 29 17:57:05 user nova-compute[74613]:   <devices>
Nov 29 17:57:05 user nova-compute[74613]:     <disk type="file" device="disk">
Nov 29 17:57:05 user nova-compute[74613]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 29 17:57:05 user nova-compute[74613]:       <source file="/opt/stack/data/nova/instances/356478b0-e233-46aa-a1bd-45ce1f9eca8f/disk"/>
Nov 29 17:57:05 user nova-compute[74613]:       <target dev="vda" bus="virtio"/>
Nov 29 17:57:05 user nova-compute[74613]:     </disk>
Nov 29 17:57:05 user nova-compute[74613]:     <interface type="ethernet">
Nov 29 17:57:05 user nova-compute[74613]:       <mac address="fa:16:3e:42:a7:9e"/>
Nov 29 17:57:05 user nova-compute[74613]:       <model type="virtio"/>
Nov 29 17:57:05 user nova-compute[74613]:       <mtu size="1442"/>
Nov 29 17:57:05 user nova-compute[74613]:       <target dev="tap22b97a14-13"/>
Nov 29 17:57:05 user nova-compute[74613]:     </interface>
Nov 29 17:57:05 user nova-compute[74613]:     <serial type="pty">
Nov 29 17:57:05 user nova-compute[74613]:       <log file="/opt/stack/data/nova/instances/356478b0-e233-46aa-a1bd-45ce1f9eca8f/console.log" append="off"/>
Nov 29 17:57:05 user nova-compute[74613]:     </serial>
Nov 29 17:57:05 user nova-compute[74613]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 29 17:57:05 user nova-compute[74613]:     <video>
Nov 29 17:57:05 user nova-compute[74613]:       <model type="virtio"/>
Nov 29 17:57:05 user nova-compute[74613]:     </video>
Nov 29 17:57:05 user nova-compute[74613]:     <rng model="virtio">
Nov 29 17:57:05 user nova-compute[74613]:       <backend model="random">/dev/urandom</backend>
Nov 29 17:57:05 user nova-compute[74613]:     </rng>
Nov 29 17:57:05 user nova-compute[74613]:     <controller type="usb" index="0" model="none"/>
Nov 29 17:57:05 user nova-compute[74613]:     <memballoon model="virtio">
Nov 29 17:57:05 user nova-compute[74613]:       <stats period="10"/>
Nov 29 17:57:05 user nova-compute[74613]:     </memballoon>
Nov 29 17:57:05 user nova-compute[74613]:   </devices>
Nov 29 17:57:05 user nova-compute[74613]: </domain>
Nov 29 17:57:05 user nova-compute[74613]:  {{(pid=74613) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 29 17:57:05 user nova-compute[74613]: DEBUG nova.virt.libvirt.vif [None req-4777801b-7829-4b8e-96af-62d077021d11 tempest-VolumesSnapshotTestJSON-1388493826 tempest-VolumesSnapshotTestJSON-1388493826-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T17:57:02Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-1467786171',display_name='tempest-VolumesSnapshotTestJSON-instance-1467786171',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-1467786171',id=18,image_ref='4217f428-8d9d-4ee1-9614-642d26d90c46',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBItcjyQv5JE5O5Bk4IFr8DNRQUnKsWBNks6GyV9R8gRqwRwhS6Bnv5C1qXLJC8jbTDF7hA1uMgoah1kQfiVWn2WhmC5JGbECo8euuya+VYnBksW+a3r58TXU1UJ4eIp9wg==',key_name='tempest-keypair-1251454955',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a9ec113a97bd40c4b68d3738c64ece01',ramdisk_id='',reservation_id='r-jx9w3kac',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='4217f428-8d9d-4ee1-9614-642d26d90c46',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-1388493826',owner_user_name='tempest-VolumesSnapshotTestJSON-1388493826-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T17:57:04Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5fd84795e6684327998b0f52f5941f86',uuid=356478b0-e233-46aa-a1bd-45ce1f9eca8f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "22b97a14-1376-4183-a2ef-27a98a891bb9", "address": "fa:16:3e:42:a7:9e", "network": {"id": "4cc7e4ab-28a3-431a-9855-22009278b949", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1066409623-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a9ec113a97bd40c4b68d3738c64ece01", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap22b97a14-13", "ovs_interfaceid": "22b97a14-1376-4183-a2ef-27a98a891bb9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74613) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 29 17:57:05 user nova-compute[74613]: DEBUG nova.network.os_vif_util [None req-4777801b-7829-4b8e-96af-62d077021d11 tempest-VolumesSnapshotTestJSON-1388493826 tempest-VolumesSnapshotTestJSON-1388493826-project-member] Converting VIF {"id": "22b97a14-1376-4183-a2ef-27a98a891bb9", "address": "fa:16:3e:42:a7:9e", "network": {"id": "4cc7e4ab-28a3-431a-9855-22009278b949", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1066409623-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a9ec113a97bd40c4b68d3738c64ece01", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap22b97a14-13", "ovs_interfaceid": "22b97a14-1376-4183-a2ef-27a98a891bb9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74613) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 17:57:05 user nova-compute[74613]: DEBUG nova.network.os_vif_util [None req-4777801b-7829-4b8e-96af-62d077021d11 tempest-VolumesSnapshotTestJSON-1388493826 tempest-VolumesSnapshotTestJSON-1388493826-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:42:a7:9e,bridge_name='br-int',has_traffic_filtering=True,id=22b97a14-1376-4183-a2ef-27a98a891bb9,network=Network(4cc7e4ab-28a3-431a-9855-22009278b949),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap22b97a14-13') {{(pid=74613) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 17:57:05 user nova-compute[74613]: DEBUG os_vif [None req-4777801b-7829-4b8e-96af-62d077021d11 tempest-VolumesSnapshotTestJSON-1388493826 tempest-VolumesSnapshotTestJSON-1388493826-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:42:a7:9e,bridge_name='br-int',has_traffic_filtering=True,id=22b97a14-1376-4183-a2ef-27a98a891bb9,network=Network(4cc7e4ab-28a3-431a-9855-22009278b949),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap22b97a14-13') {{(pid=74613) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 29 17:57:05 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:57:05 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74613) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 17:57:05 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74613) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 29 17:57:05 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:57:05 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'cd8edc27-7702-514a-86e5-9c611794d6d4', '_type': 'linux-noop'}}, row=False) {{(pid=74613) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 17:57:05 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:57:05 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 17:57:05 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:57:05 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:57:05 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap22b97a14-13, may_exist=True, interface_attrs={}) {{(pid=74613) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 17:57:05 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap22b97a14-13, col_values=(('qos', UUID('055ba8fb-98bb-4a65-b8da-c21cc2967077')),), if_exists=True) {{(pid=74613) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 17:57:05 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap22b97a14-13, col_values=(('external_ids', {'iface-id': '22b97a14-1376-4183-a2ef-27a98a891bb9', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:42:a7:9e', 'vm-uuid': '356478b0-e233-46aa-a1bd-45ce1f9eca8f'}),), if_exists=True) {{(pid=74613) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 17:57:05 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:57:05 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 17:57:05 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:57:05 user nova-compute[74613]: INFO os_vif [None req-4777801b-7829-4b8e-96af-62d077021d11 tempest-VolumesSnapshotTestJSON-1388493826 tempest-VolumesSnapshotTestJSON-1388493826-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:42:a7:9e,bridge_name='br-int',has_traffic_filtering=True,id=22b97a14-1376-4183-a2ef-27a98a891bb9,network=Network(4cc7e4ab-28a3-431a-9855-22009278b949),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap22b97a14-13')
Nov 29 17:57:05 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-4777801b-7829-4b8e-96af-62d077021d11 tempest-VolumesSnapshotTestJSON-1388493826 tempest-VolumesSnapshotTestJSON-1388493826-project-member] No BDM found with device name vda, not building metadata. {{(pid=74613) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 17:57:05 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-4777801b-7829-4b8e-96af-62d077021d11 tempest-VolumesSnapshotTestJSON-1388493826 tempest-VolumesSnapshotTestJSON-1388493826-project-member] No VIF found with MAC fa:16:3e:42:a7:9e, not building metadata {{(pid=74613) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 29 17:57:05 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-8475fd58-e80d-4854-a489-ccd5cedbc8f9 tempest-AttachVolumeShelveTestJSON-1452861425 tempest-AttachVolumeShelveTestJSON-1452861425-project-member] Start waiting for the detach event from libvirt for device vdc with device alias virtio-disk2 for instance c19e230e-2e6c-4c20-b15c-ad81a73674b4 {{(pid=74613) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 29 17:57:06 user nova-compute[74613]: DEBUG nova.network.neutron [req-ef73c4e2-ebaa-4ea1-8b1f-eee1b1d52e3a req-701dd5ef-950d-44b1-80e5-3a344c8ff386 service nova] [instance: 356478b0-e233-46aa-a1bd-45ce1f9eca8f] Updated VIF entry in instance network info cache for port 22b97a14-1376-4183-a2ef-27a98a891bb9. {{(pid=74613) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 17:57:06 user nova-compute[74613]: DEBUG nova.network.neutron [req-ef73c4e2-ebaa-4ea1-8b1f-eee1b1d52e3a req-701dd5ef-950d-44b1-80e5-3a344c8ff386 service nova] [instance: 356478b0-e233-46aa-a1bd-45ce1f9eca8f] Updating instance_info_cache with network_info: [{"id": "22b97a14-1376-4183-a2ef-27a98a891bb9", "address": "fa:16:3e:42:a7:9e", "network": {"id": "4cc7e4ab-28a3-431a-9855-22009278b949", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1066409623-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a9ec113a97bd40c4b68d3738c64ece01", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap22b97a14-13", "ovs_interfaceid": "22b97a14-1376-4183-a2ef-27a98a891bb9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74613) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 17:57:06 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-ef73c4e2-ebaa-4ea1-8b1f-eee1b1d52e3a req-701dd5ef-950d-44b1-80e5-3a344c8ff386 service nova] Releasing lock "refresh_cache-356478b0-e233-46aa-a1bd-45ce1f9eca8f" {{(pid=74613) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 17:57:07 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:57:07 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:57:07 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:57:07 user nova-compute[74613]: DEBUG nova.compute.manager [req-f3f2f5f0-08b6-4c9d-a7fb-e1c267d06c69 req-cc832f3b-5a79-4a5f-9f7a-125c7c0c389a service nova] [instance: 356478b0-e233-46aa-a1bd-45ce1f9eca8f] Received event network-vif-plugged-22b97a14-1376-4183-a2ef-27a98a891bb9 {{(pid=74613) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 17:57:07 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-f3f2f5f0-08b6-4c9d-a7fb-e1c267d06c69 req-cc832f3b-5a79-4a5f-9f7a-125c7c0c389a service nova] Acquiring lock "356478b0-e233-46aa-a1bd-45ce1f9eca8f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 17:57:07 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-f3f2f5f0-08b6-4c9d-a7fb-e1c267d06c69 req-cc832f3b-5a79-4a5f-9f7a-125c7c0c389a service nova] Lock "356478b0-e233-46aa-a1bd-45ce1f9eca8f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 17:57:07 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-f3f2f5f0-08b6-4c9d-a7fb-e1c267d06c69 req-cc832f3b-5a79-4a5f-9f7a-125c7c0c389a service nova] Lock "356478b0-e233-46aa-a1bd-45ce1f9eca8f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 17:57:07 user nova-compute[74613]: DEBUG nova.compute.manager [req-f3f2f5f0-08b6-4c9d-a7fb-e1c267d06c69 req-cc832f3b-5a79-4a5f-9f7a-125c7c0c389a service nova] [instance: 356478b0-e233-46aa-a1bd-45ce1f9eca8f] No waiting events found dispatching network-vif-plugged-22b97a14-1376-4183-a2ef-27a98a891bb9 {{(pid=74613) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 17:57:07 user nova-compute[74613]: WARNING nova.compute.manager [req-f3f2f5f0-08b6-4c9d-a7fb-e1c267d06c69 req-cc832f3b-5a79-4a5f-9f7a-125c7c0c389a service nova] [instance: 356478b0-e233-46aa-a1bd-45ce1f9eca8f] Received unexpected event network-vif-plugged-22b97a14-1376-4183-a2ef-27a98a891bb9 for instance with vm_state building and task_state spawning.
Nov 29 17:57:07 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:57:07 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:57:07 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:57:09 user nova-compute[74613]: DEBUG nova.compute.manager [None req-4777801b-7829-4b8e-96af-62d077021d11 tempest-VolumesSnapshotTestJSON-1388493826 tempest-VolumesSnapshotTestJSON-1388493826-project-member] [instance: 356478b0-e233-46aa-a1bd-45ce1f9eca8f] Instance event wait completed in 0 seconds for  {{(pid=74613) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 29 17:57:09 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-4777801b-7829-4b8e-96af-62d077021d11 tempest-VolumesSnapshotTestJSON-1388493826 tempest-VolumesSnapshotTestJSON-1388493826-project-member] [instance: 356478b0-e233-46aa-a1bd-45ce1f9eca8f] Guest created on hypervisor {{(pid=74613) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 29 17:57:09 user nova-compute[74613]: INFO nova.virt.libvirt.driver [-] [instance: 356478b0-e233-46aa-a1bd-45ce1f9eca8f] Instance spawned successfully.
Nov 29 17:57:09 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-4777801b-7829-4b8e-96af-62d077021d11 tempest-VolumesSnapshotTestJSON-1388493826 tempest-VolumesSnapshotTestJSON-1388493826-project-member] [instance: 356478b0-e233-46aa-a1bd-45ce1f9eca8f] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74613) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 29 17:57:09 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-4777801b-7829-4b8e-96af-62d077021d11 tempest-VolumesSnapshotTestJSON-1388493826 tempest-VolumesSnapshotTestJSON-1388493826-project-member] [instance: 356478b0-e233-46aa-a1bd-45ce1f9eca8f] Found default for hw_cdrom_bus of ide {{(pid=74613) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 17:57:09 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-4777801b-7829-4b8e-96af-62d077021d11 tempest-VolumesSnapshotTestJSON-1388493826 tempest-VolumesSnapshotTestJSON-1388493826-project-member] [instance: 356478b0-e233-46aa-a1bd-45ce1f9eca8f] Found default for hw_disk_bus of virtio {{(pid=74613) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 17:57:09 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-4777801b-7829-4b8e-96af-62d077021d11 tempest-VolumesSnapshotTestJSON-1388493826 tempest-VolumesSnapshotTestJSON-1388493826-project-member] [instance: 356478b0-e233-46aa-a1bd-45ce1f9eca8f] Found default for hw_input_bus of None {{(pid=74613) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 17:57:09 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-4777801b-7829-4b8e-96af-62d077021d11 tempest-VolumesSnapshotTestJSON-1388493826 tempest-VolumesSnapshotTestJSON-1388493826-project-member] [instance: 356478b0-e233-46aa-a1bd-45ce1f9eca8f] Found default for hw_pointer_model of None {{(pid=74613) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 17:57:09 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-4777801b-7829-4b8e-96af-62d077021d11 tempest-VolumesSnapshotTestJSON-1388493826 tempest-VolumesSnapshotTestJSON-1388493826-project-member] [instance: 356478b0-e233-46aa-a1bd-45ce1f9eca8f] Found default for hw_video_model of virtio {{(pid=74613) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 17:57:09 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-4777801b-7829-4b8e-96af-62d077021d11 tempest-VolumesSnapshotTestJSON-1388493826 tempest-VolumesSnapshotTestJSON-1388493826-project-member] [instance: 356478b0-e233-46aa-a1bd-45ce1f9eca8f] Found default for hw_vif_model of virtio {{(pid=74613) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 17:57:09 user nova-compute[74613]: DEBUG nova.compute.manager [req-9f8b867e-5469-4fe3-874b-95cd83b1dfe3 req-441deadd-bdae-4068-a9e8-084570a78ba1 service nova] [instance: 356478b0-e233-46aa-a1bd-45ce1f9eca8f] Received event network-vif-plugged-22b97a14-1376-4183-a2ef-27a98a891bb9 {{(pid=74613) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 17:57:09 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-9f8b867e-5469-4fe3-874b-95cd83b1dfe3 req-441deadd-bdae-4068-a9e8-084570a78ba1 service nova] Acquiring lock "356478b0-e233-46aa-a1bd-45ce1f9eca8f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 17:57:09 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-9f8b867e-5469-4fe3-874b-95cd83b1dfe3 req-441deadd-bdae-4068-a9e8-084570a78ba1 service nova] Lock "356478b0-e233-46aa-a1bd-45ce1f9eca8f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 17:57:09 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-9f8b867e-5469-4fe3-874b-95cd83b1dfe3 req-441deadd-bdae-4068-a9e8-084570a78ba1 service nova] Lock "356478b0-e233-46aa-a1bd-45ce1f9eca8f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 17:57:09 user nova-compute[74613]: DEBUG nova.compute.manager [req-9f8b867e-5469-4fe3-874b-95cd83b1dfe3 req-441deadd-bdae-4068-a9e8-084570a78ba1 service nova] [instance: 356478b0-e233-46aa-a1bd-45ce1f9eca8f] No waiting events found dispatching network-vif-plugged-22b97a14-1376-4183-a2ef-27a98a891bb9 {{(pid=74613) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 17:57:09 user nova-compute[74613]: WARNING nova.compute.manager [req-9f8b867e-5469-4fe3-874b-95cd83b1dfe3 req-441deadd-bdae-4068-a9e8-084570a78ba1 service nova] [instance: 356478b0-e233-46aa-a1bd-45ce1f9eca8f] Received unexpected event network-vif-plugged-22b97a14-1376-4183-a2ef-27a98a891bb9 for instance with vm_state building and task_state spawning.
Nov 29 17:57:09 user nova-compute[74613]: INFO nova.compute.manager [None req-4777801b-7829-4b8e-96af-62d077021d11 tempest-VolumesSnapshotTestJSON-1388493826 tempest-VolumesSnapshotTestJSON-1388493826-project-member] [instance: 356478b0-e233-46aa-a1bd-45ce1f9eca8f] Took 5.27 seconds to spawn the instance on the hypervisor.
Nov 29 17:57:09 user nova-compute[74613]: DEBUG nova.compute.manager [None req-4777801b-7829-4b8e-96af-62d077021d11 tempest-VolumesSnapshotTestJSON-1388493826 tempest-VolumesSnapshotTestJSON-1388493826-project-member] [instance: 356478b0-e233-46aa-a1bd-45ce1f9eca8f] Checking state {{(pid=74613) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 29 17:57:09 user nova-compute[74613]: INFO nova.compute.manager [None req-4777801b-7829-4b8e-96af-62d077021d11 tempest-VolumesSnapshotTestJSON-1388493826 tempest-VolumesSnapshotTestJSON-1388493826-project-member] [instance: 356478b0-e233-46aa-a1bd-45ce1f9eca8f] Took 6.40 seconds to build instance.
Nov 29 17:57:09 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-4777801b-7829-4b8e-96af-62d077021d11 tempest-VolumesSnapshotTestJSON-1388493826 tempest-VolumesSnapshotTestJSON-1388493826-project-member] Lock "356478b0-e233-46aa-a1bd-45ce1f9eca8f" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.501s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 17:57:10 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:57:10 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:57:11 user nova-compute[74613]: DEBUG oslo_service.periodic_task [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=74613) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 17:57:11 user nova-compute[74613]: DEBUG nova.compute.manager [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Cleaning up deleted instances with incomplete migration  {{(pid=74613) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 29 17:57:12 user nova-compute[74613]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ba7bfefb-a233-474d-a8fa-c3fdfb8b2472 tempest-ServerActionsTestOtherA-1784608629 tempest-ServerActionsTestOtherA-1784608629-project-member] [instance: 71f2a1ab-3df7-411c-93fa-b0a1a5a44f0a] Calling os-brick to attach iSCSI Volume {{(pid=74613) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 29 17:57:12 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba7bfefb-a233-474d-a8fa-c3fdfb8b2472 tempest-ServerActionsTestOtherA-1784608629 tempest-ServerActionsTestOtherA-1784608629-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff828156890>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:72d22ffa-f425-4575-86a5-afbd8bb9cdd6', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'hUFVkcjz', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74613) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 17:57:12 user nova-compute[74613]: WARNING os_brick.initiator.connectors.base [None req-ba7bfefb-a233-474d-a8fa-c3fdfb8b2472 tempest-ServerActionsTestOtherA-1784608629 tempest-ServerActionsTestOtherA-1784608629-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 17:57:12 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.base [None req-ba7bfefb-a233-474d-a8fa-c3fdfb8b2472 tempest-ServerActionsTestOtherA-1784608629 tempest-ServerActionsTestOtherA-1784608629-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 17:57:12 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.base [None req-ba7bfefb-a233-474d-a8fa-c3fdfb8b2472 tempest-ServerActionsTestOtherA-1784608629 tempest-ServerActionsTestOtherA-1784608629-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 17:57:12 user nova-compute[74613]: WARNING os_brick.initiator.connectors.base [None req-ba7bfefb-a233-474d-a8fa-c3fdfb8b2472 tempest-ServerActionsTestOtherA-1784608629 tempest-ServerActionsTestOtherA-1784608629-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 17:57:12 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.base [None req-ba7bfefb-a233-474d-a8fa-c3fdfb8b2472 tempest-ServerActionsTestOtherA-1784608629 tempest-ServerActionsTestOtherA-1784608629-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:72d22ffa-f425-4575-86a5-afbd8bb9cdd6" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 17:57:12 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.base [None req-ba7bfefb-a233-474d-a8fa-c3fdfb8b2472 tempest-ServerActionsTestOtherA-1784608629 tempest-ServerActionsTestOtherA-1784608629-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:72d22ffa-f425-4575-86a5-afbd8bb9cdd6" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 17:57:12 user nova-compute[74613]: INFO os_brick.initiator.connectors.iscsi [None req-ba7bfefb-a233-474d-a8fa-c3fdfb8b2472 tempest-ServerActionsTestOtherA-1784608629 tempest-ServerActionsTestOtherA-1784608629-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 29 17:57:12 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:72d22ffa-f425-4575-86a5-afbd8bb9cdd6 -p 172.16.0.220:3260 {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 17:57:12 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:72d22ffa-f425-4575-86a5-afbd8bb9cdd6 -p 172.16.0.220:3260" returned: 21 in 0.022s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 17:57:12 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4b8523d-06b7-4888-969b-b9c0ffa16e1c]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 17:57:12 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba7bfefb-a233-474d-a8fa-c3fdfb8b2472 tempest-ServerActionsTestOtherA-1784608629 tempest-ServerActionsTestOtherA-1784608629-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 29 17:57:12 user nova-compute[74613]:  {{(pid=74613) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 17:57:12 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:72d22ffa-f425-4575-86a5-afbd8bb9cdd6 -p 172.16.0.220:3260 --interface default --op new {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 17:57:12 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:72d22ffa-f425-4575-86a5-afbd8bb9cdd6 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 17:57:12 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[9da448ff-8041-46e8-be67-1ffe03e4efcc]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:72d22ffa-f425-4575-86a5-afbd8bb9cdd6] added\n', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 17:57:12 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba7bfefb-a233-474d-a8fa-c3fdfb8b2472 tempest-ServerActionsTestOtherA-1784608629 tempest-ServerActionsTestOtherA-1784608629-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:72d22ffa-f425-4575-86a5-afbd8bb9cdd6] added
Nov 29 17:57:12 user nova-compute[74613]:  stderr= {{(pid=74613) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 17:57:12 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:72d22ffa-f425-4575-86a5-afbd8bb9cdd6 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 17:57:12 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:72d22ffa-f425-4575-86a5-afbd8bb9cdd6 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 17:57:12 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[a74d7506-4c29-4472-85e6-edfa9d761ee2]: (4, ('', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 17:57:12 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba7bfefb-a233-474d-a8fa-c3fdfb8b2472 tempest-ServerActionsTestOtherA-1784608629 tempest-ServerActionsTestOtherA-1784608629-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74613) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 17:57:12 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:72d22ffa-f425-4575-86a5-afbd8bb9cdd6 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 17:57:12 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:72d22ffa-f425-4575-86a5-afbd8bb9cdd6 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 17:57:12 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[446e4c28-f890-4e27-bd57-00e4775b4ad2]: (4, ('', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 17:57:12 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba7bfefb-a233-474d-a8fa-c3fdfb8b2472 tempest-ServerActionsTestOtherA-1784608629 tempest-ServerActionsTestOtherA-1784608629-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74613) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 17:57:12 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:72d22ffa-f425-4575-86a5-afbd8bb9cdd6 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v hUFVkcjz {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 17:57:12 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:72d22ffa-f425-4575-86a5-afbd8bb9cdd6 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v hUFVkcjz" returned: 0 in 0.019s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 17:57:12 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[88a8eca8-4ffb-4ed5-9f0d-4af4b82fddb0]: (4, ('', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 17:57:12 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba7bfefb-a233-474d-a8fa-c3fdfb8b2472 tempest-ServerActionsTestOtherA-1784608629 tempest-ServerActionsTestOtherA-1784608629-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'hUFVkcjz'): stdout= stderr= {{(pid=74613) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 17:57:12 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:72d22ffa-f425-4575-86a5-afbd8bb9cdd6 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 17:57:12 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:72d22ffa-f425-4575-86a5-afbd8bb9cdd6 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 17:57:12 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[576f01c7-346d-4fca-ab07-aa54639aa6e0]: (4, ('', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 17:57:12 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba7bfefb-a233-474d-a8fa-c3fdfb8b2472 tempest-ServerActionsTestOtherA-1784608629 tempest-ServerActionsTestOtherA-1784608629-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74613) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 17:57:12 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 17:57:12 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 17:57:12 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e89852a-45cb-47f6-ab15-0b64ecd58ccf]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9511387c-8772-40f2-bf2d-6b6387649e9f (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:070b1031-e105-4cba-a039-2286e23727c5 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00ec83b4-5d84-416a-bad9-7511171a9da0 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a07b572-6430-4d0f-9aaf-8a8dbc39831e (non-flash)\n', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 17:57:12 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba7bfefb-a233-474d-a8fa-c3fdfb8b2472 tempest-ServerActionsTestOtherA-1784608629 tempest-ServerActionsTestOtherA-1784608629-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9511387c-8772-40f2-bf2d-6b6387649e9f (non-flash)
Nov 29 17:57:12 user nova-compute[74613]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:070b1031-e105-4cba-a039-2286e23727c5 (non-flash)
Nov 29 17:57:12 user nova-compute[74613]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00ec83b4-5d84-416a-bad9-7511171a9da0 (non-flash)
Nov 29 17:57:12 user nova-compute[74613]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a07b572-6430-4d0f-9aaf-8a8dbc39831e (non-flash)
Nov 29 17:57:12 user nova-compute[74613]:  stderr= {{(pid=74613) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 17:57:12 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba7bfefb-a233-474d-a8fa-c3fdfb8b2472 tempest-ServerActionsTestOtherA-1784608629 tempest-ServerActionsTestOtherA-1784608629-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9511387c-8772-40f2-bf2d-6b6387649e9f (non-flash)
Nov 29 17:57:12 user nova-compute[74613]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:070b1031-e105-4cba-a039-2286e23727c5 (non-flash)
Nov 29 17:57:12 user nova-compute[74613]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00ec83b4-5d84-416a-bad9-7511171a9da0 (non-flash)
Nov 29 17:57:12 user nova-compute[74613]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a07b572-6430-4d0f-9aaf-8a8dbc39831e (non-flash)
Nov 29 17:57:12 user nova-compute[74613]:  stderr= {{(pid=74613) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 17:57:12 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:72d22ffa-f425-4575-86a5-afbd8bb9cdd6 -p 172.16.0.220:3260 --login {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 17:57:13 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:72d22ffa-f425-4575-86a5-afbd8bb9cdd6 -p 172.16.0.220:3260 --login" returned: 0 in 0.068s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 17:57:13 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[8af94226-b877-43bd-b8e5-f7f4dd7be6f6]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:72d22ffa-f425-4575-86a5-afbd8bb9cdd6, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:72d22ffa-f425-4575-86a5-afbd8bb9cdd6, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 17:57:13 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba7bfefb-a233-474d-a8fa-c3fdfb8b2472 tempest-ServerActionsTestOtherA-1784608629 tempest-ServerActionsTestOtherA-1784608629-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:72d22ffa-f425-4575-86a5-afbd8bb9cdd6, portal: 172.16.0.220,3260]
Nov 29 17:57:13 user nova-compute[74613]: Login to [iface: default, target: iqn.2010-10.org.openstack:72d22ffa-f425-4575-86a5-afbd8bb9cdd6, portal: 172.16.0.220,3260] successful.
Nov 29 17:57:13 user nova-compute[74613]:  stderr= {{(pid=74613) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 17:57:13 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:72d22ffa-f425-4575-86a5-afbd8bb9cdd6 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 17:57:13 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:72d22ffa-f425-4575-86a5-afbd8bb9cdd6 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.022s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 17:57:13 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[653b65c6-4d10-4b93-8b75-0c78d2be28c0]: (4, ('', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 17:57:13 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba7bfefb-a233-474d-a8fa-c3fdfb8b2472 tempest-ServerActionsTestOtherA-1784608629 tempest-ServerActionsTestOtherA-1784608629-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74613) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 17:57:13 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 17:57:13 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 17:57:13 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[adab8599-4280-4835-b628-3ead2563b349]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9511387c-8772-40f2-bf2d-6b6387649e9f (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:070b1031-e105-4cba-a039-2286e23727c5 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00ec83b4-5d84-416a-bad9-7511171a9da0 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a07b572-6430-4d0f-9aaf-8a8dbc39831e (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:72d22ffa-f425-4575-86a5-afbd8bb9cdd6 (non-flash)\n', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 17:57:13 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba7bfefb-a233-474d-a8fa-c3fdfb8b2472 tempest-ServerActionsTestOtherA-1784608629 tempest-ServerActionsTestOtherA-1784608629-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9511387c-8772-40f2-bf2d-6b6387649e9f (non-flash)
Nov 29 17:57:13 user nova-compute[74613]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:070b1031-e105-4cba-a039-2286e23727c5 (non-flash)
Nov 29 17:57:13 user nova-compute[74613]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00ec83b4-5d84-416a-bad9-7511171a9da0 (non-flash)
Nov 29 17:57:13 user nova-compute[74613]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a07b572-6430-4d0f-9aaf-8a8dbc39831e (non-flash)
Nov 29 17:57:13 user nova-compute[74613]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:72d22ffa-f425-4575-86a5-afbd8bb9cdd6 (non-flash)
Nov 29 17:57:13 user nova-compute[74613]:  stderr= {{(pid=74613) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 17:57:13 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba7bfefb-a233-474d-a8fa-c3fdfb8b2472 tempest-ServerActionsTestOtherA-1784608629 tempest-ServerActionsTestOtherA-1784608629-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9511387c-8772-40f2-bf2d-6b6387649e9f (non-flash)
Nov 29 17:57:13 user nova-compute[74613]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:070b1031-e105-4cba-a039-2286e23727c5 (non-flash)
Nov 29 17:57:13 user nova-compute[74613]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00ec83b4-5d84-416a-bad9-7511171a9da0 (non-flash)
Nov 29 17:57:13 user nova-compute[74613]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a07b572-6430-4d0f-9aaf-8a8dbc39831e (non-flash)
Nov 29 17:57:13 user nova-compute[74613]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:72d22ffa-f425-4575-86a5-afbd8bb9cdd6 (non-flash)
Nov 29 17:57:13 user nova-compute[74613]:  stderr= {{(pid=74613) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 17:57:13 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.base [None req-ba7bfefb-a233-474d-a8fa-c3fdfb8b2472 tempest-ServerActionsTestOtherA-1784608629 tempest-ServerActionsTestOtherA-1784608629-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:72d22ffa-f425-4575-86a5-afbd8bb9cdd6" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.295s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 17:57:13 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba7bfefb-a233-474d-a8fa-c3fdfb8b2472 tempest-ServerActionsTestOtherA-1784608629 tempest-ServerActionsTestOtherA-1784608629-project-member] Connected to 172.16.0.220:3260 {{(pid=74613) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 29 17:57:13 user nova-compute[74613]: DEBUG os_brick.initiator.linuxscsi [None req-ba7bfefb-a233-474d-a8fa-c3fdfb8b2472 tempest-ServerActionsTestOtherA-1784608629 tempest-ServerActionsTestOtherA-1784608629-project-member] HCTL ('37', '-', '-', 0) found on session 18 with lun 0 {{(pid=74613) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 29 17:57:13 user nova-compute[74613]: DEBUG os_brick.initiator.linuxscsi [None req-ba7bfefb-a233-474d-a8fa-c3fdfb8b2472 tempest-ServerActionsTestOtherA-1784608629 tempest-ServerActionsTestOtherA-1784608629-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=74613) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 29 17:57:13 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 17:57:13 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.017s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 17:57:13 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[5169c12c-2f25-4e4c-b24c-f60b0a4c3f1f]: (4, ('- - 0', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 17:57:13 user nova-compute[74613]: DEBUG os_brick.initiator.linuxscsi [None req-ba7bfefb-a233-474d-a8fa-c3fdfb8b2472 tempest-ServerActionsTestOtherA-1784608629 tempest-ServerActionsTestOtherA-1784608629-project-member] Searching for a device in session 18 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=74613) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 29 17:57:13 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba7bfefb-a233-474d-a8fa-c3fdfb8b2472 tempest-ServerActionsTestOtherA-1784608629 tempest-ServerActionsTestOtherA-1784608629-project-member] Connected to sdf using {'target_iqn': 'iqn.2010-10.org.openstack:72d22ffa-f425-4575-86a5-afbd8bb9cdd6', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'hUFVkcjz', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74613) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 29 17:57:14 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.base [None req-ba7bfefb-a233-474d-a8fa-c3fdfb8b2472 tempest-ServerActionsTestOtherA-1784608629 tempest-ServerActionsTestOtherA-1784608629-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.330s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 17:57:14 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba7bfefb-a233-474d-a8fa-c3fdfb8b2472 tempest-ServerActionsTestOtherA-1784608629 tempest-ServerActionsTestOtherA-1784608629-project-member] <== connect_volume: return (1331ms) {'type': 'block', 'scsi_wwn': '26633653932656530', 'path': '/dev/sdf'} {{(pid=74613) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 17:57:14 user nova-compute[74613]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ba7bfefb-a233-474d-a8fa-c3fdfb8b2472 tempest-ServerActionsTestOtherA-1784608629 tempest-ServerActionsTestOtherA-1784608629-project-member] [instance: 71f2a1ab-3df7-411c-93fa-b0a1a5a44f0a] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26633653932656530', 'path': '/dev/sdf'} {{(pid=74613) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 29 17:57:14 user nova-compute[74613]: DEBUG nova.objects.instance [None req-ba7bfefb-a233-474d-a8fa-c3fdfb8b2472 tempest-ServerActionsTestOtherA-1784608629 tempest-ServerActionsTestOtherA-1784608629-project-member] Lazy-loading 'flavor' on Instance uuid 71f2a1ab-3df7-411c-93fa-b0a1a5a44f0a {{(pid=74613) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 17:57:14 user nova-compute[74613]: DEBUG nova.virt.libvirt.guest [None req-ba7bfefb-a233-474d-a8fa-c3fdfb8b2472 tempest-ServerActionsTestOtherA-1784608629 tempest-ServerActionsTestOtherA-1784608629-project-member] attach device xml: <disk type="block" device="disk">
Nov 29 17:57:14 user nova-compute[74613]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 17:57:14 user nova-compute[74613]:   <source dev="/dev/sdf"/>
Nov 29 17:57:14 user nova-compute[74613]:   <target dev="vdb" bus="virtio"/>
Nov 29 17:57:14 user nova-compute[74613]:   <serial>72d22ffa-f425-4575-86a5-afbd8bb9cdd6</serial>
Nov 29 17:57:14 user nova-compute[74613]: </disk>
Nov 29 17:57:14 user nova-compute[74613]:  {{(pid=74613) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 29 17:57:14 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-ba7bfefb-a233-474d-a8fa-c3fdfb8b2472 tempest-ServerActionsTestOtherA-1784608629 tempest-ServerActionsTestOtherA-1784608629-project-member] No BDM found with device name vda, not building metadata. {{(pid=74613) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 17:57:14 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-ba7bfefb-a233-474d-a8fa-c3fdfb8b2472 tempest-ServerActionsTestOtherA-1784608629 tempest-ServerActionsTestOtherA-1784608629-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74613) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 17:57:14 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-ba7bfefb-a233-474d-a8fa-c3fdfb8b2472 tempest-ServerActionsTestOtherA-1784608629 tempest-ServerActionsTestOtherA-1784608629-project-member] No VIF found with MAC fa:16:3e:1a:53:06, not building metadata {{(pid=74613) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 29 17:57:14 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-ba7bfefb-a233-474d-a8fa-c3fdfb8b2472 tempest-ServerActionsTestOtherA-1784608629 tempest-ServerActionsTestOtherA-1784608629-project-member] Lock "71f2a1ab-3df7-411c-93fa-b0a1a5a44f0a" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 10.330s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 17:57:15 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:57:15 user nova-compute[74613]: DEBUG nova.compute.manager [req-a8b65d02-c524-48be-b2ef-438d30132282 req-e329c042-010f-4110-8d7c-e484de27a96c service nova] [instance: 74ac9703-1cd7-4983-b7d4-c69b01fec7b2] Received event network-changed-c63b6577-fb46-437a-95b3-8321fab45d0c {{(pid=74613) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 17:57:15 user nova-compute[74613]: DEBUG nova.compute.manager [req-a8b65d02-c524-48be-b2ef-438d30132282 req-e329c042-010f-4110-8d7c-e484de27a96c service nova] [instance: 74ac9703-1cd7-4983-b7d4-c69b01fec7b2] Refreshing instance network info cache due to event network-changed-c63b6577-fb46-437a-95b3-8321fab45d0c. {{(pid=74613) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 17:57:15 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-a8b65d02-c524-48be-b2ef-438d30132282 req-e329c042-010f-4110-8d7c-e484de27a96c service nova] Acquiring lock "refresh_cache-74ac9703-1cd7-4983-b7d4-c69b01fec7b2" {{(pid=74613) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 17:57:15 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-a8b65d02-c524-48be-b2ef-438d30132282 req-e329c042-010f-4110-8d7c-e484de27a96c service nova] Acquired lock "refresh_cache-74ac9703-1cd7-4983-b7d4-c69b01fec7b2" {{(pid=74613) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 17:57:15 user nova-compute[74613]: DEBUG nova.network.neutron [req-a8b65d02-c524-48be-b2ef-438d30132282 req-e329c042-010f-4110-8d7c-e484de27a96c service nova] [instance: 74ac9703-1cd7-4983-b7d4-c69b01fec7b2] Refreshing network info cache for port c63b6577-fb46-437a-95b3-8321fab45d0c {{(pid=74613) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 17:57:15 user nova-compute[74613]: DEBUG oslo_service.periodic_task [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=74613) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 17:57:15 user nova-compute[74613]: DEBUG nova.compute.manager [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Cleaning up deleted instances {{(pid=74613) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 29 17:57:15 user nova-compute[74613]: DEBUG nova.compute.manager [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] There are 0 instances to clean {{(pid=74613) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 29 17:57:15 user nova-compute[74613]: DEBUG nova.network.neutron [req-a8b65d02-c524-48be-b2ef-438d30132282 req-e329c042-010f-4110-8d7c-e484de27a96c service nova] [instance: 74ac9703-1cd7-4983-b7d4-c69b01fec7b2] Updated VIF entry in instance network info cache for port c63b6577-fb46-437a-95b3-8321fab45d0c. {{(pid=74613) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 17:57:15 user nova-compute[74613]: DEBUG nova.network.neutron [req-a8b65d02-c524-48be-b2ef-438d30132282 req-e329c042-010f-4110-8d7c-e484de27a96c service nova] [instance: 74ac9703-1cd7-4983-b7d4-c69b01fec7b2] Updating instance_info_cache with network_info: [{"id": "c63b6577-fb46-437a-95b3-8321fab45d0c", "address": "fa:16:3e:c3:2e:71", "network": {"id": "e687ed60-2592-4836-b97e-0828527b1b9f", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1938956411-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.143", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b392ca87608940c0ae467318b66453b2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc63b6577-fb", "ovs_interfaceid": "c63b6577-fb46-437a-95b3-8321fab45d0c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74613) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 17:57:15 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:57:15 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-a8b65d02-c524-48be-b2ef-438d30132282 req-e329c042-010f-4110-8d7c-e484de27a96c service nova] Releasing lock "refresh_cache-74ac9703-1cd7-4983-b7d4-c69b01fec7b2" {{(pid=74613) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 17:57:16 user nova-compute[74613]: INFO nova.compute.manager [None req-03c71a7b-32a0-47d1-86ad-ac97b97fb8aa tempest-ServerActionsTestOtherA-1784608629 tempest-ServerActionsTestOtherA-1784608629-project-member] [instance: 71f2a1ab-3df7-411c-93fa-b0a1a5a44f0a] Rebuilding instance
Nov 29 17:57:16 user nova-compute[74613]: DEBUG nova.compute.manager [None req-03c71a7b-32a0-47d1-86ad-ac97b97fb8aa tempest-ServerActionsTestOtherA-1784608629 tempest-ServerActionsTestOtherA-1784608629-project-member] [instance: 71f2a1ab-3df7-411c-93fa-b0a1a5a44f0a] Checking state {{(pid=74613) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 29 17:57:16 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:57:16 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:57:16 user nova-compute[74613]: DEBUG oslo_service.periodic_task [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74613) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 17:57:16 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 17:57:16 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 17:57:16 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 17:57:16 user nova-compute[74613]: DEBUG nova.compute.resource_tracker [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Auditing locally available compute resources for user (node: user) {{(pid=74613) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 29 17:57:16 user nova-compute[74613]: DEBUG nova.compute.manager [req-05ddf94e-3dc2-411e-af90-43a47276e1c4 req-381f0adb-faa0-4198-9bf0-31d7c8ed978d service nova] [instance: 71f2a1ab-3df7-411c-93fa-b0a1a5a44f0a] Received event network-vif-unplugged-d40a5800-7391-4206-a661-fbce50c35a65 {{(pid=74613) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 17:57:16 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-05ddf94e-3dc2-411e-af90-43a47276e1c4 req-381f0adb-faa0-4198-9bf0-31d7c8ed978d service nova] Acquiring lock "71f2a1ab-3df7-411c-93fa-b0a1a5a44f0a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 17:57:16 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-05ddf94e-3dc2-411e-af90-43a47276e1c4 req-381f0adb-faa0-4198-9bf0-31d7c8ed978d service nova] Lock "71f2a1ab-3df7-411c-93fa-b0a1a5a44f0a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 17:57:16 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-05ddf94e-3dc2-411e-af90-43a47276e1c4 req-381f0adb-faa0-4198-9bf0-31d7c8ed978d service nova] Lock "71f2a1ab-3df7-411c-93fa-b0a1a5a44f0a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 17:57:16 user nova-compute[74613]: DEBUG nova.compute.manager [req-05ddf94e-3dc2-411e-af90-43a47276e1c4 req-381f0adb-faa0-4198-9bf0-31d7c8ed978d service nova] [instance: 71f2a1ab-3df7-411c-93fa-b0a1a5a44f0a] No waiting events found dispatching network-vif-unplugged-d40a5800-7391-4206-a661-fbce50c35a65 {{(pid=74613) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 17:57:16 user nova-compute[74613]: WARNING nova.compute.manager [req-05ddf94e-3dc2-411e-af90-43a47276e1c4 req-381f0adb-faa0-4198-9bf0-31d7c8ed978d service nova] [instance: 71f2a1ab-3df7-411c-93fa-b0a1a5a44f0a] Received unexpected event network-vif-unplugged-d40a5800-7391-4206-a661-fbce50c35a65 for instance with vm_state active and task_state rebuilding.
Nov 29 17:57:16 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:57:16 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:57:17 user nova-compute[74613]: INFO nova.virt.libvirt.driver [-] [instance: 71f2a1ab-3df7-411c-93fa-b0a1a5a44f0a] Instance destroyed successfully.
Nov 29 17:57:17 user nova-compute[74613]: INFO nova.compute.manager [None req-03c71a7b-32a0-47d1-86ad-ac97b97fb8aa tempest-ServerActionsTestOtherA-1784608629 tempest-ServerActionsTestOtherA-1784608629-project-member] [instance: 71f2a1ab-3df7-411c-93fa-b0a1a5a44f0a] Detaching volume 72d22ffa-f425-4575-86a5-afbd8bb9cdd6
Nov 29 17:57:17 user nova-compute[74613]: INFO nova.virt.block_device [None req-03c71a7b-32a0-47d1-86ad-ac97b97fb8aa tempest-ServerActionsTestOtherA-1784608629 tempest-ServerActionsTestOtherA-1784608629-project-member] [instance: 71f2a1ab-3df7-411c-93fa-b0a1a5a44f0a] Attempting to driver detach volume 72d22ffa-f425-4575-86a5-afbd8bb9cdd6 from mountpoint /dev/vdb
Nov 29 17:57:17 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c19e230e-2e6c-4c20-b15c-ad81a73674b4/disk --force-share --output=json {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 17:57:17 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-03c71a7b-32a0-47d1-86ad-ac97b97fb8aa tempest-ServerActionsTestOtherA-1784608629 tempest-ServerActionsTestOtherA-1784608629-project-member] Attempting to detach device vdb from instance 71f2a1ab-3df7-411c-93fa-b0a1a5a44f0a from the persistent domain config. {{(pid=74613) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 29 17:57:17 user nova-compute[74613]: DEBUG nova.virt.libvirt.guest [None req-03c71a7b-32a0-47d1-86ad-ac97b97fb8aa tempest-ServerActionsTestOtherA-1784608629 tempest-ServerActionsTestOtherA-1784608629-project-member] detach device xml: <disk type="block" device="disk">
Nov 29 17:57:17 user nova-compute[74613]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 17:57:17 user nova-compute[74613]:   <source dev="/dev/sdf"/>
Nov 29 17:57:17 user nova-compute[74613]:   <target dev="vdb" bus="virtio"/>
Nov 29 17:57:17 user nova-compute[74613]:   <serial>72d22ffa-f425-4575-86a5-afbd8bb9cdd6</serial>
Nov 29 17:57:17 user nova-compute[74613]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 29 17:57:17 user nova-compute[74613]: </disk>
Nov 29 17:57:17 user nova-compute[74613]:  {{(pid=74613) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 29 17:57:17 user nova-compute[74613]: INFO nova.virt.libvirt.driver [None req-03c71a7b-32a0-47d1-86ad-ac97b97fb8aa tempest-ServerActionsTestOtherA-1784608629 tempest-ServerActionsTestOtherA-1784608629-project-member] Successfully detached device vdb from instance 71f2a1ab-3df7-411c-93fa-b0a1a5a44f0a from the persistent domain config.
Nov 29 17:57:17 user nova-compute[74613]: DEBUG nova.virt.libvirt.volume.iscsi [None req-03c71a7b-32a0-47d1-86ad-ac97b97fb8aa tempest-ServerActionsTestOtherA-1784608629 tempest-ServerActionsTestOtherA-1784608629-project-member] [instance: 71f2a1ab-3df7-411c-93fa-b0a1a5a44f0a] calling os-brick to detach iSCSI Volume {{(pid=74613) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 29 17:57:17 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-03c71a7b-32a0-47d1-86ad-ac97b97fb8aa tempest-ServerActionsTestOtherA-1784608629 tempest-ServerActionsTestOtherA-1784608629-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff828156890>, {'target_iqn': 'iqn.2010-10.org.openstack:72d22ffa-f425-4575-86a5-afbd8bb9cdd6', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'hUFVkcjz', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, None), 'kwargs': False}}" {{(pid=74613) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 17:57:17 user nova-compute[74613]: WARNING os_brick.initiator.connectors.base [None req-03c71a7b-32a0-47d1-86ad-ac97b97fb8aa tempest-ServerActionsTestOtherA-1784608629 tempest-ServerActionsTestOtherA-1784608629-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Nov 29 17:57:17 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.base [None req-03c71a7b-32a0-47d1-86ad-ac97b97fb8aa tempest-ServerActionsTestOtherA-1784608629 tempest-ServerActionsTestOtherA-1784608629-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 17:57:17 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.base [None req-03c71a7b-32a0-47d1-86ad-ac97b97fb8aa tempest-ServerActionsTestOtherA-1784608629 tempest-ServerActionsTestOtherA-1784608629-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 17:57:17 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 17:57:17 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 17:57:17 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[336acd5a-c5f7-4a25-b139-a2326ef1e2bd]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:070b1031-e105-4cba-a039-2286e23727c5\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:9511387c-8772-40f2-bf2d-6b6387649e9f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:6a07b572-6430-4d0f-9aaf-8a8dbc39831e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:72d22ffa-f425-4575-86a5-afbd8bb9cdd6\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:00ec83b4-5d84-416a-bad9-7511171a9da0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 17:57:17 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-03c71a7b-32a0-47d1-86ad-ac97b97fb8aa tempest-ServerActionsTestOtherA-1784608629 tempest-ServerActionsTestOtherA-1784608629-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 29 17:57:17 user nova-compute[74613]: No targets found.
Nov 29 17:57:17 user nova-compute[74613]: iSNS:
Nov 29 17:57:17 user nova-compute[74613]: No targets found.
Nov 29 17:57:17 user nova-compute[74613]: STATIC:
Nov 29 17:57:17 user nova-compute[74613]: Target: iqn.2010-10.org.openstack:070b1031-e105-4cba-a039-2286e23727c5
Nov 29 17:57:17 user nova-compute[74613]:         Portal: 172.16.0.220:3260,-1
Nov 29 17:57:17 user nova-compute[74613]:                 Iface Name: default
Nov 29 17:57:17 user nova-compute[74613]: Target: iqn.2010-10.org.openstack:9511387c-8772-40f2-bf2d-6b6387649e9f
Nov 29 17:57:17 user nova-compute[74613]:         Portal: 172.16.0.220:3260,-1
Nov 29 17:57:17 user nova-compute[74613]:                 Iface Name: default
Nov 29 17:57:17 user nova-compute[74613]: Target: iqn.2010-10.org.openstack:6a07b572-6430-4d0f-9aaf-8a8dbc39831e
Nov 29 17:57:17 user nova-compute[74613]:         Portal: 172.16.0.220:3260,-1
Nov 29 17:57:17 user nova-compute[74613]:                 Iface Name: default
Nov 29 17:57:17 user nova-compute[74613]: Target: iqn.2010-10.org.openstack:72d22ffa-f425-4575-86a5-afbd8bb9cdd6
Nov 29 17:57:17 user nova-compute[74613]:         Portal: 172.16.0.220:3260,-1
Nov 29 17:57:17 user nova-compute[74613]:                 Iface Name: default
Nov 29 17:57:17 user nova-compute[74613]: Target: iqn.2010-10.org.openstack:00ec83b4-5d84-416a-bad9-7511171a9da0
Nov 29 17:57:17 user nova-compute[74613]:         Portal: 172.16.0.220:3260,-1
Nov 29 17:57:17 user nova-compute[74613]:                 Iface Name: default
Nov 29 17:57:17 user nova-compute[74613]: FIRMWARE:
Nov 29 17:57:17 user nova-compute[74613]: No targets found.
Nov 29 17:57:17 user nova-compute[74613]:  stderr= {{(pid=74613) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 17:57:17 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-03c71a7b-32a0-47d1-86ad-ac97b97fb8aa tempest-ServerActionsTestOtherA-1784608629 tempest-ServerActionsTestOtherA-1784608629-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 29 17:57:17 user nova-compute[74613]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 29 17:57:17 user nova-compute[74613]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74613) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 29 17:57:17 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-03c71a7b-32a0-47d1-86ad-ac97b97fb8aa tempest-ServerActionsTestOtherA-1784608629 tempest-ServerActionsTestOtherA-1784608629-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:72d22ffa-f425-4575-86a5-afbd8bb9cdd6', 0)] {{(pid=74613) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 29 17:57:17 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 17:57:17 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 17:57:17 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[decbf301-2eb4-4153-951f-4e593027674b]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:00ec83b4-5d84-416a-bad9-7511171a9da0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:070b1031-e105-4cba-a039-2286e23727c5\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6a07b572-6430-4d0f-9aaf-8a8dbc39831e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:72d22ffa-f425-4575-86a5-afbd8bb9cdd6\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9511387c-8772-40f2-bf2d-6b6387649e9f\n', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 17:57:17 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 17:57:17 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 17:57:17 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd286571-8a07-40d4-a98f-5172fc2510ae]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9511387c-8772-40f2-bf2d-6b6387649e9f (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:070b1031-e105-4cba-a039-2286e23727c5 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00ec83b4-5d84-416a-bad9-7511171a9da0 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a07b572-6430-4d0f-9aaf-8a8dbc39831e (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:72d22ffa-f425-4575-86a5-afbd8bb9cdd6 (non-flash)\n', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 17:57:17 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-03c71a7b-32a0-47d1-86ad-ac97b97fb8aa tempest-ServerActionsTestOtherA-1784608629 tempest-ServerActionsTestOtherA-1784608629-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9511387c-8772-40f2-bf2d-6b6387649e9f (non-flash)
Nov 29 17:57:17 user nova-compute[74613]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:070b1031-e105-4cba-a039-2286e23727c5 (non-flash)
Nov 29 17:57:17 user nova-compute[74613]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00ec83b4-5d84-416a-bad9-7511171a9da0 (non-flash)
Nov 29 17:57:17 user nova-compute[74613]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a07b572-6430-4d0f-9aaf-8a8dbc39831e (non-flash)
Nov 29 17:57:17 user nova-compute[74613]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:72d22ffa-f425-4575-86a5-afbd8bb9cdd6 (non-flash)
Nov 29 17:57:17 user nova-compute[74613]:  stderr= {{(pid=74613) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 17:57:17 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-03c71a7b-32a0-47d1-86ad-ac97b97fb8aa tempest-ServerActionsTestOtherA-1784608629 tempest-ServerActionsTestOtherA-1784608629-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9511387c-8772-40f2-bf2d-6b6387649e9f (non-flash)
Nov 29 17:57:17 user nova-compute[74613]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:070b1031-e105-4cba-a039-2286e23727c5 (non-flash)
Nov 29 17:57:17 user nova-compute[74613]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00ec83b4-5d84-416a-bad9-7511171a9da0 (non-flash)
Nov 29 17:57:17 user nova-compute[74613]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a07b572-6430-4d0f-9aaf-8a8dbc39831e (non-flash)
Nov 29 17:57:17 user nova-compute[74613]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:72d22ffa-f425-4575-86a5-afbd8bb9cdd6 (non-flash)
Nov 29 17:57:17 user nova-compute[74613]:  stderr= {{(pid=74613) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 17:57:17 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-03c71a7b-32a0-47d1-86ad-ac97b97fb8aa tempest-ServerActionsTestOtherA-1784608629 tempest-ServerActionsTestOtherA-1784608629-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7ff818523130>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:72d22ffa-f425-4575-86a5-afbd8bb9cdd6'): ({'sdf'}, set())}) {{(pid=74613) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 29 17:57:17 user nova-compute[74613]: DEBUG os_brick.initiator.linuxscsi [None req-03c71a7b-32a0-47d1-86ad-ac97b97fb8aa tempest-ServerActionsTestOtherA-1784608629 tempest-ServerActionsTestOtherA-1784608629-project-member] Removing single pathed devices sdf {{(pid=74613) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 29 17:57:17 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 17:57:17 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 17:57:17 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f27507b-dd1e-4b56-98fb-c8b3c7be77b8]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 17:57:17 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 17:57:17 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c19e230e-2e6c-4c20-b15c-ad81a73674b4/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 17:57:17 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c19e230e-2e6c-4c20-b15c-ad81a73674b4/disk --force-share --output=json {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 17:57:17 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.017s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 17:57:17 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[086bc3c2-0ba3-4603-bb8d-009b007f293c]: (4, ('ok\n', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 17:57:17 user nova-compute[74613]: DEBUG os_brick.initiator.linuxscsi [None req-03c71a7b-32a0-47d1-86ad-ac97b97fb8aa tempest-ServerActionsTestOtherA-1784608629 tempest-ServerActionsTestOtherA-1784608629-project-member] Flushing IO for device /dev/sdf {{(pid=74613) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 29 17:57:17 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 17:57:17 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.013s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 17:57:17 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0c713db-572d-4629-bb43-478f471fff3b]: (4, ('', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 17:57:17 user nova-compute[74613]: DEBUG os_brick.initiator.linuxscsi [None req-03c71a7b-32a0-47d1-86ad-ac97b97fb8aa tempest-ServerActionsTestOtherA-1784608629 tempest-ServerActionsTestOtherA-1784608629-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=74613) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 29 17:57:17 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 17:57:17 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.045s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 17:57:17 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[7416c7e8-e513-4cbb-886d-73a9847bc19c]: (4, ('1', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 17:57:17 user nova-compute[74613]: DEBUG os_brick.initiator.linuxscsi [None req-03c71a7b-32a0-47d1-86ad-ac97b97fb8aa tempest-ServerActionsTestOtherA-1784608629 tempest-ServerActionsTestOtherA-1784608629-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=74613) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 29 17:57:17 user nova-compute[74613]: DEBUG os_brick.initiator.linuxscsi [None req-03c71a7b-32a0-47d1-86ad-ac97b97fb8aa tempest-ServerActionsTestOtherA-1784608629 tempest-ServerActionsTestOtherA-1784608629-project-member] SCSI volumes sdf have been removed. {{(pid=74613) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 29 17:57:17 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-03c71a7b-32a0-47d1-86ad-ac97b97fb8aa tempest-ServerActionsTestOtherA-1784608629 tempest-ServerActionsTestOtherA-1784608629-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:72d22ffa-f425-4575-86a5-afbd8bb9cdd6')] {{(pid=74613) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 29 17:57:17 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:72d22ffa-f425-4575-86a5-afbd8bb9cdd6 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 17:57:17 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:72d22ffa-f425-4575-86a5-afbd8bb9cdd6 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.017s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 17:57:17 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[09f17dc2-2ba1-4bb6-a610-af69beb1ba5e]: (4, ('', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 17:57:17 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-03c71a7b-32a0-47d1-86ad-ac97b97fb8aa tempest-ServerActionsTestOtherA-1784608629 tempest-ServerActionsTestOtherA-1784608629-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74613) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 17:57:17 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:72d22ffa-f425-4575-86a5-afbd8bb9cdd6 -p 172.16.0.220:3260 --logout {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 17:57:17 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c19e230e-2e6c-4c20-b15c-ad81a73674b4/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 17:57:17 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c4bdb712-e1f9-4fc0-b527-87088d7eddf8/disk --force-share --output=json {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 17:57:17 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:72d22ffa-f425-4575-86a5-afbd8bb9cdd6 -p 172.16.0.220:3260 --logout" returned: 0 in 0.077s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 17:57:17 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[05bb1c49-589f-40b9-a769-0998f7cf0d4d]: (4, ('Logging out of session [sid: 18, target: iqn.2010-10.org.openstack:72d22ffa-f425-4575-86a5-afbd8bb9cdd6, portal: 172.16.0.220,3260]\nLogout of [sid: 18, target: iqn.2010-10.org.openstack:72d22ffa-f425-4575-86a5-afbd8bb9cdd6, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 17:57:17 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-03c71a7b-32a0-47d1-86ad-ac97b97fb8aa tempest-ServerActionsTestOtherA-1784608629 tempest-ServerActionsTestOtherA-1784608629-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 18, target: iqn.2010-10.org.openstack:72d22ffa-f425-4575-86a5-afbd8bb9cdd6, portal: 172.16.0.220,3260]
Nov 29 17:57:17 user nova-compute[74613]: Logout of [sid: 18, target: iqn.2010-10.org.openstack:72d22ffa-f425-4575-86a5-afbd8bb9cdd6, portal: 172.16.0.220,3260] successful.
Nov 29 17:57:17 user nova-compute[74613]:  stderr= {{(pid=74613) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 17:57:17 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:72d22ffa-f425-4575-86a5-afbd8bb9cdd6 -p 172.16.0.220:3260 --op delete {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 17:57:17 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:72d22ffa-f425-4575-86a5-afbd8bb9cdd6 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.026s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 17:57:17 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb82028b-6d4e-4d22-ad6c-8d11fa5b7176]: (4, ('', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 17:57:17 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-03c71a7b-32a0-47d1-86ad-ac97b97fb8aa tempest-ServerActionsTestOtherA-1784608629 tempest-ServerActionsTestOtherA-1784608629-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74613) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 17:57:17 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.base [None req-03c71a7b-32a0-47d1-86ad-ac97b97fb8aa tempest-ServerActionsTestOtherA-1784608629 tempest-ServerActionsTestOtherA-1784608629-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.373s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 17:57:17 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-03c71a7b-32a0-47d1-86ad-ac97b97fb8aa tempest-ServerActionsTestOtherA-1784608629 tempest-ServerActionsTestOtherA-1784608629-project-member] <== disconnect_volume: return (376ms) None {{(pid=74613) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 17:57:17 user nova-compute[74613]: DEBUG nova.virt.libvirt.volume.iscsi [None req-03c71a7b-32a0-47d1-86ad-ac97b97fb8aa tempest-ServerActionsTestOtherA-1784608629 tempest-ServerActionsTestOtherA-1784608629-project-member] [instance: 71f2a1ab-3df7-411c-93fa-b0a1a5a44f0a] Disconnected iSCSI Volume {{(pid=74613) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 29 17:57:17 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c4bdb712-e1f9-4fc0-b527-87088d7eddf8/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 17:57:17 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c4bdb712-e1f9-4fc0-b527-87088d7eddf8/disk --force-share --output=json {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 17:57:18 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c4bdb712-e1f9-4fc0-b527-87088d7eddf8/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 17:57:18 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b6b0ba36-ad89-45f1-9578-8b999567dd25/disk --force-share --output=json {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 17:57:18 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b6b0ba36-ad89-45f1-9578-8b999567dd25/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 17:57:18 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b6b0ba36-ad89-45f1-9578-8b999567dd25/disk --force-share --output=json {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 17:57:18 user nova-compute[74613]: INFO nova.compute.manager [None req-d310ea77-5c70-4261-93f9-d65c3ebe5b97 tempest-ServerStableDeviceRescueTest-1416322546 tempest-ServerStableDeviceRescueTest-1416322546-project-member] [instance: b6b0ba36-ad89-45f1-9578-8b999567dd25] Unrescuing
Nov 29 17:57:18 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-d310ea77-5c70-4261-93f9-d65c3ebe5b97 tempest-ServerStableDeviceRescueTest-1416322546 tempest-ServerStableDeviceRescueTest-1416322546-project-member] Acquiring lock "refresh_cache-b6b0ba36-ad89-45f1-9578-8b999567dd25" {{(pid=74613) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 17:57:18 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-d310ea77-5c70-4261-93f9-d65c3ebe5b97 tempest-ServerStableDeviceRescueTest-1416322546 tempest-ServerStableDeviceRescueTest-1416322546-project-member] Acquired lock "refresh_cache-b6b0ba36-ad89-45f1-9578-8b999567dd25" {{(pid=74613) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 17:57:18 user nova-compute[74613]: DEBUG nova.network.neutron [None req-d310ea77-5c70-4261-93f9-d65c3ebe5b97 tempest-ServerStableDeviceRescueTest-1416322546 tempest-ServerStableDeviceRescueTest-1416322546-project-member] [instance: b6b0ba36-ad89-45f1-9578-8b999567dd25] Building network info cache for instance {{(pid=74613) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 29 17:57:18 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b6b0ba36-ad89-45f1-9578-8b999567dd25/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 17:57:18 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=74613) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 29 17:57:18 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b6b0ba36-ad89-45f1-9578-8b999567dd25/disk.rescue --force-share --output=json {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 17:57:18 user nova-compute[74613]: INFO nova.virt.libvirt.driver [-] [instance: 71f2a1ab-3df7-411c-93fa-b0a1a5a44f0a] Instance destroyed successfully.
Nov 29 17:57:18 user nova-compute[74613]: DEBUG nova.virt.libvirt.vif [None req-03c71a7b-32a0-47d1-86ad-ac97b97fb8aa tempest-ServerActionsTestOtherA-1784608629 tempest-ServerActionsTestOtherA-1784608629-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T17:55:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-767391492',display_name='tempest-ServerActionsTestOtherA-server-1095947964',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-767391492',id=13,image_ref='4217f428-8d9d-4ee1-9614-642d26d90c46',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBoePbDdVpJCaWjh90UecUnwFAFq/eT9sMeustkjBwKAq8nn0Q72xeUImjY1HRKXOBeHYZZlO4bbO6ME7GeXyIhuiGXR5A0ys2izZvXx2IXQIIRGKFd1AzRXZiys4DgmVA==',key_name='tempest-keypair-218978152',keypairs=<?>,launch_index=0,launched_at=2023-11-29T17:55:20Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='b1f70c311d4941c986de21ac458d11ab',ramdisk_id='',reservation_id='r-adqmslmn',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='4217f428-8d9d-4ee1-9614-642d26d90c46',image_container_format='bare',image_disk_format='qcow2',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-1784608629',owner_user_name='tempest-ServerActionsTestOtherA-1784608629-project-member'},tags=<?>,task_state='rebuilding',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T17:57:16Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='368555c72103480b82c5c0bf64b07360',uuid=71f2a1ab-3df7-411c-93fa-b0a1a5a44f0a,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "d40a5800-7391-4206-a661-fbce50c35a65", "address": "fa:16:3e:1a:53:06", "network": {"id": "7c2c368e-4c7d-4d70-9a40-c10fe9541af9", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1287934102-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.120", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b1f70c311d4941c986de21ac458d11ab", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd40a5800-73", "ovs_interfaceid": "d40a5800-7391-4206-a661-fbce50c35a65", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74613) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 29 17:57:18 user nova-compute[74613]: DEBUG nova.network.os_vif_util [None req-03c71a7b-32a0-47d1-86ad-ac97b97fb8aa tempest-ServerActionsTestOtherA-1784608629 tempest-ServerActionsTestOtherA-1784608629-project-member] Converting VIF {"id": "d40a5800-7391-4206-a661-fbce50c35a65", "address": "fa:16:3e:1a:53:06", "network": {"id": "7c2c368e-4c7d-4d70-9a40-c10fe9541af9", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1287934102-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.120", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b1f70c311d4941c986de21ac458d11ab", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd40a5800-73", "ovs_interfaceid": "d40a5800-7391-4206-a661-fbce50c35a65", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74613) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 17:57:18 user nova-compute[74613]: DEBUG nova.network.os_vif_util [None req-03c71a7b-32a0-47d1-86ad-ac97b97fb8aa tempest-ServerActionsTestOtherA-1784608629 tempest-ServerActionsTestOtherA-1784608629-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:1a:53:06,bridge_name='br-int',has_traffic_filtering=True,id=d40a5800-7391-4206-a661-fbce50c35a65,network=Network(7c2c368e-4c7d-4d70-9a40-c10fe9541af9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd40a5800-73') {{(pid=74613) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 17:57:18 user nova-compute[74613]: DEBUG os_vif [None req-03c71a7b-32a0-47d1-86ad-ac97b97fb8aa tempest-ServerActionsTestOtherA-1784608629 tempest-ServerActionsTestOtherA-1784608629-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:1a:53:06,bridge_name='br-int',has_traffic_filtering=True,id=d40a5800-7391-4206-a661-fbce50c35a65,network=Network(7c2c368e-4c7d-4d70-9a40-c10fe9541af9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd40a5800-73') {{(pid=74613) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 29 17:57:18 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:57:18 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapd40a5800-73, bridge=br-int, if_exists=True) {{(pid=74613) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 17:57:18 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:57:18 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 17:57:18 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:57:18 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=e91e8df0-2a48-4b81-8cc5-edcc4c8bc823) {{(pid=74613) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 17:57:18 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:57:18 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 17:57:18 user nova-compute[74613]: INFO os_vif [None req-03c71a7b-32a0-47d1-86ad-ac97b97fb8aa tempest-ServerActionsTestOtherA-1784608629 tempest-ServerActionsTestOtherA-1784608629-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:1a:53:06,bridge_name='br-int',has_traffic_filtering=True,id=d40a5800-7391-4206-a661-fbce50c35a65,network=Network(7c2c368e-4c7d-4d70-9a40-c10fe9541af9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd40a5800-73')
Nov 29 17:57:18 user nova-compute[74613]: DEBUG nova.virt.libvirt.volume.iscsi [None req-03c71a7b-32a0-47d1-86ad-ac97b97fb8aa tempest-ServerActionsTestOtherA-1784608629 tempest-ServerActionsTestOtherA-1784608629-project-member] [instance: 71f2a1ab-3df7-411c-93fa-b0a1a5a44f0a] calling os-brick to detach iSCSI Volume {{(pid=74613) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 29 17:57:18 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-03c71a7b-32a0-47d1-86ad-ac97b97fb8aa tempest-ServerActionsTestOtherA-1784608629 tempest-ServerActionsTestOtherA-1784608629-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff828156890>, {'target_iqn': 'iqn.2010-10.org.openstack:72d22ffa-f425-4575-86a5-afbd8bb9cdd6', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'hUFVkcjz', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, None), 'kwargs': True}}" {{(pid=74613) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 17:57:18 user nova-compute[74613]: WARNING os_brick.initiator.connectors.base [None req-03c71a7b-32a0-47d1-86ad-ac97b97fb8aa tempest-ServerActionsTestOtherA-1784608629 tempest-ServerActionsTestOtherA-1784608629-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Nov 29 17:57:18 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.base [None req-03c71a7b-32a0-47d1-86ad-ac97b97fb8aa tempest-ServerActionsTestOtherA-1784608629 tempest-ServerActionsTestOtherA-1784608629-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 17:57:18 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.base [None req-03c71a7b-32a0-47d1-86ad-ac97b97fb8aa tempest-ServerActionsTestOtherA-1784608629 tempest-ServerActionsTestOtherA-1784608629-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 17:57:18 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 17:57:18 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 17:57:18 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[2cd07f5a-a1dd-4d0f-949b-a8642998aa92]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:070b1031-e105-4cba-a039-2286e23727c5\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:9511387c-8772-40f2-bf2d-6b6387649e9f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:6a07b572-6430-4d0f-9aaf-8a8dbc39831e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:00ec83b4-5d84-416a-bad9-7511171a9da0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 17:57:18 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-03c71a7b-32a0-47d1-86ad-ac97b97fb8aa tempest-ServerActionsTestOtherA-1784608629 tempest-ServerActionsTestOtherA-1784608629-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 29 17:57:18 user nova-compute[74613]: No targets found.
Nov 29 17:57:18 user nova-compute[74613]: iSNS:
Nov 29 17:57:18 user nova-compute[74613]: No targets found.
Nov 29 17:57:18 user nova-compute[74613]: STATIC:
Nov 29 17:57:18 user nova-compute[74613]: Target: iqn.2010-10.org.openstack:070b1031-e105-4cba-a039-2286e23727c5
Nov 29 17:57:18 user nova-compute[74613]:         Portal: 172.16.0.220:3260,-1
Nov 29 17:57:18 user nova-compute[74613]:                 Iface Name: default
Nov 29 17:57:18 user nova-compute[74613]: Target: iqn.2010-10.org.openstack:9511387c-8772-40f2-bf2d-6b6387649e9f
Nov 29 17:57:18 user nova-compute[74613]:         Portal: 172.16.0.220:3260,-1
Nov 29 17:57:18 user nova-compute[74613]:                 Iface Name: default
Nov 29 17:57:18 user nova-compute[74613]: Target: iqn.2010-10.org.openstack:6a07b572-6430-4d0f-9aaf-8a8dbc39831e
Nov 29 17:57:18 user nova-compute[74613]:         Portal: 172.16.0.220:3260,-1
Nov 29 17:57:18 user nova-compute[74613]:                 Iface Name: default
Nov 29 17:57:18 user nova-compute[74613]: Target: iqn.2010-10.org.openstack:00ec83b4-5d84-416a-bad9-7511171a9da0
Nov 29 17:57:18 user nova-compute[74613]:         Portal: 172.16.0.220:3260,-1
Nov 29 17:57:18 user nova-compute[74613]:                 Iface Name: default
Nov 29 17:57:18 user nova-compute[74613]: FIRMWARE:
Nov 29 17:57:18 user nova-compute[74613]: No targets found.
Nov 29 17:57:18 user nova-compute[74613]:  stderr= {{(pid=74613) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 17:57:18 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-03c71a7b-32a0-47d1-86ad-ac97b97fb8aa tempest-ServerActionsTestOtherA-1784608629 tempest-ServerActionsTestOtherA-1784608629-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 29 17:57:18 user nova-compute[74613]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 29 17:57:18 user nova-compute[74613]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74613) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 29 17:57:18 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-03c71a7b-32a0-47d1-86ad-ac97b97fb8aa tempest-ServerActionsTestOtherA-1784608629 tempest-ServerActionsTestOtherA-1784608629-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:72d22ffa-f425-4575-86a5-afbd8bb9cdd6', 0)] {{(pid=74613) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 29 17:57:18 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 17:57:18 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 17:57:18 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[882565cf-4dad-47ee-b8a6-21daec3aabeb]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:00ec83b4-5d84-416a-bad9-7511171a9da0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:070b1031-e105-4cba-a039-2286e23727c5\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6a07b572-6430-4d0f-9aaf-8a8dbc39831e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9511387c-8772-40f2-bf2d-6b6387649e9f\n', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 17:57:18 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 17:57:18 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b6b0ba36-ad89-45f1-9578-8b999567dd25/disk.rescue --force-share --output=json" returned: 0 in 0.207s {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 17:57:18 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b6b0ba36-ad89-45f1-9578-8b999567dd25/disk.rescue --force-share --output=json {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 17:57:18 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 17:57:18 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5a9ad1e-a52a-4306-9575-007d1f69aff3]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9511387c-8772-40f2-bf2d-6b6387649e9f (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:070b1031-e105-4cba-a039-2286e23727c5 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00ec83b4-5d84-416a-bad9-7511171a9da0 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a07b572-6430-4d0f-9aaf-8a8dbc39831e (non-flash)\n', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 17:57:18 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-03c71a7b-32a0-47d1-86ad-ac97b97fb8aa tempest-ServerActionsTestOtherA-1784608629 tempest-ServerActionsTestOtherA-1784608629-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9511387c-8772-40f2-bf2d-6b6387649e9f (non-flash)
Nov 29 17:57:18 user nova-compute[74613]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:070b1031-e105-4cba-a039-2286e23727c5 (non-flash)
Nov 29 17:57:18 user nova-compute[74613]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00ec83b4-5d84-416a-bad9-7511171a9da0 (non-flash)
Nov 29 17:57:18 user nova-compute[74613]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a07b572-6430-4d0f-9aaf-8a8dbc39831e (non-flash)
Nov 29 17:57:18 user nova-compute[74613]:  stderr= {{(pid=74613) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 17:57:18 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-03c71a7b-32a0-47d1-86ad-ac97b97fb8aa tempest-ServerActionsTestOtherA-1784608629 tempest-ServerActionsTestOtherA-1784608629-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9511387c-8772-40f2-bf2d-6b6387649e9f (non-flash)
Nov 29 17:57:18 user nova-compute[74613]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:070b1031-e105-4cba-a039-2286e23727c5 (non-flash)
Nov 29 17:57:18 user nova-compute[74613]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00ec83b4-5d84-416a-bad9-7511171a9da0 (non-flash)
Nov 29 17:57:18 user nova-compute[74613]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a07b572-6430-4d0f-9aaf-8a8dbc39831e (non-flash)
Nov 29 17:57:18 user nova-compute[74613]:  stderr= {{(pid=74613) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 17:57:18 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-03c71a7b-32a0-47d1-86ad-ac97b97fb8aa tempest-ServerActionsTestOtherA-1784608629 tempest-ServerActionsTestOtherA-1784608629-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7ff81814ab90>, {}) {{(pid=74613) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 29 17:57:18 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-03c71a7b-32a0-47d1-86ad-ac97b97fb8aa tempest-ServerActionsTestOtherA-1784608629 tempest-ServerActionsTestOtherA-1784608629-project-member] Disconnecting from: [] {{(pid=74613) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 29 17:57:18 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.base [None req-03c71a7b-32a0-47d1-86ad-ac97b97fb8aa tempest-ServerActionsTestOtherA-1784608629 tempest-ServerActionsTestOtherA-1784608629-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.131s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 17:57:18 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-03c71a7b-32a0-47d1-86ad-ac97b97fb8aa tempest-ServerActionsTestOtherA-1784608629 tempest-ServerActionsTestOtherA-1784608629-project-member] <== disconnect_volume: return (133ms) None {{(pid=74613) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 17:57:18 user nova-compute[74613]: DEBUG nova.virt.libvirt.volume.iscsi [None req-03c71a7b-32a0-47d1-86ad-ac97b97fb8aa tempest-ServerActionsTestOtherA-1784608629 tempest-ServerActionsTestOtherA-1784608629-project-member] [instance: 71f2a1ab-3df7-411c-93fa-b0a1a5a44f0a] Disconnected iSCSI Volume {{(pid=74613) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 29 17:57:18 user nova-compute[74613]: INFO nova.virt.libvirt.driver [None req-03c71a7b-32a0-47d1-86ad-ac97b97fb8aa tempest-ServerActionsTestOtherA-1784608629 tempest-ServerActionsTestOtherA-1784608629-project-member] [instance: 71f2a1ab-3df7-411c-93fa-b0a1a5a44f0a] Deleting instance files /opt/stack/data/nova/instances/71f2a1ab-3df7-411c-93fa-b0a1a5a44f0a_del
Nov 29 17:57:18 user nova-compute[74613]: INFO nova.virt.libvirt.driver [None req-03c71a7b-32a0-47d1-86ad-ac97b97fb8aa tempest-ServerActionsTestOtherA-1784608629 tempest-ServerActionsTestOtherA-1784608629-project-member] [instance: 71f2a1ab-3df7-411c-93fa-b0a1a5a44f0a] Deletion of /opt/stack/data/nova/instances/71f2a1ab-3df7-411c-93fa-b0a1a5a44f0a_del complete
Nov 29 17:57:18 user nova-compute[74613]: DEBUG nova.compute.manager [req-eee6696f-3887-44d0-89c3-85e736cc46d5 req-e22ac32d-a549-44f5-b8f0-04fe81b27590 service nova] [instance: 71f2a1ab-3df7-411c-93fa-b0a1a5a44f0a] Received event network-vif-plugged-d40a5800-7391-4206-a661-fbce50c35a65 {{(pid=74613) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 17:57:18 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-eee6696f-3887-44d0-89c3-85e736cc46d5 req-e22ac32d-a549-44f5-b8f0-04fe81b27590 service nova] Acquiring lock "71f2a1ab-3df7-411c-93fa-b0a1a5a44f0a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 17:57:18 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-eee6696f-3887-44d0-89c3-85e736cc46d5 req-e22ac32d-a549-44f5-b8f0-04fe81b27590 service nova] Lock "71f2a1ab-3df7-411c-93fa-b0a1a5a44f0a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 17:57:18 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-eee6696f-3887-44d0-89c3-85e736cc46d5 req-e22ac32d-a549-44f5-b8f0-04fe81b27590 service nova] Lock "71f2a1ab-3df7-411c-93fa-b0a1a5a44f0a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 17:57:18 user nova-compute[74613]: DEBUG nova.compute.manager [req-eee6696f-3887-44d0-89c3-85e736cc46d5 req-e22ac32d-a549-44f5-b8f0-04fe81b27590 service nova] [instance: 71f2a1ab-3df7-411c-93fa-b0a1a5a44f0a] No waiting events found dispatching network-vif-plugged-d40a5800-7391-4206-a661-fbce50c35a65 {{(pid=74613) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 17:57:18 user nova-compute[74613]: WARNING nova.compute.manager [req-eee6696f-3887-44d0-89c3-85e736cc46d5 req-e22ac32d-a549-44f5-b8f0-04fe81b27590 service nova] [instance: 71f2a1ab-3df7-411c-93fa-b0a1a5a44f0a] Received unexpected event network-vif-plugged-d40a5800-7391-4206-a661-fbce50c35a65 for instance with vm_state active and task_state rebuilding.
Nov 29 17:57:18 user nova-compute[74613]: DEBUG nova.network.neutron [None req-d310ea77-5c70-4261-93f9-d65c3ebe5b97 tempest-ServerStableDeviceRescueTest-1416322546 tempest-ServerStableDeviceRescueTest-1416322546-project-member] [instance: b6b0ba36-ad89-45f1-9578-8b999567dd25] Updating instance_info_cache with network_info: [{"id": "0167e253-42dd-486a-8231-a8b8199f3584", "address": "fa:16:3e:3f:ea:5d", "network": {"id": "880ea498-5e4e-4786-a894-bac0f42572f4", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1846928198-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.254", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b8f184c16b5348beb2dc9e6359a47651", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0167e253-42", "ovs_interfaceid": "0167e253-42dd-486a-8231-a8b8199f3584", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74613) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 17:57:18 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b6b0ba36-ad89-45f1-9578-8b999567dd25/disk.rescue --force-share --output=json" returned: 0 in 0.205s {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 17:57:18 user nova-compute[74613]: INFO nova.virt.block_device [None req-03c71a7b-32a0-47d1-86ad-ac97b97fb8aa tempest-ServerActionsTestOtherA-1784608629 tempest-ServerActionsTestOtherA-1784608629-project-member] [instance: 71f2a1ab-3df7-411c-93fa-b0a1a5a44f0a] Booting with volume 72d22ffa-f425-4575-86a5-afbd8bb9cdd6 at /dev/vdb
Nov 29 17:57:18 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-d310ea77-5c70-4261-93f9-d65c3ebe5b97 tempest-ServerStableDeviceRescueTest-1416322546 tempest-ServerStableDeviceRescueTest-1416322546-project-member] Releasing lock "refresh_cache-b6b0ba36-ad89-45f1-9578-8b999567dd25" {{(pid=74613) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 17:57:18 user nova-compute[74613]: DEBUG nova.objects.instance [None req-d310ea77-5c70-4261-93f9-d65c3ebe5b97 tempest-ServerStableDeviceRescueTest-1416322546 tempest-ServerStableDeviceRescueTest-1416322546-project-member] Lazy-loading 'flavor' on Instance uuid b6b0ba36-ad89-45f1-9578-8b999567dd25 {{(pid=74613) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 17:57:18 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=74613) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 29 17:57:18 user nova-compute[74613]: WARNING nova.virt.libvirt.driver [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Error from libvirt while getting description of instance-0000000d: [Error Code 42] Domain not found: no domain with matching uuid '71f2a1ab-3df7-411c-93fa-b0a1a5a44f0a' (instance-0000000d): libvirt.libvirtError: Domain not found: no domain with matching uuid '71f2a1ab-3df7-411c-93fa-b0a1a5a44f0a' (instance-0000000d)
Nov 29 17:57:18 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3b828860-5cc5-40b0-b845-8e560211794e/disk --force-share --output=json {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 17:57:18 user nova-compute[74613]: DEBUG os_brick.utils [None req-03c71a7b-32a0-47d1-86ad-ac97b97fb8aa tempest-ServerActionsTestOtherA-1784608629 tempest-ServerActionsTestOtherA-1784608629-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74613) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 17:57:18 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 17:57:18 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 17:57:18 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[582a15f1-6664-4fa2-93b1-9239e90d1368]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:400972819b5\n', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 17:57:18 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 17:57:18 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 17:57:18 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[de1498bf-103d-429a-a472-7a0f30939fc5]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 17:57:18 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 17:57:18 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.021s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 17:57:18 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[63e1268f-66fd-4c1b-b014-08524542e70b]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 17:57:18 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[ffac019f-58d2-4aa9-b5c0-9121950f1f0e]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 17:57:18 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-03c71a7b-32a0-47d1-86ad-ac97b97fb8aa tempest-ServerActionsTestOtherA-1784608629 tempest-ServerActionsTestOtherA-1784608629-project-member] Running cmd (subprocess): nvme version {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 17:57:19 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-03c71a7b-32a0-47d1-86ad-ac97b97fb8aa tempest-ServerActionsTestOtherA-1784608629 tempest-ServerActionsTestOtherA-1784608629-project-member] 'nvme version' failed. Not Retrying. {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 17:57:19 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.nvmeof [None req-03c71a7b-32a0-47d1-86ad-ac97b97fb8aa tempest-ServerActionsTestOtherA-1784608629 tempest-ServerActionsTestOtherA-1784608629-project-member] nvme not present on system {{(pid=74613) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 29 17:57:19 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3b828860-5cc5-40b0-b845-8e560211794e/disk --force-share --output=json" returned: 0 in 0.242s {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 17:57:19 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3b828860-5cc5-40b0-b845-8e560211794e/disk --force-share --output=json {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 17:57:19 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:57:19 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 17:57:19 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 17:57:19 user nova-compute[74613]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 29 17:57:19 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[8957c70e-bf96-4047-9fd3-49a31026b22b]: (4, '') {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 17:57:19 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:57:19 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.lightos [None req-03c71a7b-32a0-47d1-86ad-ac97b97fb8aa tempest-ServerActionsTestOtherA-1784608629 tempest-ServerActionsTestOtherA-1784608629-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74613) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 29 17:57:19 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.lightos [None req-03c71a7b-32a0-47d1-86ad-ac97b97fb8aa tempest-ServerActionsTestOtherA-1784608629 tempest-ServerActionsTestOtherA-1784608629-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74613) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 29 17:57:19 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.lightos [None req-03c71a7b-32a0-47d1-86ad-ac97b97fb8aa tempest-ServerActionsTestOtherA-1784608629 tempest-ServerActionsTestOtherA-1784608629-project-member] LIGHTOS: no hostnqn found. {{(pid=74613) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 29 17:57:19 user nova-compute[74613]: DEBUG os_brick.utils [None req-03c71a7b-32a0-47d1-86ad-ac97b97fb8aa tempest-ServerActionsTestOtherA-1784608629 tempest-ServerActionsTestOtherA-1784608629-project-member] <== get_connector_properties: return (265ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:400972819b5', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74613) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 17:57:19 user nova-compute[74613]: DEBUG nova.virt.block_device [None req-03c71a7b-32a0-47d1-86ad-ac97b97fb8aa tempest-ServerActionsTestOtherA-1784608629 tempest-ServerActionsTestOtherA-1784608629-project-member] [instance: 71f2a1ab-3df7-411c-93fa-b0a1a5a44f0a] Updating existing volume attachment record: 2b57905b-4d7b-4b9b-a7ce-8375444e7a47 {{(pid=74613) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 29 17:57:19 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:57:19 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3b828860-5cc5-40b0-b845-8e560211794e/disk --force-share --output=json" returned: 0 in 0.222s {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 17:57:19 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/abc9e2b8-f467-4cd0-b40f-de511fde1ec1/disk --force-share --output=json {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 17:57:19 user nova-compute[74613]: DEBUG nova.compute.manager [req-17ddc80c-edf8-4a36-b663-d1527894c0c7 req-d5c0d2d2-833e-48f0-b606-ce31b3b75ee7 service nova] [instance: b6b0ba36-ad89-45f1-9578-8b999567dd25] Received event network-vif-unplugged-0167e253-42dd-486a-8231-a8b8199f3584 {{(pid=74613) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 17:57:19 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-17ddc80c-edf8-4a36-b663-d1527894c0c7 req-d5c0d2d2-833e-48f0-b606-ce31b3b75ee7 service nova] Acquiring lock "b6b0ba36-ad89-45f1-9578-8b999567dd25-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 17:57:19 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-17ddc80c-edf8-4a36-b663-d1527894c0c7 req-d5c0d2d2-833e-48f0-b606-ce31b3b75ee7 service nova] Lock "b6b0ba36-ad89-45f1-9578-8b999567dd25-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 17:57:19 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-17ddc80c-edf8-4a36-b663-d1527894c0c7 req-d5c0d2d2-833e-48f0-b606-ce31b3b75ee7 service nova] Lock "b6b0ba36-ad89-45f1-9578-8b999567dd25-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 17:57:19 user nova-compute[74613]: DEBUG nova.compute.manager [req-17ddc80c-edf8-4a36-b663-d1527894c0c7 req-d5c0d2d2-833e-48f0-b606-ce31b3b75ee7 service nova] [instance: b6b0ba36-ad89-45f1-9578-8b999567dd25] No waiting events found dispatching network-vif-unplugged-0167e253-42dd-486a-8231-a8b8199f3584 {{(pid=74613) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 17:57:19 user nova-compute[74613]: WARNING nova.compute.manager [req-17ddc80c-edf8-4a36-b663-d1527894c0c7 req-d5c0d2d2-833e-48f0-b606-ce31b3b75ee7 service nova] [instance: b6b0ba36-ad89-45f1-9578-8b999567dd25] Received unexpected event network-vif-unplugged-0167e253-42dd-486a-8231-a8b8199f3584 for instance with vm_state rescued and task_state unrescuing.
Nov 29 17:57:19 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/abc9e2b8-f467-4cd0-b40f-de511fde1ec1/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 17:57:19 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/abc9e2b8-f467-4cd0-b40f-de511fde1ec1/disk --force-share --output=json {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 17:57:19 user nova-compute[74613]: DEBUG nova.compute.manager [req-db3fb3e3-f59d-47bb-a785-b902467ed012 req-6a6f2a43-188e-4f7e-b473-057863d24e15 service nova] [instance: b6b0ba36-ad89-45f1-9578-8b999567dd25] Received event network-changed-0167e253-42dd-486a-8231-a8b8199f3584 {{(pid=74613) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 17:57:19 user nova-compute[74613]: DEBUG nova.compute.manager [req-db3fb3e3-f59d-47bb-a785-b902467ed012 req-6a6f2a43-188e-4f7e-b473-057863d24e15 service nova] [instance: b6b0ba36-ad89-45f1-9578-8b999567dd25] Refreshing instance network info cache due to event network-changed-0167e253-42dd-486a-8231-a8b8199f3584. {{(pid=74613) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 17:57:19 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-db3fb3e3-f59d-47bb-a785-b902467ed012 req-6a6f2a43-188e-4f7e-b473-057863d24e15 service nova] Acquiring lock "refresh_cache-b6b0ba36-ad89-45f1-9578-8b999567dd25" {{(pid=74613) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 17:57:19 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-db3fb3e3-f59d-47bb-a785-b902467ed012 req-6a6f2a43-188e-4f7e-b473-057863d24e15 service nova] Acquired lock "refresh_cache-b6b0ba36-ad89-45f1-9578-8b999567dd25" {{(pid=74613) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 17:57:19 user nova-compute[74613]: DEBUG nova.network.neutron [req-db3fb3e3-f59d-47bb-a785-b902467ed012 req-6a6f2a43-188e-4f7e-b473-057863d24e15 service nova] [instance: b6b0ba36-ad89-45f1-9578-8b999567dd25] Refreshing network info cache for port 0167e253-42dd-486a-8231-a8b8199f3584 {{(pid=74613) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 17:57:19 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/abc9e2b8-f467-4cd0-b40f-de511fde1ec1/disk --force-share --output=json" returned: 0 in 0.208s {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 17:57:19 user nova-compute[74613]: INFO nova.virt.libvirt.driver [-] [instance: b6b0ba36-ad89-45f1-9578-8b999567dd25] Instance destroyed successfully.
Nov 29 17:57:19 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0aa463c6-01e7-48e5-b082-e083558342e3/disk --force-share --output=json {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 17:57:19 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0aa463c6-01e7-48e5-b082-e083558342e3/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 17:57:19 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0aa463c6-01e7-48e5-b082-e083558342e3/disk --force-share --output=json {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 17:57:20 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0aa463c6-01e7-48e5-b082-e083558342e3/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 17:57:20 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:57:20 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74613) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 29 17:57:20 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cd22685a-028c-4e0c-834d-e7b20f6d06ab/disk.rescue --force-share --output=json {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 17:57:20 user nova-compute[74613]: DEBUG nova.network.neutron [req-db3fb3e3-f59d-47bb-a785-b902467ed012 req-6a6f2a43-188e-4f7e-b473-057863d24e15 service nova] [instance: b6b0ba36-ad89-45f1-9578-8b999567dd25] Updated VIF entry in instance network info cache for port 0167e253-42dd-486a-8231-a8b8199f3584. {{(pid=74613) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 17:57:20 user nova-compute[74613]: DEBUG nova.network.neutron [req-db3fb3e3-f59d-47bb-a785-b902467ed012 req-6a6f2a43-188e-4f7e-b473-057863d24e15 service nova] [instance: b6b0ba36-ad89-45f1-9578-8b999567dd25] Updating instance_info_cache with network_info: [{"id": "0167e253-42dd-486a-8231-a8b8199f3584", "address": "fa:16:3e:3f:ea:5d", "network": {"id": "880ea498-5e4e-4786-a894-bac0f42572f4", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1846928198-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.254", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b8f184c16b5348beb2dc9e6359a47651", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0167e253-42", "ovs_interfaceid": "0167e253-42dd-486a-8231-a8b8199f3584", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74613) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 17:57:20 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-db3fb3e3-f59d-47bb-a785-b902467ed012 req-6a6f2a43-188e-4f7e-b473-057863d24e15 service nova] Releasing lock "refresh_cache-b6b0ba36-ad89-45f1-9578-8b999567dd25" {{(pid=74613) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 17:57:20 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cd22685a-028c-4e0c-834d-e7b20f6d06ab/disk.rescue --force-share --output=json" returned: 0 in 0.188s {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 17:57:20 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cd22685a-028c-4e0c-834d-e7b20f6d06ab/disk.rescue --force-share --output=json {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 17:57:20 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cd22685a-028c-4e0c-834d-e7b20f6d06ab/disk.rescue --force-share --output=json" returned: 0 in 0.220s {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 17:57:20 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/356478b0-e233-46aa-a1bd-45ce1f9eca8f/disk --force-share --output=json {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 17:57:20 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/356478b0-e233-46aa-a1bd-45ce1f9eca8f/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 17:57:20 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/356478b0-e233-46aa-a1bd-45ce1f9eca8f/disk --force-share --output=json {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 17:57:20 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/356478b0-e233-46aa-a1bd-45ce1f9eca8f/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 17:57:20 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/74ac9703-1cd7-4983-b7d4-c69b01fec7b2/disk --force-share --output=json {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 17:57:21 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/74ac9703-1cd7-4983-b7d4-c69b01fec7b2/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 17:57:21 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/74ac9703-1cd7-4983-b7d4-c69b01fec7b2/disk --force-share --output=json {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 17:57:21 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:57:21 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:57:21 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:57:21 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/74ac9703-1cd7-4983-b7d4-c69b01fec7b2/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 17:57:23 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:57:23 user nova-compute[74613]: DEBUG nova.compute.manager [req-2a990dca-8577-40ee-b037-237e81f17784 req-3ad6b3f4-0e07-45b0-a742-43e629b55cf3 service nova] [instance: b6b0ba36-ad89-45f1-9578-8b999567dd25] Received event network-vif-plugged-0167e253-42dd-486a-8231-a8b8199f3584 {{(pid=74613) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 17:57:23 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-2a990dca-8577-40ee-b037-237e81f17784 req-3ad6b3f4-0e07-45b0-a742-43e629b55cf3 service nova] Acquiring lock "b6b0ba36-ad89-45f1-9578-8b999567dd25-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 17:57:23 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-2a990dca-8577-40ee-b037-237e81f17784 req-3ad6b3f4-0e07-45b0-a742-43e629b55cf3 service nova] Lock "b6b0ba36-ad89-45f1-9578-8b999567dd25-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 17:57:23 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-2a990dca-8577-40ee-b037-237e81f17784 req-3ad6b3f4-0e07-45b0-a742-43e629b55cf3 service nova] Lock "b6b0ba36-ad89-45f1-9578-8b999567dd25-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 17:57:23 user nova-compute[74613]: DEBUG nova.compute.manager [req-2a990dca-8577-40ee-b037-237e81f17784 req-3ad6b3f4-0e07-45b0-a742-43e629b55cf3 service nova] [instance: b6b0ba36-ad89-45f1-9578-8b999567dd25] No waiting events found dispatching network-vif-plugged-0167e253-42dd-486a-8231-a8b8199f3584 {{(pid=74613) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 17:57:23 user nova-compute[74613]: WARNING nova.compute.manager [req-2a990dca-8577-40ee-b037-237e81f17784 req-3ad6b3f4-0e07-45b0-a742-43e629b55cf3 service nova] [instance: b6b0ba36-ad89-45f1-9578-8b999567dd25] Received unexpected event network-vif-plugged-0167e253-42dd-486a-8231-a8b8199f3584 for instance with vm_state rescued and task_state unrescuing.
Nov 29 17:57:23 user nova-compute[74613]: DEBUG nova.compute.manager [req-2a990dca-8577-40ee-b037-237e81f17784 req-3ad6b3f4-0e07-45b0-a742-43e629b55cf3 service nova] [instance: b6b0ba36-ad89-45f1-9578-8b999567dd25] Received event network-vif-plugged-0167e253-42dd-486a-8231-a8b8199f3584 {{(pid=74613) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 17:57:23 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-2a990dca-8577-40ee-b037-237e81f17784 req-3ad6b3f4-0e07-45b0-a742-43e629b55cf3 service nova] Acquiring lock "b6b0ba36-ad89-45f1-9578-8b999567dd25-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 17:57:23 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-2a990dca-8577-40ee-b037-237e81f17784 req-3ad6b3f4-0e07-45b0-a742-43e629b55cf3 service nova] Lock "b6b0ba36-ad89-45f1-9578-8b999567dd25-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 17:57:23 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-2a990dca-8577-40ee-b037-237e81f17784 req-3ad6b3f4-0e07-45b0-a742-43e629b55cf3 service nova] Lock "b6b0ba36-ad89-45f1-9578-8b999567dd25-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 17:57:23 user nova-compute[74613]: DEBUG nova.compute.manager [req-2a990dca-8577-40ee-b037-237e81f17784 req-3ad6b3f4-0e07-45b0-a742-43e629b55cf3 service nova] [instance: b6b0ba36-ad89-45f1-9578-8b999567dd25] No waiting events found dispatching network-vif-plugged-0167e253-42dd-486a-8231-a8b8199f3584 {{(pid=74613) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 17:57:23 user nova-compute[74613]: WARNING nova.compute.manager [req-2a990dca-8577-40ee-b037-237e81f17784 req-3ad6b3f4-0e07-45b0-a742-43e629b55cf3 service nova] [instance: b6b0ba36-ad89-45f1-9578-8b999567dd25] Received unexpected event network-vif-plugged-0167e253-42dd-486a-8231-a8b8199f3584 for instance with vm_state rescued and task_state unrescuing.
Nov 29 17:57:23 user nova-compute[74613]: DEBUG nova.compute.manager [req-ef2b84e4-3ec1-4410-9133-df8486d60a71 req-2eb27062-204b-40bb-8cf3-170544d93235 service nova] [instance: b6b0ba36-ad89-45f1-9578-8b999567dd25] Received event network-changed-0167e253-42dd-486a-8231-a8b8199f3584 {{(pid=74613) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 17:57:23 user nova-compute[74613]: DEBUG nova.compute.manager [req-ef2b84e4-3ec1-4410-9133-df8486d60a71 req-2eb27062-204b-40bb-8cf3-170544d93235 service nova] [instance: b6b0ba36-ad89-45f1-9578-8b999567dd25] Refreshing instance network info cache due to event network-changed-0167e253-42dd-486a-8231-a8b8199f3584. {{(pid=74613) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 17:57:23 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-ef2b84e4-3ec1-4410-9133-df8486d60a71 req-2eb27062-204b-40bb-8cf3-170544d93235 service nova] Acquiring lock "refresh_cache-b6b0ba36-ad89-45f1-9578-8b999567dd25" {{(pid=74613) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 17:57:23 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-ef2b84e4-3ec1-4410-9133-df8486d60a71 req-2eb27062-204b-40bb-8cf3-170544d93235 service nova] Acquired lock "refresh_cache-b6b0ba36-ad89-45f1-9578-8b999567dd25" {{(pid=74613) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 17:57:23 user nova-compute[74613]: DEBUG nova.network.neutron [req-ef2b84e4-3ec1-4410-9133-df8486d60a71 req-2eb27062-204b-40bb-8cf3-170544d93235 service nova] [instance: b6b0ba36-ad89-45f1-9578-8b999567dd25] Refreshing network info cache for port 0167e253-42dd-486a-8231-a8b8199f3584 {{(pid=74613) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 17:57:23 user nova-compute[74613]: DEBUG nova.compute.manager [req-780722b0-371b-46b6-b346-b646a145de0c req-cfd2a9a0-d79f-4741-a1e6-4489281a2b6d service nova] [instance: b6b0ba36-ad89-45f1-9578-8b999567dd25] Received event network-vif-plugged-0167e253-42dd-486a-8231-a8b8199f3584 {{(pid=74613) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 17:57:23 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-780722b0-371b-46b6-b346-b646a145de0c req-cfd2a9a0-d79f-4741-a1e6-4489281a2b6d service nova] Acquiring lock "b6b0ba36-ad89-45f1-9578-8b999567dd25-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 17:57:23 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-780722b0-371b-46b6-b346-b646a145de0c req-cfd2a9a0-d79f-4741-a1e6-4489281a2b6d service nova] Lock "b6b0ba36-ad89-45f1-9578-8b999567dd25-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 17:57:23 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-780722b0-371b-46b6-b346-b646a145de0c req-cfd2a9a0-d79f-4741-a1e6-4489281a2b6d service nova] Lock "b6b0ba36-ad89-45f1-9578-8b999567dd25-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 17:57:23 user nova-compute[74613]: DEBUG nova.compute.manager [req-780722b0-371b-46b6-b346-b646a145de0c req-cfd2a9a0-d79f-4741-a1e6-4489281a2b6d service nova] [instance: b6b0ba36-ad89-45f1-9578-8b999567dd25] No waiting events found dispatching network-vif-plugged-0167e253-42dd-486a-8231-a8b8199f3584 {{(pid=74613) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 17:57:23 user nova-compute[74613]: WARNING nova.compute.manager [req-780722b0-371b-46b6-b346-b646a145de0c req-cfd2a9a0-d79f-4741-a1e6-4489281a2b6d service nova] [instance: b6b0ba36-ad89-45f1-9578-8b999567dd25] Received unexpected event network-vif-plugged-0167e253-42dd-486a-8231-a8b8199f3584 for instance with vm_state rescued and task_state unrescuing.
Nov 29 17:57:23 user nova-compute[74613]: DEBUG nova.compute.manager [None req-d310ea77-5c70-4261-93f9-d65c3ebe5b97 tempest-ServerStableDeviceRescueTest-1416322546 tempest-ServerStableDeviceRescueTest-1416322546-project-member] [instance: b6b0ba36-ad89-45f1-9578-8b999567dd25] Checking state {{(pid=74613) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 29 17:57:24 user nova-compute[74613]: WARNING nova.virt.libvirt.driver [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 17:57:24 user nova-compute[74613]: WARNING nova.virt.libvirt.driver [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 17:57:24 user nova-compute[74613]: DEBUG nova.compute.resource_tracker [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Hypervisor/Node resource view: name=user free_ram=7388MB free_disk=24.955524444580078GB free_vcpus=2 pci_devices=[{"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74613) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 29 17:57:24 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 17:57:24 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 17:57:24 user nova-compute[74613]: DEBUG nova.compute.resource_tracker [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Instance b6b0ba36-ad89-45f1-9578-8b999567dd25 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74613) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 17:57:24 user nova-compute[74613]: DEBUG nova.compute.resource_tracker [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Instance 3b828860-5cc5-40b0-b845-8e560211794e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74613) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 17:57:24 user nova-compute[74613]: DEBUG nova.compute.resource_tracker [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Instance abc9e2b8-f467-4cd0-b40f-de511fde1ec1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74613) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 17:57:24 user nova-compute[74613]: DEBUG nova.compute.resource_tracker [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Instance cd22685a-028c-4e0c-834d-e7b20f6d06ab actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74613) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 17:57:24 user nova-compute[74613]: DEBUG nova.compute.resource_tracker [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Instance 71f2a1ab-3df7-411c-93fa-b0a1a5a44f0a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74613) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 17:57:24 user nova-compute[74613]: DEBUG nova.compute.resource_tracker [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Instance c19e230e-2e6c-4c20-b15c-ad81a73674b4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74613) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 17:57:24 user nova-compute[74613]: DEBUG nova.compute.resource_tracker [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Instance 74ac9703-1cd7-4983-b7d4-c69b01fec7b2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74613) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 17:57:24 user nova-compute[74613]: DEBUG nova.compute.resource_tracker [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Instance c4bdb712-e1f9-4fc0-b527-87088d7eddf8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74613) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 17:57:24 user nova-compute[74613]: DEBUG nova.compute.resource_tracker [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Instance 0aa463c6-01e7-48e5-b082-e083558342e3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74613) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 17:57:24 user nova-compute[74613]: DEBUG nova.compute.resource_tracker [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Instance fae10c60-f989-4c99-bde4-60cd9f3e2055 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74613) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 17:57:24 user nova-compute[74613]: DEBUG nova.compute.resource_tracker [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Instance 356478b0-e233-46aa-a1bd-45ce1f9eca8f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74613) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 17:57:24 user nova-compute[74613]: DEBUG nova.compute.resource_tracker [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Total usable vcpus: 12, total allocated vcpus: 11 {{(pid=74613) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 29 17:57:24 user nova-compute[74613]: DEBUG nova.compute.resource_tracker [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Final resource view: name=user phys_ram=16011MB used_ram=6144MB phys_disk=40GB used_disk=9GB total_vcpus=12 used_vcpus=11 pci_stats=[] {{(pid=74613) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 29 17:57:24 user nova-compute[74613]: DEBUG nova.scheduler.client.report [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Refreshing inventories for resource provider 639d980e-3b12-44b1-b8f4-1812416fa4dd {{(pid=74613) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 29 17:57:24 user nova-compute[74613]: DEBUG nova.scheduler.client.report [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Updating ProviderTree inventory for provider 639d980e-3b12-44b1-b8f4-1812416fa4dd from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74613) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 29 17:57:24 user nova-compute[74613]: DEBUG nova.compute.provider_tree [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Updating inventory in ProviderTree for provider 639d980e-3b12-44b1-b8f4-1812416fa4dd with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74613) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 29 17:57:24 user nova-compute[74613]: DEBUG nova.scheduler.client.report [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Refreshing aggregate associations for resource provider 639d980e-3b12-44b1-b8f4-1812416fa4dd, aggregates: None {{(pid=74613) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 29 17:57:24 user nova-compute[74613]: DEBUG nova.scheduler.client.report [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Refreshing trait associations for resource provider 639d980e-3b12-44b1-b8f4-1812416fa4dd, traits: HW_CPU_X86_SSE,COMPUTE_VOLUME_EXTEND,COMPUTE_ACCELERATORS,HW_CPU_X86_SSE41,COMPUTE_STORAGE_BUS_IDE,COMPUTE_NODE,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,HW_CPU_X86_MMX,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,HW_CPU_X86_SSE2,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_STORAGE_BUS_USB,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_STORAGE_BUS_SATA,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_DEVICE_TAGGING,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_RESCUE_BFV,HW_CPU_X86_SSSE3,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_TRUSTED_CERTS,HW_CPU_X86_SSE42,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_STORAGE_BUS_FDC {{(pid=74613) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 29 17:57:24 user nova-compute[74613]: DEBUG nova.network.neutron [req-ef2b84e4-3ec1-4410-9133-df8486d60a71 req-2eb27062-204b-40bb-8cf3-170544d93235 service nova] [instance: b6b0ba36-ad89-45f1-9578-8b999567dd25] Updated VIF entry in instance network info cache for port 0167e253-42dd-486a-8231-a8b8199f3584. {{(pid=74613) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 17:57:24 user nova-compute[74613]: DEBUG nova.network.neutron [req-ef2b84e4-3ec1-4410-9133-df8486d60a71 req-2eb27062-204b-40bb-8cf3-170544d93235 service nova] [instance: b6b0ba36-ad89-45f1-9578-8b999567dd25] Updating instance_info_cache with network_info: [{"id": "0167e253-42dd-486a-8231-a8b8199f3584", "address": "fa:16:3e:3f:ea:5d", "network": {"id": "880ea498-5e4e-4786-a894-bac0f42572f4", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1846928198-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.254", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b8f184c16b5348beb2dc9e6359a47651", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0167e253-42", "ovs_interfaceid": "0167e253-42dd-486a-8231-a8b8199f3584", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74613) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 17:57:24 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-ef2b84e4-3ec1-4410-9133-df8486d60a71 req-2eb27062-204b-40bb-8cf3-170544d93235 service nova] Releasing lock "refresh_cache-b6b0ba36-ad89-45f1-9578-8b999567dd25" {{(pid=74613) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 17:57:24 user nova-compute[74613]: DEBUG nova.compute.provider_tree [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Inventory has not changed in ProviderTree for provider: 639d980e-3b12-44b1-b8f4-1812416fa4dd {{(pid=74613) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 17:57:24 user nova-compute[74613]: DEBUG nova.scheduler.client.report [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Inventory has not changed for provider 639d980e-3b12-44b1-b8f4-1812416fa4dd based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74613) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 17:57:24 user nova-compute[74613]: DEBUG nova.compute.resource_tracker [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Compute_service record updated for user:user {{(pid=74613) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 29 17:57:24 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.952s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 17:57:24 user nova-compute[74613]: DEBUG oslo_service.periodic_task [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=74613) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 17:57:25 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:57:25 user nova-compute[74613]: WARNING nova.virt.libvirt.driver [None req-8475fd58-e80d-4854-a489-ccd5cedbc8f9 tempest-AttachVolumeShelveTestJSON-1452861425 tempest-AttachVolumeShelveTestJSON-1452861425-project-member] Waiting for libvirt event about the detach of device vdc with device alias virtio-disk2 from instance c19e230e-2e6c-4c20-b15c-ad81a73674b4 is timed out.
Nov 29 17:57:25 user nova-compute[74613]: INFO nova.virt.libvirt.driver [None req-8475fd58-e80d-4854-a489-ccd5cedbc8f9 tempest-AttachVolumeShelveTestJSON-1452861425 tempest-AttachVolumeShelveTestJSON-1452861425-project-member] Successfully detached device vdc from instance c19e230e-2e6c-4c20-b15c-ad81a73674b4 from the live domain config.
Nov 29 17:57:25 user nova-compute[74613]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8475fd58-e80d-4854-a489-ccd5cedbc8f9 tempest-AttachVolumeShelveTestJSON-1452861425 tempest-AttachVolumeShelveTestJSON-1452861425-project-member] [instance: c19e230e-2e6c-4c20-b15c-ad81a73674b4] calling os-brick to detach iSCSI Volume {{(pid=74613) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 29 17:57:25 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-8475fd58-e80d-4854-a489-ccd5cedbc8f9 tempest-AttachVolumeShelveTestJSON-1452861425 tempest-AttachVolumeShelveTestJSON-1452861425-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff828156890>, {'target_iqn': 'iqn.2010-10.org.openstack:00ec83b4-5d84-416a-bad9-7511171a9da0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VTYFxodf', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=74613) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 17:57:25 user nova-compute[74613]: WARNING os_brick.initiator.connectors.base [None req-8475fd58-e80d-4854-a489-ccd5cedbc8f9 tempest-AttachVolumeShelveTestJSON-1452861425 tempest-AttachVolumeShelveTestJSON-1452861425-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 17:57:25 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.base [None req-8475fd58-e80d-4854-a489-ccd5cedbc8f9 tempest-AttachVolumeShelveTestJSON-1452861425 tempest-AttachVolumeShelveTestJSON-1452861425-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 17:57:25 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.base [None req-8475fd58-e80d-4854-a489-ccd5cedbc8f9 tempest-AttachVolumeShelveTestJSON-1452861425 tempest-AttachVolumeShelveTestJSON-1452861425-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 17:57:25 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 17:57:25 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 17:57:25 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[13434028-70b1-4552-819a-ad32a5783611]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:070b1031-e105-4cba-a039-2286e23727c5\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:9511387c-8772-40f2-bf2d-6b6387649e9f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:6a07b572-6430-4d0f-9aaf-8a8dbc39831e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:00ec83b4-5d84-416a-bad9-7511171a9da0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 17:57:25 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-8475fd58-e80d-4854-a489-ccd5cedbc8f9 tempest-AttachVolumeShelveTestJSON-1452861425 tempest-AttachVolumeShelveTestJSON-1452861425-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 29 17:57:25 user nova-compute[74613]: No targets found.
Nov 29 17:57:25 user nova-compute[74613]: iSNS:
Nov 29 17:57:25 user nova-compute[74613]: No targets found.
Nov 29 17:57:25 user nova-compute[74613]: STATIC:
Nov 29 17:57:25 user nova-compute[74613]: Target: iqn.2010-10.org.openstack:070b1031-e105-4cba-a039-2286e23727c5
Nov 29 17:57:25 user nova-compute[74613]:         Portal: 172.16.0.220:3260,-1
Nov 29 17:57:25 user nova-compute[74613]:                 Iface Name: default
Nov 29 17:57:25 user nova-compute[74613]: Target: iqn.2010-10.org.openstack:9511387c-8772-40f2-bf2d-6b6387649e9f
Nov 29 17:57:25 user nova-compute[74613]:         Portal: 172.16.0.220:3260,-1
Nov 29 17:57:25 user nova-compute[74613]:                 Iface Name: default
Nov 29 17:57:25 user nova-compute[74613]: Target: iqn.2010-10.org.openstack:6a07b572-6430-4d0f-9aaf-8a8dbc39831e
Nov 29 17:57:25 user nova-compute[74613]:         Portal: 172.16.0.220:3260,-1
Nov 29 17:57:25 user nova-compute[74613]:                 Iface Name: default
Nov 29 17:57:25 user nova-compute[74613]: Target: iqn.2010-10.org.openstack:00ec83b4-5d84-416a-bad9-7511171a9da0
Nov 29 17:57:25 user nova-compute[74613]:         Portal: 172.16.0.220:3260,-1
Nov 29 17:57:25 user nova-compute[74613]:                 Iface Name: default
Nov 29 17:57:25 user nova-compute[74613]: FIRMWARE:
Nov 29 17:57:25 user nova-compute[74613]: No targets found.
Nov 29 17:57:25 user nova-compute[74613]:  stderr= {{(pid=74613) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 17:57:25 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-8475fd58-e80d-4854-a489-ccd5cedbc8f9 tempest-AttachVolumeShelveTestJSON-1452861425 tempest-AttachVolumeShelveTestJSON-1452861425-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 29 17:57:25 user nova-compute[74613]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 29 17:57:25 user nova-compute[74613]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74613) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 29 17:57:25 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-8475fd58-e80d-4854-a489-ccd5cedbc8f9 tempest-AttachVolumeShelveTestJSON-1452861425 tempest-AttachVolumeShelveTestJSON-1452861425-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:00ec83b4-5d84-416a-bad9-7511171a9da0', 0)] {{(pid=74613) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 29 17:57:25 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 17:57:25 user nova-compute[74613]: DEBUG oslo_service.periodic_task [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74613) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 17:57:25 user nova-compute[74613]: DEBUG oslo_service.periodic_task [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74613) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 17:57:25 user nova-compute[74613]: DEBUG oslo_service.periodic_task [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74613) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 17:57:25 user nova-compute[74613]: DEBUG nova.compute.manager [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Starting heal instance info cache {{(pid=74613) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 29 17:57:25 user nova-compute[74613]: DEBUG nova.compute.manager [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Rebuilding the list of instances to heal {{(pid=74613) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 29 17:57:25 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 17:57:25 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0ec4fc7-2cab-4021-b215-99b16f63f103]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:00ec83b4-5d84-416a-bad9-7511171a9da0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:070b1031-e105-4cba-a039-2286e23727c5\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6a07b572-6430-4d0f-9aaf-8a8dbc39831e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9511387c-8772-40f2-bf2d-6b6387649e9f\n', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 17:57:25 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 17:57:26 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 17:57:26 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[4bf154b4-3477-4df9-b4c2-5d6536cf024a]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9511387c-8772-40f2-bf2d-6b6387649e9f (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:070b1031-e105-4cba-a039-2286e23727c5 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00ec83b4-5d84-416a-bad9-7511171a9da0 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a07b572-6430-4d0f-9aaf-8a8dbc39831e (non-flash)\n', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 17:57:26 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-8475fd58-e80d-4854-a489-ccd5cedbc8f9 tempest-AttachVolumeShelveTestJSON-1452861425 tempest-AttachVolumeShelveTestJSON-1452861425-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9511387c-8772-40f2-bf2d-6b6387649e9f (non-flash)
Nov 29 17:57:26 user nova-compute[74613]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:070b1031-e105-4cba-a039-2286e23727c5 (non-flash)
Nov 29 17:57:26 user nova-compute[74613]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00ec83b4-5d84-416a-bad9-7511171a9da0 (non-flash)
Nov 29 17:57:26 user nova-compute[74613]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a07b572-6430-4d0f-9aaf-8a8dbc39831e (non-flash)
Nov 29 17:57:26 user nova-compute[74613]:  stderr= {{(pid=74613) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 17:57:26 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-8475fd58-e80d-4854-a489-ccd5cedbc8f9 tempest-AttachVolumeShelveTestJSON-1452861425 tempest-AttachVolumeShelveTestJSON-1452861425-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9511387c-8772-40f2-bf2d-6b6387649e9f (non-flash)
Nov 29 17:57:26 user nova-compute[74613]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:070b1031-e105-4cba-a039-2286e23727c5 (non-flash)
Nov 29 17:57:26 user nova-compute[74613]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00ec83b4-5d84-416a-bad9-7511171a9da0 (non-flash)
Nov 29 17:57:26 user nova-compute[74613]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a07b572-6430-4d0f-9aaf-8a8dbc39831e (non-flash)
Nov 29 17:57:26 user nova-compute[74613]:  stderr= {{(pid=74613) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 17:57:26 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-8475fd58-e80d-4854-a489-ccd5cedbc8f9 tempest-AttachVolumeShelveTestJSON-1452861425 tempest-AttachVolumeShelveTestJSON-1452861425-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7ff818291d80>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:00ec83b4-5d84-416a-bad9-7511171a9da0'): ({'sdd'}, set())}) {{(pid=74613) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 29 17:57:26 user nova-compute[74613]: DEBUG os_brick.initiator.linuxscsi [None req-8475fd58-e80d-4854-a489-ccd5cedbc8f9 tempest-AttachVolumeShelveTestJSON-1452861425 tempest-AttachVolumeShelveTestJSON-1452861425-project-member] Removing single pathed devices sdd {{(pid=74613) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 29 17:57:26 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 17:57:26 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.026s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 17:57:26 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[c42b9b44-d5ce-448f-ac78-fe03d3dbf90d]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 17:57:26 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 17:57:26 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.020s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 17:57:26 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[db157d5e-c046-44a8-ba47-b1413907630a]: (4, ('ok\n', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 17:57:26 user nova-compute[74613]: DEBUG os_brick.initiator.linuxscsi [None req-8475fd58-e80d-4854-a489-ccd5cedbc8f9 tempest-AttachVolumeShelveTestJSON-1452861425 tempest-AttachVolumeShelveTestJSON-1452861425-project-member] Flushing IO for device /dev/sdd {{(pid=74613) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 29 17:57:26 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 17:57:26 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.012s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 17:57:26 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[d018ebaa-9d4a-46fe-9276-a72017958e50]: (4, ('', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 17:57:26 user nova-compute[74613]: DEBUG os_brick.initiator.linuxscsi [None req-8475fd58-e80d-4854-a489-ccd5cedbc8f9 tempest-AttachVolumeShelveTestJSON-1452861425 tempest-AttachVolumeShelveTestJSON-1452861425-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=74613) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 29 17:57:26 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 17:57:26 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Acquiring lock "refresh_cache-b6b0ba36-ad89-45f1-9578-8b999567dd25" {{(pid=74613) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 17:57:26 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Acquired lock "refresh_cache-b6b0ba36-ad89-45f1-9578-8b999567dd25" {{(pid=74613) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 17:57:26 user nova-compute[74613]: DEBUG nova.network.neutron [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] [instance: b6b0ba36-ad89-45f1-9578-8b999567dd25] Forcefully refreshing network info cache for instance {{(pid=74613) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 29 17:57:26 user nova-compute[74613]: DEBUG nova.objects.instance [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Lazy-loading 'info_cache' on Instance uuid b6b0ba36-ad89-45f1-9578-8b999567dd25 {{(pid=74613) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 17:57:26 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.036s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 17:57:26 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[3234c631-8fce-469d-a176-d486d8a01820]: (4, ('1', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 17:57:26 user nova-compute[74613]: DEBUG os_brick.initiator.linuxscsi [None req-8475fd58-e80d-4854-a489-ccd5cedbc8f9 tempest-AttachVolumeShelveTestJSON-1452861425 tempest-AttachVolumeShelveTestJSON-1452861425-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=74613) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 29 17:57:26 user nova-compute[74613]: DEBUG os_brick.initiator.linuxscsi [None req-8475fd58-e80d-4854-a489-ccd5cedbc8f9 tempest-AttachVolumeShelveTestJSON-1452861425 tempest-AttachVolumeShelveTestJSON-1452861425-project-member] SCSI volumes sdd have been removed. {{(pid=74613) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 29 17:57:26 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-8475fd58-e80d-4854-a489-ccd5cedbc8f9 tempest-AttachVolumeShelveTestJSON-1452861425 tempest-AttachVolumeShelveTestJSON-1452861425-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:00ec83b4-5d84-416a-bad9-7511171a9da0')] {{(pid=74613) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 29 17:57:26 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:00ec83b4-5d84-416a-bad9-7511171a9da0 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 17:57:26 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:00ec83b4-5d84-416a-bad9-7511171a9da0 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 17:57:26 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[d85cc7cc-3b1f-4d44-8524-a2b8b9ce2a57]: (4, ('', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 17:57:26 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-8475fd58-e80d-4854-a489-ccd5cedbc8f9 tempest-AttachVolumeShelveTestJSON-1452861425 tempest-AttachVolumeShelveTestJSON-1452861425-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74613) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 17:57:26 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:00ec83b4-5d84-416a-bad9-7511171a9da0 -p 172.16.0.220:3260 --logout {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 17:57:26 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:00ec83b4-5d84-416a-bad9-7511171a9da0 -p 172.16.0.220:3260 --logout" returned: 0 in 0.063s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 17:57:26 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[68c04f9b-2692-427b-8a73-91d7ce89a7c2]: (4, ('Logging out of session [sid: 16, target: iqn.2010-10.org.openstack:00ec83b4-5d84-416a-bad9-7511171a9da0, portal: 172.16.0.220,3260]\nLogout of [sid: 16, target: iqn.2010-10.org.openstack:00ec83b4-5d84-416a-bad9-7511171a9da0, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 17:57:26 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-8475fd58-e80d-4854-a489-ccd5cedbc8f9 tempest-AttachVolumeShelveTestJSON-1452861425 tempest-AttachVolumeShelveTestJSON-1452861425-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 16, target: iqn.2010-10.org.openstack:00ec83b4-5d84-416a-bad9-7511171a9da0, portal: 172.16.0.220,3260]
Nov 29 17:57:26 user nova-compute[74613]: Logout of [sid: 16, target: iqn.2010-10.org.openstack:00ec83b4-5d84-416a-bad9-7511171a9da0, portal: 172.16.0.220,3260] successful.
Nov 29 17:57:26 user nova-compute[74613]:  stderr= {{(pid=74613) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 17:57:26 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:00ec83b4-5d84-416a-bad9-7511171a9da0 -p 172.16.0.220:3260 --op delete {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 17:57:26 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:00ec83b4-5d84-416a-bad9-7511171a9da0 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.033s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 17:57:26 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9406a57-ff1d-43f0-80cc-21613d64fcfa]: (4, ('', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 17:57:26 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-8475fd58-e80d-4854-a489-ccd5cedbc8f9 tempest-AttachVolumeShelveTestJSON-1452861425 tempest-AttachVolumeShelveTestJSON-1452861425-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74613) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 17:57:26 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.base [None req-8475fd58-e80d-4854-a489-ccd5cedbc8f9 tempest-AttachVolumeShelveTestJSON-1452861425 tempest-AttachVolumeShelveTestJSON-1452861425-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.344s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 17:57:26 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-8475fd58-e80d-4854-a489-ccd5cedbc8f9 tempest-AttachVolumeShelveTestJSON-1452861425 tempest-AttachVolumeShelveTestJSON-1452861425-project-member] <== disconnect_volume: return (346ms) None {{(pid=74613) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 17:57:26 user nova-compute[74613]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8475fd58-e80d-4854-a489-ccd5cedbc8f9 tempest-AttachVolumeShelveTestJSON-1452861425 tempest-AttachVolumeShelveTestJSON-1452861425-project-member] [instance: c19e230e-2e6c-4c20-b15c-ad81a73674b4] Disconnected iSCSI Volume {{(pid=74613) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 29 17:57:26 user nova-compute[74613]: DEBUG nova.network.neutron [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] [instance: b6b0ba36-ad89-45f1-9578-8b999567dd25] Updating instance_info_cache with network_info: [{"id": "0167e253-42dd-486a-8231-a8b8199f3584", "address": "fa:16:3e:3f:ea:5d", "network": {"id": "880ea498-5e4e-4786-a894-bac0f42572f4", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1846928198-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.254", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b8f184c16b5348beb2dc9e6359a47651", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0167e253-42", "ovs_interfaceid": "0167e253-42dd-486a-8231-a8b8199f3584", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74613) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 17:57:26 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Releasing lock "refresh_cache-b6b0ba36-ad89-45f1-9578-8b999567dd25" {{(pid=74613) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 17:57:26 user nova-compute[74613]: DEBUG nova.compute.manager [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] [instance: b6b0ba36-ad89-45f1-9578-8b999567dd25] Updated the network info_cache for instance {{(pid=74613) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 29 17:57:26 user nova-compute[74613]: DEBUG oslo_service.periodic_task [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74613) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 17:57:26 user nova-compute[74613]: DEBUG oslo_service.periodic_task [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74613) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 17:57:26 user nova-compute[74613]: DEBUG oslo_service.periodic_task [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74613) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 17:57:26 user nova-compute[74613]: DEBUG oslo_service.periodic_task [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74613) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 17:57:26 user nova-compute[74613]: DEBUG oslo_service.periodic_task [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74613) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 17:57:26 user nova-compute[74613]: DEBUG oslo_service.periodic_task [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74613) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 17:57:26 user nova-compute[74613]: DEBUG nova.compute.manager [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74613) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 29 17:57:27 user nova-compute[74613]: DEBUG nova.objects.instance [None req-8475fd58-e80d-4854-a489-ccd5cedbc8f9 tempest-AttachVolumeShelveTestJSON-1452861425 tempest-AttachVolumeShelveTestJSON-1452861425-project-member] Lazy-loading 'flavor' on Instance uuid c19e230e-2e6c-4c20-b15c-ad81a73674b4 {{(pid=74613) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 17:57:27 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-8475fd58-e80d-4854-a489-ccd5cedbc8f9 tempest-AttachVolumeShelveTestJSON-1452861425 tempest-AttachVolumeShelveTestJSON-1452861425-project-member] Lock "c19e230e-2e6c-4c20-b15c-ad81a73674b4" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.902s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 17:57:28 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-03c71a7b-32a0-47d1-86ad-ac97b97fb8aa tempest-ServerActionsTestOtherA-1784608629 tempest-ServerActionsTestOtherA-1784608629-project-member] [instance: 71f2a1ab-3df7-411c-93fa-b0a1a5a44f0a] Creating instance directory {{(pid=74613) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 29 17:57:28 user nova-compute[74613]: INFO nova.virt.libvirt.driver [None req-03c71a7b-32a0-47d1-86ad-ac97b97fb8aa tempest-ServerActionsTestOtherA-1784608629 tempest-ServerActionsTestOtherA-1784608629-project-member] [instance: 71f2a1ab-3df7-411c-93fa-b0a1a5a44f0a] Creating image(s)
Nov 29 17:57:28 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-03c71a7b-32a0-47d1-86ad-ac97b97fb8aa tempest-ServerActionsTestOtherA-1784608629 tempest-ServerActionsTestOtherA-1784608629-project-member] Acquiring lock "/opt/stack/data/nova/instances/71f2a1ab-3df7-411c-93fa-b0a1a5a44f0a/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 17:57:28 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-03c71a7b-32a0-47d1-86ad-ac97b97fb8aa tempest-ServerActionsTestOtherA-1784608629 tempest-ServerActionsTestOtherA-1784608629-project-member] Lock "/opt/stack/data/nova/instances/71f2a1ab-3df7-411c-93fa-b0a1a5a44f0a/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 17:57:28 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-03c71a7b-32a0-47d1-86ad-ac97b97fb8aa tempest-ServerActionsTestOtherA-1784608629 tempest-ServerActionsTestOtherA-1784608629-project-member] Lock "/opt/stack/data/nova/instances/71f2a1ab-3df7-411c-93fa-b0a1a5a44f0a/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 17:57:28 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-03c71a7b-32a0-47d1-86ad-ac97b97fb8aa tempest-ServerActionsTestOtherA-1784608629 tempest-ServerActionsTestOtherA-1784608629-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/21faea9e6951f3bdd0153b76ac89fe1a60a34758 --force-share --output=json {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 17:57:28 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-03c71a7b-32a0-47d1-86ad-ac97b97fb8aa tempest-ServerActionsTestOtherA-1784608629 tempest-ServerActionsTestOtherA-1784608629-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/21faea9e6951f3bdd0153b76ac89fe1a60a34758 --force-share --output=json" returned: 0 in 0.184s {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 17:57:28 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-03c71a7b-32a0-47d1-86ad-ac97b97fb8aa tempest-ServerActionsTestOtherA-1784608629 tempest-ServerActionsTestOtherA-1784608629-project-member] Acquiring lock "21faea9e6951f3bdd0153b76ac89fe1a60a34758" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 17:57:28 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-03c71a7b-32a0-47d1-86ad-ac97b97fb8aa tempest-ServerActionsTestOtherA-1784608629 tempest-ServerActionsTestOtherA-1784608629-project-member] Lock "21faea9e6951f3bdd0153b76ac89fe1a60a34758" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 17:57:28 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-03c71a7b-32a0-47d1-86ad-ac97b97fb8aa tempest-ServerActionsTestOtherA-1784608629 tempest-ServerActionsTestOtherA-1784608629-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/21faea9e6951f3bdd0153b76ac89fe1a60a34758 --force-share --output=json {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 17:57:28 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-03c71a7b-32a0-47d1-86ad-ac97b97fb8aa tempest-ServerActionsTestOtherA-1784608629 tempest-ServerActionsTestOtherA-1784608629-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/21faea9e6951f3bdd0153b76ac89fe1a60a34758 --force-share --output=json" returned: 0 in 0.205s {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 17:57:28 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-03c71a7b-32a0-47d1-86ad-ac97b97fb8aa tempest-ServerActionsTestOtherA-1784608629 tempest-ServerActionsTestOtherA-1784608629-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/21faea9e6951f3bdd0153b76ac89fe1a60a34758,backing_fmt=raw /opt/stack/data/nova/instances/71f2a1ab-3df7-411c-93fa-b0a1a5a44f0a/disk 1073741824 {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 17:57:28 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-03c71a7b-32a0-47d1-86ad-ac97b97fb8aa tempest-ServerActionsTestOtherA-1784608629 tempest-ServerActionsTestOtherA-1784608629-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/21faea9e6951f3bdd0153b76ac89fe1a60a34758,backing_fmt=raw /opt/stack/data/nova/instances/71f2a1ab-3df7-411c-93fa-b0a1a5a44f0a/disk 1073741824" returned: 0 in 0.054s {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 17:57:28 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-03c71a7b-32a0-47d1-86ad-ac97b97fb8aa tempest-ServerActionsTestOtherA-1784608629 tempest-ServerActionsTestOtherA-1784608629-project-member] Lock "21faea9e6951f3bdd0153b76ac89fe1a60a34758" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.267s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 17:57:28 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-03c71a7b-32a0-47d1-86ad-ac97b97fb8aa tempest-ServerActionsTestOtherA-1784608629 tempest-ServerActionsTestOtherA-1784608629-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/21faea9e6951f3bdd0153b76ac89fe1a60a34758 --force-share --output=json {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 17:57:28 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-03c71a7b-32a0-47d1-86ad-ac97b97fb8aa tempest-ServerActionsTestOtherA-1784608629 tempest-ServerActionsTestOtherA-1784608629-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/21faea9e6951f3bdd0153b76ac89fe1a60a34758 --force-share --output=json" returned: 0 in 0.181s {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 17:57:28 user nova-compute[74613]: DEBUG nova.virt.disk.api [None req-03c71a7b-32a0-47d1-86ad-ac97b97fb8aa tempest-ServerActionsTestOtherA-1784608629 tempest-ServerActionsTestOtherA-1784608629-project-member] Checking if we can resize image /opt/stack/data/nova/instances/71f2a1ab-3df7-411c-93fa-b0a1a5a44f0a/disk. size=1073741824 {{(pid=74613) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 29 17:57:28 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-03c71a7b-32a0-47d1-86ad-ac97b97fb8aa tempest-ServerActionsTestOtherA-1784608629 tempest-ServerActionsTestOtherA-1784608629-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/71f2a1ab-3df7-411c-93fa-b0a1a5a44f0a/disk --force-share --output=json {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 17:57:28 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-03c71a7b-32a0-47d1-86ad-ac97b97fb8aa tempest-ServerActionsTestOtherA-1784608629 tempest-ServerActionsTestOtherA-1784608629-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/71f2a1ab-3df7-411c-93fa-b0a1a5a44f0a/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 17:57:28 user nova-compute[74613]: DEBUG nova.virt.disk.api [None req-03c71a7b-32a0-47d1-86ad-ac97b97fb8aa tempest-ServerActionsTestOtherA-1784608629 tempest-ServerActionsTestOtherA-1784608629-project-member] Cannot resize image /opt/stack/data/nova/instances/71f2a1ab-3df7-411c-93fa-b0a1a5a44f0a/disk to a smaller size. {{(pid=74613) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 29 17:57:28 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-03c71a7b-32a0-47d1-86ad-ac97b97fb8aa tempest-ServerActionsTestOtherA-1784608629 tempest-ServerActionsTestOtherA-1784608629-project-member] [instance: 71f2a1ab-3df7-411c-93fa-b0a1a5a44f0a] Created local disks {{(pid=74613) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 29 17:57:28 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-03c71a7b-32a0-47d1-86ad-ac97b97fb8aa tempest-ServerActionsTestOtherA-1784608629 tempest-ServerActionsTestOtherA-1784608629-project-member] [instance: 71f2a1ab-3df7-411c-93fa-b0a1a5a44f0a] Ensure instance console log exists: /opt/stack/data/nova/instances/71f2a1ab-3df7-411c-93fa-b0a1a5a44f0a/console.log {{(pid=74613) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 29 17:57:28 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-03c71a7b-32a0-47d1-86ad-ac97b97fb8aa tempest-ServerActionsTestOtherA-1784608629 tempest-ServerActionsTestOtherA-1784608629-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 17:57:28 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-03c71a7b-32a0-47d1-86ad-ac97b97fb8aa tempest-ServerActionsTestOtherA-1784608629 tempest-ServerActionsTestOtherA-1784608629-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.002s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 17:57:28 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-03c71a7b-32a0-47d1-86ad-ac97b97fb8aa tempest-ServerActionsTestOtherA-1784608629 tempest-ServerActionsTestOtherA-1784608629-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 17:57:28 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-03c71a7b-32a0-47d1-86ad-ac97b97fb8aa tempest-ServerActionsTestOtherA-1784608629 tempest-ServerActionsTestOtherA-1784608629-project-member] [instance: 71f2a1ab-3df7-411c-93fa-b0a1a5a44f0a] Start _get_guest_xml network_info=[{"id": "d40a5800-7391-4206-a661-fbce50c35a65", "address": "fa:16:3e:1a:53:06", "network": {"id": "7c2c368e-4c7d-4d70-9a40-c10fe9541af9", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1287934102-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.120", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b1f70c311d4941c986de21ac458d11ab", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd40a5800-73", "ovs_interfaceid": "d40a5800-7391-4206-a661-fbce50c35a65", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-29T17:47:38Z,direct_url=<?>,disk_format='qcow2',id=4217f428-8d9d-4ee1-9614-642d26d90c46,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='794b07cbd46a44b5865cfda741036bae',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-29T17:47:40Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'size': 0, 'device_type': 'disk', 'boot_index': 0, 'guest_format': None, 'encrypted': False, 'encryption_format': None, 'disk_bus': 'virtio', 'image_id': '4217f428-8d9d-4ee1-9614-642d26d90c46'}], 'ephemerals': [], 'block_device_mapping': [{'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:72d22ffa-f425-4575-86a5-afbd8bb9cdd6', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'hUFVkcjz', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '71f2a1ab-3df7-411c-93fa-b0a1a5a44f0a', 'attached_at': '', 'detached_at': '', 'volume_id': '72d22ffa-f425-4575-86a5-afbd8bb9cdd6', 'serial': '72d22ffa-f425-4575-86a5-afbd8bb9cdd6'}, 'mount_device': '/dev/vdb', 'delete_on_termination': False, 'device_type': 'disk', 'boot_index': None, 'guest_format': None, 'attachment_id': '2b57905b-4d7b-4b9b-a7ce-8375444e7a47', 'disk_bus': 'virtio', 'volume_type': None} {{(pid=74613) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 29 17:57:28 user nova-compute[74613]: WARNING nova.virt.libvirt.driver [None req-03c71a7b-32a0-47d1-86ad-ac97b97fb8aa tempest-ServerActionsTestOtherA-1784608629 tempest-ServerActionsTestOtherA-1784608629-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.: NotImplementedError
Nov 29 17:57:28 user nova-compute[74613]: WARNING nova.virt.libvirt.driver [None req-03c71a7b-32a0-47d1-86ad-ac97b97fb8aa tempest-ServerActionsTestOtherA-1784608629 tempest-ServerActionsTestOtherA-1784608629-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.: NotImplementedError
Nov 29 17:57:28 user nova-compute[74613]: DEBUG nova.virt.libvirt.host [None req-03c71a7b-32a0-47d1-86ad-ac97b97fb8aa tempest-ServerActionsTestOtherA-1784608629 tempest-ServerActionsTestOtherA-1784608629-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74613) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 29 17:57:28 user nova-compute[74613]: DEBUG nova.virt.libvirt.host [None req-03c71a7b-32a0-47d1-86ad-ac97b97fb8aa tempest-ServerActionsTestOtherA-1784608629 tempest-ServerActionsTestOtherA-1784608629-project-member] CPU controller missing on host. {{(pid=74613) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 29 17:57:28 user nova-compute[74613]: DEBUG nova.virt.libvirt.host [None req-03c71a7b-32a0-47d1-86ad-ac97b97fb8aa tempest-ServerActionsTestOtherA-1784608629 tempest-ServerActionsTestOtherA-1784608629-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74613) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 29 17:57:28 user nova-compute[74613]: DEBUG nova.virt.libvirt.host [None req-03c71a7b-32a0-47d1-86ad-ac97b97fb8aa tempest-ServerActionsTestOtherA-1784608629 tempest-ServerActionsTestOtherA-1784608629-project-member] CPU controller found on host. {{(pid=74613) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 29 17:57:28 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-03c71a7b-32a0-47d1-86ad-ac97b97fb8aa tempest-ServerActionsTestOtherA-1784608629 tempest-ServerActionsTestOtherA-1784608629-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74613) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 29 17:57:28 user nova-compute[74613]: DEBUG nova.virt.hardware [None req-03c71a7b-32a0-47d1-86ad-ac97b97fb8aa tempest-ServerActionsTestOtherA-1784608629 tempest-ServerActionsTestOtherA-1784608629-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-29T17:47:27Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-29T17:47:38Z,direct_url=<?>,disk_format='qcow2',id=4217f428-8d9d-4ee1-9614-642d26d90c46,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='794b07cbd46a44b5865cfda741036bae',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-29T17:47:40Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74613) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 29 17:57:28 user nova-compute[74613]: DEBUG nova.virt.hardware [None req-03c71a7b-32a0-47d1-86ad-ac97b97fb8aa tempest-ServerActionsTestOtherA-1784608629 tempest-ServerActionsTestOtherA-1784608629-project-member] Flavor limits 0:0:0 {{(pid=74613) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 29 17:57:28 user nova-compute[74613]: DEBUG nova.virt.hardware [None req-03c71a7b-32a0-47d1-86ad-ac97b97fb8aa tempest-ServerActionsTestOtherA-1784608629 tempest-ServerActionsTestOtherA-1784608629-project-member] Image limits 0:0:0 {{(pid=74613) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 29 17:57:28 user nova-compute[74613]: DEBUG nova.virt.hardware [None req-03c71a7b-32a0-47d1-86ad-ac97b97fb8aa tempest-ServerActionsTestOtherA-1784608629 tempest-ServerActionsTestOtherA-1784608629-project-member] Flavor pref 0:0:0 {{(pid=74613) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 29 17:57:28 user nova-compute[74613]: DEBUG nova.virt.hardware [None req-03c71a7b-32a0-47d1-86ad-ac97b97fb8aa tempest-ServerActionsTestOtherA-1784608629 tempest-ServerActionsTestOtherA-1784608629-project-member] Image pref 0:0:0 {{(pid=74613) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 29 17:57:28 user nova-compute[74613]: DEBUG nova.virt.hardware [None req-03c71a7b-32a0-47d1-86ad-ac97b97fb8aa tempest-ServerActionsTestOtherA-1784608629 tempest-ServerActionsTestOtherA-1784608629-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74613) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 29 17:57:28 user nova-compute[74613]: DEBUG nova.virt.hardware [None req-03c71a7b-32a0-47d1-86ad-ac97b97fb8aa tempest-ServerActionsTestOtherA-1784608629 tempest-ServerActionsTestOtherA-1784608629-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74613) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 29 17:57:28 user nova-compute[74613]: DEBUG nova.virt.hardware [None req-03c71a7b-32a0-47d1-86ad-ac97b97fb8aa tempest-ServerActionsTestOtherA-1784608629 tempest-ServerActionsTestOtherA-1784608629-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74613) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 29 17:57:28 user nova-compute[74613]: DEBUG nova.virt.hardware [None req-03c71a7b-32a0-47d1-86ad-ac97b97fb8aa tempest-ServerActionsTestOtherA-1784608629 tempest-ServerActionsTestOtherA-1784608629-project-member] Got 1 possible topologies {{(pid=74613) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 29 17:57:28 user nova-compute[74613]: DEBUG nova.virt.hardware [None req-03c71a7b-32a0-47d1-86ad-ac97b97fb8aa tempest-ServerActionsTestOtherA-1784608629 tempest-ServerActionsTestOtherA-1784608629-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74613) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 29 17:57:28 user nova-compute[74613]: DEBUG nova.virt.hardware [None req-03c71a7b-32a0-47d1-86ad-ac97b97fb8aa tempest-ServerActionsTestOtherA-1784608629 tempest-ServerActionsTestOtherA-1784608629-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74613) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 29 17:57:28 user nova-compute[74613]: DEBUG nova.objects.instance [None req-03c71a7b-32a0-47d1-86ad-ac97b97fb8aa tempest-ServerActionsTestOtherA-1784608629 tempest-ServerActionsTestOtherA-1784608629-project-member] Lazy-loading 'vcpu_model' on Instance uuid 71f2a1ab-3df7-411c-93fa-b0a1a5a44f0a {{(pid=74613) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 17:57:28 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:57:29 user nova-compute[74613]: DEBUG nova.virt.libvirt.volume.iscsi [None req-03c71a7b-32a0-47d1-86ad-ac97b97fb8aa tempest-ServerActionsTestOtherA-1784608629 tempest-ServerActionsTestOtherA-1784608629-project-member] [instance: 71f2a1ab-3df7-411c-93fa-b0a1a5a44f0a] Calling os-brick to attach iSCSI Volume {{(pid=74613) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 29 17:57:29 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-03c71a7b-32a0-47d1-86ad-ac97b97fb8aa tempest-ServerActionsTestOtherA-1784608629 tempest-ServerActionsTestOtherA-1784608629-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff828156890>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:72d22ffa-f425-4575-86a5-afbd8bb9cdd6', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'hUFVkcjz', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74613) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 17:57:29 user nova-compute[74613]: WARNING os_brick.initiator.connectors.base [None req-03c71a7b-32a0-47d1-86ad-ac97b97fb8aa tempest-ServerActionsTestOtherA-1784608629 tempest-ServerActionsTestOtherA-1784608629-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Nov 29 17:57:29 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.base [None req-03c71a7b-32a0-47d1-86ad-ac97b97fb8aa tempest-ServerActionsTestOtherA-1784608629 tempest-ServerActionsTestOtherA-1784608629-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 17:57:29 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.base [None req-03c71a7b-32a0-47d1-86ad-ac97b97fb8aa tempest-ServerActionsTestOtherA-1784608629 tempest-ServerActionsTestOtherA-1784608629-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 17:57:29 user nova-compute[74613]: WARNING os_brick.initiator.connectors.base [None req-03c71a7b-32a0-47d1-86ad-ac97b97fb8aa tempest-ServerActionsTestOtherA-1784608629 tempest-ServerActionsTestOtherA-1784608629-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Nov 29 17:57:29 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.base [None req-03c71a7b-32a0-47d1-86ad-ac97b97fb8aa tempest-ServerActionsTestOtherA-1784608629 tempest-ServerActionsTestOtherA-1784608629-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:72d22ffa-f425-4575-86a5-afbd8bb9cdd6" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 17:57:29 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.base [None req-03c71a7b-32a0-47d1-86ad-ac97b97fb8aa tempest-ServerActionsTestOtherA-1784608629 tempest-ServerActionsTestOtherA-1784608629-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:72d22ffa-f425-4575-86a5-afbd8bb9cdd6" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 17:57:29 user nova-compute[74613]: INFO os_brick.initiator.connectors.iscsi [None req-03c71a7b-32a0-47d1-86ad-ac97b97fb8aa tempest-ServerActionsTestOtherA-1784608629 tempest-ServerActionsTestOtherA-1784608629-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 29 17:57:29 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:72d22ffa-f425-4575-86a5-afbd8bb9cdd6 -p 172.16.0.220:3260 {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 17:57:29 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:72d22ffa-f425-4575-86a5-afbd8bb9cdd6 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 17:57:29 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[402aa0b2-bc91-4381-898a-ecb97aeca22d]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 17:57:29 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-03c71a7b-32a0-47d1-86ad-ac97b97fb8aa tempest-ServerActionsTestOtherA-1784608629 tempest-ServerActionsTestOtherA-1784608629-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 29 17:57:29 user nova-compute[74613]:  {{(pid=74613) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 17:57:29 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:72d22ffa-f425-4575-86a5-afbd8bb9cdd6 -p 172.16.0.220:3260 --interface default --op new {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 17:57:29 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:72d22ffa-f425-4575-86a5-afbd8bb9cdd6 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 17:57:29 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[78311ceb-a0fa-4ad3-a9d4-91dfaa9c803a]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:72d22ffa-f425-4575-86a5-afbd8bb9cdd6] added\n', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 17:57:29 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-03c71a7b-32a0-47d1-86ad-ac97b97fb8aa tempest-ServerActionsTestOtherA-1784608629 tempest-ServerActionsTestOtherA-1784608629-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:72d22ffa-f425-4575-86a5-afbd8bb9cdd6] added
Nov 29 17:57:29 user nova-compute[74613]:  stderr= {{(pid=74613) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 17:57:29 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:72d22ffa-f425-4575-86a5-afbd8bb9cdd6 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 17:57:29 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:72d22ffa-f425-4575-86a5-afbd8bb9cdd6 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 17:57:29 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[00d65fc7-79e1-403b-b3f3-398c541d4fcd]: (4, ('', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 17:57:29 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-03c71a7b-32a0-47d1-86ad-ac97b97fb8aa tempest-ServerActionsTestOtherA-1784608629 tempest-ServerActionsTestOtherA-1784608629-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74613) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 17:57:29 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:72d22ffa-f425-4575-86a5-afbd8bb9cdd6 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 17:57:29 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:72d22ffa-f425-4575-86a5-afbd8bb9cdd6 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 17:57:29 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[10406455-5e06-4d38-8531-1f1153ae0af9]: (4, ('', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 17:57:29 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-03c71a7b-32a0-47d1-86ad-ac97b97fb8aa tempest-ServerActionsTestOtherA-1784608629 tempest-ServerActionsTestOtherA-1784608629-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74613) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 17:57:29 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:72d22ffa-f425-4575-86a5-afbd8bb9cdd6 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v hUFVkcjz {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 17:57:29 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:72d22ffa-f425-4575-86a5-afbd8bb9cdd6 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v hUFVkcjz" returned: 0 in 0.024s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 17:57:29 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[67028f03-fd22-4803-8071-fe94c3a77e4e]: (4, ('', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 17:57:29 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-03c71a7b-32a0-47d1-86ad-ac97b97fb8aa tempest-ServerActionsTestOtherA-1784608629 tempest-ServerActionsTestOtherA-1784608629-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'hUFVkcjz'): stdout= stderr= {{(pid=74613) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 17:57:29 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:72d22ffa-f425-4575-86a5-afbd8bb9cdd6 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 17:57:29 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:72d22ffa-f425-4575-86a5-afbd8bb9cdd6 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 17:57:29 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[453ba905-4adb-4961-86f1-44cbeef66ed5]: (4, ('', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 17:57:29 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-03c71a7b-32a0-47d1-86ad-ac97b97fb8aa tempest-ServerActionsTestOtherA-1784608629 tempest-ServerActionsTestOtherA-1784608629-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74613) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 17:57:29 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 17:57:29 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 17:57:29 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[e964bfa6-eee4-4b04-8dcc-1f4f52e4a4bb]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9511387c-8772-40f2-bf2d-6b6387649e9f (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:070b1031-e105-4cba-a039-2286e23727c5 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a07b572-6430-4d0f-9aaf-8a8dbc39831e (non-flash)\n', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 17:57:29 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-03c71a7b-32a0-47d1-86ad-ac97b97fb8aa tempest-ServerActionsTestOtherA-1784608629 tempest-ServerActionsTestOtherA-1784608629-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9511387c-8772-40f2-bf2d-6b6387649e9f (non-flash)
Nov 29 17:57:29 user nova-compute[74613]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:070b1031-e105-4cba-a039-2286e23727c5 (non-flash)
Nov 29 17:57:29 user nova-compute[74613]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a07b572-6430-4d0f-9aaf-8a8dbc39831e (non-flash)
Nov 29 17:57:29 user nova-compute[74613]:  stderr= {{(pid=74613) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 17:57:29 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-03c71a7b-32a0-47d1-86ad-ac97b97fb8aa tempest-ServerActionsTestOtherA-1784608629 tempest-ServerActionsTestOtherA-1784608629-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9511387c-8772-40f2-bf2d-6b6387649e9f (non-flash)
Nov 29 17:57:29 user nova-compute[74613]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:070b1031-e105-4cba-a039-2286e23727c5 (non-flash)
Nov 29 17:57:29 user nova-compute[74613]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a07b572-6430-4d0f-9aaf-8a8dbc39831e (non-flash)
Nov 29 17:57:29 user nova-compute[74613]:  stderr= {{(pid=74613) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 17:57:29 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:72d22ffa-f425-4575-86a5-afbd8bb9cdd6 -p 172.16.0.220:3260 --login {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 17:57:29 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:72d22ffa-f425-4575-86a5-afbd8bb9cdd6 -p 172.16.0.220:3260 --login" returned: 0 in 0.069s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 17:57:29 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[237cc74d-e239-42db-a84f-ca35c0243645]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:72d22ffa-f425-4575-86a5-afbd8bb9cdd6, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:72d22ffa-f425-4575-86a5-afbd8bb9cdd6, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 17:57:29 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-03c71a7b-32a0-47d1-86ad-ac97b97fb8aa tempest-ServerActionsTestOtherA-1784608629 tempest-ServerActionsTestOtherA-1784608629-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:72d22ffa-f425-4575-86a5-afbd8bb9cdd6, portal: 172.16.0.220,3260]
Nov 29 17:57:29 user nova-compute[74613]: Login to [iface: default, target: iqn.2010-10.org.openstack:72d22ffa-f425-4575-86a5-afbd8bb9cdd6, portal: 172.16.0.220,3260] successful.
Nov 29 17:57:29 user nova-compute[74613]:  stderr= {{(pid=74613) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 17:57:29 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:72d22ffa-f425-4575-86a5-afbd8bb9cdd6 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 17:57:29 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:72d22ffa-f425-4575-86a5-afbd8bb9cdd6 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 17:57:29 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8c7eae1-963d-4d9a-8df2-41e326dd8172]: (4, ('', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 17:57:29 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-03c71a7b-32a0-47d1-86ad-ac97b97fb8aa tempest-ServerActionsTestOtherA-1784608629 tempest-ServerActionsTestOtherA-1784608629-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74613) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 17:57:29 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 17:57:29 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 17:57:29 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3487742-10d9-4452-9b09-196ecb5acded]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9511387c-8772-40f2-bf2d-6b6387649e9f (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:070b1031-e105-4cba-a039-2286e23727c5 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a07b572-6430-4d0f-9aaf-8a8dbc39831e (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:72d22ffa-f425-4575-86a5-afbd8bb9cdd6 (non-flash)\n', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 17:57:29 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-03c71a7b-32a0-47d1-86ad-ac97b97fb8aa tempest-ServerActionsTestOtherA-1784608629 tempest-ServerActionsTestOtherA-1784608629-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9511387c-8772-40f2-bf2d-6b6387649e9f (non-flash)
Nov 29 17:57:29 user nova-compute[74613]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:070b1031-e105-4cba-a039-2286e23727c5 (non-flash)
Nov 29 17:57:29 user nova-compute[74613]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a07b572-6430-4d0f-9aaf-8a8dbc39831e (non-flash)
Nov 29 17:57:29 user nova-compute[74613]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:72d22ffa-f425-4575-86a5-afbd8bb9cdd6 (non-flash)
Nov 29 17:57:29 user nova-compute[74613]:  stderr= {{(pid=74613) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 17:57:29 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-03c71a7b-32a0-47d1-86ad-ac97b97fb8aa tempest-ServerActionsTestOtherA-1784608629 tempest-ServerActionsTestOtherA-1784608629-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9511387c-8772-40f2-bf2d-6b6387649e9f (non-flash)
Nov 29 17:57:29 user nova-compute[74613]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:070b1031-e105-4cba-a039-2286e23727c5 (non-flash)
Nov 29 17:57:29 user nova-compute[74613]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a07b572-6430-4d0f-9aaf-8a8dbc39831e (non-flash)
Nov 29 17:57:29 user nova-compute[74613]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:72d22ffa-f425-4575-86a5-afbd8bb9cdd6 (non-flash)
Nov 29 17:57:29 user nova-compute[74613]:  stderr= {{(pid=74613) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 17:57:29 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.base [None req-03c71a7b-32a0-47d1-86ad-ac97b97fb8aa tempest-ServerActionsTestOtherA-1784608629 tempest-ServerActionsTestOtherA-1784608629-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:72d22ffa-f425-4575-86a5-afbd8bb9cdd6" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.293s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 17:57:29 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-03c71a7b-32a0-47d1-86ad-ac97b97fb8aa tempest-ServerActionsTestOtherA-1784608629 tempest-ServerActionsTestOtherA-1784608629-project-member] Connected to 172.16.0.220:3260 {{(pid=74613) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 29 17:57:29 user nova-compute[74613]: DEBUG os_brick.initiator.linuxscsi [None req-03c71a7b-32a0-47d1-86ad-ac97b97fb8aa tempest-ServerActionsTestOtherA-1784608629 tempest-ServerActionsTestOtherA-1784608629-project-member] HCTL ('35', '-', '-', 0) found on session 19 with lun 0 {{(pid=74613) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 29 17:57:29 user nova-compute[74613]: DEBUG os_brick.initiator.linuxscsi [None req-03c71a7b-32a0-47d1-86ad-ac97b97fb8aa tempest-ServerActionsTestOtherA-1784608629 tempest-ServerActionsTestOtherA-1784608629-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=74613) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 29 17:57:29 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 17:57:29 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.028s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 17:57:29 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[39ae52c2-c7a9-4d79-b02a-b9881d390d67]: (4, ('- - 0', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 17:57:29 user nova-compute[74613]: DEBUG os_brick.initiator.linuxscsi [None req-03c71a7b-32a0-47d1-86ad-ac97b97fb8aa tempest-ServerActionsTestOtherA-1784608629 tempest-ServerActionsTestOtherA-1784608629-project-member] Searching for a device in session 19 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=74613) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 29 17:57:29 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-03c71a7b-32a0-47d1-86ad-ac97b97fb8aa tempest-ServerActionsTestOtherA-1784608629 tempest-ServerActionsTestOtherA-1784608629-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:72d22ffa-f425-4575-86a5-afbd8bb9cdd6', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'hUFVkcjz', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74613) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 29 17:57:30 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:57:30 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.base [None req-03c71a7b-32a0-47d1-86ad-ac97b97fb8aa tempest-ServerActionsTestOtherA-1784608629 tempest-ServerActionsTestOtherA-1784608629-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.340s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 17:57:30 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-03c71a7b-32a0-47d1-86ad-ac97b97fb8aa tempest-ServerActionsTestOtherA-1784608629 tempest-ServerActionsTestOtherA-1784608629-project-member] <== connect_volume: return (1341ms) {'type': 'block', 'scsi_wwn': '26633653932656530', 'path': '/dev/sdd'} {{(pid=74613) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 17:57:30 user nova-compute[74613]: DEBUG nova.virt.libvirt.volume.iscsi [None req-03c71a7b-32a0-47d1-86ad-ac97b97fb8aa tempest-ServerActionsTestOtherA-1784608629 tempest-ServerActionsTestOtherA-1784608629-project-member] [instance: 71f2a1ab-3df7-411c-93fa-b0a1a5a44f0a] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26633653932656530', 'path': '/dev/sdd'} {{(pid=74613) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 29 17:57:30 user nova-compute[74613]: DEBUG nova.virt.libvirt.vif [None req-03c71a7b-32a0-47d1-86ad-ac97b97fb8aa tempest-ServerActionsTestOtherA-1784608629 tempest-ServerActionsTestOtherA-1784608629-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-29T17:55:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-767391492',display_name='tempest-ServerActionsTestOtherA-server-1095947964',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-767391492',id=13,image_ref='4217f428-8d9d-4ee1-9614-642d26d90c46',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBoePbDdVpJCaWjh90UecUnwFAFq/eT9sMeustkjBwKAq8nn0Q72xeUImjY1HRKXOBeHYZZlO4bbO6ME7GeXyIhuiGXR5A0ys2izZvXx2IXQIIRGKFd1AzRXZiys4DgmVA==',key_name='tempest-keypair-218978152',keypairs=<?>,launch_index=0,launched_at=2023-11-29T17:55:20Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='b1f70c311d4941c986de21ac458d11ab',ramdisk_id='',reservation_id='r-adqmslmn',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='4217f428-8d9d-4ee1-9614-642d26d90c46',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-1784608629',owner_user_name='tempest-ServerActionsTestOtherA-1784608629-project-member'},tags=<?>,task_state='rebuild_spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T17:57:19Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='368555c72103480b82c5c0bf64b07360',uuid=71f2a1ab-3df7-411c-93fa-b0a1a5a44f0a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "d40a5800-7391-4206-a661-fbce50c35a65", "address": "fa:16:3e:1a:53:06", "network": {"id": "7c2c368e-4c7d-4d70-9a40-c10fe9541af9", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1287934102-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.120", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b1f70c311d4941c986de21ac458d11ab", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd40a5800-73", "ovs_interfaceid": "d40a5800-7391-4206-a661-fbce50c35a65", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74613) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 29 17:57:30 user nova-compute[74613]: DEBUG nova.network.os_vif_util [None req-03c71a7b-32a0-47d1-86ad-ac97b97fb8aa tempest-ServerActionsTestOtherA-1784608629 tempest-ServerActionsTestOtherA-1784608629-project-member] Converting VIF {"id": "d40a5800-7391-4206-a661-fbce50c35a65", "address": "fa:16:3e:1a:53:06", "network": {"id": "7c2c368e-4c7d-4d70-9a40-c10fe9541af9", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1287934102-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.120", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b1f70c311d4941c986de21ac458d11ab", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd40a5800-73", "ovs_interfaceid": "d40a5800-7391-4206-a661-fbce50c35a65", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74613) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 17:57:30 user nova-compute[74613]: DEBUG nova.network.os_vif_util [None req-03c71a7b-32a0-47d1-86ad-ac97b97fb8aa tempest-ServerActionsTestOtherA-1784608629 tempest-ServerActionsTestOtherA-1784608629-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:1a:53:06,bridge_name='br-int',has_traffic_filtering=True,id=d40a5800-7391-4206-a661-fbce50c35a65,network=Network(7c2c368e-4c7d-4d70-9a40-c10fe9541af9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd40a5800-73') {{(pid=74613) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 17:57:30 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-03c71a7b-32a0-47d1-86ad-ac97b97fb8aa tempest-ServerActionsTestOtherA-1784608629 tempest-ServerActionsTestOtherA-1784608629-project-member] [instance: 71f2a1ab-3df7-411c-93fa-b0a1a5a44f0a] End _get_guest_xml xml=<domain type="kvm">
Nov 29 17:57:30 user nova-compute[74613]:   <uuid>71f2a1ab-3df7-411c-93fa-b0a1a5a44f0a</uuid>
Nov 29 17:57:30 user nova-compute[74613]:   <name>instance-0000000d</name>
Nov 29 17:57:30 user nova-compute[74613]:   <memory>524288</memory>
Nov 29 17:57:30 user nova-compute[74613]:   <vcpu>1</vcpu>
Nov 29 17:57:30 user nova-compute[74613]:   <metadata>
Nov 29 17:57:30 user nova-compute[74613]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 29 17:57:30 user nova-compute[74613]:       <nova:package version="0.0.0"/>
Nov 29 17:57:30 user nova-compute[74613]:       <nova:name>tempest-ServerActionsTestOtherA-server-1095947964</nova:name>
Nov 29 17:57:30 user nova-compute[74613]:       <nova:creationTime>2023-11-29 17:57:28</nova:creationTime>
Nov 29 17:57:30 user nova-compute[74613]:       <nova:flavor name="m1.tiny">
Nov 29 17:57:30 user nova-compute[74613]:         <nova:memory>512</nova:memory>
Nov 29 17:57:30 user nova-compute[74613]:         <nova:disk>1</nova:disk>
Nov 29 17:57:30 user nova-compute[74613]:         <nova:swap>0</nova:swap>
Nov 29 17:57:30 user nova-compute[74613]:         <nova:ephemeral>0</nova:ephemeral>
Nov 29 17:57:30 user nova-compute[74613]:         <nova:vcpus>1</nova:vcpus>
Nov 29 17:57:30 user nova-compute[74613]:       </nova:flavor>
Nov 29 17:57:30 user nova-compute[74613]:       <nova:owner>
Nov 29 17:57:30 user nova-compute[74613]:         <nova:user uuid="368555c72103480b82c5c0bf64b07360">tempest-ServerActionsTestOtherA-1784608629-project-member</nova:user>
Nov 29 17:57:30 user nova-compute[74613]:         <nova:project uuid="b1f70c311d4941c986de21ac458d11ab">tempest-ServerActionsTestOtherA-1784608629</nova:project>
Nov 29 17:57:30 user nova-compute[74613]:       </nova:owner>
Nov 29 17:57:30 user nova-compute[74613]:       <nova:root type="image" uuid="4217f428-8d9d-4ee1-9614-642d26d90c46"/>
Nov 29 17:57:30 user nova-compute[74613]:       <nova:ports>
Nov 29 17:57:30 user nova-compute[74613]:         <nova:port uuid="d40a5800-7391-4206-a661-fbce50c35a65">
Nov 29 17:57:30 user nova-compute[74613]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Nov 29 17:57:30 user nova-compute[74613]:         </nova:port>
Nov 29 17:57:30 user nova-compute[74613]:       </nova:ports>
Nov 29 17:57:30 user nova-compute[74613]:     </nova:instance>
Nov 29 17:57:30 user nova-compute[74613]:   </metadata>
Nov 29 17:57:30 user nova-compute[74613]:   <sysinfo type="smbios">
Nov 29 17:57:30 user nova-compute[74613]:     <system>
Nov 29 17:57:30 user nova-compute[74613]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 29 17:57:30 user nova-compute[74613]:       <entry name="product">OpenStack Nova</entry>
Nov 29 17:57:30 user nova-compute[74613]:       <entry name="version">0.0.0</entry>
Nov 29 17:57:30 user nova-compute[74613]:       <entry name="serial">71f2a1ab-3df7-411c-93fa-b0a1a5a44f0a</entry>
Nov 29 17:57:30 user nova-compute[74613]:       <entry name="uuid">71f2a1ab-3df7-411c-93fa-b0a1a5a44f0a</entry>
Nov 29 17:57:30 user nova-compute[74613]:       <entry name="family">Virtual Machine</entry>
Nov 29 17:57:30 user nova-compute[74613]:     </system>
Nov 29 17:57:30 user nova-compute[74613]:   </sysinfo>
Nov 29 17:57:30 user nova-compute[74613]:   <os>
Nov 29 17:57:30 user nova-compute[74613]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 29 17:57:30 user nova-compute[74613]:     <boot dev="hd"/>
Nov 29 17:57:30 user nova-compute[74613]:     <smbios mode="sysinfo"/>
Nov 29 17:57:30 user nova-compute[74613]:   </os>
Nov 29 17:57:30 user nova-compute[74613]:   <features>
Nov 29 17:57:30 user nova-compute[74613]:     <acpi/>
Nov 29 17:57:30 user nova-compute[74613]:     <apic/>
Nov 29 17:57:30 user nova-compute[74613]:     <vmcoreinfo/>
Nov 29 17:57:30 user nova-compute[74613]:   </features>
Nov 29 17:57:30 user nova-compute[74613]:   <clock offset="utc">
Nov 29 17:57:30 user nova-compute[74613]:     <timer name="pit" tickpolicy="delay"/>
Nov 29 17:57:30 user nova-compute[74613]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 29 17:57:30 user nova-compute[74613]:     <timer name="hpet" present="no"/>
Nov 29 17:57:30 user nova-compute[74613]:   </clock>
Nov 29 17:57:30 user nova-compute[74613]:   <cpu mode="custom" match="exact">
Nov 29 17:57:30 user nova-compute[74613]:     <model>Nehalem</model>
Nov 29 17:57:30 user nova-compute[74613]:     <topology sockets="1" cores="1" threads="1"/>
Nov 29 17:57:30 user nova-compute[74613]:   </cpu>
Nov 29 17:57:30 user nova-compute[74613]:   <devices>
Nov 29 17:57:30 user nova-compute[74613]:     <disk type="file" device="disk">
Nov 29 17:57:30 user nova-compute[74613]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 29 17:57:30 user nova-compute[74613]:       <source file="/opt/stack/data/nova/instances/71f2a1ab-3df7-411c-93fa-b0a1a5a44f0a/disk"/>
Nov 29 17:57:30 user nova-compute[74613]:       <target dev="vda" bus="virtio"/>
Nov 29 17:57:30 user nova-compute[74613]:     </disk>
Nov 29 17:57:30 user nova-compute[74613]:     <disk type="block" device="disk">
Nov 29 17:57:30 user nova-compute[74613]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 17:57:30 user nova-compute[74613]:       <source dev="/dev/sdd"/>
Nov 29 17:57:30 user nova-compute[74613]:       <target dev="vdb" bus="virtio"/>
Nov 29 17:57:30 user nova-compute[74613]:       <serial>72d22ffa-f425-4575-86a5-afbd8bb9cdd6</serial>
Nov 29 17:57:30 user nova-compute[74613]:     </disk>
Nov 29 17:57:30 user nova-compute[74613]:     <interface type="ethernet">
Nov 29 17:57:30 user nova-compute[74613]:       <mac address="fa:16:3e:1a:53:06"/>
Nov 29 17:57:30 user nova-compute[74613]:       <model type="virtio"/>
Nov 29 17:57:30 user nova-compute[74613]:       <mtu size="1442"/>
Nov 29 17:57:30 user nova-compute[74613]:       <target dev="tapd40a5800-73"/>
Nov 29 17:57:30 user nova-compute[74613]:     </interface>
Nov 29 17:57:30 user nova-compute[74613]:     <serial type="pty">
Nov 29 17:57:30 user nova-compute[74613]:       <log file="/opt/stack/data/nova/instances/71f2a1ab-3df7-411c-93fa-b0a1a5a44f0a/console.log" append="off"/>
Nov 29 17:57:30 user nova-compute[74613]:     </serial>
Nov 29 17:57:30 user nova-compute[74613]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 29 17:57:30 user nova-compute[74613]:     <video>
Nov 29 17:57:30 user nova-compute[74613]:       <model type="virtio"/>
Nov 29 17:57:30 user nova-compute[74613]:     </video>
Nov 29 17:57:30 user nova-compute[74613]:     <rng model="virtio">
Nov 29 17:57:30 user nova-compute[74613]:       <backend model="random">/dev/urandom</backend>
Nov 29 17:57:30 user nova-compute[74613]:     </rng>
Nov 29 17:57:30 user nova-compute[74613]:     <controller type="usb" index="0" model="none"/>
Nov 29 17:57:30 user nova-compute[74613]:     <memballoon model="virtio">
Nov 29 17:57:30 user nova-compute[74613]:       <stats period="10"/>
Nov 29 17:57:30 user nova-compute[74613]:     </memballoon>
Nov 29 17:57:30 user nova-compute[74613]:   </devices>
Nov 29 17:57:30 user nova-compute[74613]: </domain>
Nov 29 17:57:30 user nova-compute[74613]:  {{(pid=74613) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 29 17:57:30 user nova-compute[74613]: DEBUG nova.virt.libvirt.vif [None req-03c71a7b-32a0-47d1-86ad-ac97b97fb8aa tempest-ServerActionsTestOtherA-1784608629 tempest-ServerActionsTestOtherA-1784608629-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-29T17:55:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-767391492',display_name='tempest-ServerActionsTestOtherA-server-1095947964',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-767391492',id=13,image_ref='4217f428-8d9d-4ee1-9614-642d26d90c46',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBoePbDdVpJCaWjh90UecUnwFAFq/eT9sMeustkjBwKAq8nn0Q72xeUImjY1HRKXOBeHYZZlO4bbO6ME7GeXyIhuiGXR5A0ys2izZvXx2IXQIIRGKFd1AzRXZiys4DgmVA==',key_name='tempest-keypair-218978152',keypairs=<?>,launch_index=0,launched_at=2023-11-29T17:55:20Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='b1f70c311d4941c986de21ac458d11ab',ramdisk_id='',reservation_id='r-adqmslmn',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='4217f428-8d9d-4ee1-9614-642d26d90c46',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-1784608629',owner_user_name='tempest-ServerActionsTestOtherA-1784608629-project-member'},tags=<?>,task_state='rebuild_spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T17:57:19Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='368555c72103480b82c5c0bf64b07360',uuid=71f2a1ab-3df7-411c-93fa-b0a1a5a44f0a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "d40a5800-7391-4206-a661-fbce50c35a65", "address": "fa:16:3e:1a:53:06", "network": {"id": "7c2c368e-4c7d-4d70-9a40-c10fe9541af9", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1287934102-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.120", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b1f70c311d4941c986de21ac458d11ab", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd40a5800-73", "ovs_interfaceid": "d40a5800-7391-4206-a661-fbce50c35a65", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74613) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 29 17:57:30 user nova-compute[74613]: DEBUG nova.network.os_vif_util [None req-03c71a7b-32a0-47d1-86ad-ac97b97fb8aa tempest-ServerActionsTestOtherA-1784608629 tempest-ServerActionsTestOtherA-1784608629-project-member] Converting VIF {"id": "d40a5800-7391-4206-a661-fbce50c35a65", "address": "fa:16:3e:1a:53:06", "network": {"id": "7c2c368e-4c7d-4d70-9a40-c10fe9541af9", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1287934102-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.120", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b1f70c311d4941c986de21ac458d11ab", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd40a5800-73", "ovs_interfaceid": "d40a5800-7391-4206-a661-fbce50c35a65", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74613) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 17:57:30 user nova-compute[74613]: DEBUG nova.network.os_vif_util [None req-03c71a7b-32a0-47d1-86ad-ac97b97fb8aa tempest-ServerActionsTestOtherA-1784608629 tempest-ServerActionsTestOtherA-1784608629-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:1a:53:06,bridge_name='br-int',has_traffic_filtering=True,id=d40a5800-7391-4206-a661-fbce50c35a65,network=Network(7c2c368e-4c7d-4d70-9a40-c10fe9541af9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd40a5800-73') {{(pid=74613) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 17:57:30 user nova-compute[74613]: DEBUG os_vif [None req-03c71a7b-32a0-47d1-86ad-ac97b97fb8aa tempest-ServerActionsTestOtherA-1784608629 tempest-ServerActionsTestOtherA-1784608629-project-member] Plugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:1a:53:06,bridge_name='br-int',has_traffic_filtering=True,id=d40a5800-7391-4206-a661-fbce50c35a65,network=Network(7c2c368e-4c7d-4d70-9a40-c10fe9541af9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd40a5800-73') {{(pid=74613) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 29 17:57:30 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:57:30 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74613) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 17:57:30 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74613) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 29 17:57:30 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:57:30 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '3e6b8a25-7cb8-591d-a307-733d3db208c6', '_type': 'linux-noop'}}, row=False) {{(pid=74613) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 17:57:30 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:57:30 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:57:30 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:57:30 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapd40a5800-73, may_exist=True, interface_attrs={}) {{(pid=74613) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 17:57:30 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapd40a5800-73, col_values=(('qos', UUID('9f548cfa-9c5b-4385-ba3c-5dde23ec57c1')),), if_exists=True) {{(pid=74613) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 17:57:30 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapd40a5800-73, col_values=(('external_ids', {'iface-id': 'd40a5800-7391-4206-a661-fbce50c35a65', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:1a:53:06', 'vm-uuid': '71f2a1ab-3df7-411c-93fa-b0a1a5a44f0a'}),), if_exists=True) {{(pid=74613) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 17:57:30 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:57:30 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 17:57:30 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:57:30 user nova-compute[74613]: INFO os_vif [None req-03c71a7b-32a0-47d1-86ad-ac97b97fb8aa tempest-ServerActionsTestOtherA-1784608629 tempest-ServerActionsTestOtherA-1784608629-project-member] Successfully plugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:1a:53:06,bridge_name='br-int',has_traffic_filtering=True,id=d40a5800-7391-4206-a661-fbce50c35a65,network=Network(7c2c368e-4c7d-4d70-9a40-c10fe9541af9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd40a5800-73')
Nov 29 17:57:30 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-03c71a7b-32a0-47d1-86ad-ac97b97fb8aa tempest-ServerActionsTestOtherA-1784608629 tempest-ServerActionsTestOtherA-1784608629-project-member] No BDM found with device name vda, not building metadata. {{(pid=74613) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 17:57:30 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-03c71a7b-32a0-47d1-86ad-ac97b97fb8aa tempest-ServerActionsTestOtherA-1784608629 tempest-ServerActionsTestOtherA-1784608629-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74613) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 17:57:30 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-03c71a7b-32a0-47d1-86ad-ac97b97fb8aa tempest-ServerActionsTestOtherA-1784608629 tempest-ServerActionsTestOtherA-1784608629-project-member] No VIF found with MAC fa:16:3e:1a:53:06, not building metadata {{(pid=74613) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 29 17:57:32 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:57:32 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:57:32 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:57:32 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:57:32 user nova-compute[74613]: DEBUG nova.compute.manager [req-f59ca8c6-8c37-405f-946a-438366a65a40 req-80d23042-b0a9-4e23-962e-c801a3141a27 service nova] [instance: 71f2a1ab-3df7-411c-93fa-b0a1a5a44f0a] Received event network-vif-plugged-d40a5800-7391-4206-a661-fbce50c35a65 {{(pid=74613) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 17:57:32 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-f59ca8c6-8c37-405f-946a-438366a65a40 req-80d23042-b0a9-4e23-962e-c801a3141a27 service nova] Acquiring lock "71f2a1ab-3df7-411c-93fa-b0a1a5a44f0a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 17:57:32 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-f59ca8c6-8c37-405f-946a-438366a65a40 req-80d23042-b0a9-4e23-962e-c801a3141a27 service nova] Lock "71f2a1ab-3df7-411c-93fa-b0a1a5a44f0a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 17:57:32 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-f59ca8c6-8c37-405f-946a-438366a65a40 req-80d23042-b0a9-4e23-962e-c801a3141a27 service nova] Lock "71f2a1ab-3df7-411c-93fa-b0a1a5a44f0a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 17:57:32 user nova-compute[74613]: DEBUG nova.compute.manager [req-f59ca8c6-8c37-405f-946a-438366a65a40 req-80d23042-b0a9-4e23-962e-c801a3141a27 service nova] [instance: 71f2a1ab-3df7-411c-93fa-b0a1a5a44f0a] No waiting events found dispatching network-vif-plugged-d40a5800-7391-4206-a661-fbce50c35a65 {{(pid=74613) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 17:57:32 user nova-compute[74613]: WARNING nova.compute.manager [req-f59ca8c6-8c37-405f-946a-438366a65a40 req-80d23042-b0a9-4e23-962e-c801a3141a27 service nova] [instance: 71f2a1ab-3df7-411c-93fa-b0a1a5a44f0a] Received unexpected event network-vif-plugged-d40a5800-7391-4206-a661-fbce50c35a65 for instance with vm_state active and task_state rebuild_spawning.
Nov 29 17:57:32 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:57:34 user nova-compute[74613]: DEBUG nova.compute.manager [None req-03c71a7b-32a0-47d1-86ad-ac97b97fb8aa tempest-ServerActionsTestOtherA-1784608629 tempest-ServerActionsTestOtherA-1784608629-project-member] [instance: 71f2a1ab-3df7-411c-93fa-b0a1a5a44f0a] Instance event wait completed in 0 seconds for  {{(pid=74613) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 29 17:57:34 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-03c71a7b-32a0-47d1-86ad-ac97b97fb8aa tempest-ServerActionsTestOtherA-1784608629 tempest-ServerActionsTestOtherA-1784608629-project-member] [instance: 71f2a1ab-3df7-411c-93fa-b0a1a5a44f0a] Guest created on hypervisor {{(pid=74613) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 29 17:57:34 user nova-compute[74613]: INFO nova.virt.libvirt.driver [-] [instance: 71f2a1ab-3df7-411c-93fa-b0a1a5a44f0a] Instance spawned successfully.
Nov 29 17:57:34 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-03c71a7b-32a0-47d1-86ad-ac97b97fb8aa tempest-ServerActionsTestOtherA-1784608629 tempest-ServerActionsTestOtherA-1784608629-project-member] [instance: 71f2a1ab-3df7-411c-93fa-b0a1a5a44f0a] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74613) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 29 17:57:34 user nova-compute[74613]: DEBUG nova.compute.manager [req-2bee448c-2d17-4b5c-83f2-a58c16b40a75 req-3e5429d0-4e87-41b0-8d8e-25f13f3f3334 service nova] [instance: 71f2a1ab-3df7-411c-93fa-b0a1a5a44f0a] Received event network-vif-plugged-d40a5800-7391-4206-a661-fbce50c35a65 {{(pid=74613) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 17:57:34 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-2bee448c-2d17-4b5c-83f2-a58c16b40a75 req-3e5429d0-4e87-41b0-8d8e-25f13f3f3334 service nova] Acquiring lock "71f2a1ab-3df7-411c-93fa-b0a1a5a44f0a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 17:57:34 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-2bee448c-2d17-4b5c-83f2-a58c16b40a75 req-3e5429d0-4e87-41b0-8d8e-25f13f3f3334 service nova] Lock "71f2a1ab-3df7-411c-93fa-b0a1a5a44f0a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 17:57:34 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-2bee448c-2d17-4b5c-83f2-a58c16b40a75 req-3e5429d0-4e87-41b0-8d8e-25f13f3f3334 service nova] Lock "71f2a1ab-3df7-411c-93fa-b0a1a5a44f0a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 17:57:34 user nova-compute[74613]: DEBUG nova.compute.manager [req-2bee448c-2d17-4b5c-83f2-a58c16b40a75 req-3e5429d0-4e87-41b0-8d8e-25f13f3f3334 service nova] [instance: 71f2a1ab-3df7-411c-93fa-b0a1a5a44f0a] No waiting events found dispatching network-vif-plugged-d40a5800-7391-4206-a661-fbce50c35a65 {{(pid=74613) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 17:57:34 user nova-compute[74613]: WARNING nova.compute.manager [req-2bee448c-2d17-4b5c-83f2-a58c16b40a75 req-3e5429d0-4e87-41b0-8d8e-25f13f3f3334 service nova] [instance: 71f2a1ab-3df7-411c-93fa-b0a1a5a44f0a] Received unexpected event network-vif-plugged-d40a5800-7391-4206-a661-fbce50c35a65 for instance with vm_state active and task_state rebuild_spawning.
Nov 29 17:57:34 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-03c71a7b-32a0-47d1-86ad-ac97b97fb8aa tempest-ServerActionsTestOtherA-1784608629 tempest-ServerActionsTestOtherA-1784608629-project-member] [instance: 71f2a1ab-3df7-411c-93fa-b0a1a5a44f0a] Found default for hw_cdrom_bus of ide {{(pid=74613) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 17:57:34 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-03c71a7b-32a0-47d1-86ad-ac97b97fb8aa tempest-ServerActionsTestOtherA-1784608629 tempest-ServerActionsTestOtherA-1784608629-project-member] [instance: 71f2a1ab-3df7-411c-93fa-b0a1a5a44f0a] Found default for hw_disk_bus of virtio {{(pid=74613) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 17:57:34 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-03c71a7b-32a0-47d1-86ad-ac97b97fb8aa tempest-ServerActionsTestOtherA-1784608629 tempest-ServerActionsTestOtherA-1784608629-project-member] [instance: 71f2a1ab-3df7-411c-93fa-b0a1a5a44f0a] Found default for hw_input_bus of None {{(pid=74613) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 17:57:34 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-03c71a7b-32a0-47d1-86ad-ac97b97fb8aa tempest-ServerActionsTestOtherA-1784608629 tempest-ServerActionsTestOtherA-1784608629-project-member] [instance: 71f2a1ab-3df7-411c-93fa-b0a1a5a44f0a] Found default for hw_pointer_model of None {{(pid=74613) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 17:57:34 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-03c71a7b-32a0-47d1-86ad-ac97b97fb8aa tempest-ServerActionsTestOtherA-1784608629 tempest-ServerActionsTestOtherA-1784608629-project-member] [instance: 71f2a1ab-3df7-411c-93fa-b0a1a5a44f0a] Found default for hw_video_model of virtio {{(pid=74613) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 17:57:34 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-03c71a7b-32a0-47d1-86ad-ac97b97fb8aa tempest-ServerActionsTestOtherA-1784608629 tempest-ServerActionsTestOtherA-1784608629-project-member] [instance: 71f2a1ab-3df7-411c-93fa-b0a1a5a44f0a] Found default for hw_vif_model of virtio {{(pid=74613) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 17:57:34 user nova-compute[74613]: DEBUG nova.compute.manager [None req-03c71a7b-32a0-47d1-86ad-ac97b97fb8aa tempest-ServerActionsTestOtherA-1784608629 tempest-ServerActionsTestOtherA-1784608629-project-member] [instance: 71f2a1ab-3df7-411c-93fa-b0a1a5a44f0a] Checking state {{(pid=74613) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 29 17:57:34 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-03c71a7b-32a0-47d1-86ad-ac97b97fb8aa tempest-ServerActionsTestOtherA-1784608629 tempest-ServerActionsTestOtherA-1784608629-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 17:57:34 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-03c71a7b-32a0-47d1-86ad-ac97b97fb8aa tempest-ServerActionsTestOtherA-1784608629 tempest-ServerActionsTestOtherA-1784608629-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: waited 0.001s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 17:57:34 user nova-compute[74613]: DEBUG nova.objects.instance [None req-03c71a7b-32a0-47d1-86ad-ac97b97fb8aa tempest-ServerActionsTestOtherA-1784608629 tempest-ServerActionsTestOtherA-1784608629-project-member] [instance: 71f2a1ab-3df7-411c-93fa-b0a1a5a44f0a] Trying to apply a migration context that does not seem to be set for this instance {{(pid=74613) apply_migration_context /opt/stack/nova/nova/objects/instance.py:1067}}
Nov 29 17:57:34 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-03c71a7b-32a0-47d1-86ad-ac97b97fb8aa tempest-ServerActionsTestOtherA-1784608629 tempest-ServerActionsTestOtherA-1784608629-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: held 0.087s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 17:57:35 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:57:35 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:57:38 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-ac9b8a58-0084-4cf0-ab6b-5e12ca74bafa tempest-ServersNegativeTestJSON-1631676891 tempest-ServersNegativeTestJSON-1631676891-project-member] Acquiring lock "fce4b456-c108-439f-b0ff-7619aaf77e69" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 17:57:38 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-ac9b8a58-0084-4cf0-ab6b-5e12ca74bafa tempest-ServersNegativeTestJSON-1631676891 tempest-ServersNegativeTestJSON-1631676891-project-member] Lock "fce4b456-c108-439f-b0ff-7619aaf77e69" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 17:57:38 user nova-compute[74613]: DEBUG nova.compute.manager [None req-ac9b8a58-0084-4cf0-ab6b-5e12ca74bafa tempest-ServersNegativeTestJSON-1631676891 tempest-ServersNegativeTestJSON-1631676891-project-member] [instance: fce4b456-c108-439f-b0ff-7619aaf77e69] Starting instance... {{(pid=74613) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 29 17:57:38 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-ac9b8a58-0084-4cf0-ab6b-5e12ca74bafa tempest-ServersNegativeTestJSON-1631676891 tempest-ServersNegativeTestJSON-1631676891-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 17:57:38 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-ac9b8a58-0084-4cf0-ab6b-5e12ca74bafa tempest-ServersNegativeTestJSON-1631676891 tempest-ServersNegativeTestJSON-1631676891-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 17:57:39 user nova-compute[74613]: DEBUG nova.virt.hardware [None req-ac9b8a58-0084-4cf0-ab6b-5e12ca74bafa tempest-ServersNegativeTestJSON-1631676891 tempest-ServersNegativeTestJSON-1631676891-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74613) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 29 17:57:39 user nova-compute[74613]: INFO nova.compute.claims [None req-ac9b8a58-0084-4cf0-ab6b-5e12ca74bafa tempest-ServersNegativeTestJSON-1631676891 tempest-ServersNegativeTestJSON-1631676891-project-member] [instance: fce4b456-c108-439f-b0ff-7619aaf77e69] Claim successful on node user
Nov 29 17:57:39 user nova-compute[74613]: DEBUG nova.compute.provider_tree [None req-ac9b8a58-0084-4cf0-ab6b-5e12ca74bafa tempest-ServersNegativeTestJSON-1631676891 tempest-ServersNegativeTestJSON-1631676891-project-member] Inventory has not changed in ProviderTree for provider: 639d980e-3b12-44b1-b8f4-1812416fa4dd {{(pid=74613) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 17:57:39 user nova-compute[74613]: DEBUG nova.scheduler.client.report [None req-ac9b8a58-0084-4cf0-ab6b-5e12ca74bafa tempest-ServersNegativeTestJSON-1631676891 tempest-ServersNegativeTestJSON-1631676891-project-member] Inventory has not changed for provider 639d980e-3b12-44b1-b8f4-1812416fa4dd based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74613) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 17:57:39 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-ac9b8a58-0084-4cf0-ab6b-5e12ca74bafa tempest-ServersNegativeTestJSON-1631676891 tempest-ServersNegativeTestJSON-1631676891-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.493s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 17:57:39 user nova-compute[74613]: DEBUG nova.compute.manager [None req-ac9b8a58-0084-4cf0-ab6b-5e12ca74bafa tempest-ServersNegativeTestJSON-1631676891 tempest-ServersNegativeTestJSON-1631676891-project-member] [instance: fce4b456-c108-439f-b0ff-7619aaf77e69] Start building networks asynchronously for instance. {{(pid=74613) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 29 17:57:39 user nova-compute[74613]: DEBUG nova.compute.manager [None req-ac9b8a58-0084-4cf0-ab6b-5e12ca74bafa tempest-ServersNegativeTestJSON-1631676891 tempest-ServersNegativeTestJSON-1631676891-project-member] [instance: fce4b456-c108-439f-b0ff-7619aaf77e69] Allocating IP information in the background. {{(pid=74613) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 29 17:57:39 user nova-compute[74613]: DEBUG nova.network.neutron [None req-ac9b8a58-0084-4cf0-ab6b-5e12ca74bafa tempest-ServersNegativeTestJSON-1631676891 tempest-ServersNegativeTestJSON-1631676891-project-member] [instance: fce4b456-c108-439f-b0ff-7619aaf77e69] allocate_for_instance() {{(pid=74613) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 29 17:57:39 user nova-compute[74613]: INFO nova.virt.libvirt.driver [None req-ac9b8a58-0084-4cf0-ab6b-5e12ca74bafa tempest-ServersNegativeTestJSON-1631676891 tempest-ServersNegativeTestJSON-1631676891-project-member] [instance: fce4b456-c108-439f-b0ff-7619aaf77e69] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 29 17:57:39 user nova-compute[74613]: DEBUG nova.compute.manager [None req-ac9b8a58-0084-4cf0-ab6b-5e12ca74bafa tempest-ServersNegativeTestJSON-1631676891 tempest-ServersNegativeTestJSON-1631676891-project-member] [instance: fce4b456-c108-439f-b0ff-7619aaf77e69] Start building block device mappings for instance. {{(pid=74613) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 29 17:57:39 user nova-compute[74613]: DEBUG nova.policy [None req-ac9b8a58-0084-4cf0-ab6b-5e12ca74bafa tempest-ServersNegativeTestJSON-1631676891 tempest-ServersNegativeTestJSON-1631676891-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '4b4c259dfbf244c6b48374ab04e6d694', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68aabefe0c4340ce8408e386748fa0cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74613) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 29 17:57:39 user nova-compute[74613]: DEBUG nova.compute.manager [None req-ac9b8a58-0084-4cf0-ab6b-5e12ca74bafa tempest-ServersNegativeTestJSON-1631676891 tempest-ServersNegativeTestJSON-1631676891-project-member] [instance: fce4b456-c108-439f-b0ff-7619aaf77e69] Start spawning the instance on the hypervisor. {{(pid=74613) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 29 17:57:39 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-ac9b8a58-0084-4cf0-ab6b-5e12ca74bafa tempest-ServersNegativeTestJSON-1631676891 tempest-ServersNegativeTestJSON-1631676891-project-member] [instance: fce4b456-c108-439f-b0ff-7619aaf77e69] Creating instance directory {{(pid=74613) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 29 17:57:39 user nova-compute[74613]: INFO nova.virt.libvirt.driver [None req-ac9b8a58-0084-4cf0-ab6b-5e12ca74bafa tempest-ServersNegativeTestJSON-1631676891 tempest-ServersNegativeTestJSON-1631676891-project-member] [instance: fce4b456-c108-439f-b0ff-7619aaf77e69] Creating image(s)
Nov 29 17:57:39 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-ac9b8a58-0084-4cf0-ab6b-5e12ca74bafa tempest-ServersNegativeTestJSON-1631676891 tempest-ServersNegativeTestJSON-1631676891-project-member] Acquiring lock "/opt/stack/data/nova/instances/fce4b456-c108-439f-b0ff-7619aaf77e69/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 17:57:39 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-ac9b8a58-0084-4cf0-ab6b-5e12ca74bafa tempest-ServersNegativeTestJSON-1631676891 tempest-ServersNegativeTestJSON-1631676891-project-member] Lock "/opt/stack/data/nova/instances/fce4b456-c108-439f-b0ff-7619aaf77e69/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 17:57:39 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-ac9b8a58-0084-4cf0-ab6b-5e12ca74bafa tempest-ServersNegativeTestJSON-1631676891 tempest-ServersNegativeTestJSON-1631676891-project-member] Lock "/opt/stack/data/nova/instances/fce4b456-c108-439f-b0ff-7619aaf77e69/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 17:57:39 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-ac9b8a58-0084-4cf0-ab6b-5e12ca74bafa tempest-ServersNegativeTestJSON-1631676891 tempest-ServersNegativeTestJSON-1631676891-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/21faea9e6951f3bdd0153b76ac89fe1a60a34758 --force-share --output=json {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 17:57:39 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-ac9b8a58-0084-4cf0-ab6b-5e12ca74bafa tempest-ServersNegativeTestJSON-1631676891 tempest-ServersNegativeTestJSON-1631676891-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/21faea9e6951f3bdd0153b76ac89fe1a60a34758 --force-share --output=json" returned: 0 in 0.217s {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 17:57:39 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-ac9b8a58-0084-4cf0-ab6b-5e12ca74bafa tempest-ServersNegativeTestJSON-1631676891 tempest-ServersNegativeTestJSON-1631676891-project-member] Acquiring lock "21faea9e6951f3bdd0153b76ac89fe1a60a34758" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 17:57:39 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-ac9b8a58-0084-4cf0-ab6b-5e12ca74bafa tempest-ServersNegativeTestJSON-1631676891 tempest-ServersNegativeTestJSON-1631676891-project-member] Lock "21faea9e6951f3bdd0153b76ac89fe1a60a34758" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 17:57:39 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-ac9b8a58-0084-4cf0-ab6b-5e12ca74bafa tempest-ServersNegativeTestJSON-1631676891 tempest-ServersNegativeTestJSON-1631676891-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/21faea9e6951f3bdd0153b76ac89fe1a60a34758 --force-share --output=json {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 17:57:40 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-ac9b8a58-0084-4cf0-ab6b-5e12ca74bafa tempest-ServersNegativeTestJSON-1631676891 tempest-ServersNegativeTestJSON-1631676891-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/21faea9e6951f3bdd0153b76ac89fe1a60a34758 --force-share --output=json" returned: 0 in 0.232s {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 17:57:40 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-ac9b8a58-0084-4cf0-ab6b-5e12ca74bafa tempest-ServersNegativeTestJSON-1631676891 tempest-ServersNegativeTestJSON-1631676891-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/21faea9e6951f3bdd0153b76ac89fe1a60a34758,backing_fmt=raw /opt/stack/data/nova/instances/fce4b456-c108-439f-b0ff-7619aaf77e69/disk 1073741824 {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 17:57:40 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:57:40 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-ac9b8a58-0084-4cf0-ab6b-5e12ca74bafa tempest-ServersNegativeTestJSON-1631676891 tempest-ServersNegativeTestJSON-1631676891-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/21faea9e6951f3bdd0153b76ac89fe1a60a34758,backing_fmt=raw /opt/stack/data/nova/instances/fce4b456-c108-439f-b0ff-7619aaf77e69/disk 1073741824" returned: 0 in 0.050s {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 17:57:40 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-ac9b8a58-0084-4cf0-ab6b-5e12ca74bafa tempest-ServersNegativeTestJSON-1631676891 tempest-ServersNegativeTestJSON-1631676891-project-member] Lock "21faea9e6951f3bdd0153b76ac89fe1a60a34758" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.288s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 17:57:40 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-ac9b8a58-0084-4cf0-ab6b-5e12ca74bafa tempest-ServersNegativeTestJSON-1631676891 tempest-ServersNegativeTestJSON-1631676891-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/21faea9e6951f3bdd0153b76ac89fe1a60a34758 --force-share --output=json {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 17:57:40 user nova-compute[74613]: DEBUG nova.network.neutron [None req-ac9b8a58-0084-4cf0-ab6b-5e12ca74bafa tempest-ServersNegativeTestJSON-1631676891 tempest-ServersNegativeTestJSON-1631676891-project-member] [instance: fce4b456-c108-439f-b0ff-7619aaf77e69] Successfully created port: 3e7fadc1-cfec-4ced-8078-8056d61d96a5 {{(pid=74613) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 29 17:57:40 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-ac9b8a58-0084-4cf0-ab6b-5e12ca74bafa tempest-ServersNegativeTestJSON-1631676891 tempest-ServersNegativeTestJSON-1631676891-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/21faea9e6951f3bdd0153b76ac89fe1a60a34758 --force-share --output=json" returned: 0 in 0.205s {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 17:57:40 user nova-compute[74613]: DEBUG nova.virt.disk.api [None req-ac9b8a58-0084-4cf0-ab6b-5e12ca74bafa tempest-ServersNegativeTestJSON-1631676891 tempest-ServersNegativeTestJSON-1631676891-project-member] Checking if we can resize image /opt/stack/data/nova/instances/fce4b456-c108-439f-b0ff-7619aaf77e69/disk. size=1073741824 {{(pid=74613) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 29 17:57:40 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-ac9b8a58-0084-4cf0-ab6b-5e12ca74bafa tempest-ServersNegativeTestJSON-1631676891 tempest-ServersNegativeTestJSON-1631676891-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fce4b456-c108-439f-b0ff-7619aaf77e69/disk --force-share --output=json {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 17:57:40 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:57:40 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-ac9b8a58-0084-4cf0-ab6b-5e12ca74bafa tempest-ServersNegativeTestJSON-1631676891 tempest-ServersNegativeTestJSON-1631676891-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fce4b456-c108-439f-b0ff-7619aaf77e69/disk --force-share --output=json" returned: 0 in 0.215s {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 17:57:40 user nova-compute[74613]: DEBUG nova.virt.disk.api [None req-ac9b8a58-0084-4cf0-ab6b-5e12ca74bafa tempest-ServersNegativeTestJSON-1631676891 tempest-ServersNegativeTestJSON-1631676891-project-member] Cannot resize image /opt/stack/data/nova/instances/fce4b456-c108-439f-b0ff-7619aaf77e69/disk to a smaller size. {{(pid=74613) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 29 17:57:40 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-ac9b8a58-0084-4cf0-ab6b-5e12ca74bafa tempest-ServersNegativeTestJSON-1631676891 tempest-ServersNegativeTestJSON-1631676891-project-member] [instance: fce4b456-c108-439f-b0ff-7619aaf77e69] Created local disks {{(pid=74613) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 29 17:57:40 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-ac9b8a58-0084-4cf0-ab6b-5e12ca74bafa tempest-ServersNegativeTestJSON-1631676891 tempest-ServersNegativeTestJSON-1631676891-project-member] [instance: fce4b456-c108-439f-b0ff-7619aaf77e69] Ensure instance console log exists: /opt/stack/data/nova/instances/fce4b456-c108-439f-b0ff-7619aaf77e69/console.log {{(pid=74613) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 29 17:57:40 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-ac9b8a58-0084-4cf0-ab6b-5e12ca74bafa tempest-ServersNegativeTestJSON-1631676891 tempest-ServersNegativeTestJSON-1631676891-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 17:57:40 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-ac9b8a58-0084-4cf0-ab6b-5e12ca74bafa tempest-ServersNegativeTestJSON-1631676891 tempest-ServersNegativeTestJSON-1631676891-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 17:57:40 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-ac9b8a58-0084-4cf0-ab6b-5e12ca74bafa tempest-ServersNegativeTestJSON-1631676891 tempest-ServersNegativeTestJSON-1631676891-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 17:57:40 user nova-compute[74613]: DEBUG nova.network.neutron [None req-ac9b8a58-0084-4cf0-ab6b-5e12ca74bafa tempest-ServersNegativeTestJSON-1631676891 tempest-ServersNegativeTestJSON-1631676891-project-member] [instance: fce4b456-c108-439f-b0ff-7619aaf77e69] Successfully updated port: 3e7fadc1-cfec-4ced-8078-8056d61d96a5 {{(pid=74613) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 29 17:57:40 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-ac9b8a58-0084-4cf0-ab6b-5e12ca74bafa tempest-ServersNegativeTestJSON-1631676891 tempest-ServersNegativeTestJSON-1631676891-project-member] Acquiring lock "refresh_cache-fce4b456-c108-439f-b0ff-7619aaf77e69" {{(pid=74613) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 17:57:40 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-ac9b8a58-0084-4cf0-ab6b-5e12ca74bafa tempest-ServersNegativeTestJSON-1631676891 tempest-ServersNegativeTestJSON-1631676891-project-member] Acquired lock "refresh_cache-fce4b456-c108-439f-b0ff-7619aaf77e69" {{(pid=74613) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 17:57:41 user nova-compute[74613]: DEBUG nova.network.neutron [None req-ac9b8a58-0084-4cf0-ab6b-5e12ca74bafa tempest-ServersNegativeTestJSON-1631676891 tempest-ServersNegativeTestJSON-1631676891-project-member] [instance: fce4b456-c108-439f-b0ff-7619aaf77e69] Building network info cache for instance {{(pid=74613) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 29 17:57:41 user nova-compute[74613]: DEBUG nova.compute.manager [req-44e629d5-e828-4747-b4e7-c887c9ddb520 req-187511ae-f93a-4aee-8937-24160c5e5b8f service nova] [instance: fce4b456-c108-439f-b0ff-7619aaf77e69] Received event network-changed-3e7fadc1-cfec-4ced-8078-8056d61d96a5 {{(pid=74613) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 17:57:41 user nova-compute[74613]: DEBUG nova.compute.manager [req-44e629d5-e828-4747-b4e7-c887c9ddb520 req-187511ae-f93a-4aee-8937-24160c5e5b8f service nova] [instance: fce4b456-c108-439f-b0ff-7619aaf77e69] Refreshing instance network info cache due to event network-changed-3e7fadc1-cfec-4ced-8078-8056d61d96a5. {{(pid=74613) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 17:57:41 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-44e629d5-e828-4747-b4e7-c887c9ddb520 req-187511ae-f93a-4aee-8937-24160c5e5b8f service nova] Acquiring lock "refresh_cache-fce4b456-c108-439f-b0ff-7619aaf77e69" {{(pid=74613) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 17:57:41 user nova-compute[74613]: DEBUG nova.network.neutron [None req-ac9b8a58-0084-4cf0-ab6b-5e12ca74bafa tempest-ServersNegativeTestJSON-1631676891 tempest-ServersNegativeTestJSON-1631676891-project-member] [instance: fce4b456-c108-439f-b0ff-7619aaf77e69] Instance cache missing network info. {{(pid=74613) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 29 17:57:41 user nova-compute[74613]: DEBUG nova.network.neutron [None req-ac9b8a58-0084-4cf0-ab6b-5e12ca74bafa tempest-ServersNegativeTestJSON-1631676891 tempest-ServersNegativeTestJSON-1631676891-project-member] [instance: fce4b456-c108-439f-b0ff-7619aaf77e69] Updating instance_info_cache with network_info: [{"id": "3e7fadc1-cfec-4ced-8078-8056d61d96a5", "address": "fa:16:3e:c2:a1:c4", "network": {"id": "4d31e03e-697a-44c2-a03e-77eed3dbce43", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-629140279-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "68aabefe0c4340ce8408e386748fa0cf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3e7fadc1-cf", "ovs_interfaceid": "3e7fadc1-cfec-4ced-8078-8056d61d96a5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74613) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 17:57:41 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-ac9b8a58-0084-4cf0-ab6b-5e12ca74bafa tempest-ServersNegativeTestJSON-1631676891 tempest-ServersNegativeTestJSON-1631676891-project-member] Releasing lock "refresh_cache-fce4b456-c108-439f-b0ff-7619aaf77e69" {{(pid=74613) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 17:57:41 user nova-compute[74613]: DEBUG nova.compute.manager [None req-ac9b8a58-0084-4cf0-ab6b-5e12ca74bafa tempest-ServersNegativeTestJSON-1631676891 tempest-ServersNegativeTestJSON-1631676891-project-member] [instance: fce4b456-c108-439f-b0ff-7619aaf77e69] Instance network_info: |[{"id": "3e7fadc1-cfec-4ced-8078-8056d61d96a5", "address": "fa:16:3e:c2:a1:c4", "network": {"id": "4d31e03e-697a-44c2-a03e-77eed3dbce43", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-629140279-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "68aabefe0c4340ce8408e386748fa0cf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3e7fadc1-cf", "ovs_interfaceid": "3e7fadc1-cfec-4ced-8078-8056d61d96a5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74613) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 29 17:57:41 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-44e629d5-e828-4747-b4e7-c887c9ddb520 req-187511ae-f93a-4aee-8937-24160c5e5b8f service nova] Acquired lock "refresh_cache-fce4b456-c108-439f-b0ff-7619aaf77e69" {{(pid=74613) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 17:57:41 user nova-compute[74613]: DEBUG nova.network.neutron [req-44e629d5-e828-4747-b4e7-c887c9ddb520 req-187511ae-f93a-4aee-8937-24160c5e5b8f service nova] [instance: fce4b456-c108-439f-b0ff-7619aaf77e69] Refreshing network info cache for port 3e7fadc1-cfec-4ced-8078-8056d61d96a5 {{(pid=74613) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 17:57:41 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-ac9b8a58-0084-4cf0-ab6b-5e12ca74bafa tempest-ServersNegativeTestJSON-1631676891 tempest-ServersNegativeTestJSON-1631676891-project-member] [instance: fce4b456-c108-439f-b0ff-7619aaf77e69] Start _get_guest_xml network_info=[{"id": "3e7fadc1-cfec-4ced-8078-8056d61d96a5", "address": "fa:16:3e:c2:a1:c4", "network": {"id": "4d31e03e-697a-44c2-a03e-77eed3dbce43", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-629140279-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "68aabefe0c4340ce8408e386748fa0cf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3e7fadc1-cf", "ovs_interfaceid": "3e7fadc1-cfec-4ced-8078-8056d61d96a5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-29T17:47:38Z,direct_url=<?>,disk_format='qcow2',id=4217f428-8d9d-4ee1-9614-642d26d90c46,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='794b07cbd46a44b5865cfda741036bae',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-29T17:47:40Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'size': 0, 'device_type': 'disk', 'boot_index': 0, 'guest_format': None, 'encrypted': False, 'encryption_format': None, 'disk_bus': 'virtio', 'image_id': '4217f428-8d9d-4ee1-9614-642d26d90c46'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74613) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 29 17:57:41 user nova-compute[74613]: WARNING nova.virt.libvirt.driver [None req-ac9b8a58-0084-4cf0-ab6b-5e12ca74bafa tempest-ServersNegativeTestJSON-1631676891 tempest-ServersNegativeTestJSON-1631676891-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 17:57:41 user nova-compute[74613]: WARNING nova.virt.libvirt.driver [None req-ac9b8a58-0084-4cf0-ab6b-5e12ca74bafa tempest-ServersNegativeTestJSON-1631676891 tempest-ServersNegativeTestJSON-1631676891-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 17:57:41 user nova-compute[74613]: DEBUG nova.virt.libvirt.host [None req-ac9b8a58-0084-4cf0-ab6b-5e12ca74bafa tempest-ServersNegativeTestJSON-1631676891 tempest-ServersNegativeTestJSON-1631676891-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74613) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 29 17:57:41 user nova-compute[74613]: DEBUG nova.virt.libvirt.host [None req-ac9b8a58-0084-4cf0-ab6b-5e12ca74bafa tempest-ServersNegativeTestJSON-1631676891 tempest-ServersNegativeTestJSON-1631676891-project-member] CPU controller missing on host. {{(pid=74613) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 29 17:57:41 user nova-compute[74613]: DEBUG nova.virt.libvirt.host [None req-ac9b8a58-0084-4cf0-ab6b-5e12ca74bafa tempest-ServersNegativeTestJSON-1631676891 tempest-ServersNegativeTestJSON-1631676891-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74613) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 29 17:57:41 user nova-compute[74613]: DEBUG nova.virt.libvirt.host [None req-ac9b8a58-0084-4cf0-ab6b-5e12ca74bafa tempest-ServersNegativeTestJSON-1631676891 tempest-ServersNegativeTestJSON-1631676891-project-member] CPU controller found on host. {{(pid=74613) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 29 17:57:41 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-ac9b8a58-0084-4cf0-ab6b-5e12ca74bafa tempest-ServersNegativeTestJSON-1631676891 tempest-ServersNegativeTestJSON-1631676891-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74613) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 29 17:57:41 user nova-compute[74613]: DEBUG nova.virt.hardware [None req-ac9b8a58-0084-4cf0-ab6b-5e12ca74bafa tempest-ServersNegativeTestJSON-1631676891 tempest-ServersNegativeTestJSON-1631676891-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-29T17:47:27Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-29T17:47:38Z,direct_url=<?>,disk_format='qcow2',id=4217f428-8d9d-4ee1-9614-642d26d90c46,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='794b07cbd46a44b5865cfda741036bae',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-29T17:47:40Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74613) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 29 17:57:41 user nova-compute[74613]: DEBUG nova.virt.hardware [None req-ac9b8a58-0084-4cf0-ab6b-5e12ca74bafa tempest-ServersNegativeTestJSON-1631676891 tempest-ServersNegativeTestJSON-1631676891-project-member] Flavor limits 0:0:0 {{(pid=74613) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 29 17:57:41 user nova-compute[74613]: DEBUG nova.virt.hardware [None req-ac9b8a58-0084-4cf0-ab6b-5e12ca74bafa tempest-ServersNegativeTestJSON-1631676891 tempest-ServersNegativeTestJSON-1631676891-project-member] Image limits 0:0:0 {{(pid=74613) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 29 17:57:41 user nova-compute[74613]: DEBUG nova.virt.hardware [None req-ac9b8a58-0084-4cf0-ab6b-5e12ca74bafa tempest-ServersNegativeTestJSON-1631676891 tempest-ServersNegativeTestJSON-1631676891-project-member] Flavor pref 0:0:0 {{(pid=74613) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 29 17:57:41 user nova-compute[74613]: DEBUG nova.virt.hardware [None req-ac9b8a58-0084-4cf0-ab6b-5e12ca74bafa tempest-ServersNegativeTestJSON-1631676891 tempest-ServersNegativeTestJSON-1631676891-project-member] Image pref 0:0:0 {{(pid=74613) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 29 17:57:41 user nova-compute[74613]: DEBUG nova.virt.hardware [None req-ac9b8a58-0084-4cf0-ab6b-5e12ca74bafa tempest-ServersNegativeTestJSON-1631676891 tempest-ServersNegativeTestJSON-1631676891-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74613) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 29 17:57:41 user nova-compute[74613]: DEBUG nova.virt.hardware [None req-ac9b8a58-0084-4cf0-ab6b-5e12ca74bafa tempest-ServersNegativeTestJSON-1631676891 tempest-ServersNegativeTestJSON-1631676891-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74613) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 29 17:57:41 user nova-compute[74613]: DEBUG nova.virt.hardware [None req-ac9b8a58-0084-4cf0-ab6b-5e12ca74bafa tempest-ServersNegativeTestJSON-1631676891 tempest-ServersNegativeTestJSON-1631676891-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74613) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 29 17:57:41 user nova-compute[74613]: DEBUG nova.virt.hardware [None req-ac9b8a58-0084-4cf0-ab6b-5e12ca74bafa tempest-ServersNegativeTestJSON-1631676891 tempest-ServersNegativeTestJSON-1631676891-project-member] Got 1 possible topologies {{(pid=74613) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 29 17:57:41 user nova-compute[74613]: DEBUG nova.virt.hardware [None req-ac9b8a58-0084-4cf0-ab6b-5e12ca74bafa tempest-ServersNegativeTestJSON-1631676891 tempest-ServersNegativeTestJSON-1631676891-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74613) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 29 17:57:41 user nova-compute[74613]: DEBUG nova.virt.hardware [None req-ac9b8a58-0084-4cf0-ab6b-5e12ca74bafa tempest-ServersNegativeTestJSON-1631676891 tempest-ServersNegativeTestJSON-1631676891-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74613) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 29 17:57:41 user nova-compute[74613]: DEBUG nova.virt.libvirt.vif [None req-ac9b8a58-0084-4cf0-ab6b-5e12ca74bafa tempest-ServersNegativeTestJSON-1631676891 tempest-ServersNegativeTestJSON-1631676891-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T17:57:38Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-1802770032',display_name='tempest-ServersNegativeTestJSON-server-1802770032',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-1802770032',id=19,image_ref='4217f428-8d9d-4ee1-9614-642d26d90c46',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='68aabefe0c4340ce8408e386748fa0cf',ramdisk_id='',reservation_id='r-6tdmy1m6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='4217f428-8d9d-4ee1-9614-642d26d90c46',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-1631676891',owner_user_name='tempest-ServersNegativeTestJSON-1631676891-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T17:57:40Z,user_data=None,user_id='4b4c259dfbf244c6b48374ab04e6d694',uuid=fce4b456-c108-439f-b0ff-7619aaf77e69,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3e7fadc1-cfec-4ced-8078-8056d61d96a5", "address": "fa:16:3e:c2:a1:c4", "network": {"id": "4d31e03e-697a-44c2-a03e-77eed3dbce43", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-629140279-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "68aabefe0c4340ce8408e386748fa0cf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3e7fadc1-cf", "ovs_interfaceid": "3e7fadc1-cfec-4ced-8078-8056d61d96a5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74613) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 29 17:57:41 user nova-compute[74613]: DEBUG nova.network.os_vif_util [None req-ac9b8a58-0084-4cf0-ab6b-5e12ca74bafa tempest-ServersNegativeTestJSON-1631676891 tempest-ServersNegativeTestJSON-1631676891-project-member] Converting VIF {"id": "3e7fadc1-cfec-4ced-8078-8056d61d96a5", "address": "fa:16:3e:c2:a1:c4", "network": {"id": "4d31e03e-697a-44c2-a03e-77eed3dbce43", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-629140279-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "68aabefe0c4340ce8408e386748fa0cf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3e7fadc1-cf", "ovs_interfaceid": "3e7fadc1-cfec-4ced-8078-8056d61d96a5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74613) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 17:57:41 user nova-compute[74613]: DEBUG nova.network.os_vif_util [None req-ac9b8a58-0084-4cf0-ab6b-5e12ca74bafa tempest-ServersNegativeTestJSON-1631676891 tempest-ServersNegativeTestJSON-1631676891-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c2:a1:c4,bridge_name='br-int',has_traffic_filtering=True,id=3e7fadc1-cfec-4ced-8078-8056d61d96a5,network=Network(4d31e03e-697a-44c2-a03e-77eed3dbce43),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3e7fadc1-cf') {{(pid=74613) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 17:57:41 user nova-compute[74613]: DEBUG nova.objects.instance [None req-ac9b8a58-0084-4cf0-ab6b-5e12ca74bafa tempest-ServersNegativeTestJSON-1631676891 tempest-ServersNegativeTestJSON-1631676891-project-member] Lazy-loading 'pci_devices' on Instance uuid fce4b456-c108-439f-b0ff-7619aaf77e69 {{(pid=74613) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 17:57:41 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-ac9b8a58-0084-4cf0-ab6b-5e12ca74bafa tempest-ServersNegativeTestJSON-1631676891 tempest-ServersNegativeTestJSON-1631676891-project-member] [instance: fce4b456-c108-439f-b0ff-7619aaf77e69] End _get_guest_xml xml=<domain type="kvm">
Nov 29 17:57:41 user nova-compute[74613]:   <uuid>fce4b456-c108-439f-b0ff-7619aaf77e69</uuid>
Nov 29 17:57:41 user nova-compute[74613]:   <name>instance-00000013</name>
Nov 29 17:57:41 user nova-compute[74613]:   <memory>524288</memory>
Nov 29 17:57:41 user nova-compute[74613]:   <vcpu>1</vcpu>
Nov 29 17:57:41 user nova-compute[74613]:   <metadata>
Nov 29 17:57:41 user nova-compute[74613]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 29 17:57:41 user nova-compute[74613]:       <nova:package version="0.0.0"/>
Nov 29 17:57:41 user nova-compute[74613]:       <nova:name>tempest-ServersNegativeTestJSON-server-1802770032</nova:name>
Nov 29 17:57:41 user nova-compute[74613]:       <nova:creationTime>2023-11-29 17:57:41</nova:creationTime>
Nov 29 17:57:41 user nova-compute[74613]:       <nova:flavor name="m1.tiny">
Nov 29 17:57:41 user nova-compute[74613]:         <nova:memory>512</nova:memory>
Nov 29 17:57:41 user nova-compute[74613]:         <nova:disk>1</nova:disk>
Nov 29 17:57:41 user nova-compute[74613]:         <nova:swap>0</nova:swap>
Nov 29 17:57:41 user nova-compute[74613]:         <nova:ephemeral>0</nova:ephemeral>
Nov 29 17:57:41 user nova-compute[74613]:         <nova:vcpus>1</nova:vcpus>
Nov 29 17:57:41 user nova-compute[74613]:       </nova:flavor>
Nov 29 17:57:41 user nova-compute[74613]:       <nova:owner>
Nov 29 17:57:41 user nova-compute[74613]:         <nova:user uuid="4b4c259dfbf244c6b48374ab04e6d694">tempest-ServersNegativeTestJSON-1631676891-project-member</nova:user>
Nov 29 17:57:41 user nova-compute[74613]:         <nova:project uuid="68aabefe0c4340ce8408e386748fa0cf">tempest-ServersNegativeTestJSON-1631676891</nova:project>
Nov 29 17:57:41 user nova-compute[74613]:       </nova:owner>
Nov 29 17:57:41 user nova-compute[74613]:       <nova:root type="image" uuid="4217f428-8d9d-4ee1-9614-642d26d90c46"/>
Nov 29 17:57:41 user nova-compute[74613]:       <nova:ports>
Nov 29 17:57:41 user nova-compute[74613]:         <nova:port uuid="3e7fadc1-cfec-4ced-8078-8056d61d96a5">
Nov 29 17:57:41 user nova-compute[74613]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Nov 29 17:57:41 user nova-compute[74613]:         </nova:port>
Nov 29 17:57:41 user nova-compute[74613]:       </nova:ports>
Nov 29 17:57:41 user nova-compute[74613]:     </nova:instance>
Nov 29 17:57:41 user nova-compute[74613]:   </metadata>
Nov 29 17:57:41 user nova-compute[74613]:   <sysinfo type="smbios">
Nov 29 17:57:41 user nova-compute[74613]:     <system>
Nov 29 17:57:41 user nova-compute[74613]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 29 17:57:41 user nova-compute[74613]:       <entry name="product">OpenStack Nova</entry>
Nov 29 17:57:41 user nova-compute[74613]:       <entry name="version">0.0.0</entry>
Nov 29 17:57:41 user nova-compute[74613]:       <entry name="serial">fce4b456-c108-439f-b0ff-7619aaf77e69</entry>
Nov 29 17:57:41 user nova-compute[74613]:       <entry name="uuid">fce4b456-c108-439f-b0ff-7619aaf77e69</entry>
Nov 29 17:57:41 user nova-compute[74613]:       <entry name="family">Virtual Machine</entry>
Nov 29 17:57:41 user nova-compute[74613]:     </system>
Nov 29 17:57:41 user nova-compute[74613]:   </sysinfo>
Nov 29 17:57:41 user nova-compute[74613]:   <os>
Nov 29 17:57:41 user nova-compute[74613]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 29 17:57:41 user nova-compute[74613]:     <boot dev="hd"/>
Nov 29 17:57:41 user nova-compute[74613]:     <smbios mode="sysinfo"/>
Nov 29 17:57:41 user nova-compute[74613]:   </os>
Nov 29 17:57:41 user nova-compute[74613]:   <features>
Nov 29 17:57:41 user nova-compute[74613]:     <acpi/>
Nov 29 17:57:41 user nova-compute[74613]:     <apic/>
Nov 29 17:57:41 user nova-compute[74613]:     <vmcoreinfo/>
Nov 29 17:57:41 user nova-compute[74613]:   </features>
Nov 29 17:57:41 user nova-compute[74613]:   <clock offset="utc">
Nov 29 17:57:41 user nova-compute[74613]:     <timer name="pit" tickpolicy="delay"/>
Nov 29 17:57:41 user nova-compute[74613]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 29 17:57:41 user nova-compute[74613]:     <timer name="hpet" present="no"/>
Nov 29 17:57:41 user nova-compute[74613]:   </clock>
Nov 29 17:57:41 user nova-compute[74613]:   <cpu mode="custom" match="exact">
Nov 29 17:57:41 user nova-compute[74613]:     <model>Nehalem</model>
Nov 29 17:57:41 user nova-compute[74613]:     <topology sockets="1" cores="1" threads="1"/>
Nov 29 17:57:41 user nova-compute[74613]:   </cpu>
Nov 29 17:57:41 user nova-compute[74613]:   <devices>
Nov 29 17:57:41 user nova-compute[74613]:     <disk type="file" device="disk">
Nov 29 17:57:41 user nova-compute[74613]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 29 17:57:41 user nova-compute[74613]:       <source file="/opt/stack/data/nova/instances/fce4b456-c108-439f-b0ff-7619aaf77e69/disk"/>
Nov 29 17:57:41 user nova-compute[74613]:       <target dev="vda" bus="virtio"/>
Nov 29 17:57:41 user nova-compute[74613]:     </disk>
Nov 29 17:57:41 user nova-compute[74613]:     <interface type="ethernet">
Nov 29 17:57:41 user nova-compute[74613]:       <mac address="fa:16:3e:c2:a1:c4"/>
Nov 29 17:57:41 user nova-compute[74613]:       <model type="virtio"/>
Nov 29 17:57:41 user nova-compute[74613]:       <mtu size="1442"/>
Nov 29 17:57:41 user nova-compute[74613]:       <target dev="tap3e7fadc1-cf"/>
Nov 29 17:57:41 user nova-compute[74613]:     </interface>
Nov 29 17:57:41 user nova-compute[74613]:     <serial type="pty">
Nov 29 17:57:41 user nova-compute[74613]:       <log file="/opt/stack/data/nova/instances/fce4b456-c108-439f-b0ff-7619aaf77e69/console.log" append="off"/>
Nov 29 17:57:41 user nova-compute[74613]:     </serial>
Nov 29 17:57:41 user nova-compute[74613]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 29 17:57:41 user nova-compute[74613]:     <video>
Nov 29 17:57:41 user nova-compute[74613]:       <model type="virtio"/>
Nov 29 17:57:41 user nova-compute[74613]:     </video>
Nov 29 17:57:41 user nova-compute[74613]:     <rng model="virtio">
Nov 29 17:57:41 user nova-compute[74613]:       <backend model="random">/dev/urandom</backend>
Nov 29 17:57:41 user nova-compute[74613]:     </rng>
Nov 29 17:57:41 user nova-compute[74613]:     <controller type="usb" index="0" model="none"/>
Nov 29 17:57:41 user nova-compute[74613]:     <memballoon model="virtio">
Nov 29 17:57:41 user nova-compute[74613]:       <stats period="10"/>
Nov 29 17:57:41 user nova-compute[74613]:     </memballoon>
Nov 29 17:57:41 user nova-compute[74613]:   </devices>
Nov 29 17:57:41 user nova-compute[74613]: </domain>
Nov 29 17:57:41 user nova-compute[74613]:  {{(pid=74613) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 29 17:57:41 user nova-compute[74613]: DEBUG nova.virt.libvirt.vif [None req-ac9b8a58-0084-4cf0-ab6b-5e12ca74bafa tempest-ServersNegativeTestJSON-1631676891 tempest-ServersNegativeTestJSON-1631676891-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T17:57:38Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-1802770032',display_name='tempest-ServersNegativeTestJSON-server-1802770032',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-1802770032',id=19,image_ref='4217f428-8d9d-4ee1-9614-642d26d90c46',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='68aabefe0c4340ce8408e386748fa0cf',ramdisk_id='',reservation_id='r-6tdmy1m6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='4217f428-8d9d-4ee1-9614-642d26d90c46',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-1631676891',owner_user_name='tempest-ServersNegativeTestJSON-1631676891-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T17:57:40Z,user_data=None,user_id='4b4c259dfbf244c6b48374ab04e6d694',uuid=fce4b456-c108-439f-b0ff-7619aaf77e69,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3e7fadc1-cfec-4ced-8078-8056d61d96a5", "address": "fa:16:3e:c2:a1:c4", "network": {"id": "4d31e03e-697a-44c2-a03e-77eed3dbce43", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-629140279-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "68aabefe0c4340ce8408e386748fa0cf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3e7fadc1-cf", "ovs_interfaceid": "3e7fadc1-cfec-4ced-8078-8056d61d96a5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74613) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 29 17:57:41 user nova-compute[74613]: DEBUG nova.network.os_vif_util [None req-ac9b8a58-0084-4cf0-ab6b-5e12ca74bafa tempest-ServersNegativeTestJSON-1631676891 tempest-ServersNegativeTestJSON-1631676891-project-member] Converting VIF {"id": "3e7fadc1-cfec-4ced-8078-8056d61d96a5", "address": "fa:16:3e:c2:a1:c4", "network": {"id": "4d31e03e-697a-44c2-a03e-77eed3dbce43", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-629140279-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "68aabefe0c4340ce8408e386748fa0cf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3e7fadc1-cf", "ovs_interfaceid": "3e7fadc1-cfec-4ced-8078-8056d61d96a5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74613) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 17:57:41 user nova-compute[74613]: DEBUG nova.network.os_vif_util [None req-ac9b8a58-0084-4cf0-ab6b-5e12ca74bafa tempest-ServersNegativeTestJSON-1631676891 tempest-ServersNegativeTestJSON-1631676891-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c2:a1:c4,bridge_name='br-int',has_traffic_filtering=True,id=3e7fadc1-cfec-4ced-8078-8056d61d96a5,network=Network(4d31e03e-697a-44c2-a03e-77eed3dbce43),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3e7fadc1-cf') {{(pid=74613) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 17:57:41 user nova-compute[74613]: DEBUG os_vif [None req-ac9b8a58-0084-4cf0-ab6b-5e12ca74bafa tempest-ServersNegativeTestJSON-1631676891 tempest-ServersNegativeTestJSON-1631676891-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c2:a1:c4,bridge_name='br-int',has_traffic_filtering=True,id=3e7fadc1-cfec-4ced-8078-8056d61d96a5,network=Network(4d31e03e-697a-44c2-a03e-77eed3dbce43),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3e7fadc1-cf') {{(pid=74613) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 29 17:57:41 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:57:41 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74613) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 17:57:41 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74613) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 29 17:57:41 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:57:41 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '44cf5134-55b2-5f4e-92b1-9eefa96c15dc', '_type': 'linux-noop'}}, row=False) {{(pid=74613) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 17:57:41 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 17:57:41 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:57:41 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap3e7fadc1-cf, may_exist=True, interface_attrs={}) {{(pid=74613) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 17:57:41 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap3e7fadc1-cf, col_values=(('qos', UUID('6f95491c-8cf2-411b-a66a-ae41ed3e3e0c')),), if_exists=True) {{(pid=74613) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 17:57:41 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap3e7fadc1-cf, col_values=(('external_ids', {'iface-id': '3e7fadc1-cfec-4ced-8078-8056d61d96a5', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:c2:a1:c4', 'vm-uuid': 'fce4b456-c108-439f-b0ff-7619aaf77e69'}),), if_exists=True) {{(pid=74613) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 17:57:41 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:57:41 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 17:57:41 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:57:41 user nova-compute[74613]: INFO os_vif [None req-ac9b8a58-0084-4cf0-ab6b-5e12ca74bafa tempest-ServersNegativeTestJSON-1631676891 tempest-ServersNegativeTestJSON-1631676891-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c2:a1:c4,bridge_name='br-int',has_traffic_filtering=True,id=3e7fadc1-cfec-4ced-8078-8056d61d96a5,network=Network(4d31e03e-697a-44c2-a03e-77eed3dbce43),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3e7fadc1-cf')
Nov 29 17:57:41 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-ac9b8a58-0084-4cf0-ab6b-5e12ca74bafa tempest-ServersNegativeTestJSON-1631676891 tempest-ServersNegativeTestJSON-1631676891-project-member] No BDM found with device name vda, not building metadata. {{(pid=74613) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 17:57:41 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-ac9b8a58-0084-4cf0-ab6b-5e12ca74bafa tempest-ServersNegativeTestJSON-1631676891 tempest-ServersNegativeTestJSON-1631676891-project-member] No VIF found with MAC fa:16:3e:c2:a1:c4, not building metadata {{(pid=74613) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 29 17:57:41 user nova-compute[74613]: DEBUG nova.network.neutron [req-44e629d5-e828-4747-b4e7-c887c9ddb520 req-187511ae-f93a-4aee-8937-24160c5e5b8f service nova] [instance: fce4b456-c108-439f-b0ff-7619aaf77e69] Updated VIF entry in instance network info cache for port 3e7fadc1-cfec-4ced-8078-8056d61d96a5. {{(pid=74613) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 17:57:41 user nova-compute[74613]: DEBUG nova.network.neutron [req-44e629d5-e828-4747-b4e7-c887c9ddb520 req-187511ae-f93a-4aee-8937-24160c5e5b8f service nova] [instance: fce4b456-c108-439f-b0ff-7619aaf77e69] Updating instance_info_cache with network_info: [{"id": "3e7fadc1-cfec-4ced-8078-8056d61d96a5", "address": "fa:16:3e:c2:a1:c4", "network": {"id": "4d31e03e-697a-44c2-a03e-77eed3dbce43", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-629140279-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "68aabefe0c4340ce8408e386748fa0cf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3e7fadc1-cf", "ovs_interfaceid": "3e7fadc1-cfec-4ced-8078-8056d61d96a5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74613) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 17:57:41 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-44e629d5-e828-4747-b4e7-c887c9ddb520 req-187511ae-f93a-4aee-8937-24160c5e5b8f service nova] Releasing lock "refresh_cache-fce4b456-c108-439f-b0ff-7619aaf77e69" {{(pid=74613) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 17:57:42 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:57:42 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:57:42 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:57:42 user nova-compute[74613]: DEBUG nova.compute.manager [req-ebae0893-1f21-43e9-b6ce-ca4c35bd59fb req-aa4d5ac4-0a57-42f8-8125-58233fa6c073 service nova] [instance: fce4b456-c108-439f-b0ff-7619aaf77e69] Received event network-vif-plugged-3e7fadc1-cfec-4ced-8078-8056d61d96a5 {{(pid=74613) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 17:57:42 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-ebae0893-1f21-43e9-b6ce-ca4c35bd59fb req-aa4d5ac4-0a57-42f8-8125-58233fa6c073 service nova] Acquiring lock "fce4b456-c108-439f-b0ff-7619aaf77e69-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 17:57:42 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-ebae0893-1f21-43e9-b6ce-ca4c35bd59fb req-aa4d5ac4-0a57-42f8-8125-58233fa6c073 service nova] Lock "fce4b456-c108-439f-b0ff-7619aaf77e69-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 17:57:43 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-ebae0893-1f21-43e9-b6ce-ca4c35bd59fb req-aa4d5ac4-0a57-42f8-8125-58233fa6c073 service nova] Lock "fce4b456-c108-439f-b0ff-7619aaf77e69-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 17:57:43 user nova-compute[74613]: DEBUG nova.compute.manager [req-ebae0893-1f21-43e9-b6ce-ca4c35bd59fb req-aa4d5ac4-0a57-42f8-8125-58233fa6c073 service nova] [instance: fce4b456-c108-439f-b0ff-7619aaf77e69] No waiting events found dispatching network-vif-plugged-3e7fadc1-cfec-4ced-8078-8056d61d96a5 {{(pid=74613) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 17:57:43 user nova-compute[74613]: WARNING nova.compute.manager [req-ebae0893-1f21-43e9-b6ce-ca4c35bd59fb req-aa4d5ac4-0a57-42f8-8125-58233fa6c073 service nova] [instance: fce4b456-c108-439f-b0ff-7619aaf77e69] Received unexpected event network-vif-plugged-3e7fadc1-cfec-4ced-8078-8056d61d96a5 for instance with vm_state building and task_state spawning.
Nov 29 17:57:43 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:57:43 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:57:45 user nova-compute[74613]: DEBUG nova.compute.manager [req-5b4bde9e-969e-4f9c-a9ee-0415bbda2406 req-05dce651-a4a5-45bf-beb9-694b65f4a05f service nova] [instance: fce4b456-c108-439f-b0ff-7619aaf77e69] Received event network-vif-plugged-3e7fadc1-cfec-4ced-8078-8056d61d96a5 {{(pid=74613) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 17:57:45 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-5b4bde9e-969e-4f9c-a9ee-0415bbda2406 req-05dce651-a4a5-45bf-beb9-694b65f4a05f service nova] Acquiring lock "fce4b456-c108-439f-b0ff-7619aaf77e69-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 17:57:45 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-5b4bde9e-969e-4f9c-a9ee-0415bbda2406 req-05dce651-a4a5-45bf-beb9-694b65f4a05f service nova] Lock "fce4b456-c108-439f-b0ff-7619aaf77e69-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 17:57:45 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-5b4bde9e-969e-4f9c-a9ee-0415bbda2406 req-05dce651-a4a5-45bf-beb9-694b65f4a05f service nova] Lock "fce4b456-c108-439f-b0ff-7619aaf77e69-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 17:57:45 user nova-compute[74613]: DEBUG nova.compute.manager [req-5b4bde9e-969e-4f9c-a9ee-0415bbda2406 req-05dce651-a4a5-45bf-beb9-694b65f4a05f service nova] [instance: fce4b456-c108-439f-b0ff-7619aaf77e69] No waiting events found dispatching network-vif-plugged-3e7fadc1-cfec-4ced-8078-8056d61d96a5 {{(pid=74613) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 17:57:45 user nova-compute[74613]: WARNING nova.compute.manager [req-5b4bde9e-969e-4f9c-a9ee-0415bbda2406 req-05dce651-a4a5-45bf-beb9-694b65f4a05f service nova] [instance: fce4b456-c108-439f-b0ff-7619aaf77e69] Received unexpected event network-vif-plugged-3e7fadc1-cfec-4ced-8078-8056d61d96a5 for instance with vm_state building and task_state spawning.
Nov 29 17:57:45 user nova-compute[74613]: DEBUG nova.compute.manager [None req-ac9b8a58-0084-4cf0-ab6b-5e12ca74bafa tempest-ServersNegativeTestJSON-1631676891 tempest-ServersNegativeTestJSON-1631676891-project-member] [instance: fce4b456-c108-439f-b0ff-7619aaf77e69] Instance event wait completed in 0 seconds for  {{(pid=74613) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 29 17:57:45 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-ac9b8a58-0084-4cf0-ab6b-5e12ca74bafa tempest-ServersNegativeTestJSON-1631676891 tempest-ServersNegativeTestJSON-1631676891-project-member] [instance: fce4b456-c108-439f-b0ff-7619aaf77e69] Guest created on hypervisor {{(pid=74613) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 29 17:57:45 user nova-compute[74613]: INFO nova.virt.libvirt.driver [-] [instance: fce4b456-c108-439f-b0ff-7619aaf77e69] Instance spawned successfully.
Nov 29 17:57:45 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-ac9b8a58-0084-4cf0-ab6b-5e12ca74bafa tempest-ServersNegativeTestJSON-1631676891 tempest-ServersNegativeTestJSON-1631676891-project-member] [instance: fce4b456-c108-439f-b0ff-7619aaf77e69] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74613) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 29 17:57:45 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-ac9b8a58-0084-4cf0-ab6b-5e12ca74bafa tempest-ServersNegativeTestJSON-1631676891 tempest-ServersNegativeTestJSON-1631676891-project-member] [instance: fce4b456-c108-439f-b0ff-7619aaf77e69] Found default for hw_cdrom_bus of ide {{(pid=74613) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 17:57:45 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-ac9b8a58-0084-4cf0-ab6b-5e12ca74bafa tempest-ServersNegativeTestJSON-1631676891 tempest-ServersNegativeTestJSON-1631676891-project-member] [instance: fce4b456-c108-439f-b0ff-7619aaf77e69] Found default for hw_disk_bus of virtio {{(pid=74613) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 17:57:45 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-ac9b8a58-0084-4cf0-ab6b-5e12ca74bafa tempest-ServersNegativeTestJSON-1631676891 tempest-ServersNegativeTestJSON-1631676891-project-member] [instance: fce4b456-c108-439f-b0ff-7619aaf77e69] Found default for hw_input_bus of None {{(pid=74613) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 17:57:45 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-ac9b8a58-0084-4cf0-ab6b-5e12ca74bafa tempest-ServersNegativeTestJSON-1631676891 tempest-ServersNegativeTestJSON-1631676891-project-member] [instance: fce4b456-c108-439f-b0ff-7619aaf77e69] Found default for hw_pointer_model of None {{(pid=74613) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 17:57:45 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-ac9b8a58-0084-4cf0-ab6b-5e12ca74bafa tempest-ServersNegativeTestJSON-1631676891 tempest-ServersNegativeTestJSON-1631676891-project-member] [instance: fce4b456-c108-439f-b0ff-7619aaf77e69] Found default for hw_video_model of virtio {{(pid=74613) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 17:57:45 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-ac9b8a58-0084-4cf0-ab6b-5e12ca74bafa tempest-ServersNegativeTestJSON-1631676891 tempest-ServersNegativeTestJSON-1631676891-project-member] [instance: fce4b456-c108-439f-b0ff-7619aaf77e69] Found default for hw_vif_model of virtio {{(pid=74613) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 17:57:45 user nova-compute[74613]: INFO nova.compute.manager [None req-ac9b8a58-0084-4cf0-ab6b-5e12ca74bafa tempest-ServersNegativeTestJSON-1631676891 tempest-ServersNegativeTestJSON-1631676891-project-member] [instance: fce4b456-c108-439f-b0ff-7619aaf77e69] Took 5.46 seconds to spawn the instance on the hypervisor.
Nov 29 17:57:45 user nova-compute[74613]: DEBUG nova.compute.manager [None req-ac9b8a58-0084-4cf0-ab6b-5e12ca74bafa tempest-ServersNegativeTestJSON-1631676891 tempest-ServersNegativeTestJSON-1631676891-project-member] [instance: fce4b456-c108-439f-b0ff-7619aaf77e69] Checking state {{(pid=74613) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 29 17:57:45 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:57:45 user nova-compute[74613]: INFO nova.compute.manager [None req-ac9b8a58-0084-4cf0-ab6b-5e12ca74bafa tempest-ServersNegativeTestJSON-1631676891 tempest-ServersNegativeTestJSON-1631676891-project-member] [instance: fce4b456-c108-439f-b0ff-7619aaf77e69] Took 6.32 seconds to build instance.
Nov 29 17:57:45 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-ac9b8a58-0084-4cf0-ab6b-5e12ca74bafa tempest-ServersNegativeTestJSON-1631676891 tempest-ServersNegativeTestJSON-1631676891-project-member] Lock "fce4b456-c108-439f-b0ff-7619aaf77e69" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.427s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 17:57:46 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:57:50 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:57:51 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:57:51 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-4e53d14d-1c6b-444e-a256-5cc917678186 tempest-ServerStableDeviceRescueTest-1416322546 tempest-ServerStableDeviceRescueTest-1416322546-project-member] Acquiring lock "b6b0ba36-ad89-45f1-9578-8b999567dd25" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 17:57:51 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-4e53d14d-1c6b-444e-a256-5cc917678186 tempest-ServerStableDeviceRescueTest-1416322546 tempest-ServerStableDeviceRescueTest-1416322546-project-member] Lock "b6b0ba36-ad89-45f1-9578-8b999567dd25" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 17:57:51 user nova-compute[74613]: INFO nova.compute.manager [None req-4e53d14d-1c6b-444e-a256-5cc917678186 tempest-ServerStableDeviceRescueTest-1416322546 tempest-ServerStableDeviceRescueTest-1416322546-project-member] [instance: b6b0ba36-ad89-45f1-9578-8b999567dd25] Detaching volume 070b1031-e105-4cba-a039-2286e23727c5
Nov 29 17:57:51 user nova-compute[74613]: INFO nova.virt.block_device [None req-4e53d14d-1c6b-444e-a256-5cc917678186 tempest-ServerStableDeviceRescueTest-1416322546 tempest-ServerStableDeviceRescueTest-1416322546-project-member] [instance: b6b0ba36-ad89-45f1-9578-8b999567dd25] Attempting to driver detach volume 070b1031-e105-4cba-a039-2286e23727c5 from mountpoint /dev/vdb
Nov 29 17:57:51 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-4e53d14d-1c6b-444e-a256-5cc917678186 tempest-ServerStableDeviceRescueTest-1416322546 tempest-ServerStableDeviceRescueTest-1416322546-project-member] Attempting to detach device vdb from instance b6b0ba36-ad89-45f1-9578-8b999567dd25 from the persistent domain config. {{(pid=74613) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 29 17:57:51 user nova-compute[74613]: DEBUG nova.virt.libvirt.guest [None req-4e53d14d-1c6b-444e-a256-5cc917678186 tempest-ServerStableDeviceRescueTest-1416322546 tempest-ServerStableDeviceRescueTest-1416322546-project-member] detach device xml: <disk type="block" device="disk">
Nov 29 17:57:51 user nova-compute[74613]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 17:57:51 user nova-compute[74613]:   <source dev="/dev/sdc"/>
Nov 29 17:57:51 user nova-compute[74613]:   <target dev="vdb" bus="virtio"/>
Nov 29 17:57:51 user nova-compute[74613]:   <serial>070b1031-e105-4cba-a039-2286e23727c5</serial>
Nov 29 17:57:51 user nova-compute[74613]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 29 17:57:51 user nova-compute[74613]: </disk>
Nov 29 17:57:51 user nova-compute[74613]:  {{(pid=74613) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 29 17:57:51 user nova-compute[74613]: INFO nova.virt.libvirt.driver [None req-4e53d14d-1c6b-444e-a256-5cc917678186 tempest-ServerStableDeviceRescueTest-1416322546 tempest-ServerStableDeviceRescueTest-1416322546-project-member] Successfully detached device vdb from instance b6b0ba36-ad89-45f1-9578-8b999567dd25 from the persistent domain config.
Nov 29 17:57:51 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-4e53d14d-1c6b-444e-a256-5cc917678186 tempest-ServerStableDeviceRescueTest-1416322546 tempest-ServerStableDeviceRescueTest-1416322546-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance b6b0ba36-ad89-45f1-9578-8b999567dd25 from the live domain config. {{(pid=74613) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 29 17:57:51 user nova-compute[74613]: DEBUG nova.virt.libvirt.guest [None req-4e53d14d-1c6b-444e-a256-5cc917678186 tempest-ServerStableDeviceRescueTest-1416322546 tempest-ServerStableDeviceRescueTest-1416322546-project-member] detach device xml: <disk type="block" device="disk">
Nov 29 17:57:51 user nova-compute[74613]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 17:57:51 user nova-compute[74613]:   <source dev="/dev/sdc"/>
Nov 29 17:57:51 user nova-compute[74613]:   <target dev="vdb" bus="virtio"/>
Nov 29 17:57:51 user nova-compute[74613]:   <serial>070b1031-e105-4cba-a039-2286e23727c5</serial>
Nov 29 17:57:51 user nova-compute[74613]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 29 17:57:51 user nova-compute[74613]: </disk>
Nov 29 17:57:51 user nova-compute[74613]:  {{(pid=74613) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 29 17:57:52 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-4e53d14d-1c6b-444e-a256-5cc917678186 tempest-ServerStableDeviceRescueTest-1416322546 tempest-ServerStableDeviceRescueTest-1416322546-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance b6b0ba36-ad89-45f1-9578-8b999567dd25 {{(pid=74613) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 29 17:57:55 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:57:55 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-d28734ad-96d9-4002-9f43-d0b811290e85 tempest-AttachVolumeShelveTestJSON-1452861425 tempest-AttachVolumeShelveTestJSON-1452861425-project-member] Acquiring lock "c19e230e-2e6c-4c20-b15c-ad81a73674b4" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 17:57:55 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-d28734ad-96d9-4002-9f43-d0b811290e85 tempest-AttachVolumeShelveTestJSON-1452861425 tempest-AttachVolumeShelveTestJSON-1452861425-project-member] Lock "c19e230e-2e6c-4c20-b15c-ad81a73674b4" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 17:57:55 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-d28734ad-96d9-4002-9f43-d0b811290e85 tempest-AttachVolumeShelveTestJSON-1452861425 tempest-AttachVolumeShelveTestJSON-1452861425-project-member] Acquiring lock "c19e230e-2e6c-4c20-b15c-ad81a73674b4-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 17:57:55 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-d28734ad-96d9-4002-9f43-d0b811290e85 tempest-AttachVolumeShelveTestJSON-1452861425 tempest-AttachVolumeShelveTestJSON-1452861425-project-member] Lock "c19e230e-2e6c-4c20-b15c-ad81a73674b4-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.005s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 17:57:55 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-d28734ad-96d9-4002-9f43-d0b811290e85 tempest-AttachVolumeShelveTestJSON-1452861425 tempest-AttachVolumeShelveTestJSON-1452861425-project-member] Lock "c19e230e-2e6c-4c20-b15c-ad81a73674b4-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 17:57:55 user nova-compute[74613]: INFO nova.compute.manager [None req-d28734ad-96d9-4002-9f43-d0b811290e85 tempest-AttachVolumeShelveTestJSON-1452861425 tempest-AttachVolumeShelveTestJSON-1452861425-project-member] [instance: c19e230e-2e6c-4c20-b15c-ad81a73674b4] Terminating instance
Nov 29 17:57:55 user nova-compute[74613]: DEBUG nova.compute.manager [None req-d28734ad-96d9-4002-9f43-d0b811290e85 tempest-AttachVolumeShelveTestJSON-1452861425 tempest-AttachVolumeShelveTestJSON-1452861425-project-member] [instance: c19e230e-2e6c-4c20-b15c-ad81a73674b4] Start destroying the instance on the hypervisor. {{(pid=74613) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 29 17:57:55 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:57:55 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:57:55 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:57:55 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:57:55 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:57:55 user nova-compute[74613]: DEBUG nova.compute.manager [req-496cf26f-9283-4393-a224-af38a73d5d05 req-290be64f-0738-4fba-8d71-c961a10f9e71 service nova] [instance: c19e230e-2e6c-4c20-b15c-ad81a73674b4] Received event network-vif-unplugged-a414bce0-6293-4987-9441-46943fe2e877 {{(pid=74613) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 17:57:55 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-496cf26f-9283-4393-a224-af38a73d5d05 req-290be64f-0738-4fba-8d71-c961a10f9e71 service nova] Acquiring lock "c19e230e-2e6c-4c20-b15c-ad81a73674b4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 17:57:55 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-496cf26f-9283-4393-a224-af38a73d5d05 req-290be64f-0738-4fba-8d71-c961a10f9e71 service nova] Lock "c19e230e-2e6c-4c20-b15c-ad81a73674b4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 17:57:55 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-496cf26f-9283-4393-a224-af38a73d5d05 req-290be64f-0738-4fba-8d71-c961a10f9e71 service nova] Lock "c19e230e-2e6c-4c20-b15c-ad81a73674b4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 17:57:55 user nova-compute[74613]: DEBUG nova.compute.manager [req-496cf26f-9283-4393-a224-af38a73d5d05 req-290be64f-0738-4fba-8d71-c961a10f9e71 service nova] [instance: c19e230e-2e6c-4c20-b15c-ad81a73674b4] No waiting events found dispatching network-vif-unplugged-a414bce0-6293-4987-9441-46943fe2e877 {{(pid=74613) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 17:57:55 user nova-compute[74613]: DEBUG nova.compute.manager [req-496cf26f-9283-4393-a224-af38a73d5d05 req-290be64f-0738-4fba-8d71-c961a10f9e71 service nova] [instance: c19e230e-2e6c-4c20-b15c-ad81a73674b4] Received event network-vif-unplugged-a414bce0-6293-4987-9441-46943fe2e877 for instance with task_state deleting. {{(pid=74613) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 29 17:57:56 user nova-compute[74613]: INFO nova.virt.libvirt.driver [-] [instance: c19e230e-2e6c-4c20-b15c-ad81a73674b4] Instance destroyed successfully.
Nov 29 17:57:56 user nova-compute[74613]: DEBUG nova.objects.instance [None req-d28734ad-96d9-4002-9f43-d0b811290e85 tempest-AttachVolumeShelveTestJSON-1452861425 tempest-AttachVolumeShelveTestJSON-1452861425-project-member] Lazy-loading 'resources' on Instance uuid c19e230e-2e6c-4c20-b15c-ad81a73674b4 {{(pid=74613) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 17:57:56 user nova-compute[74613]: DEBUG nova.virt.libvirt.vif [None req-d28734ad-96d9-4002-9f43-d0b811290e85 tempest-AttachVolumeShelveTestJSON-1452861425 tempest-AttachVolumeShelveTestJSON-1452861425-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-29T17:51:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-705281655',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-705281655',id=3,image_ref='4217f428-8d9d-4ee1-9614-642d26d90c46',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLofinuzL4KIe2/FJI/rOzpr08YCyh/7umJCTHDfb/8b61GmXnBJ32Swg1dTDe95ImRcaYamLXrnnmDILi1vgJuezNA9fzD/sJhWrgADbQSCHdOnl0SlzP290n0Y8JsPZA==',key_name='tempest-keypair-248065239',keypairs=<?>,launch_index=0,launched_at=2023-11-29T17:55:42Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='1c0c1c71400549369c1b11ca7d5f43ec',ramdisk_id='',reservation_id='r-ab112qsi',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='4217f428-8d9d-4ee1-9614-642d26d90c46',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1452861425',owner_user_name='tempest-AttachVolumeShelveTestJSON-1452861425-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-29T17:55:43Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='45192488dde84ebfbcacfdbd4f898799',uuid=c19e230e-2e6c-4c20-b15c-ad81a73674b4,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "a414bce0-6293-4987-9441-46943fe2e877", "address": "fa:16:3e:8e:94:32", "network": {"id": "4a101f3e-d23e-4198-bc3c-b4f9b4d2b4c4", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-864151424-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.168", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1c0c1c71400549369c1b11ca7d5f43ec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa414bce0-62", "ovs_interfaceid": "a414bce0-6293-4987-9441-46943fe2e877", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74613) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 29 17:57:56 user nova-compute[74613]: DEBUG nova.network.os_vif_util [None req-d28734ad-96d9-4002-9f43-d0b811290e85 tempest-AttachVolumeShelveTestJSON-1452861425 tempest-AttachVolumeShelveTestJSON-1452861425-project-member] Converting VIF {"id": "a414bce0-6293-4987-9441-46943fe2e877", "address": "fa:16:3e:8e:94:32", "network": {"id": "4a101f3e-d23e-4198-bc3c-b4f9b4d2b4c4", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-864151424-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.168", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1c0c1c71400549369c1b11ca7d5f43ec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa414bce0-62", "ovs_interfaceid": "a414bce0-6293-4987-9441-46943fe2e877", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74613) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 17:57:56 user nova-compute[74613]: DEBUG nova.network.os_vif_util [None req-d28734ad-96d9-4002-9f43-d0b811290e85 tempest-AttachVolumeShelveTestJSON-1452861425 tempest-AttachVolumeShelveTestJSON-1452861425-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8e:94:32,bridge_name='br-int',has_traffic_filtering=True,id=a414bce0-6293-4987-9441-46943fe2e877,network=Network(4a101f3e-d23e-4198-bc3c-b4f9b4d2b4c4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa414bce0-62') {{(pid=74613) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 17:57:56 user nova-compute[74613]: DEBUG os_vif [None req-d28734ad-96d9-4002-9f43-d0b811290e85 tempest-AttachVolumeShelveTestJSON-1452861425 tempest-AttachVolumeShelveTestJSON-1452861425-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:8e:94:32,bridge_name='br-int',has_traffic_filtering=True,id=a414bce0-6293-4987-9441-46943fe2e877,network=Network(4a101f3e-d23e-4198-bc3c-b4f9b4d2b4c4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa414bce0-62') {{(pid=74613) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 29 17:57:56 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:57:56 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapa414bce0-62, bridge=br-int, if_exists=True) {{(pid=74613) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 17:57:56 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:57:56 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:57:56 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:57:56 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=454d5dbf-4e83-4618-9f40-f1f2f9cb6628) {{(pid=74613) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 17:57:56 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:57:56 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 17:57:56 user nova-compute[74613]: INFO os_vif [None req-d28734ad-96d9-4002-9f43-d0b811290e85 tempest-AttachVolumeShelveTestJSON-1452861425 tempest-AttachVolumeShelveTestJSON-1452861425-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:8e:94:32,bridge_name='br-int',has_traffic_filtering=True,id=a414bce0-6293-4987-9441-46943fe2e877,network=Network(4a101f3e-d23e-4198-bc3c-b4f9b4d2b4c4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa414bce0-62')
Nov 29 17:57:56 user nova-compute[74613]: INFO nova.virt.libvirt.driver [None req-d28734ad-96d9-4002-9f43-d0b811290e85 tempest-AttachVolumeShelveTestJSON-1452861425 tempest-AttachVolumeShelveTestJSON-1452861425-project-member] [instance: c19e230e-2e6c-4c20-b15c-ad81a73674b4] Deleting instance files /opt/stack/data/nova/instances/c19e230e-2e6c-4c20-b15c-ad81a73674b4_del
Nov 29 17:57:56 user nova-compute[74613]: INFO nova.virt.libvirt.driver [None req-d28734ad-96d9-4002-9f43-d0b811290e85 tempest-AttachVolumeShelveTestJSON-1452861425 tempest-AttachVolumeShelveTestJSON-1452861425-project-member] [instance: c19e230e-2e6c-4c20-b15c-ad81a73674b4] Deletion of /opt/stack/data/nova/instances/c19e230e-2e6c-4c20-b15c-ad81a73674b4_del complete
Nov 29 17:57:56 user nova-compute[74613]: INFO nova.compute.manager [None req-d28734ad-96d9-4002-9f43-d0b811290e85 tempest-AttachVolumeShelveTestJSON-1452861425 tempest-AttachVolumeShelveTestJSON-1452861425-project-member] [instance: c19e230e-2e6c-4c20-b15c-ad81a73674b4] Took 0.87 seconds to destroy the instance on the hypervisor.
Nov 29 17:57:56 user nova-compute[74613]: DEBUG oslo.service.loopingcall [None req-d28734ad-96d9-4002-9f43-d0b811290e85 tempest-AttachVolumeShelveTestJSON-1452861425 tempest-AttachVolumeShelveTestJSON-1452861425-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74613) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 29 17:57:56 user nova-compute[74613]: DEBUG nova.compute.manager [-] [instance: c19e230e-2e6c-4c20-b15c-ad81a73674b4] Deallocating network for instance {{(pid=74613) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 29 17:57:56 user nova-compute[74613]: DEBUG nova.network.neutron [-] [instance: c19e230e-2e6c-4c20-b15c-ad81a73674b4] deallocate_for_instance() {{(pid=74613) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 29 17:57:57 user nova-compute[74613]: DEBUG nova.network.neutron [-] [instance: c19e230e-2e6c-4c20-b15c-ad81a73674b4] Updating instance_info_cache with network_info: [] {{(pid=74613) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 17:57:57 user nova-compute[74613]: INFO nova.compute.manager [-] [instance: c19e230e-2e6c-4c20-b15c-ad81a73674b4] Took 0.99 seconds to deallocate network for instance.
Nov 29 17:57:57 user nova-compute[74613]: DEBUG nova.compute.manager [req-93e1047a-8898-4fd2-87d2-4100d2138ec1 req-36776582-f94d-4371-9a46-f0b976ec7327 service nova] [instance: c19e230e-2e6c-4c20-b15c-ad81a73674b4] Received event network-vif-deleted-a414bce0-6293-4987-9441-46943fe2e877 {{(pid=74613) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 17:57:57 user nova-compute[74613]: INFO nova.compute.manager [req-93e1047a-8898-4fd2-87d2-4100d2138ec1 req-36776582-f94d-4371-9a46-f0b976ec7327 service nova] [instance: c19e230e-2e6c-4c20-b15c-ad81a73674b4] Neutron deleted interface a414bce0-6293-4987-9441-46943fe2e877; detaching it from the instance and deleting it from the info cache
Nov 29 17:57:57 user nova-compute[74613]: DEBUG nova.network.neutron [req-93e1047a-8898-4fd2-87d2-4100d2138ec1 req-36776582-f94d-4371-9a46-f0b976ec7327 service nova] [instance: c19e230e-2e6c-4c20-b15c-ad81a73674b4] Updating instance_info_cache with network_info: [] {{(pid=74613) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 17:57:57 user nova-compute[74613]: DEBUG nova.compute.manager [req-93e1047a-8898-4fd2-87d2-4100d2138ec1 req-36776582-f94d-4371-9a46-f0b976ec7327 service nova] [instance: c19e230e-2e6c-4c20-b15c-ad81a73674b4] Detach interface failed, port_id=a414bce0-6293-4987-9441-46943fe2e877, reason: Instance c19e230e-2e6c-4c20-b15c-ad81a73674b4 could not be found. {{(pid=74613) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 29 17:57:57 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-d28734ad-96d9-4002-9f43-d0b811290e85 tempest-AttachVolumeShelveTestJSON-1452861425 tempest-AttachVolumeShelveTestJSON-1452861425-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 17:57:57 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-d28734ad-96d9-4002-9f43-d0b811290e85 tempest-AttachVolumeShelveTestJSON-1452861425 tempest-AttachVolumeShelveTestJSON-1452861425-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 17:57:57 user nova-compute[74613]: DEBUG oslo_service.periodic_task [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Running periodic task ComputeManager._sync_power_states {{(pid=74613) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 17:57:57 user nova-compute[74613]: WARNING nova.compute.manager [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] While synchronizing instance power states, found 12 instances in the database and 11 instances on the hypervisor.
Nov 29 17:57:57 user nova-compute[74613]: DEBUG nova.compute.manager [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Triggering sync for uuid b6b0ba36-ad89-45f1-9578-8b999567dd25 {{(pid=74613) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 29 17:57:57 user nova-compute[74613]: DEBUG nova.compute.manager [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Triggering sync for uuid 3b828860-5cc5-40b0-b845-8e560211794e {{(pid=74613) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 29 17:57:57 user nova-compute[74613]: DEBUG nova.compute.manager [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Triggering sync for uuid c19e230e-2e6c-4c20-b15c-ad81a73674b4 {{(pid=74613) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 29 17:57:57 user nova-compute[74613]: DEBUG nova.compute.manager [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Triggering sync for uuid abc9e2b8-f467-4cd0-b40f-de511fde1ec1 {{(pid=74613) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 29 17:57:57 user nova-compute[74613]: DEBUG nova.compute.manager [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Triggering sync for uuid cd22685a-028c-4e0c-834d-e7b20f6d06ab {{(pid=74613) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 29 17:57:57 user nova-compute[74613]: DEBUG nova.compute.manager [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Triggering sync for uuid 71f2a1ab-3df7-411c-93fa-b0a1a5a44f0a {{(pid=74613) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 29 17:57:57 user nova-compute[74613]: DEBUG nova.compute.manager [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Triggering sync for uuid 74ac9703-1cd7-4983-b7d4-c69b01fec7b2 {{(pid=74613) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 29 17:57:57 user nova-compute[74613]: DEBUG nova.compute.manager [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Triggering sync for uuid c4bdb712-e1f9-4fc0-b527-87088d7eddf8 {{(pid=74613) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 29 17:57:57 user nova-compute[74613]: DEBUG nova.compute.manager [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Triggering sync for uuid 0aa463c6-01e7-48e5-b082-e083558342e3 {{(pid=74613) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 29 17:57:57 user nova-compute[74613]: DEBUG nova.compute.manager [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Triggering sync for uuid fae10c60-f989-4c99-bde4-60cd9f3e2055 {{(pid=74613) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 29 17:57:57 user nova-compute[74613]: DEBUG nova.compute.manager [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Triggering sync for uuid 356478b0-e233-46aa-a1bd-45ce1f9eca8f {{(pid=74613) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 29 17:57:57 user nova-compute[74613]: DEBUG nova.compute.manager [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Triggering sync for uuid fce4b456-c108-439f-b0ff-7619aaf77e69 {{(pid=74613) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 29 17:57:57 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Acquiring lock "b6b0ba36-ad89-45f1-9578-8b999567dd25" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 17:57:57 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Acquiring lock "3b828860-5cc5-40b0-b845-8e560211794e" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 17:57:57 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Lock "3b828860-5cc5-40b0-b845-8e560211794e" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 17:57:57 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Acquiring lock "c19e230e-2e6c-4c20-b15c-ad81a73674b4" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 17:57:57 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Acquiring lock "abc9e2b8-f467-4cd0-b40f-de511fde1ec1" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 17:57:57 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Lock "abc9e2b8-f467-4cd0-b40f-de511fde1ec1" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.005s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 17:57:57 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Acquiring lock "cd22685a-028c-4e0c-834d-e7b20f6d06ab" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 17:57:57 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Lock "cd22685a-028c-4e0c-834d-e7b20f6d06ab" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 17:57:57 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Acquiring lock "71f2a1ab-3df7-411c-93fa-b0a1a5a44f0a" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 17:57:57 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Lock "71f2a1ab-3df7-411c-93fa-b0a1a5a44f0a" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 17:57:57 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Acquiring lock "74ac9703-1cd7-4983-b7d4-c69b01fec7b2" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 17:57:57 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Lock "74ac9703-1cd7-4983-b7d4-c69b01fec7b2" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 17:57:57 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Acquiring lock "c4bdb712-e1f9-4fc0-b527-87088d7eddf8" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 17:57:57 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Lock "c4bdb712-e1f9-4fc0-b527-87088d7eddf8" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 17:57:57 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Acquiring lock "0aa463c6-01e7-48e5-b082-e083558342e3" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 17:57:57 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Lock "0aa463c6-01e7-48e5-b082-e083558342e3" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 17:57:57 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Acquiring lock "fae10c60-f989-4c99-bde4-60cd9f3e2055" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 17:57:57 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Lock "fae10c60-f989-4c99-bde4-60cd9f3e2055" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 17:57:57 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Acquiring lock "356478b0-e233-46aa-a1bd-45ce1f9eca8f" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 17:57:57 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Lock "356478b0-e233-46aa-a1bd-45ce1f9eca8f" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 17:57:57 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Acquiring lock "fce4b456-c108-439f-b0ff-7619aaf77e69" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 17:57:57 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Lock "fce4b456-c108-439f-b0ff-7619aaf77e69" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 17:57:57 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Lock "abc9e2b8-f467-4cd0-b40f-de511fde1ec1" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.089s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 17:57:57 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Lock "cd22685a-028c-4e0c-834d-e7b20f6d06ab" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.091s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 17:57:57 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Lock "3b828860-5cc5-40b0-b845-8e560211794e" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.105s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 17:57:57 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Lock "fae10c60-f989-4c99-bde4-60cd9f3e2055" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.098s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 17:57:57 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Lock "74ac9703-1cd7-4983-b7d4-c69b01fec7b2" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.106s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 17:57:57 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Lock "c4bdb712-e1f9-4fc0-b527-87088d7eddf8" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.107s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 17:57:57 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Lock "71f2a1ab-3df7-411c-93fa-b0a1a5a44f0a" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.110s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 17:57:57 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Lock "356478b0-e233-46aa-a1bd-45ce1f9eca8f" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.107s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 17:57:57 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Lock "0aa463c6-01e7-48e5-b082-e083558342e3" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.119s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 17:57:57 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Lock "fce4b456-c108-439f-b0ff-7619aaf77e69" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.120s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 17:57:57 user nova-compute[74613]: DEBUG nova.compute.manager [req-fea66499-cc25-4ea2-8676-61c094608d2d req-b44568fe-1ff4-4184-a832-30cfc3e20900 service nova] [instance: c19e230e-2e6c-4c20-b15c-ad81a73674b4] Received event network-vif-plugged-a414bce0-6293-4987-9441-46943fe2e877 {{(pid=74613) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 17:57:57 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-fea66499-cc25-4ea2-8676-61c094608d2d req-b44568fe-1ff4-4184-a832-30cfc3e20900 service nova] Acquiring lock "c19e230e-2e6c-4c20-b15c-ad81a73674b4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 17:57:57 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-fea66499-cc25-4ea2-8676-61c094608d2d req-b44568fe-1ff4-4184-a832-30cfc3e20900 service nova] Lock "c19e230e-2e6c-4c20-b15c-ad81a73674b4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 17:57:57 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-fea66499-cc25-4ea2-8676-61c094608d2d req-b44568fe-1ff4-4184-a832-30cfc3e20900 service nova] Lock "c19e230e-2e6c-4c20-b15c-ad81a73674b4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 17:57:57 user nova-compute[74613]: DEBUG nova.compute.manager [req-fea66499-cc25-4ea2-8676-61c094608d2d req-b44568fe-1ff4-4184-a832-30cfc3e20900 service nova] [instance: c19e230e-2e6c-4c20-b15c-ad81a73674b4] No waiting events found dispatching network-vif-plugged-a414bce0-6293-4987-9441-46943fe2e877 {{(pid=74613) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 17:57:57 user nova-compute[74613]: WARNING nova.compute.manager [req-fea66499-cc25-4ea2-8676-61c094608d2d req-b44568fe-1ff4-4184-a832-30cfc3e20900 service nova] [instance: c19e230e-2e6c-4c20-b15c-ad81a73674b4] Received unexpected event network-vif-plugged-a414bce0-6293-4987-9441-46943fe2e877 for instance with vm_state deleted and task_state None.
Nov 29 17:57:57 user nova-compute[74613]: DEBUG nova.compute.provider_tree [None req-d28734ad-96d9-4002-9f43-d0b811290e85 tempest-AttachVolumeShelveTestJSON-1452861425 tempest-AttachVolumeShelveTestJSON-1452861425-project-member] Inventory has not changed in ProviderTree for provider: 639d980e-3b12-44b1-b8f4-1812416fa4dd {{(pid=74613) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 17:57:58 user nova-compute[74613]: DEBUG nova.scheduler.client.report [None req-d28734ad-96d9-4002-9f43-d0b811290e85 tempest-AttachVolumeShelveTestJSON-1452861425 tempest-AttachVolumeShelveTestJSON-1452861425-project-member] Inventory has not changed for provider 639d980e-3b12-44b1-b8f4-1812416fa4dd based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74613) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 17:57:58 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-d28734ad-96d9-4002-9f43-d0b811290e85 tempest-AttachVolumeShelveTestJSON-1452861425 tempest-AttachVolumeShelveTestJSON-1452861425-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.503s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 17:57:58 user nova-compute[74613]: INFO nova.scheduler.client.report [None req-d28734ad-96d9-4002-9f43-d0b811290e85 tempest-AttachVolumeShelveTestJSON-1452861425 tempest-AttachVolumeShelveTestJSON-1452861425-project-member] Deleted allocations for instance c19e230e-2e6c-4c20-b15c-ad81a73674b4
Nov 29 17:57:58 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-d28734ad-96d9-4002-9f43-d0b811290e85 tempest-AttachVolumeShelveTestJSON-1452861425 tempest-AttachVolumeShelveTestJSON-1452861425-project-member] Lock "c19e230e-2e6c-4c20-b15c-ad81a73674b4" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.580s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 17:57:58 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Lock "c19e230e-2e6c-4c20-b15c-ad81a73674b4" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.427s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 17:57:58 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Lock "c19e230e-2e6c-4c20-b15c-ad81a73674b4" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.025s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 17:58:00 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:58:01 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:58:05 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:58:07 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:58:08 user nova-compute[74613]: INFO nova.compute.manager [None req-6c06efa3-71b7-4af0-85c2-9306cba3d34c tempest-ServerBootFromVolumeStableRescueTest-414665510 tempest-ServerBootFromVolumeStableRescueTest-414665510-project-member] [instance: cd22685a-028c-4e0c-834d-e7b20f6d06ab] Unrescuing
Nov 29 17:58:08 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-6c06efa3-71b7-4af0-85c2-9306cba3d34c tempest-ServerBootFromVolumeStableRescueTest-414665510 tempest-ServerBootFromVolumeStableRescueTest-414665510-project-member] Acquiring lock "refresh_cache-cd22685a-028c-4e0c-834d-e7b20f6d06ab" {{(pid=74613) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 17:58:08 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-6c06efa3-71b7-4af0-85c2-9306cba3d34c tempest-ServerBootFromVolumeStableRescueTest-414665510 tempest-ServerBootFromVolumeStableRescueTest-414665510-project-member] Acquired lock "refresh_cache-cd22685a-028c-4e0c-834d-e7b20f6d06ab" {{(pid=74613) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 17:58:08 user nova-compute[74613]: DEBUG nova.network.neutron [None req-6c06efa3-71b7-4af0-85c2-9306cba3d34c tempest-ServerBootFromVolumeStableRescueTest-414665510 tempest-ServerBootFromVolumeStableRescueTest-414665510-project-member] [instance: cd22685a-028c-4e0c-834d-e7b20f6d06ab] Building network info cache for instance {{(pid=74613) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 29 17:58:09 user nova-compute[74613]: DEBUG nova.network.neutron [None req-6c06efa3-71b7-4af0-85c2-9306cba3d34c tempest-ServerBootFromVolumeStableRescueTest-414665510 tempest-ServerBootFromVolumeStableRescueTest-414665510-project-member] [instance: cd22685a-028c-4e0c-834d-e7b20f6d06ab] Updating instance_info_cache with network_info: [{"id": "5b08bd65-707e-48a5-800b-dd0670c88d61", "address": "fa:16:3e:28:d8:3d", "network": {"id": "0722b02d-a357-4360-87e8-580913723985", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-579793494-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b820dd795dfe46cd804772f0e71f98e9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5b08bd65-70", "ovs_interfaceid": "5b08bd65-707e-48a5-800b-dd0670c88d61", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74613) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 17:58:09 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-6c06efa3-71b7-4af0-85c2-9306cba3d34c tempest-ServerBootFromVolumeStableRescueTest-414665510 tempest-ServerBootFromVolumeStableRescueTest-414665510-project-member] Releasing lock "refresh_cache-cd22685a-028c-4e0c-834d-e7b20f6d06ab" {{(pid=74613) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 17:58:09 user nova-compute[74613]: DEBUG nova.objects.instance [None req-6c06efa3-71b7-4af0-85c2-9306cba3d34c tempest-ServerBootFromVolumeStableRescueTest-414665510 tempest-ServerBootFromVolumeStableRescueTest-414665510-project-member] Lazy-loading 'flavor' on Instance uuid cd22685a-028c-4e0c-834d-e7b20f6d06ab {{(pid=74613) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 17:58:09 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:58:09 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:58:09 user nova-compute[74613]: DEBUG nova.compute.manager [req-c801a4ac-5f98-4d67-bb18-1932fbe63562 req-20af9faa-f607-4b29-822f-5742e6f0b554 service nova] [instance: cd22685a-028c-4e0c-834d-e7b20f6d06ab] Received event network-vif-unplugged-5b08bd65-707e-48a5-800b-dd0670c88d61 {{(pid=74613) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 17:58:09 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-c801a4ac-5f98-4d67-bb18-1932fbe63562 req-20af9faa-f607-4b29-822f-5742e6f0b554 service nova] Acquiring lock "cd22685a-028c-4e0c-834d-e7b20f6d06ab-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 17:58:09 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-c801a4ac-5f98-4d67-bb18-1932fbe63562 req-20af9faa-f607-4b29-822f-5742e6f0b554 service nova] Lock "cd22685a-028c-4e0c-834d-e7b20f6d06ab-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 17:58:09 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-c801a4ac-5f98-4d67-bb18-1932fbe63562 req-20af9faa-f607-4b29-822f-5742e6f0b554 service nova] Lock "cd22685a-028c-4e0c-834d-e7b20f6d06ab-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 17:58:09 user nova-compute[74613]: DEBUG nova.compute.manager [req-c801a4ac-5f98-4d67-bb18-1932fbe63562 req-20af9faa-f607-4b29-822f-5742e6f0b554 service nova] [instance: cd22685a-028c-4e0c-834d-e7b20f6d06ab] No waiting events found dispatching network-vif-unplugged-5b08bd65-707e-48a5-800b-dd0670c88d61 {{(pid=74613) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 17:58:09 user nova-compute[74613]: WARNING nova.compute.manager [req-c801a4ac-5f98-4d67-bb18-1932fbe63562 req-20af9faa-f607-4b29-822f-5742e6f0b554 service nova] [instance: cd22685a-028c-4e0c-834d-e7b20f6d06ab] Received unexpected event network-vif-unplugged-5b08bd65-707e-48a5-800b-dd0670c88d61 for instance with vm_state rescued and task_state unrescuing.
Nov 29 17:58:09 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:58:09 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:58:09 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:58:09 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:58:09 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:58:09 user nova-compute[74613]: INFO nova.virt.libvirt.driver [-] [instance: cd22685a-028c-4e0c-834d-e7b20f6d06ab] Instance destroyed successfully.
Nov 29 17:58:09 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:58:10 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:58:10 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:58:10 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:58:10 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:58:10 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:58:11 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:58:11 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:58:11 user nova-compute[74613]: DEBUG nova.compute.manager [req-2772b219-3c83-4dcc-838c-28f288c02a13 req-ee5985be-d6d3-4129-a89c-a127615bfc65 service nova] [instance: 0aa463c6-01e7-48e5-b082-e083558342e3] Received event network-changed-9e74da09-a403-40b9-aad1-3cba1f7bd9d5 {{(pid=74613) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 17:58:11 user nova-compute[74613]: DEBUG nova.compute.manager [req-2772b219-3c83-4dcc-838c-28f288c02a13 req-ee5985be-d6d3-4129-a89c-a127615bfc65 service nova] [instance: 0aa463c6-01e7-48e5-b082-e083558342e3] Refreshing instance network info cache due to event network-changed-9e74da09-a403-40b9-aad1-3cba1f7bd9d5. {{(pid=74613) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 17:58:11 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-2772b219-3c83-4dcc-838c-28f288c02a13 req-ee5985be-d6d3-4129-a89c-a127615bfc65 service nova] Acquiring lock "refresh_cache-0aa463c6-01e7-48e5-b082-e083558342e3" {{(pid=74613) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 17:58:11 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-2772b219-3c83-4dcc-838c-28f288c02a13 req-ee5985be-d6d3-4129-a89c-a127615bfc65 service nova] Acquired lock "refresh_cache-0aa463c6-01e7-48e5-b082-e083558342e3" {{(pid=74613) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 17:58:11 user nova-compute[74613]: DEBUG nova.network.neutron [req-2772b219-3c83-4dcc-838c-28f288c02a13 req-ee5985be-d6d3-4129-a89c-a127615bfc65 service nova] [instance: 0aa463c6-01e7-48e5-b082-e083558342e3] Refreshing network info cache for port 9e74da09-a403-40b9-aad1-3cba1f7bd9d5 {{(pid=74613) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 17:58:11 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:58:11 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:58:11 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:58:11 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:58:11 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:58:11 user nova-compute[74613]: DEBUG nova.compute.manager [req-ad1e3a6e-5262-4cad-802a-1337bad58f80 req-31115ea2-68eb-49ca-9b3d-31825985f10e service nova] [instance: cd22685a-028c-4e0c-834d-e7b20f6d06ab] Received event network-vif-plugged-5b08bd65-707e-48a5-800b-dd0670c88d61 {{(pid=74613) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 17:58:11 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-ad1e3a6e-5262-4cad-802a-1337bad58f80 req-31115ea2-68eb-49ca-9b3d-31825985f10e service nova] Acquiring lock "cd22685a-028c-4e0c-834d-e7b20f6d06ab-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 17:58:11 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-ad1e3a6e-5262-4cad-802a-1337bad58f80 req-31115ea2-68eb-49ca-9b3d-31825985f10e service nova] Lock "cd22685a-028c-4e0c-834d-e7b20f6d06ab-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 17:58:11 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-ad1e3a6e-5262-4cad-802a-1337bad58f80 req-31115ea2-68eb-49ca-9b3d-31825985f10e service nova] Lock "cd22685a-028c-4e0c-834d-e7b20f6d06ab-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 17:58:11 user nova-compute[74613]: DEBUG nova.compute.manager [req-ad1e3a6e-5262-4cad-802a-1337bad58f80 req-31115ea2-68eb-49ca-9b3d-31825985f10e service nova] [instance: cd22685a-028c-4e0c-834d-e7b20f6d06ab] No waiting events found dispatching network-vif-plugged-5b08bd65-707e-48a5-800b-dd0670c88d61 {{(pid=74613) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 17:58:11 user nova-compute[74613]: WARNING nova.compute.manager [req-ad1e3a6e-5262-4cad-802a-1337bad58f80 req-31115ea2-68eb-49ca-9b3d-31825985f10e service nova] [instance: cd22685a-028c-4e0c-834d-e7b20f6d06ab] Received unexpected event network-vif-plugged-5b08bd65-707e-48a5-800b-dd0670c88d61 for instance with vm_state rescued and task_state unrescuing.
Nov 29 17:58:11 user nova-compute[74613]: DEBUG nova.compute.manager [req-ad1e3a6e-5262-4cad-802a-1337bad58f80 req-31115ea2-68eb-49ca-9b3d-31825985f10e service nova] [instance: cd22685a-028c-4e0c-834d-e7b20f6d06ab] Received event network-vif-plugged-5b08bd65-707e-48a5-800b-dd0670c88d61 {{(pid=74613) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 17:58:11 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-ad1e3a6e-5262-4cad-802a-1337bad58f80 req-31115ea2-68eb-49ca-9b3d-31825985f10e service nova] Acquiring lock "cd22685a-028c-4e0c-834d-e7b20f6d06ab-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 17:58:11 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-ad1e3a6e-5262-4cad-802a-1337bad58f80 req-31115ea2-68eb-49ca-9b3d-31825985f10e service nova] Lock "cd22685a-028c-4e0c-834d-e7b20f6d06ab-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 17:58:11 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-ad1e3a6e-5262-4cad-802a-1337bad58f80 req-31115ea2-68eb-49ca-9b3d-31825985f10e service nova] Lock "cd22685a-028c-4e0c-834d-e7b20f6d06ab-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 17:58:11 user nova-compute[74613]: DEBUG nova.compute.manager [req-ad1e3a6e-5262-4cad-802a-1337bad58f80 req-31115ea2-68eb-49ca-9b3d-31825985f10e service nova] [instance: cd22685a-028c-4e0c-834d-e7b20f6d06ab] No waiting events found dispatching network-vif-plugged-5b08bd65-707e-48a5-800b-dd0670c88d61 {{(pid=74613) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 17:58:11 user nova-compute[74613]: WARNING nova.compute.manager [req-ad1e3a6e-5262-4cad-802a-1337bad58f80 req-31115ea2-68eb-49ca-9b3d-31825985f10e service nova] [instance: cd22685a-028c-4e0c-834d-e7b20f6d06ab] Received unexpected event network-vif-plugged-5b08bd65-707e-48a5-800b-dd0670c88d61 for instance with vm_state rescued and task_state unrescuing.
Nov 29 17:58:11 user nova-compute[74613]: DEBUG nova.compute.manager [req-ad1e3a6e-5262-4cad-802a-1337bad58f80 req-31115ea2-68eb-49ca-9b3d-31825985f10e service nova] [instance: cd22685a-028c-4e0c-834d-e7b20f6d06ab] Received event network-vif-plugged-5b08bd65-707e-48a5-800b-dd0670c88d61 {{(pid=74613) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 17:58:11 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-ad1e3a6e-5262-4cad-802a-1337bad58f80 req-31115ea2-68eb-49ca-9b3d-31825985f10e service nova] Acquiring lock "cd22685a-028c-4e0c-834d-e7b20f6d06ab-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 17:58:11 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-ad1e3a6e-5262-4cad-802a-1337bad58f80 req-31115ea2-68eb-49ca-9b3d-31825985f10e service nova] Lock "cd22685a-028c-4e0c-834d-e7b20f6d06ab-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 17:58:11 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-ad1e3a6e-5262-4cad-802a-1337bad58f80 req-31115ea2-68eb-49ca-9b3d-31825985f10e service nova] Lock "cd22685a-028c-4e0c-834d-e7b20f6d06ab-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 17:58:11 user nova-compute[74613]: DEBUG nova.compute.manager [req-ad1e3a6e-5262-4cad-802a-1337bad58f80 req-31115ea2-68eb-49ca-9b3d-31825985f10e service nova] [instance: cd22685a-028c-4e0c-834d-e7b20f6d06ab] No waiting events found dispatching network-vif-plugged-5b08bd65-707e-48a5-800b-dd0670c88d61 {{(pid=74613) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 17:58:11 user nova-compute[74613]: WARNING nova.compute.manager [req-ad1e3a6e-5262-4cad-802a-1337bad58f80 req-31115ea2-68eb-49ca-9b3d-31825985f10e service nova] [instance: cd22685a-028c-4e0c-834d-e7b20f6d06ab] Received unexpected event network-vif-plugged-5b08bd65-707e-48a5-800b-dd0670c88d61 for instance with vm_state rescued and task_state unrescuing.
Nov 29 17:58:11 user nova-compute[74613]: DEBUG nova.compute.manager [req-ad1e3a6e-5262-4cad-802a-1337bad58f80 req-31115ea2-68eb-49ca-9b3d-31825985f10e service nova] [instance: cd22685a-028c-4e0c-834d-e7b20f6d06ab] Received event network-vif-unplugged-5b08bd65-707e-48a5-800b-dd0670c88d61 {{(pid=74613) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 17:58:11 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-ad1e3a6e-5262-4cad-802a-1337bad58f80 req-31115ea2-68eb-49ca-9b3d-31825985f10e service nova] Acquiring lock "cd22685a-028c-4e0c-834d-e7b20f6d06ab-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 17:58:11 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-ad1e3a6e-5262-4cad-802a-1337bad58f80 req-31115ea2-68eb-49ca-9b3d-31825985f10e service nova] Lock "cd22685a-028c-4e0c-834d-e7b20f6d06ab-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 17:58:11 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-ad1e3a6e-5262-4cad-802a-1337bad58f80 req-31115ea2-68eb-49ca-9b3d-31825985f10e service nova] Lock "cd22685a-028c-4e0c-834d-e7b20f6d06ab-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 17:58:11 user nova-compute[74613]: DEBUG nova.compute.manager [req-ad1e3a6e-5262-4cad-802a-1337bad58f80 req-31115ea2-68eb-49ca-9b3d-31825985f10e service nova] [instance: cd22685a-028c-4e0c-834d-e7b20f6d06ab] No waiting events found dispatching network-vif-unplugged-5b08bd65-707e-48a5-800b-dd0670c88d61 {{(pid=74613) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 17:58:11 user nova-compute[74613]: WARNING nova.compute.manager [req-ad1e3a6e-5262-4cad-802a-1337bad58f80 req-31115ea2-68eb-49ca-9b3d-31825985f10e service nova] [instance: cd22685a-028c-4e0c-834d-e7b20f6d06ab] Received unexpected event network-vif-unplugged-5b08bd65-707e-48a5-800b-dd0670c88d61 for instance with vm_state rescued and task_state unrescuing.
Nov 29 17:58:11 user nova-compute[74613]: DEBUG nova.compute.manager [req-ad1e3a6e-5262-4cad-802a-1337bad58f80 req-31115ea2-68eb-49ca-9b3d-31825985f10e service nova] [instance: cd22685a-028c-4e0c-834d-e7b20f6d06ab] Received event network-vif-plugged-5b08bd65-707e-48a5-800b-dd0670c88d61 {{(pid=74613) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 17:58:11 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-ad1e3a6e-5262-4cad-802a-1337bad58f80 req-31115ea2-68eb-49ca-9b3d-31825985f10e service nova] Acquiring lock "cd22685a-028c-4e0c-834d-e7b20f6d06ab-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 17:58:11 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-ad1e3a6e-5262-4cad-802a-1337bad58f80 req-31115ea2-68eb-49ca-9b3d-31825985f10e service nova] Lock "cd22685a-028c-4e0c-834d-e7b20f6d06ab-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 17:58:11 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-ad1e3a6e-5262-4cad-802a-1337bad58f80 req-31115ea2-68eb-49ca-9b3d-31825985f10e service nova] Lock "cd22685a-028c-4e0c-834d-e7b20f6d06ab-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 17:58:11 user nova-compute[74613]: DEBUG nova.compute.manager [req-ad1e3a6e-5262-4cad-802a-1337bad58f80 req-31115ea2-68eb-49ca-9b3d-31825985f10e service nova] [instance: cd22685a-028c-4e0c-834d-e7b20f6d06ab] No waiting events found dispatching network-vif-plugged-5b08bd65-707e-48a5-800b-dd0670c88d61 {{(pid=74613) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 17:58:11 user nova-compute[74613]: WARNING nova.compute.manager [req-ad1e3a6e-5262-4cad-802a-1337bad58f80 req-31115ea2-68eb-49ca-9b3d-31825985f10e service nova] [instance: cd22685a-028c-4e0c-834d-e7b20f6d06ab] Received unexpected event network-vif-plugged-5b08bd65-707e-48a5-800b-dd0670c88d61 for instance with vm_state rescued and task_state unrescuing.
Nov 29 17:58:11 user nova-compute[74613]: DEBUG nova.network.neutron [req-2772b219-3c83-4dcc-838c-28f288c02a13 req-ee5985be-d6d3-4129-a89c-a127615bfc65 service nova] [instance: 0aa463c6-01e7-48e5-b082-e083558342e3] Updated VIF entry in instance network info cache for port 9e74da09-a403-40b9-aad1-3cba1f7bd9d5. {{(pid=74613) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 17:58:11 user nova-compute[74613]: DEBUG nova.network.neutron [req-2772b219-3c83-4dcc-838c-28f288c02a13 req-ee5985be-d6d3-4129-a89c-a127615bfc65 service nova] [instance: 0aa463c6-01e7-48e5-b082-e083558342e3] Updating instance_info_cache with network_info: [{"id": "9e74da09-a403-40b9-aad1-3cba1f7bd9d5", "address": "fa:16:3e:78:6a:83", "network": {"id": "485e1e0d-aa2c-47c2-a010-c84e83dbcc9c", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-686908926-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.230", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3832a80aaabc42ba8400823aa6b76c29", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9e74da09-a4", "ovs_interfaceid": "9e74da09-a403-40b9-aad1-3cba1f7bd9d5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74613) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 17:58:11 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-2772b219-3c83-4dcc-838c-28f288c02a13 req-ee5985be-d6d3-4129-a89c-a127615bfc65 service nova] Releasing lock "refresh_cache-0aa463c6-01e7-48e5-b082-e083558342e3" {{(pid=74613) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 17:58:12 user nova-compute[74613]: WARNING nova.virt.libvirt.driver [None req-4e53d14d-1c6b-444e-a256-5cc917678186 tempest-ServerStableDeviceRescueTest-1416322546 tempest-ServerStableDeviceRescueTest-1416322546-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance b6b0ba36-ad89-45f1-9578-8b999567dd25 is timed out.
Nov 29 17:58:12 user nova-compute[74613]: INFO nova.virt.libvirt.driver [None req-4e53d14d-1c6b-444e-a256-5cc917678186 tempest-ServerStableDeviceRescueTest-1416322546 tempest-ServerStableDeviceRescueTest-1416322546-project-member] Successfully detached device vdb from instance b6b0ba36-ad89-45f1-9578-8b999567dd25 from the live domain config.
Nov 29 17:58:12 user nova-compute[74613]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4e53d14d-1c6b-444e-a256-5cc917678186 tempest-ServerStableDeviceRescueTest-1416322546 tempest-ServerStableDeviceRescueTest-1416322546-project-member] [instance: b6b0ba36-ad89-45f1-9578-8b999567dd25] calling os-brick to detach iSCSI Volume {{(pid=74613) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 29 17:58:12 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e53d14d-1c6b-444e-a256-5cc917678186 tempest-ServerStableDeviceRescueTest-1416322546 tempest-ServerStableDeviceRescueTest-1416322546-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff828156890>, {'target_iqn': 'iqn.2010-10.org.openstack:070b1031-e105-4cba-a039-2286e23727c5', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NfwgLEhX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=74613) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 17:58:12 user nova-compute[74613]: WARNING os_brick.initiator.connectors.base [None req-4e53d14d-1c6b-444e-a256-5cc917678186 tempest-ServerStableDeviceRescueTest-1416322546 tempest-ServerStableDeviceRescueTest-1416322546-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 17:58:12 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.base [None req-4e53d14d-1c6b-444e-a256-5cc917678186 tempest-ServerStableDeviceRescueTest-1416322546 tempest-ServerStableDeviceRescueTest-1416322546-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 17:58:12 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.base [None req-4e53d14d-1c6b-444e-a256-5cc917678186 tempest-ServerStableDeviceRescueTest-1416322546 tempest-ServerStableDeviceRescueTest-1416322546-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 17:58:12 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 17:58:12 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 17:58:12 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[dde1bea3-a86e-4a66-b4f4-18a33bb9d1a9]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:070b1031-e105-4cba-a039-2286e23727c5\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:9511387c-8772-40f2-bf2d-6b6387649e9f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:6a07b572-6430-4d0f-9aaf-8a8dbc39831e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:72d22ffa-f425-4575-86a5-afbd8bb9cdd6\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 17:58:12 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e53d14d-1c6b-444e-a256-5cc917678186 tempest-ServerStableDeviceRescueTest-1416322546 tempest-ServerStableDeviceRescueTest-1416322546-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 29 17:58:12 user nova-compute[74613]: No targets found.
Nov 29 17:58:12 user nova-compute[74613]: iSNS:
Nov 29 17:58:12 user nova-compute[74613]: No targets found.
Nov 29 17:58:12 user nova-compute[74613]: STATIC:
Nov 29 17:58:12 user nova-compute[74613]: Target: iqn.2010-10.org.openstack:070b1031-e105-4cba-a039-2286e23727c5
Nov 29 17:58:12 user nova-compute[74613]:         Portal: 172.16.0.220:3260,-1
Nov 29 17:58:12 user nova-compute[74613]:                 Iface Name: default
Nov 29 17:58:12 user nova-compute[74613]: Target: iqn.2010-10.org.openstack:9511387c-8772-40f2-bf2d-6b6387649e9f
Nov 29 17:58:12 user nova-compute[74613]:         Portal: 172.16.0.220:3260,-1
Nov 29 17:58:12 user nova-compute[74613]:                 Iface Name: default
Nov 29 17:58:12 user nova-compute[74613]: Target: iqn.2010-10.org.openstack:6a07b572-6430-4d0f-9aaf-8a8dbc39831e
Nov 29 17:58:12 user nova-compute[74613]:         Portal: 172.16.0.220:3260,-1
Nov 29 17:58:12 user nova-compute[74613]:                 Iface Name: default
Nov 29 17:58:12 user nova-compute[74613]: Target: iqn.2010-10.org.openstack:72d22ffa-f425-4575-86a5-afbd8bb9cdd6
Nov 29 17:58:12 user nova-compute[74613]:         Portal: 172.16.0.220:3260,-1
Nov 29 17:58:12 user nova-compute[74613]:                 Iface Name: default
Nov 29 17:58:12 user nova-compute[74613]: FIRMWARE:
Nov 29 17:58:12 user nova-compute[74613]: No targets found.
Nov 29 17:58:12 user nova-compute[74613]:  stderr= {{(pid=74613) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 17:58:12 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e53d14d-1c6b-444e-a256-5cc917678186 tempest-ServerStableDeviceRescueTest-1416322546 tempest-ServerStableDeviceRescueTest-1416322546-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 29 17:58:12 user nova-compute[74613]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 29 17:58:12 user nova-compute[74613]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74613) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 29 17:58:12 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e53d14d-1c6b-444e-a256-5cc917678186 tempest-ServerStableDeviceRescueTest-1416322546 tempest-ServerStableDeviceRescueTest-1416322546-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:070b1031-e105-4cba-a039-2286e23727c5', 0)] {{(pid=74613) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 29 17:58:12 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 17:58:12 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 17:58:12 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a0e4167-2a70-431d-89ca-d78b7ea93fa3]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:070b1031-e105-4cba-a039-2286e23727c5\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6a07b572-6430-4d0f-9aaf-8a8dbc39831e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:72d22ffa-f425-4575-86a5-afbd8bb9cdd6\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9511387c-8772-40f2-bf2d-6b6387649e9f\n', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 17:58:12 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 17:58:12 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 17:58:12 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[63cc0aff-bcb9-445d-9b22-a7474a7914f9]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9511387c-8772-40f2-bf2d-6b6387649e9f (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:070b1031-e105-4cba-a039-2286e23727c5 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a07b572-6430-4d0f-9aaf-8a8dbc39831e (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:72d22ffa-f425-4575-86a5-afbd8bb9cdd6 (non-flash)\n', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 17:58:12 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e53d14d-1c6b-444e-a256-5cc917678186 tempest-ServerStableDeviceRescueTest-1416322546 tempest-ServerStableDeviceRescueTest-1416322546-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9511387c-8772-40f2-bf2d-6b6387649e9f (non-flash)
Nov 29 17:58:12 user nova-compute[74613]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:070b1031-e105-4cba-a039-2286e23727c5 (non-flash)
Nov 29 17:58:12 user nova-compute[74613]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a07b572-6430-4d0f-9aaf-8a8dbc39831e (non-flash)
Nov 29 17:58:12 user nova-compute[74613]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:72d22ffa-f425-4575-86a5-afbd8bb9cdd6 (non-flash)
Nov 29 17:58:12 user nova-compute[74613]:  stderr= {{(pid=74613) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 17:58:12 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e53d14d-1c6b-444e-a256-5cc917678186 tempest-ServerStableDeviceRescueTest-1416322546 tempest-ServerStableDeviceRescueTest-1416322546-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9511387c-8772-40f2-bf2d-6b6387649e9f (non-flash)
Nov 29 17:58:12 user nova-compute[74613]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:070b1031-e105-4cba-a039-2286e23727c5 (non-flash)
Nov 29 17:58:12 user nova-compute[74613]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a07b572-6430-4d0f-9aaf-8a8dbc39831e (non-flash)
Nov 29 17:58:12 user nova-compute[74613]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:72d22ffa-f425-4575-86a5-afbd8bb9cdd6 (non-flash)
Nov 29 17:58:12 user nova-compute[74613]:  stderr= {{(pid=74613) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 17:58:12 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e53d14d-1c6b-444e-a256-5cc917678186 tempest-ServerStableDeviceRescueTest-1416322546 tempest-ServerStableDeviceRescueTest-1416322546-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7ff818291480>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:070b1031-e105-4cba-a039-2286e23727c5'): ({'sdc'}, set())}) {{(pid=74613) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 29 17:58:12 user nova-compute[74613]: DEBUG os_brick.initiator.linuxscsi [None req-4e53d14d-1c6b-444e-a256-5cc917678186 tempest-ServerStableDeviceRescueTest-1416322546 tempest-ServerStableDeviceRescueTest-1416322546-project-member] Removing single pathed devices sdc {{(pid=74613) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 29 17:58:12 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 17:58:12 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 17:58:12 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a36962e-16bf-4be8-86c1-c6130c51da7d]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 17:58:12 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 17:58:12 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.018s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 17:58:12 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca2310fd-c211-4178-8a5c-68b9aeb2e71b]: (4, ('ok\n', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 17:58:12 user nova-compute[74613]: DEBUG os_brick.initiator.linuxscsi [None req-4e53d14d-1c6b-444e-a256-5cc917678186 tempest-ServerStableDeviceRescueTest-1416322546 tempest-ServerStableDeviceRescueTest-1416322546-project-member] Flushing IO for device /dev/sdc {{(pid=74613) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 29 17:58:12 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 17:58:12 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.012s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 17:58:12 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[429181d5-c0b8-4572-958a-9f453f88d250]: (4, ('', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 17:58:12 user nova-compute[74613]: DEBUG os_brick.initiator.linuxscsi [None req-4e53d14d-1c6b-444e-a256-5cc917678186 tempest-ServerStableDeviceRescueTest-1416322546 tempest-ServerStableDeviceRescueTest-1416322546-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=74613) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 29 17:58:12 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 17:58:12 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.040s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 17:58:12 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d2d46b7-1cfc-4487-9d05-3cb70ac0fc5b]: (4, ('1', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 17:58:12 user nova-compute[74613]: DEBUG os_brick.initiator.linuxscsi [None req-4e53d14d-1c6b-444e-a256-5cc917678186 tempest-ServerStableDeviceRescueTest-1416322546 tempest-ServerStableDeviceRescueTest-1416322546-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=74613) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 29 17:58:12 user nova-compute[74613]: DEBUG os_brick.initiator.linuxscsi [None req-4e53d14d-1c6b-444e-a256-5cc917678186 tempest-ServerStableDeviceRescueTest-1416322546 tempest-ServerStableDeviceRescueTest-1416322546-project-member] SCSI volumes sdc have been removed. {{(pid=74613) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 29 17:58:12 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e53d14d-1c6b-444e-a256-5cc917678186 tempest-ServerStableDeviceRescueTest-1416322546 tempest-ServerStableDeviceRescueTest-1416322546-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:070b1031-e105-4cba-a039-2286e23727c5')] {{(pid=74613) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 29 17:58:12 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:070b1031-e105-4cba-a039-2286e23727c5 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 17:58:12 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:070b1031-e105-4cba-a039-2286e23727c5 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.025s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 17:58:12 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d866aee-9837-4635-ad1b-f83ca4f13e27]: (4, ('', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 17:58:12 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e53d14d-1c6b-444e-a256-5cc917678186 tempest-ServerStableDeviceRescueTest-1416322546 tempest-ServerStableDeviceRescueTest-1416322546-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74613) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 17:58:12 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:070b1031-e105-4cba-a039-2286e23727c5 -p 172.16.0.220:3260 --logout {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 17:58:12 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:070b1031-e105-4cba-a039-2286e23727c5 -p 172.16.0.220:3260 --logout" returned: 0 in 0.053s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 17:58:12 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[193cc8a0-29f8-47b9-bd74-fd05bb433d08]: (4, ('Logging out of session [sid: 15, target: iqn.2010-10.org.openstack:070b1031-e105-4cba-a039-2286e23727c5, portal: 172.16.0.220,3260]\nLogout of [sid: 15, target: iqn.2010-10.org.openstack:070b1031-e105-4cba-a039-2286e23727c5, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 17:58:12 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e53d14d-1c6b-444e-a256-5cc917678186 tempest-ServerStableDeviceRescueTest-1416322546 tempest-ServerStableDeviceRescueTest-1416322546-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 15, target: iqn.2010-10.org.openstack:070b1031-e105-4cba-a039-2286e23727c5, portal: 172.16.0.220,3260]
Nov 29 17:58:12 user nova-compute[74613]: Logout of [sid: 15, target: iqn.2010-10.org.openstack:070b1031-e105-4cba-a039-2286e23727c5, portal: 172.16.0.220,3260] successful.
Nov 29 17:58:12 user nova-compute[74613]:  stderr= {{(pid=74613) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 17:58:12 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:070b1031-e105-4cba-a039-2286e23727c5 -p 172.16.0.220:3260 --op delete {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 17:58:12 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:070b1031-e105-4cba-a039-2286e23727c5 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.033s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 17:58:12 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[67506051-8146-43d2-adb9-b1c92fc688ea]: (4, ('', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 17:58:12 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e53d14d-1c6b-444e-a256-5cc917678186 tempest-ServerStableDeviceRescueTest-1416322546 tempest-ServerStableDeviceRescueTest-1416322546-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74613) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 17:58:12 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.base [None req-4e53d14d-1c6b-444e-a256-5cc917678186 tempest-ServerStableDeviceRescueTest-1416322546 tempest-ServerStableDeviceRescueTest-1416322546-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.306s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 17:58:12 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e53d14d-1c6b-444e-a256-5cc917678186 tempest-ServerStableDeviceRescueTest-1416322546 tempest-ServerStableDeviceRescueTest-1416322546-project-member] <== disconnect_volume: return (307ms) None {{(pid=74613) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 17:58:12 user nova-compute[74613]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4e53d14d-1c6b-444e-a256-5cc917678186 tempest-ServerStableDeviceRescueTest-1416322546 tempest-ServerStableDeviceRescueTest-1416322546-project-member] [instance: b6b0ba36-ad89-45f1-9578-8b999567dd25] Disconnected iSCSI Volume {{(pid=74613) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 29 17:58:13 user nova-compute[74613]: DEBUG nova.compute.manager [None req-6c06efa3-71b7-4af0-85c2-9306cba3d34c tempest-ServerBootFromVolumeStableRescueTest-414665510 tempest-ServerBootFromVolumeStableRescueTest-414665510-project-member] [instance: cd22685a-028c-4e0c-834d-e7b20f6d06ab] Checking state {{(pid=74613) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 29 17:58:13 user nova-compute[74613]: DEBUG nova.objects.instance [None req-4e53d14d-1c6b-444e-a256-5cc917678186 tempest-ServerStableDeviceRescueTest-1416322546 tempest-ServerStableDeviceRescueTest-1416322546-project-member] Lazy-loading 'flavor' on Instance uuid b6b0ba36-ad89-45f1-9578-8b999567dd25 {{(pid=74613) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 17:58:13 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-4e53d14d-1c6b-444e-a256-5cc917678186 tempest-ServerStableDeviceRescueTest-1416322546 tempest-ServerStableDeviceRescueTest-1416322546-project-member] Lock "b6b0ba36-ad89-45f1-9578-8b999567dd25" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.812s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 17:58:13 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Lock "b6b0ba36-ad89-45f1-9578-8b999567dd25" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 15.686s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 17:58:13 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Lock "b6b0ba36-ad89-45f1-9578-8b999567dd25" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.029s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 17:58:13 user nova-compute[74613]: DEBUG nova.compute.manager [req-14a9b8cf-3492-4506-8be5-e73d1c28afb7 req-87a5f41f-569e-42a2-a7ba-781187b55029 service nova] [instance: cd22685a-028c-4e0c-834d-e7b20f6d06ab] Received event network-vif-plugged-5b08bd65-707e-48a5-800b-dd0670c88d61 {{(pid=74613) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 17:58:13 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-14a9b8cf-3492-4506-8be5-e73d1c28afb7 req-87a5f41f-569e-42a2-a7ba-781187b55029 service nova] Acquiring lock "cd22685a-028c-4e0c-834d-e7b20f6d06ab-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 17:58:13 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-14a9b8cf-3492-4506-8be5-e73d1c28afb7 req-87a5f41f-569e-42a2-a7ba-781187b55029 service nova] Lock "cd22685a-028c-4e0c-834d-e7b20f6d06ab-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 17:58:13 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-14a9b8cf-3492-4506-8be5-e73d1c28afb7 req-87a5f41f-569e-42a2-a7ba-781187b55029 service nova] Lock "cd22685a-028c-4e0c-834d-e7b20f6d06ab-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 17:58:13 user nova-compute[74613]: DEBUG nova.compute.manager [req-14a9b8cf-3492-4506-8be5-e73d1c28afb7 req-87a5f41f-569e-42a2-a7ba-781187b55029 service nova] [instance: cd22685a-028c-4e0c-834d-e7b20f6d06ab] No waiting events found dispatching network-vif-plugged-5b08bd65-707e-48a5-800b-dd0670c88d61 {{(pid=74613) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 17:58:13 user nova-compute[74613]: WARNING nova.compute.manager [req-14a9b8cf-3492-4506-8be5-e73d1c28afb7 req-87a5f41f-569e-42a2-a7ba-781187b55029 service nova] [instance: cd22685a-028c-4e0c-834d-e7b20f6d06ab] Received unexpected event network-vif-plugged-5b08bd65-707e-48a5-800b-dd0670c88d61 for instance with vm_state active and task_state None.
Nov 29 17:58:13 user nova-compute[74613]: DEBUG nova.compute.manager [req-14a9b8cf-3492-4506-8be5-e73d1c28afb7 req-87a5f41f-569e-42a2-a7ba-781187b55029 service nova] [instance: cd22685a-028c-4e0c-834d-e7b20f6d06ab] Received event network-vif-plugged-5b08bd65-707e-48a5-800b-dd0670c88d61 {{(pid=74613) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 17:58:13 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-14a9b8cf-3492-4506-8be5-e73d1c28afb7 req-87a5f41f-569e-42a2-a7ba-781187b55029 service nova] Acquiring lock "cd22685a-028c-4e0c-834d-e7b20f6d06ab-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 17:58:13 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-14a9b8cf-3492-4506-8be5-e73d1c28afb7 req-87a5f41f-569e-42a2-a7ba-781187b55029 service nova] Lock "cd22685a-028c-4e0c-834d-e7b20f6d06ab-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 17:58:13 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-14a9b8cf-3492-4506-8be5-e73d1c28afb7 req-87a5f41f-569e-42a2-a7ba-781187b55029 service nova] Lock "cd22685a-028c-4e0c-834d-e7b20f6d06ab-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 17:58:13 user nova-compute[74613]: DEBUG nova.compute.manager [req-14a9b8cf-3492-4506-8be5-e73d1c28afb7 req-87a5f41f-569e-42a2-a7ba-781187b55029 service nova] [instance: cd22685a-028c-4e0c-834d-e7b20f6d06ab] No waiting events found dispatching network-vif-plugged-5b08bd65-707e-48a5-800b-dd0670c88d61 {{(pid=74613) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 17:58:13 user nova-compute[74613]: WARNING nova.compute.manager [req-14a9b8cf-3492-4506-8be5-e73d1c28afb7 req-87a5f41f-569e-42a2-a7ba-781187b55029 service nova] [instance: cd22685a-028c-4e0c-834d-e7b20f6d06ab] Received unexpected event network-vif-plugged-5b08bd65-707e-48a5-800b-dd0670c88d61 for instance with vm_state active and task_state None.
Nov 29 17:58:13 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-60263073-b1d9-46ea-8b43-37969de15eba tempest-VolumesAdminNegativeTest-636556351 tempest-VolumesAdminNegativeTest-636556351-project-member] Acquiring lock "0aa463c6-01e7-48e5-b082-e083558342e3" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 17:58:13 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-60263073-b1d9-46ea-8b43-37969de15eba tempest-VolumesAdminNegativeTest-636556351 tempest-VolumesAdminNegativeTest-636556351-project-member] Lock "0aa463c6-01e7-48e5-b082-e083558342e3" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 17:58:13 user nova-compute[74613]: DEBUG nova.objects.instance [None req-60263073-b1d9-46ea-8b43-37969de15eba tempest-VolumesAdminNegativeTest-636556351 tempest-VolumesAdminNegativeTest-636556351-project-member] Lazy-loading 'flavor' on Instance uuid 0aa463c6-01e7-48e5-b082-e083558342e3 {{(pid=74613) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 17:58:13 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-60263073-b1d9-46ea-8b43-37969de15eba tempest-VolumesAdminNegativeTest-636556351 tempest-VolumesAdminNegativeTest-636556351-project-member] Lock "0aa463c6-01e7-48e5-b082-e083558342e3" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.057s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 17:58:14 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-60263073-b1d9-46ea-8b43-37969de15eba tempest-VolumesAdminNegativeTest-636556351 tempest-VolumesAdminNegativeTest-636556351-project-member] Acquiring lock "0aa463c6-01e7-48e5-b082-e083558342e3" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 17:58:14 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-60263073-b1d9-46ea-8b43-37969de15eba tempest-VolumesAdminNegativeTest-636556351 tempest-VolumesAdminNegativeTest-636556351-project-member] Lock "0aa463c6-01e7-48e5-b082-e083558342e3" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 17:58:14 user nova-compute[74613]: INFO nova.compute.manager [None req-60263073-b1d9-46ea-8b43-37969de15eba tempest-VolumesAdminNegativeTest-636556351 tempest-VolumesAdminNegativeTest-636556351-project-member] [instance: 0aa463c6-01e7-48e5-b082-e083558342e3] Attaching volume d8614e81-d01c-4ec5-9f96-46df3535d465 to /dev/vdb
Nov 29 17:58:14 user nova-compute[74613]: DEBUG os_brick.utils [None req-60263073-b1d9-46ea-8b43-37969de15eba tempest-VolumesAdminNegativeTest-636556351 tempest-VolumesAdminNegativeTest-636556351-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74613) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 17:58:14 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 17:58:14 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 17:58:14 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2ec5ee0-7daa-428f-a7f8-58c57fec9c0b]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:400972819b5\n', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 17:58:14 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 17:58:14 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 17:58:14 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[6abda352-8c0e-485f-aaf5-74da6a2f1b1e]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 17:58:14 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 17:58:14 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 17:58:14 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[a40fff5b-8e8d-4849-a18b-9d7224fc8763]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 17:58:14 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe4b5f52-af06-499b-a98f-fb21fce822fd]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 17:58:14 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-60263073-b1d9-46ea-8b43-37969de15eba tempest-VolumesAdminNegativeTest-636556351 tempest-VolumesAdminNegativeTest-636556351-project-member] Running cmd (subprocess): nvme version {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 17:58:14 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-60263073-b1d9-46ea-8b43-37969de15eba tempest-VolumesAdminNegativeTest-636556351 tempest-VolumesAdminNegativeTest-636556351-project-member] 'nvme version' failed. Not Retrying. {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 17:58:14 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.nvmeof [None req-60263073-b1d9-46ea-8b43-37969de15eba tempest-VolumesAdminNegativeTest-636556351 tempest-VolumesAdminNegativeTest-636556351-project-member] nvme not present on system {{(pid=74613) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 29 17:58:14 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 17:58:14 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 17:58:14 user nova-compute[74613]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 29 17:58:14 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[4361378d-2d0b-43be-9308-f5b96e3cabef]: (4, '') {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 17:58:14 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.lightos [None req-60263073-b1d9-46ea-8b43-37969de15eba tempest-VolumesAdminNegativeTest-636556351 tempest-VolumesAdminNegativeTest-636556351-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74613) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 29 17:58:14 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.lightos [None req-60263073-b1d9-46ea-8b43-37969de15eba tempest-VolumesAdminNegativeTest-636556351 tempest-VolumesAdminNegativeTest-636556351-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74613) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 29 17:58:14 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.lightos [None req-60263073-b1d9-46ea-8b43-37969de15eba tempest-VolumesAdminNegativeTest-636556351 tempest-VolumesAdminNegativeTest-636556351-project-member] LIGHTOS: no hostnqn found. {{(pid=74613) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 29 17:58:14 user nova-compute[74613]: DEBUG os_brick.utils [None req-60263073-b1d9-46ea-8b43-37969de15eba tempest-VolumesAdminNegativeTest-636556351 tempest-VolumesAdminNegativeTest-636556351-project-member] <== get_connector_properties: return (118ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:400972819b5', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74613) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 17:58:14 user nova-compute[74613]: DEBUG nova.virt.block_device [None req-60263073-b1d9-46ea-8b43-37969de15eba tempest-VolumesAdminNegativeTest-636556351 tempest-VolumesAdminNegativeTest-636556351-project-member] [instance: 0aa463c6-01e7-48e5-b082-e083558342e3] Updating existing volume attachment record: b0c3c9ae-d35f-4f68-a8ef-8de5434b983b {{(pid=74613) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 29 17:58:15 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:58:15 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:58:16 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:58:17 user nova-compute[74613]: DEBUG oslo_service.periodic_task [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74613) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 17:58:17 user nova-compute[74613]: DEBUG oslo_service.periodic_task [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74613) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 17:58:17 user nova-compute[74613]: DEBUG oslo_service.periodic_task [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74613) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 17:58:17 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 17:58:17 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 17:58:17 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 17:58:17 user nova-compute[74613]: DEBUG nova.compute.resource_tracker [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Auditing locally available compute resources for user (node: user) {{(pid=74613) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 29 17:58:17 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c4bdb712-e1f9-4fc0-b527-87088d7eddf8/disk --force-share --output=json {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 17:58:18 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c4bdb712-e1f9-4fc0-b527-87088d7eddf8/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 17:58:18 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c4bdb712-e1f9-4fc0-b527-87088d7eddf8/disk --force-share --output=json {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 17:58:18 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c4bdb712-e1f9-4fc0-b527-87088d7eddf8/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 17:58:18 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b6b0ba36-ad89-45f1-9578-8b999567dd25/disk --force-share --output=json {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 17:58:18 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b6b0ba36-ad89-45f1-9578-8b999567dd25/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 17:58:18 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b6b0ba36-ad89-45f1-9578-8b999567dd25/disk --force-share --output=json {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 17:58:18 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b6b0ba36-ad89-45f1-9578-8b999567dd25/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 17:58:18 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=74613) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 29 17:58:18 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fce4b456-c108-439f-b0ff-7619aaf77e69/disk --force-share --output=json {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 17:58:18 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fce4b456-c108-439f-b0ff-7619aaf77e69/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 17:58:18 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fce4b456-c108-439f-b0ff-7619aaf77e69/disk --force-share --output=json {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 17:58:18 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fce4b456-c108-439f-b0ff-7619aaf77e69/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 17:58:18 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/71f2a1ab-3df7-411c-93fa-b0a1a5a44f0a/disk --force-share --output=json {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 17:58:19 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/71f2a1ab-3df7-411c-93fa-b0a1a5a44f0a/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 17:58:19 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/71f2a1ab-3df7-411c-93fa-b0a1a5a44f0a/disk --force-share --output=json {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 17:58:19 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/71f2a1ab-3df7-411c-93fa-b0a1a5a44f0a/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 17:58:19 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=74613) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 29 17:58:19 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3b828860-5cc5-40b0-b845-8e560211794e/disk --force-share --output=json {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 17:58:19 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-fc65ae93-e4a7-42cd-ba65-874189d46dc4 tempest-ServerActionsTestOtherB-894551005 tempest-ServerActionsTestOtherB-894551005-project-member] Acquiring lock "74ac9703-1cd7-4983-b7d4-c69b01fec7b2" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 17:58:19 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-fc65ae93-e4a7-42cd-ba65-874189d46dc4 tempest-ServerActionsTestOtherB-894551005 tempest-ServerActionsTestOtherB-894551005-project-member] Lock "74ac9703-1cd7-4983-b7d4-c69b01fec7b2" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.003s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 17:58:19 user nova-compute[74613]: DEBUG nova.objects.instance [None req-fc65ae93-e4a7-42cd-ba65-874189d46dc4 tempest-ServerActionsTestOtherB-894551005 tempest-ServerActionsTestOtherB-894551005-project-member] Lazy-loading 'flavor' on Instance uuid 74ac9703-1cd7-4983-b7d4-c69b01fec7b2 {{(pid=74613) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 17:58:19 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3b828860-5cc5-40b0-b845-8e560211794e/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 17:58:19 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3b828860-5cc5-40b0-b845-8e560211794e/disk --force-share --output=json {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 17:58:19 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-fc65ae93-e4a7-42cd-ba65-874189d46dc4 tempest-ServerActionsTestOtherB-894551005 tempest-ServerActionsTestOtherB-894551005-project-member] Lock "74ac9703-1cd7-4983-b7d4-c69b01fec7b2" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.126s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 17:58:19 user nova-compute[74613]: DEBUG nova.compute.manager [req-1c125eaa-3ada-4778-9af4-7742d6b75b59 req-9398fa2f-c099-4460-b641-9c5d72b4cab9 service nova] [instance: fae10c60-f989-4c99-bde4-60cd9f3e2055] Received event network-changed-435f55bd-6b68-4466-96d8-7ca838b0a594 {{(pid=74613) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 17:58:19 user nova-compute[74613]: DEBUG nova.compute.manager [req-1c125eaa-3ada-4778-9af4-7742d6b75b59 req-9398fa2f-c099-4460-b641-9c5d72b4cab9 service nova] [instance: fae10c60-f989-4c99-bde4-60cd9f3e2055] Refreshing instance network info cache due to event network-changed-435f55bd-6b68-4466-96d8-7ca838b0a594. {{(pid=74613) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 17:58:19 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-1c125eaa-3ada-4778-9af4-7742d6b75b59 req-9398fa2f-c099-4460-b641-9c5d72b4cab9 service nova] Acquiring lock "refresh_cache-fae10c60-f989-4c99-bde4-60cd9f3e2055" {{(pid=74613) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 17:58:19 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-1c125eaa-3ada-4778-9af4-7742d6b75b59 req-9398fa2f-c099-4460-b641-9c5d72b4cab9 service nova] Acquired lock "refresh_cache-fae10c60-f989-4c99-bde4-60cd9f3e2055" {{(pid=74613) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 17:58:19 user nova-compute[74613]: DEBUG nova.network.neutron [req-1c125eaa-3ada-4778-9af4-7742d6b75b59 req-9398fa2f-c099-4460-b641-9c5d72b4cab9 service nova] [instance: fae10c60-f989-4c99-bde4-60cd9f3e2055] Refreshing network info cache for port 435f55bd-6b68-4466-96d8-7ca838b0a594 {{(pid=74613) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 17:58:19 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3b828860-5cc5-40b0-b845-8e560211794e/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 17:58:19 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/abc9e2b8-f467-4cd0-b40f-de511fde1ec1/disk --force-share --output=json {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 17:58:19 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-fc65ae93-e4a7-42cd-ba65-874189d46dc4 tempest-ServerActionsTestOtherB-894551005 tempest-ServerActionsTestOtherB-894551005-project-member] Acquiring lock "74ac9703-1cd7-4983-b7d4-c69b01fec7b2" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 17:58:19 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-fc65ae93-e4a7-42cd-ba65-874189d46dc4 tempest-ServerActionsTestOtherB-894551005 tempest-ServerActionsTestOtherB-894551005-project-member] Lock "74ac9703-1cd7-4983-b7d4-c69b01fec7b2" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 17:58:19 user nova-compute[74613]: INFO nova.compute.manager [None req-fc65ae93-e4a7-42cd-ba65-874189d46dc4 tempest-ServerActionsTestOtherB-894551005 tempest-ServerActionsTestOtherB-894551005-project-member] [instance: 74ac9703-1cd7-4983-b7d4-c69b01fec7b2] Attaching volume bb526b54-3017-4f30-b5c7-88027b146d52 to /dev/vdb
Nov 29 17:58:19 user nova-compute[74613]: DEBUG os_brick.utils [None req-fc65ae93-e4a7-42cd-ba65-874189d46dc4 tempest-ServerActionsTestOtherB-894551005 tempest-ServerActionsTestOtherB-894551005-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74613) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 17:58:19 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 17:58:19 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 17:58:19 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7b2d6df-2d1c-4c31-b84f-de12e41e1bc3]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:400972819b5\n', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 17:58:19 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 17:58:19 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/abc9e2b8-f467-4cd0-b40f-de511fde1ec1/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 17:58:19 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/abc9e2b8-f467-4cd0-b40f-de511fde1ec1/disk --force-share --output=json {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 17:58:19 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.014s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 17:58:19 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d9d16b1-c2b0-4bce-b1b4-6544c7c6dabe]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 17:58:19 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 17:58:19 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 17:58:19 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[d139da65-3b02-4bb2-b6d7-e0c33d755e0b]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 17:58:19 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[76d3aa43-6715-49da-a6b8-8036c5bd4f85]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 17:58:19 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-fc65ae93-e4a7-42cd-ba65-874189d46dc4 tempest-ServerActionsTestOtherB-894551005 tempest-ServerActionsTestOtherB-894551005-project-member] Running cmd (subprocess): nvme version {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 17:58:20 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-fc65ae93-e4a7-42cd-ba65-874189d46dc4 tempest-ServerActionsTestOtherB-894551005 tempest-ServerActionsTestOtherB-894551005-project-member] 'nvme version' failed. Not Retrying. {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 17:58:20 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.nvmeof [None req-fc65ae93-e4a7-42cd-ba65-874189d46dc4 tempest-ServerActionsTestOtherB-894551005 tempest-ServerActionsTestOtherB-894551005-project-member] nvme not present on system {{(pid=74613) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 29 17:58:20 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 17:58:20 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 17:58:20 user nova-compute[74613]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 29 17:58:20 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4d22447-6f39-432d-a6ce-d16e31fdd30b]: (4, '') {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 17:58:20 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.lightos [None req-fc65ae93-e4a7-42cd-ba65-874189d46dc4 tempest-ServerActionsTestOtherB-894551005 tempest-ServerActionsTestOtherB-894551005-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74613) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 29 17:58:20 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.lightos [None req-fc65ae93-e4a7-42cd-ba65-874189d46dc4 tempest-ServerActionsTestOtherB-894551005 tempest-ServerActionsTestOtherB-894551005-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74613) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 29 17:58:20 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.lightos [None req-fc65ae93-e4a7-42cd-ba65-874189d46dc4 tempest-ServerActionsTestOtherB-894551005 tempest-ServerActionsTestOtherB-894551005-project-member] LIGHTOS: no hostnqn found. {{(pid=74613) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 29 17:58:20 user nova-compute[74613]: DEBUG os_brick.utils [None req-fc65ae93-e4a7-42cd-ba65-874189d46dc4 tempest-ServerActionsTestOtherB-894551005 tempest-ServerActionsTestOtherB-894551005-project-member] <== get_connector_properties: return (177ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:400972819b5', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74613) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 17:58:20 user nova-compute[74613]: DEBUG nova.virt.block_device [None req-fc65ae93-e4a7-42cd-ba65-874189d46dc4 tempest-ServerActionsTestOtherB-894551005 tempest-ServerActionsTestOtherB-894551005-project-member] [instance: 74ac9703-1cd7-4983-b7d4-c69b01fec7b2] Updating existing volume attachment record: aa6c64c5-4648-408e-bb7e-7c097f8ed67f {{(pid=74613) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 29 17:58:20 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/abc9e2b8-f467-4cd0-b40f-de511fde1ec1/disk --force-share --output=json" returned: 0 in 0.221s {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 17:58:20 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0aa463c6-01e7-48e5-b082-e083558342e3/disk --force-share --output=json {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 17:58:20 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-e567ed9d-d98a-47ee-880a-c0d3bae519c3 tempest-TestShelveInstance-765407413 tempest-TestShelveInstance-765407413-project-member] Acquiring lock "fae10c60-f989-4c99-bde4-60cd9f3e2055" by "nova.compute.manager.ComputeManager.shelve_offload_instance.<locals>.do_shelve_offload_instance" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 17:58:20 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-e567ed9d-d98a-47ee-880a-c0d3bae519c3 tempest-TestShelveInstance-765407413 tempest-TestShelveInstance-765407413-project-member] Lock "fae10c60-f989-4c99-bde4-60cd9f3e2055" acquired by "nova.compute.manager.ComputeManager.shelve_offload_instance.<locals>.do_shelve_offload_instance" :: waited 0.002s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 17:58:20 user nova-compute[74613]: INFO nova.compute.manager [None req-e567ed9d-d98a-47ee-880a-c0d3bae519c3 tempest-TestShelveInstance-765407413 tempest-TestShelveInstance-765407413-project-member] [instance: fae10c60-f989-4c99-bde4-60cd9f3e2055] Shelve offloading
Nov 29 17:58:20 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:58:20 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:58:20 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0aa463c6-01e7-48e5-b082-e083558342e3/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 17:58:20 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0aa463c6-01e7-48e5-b082-e083558342e3/disk --force-share --output=json {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 17:58:20 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:58:20 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:58:20 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:58:20 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0aa463c6-01e7-48e5-b082-e083558342e3/disk --force-share --output=json" returned: 0 in 0.210s {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 17:58:20 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74613) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 29 17:58:20 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/356478b0-e233-46aa-a1bd-45ce1f9eca8f/disk --force-share --output=json {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 17:58:20 user nova-compute[74613]: DEBUG nova.network.neutron [req-1c125eaa-3ada-4778-9af4-7742d6b75b59 req-9398fa2f-c099-4460-b641-9c5d72b4cab9 service nova] [instance: fae10c60-f989-4c99-bde4-60cd9f3e2055] Updated VIF entry in instance network info cache for port 435f55bd-6b68-4466-96d8-7ca838b0a594. {{(pid=74613) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 17:58:20 user nova-compute[74613]: DEBUG nova.network.neutron [req-1c125eaa-3ada-4778-9af4-7742d6b75b59 req-9398fa2f-c099-4460-b641-9c5d72b4cab9 service nova] [instance: fae10c60-f989-4c99-bde4-60cd9f3e2055] Updating instance_info_cache with network_info: [{"id": "435f55bd-6b68-4466-96d8-7ca838b0a594", "address": "fa:16:3e:d5:66:27", "network": {"id": "3f3e011f-3d5c-4e32-bcae-cc1424ebf2d7", "bridge": "br-int", "label": "tempest-TestShelveInstance-1657844818-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.13", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5c079293283c4f248bc8bae125dcfbe9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap435f55bd-6b", "ovs_interfaceid": "435f55bd-6b68-4466-96d8-7ca838b0a594", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74613) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 17:58:20 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/356478b0-e233-46aa-a1bd-45ce1f9eca8f/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 17:58:20 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/356478b0-e233-46aa-a1bd-45ce1f9eca8f/disk --force-share --output=json {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 17:58:20 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-1c125eaa-3ada-4778-9af4-7742d6b75b59 req-9398fa2f-c099-4460-b641-9c5d72b4cab9 service nova] Releasing lock "refresh_cache-fae10c60-f989-4c99-bde4-60cd9f3e2055" {{(pid=74613) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 17:58:20 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/356478b0-e233-46aa-a1bd-45ce1f9eca8f/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 17:58:20 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/74ac9703-1cd7-4983-b7d4-c69b01fec7b2/disk --force-share --output=json {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 17:58:20 user nova-compute[74613]: INFO nova.virt.libvirt.driver [-] [instance: fae10c60-f989-4c99-bde4-60cd9f3e2055] Instance destroyed successfully.
Nov 29 17:58:20 user nova-compute[74613]: DEBUG nova.compute.manager [None req-e567ed9d-d98a-47ee-880a-c0d3bae519c3 tempest-TestShelveInstance-765407413 tempest-TestShelveInstance-765407413-project-member] [instance: fae10c60-f989-4c99-bde4-60cd9f3e2055] Checking state {{(pid=74613) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 29 17:58:20 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-e567ed9d-d98a-47ee-880a-c0d3bae519c3 tempest-TestShelveInstance-765407413 tempest-TestShelveInstance-765407413-project-member] Acquiring lock "refresh_cache-fae10c60-f989-4c99-bde4-60cd9f3e2055" {{(pid=74613) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 17:58:20 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-e567ed9d-d98a-47ee-880a-c0d3bae519c3 tempest-TestShelveInstance-765407413 tempest-TestShelveInstance-765407413-project-member] Acquired lock "refresh_cache-fae10c60-f989-4c99-bde4-60cd9f3e2055" {{(pid=74613) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 17:58:20 user nova-compute[74613]: DEBUG nova.network.neutron [None req-e567ed9d-d98a-47ee-880a-c0d3bae519c3 tempest-TestShelveInstance-765407413 tempest-TestShelveInstance-765407413-project-member] [instance: fae10c60-f989-4c99-bde4-60cd9f3e2055] Building network info cache for instance {{(pid=74613) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 29 17:58:21 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/74ac9703-1cd7-4983-b7d4-c69b01fec7b2/disk --force-share --output=json" returned: 0 in 0.211s {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 17:58:21 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/74ac9703-1cd7-4983-b7d4-c69b01fec7b2/disk --force-share --output=json {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 17:58:21 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/74ac9703-1cd7-4983-b7d4-c69b01fec7b2/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 17:58:21 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:58:21 user nova-compute[74613]: DEBUG nova.compute.manager [req-eb982d09-3c32-4859-8a51-818063a1cbf1 req-433b4903-727f-454e-a380-faa1693693fd service nova] [instance: fae10c60-f989-4c99-bde4-60cd9f3e2055] Received event network-vif-unplugged-435f55bd-6b68-4466-96d8-7ca838b0a594 {{(pid=74613) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 17:58:21 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-eb982d09-3c32-4859-8a51-818063a1cbf1 req-433b4903-727f-454e-a380-faa1693693fd service nova] Acquiring lock "fae10c60-f989-4c99-bde4-60cd9f3e2055-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 17:58:21 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-eb982d09-3c32-4859-8a51-818063a1cbf1 req-433b4903-727f-454e-a380-faa1693693fd service nova] Lock "fae10c60-f989-4c99-bde4-60cd9f3e2055-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 17:58:21 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-eb982d09-3c32-4859-8a51-818063a1cbf1 req-433b4903-727f-454e-a380-faa1693693fd service nova] Lock "fae10c60-f989-4c99-bde4-60cd9f3e2055-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 17:58:21 user nova-compute[74613]: DEBUG nova.compute.manager [req-eb982d09-3c32-4859-8a51-818063a1cbf1 req-433b4903-727f-454e-a380-faa1693693fd service nova] [instance: fae10c60-f989-4c99-bde4-60cd9f3e2055] No waiting events found dispatching network-vif-unplugged-435f55bd-6b68-4466-96d8-7ca838b0a594 {{(pid=74613) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 17:58:21 user nova-compute[74613]: WARNING nova.compute.manager [req-eb982d09-3c32-4859-8a51-818063a1cbf1 req-433b4903-727f-454e-a380-faa1693693fd service nova] [instance: fae10c60-f989-4c99-bde4-60cd9f3e2055] Received unexpected event network-vif-unplugged-435f55bd-6b68-4466-96d8-7ca838b0a594 for instance with vm_state active and task_state shelving.
Nov 29 17:58:21 user nova-compute[74613]: DEBUG nova.compute.manager [req-eb982d09-3c32-4859-8a51-818063a1cbf1 req-433b4903-727f-454e-a380-faa1693693fd service nova] [instance: fae10c60-f989-4c99-bde4-60cd9f3e2055] Received event network-vif-plugged-435f55bd-6b68-4466-96d8-7ca838b0a594 {{(pid=74613) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 17:58:21 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-eb982d09-3c32-4859-8a51-818063a1cbf1 req-433b4903-727f-454e-a380-faa1693693fd service nova] Acquiring lock "fae10c60-f989-4c99-bde4-60cd9f3e2055-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 17:58:21 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-eb982d09-3c32-4859-8a51-818063a1cbf1 req-433b4903-727f-454e-a380-faa1693693fd service nova] Lock "fae10c60-f989-4c99-bde4-60cd9f3e2055-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 17:58:21 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-eb982d09-3c32-4859-8a51-818063a1cbf1 req-433b4903-727f-454e-a380-faa1693693fd service nova] Lock "fae10c60-f989-4c99-bde4-60cd9f3e2055-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 17:58:21 user nova-compute[74613]: DEBUG nova.compute.manager [req-eb982d09-3c32-4859-8a51-818063a1cbf1 req-433b4903-727f-454e-a380-faa1693693fd service nova] [instance: fae10c60-f989-4c99-bde4-60cd9f3e2055] No waiting events found dispatching network-vif-plugged-435f55bd-6b68-4466-96d8-7ca838b0a594 {{(pid=74613) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 17:58:21 user nova-compute[74613]: WARNING nova.compute.manager [req-eb982d09-3c32-4859-8a51-818063a1cbf1 req-433b4903-727f-454e-a380-faa1693693fd service nova] [instance: fae10c60-f989-4c99-bde4-60cd9f3e2055] Received unexpected event network-vif-plugged-435f55bd-6b68-4466-96d8-7ca838b0a594 for instance with vm_state active and task_state shelving.
Nov 29 17:58:21 user nova-compute[74613]: WARNING nova.virt.libvirt.driver [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 17:58:21 user nova-compute[74613]: WARNING nova.virt.libvirt.driver [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 17:58:21 user nova-compute[74613]: DEBUG nova.compute.resource_tracker [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Hypervisor/Node resource view: name=user free_ram=7336MB free_disk=24.90831756591797GB free_vcpus=1 pci_devices=[{"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74613) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 29 17:58:21 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 17:58:21 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 17:58:21 user nova-compute[74613]: DEBUG nova.network.neutron [None req-e567ed9d-d98a-47ee-880a-c0d3bae519c3 tempest-TestShelveInstance-765407413 tempest-TestShelveInstance-765407413-project-member] [instance: fae10c60-f989-4c99-bde4-60cd9f3e2055] Updating instance_info_cache with network_info: [{"id": "435f55bd-6b68-4466-96d8-7ca838b0a594", "address": "fa:16:3e:d5:66:27", "network": {"id": "3f3e011f-3d5c-4e32-bcae-cc1424ebf2d7", "bridge": "br-int", "label": "tempest-TestShelveInstance-1657844818-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.13", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5c079293283c4f248bc8bae125dcfbe9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap435f55bd-6b", "ovs_interfaceid": "435f55bd-6b68-4466-96d8-7ca838b0a594", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74613) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 17:58:21 user nova-compute[74613]: DEBUG nova.compute.resource_tracker [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Instance b6b0ba36-ad89-45f1-9578-8b999567dd25 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74613) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 17:58:21 user nova-compute[74613]: DEBUG nova.compute.resource_tracker [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Instance 3b828860-5cc5-40b0-b845-8e560211794e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74613) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 17:58:21 user nova-compute[74613]: DEBUG nova.compute.resource_tracker [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Instance abc9e2b8-f467-4cd0-b40f-de511fde1ec1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74613) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 17:58:21 user nova-compute[74613]: DEBUG nova.compute.resource_tracker [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Instance cd22685a-028c-4e0c-834d-e7b20f6d06ab actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74613) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 17:58:21 user nova-compute[74613]: DEBUG nova.compute.resource_tracker [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Instance 71f2a1ab-3df7-411c-93fa-b0a1a5a44f0a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74613) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 17:58:21 user nova-compute[74613]: DEBUG nova.compute.resource_tracker [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Instance 74ac9703-1cd7-4983-b7d4-c69b01fec7b2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74613) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 17:58:21 user nova-compute[74613]: DEBUG nova.compute.resource_tracker [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Instance c4bdb712-e1f9-4fc0-b527-87088d7eddf8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74613) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 17:58:21 user nova-compute[74613]: DEBUG nova.compute.resource_tracker [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Instance 0aa463c6-01e7-48e5-b082-e083558342e3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74613) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 17:58:21 user nova-compute[74613]: DEBUG nova.compute.resource_tracker [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Instance fae10c60-f989-4c99-bde4-60cd9f3e2055 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74613) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 17:58:21 user nova-compute[74613]: DEBUG nova.compute.resource_tracker [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Instance 356478b0-e233-46aa-a1bd-45ce1f9eca8f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74613) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 17:58:21 user nova-compute[74613]: DEBUG nova.compute.resource_tracker [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Instance fce4b456-c108-439f-b0ff-7619aaf77e69 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74613) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 17:58:21 user nova-compute[74613]: DEBUG nova.compute.resource_tracker [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Total usable vcpus: 12, total allocated vcpus: 11 {{(pid=74613) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 29 17:58:21 user nova-compute[74613]: DEBUG nova.compute.resource_tracker [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Final resource view: name=user phys_ram=16011MB used_ram=6144MB phys_disk=40GB used_disk=9GB total_vcpus=12 used_vcpus=11 pci_stats=[] {{(pid=74613) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 29 17:58:21 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-e567ed9d-d98a-47ee-880a-c0d3bae519c3 tempest-TestShelveInstance-765407413 tempest-TestShelveInstance-765407413-project-member] Releasing lock "refresh_cache-fae10c60-f989-4c99-bde4-60cd9f3e2055" {{(pid=74613) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 17:58:22 user nova-compute[74613]: DEBUG nova.virt.libvirt.volume.iscsi [None req-60263073-b1d9-46ea-8b43-37969de15eba tempest-VolumesAdminNegativeTest-636556351 tempest-VolumesAdminNegativeTest-636556351-project-member] [instance: 0aa463c6-01e7-48e5-b082-e083558342e3] Calling os-brick to attach iSCSI Volume {{(pid=74613) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 29 17:58:22 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-60263073-b1d9-46ea-8b43-37969de15eba tempest-VolumesAdminNegativeTest-636556351 tempest-VolumesAdminNegativeTest-636556351-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff828156890>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:d8614e81-d01c-4ec5-9f96-46df3535d465', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jJTGiKxp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74613) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 17:58:22 user nova-compute[74613]: WARNING os_brick.initiator.connectors.base [None req-60263073-b1d9-46ea-8b43-37969de15eba tempest-VolumesAdminNegativeTest-636556351 tempest-VolumesAdminNegativeTest-636556351-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 17:58:22 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.base [None req-60263073-b1d9-46ea-8b43-37969de15eba tempest-VolumesAdminNegativeTest-636556351 tempest-VolumesAdminNegativeTest-636556351-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 17:58:22 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.base [None req-60263073-b1d9-46ea-8b43-37969de15eba tempest-VolumesAdminNegativeTest-636556351 tempest-VolumesAdminNegativeTest-636556351-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 17:58:22 user nova-compute[74613]: WARNING os_brick.initiator.connectors.base [None req-60263073-b1d9-46ea-8b43-37969de15eba tempest-VolumesAdminNegativeTest-636556351 tempest-VolumesAdminNegativeTest-636556351-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 17:58:22 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.base [None req-60263073-b1d9-46ea-8b43-37969de15eba tempest-VolumesAdminNegativeTest-636556351 tempest-VolumesAdminNegativeTest-636556351-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d8614e81-d01c-4ec5-9f96-46df3535d465" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 17:58:22 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.base [None req-60263073-b1d9-46ea-8b43-37969de15eba tempest-VolumesAdminNegativeTest-636556351 tempest-VolumesAdminNegativeTest-636556351-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d8614e81-d01c-4ec5-9f96-46df3535d465" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 17:58:22 user nova-compute[74613]: INFO os_brick.initiator.connectors.iscsi [None req-60263073-b1d9-46ea-8b43-37969de15eba tempest-VolumesAdminNegativeTest-636556351 tempest-VolumesAdminNegativeTest-636556351-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 29 17:58:22 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d8614e81-d01c-4ec5-9f96-46df3535d465 -p 172.16.0.220:3260 {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 17:58:22 user nova-compute[74613]: DEBUG nova.compute.provider_tree [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Inventory has not changed in ProviderTree for provider: 639d980e-3b12-44b1-b8f4-1812416fa4dd {{(pid=74613) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 17:58:22 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d8614e81-d01c-4ec5-9f96-46df3535d465 -p 172.16.0.220:3260" returned: 21 in 0.016s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 17:58:22 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[6dfdc5b7-59fe-4849-a892-0976bbeccb96]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 17:58:22 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-60263073-b1d9-46ea-8b43-37969de15eba tempest-VolumesAdminNegativeTest-636556351 tempest-VolumesAdminNegativeTest-636556351-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 29 17:58:22 user nova-compute[74613]:  {{(pid=74613) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 17:58:22 user nova-compute[74613]: DEBUG nova.scheduler.client.report [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Inventory has not changed for provider 639d980e-3b12-44b1-b8f4-1812416fa4dd based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74613) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 17:58:22 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d8614e81-d01c-4ec5-9f96-46df3535d465 -p 172.16.0.220:3260 --interface default --op new {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 17:58:22 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d8614e81-d01c-4ec5-9f96-46df3535d465 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 17:58:22 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[b62305e4-54cf-4049-91b7-a94d2b81c9ea]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d8614e81-d01c-4ec5-9f96-46df3535d465] added\n', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 17:58:22 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-60263073-b1d9-46ea-8b43-37969de15eba tempest-VolumesAdminNegativeTest-636556351 tempest-VolumesAdminNegativeTest-636556351-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d8614e81-d01c-4ec5-9f96-46df3535d465] added
Nov 29 17:58:22 user nova-compute[74613]:  stderr= {{(pid=74613) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 17:58:22 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d8614e81-d01c-4ec5-9f96-46df3535d465 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 17:58:22 user nova-compute[74613]: DEBUG nova.compute.resource_tracker [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Compute_service record updated for user:user {{(pid=74613) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 29 17:58:22 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.546s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 17:58:22 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d8614e81-d01c-4ec5-9f96-46df3535d465 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 17:58:22 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[8abf511d-259f-490d-8cd3-504183a0c0a5]: (4, ('', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 17:58:22 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-60263073-b1d9-46ea-8b43-37969de15eba tempest-VolumesAdminNegativeTest-636556351 tempest-VolumesAdminNegativeTest-636556351-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74613) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 17:58:22 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d8614e81-d01c-4ec5-9f96-46df3535d465 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 17:58:22 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d8614e81-d01c-4ec5-9f96-46df3535d465 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.032s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 17:58:22 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[11fccb85-0d6c-46eb-bbb4-1ef358d9b637]: (4, ('', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 17:58:22 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-60263073-b1d9-46ea-8b43-37969de15eba tempest-VolumesAdminNegativeTest-636556351 tempest-VolumesAdminNegativeTest-636556351-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74613) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 17:58:22 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d8614e81-d01c-4ec5-9f96-46df3535d465 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v jJTGiKxp {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 17:58:22 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d8614e81-d01c-4ec5-9f96-46df3535d465 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v jJTGiKxp" returned: 0 in 0.023s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 17:58:22 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[5288839e-59e5-43d8-9172-0f8e46f71986]: (4, ('', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 17:58:22 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-60263073-b1d9-46ea-8b43-37969de15eba tempest-VolumesAdminNegativeTest-636556351 tempest-VolumesAdminNegativeTest-636556351-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'jJTGiKxp'): stdout= stderr= {{(pid=74613) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 17:58:22 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d8614e81-d01c-4ec5-9f96-46df3535d465 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 17:58:22 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d8614e81-d01c-4ec5-9f96-46df3535d465 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 17:58:22 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d357efd-d300-4f6a-9500-70faabe8df97]: (4, ('', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 17:58:22 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-60263073-b1d9-46ea-8b43-37969de15eba tempest-VolumesAdminNegativeTest-636556351 tempest-VolumesAdminNegativeTest-636556351-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74613) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 17:58:22 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 17:58:22 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 17:58:22 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[95b601df-72a4-495f-aa1d-12e88783bc46]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9511387c-8772-40f2-bf2d-6b6387649e9f (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a07b572-6430-4d0f-9aaf-8a8dbc39831e (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:72d22ffa-f425-4575-86a5-afbd8bb9cdd6 (non-flash)\n', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 17:58:22 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-60263073-b1d9-46ea-8b43-37969de15eba tempest-VolumesAdminNegativeTest-636556351 tempest-VolumesAdminNegativeTest-636556351-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9511387c-8772-40f2-bf2d-6b6387649e9f (non-flash)
Nov 29 17:58:22 user nova-compute[74613]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a07b572-6430-4d0f-9aaf-8a8dbc39831e (non-flash)
Nov 29 17:58:22 user nova-compute[74613]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:72d22ffa-f425-4575-86a5-afbd8bb9cdd6 (non-flash)
Nov 29 17:58:22 user nova-compute[74613]:  stderr= {{(pid=74613) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 17:58:22 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-60263073-b1d9-46ea-8b43-37969de15eba tempest-VolumesAdminNegativeTest-636556351 tempest-VolumesAdminNegativeTest-636556351-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9511387c-8772-40f2-bf2d-6b6387649e9f (non-flash)
Nov 29 17:58:22 user nova-compute[74613]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a07b572-6430-4d0f-9aaf-8a8dbc39831e (non-flash)
Nov 29 17:58:22 user nova-compute[74613]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:72d22ffa-f425-4575-86a5-afbd8bb9cdd6 (non-flash)
Nov 29 17:58:22 user nova-compute[74613]:  stderr= {{(pid=74613) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 17:58:22 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d8614e81-d01c-4ec5-9f96-46df3535d465 -p 172.16.0.220:3260 --login {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 17:58:22 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d8614e81-d01c-4ec5-9f96-46df3535d465 -p 172.16.0.220:3260 --login" returned: 0 in 0.067s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 17:58:22 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3cde925-bcdc-467f-9149-701de08ca3cc]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:d8614e81-d01c-4ec5-9f96-46df3535d465, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:d8614e81-d01c-4ec5-9f96-46df3535d465, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 17:58:22 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-60263073-b1d9-46ea-8b43-37969de15eba tempest-VolumesAdminNegativeTest-636556351 tempest-VolumesAdminNegativeTest-636556351-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:d8614e81-d01c-4ec5-9f96-46df3535d465, portal: 172.16.0.220,3260]
Nov 29 17:58:22 user nova-compute[74613]: Login to [iface: default, target: iqn.2010-10.org.openstack:d8614e81-d01c-4ec5-9f96-46df3535d465, portal: 172.16.0.220,3260] successful.
Nov 29 17:58:22 user nova-compute[74613]:  stderr= {{(pid=74613) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 17:58:22 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d8614e81-d01c-4ec5-9f96-46df3535d465 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 17:58:22 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d8614e81-d01c-4ec5-9f96-46df3535d465 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 17:58:22 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[c68d0760-c4ed-4881-976a-1dd694e3da89]: (4, ('', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 17:58:22 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-60263073-b1d9-46ea-8b43-37969de15eba tempest-VolumesAdminNegativeTest-636556351 tempest-VolumesAdminNegativeTest-636556351-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74613) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 17:58:22 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 17:58:22 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 17:58:22 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[e68afb16-d0f4-464b-a388-6fd9b665807d]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9511387c-8772-40f2-bf2d-6b6387649e9f (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a07b572-6430-4d0f-9aaf-8a8dbc39831e (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:72d22ffa-f425-4575-86a5-afbd8bb9cdd6 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d8614e81-d01c-4ec5-9f96-46df3535d465 (non-flash)\n', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 17:58:22 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-60263073-b1d9-46ea-8b43-37969de15eba tempest-VolumesAdminNegativeTest-636556351 tempest-VolumesAdminNegativeTest-636556351-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9511387c-8772-40f2-bf2d-6b6387649e9f (non-flash)
Nov 29 17:58:22 user nova-compute[74613]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a07b572-6430-4d0f-9aaf-8a8dbc39831e (non-flash)
Nov 29 17:58:22 user nova-compute[74613]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:72d22ffa-f425-4575-86a5-afbd8bb9cdd6 (non-flash)
Nov 29 17:58:22 user nova-compute[74613]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d8614e81-d01c-4ec5-9f96-46df3535d465 (non-flash)
Nov 29 17:58:22 user nova-compute[74613]:  stderr= {{(pid=74613) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 17:58:22 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-60263073-b1d9-46ea-8b43-37969de15eba tempest-VolumesAdminNegativeTest-636556351 tempest-VolumesAdminNegativeTest-636556351-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9511387c-8772-40f2-bf2d-6b6387649e9f (non-flash)
Nov 29 17:58:22 user nova-compute[74613]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a07b572-6430-4d0f-9aaf-8a8dbc39831e (non-flash)
Nov 29 17:58:22 user nova-compute[74613]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:72d22ffa-f425-4575-86a5-afbd8bb9cdd6 (non-flash)
Nov 29 17:58:22 user nova-compute[74613]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d8614e81-d01c-4ec5-9f96-46df3535d465 (non-flash)
Nov 29 17:58:22 user nova-compute[74613]:  stderr= {{(pid=74613) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 17:58:22 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.base [None req-60263073-b1d9-46ea-8b43-37969de15eba tempest-VolumesAdminNegativeTest-636556351 tempest-VolumesAdminNegativeTest-636556351-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d8614e81-d01c-4ec5-9f96-46df3535d465" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.315s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 17:58:22 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-60263073-b1d9-46ea-8b43-37969de15eba tempest-VolumesAdminNegativeTest-636556351 tempest-VolumesAdminNegativeTest-636556351-project-member] Connected to 172.16.0.220:3260 {{(pid=74613) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 29 17:58:22 user nova-compute[74613]: DEBUG os_brick.initiator.linuxscsi [None req-60263073-b1d9-46ea-8b43-37969de15eba tempest-VolumesAdminNegativeTest-636556351 tempest-VolumesAdminNegativeTest-636556351-project-member] HCTL ('34', '-', '-', 0) found on session 20 with lun 0 {{(pid=74613) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 29 17:58:22 user nova-compute[74613]: DEBUG os_brick.initiator.linuxscsi [None req-60263073-b1d9-46ea-8b43-37969de15eba tempest-VolumesAdminNegativeTest-636556351 tempest-VolumesAdminNegativeTest-636556351-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=74613) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 29 17:58:22 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 17:58:22 user nova-compute[74613]: INFO nova.virt.libvirt.driver [-] [instance: fae10c60-f989-4c99-bde4-60cd9f3e2055] Instance destroyed successfully.
Nov 29 17:58:22 user nova-compute[74613]: DEBUG nova.objects.instance [None req-e567ed9d-d98a-47ee-880a-c0d3bae519c3 tempest-TestShelveInstance-765407413 tempest-TestShelveInstance-765407413-project-member] Lazy-loading 'resources' on Instance uuid fae10c60-f989-4c99-bde4-60cd9f3e2055 {{(pid=74613) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 17:58:22 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.018s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 17:58:22 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[16c04fb1-c26c-4918-a7c1-3a49f8b93bdb]: (4, ('- - 0', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 17:58:22 user nova-compute[74613]: DEBUG os_brick.initiator.linuxscsi [None req-60263073-b1d9-46ea-8b43-37969de15eba tempest-VolumesAdminNegativeTest-636556351 tempest-VolumesAdminNegativeTest-636556351-project-member] Searching for a device in session 20 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=74613) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 29 17:58:22 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-60263073-b1d9-46ea-8b43-37969de15eba tempest-VolumesAdminNegativeTest-636556351 tempest-VolumesAdminNegativeTest-636556351-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:d8614e81-d01c-4ec5-9f96-46df3535d465', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jJTGiKxp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74613) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 29 17:58:22 user nova-compute[74613]: DEBUG nova.virt.libvirt.vif [None req-e567ed9d-d98a-47ee-880a-c0d3bae519c3 tempest-TestShelveInstance-765407413 tempest-TestShelveInstance-765407413-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T17:56:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-1000519643',display_name='tempest-TestShelveInstance-server-1000519643',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-1000519643',id=17,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIf0ckq9VTzT5zGxHlDNferoBY2qwcYhFAXkrikI+NkgwSPctxoKzz9bP5zmVCPOQOOhQGndx3fZHEpLC6hFyIVKKa+ebw7eRNhm0TtBMSe+I3x4HRsQTY3UyYkb58qQfQ==',key_name='tempest-TestShelveInstance-195591000',keypairs=<?>,launch_index=0,launched_at=2023-11-29T17:56:44Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='5c079293283c4f248bc8bae125dcfbe9',ramdisk_id='',reservation_id='r-a58ey1iu',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-765407413',owner_user_name='tempest-TestShelveInstance-765407413-project-member'},tags=<?>,task_state='shelving',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-29T17:56:45Z,user_data=None,user_id='b4bdd0503dbb42e3a9fc3c7d3cfe3b08',uuid=fae10c60-f989-4c99-bde4-60cd9f3e2055,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "435f55bd-6b68-4466-96d8-7ca838b0a594", "address": "fa:16:3e:d5:66:27", "network": {"id": "3f3e011f-3d5c-4e32-bcae-cc1424ebf2d7", "bridge": "br-int", "label": "tempest-TestShelveInstance-1657844818-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.13", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5c079293283c4f248bc8bae125dcfbe9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap435f55bd-6b", "ovs_interfaceid": "435f55bd-6b68-4466-96d8-7ca838b0a594", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74613) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 29 17:58:22 user nova-compute[74613]: DEBUG nova.network.os_vif_util [None req-e567ed9d-d98a-47ee-880a-c0d3bae519c3 tempest-TestShelveInstance-765407413 tempest-TestShelveInstance-765407413-project-member] Converting VIF {"id": "435f55bd-6b68-4466-96d8-7ca838b0a594", "address": "fa:16:3e:d5:66:27", "network": {"id": "3f3e011f-3d5c-4e32-bcae-cc1424ebf2d7", "bridge": "br-int", "label": "tempest-TestShelveInstance-1657844818-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.13", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5c079293283c4f248bc8bae125dcfbe9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap435f55bd-6b", "ovs_interfaceid": "435f55bd-6b68-4466-96d8-7ca838b0a594", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74613) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 17:58:22 user nova-compute[74613]: DEBUG nova.network.os_vif_util [None req-e567ed9d-d98a-47ee-880a-c0d3bae519c3 tempest-TestShelveInstance-765407413 tempest-TestShelveInstance-765407413-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d5:66:27,bridge_name='br-int',has_traffic_filtering=True,id=435f55bd-6b68-4466-96d8-7ca838b0a594,network=Network(3f3e011f-3d5c-4e32-bcae-cc1424ebf2d7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap435f55bd-6b') {{(pid=74613) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 17:58:22 user nova-compute[74613]: DEBUG os_vif [None req-e567ed9d-d98a-47ee-880a-c0d3bae519c3 tempest-TestShelveInstance-765407413 tempest-TestShelveInstance-765407413-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d5:66:27,bridge_name='br-int',has_traffic_filtering=True,id=435f55bd-6b68-4466-96d8-7ca838b0a594,network=Network(3f3e011f-3d5c-4e32-bcae-cc1424ebf2d7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap435f55bd-6b') {{(pid=74613) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 29 17:58:22 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:58:22 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap435f55bd-6b, bridge=br-int, if_exists=True) {{(pid=74613) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 17:58:22 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:58:22 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 17:58:22 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:58:22 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=cbf83aa8-c07f-400f-bbf0-021357a36cc0) {{(pid=74613) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 17:58:22 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:58:22 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 17:58:22 user nova-compute[74613]: INFO os_vif [None req-e567ed9d-d98a-47ee-880a-c0d3bae519c3 tempest-TestShelveInstance-765407413 tempest-TestShelveInstance-765407413-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d5:66:27,bridge_name='br-int',has_traffic_filtering=True,id=435f55bd-6b68-4466-96d8-7ca838b0a594,network=Network(3f3e011f-3d5c-4e32-bcae-cc1424ebf2d7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap435f55bd-6b')
Nov 29 17:58:22 user nova-compute[74613]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e567ed9d-d98a-47ee-880a-c0d3bae519c3 tempest-TestShelveInstance-765407413 tempest-TestShelveInstance-765407413-project-member] [instance: fae10c60-f989-4c99-bde4-60cd9f3e2055] calling os-brick to detach iSCSI Volume {{(pid=74613) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 29 17:58:22 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-e567ed9d-d98a-47ee-880a-c0d3bae519c3 tempest-TestShelveInstance-765407413 tempest-TestShelveInstance-765407413-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff828156890>, {'target_iqn': 'iqn.2010-10.org.openstack:6a07b572-6430-4d0f-9aaf-8a8dbc39831e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BZedJSro', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': True}}" {{(pid=74613) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 17:58:22 user nova-compute[74613]: WARNING os_brick.initiator.connectors.base [None req-e567ed9d-d98a-47ee-880a-c0d3bae519c3 tempest-TestShelveInstance-765407413 tempest-TestShelveInstance-765407413-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 17:58:22 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.base [None req-e567ed9d-d98a-47ee-880a-c0d3bae519c3 tempest-TestShelveInstance-765407413 tempest-TestShelveInstance-765407413-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 17:58:22 user nova-compute[74613]: DEBUG nova.compute.manager [req-814df476-30fe-4a76-aa26-9862938c61fb req-99b4cedb-04f7-4aee-8383-05d335d25862 service nova] [instance: fae10c60-f989-4c99-bde4-60cd9f3e2055] Received event network-changed-435f55bd-6b68-4466-96d8-7ca838b0a594 {{(pid=74613) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 17:58:22 user nova-compute[74613]: DEBUG nova.compute.manager [req-814df476-30fe-4a76-aa26-9862938c61fb req-99b4cedb-04f7-4aee-8383-05d335d25862 service nova] [instance: fae10c60-f989-4c99-bde4-60cd9f3e2055] Refreshing instance network info cache due to event network-changed-435f55bd-6b68-4466-96d8-7ca838b0a594. {{(pid=74613) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 17:58:22 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-814df476-30fe-4a76-aa26-9862938c61fb req-99b4cedb-04f7-4aee-8383-05d335d25862 service nova] Acquiring lock "refresh_cache-fae10c60-f989-4c99-bde4-60cd9f3e2055" {{(pid=74613) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 17:58:22 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-814df476-30fe-4a76-aa26-9862938c61fb req-99b4cedb-04f7-4aee-8383-05d335d25862 service nova] Acquired lock "refresh_cache-fae10c60-f989-4c99-bde4-60cd9f3e2055" {{(pid=74613) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 17:58:22 user nova-compute[74613]: DEBUG nova.network.neutron [req-814df476-30fe-4a76-aa26-9862938c61fb req-99b4cedb-04f7-4aee-8383-05d335d25862 service nova] [instance: fae10c60-f989-4c99-bde4-60cd9f3e2055] Refreshing network info cache for port 435f55bd-6b68-4466-96d8-7ca838b0a594 {{(pid=74613) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 17:58:23 user nova-compute[74613]: DEBUG nova.network.neutron [req-814df476-30fe-4a76-aa26-9862938c61fb req-99b4cedb-04f7-4aee-8383-05d335d25862 service nova] [instance: fae10c60-f989-4c99-bde4-60cd9f3e2055] Updated VIF entry in instance network info cache for port 435f55bd-6b68-4466-96d8-7ca838b0a594. {{(pid=74613) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 17:58:23 user nova-compute[74613]: DEBUG nova.network.neutron [req-814df476-30fe-4a76-aa26-9862938c61fb req-99b4cedb-04f7-4aee-8383-05d335d25862 service nova] [instance: fae10c60-f989-4c99-bde4-60cd9f3e2055] Updating instance_info_cache with network_info: [{"id": "435f55bd-6b68-4466-96d8-7ca838b0a594", "address": "fa:16:3e:d5:66:27", "network": {"id": "3f3e011f-3d5c-4e32-bcae-cc1424ebf2d7", "bridge": null, "label": "tempest-TestShelveInstance-1657844818-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.13", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5c079293283c4f248bc8bae125dcfbe9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "unbound", "details": {}, "devname": "tap435f55bd-6b", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74613) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 17:58:23 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-814df476-30fe-4a76-aa26-9862938c61fb req-99b4cedb-04f7-4aee-8383-05d335d25862 service nova] Releasing lock "refresh_cache-fae10c60-f989-4c99-bde4-60cd9f3e2055" {{(pid=74613) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 17:58:23 user nova-compute[74613]: DEBUG oslo_service.periodic_task [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74613) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 17:58:23 user nova-compute[74613]: DEBUG oslo_service.periodic_task [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74613) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 17:58:23 user nova-compute[74613]: DEBUG nova.compute.manager [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Starting heal instance info cache {{(pid=74613) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 29 17:58:23 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Acquiring lock "refresh_cache-3b828860-5cc5-40b0-b845-8e560211794e" {{(pid=74613) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 17:58:23 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Acquired lock "refresh_cache-3b828860-5cc5-40b0-b845-8e560211794e" {{(pid=74613) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 17:58:23 user nova-compute[74613]: DEBUG nova.network.neutron [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] [instance: 3b828860-5cc5-40b0-b845-8e560211794e] Forcefully refreshing network info cache for instance {{(pid=74613) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 29 17:58:23 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.base [None req-60263073-b1d9-46ea-8b43-37969de15eba tempest-VolumesAdminNegativeTest-636556351 tempest-VolumesAdminNegativeTest-636556351-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.351s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 17:58:23 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-60263073-b1d9-46ea-8b43-37969de15eba tempest-VolumesAdminNegativeTest-636556351 tempest-VolumesAdminNegativeTest-636556351-project-member] <== connect_volume: return (1353ms) {'type': 'block', 'scsi_wwn': '23236616434336336', 'path': '/dev/sdc'} {{(pid=74613) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 17:58:23 user nova-compute[74613]: DEBUG nova.virt.libvirt.volume.iscsi [None req-60263073-b1d9-46ea-8b43-37969de15eba tempest-VolumesAdminNegativeTest-636556351 tempest-VolumesAdminNegativeTest-636556351-project-member] [instance: 0aa463c6-01e7-48e5-b082-e083558342e3] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23236616434336336', 'path': '/dev/sdc'} {{(pid=74613) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 29 17:58:23 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.base [None req-e567ed9d-d98a-47ee-880a-c0d3bae519c3 tempest-TestShelveInstance-765407413 tempest-TestShelveInstance-765407413-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.962s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 17:58:23 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 17:58:23 user nova-compute[74613]: DEBUG nova.objects.instance [None req-60263073-b1d9-46ea-8b43-37969de15eba tempest-VolumesAdminNegativeTest-636556351 tempest-VolumesAdminNegativeTest-636556351-project-member] Lazy-loading 'flavor' on Instance uuid 0aa463c6-01e7-48e5-b082-e083558342e3 {{(pid=74613) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 17:58:23 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 17:58:23 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[7af81c48-5caf-4d77-9584-8d5a8933ddee]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:9511387c-8772-40f2-bf2d-6b6387649e9f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:6a07b572-6430-4d0f-9aaf-8a8dbc39831e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d8614e81-d01c-4ec5-9f96-46df3535d465\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:72d22ffa-f425-4575-86a5-afbd8bb9cdd6\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 17:58:23 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-e567ed9d-d98a-47ee-880a-c0d3bae519c3 tempest-TestShelveInstance-765407413 tempest-TestShelveInstance-765407413-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 29 17:58:23 user nova-compute[74613]: No targets found.
Nov 29 17:58:23 user nova-compute[74613]: iSNS:
Nov 29 17:58:23 user nova-compute[74613]: No targets found.
Nov 29 17:58:23 user nova-compute[74613]: STATIC:
Nov 29 17:58:23 user nova-compute[74613]: Target: iqn.2010-10.org.openstack:9511387c-8772-40f2-bf2d-6b6387649e9f
Nov 29 17:58:23 user nova-compute[74613]:         Portal: 172.16.0.220:3260,-1
Nov 29 17:58:23 user nova-compute[74613]:                 Iface Name: default
Nov 29 17:58:23 user nova-compute[74613]: Target: iqn.2010-10.org.openstack:6a07b572-6430-4d0f-9aaf-8a8dbc39831e
Nov 29 17:58:23 user nova-compute[74613]:         Portal: 172.16.0.220:3260,-1
Nov 29 17:58:23 user nova-compute[74613]:                 Iface Name: default
Nov 29 17:58:23 user nova-compute[74613]: Target: iqn.2010-10.org.openstack:d8614e81-d01c-4ec5-9f96-46df3535d465
Nov 29 17:58:23 user nova-compute[74613]:         Portal: 172.16.0.220:3260,-1
Nov 29 17:58:23 user nova-compute[74613]:                 Iface Name: default
Nov 29 17:58:23 user nova-compute[74613]: Target: iqn.2010-10.org.openstack:72d22ffa-f425-4575-86a5-afbd8bb9cdd6
Nov 29 17:58:23 user nova-compute[74613]:         Portal: 172.16.0.220:3260,-1
Nov 29 17:58:23 user nova-compute[74613]:                 Iface Name: default
Nov 29 17:58:23 user nova-compute[74613]: FIRMWARE:
Nov 29 17:58:23 user nova-compute[74613]: No targets found.
Nov 29 17:58:23 user nova-compute[74613]:  stderr= {{(pid=74613) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 17:58:23 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-e567ed9d-d98a-47ee-880a-c0d3bae519c3 tempest-TestShelveInstance-765407413 tempest-TestShelveInstance-765407413-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 29 17:58:23 user nova-compute[74613]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 29 17:58:23 user nova-compute[74613]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74613) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 29 17:58:23 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-e567ed9d-d98a-47ee-880a-c0d3bae519c3 tempest-TestShelveInstance-765407413 tempest-TestShelveInstance-765407413-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6a07b572-6430-4d0f-9aaf-8a8dbc39831e', 0)] {{(pid=74613) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 29 17:58:23 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 17:58:23 user nova-compute[74613]: DEBUG nova.virt.libvirt.guest [None req-60263073-b1d9-46ea-8b43-37969de15eba tempest-VolumesAdminNegativeTest-636556351 tempest-VolumesAdminNegativeTest-636556351-project-member] attach device xml: <disk type="block" device="disk">
Nov 29 17:58:23 user nova-compute[74613]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 17:58:23 user nova-compute[74613]:   <source dev="/dev/sdc"/>
Nov 29 17:58:23 user nova-compute[74613]:   <target dev="vdb" bus="virtio"/>
Nov 29 17:58:23 user nova-compute[74613]:   <serial>d8614e81-d01c-4ec5-9f96-46df3535d465</serial>
Nov 29 17:58:23 user nova-compute[74613]: </disk>
Nov 29 17:58:23 user nova-compute[74613]:  {{(pid=74613) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 29 17:58:23 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 17:58:23 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[df6c65b0-f584-47e6-afb8-11aafc7d57ae]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6a07b572-6430-4d0f-9aaf-8a8dbc39831e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:72d22ffa-f425-4575-86a5-afbd8bb9cdd6\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9511387c-8772-40f2-bf2d-6b6387649e9f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d8614e81-d01c-4ec5-9f96-46df3535d465\n', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 17:58:23 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 17:58:23 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 17:58:23 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a759bd3-beed-4bb2-895a-6e1fdaa88c94]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9511387c-8772-40f2-bf2d-6b6387649e9f (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a07b572-6430-4d0f-9aaf-8a8dbc39831e (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:72d22ffa-f425-4575-86a5-afbd8bb9cdd6 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d8614e81-d01c-4ec5-9f96-46df3535d465 (non-flash)\n', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 17:58:23 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-e567ed9d-d98a-47ee-880a-c0d3bae519c3 tempest-TestShelveInstance-765407413 tempest-TestShelveInstance-765407413-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9511387c-8772-40f2-bf2d-6b6387649e9f (non-flash)
Nov 29 17:58:23 user nova-compute[74613]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a07b572-6430-4d0f-9aaf-8a8dbc39831e (non-flash)
Nov 29 17:58:23 user nova-compute[74613]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:72d22ffa-f425-4575-86a5-afbd8bb9cdd6 (non-flash)
Nov 29 17:58:23 user nova-compute[74613]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d8614e81-d01c-4ec5-9f96-46df3535d465 (non-flash)
Nov 29 17:58:23 user nova-compute[74613]:  stderr= {{(pid=74613) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 17:58:23 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-e567ed9d-d98a-47ee-880a-c0d3bae519c3 tempest-TestShelveInstance-765407413 tempest-TestShelveInstance-765407413-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9511387c-8772-40f2-bf2d-6b6387649e9f (non-flash)
Nov 29 17:58:23 user nova-compute[74613]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a07b572-6430-4d0f-9aaf-8a8dbc39831e (non-flash)
Nov 29 17:58:23 user nova-compute[74613]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:72d22ffa-f425-4575-86a5-afbd8bb9cdd6 (non-flash)
Nov 29 17:58:23 user nova-compute[74613]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d8614e81-d01c-4ec5-9f96-46df3535d465 (non-flash)
Nov 29 17:58:23 user nova-compute[74613]:  stderr= {{(pid=74613) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 17:58:23 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-e567ed9d-d98a-47ee-880a-c0d3bae519c3 tempest-TestShelveInstance-765407413 tempest-TestShelveInstance-765407413-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7ff818293e20>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6a07b572-6430-4d0f-9aaf-8a8dbc39831e'): ({'sde'}, set())}) {{(pid=74613) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 29 17:58:23 user nova-compute[74613]: DEBUG os_brick.initiator.linuxscsi [None req-e567ed9d-d98a-47ee-880a-c0d3bae519c3 tempest-TestShelveInstance-765407413 tempest-TestShelveInstance-765407413-project-member] Removing single pathed devices sde {{(pid=74613) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 29 17:58:23 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 17:58:23 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 17:58:23 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef98a21d-2b02-423e-b887-5fb809880808]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 17:58:23 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 17:58:23 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.023s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 17:58:23 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[abd990c3-fd66-422b-8f3f-66c86f49b8ee]: (4, ('ok\n', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 17:58:23 user nova-compute[74613]: DEBUG os_brick.initiator.linuxscsi [None req-e567ed9d-d98a-47ee-880a-c0d3bae519c3 tempest-TestShelveInstance-765407413 tempest-TestShelveInstance-765407413-project-member] Flushing IO for device /dev/sde {{(pid=74613) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 29 17:58:23 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 17:58:23 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.013s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 17:58:23 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[864118cf-b11e-4ab2-b162-be0217f0dae6]: (4, ('', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 17:58:23 user nova-compute[74613]: DEBUG os_brick.initiator.linuxscsi [None req-e567ed9d-d98a-47ee-880a-c0d3bae519c3 tempest-TestShelveInstance-765407413 tempest-TestShelveInstance-765407413-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=74613) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 29 17:58:23 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 17:58:23 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.043s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 17:58:23 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[974e4128-7456-41a8-a7bf-d030ab059fd4]: (4, ('1', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 17:58:23 user nova-compute[74613]: DEBUG os_brick.initiator.linuxscsi [None req-e567ed9d-d98a-47ee-880a-c0d3bae519c3 tempest-TestShelveInstance-765407413 tempest-TestShelveInstance-765407413-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=74613) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 29 17:58:23 user nova-compute[74613]: DEBUG os_brick.initiator.linuxscsi [None req-e567ed9d-d98a-47ee-880a-c0d3bae519c3 tempest-TestShelveInstance-765407413 tempest-TestShelveInstance-765407413-project-member] SCSI volumes sde have been removed. {{(pid=74613) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 29 17:58:23 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-e567ed9d-d98a-47ee-880a-c0d3bae519c3 tempest-TestShelveInstance-765407413 tempest-TestShelveInstance-765407413-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6a07b572-6430-4d0f-9aaf-8a8dbc39831e')] {{(pid=74613) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 29 17:58:23 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6a07b572-6430-4d0f-9aaf-8a8dbc39831e -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 17:58:23 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6a07b572-6430-4d0f-9aaf-8a8dbc39831e -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.024s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 17:58:23 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[eccc452b-965f-49d0-a15b-8d5feef6add4]: (4, ('', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 17:58:23 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-e567ed9d-d98a-47ee-880a-c0d3bae519c3 tempest-TestShelveInstance-765407413 tempest-TestShelveInstance-765407413-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74613) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 17:58:23 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6a07b572-6430-4d0f-9aaf-8a8dbc39831e -p 172.16.0.220:3260 --logout {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 17:58:23 user nova-compute[74613]: DEBUG nova.network.neutron [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] [instance: 3b828860-5cc5-40b0-b845-8e560211794e] Updating instance_info_cache with network_info: [{"id": "dfe097e1-192f-47e2-96b7-0e9fe8320758", "address": "fa:16:3e:c2:a8:2f", "network": {"id": "0722b02d-a357-4360-87e8-580913723985", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-579793494-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b820dd795dfe46cd804772f0e71f98e9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdfe097e1-19", "ovs_interfaceid": "dfe097e1-192f-47e2-96b7-0e9fe8320758", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74613) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 17:58:23 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Releasing lock "refresh_cache-3b828860-5cc5-40b0-b845-8e560211794e" {{(pid=74613) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 17:58:23 user nova-compute[74613]: DEBUG nova.compute.manager [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] [instance: 3b828860-5cc5-40b0-b845-8e560211794e] Updated the network info_cache for instance {{(pid=74613) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 29 17:58:23 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6a07b572-6430-4d0f-9aaf-8a8dbc39831e -p 172.16.0.220:3260 --logout" returned: 0 in 0.070s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 17:58:23 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[64b5b117-638a-470f-9c19-dc9ea75254f8]: (4, ('Logging out of session [sid: 17, target: iqn.2010-10.org.openstack:6a07b572-6430-4d0f-9aaf-8a8dbc39831e, portal: 172.16.0.220,3260]\nLogout of [sid: 17, target: iqn.2010-10.org.openstack:6a07b572-6430-4d0f-9aaf-8a8dbc39831e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 17:58:23 user nova-compute[74613]: DEBUG oslo_service.periodic_task [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74613) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 17:58:23 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-e567ed9d-d98a-47ee-880a-c0d3bae519c3 tempest-TestShelveInstance-765407413 tempest-TestShelveInstance-765407413-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 17, target: iqn.2010-10.org.openstack:6a07b572-6430-4d0f-9aaf-8a8dbc39831e, portal: 172.16.0.220,3260]
Nov 29 17:58:23 user nova-compute[74613]: Logout of [sid: 17, target: iqn.2010-10.org.openstack:6a07b572-6430-4d0f-9aaf-8a8dbc39831e, portal: 172.16.0.220,3260] successful.
Nov 29 17:58:23 user nova-compute[74613]:  stderr= {{(pid=74613) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 17:58:23 user nova-compute[74613]: DEBUG oslo_service.periodic_task [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74613) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 17:58:23 user nova-compute[74613]: DEBUG oslo_service.periodic_task [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74613) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 17:58:23 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6a07b572-6430-4d0f-9aaf-8a8dbc39831e -p 172.16.0.220:3260 --op delete {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 17:58:23 user nova-compute[74613]: DEBUG oslo_service.periodic_task [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74613) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 17:58:23 user nova-compute[74613]: DEBUG nova.compute.manager [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74613) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 29 17:58:23 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6a07b572-6430-4d0f-9aaf-8a8dbc39831e -p 172.16.0.220:3260 --op delete" returned: 0 in 0.025s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 17:58:23 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[9606ccff-e8a2-4174-ba76-03b0e2389f9e]: (4, ('', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 17:58:23 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-e567ed9d-d98a-47ee-880a-c0d3bae519c3 tempest-TestShelveInstance-765407413 tempest-TestShelveInstance-765407413-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74613) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 17:58:23 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.base [None req-e567ed9d-d98a-47ee-880a-c0d3bae519c3 tempest-TestShelveInstance-765407413 tempest-TestShelveInstance-765407413-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.350s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 17:58:23 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-e567ed9d-d98a-47ee-880a-c0d3bae519c3 tempest-TestShelveInstance-765407413 tempest-TestShelveInstance-765407413-project-member] <== disconnect_volume: return (1312ms) None {{(pid=74613) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 17:58:23 user nova-compute[74613]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e567ed9d-d98a-47ee-880a-c0d3bae519c3 tempest-TestShelveInstance-765407413 tempest-TestShelveInstance-765407413-project-member] [instance: fae10c60-f989-4c99-bde4-60cd9f3e2055] Disconnected iSCSI Volume {{(pid=74613) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 29 17:58:23 user nova-compute[74613]: INFO nova.virt.libvirt.driver [None req-e567ed9d-d98a-47ee-880a-c0d3bae519c3 tempest-TestShelveInstance-765407413 tempest-TestShelveInstance-765407413-project-member] [instance: fae10c60-f989-4c99-bde4-60cd9f3e2055] Deleting instance files /opt/stack/data/nova/instances/fae10c60-f989-4c99-bde4-60cd9f3e2055_del
Nov 29 17:58:23 user nova-compute[74613]: INFO nova.virt.libvirt.driver [None req-e567ed9d-d98a-47ee-880a-c0d3bae519c3 tempest-TestShelveInstance-765407413 tempest-TestShelveInstance-765407413-project-member] [instance: fae10c60-f989-4c99-bde4-60cd9f3e2055] Deletion of /opt/stack/data/nova/instances/fae10c60-f989-4c99-bde4-60cd9f3e2055_del complete
Nov 29 17:58:24 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-60263073-b1d9-46ea-8b43-37969de15eba tempest-VolumesAdminNegativeTest-636556351 tempest-VolumesAdminNegativeTest-636556351-project-member] No BDM found with device name vda, not building metadata. {{(pid=74613) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 17:58:24 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-60263073-b1d9-46ea-8b43-37969de15eba tempest-VolumesAdminNegativeTest-636556351 tempest-VolumesAdminNegativeTest-636556351-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74613) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 17:58:24 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-60263073-b1d9-46ea-8b43-37969de15eba tempest-VolumesAdminNegativeTest-636556351 tempest-VolumesAdminNegativeTest-636556351-project-member] No VIF found with MAC fa:16:3e:78:6a:83, not building metadata {{(pid=74613) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 29 17:58:24 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-60263073-b1d9-46ea-8b43-37969de15eba tempest-VolumesAdminNegativeTest-636556351 tempest-VolumesAdminNegativeTest-636556351-project-member] Lock "0aa463c6-01e7-48e5-b082-e083558342e3" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 10.133s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 17:58:25 user nova-compute[74613]: INFO nova.scheduler.client.report [None req-e567ed9d-d98a-47ee-880a-c0d3bae519c3 tempest-TestShelveInstance-765407413 tempest-TestShelveInstance-765407413-project-member] Deleted allocations for instance fae10c60-f989-4c99-bde4-60cd9f3e2055
Nov 29 17:58:25 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-e567ed9d-d98a-47ee-880a-c0d3bae519c3 tempest-TestShelveInstance-765407413 tempest-TestShelveInstance-765407413-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 17:58:25 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-e567ed9d-d98a-47ee-880a-c0d3bae519c3 tempest-TestShelveInstance-765407413 tempest-TestShelveInstance-765407413-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 17:58:25 user nova-compute[74613]: DEBUG nova.objects.instance [None req-e567ed9d-d98a-47ee-880a-c0d3bae519c3 tempest-TestShelveInstance-765407413 tempest-TestShelveInstance-765407413-project-member] Lazy-loading 'numa_topology' on Instance uuid fae10c60-f989-4c99-bde4-60cd9f3e2055 {{(pid=74613) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 17:58:25 user nova-compute[74613]: DEBUG nova.objects.base [None req-e567ed9d-d98a-47ee-880a-c0d3bae519c3 tempest-TestShelveInstance-765407413 tempest-TestShelveInstance-765407413-project-member] Object Instance<fae10c60-f989-4c99-bde4-60cd9f3e2055> lazy-loaded attributes: resources,numa_topology {{(pid=74613) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 29 17:58:25 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:58:25 user nova-compute[74613]: DEBUG nova.compute.provider_tree [None req-e567ed9d-d98a-47ee-880a-c0d3bae519c3 tempest-TestShelveInstance-765407413 tempest-TestShelveInstance-765407413-project-member] Inventory has not changed in ProviderTree for provider: 639d980e-3b12-44b1-b8f4-1812416fa4dd {{(pid=74613) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 17:58:25 user nova-compute[74613]: DEBUG nova.scheduler.client.report [None req-e567ed9d-d98a-47ee-880a-c0d3bae519c3 tempest-TestShelveInstance-765407413 tempest-TestShelveInstance-765407413-project-member] Inventory has not changed for provider 639d980e-3b12-44b1-b8f4-1812416fa4dd based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74613) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 17:58:25 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-e567ed9d-d98a-47ee-880a-c0d3bae519c3 tempest-TestShelveInstance-765407413 tempest-TestShelveInstance-765407413-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.385s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 17:58:25 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-e567ed9d-d98a-47ee-880a-c0d3bae519c3 tempest-TestShelveInstance-765407413 tempest-TestShelveInstance-765407413-project-member] Lock "fae10c60-f989-4c99-bde4-60cd9f3e2055" "released" by "nova.compute.manager.ComputeManager.shelve_offload_instance.<locals>.do_shelve_offload_instance" :: held 5.335s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 17:58:25 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-4ee7a628-cff4-43f1-9b79-dbc8d6129d20 tempest-VolumesAdminNegativeTest-636556351 tempest-VolumesAdminNegativeTest-636556351-project-member] Acquiring lock "0aa463c6-01e7-48e5-b082-e083558342e3" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 17:58:25 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-4ee7a628-cff4-43f1-9b79-dbc8d6129d20 tempest-VolumesAdminNegativeTest-636556351 tempest-VolumesAdminNegativeTest-636556351-project-member] Lock "0aa463c6-01e7-48e5-b082-e083558342e3" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 17:58:25 user nova-compute[74613]: INFO nova.compute.manager [None req-4ee7a628-cff4-43f1-9b79-dbc8d6129d20 tempest-VolumesAdminNegativeTest-636556351 tempest-VolumesAdminNegativeTest-636556351-project-member] [instance: 0aa463c6-01e7-48e5-b082-e083558342e3] Detaching volume d8614e81-d01c-4ec5-9f96-46df3535d465
Nov 29 17:58:25 user nova-compute[74613]: INFO nova.virt.block_device [None req-4ee7a628-cff4-43f1-9b79-dbc8d6129d20 tempest-VolumesAdminNegativeTest-636556351 tempest-VolumesAdminNegativeTest-636556351-project-member] [instance: 0aa463c6-01e7-48e5-b082-e083558342e3] Attempting to driver detach volume d8614e81-d01c-4ec5-9f96-46df3535d465 from mountpoint /dev/vdb
Nov 29 17:58:25 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-4ee7a628-cff4-43f1-9b79-dbc8d6129d20 tempest-VolumesAdminNegativeTest-636556351 tempest-VolumesAdminNegativeTest-636556351-project-member] Attempting to detach device vdb from instance 0aa463c6-01e7-48e5-b082-e083558342e3 from the persistent domain config. {{(pid=74613) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 29 17:58:25 user nova-compute[74613]: DEBUG nova.virt.libvirt.guest [None req-4ee7a628-cff4-43f1-9b79-dbc8d6129d20 tempest-VolumesAdminNegativeTest-636556351 tempest-VolumesAdminNegativeTest-636556351-project-member] detach device xml: <disk type="block" device="disk">
Nov 29 17:58:25 user nova-compute[74613]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 17:58:25 user nova-compute[74613]:   <source dev="/dev/sdc"/>
Nov 29 17:58:25 user nova-compute[74613]:   <target dev="vdb" bus="virtio"/>
Nov 29 17:58:25 user nova-compute[74613]:   <serial>d8614e81-d01c-4ec5-9f96-46df3535d465</serial>
Nov 29 17:58:25 user nova-compute[74613]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 29 17:58:25 user nova-compute[74613]: </disk>
Nov 29 17:58:25 user nova-compute[74613]:  {{(pid=74613) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 29 17:58:25 user nova-compute[74613]: INFO nova.virt.libvirt.driver [None req-4ee7a628-cff4-43f1-9b79-dbc8d6129d20 tempest-VolumesAdminNegativeTest-636556351 tempest-VolumesAdminNegativeTest-636556351-project-member] Successfully detached device vdb from instance 0aa463c6-01e7-48e5-b082-e083558342e3 from the persistent domain config.
Nov 29 17:58:25 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-4ee7a628-cff4-43f1-9b79-dbc8d6129d20 tempest-VolumesAdminNegativeTest-636556351 tempest-VolumesAdminNegativeTest-636556351-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 0aa463c6-01e7-48e5-b082-e083558342e3 from the live domain config. {{(pid=74613) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 29 17:58:25 user nova-compute[74613]: DEBUG nova.virt.libvirt.guest [None req-4ee7a628-cff4-43f1-9b79-dbc8d6129d20 tempest-VolumesAdminNegativeTest-636556351 tempest-VolumesAdminNegativeTest-636556351-project-member] detach device xml: <disk type="block" device="disk">
Nov 29 17:58:25 user nova-compute[74613]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 17:58:25 user nova-compute[74613]:   <source dev="/dev/sdc"/>
Nov 29 17:58:25 user nova-compute[74613]:   <target dev="vdb" bus="virtio"/>
Nov 29 17:58:25 user nova-compute[74613]:   <serial>d8614e81-d01c-4ec5-9f96-46df3535d465</serial>
Nov 29 17:58:25 user nova-compute[74613]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 29 17:58:25 user nova-compute[74613]: </disk>
Nov 29 17:58:25 user nova-compute[74613]:  {{(pid=74613) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 29 17:58:26 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-4ee7a628-cff4-43f1-9b79-dbc8d6129d20 tempest-VolumesAdminNegativeTest-636556351 tempest-VolumesAdminNegativeTest-636556351-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 0aa463c6-01e7-48e5-b082-e083558342e3 {{(pid=74613) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 29 17:58:27 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:58:27 user nova-compute[74613]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fc65ae93-e4a7-42cd-ba65-874189d46dc4 tempest-ServerActionsTestOtherB-894551005 tempest-ServerActionsTestOtherB-894551005-project-member] [instance: 74ac9703-1cd7-4983-b7d4-c69b01fec7b2] Calling os-brick to attach iSCSI Volume {{(pid=74613) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 29 17:58:27 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-fc65ae93-e4a7-42cd-ba65-874189d46dc4 tempest-ServerActionsTestOtherB-894551005 tempest-ServerActionsTestOtherB-894551005-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff828156890>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:bb526b54-3017-4f30-b5c7-88027b146d52', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RtrxDocV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74613) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 17:58:27 user nova-compute[74613]: WARNING os_brick.initiator.connectors.base [None req-fc65ae93-e4a7-42cd-ba65-874189d46dc4 tempest-ServerActionsTestOtherB-894551005 tempest-ServerActionsTestOtherB-894551005-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 17:58:27 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.base [None req-fc65ae93-e4a7-42cd-ba65-874189d46dc4 tempest-ServerActionsTestOtherB-894551005 tempest-ServerActionsTestOtherB-894551005-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 17:58:27 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.base [None req-fc65ae93-e4a7-42cd-ba65-874189d46dc4 tempest-ServerActionsTestOtherB-894551005 tempest-ServerActionsTestOtherB-894551005-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 17:58:27 user nova-compute[74613]: WARNING os_brick.initiator.connectors.base [None req-fc65ae93-e4a7-42cd-ba65-874189d46dc4 tempest-ServerActionsTestOtherB-894551005 tempest-ServerActionsTestOtherB-894551005-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 17:58:27 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.base [None req-fc65ae93-e4a7-42cd-ba65-874189d46dc4 tempest-ServerActionsTestOtherB-894551005 tempest-ServerActionsTestOtherB-894551005-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:bb526b54-3017-4f30-b5c7-88027b146d52" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 17:58:27 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.base [None req-fc65ae93-e4a7-42cd-ba65-874189d46dc4 tempest-ServerActionsTestOtherB-894551005 tempest-ServerActionsTestOtherB-894551005-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:bb526b54-3017-4f30-b5c7-88027b146d52" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 17:58:27 user nova-compute[74613]: INFO os_brick.initiator.connectors.iscsi [None req-fc65ae93-e4a7-42cd-ba65-874189d46dc4 tempest-ServerActionsTestOtherB-894551005 tempest-ServerActionsTestOtherB-894551005-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 29 17:58:27 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bb526b54-3017-4f30-b5c7-88027b146d52 -p 172.16.0.220:3260 {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 17:58:27 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bb526b54-3017-4f30-b5c7-88027b146d52 -p 172.16.0.220:3260" returned: 21 in 0.016s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 17:58:27 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[83b71804-8165-46a2-b592-a7e8833e6981]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 17:58:27 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-fc65ae93-e4a7-42cd-ba65-874189d46dc4 tempest-ServerActionsTestOtherB-894551005 tempest-ServerActionsTestOtherB-894551005-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 29 17:58:27 user nova-compute[74613]:  {{(pid=74613) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 17:58:27 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bb526b54-3017-4f30-b5c7-88027b146d52 -p 172.16.0.220:3260 --interface default --op new {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 17:58:28 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bb526b54-3017-4f30-b5c7-88027b146d52 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 17:58:28 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a671a6a-c7a6-4d2f-ba6c-42e8b7e6a69c]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:bb526b54-3017-4f30-b5c7-88027b146d52] added\n', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 17:58:28 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-fc65ae93-e4a7-42cd-ba65-874189d46dc4 tempest-ServerActionsTestOtherB-894551005 tempest-ServerActionsTestOtherB-894551005-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:bb526b54-3017-4f30-b5c7-88027b146d52] added
Nov 29 17:58:28 user nova-compute[74613]:  stderr= {{(pid=74613) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 17:58:28 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bb526b54-3017-4f30-b5c7-88027b146d52 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 17:58:28 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bb526b54-3017-4f30-b5c7-88027b146d52 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.016s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 17:58:28 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5ad1bff-3856-47fb-bf31-f63eb87b076b]: (4, ('', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 17:58:28 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-fc65ae93-e4a7-42cd-ba65-874189d46dc4 tempest-ServerActionsTestOtherB-894551005 tempest-ServerActionsTestOtherB-894551005-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74613) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 17:58:28 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bb526b54-3017-4f30-b5c7-88027b146d52 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 17:58:28 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bb526b54-3017-4f30-b5c7-88027b146d52 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 17:58:28 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[b75b1168-ba28-40b1-ba1a-f57b4c1b6eab]: (4, ('', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 17:58:28 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-fc65ae93-e4a7-42cd-ba65-874189d46dc4 tempest-ServerActionsTestOtherB-894551005 tempest-ServerActionsTestOtherB-894551005-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74613) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 17:58:28 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bb526b54-3017-4f30-b5c7-88027b146d52 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v RtrxDocV {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 17:58:28 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bb526b54-3017-4f30-b5c7-88027b146d52 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v RtrxDocV" returned: 0 in 0.016s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 17:58:28 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[80580b87-65f3-4318-980a-d251e2e95671]: (4, ('', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 17:58:28 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-fc65ae93-e4a7-42cd-ba65-874189d46dc4 tempest-ServerActionsTestOtherB-894551005 tempest-ServerActionsTestOtherB-894551005-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'RtrxDocV'): stdout= stderr= {{(pid=74613) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 17:58:28 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bb526b54-3017-4f30-b5c7-88027b146d52 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 17:58:28 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bb526b54-3017-4f30-b5c7-88027b146d52 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 17:58:28 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[889084fe-961c-455b-99c2-6eba87b63937]: (4, ('', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 17:58:28 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-fc65ae93-e4a7-42cd-ba65-874189d46dc4 tempest-ServerActionsTestOtherB-894551005 tempest-ServerActionsTestOtherB-894551005-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74613) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 17:58:28 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 17:58:28 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 17:58:28 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[0cc8d31a-dd19-4078-946f-ef798045f18d]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9511387c-8772-40f2-bf2d-6b6387649e9f (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:72d22ffa-f425-4575-86a5-afbd8bb9cdd6 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d8614e81-d01c-4ec5-9f96-46df3535d465 (non-flash)\n', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 17:58:28 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-fc65ae93-e4a7-42cd-ba65-874189d46dc4 tempest-ServerActionsTestOtherB-894551005 tempest-ServerActionsTestOtherB-894551005-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9511387c-8772-40f2-bf2d-6b6387649e9f (non-flash)
Nov 29 17:58:28 user nova-compute[74613]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:72d22ffa-f425-4575-86a5-afbd8bb9cdd6 (non-flash)
Nov 29 17:58:28 user nova-compute[74613]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d8614e81-d01c-4ec5-9f96-46df3535d465 (non-flash)
Nov 29 17:58:28 user nova-compute[74613]:  stderr= {{(pid=74613) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 17:58:28 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-fc65ae93-e4a7-42cd-ba65-874189d46dc4 tempest-ServerActionsTestOtherB-894551005 tempest-ServerActionsTestOtherB-894551005-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9511387c-8772-40f2-bf2d-6b6387649e9f (non-flash)
Nov 29 17:58:28 user nova-compute[74613]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:72d22ffa-f425-4575-86a5-afbd8bb9cdd6 (non-flash)
Nov 29 17:58:28 user nova-compute[74613]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d8614e81-d01c-4ec5-9f96-46df3535d465 (non-flash)
Nov 29 17:58:28 user nova-compute[74613]:  stderr= {{(pid=74613) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 17:58:28 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bb526b54-3017-4f30-b5c7-88027b146d52 -p 172.16.0.220:3260 --login {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 17:58:28 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bb526b54-3017-4f30-b5c7-88027b146d52 -p 172.16.0.220:3260 --login" returned: 0 in 0.060s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 17:58:28 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[977cec34-be57-4970-8a68-e724d999d0ef]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:bb526b54-3017-4f30-b5c7-88027b146d52, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:bb526b54-3017-4f30-b5c7-88027b146d52, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 17:58:28 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-fc65ae93-e4a7-42cd-ba65-874189d46dc4 tempest-ServerActionsTestOtherB-894551005 tempest-ServerActionsTestOtherB-894551005-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:bb526b54-3017-4f30-b5c7-88027b146d52, portal: 172.16.0.220,3260]
Nov 29 17:58:28 user nova-compute[74613]: Login to [iface: default, target: iqn.2010-10.org.openstack:bb526b54-3017-4f30-b5c7-88027b146d52, portal: 172.16.0.220,3260] successful.
Nov 29 17:58:28 user nova-compute[74613]:  stderr= {{(pid=74613) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 17:58:28 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bb526b54-3017-4f30-b5c7-88027b146d52 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 17:58:28 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bb526b54-3017-4f30-b5c7-88027b146d52 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 17:58:28 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[f364fbe9-e280-4d90-b995-6726ae6cdca1]: (4, ('', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 17:58:28 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-fc65ae93-e4a7-42cd-ba65-874189d46dc4 tempest-ServerActionsTestOtherB-894551005 tempest-ServerActionsTestOtherB-894551005-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74613) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 17:58:28 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 17:58:28 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 17:58:28 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb194a99-9ccf-46fa-87ca-6bdf9935f96c]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9511387c-8772-40f2-bf2d-6b6387649e9f (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:72d22ffa-f425-4575-86a5-afbd8bb9cdd6 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d8614e81-d01c-4ec5-9f96-46df3535d465 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb526b54-3017-4f30-b5c7-88027b146d52 (non-flash)\n', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 17:58:28 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-fc65ae93-e4a7-42cd-ba65-874189d46dc4 tempest-ServerActionsTestOtherB-894551005 tempest-ServerActionsTestOtherB-894551005-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9511387c-8772-40f2-bf2d-6b6387649e9f (non-flash)
Nov 29 17:58:28 user nova-compute[74613]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:72d22ffa-f425-4575-86a5-afbd8bb9cdd6 (non-flash)
Nov 29 17:58:28 user nova-compute[74613]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d8614e81-d01c-4ec5-9f96-46df3535d465 (non-flash)
Nov 29 17:58:28 user nova-compute[74613]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb526b54-3017-4f30-b5c7-88027b146d52 (non-flash)
Nov 29 17:58:28 user nova-compute[74613]:  stderr= {{(pid=74613) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 17:58:28 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-fc65ae93-e4a7-42cd-ba65-874189d46dc4 tempest-ServerActionsTestOtherB-894551005 tempest-ServerActionsTestOtherB-894551005-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9511387c-8772-40f2-bf2d-6b6387649e9f (non-flash)
Nov 29 17:58:28 user nova-compute[74613]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:72d22ffa-f425-4575-86a5-afbd8bb9cdd6 (non-flash)
Nov 29 17:58:28 user nova-compute[74613]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d8614e81-d01c-4ec5-9f96-46df3535d465 (non-flash)
Nov 29 17:58:28 user nova-compute[74613]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb526b54-3017-4f30-b5c7-88027b146d52 (non-flash)
Nov 29 17:58:28 user nova-compute[74613]:  stderr= {{(pid=74613) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 17:58:28 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.base [None req-fc65ae93-e4a7-42cd-ba65-874189d46dc4 tempest-ServerActionsTestOtherB-894551005 tempest-ServerActionsTestOtherB-894551005-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:bb526b54-3017-4f30-b5c7-88027b146d52" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.262s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 17:58:28 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-fc65ae93-e4a7-42cd-ba65-874189d46dc4 tempest-ServerActionsTestOtherB-894551005 tempest-ServerActionsTestOtherB-894551005-project-member] Connected to 172.16.0.220:3260 {{(pid=74613) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 29 17:58:28 user nova-compute[74613]: DEBUG os_brick.initiator.linuxscsi [None req-fc65ae93-e4a7-42cd-ba65-874189d46dc4 tempest-ServerActionsTestOtherB-894551005 tempest-ServerActionsTestOtherB-894551005-project-member] HCTL ('36', '-', '-', 0) found on session 21 with lun 0 {{(pid=74613) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 29 17:58:28 user nova-compute[74613]: DEBUG os_brick.initiator.linuxscsi [None req-fc65ae93-e4a7-42cd-ba65-874189d46dc4 tempest-ServerActionsTestOtherB-894551005 tempest-ServerActionsTestOtherB-894551005-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=74613) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 29 17:58:28 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 17:58:28 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.016s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 17:58:28 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[9eba9062-4bd6-41de-9faf-dce3f70a7d2e]: (4, ('- - 0', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 17:58:28 user nova-compute[74613]: DEBUG os_brick.initiator.linuxscsi [None req-fc65ae93-e4a7-42cd-ba65-874189d46dc4 tempest-ServerActionsTestOtherB-894551005 tempest-ServerActionsTestOtherB-894551005-project-member] Searching for a device in session 21 and hctl ['36', '*', '*', 0] yield: sde {{(pid=74613) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 29 17:58:28 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-fc65ae93-e4a7-42cd-ba65-874189d46dc4 tempest-ServerActionsTestOtherB-894551005 tempest-ServerActionsTestOtherB-894551005-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:bb526b54-3017-4f30-b5c7-88027b146d52', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RtrxDocV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74613) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 29 17:58:29 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.base [None req-fc65ae93-e4a7-42cd-ba65-874189d46dc4 tempest-ServerActionsTestOtherB-894551005 tempest-ServerActionsTestOtherB-894551005-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.296s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 17:58:29 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-fc65ae93-e4a7-42cd-ba65-874189d46dc4 tempest-ServerActionsTestOtherB-894551005 tempest-ServerActionsTestOtherB-894551005-project-member] <== connect_volume: return (1297ms) {'type': 'block', 'scsi_wwn': '23763623539386230', 'path': '/dev/sde'} {{(pid=74613) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 17:58:29 user nova-compute[74613]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fc65ae93-e4a7-42cd-ba65-874189d46dc4 tempest-ServerActionsTestOtherB-894551005 tempest-ServerActionsTestOtherB-894551005-project-member] [instance: 74ac9703-1cd7-4983-b7d4-c69b01fec7b2] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23763623539386230', 'path': '/dev/sde'} {{(pid=74613) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 29 17:58:29 user nova-compute[74613]: DEBUG nova.objects.instance [None req-fc65ae93-e4a7-42cd-ba65-874189d46dc4 tempest-ServerActionsTestOtherB-894551005 tempest-ServerActionsTestOtherB-894551005-project-member] Lazy-loading 'flavor' on Instance uuid 74ac9703-1cd7-4983-b7d4-c69b01fec7b2 {{(pid=74613) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 17:58:29 user nova-compute[74613]: DEBUG nova.virt.libvirt.guest [None req-fc65ae93-e4a7-42cd-ba65-874189d46dc4 tempest-ServerActionsTestOtherB-894551005 tempest-ServerActionsTestOtherB-894551005-project-member] attach device xml: <disk type="block" device="disk">
Nov 29 17:58:29 user nova-compute[74613]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 17:58:29 user nova-compute[74613]:   <source dev="/dev/sde"/>
Nov 29 17:58:29 user nova-compute[74613]:   <target dev="vdb" bus="virtio"/>
Nov 29 17:58:29 user nova-compute[74613]:   <serial>bb526b54-3017-4f30-b5c7-88027b146d52</serial>
Nov 29 17:58:29 user nova-compute[74613]: </disk>
Nov 29 17:58:29 user nova-compute[74613]:  {{(pid=74613) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 29 17:58:29 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-fc65ae93-e4a7-42cd-ba65-874189d46dc4 tempest-ServerActionsTestOtherB-894551005 tempest-ServerActionsTestOtherB-894551005-project-member] No BDM found with device name vda, not building metadata. {{(pid=74613) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 17:58:29 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-fc65ae93-e4a7-42cd-ba65-874189d46dc4 tempest-ServerActionsTestOtherB-894551005 tempest-ServerActionsTestOtherB-894551005-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74613) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 17:58:29 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-fc65ae93-e4a7-42cd-ba65-874189d46dc4 tempest-ServerActionsTestOtherB-894551005 tempest-ServerActionsTestOtherB-894551005-project-member] No VIF found with MAC fa:16:3e:c3:2e:71, not building metadata {{(pid=74613) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 29 17:58:29 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-fc65ae93-e4a7-42cd-ba65-874189d46dc4 tempest-ServerActionsTestOtherB-894551005 tempest-ServerActionsTestOtherB-894551005-project-member] Lock "74ac9703-1cd7-4983-b7d4-c69b01fec7b2" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 10.055s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 17:58:30 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:58:32 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:58:32 user nova-compute[74613]: DEBUG nova.compute.manager [None req-bca23527-ede8-4e6a-b1cb-00e5bf8301c1 tempest-ServerActionsTestOtherB-894551005 tempest-ServerActionsTestOtherB-894551005-project-member] [instance: 74ac9703-1cd7-4983-b7d4-c69b01fec7b2] Stashing vm_state: active {{(pid=74613) _prep_resize /opt/stack/nova/nova/compute/manager.py:5615}}
Nov 29 17:58:32 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-bca23527-ede8-4e6a-b1cb-00e5bf8301c1 tempest-ServerActionsTestOtherB-894551005 tempest-ServerActionsTestOtherB-894551005-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 17:58:32 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-bca23527-ede8-4e6a-b1cb-00e5bf8301c1 tempest-ServerActionsTestOtherB-894551005 tempest-ServerActionsTestOtherB-894551005-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: waited 0.001s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 17:58:32 user nova-compute[74613]: DEBUG nova.virt.hardware [None req-bca23527-ede8-4e6a-b1cb-00e5bf8301c1 tempest-ServerActionsTestOtherB-894551005 tempest-ServerActionsTestOtherB-894551005-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74613) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 29 17:58:32 user nova-compute[74613]: INFO nova.compute.claims [None req-bca23527-ede8-4e6a-b1cb-00e5bf8301c1 tempest-ServerActionsTestOtherB-894551005 tempest-ServerActionsTestOtherB-894551005-project-member] [instance: 74ac9703-1cd7-4983-b7d4-c69b01fec7b2] Claim successful on node user
Nov 29 17:58:33 user nova-compute[74613]: INFO nova.compute.resource_tracker [None req-bca23527-ede8-4e6a-b1cb-00e5bf8301c1 tempest-ServerActionsTestOtherB-894551005 tempest-ServerActionsTestOtherB-894551005-project-member] [instance: 74ac9703-1cd7-4983-b7d4-c69b01fec7b2] Updating resource usage from migration 8810a11f-ec67-4d25-b99d-d74f186c3a86
Nov 29 17:58:33 user nova-compute[74613]: DEBUG nova.compute.provider_tree [None req-bca23527-ede8-4e6a-b1cb-00e5bf8301c1 tempest-ServerActionsTestOtherB-894551005 tempest-ServerActionsTestOtherB-894551005-project-member] Inventory has not changed in ProviderTree for provider: 639d980e-3b12-44b1-b8f4-1812416fa4dd {{(pid=74613) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 17:58:33 user nova-compute[74613]: DEBUG nova.scheduler.client.report [None req-bca23527-ede8-4e6a-b1cb-00e5bf8301c1 tempest-ServerActionsTestOtherB-894551005 tempest-ServerActionsTestOtherB-894551005-project-member] Inventory has not changed for provider 639d980e-3b12-44b1-b8f4-1812416fa4dd based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74613) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 17:58:33 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-bca23527-ede8-4e6a-b1cb-00e5bf8301c1 tempest-ServerActionsTestOtherB-894551005 tempest-ServerActionsTestOtherB-894551005-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: held 0.445s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 17:58:33 user nova-compute[74613]: INFO nova.compute.manager [None req-bca23527-ede8-4e6a-b1cb-00e5bf8301c1 tempest-ServerActionsTestOtherB-894551005 tempest-ServerActionsTestOtherB-894551005-project-member] [instance: 74ac9703-1cd7-4983-b7d4-c69b01fec7b2] Migrating
Nov 29 17:58:33 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-bca23527-ede8-4e6a-b1cb-00e5bf8301c1 tempest-ServerActionsTestOtherB-894551005 tempest-ServerActionsTestOtherB-894551005-project-member] Acquiring lock "compute-rpcapi-router" {{(pid=74613) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 17:58:33 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-bca23527-ede8-4e6a-b1cb-00e5bf8301c1 tempest-ServerActionsTestOtherB-894551005 tempest-ServerActionsTestOtherB-894551005-project-member] Acquired lock "compute-rpcapi-router" {{(pid=74613) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 17:58:33 user nova-compute[74613]: INFO nova.compute.rpcapi [None req-bca23527-ede8-4e6a-b1cb-00e5bf8301c1 tempest-ServerActionsTestOtherB-894551005 tempest-ServerActionsTestOtherB-894551005-project-member] Automatically selected compute RPC version 6.2 from minimum service version 66
Nov 29 17:58:33 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-bca23527-ede8-4e6a-b1cb-00e5bf8301c1 tempest-ServerActionsTestOtherB-894551005 tempest-ServerActionsTestOtherB-894551005-project-member] Releasing lock "compute-rpcapi-router" {{(pid=74613) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 17:58:33 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-bca23527-ede8-4e6a-b1cb-00e5bf8301c1 tempest-ServerActionsTestOtherB-894551005 tempest-ServerActionsTestOtherB-894551005-project-member] Acquiring lock "refresh_cache-74ac9703-1cd7-4983-b7d4-c69b01fec7b2" {{(pid=74613) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 17:58:33 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-bca23527-ede8-4e6a-b1cb-00e5bf8301c1 tempest-ServerActionsTestOtherB-894551005 tempest-ServerActionsTestOtherB-894551005-project-member] Acquired lock "refresh_cache-74ac9703-1cd7-4983-b7d4-c69b01fec7b2" {{(pid=74613) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 17:58:33 user nova-compute[74613]: DEBUG nova.network.neutron [None req-bca23527-ede8-4e6a-b1cb-00e5bf8301c1 tempest-ServerActionsTestOtherB-894551005 tempest-ServerActionsTestOtherB-894551005-project-member] [instance: 74ac9703-1cd7-4983-b7d4-c69b01fec7b2] Building network info cache for instance {{(pid=74613) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 29 17:58:33 user nova-compute[74613]: DEBUG nova.network.neutron [None req-bca23527-ede8-4e6a-b1cb-00e5bf8301c1 tempest-ServerActionsTestOtherB-894551005 tempest-ServerActionsTestOtherB-894551005-project-member] [instance: 74ac9703-1cd7-4983-b7d4-c69b01fec7b2] Updating instance_info_cache with network_info: [{"id": "c63b6577-fb46-437a-95b3-8321fab45d0c", "address": "fa:16:3e:c3:2e:71", "network": {"id": "e687ed60-2592-4836-b97e-0828527b1b9f", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1938956411-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.143", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b392ca87608940c0ae467318b66453b2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc63b6577-fb", "ovs_interfaceid": "c63b6577-fb46-437a-95b3-8321fab45d0c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74613) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 17:58:33 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-bca23527-ede8-4e6a-b1cb-00e5bf8301c1 tempest-ServerActionsTestOtherB-894551005 tempest-ServerActionsTestOtherB-894551005-project-member] Releasing lock "refresh_cache-74ac9703-1cd7-4983-b7d4-c69b01fec7b2" {{(pid=74613) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 17:58:34 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-bca23527-ede8-4e6a-b1cb-00e5bf8301c1 tempest-ServerActionsTestOtherB-894551005 tempest-ServerActionsTestOtherB-894551005-project-member] [instance: 74ac9703-1cd7-4983-b7d4-c69b01fec7b2] Starting migrate_disk_and_power_off {{(pid=74613) migrate_disk_and_power_off /opt/stack/nova/nova/virt/libvirt/driver.py:11484}}
Nov 29 17:58:34 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:58:34 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:58:34 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:58:34 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:58:34 user nova-compute[74613]: DEBUG nova.compute.manager [req-8386fd46-fde7-4635-a8fe-6c7496c46ba6 req-72d17cbd-807c-4c76-be2f-86f1f2dd0a11 service nova] [instance: 74ac9703-1cd7-4983-b7d4-c69b01fec7b2] Received event network-vif-unplugged-c63b6577-fb46-437a-95b3-8321fab45d0c {{(pid=74613) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 17:58:34 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-8386fd46-fde7-4635-a8fe-6c7496c46ba6 req-72d17cbd-807c-4c76-be2f-86f1f2dd0a11 service nova] Acquiring lock "74ac9703-1cd7-4983-b7d4-c69b01fec7b2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 17:58:34 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-8386fd46-fde7-4635-a8fe-6c7496c46ba6 req-72d17cbd-807c-4c76-be2f-86f1f2dd0a11 service nova] Lock "74ac9703-1cd7-4983-b7d4-c69b01fec7b2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 17:58:34 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-8386fd46-fde7-4635-a8fe-6c7496c46ba6 req-72d17cbd-807c-4c76-be2f-86f1f2dd0a11 service nova] Lock "74ac9703-1cd7-4983-b7d4-c69b01fec7b2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 17:58:34 user nova-compute[74613]: DEBUG nova.compute.manager [req-8386fd46-fde7-4635-a8fe-6c7496c46ba6 req-72d17cbd-807c-4c76-be2f-86f1f2dd0a11 service nova] [instance: 74ac9703-1cd7-4983-b7d4-c69b01fec7b2] No waiting events found dispatching network-vif-unplugged-c63b6577-fb46-437a-95b3-8321fab45d0c {{(pid=74613) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 17:58:34 user nova-compute[74613]: WARNING nova.compute.manager [req-8386fd46-fde7-4635-a8fe-6c7496c46ba6 req-72d17cbd-807c-4c76-be2f-86f1f2dd0a11 service nova] [instance: 74ac9703-1cd7-4983-b7d4-c69b01fec7b2] Received unexpected event network-vif-unplugged-c63b6577-fb46-437a-95b3-8321fab45d0c for instance with vm_state active and task_state resize_migrating.
Nov 29 17:58:34 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:58:34 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:58:34 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:58:34 user nova-compute[74613]: INFO nova.virt.libvirt.driver [-] [instance: 74ac9703-1cd7-4983-b7d4-c69b01fec7b2] Instance destroyed successfully.
Nov 29 17:58:34 user nova-compute[74613]: DEBUG nova.virt.libvirt.vif [None req-bca23527-ede8-4e6a-b1cb-00e5bf8301c1 tempest-ServerActionsTestOtherB-894551005 tempest-ServerActionsTestOtherB-894551005-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T17:55:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-931769463',display_name='tempest-ServerActionsTestOtherB-server-931769463',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-931769463',id=14,image_ref='4217f428-8d9d-4ee1-9614-642d26d90c46',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBE0p3wmKXoOCABzKEPJ0MsHfAtC1JQfzjVn7a3OeQC65p309Te6g/AbiDIZbrFAX7j9aAJfq/HNC8gx1yP/V9/PHfR3o28o9EgbHEcoTtW/dEJGkpFGjjy+hrqfOfHYCnA==',key_name='tempest-keypair-464492783',keypairs=<?>,launch_index=0,launched_at=2023-11-29T17:55:35Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='b392ca87608940c0ae467318b66453b2',ramdisk_id='',reservation_id='r-0wzexjb0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='4217f428-8d9d-4ee1-9614-642d26d90c46',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-894551005',owner_user_name='tempest-ServerActionsTestOtherB-894551005-project-member'},tags=<?>,task_state='resize_migrating',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T17:58:33Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1a6eb590fed440729b45b8db79eb7c2f',uuid=74ac9703-1cd7-4983-b7d4-c69b01fec7b2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "c63b6577-fb46-437a-95b3-8321fab45d0c", "address": "fa:16:3e:c3:2e:71", "network": {"id": "e687ed60-2592-4836-b97e-0828527b1b9f", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1938956411-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.143", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-1938956411-network", "vif_mac": "fa:16:3e:c3:2e:71"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b392ca87608940c0ae467318b66453b2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc63b6577-fb", "ovs_interfaceid": "c63b6577-fb46-437a-95b3-8321fab45d0c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74613) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 29 17:58:34 user nova-compute[74613]: DEBUG nova.network.os_vif_util [None req-bca23527-ede8-4e6a-b1cb-00e5bf8301c1 tempest-ServerActionsTestOtherB-894551005 tempest-ServerActionsTestOtherB-894551005-project-member] Converting VIF {"id": "c63b6577-fb46-437a-95b3-8321fab45d0c", "address": "fa:16:3e:c3:2e:71", "network": {"id": "e687ed60-2592-4836-b97e-0828527b1b9f", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1938956411-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.143", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-1938956411-network", "vif_mac": "fa:16:3e:c3:2e:71"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b392ca87608940c0ae467318b66453b2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc63b6577-fb", "ovs_interfaceid": "c63b6577-fb46-437a-95b3-8321fab45d0c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74613) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 17:58:34 user nova-compute[74613]: DEBUG nova.network.os_vif_util [None req-bca23527-ede8-4e6a-b1cb-00e5bf8301c1 tempest-ServerActionsTestOtherB-894551005 tempest-ServerActionsTestOtherB-894551005-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:c3:2e:71,bridge_name='br-int',has_traffic_filtering=True,id=c63b6577-fb46-437a-95b3-8321fab45d0c,network=Network(e687ed60-2592-4836-b97e-0828527b1b9f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc63b6577-fb') {{(pid=74613) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 17:58:34 user nova-compute[74613]: DEBUG os_vif [None req-bca23527-ede8-4e6a-b1cb-00e5bf8301c1 tempest-ServerActionsTestOtherB-894551005 tempest-ServerActionsTestOtherB-894551005-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:c3:2e:71,bridge_name='br-int',has_traffic_filtering=True,id=c63b6577-fb46-437a-95b3-8321fab45d0c,network=Network(e687ed60-2592-4836-b97e-0828527b1b9f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc63b6577-fb') {{(pid=74613) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 29 17:58:34 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:58:34 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapc63b6577-fb, bridge=br-int, if_exists=True) {{(pid=74613) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 17:58:34 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:58:34 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:58:34 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:58:34 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=624a98ed-84b4-4206-9aef-c4f7baa58c74) {{(pid=74613) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 17:58:34 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:58:34 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:58:34 user nova-compute[74613]: INFO os_vif [None req-bca23527-ede8-4e6a-b1cb-00e5bf8301c1 tempest-ServerActionsTestOtherB-894551005 tempest-ServerActionsTestOtherB-894551005-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:c3:2e:71,bridge_name='br-int',has_traffic_filtering=True,id=c63b6577-fb46-437a-95b3-8321fab45d0c,network=Network(e687ed60-2592-4836-b97e-0828527b1b9f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc63b6577-fb')
Nov 29 17:58:34 user nova-compute[74613]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bca23527-ede8-4e6a-b1cb-00e5bf8301c1 tempest-ServerActionsTestOtherB-894551005 tempest-ServerActionsTestOtherB-894551005-project-member] [instance: 74ac9703-1cd7-4983-b7d4-c69b01fec7b2] calling os-brick to detach iSCSI Volume {{(pid=74613) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 29 17:58:34 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-bca23527-ede8-4e6a-b1cb-00e5bf8301c1 tempest-ServerActionsTestOtherB-894551005 tempest-ServerActionsTestOtherB-894551005-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff828156890>, {'target_iqn': 'iqn.2010-10.org.openstack:bb526b54-3017-4f30-b5c7-88027b146d52', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RtrxDocV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': False}}" {{(pid=74613) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 17:58:34 user nova-compute[74613]: WARNING os_brick.initiator.connectors.base [None req-bca23527-ede8-4e6a-b1cb-00e5bf8301c1 tempest-ServerActionsTestOtherB-894551005 tempest-ServerActionsTestOtherB-894551005-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 17:58:34 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.base [None req-bca23527-ede8-4e6a-b1cb-00e5bf8301c1 tempest-ServerActionsTestOtherB-894551005 tempest-ServerActionsTestOtherB-894551005-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 17:58:34 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.base [None req-bca23527-ede8-4e6a-b1cb-00e5bf8301c1 tempest-ServerActionsTestOtherB-894551005 tempest-ServerActionsTestOtherB-894551005-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 17:58:34 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 17:58:34 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 17:58:34 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7e01c61-e954-4cf8-8266-b0e10b56a68e]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:9511387c-8772-40f2-bf2d-6b6387649e9f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d8614e81-d01c-4ec5-9f96-46df3535d465\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:72d22ffa-f425-4575-86a5-afbd8bb9cdd6\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:bb526b54-3017-4f30-b5c7-88027b146d52\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 17:58:34 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-bca23527-ede8-4e6a-b1cb-00e5bf8301c1 tempest-ServerActionsTestOtherB-894551005 tempest-ServerActionsTestOtherB-894551005-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 29 17:58:34 user nova-compute[74613]: No targets found.
Nov 29 17:58:34 user nova-compute[74613]: iSNS:
Nov 29 17:58:34 user nova-compute[74613]: No targets found.
Nov 29 17:58:34 user nova-compute[74613]: STATIC:
Nov 29 17:58:34 user nova-compute[74613]: Target: iqn.2010-10.org.openstack:9511387c-8772-40f2-bf2d-6b6387649e9f
Nov 29 17:58:34 user nova-compute[74613]:         Portal: 172.16.0.220:3260,-1
Nov 29 17:58:34 user nova-compute[74613]:                 Iface Name: default
Nov 29 17:58:34 user nova-compute[74613]: Target: iqn.2010-10.org.openstack:d8614e81-d01c-4ec5-9f96-46df3535d465
Nov 29 17:58:34 user nova-compute[74613]:         Portal: 172.16.0.220:3260,-1
Nov 29 17:58:34 user nova-compute[74613]:                 Iface Name: default
Nov 29 17:58:34 user nova-compute[74613]: Target: iqn.2010-10.org.openstack:72d22ffa-f425-4575-86a5-afbd8bb9cdd6
Nov 29 17:58:34 user nova-compute[74613]:         Portal: 172.16.0.220:3260,-1
Nov 29 17:58:34 user nova-compute[74613]:                 Iface Name: default
Nov 29 17:58:34 user nova-compute[74613]: Target: iqn.2010-10.org.openstack:bb526b54-3017-4f30-b5c7-88027b146d52
Nov 29 17:58:34 user nova-compute[74613]:         Portal: 172.16.0.220:3260,-1
Nov 29 17:58:34 user nova-compute[74613]:                 Iface Name: default
Nov 29 17:58:34 user nova-compute[74613]: FIRMWARE:
Nov 29 17:58:34 user nova-compute[74613]: No targets found.
Nov 29 17:58:34 user nova-compute[74613]:  stderr= {{(pid=74613) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 17:58:34 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-bca23527-ede8-4e6a-b1cb-00e5bf8301c1 tempest-ServerActionsTestOtherB-894551005 tempest-ServerActionsTestOtherB-894551005-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 29 17:58:34 user nova-compute[74613]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 29 17:58:34 user nova-compute[74613]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74613) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 29 17:58:34 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-bca23527-ede8-4e6a-b1cb-00e5bf8301c1 tempest-ServerActionsTestOtherB-894551005 tempest-ServerActionsTestOtherB-894551005-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:bb526b54-3017-4f30-b5c7-88027b146d52', 0)] {{(pid=74613) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 29 17:58:34 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:58:34 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 17:58:34 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 17:58:34 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f25de39-483c-49f9-b3b9-a1256869d0ce]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:72d22ffa-f425-4575-86a5-afbd8bb9cdd6\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9511387c-8772-40f2-bf2d-6b6387649e9f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:bb526b54-3017-4f30-b5c7-88027b146d52\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d8614e81-d01c-4ec5-9f96-46df3535d465\n', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 17:58:34 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 17:58:34 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.034s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 17:58:34 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa9f4b3c-e7a2-492f-ab87-457d97e7874a]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9511387c-8772-40f2-bf2d-6b6387649e9f (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:72d22ffa-f425-4575-86a5-afbd8bb9cdd6 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d8614e81-d01c-4ec5-9f96-46df3535d465 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb526b54-3017-4f30-b5c7-88027b146d52 (non-flash)\n', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 17:58:34 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-bca23527-ede8-4e6a-b1cb-00e5bf8301c1 tempest-ServerActionsTestOtherB-894551005 tempest-ServerActionsTestOtherB-894551005-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9511387c-8772-40f2-bf2d-6b6387649e9f (non-flash)
Nov 29 17:58:34 user nova-compute[74613]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:72d22ffa-f425-4575-86a5-afbd8bb9cdd6 (non-flash)
Nov 29 17:58:34 user nova-compute[74613]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d8614e81-d01c-4ec5-9f96-46df3535d465 (non-flash)
Nov 29 17:58:34 user nova-compute[74613]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb526b54-3017-4f30-b5c7-88027b146d52 (non-flash)
Nov 29 17:58:34 user nova-compute[74613]:  stderr= {{(pid=74613) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 17:58:34 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-bca23527-ede8-4e6a-b1cb-00e5bf8301c1 tempest-ServerActionsTestOtherB-894551005 tempest-ServerActionsTestOtherB-894551005-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9511387c-8772-40f2-bf2d-6b6387649e9f (non-flash)
Nov 29 17:58:34 user nova-compute[74613]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:72d22ffa-f425-4575-86a5-afbd8bb9cdd6 (non-flash)
Nov 29 17:58:34 user nova-compute[74613]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d8614e81-d01c-4ec5-9f96-46df3535d465 (non-flash)
Nov 29 17:58:34 user nova-compute[74613]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb526b54-3017-4f30-b5c7-88027b146d52 (non-flash)
Nov 29 17:58:34 user nova-compute[74613]:  stderr= {{(pid=74613) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 17:58:34 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-bca23527-ede8-4e6a-b1cb-00e5bf8301c1 tempest-ServerActionsTestOtherB-894551005 tempest-ServerActionsTestOtherB-894551005-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7ff818291090>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:bb526b54-3017-4f30-b5c7-88027b146d52'): ({'sde'}, set())}) {{(pid=74613) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 29 17:58:34 user nova-compute[74613]: DEBUG os_brick.initiator.linuxscsi [None req-bca23527-ede8-4e6a-b1cb-00e5bf8301c1 tempest-ServerActionsTestOtherB-894551005 tempest-ServerActionsTestOtherB-894551005-project-member] Removing single pathed devices sde {{(pid=74613) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 29 17:58:34 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 17:58:34 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 17:58:34 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c359871-ad31-44b1-8c7b-23790b7f9f4a]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 17:58:34 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 17:58:35 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.020s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 17:58:35 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3fb1cb6-90fc-43b3-9bf3-d2453046558f]: (4, ('ok\n', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 17:58:35 user nova-compute[74613]: DEBUG os_brick.initiator.linuxscsi [None req-bca23527-ede8-4e6a-b1cb-00e5bf8301c1 tempest-ServerActionsTestOtherB-894551005 tempest-ServerActionsTestOtherB-894551005-project-member] Flushing IO for device /dev/sde {{(pid=74613) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 29 17:58:35 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 17:58:35 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.013s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 17:58:35 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ea342e4-88f1-4078-b2ca-f6949b435bbe]: (4, ('', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 17:58:35 user nova-compute[74613]: DEBUG os_brick.initiator.linuxscsi [None req-bca23527-ede8-4e6a-b1cb-00e5bf8301c1 tempest-ServerActionsTestOtherB-894551005 tempest-ServerActionsTestOtherB-894551005-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=74613) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 29 17:58:35 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 17:58:35 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.030s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 17:58:35 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[18ea7544-e27b-476a-aac3-609e2ef96057]: (4, ('1', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 17:58:35 user nova-compute[74613]: DEBUG os_brick.initiator.linuxscsi [None req-bca23527-ede8-4e6a-b1cb-00e5bf8301c1 tempest-ServerActionsTestOtherB-894551005 tempest-ServerActionsTestOtherB-894551005-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=74613) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 29 17:58:35 user nova-compute[74613]: DEBUG os_brick.initiator.linuxscsi [None req-bca23527-ede8-4e6a-b1cb-00e5bf8301c1 tempest-ServerActionsTestOtherB-894551005 tempest-ServerActionsTestOtherB-894551005-project-member] SCSI volumes sde have been removed. {{(pid=74613) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 29 17:58:35 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-bca23527-ede8-4e6a-b1cb-00e5bf8301c1 tempest-ServerActionsTestOtherB-894551005 tempest-ServerActionsTestOtherB-894551005-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:bb526b54-3017-4f30-b5c7-88027b146d52')] {{(pid=74613) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 29 17:58:35 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bb526b54-3017-4f30-b5c7-88027b146d52 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 17:58:35 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bb526b54-3017-4f30-b5c7-88027b146d52 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.024s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 17:58:35 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e7ec47b-a564-49f4-8f3e-cb31d096f6df]: (4, ('', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 17:58:35 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-bca23527-ede8-4e6a-b1cb-00e5bf8301c1 tempest-ServerActionsTestOtherB-894551005 tempest-ServerActionsTestOtherB-894551005-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74613) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 17:58:35 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bb526b54-3017-4f30-b5c7-88027b146d52 -p 172.16.0.220:3260 --logout {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 17:58:35 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bb526b54-3017-4f30-b5c7-88027b146d52 -p 172.16.0.220:3260 --logout" returned: 0 in 0.065s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 17:58:35 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e1abeab-425d-4149-ab7f-4acd15897789]: (4, ('Logging out of session [sid: 21, target: iqn.2010-10.org.openstack:bb526b54-3017-4f30-b5c7-88027b146d52, portal: 172.16.0.220,3260]\nLogout of [sid: 21, target: iqn.2010-10.org.openstack:bb526b54-3017-4f30-b5c7-88027b146d52, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 17:58:35 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-bca23527-ede8-4e6a-b1cb-00e5bf8301c1 tempest-ServerActionsTestOtherB-894551005 tempest-ServerActionsTestOtherB-894551005-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 21, target: iqn.2010-10.org.openstack:bb526b54-3017-4f30-b5c7-88027b146d52, portal: 172.16.0.220,3260]
Nov 29 17:58:35 user nova-compute[74613]: Logout of [sid: 21, target: iqn.2010-10.org.openstack:bb526b54-3017-4f30-b5c7-88027b146d52, portal: 172.16.0.220,3260] successful.
Nov 29 17:58:35 user nova-compute[74613]:  stderr= {{(pid=74613) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 17:58:35 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bb526b54-3017-4f30-b5c7-88027b146d52 -p 172.16.0.220:3260 --op delete {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 17:58:35 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bb526b54-3017-4f30-b5c7-88027b146d52 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.028s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 17:58:35 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[11726bf9-f095-449a-a540-26a34e8a5efe]: (4, ('', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 17:58:35 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-bca23527-ede8-4e6a-b1cb-00e5bf8301c1 tempest-ServerActionsTestOtherB-894551005 tempest-ServerActionsTestOtherB-894551005-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74613) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 17:58:35 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.base [None req-bca23527-ede8-4e6a-b1cb-00e5bf8301c1 tempest-ServerActionsTestOtherB-894551005 tempest-ServerActionsTestOtherB-894551005-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.332s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 17:58:35 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-bca23527-ede8-4e6a-b1cb-00e5bf8301c1 tempest-ServerActionsTestOtherB-894551005 tempest-ServerActionsTestOtherB-894551005-project-member] <== disconnect_volume: return (334ms) None {{(pid=74613) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 17:58:35 user nova-compute[74613]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bca23527-ede8-4e6a-b1cb-00e5bf8301c1 tempest-ServerActionsTestOtherB-894551005 tempest-ServerActionsTestOtherB-894551005-project-member] [instance: 74ac9703-1cd7-4983-b7d4-c69b01fec7b2] Disconnected iSCSI Volume {{(pid=74613) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 29 17:58:35 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-bca23527-ede8-4e6a-b1cb-00e5bf8301c1 tempest-ServerActionsTestOtherB-894551005 tempest-ServerActionsTestOtherB-894551005-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/74ac9703-1cd7-4983-b7d4-c69b01fec7b2/disk --force-share --output=json {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 17:58:35 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:58:35 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:58:35 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:58:35 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-bca23527-ede8-4e6a-b1cb-00e5bf8301c1 tempest-ServerActionsTestOtherB-894551005 tempest-ServerActionsTestOtherB-894551005-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/74ac9703-1cd7-4983-b7d4-c69b01fec7b2/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 17:58:35 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-bca23527-ede8-4e6a-b1cb-00e5bf8301c1 tempest-ServerActionsTestOtherB-894551005 tempest-ServerActionsTestOtherB-894551005-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/74ac9703-1cd7-4983-b7d4-c69b01fec7b2/disk --force-share --output=json {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 17:58:35 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:58:35 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:58:35 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-bca23527-ede8-4e6a-b1cb-00e5bf8301c1 tempest-ServerActionsTestOtherB-894551005 tempest-ServerActionsTestOtherB-894551005-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/74ac9703-1cd7-4983-b7d4-c69b01fec7b2/disk --force-share --output=json" returned: 0 in 0.231s {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 17:58:35 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-bca23527-ede8-4e6a-b1cb-00e5bf8301c1 tempest-ServerActionsTestOtherB-894551005 tempest-ServerActionsTestOtherB-894551005-project-member] skipping disk /dev/sde (vdb) as it is a volume {{(pid=74613) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 29 17:58:35 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-bca23527-ede8-4e6a-b1cb-00e5bf8301c1 tempest-ServerActionsTestOtherB-894551005 tempest-ServerActionsTestOtherB-894551005-project-member] Running cmd (subprocess): cp -r /opt/stack/data/nova/instances/74ac9703-1cd7-4983-b7d4-c69b01fec7b2_resize/disk /opt/stack/data/nova/instances/74ac9703-1cd7-4983-b7d4-c69b01fec7b2/disk {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 17:58:36 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-bca23527-ede8-4e6a-b1cb-00e5bf8301c1 tempest-ServerActionsTestOtherB-894551005 tempest-ServerActionsTestOtherB-894551005-project-member] CMD "cp -r /opt/stack/data/nova/instances/74ac9703-1cd7-4983-b7d4-c69b01fec7b2_resize/disk /opt/stack/data/nova/instances/74ac9703-1cd7-4983-b7d4-c69b01fec7b2/disk" returned: 0 in 0.367s {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 17:58:36 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-bca23527-ede8-4e6a-b1cb-00e5bf8301c1 tempest-ServerActionsTestOtherB-894551005 tempest-ServerActionsTestOtherB-894551005-project-member] Running cmd (subprocess): cp -r /opt/stack/data/nova/instances/74ac9703-1cd7-4983-b7d4-c69b01fec7b2_resize/disk.info /opt/stack/data/nova/instances/74ac9703-1cd7-4983-b7d4-c69b01fec7b2/disk.info {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 17:58:36 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-bca23527-ede8-4e6a-b1cb-00e5bf8301c1 tempest-ServerActionsTestOtherB-894551005 tempest-ServerActionsTestOtherB-894551005-project-member] CMD "cp -r /opt/stack/data/nova/instances/74ac9703-1cd7-4983-b7d4-c69b01fec7b2_resize/disk.info /opt/stack/data/nova/instances/74ac9703-1cd7-4983-b7d4-c69b01fec7b2/disk.info" returned: 0 in 0.067s {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 17:58:36 user nova-compute[74613]: DEBUG nova.compute.manager [req-4ed9d973-033c-4d4f-8547-564f289af744 req-15b653be-2248-48e2-b692-6405de887ea0 service nova] [instance: 74ac9703-1cd7-4983-b7d4-c69b01fec7b2] Received event network-vif-plugged-c63b6577-fb46-437a-95b3-8321fab45d0c {{(pid=74613) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 17:58:36 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-4ed9d973-033c-4d4f-8547-564f289af744 req-15b653be-2248-48e2-b692-6405de887ea0 service nova] Acquiring lock "74ac9703-1cd7-4983-b7d4-c69b01fec7b2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 17:58:36 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-4ed9d973-033c-4d4f-8547-564f289af744 req-15b653be-2248-48e2-b692-6405de887ea0 service nova] Lock "74ac9703-1cd7-4983-b7d4-c69b01fec7b2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 17:58:36 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-4ed9d973-033c-4d4f-8547-564f289af744 req-15b653be-2248-48e2-b692-6405de887ea0 service nova] Lock "74ac9703-1cd7-4983-b7d4-c69b01fec7b2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 17:58:36 user nova-compute[74613]: DEBUG nova.compute.manager [req-4ed9d973-033c-4d4f-8547-564f289af744 req-15b653be-2248-48e2-b692-6405de887ea0 service nova] [instance: 74ac9703-1cd7-4983-b7d4-c69b01fec7b2] No waiting events found dispatching network-vif-plugged-c63b6577-fb46-437a-95b3-8321fab45d0c {{(pid=74613) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 17:58:36 user nova-compute[74613]: WARNING nova.compute.manager [req-4ed9d973-033c-4d4f-8547-564f289af744 req-15b653be-2248-48e2-b692-6405de887ea0 service nova] [instance: 74ac9703-1cd7-4983-b7d4-c69b01fec7b2] Received unexpected event network-vif-plugged-c63b6577-fb46-437a-95b3-8321fab45d0c for instance with vm_state active and task_state resize_migrating.
Nov 29 17:58:36 user nova-compute[74613]: DEBUG nova.compute.manager [req-4ed9d973-033c-4d4f-8547-564f289af744 req-15b653be-2248-48e2-b692-6405de887ea0 service nova] [instance: 74ac9703-1cd7-4983-b7d4-c69b01fec7b2] Received event network-vif-plugged-c63b6577-fb46-437a-95b3-8321fab45d0c {{(pid=74613) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 17:58:36 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-4ed9d973-033c-4d4f-8547-564f289af744 req-15b653be-2248-48e2-b692-6405de887ea0 service nova] Acquiring lock "74ac9703-1cd7-4983-b7d4-c69b01fec7b2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 17:58:36 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-4ed9d973-033c-4d4f-8547-564f289af744 req-15b653be-2248-48e2-b692-6405de887ea0 service nova] Lock "74ac9703-1cd7-4983-b7d4-c69b01fec7b2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 17:58:36 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-4ed9d973-033c-4d4f-8547-564f289af744 req-15b653be-2248-48e2-b692-6405de887ea0 service nova] Lock "74ac9703-1cd7-4983-b7d4-c69b01fec7b2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 17:58:36 user nova-compute[74613]: DEBUG nova.compute.manager [req-4ed9d973-033c-4d4f-8547-564f289af744 req-15b653be-2248-48e2-b692-6405de887ea0 service nova] [instance: 74ac9703-1cd7-4983-b7d4-c69b01fec7b2] No waiting events found dispatching network-vif-plugged-c63b6577-fb46-437a-95b3-8321fab45d0c {{(pid=74613) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 17:58:36 user nova-compute[74613]: WARNING nova.compute.manager [req-4ed9d973-033c-4d4f-8547-564f289af744 req-15b653be-2248-48e2-b692-6405de887ea0 service nova] [instance: 74ac9703-1cd7-4983-b7d4-c69b01fec7b2] Received unexpected event network-vif-plugged-c63b6577-fb46-437a-95b3-8321fab45d0c for instance with vm_state active and task_state resize_migrating.
Nov 29 17:58:36 user nova-compute[74613]: DEBUG nova.compute.manager [req-4ed9d973-033c-4d4f-8547-564f289af744 req-15b653be-2248-48e2-b692-6405de887ea0 service nova] [instance: 74ac9703-1cd7-4983-b7d4-c69b01fec7b2] Received event network-vif-plugged-c63b6577-fb46-437a-95b3-8321fab45d0c {{(pid=74613) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 17:58:36 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-4ed9d973-033c-4d4f-8547-564f289af744 req-15b653be-2248-48e2-b692-6405de887ea0 service nova] Acquiring lock "74ac9703-1cd7-4983-b7d4-c69b01fec7b2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 17:58:36 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-4ed9d973-033c-4d4f-8547-564f289af744 req-15b653be-2248-48e2-b692-6405de887ea0 service nova] Lock "74ac9703-1cd7-4983-b7d4-c69b01fec7b2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 17:58:36 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-4ed9d973-033c-4d4f-8547-564f289af744 req-15b653be-2248-48e2-b692-6405de887ea0 service nova] Lock "74ac9703-1cd7-4983-b7d4-c69b01fec7b2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 17:58:36 user nova-compute[74613]: DEBUG nova.compute.manager [req-4ed9d973-033c-4d4f-8547-564f289af744 req-15b653be-2248-48e2-b692-6405de887ea0 service nova] [instance: 74ac9703-1cd7-4983-b7d4-c69b01fec7b2] No waiting events found dispatching network-vif-plugged-c63b6577-fb46-437a-95b3-8321fab45d0c {{(pid=74613) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 17:58:36 user nova-compute[74613]: WARNING nova.compute.manager [req-4ed9d973-033c-4d4f-8547-564f289af744 req-15b653be-2248-48e2-b692-6405de887ea0 service nova] [instance: 74ac9703-1cd7-4983-b7d4-c69b01fec7b2] Received unexpected event network-vif-plugged-c63b6577-fb46-437a-95b3-8321fab45d0c for instance with vm_state active and task_state resize_migrating.
Nov 29 17:58:36 user nova-compute[74613]: DEBUG nova.compute.manager [req-4ed9d973-033c-4d4f-8547-564f289af744 req-15b653be-2248-48e2-b692-6405de887ea0 service nova] [instance: 74ac9703-1cd7-4983-b7d4-c69b01fec7b2] Received event network-vif-unplugged-c63b6577-fb46-437a-95b3-8321fab45d0c {{(pid=74613) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 17:58:36 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-4ed9d973-033c-4d4f-8547-564f289af744 req-15b653be-2248-48e2-b692-6405de887ea0 service nova] Acquiring lock "74ac9703-1cd7-4983-b7d4-c69b01fec7b2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 17:58:36 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-4ed9d973-033c-4d4f-8547-564f289af744 req-15b653be-2248-48e2-b692-6405de887ea0 service nova] Lock "74ac9703-1cd7-4983-b7d4-c69b01fec7b2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 17:58:36 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-4ed9d973-033c-4d4f-8547-564f289af744 req-15b653be-2248-48e2-b692-6405de887ea0 service nova] Lock "74ac9703-1cd7-4983-b7d4-c69b01fec7b2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 17:58:36 user nova-compute[74613]: DEBUG nova.compute.manager [req-4ed9d973-033c-4d4f-8547-564f289af744 req-15b653be-2248-48e2-b692-6405de887ea0 service nova] [instance: 74ac9703-1cd7-4983-b7d4-c69b01fec7b2] No waiting events found dispatching network-vif-unplugged-c63b6577-fb46-437a-95b3-8321fab45d0c {{(pid=74613) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 17:58:36 user nova-compute[74613]: WARNING nova.compute.manager [req-4ed9d973-033c-4d4f-8547-564f289af744 req-15b653be-2248-48e2-b692-6405de887ea0 service nova] [instance: 74ac9703-1cd7-4983-b7d4-c69b01fec7b2] Received unexpected event network-vif-unplugged-c63b6577-fb46-437a-95b3-8321fab45d0c for instance with vm_state active and task_state resize_migrating.
Nov 29 17:58:36 user nova-compute[74613]: DEBUG nova.compute.manager [req-4ed9d973-033c-4d4f-8547-564f289af744 req-15b653be-2248-48e2-b692-6405de887ea0 service nova] [instance: 74ac9703-1cd7-4983-b7d4-c69b01fec7b2] Received event network-vif-plugged-c63b6577-fb46-437a-95b3-8321fab45d0c {{(pid=74613) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 17:58:36 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-4ed9d973-033c-4d4f-8547-564f289af744 req-15b653be-2248-48e2-b692-6405de887ea0 service nova] Acquiring lock "74ac9703-1cd7-4983-b7d4-c69b01fec7b2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 17:58:36 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-4ed9d973-033c-4d4f-8547-564f289af744 req-15b653be-2248-48e2-b692-6405de887ea0 service nova] Lock "74ac9703-1cd7-4983-b7d4-c69b01fec7b2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 17:58:36 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-4ed9d973-033c-4d4f-8547-564f289af744 req-15b653be-2248-48e2-b692-6405de887ea0 service nova] Lock "74ac9703-1cd7-4983-b7d4-c69b01fec7b2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 17:58:36 user nova-compute[74613]: DEBUG nova.compute.manager [req-4ed9d973-033c-4d4f-8547-564f289af744 req-15b653be-2248-48e2-b692-6405de887ea0 service nova] [instance: 74ac9703-1cd7-4983-b7d4-c69b01fec7b2] No waiting events found dispatching network-vif-plugged-c63b6577-fb46-437a-95b3-8321fab45d0c {{(pid=74613) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 17:58:36 user nova-compute[74613]: WARNING nova.compute.manager [req-4ed9d973-033c-4d4f-8547-564f289af744 req-15b653be-2248-48e2-b692-6405de887ea0 service nova] [instance: 74ac9703-1cd7-4983-b7d4-c69b01fec7b2] Received unexpected event network-vif-plugged-c63b6577-fb46-437a-95b3-8321fab45d0c for instance with vm_state active and task_state resize_migrating.
Nov 29 17:58:37 user nova-compute[74613]: DEBUG nova.network.neutron [None req-bca23527-ede8-4e6a-b1cb-00e5bf8301c1 tempest-ServerActionsTestOtherB-894551005 tempest-ServerActionsTestOtherB-894551005-project-member] [instance: 74ac9703-1cd7-4983-b7d4-c69b01fec7b2] Port c63b6577-fb46-437a-95b3-8321fab45d0c binding to destination host user is already ACTIVE {{(pid=74613) migrate_instance_start /opt/stack/nova/nova/network/neutron.py:3170}}
Nov 29 17:58:37 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-bca23527-ede8-4e6a-b1cb-00e5bf8301c1 tempest-ServerActionsTestOtherB-894551005 tempest-ServerActionsTestOtherB-894551005-project-member] Acquiring lock "74ac9703-1cd7-4983-b7d4-c69b01fec7b2-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 17:58:37 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-bca23527-ede8-4e6a-b1cb-00e5bf8301c1 tempest-ServerActionsTestOtherB-894551005 tempest-ServerActionsTestOtherB-894551005-project-member] Lock "74ac9703-1cd7-4983-b7d4-c69b01fec7b2-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 17:58:37 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-bca23527-ede8-4e6a-b1cb-00e5bf8301c1 tempest-ServerActionsTestOtherB-894551005 tempest-ServerActionsTestOtherB-894551005-project-member] Lock "74ac9703-1cd7-4983-b7d4-c69b01fec7b2-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 17:58:37 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-bca23527-ede8-4e6a-b1cb-00e5bf8301c1 tempest-ServerActionsTestOtherB-894551005 tempest-ServerActionsTestOtherB-894551005-project-member] Acquiring lock "refresh_cache-74ac9703-1cd7-4983-b7d4-c69b01fec7b2" {{(pid=74613) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 17:58:37 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-bca23527-ede8-4e6a-b1cb-00e5bf8301c1 tempest-ServerActionsTestOtherB-894551005 tempest-ServerActionsTestOtherB-894551005-project-member] Acquired lock "refresh_cache-74ac9703-1cd7-4983-b7d4-c69b01fec7b2" {{(pid=74613) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 17:58:37 user nova-compute[74613]: DEBUG nova.network.neutron [None req-bca23527-ede8-4e6a-b1cb-00e5bf8301c1 tempest-ServerActionsTestOtherB-894551005 tempest-ServerActionsTestOtherB-894551005-project-member] [instance: 74ac9703-1cd7-4983-b7d4-c69b01fec7b2] Building network info cache for instance {{(pid=74613) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 29 17:58:37 user nova-compute[74613]: DEBUG nova.network.neutron [None req-bca23527-ede8-4e6a-b1cb-00e5bf8301c1 tempest-ServerActionsTestOtherB-894551005 tempest-ServerActionsTestOtherB-894551005-project-member] [instance: 74ac9703-1cd7-4983-b7d4-c69b01fec7b2] Updating instance_info_cache with network_info: [{"id": "c63b6577-fb46-437a-95b3-8321fab45d0c", "address": "fa:16:3e:c3:2e:71", "network": {"id": "e687ed60-2592-4836-b97e-0828527b1b9f", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1938956411-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.143", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b392ca87608940c0ae467318b66453b2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc63b6577-fb", "ovs_interfaceid": "c63b6577-fb46-437a-95b3-8321fab45d0c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74613) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 17:58:37 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-bca23527-ede8-4e6a-b1cb-00e5bf8301c1 tempest-ServerActionsTestOtherB-894551005 tempest-ServerActionsTestOtherB-894551005-project-member] Releasing lock "refresh_cache-74ac9703-1cd7-4983-b7d4-c69b01fec7b2" {{(pid=74613) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 17:58:37 user nova-compute[74613]: DEBUG os_brick.utils [None req-bca23527-ede8-4e6a-b1cb-00e5bf8301c1 tempest-ServerActionsTestOtherB-894551005 tempest-ServerActionsTestOtherB-894551005-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74613) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 17:58:37 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 17:58:37 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 17:58:37 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[20f7d07c-e4d2-4eb4-a8d5-d3ee438ad4a9]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:400972819b5\n', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 17:58:37 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 17:58:37 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.020s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 17:58:37 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[0123fa1b-ac97-4ad7-a23d-282a1b156654]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 17:58:37 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 17:58:37 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 17:58:37 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5da5694-7eaf-419c-ac32-431f850b7273]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 17:58:37 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[6438036f-e9ba-49d5-a893-c96e4c32a987]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 17:58:37 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-bca23527-ede8-4e6a-b1cb-00e5bf8301c1 tempest-ServerActionsTestOtherB-894551005 tempest-ServerActionsTestOtherB-894551005-project-member] Running cmd (subprocess): nvme version {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 17:58:38 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-bca23527-ede8-4e6a-b1cb-00e5bf8301c1 tempest-ServerActionsTestOtherB-894551005 tempest-ServerActionsTestOtherB-894551005-project-member] 'nvme version' failed. Not Retrying. {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 17:58:38 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.nvmeof [None req-bca23527-ede8-4e6a-b1cb-00e5bf8301c1 tempest-ServerActionsTestOtherB-894551005 tempest-ServerActionsTestOtherB-894551005-project-member] nvme not present on system {{(pid=74613) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 29 17:58:38 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 17:58:38 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 17:58:38 user nova-compute[74613]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 29 17:58:38 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[431518a4-e904-4b2c-bd22-2c3085eb9ddc]: (4, '') {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 17:58:38 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.lightos [None req-bca23527-ede8-4e6a-b1cb-00e5bf8301c1 tempest-ServerActionsTestOtherB-894551005 tempest-ServerActionsTestOtherB-894551005-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74613) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 29 17:58:38 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.lightos [None req-bca23527-ede8-4e6a-b1cb-00e5bf8301c1 tempest-ServerActionsTestOtherB-894551005 tempest-ServerActionsTestOtherB-894551005-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74613) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 29 17:58:38 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.lightos [None req-bca23527-ede8-4e6a-b1cb-00e5bf8301c1 tempest-ServerActionsTestOtherB-894551005 tempest-ServerActionsTestOtherB-894551005-project-member] LIGHTOS: no hostnqn found. {{(pid=74613) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 29 17:58:38 user nova-compute[74613]: DEBUG os_brick.utils [None req-bca23527-ede8-4e6a-b1cb-00e5bf8301c1 tempest-ServerActionsTestOtherB-894551005 tempest-ServerActionsTestOtherB-894551005-project-member] <== get_connector_properties: return (124ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:400972819b5', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74613) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 17:58:39 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:58:42 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-a682e6da-a7ab-4a9c-8872-c783fa8b8e0c tempest-ServerStableDeviceRescueTest-1416322546 tempest-ServerStableDeviceRescueTest-1416322546-project-member] Acquiring lock "b6b0ba36-ad89-45f1-9578-8b999567dd25" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 17:58:42 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-a682e6da-a7ab-4a9c-8872-c783fa8b8e0c tempest-ServerStableDeviceRescueTest-1416322546 tempest-ServerStableDeviceRescueTest-1416322546-project-member] Lock "b6b0ba36-ad89-45f1-9578-8b999567dd25" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 17:58:42 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-a682e6da-a7ab-4a9c-8872-c783fa8b8e0c tempest-ServerStableDeviceRescueTest-1416322546 tempest-ServerStableDeviceRescueTest-1416322546-project-member] Acquiring lock "b6b0ba36-ad89-45f1-9578-8b999567dd25-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 17:58:42 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-a682e6da-a7ab-4a9c-8872-c783fa8b8e0c tempest-ServerStableDeviceRescueTest-1416322546 tempest-ServerStableDeviceRescueTest-1416322546-project-member] Lock "b6b0ba36-ad89-45f1-9578-8b999567dd25-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 17:58:42 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-a682e6da-a7ab-4a9c-8872-c783fa8b8e0c tempest-ServerStableDeviceRescueTest-1416322546 tempest-ServerStableDeviceRescueTest-1416322546-project-member] Lock "b6b0ba36-ad89-45f1-9578-8b999567dd25-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 17:58:42 user nova-compute[74613]: INFO nova.compute.manager [None req-a682e6da-a7ab-4a9c-8872-c783fa8b8e0c tempest-ServerStableDeviceRescueTest-1416322546 tempest-ServerStableDeviceRescueTest-1416322546-project-member] [instance: b6b0ba36-ad89-45f1-9578-8b999567dd25] Terminating instance
Nov 29 17:58:42 user nova-compute[74613]: DEBUG nova.compute.manager [None req-a682e6da-a7ab-4a9c-8872-c783fa8b8e0c tempest-ServerStableDeviceRescueTest-1416322546 tempest-ServerStableDeviceRescueTest-1416322546-project-member] [instance: b6b0ba36-ad89-45f1-9578-8b999567dd25] Start destroying the instance on the hypervisor. {{(pid=74613) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 29 17:58:42 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:58:42 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:58:42 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:58:42 user nova-compute[74613]: DEBUG nova.compute.manager [req-fcb2c997-06c6-41f7-a392-aef10ed979b8 req-ce60cacd-9a4e-4b07-9f7d-9e740257be61 service nova] [instance: b6b0ba36-ad89-45f1-9578-8b999567dd25] Received event network-vif-unplugged-0167e253-42dd-486a-8231-a8b8199f3584 {{(pid=74613) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 17:58:42 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-fcb2c997-06c6-41f7-a392-aef10ed979b8 req-ce60cacd-9a4e-4b07-9f7d-9e740257be61 service nova] Acquiring lock "b6b0ba36-ad89-45f1-9578-8b999567dd25-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 17:58:42 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-fcb2c997-06c6-41f7-a392-aef10ed979b8 req-ce60cacd-9a4e-4b07-9f7d-9e740257be61 service nova] Lock "b6b0ba36-ad89-45f1-9578-8b999567dd25-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 17:58:42 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-fcb2c997-06c6-41f7-a392-aef10ed979b8 req-ce60cacd-9a4e-4b07-9f7d-9e740257be61 service nova] Lock "b6b0ba36-ad89-45f1-9578-8b999567dd25-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 17:58:42 user nova-compute[74613]: DEBUG nova.compute.manager [req-fcb2c997-06c6-41f7-a392-aef10ed979b8 req-ce60cacd-9a4e-4b07-9f7d-9e740257be61 service nova] [instance: b6b0ba36-ad89-45f1-9578-8b999567dd25] No waiting events found dispatching network-vif-unplugged-0167e253-42dd-486a-8231-a8b8199f3584 {{(pid=74613) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 17:58:42 user nova-compute[74613]: DEBUG nova.compute.manager [req-fcb2c997-06c6-41f7-a392-aef10ed979b8 req-ce60cacd-9a4e-4b07-9f7d-9e740257be61 service nova] [instance: b6b0ba36-ad89-45f1-9578-8b999567dd25] Received event network-vif-unplugged-0167e253-42dd-486a-8231-a8b8199f3584 for instance with task_state deleting. {{(pid=74613) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 29 17:58:43 user nova-compute[74613]: INFO nova.virt.libvirt.driver [-] [instance: b6b0ba36-ad89-45f1-9578-8b999567dd25] Instance destroyed successfully.
Nov 29 17:58:43 user nova-compute[74613]: DEBUG nova.objects.instance [None req-a682e6da-a7ab-4a9c-8872-c783fa8b8e0c tempest-ServerStableDeviceRescueTest-1416322546 tempest-ServerStableDeviceRescueTest-1416322546-project-member] Lazy-loading 'resources' on Instance uuid b6b0ba36-ad89-45f1-9578-8b999567dd25 {{(pid=74613) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 17:58:43 user nova-compute[74613]: DEBUG nova.virt.libvirt.vif [None req-a682e6da-a7ab-4a9c-8872-c783fa8b8e0c tempest-ServerStableDeviceRescueTest-1416322546 tempest-ServerStableDeviceRescueTest-1416322546-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T17:51:21Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-56030904',display_name='tempest-ServerStableDeviceRescueTest-server-56030904',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-56030904',id=1,image_ref='4217f428-8d9d-4ee1-9614-642d26d90c46',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBI85GZspGma1CfHLklAfK5ROqiFitnBViWC2sBj1qECdxTf0mbQqMsBEY3GHAf3hN5wBoUAnLHRf24tZw5VxrRYKqkyzeutcAUMWWy4Q3HjZLnkFQi82h3okfVi2Mvtpcw==',key_name='tempest-keypair-2003214039',keypairs=<?>,launch_index=0,launched_at=2023-11-29T17:55:38Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='b8f184c16b5348beb2dc9e6359a47651',ramdisk_id='',reservation_id='r-ywn83s23',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='4217f428-8d9d-4ee1-9614-642d26d90c46',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerStableDeviceRescueTest-1416322546',owner_user_name='tempest-ServerStableDeviceRescueTest-1416322546-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-29T17:57:24Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='71f13889d23c4ddb9c5e52d7a1a82d47',uuid=b6b0ba36-ad89-45f1-9578-8b999567dd25,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "0167e253-42dd-486a-8231-a8b8199f3584", "address": "fa:16:3e:3f:ea:5d", "network": {"id": "880ea498-5e4e-4786-a894-bac0f42572f4", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1846928198-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.254", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b8f184c16b5348beb2dc9e6359a47651", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0167e253-42", "ovs_interfaceid": "0167e253-42dd-486a-8231-a8b8199f3584", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74613) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 29 17:58:43 user nova-compute[74613]: DEBUG nova.network.os_vif_util [None req-a682e6da-a7ab-4a9c-8872-c783fa8b8e0c tempest-ServerStableDeviceRescueTest-1416322546 tempest-ServerStableDeviceRescueTest-1416322546-project-member] Converting VIF {"id": "0167e253-42dd-486a-8231-a8b8199f3584", "address": "fa:16:3e:3f:ea:5d", "network": {"id": "880ea498-5e4e-4786-a894-bac0f42572f4", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1846928198-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.254", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b8f184c16b5348beb2dc9e6359a47651", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0167e253-42", "ovs_interfaceid": "0167e253-42dd-486a-8231-a8b8199f3584", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74613) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 17:58:43 user nova-compute[74613]: DEBUG nova.network.os_vif_util [None req-a682e6da-a7ab-4a9c-8872-c783fa8b8e0c tempest-ServerStableDeviceRescueTest-1416322546 tempest-ServerStableDeviceRescueTest-1416322546-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:3f:ea:5d,bridge_name='br-int',has_traffic_filtering=True,id=0167e253-42dd-486a-8231-a8b8199f3584,network=Network(880ea498-5e4e-4786-a894-bac0f42572f4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0167e253-42') {{(pid=74613) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 17:58:43 user nova-compute[74613]: DEBUG os_vif [None req-a682e6da-a7ab-4a9c-8872-c783fa8b8e0c tempest-ServerStableDeviceRescueTest-1416322546 tempest-ServerStableDeviceRescueTest-1416322546-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:3f:ea:5d,bridge_name='br-int',has_traffic_filtering=True,id=0167e253-42dd-486a-8231-a8b8199f3584,network=Network(880ea498-5e4e-4786-a894-bac0f42572f4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0167e253-42') {{(pid=74613) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 29 17:58:43 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:58:43 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap0167e253-42, bridge=br-int, if_exists=True) {{(pid=74613) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 17:58:43 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:58:43 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 17:58:43 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:58:43 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=0d107f67-70c0-463b-b623-4c5f1fc3c92d) {{(pid=74613) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 17:58:43 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:58:43 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:58:43 user nova-compute[74613]: INFO os_vif [None req-a682e6da-a7ab-4a9c-8872-c783fa8b8e0c tempest-ServerStableDeviceRescueTest-1416322546 tempest-ServerStableDeviceRescueTest-1416322546-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:3f:ea:5d,bridge_name='br-int',has_traffic_filtering=True,id=0167e253-42dd-486a-8231-a8b8199f3584,network=Network(880ea498-5e4e-4786-a894-bac0f42572f4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0167e253-42')
Nov 29 17:58:43 user nova-compute[74613]: INFO nova.virt.libvirt.driver [None req-a682e6da-a7ab-4a9c-8872-c783fa8b8e0c tempest-ServerStableDeviceRescueTest-1416322546 tempest-ServerStableDeviceRescueTest-1416322546-project-member] [instance: b6b0ba36-ad89-45f1-9578-8b999567dd25] Deleting instance files /opt/stack/data/nova/instances/b6b0ba36-ad89-45f1-9578-8b999567dd25_del
Nov 29 17:58:43 user nova-compute[74613]: INFO nova.virt.libvirt.driver [None req-a682e6da-a7ab-4a9c-8872-c783fa8b8e0c tempest-ServerStableDeviceRescueTest-1416322546 tempest-ServerStableDeviceRescueTest-1416322546-project-member] [instance: b6b0ba36-ad89-45f1-9578-8b999567dd25] Deletion of /opt/stack/data/nova/instances/b6b0ba36-ad89-45f1-9578-8b999567dd25_del complete
Nov 29 17:58:43 user nova-compute[74613]: INFO nova.compute.manager [None req-a682e6da-a7ab-4a9c-8872-c783fa8b8e0c tempest-ServerStableDeviceRescueTest-1416322546 tempest-ServerStableDeviceRescueTest-1416322546-project-member] [instance: b6b0ba36-ad89-45f1-9578-8b999567dd25] Took 0.92 seconds to destroy the instance on the hypervisor.
Nov 29 17:58:43 user nova-compute[74613]: DEBUG oslo.service.loopingcall [None req-a682e6da-a7ab-4a9c-8872-c783fa8b8e0c tempest-ServerStableDeviceRescueTest-1416322546 tempest-ServerStableDeviceRescueTest-1416322546-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74613) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 29 17:58:43 user nova-compute[74613]: DEBUG nova.compute.manager [-] [instance: b6b0ba36-ad89-45f1-9578-8b999567dd25] Deallocating network for instance {{(pid=74613) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 29 17:58:43 user nova-compute[74613]: DEBUG nova.network.neutron [-] [instance: b6b0ba36-ad89-45f1-9578-8b999567dd25] deallocate_for_instance() {{(pid=74613) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 29 17:58:44 user nova-compute[74613]: DEBUG nova.network.neutron [-] [instance: b6b0ba36-ad89-45f1-9578-8b999567dd25] Updating instance_info_cache with network_info: [] {{(pid=74613) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 17:58:44 user nova-compute[74613]: INFO nova.compute.manager [-] [instance: b6b0ba36-ad89-45f1-9578-8b999567dd25] Took 0.83 seconds to deallocate network for instance.
Nov 29 17:58:44 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-a682e6da-a7ab-4a9c-8872-c783fa8b8e0c tempest-ServerStableDeviceRescueTest-1416322546 tempest-ServerStableDeviceRescueTest-1416322546-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 17:58:44 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-a682e6da-a7ab-4a9c-8872-c783fa8b8e0c tempest-ServerStableDeviceRescueTest-1416322546 tempest-ServerStableDeviceRescueTest-1416322546-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 17:58:44 user nova-compute[74613]: DEBUG nova.compute.provider_tree [None req-a682e6da-a7ab-4a9c-8872-c783fa8b8e0c tempest-ServerStableDeviceRescueTest-1416322546 tempest-ServerStableDeviceRescueTest-1416322546-project-member] Inventory has not changed in ProviderTree for provider: 639d980e-3b12-44b1-b8f4-1812416fa4dd {{(pid=74613) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 17:58:44 user nova-compute[74613]: DEBUG nova.scheduler.client.report [None req-a682e6da-a7ab-4a9c-8872-c783fa8b8e0c tempest-ServerStableDeviceRescueTest-1416322546 tempest-ServerStableDeviceRescueTest-1416322546-project-member] Inventory has not changed for provider 639d980e-3b12-44b1-b8f4-1812416fa4dd based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74613) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 17:58:44 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-a682e6da-a7ab-4a9c-8872-c783fa8b8e0c tempest-ServerStableDeviceRescueTest-1416322546 tempest-ServerStableDeviceRescueTest-1416322546-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.348s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 17:58:44 user nova-compute[74613]: INFO nova.scheduler.client.report [None req-a682e6da-a7ab-4a9c-8872-c783fa8b8e0c tempest-ServerStableDeviceRescueTest-1416322546 tempest-ServerStableDeviceRescueTest-1416322546-project-member] Deleted allocations for instance b6b0ba36-ad89-45f1-9578-8b999567dd25
Nov 29 17:58:44 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-a682e6da-a7ab-4a9c-8872-c783fa8b8e0c tempest-ServerStableDeviceRescueTest-1416322546 tempest-ServerStableDeviceRescueTest-1416322546-project-member] Lock "b6b0ba36-ad89-45f1-9578-8b999567dd25" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.316s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 17:58:44 user nova-compute[74613]: DEBUG nova.compute.manager [req-6ff8118e-a4e2-46aa-9a2e-3eda112fe57f req-33710f37-6001-47c5-a184-b5efece558b4 service nova] [instance: b6b0ba36-ad89-45f1-9578-8b999567dd25] Received event network-vif-plugged-0167e253-42dd-486a-8231-a8b8199f3584 {{(pid=74613) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 17:58:44 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-6ff8118e-a4e2-46aa-9a2e-3eda112fe57f req-33710f37-6001-47c5-a184-b5efece558b4 service nova] Acquiring lock "b6b0ba36-ad89-45f1-9578-8b999567dd25-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 17:58:44 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-6ff8118e-a4e2-46aa-9a2e-3eda112fe57f req-33710f37-6001-47c5-a184-b5efece558b4 service nova] Lock "b6b0ba36-ad89-45f1-9578-8b999567dd25-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 17:58:44 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-6ff8118e-a4e2-46aa-9a2e-3eda112fe57f req-33710f37-6001-47c5-a184-b5efece558b4 service nova] Lock "b6b0ba36-ad89-45f1-9578-8b999567dd25-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 17:58:44 user nova-compute[74613]: DEBUG nova.compute.manager [req-6ff8118e-a4e2-46aa-9a2e-3eda112fe57f req-33710f37-6001-47c5-a184-b5efece558b4 service nova] [instance: b6b0ba36-ad89-45f1-9578-8b999567dd25] No waiting events found dispatching network-vif-plugged-0167e253-42dd-486a-8231-a8b8199f3584 {{(pid=74613) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 17:58:44 user nova-compute[74613]: WARNING nova.compute.manager [req-6ff8118e-a4e2-46aa-9a2e-3eda112fe57f req-33710f37-6001-47c5-a184-b5efece558b4 service nova] [instance: b6b0ba36-ad89-45f1-9578-8b999567dd25] Received unexpected event network-vif-plugged-0167e253-42dd-486a-8231-a8b8199f3584 for instance with vm_state deleted and task_state None.
Nov 29 17:58:44 user nova-compute[74613]: DEBUG nova.compute.manager [req-6ff8118e-a4e2-46aa-9a2e-3eda112fe57f req-33710f37-6001-47c5-a184-b5efece558b4 service nova] [instance: b6b0ba36-ad89-45f1-9578-8b999567dd25] Received event network-vif-deleted-0167e253-42dd-486a-8231-a8b8199f3584 {{(pid=74613) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 17:58:45 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:58:45 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-bca23527-ede8-4e6a-b1cb-00e5bf8301c1 tempest-ServerActionsTestOtherB-894551005 tempest-ServerActionsTestOtherB-894551005-project-member] [instance: 74ac9703-1cd7-4983-b7d4-c69b01fec7b2] Starting finish_migration {{(pid=74613) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11671}}
Nov 29 17:58:45 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-bca23527-ede8-4e6a-b1cb-00e5bf8301c1 tempest-ServerActionsTestOtherB-894551005 tempest-ServerActionsTestOtherB-894551005-project-member] [instance: 74ac9703-1cd7-4983-b7d4-c69b01fec7b2] Instance directory exists: not creating {{(pid=74613) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Nov 29 17:58:45 user nova-compute[74613]: INFO nova.virt.libvirt.driver [None req-bca23527-ede8-4e6a-b1cb-00e5bf8301c1 tempest-ServerActionsTestOtherB-894551005 tempest-ServerActionsTestOtherB-894551005-project-member] [instance: 74ac9703-1cd7-4983-b7d4-c69b01fec7b2] Creating image(s)
Nov 29 17:58:45 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-bca23527-ede8-4e6a-b1cb-00e5bf8301c1 tempest-ServerActionsTestOtherB-894551005 tempest-ServerActionsTestOtherB-894551005-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/21faea9e6951f3bdd0153b76ac89fe1a60a34758 --force-share --output=json {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 17:58:46 user nova-compute[74613]: WARNING nova.virt.libvirt.driver [None req-4ee7a628-cff4-43f1-9b79-dbc8d6129d20 tempest-VolumesAdminNegativeTest-636556351 tempest-VolumesAdminNegativeTest-636556351-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 0aa463c6-01e7-48e5-b082-e083558342e3 is timed out.
Nov 29 17:58:46 user nova-compute[74613]: INFO nova.virt.libvirt.driver [None req-4ee7a628-cff4-43f1-9b79-dbc8d6129d20 tempest-VolumesAdminNegativeTest-636556351 tempest-VolumesAdminNegativeTest-636556351-project-member] Successfully detached device vdb from instance 0aa463c6-01e7-48e5-b082-e083558342e3 from the live domain config.
Nov 29 17:58:46 user nova-compute[74613]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4ee7a628-cff4-43f1-9b79-dbc8d6129d20 tempest-VolumesAdminNegativeTest-636556351 tempest-VolumesAdminNegativeTest-636556351-project-member] [instance: 0aa463c6-01e7-48e5-b082-e083558342e3] calling os-brick to detach iSCSI Volume {{(pid=74613) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 29 17:58:46 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ee7a628-cff4-43f1-9b79-dbc8d6129d20 tempest-VolumesAdminNegativeTest-636556351 tempest-VolumesAdminNegativeTest-636556351-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff828156890>, {'target_iqn': 'iqn.2010-10.org.openstack:d8614e81-d01c-4ec5-9f96-46df3535d465', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jJTGiKxp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=74613) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 17:58:46 user nova-compute[74613]: WARNING os_brick.initiator.connectors.base [None req-4ee7a628-cff4-43f1-9b79-dbc8d6129d20 tempest-VolumesAdminNegativeTest-636556351 tempest-VolumesAdminNegativeTest-636556351-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 17:58:46 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.base [None req-4ee7a628-cff4-43f1-9b79-dbc8d6129d20 tempest-VolumesAdminNegativeTest-636556351 tempest-VolumesAdminNegativeTest-636556351-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 17:58:46 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.base [None req-4ee7a628-cff4-43f1-9b79-dbc8d6129d20 tempest-VolumesAdminNegativeTest-636556351 tempest-VolumesAdminNegativeTest-636556351-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 17:58:46 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 17:58:46 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 17:58:46 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3b8d20b-9739-4d8c-bad0-d118de526681]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:9511387c-8772-40f2-bf2d-6b6387649e9f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d8614e81-d01c-4ec5-9f96-46df3535d465\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:72d22ffa-f425-4575-86a5-afbd8bb9cdd6\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 17:58:46 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ee7a628-cff4-43f1-9b79-dbc8d6129d20 tempest-VolumesAdminNegativeTest-636556351 tempest-VolumesAdminNegativeTest-636556351-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 29 17:58:46 user nova-compute[74613]: No targets found.
Nov 29 17:58:46 user nova-compute[74613]: iSNS:
Nov 29 17:58:46 user nova-compute[74613]: No targets found.
Nov 29 17:58:46 user nova-compute[74613]: STATIC:
Nov 29 17:58:46 user nova-compute[74613]: Target: iqn.2010-10.org.openstack:9511387c-8772-40f2-bf2d-6b6387649e9f
Nov 29 17:58:46 user nova-compute[74613]:         Portal: 172.16.0.220:3260,-1
Nov 29 17:58:46 user nova-compute[74613]:                 Iface Name: default
Nov 29 17:58:46 user nova-compute[74613]: Target: iqn.2010-10.org.openstack:d8614e81-d01c-4ec5-9f96-46df3535d465
Nov 29 17:58:46 user nova-compute[74613]:         Portal: 172.16.0.220:3260,-1
Nov 29 17:58:46 user nova-compute[74613]:                 Iface Name: default
Nov 29 17:58:46 user nova-compute[74613]: Target: iqn.2010-10.org.openstack:72d22ffa-f425-4575-86a5-afbd8bb9cdd6
Nov 29 17:58:46 user nova-compute[74613]:         Portal: 172.16.0.220:3260,-1
Nov 29 17:58:46 user nova-compute[74613]:                 Iface Name: default
Nov 29 17:58:46 user nova-compute[74613]: FIRMWARE:
Nov 29 17:58:46 user nova-compute[74613]: No targets found.
Nov 29 17:58:46 user nova-compute[74613]:  stderr= {{(pid=74613) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 17:58:46 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ee7a628-cff4-43f1-9b79-dbc8d6129d20 tempest-VolumesAdminNegativeTest-636556351 tempest-VolumesAdminNegativeTest-636556351-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 29 17:58:46 user nova-compute[74613]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 29 17:58:46 user nova-compute[74613]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74613) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 29 17:58:46 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ee7a628-cff4-43f1-9b79-dbc8d6129d20 tempest-VolumesAdminNegativeTest-636556351 tempest-VolumesAdminNegativeTest-636556351-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d8614e81-d01c-4ec5-9f96-46df3535d465', 0)] {{(pid=74613) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 29 17:58:46 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-bca23527-ede8-4e6a-b1cb-00e5bf8301c1 tempest-ServerActionsTestOtherB-894551005 tempest-ServerActionsTestOtherB-894551005-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/21faea9e6951f3bdd0153b76ac89fe1a60a34758 --force-share --output=json" returned: 0 in 0.179s {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 17:58:46 user nova-compute[74613]: DEBUG nova.virt.disk.api [None req-bca23527-ede8-4e6a-b1cb-00e5bf8301c1 tempest-ServerActionsTestOtherB-894551005 tempest-ServerActionsTestOtherB-894551005-project-member] Checking if we can resize image /opt/stack/data/nova/instances/74ac9703-1cd7-4983-b7d4-c69b01fec7b2/disk. size=21474836480 {{(pid=74613) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 29 17:58:46 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-bca23527-ede8-4e6a-b1cb-00e5bf8301c1 tempest-ServerActionsTestOtherB-894551005 tempest-ServerActionsTestOtherB-894551005-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/74ac9703-1cd7-4983-b7d4-c69b01fec7b2/disk --force-share --output=json {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 17:58:46 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 17:58:46 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 17:58:46 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[70f26026-10f1-4e28-afcd-26202c5ea819]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:72d22ffa-f425-4575-86a5-afbd8bb9cdd6\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9511387c-8772-40f2-bf2d-6b6387649e9f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d8614e81-d01c-4ec5-9f96-46df3535d465\n', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 17:58:46 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 17:58:46 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 17:58:46 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3ac297e-b39a-495f-96b7-7fb1f3df8586]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9511387c-8772-40f2-bf2d-6b6387649e9f (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:72d22ffa-f425-4575-86a5-afbd8bb9cdd6 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d8614e81-d01c-4ec5-9f96-46df3535d465 (non-flash)\n', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 17:58:46 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ee7a628-cff4-43f1-9b79-dbc8d6129d20 tempest-VolumesAdminNegativeTest-636556351 tempest-VolumesAdminNegativeTest-636556351-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9511387c-8772-40f2-bf2d-6b6387649e9f (non-flash)
Nov 29 17:58:46 user nova-compute[74613]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:72d22ffa-f425-4575-86a5-afbd8bb9cdd6 (non-flash)
Nov 29 17:58:46 user nova-compute[74613]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d8614e81-d01c-4ec5-9f96-46df3535d465 (non-flash)
Nov 29 17:58:46 user nova-compute[74613]:  stderr= {{(pid=74613) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 17:58:46 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ee7a628-cff4-43f1-9b79-dbc8d6129d20 tempest-VolumesAdminNegativeTest-636556351 tempest-VolumesAdminNegativeTest-636556351-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9511387c-8772-40f2-bf2d-6b6387649e9f (non-flash)
Nov 29 17:58:46 user nova-compute[74613]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:72d22ffa-f425-4575-86a5-afbd8bb9cdd6 (non-flash)
Nov 29 17:58:46 user nova-compute[74613]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d8614e81-d01c-4ec5-9f96-46df3535d465 (non-flash)
Nov 29 17:58:46 user nova-compute[74613]:  stderr= {{(pid=74613) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 17:58:46 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ee7a628-cff4-43f1-9b79-dbc8d6129d20 tempest-VolumesAdminNegativeTest-636556351 tempest-VolumesAdminNegativeTest-636556351-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7ff8284ed090>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d8614e81-d01c-4ec5-9f96-46df3535d465'): ({'sdc'}, set())}) {{(pid=74613) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 29 17:58:46 user nova-compute[74613]: DEBUG os_brick.initiator.linuxscsi [None req-4ee7a628-cff4-43f1-9b79-dbc8d6129d20 tempest-VolumesAdminNegativeTest-636556351 tempest-VolumesAdminNegativeTest-636556351-project-member] Removing single pathed devices sdc {{(pid=74613) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 29 17:58:46 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 17:58:46 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 17:58:46 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[3435fe78-e8bd-4f61-840f-2d94d50c23fe]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 17:58:46 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 17:58:46 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.019s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 17:58:46 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce99a5c2-eb33-48a0-b0b7-5fc8a03e4960]: (4, ('ok\n', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 17:58:46 user nova-compute[74613]: DEBUG os_brick.initiator.linuxscsi [None req-4ee7a628-cff4-43f1-9b79-dbc8d6129d20 tempest-VolumesAdminNegativeTest-636556351 tempest-VolumesAdminNegativeTest-636556351-project-member] Flushing IO for device /dev/sdc {{(pid=74613) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 29 17:58:46 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 17:58:46 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.012s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 17:58:46 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[66831cc0-2dac-4460-8e27-3bfeb32ecc1b]: (4, ('', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 17:58:46 user nova-compute[74613]: DEBUG os_brick.initiator.linuxscsi [None req-4ee7a628-cff4-43f1-9b79-dbc8d6129d20 tempest-VolumesAdminNegativeTest-636556351 tempest-VolumesAdminNegativeTest-636556351-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=74613) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 29 17:58:46 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 17:58:46 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-bca23527-ede8-4e6a-b1cb-00e5bf8301c1 tempest-ServerActionsTestOtherB-894551005 tempest-ServerActionsTestOtherB-894551005-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/74ac9703-1cd7-4983-b7d4-c69b01fec7b2/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 17:58:46 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-bca23527-ede8-4e6a-b1cb-00e5bf8301c1 tempest-ServerActionsTestOtherB-894551005 tempest-ServerActionsTestOtherB-894551005-project-member] Running cmd (subprocess): qemu-img resize /opt/stack/data/nova/instances/74ac9703-1cd7-4983-b7d4-c69b01fec7b2/disk 21474836480 {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 17:58:46 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.040s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 17:58:46 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[51fe12b6-eaa8-4be5-8b88-24ddfddced0f]: (4, ('1', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 17:58:46 user nova-compute[74613]: DEBUG os_brick.initiator.linuxscsi [None req-4ee7a628-cff4-43f1-9b79-dbc8d6129d20 tempest-VolumesAdminNegativeTest-636556351 tempest-VolumesAdminNegativeTest-636556351-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=74613) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 29 17:58:46 user nova-compute[74613]: DEBUG os_brick.initiator.linuxscsi [None req-4ee7a628-cff4-43f1-9b79-dbc8d6129d20 tempest-VolumesAdminNegativeTest-636556351 tempest-VolumesAdminNegativeTest-636556351-project-member] SCSI volumes sdc have been removed. {{(pid=74613) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 29 17:58:46 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ee7a628-cff4-43f1-9b79-dbc8d6129d20 tempest-VolumesAdminNegativeTest-636556351 tempest-VolumesAdminNegativeTest-636556351-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d8614e81-d01c-4ec5-9f96-46df3535d465')] {{(pid=74613) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 29 17:58:46 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d8614e81-d01c-4ec5-9f96-46df3535d465 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 17:58:46 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d8614e81-d01c-4ec5-9f96-46df3535d465 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.077s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 17:58:46 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[51e34380-356f-4d49-a140-1ea29dbb4457]: (4, ('', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 17:58:46 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ee7a628-cff4-43f1-9b79-dbc8d6129d20 tempest-VolumesAdminNegativeTest-636556351 tempest-VolumesAdminNegativeTest-636556351-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74613) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 17:58:46 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d8614e81-d01c-4ec5-9f96-46df3535d465 -p 172.16.0.220:3260 --logout {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 17:58:46 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-bca23527-ede8-4e6a-b1cb-00e5bf8301c1 tempest-ServerActionsTestOtherB-894551005 tempest-ServerActionsTestOtherB-894551005-project-member] CMD "qemu-img resize /opt/stack/data/nova/instances/74ac9703-1cd7-4983-b7d4-c69b01fec7b2/disk 21474836480" returned: 0 in 0.309s {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 17:58:46 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d8614e81-d01c-4ec5-9f96-46df3535d465 -p 172.16.0.220:3260 --logout" returned: 0 in 0.190s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 17:58:46 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe47ca80-036b-44d7-a8d9-835782bf01ea]: (4, ('Logging out of session [sid: 20, target: iqn.2010-10.org.openstack:d8614e81-d01c-4ec5-9f96-46df3535d465, portal: 172.16.0.220,3260]\nLogout of [sid: 20, target: iqn.2010-10.org.openstack:d8614e81-d01c-4ec5-9f96-46df3535d465, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 17:58:46 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ee7a628-cff4-43f1-9b79-dbc8d6129d20 tempest-VolumesAdminNegativeTest-636556351 tempest-VolumesAdminNegativeTest-636556351-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 20, target: iqn.2010-10.org.openstack:d8614e81-d01c-4ec5-9f96-46df3535d465, portal: 172.16.0.220,3260]
Nov 29 17:58:46 user nova-compute[74613]: Logout of [sid: 20, target: iqn.2010-10.org.openstack:d8614e81-d01c-4ec5-9f96-46df3535d465, portal: 172.16.0.220,3260] successful.
Nov 29 17:58:46 user nova-compute[74613]:  stderr= {{(pid=74613) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 17:58:46 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d8614e81-d01c-4ec5-9f96-46df3535d465 -p 172.16.0.220:3260 --op delete {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 17:58:46 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-bca23527-ede8-4e6a-b1cb-00e5bf8301c1 tempest-ServerActionsTestOtherB-894551005 tempest-ServerActionsTestOtherB-894551005-project-member] [instance: 74ac9703-1cd7-4983-b7d4-c69b01fec7b2] Did not create local disks {{(pid=74613) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 29 17:58:46 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-bca23527-ede8-4e6a-b1cb-00e5bf8301c1 tempest-ServerActionsTestOtherB-894551005 tempest-ServerActionsTestOtherB-894551005-project-member] [instance: 74ac9703-1cd7-4983-b7d4-c69b01fec7b2] Ensure instance console log exists: /opt/stack/data/nova/instances/74ac9703-1cd7-4983-b7d4-c69b01fec7b2/console.log {{(pid=74613) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 29 17:58:46 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-bca23527-ede8-4e6a-b1cb-00e5bf8301c1 tempest-ServerActionsTestOtherB-894551005 tempest-ServerActionsTestOtherB-894551005-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 17:58:46 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-bca23527-ede8-4e6a-b1cb-00e5bf8301c1 tempest-ServerActionsTestOtherB-894551005 tempest-ServerActionsTestOtherB-894551005-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 17:58:46 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-bca23527-ede8-4e6a-b1cb-00e5bf8301c1 tempest-ServerActionsTestOtherB-894551005 tempest-ServerActionsTestOtherB-894551005-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 17:58:46 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-bca23527-ede8-4e6a-b1cb-00e5bf8301c1 tempest-ServerActionsTestOtherB-894551005 tempest-ServerActionsTestOtherB-894551005-project-member] [instance: 74ac9703-1cd7-4983-b7d4-c69b01fec7b2] Start _get_guest_xml network_info=[{"id": "c63b6577-fb46-437a-95b3-8321fab45d0c", "address": "fa:16:3e:c3:2e:71", "network": {"id": "e687ed60-2592-4836-b97e-0828527b1b9f", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1938956411-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.143", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-1938956411-network", "vif_mac": "fa:16:3e:c3:2e:71"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b392ca87608940c0ae467318b66453b2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc63b6577-fb", "ovs_interfaceid": "c63b6577-fb46-437a-95b3-8321fab45d0c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-29T17:47:38Z,direct_url=<?>,disk_format='qcow2',id=4217f428-8d9d-4ee1-9614-642d26d90c46,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='794b07cbd46a44b5865cfda741036bae',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-29T17:47:40Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'size': 0, 'device_type': 'disk', 'boot_index': 0, 'guest_format': None, 'encrypted': False, 'encryption_format': None, 'disk_bus': 'virtio', 'image_id': '4217f428-8d9d-4ee1-9614-642d26d90c46'}], 'ephemerals': [], 'block_device_mapping': [{'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:bb526b54-3017-4f30-b5c7-88027b146d52', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RtrxDocV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'attaching', 'instance': '74ac9703-1cd7-4983-b7d4-c69b01fec7b2', 'attached_at': '2023-11-29T17:58:46.000000', 'detached_at': '', 'volume_id': 'bb526b54-3017-4f30-b5c7-88027b146d52', 'serial': 'bb526b54-3017-4f30-b5c7-88027b146d52'}, 'mount_device': '/dev/vdb', 'delete_on_termination': False, 'device_type': 'disk', 'boot_index': None, 'guest_format': None, 'attachment_id': 'd659b631-9325-485e-a6cb-404a80af8285', 'disk_bus': 'virtio', 'volume_type': None} {{(pid=74613) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 29 17:58:46 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d8614e81-d01c-4ec5-9f96-46df3535d465 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.022s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 17:58:46 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[60bc78d1-c134-4b3e-a212-8524908c966b]: (4, ('', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 17:58:46 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ee7a628-cff4-43f1-9b79-dbc8d6129d20 tempest-VolumesAdminNegativeTest-636556351 tempest-VolumesAdminNegativeTest-636556351-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74613) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 17:58:46 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.base [None req-4ee7a628-cff4-43f1-9b79-dbc8d6129d20 tempest-VolumesAdminNegativeTest-636556351 tempest-VolumesAdminNegativeTest-636556351-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.554s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 17:58:46 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ee7a628-cff4-43f1-9b79-dbc8d6129d20 tempest-VolumesAdminNegativeTest-636556351 tempest-VolumesAdminNegativeTest-636556351-project-member] <== disconnect_volume: return (556ms) None {{(pid=74613) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 17:58:46 user nova-compute[74613]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4ee7a628-cff4-43f1-9b79-dbc8d6129d20 tempest-VolumesAdminNegativeTest-636556351 tempest-VolumesAdminNegativeTest-636556351-project-member] [instance: 0aa463c6-01e7-48e5-b082-e083558342e3] Disconnected iSCSI Volume {{(pid=74613) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 29 17:58:46 user nova-compute[74613]: WARNING nova.virt.libvirt.driver [None req-bca23527-ede8-4e6a-b1cb-00e5bf8301c1 tempest-ServerActionsTestOtherB-894551005 tempest-ServerActionsTestOtherB-894551005-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 17:58:46 user nova-compute[74613]: WARNING nova.virt.libvirt.driver [None req-bca23527-ede8-4e6a-b1cb-00e5bf8301c1 tempest-ServerActionsTestOtherB-894551005 tempest-ServerActionsTestOtherB-894551005-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 17:58:46 user nova-compute[74613]: DEBUG nova.virt.libvirt.host [None req-bca23527-ede8-4e6a-b1cb-00e5bf8301c1 tempest-ServerActionsTestOtherB-894551005 tempest-ServerActionsTestOtherB-894551005-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74613) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 29 17:58:46 user nova-compute[74613]: DEBUG nova.virt.libvirt.host [None req-bca23527-ede8-4e6a-b1cb-00e5bf8301c1 tempest-ServerActionsTestOtherB-894551005 tempest-ServerActionsTestOtherB-894551005-project-member] CPU controller missing on host. {{(pid=74613) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 29 17:58:46 user nova-compute[74613]: DEBUG nova.virt.libvirt.host [None req-bca23527-ede8-4e6a-b1cb-00e5bf8301c1 tempest-ServerActionsTestOtherB-894551005 tempest-ServerActionsTestOtherB-894551005-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74613) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 29 17:58:46 user nova-compute[74613]: DEBUG nova.virt.libvirt.host [None req-bca23527-ede8-4e6a-b1cb-00e5bf8301c1 tempest-ServerActionsTestOtherB-894551005 tempest-ServerActionsTestOtherB-894551005-project-member] CPU controller found on host. {{(pid=74613) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 29 17:58:46 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-bca23527-ede8-4e6a-b1cb-00e5bf8301c1 tempest-ServerActionsTestOtherB-894551005 tempest-ServerActionsTestOtherB-894551005-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74613) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 29 17:58:46 user nova-compute[74613]: DEBUG nova.virt.hardware [None req-bca23527-ede8-4e6a-b1cb-00e5bf8301c1 tempest-ServerActionsTestOtherB-894551005 tempest-ServerActionsTestOtherB-894551005-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-29T17:47:29Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='2',id=7,is_public=True,memory_mb=2048,name='m1.small',projects=<?>,root_gb=20,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-29T17:47:38Z,direct_url=<?>,disk_format='qcow2',id=4217f428-8d9d-4ee1-9614-642d26d90c46,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='794b07cbd46a44b5865cfda741036bae',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-29T17:47:40Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74613) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 29 17:58:46 user nova-compute[74613]: DEBUG nova.virt.hardware [None req-bca23527-ede8-4e6a-b1cb-00e5bf8301c1 tempest-ServerActionsTestOtherB-894551005 tempest-ServerActionsTestOtherB-894551005-project-member] Flavor limits 0:0:0 {{(pid=74613) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 29 17:58:46 user nova-compute[74613]: DEBUG nova.virt.hardware [None req-bca23527-ede8-4e6a-b1cb-00e5bf8301c1 tempest-ServerActionsTestOtherB-894551005 tempest-ServerActionsTestOtherB-894551005-project-member] Image limits 0:0:0 {{(pid=74613) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 29 17:58:46 user nova-compute[74613]: DEBUG nova.virt.hardware [None req-bca23527-ede8-4e6a-b1cb-00e5bf8301c1 tempest-ServerActionsTestOtherB-894551005 tempest-ServerActionsTestOtherB-894551005-project-member] Flavor pref 0:0:0 {{(pid=74613) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 29 17:58:46 user nova-compute[74613]: DEBUG nova.virt.hardware [None req-bca23527-ede8-4e6a-b1cb-00e5bf8301c1 tempest-ServerActionsTestOtherB-894551005 tempest-ServerActionsTestOtherB-894551005-project-member] Image pref 0:0:0 {{(pid=74613) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 29 17:58:46 user nova-compute[74613]: DEBUG nova.virt.hardware [None req-bca23527-ede8-4e6a-b1cb-00e5bf8301c1 tempest-ServerActionsTestOtherB-894551005 tempest-ServerActionsTestOtherB-894551005-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74613) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 29 17:58:46 user nova-compute[74613]: DEBUG nova.virt.hardware [None req-bca23527-ede8-4e6a-b1cb-00e5bf8301c1 tempest-ServerActionsTestOtherB-894551005 tempest-ServerActionsTestOtherB-894551005-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74613) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 29 17:58:46 user nova-compute[74613]: DEBUG nova.virt.hardware [None req-bca23527-ede8-4e6a-b1cb-00e5bf8301c1 tempest-ServerActionsTestOtherB-894551005 tempest-ServerActionsTestOtherB-894551005-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74613) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 29 17:58:46 user nova-compute[74613]: DEBUG nova.virt.hardware [None req-bca23527-ede8-4e6a-b1cb-00e5bf8301c1 tempest-ServerActionsTestOtherB-894551005 tempest-ServerActionsTestOtherB-894551005-project-member] Got 1 possible topologies {{(pid=74613) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 29 17:58:46 user nova-compute[74613]: DEBUG nova.virt.hardware [None req-bca23527-ede8-4e6a-b1cb-00e5bf8301c1 tempest-ServerActionsTestOtherB-894551005 tempest-ServerActionsTestOtherB-894551005-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74613) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 29 17:58:46 user nova-compute[74613]: DEBUG nova.virt.hardware [None req-bca23527-ede8-4e6a-b1cb-00e5bf8301c1 tempest-ServerActionsTestOtherB-894551005 tempest-ServerActionsTestOtherB-894551005-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74613) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 29 17:58:46 user nova-compute[74613]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bca23527-ede8-4e6a-b1cb-00e5bf8301c1 tempest-ServerActionsTestOtherB-894551005 tempest-ServerActionsTestOtherB-894551005-project-member] [instance: 74ac9703-1cd7-4983-b7d4-c69b01fec7b2] Calling os-brick to attach iSCSI Volume {{(pid=74613) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 29 17:58:46 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-bca23527-ede8-4e6a-b1cb-00e5bf8301c1 tempest-ServerActionsTestOtherB-894551005 tempest-ServerActionsTestOtherB-894551005-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff828156890>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:bb526b54-3017-4f30-b5c7-88027b146d52', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RtrxDocV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74613) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 17:58:46 user nova-compute[74613]: WARNING os_brick.initiator.connectors.base [None req-bca23527-ede8-4e6a-b1cb-00e5bf8301c1 tempest-ServerActionsTestOtherB-894551005 tempest-ServerActionsTestOtherB-894551005-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 17:58:46 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.base [None req-bca23527-ede8-4e6a-b1cb-00e5bf8301c1 tempest-ServerActionsTestOtherB-894551005 tempest-ServerActionsTestOtherB-894551005-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 17:58:46 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.base [None req-bca23527-ede8-4e6a-b1cb-00e5bf8301c1 tempest-ServerActionsTestOtherB-894551005 tempest-ServerActionsTestOtherB-894551005-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.003s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 17:58:46 user nova-compute[74613]: WARNING os_brick.initiator.connectors.base [None req-bca23527-ede8-4e6a-b1cb-00e5bf8301c1 tempest-ServerActionsTestOtherB-894551005 tempest-ServerActionsTestOtherB-894551005-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 17:58:46 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.base [None req-bca23527-ede8-4e6a-b1cb-00e5bf8301c1 tempest-ServerActionsTestOtherB-894551005 tempest-ServerActionsTestOtherB-894551005-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:bb526b54-3017-4f30-b5c7-88027b146d52" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 17:58:46 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.base [None req-bca23527-ede8-4e6a-b1cb-00e5bf8301c1 tempest-ServerActionsTestOtherB-894551005 tempest-ServerActionsTestOtherB-894551005-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:bb526b54-3017-4f30-b5c7-88027b146d52" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 17:58:46 user nova-compute[74613]: INFO os_brick.initiator.connectors.iscsi [None req-bca23527-ede8-4e6a-b1cb-00e5bf8301c1 tempest-ServerActionsTestOtherB-894551005 tempest-ServerActionsTestOtherB-894551005-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 29 17:58:46 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bb526b54-3017-4f30-b5c7-88027b146d52 -p 172.16.0.220:3260 {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 17:58:46 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bb526b54-3017-4f30-b5c7-88027b146d52 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 17:58:46 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[7695553a-877c-416c-8abf-54c0b32aa59b]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 17:58:46 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-bca23527-ede8-4e6a-b1cb-00e5bf8301c1 tempest-ServerActionsTestOtherB-894551005 tempest-ServerActionsTestOtherB-894551005-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 29 17:58:46 user nova-compute[74613]:  {{(pid=74613) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 17:58:46 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bb526b54-3017-4f30-b5c7-88027b146d52 -p 172.16.0.220:3260 --interface default --op new {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 17:58:46 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bb526b54-3017-4f30-b5c7-88027b146d52 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 17:58:46 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[562de12e-6a1e-4c01-8871-875a9fda3042]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:bb526b54-3017-4f30-b5c7-88027b146d52] added\n', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 17:58:46 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-bca23527-ede8-4e6a-b1cb-00e5bf8301c1 tempest-ServerActionsTestOtherB-894551005 tempest-ServerActionsTestOtherB-894551005-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:bb526b54-3017-4f30-b5c7-88027b146d52] added
Nov 29 17:58:46 user nova-compute[74613]:  stderr= {{(pid=74613) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 17:58:46 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bb526b54-3017-4f30-b5c7-88027b146d52 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 17:58:46 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bb526b54-3017-4f30-b5c7-88027b146d52 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 17:58:46 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[b57b8b2e-f745-4ef9-8157-5d62c9676ff8]: (4, ('', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 17:58:46 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-bca23527-ede8-4e6a-b1cb-00e5bf8301c1 tempest-ServerActionsTestOtherB-894551005 tempest-ServerActionsTestOtherB-894551005-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74613) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 17:58:46 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bb526b54-3017-4f30-b5c7-88027b146d52 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 17:58:46 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bb526b54-3017-4f30-b5c7-88027b146d52 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 17:58:46 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c43d7f9-9ce0-4019-9f25-cb14ca0de293]: (4, ('', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 17:58:46 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-bca23527-ede8-4e6a-b1cb-00e5bf8301c1 tempest-ServerActionsTestOtherB-894551005 tempest-ServerActionsTestOtherB-894551005-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74613) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 17:58:46 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bb526b54-3017-4f30-b5c7-88027b146d52 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v RtrxDocV {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 17:58:46 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bb526b54-3017-4f30-b5c7-88027b146d52 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v RtrxDocV" returned: 0 in 0.023s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 17:58:46 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[16e19f55-71ac-4b06-aeea-8873569c66c6]: (4, ('', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 17:58:46 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-bca23527-ede8-4e6a-b1cb-00e5bf8301c1 tempest-ServerActionsTestOtherB-894551005 tempest-ServerActionsTestOtherB-894551005-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'RtrxDocV'): stdout= stderr= {{(pid=74613) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 17:58:46 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bb526b54-3017-4f30-b5c7-88027b146d52 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 17:58:46 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bb526b54-3017-4f30-b5c7-88027b146d52 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 17:58:46 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8e9f5b9-0819-4e78-a363-d8437ae3bcda]: (4, ('', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 17:58:46 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-bca23527-ede8-4e6a-b1cb-00e5bf8301c1 tempest-ServerActionsTestOtherB-894551005 tempest-ServerActionsTestOtherB-894551005-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74613) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 17:58:46 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 17:58:46 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 17:58:46 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0f1f7c0-f1b8-4105-8eff-0014bcd99231]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9511387c-8772-40f2-bf2d-6b6387649e9f (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:72d22ffa-f425-4575-86a5-afbd8bb9cdd6 (non-flash)\n', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 17:58:46 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-bca23527-ede8-4e6a-b1cb-00e5bf8301c1 tempest-ServerActionsTestOtherB-894551005 tempest-ServerActionsTestOtherB-894551005-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9511387c-8772-40f2-bf2d-6b6387649e9f (non-flash)
Nov 29 17:58:46 user nova-compute[74613]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:72d22ffa-f425-4575-86a5-afbd8bb9cdd6 (non-flash)
Nov 29 17:58:46 user nova-compute[74613]:  stderr= {{(pid=74613) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 17:58:46 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-bca23527-ede8-4e6a-b1cb-00e5bf8301c1 tempest-ServerActionsTestOtherB-894551005 tempest-ServerActionsTestOtherB-894551005-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9511387c-8772-40f2-bf2d-6b6387649e9f (non-flash)
Nov 29 17:58:46 user nova-compute[74613]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:72d22ffa-f425-4575-86a5-afbd8bb9cdd6 (non-flash)
Nov 29 17:58:46 user nova-compute[74613]:  stderr= {{(pid=74613) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 17:58:46 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bb526b54-3017-4f30-b5c7-88027b146d52 -p 172.16.0.220:3260 --login {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 17:58:47 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bb526b54-3017-4f30-b5c7-88027b146d52 -p 172.16.0.220:3260 --login" returned: 0 in 0.066s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 17:58:47 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0f13a28-27a5-4b77-87b5-499e1ad3a0cd]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:bb526b54-3017-4f30-b5c7-88027b146d52, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:bb526b54-3017-4f30-b5c7-88027b146d52, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 17:58:47 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-bca23527-ede8-4e6a-b1cb-00e5bf8301c1 tempest-ServerActionsTestOtherB-894551005 tempest-ServerActionsTestOtherB-894551005-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:bb526b54-3017-4f30-b5c7-88027b146d52, portal: 172.16.0.220,3260]
Nov 29 17:58:47 user nova-compute[74613]: Login to [iface: default, target: iqn.2010-10.org.openstack:bb526b54-3017-4f30-b5c7-88027b146d52, portal: 172.16.0.220,3260] successful.
Nov 29 17:58:47 user nova-compute[74613]:  stderr= {{(pid=74613) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 17:58:47 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bb526b54-3017-4f30-b5c7-88027b146d52 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 17:58:47 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bb526b54-3017-4f30-b5c7-88027b146d52 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 17:58:47 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ad2a41a-922d-4d9a-84e8-04a9d3545087]: (4, ('', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 17:58:47 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-bca23527-ede8-4e6a-b1cb-00e5bf8301c1 tempest-ServerActionsTestOtherB-894551005 tempest-ServerActionsTestOtherB-894551005-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74613) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 17:58:47 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 17:58:47 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 17:58:47 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[71b798b4-567d-43bb-8f0c-604c9a3d0e6c]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9511387c-8772-40f2-bf2d-6b6387649e9f (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:72d22ffa-f425-4575-86a5-afbd8bb9cdd6 (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb526b54-3017-4f30-b5c7-88027b146d52 (non-flash)\n', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 17:58:47 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-bca23527-ede8-4e6a-b1cb-00e5bf8301c1 tempest-ServerActionsTestOtherB-894551005 tempest-ServerActionsTestOtherB-894551005-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9511387c-8772-40f2-bf2d-6b6387649e9f (non-flash)
Nov 29 17:58:47 user nova-compute[74613]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:72d22ffa-f425-4575-86a5-afbd8bb9cdd6 (non-flash)
Nov 29 17:58:47 user nova-compute[74613]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb526b54-3017-4f30-b5c7-88027b146d52 (non-flash)
Nov 29 17:58:47 user nova-compute[74613]:  stderr= {{(pid=74613) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 17:58:47 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-bca23527-ede8-4e6a-b1cb-00e5bf8301c1 tempest-ServerActionsTestOtherB-894551005 tempest-ServerActionsTestOtherB-894551005-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9511387c-8772-40f2-bf2d-6b6387649e9f (non-flash)
Nov 29 17:58:47 user nova-compute[74613]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:72d22ffa-f425-4575-86a5-afbd8bb9cdd6 (non-flash)
Nov 29 17:58:47 user nova-compute[74613]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb526b54-3017-4f30-b5c7-88027b146d52 (non-flash)
Nov 29 17:58:47 user nova-compute[74613]:  stderr= {{(pid=74613) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 17:58:47 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.base [None req-bca23527-ede8-4e6a-b1cb-00e5bf8301c1 tempest-ServerActionsTestOtherB-894551005 tempest-ServerActionsTestOtherB-894551005-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:bb526b54-3017-4f30-b5c7-88027b146d52" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.303s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 17:58:47 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-bca23527-ede8-4e6a-b1cb-00e5bf8301c1 tempest-ServerActionsTestOtherB-894551005 tempest-ServerActionsTestOtherB-894551005-project-member] Connected to 172.16.0.220:3260 {{(pid=74613) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 29 17:58:47 user nova-compute[74613]: DEBUG os_brick.initiator.linuxscsi [None req-bca23527-ede8-4e6a-b1cb-00e5bf8301c1 tempest-ServerActionsTestOtherB-894551005 tempest-ServerActionsTestOtherB-894551005-project-member] HCTL ('34', '-', '-', 0) found on session 22 with lun 0 {{(pid=74613) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 29 17:58:47 user nova-compute[74613]: DEBUG os_brick.initiator.linuxscsi [None req-bca23527-ede8-4e6a-b1cb-00e5bf8301c1 tempest-ServerActionsTestOtherB-894551005 tempest-ServerActionsTestOtherB-894551005-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=74613) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 29 17:58:47 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 17:58:47 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.019s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 17:58:47 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[51f95089-3e33-4634-96a1-a1da6507106a]: (4, ('- - 0', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 17:58:47 user nova-compute[74613]: DEBUG os_brick.initiator.linuxscsi [None req-bca23527-ede8-4e6a-b1cb-00e5bf8301c1 tempest-ServerActionsTestOtherB-894551005 tempest-ServerActionsTestOtherB-894551005-project-member] Searching for a device in session 22 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=74613) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 29 17:58:47 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-bca23527-ede8-4e6a-b1cb-00e5bf8301c1 tempest-ServerActionsTestOtherB-894551005 tempest-ServerActionsTestOtherB-894551005-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:bb526b54-3017-4f30-b5c7-88027b146d52', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RtrxDocV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74613) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 29 17:58:47 user nova-compute[74613]: DEBUG nova.objects.instance [None req-4ee7a628-cff4-43f1-9b79-dbc8d6129d20 tempest-VolumesAdminNegativeTest-636556351 tempest-VolumesAdminNegativeTest-636556351-project-member] Lazy-loading 'flavor' on Instance uuid 0aa463c6-01e7-48e5-b082-e083558342e3 {{(pid=74613) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 17:58:47 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-4ee7a628-cff4-43f1-9b79-dbc8d6129d20 tempest-VolumesAdminNegativeTest-636556351 tempest-VolumesAdminNegativeTest-636556351-project-member] Lock "0aa463c6-01e7-48e5-b082-e083558342e3" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.014s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 17:58:48 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.base [None req-bca23527-ede8-4e6a-b1cb-00e5bf8301c1 tempest-ServerActionsTestOtherB-894551005 tempest-ServerActionsTestOtherB-894551005-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.338s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 17:58:48 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-bca23527-ede8-4e6a-b1cb-00e5bf8301c1 tempest-ServerActionsTestOtherB-894551005 tempest-ServerActionsTestOtherB-894551005-project-member] <== connect_volume: return (1340ms) {'type': 'block', 'scsi_wwn': '23763623539386230', 'path': '/dev/sdc'} {{(pid=74613) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 17:58:48 user nova-compute[74613]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bca23527-ede8-4e6a-b1cb-00e5bf8301c1 tempest-ServerActionsTestOtherB-894551005 tempest-ServerActionsTestOtherB-894551005-project-member] [instance: 74ac9703-1cd7-4983-b7d4-c69b01fec7b2] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23763623539386230', 'path': '/dev/sdc'} {{(pid=74613) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 29 17:58:48 user nova-compute[74613]: DEBUG nova.virt.libvirt.vif [None req-bca23527-ede8-4e6a-b1cb-00e5bf8301c1 tempest-ServerActionsTestOtherB-894551005 tempest-ServerActionsTestOtherB-894551005-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T17:55:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-931769463',display_name='tempest-ServerActionsTestOtherB-server-931769463',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-931769463',id=14,image_ref='4217f428-8d9d-4ee1-9614-642d26d90c46',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBE0p3wmKXoOCABzKEPJ0MsHfAtC1JQfzjVn7a3OeQC65p309Te6g/AbiDIZbrFAX7j9aAJfq/HNC8gx1yP/V9/PHfR3o28o9EgbHEcoTtW/dEJGkpFGjjy+hrqfOfHYCnA==',key_name='tempest-keypair-464492783',keypairs=<?>,launch_index=0,launched_at=2023-11-29T17:55:35Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='b392ca87608940c0ae467318b66453b2',ramdisk_id='',reservation_id='r-0wzexjb0',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='4217f428-8d9d-4ee1-9614-642d26d90c46',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-894551005',owner_user_name='tempest-ServerActionsTestOtherB-894551005-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T17:58:37Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1a6eb590fed440729b45b8db79eb7c2f',uuid=74ac9703-1cd7-4983-b7d4-c69b01fec7b2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "c63b6577-fb46-437a-95b3-8321fab45d0c", "address": "fa:16:3e:c3:2e:71", "network": {"id": "e687ed60-2592-4836-b97e-0828527b1b9f", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1938956411-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.143", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-1938956411-network", "vif_mac": "fa:16:3e:c3:2e:71"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b392ca87608940c0ae467318b66453b2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc63b6577-fb", "ovs_interfaceid": "c63b6577-fb46-437a-95b3-8321fab45d0c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74613) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 29 17:58:48 user nova-compute[74613]: DEBUG nova.network.os_vif_util [None req-bca23527-ede8-4e6a-b1cb-00e5bf8301c1 tempest-ServerActionsTestOtherB-894551005 tempest-ServerActionsTestOtherB-894551005-project-member] Converting VIF {"id": "c63b6577-fb46-437a-95b3-8321fab45d0c", "address": "fa:16:3e:c3:2e:71", "network": {"id": "e687ed60-2592-4836-b97e-0828527b1b9f", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1938956411-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.143", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-1938956411-network", "vif_mac": "fa:16:3e:c3:2e:71"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b392ca87608940c0ae467318b66453b2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc63b6577-fb", "ovs_interfaceid": "c63b6577-fb46-437a-95b3-8321fab45d0c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74613) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 17:58:48 user nova-compute[74613]: DEBUG nova.network.os_vif_util [None req-bca23527-ede8-4e6a-b1cb-00e5bf8301c1 tempest-ServerActionsTestOtherB-894551005 tempest-ServerActionsTestOtherB-894551005-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c3:2e:71,bridge_name='br-int',has_traffic_filtering=True,id=c63b6577-fb46-437a-95b3-8321fab45d0c,network=Network(e687ed60-2592-4836-b97e-0828527b1b9f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc63b6577-fb') {{(pid=74613) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 17:58:48 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-bca23527-ede8-4e6a-b1cb-00e5bf8301c1 tempest-ServerActionsTestOtherB-894551005 tempest-ServerActionsTestOtherB-894551005-project-member] [instance: 74ac9703-1cd7-4983-b7d4-c69b01fec7b2] End _get_guest_xml xml=<domain type="kvm">
Nov 29 17:58:48 user nova-compute[74613]:   <uuid>74ac9703-1cd7-4983-b7d4-c69b01fec7b2</uuid>
Nov 29 17:58:48 user nova-compute[74613]:   <name>instance-0000000e</name>
Nov 29 17:58:48 user nova-compute[74613]:   <memory>2097152</memory>
Nov 29 17:58:48 user nova-compute[74613]:   <vcpu>1</vcpu>
Nov 29 17:58:48 user nova-compute[74613]:   <metadata>
Nov 29 17:58:48 user nova-compute[74613]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 29 17:58:48 user nova-compute[74613]:       <nova:package version="0.0.0"/>
Nov 29 17:58:48 user nova-compute[74613]:       <nova:name>tempest-ServerActionsTestOtherB-server-931769463</nova:name>
Nov 29 17:58:48 user nova-compute[74613]:       <nova:creationTime>2023-11-29 17:58:46</nova:creationTime>
Nov 29 17:58:48 user nova-compute[74613]:       <nova:flavor name="m1.small">
Nov 29 17:58:48 user nova-compute[74613]:         <nova:memory>2048</nova:memory>
Nov 29 17:58:48 user nova-compute[74613]:         <nova:disk>20</nova:disk>
Nov 29 17:58:48 user nova-compute[74613]:         <nova:swap>0</nova:swap>
Nov 29 17:58:48 user nova-compute[74613]:         <nova:ephemeral>0</nova:ephemeral>
Nov 29 17:58:48 user nova-compute[74613]:         <nova:vcpus>1</nova:vcpus>
Nov 29 17:58:48 user nova-compute[74613]:       </nova:flavor>
Nov 29 17:58:48 user nova-compute[74613]:       <nova:owner>
Nov 29 17:58:48 user nova-compute[74613]:         <nova:user uuid="1a6eb590fed440729b45b8db79eb7c2f">tempest-ServerActionsTestOtherB-894551005-project-member</nova:user>
Nov 29 17:58:48 user nova-compute[74613]:         <nova:project uuid="b392ca87608940c0ae467318b66453b2">tempest-ServerActionsTestOtherB-894551005</nova:project>
Nov 29 17:58:48 user nova-compute[74613]:       </nova:owner>
Nov 29 17:58:48 user nova-compute[74613]:       <nova:root type="image" uuid="4217f428-8d9d-4ee1-9614-642d26d90c46"/>
Nov 29 17:58:48 user nova-compute[74613]:       <nova:ports>
Nov 29 17:58:48 user nova-compute[74613]:         <nova:port uuid="c63b6577-fb46-437a-95b3-8321fab45d0c">
Nov 29 17:58:48 user nova-compute[74613]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Nov 29 17:58:48 user nova-compute[74613]:         </nova:port>
Nov 29 17:58:48 user nova-compute[74613]:       </nova:ports>
Nov 29 17:58:48 user nova-compute[74613]:     </nova:instance>
Nov 29 17:58:48 user nova-compute[74613]:   </metadata>
Nov 29 17:58:48 user nova-compute[74613]:   <sysinfo type="smbios">
Nov 29 17:58:48 user nova-compute[74613]:     <system>
Nov 29 17:58:48 user nova-compute[74613]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 29 17:58:48 user nova-compute[74613]:       <entry name="product">OpenStack Nova</entry>
Nov 29 17:58:48 user nova-compute[74613]:       <entry name="version">0.0.0</entry>
Nov 29 17:58:48 user nova-compute[74613]:       <entry name="serial">74ac9703-1cd7-4983-b7d4-c69b01fec7b2</entry>
Nov 29 17:58:48 user nova-compute[74613]:       <entry name="uuid">74ac9703-1cd7-4983-b7d4-c69b01fec7b2</entry>
Nov 29 17:58:48 user nova-compute[74613]:       <entry name="family">Virtual Machine</entry>
Nov 29 17:58:48 user nova-compute[74613]:     </system>
Nov 29 17:58:48 user nova-compute[74613]:   </sysinfo>
Nov 29 17:58:48 user nova-compute[74613]:   <os>
Nov 29 17:58:48 user nova-compute[74613]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 29 17:58:48 user nova-compute[74613]:     <boot dev="hd"/>
Nov 29 17:58:48 user nova-compute[74613]:     <smbios mode="sysinfo"/>
Nov 29 17:58:48 user nova-compute[74613]:   </os>
Nov 29 17:58:48 user nova-compute[74613]:   <features>
Nov 29 17:58:48 user nova-compute[74613]:     <acpi/>
Nov 29 17:58:48 user nova-compute[74613]:     <apic/>
Nov 29 17:58:48 user nova-compute[74613]:     <vmcoreinfo/>
Nov 29 17:58:48 user nova-compute[74613]:   </features>
Nov 29 17:58:48 user nova-compute[74613]:   <clock offset="utc">
Nov 29 17:58:48 user nova-compute[74613]:     <timer name="pit" tickpolicy="delay"/>
Nov 29 17:58:48 user nova-compute[74613]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 29 17:58:48 user nova-compute[74613]:     <timer name="hpet" present="no"/>
Nov 29 17:58:48 user nova-compute[74613]:   </clock>
Nov 29 17:58:48 user nova-compute[74613]:   <cpu mode="custom" match="exact">
Nov 29 17:58:48 user nova-compute[74613]:     <model>Nehalem</model>
Nov 29 17:58:48 user nova-compute[74613]:     <topology sockets="1" cores="1" threads="1"/>
Nov 29 17:58:48 user nova-compute[74613]:   </cpu>
Nov 29 17:58:48 user nova-compute[74613]:   <devices>
Nov 29 17:58:48 user nova-compute[74613]:     <disk type="file" device="disk">
Nov 29 17:58:48 user nova-compute[74613]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 29 17:58:48 user nova-compute[74613]:       <source file="/opt/stack/data/nova/instances/74ac9703-1cd7-4983-b7d4-c69b01fec7b2/disk"/>
Nov 29 17:58:48 user nova-compute[74613]:       <target dev="vda" bus="virtio"/>
Nov 29 17:58:48 user nova-compute[74613]:     </disk>
Nov 29 17:58:48 user nova-compute[74613]:     <disk type="block" device="disk">
Nov 29 17:58:48 user nova-compute[74613]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 17:58:48 user nova-compute[74613]:       <source dev="/dev/sdc"/>
Nov 29 17:58:48 user nova-compute[74613]:       <target dev="vdb" bus="virtio"/>
Nov 29 17:58:48 user nova-compute[74613]:       <serial>bb526b54-3017-4f30-b5c7-88027b146d52</serial>
Nov 29 17:58:48 user nova-compute[74613]:     </disk>
Nov 29 17:58:48 user nova-compute[74613]:     <interface type="ethernet">
Nov 29 17:58:48 user nova-compute[74613]:       <mac address="fa:16:3e:c3:2e:71"/>
Nov 29 17:58:48 user nova-compute[74613]:       <model type="virtio"/>
Nov 29 17:58:48 user nova-compute[74613]:       <mtu size="1442"/>
Nov 29 17:58:48 user nova-compute[74613]:       <target dev="tapc63b6577-fb"/>
Nov 29 17:58:48 user nova-compute[74613]:     </interface>
Nov 29 17:58:48 user nova-compute[74613]:     <serial type="pty">
Nov 29 17:58:48 user nova-compute[74613]:       <log file="/opt/stack/data/nova/instances/74ac9703-1cd7-4983-b7d4-c69b01fec7b2/console.log" append="off"/>
Nov 29 17:58:48 user nova-compute[74613]:     </serial>
Nov 29 17:58:48 user nova-compute[74613]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 29 17:58:48 user nova-compute[74613]:     <video>
Nov 29 17:58:48 user nova-compute[74613]:       <model type="virtio"/>
Nov 29 17:58:48 user nova-compute[74613]:     </video>
Nov 29 17:58:48 user nova-compute[74613]:     <rng model="virtio">
Nov 29 17:58:48 user nova-compute[74613]:       <backend model="random">/dev/urandom</backend>
Nov 29 17:58:48 user nova-compute[74613]:     </rng>
Nov 29 17:58:48 user nova-compute[74613]:     <controller type="usb" index="0" model="none"/>
Nov 29 17:58:48 user nova-compute[74613]:     <memballoon model="virtio">
Nov 29 17:58:48 user nova-compute[74613]:       <stats period="10"/>
Nov 29 17:58:48 user nova-compute[74613]:     </memballoon>
Nov 29 17:58:48 user nova-compute[74613]:   </devices>
Nov 29 17:58:48 user nova-compute[74613]: </domain>
Nov 29 17:58:48 user nova-compute[74613]:  {{(pid=74613) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 29 17:58:48 user nova-compute[74613]: DEBUG nova.virt.libvirt.vif [None req-bca23527-ede8-4e6a-b1cb-00e5bf8301c1 tempest-ServerActionsTestOtherB-894551005 tempest-ServerActionsTestOtherB-894551005-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T17:55:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-931769463',display_name='tempest-ServerActionsTestOtherB-server-931769463',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-931769463',id=14,image_ref='4217f428-8d9d-4ee1-9614-642d26d90c46',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBE0p3wmKXoOCABzKEPJ0MsHfAtC1JQfzjVn7a3OeQC65p309Te6g/AbiDIZbrFAX7j9aAJfq/HNC8gx1yP/V9/PHfR3o28o9EgbHEcoTtW/dEJGkpFGjjy+hrqfOfHYCnA==',key_name='tempest-keypair-464492783',keypairs=<?>,launch_index=0,launched_at=2023-11-29T17:55:35Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='b392ca87608940c0ae467318b66453b2',ramdisk_id='',reservation_id='r-0wzexjb0',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='4217f428-8d9d-4ee1-9614-642d26d90c46',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-894551005',owner_user_name='tempest-ServerActionsTestOtherB-894551005-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T17:58:37Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1a6eb590fed440729b45b8db79eb7c2f',uuid=74ac9703-1cd7-4983-b7d4-c69b01fec7b2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "c63b6577-fb46-437a-95b3-8321fab45d0c", "address": "fa:16:3e:c3:2e:71", "network": {"id": "e687ed60-2592-4836-b97e-0828527b1b9f", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1938956411-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.143", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-1938956411-network", "vif_mac": "fa:16:3e:c3:2e:71"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b392ca87608940c0ae467318b66453b2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc63b6577-fb", "ovs_interfaceid": "c63b6577-fb46-437a-95b3-8321fab45d0c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74613) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 29 17:58:48 user nova-compute[74613]: DEBUG nova.network.os_vif_util [None req-bca23527-ede8-4e6a-b1cb-00e5bf8301c1 tempest-ServerActionsTestOtherB-894551005 tempest-ServerActionsTestOtherB-894551005-project-member] Converting VIF {"id": "c63b6577-fb46-437a-95b3-8321fab45d0c", "address": "fa:16:3e:c3:2e:71", "network": {"id": "e687ed60-2592-4836-b97e-0828527b1b9f", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1938956411-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.143", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-1938956411-network", "vif_mac": "fa:16:3e:c3:2e:71"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b392ca87608940c0ae467318b66453b2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc63b6577-fb", "ovs_interfaceid": "c63b6577-fb46-437a-95b3-8321fab45d0c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74613) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 17:58:48 user nova-compute[74613]: DEBUG nova.network.os_vif_util [None req-bca23527-ede8-4e6a-b1cb-00e5bf8301c1 tempest-ServerActionsTestOtherB-894551005 tempest-ServerActionsTestOtherB-894551005-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c3:2e:71,bridge_name='br-int',has_traffic_filtering=True,id=c63b6577-fb46-437a-95b3-8321fab45d0c,network=Network(e687ed60-2592-4836-b97e-0828527b1b9f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc63b6577-fb') {{(pid=74613) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 17:58:48 user nova-compute[74613]: DEBUG os_vif [None req-bca23527-ede8-4e6a-b1cb-00e5bf8301c1 tempest-ServerActionsTestOtherB-894551005 tempest-ServerActionsTestOtherB-894551005-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c3:2e:71,bridge_name='br-int',has_traffic_filtering=True,id=c63b6577-fb46-437a-95b3-8321fab45d0c,network=Network(e687ed60-2592-4836-b97e-0828527b1b9f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc63b6577-fb') {{(pid=74613) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 29 17:58:48 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:58:48 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74613) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 17:58:48 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74613) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 29 17:58:48 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:58:48 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '0a1a518d-0115-5f9b-8d7d-237989c4884e', '_type': 'linux-noop'}}, row=False) {{(pid=74613) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 17:58:48 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 17:58:48 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:58:48 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapc63b6577-fb, may_exist=True, interface_attrs={}) {{(pid=74613) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 17:58:48 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapc63b6577-fb, col_values=(('qos', UUID('5d18044f-2f0c-4131-af2e-7f7807e4fa8a')),), if_exists=True) {{(pid=74613) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 17:58:48 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapc63b6577-fb, col_values=(('external_ids', {'iface-id': 'c63b6577-fb46-437a-95b3-8321fab45d0c', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:c3:2e:71', 'vm-uuid': '74ac9703-1cd7-4983-b7d4-c69b01fec7b2'}),), if_exists=True) {{(pid=74613) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 17:58:48 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 17:58:48 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:58:48 user nova-compute[74613]: INFO os_vif [None req-bca23527-ede8-4e6a-b1cb-00e5bf8301c1 tempest-ServerActionsTestOtherB-894551005 tempest-ServerActionsTestOtherB-894551005-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c3:2e:71,bridge_name='br-int',has_traffic_filtering=True,id=c63b6577-fb46-437a-95b3-8321fab45d0c,network=Network(e687ed60-2592-4836-b97e-0828527b1b9f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc63b6577-fb')
Nov 29 17:58:48 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-bca23527-ede8-4e6a-b1cb-00e5bf8301c1 tempest-ServerActionsTestOtherB-894551005 tempest-ServerActionsTestOtherB-894551005-project-member] No BDM found with device name vda, not building metadata. {{(pid=74613) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 17:58:48 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-bca23527-ede8-4e6a-b1cb-00e5bf8301c1 tempest-ServerActionsTestOtherB-894551005 tempest-ServerActionsTestOtherB-894551005-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74613) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 17:58:48 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-bca23527-ede8-4e6a-b1cb-00e5bf8301c1 tempest-ServerActionsTestOtherB-894551005 tempest-ServerActionsTestOtherB-894551005-project-member] No VIF found with MAC fa:16:3e:c3:2e:71, not building metadata {{(pid=74613) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 29 17:58:49 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-b405169a-174e-44ac-b9fa-687e2e90f663 tempest-AttachVolumeShelveTestJSON-1452861425 tempest-AttachVolumeShelveTestJSON-1452861425-project-member] Acquiring lock "f9be53df-54e6-4f59-9cef-0ba7434f0c29" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 17:58:49 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-b405169a-174e-44ac-b9fa-687e2e90f663 tempest-AttachVolumeShelveTestJSON-1452861425 tempest-AttachVolumeShelveTestJSON-1452861425-project-member] Lock "f9be53df-54e6-4f59-9cef-0ba7434f0c29" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 17:58:49 user nova-compute[74613]: DEBUG nova.compute.manager [None req-b405169a-174e-44ac-b9fa-687e2e90f663 tempest-AttachVolumeShelveTestJSON-1452861425 tempest-AttachVolumeShelveTestJSON-1452861425-project-member] [instance: f9be53df-54e6-4f59-9cef-0ba7434f0c29] Starting instance... {{(pid=74613) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 29 17:58:49 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:58:49 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:58:49 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:58:49 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-b405169a-174e-44ac-b9fa-687e2e90f663 tempest-AttachVolumeShelveTestJSON-1452861425 tempest-AttachVolumeShelveTestJSON-1452861425-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 17:58:49 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-b405169a-174e-44ac-b9fa-687e2e90f663 tempest-AttachVolumeShelveTestJSON-1452861425 tempest-AttachVolumeShelveTestJSON-1452861425-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 17:58:49 user nova-compute[74613]: DEBUG nova.virt.hardware [None req-b405169a-174e-44ac-b9fa-687e2e90f663 tempest-AttachVolumeShelveTestJSON-1452861425 tempest-AttachVolumeShelveTestJSON-1452861425-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74613) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 29 17:58:49 user nova-compute[74613]: INFO nova.compute.claims [None req-b405169a-174e-44ac-b9fa-687e2e90f663 tempest-AttachVolumeShelveTestJSON-1452861425 tempest-AttachVolumeShelveTestJSON-1452861425-project-member] [instance: f9be53df-54e6-4f59-9cef-0ba7434f0c29] Claim successful on node user
Nov 29 17:58:49 user nova-compute[74613]: DEBUG nova.compute.manager [req-c346e1ab-e069-4a1e-8610-bdd34812eb33 req-88a4a374-137f-4acd-94f6-189698b4f140 service nova] [instance: 74ac9703-1cd7-4983-b7d4-c69b01fec7b2] Received event network-vif-plugged-c63b6577-fb46-437a-95b3-8321fab45d0c {{(pid=74613) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 17:58:49 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-c346e1ab-e069-4a1e-8610-bdd34812eb33 req-88a4a374-137f-4acd-94f6-189698b4f140 service nova] Acquiring lock "74ac9703-1cd7-4983-b7d4-c69b01fec7b2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 17:58:49 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-c346e1ab-e069-4a1e-8610-bdd34812eb33 req-88a4a374-137f-4acd-94f6-189698b4f140 service nova] Lock "74ac9703-1cd7-4983-b7d4-c69b01fec7b2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 17:58:49 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-c346e1ab-e069-4a1e-8610-bdd34812eb33 req-88a4a374-137f-4acd-94f6-189698b4f140 service nova] Lock "74ac9703-1cd7-4983-b7d4-c69b01fec7b2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 17:58:49 user nova-compute[74613]: DEBUG nova.compute.manager [req-c346e1ab-e069-4a1e-8610-bdd34812eb33 req-88a4a374-137f-4acd-94f6-189698b4f140 service nova] [instance: 74ac9703-1cd7-4983-b7d4-c69b01fec7b2] No waiting events found dispatching network-vif-plugged-c63b6577-fb46-437a-95b3-8321fab45d0c {{(pid=74613) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 17:58:49 user nova-compute[74613]: WARNING nova.compute.manager [req-c346e1ab-e069-4a1e-8610-bdd34812eb33 req-88a4a374-137f-4acd-94f6-189698b4f140 service nova] [instance: 74ac9703-1cd7-4983-b7d4-c69b01fec7b2] Received unexpected event network-vif-plugged-c63b6577-fb46-437a-95b3-8321fab45d0c for instance with vm_state active and task_state resize_finish.
Nov 29 17:58:50 user nova-compute[74613]: DEBUG nova.compute.provider_tree [None req-b405169a-174e-44ac-b9fa-687e2e90f663 tempest-AttachVolumeShelveTestJSON-1452861425 tempest-AttachVolumeShelveTestJSON-1452861425-project-member] Inventory has not changed in ProviderTree for provider: 639d980e-3b12-44b1-b8f4-1812416fa4dd {{(pid=74613) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 17:58:50 user nova-compute[74613]: DEBUG nova.scheduler.client.report [None req-b405169a-174e-44ac-b9fa-687e2e90f663 tempest-AttachVolumeShelveTestJSON-1452861425 tempest-AttachVolumeShelveTestJSON-1452861425-project-member] Inventory has not changed for provider 639d980e-3b12-44b1-b8f4-1812416fa4dd based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74613) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 17:58:50 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-b405169a-174e-44ac-b9fa-687e2e90f663 tempest-AttachVolumeShelveTestJSON-1452861425 tempest-AttachVolumeShelveTestJSON-1452861425-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.626s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 17:58:50 user nova-compute[74613]: DEBUG nova.compute.manager [None req-b405169a-174e-44ac-b9fa-687e2e90f663 tempest-AttachVolumeShelveTestJSON-1452861425 tempest-AttachVolumeShelveTestJSON-1452861425-project-member] [instance: f9be53df-54e6-4f59-9cef-0ba7434f0c29] Start building networks asynchronously for instance. {{(pid=74613) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 29 17:58:50 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:58:50 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:58:50 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:58:50 user nova-compute[74613]: DEBUG nova.compute.manager [None req-b405169a-174e-44ac-b9fa-687e2e90f663 tempest-AttachVolumeShelveTestJSON-1452861425 tempest-AttachVolumeShelveTestJSON-1452861425-project-member] [instance: f9be53df-54e6-4f59-9cef-0ba7434f0c29] Allocating IP information in the background. {{(pid=74613) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 29 17:58:50 user nova-compute[74613]: DEBUG nova.network.neutron [None req-b405169a-174e-44ac-b9fa-687e2e90f663 tempest-AttachVolumeShelveTestJSON-1452861425 tempest-AttachVolumeShelveTestJSON-1452861425-project-member] [instance: f9be53df-54e6-4f59-9cef-0ba7434f0c29] allocate_for_instance() {{(pid=74613) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 29 17:58:50 user nova-compute[74613]: INFO nova.virt.libvirt.driver [None req-b405169a-174e-44ac-b9fa-687e2e90f663 tempest-AttachVolumeShelveTestJSON-1452861425 tempest-AttachVolumeShelveTestJSON-1452861425-project-member] [instance: f9be53df-54e6-4f59-9cef-0ba7434f0c29] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 29 17:58:50 user nova-compute[74613]: DEBUG nova.compute.manager [None req-b405169a-174e-44ac-b9fa-687e2e90f663 tempest-AttachVolumeShelveTestJSON-1452861425 tempest-AttachVolumeShelveTestJSON-1452861425-project-member] [instance: f9be53df-54e6-4f59-9cef-0ba7434f0c29] Start building block device mappings for instance. {{(pid=74613) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 29 17:58:50 user nova-compute[74613]: DEBUG nova.compute.manager [None req-b405169a-174e-44ac-b9fa-687e2e90f663 tempest-AttachVolumeShelveTestJSON-1452861425 tempest-AttachVolumeShelveTestJSON-1452861425-project-member] [instance: f9be53df-54e6-4f59-9cef-0ba7434f0c29] Start spawning the instance on the hypervisor. {{(pid=74613) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 29 17:58:50 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-b405169a-174e-44ac-b9fa-687e2e90f663 tempest-AttachVolumeShelveTestJSON-1452861425 tempest-AttachVolumeShelveTestJSON-1452861425-project-member] [instance: f9be53df-54e6-4f59-9cef-0ba7434f0c29] Creating instance directory {{(pid=74613) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 29 17:58:50 user nova-compute[74613]: INFO nova.virt.libvirt.driver [None req-b405169a-174e-44ac-b9fa-687e2e90f663 tempest-AttachVolumeShelveTestJSON-1452861425 tempest-AttachVolumeShelveTestJSON-1452861425-project-member] [instance: f9be53df-54e6-4f59-9cef-0ba7434f0c29] Creating image(s)
Nov 29 17:58:50 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-b405169a-174e-44ac-b9fa-687e2e90f663 tempest-AttachVolumeShelveTestJSON-1452861425 tempest-AttachVolumeShelveTestJSON-1452861425-project-member] Acquiring lock "/opt/stack/data/nova/instances/f9be53df-54e6-4f59-9cef-0ba7434f0c29/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 17:58:50 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-b405169a-174e-44ac-b9fa-687e2e90f663 tempest-AttachVolumeShelveTestJSON-1452861425 tempest-AttachVolumeShelveTestJSON-1452861425-project-member] Lock "/opt/stack/data/nova/instances/f9be53df-54e6-4f59-9cef-0ba7434f0c29/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 17:58:50 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-b405169a-174e-44ac-b9fa-687e2e90f663 tempest-AttachVolumeShelveTestJSON-1452861425 tempest-AttachVolumeShelveTestJSON-1452861425-project-member] Lock "/opt/stack/data/nova/instances/f9be53df-54e6-4f59-9cef-0ba7434f0c29/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 17:58:50 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-b405169a-174e-44ac-b9fa-687e2e90f663 tempest-AttachVolumeShelveTestJSON-1452861425 tempest-AttachVolumeShelveTestJSON-1452861425-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/21faea9e6951f3bdd0153b76ac89fe1a60a34758 --force-share --output=json {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 17:58:50 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-b405169a-174e-44ac-b9fa-687e2e90f663 tempest-AttachVolumeShelveTestJSON-1452861425 tempest-AttachVolumeShelveTestJSON-1452861425-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/21faea9e6951f3bdd0153b76ac89fe1a60a34758 --force-share --output=json" returned: 0 in 0.186s {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 17:58:50 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-b405169a-174e-44ac-b9fa-687e2e90f663 tempest-AttachVolumeShelveTestJSON-1452861425 tempest-AttachVolumeShelveTestJSON-1452861425-project-member] Acquiring lock "21faea9e6951f3bdd0153b76ac89fe1a60a34758" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 17:58:50 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-b405169a-174e-44ac-b9fa-687e2e90f663 tempest-AttachVolumeShelveTestJSON-1452861425 tempest-AttachVolumeShelveTestJSON-1452861425-project-member] Lock "21faea9e6951f3bdd0153b76ac89fe1a60a34758" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.003s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 17:58:50 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-b405169a-174e-44ac-b9fa-687e2e90f663 tempest-AttachVolumeShelveTestJSON-1452861425 tempest-AttachVolumeShelveTestJSON-1452861425-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/21faea9e6951f3bdd0153b76ac89fe1a60a34758 --force-share --output=json {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 17:58:50 user nova-compute[74613]: DEBUG nova.policy [None req-b405169a-174e-44ac-b9fa-687e2e90f663 tempest-AttachVolumeShelveTestJSON-1452861425 tempest-AttachVolumeShelveTestJSON-1452861425-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '45192488dde84ebfbcacfdbd4f898799', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c0c1c71400549369c1b11ca7d5f43ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74613) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 29 17:58:50 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-b405169a-174e-44ac-b9fa-687e2e90f663 tempest-AttachVolumeShelveTestJSON-1452861425 tempest-AttachVolumeShelveTestJSON-1452861425-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/21faea9e6951f3bdd0153b76ac89fe1a60a34758 --force-share --output=json" returned: 0 in 0.190s {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 17:58:50 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-b405169a-174e-44ac-b9fa-687e2e90f663 tempest-AttachVolumeShelveTestJSON-1452861425 tempest-AttachVolumeShelveTestJSON-1452861425-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/21faea9e6951f3bdd0153b76ac89fe1a60a34758,backing_fmt=raw /opt/stack/data/nova/instances/f9be53df-54e6-4f59-9cef-0ba7434f0c29/disk 1073741824 {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 17:58:50 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-b405169a-174e-44ac-b9fa-687e2e90f663 tempest-AttachVolumeShelveTestJSON-1452861425 tempest-AttachVolumeShelveTestJSON-1452861425-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/21faea9e6951f3bdd0153b76ac89fe1a60a34758,backing_fmt=raw /opt/stack/data/nova/instances/f9be53df-54e6-4f59-9cef-0ba7434f0c29/disk 1073741824" returned: 0 in 0.047s {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 17:58:50 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-b405169a-174e-44ac-b9fa-687e2e90f663 tempest-AttachVolumeShelveTestJSON-1452861425 tempest-AttachVolumeShelveTestJSON-1452861425-project-member] Lock "21faea9e6951f3bdd0153b76ac89fe1a60a34758" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.244s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 17:58:50 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-b405169a-174e-44ac-b9fa-687e2e90f663 tempest-AttachVolumeShelveTestJSON-1452861425 tempest-AttachVolumeShelveTestJSON-1452861425-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/21faea9e6951f3bdd0153b76ac89fe1a60a34758 --force-share --output=json {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 17:58:51 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-b405169a-174e-44ac-b9fa-687e2e90f663 tempest-AttachVolumeShelveTestJSON-1452861425 tempest-AttachVolumeShelveTestJSON-1452861425-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/21faea9e6951f3bdd0153b76ac89fe1a60a34758 --force-share --output=json" returned: 0 in 0.189s {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 17:58:51 user nova-compute[74613]: DEBUG nova.virt.disk.api [None req-b405169a-174e-44ac-b9fa-687e2e90f663 tempest-AttachVolumeShelveTestJSON-1452861425 tempest-AttachVolumeShelveTestJSON-1452861425-project-member] Checking if we can resize image /opt/stack/data/nova/instances/f9be53df-54e6-4f59-9cef-0ba7434f0c29/disk. size=1073741824 {{(pid=74613) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 29 17:58:51 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-b405169a-174e-44ac-b9fa-687e2e90f663 tempest-AttachVolumeShelveTestJSON-1452861425 tempest-AttachVolumeShelveTestJSON-1452861425-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f9be53df-54e6-4f59-9cef-0ba7434f0c29/disk --force-share --output=json {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 17:58:51 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-b405169a-174e-44ac-b9fa-687e2e90f663 tempest-AttachVolumeShelveTestJSON-1452861425 tempest-AttachVolumeShelveTestJSON-1452861425-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f9be53df-54e6-4f59-9cef-0ba7434f0c29/disk --force-share --output=json" returned: 0 in 0.208s {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 17:58:51 user nova-compute[74613]: DEBUG nova.virt.disk.api [None req-b405169a-174e-44ac-b9fa-687e2e90f663 tempest-AttachVolumeShelveTestJSON-1452861425 tempest-AttachVolumeShelveTestJSON-1452861425-project-member] Cannot resize image /opt/stack/data/nova/instances/f9be53df-54e6-4f59-9cef-0ba7434f0c29/disk to a smaller size. {{(pid=74613) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 29 17:58:51 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-b405169a-174e-44ac-b9fa-687e2e90f663 tempest-AttachVolumeShelveTestJSON-1452861425 tempest-AttachVolumeShelveTestJSON-1452861425-project-member] [instance: f9be53df-54e6-4f59-9cef-0ba7434f0c29] Created local disks {{(pid=74613) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 29 17:58:51 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-b405169a-174e-44ac-b9fa-687e2e90f663 tempest-AttachVolumeShelveTestJSON-1452861425 tempest-AttachVolumeShelveTestJSON-1452861425-project-member] [instance: f9be53df-54e6-4f59-9cef-0ba7434f0c29] Ensure instance console log exists: /opt/stack/data/nova/instances/f9be53df-54e6-4f59-9cef-0ba7434f0c29/console.log {{(pid=74613) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 29 17:58:51 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-b405169a-174e-44ac-b9fa-687e2e90f663 tempest-AttachVolumeShelveTestJSON-1452861425 tempest-AttachVolumeShelveTestJSON-1452861425-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 17:58:51 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-b405169a-174e-44ac-b9fa-687e2e90f663 tempest-AttachVolumeShelveTestJSON-1452861425 tempest-AttachVolumeShelveTestJSON-1452861425-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 17:58:51 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-b405169a-174e-44ac-b9fa-687e2e90f663 tempest-AttachVolumeShelveTestJSON-1452861425 tempest-AttachVolumeShelveTestJSON-1452861425-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 17:58:51 user nova-compute[74613]: DEBUG nova.network.neutron [None req-b405169a-174e-44ac-b9fa-687e2e90f663 tempest-AttachVolumeShelveTestJSON-1452861425 tempest-AttachVolumeShelveTestJSON-1452861425-project-member] [instance: f9be53df-54e6-4f59-9cef-0ba7434f0c29] Successfully created port: 175b56ab-750b-4dbf-a981-2a32d749d445 {{(pid=74613) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 29 17:58:52 user nova-compute[74613]: DEBUG nova.compute.manager [None req-bca23527-ede8-4e6a-b1cb-00e5bf8301c1 tempest-ServerActionsTestOtherB-894551005 tempest-ServerActionsTestOtherB-894551005-project-member] [instance: 74ac9703-1cd7-4983-b7d4-c69b01fec7b2] Instance event wait completed in 0 seconds for  {{(pid=74613) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 29 17:58:52 user nova-compute[74613]: INFO nova.virt.libvirt.driver [-] [instance: 74ac9703-1cd7-4983-b7d4-c69b01fec7b2] Instance running successfully.
Nov 29 17:58:52 user nova-compute[74613]: DEBUG nova.virt.libvirt.guest [None req-bca23527-ede8-4e6a-b1cb-00e5bf8301c1 tempest-ServerActionsTestOtherB-894551005 tempest-ServerActionsTestOtherB-894551005-project-member] [instance: 74ac9703-1cd7-4983-b7d4-c69b01fec7b2] Failed to set time: agent not configured {{(pid=74613) sync_guest_time /opt/stack/nova/nova/virt/libvirt/guest.py:200}}
Nov 29 17:58:52 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-bca23527-ede8-4e6a-b1cb-00e5bf8301c1 tempest-ServerActionsTestOtherB-894551005 tempest-ServerActionsTestOtherB-894551005-project-member] [instance: 74ac9703-1cd7-4983-b7d4-c69b01fec7b2] finish_migration finished successfully. {{(pid=74613) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11766}}
Nov 29 17:58:52 user nova-compute[74613]: DEBUG nova.compute.manager [req-f0596e16-486b-49a5-9cc6-620345c9c7e6 req-1df69474-9d61-496a-9755-b8093318232a service nova] [instance: 74ac9703-1cd7-4983-b7d4-c69b01fec7b2] Received event network-vif-plugged-c63b6577-fb46-437a-95b3-8321fab45d0c {{(pid=74613) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 17:58:52 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-f0596e16-486b-49a5-9cc6-620345c9c7e6 req-1df69474-9d61-496a-9755-b8093318232a service nova] Acquiring lock "74ac9703-1cd7-4983-b7d4-c69b01fec7b2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 17:58:52 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-f0596e16-486b-49a5-9cc6-620345c9c7e6 req-1df69474-9d61-496a-9755-b8093318232a service nova] Lock "74ac9703-1cd7-4983-b7d4-c69b01fec7b2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 17:58:52 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-f0596e16-486b-49a5-9cc6-620345c9c7e6 req-1df69474-9d61-496a-9755-b8093318232a service nova] Lock "74ac9703-1cd7-4983-b7d4-c69b01fec7b2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 17:58:52 user nova-compute[74613]: DEBUG nova.compute.manager [req-f0596e16-486b-49a5-9cc6-620345c9c7e6 req-1df69474-9d61-496a-9755-b8093318232a service nova] [instance: 74ac9703-1cd7-4983-b7d4-c69b01fec7b2] No waiting events found dispatching network-vif-plugged-c63b6577-fb46-437a-95b3-8321fab45d0c {{(pid=74613) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 17:58:52 user nova-compute[74613]: WARNING nova.compute.manager [req-f0596e16-486b-49a5-9cc6-620345c9c7e6 req-1df69474-9d61-496a-9755-b8093318232a service nova] [instance: 74ac9703-1cd7-4983-b7d4-c69b01fec7b2] Received unexpected event network-vif-plugged-c63b6577-fb46-437a-95b3-8321fab45d0c for instance with vm_state active and task_state resize_finish.
Nov 29 17:58:52 user nova-compute[74613]: DEBUG nova.network.neutron [None req-b405169a-174e-44ac-b9fa-687e2e90f663 tempest-AttachVolumeShelveTestJSON-1452861425 tempest-AttachVolumeShelveTestJSON-1452861425-project-member] [instance: f9be53df-54e6-4f59-9cef-0ba7434f0c29] Successfully updated port: 175b56ab-750b-4dbf-a981-2a32d749d445 {{(pid=74613) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 29 17:58:52 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-b405169a-174e-44ac-b9fa-687e2e90f663 tempest-AttachVolumeShelveTestJSON-1452861425 tempest-AttachVolumeShelveTestJSON-1452861425-project-member] Acquiring lock "refresh_cache-f9be53df-54e6-4f59-9cef-0ba7434f0c29" {{(pid=74613) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 17:58:52 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-b405169a-174e-44ac-b9fa-687e2e90f663 tempest-AttachVolumeShelveTestJSON-1452861425 tempest-AttachVolumeShelveTestJSON-1452861425-project-member] Acquired lock "refresh_cache-f9be53df-54e6-4f59-9cef-0ba7434f0c29" {{(pid=74613) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 17:58:52 user nova-compute[74613]: DEBUG nova.network.neutron [None req-b405169a-174e-44ac-b9fa-687e2e90f663 tempest-AttachVolumeShelveTestJSON-1452861425 tempest-AttachVolumeShelveTestJSON-1452861425-project-member] [instance: f9be53df-54e6-4f59-9cef-0ba7434f0c29] Building network info cache for instance {{(pid=74613) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 29 17:58:52 user nova-compute[74613]: DEBUG nova.network.neutron [None req-b405169a-174e-44ac-b9fa-687e2e90f663 tempest-AttachVolumeShelveTestJSON-1452861425 tempest-AttachVolumeShelveTestJSON-1452861425-project-member] [instance: f9be53df-54e6-4f59-9cef-0ba7434f0c29] Instance cache missing network info. {{(pid=74613) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 29 17:58:52 user nova-compute[74613]: DEBUG nova.network.neutron [None req-b405169a-174e-44ac-b9fa-687e2e90f663 tempest-AttachVolumeShelveTestJSON-1452861425 tempest-AttachVolumeShelveTestJSON-1452861425-project-member] [instance: f9be53df-54e6-4f59-9cef-0ba7434f0c29] Updating instance_info_cache with network_info: [{"id": "175b56ab-750b-4dbf-a981-2a32d749d445", "address": "fa:16:3e:e8:f3:9e", "network": {"id": "4a101f3e-d23e-4198-bc3c-b4f9b4d2b4c4", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-864151424-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1c0c1c71400549369c1b11ca7d5f43ec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap175b56ab-75", "ovs_interfaceid": "175b56ab-750b-4dbf-a981-2a32d749d445", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74613) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 17:58:52 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-b405169a-174e-44ac-b9fa-687e2e90f663 tempest-AttachVolumeShelveTestJSON-1452861425 tempest-AttachVolumeShelveTestJSON-1452861425-project-member] Releasing lock "refresh_cache-f9be53df-54e6-4f59-9cef-0ba7434f0c29" {{(pid=74613) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 17:58:52 user nova-compute[74613]: DEBUG nova.compute.manager [None req-b405169a-174e-44ac-b9fa-687e2e90f663 tempest-AttachVolumeShelveTestJSON-1452861425 tempest-AttachVolumeShelveTestJSON-1452861425-project-member] [instance: f9be53df-54e6-4f59-9cef-0ba7434f0c29] Instance network_info: |[{"id": "175b56ab-750b-4dbf-a981-2a32d749d445", "address": "fa:16:3e:e8:f3:9e", "network": {"id": "4a101f3e-d23e-4198-bc3c-b4f9b4d2b4c4", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-864151424-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1c0c1c71400549369c1b11ca7d5f43ec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap175b56ab-75", "ovs_interfaceid": "175b56ab-750b-4dbf-a981-2a32d749d445", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74613) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 29 17:58:52 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-b405169a-174e-44ac-b9fa-687e2e90f663 tempest-AttachVolumeShelveTestJSON-1452861425 tempest-AttachVolumeShelveTestJSON-1452861425-project-member] [instance: f9be53df-54e6-4f59-9cef-0ba7434f0c29] Start _get_guest_xml network_info=[{"id": "175b56ab-750b-4dbf-a981-2a32d749d445", "address": "fa:16:3e:e8:f3:9e", "network": {"id": "4a101f3e-d23e-4198-bc3c-b4f9b4d2b4c4", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-864151424-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1c0c1c71400549369c1b11ca7d5f43ec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap175b56ab-75", "ovs_interfaceid": "175b56ab-750b-4dbf-a981-2a32d749d445", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-29T17:47:38Z,direct_url=<?>,disk_format='qcow2',id=4217f428-8d9d-4ee1-9614-642d26d90c46,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='794b07cbd46a44b5865cfda741036bae',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-29T17:47:40Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'size': 0, 'device_type': 'disk', 'boot_index': 0, 'guest_format': None, 'encrypted': False, 'encryption_format': None, 'disk_bus': 'virtio', 'image_id': '4217f428-8d9d-4ee1-9614-642d26d90c46'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74613) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 29 17:58:52 user nova-compute[74613]: WARNING nova.virt.libvirt.driver [None req-b405169a-174e-44ac-b9fa-687e2e90f663 tempest-AttachVolumeShelveTestJSON-1452861425 tempest-AttachVolumeShelveTestJSON-1452861425-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 17:58:52 user nova-compute[74613]: WARNING nova.virt.libvirt.driver [None req-b405169a-174e-44ac-b9fa-687e2e90f663 tempest-AttachVolumeShelveTestJSON-1452861425 tempest-AttachVolumeShelveTestJSON-1452861425-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 17:58:52 user nova-compute[74613]: DEBUG nova.virt.libvirt.host [None req-b405169a-174e-44ac-b9fa-687e2e90f663 tempest-AttachVolumeShelveTestJSON-1452861425 tempest-AttachVolumeShelveTestJSON-1452861425-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74613) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 29 17:58:52 user nova-compute[74613]: DEBUG nova.virt.libvirt.host [None req-b405169a-174e-44ac-b9fa-687e2e90f663 tempest-AttachVolumeShelveTestJSON-1452861425 tempest-AttachVolumeShelveTestJSON-1452861425-project-member] CPU controller missing on host. {{(pid=74613) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 29 17:58:52 user nova-compute[74613]: DEBUG nova.virt.libvirt.host [None req-b405169a-174e-44ac-b9fa-687e2e90f663 tempest-AttachVolumeShelveTestJSON-1452861425 tempest-AttachVolumeShelveTestJSON-1452861425-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74613) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 29 17:58:52 user nova-compute[74613]: DEBUG nova.virt.libvirt.host [None req-b405169a-174e-44ac-b9fa-687e2e90f663 tempest-AttachVolumeShelveTestJSON-1452861425 tempest-AttachVolumeShelveTestJSON-1452861425-project-member] CPU controller found on host. {{(pid=74613) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 29 17:58:52 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-b405169a-174e-44ac-b9fa-687e2e90f663 tempest-AttachVolumeShelveTestJSON-1452861425 tempest-AttachVolumeShelveTestJSON-1452861425-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74613) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 29 17:58:52 user nova-compute[74613]: DEBUG nova.virt.hardware [None req-b405169a-174e-44ac-b9fa-687e2e90f663 tempest-AttachVolumeShelveTestJSON-1452861425 tempest-AttachVolumeShelveTestJSON-1452861425-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-29T17:47:27Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-29T17:47:38Z,direct_url=<?>,disk_format='qcow2',id=4217f428-8d9d-4ee1-9614-642d26d90c46,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='794b07cbd46a44b5865cfda741036bae',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-29T17:47:40Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74613) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 29 17:58:52 user nova-compute[74613]: DEBUG nova.virt.hardware [None req-b405169a-174e-44ac-b9fa-687e2e90f663 tempest-AttachVolumeShelveTestJSON-1452861425 tempest-AttachVolumeShelveTestJSON-1452861425-project-member] Flavor limits 0:0:0 {{(pid=74613) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 29 17:58:52 user nova-compute[74613]: DEBUG nova.virt.hardware [None req-b405169a-174e-44ac-b9fa-687e2e90f663 tempest-AttachVolumeShelveTestJSON-1452861425 tempest-AttachVolumeShelveTestJSON-1452861425-project-member] Image limits 0:0:0 {{(pid=74613) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 29 17:58:52 user nova-compute[74613]: DEBUG nova.virt.hardware [None req-b405169a-174e-44ac-b9fa-687e2e90f663 tempest-AttachVolumeShelveTestJSON-1452861425 tempest-AttachVolumeShelveTestJSON-1452861425-project-member] Flavor pref 0:0:0 {{(pid=74613) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 29 17:58:52 user nova-compute[74613]: DEBUG nova.virt.hardware [None req-b405169a-174e-44ac-b9fa-687e2e90f663 tempest-AttachVolumeShelveTestJSON-1452861425 tempest-AttachVolumeShelveTestJSON-1452861425-project-member] Image pref 0:0:0 {{(pid=74613) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 29 17:58:52 user nova-compute[74613]: DEBUG nova.virt.hardware [None req-b405169a-174e-44ac-b9fa-687e2e90f663 tempest-AttachVolumeShelveTestJSON-1452861425 tempest-AttachVolumeShelveTestJSON-1452861425-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74613) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 29 17:58:52 user nova-compute[74613]: DEBUG nova.virt.hardware [None req-b405169a-174e-44ac-b9fa-687e2e90f663 tempest-AttachVolumeShelveTestJSON-1452861425 tempest-AttachVolumeShelveTestJSON-1452861425-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74613) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 29 17:58:52 user nova-compute[74613]: DEBUG nova.virt.hardware [None req-b405169a-174e-44ac-b9fa-687e2e90f663 tempest-AttachVolumeShelveTestJSON-1452861425 tempest-AttachVolumeShelveTestJSON-1452861425-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74613) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 29 17:58:52 user nova-compute[74613]: DEBUG nova.virt.hardware [None req-b405169a-174e-44ac-b9fa-687e2e90f663 tempest-AttachVolumeShelveTestJSON-1452861425 tempest-AttachVolumeShelveTestJSON-1452861425-project-member] Got 1 possible topologies {{(pid=74613) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 29 17:58:52 user nova-compute[74613]: DEBUG nova.virt.hardware [None req-b405169a-174e-44ac-b9fa-687e2e90f663 tempest-AttachVolumeShelveTestJSON-1452861425 tempest-AttachVolumeShelveTestJSON-1452861425-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74613) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 29 17:58:52 user nova-compute[74613]: DEBUG nova.virt.hardware [None req-b405169a-174e-44ac-b9fa-687e2e90f663 tempest-AttachVolumeShelveTestJSON-1452861425 tempest-AttachVolumeShelveTestJSON-1452861425-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74613) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 29 17:58:52 user nova-compute[74613]: DEBUG nova.virt.libvirt.vif [None req-b405169a-174e-44ac-b9fa-687e2e90f663 tempest-AttachVolumeShelveTestJSON-1452861425 tempest-AttachVolumeShelveTestJSON-1452861425-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T17:58:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1968314827',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1968314827',id=20,image_ref='4217f428-8d9d-4ee1-9614-642d26d90c46',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBD3+ii+PLRizYlFkb7wD/B1NviUyG/AGb0OGXzoabE7BPGjgfwRJuzQbYeCpnCbXJJxRZe//IQydP4sQ1W/jCdBIdEU1Q9Gq/9zv5qMuBOIzCzGmDAMD8rdWn1s7sD+8mw==',key_name='tempest-keypair-1048982870',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1c0c1c71400549369c1b11ca7d5f43ec',ramdisk_id='',reservation_id='r-crz26r0v',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='4217f428-8d9d-4ee1-9614-642d26d90c46',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-1452861425',owner_user_name='tempest-AttachVolumeShelveTestJSON-1452861425-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T17:58:50Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='45192488dde84ebfbcacfdbd4f898799',uuid=f9be53df-54e6-4f59-9cef-0ba7434f0c29,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "175b56ab-750b-4dbf-a981-2a32d749d445", "address": "fa:16:3e:e8:f3:9e", "network": {"id": "4a101f3e-d23e-4198-bc3c-b4f9b4d2b4c4", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-864151424-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1c0c1c71400549369c1b11ca7d5f43ec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap175b56ab-75", "ovs_interfaceid": "175b56ab-750b-4dbf-a981-2a32d749d445", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74613) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 29 17:58:52 user nova-compute[74613]: DEBUG nova.network.os_vif_util [None req-b405169a-174e-44ac-b9fa-687e2e90f663 tempest-AttachVolumeShelveTestJSON-1452861425 tempest-AttachVolumeShelveTestJSON-1452861425-project-member] Converting VIF {"id": "175b56ab-750b-4dbf-a981-2a32d749d445", "address": "fa:16:3e:e8:f3:9e", "network": {"id": "4a101f3e-d23e-4198-bc3c-b4f9b4d2b4c4", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-864151424-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1c0c1c71400549369c1b11ca7d5f43ec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap175b56ab-75", "ovs_interfaceid": "175b56ab-750b-4dbf-a981-2a32d749d445", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74613) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 17:58:52 user nova-compute[74613]: DEBUG nova.network.os_vif_util [None req-b405169a-174e-44ac-b9fa-687e2e90f663 tempest-AttachVolumeShelveTestJSON-1452861425 tempest-AttachVolumeShelveTestJSON-1452861425-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e8:f3:9e,bridge_name='br-int',has_traffic_filtering=True,id=175b56ab-750b-4dbf-a981-2a32d749d445,network=Network(4a101f3e-d23e-4198-bc3c-b4f9b4d2b4c4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap175b56ab-75') {{(pid=74613) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 17:58:52 user nova-compute[74613]: DEBUG nova.objects.instance [None req-b405169a-174e-44ac-b9fa-687e2e90f663 tempest-AttachVolumeShelveTestJSON-1452861425 tempest-AttachVolumeShelveTestJSON-1452861425-project-member] Lazy-loading 'pci_devices' on Instance uuid f9be53df-54e6-4f59-9cef-0ba7434f0c29 {{(pid=74613) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 17:58:52 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-b405169a-174e-44ac-b9fa-687e2e90f663 tempest-AttachVolumeShelveTestJSON-1452861425 tempest-AttachVolumeShelveTestJSON-1452861425-project-member] [instance: f9be53df-54e6-4f59-9cef-0ba7434f0c29] End _get_guest_xml xml=<domain type="kvm">
Nov 29 17:58:52 user nova-compute[74613]:   <uuid>f9be53df-54e6-4f59-9cef-0ba7434f0c29</uuid>
Nov 29 17:58:52 user nova-compute[74613]:   <name>instance-00000014</name>
Nov 29 17:58:52 user nova-compute[74613]:   <memory>524288</memory>
Nov 29 17:58:52 user nova-compute[74613]:   <vcpu>1</vcpu>
Nov 29 17:58:52 user nova-compute[74613]:   <metadata>
Nov 29 17:58:52 user nova-compute[74613]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 29 17:58:52 user nova-compute[74613]:       <nova:package version="0.0.0"/>
Nov 29 17:58:52 user nova-compute[74613]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-1968314827</nova:name>
Nov 29 17:58:52 user nova-compute[74613]:       <nova:creationTime>2023-11-29 17:58:52</nova:creationTime>
Nov 29 17:58:52 user nova-compute[74613]:       <nova:flavor name="m1.tiny">
Nov 29 17:58:52 user nova-compute[74613]:         <nova:memory>512</nova:memory>
Nov 29 17:58:52 user nova-compute[74613]:         <nova:disk>1</nova:disk>
Nov 29 17:58:52 user nova-compute[74613]:         <nova:swap>0</nova:swap>
Nov 29 17:58:52 user nova-compute[74613]:         <nova:ephemeral>0</nova:ephemeral>
Nov 29 17:58:52 user nova-compute[74613]:         <nova:vcpus>1</nova:vcpus>
Nov 29 17:58:52 user nova-compute[74613]:       </nova:flavor>
Nov 29 17:58:52 user nova-compute[74613]:       <nova:owner>
Nov 29 17:58:52 user nova-compute[74613]:         <nova:user uuid="45192488dde84ebfbcacfdbd4f898799">tempest-AttachVolumeShelveTestJSON-1452861425-project-member</nova:user>
Nov 29 17:58:52 user nova-compute[74613]:         <nova:project uuid="1c0c1c71400549369c1b11ca7d5f43ec">tempest-AttachVolumeShelveTestJSON-1452861425</nova:project>
Nov 29 17:58:52 user nova-compute[74613]:       </nova:owner>
Nov 29 17:58:52 user nova-compute[74613]:       <nova:root type="image" uuid="4217f428-8d9d-4ee1-9614-642d26d90c46"/>
Nov 29 17:58:52 user nova-compute[74613]:       <nova:ports>
Nov 29 17:58:52 user nova-compute[74613]:         <nova:port uuid="175b56ab-750b-4dbf-a981-2a32d749d445">
Nov 29 17:58:52 user nova-compute[74613]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Nov 29 17:58:52 user nova-compute[74613]:         </nova:port>
Nov 29 17:58:52 user nova-compute[74613]:       </nova:ports>
Nov 29 17:58:52 user nova-compute[74613]:     </nova:instance>
Nov 29 17:58:52 user nova-compute[74613]:   </metadata>
Nov 29 17:58:52 user nova-compute[74613]:   <sysinfo type="smbios">
Nov 29 17:58:52 user nova-compute[74613]:     <system>
Nov 29 17:58:52 user nova-compute[74613]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 29 17:58:52 user nova-compute[74613]:       <entry name="product">OpenStack Nova</entry>
Nov 29 17:58:52 user nova-compute[74613]:       <entry name="version">0.0.0</entry>
Nov 29 17:58:52 user nova-compute[74613]:       <entry name="serial">f9be53df-54e6-4f59-9cef-0ba7434f0c29</entry>
Nov 29 17:58:52 user nova-compute[74613]:       <entry name="uuid">f9be53df-54e6-4f59-9cef-0ba7434f0c29</entry>
Nov 29 17:58:52 user nova-compute[74613]:       <entry name="family">Virtual Machine</entry>
Nov 29 17:58:52 user nova-compute[74613]:     </system>
Nov 29 17:58:52 user nova-compute[74613]:   </sysinfo>
Nov 29 17:58:52 user nova-compute[74613]:   <os>
Nov 29 17:58:52 user nova-compute[74613]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 29 17:58:52 user nova-compute[74613]:     <boot dev="hd"/>
Nov 29 17:58:52 user nova-compute[74613]:     <smbios mode="sysinfo"/>
Nov 29 17:58:52 user nova-compute[74613]:   </os>
Nov 29 17:58:52 user nova-compute[74613]:   <features>
Nov 29 17:58:52 user nova-compute[74613]:     <acpi/>
Nov 29 17:58:52 user nova-compute[74613]:     <apic/>
Nov 29 17:58:52 user nova-compute[74613]:     <vmcoreinfo/>
Nov 29 17:58:52 user nova-compute[74613]:   </features>
Nov 29 17:58:52 user nova-compute[74613]:   <clock offset="utc">
Nov 29 17:58:52 user nova-compute[74613]:     <timer name="pit" tickpolicy="delay"/>
Nov 29 17:58:52 user nova-compute[74613]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 29 17:58:52 user nova-compute[74613]:     <timer name="hpet" present="no"/>
Nov 29 17:58:52 user nova-compute[74613]:   </clock>
Nov 29 17:58:52 user nova-compute[74613]:   <cpu mode="custom" match="exact">
Nov 29 17:58:52 user nova-compute[74613]:     <model>Nehalem</model>
Nov 29 17:58:52 user nova-compute[74613]:     <topology sockets="1" cores="1" threads="1"/>
Nov 29 17:58:52 user nova-compute[74613]:   </cpu>
Nov 29 17:58:52 user nova-compute[74613]:   <devices>
Nov 29 17:58:52 user nova-compute[74613]:     <disk type="file" device="disk">
Nov 29 17:58:52 user nova-compute[74613]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 29 17:58:52 user nova-compute[74613]:       <source file="/opt/stack/data/nova/instances/f9be53df-54e6-4f59-9cef-0ba7434f0c29/disk"/>
Nov 29 17:58:52 user nova-compute[74613]:       <target dev="vda" bus="virtio"/>
Nov 29 17:58:52 user nova-compute[74613]:     </disk>
Nov 29 17:58:52 user nova-compute[74613]:     <interface type="ethernet">
Nov 29 17:58:52 user nova-compute[74613]:       <mac address="fa:16:3e:e8:f3:9e"/>
Nov 29 17:58:52 user nova-compute[74613]:       <model type="virtio"/>
Nov 29 17:58:52 user nova-compute[74613]:       <mtu size="1442"/>
Nov 29 17:58:52 user nova-compute[74613]:       <target dev="tap175b56ab-75"/>
Nov 29 17:58:52 user nova-compute[74613]:     </interface>
Nov 29 17:58:52 user nova-compute[74613]:     <serial type="pty">
Nov 29 17:58:52 user nova-compute[74613]:       <log file="/opt/stack/data/nova/instances/f9be53df-54e6-4f59-9cef-0ba7434f0c29/console.log" append="off"/>
Nov 29 17:58:52 user nova-compute[74613]:     </serial>
Nov 29 17:58:52 user nova-compute[74613]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 29 17:58:52 user nova-compute[74613]:     <video>
Nov 29 17:58:52 user nova-compute[74613]:       <model type="virtio"/>
Nov 29 17:58:52 user nova-compute[74613]:     </video>
Nov 29 17:58:52 user nova-compute[74613]:     <rng model="virtio">
Nov 29 17:58:52 user nova-compute[74613]:       <backend model="random">/dev/urandom</backend>
Nov 29 17:58:52 user nova-compute[74613]:     </rng>
Nov 29 17:58:52 user nova-compute[74613]:     <controller type="usb" index="0" model="none"/>
Nov 29 17:58:52 user nova-compute[74613]:     <memballoon model="virtio">
Nov 29 17:58:52 user nova-compute[74613]:       <stats period="10"/>
Nov 29 17:58:52 user nova-compute[74613]:     </memballoon>
Nov 29 17:58:52 user nova-compute[74613]:   </devices>
Nov 29 17:58:52 user nova-compute[74613]: </domain>
Nov 29 17:58:52 user nova-compute[74613]:  {{(pid=74613) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 29 17:58:52 user nova-compute[74613]: DEBUG nova.virt.libvirt.vif [None req-b405169a-174e-44ac-b9fa-687e2e90f663 tempest-AttachVolumeShelveTestJSON-1452861425 tempest-AttachVolumeShelveTestJSON-1452861425-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T17:58:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1968314827',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1968314827',id=20,image_ref='4217f428-8d9d-4ee1-9614-642d26d90c46',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBD3+ii+PLRizYlFkb7wD/B1NviUyG/AGb0OGXzoabE7BPGjgfwRJuzQbYeCpnCbXJJxRZe//IQydP4sQ1W/jCdBIdEU1Q9Gq/9zv5qMuBOIzCzGmDAMD8rdWn1s7sD+8mw==',key_name='tempest-keypair-1048982870',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1c0c1c71400549369c1b11ca7d5f43ec',ramdisk_id='',reservation_id='r-crz26r0v',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='4217f428-8d9d-4ee1-9614-642d26d90c46',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-1452861425',owner_user_name='tempest-AttachVolumeShelveTestJSON-1452861425-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T17:58:50Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='45192488dde84ebfbcacfdbd4f898799',uuid=f9be53df-54e6-4f59-9cef-0ba7434f0c29,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "175b56ab-750b-4dbf-a981-2a32d749d445", "address": "fa:16:3e:e8:f3:9e", "network": {"id": "4a101f3e-d23e-4198-bc3c-b4f9b4d2b4c4", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-864151424-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1c0c1c71400549369c1b11ca7d5f43ec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap175b56ab-75", "ovs_interfaceid": "175b56ab-750b-4dbf-a981-2a32d749d445", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74613) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 29 17:58:52 user nova-compute[74613]: DEBUG nova.network.os_vif_util [None req-b405169a-174e-44ac-b9fa-687e2e90f663 tempest-AttachVolumeShelveTestJSON-1452861425 tempest-AttachVolumeShelveTestJSON-1452861425-project-member] Converting VIF {"id": "175b56ab-750b-4dbf-a981-2a32d749d445", "address": "fa:16:3e:e8:f3:9e", "network": {"id": "4a101f3e-d23e-4198-bc3c-b4f9b4d2b4c4", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-864151424-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1c0c1c71400549369c1b11ca7d5f43ec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap175b56ab-75", "ovs_interfaceid": "175b56ab-750b-4dbf-a981-2a32d749d445", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74613) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 17:58:52 user nova-compute[74613]: DEBUG nova.network.os_vif_util [None req-b405169a-174e-44ac-b9fa-687e2e90f663 tempest-AttachVolumeShelveTestJSON-1452861425 tempest-AttachVolumeShelveTestJSON-1452861425-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e8:f3:9e,bridge_name='br-int',has_traffic_filtering=True,id=175b56ab-750b-4dbf-a981-2a32d749d445,network=Network(4a101f3e-d23e-4198-bc3c-b4f9b4d2b4c4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap175b56ab-75') {{(pid=74613) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 17:58:52 user nova-compute[74613]: DEBUG os_vif [None req-b405169a-174e-44ac-b9fa-687e2e90f663 tempest-AttachVolumeShelveTestJSON-1452861425 tempest-AttachVolumeShelveTestJSON-1452861425-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e8:f3:9e,bridge_name='br-int',has_traffic_filtering=True,id=175b56ab-750b-4dbf-a981-2a32d749d445,network=Network(4a101f3e-d23e-4198-bc3c-b4f9b4d2b4c4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap175b56ab-75') {{(pid=74613) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 29 17:58:52 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:58:52 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74613) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 17:58:52 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74613) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 29 17:58:52 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:58:52 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'fccbc867-50ef-57d4-86dd-8752796efd8b', '_type': 'linux-noop'}}, row=False) {{(pid=74613) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 17:58:52 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:58:52 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 17:58:52 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:58:52 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap175b56ab-75, may_exist=True, interface_attrs={}) {{(pid=74613) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 17:58:52 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap175b56ab-75, col_values=(('qos', UUID('08ffbbf7-e739-4b07-be46-f7648ccd1011')),), if_exists=True) {{(pid=74613) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 17:58:52 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap175b56ab-75, col_values=(('external_ids', {'iface-id': '175b56ab-750b-4dbf-a981-2a32d749d445', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:e8:f3:9e', 'vm-uuid': 'f9be53df-54e6-4f59-9cef-0ba7434f0c29'}),), if_exists=True) {{(pid=74613) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 17:58:52 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:58:52 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 17:58:52 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:58:52 user nova-compute[74613]: INFO os_vif [None req-b405169a-174e-44ac-b9fa-687e2e90f663 tempest-AttachVolumeShelveTestJSON-1452861425 tempest-AttachVolumeShelveTestJSON-1452861425-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e8:f3:9e,bridge_name='br-int',has_traffic_filtering=True,id=175b56ab-750b-4dbf-a981-2a32d749d445,network=Network(4a101f3e-d23e-4198-bc3c-b4f9b4d2b4c4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap175b56ab-75')
Nov 29 17:58:52 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-b405169a-174e-44ac-b9fa-687e2e90f663 tempest-AttachVolumeShelveTestJSON-1452861425 tempest-AttachVolumeShelveTestJSON-1452861425-project-member] No BDM found with device name vda, not building metadata. {{(pid=74613) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 17:58:52 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-b405169a-174e-44ac-b9fa-687e2e90f663 tempest-AttachVolumeShelveTestJSON-1452861425 tempest-AttachVolumeShelveTestJSON-1452861425-project-member] No VIF found with MAC fa:16:3e:e8:f3:9e, not building metadata {{(pid=74613) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 29 17:58:54 user nova-compute[74613]: DEBUG nova.compute.manager [req-93732f8d-2d44-40f7-acfb-057de04805aa req-4183f39f-55c0-4772-ac21-debb8e2bd571 service nova] [instance: 356478b0-e233-46aa-a1bd-45ce1f9eca8f] Received event network-changed-22b97a14-1376-4183-a2ef-27a98a891bb9 {{(pid=74613) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 17:58:54 user nova-compute[74613]: DEBUG nova.compute.manager [req-93732f8d-2d44-40f7-acfb-057de04805aa req-4183f39f-55c0-4772-ac21-debb8e2bd571 service nova] [instance: 356478b0-e233-46aa-a1bd-45ce1f9eca8f] Refreshing instance network info cache due to event network-changed-22b97a14-1376-4183-a2ef-27a98a891bb9. {{(pid=74613) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 17:58:54 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-93732f8d-2d44-40f7-acfb-057de04805aa req-4183f39f-55c0-4772-ac21-debb8e2bd571 service nova] Acquiring lock "refresh_cache-356478b0-e233-46aa-a1bd-45ce1f9eca8f" {{(pid=74613) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 17:58:54 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-93732f8d-2d44-40f7-acfb-057de04805aa req-4183f39f-55c0-4772-ac21-debb8e2bd571 service nova] Acquired lock "refresh_cache-356478b0-e233-46aa-a1bd-45ce1f9eca8f" {{(pid=74613) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 17:58:54 user nova-compute[74613]: DEBUG nova.network.neutron [req-93732f8d-2d44-40f7-acfb-057de04805aa req-4183f39f-55c0-4772-ac21-debb8e2bd571 service nova] [instance: 356478b0-e233-46aa-a1bd-45ce1f9eca8f] Refreshing network info cache for port 22b97a14-1376-4183-a2ef-27a98a891bb9 {{(pid=74613) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 17:58:54 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:58:54 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:58:54 user nova-compute[74613]: DEBUG nova.compute.manager [req-cb4d9774-fa37-4fcc-bdc1-c06ab4502b3f req-b57266e8-3755-4653-ad2c-842f792b56f9 service nova] [instance: f9be53df-54e6-4f59-9cef-0ba7434f0c29] Received event network-changed-175b56ab-750b-4dbf-a981-2a32d749d445 {{(pid=74613) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 17:58:54 user nova-compute[74613]: DEBUG nova.compute.manager [req-cb4d9774-fa37-4fcc-bdc1-c06ab4502b3f req-b57266e8-3755-4653-ad2c-842f792b56f9 service nova] [instance: f9be53df-54e6-4f59-9cef-0ba7434f0c29] Refreshing instance network info cache due to event network-changed-175b56ab-750b-4dbf-a981-2a32d749d445. {{(pid=74613) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 17:58:54 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-cb4d9774-fa37-4fcc-bdc1-c06ab4502b3f req-b57266e8-3755-4653-ad2c-842f792b56f9 service nova] Acquiring lock "refresh_cache-f9be53df-54e6-4f59-9cef-0ba7434f0c29" {{(pid=74613) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 17:58:54 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-cb4d9774-fa37-4fcc-bdc1-c06ab4502b3f req-b57266e8-3755-4653-ad2c-842f792b56f9 service nova] Acquired lock "refresh_cache-f9be53df-54e6-4f59-9cef-0ba7434f0c29" {{(pid=74613) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 17:58:54 user nova-compute[74613]: DEBUG nova.network.neutron [req-cb4d9774-fa37-4fcc-bdc1-c06ab4502b3f req-b57266e8-3755-4653-ad2c-842f792b56f9 service nova] [instance: f9be53df-54e6-4f59-9cef-0ba7434f0c29] Refreshing network info cache for port 175b56ab-750b-4dbf-a981-2a32d749d445 {{(pid=74613) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 17:58:54 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-7817a9a6-d1a8-4be2-a0ff-d9acc74cb0da tempest-VolumesSnapshotTestJSON-1388493826 tempest-VolumesSnapshotTestJSON-1388493826-project-member] Acquiring lock "356478b0-e233-46aa-a1bd-45ce1f9eca8f" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 17:58:54 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-7817a9a6-d1a8-4be2-a0ff-d9acc74cb0da tempest-VolumesSnapshotTestJSON-1388493826 tempest-VolumesSnapshotTestJSON-1388493826-project-member] Lock "356478b0-e233-46aa-a1bd-45ce1f9eca8f" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.002s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 17:58:54 user nova-compute[74613]: DEBUG nova.objects.instance [None req-7817a9a6-d1a8-4be2-a0ff-d9acc74cb0da tempest-VolumesSnapshotTestJSON-1388493826 tempest-VolumesSnapshotTestJSON-1388493826-project-member] Lazy-loading 'flavor' on Instance uuid 356478b0-e233-46aa-a1bd-45ce1f9eca8f {{(pid=74613) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 17:58:54 user nova-compute[74613]: INFO nova.virt.libvirt.driver [None req-7817a9a6-d1a8-4be2-a0ff-d9acc74cb0da tempest-VolumesSnapshotTestJSON-1388493826 tempest-VolumesSnapshotTestJSON-1388493826-project-member] [instance: 356478b0-e233-46aa-a1bd-45ce1f9eca8f] Ignoring supplied device name: /dev/vdb
Nov 29 17:58:54 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-7817a9a6-d1a8-4be2-a0ff-d9acc74cb0da tempest-VolumesSnapshotTestJSON-1388493826 tempest-VolumesSnapshotTestJSON-1388493826-project-member] Lock "356478b0-e233-46aa-a1bd-45ce1f9eca8f" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.100s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 17:58:54 user nova-compute[74613]: DEBUG nova.compute.manager [req-1eba5449-e7f6-43c4-b463-d4afa5c1c4a6 req-a58b90b2-d853-4172-96a0-6489b750b6e4 service nova] [instance: f9be53df-54e6-4f59-9cef-0ba7434f0c29] Received event network-vif-plugged-175b56ab-750b-4dbf-a981-2a32d749d445 {{(pid=74613) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 17:58:54 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-1eba5449-e7f6-43c4-b463-d4afa5c1c4a6 req-a58b90b2-d853-4172-96a0-6489b750b6e4 service nova] Acquiring lock "f9be53df-54e6-4f59-9cef-0ba7434f0c29-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 17:58:54 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-1eba5449-e7f6-43c4-b463-d4afa5c1c4a6 req-a58b90b2-d853-4172-96a0-6489b750b6e4 service nova] Lock "f9be53df-54e6-4f59-9cef-0ba7434f0c29-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 17:58:54 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-1eba5449-e7f6-43c4-b463-d4afa5c1c4a6 req-a58b90b2-d853-4172-96a0-6489b750b6e4 service nova] Lock "f9be53df-54e6-4f59-9cef-0ba7434f0c29-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 17:58:54 user nova-compute[74613]: DEBUG nova.compute.manager [req-1eba5449-e7f6-43c4-b463-d4afa5c1c4a6 req-a58b90b2-d853-4172-96a0-6489b750b6e4 service nova] [instance: f9be53df-54e6-4f59-9cef-0ba7434f0c29] No waiting events found dispatching network-vif-plugged-175b56ab-750b-4dbf-a981-2a32d749d445 {{(pid=74613) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 17:58:54 user nova-compute[74613]: WARNING nova.compute.manager [req-1eba5449-e7f6-43c4-b463-d4afa5c1c4a6 req-a58b90b2-d853-4172-96a0-6489b750b6e4 service nova] [instance: f9be53df-54e6-4f59-9cef-0ba7434f0c29] Received unexpected event network-vif-plugged-175b56ab-750b-4dbf-a981-2a32d749d445 for instance with vm_state building and task_state spawning.
Nov 29 17:58:54 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-7817a9a6-d1a8-4be2-a0ff-d9acc74cb0da tempest-VolumesSnapshotTestJSON-1388493826 tempest-VolumesSnapshotTestJSON-1388493826-project-member] Acquiring lock "356478b0-e233-46aa-a1bd-45ce1f9eca8f" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 17:58:54 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-7817a9a6-d1a8-4be2-a0ff-d9acc74cb0da tempest-VolumesSnapshotTestJSON-1388493826 tempest-VolumesSnapshotTestJSON-1388493826-project-member] Lock "356478b0-e233-46aa-a1bd-45ce1f9eca8f" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.002s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 17:58:54 user nova-compute[74613]: INFO nova.compute.manager [None req-7817a9a6-d1a8-4be2-a0ff-d9acc74cb0da tempest-VolumesSnapshotTestJSON-1388493826 tempest-VolumesSnapshotTestJSON-1388493826-project-member] [instance: 356478b0-e233-46aa-a1bd-45ce1f9eca8f] Attaching volume 97d30677-4d07-468f-99d9-de70cdd5053e to /dev/vdb
Nov 29 17:58:55 user nova-compute[74613]: DEBUG nova.network.neutron [req-93732f8d-2d44-40f7-acfb-057de04805aa req-4183f39f-55c0-4772-ac21-debb8e2bd571 service nova] [instance: 356478b0-e233-46aa-a1bd-45ce1f9eca8f] Updated VIF entry in instance network info cache for port 22b97a14-1376-4183-a2ef-27a98a891bb9. {{(pid=74613) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 17:58:55 user nova-compute[74613]: DEBUG nova.network.neutron [req-93732f8d-2d44-40f7-acfb-057de04805aa req-4183f39f-55c0-4772-ac21-debb8e2bd571 service nova] [instance: 356478b0-e233-46aa-a1bd-45ce1f9eca8f] Updating instance_info_cache with network_info: [{"id": "22b97a14-1376-4183-a2ef-27a98a891bb9", "address": "fa:16:3e:42:a7:9e", "network": {"id": "4cc7e4ab-28a3-431a-9855-22009278b949", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1066409623-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.47", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a9ec113a97bd40c4b68d3738c64ece01", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap22b97a14-13", "ovs_interfaceid": "22b97a14-1376-4183-a2ef-27a98a891bb9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74613) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 17:58:55 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-93732f8d-2d44-40f7-acfb-057de04805aa req-4183f39f-55c0-4772-ac21-debb8e2bd571 service nova] Releasing lock "refresh_cache-356478b0-e233-46aa-a1bd-45ce1f9eca8f" {{(pid=74613) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 17:58:55 user nova-compute[74613]: DEBUG os_brick.utils [None req-7817a9a6-d1a8-4be2-a0ff-d9acc74cb0da tempest-VolumesSnapshotTestJSON-1388493826 tempest-VolumesSnapshotTestJSON-1388493826-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74613) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 17:58:55 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 17:58:55 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 17:58:55 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[27b17b3d-836f-467f-bae7-5af42e9a6cb0]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:400972819b5\n', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 17:58:55 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 17:58:55 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:58:55 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:58:55 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:58:55 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.022s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 17:58:55 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[29b7cb24-d111-4327-af73-602d5a88fa7e]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 17:58:55 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 17:58:55 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:58:55 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.022s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 17:58:55 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e2488a6-0b5e-4619-8966-e0714cbbfcf1]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 17:58:55 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d678a8c-2c97-4ddc-8ec2-742dd93f2841]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 17:58:55 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-7817a9a6-d1a8-4be2-a0ff-d9acc74cb0da tempest-VolumesSnapshotTestJSON-1388493826 tempest-VolumesSnapshotTestJSON-1388493826-project-member] Running cmd (subprocess): nvme version {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 17:58:55 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-7817a9a6-d1a8-4be2-a0ff-d9acc74cb0da tempest-VolumesSnapshotTestJSON-1388493826 tempest-VolumesSnapshotTestJSON-1388493826-project-member] 'nvme version' failed. Not Retrying. {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 17:58:55 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.nvmeof [None req-7817a9a6-d1a8-4be2-a0ff-d9acc74cb0da tempest-VolumesSnapshotTestJSON-1388493826 tempest-VolumesSnapshotTestJSON-1388493826-project-member] nvme not present on system {{(pid=74613) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 29 17:58:55 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 17:58:55 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:58:55 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 17:58:55 user nova-compute[74613]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 29 17:58:55 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b136e72-a425-4bcc-8105-e46b5ebd9a5c]: (4, '') {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 17:58:55 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.lightos [None req-7817a9a6-d1a8-4be2-a0ff-d9acc74cb0da tempest-VolumesSnapshotTestJSON-1388493826 tempest-VolumesSnapshotTestJSON-1388493826-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74613) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 29 17:58:55 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.lightos [None req-7817a9a6-d1a8-4be2-a0ff-d9acc74cb0da tempest-VolumesSnapshotTestJSON-1388493826 tempest-VolumesSnapshotTestJSON-1388493826-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74613) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 29 17:58:55 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.lightos [None req-7817a9a6-d1a8-4be2-a0ff-d9acc74cb0da tempest-VolumesSnapshotTestJSON-1388493826 tempest-VolumesSnapshotTestJSON-1388493826-project-member] LIGHTOS: no hostnqn found. {{(pid=74613) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 29 17:58:55 user nova-compute[74613]: DEBUG os_brick.utils [None req-7817a9a6-d1a8-4be2-a0ff-d9acc74cb0da tempest-VolumesSnapshotTestJSON-1388493826 tempest-VolumesSnapshotTestJSON-1388493826-project-member] <== get_connector_properties: return (164ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:400972819b5', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74613) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 17:58:55 user nova-compute[74613]: DEBUG nova.virt.block_device [None req-7817a9a6-d1a8-4be2-a0ff-d9acc74cb0da tempest-VolumesSnapshotTestJSON-1388493826 tempest-VolumesSnapshotTestJSON-1388493826-project-member] [instance: 356478b0-e233-46aa-a1bd-45ce1f9eca8f] Updating existing volume attachment record: 37c4f832-7ca8-4e10-8c52-a9d309c8f392 {{(pid=74613) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 29 17:58:55 user nova-compute[74613]: DEBUG nova.network.neutron [req-cb4d9774-fa37-4fcc-bdc1-c06ab4502b3f req-b57266e8-3755-4653-ad2c-842f792b56f9 service nova] [instance: f9be53df-54e6-4f59-9cef-0ba7434f0c29] Updated VIF entry in instance network info cache for port 175b56ab-750b-4dbf-a981-2a32d749d445. {{(pid=74613) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 17:58:55 user nova-compute[74613]: DEBUG nova.network.neutron [req-cb4d9774-fa37-4fcc-bdc1-c06ab4502b3f req-b57266e8-3755-4653-ad2c-842f792b56f9 service nova] [instance: f9be53df-54e6-4f59-9cef-0ba7434f0c29] Updating instance_info_cache with network_info: [{"id": "175b56ab-750b-4dbf-a981-2a32d749d445", "address": "fa:16:3e:e8:f3:9e", "network": {"id": "4a101f3e-d23e-4198-bc3c-b4f9b4d2b4c4", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-864151424-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1c0c1c71400549369c1b11ca7d5f43ec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap175b56ab-75", "ovs_interfaceid": "175b56ab-750b-4dbf-a981-2a32d749d445", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74613) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 17:58:55 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-cb4d9774-fa37-4fcc-bdc1-c06ab4502b3f req-b57266e8-3755-4653-ad2c-842f792b56f9 service nova] Releasing lock "refresh_cache-f9be53df-54e6-4f59-9cef-0ba7434f0c29" {{(pid=74613) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 17:58:56 user nova-compute[74613]: DEBUG nova.compute.manager [None req-b405169a-174e-44ac-b9fa-687e2e90f663 tempest-AttachVolumeShelveTestJSON-1452861425 tempest-AttachVolumeShelveTestJSON-1452861425-project-member] [instance: f9be53df-54e6-4f59-9cef-0ba7434f0c29] Instance event wait completed in 0 seconds for  {{(pid=74613) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 29 17:58:56 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-b405169a-174e-44ac-b9fa-687e2e90f663 tempest-AttachVolumeShelveTestJSON-1452861425 tempest-AttachVolumeShelveTestJSON-1452861425-project-member] [instance: f9be53df-54e6-4f59-9cef-0ba7434f0c29] Guest created on hypervisor {{(pid=74613) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 29 17:58:56 user nova-compute[74613]: INFO nova.virt.libvirt.driver [-] [instance: f9be53df-54e6-4f59-9cef-0ba7434f0c29] Instance spawned successfully.
Nov 29 17:58:56 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-b405169a-174e-44ac-b9fa-687e2e90f663 tempest-AttachVolumeShelveTestJSON-1452861425 tempest-AttachVolumeShelveTestJSON-1452861425-project-member] [instance: f9be53df-54e6-4f59-9cef-0ba7434f0c29] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74613) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 29 17:58:56 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-b405169a-174e-44ac-b9fa-687e2e90f663 tempest-AttachVolumeShelveTestJSON-1452861425 tempest-AttachVolumeShelveTestJSON-1452861425-project-member] [instance: f9be53df-54e6-4f59-9cef-0ba7434f0c29] Found default for hw_cdrom_bus of ide {{(pid=74613) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 17:58:56 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-b405169a-174e-44ac-b9fa-687e2e90f663 tempest-AttachVolumeShelveTestJSON-1452861425 tempest-AttachVolumeShelveTestJSON-1452861425-project-member] [instance: f9be53df-54e6-4f59-9cef-0ba7434f0c29] Found default for hw_disk_bus of virtio {{(pid=74613) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 17:58:56 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-b405169a-174e-44ac-b9fa-687e2e90f663 tempest-AttachVolumeShelveTestJSON-1452861425 tempest-AttachVolumeShelveTestJSON-1452861425-project-member] [instance: f9be53df-54e6-4f59-9cef-0ba7434f0c29] Found default for hw_input_bus of None {{(pid=74613) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 17:58:56 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-b405169a-174e-44ac-b9fa-687e2e90f663 tempest-AttachVolumeShelveTestJSON-1452861425 tempest-AttachVolumeShelveTestJSON-1452861425-project-member] [instance: f9be53df-54e6-4f59-9cef-0ba7434f0c29] Found default for hw_pointer_model of None {{(pid=74613) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 17:58:56 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-b405169a-174e-44ac-b9fa-687e2e90f663 tempest-AttachVolumeShelveTestJSON-1452861425 tempest-AttachVolumeShelveTestJSON-1452861425-project-member] [instance: f9be53df-54e6-4f59-9cef-0ba7434f0c29] Found default for hw_video_model of virtio {{(pid=74613) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 17:58:56 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-b405169a-174e-44ac-b9fa-687e2e90f663 tempest-AttachVolumeShelveTestJSON-1452861425 tempest-AttachVolumeShelveTestJSON-1452861425-project-member] [instance: f9be53df-54e6-4f59-9cef-0ba7434f0c29] Found default for hw_vif_model of virtio {{(pid=74613) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 17:58:56 user nova-compute[74613]: DEBUG nova.compute.manager [req-eb1d08fd-2152-4c6c-9b06-3ce6cccdfc5d req-1c8e322b-3e16-4b3d-9c47-bafab40388fd service nova] [instance: f9be53df-54e6-4f59-9cef-0ba7434f0c29] Received event network-vif-plugged-175b56ab-750b-4dbf-a981-2a32d749d445 {{(pid=74613) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 17:58:56 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-eb1d08fd-2152-4c6c-9b06-3ce6cccdfc5d req-1c8e322b-3e16-4b3d-9c47-bafab40388fd service nova] Acquiring lock "f9be53df-54e6-4f59-9cef-0ba7434f0c29-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 17:58:56 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-eb1d08fd-2152-4c6c-9b06-3ce6cccdfc5d req-1c8e322b-3e16-4b3d-9c47-bafab40388fd service nova] Lock "f9be53df-54e6-4f59-9cef-0ba7434f0c29-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 17:58:56 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-eb1d08fd-2152-4c6c-9b06-3ce6cccdfc5d req-1c8e322b-3e16-4b3d-9c47-bafab40388fd service nova] Lock "f9be53df-54e6-4f59-9cef-0ba7434f0c29-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 17:58:56 user nova-compute[74613]: DEBUG nova.compute.manager [req-eb1d08fd-2152-4c6c-9b06-3ce6cccdfc5d req-1c8e322b-3e16-4b3d-9c47-bafab40388fd service nova] [instance: f9be53df-54e6-4f59-9cef-0ba7434f0c29] No waiting events found dispatching network-vif-plugged-175b56ab-750b-4dbf-a981-2a32d749d445 {{(pid=74613) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 17:58:56 user nova-compute[74613]: WARNING nova.compute.manager [req-eb1d08fd-2152-4c6c-9b06-3ce6cccdfc5d req-1c8e322b-3e16-4b3d-9c47-bafab40388fd service nova] [instance: f9be53df-54e6-4f59-9cef-0ba7434f0c29] Received unexpected event network-vif-plugged-175b56ab-750b-4dbf-a981-2a32d749d445 for instance with vm_state building and task_state spawning.
Nov 29 17:58:56 user nova-compute[74613]: INFO nova.compute.manager [None req-b405169a-174e-44ac-b9fa-687e2e90f663 tempest-AttachVolumeShelveTestJSON-1452861425 tempest-AttachVolumeShelveTestJSON-1452861425-project-member] [instance: f9be53df-54e6-4f59-9cef-0ba7434f0c29] Took 6.53 seconds to spawn the instance on the hypervisor.
Nov 29 17:58:56 user nova-compute[74613]: DEBUG nova.compute.manager [None req-b405169a-174e-44ac-b9fa-687e2e90f663 tempest-AttachVolumeShelveTestJSON-1452861425 tempest-AttachVolumeShelveTestJSON-1452861425-project-member] [instance: f9be53df-54e6-4f59-9cef-0ba7434f0c29] Checking state {{(pid=74613) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 29 17:58:57 user nova-compute[74613]: INFO nova.compute.manager [None req-b405169a-174e-44ac-b9fa-687e2e90f663 tempest-AttachVolumeShelveTestJSON-1452861425 tempest-AttachVolumeShelveTestJSON-1452861425-project-member] [instance: f9be53df-54e6-4f59-9cef-0ba7434f0c29] Took 7.57 seconds to build instance.
Nov 29 17:58:57 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-b405169a-174e-44ac-b9fa-687e2e90f663 tempest-AttachVolumeShelveTestJSON-1452861425 tempest-AttachVolumeShelveTestJSON-1452861425-project-member] Lock "f9be53df-54e6-4f59-9cef-0ba7434f0c29" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.669s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 17:58:57 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:59:00 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:59:02 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:59:03 user nova-compute[74613]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7817a9a6-d1a8-4be2-a0ff-d9acc74cb0da tempest-VolumesSnapshotTestJSON-1388493826 tempest-VolumesSnapshotTestJSON-1388493826-project-member] [instance: 356478b0-e233-46aa-a1bd-45ce1f9eca8f] Calling os-brick to attach iSCSI Volume {{(pid=74613) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 29 17:59:03 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-7817a9a6-d1a8-4be2-a0ff-d9acc74cb0da tempest-VolumesSnapshotTestJSON-1388493826 tempest-VolumesSnapshotTestJSON-1388493826-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff828156890>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:97d30677-4d07-468f-99d9-de70cdd5053e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'bUOvuZlz', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74613) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 17:59:03 user nova-compute[74613]: WARNING os_brick.initiator.connectors.base [None req-7817a9a6-d1a8-4be2-a0ff-d9acc74cb0da tempest-VolumesSnapshotTestJSON-1388493826 tempest-VolumesSnapshotTestJSON-1388493826-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 17:59:03 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.base [None req-7817a9a6-d1a8-4be2-a0ff-d9acc74cb0da tempest-VolumesSnapshotTestJSON-1388493826 tempest-VolumesSnapshotTestJSON-1388493826-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 17:59:03 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.base [None req-7817a9a6-d1a8-4be2-a0ff-d9acc74cb0da tempest-VolumesSnapshotTestJSON-1388493826 tempest-VolumesSnapshotTestJSON-1388493826-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 17:59:03 user nova-compute[74613]: WARNING os_brick.initiator.connectors.base [None req-7817a9a6-d1a8-4be2-a0ff-d9acc74cb0da tempest-VolumesSnapshotTestJSON-1388493826 tempest-VolumesSnapshotTestJSON-1388493826-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 17:59:03 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.base [None req-7817a9a6-d1a8-4be2-a0ff-d9acc74cb0da tempest-VolumesSnapshotTestJSON-1388493826 tempest-VolumesSnapshotTestJSON-1388493826-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:97d30677-4d07-468f-99d9-de70cdd5053e" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 17:59:03 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.base [None req-7817a9a6-d1a8-4be2-a0ff-d9acc74cb0da tempest-VolumesSnapshotTestJSON-1388493826 tempest-VolumesSnapshotTestJSON-1388493826-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:97d30677-4d07-468f-99d9-de70cdd5053e" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 17:59:03 user nova-compute[74613]: INFO os_brick.initiator.connectors.iscsi [None req-7817a9a6-d1a8-4be2-a0ff-d9acc74cb0da tempest-VolumesSnapshotTestJSON-1388493826 tempest-VolumesSnapshotTestJSON-1388493826-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 29 17:59:03 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:97d30677-4d07-468f-99d9-de70cdd5053e -p 172.16.0.220:3260 {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 17:59:03 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:97d30677-4d07-468f-99d9-de70cdd5053e -p 172.16.0.220:3260" returned: 21 in 0.026s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 17:59:03 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c4c86a1-7416-4251-8cd9-bbb06619d5f2]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 17:59:03 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-7817a9a6-d1a8-4be2-a0ff-d9acc74cb0da tempest-VolumesSnapshotTestJSON-1388493826 tempest-VolumesSnapshotTestJSON-1388493826-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 29 17:59:03 user nova-compute[74613]:  {{(pid=74613) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 17:59:03 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:97d30677-4d07-468f-99d9-de70cdd5053e -p 172.16.0.220:3260 --interface default --op new {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 17:59:03 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:97d30677-4d07-468f-99d9-de70cdd5053e -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.025s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 17:59:03 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[9cea75fa-7664-443b-b311-eebcfda0be3e]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:97d30677-4d07-468f-99d9-de70cdd5053e] added\n', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 17:59:03 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-7817a9a6-d1a8-4be2-a0ff-d9acc74cb0da tempest-VolumesSnapshotTestJSON-1388493826 tempest-VolumesSnapshotTestJSON-1388493826-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:97d30677-4d07-468f-99d9-de70cdd5053e] added
Nov 29 17:59:03 user nova-compute[74613]:  stderr= {{(pid=74613) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 17:59:03 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:97d30677-4d07-468f-99d9-de70cdd5053e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 17:59:03 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:97d30677-4d07-468f-99d9-de70cdd5053e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 17:59:03 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2645e5a-6ed1-4020-9690-7cf76309d66b]: (4, ('', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 17:59:03 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-7817a9a6-d1a8-4be2-a0ff-d9acc74cb0da tempest-VolumesSnapshotTestJSON-1388493826 tempest-VolumesSnapshotTestJSON-1388493826-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74613) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 17:59:03 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:97d30677-4d07-468f-99d9-de70cdd5053e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 17:59:03 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:97d30677-4d07-468f-99d9-de70cdd5053e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.030s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 17:59:03 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[08bb99cd-3db5-49b4-b8fb-1457ea6c75a8]: (4, ('', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 17:59:03 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-7817a9a6-d1a8-4be2-a0ff-d9acc74cb0da tempest-VolumesSnapshotTestJSON-1388493826 tempest-VolumesSnapshotTestJSON-1388493826-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74613) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 17:59:03 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:97d30677-4d07-468f-99d9-de70cdd5053e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v bUOvuZlz {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 17:59:03 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:97d30677-4d07-468f-99d9-de70cdd5053e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v bUOvuZlz" returned: 0 in 0.018s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 17:59:03 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae8a261c-fcf5-4918-aa9b-7c7c3c9e7b00]: (4, ('', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 17:59:03 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-7817a9a6-d1a8-4be2-a0ff-d9acc74cb0da tempest-VolumesSnapshotTestJSON-1388493826 tempest-VolumesSnapshotTestJSON-1388493826-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'bUOvuZlz'): stdout= stderr= {{(pid=74613) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 17:59:03 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:97d30677-4d07-468f-99d9-de70cdd5053e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 17:59:03 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:97d30677-4d07-468f-99d9-de70cdd5053e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 17:59:03 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[51b5d90e-91d0-4e07-8d2a-15b08b0a774e]: (4, ('', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 17:59:03 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-7817a9a6-d1a8-4be2-a0ff-d9acc74cb0da tempest-VolumesSnapshotTestJSON-1388493826 tempest-VolumesSnapshotTestJSON-1388493826-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74613) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 17:59:03 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 17:59:03 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 17:59:03 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb00ba6e-3950-4e03-91bb-0bccb2a12a5a]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9511387c-8772-40f2-bf2d-6b6387649e9f (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:72d22ffa-f425-4575-86a5-afbd8bb9cdd6 (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb526b54-3017-4f30-b5c7-88027b146d52 (non-flash)\n', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 17:59:03 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-7817a9a6-d1a8-4be2-a0ff-d9acc74cb0da tempest-VolumesSnapshotTestJSON-1388493826 tempest-VolumesSnapshotTestJSON-1388493826-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9511387c-8772-40f2-bf2d-6b6387649e9f (non-flash)
Nov 29 17:59:03 user nova-compute[74613]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:72d22ffa-f425-4575-86a5-afbd8bb9cdd6 (non-flash)
Nov 29 17:59:03 user nova-compute[74613]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb526b54-3017-4f30-b5c7-88027b146d52 (non-flash)
Nov 29 17:59:03 user nova-compute[74613]:  stderr= {{(pid=74613) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 17:59:03 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-7817a9a6-d1a8-4be2-a0ff-d9acc74cb0da tempest-VolumesSnapshotTestJSON-1388493826 tempest-VolumesSnapshotTestJSON-1388493826-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9511387c-8772-40f2-bf2d-6b6387649e9f (non-flash)
Nov 29 17:59:03 user nova-compute[74613]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:72d22ffa-f425-4575-86a5-afbd8bb9cdd6 (non-flash)
Nov 29 17:59:03 user nova-compute[74613]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb526b54-3017-4f30-b5c7-88027b146d52 (non-flash)
Nov 29 17:59:03 user nova-compute[74613]:  stderr= {{(pid=74613) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 17:59:03 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:97d30677-4d07-468f-99d9-de70cdd5053e -p 172.16.0.220:3260 --login {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 17:59:03 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:97d30677-4d07-468f-99d9-de70cdd5053e -p 172.16.0.220:3260 --login" returned: 0 in 0.066s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 17:59:03 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e06081f-0c22-4917-b8c3-a13c3baac939]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:97d30677-4d07-468f-99d9-de70cdd5053e, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:97d30677-4d07-468f-99d9-de70cdd5053e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 17:59:03 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-7817a9a6-d1a8-4be2-a0ff-d9acc74cb0da tempest-VolumesSnapshotTestJSON-1388493826 tempest-VolumesSnapshotTestJSON-1388493826-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:97d30677-4d07-468f-99d9-de70cdd5053e, portal: 172.16.0.220,3260]
Nov 29 17:59:03 user nova-compute[74613]: Login to [iface: default, target: iqn.2010-10.org.openstack:97d30677-4d07-468f-99d9-de70cdd5053e, portal: 172.16.0.220,3260] successful.
Nov 29 17:59:03 user nova-compute[74613]:  stderr= {{(pid=74613) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 17:59:03 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:97d30677-4d07-468f-99d9-de70cdd5053e -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 17:59:03 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:97d30677-4d07-468f-99d9-de70cdd5053e -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 17:59:03 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f3ce7d3-f57b-4291-8ea9-b37407b3cccd]: (4, ('', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 17:59:03 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-7817a9a6-d1a8-4be2-a0ff-d9acc74cb0da tempest-VolumesSnapshotTestJSON-1388493826 tempest-VolumesSnapshotTestJSON-1388493826-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74613) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 17:59:03 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 17:59:03 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 17:59:03 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[7de8fe0d-cae3-48e7-ba3c-df65c6e8fb67]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9511387c-8772-40f2-bf2d-6b6387649e9f (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:72d22ffa-f425-4575-86a5-afbd8bb9cdd6 (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb526b54-3017-4f30-b5c7-88027b146d52 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:97d30677-4d07-468f-99d9-de70cdd5053e (non-flash)\n', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 17:59:03 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-7817a9a6-d1a8-4be2-a0ff-d9acc74cb0da tempest-VolumesSnapshotTestJSON-1388493826 tempest-VolumesSnapshotTestJSON-1388493826-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9511387c-8772-40f2-bf2d-6b6387649e9f (non-flash)
Nov 29 17:59:03 user nova-compute[74613]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:72d22ffa-f425-4575-86a5-afbd8bb9cdd6 (non-flash)
Nov 29 17:59:03 user nova-compute[74613]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb526b54-3017-4f30-b5c7-88027b146d52 (non-flash)
Nov 29 17:59:03 user nova-compute[74613]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:97d30677-4d07-468f-99d9-de70cdd5053e (non-flash)
Nov 29 17:59:03 user nova-compute[74613]:  stderr= {{(pid=74613) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 17:59:03 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-7817a9a6-d1a8-4be2-a0ff-d9acc74cb0da tempest-VolumesSnapshotTestJSON-1388493826 tempest-VolumesSnapshotTestJSON-1388493826-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9511387c-8772-40f2-bf2d-6b6387649e9f (non-flash)
Nov 29 17:59:03 user nova-compute[74613]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:72d22ffa-f425-4575-86a5-afbd8bb9cdd6 (non-flash)
Nov 29 17:59:03 user nova-compute[74613]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb526b54-3017-4f30-b5c7-88027b146d52 (non-flash)
Nov 29 17:59:03 user nova-compute[74613]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:97d30677-4d07-468f-99d9-de70cdd5053e (non-flash)
Nov 29 17:59:03 user nova-compute[74613]:  stderr= {{(pid=74613) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 17:59:03 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.base [None req-7817a9a6-d1a8-4be2-a0ff-d9acc74cb0da tempest-VolumesSnapshotTestJSON-1388493826 tempest-VolumesSnapshotTestJSON-1388493826-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:97d30677-4d07-468f-99d9-de70cdd5053e" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.316s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 17:59:03 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-7817a9a6-d1a8-4be2-a0ff-d9acc74cb0da tempest-VolumesSnapshotTestJSON-1388493826 tempest-VolumesSnapshotTestJSON-1388493826-project-member] Connected to 172.16.0.220:3260 {{(pid=74613) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 29 17:59:03 user nova-compute[74613]: DEBUG os_brick.initiator.linuxscsi [None req-7817a9a6-d1a8-4be2-a0ff-d9acc74cb0da tempest-VolumesSnapshotTestJSON-1388493826 tempest-VolumesSnapshotTestJSON-1388493826-project-member] HCTL ('36', '-', '-', 0) found on session 23 with lun 0 {{(pid=74613) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 29 17:59:03 user nova-compute[74613]: DEBUG os_brick.initiator.linuxscsi [None req-7817a9a6-d1a8-4be2-a0ff-d9acc74cb0da tempest-VolumesSnapshotTestJSON-1388493826 tempest-VolumesSnapshotTestJSON-1388493826-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=74613) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 29 17:59:03 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 17:59:03 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.019s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 17:59:03 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d9bb18b-d147-417d-8e7d-d7e9659375c0]: (4, ('- - 0', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 17:59:03 user nova-compute[74613]: DEBUG os_brick.initiator.linuxscsi [None req-7817a9a6-d1a8-4be2-a0ff-d9acc74cb0da tempest-VolumesSnapshotTestJSON-1388493826 tempest-VolumesSnapshotTestJSON-1388493826-project-member] Searching for a device in session 23 and hctl ['36', '*', '*', 0] yield: sde {{(pid=74613) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 29 17:59:03 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-7817a9a6-d1a8-4be2-a0ff-d9acc74cb0da tempest-VolumesSnapshotTestJSON-1388493826 tempest-VolumesSnapshotTestJSON-1388493826-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:97d30677-4d07-468f-99d9-de70cdd5053e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'bUOvuZlz', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74613) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 29 17:59:04 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.base [None req-7817a9a6-d1a8-4be2-a0ff-d9acc74cb0da tempest-VolumesSnapshotTestJSON-1388493826 tempest-VolumesSnapshotTestJSON-1388493826-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.349s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 17:59:04 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-7817a9a6-d1a8-4be2-a0ff-d9acc74cb0da tempest-VolumesSnapshotTestJSON-1388493826 tempest-VolumesSnapshotTestJSON-1388493826-project-member] <== connect_volume: return (1350ms) {'type': 'block', 'scsi_wwn': '26537316364383132', 'path': '/dev/sde'} {{(pid=74613) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 17:59:04 user nova-compute[74613]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7817a9a6-d1a8-4be2-a0ff-d9acc74cb0da tempest-VolumesSnapshotTestJSON-1388493826 tempest-VolumesSnapshotTestJSON-1388493826-project-member] [instance: 356478b0-e233-46aa-a1bd-45ce1f9eca8f] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26537316364383132', 'path': '/dev/sde'} {{(pid=74613) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 29 17:59:05 user nova-compute[74613]: DEBUG nova.objects.instance [None req-7817a9a6-d1a8-4be2-a0ff-d9acc74cb0da tempest-VolumesSnapshotTestJSON-1388493826 tempest-VolumesSnapshotTestJSON-1388493826-project-member] Lazy-loading 'flavor' on Instance uuid 356478b0-e233-46aa-a1bd-45ce1f9eca8f {{(pid=74613) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 17:59:05 user nova-compute[74613]: DEBUG nova.virt.libvirt.guest [None req-7817a9a6-d1a8-4be2-a0ff-d9acc74cb0da tempest-VolumesSnapshotTestJSON-1388493826 tempest-VolumesSnapshotTestJSON-1388493826-project-member] attach device xml: <disk type="block" device="disk">
Nov 29 17:59:05 user nova-compute[74613]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 17:59:05 user nova-compute[74613]:   <source dev="/dev/sde"/>
Nov 29 17:59:05 user nova-compute[74613]:   <target dev="vdb" bus="virtio"/>
Nov 29 17:59:05 user nova-compute[74613]:   <serial>97d30677-4d07-468f-99d9-de70cdd5053e</serial>
Nov 29 17:59:05 user nova-compute[74613]: </disk>
Nov 29 17:59:05 user nova-compute[74613]:  {{(pid=74613) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 29 17:59:05 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:59:05 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-7817a9a6-d1a8-4be2-a0ff-d9acc74cb0da tempest-VolumesSnapshotTestJSON-1388493826 tempest-VolumesSnapshotTestJSON-1388493826-project-member] No BDM found with device name vda, not building metadata. {{(pid=74613) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 17:59:05 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-7817a9a6-d1a8-4be2-a0ff-d9acc74cb0da tempest-VolumesSnapshotTestJSON-1388493826 tempest-VolumesSnapshotTestJSON-1388493826-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74613) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 17:59:05 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-7817a9a6-d1a8-4be2-a0ff-d9acc74cb0da tempest-VolumesSnapshotTestJSON-1388493826 tempest-VolumesSnapshotTestJSON-1388493826-project-member] No VIF found with MAC fa:16:3e:42:a7:9e, not building metadata {{(pid=74613) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 29 17:59:05 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-7817a9a6-d1a8-4be2-a0ff-d9acc74cb0da tempest-VolumesSnapshotTestJSON-1388493826 tempest-VolumesSnapshotTestJSON-1388493826-project-member] Lock "356478b0-e233-46aa-a1bd-45ce1f9eca8f" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 10.643s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 17:59:07 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:59:10 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:59:11 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:59:12 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:59:12 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:59:13 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:59:15 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:59:16 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:59:16 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-3bd8301c-1cf5-43f0-bb0c-a85f66251dcc tempest-VolumesAdminNegativeTest-636556351 tempest-VolumesAdminNegativeTest-636556351-project-member] Acquiring lock "481055d5-0f19-4637-9b00-869967ea7889" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 17:59:16 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-3bd8301c-1cf5-43f0-bb0c-a85f66251dcc tempest-VolumesAdminNegativeTest-636556351 tempest-VolumesAdminNegativeTest-636556351-project-member] Lock "481055d5-0f19-4637-9b00-869967ea7889" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 17:59:16 user nova-compute[74613]: DEBUG nova.compute.manager [None req-3bd8301c-1cf5-43f0-bb0c-a85f66251dcc tempest-VolumesAdminNegativeTest-636556351 tempest-VolumesAdminNegativeTest-636556351-project-member] [instance: 481055d5-0f19-4637-9b00-869967ea7889] Starting instance... {{(pid=74613) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 29 17:59:17 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-3bd8301c-1cf5-43f0-bb0c-a85f66251dcc tempest-VolumesAdminNegativeTest-636556351 tempest-VolumesAdminNegativeTest-636556351-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 17:59:17 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-3bd8301c-1cf5-43f0-bb0c-a85f66251dcc tempest-VolumesAdminNegativeTest-636556351 tempest-VolumesAdminNegativeTest-636556351-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 17:59:17 user nova-compute[74613]: DEBUG nova.virt.hardware [None req-3bd8301c-1cf5-43f0-bb0c-a85f66251dcc tempest-VolumesAdminNegativeTest-636556351 tempest-VolumesAdminNegativeTest-636556351-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74613) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 29 17:59:17 user nova-compute[74613]: INFO nova.compute.claims [None req-3bd8301c-1cf5-43f0-bb0c-a85f66251dcc tempest-VolumesAdminNegativeTest-636556351 tempest-VolumesAdminNegativeTest-636556351-project-member] [instance: 481055d5-0f19-4637-9b00-869967ea7889] Claim successful on node user
Nov 29 17:59:17 user nova-compute[74613]: DEBUG nova.compute.provider_tree [None req-3bd8301c-1cf5-43f0-bb0c-a85f66251dcc tempest-VolumesAdminNegativeTest-636556351 tempest-VolumesAdminNegativeTest-636556351-project-member] Inventory has not changed in ProviderTree for provider: 639d980e-3b12-44b1-b8f4-1812416fa4dd {{(pid=74613) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 17:59:17 user nova-compute[74613]: DEBUG nova.scheduler.client.report [None req-3bd8301c-1cf5-43f0-bb0c-a85f66251dcc tempest-VolumesAdminNegativeTest-636556351 tempest-VolumesAdminNegativeTest-636556351-project-member] Inventory has not changed for provider 639d980e-3b12-44b1-b8f4-1812416fa4dd based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74613) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 17:59:17 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-3bd8301c-1cf5-43f0-bb0c-a85f66251dcc tempest-VolumesAdminNegativeTest-636556351 tempest-VolumesAdminNegativeTest-636556351-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.471s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 17:59:17 user nova-compute[74613]: DEBUG nova.compute.manager [None req-3bd8301c-1cf5-43f0-bb0c-a85f66251dcc tempest-VolumesAdminNegativeTest-636556351 tempest-VolumesAdminNegativeTest-636556351-project-member] [instance: 481055d5-0f19-4637-9b00-869967ea7889] Start building networks asynchronously for instance. {{(pid=74613) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 29 17:59:17 user nova-compute[74613]: DEBUG nova.compute.manager [None req-3bd8301c-1cf5-43f0-bb0c-a85f66251dcc tempest-VolumesAdminNegativeTest-636556351 tempest-VolumesAdminNegativeTest-636556351-project-member] [instance: 481055d5-0f19-4637-9b00-869967ea7889] Allocating IP information in the background. {{(pid=74613) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 29 17:59:17 user nova-compute[74613]: DEBUG nova.network.neutron [None req-3bd8301c-1cf5-43f0-bb0c-a85f66251dcc tempest-VolumesAdminNegativeTest-636556351 tempest-VolumesAdminNegativeTest-636556351-project-member] [instance: 481055d5-0f19-4637-9b00-869967ea7889] allocate_for_instance() {{(pid=74613) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 29 17:59:17 user nova-compute[74613]: DEBUG oslo_service.periodic_task [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74613) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 17:59:17 user nova-compute[74613]: INFO nova.virt.libvirt.driver [None req-3bd8301c-1cf5-43f0-bb0c-a85f66251dcc tempest-VolumesAdminNegativeTest-636556351 tempest-VolumesAdminNegativeTest-636556351-project-member] [instance: 481055d5-0f19-4637-9b00-869967ea7889] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 29 17:59:17 user nova-compute[74613]: DEBUG nova.compute.manager [None req-3bd8301c-1cf5-43f0-bb0c-a85f66251dcc tempest-VolumesAdminNegativeTest-636556351 tempest-VolumesAdminNegativeTest-636556351-project-member] [instance: 481055d5-0f19-4637-9b00-869967ea7889] Start building block device mappings for instance. {{(pid=74613) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 29 17:59:17 user nova-compute[74613]: DEBUG nova.policy [None req-3bd8301c-1cf5-43f0-bb0c-a85f66251dcc tempest-VolumesAdminNegativeTest-636556351 tempest-VolumesAdminNegativeTest-636556351-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '30b382b3a0c44bdf8ea91ea3ae780243', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3832a80aaabc42ba8400823aa6b76c29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74613) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 29 17:59:17 user nova-compute[74613]: DEBUG nova.compute.manager [None req-3bd8301c-1cf5-43f0-bb0c-a85f66251dcc tempest-VolumesAdminNegativeTest-636556351 tempest-VolumesAdminNegativeTest-636556351-project-member] [instance: 481055d5-0f19-4637-9b00-869967ea7889] Start spawning the instance on the hypervisor. {{(pid=74613) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 29 17:59:17 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-3bd8301c-1cf5-43f0-bb0c-a85f66251dcc tempest-VolumesAdminNegativeTest-636556351 tempest-VolumesAdminNegativeTest-636556351-project-member] [instance: 481055d5-0f19-4637-9b00-869967ea7889] Creating instance directory {{(pid=74613) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 29 17:59:17 user nova-compute[74613]: INFO nova.virt.libvirt.driver [None req-3bd8301c-1cf5-43f0-bb0c-a85f66251dcc tempest-VolumesAdminNegativeTest-636556351 tempest-VolumesAdminNegativeTest-636556351-project-member] [instance: 481055d5-0f19-4637-9b00-869967ea7889] Creating image(s)
Nov 29 17:59:17 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-3bd8301c-1cf5-43f0-bb0c-a85f66251dcc tempest-VolumesAdminNegativeTest-636556351 tempest-VolumesAdminNegativeTest-636556351-project-member] Acquiring lock "/opt/stack/data/nova/instances/481055d5-0f19-4637-9b00-869967ea7889/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 17:59:17 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-3bd8301c-1cf5-43f0-bb0c-a85f66251dcc tempest-VolumesAdminNegativeTest-636556351 tempest-VolumesAdminNegativeTest-636556351-project-member] Lock "/opt/stack/data/nova/instances/481055d5-0f19-4637-9b00-869967ea7889/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 17:59:17 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-3bd8301c-1cf5-43f0-bb0c-a85f66251dcc tempest-VolumesAdminNegativeTest-636556351 tempest-VolumesAdminNegativeTest-636556351-project-member] Lock "/opt/stack/data/nova/instances/481055d5-0f19-4637-9b00-869967ea7889/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.006s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 17:59:17 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-3bd8301c-1cf5-43f0-bb0c-a85f66251dcc tempest-VolumesAdminNegativeTest-636556351 tempest-VolumesAdminNegativeTest-636556351-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/21faea9e6951f3bdd0153b76ac89fe1a60a34758 --force-share --output=json {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 17:59:17 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:59:18 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-3bd8301c-1cf5-43f0-bb0c-a85f66251dcc tempest-VolumesAdminNegativeTest-636556351 tempest-VolumesAdminNegativeTest-636556351-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/21faea9e6951f3bdd0153b76ac89fe1a60a34758 --force-share --output=json" returned: 0 in 0.180s {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 17:59:18 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-3bd8301c-1cf5-43f0-bb0c-a85f66251dcc tempest-VolumesAdminNegativeTest-636556351 tempest-VolumesAdminNegativeTest-636556351-project-member] Acquiring lock "21faea9e6951f3bdd0153b76ac89fe1a60a34758" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 17:59:18 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-3bd8301c-1cf5-43f0-bb0c-a85f66251dcc tempest-VolumesAdminNegativeTest-636556351 tempest-VolumesAdminNegativeTest-636556351-project-member] Lock "21faea9e6951f3bdd0153b76ac89fe1a60a34758" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 17:59:18 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-3bd8301c-1cf5-43f0-bb0c-a85f66251dcc tempest-VolumesAdminNegativeTest-636556351 tempest-VolumesAdminNegativeTest-636556351-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/21faea9e6951f3bdd0153b76ac89fe1a60a34758 --force-share --output=json {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 17:59:18 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-3bd8301c-1cf5-43f0-bb0c-a85f66251dcc tempest-VolumesAdminNegativeTest-636556351 tempest-VolumesAdminNegativeTest-636556351-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/21faea9e6951f3bdd0153b76ac89fe1a60a34758 --force-share --output=json" returned: 0 in 0.204s {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 17:59:18 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-3bd8301c-1cf5-43f0-bb0c-a85f66251dcc tempest-VolumesAdminNegativeTest-636556351 tempest-VolumesAdminNegativeTest-636556351-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/21faea9e6951f3bdd0153b76ac89fe1a60a34758,backing_fmt=raw /opt/stack/data/nova/instances/481055d5-0f19-4637-9b00-869967ea7889/disk 1073741824 {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 17:59:18 user nova-compute[74613]: DEBUG nova.network.neutron [None req-3bd8301c-1cf5-43f0-bb0c-a85f66251dcc tempest-VolumesAdminNegativeTest-636556351 tempest-VolumesAdminNegativeTest-636556351-project-member] [instance: 481055d5-0f19-4637-9b00-869967ea7889] Successfully created port: 93e35c24-f93e-4a63-bffb-845d31c63cde {{(pid=74613) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 29 17:59:18 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-3bd8301c-1cf5-43f0-bb0c-a85f66251dcc tempest-VolumesAdminNegativeTest-636556351 tempest-VolumesAdminNegativeTest-636556351-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/21faea9e6951f3bdd0153b76ac89fe1a60a34758,backing_fmt=raw /opt/stack/data/nova/instances/481055d5-0f19-4637-9b00-869967ea7889/disk 1073741824" returned: 0 in 0.055s {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 17:59:18 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-3bd8301c-1cf5-43f0-bb0c-a85f66251dcc tempest-VolumesAdminNegativeTest-636556351 tempest-VolumesAdminNegativeTest-636556351-project-member] Lock "21faea9e6951f3bdd0153b76ac89fe1a60a34758" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.265s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 17:59:18 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-3bd8301c-1cf5-43f0-bb0c-a85f66251dcc tempest-VolumesAdminNegativeTest-636556351 tempest-VolumesAdminNegativeTest-636556351-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/21faea9e6951f3bdd0153b76ac89fe1a60a34758 --force-share --output=json {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 17:59:18 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-3bd8301c-1cf5-43f0-bb0c-a85f66251dcc tempest-VolumesAdminNegativeTest-636556351 tempest-VolumesAdminNegativeTest-636556351-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/21faea9e6951f3bdd0153b76ac89fe1a60a34758 --force-share --output=json" returned: 0 in 0.186s {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 17:59:18 user nova-compute[74613]: DEBUG nova.virt.disk.api [None req-3bd8301c-1cf5-43f0-bb0c-a85f66251dcc tempest-VolumesAdminNegativeTest-636556351 tempest-VolumesAdminNegativeTest-636556351-project-member] Checking if we can resize image /opt/stack/data/nova/instances/481055d5-0f19-4637-9b00-869967ea7889/disk. size=1073741824 {{(pid=74613) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 29 17:59:18 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-3bd8301c-1cf5-43f0-bb0c-a85f66251dcc tempest-VolumesAdminNegativeTest-636556351 tempest-VolumesAdminNegativeTest-636556351-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/481055d5-0f19-4637-9b00-869967ea7889/disk --force-share --output=json {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 17:59:18 user nova-compute[74613]: DEBUG oslo_service.periodic_task [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74613) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 17:59:18 user nova-compute[74613]: DEBUG oslo_service.periodic_task [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74613) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 17:59:18 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 17:59:18 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 17:59:18 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 17:59:18 user nova-compute[74613]: DEBUG nova.compute.resource_tracker [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Auditing locally available compute resources for user (node: user) {{(pid=74613) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 29 17:59:18 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-3bd8301c-1cf5-43f0-bb0c-a85f66251dcc tempest-VolumesAdminNegativeTest-636556351 tempest-VolumesAdminNegativeTest-636556351-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/481055d5-0f19-4637-9b00-869967ea7889/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 17:59:18 user nova-compute[74613]: DEBUG nova.virt.disk.api [None req-3bd8301c-1cf5-43f0-bb0c-a85f66251dcc tempest-VolumesAdminNegativeTest-636556351 tempest-VolumesAdminNegativeTest-636556351-project-member] Cannot resize image /opt/stack/data/nova/instances/481055d5-0f19-4637-9b00-869967ea7889/disk to a smaller size. {{(pid=74613) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 29 17:59:18 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-3bd8301c-1cf5-43f0-bb0c-a85f66251dcc tempest-VolumesAdminNegativeTest-636556351 tempest-VolumesAdminNegativeTest-636556351-project-member] [instance: 481055d5-0f19-4637-9b00-869967ea7889] Created local disks {{(pid=74613) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 29 17:59:18 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-3bd8301c-1cf5-43f0-bb0c-a85f66251dcc tempest-VolumesAdminNegativeTest-636556351 tempest-VolumesAdminNegativeTest-636556351-project-member] [instance: 481055d5-0f19-4637-9b00-869967ea7889] Ensure instance console log exists: /opt/stack/data/nova/instances/481055d5-0f19-4637-9b00-869967ea7889/console.log {{(pid=74613) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 29 17:59:18 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-3bd8301c-1cf5-43f0-bb0c-a85f66251dcc tempest-VolumesAdminNegativeTest-636556351 tempest-VolumesAdminNegativeTest-636556351-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 17:59:18 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-3bd8301c-1cf5-43f0-bb0c-a85f66251dcc tempest-VolumesAdminNegativeTest-636556351 tempest-VolumesAdminNegativeTest-636556351-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 17:59:18 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-3bd8301c-1cf5-43f0-bb0c-a85f66251dcc tempest-VolumesAdminNegativeTest-636556351 tempest-VolumesAdminNegativeTest-636556351-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 17:59:18 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c4bdb712-e1f9-4fc0-b527-87088d7eddf8/disk --force-share --output=json {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 17:59:19 user nova-compute[74613]: DEBUG nova.network.neutron [None req-3bd8301c-1cf5-43f0-bb0c-a85f66251dcc tempest-VolumesAdminNegativeTest-636556351 tempest-VolumesAdminNegativeTest-636556351-project-member] [instance: 481055d5-0f19-4637-9b00-869967ea7889] Successfully updated port: 93e35c24-f93e-4a63-bffb-845d31c63cde {{(pid=74613) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 29 17:59:19 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c4bdb712-e1f9-4fc0-b527-87088d7eddf8/disk --force-share --output=json" returned: 0 in 0.229s {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 17:59:19 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c4bdb712-e1f9-4fc0-b527-87088d7eddf8/disk --force-share --output=json {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 17:59:19 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-3bd8301c-1cf5-43f0-bb0c-a85f66251dcc tempest-VolumesAdminNegativeTest-636556351 tempest-VolumesAdminNegativeTest-636556351-project-member] Acquiring lock "refresh_cache-481055d5-0f19-4637-9b00-869967ea7889" {{(pid=74613) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 17:59:19 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-3bd8301c-1cf5-43f0-bb0c-a85f66251dcc tempest-VolumesAdminNegativeTest-636556351 tempest-VolumesAdminNegativeTest-636556351-project-member] Acquired lock "refresh_cache-481055d5-0f19-4637-9b00-869967ea7889" {{(pid=74613) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 17:59:19 user nova-compute[74613]: DEBUG nova.network.neutron [None req-3bd8301c-1cf5-43f0-bb0c-a85f66251dcc tempest-VolumesAdminNegativeTest-636556351 tempest-VolumesAdminNegativeTest-636556351-project-member] [instance: 481055d5-0f19-4637-9b00-869967ea7889] Building network info cache for instance {{(pid=74613) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 29 17:59:19 user nova-compute[74613]: DEBUG nova.compute.manager [req-9c2902bd-b35f-4f91-be90-acc158cdb750 req-92200f3d-caec-42f2-9650-80f22eca6353 service nova] [instance: 481055d5-0f19-4637-9b00-869967ea7889] Received event network-changed-93e35c24-f93e-4a63-bffb-845d31c63cde {{(pid=74613) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 17:59:19 user nova-compute[74613]: DEBUG nova.compute.manager [req-9c2902bd-b35f-4f91-be90-acc158cdb750 req-92200f3d-caec-42f2-9650-80f22eca6353 service nova] [instance: 481055d5-0f19-4637-9b00-869967ea7889] Refreshing instance network info cache due to event network-changed-93e35c24-f93e-4a63-bffb-845d31c63cde. {{(pid=74613) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 17:59:19 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-9c2902bd-b35f-4f91-be90-acc158cdb750 req-92200f3d-caec-42f2-9650-80f22eca6353 service nova] Acquiring lock "refresh_cache-481055d5-0f19-4637-9b00-869967ea7889" {{(pid=74613) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 17:59:19 user nova-compute[74613]: DEBUG nova.network.neutron [None req-3bd8301c-1cf5-43f0-bb0c-a85f66251dcc tempest-VolumesAdminNegativeTest-636556351 tempest-VolumesAdminNegativeTest-636556351-project-member] [instance: 481055d5-0f19-4637-9b00-869967ea7889] Instance cache missing network info. {{(pid=74613) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 29 17:59:19 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c4bdb712-e1f9-4fc0-b527-87088d7eddf8/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 17:59:19 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fce4b456-c108-439f-b0ff-7619aaf77e69/disk --force-share --output=json {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 17:59:19 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fce4b456-c108-439f-b0ff-7619aaf77e69/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 17:59:19 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fce4b456-c108-439f-b0ff-7619aaf77e69/disk --force-share --output=json {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 17:59:19 user nova-compute[74613]: DEBUG nova.network.neutron [None req-3bd8301c-1cf5-43f0-bb0c-a85f66251dcc tempest-VolumesAdminNegativeTest-636556351 tempest-VolumesAdminNegativeTest-636556351-project-member] [instance: 481055d5-0f19-4637-9b00-869967ea7889] Updating instance_info_cache with network_info: [{"id": "93e35c24-f93e-4a63-bffb-845d31c63cde", "address": "fa:16:3e:96:ed:fa", "network": {"id": "485e1e0d-aa2c-47c2-a010-c84e83dbcc9c", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-686908926-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3832a80aaabc42ba8400823aa6b76c29", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap93e35c24-f9", "ovs_interfaceid": "93e35c24-f93e-4a63-bffb-845d31c63cde", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74613) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 17:59:19 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-3bd8301c-1cf5-43f0-bb0c-a85f66251dcc tempest-VolumesAdminNegativeTest-636556351 tempest-VolumesAdminNegativeTest-636556351-project-member] Releasing lock "refresh_cache-481055d5-0f19-4637-9b00-869967ea7889" {{(pid=74613) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 17:59:19 user nova-compute[74613]: DEBUG nova.compute.manager [None req-3bd8301c-1cf5-43f0-bb0c-a85f66251dcc tempest-VolumesAdminNegativeTest-636556351 tempest-VolumesAdminNegativeTest-636556351-project-member] [instance: 481055d5-0f19-4637-9b00-869967ea7889] Instance network_info: |[{"id": "93e35c24-f93e-4a63-bffb-845d31c63cde", "address": "fa:16:3e:96:ed:fa", "network": {"id": "485e1e0d-aa2c-47c2-a010-c84e83dbcc9c", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-686908926-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3832a80aaabc42ba8400823aa6b76c29", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap93e35c24-f9", "ovs_interfaceid": "93e35c24-f93e-4a63-bffb-845d31c63cde", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74613) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 29 17:59:19 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-9c2902bd-b35f-4f91-be90-acc158cdb750 req-92200f3d-caec-42f2-9650-80f22eca6353 service nova] Acquired lock "refresh_cache-481055d5-0f19-4637-9b00-869967ea7889" {{(pid=74613) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 17:59:19 user nova-compute[74613]: DEBUG nova.network.neutron [req-9c2902bd-b35f-4f91-be90-acc158cdb750 req-92200f3d-caec-42f2-9650-80f22eca6353 service nova] [instance: 481055d5-0f19-4637-9b00-869967ea7889] Refreshing network info cache for port 93e35c24-f93e-4a63-bffb-845d31c63cde {{(pid=74613) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 17:59:19 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-3bd8301c-1cf5-43f0-bb0c-a85f66251dcc tempest-VolumesAdminNegativeTest-636556351 tempest-VolumesAdminNegativeTest-636556351-project-member] [instance: 481055d5-0f19-4637-9b00-869967ea7889] Start _get_guest_xml network_info=[{"id": "93e35c24-f93e-4a63-bffb-845d31c63cde", "address": "fa:16:3e:96:ed:fa", "network": {"id": "485e1e0d-aa2c-47c2-a010-c84e83dbcc9c", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-686908926-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3832a80aaabc42ba8400823aa6b76c29", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap93e35c24-f9", "ovs_interfaceid": "93e35c24-f93e-4a63-bffb-845d31c63cde", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-29T17:47:38Z,direct_url=<?>,disk_format='qcow2',id=4217f428-8d9d-4ee1-9614-642d26d90c46,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='794b07cbd46a44b5865cfda741036bae',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-29T17:47:40Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'size': 0, 'device_type': 'disk', 'boot_index': 0, 'guest_format': None, 'encrypted': False, 'encryption_format': None, 'disk_bus': 'virtio', 'image_id': '4217f428-8d9d-4ee1-9614-642d26d90c46'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74613) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 29 17:59:19 user nova-compute[74613]: WARNING nova.virt.libvirt.driver [None req-3bd8301c-1cf5-43f0-bb0c-a85f66251dcc tempest-VolumesAdminNegativeTest-636556351 tempest-VolumesAdminNegativeTest-636556351-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 17:59:19 user nova-compute[74613]: WARNING nova.virt.libvirt.driver [None req-3bd8301c-1cf5-43f0-bb0c-a85f66251dcc tempest-VolumesAdminNegativeTest-636556351 tempest-VolumesAdminNegativeTest-636556351-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 17:59:19 user nova-compute[74613]: DEBUG nova.virt.libvirt.host [None req-3bd8301c-1cf5-43f0-bb0c-a85f66251dcc tempest-VolumesAdminNegativeTest-636556351 tempest-VolumesAdminNegativeTest-636556351-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74613) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 29 17:59:19 user nova-compute[74613]: DEBUG nova.virt.libvirt.host [None req-3bd8301c-1cf5-43f0-bb0c-a85f66251dcc tempest-VolumesAdminNegativeTest-636556351 tempest-VolumesAdminNegativeTest-636556351-project-member] CPU controller missing on host. {{(pid=74613) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 29 17:59:19 user nova-compute[74613]: DEBUG nova.virt.libvirt.host [None req-3bd8301c-1cf5-43f0-bb0c-a85f66251dcc tempest-VolumesAdminNegativeTest-636556351 tempest-VolumesAdminNegativeTest-636556351-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74613) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 29 17:59:19 user nova-compute[74613]: DEBUG nova.virt.libvirt.host [None req-3bd8301c-1cf5-43f0-bb0c-a85f66251dcc tempest-VolumesAdminNegativeTest-636556351 tempest-VolumesAdminNegativeTest-636556351-project-member] CPU controller found on host. {{(pid=74613) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 29 17:59:19 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-3bd8301c-1cf5-43f0-bb0c-a85f66251dcc tempest-VolumesAdminNegativeTest-636556351 tempest-VolumesAdminNegativeTest-636556351-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74613) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 29 17:59:19 user nova-compute[74613]: DEBUG nova.virt.hardware [None req-3bd8301c-1cf5-43f0-bb0c-a85f66251dcc tempest-VolumesAdminNegativeTest-636556351 tempest-VolumesAdminNegativeTest-636556351-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-29T17:47:27Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-29T17:47:38Z,direct_url=<?>,disk_format='qcow2',id=4217f428-8d9d-4ee1-9614-642d26d90c46,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='794b07cbd46a44b5865cfda741036bae',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-29T17:47:40Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74613) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 29 17:59:19 user nova-compute[74613]: DEBUG nova.virt.hardware [None req-3bd8301c-1cf5-43f0-bb0c-a85f66251dcc tempest-VolumesAdminNegativeTest-636556351 tempest-VolumesAdminNegativeTest-636556351-project-member] Flavor limits 0:0:0 {{(pid=74613) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 29 17:59:19 user nova-compute[74613]: DEBUG nova.virt.hardware [None req-3bd8301c-1cf5-43f0-bb0c-a85f66251dcc tempest-VolumesAdminNegativeTest-636556351 tempest-VolumesAdminNegativeTest-636556351-project-member] Image limits 0:0:0 {{(pid=74613) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 29 17:59:19 user nova-compute[74613]: DEBUG nova.virt.hardware [None req-3bd8301c-1cf5-43f0-bb0c-a85f66251dcc tempest-VolumesAdminNegativeTest-636556351 tempest-VolumesAdminNegativeTest-636556351-project-member] Flavor pref 0:0:0 {{(pid=74613) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 29 17:59:19 user nova-compute[74613]: DEBUG nova.virt.hardware [None req-3bd8301c-1cf5-43f0-bb0c-a85f66251dcc tempest-VolumesAdminNegativeTest-636556351 tempest-VolumesAdminNegativeTest-636556351-project-member] Image pref 0:0:0 {{(pid=74613) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 29 17:59:19 user nova-compute[74613]: DEBUG nova.virt.hardware [None req-3bd8301c-1cf5-43f0-bb0c-a85f66251dcc tempest-VolumesAdminNegativeTest-636556351 tempest-VolumesAdminNegativeTest-636556351-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74613) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 29 17:59:19 user nova-compute[74613]: DEBUG nova.virt.hardware [None req-3bd8301c-1cf5-43f0-bb0c-a85f66251dcc tempest-VolumesAdminNegativeTest-636556351 tempest-VolumesAdminNegativeTest-636556351-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74613) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 29 17:59:19 user nova-compute[74613]: DEBUG nova.virt.hardware [None req-3bd8301c-1cf5-43f0-bb0c-a85f66251dcc tempest-VolumesAdminNegativeTest-636556351 tempest-VolumesAdminNegativeTest-636556351-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74613) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 29 17:59:19 user nova-compute[74613]: DEBUG nova.virt.hardware [None req-3bd8301c-1cf5-43f0-bb0c-a85f66251dcc tempest-VolumesAdminNegativeTest-636556351 tempest-VolumesAdminNegativeTest-636556351-project-member] Got 1 possible topologies {{(pid=74613) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 29 17:59:19 user nova-compute[74613]: DEBUG nova.virt.hardware [None req-3bd8301c-1cf5-43f0-bb0c-a85f66251dcc tempest-VolumesAdminNegativeTest-636556351 tempest-VolumesAdminNegativeTest-636556351-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74613) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 29 17:59:19 user nova-compute[74613]: DEBUG nova.virt.hardware [None req-3bd8301c-1cf5-43f0-bb0c-a85f66251dcc tempest-VolumesAdminNegativeTest-636556351 tempest-VolumesAdminNegativeTest-636556351-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74613) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 29 17:59:19 user nova-compute[74613]: DEBUG nova.virt.libvirt.vif [None req-3bd8301c-1cf5-43f0-bb0c-a85f66251dcc tempest-VolumesAdminNegativeTest-636556351 tempest-VolumesAdminNegativeTest-636556351-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T17:59:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-537972870',display_name='tempest-VolumesAdminNegativeTest-server-537972870',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-537972870',id=21,image_ref='4217f428-8d9d-4ee1-9614-642d26d90c46',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3832a80aaabc42ba8400823aa6b76c29',ramdisk_id='',reservation_id='r-6rumhxs6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='4217f428-8d9d-4ee1-9614-642d26d90c46',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-636556351',owner_user_name='tempest-VolumesAdminNegativeTest-636556351-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T17:59:18Z,user_data=None,user_id='30b382b3a0c44bdf8ea91ea3ae780243',uuid=481055d5-0f19-4637-9b00-869967ea7889,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "93e35c24-f93e-4a63-bffb-845d31c63cde", "address": "fa:16:3e:96:ed:fa", "network": {"id": "485e1e0d-aa2c-47c2-a010-c84e83dbcc9c", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-686908926-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3832a80aaabc42ba8400823aa6b76c29", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap93e35c24-f9", "ovs_interfaceid": "93e35c24-f93e-4a63-bffb-845d31c63cde", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74613) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 29 17:59:19 user nova-compute[74613]: DEBUG nova.network.os_vif_util [None req-3bd8301c-1cf5-43f0-bb0c-a85f66251dcc tempest-VolumesAdminNegativeTest-636556351 tempest-VolumesAdminNegativeTest-636556351-project-member] Converting VIF {"id": "93e35c24-f93e-4a63-bffb-845d31c63cde", "address": "fa:16:3e:96:ed:fa", "network": {"id": "485e1e0d-aa2c-47c2-a010-c84e83dbcc9c", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-686908926-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3832a80aaabc42ba8400823aa6b76c29", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap93e35c24-f9", "ovs_interfaceid": "93e35c24-f93e-4a63-bffb-845d31c63cde", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74613) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 17:59:19 user nova-compute[74613]: DEBUG nova.network.os_vif_util [None req-3bd8301c-1cf5-43f0-bb0c-a85f66251dcc tempest-VolumesAdminNegativeTest-636556351 tempest-VolumesAdminNegativeTest-636556351-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:96:ed:fa,bridge_name='br-int',has_traffic_filtering=True,id=93e35c24-f93e-4a63-bffb-845d31c63cde,network=Network(485e1e0d-aa2c-47c2-a010-c84e83dbcc9c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap93e35c24-f9') {{(pid=74613) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 17:59:19 user nova-compute[74613]: DEBUG nova.objects.instance [None req-3bd8301c-1cf5-43f0-bb0c-a85f66251dcc tempest-VolumesAdminNegativeTest-636556351 tempest-VolumesAdminNegativeTest-636556351-project-member] Lazy-loading 'pci_devices' on Instance uuid 481055d5-0f19-4637-9b00-869967ea7889 {{(pid=74613) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 17:59:19 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-3bd8301c-1cf5-43f0-bb0c-a85f66251dcc tempest-VolumesAdminNegativeTest-636556351 tempest-VolumesAdminNegativeTest-636556351-project-member] [instance: 481055d5-0f19-4637-9b00-869967ea7889] End _get_guest_xml xml=<domain type="kvm">
Nov 29 17:59:19 user nova-compute[74613]:   <uuid>481055d5-0f19-4637-9b00-869967ea7889</uuid>
Nov 29 17:59:19 user nova-compute[74613]:   <name>instance-00000015</name>
Nov 29 17:59:19 user nova-compute[74613]:   <memory>524288</memory>
Nov 29 17:59:19 user nova-compute[74613]:   <vcpu>1</vcpu>
Nov 29 17:59:19 user nova-compute[74613]:   <metadata>
Nov 29 17:59:19 user nova-compute[74613]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 29 17:59:19 user nova-compute[74613]:       <nova:package version="0.0.0"/>
Nov 29 17:59:19 user nova-compute[74613]:       <nova:name>tempest-VolumesAdminNegativeTest-server-537972870</nova:name>
Nov 29 17:59:19 user nova-compute[74613]:       <nova:creationTime>2023-11-29 17:59:19</nova:creationTime>
Nov 29 17:59:19 user nova-compute[74613]:       <nova:flavor name="m1.tiny">
Nov 29 17:59:19 user nova-compute[74613]:         <nova:memory>512</nova:memory>
Nov 29 17:59:19 user nova-compute[74613]:         <nova:disk>1</nova:disk>
Nov 29 17:59:19 user nova-compute[74613]:         <nova:swap>0</nova:swap>
Nov 29 17:59:19 user nova-compute[74613]:         <nova:ephemeral>0</nova:ephemeral>
Nov 29 17:59:19 user nova-compute[74613]:         <nova:vcpus>1</nova:vcpus>
Nov 29 17:59:19 user nova-compute[74613]:       </nova:flavor>
Nov 29 17:59:19 user nova-compute[74613]:       <nova:owner>
Nov 29 17:59:19 user nova-compute[74613]:         <nova:user uuid="30b382b3a0c44bdf8ea91ea3ae780243">tempest-VolumesAdminNegativeTest-636556351-project-member</nova:user>
Nov 29 17:59:19 user nova-compute[74613]:         <nova:project uuid="3832a80aaabc42ba8400823aa6b76c29">tempest-VolumesAdminNegativeTest-636556351</nova:project>
Nov 29 17:59:19 user nova-compute[74613]:       </nova:owner>
Nov 29 17:59:19 user nova-compute[74613]:       <nova:root type="image" uuid="4217f428-8d9d-4ee1-9614-642d26d90c46"/>
Nov 29 17:59:19 user nova-compute[74613]:       <nova:ports>
Nov 29 17:59:19 user nova-compute[74613]:         <nova:port uuid="93e35c24-f93e-4a63-bffb-845d31c63cde">
Nov 29 17:59:19 user nova-compute[74613]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Nov 29 17:59:19 user nova-compute[74613]:         </nova:port>
Nov 29 17:59:19 user nova-compute[74613]:       </nova:ports>
Nov 29 17:59:19 user nova-compute[74613]:     </nova:instance>
Nov 29 17:59:19 user nova-compute[74613]:   </metadata>
Nov 29 17:59:19 user nova-compute[74613]:   <sysinfo type="smbios">
Nov 29 17:59:19 user nova-compute[74613]:     <system>
Nov 29 17:59:19 user nova-compute[74613]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 29 17:59:19 user nova-compute[74613]:       <entry name="product">OpenStack Nova</entry>
Nov 29 17:59:19 user nova-compute[74613]:       <entry name="version">0.0.0</entry>
Nov 29 17:59:19 user nova-compute[74613]:       <entry name="serial">481055d5-0f19-4637-9b00-869967ea7889</entry>
Nov 29 17:59:19 user nova-compute[74613]:       <entry name="uuid">481055d5-0f19-4637-9b00-869967ea7889</entry>
Nov 29 17:59:19 user nova-compute[74613]:       <entry name="family">Virtual Machine</entry>
Nov 29 17:59:19 user nova-compute[74613]:     </system>
Nov 29 17:59:19 user nova-compute[74613]:   </sysinfo>
Nov 29 17:59:19 user nova-compute[74613]:   <os>
Nov 29 17:59:19 user nova-compute[74613]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 29 17:59:19 user nova-compute[74613]:     <boot dev="hd"/>
Nov 29 17:59:19 user nova-compute[74613]:     <smbios mode="sysinfo"/>
Nov 29 17:59:19 user nova-compute[74613]:   </os>
Nov 29 17:59:19 user nova-compute[74613]:   <features>
Nov 29 17:59:19 user nova-compute[74613]:     <acpi/>
Nov 29 17:59:19 user nova-compute[74613]:     <apic/>
Nov 29 17:59:19 user nova-compute[74613]:     <vmcoreinfo/>
Nov 29 17:59:19 user nova-compute[74613]:   </features>
Nov 29 17:59:19 user nova-compute[74613]:   <clock offset="utc">
Nov 29 17:59:19 user nova-compute[74613]:     <timer name="pit" tickpolicy="delay"/>
Nov 29 17:59:19 user nova-compute[74613]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 29 17:59:19 user nova-compute[74613]:     <timer name="hpet" present="no"/>
Nov 29 17:59:19 user nova-compute[74613]:   </clock>
Nov 29 17:59:19 user nova-compute[74613]:   <cpu mode="custom" match="exact">
Nov 29 17:59:19 user nova-compute[74613]:     <model>Nehalem</model>
Nov 29 17:59:19 user nova-compute[74613]:     <topology sockets="1" cores="1" threads="1"/>
Nov 29 17:59:19 user nova-compute[74613]:   </cpu>
Nov 29 17:59:19 user nova-compute[74613]:   <devices>
Nov 29 17:59:19 user nova-compute[74613]:     <disk type="file" device="disk">
Nov 29 17:59:19 user nova-compute[74613]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 29 17:59:19 user nova-compute[74613]:       <source file="/opt/stack/data/nova/instances/481055d5-0f19-4637-9b00-869967ea7889/disk"/>
Nov 29 17:59:19 user nova-compute[74613]:       <target dev="vda" bus="virtio"/>
Nov 29 17:59:19 user nova-compute[74613]:     </disk>
Nov 29 17:59:19 user nova-compute[74613]:     <interface type="ethernet">
Nov 29 17:59:19 user nova-compute[74613]:       <mac address="fa:16:3e:96:ed:fa"/>
Nov 29 17:59:19 user nova-compute[74613]:       <model type="virtio"/>
Nov 29 17:59:19 user nova-compute[74613]:       <mtu size="1442"/>
Nov 29 17:59:19 user nova-compute[74613]:       <target dev="tap93e35c24-f9"/>
Nov 29 17:59:19 user nova-compute[74613]:     </interface>
Nov 29 17:59:19 user nova-compute[74613]:     <serial type="pty">
Nov 29 17:59:19 user nova-compute[74613]:       <log file="/opt/stack/data/nova/instances/481055d5-0f19-4637-9b00-869967ea7889/console.log" append="off"/>
Nov 29 17:59:19 user nova-compute[74613]:     </serial>
Nov 29 17:59:19 user nova-compute[74613]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 29 17:59:19 user nova-compute[74613]:     <video>
Nov 29 17:59:19 user nova-compute[74613]:       <model type="virtio"/>
Nov 29 17:59:19 user nova-compute[74613]:     </video>
Nov 29 17:59:19 user nova-compute[74613]:     <rng model="virtio">
Nov 29 17:59:19 user nova-compute[74613]:       <backend model="random">/dev/urandom</backend>
Nov 29 17:59:19 user nova-compute[74613]:     </rng>
Nov 29 17:59:19 user nova-compute[74613]:     <controller type="usb" index="0" model="none"/>
Nov 29 17:59:19 user nova-compute[74613]:     <memballoon model="virtio">
Nov 29 17:59:19 user nova-compute[74613]:       <stats period="10"/>
Nov 29 17:59:19 user nova-compute[74613]:     </memballoon>
Nov 29 17:59:19 user nova-compute[74613]:   </devices>
Nov 29 17:59:19 user nova-compute[74613]: </domain>
Nov 29 17:59:19 user nova-compute[74613]:  {{(pid=74613) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 29 17:59:19 user nova-compute[74613]: DEBUG nova.virt.libvirt.vif [None req-3bd8301c-1cf5-43f0-bb0c-a85f66251dcc tempest-VolumesAdminNegativeTest-636556351 tempest-VolumesAdminNegativeTest-636556351-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T17:59:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-537972870',display_name='tempest-VolumesAdminNegativeTest-server-537972870',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-537972870',id=21,image_ref='4217f428-8d9d-4ee1-9614-642d26d90c46',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3832a80aaabc42ba8400823aa6b76c29',ramdisk_id='',reservation_id='r-6rumhxs6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='4217f428-8d9d-4ee1-9614-642d26d90c46',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-636556351',owner_user_name='tempest-VolumesAdminNegativeTest-636556351-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T17:59:18Z,user_data=None,user_id='30b382b3a0c44bdf8ea91ea3ae780243',uuid=481055d5-0f19-4637-9b00-869967ea7889,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "93e35c24-f93e-4a63-bffb-845d31c63cde", "address": "fa:16:3e:96:ed:fa", "network": {"id": "485e1e0d-aa2c-47c2-a010-c84e83dbcc9c", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-686908926-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3832a80aaabc42ba8400823aa6b76c29", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap93e35c24-f9", "ovs_interfaceid": "93e35c24-f93e-4a63-bffb-845d31c63cde", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74613) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 29 17:59:19 user nova-compute[74613]: DEBUG nova.network.os_vif_util [None req-3bd8301c-1cf5-43f0-bb0c-a85f66251dcc tempest-VolumesAdminNegativeTest-636556351 tempest-VolumesAdminNegativeTest-636556351-project-member] Converting VIF {"id": "93e35c24-f93e-4a63-bffb-845d31c63cde", "address": "fa:16:3e:96:ed:fa", "network": {"id": "485e1e0d-aa2c-47c2-a010-c84e83dbcc9c", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-686908926-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3832a80aaabc42ba8400823aa6b76c29", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap93e35c24-f9", "ovs_interfaceid": "93e35c24-f93e-4a63-bffb-845d31c63cde", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74613) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 17:59:19 user nova-compute[74613]: DEBUG nova.network.os_vif_util [None req-3bd8301c-1cf5-43f0-bb0c-a85f66251dcc tempest-VolumesAdminNegativeTest-636556351 tempest-VolumesAdminNegativeTest-636556351-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:96:ed:fa,bridge_name='br-int',has_traffic_filtering=True,id=93e35c24-f93e-4a63-bffb-845d31c63cde,network=Network(485e1e0d-aa2c-47c2-a010-c84e83dbcc9c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap93e35c24-f9') {{(pid=74613) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 17:59:19 user nova-compute[74613]: DEBUG os_vif [None req-3bd8301c-1cf5-43f0-bb0c-a85f66251dcc tempest-VolumesAdminNegativeTest-636556351 tempest-VolumesAdminNegativeTest-636556351-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:96:ed:fa,bridge_name='br-int',has_traffic_filtering=True,id=93e35c24-f93e-4a63-bffb-845d31c63cde,network=Network(485e1e0d-aa2c-47c2-a010-c84e83dbcc9c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap93e35c24-f9') {{(pid=74613) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 29 17:59:19 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:59:19 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74613) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 17:59:19 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74613) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 29 17:59:19 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:59:19 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '4b77d365-a540-572f-bfca-c295d6aae8a9', '_type': 'linux-noop'}}, row=False) {{(pid=74613) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 17:59:19 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fce4b456-c108-439f-b0ff-7619aaf77e69/disk --force-share --output=json" returned: 0 in 0.213s {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 17:59:19 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 17:59:19 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f9be53df-54e6-4f59-9cef-0ba7434f0c29/disk --force-share --output=json {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 17:59:19 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:59:19 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:59:19 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap93e35c24-f9, may_exist=True, interface_attrs={}) {{(pid=74613) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 17:59:19 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap93e35c24-f9, col_values=(('qos', UUID('5e277923-1b3b-467a-ac56-1ea8caed00f6')),), if_exists=True) {{(pid=74613) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 17:59:19 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap93e35c24-f9, col_values=(('external_ids', {'iface-id': '93e35c24-f93e-4a63-bffb-845d31c63cde', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:96:ed:fa', 'vm-uuid': '481055d5-0f19-4637-9b00-869967ea7889'}),), if_exists=True) {{(pid=74613) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 17:59:19 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:59:19 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 17:59:19 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:59:19 user nova-compute[74613]: INFO os_vif [None req-3bd8301c-1cf5-43f0-bb0c-a85f66251dcc tempest-VolumesAdminNegativeTest-636556351 tempest-VolumesAdminNegativeTest-636556351-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:96:ed:fa,bridge_name='br-int',has_traffic_filtering=True,id=93e35c24-f93e-4a63-bffb-845d31c63cde,network=Network(485e1e0d-aa2c-47c2-a010-c84e83dbcc9c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap93e35c24-f9')
Nov 29 17:59:19 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-3bd8301c-1cf5-43f0-bb0c-a85f66251dcc tempest-VolumesAdminNegativeTest-636556351 tempest-VolumesAdminNegativeTest-636556351-project-member] No BDM found with device name vda, not building metadata. {{(pid=74613) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 17:59:19 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-3bd8301c-1cf5-43f0-bb0c-a85f66251dcc tempest-VolumesAdminNegativeTest-636556351 tempest-VolumesAdminNegativeTest-636556351-project-member] No VIF found with MAC fa:16:3e:96:ed:fa, not building metadata {{(pid=74613) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 29 17:59:19 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f9be53df-54e6-4f59-9cef-0ba7434f0c29/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 17:59:19 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f9be53df-54e6-4f59-9cef-0ba7434f0c29/disk --force-share --output=json {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 17:59:19 user nova-compute[74613]: DEBUG nova.network.neutron [req-9c2902bd-b35f-4f91-be90-acc158cdb750 req-92200f3d-caec-42f2-9650-80f22eca6353 service nova] [instance: 481055d5-0f19-4637-9b00-869967ea7889] Updated VIF entry in instance network info cache for port 93e35c24-f93e-4a63-bffb-845d31c63cde. {{(pid=74613) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 17:59:19 user nova-compute[74613]: DEBUG nova.network.neutron [req-9c2902bd-b35f-4f91-be90-acc158cdb750 req-92200f3d-caec-42f2-9650-80f22eca6353 service nova] [instance: 481055d5-0f19-4637-9b00-869967ea7889] Updating instance_info_cache with network_info: [{"id": "93e35c24-f93e-4a63-bffb-845d31c63cde", "address": "fa:16:3e:96:ed:fa", "network": {"id": "485e1e0d-aa2c-47c2-a010-c84e83dbcc9c", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-686908926-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3832a80aaabc42ba8400823aa6b76c29", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap93e35c24-f9", "ovs_interfaceid": "93e35c24-f93e-4a63-bffb-845d31c63cde", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74613) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 17:59:19 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-9c2902bd-b35f-4f91-be90-acc158cdb750 req-92200f3d-caec-42f2-9650-80f22eca6353 service nova] Releasing lock "refresh_cache-481055d5-0f19-4637-9b00-869967ea7889" {{(pid=74613) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 17:59:20 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f9be53df-54e6-4f59-9cef-0ba7434f0c29/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 17:59:20 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/71f2a1ab-3df7-411c-93fa-b0a1a5a44f0a/disk --force-share --output=json {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 17:59:20 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:59:20 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/71f2a1ab-3df7-411c-93fa-b0a1a5a44f0a/disk --force-share --output=json" returned: 0 in 0.206s {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 17:59:20 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/71f2a1ab-3df7-411c-93fa-b0a1a5a44f0a/disk --force-share --output=json {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 17:59:20 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/71f2a1ab-3df7-411c-93fa-b0a1a5a44f0a/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 17:59:20 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=74613) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 29 17:59:20 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3b828860-5cc5-40b0-b845-8e560211794e/disk --force-share --output=json {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 17:59:20 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3b828860-5cc5-40b0-b845-8e560211794e/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 17:59:20 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3b828860-5cc5-40b0-b845-8e560211794e/disk --force-share --output=json {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 17:59:20 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3b828860-5cc5-40b0-b845-8e560211794e/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 17:59:20 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/abc9e2b8-f467-4cd0-b40f-de511fde1ec1/disk --force-share --output=json {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 17:59:21 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:59:21 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/abc9e2b8-f467-4cd0-b40f-de511fde1ec1/disk --force-share --output=json" returned: 0 in 0.261s {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 17:59:21 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/abc9e2b8-f467-4cd0-b40f-de511fde1ec1/disk --force-share --output=json {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 17:59:21 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:59:21 user nova-compute[74613]: DEBUG nova.compute.manager [req-ec2eb919-d378-4b5a-aceb-8771e26b7fde req-8797518f-27e2-460b-a436-f4f2a3413668 service nova] [instance: 481055d5-0f19-4637-9b00-869967ea7889] Received event network-vif-plugged-93e35c24-f93e-4a63-bffb-845d31c63cde {{(pid=74613) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 17:59:21 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-ec2eb919-d378-4b5a-aceb-8771e26b7fde req-8797518f-27e2-460b-a436-f4f2a3413668 service nova] Acquiring lock "481055d5-0f19-4637-9b00-869967ea7889-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 17:59:21 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-ec2eb919-d378-4b5a-aceb-8771e26b7fde req-8797518f-27e2-460b-a436-f4f2a3413668 service nova] Lock "481055d5-0f19-4637-9b00-869967ea7889-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 17:59:21 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-ec2eb919-d378-4b5a-aceb-8771e26b7fde req-8797518f-27e2-460b-a436-f4f2a3413668 service nova] Lock "481055d5-0f19-4637-9b00-869967ea7889-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 17:59:21 user nova-compute[74613]: DEBUG nova.compute.manager [req-ec2eb919-d378-4b5a-aceb-8771e26b7fde req-8797518f-27e2-460b-a436-f4f2a3413668 service nova] [instance: 481055d5-0f19-4637-9b00-869967ea7889] No waiting events found dispatching network-vif-plugged-93e35c24-f93e-4a63-bffb-845d31c63cde {{(pid=74613) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 17:59:21 user nova-compute[74613]: WARNING nova.compute.manager [req-ec2eb919-d378-4b5a-aceb-8771e26b7fde req-8797518f-27e2-460b-a436-f4f2a3413668 service nova] [instance: 481055d5-0f19-4637-9b00-869967ea7889] Received unexpected event network-vif-plugged-93e35c24-f93e-4a63-bffb-845d31c63cde for instance with vm_state building and task_state spawning.
Nov 29 17:59:21 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/abc9e2b8-f467-4cd0-b40f-de511fde1ec1/disk --force-share --output=json" returned: 0 in 0.222s {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 17:59:21 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0aa463c6-01e7-48e5-b082-e083558342e3/disk --force-share --output=json {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 17:59:21 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:59:21 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0aa463c6-01e7-48e5-b082-e083558342e3/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 17:59:21 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0aa463c6-01e7-48e5-b082-e083558342e3/disk --force-share --output=json {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 17:59:21 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0aa463c6-01e7-48e5-b082-e083558342e3/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 17:59:21 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74613) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 29 17:59:21 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/356478b0-e233-46aa-a1bd-45ce1f9eca8f/disk --force-share --output=json {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 17:59:21 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/356478b0-e233-46aa-a1bd-45ce1f9eca8f/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 17:59:21 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/356478b0-e233-46aa-a1bd-45ce1f9eca8f/disk --force-share --output=json {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 17:59:22 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/356478b0-e233-46aa-a1bd-45ce1f9eca8f/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 17:59:22 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] skipping disk /dev/sde (vdb) as it is a volume {{(pid=74613) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 29 17:59:22 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/74ac9703-1cd7-4983-b7d4-c69b01fec7b2/disk --force-share --output=json {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 17:59:22 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/74ac9703-1cd7-4983-b7d4-c69b01fec7b2/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 17:59:22 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/74ac9703-1cd7-4983-b7d4-c69b01fec7b2/disk --force-share --output=json {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 17:59:22 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/74ac9703-1cd7-4983-b7d4-c69b01fec7b2/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 17:59:22 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=74613) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 29 17:59:22 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-8ef6e5c3-bbf9-4cdd-9ffe-c1e7e3236ca9 tempest-TestServerVolumeAttachScenarioOldVersion-673194571 tempest-TestServerVolumeAttachScenarioOldVersion-673194571-project-member] Acquiring lock "5221f9b9-e4db-406b-ae82-4a7c6522ee64" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 17:59:22 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-8ef6e5c3-bbf9-4cdd-9ffe-c1e7e3236ca9 tempest-TestServerVolumeAttachScenarioOldVersion-673194571 tempest-TestServerVolumeAttachScenarioOldVersion-673194571-project-member] Lock "5221f9b9-e4db-406b-ae82-4a7c6522ee64" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 17:59:23 user nova-compute[74613]: DEBUG nova.compute.manager [None req-3bd8301c-1cf5-43f0-bb0c-a85f66251dcc tempest-VolumesAdminNegativeTest-636556351 tempest-VolumesAdminNegativeTest-636556351-project-member] [instance: 481055d5-0f19-4637-9b00-869967ea7889] Instance event wait completed in 0 seconds for  {{(pid=74613) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 29 17:59:23 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-3bd8301c-1cf5-43f0-bb0c-a85f66251dcc tempest-VolumesAdminNegativeTest-636556351 tempest-VolumesAdminNegativeTest-636556351-project-member] [instance: 481055d5-0f19-4637-9b00-869967ea7889] Guest created on hypervisor {{(pid=74613) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 29 17:59:23 user nova-compute[74613]: DEBUG nova.compute.manager [req-26ad617a-0401-409d-b359-99192bc3e544 req-e19d4032-9ab9-4231-98dc-6c2ccc200194 service nova] [instance: 481055d5-0f19-4637-9b00-869967ea7889] Received event network-vif-plugged-93e35c24-f93e-4a63-bffb-845d31c63cde {{(pid=74613) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 17:59:23 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-26ad617a-0401-409d-b359-99192bc3e544 req-e19d4032-9ab9-4231-98dc-6c2ccc200194 service nova] Acquiring lock "481055d5-0f19-4637-9b00-869967ea7889-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 17:59:23 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-26ad617a-0401-409d-b359-99192bc3e544 req-e19d4032-9ab9-4231-98dc-6c2ccc200194 service nova] Lock "481055d5-0f19-4637-9b00-869967ea7889-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 17:59:23 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-26ad617a-0401-409d-b359-99192bc3e544 req-e19d4032-9ab9-4231-98dc-6c2ccc200194 service nova] Lock "481055d5-0f19-4637-9b00-869967ea7889-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 17:59:23 user nova-compute[74613]: DEBUG nova.compute.manager [req-26ad617a-0401-409d-b359-99192bc3e544 req-e19d4032-9ab9-4231-98dc-6c2ccc200194 service nova] [instance: 481055d5-0f19-4637-9b00-869967ea7889] No waiting events found dispatching network-vif-plugged-93e35c24-f93e-4a63-bffb-845d31c63cde {{(pid=74613) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 17:59:23 user nova-compute[74613]: WARNING nova.compute.manager [req-26ad617a-0401-409d-b359-99192bc3e544 req-e19d4032-9ab9-4231-98dc-6c2ccc200194 service nova] [instance: 481055d5-0f19-4637-9b00-869967ea7889] Received unexpected event network-vif-plugged-93e35c24-f93e-4a63-bffb-845d31c63cde for instance with vm_state building and task_state spawning.
Nov 29 17:59:23 user nova-compute[74613]: DEBUG nova.compute.manager [None req-8ef6e5c3-bbf9-4cdd-9ffe-c1e7e3236ca9 tempest-TestServerVolumeAttachScenarioOldVersion-673194571 tempest-TestServerVolumeAttachScenarioOldVersion-673194571-project-member] [instance: 5221f9b9-e4db-406b-ae82-4a7c6522ee64] Starting instance... {{(pid=74613) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 29 17:59:23 user nova-compute[74613]: INFO nova.virt.libvirt.driver [-] [instance: 481055d5-0f19-4637-9b00-869967ea7889] Instance spawned successfully.
Nov 29 17:59:23 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-3bd8301c-1cf5-43f0-bb0c-a85f66251dcc tempest-VolumesAdminNegativeTest-636556351 tempest-VolumesAdminNegativeTest-636556351-project-member] [instance: 481055d5-0f19-4637-9b00-869967ea7889] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74613) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 29 17:59:23 user nova-compute[74613]: WARNING nova.virt.libvirt.driver [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 17:59:23 user nova-compute[74613]: WARNING nova.virt.libvirt.driver [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 17:59:23 user nova-compute[74613]: DEBUG nova.compute.resource_tracker [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Hypervisor/Node resource view: name=user free_ram=7611MB free_disk=24.963623046875GB free_vcpus=2 pci_devices=[{"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74613) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 29 17:59:23 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 17:59:23 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 17:59:23 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-3bd8301c-1cf5-43f0-bb0c-a85f66251dcc tempest-VolumesAdminNegativeTest-636556351 tempest-VolumesAdminNegativeTest-636556351-project-member] [instance: 481055d5-0f19-4637-9b00-869967ea7889] Found default for hw_cdrom_bus of ide {{(pid=74613) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 17:59:23 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-3bd8301c-1cf5-43f0-bb0c-a85f66251dcc tempest-VolumesAdminNegativeTest-636556351 tempest-VolumesAdminNegativeTest-636556351-project-member] [instance: 481055d5-0f19-4637-9b00-869967ea7889] Found default for hw_disk_bus of virtio {{(pid=74613) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 17:59:23 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-3bd8301c-1cf5-43f0-bb0c-a85f66251dcc tempest-VolumesAdminNegativeTest-636556351 tempest-VolumesAdminNegativeTest-636556351-project-member] [instance: 481055d5-0f19-4637-9b00-869967ea7889] Found default for hw_input_bus of None {{(pid=74613) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 17:59:23 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-3bd8301c-1cf5-43f0-bb0c-a85f66251dcc tempest-VolumesAdminNegativeTest-636556351 tempest-VolumesAdminNegativeTest-636556351-project-member] [instance: 481055d5-0f19-4637-9b00-869967ea7889] Found default for hw_pointer_model of None {{(pid=74613) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 17:59:23 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-3bd8301c-1cf5-43f0-bb0c-a85f66251dcc tempest-VolumesAdminNegativeTest-636556351 tempest-VolumesAdminNegativeTest-636556351-project-member] [instance: 481055d5-0f19-4637-9b00-869967ea7889] Found default for hw_video_model of virtio {{(pid=74613) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 17:59:23 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-3bd8301c-1cf5-43f0-bb0c-a85f66251dcc tempest-VolumesAdminNegativeTest-636556351 tempest-VolumesAdminNegativeTest-636556351-project-member] [instance: 481055d5-0f19-4637-9b00-869967ea7889] Found default for hw_vif_model of virtio {{(pid=74613) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 17:59:23 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-8ef6e5c3-bbf9-4cdd-9ffe-c1e7e3236ca9 tempest-TestServerVolumeAttachScenarioOldVersion-673194571 tempest-TestServerVolumeAttachScenarioOldVersion-673194571-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 17:59:23 user nova-compute[74613]: INFO nova.compute.manager [None req-3bd8301c-1cf5-43f0-bb0c-a85f66251dcc tempest-VolumesAdminNegativeTest-636556351 tempest-VolumesAdminNegativeTest-636556351-project-member] [instance: 481055d5-0f19-4637-9b00-869967ea7889] Took 5.99 seconds to spawn the instance on the hypervisor.
Nov 29 17:59:23 user nova-compute[74613]: DEBUG nova.compute.manager [None req-3bd8301c-1cf5-43f0-bb0c-a85f66251dcc tempest-VolumesAdminNegativeTest-636556351 tempest-VolumesAdminNegativeTest-636556351-project-member] [instance: 481055d5-0f19-4637-9b00-869967ea7889] Checking state {{(pid=74613) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 29 17:59:23 user nova-compute[74613]: DEBUG nova.compute.resource_tracker [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Applying migration context for instance 74ac9703-1cd7-4983-b7d4-c69b01fec7b2 as it has an incoming, in-progress migration 8810a11f-ec67-4d25-b99d-d74f186c3a86. Migration status is finished {{(pid=74613) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1016}}
Nov 29 17:59:23 user nova-compute[74613]: INFO nova.compute.resource_tracker [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] [instance: 74ac9703-1cd7-4983-b7d4-c69b01fec7b2] Updating resource usage from migration 8810a11f-ec67-4d25-b99d-d74f186c3a86
Nov 29 17:59:23 user nova-compute[74613]: DEBUG nova.compute.resource_tracker [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Instance 3b828860-5cc5-40b0-b845-8e560211794e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74613) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 17:59:23 user nova-compute[74613]: DEBUG nova.compute.resource_tracker [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Instance abc9e2b8-f467-4cd0-b40f-de511fde1ec1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74613) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 17:59:23 user nova-compute[74613]: DEBUG nova.compute.resource_tracker [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Instance cd22685a-028c-4e0c-834d-e7b20f6d06ab actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74613) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 17:59:23 user nova-compute[74613]: DEBUG nova.compute.resource_tracker [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Instance 71f2a1ab-3df7-411c-93fa-b0a1a5a44f0a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74613) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 17:59:23 user nova-compute[74613]: DEBUG nova.compute.resource_tracker [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Instance c4bdb712-e1f9-4fc0-b527-87088d7eddf8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74613) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 17:59:23 user nova-compute[74613]: DEBUG nova.compute.resource_tracker [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Instance 0aa463c6-01e7-48e5-b082-e083558342e3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74613) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 17:59:23 user nova-compute[74613]: DEBUG nova.compute.resource_tracker [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Instance 356478b0-e233-46aa-a1bd-45ce1f9eca8f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74613) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 17:59:23 user nova-compute[74613]: DEBUG nova.compute.resource_tracker [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Instance fce4b456-c108-439f-b0ff-7619aaf77e69 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74613) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 17:59:23 user nova-compute[74613]: DEBUG nova.compute.resource_tracker [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Migration 8810a11f-ec67-4d25-b99d-d74f186c3a86 is active on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74613) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1709}}
Nov 29 17:59:23 user nova-compute[74613]: DEBUG nova.compute.resource_tracker [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Instance 74ac9703-1cd7-4983-b7d4-c69b01fec7b2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 20, 'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=74613) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 17:59:23 user nova-compute[74613]: DEBUG nova.compute.resource_tracker [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Instance f9be53df-54e6-4f59-9cef-0ba7434f0c29 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74613) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 17:59:23 user nova-compute[74613]: DEBUG nova.compute.resource_tracker [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Instance 481055d5-0f19-4637-9b00-869967ea7889 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74613) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 17:59:23 user nova-compute[74613]: DEBUG nova.compute.resource_tracker [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Instance 5221f9b9-e4db-406b-ae82-4a7c6522ee64 has been scheduled to this compute host, the scheduler has made an allocation against this compute node but the instance has yet to start. Skipping heal of allocation: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74613) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1761}}
Nov 29 17:59:23 user nova-compute[74613]: DEBUG nova.compute.resource_tracker [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Total usable vcpus: 12, total allocated vcpus: 12 {{(pid=74613) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 29 17:59:23 user nova-compute[74613]: DEBUG nova.compute.resource_tracker [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Final resource view: name=user phys_ram=16011MB used_ram=8192MB phys_disk=40GB used_disk=30GB total_vcpus=12 used_vcpus=12 pci_stats=[] {{(pid=74613) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 29 17:59:23 user nova-compute[74613]: INFO nova.compute.manager [None req-3bd8301c-1cf5-43f0-bb0c-a85f66251dcc tempest-VolumesAdminNegativeTest-636556351 tempest-VolumesAdminNegativeTest-636556351-project-member] [instance: 481055d5-0f19-4637-9b00-869967ea7889] Took 6.92 seconds to build instance.
Nov 29 17:59:23 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-3bd8301c-1cf5-43f0-bb0c-a85f66251dcc tempest-VolumesAdminNegativeTest-636556351 tempest-VolumesAdminNegativeTest-636556351-project-member] Lock "481055d5-0f19-4637-9b00-869967ea7889" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.018s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 17:59:24 user nova-compute[74613]: DEBUG nova.compute.provider_tree [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Inventory has not changed in ProviderTree for provider: 639d980e-3b12-44b1-b8f4-1812416fa4dd {{(pid=74613) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 17:59:24 user nova-compute[74613]: DEBUG nova.scheduler.client.report [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Inventory has not changed for provider 639d980e-3b12-44b1-b8f4-1812416fa4dd based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74613) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 17:59:24 user nova-compute[74613]: DEBUG nova.compute.resource_tracker [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Compute_service record updated for user:user {{(pid=74613) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 29 17:59:24 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.587s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 17:59:24 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-8ef6e5c3-bbf9-4cdd-9ffe-c1e7e3236ca9 tempest-TestServerVolumeAttachScenarioOldVersion-673194571 tempest-TestServerVolumeAttachScenarioOldVersion-673194571-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.503s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 17:59:24 user nova-compute[74613]: DEBUG nova.virt.hardware [None req-8ef6e5c3-bbf9-4cdd-9ffe-c1e7e3236ca9 tempest-TestServerVolumeAttachScenarioOldVersion-673194571 tempest-TestServerVolumeAttachScenarioOldVersion-673194571-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74613) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 29 17:59:24 user nova-compute[74613]: INFO nova.compute.claims [None req-8ef6e5c3-bbf9-4cdd-9ffe-c1e7e3236ca9 tempest-TestServerVolumeAttachScenarioOldVersion-673194571 tempest-TestServerVolumeAttachScenarioOldVersion-673194571-project-member] [instance: 5221f9b9-e4db-406b-ae82-4a7c6522ee64] Claim successful on node user
Nov 29 17:59:24 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:59:24 user nova-compute[74613]: DEBUG nova.compute.provider_tree [None req-8ef6e5c3-bbf9-4cdd-9ffe-c1e7e3236ca9 tempest-TestServerVolumeAttachScenarioOldVersion-673194571 tempest-TestServerVolumeAttachScenarioOldVersion-673194571-project-member] Inventory has not changed in ProviderTree for provider: 639d980e-3b12-44b1-b8f4-1812416fa4dd {{(pid=74613) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 17:59:24 user nova-compute[74613]: DEBUG nova.scheduler.client.report [None req-8ef6e5c3-bbf9-4cdd-9ffe-c1e7e3236ca9 tempest-TestServerVolumeAttachScenarioOldVersion-673194571 tempest-TestServerVolumeAttachScenarioOldVersion-673194571-project-member] Inventory has not changed for provider 639d980e-3b12-44b1-b8f4-1812416fa4dd based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74613) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 17:59:24 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-8ef6e5c3-bbf9-4cdd-9ffe-c1e7e3236ca9 tempest-TestServerVolumeAttachScenarioOldVersion-673194571 tempest-TestServerVolumeAttachScenarioOldVersion-673194571-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.549s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 17:59:24 user nova-compute[74613]: DEBUG nova.compute.manager [None req-8ef6e5c3-bbf9-4cdd-9ffe-c1e7e3236ca9 tempest-TestServerVolumeAttachScenarioOldVersion-673194571 tempest-TestServerVolumeAttachScenarioOldVersion-673194571-project-member] [instance: 5221f9b9-e4db-406b-ae82-4a7c6522ee64] Start building networks asynchronously for instance. {{(pid=74613) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 29 17:59:24 user nova-compute[74613]: DEBUG nova.compute.manager [None req-8ef6e5c3-bbf9-4cdd-9ffe-c1e7e3236ca9 tempest-TestServerVolumeAttachScenarioOldVersion-673194571 tempest-TestServerVolumeAttachScenarioOldVersion-673194571-project-member] [instance: 5221f9b9-e4db-406b-ae82-4a7c6522ee64] Allocating IP information in the background. {{(pid=74613) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 29 17:59:24 user nova-compute[74613]: DEBUG nova.network.neutron [None req-8ef6e5c3-bbf9-4cdd-9ffe-c1e7e3236ca9 tempest-TestServerVolumeAttachScenarioOldVersion-673194571 tempest-TestServerVolumeAttachScenarioOldVersion-673194571-project-member] [instance: 5221f9b9-e4db-406b-ae82-4a7c6522ee64] allocate_for_instance() {{(pid=74613) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 29 17:59:24 user nova-compute[74613]: INFO nova.virt.libvirt.driver [None req-8ef6e5c3-bbf9-4cdd-9ffe-c1e7e3236ca9 tempest-TestServerVolumeAttachScenarioOldVersion-673194571 tempest-TestServerVolumeAttachScenarioOldVersion-673194571-project-member] [instance: 5221f9b9-e4db-406b-ae82-4a7c6522ee64] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 29 17:59:24 user nova-compute[74613]: DEBUG nova.compute.manager [None req-8ef6e5c3-bbf9-4cdd-9ffe-c1e7e3236ca9 tempest-TestServerVolumeAttachScenarioOldVersion-673194571 tempest-TestServerVolumeAttachScenarioOldVersion-673194571-project-member] [instance: 5221f9b9-e4db-406b-ae82-4a7c6522ee64] Start building block device mappings for instance. {{(pid=74613) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 29 17:59:25 user nova-compute[74613]: DEBUG nova.policy [None req-8ef6e5c3-bbf9-4cdd-9ffe-c1e7e3236ca9 tempest-TestServerVolumeAttachScenarioOldVersion-673194571 tempest-TestServerVolumeAttachScenarioOldVersion-673194571-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '811b6a61f2d2428c8c179ba4bf3b5fa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0634597a325d46c18743626c2334e455', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74613) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 29 17:59:25 user nova-compute[74613]: DEBUG nova.compute.manager [None req-8ef6e5c3-bbf9-4cdd-9ffe-c1e7e3236ca9 tempest-TestServerVolumeAttachScenarioOldVersion-673194571 tempest-TestServerVolumeAttachScenarioOldVersion-673194571-project-member] [instance: 5221f9b9-e4db-406b-ae82-4a7c6522ee64] Start spawning the instance on the hypervisor. {{(pid=74613) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 29 17:59:25 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-8ef6e5c3-bbf9-4cdd-9ffe-c1e7e3236ca9 tempest-TestServerVolumeAttachScenarioOldVersion-673194571 tempest-TestServerVolumeAttachScenarioOldVersion-673194571-project-member] [instance: 5221f9b9-e4db-406b-ae82-4a7c6522ee64] Creating instance directory {{(pid=74613) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 29 17:59:25 user nova-compute[74613]: INFO nova.virt.libvirt.driver [None req-8ef6e5c3-bbf9-4cdd-9ffe-c1e7e3236ca9 tempest-TestServerVolumeAttachScenarioOldVersion-673194571 tempest-TestServerVolumeAttachScenarioOldVersion-673194571-project-member] [instance: 5221f9b9-e4db-406b-ae82-4a7c6522ee64] Creating image(s)
Nov 29 17:59:25 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-8ef6e5c3-bbf9-4cdd-9ffe-c1e7e3236ca9 tempest-TestServerVolumeAttachScenarioOldVersion-673194571 tempest-TestServerVolumeAttachScenarioOldVersion-673194571-project-member] Acquiring lock "/opt/stack/data/nova/instances/5221f9b9-e4db-406b-ae82-4a7c6522ee64/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 17:59:25 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-8ef6e5c3-bbf9-4cdd-9ffe-c1e7e3236ca9 tempest-TestServerVolumeAttachScenarioOldVersion-673194571 tempest-TestServerVolumeAttachScenarioOldVersion-673194571-project-member] Lock "/opt/stack/data/nova/instances/5221f9b9-e4db-406b-ae82-4a7c6522ee64/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 17:59:25 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-8ef6e5c3-bbf9-4cdd-9ffe-c1e7e3236ca9 tempest-TestServerVolumeAttachScenarioOldVersion-673194571 tempest-TestServerVolumeAttachScenarioOldVersion-673194571-project-member] Lock "/opt/stack/data/nova/instances/5221f9b9-e4db-406b-ae82-4a7c6522ee64/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 17:59:25 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-8ef6e5c3-bbf9-4cdd-9ffe-c1e7e3236ca9 tempest-TestServerVolumeAttachScenarioOldVersion-673194571 tempest-TestServerVolumeAttachScenarioOldVersion-673194571-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/21faea9e6951f3bdd0153b76ac89fe1a60a34758 --force-share --output=json {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 17:59:25 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:59:25 user nova-compute[74613]: DEBUG oslo_service.periodic_task [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74613) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 17:59:25 user nova-compute[74613]: DEBUG oslo_service.periodic_task [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74613) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 17:59:25 user nova-compute[74613]: DEBUG oslo_service.periodic_task [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74613) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 17:59:25 user nova-compute[74613]: DEBUG nova.compute.manager [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Starting heal instance info cache {{(pid=74613) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 29 17:59:25 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-8ef6e5c3-bbf9-4cdd-9ffe-c1e7e3236ca9 tempest-TestServerVolumeAttachScenarioOldVersion-673194571 tempest-TestServerVolumeAttachScenarioOldVersion-673194571-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/21faea9e6951f3bdd0153b76ac89fe1a60a34758 --force-share --output=json" returned: 0 in 0.185s {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 17:59:25 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-8ef6e5c3-bbf9-4cdd-9ffe-c1e7e3236ca9 tempest-TestServerVolumeAttachScenarioOldVersion-673194571 tempest-TestServerVolumeAttachScenarioOldVersion-673194571-project-member] Acquiring lock "21faea9e6951f3bdd0153b76ac89fe1a60a34758" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 17:59:25 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-8ef6e5c3-bbf9-4cdd-9ffe-c1e7e3236ca9 tempest-TestServerVolumeAttachScenarioOldVersion-673194571 tempest-TestServerVolumeAttachScenarioOldVersion-673194571-project-member] Lock "21faea9e6951f3bdd0153b76ac89fe1a60a34758" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 17:59:25 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-8ef6e5c3-bbf9-4cdd-9ffe-c1e7e3236ca9 tempest-TestServerVolumeAttachScenarioOldVersion-673194571 tempest-TestServerVolumeAttachScenarioOldVersion-673194571-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/21faea9e6951f3bdd0153b76ac89fe1a60a34758 --force-share --output=json {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 17:59:25 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Acquiring lock "refresh_cache-abc9e2b8-f467-4cd0-b40f-de511fde1ec1" {{(pid=74613) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 17:59:25 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Acquired lock "refresh_cache-abc9e2b8-f467-4cd0-b40f-de511fde1ec1" {{(pid=74613) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 17:59:25 user nova-compute[74613]: DEBUG nova.network.neutron [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] [instance: abc9e2b8-f467-4cd0-b40f-de511fde1ec1] Forcefully refreshing network info cache for instance {{(pid=74613) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 29 17:59:25 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-8ef6e5c3-bbf9-4cdd-9ffe-c1e7e3236ca9 tempest-TestServerVolumeAttachScenarioOldVersion-673194571 tempest-TestServerVolumeAttachScenarioOldVersion-673194571-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/21faea9e6951f3bdd0153b76ac89fe1a60a34758 --force-share --output=json" returned: 0 in 0.221s {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 17:59:25 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-8ef6e5c3-bbf9-4cdd-9ffe-c1e7e3236ca9 tempest-TestServerVolumeAttachScenarioOldVersion-673194571 tempest-TestServerVolumeAttachScenarioOldVersion-673194571-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/21faea9e6951f3bdd0153b76ac89fe1a60a34758,backing_fmt=raw /opt/stack/data/nova/instances/5221f9b9-e4db-406b-ae82-4a7c6522ee64/disk 1073741824 {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 17:59:25 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-8ef6e5c3-bbf9-4cdd-9ffe-c1e7e3236ca9 tempest-TestServerVolumeAttachScenarioOldVersion-673194571 tempest-TestServerVolumeAttachScenarioOldVersion-673194571-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/21faea9e6951f3bdd0153b76ac89fe1a60a34758,backing_fmt=raw /opt/stack/data/nova/instances/5221f9b9-e4db-406b-ae82-4a7c6522ee64/disk 1073741824" returned: 0 in 0.050s {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 17:59:25 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-8ef6e5c3-bbf9-4cdd-9ffe-c1e7e3236ca9 tempest-TestServerVolumeAttachScenarioOldVersion-673194571 tempest-TestServerVolumeAttachScenarioOldVersion-673194571-project-member] Lock "21faea9e6951f3bdd0153b76ac89fe1a60a34758" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.283s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 17:59:25 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-8ef6e5c3-bbf9-4cdd-9ffe-c1e7e3236ca9 tempest-TestServerVolumeAttachScenarioOldVersion-673194571 tempest-TestServerVolumeAttachScenarioOldVersion-673194571-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/21faea9e6951f3bdd0153b76ac89fe1a60a34758 --force-share --output=json {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 17:59:25 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-8ef6e5c3-bbf9-4cdd-9ffe-c1e7e3236ca9 tempest-TestServerVolumeAttachScenarioOldVersion-673194571 tempest-TestServerVolumeAttachScenarioOldVersion-673194571-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/21faea9e6951f3bdd0153b76ac89fe1a60a34758 --force-share --output=json" returned: 0 in 0.183s {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 17:59:25 user nova-compute[74613]: DEBUG nova.virt.disk.api [None req-8ef6e5c3-bbf9-4cdd-9ffe-c1e7e3236ca9 tempest-TestServerVolumeAttachScenarioOldVersion-673194571 tempest-TestServerVolumeAttachScenarioOldVersion-673194571-project-member] Checking if we can resize image /opt/stack/data/nova/instances/5221f9b9-e4db-406b-ae82-4a7c6522ee64/disk. size=1073741824 {{(pid=74613) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 29 17:59:25 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-8ef6e5c3-bbf9-4cdd-9ffe-c1e7e3236ca9 tempest-TestServerVolumeAttachScenarioOldVersion-673194571 tempest-TestServerVolumeAttachScenarioOldVersion-673194571-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5221f9b9-e4db-406b-ae82-4a7c6522ee64/disk --force-share --output=json {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 17:59:25 user nova-compute[74613]: DEBUG nova.network.neutron [None req-8ef6e5c3-bbf9-4cdd-9ffe-c1e7e3236ca9 tempest-TestServerVolumeAttachScenarioOldVersion-673194571 tempest-TestServerVolumeAttachScenarioOldVersion-673194571-project-member] [instance: 5221f9b9-e4db-406b-ae82-4a7c6522ee64] Successfully created port: 2b04c4cf-f85a-4089-8f4a-e2a1c4eec1ae {{(pid=74613) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 29 17:59:26 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-8ef6e5c3-bbf9-4cdd-9ffe-c1e7e3236ca9 tempest-TestServerVolumeAttachScenarioOldVersion-673194571 tempest-TestServerVolumeAttachScenarioOldVersion-673194571-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5221f9b9-e4db-406b-ae82-4a7c6522ee64/disk --force-share --output=json" returned: 0 in 0.236s {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 17:59:26 user nova-compute[74613]: DEBUG nova.virt.disk.api [None req-8ef6e5c3-bbf9-4cdd-9ffe-c1e7e3236ca9 tempest-TestServerVolumeAttachScenarioOldVersion-673194571 tempest-TestServerVolumeAttachScenarioOldVersion-673194571-project-member] Cannot resize image /opt/stack/data/nova/instances/5221f9b9-e4db-406b-ae82-4a7c6522ee64/disk to a smaller size. {{(pid=74613) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 29 17:59:26 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-8ef6e5c3-bbf9-4cdd-9ffe-c1e7e3236ca9 tempest-TestServerVolumeAttachScenarioOldVersion-673194571 tempest-TestServerVolumeAttachScenarioOldVersion-673194571-project-member] [instance: 5221f9b9-e4db-406b-ae82-4a7c6522ee64] Created local disks {{(pid=74613) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 29 17:59:26 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-8ef6e5c3-bbf9-4cdd-9ffe-c1e7e3236ca9 tempest-TestServerVolumeAttachScenarioOldVersion-673194571 tempest-TestServerVolumeAttachScenarioOldVersion-673194571-project-member] [instance: 5221f9b9-e4db-406b-ae82-4a7c6522ee64] Ensure instance console log exists: /opt/stack/data/nova/instances/5221f9b9-e4db-406b-ae82-4a7c6522ee64/console.log {{(pid=74613) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 29 17:59:26 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-8ef6e5c3-bbf9-4cdd-9ffe-c1e7e3236ca9 tempest-TestServerVolumeAttachScenarioOldVersion-673194571 tempest-TestServerVolumeAttachScenarioOldVersion-673194571-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 17:59:26 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-8ef6e5c3-bbf9-4cdd-9ffe-c1e7e3236ca9 tempest-TestServerVolumeAttachScenarioOldVersion-673194571 tempest-TestServerVolumeAttachScenarioOldVersion-673194571-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 17:59:26 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-8ef6e5c3-bbf9-4cdd-9ffe-c1e7e3236ca9 tempest-TestServerVolumeAttachScenarioOldVersion-673194571 tempest-TestServerVolumeAttachScenarioOldVersion-673194571-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 17:59:26 user nova-compute[74613]: DEBUG nova.network.neutron [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] [instance: abc9e2b8-f467-4cd0-b40f-de511fde1ec1] Updating instance_info_cache with network_info: [{"id": "59a8bf1b-9fb1-4526-92d5-9ad1897c1ee8", "address": "fa:16:3e:e3:5f:12", "network": {"id": "7c2c368e-4c7d-4d70-9a40-c10fe9541af9", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1287934102-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.103", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b1f70c311d4941c986de21ac458d11ab", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap59a8bf1b-9f", "ovs_interfaceid": "59a8bf1b-9fb1-4526-92d5-9ad1897c1ee8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74613) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 17:59:26 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Releasing lock "refresh_cache-abc9e2b8-f467-4cd0-b40f-de511fde1ec1" {{(pid=74613) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 17:59:26 user nova-compute[74613]: DEBUG nova.compute.manager [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] [instance: abc9e2b8-f467-4cd0-b40f-de511fde1ec1] Updated the network info_cache for instance {{(pid=74613) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 29 17:59:26 user nova-compute[74613]: DEBUG oslo_service.periodic_task [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74613) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 17:59:26 user nova-compute[74613]: DEBUG oslo_service.periodic_task [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74613) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 17:59:26 user nova-compute[74613]: DEBUG oslo_service.periodic_task [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74613) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 17:59:26 user nova-compute[74613]: DEBUG oslo_service.periodic_task [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74613) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 17:59:26 user nova-compute[74613]: DEBUG nova.compute.manager [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74613) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 29 17:59:26 user nova-compute[74613]: DEBUG nova.network.neutron [None req-8ef6e5c3-bbf9-4cdd-9ffe-c1e7e3236ca9 tempest-TestServerVolumeAttachScenarioOldVersion-673194571 tempest-TestServerVolumeAttachScenarioOldVersion-673194571-project-member] [instance: 5221f9b9-e4db-406b-ae82-4a7c6522ee64] Successfully updated port: 2b04c4cf-f85a-4089-8f4a-e2a1c4eec1ae {{(pid=74613) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 29 17:59:26 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-8ef6e5c3-bbf9-4cdd-9ffe-c1e7e3236ca9 tempest-TestServerVolumeAttachScenarioOldVersion-673194571 tempest-TestServerVolumeAttachScenarioOldVersion-673194571-project-member] Acquiring lock "refresh_cache-5221f9b9-e4db-406b-ae82-4a7c6522ee64" {{(pid=74613) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 17:59:26 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-8ef6e5c3-bbf9-4cdd-9ffe-c1e7e3236ca9 tempest-TestServerVolumeAttachScenarioOldVersion-673194571 tempest-TestServerVolumeAttachScenarioOldVersion-673194571-project-member] Acquired lock "refresh_cache-5221f9b9-e4db-406b-ae82-4a7c6522ee64" {{(pid=74613) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 17:59:26 user nova-compute[74613]: DEBUG nova.network.neutron [None req-8ef6e5c3-bbf9-4cdd-9ffe-c1e7e3236ca9 tempest-TestServerVolumeAttachScenarioOldVersion-673194571 tempest-TestServerVolumeAttachScenarioOldVersion-673194571-project-member] [instance: 5221f9b9-e4db-406b-ae82-4a7c6522ee64] Building network info cache for instance {{(pid=74613) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 29 17:59:26 user nova-compute[74613]: DEBUG nova.compute.manager [req-544416a4-6329-45a0-9036-53fc59037a53 req-c15ea046-e85f-4b00-a572-f4b793dc50ee service nova] [instance: 5221f9b9-e4db-406b-ae82-4a7c6522ee64] Received event network-changed-2b04c4cf-f85a-4089-8f4a-e2a1c4eec1ae {{(pid=74613) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 17:59:26 user nova-compute[74613]: DEBUG nova.compute.manager [req-544416a4-6329-45a0-9036-53fc59037a53 req-c15ea046-e85f-4b00-a572-f4b793dc50ee service nova] [instance: 5221f9b9-e4db-406b-ae82-4a7c6522ee64] Refreshing instance network info cache due to event network-changed-2b04c4cf-f85a-4089-8f4a-e2a1c4eec1ae. {{(pid=74613) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 17:59:26 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-544416a4-6329-45a0-9036-53fc59037a53 req-c15ea046-e85f-4b00-a572-f4b793dc50ee service nova] Acquiring lock "refresh_cache-5221f9b9-e4db-406b-ae82-4a7c6522ee64" {{(pid=74613) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 17:59:26 user nova-compute[74613]: DEBUG nova.network.neutron [None req-8ef6e5c3-bbf9-4cdd-9ffe-c1e7e3236ca9 tempest-TestServerVolumeAttachScenarioOldVersion-673194571 tempest-TestServerVolumeAttachScenarioOldVersion-673194571-project-member] [instance: 5221f9b9-e4db-406b-ae82-4a7c6522ee64] Instance cache missing network info. {{(pid=74613) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 29 17:59:26 user nova-compute[74613]: DEBUG nova.network.neutron [None req-8ef6e5c3-bbf9-4cdd-9ffe-c1e7e3236ca9 tempest-TestServerVolumeAttachScenarioOldVersion-673194571 tempest-TestServerVolumeAttachScenarioOldVersion-673194571-project-member] [instance: 5221f9b9-e4db-406b-ae82-4a7c6522ee64] Updating instance_info_cache with network_info: [{"id": "2b04c4cf-f85a-4089-8f4a-e2a1c4eec1ae", "address": "fa:16:3e:bc:57:f9", "network": {"id": "c8bdb714-50af-4c1d-9e06-9c71a384b633", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-489594897-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0634597a325d46c18743626c2334e455", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2b04c4cf-f8", "ovs_interfaceid": "2b04c4cf-f85a-4089-8f4a-e2a1c4eec1ae", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74613) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 17:59:26 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-8ef6e5c3-bbf9-4cdd-9ffe-c1e7e3236ca9 tempest-TestServerVolumeAttachScenarioOldVersion-673194571 tempest-TestServerVolumeAttachScenarioOldVersion-673194571-project-member] Releasing lock "refresh_cache-5221f9b9-e4db-406b-ae82-4a7c6522ee64" {{(pid=74613) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 17:59:26 user nova-compute[74613]: DEBUG nova.compute.manager [None req-8ef6e5c3-bbf9-4cdd-9ffe-c1e7e3236ca9 tempest-TestServerVolumeAttachScenarioOldVersion-673194571 tempest-TestServerVolumeAttachScenarioOldVersion-673194571-project-member] [instance: 5221f9b9-e4db-406b-ae82-4a7c6522ee64] Instance network_info: |[{"id": "2b04c4cf-f85a-4089-8f4a-e2a1c4eec1ae", "address": "fa:16:3e:bc:57:f9", "network": {"id": "c8bdb714-50af-4c1d-9e06-9c71a384b633", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-489594897-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0634597a325d46c18743626c2334e455", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2b04c4cf-f8", "ovs_interfaceid": "2b04c4cf-f85a-4089-8f4a-e2a1c4eec1ae", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74613) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 29 17:59:26 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-544416a4-6329-45a0-9036-53fc59037a53 req-c15ea046-e85f-4b00-a572-f4b793dc50ee service nova] Acquired lock "refresh_cache-5221f9b9-e4db-406b-ae82-4a7c6522ee64" {{(pid=74613) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 17:59:26 user nova-compute[74613]: DEBUG nova.network.neutron [req-544416a4-6329-45a0-9036-53fc59037a53 req-c15ea046-e85f-4b00-a572-f4b793dc50ee service nova] [instance: 5221f9b9-e4db-406b-ae82-4a7c6522ee64] Refreshing network info cache for port 2b04c4cf-f85a-4089-8f4a-e2a1c4eec1ae {{(pid=74613) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 17:59:26 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-8ef6e5c3-bbf9-4cdd-9ffe-c1e7e3236ca9 tempest-TestServerVolumeAttachScenarioOldVersion-673194571 tempest-TestServerVolumeAttachScenarioOldVersion-673194571-project-member] [instance: 5221f9b9-e4db-406b-ae82-4a7c6522ee64] Start _get_guest_xml network_info=[{"id": "2b04c4cf-f85a-4089-8f4a-e2a1c4eec1ae", "address": "fa:16:3e:bc:57:f9", "network": {"id": "c8bdb714-50af-4c1d-9e06-9c71a384b633", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-489594897-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0634597a325d46c18743626c2334e455", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2b04c4cf-f8", "ovs_interfaceid": "2b04c4cf-f85a-4089-8f4a-e2a1c4eec1ae", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-29T17:47:38Z,direct_url=<?>,disk_format='qcow2',id=4217f428-8d9d-4ee1-9614-642d26d90c46,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='794b07cbd46a44b5865cfda741036bae',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-29T17:47:40Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'size': 0, 'device_type': 'disk', 'boot_index': 0, 'guest_format': None, 'encrypted': False, 'encryption_format': None, 'disk_bus': 'virtio', 'image_id': '4217f428-8d9d-4ee1-9614-642d26d90c46'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74613) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 29 17:59:26 user nova-compute[74613]: WARNING nova.virt.libvirt.driver [None req-8ef6e5c3-bbf9-4cdd-9ffe-c1e7e3236ca9 tempest-TestServerVolumeAttachScenarioOldVersion-673194571 tempest-TestServerVolumeAttachScenarioOldVersion-673194571-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 17:59:26 user nova-compute[74613]: WARNING nova.virt.libvirt.driver [None req-8ef6e5c3-bbf9-4cdd-9ffe-c1e7e3236ca9 tempest-TestServerVolumeAttachScenarioOldVersion-673194571 tempest-TestServerVolumeAttachScenarioOldVersion-673194571-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 17:59:26 user nova-compute[74613]: DEBUG nova.virt.libvirt.host [None req-8ef6e5c3-bbf9-4cdd-9ffe-c1e7e3236ca9 tempest-TestServerVolumeAttachScenarioOldVersion-673194571 tempest-TestServerVolumeAttachScenarioOldVersion-673194571-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74613) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 29 17:59:26 user nova-compute[74613]: DEBUG nova.virt.libvirt.host [None req-8ef6e5c3-bbf9-4cdd-9ffe-c1e7e3236ca9 tempest-TestServerVolumeAttachScenarioOldVersion-673194571 tempest-TestServerVolumeAttachScenarioOldVersion-673194571-project-member] CPU controller missing on host. {{(pid=74613) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 29 17:59:26 user nova-compute[74613]: DEBUG nova.virt.libvirt.host [None req-8ef6e5c3-bbf9-4cdd-9ffe-c1e7e3236ca9 tempest-TestServerVolumeAttachScenarioOldVersion-673194571 tempest-TestServerVolumeAttachScenarioOldVersion-673194571-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74613) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 29 17:59:26 user nova-compute[74613]: DEBUG nova.virt.libvirt.host [None req-8ef6e5c3-bbf9-4cdd-9ffe-c1e7e3236ca9 tempest-TestServerVolumeAttachScenarioOldVersion-673194571 tempest-TestServerVolumeAttachScenarioOldVersion-673194571-project-member] CPU controller found on host. {{(pid=74613) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 29 17:59:26 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-8ef6e5c3-bbf9-4cdd-9ffe-c1e7e3236ca9 tempest-TestServerVolumeAttachScenarioOldVersion-673194571 tempest-TestServerVolumeAttachScenarioOldVersion-673194571-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74613) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 29 17:59:26 user nova-compute[74613]: DEBUG nova.virt.hardware [None req-8ef6e5c3-bbf9-4cdd-9ffe-c1e7e3236ca9 tempest-TestServerVolumeAttachScenarioOldVersion-673194571 tempest-TestServerVolumeAttachScenarioOldVersion-673194571-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-29T17:47:27Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-29T17:47:38Z,direct_url=<?>,disk_format='qcow2',id=4217f428-8d9d-4ee1-9614-642d26d90c46,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='794b07cbd46a44b5865cfda741036bae',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-29T17:47:40Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74613) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 29 17:59:26 user nova-compute[74613]: DEBUG nova.virt.hardware [None req-8ef6e5c3-bbf9-4cdd-9ffe-c1e7e3236ca9 tempest-TestServerVolumeAttachScenarioOldVersion-673194571 tempest-TestServerVolumeAttachScenarioOldVersion-673194571-project-member] Flavor limits 0:0:0 {{(pid=74613) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 29 17:59:26 user nova-compute[74613]: DEBUG nova.virt.hardware [None req-8ef6e5c3-bbf9-4cdd-9ffe-c1e7e3236ca9 tempest-TestServerVolumeAttachScenarioOldVersion-673194571 tempest-TestServerVolumeAttachScenarioOldVersion-673194571-project-member] Image limits 0:0:0 {{(pid=74613) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 29 17:59:26 user nova-compute[74613]: DEBUG nova.virt.hardware [None req-8ef6e5c3-bbf9-4cdd-9ffe-c1e7e3236ca9 tempest-TestServerVolumeAttachScenarioOldVersion-673194571 tempest-TestServerVolumeAttachScenarioOldVersion-673194571-project-member] Flavor pref 0:0:0 {{(pid=74613) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 29 17:59:26 user nova-compute[74613]: DEBUG nova.virt.hardware [None req-8ef6e5c3-bbf9-4cdd-9ffe-c1e7e3236ca9 tempest-TestServerVolumeAttachScenarioOldVersion-673194571 tempest-TestServerVolumeAttachScenarioOldVersion-673194571-project-member] Image pref 0:0:0 {{(pid=74613) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 29 17:59:26 user nova-compute[74613]: DEBUG nova.virt.hardware [None req-8ef6e5c3-bbf9-4cdd-9ffe-c1e7e3236ca9 tempest-TestServerVolumeAttachScenarioOldVersion-673194571 tempest-TestServerVolumeAttachScenarioOldVersion-673194571-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74613) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 29 17:59:26 user nova-compute[74613]: DEBUG nova.virt.hardware [None req-8ef6e5c3-bbf9-4cdd-9ffe-c1e7e3236ca9 tempest-TestServerVolumeAttachScenarioOldVersion-673194571 tempest-TestServerVolumeAttachScenarioOldVersion-673194571-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74613) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 29 17:59:26 user nova-compute[74613]: DEBUG nova.virt.hardware [None req-8ef6e5c3-bbf9-4cdd-9ffe-c1e7e3236ca9 tempest-TestServerVolumeAttachScenarioOldVersion-673194571 tempest-TestServerVolumeAttachScenarioOldVersion-673194571-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74613) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 29 17:59:26 user nova-compute[74613]: DEBUG nova.virt.hardware [None req-8ef6e5c3-bbf9-4cdd-9ffe-c1e7e3236ca9 tempest-TestServerVolumeAttachScenarioOldVersion-673194571 tempest-TestServerVolumeAttachScenarioOldVersion-673194571-project-member] Got 1 possible topologies {{(pid=74613) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 29 17:59:26 user nova-compute[74613]: DEBUG nova.virt.hardware [None req-8ef6e5c3-bbf9-4cdd-9ffe-c1e7e3236ca9 tempest-TestServerVolumeAttachScenarioOldVersion-673194571 tempest-TestServerVolumeAttachScenarioOldVersion-673194571-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74613) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 29 17:59:26 user nova-compute[74613]: DEBUG nova.virt.hardware [None req-8ef6e5c3-bbf9-4cdd-9ffe-c1e7e3236ca9 tempest-TestServerVolumeAttachScenarioOldVersion-673194571 tempest-TestServerVolumeAttachScenarioOldVersion-673194571-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74613) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 29 17:59:26 user nova-compute[74613]: DEBUG nova.virt.libvirt.vif [None req-8ef6e5c3-bbf9-4cdd-9ffe-c1e7e3236ca9 tempest-TestServerVolumeAttachScenarioOldVersion-673194571 tempest-TestServerVolumeAttachScenarioOldVersion-673194571-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T17:59:21Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestServerVolumeAttachScenarioOldVersion-server-1307106681',display_name='tempest-TestServerVolumeAttachScenarioOldVersion-server-1307106681',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachscenariooldversion-server-1307106',id=22,image_ref='4217f428-8d9d-4ee1-9614-642d26d90c46',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHp8I+7uFr6Myqto3Nvd4gevnTd55R+Vz8IzGZkzkbGsIqi9dm9N180ux9n95dcFjYBG6Ptof2ppf6OWO6/f2sYeBwi6BQf2QGH5A+F/q1TeKBwNzzppk1xSYSHzRISxwA==',key_name='tempest-keypair-121927362',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0634597a325d46c18743626c2334e455',ramdisk_id='',reservation_id='r-pygyphy8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='4217f428-8d9d-4ee1-9614-642d26d90c46',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestServerVolumeAttachScenarioOldVersion-673194571',owner_user_name='tempest-TestServerVolumeAttachScenarioOldVersion-673194571-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T17:59:25Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='811b6a61f2d2428c8c179ba4bf3b5fa6',uuid=5221f9b9-e4db-406b-ae82-4a7c6522ee64,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2b04c4cf-f85a-4089-8f4a-e2a1c4eec1ae", "address": "fa:16:3e:bc:57:f9", "network": {"id": "c8bdb714-50af-4c1d-9e06-9c71a384b633", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-489594897-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0634597a325d46c18743626c2334e455", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2b04c4cf-f8", "ovs_interfaceid": "2b04c4cf-f85a-4089-8f4a-e2a1c4eec1ae", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74613) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 29 17:59:26 user nova-compute[74613]: DEBUG nova.network.os_vif_util [None req-8ef6e5c3-bbf9-4cdd-9ffe-c1e7e3236ca9 tempest-TestServerVolumeAttachScenarioOldVersion-673194571 tempest-TestServerVolumeAttachScenarioOldVersion-673194571-project-member] Converting VIF {"id": "2b04c4cf-f85a-4089-8f4a-e2a1c4eec1ae", "address": "fa:16:3e:bc:57:f9", "network": {"id": "c8bdb714-50af-4c1d-9e06-9c71a384b633", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-489594897-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0634597a325d46c18743626c2334e455", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2b04c4cf-f8", "ovs_interfaceid": "2b04c4cf-f85a-4089-8f4a-e2a1c4eec1ae", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74613) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 17:59:26 user nova-compute[74613]: DEBUG nova.network.os_vif_util [None req-8ef6e5c3-bbf9-4cdd-9ffe-c1e7e3236ca9 tempest-TestServerVolumeAttachScenarioOldVersion-673194571 tempest-TestServerVolumeAttachScenarioOldVersion-673194571-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:bc:57:f9,bridge_name='br-int',has_traffic_filtering=True,id=2b04c4cf-f85a-4089-8f4a-e2a1c4eec1ae,network=Network(c8bdb714-50af-4c1d-9e06-9c71a384b633),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2b04c4cf-f8') {{(pid=74613) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 17:59:26 user nova-compute[74613]: DEBUG nova.objects.instance [None req-8ef6e5c3-bbf9-4cdd-9ffe-c1e7e3236ca9 tempest-TestServerVolumeAttachScenarioOldVersion-673194571 tempest-TestServerVolumeAttachScenarioOldVersion-673194571-project-member] Lazy-loading 'pci_devices' on Instance uuid 5221f9b9-e4db-406b-ae82-4a7c6522ee64 {{(pid=74613) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 17:59:26 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-8ef6e5c3-bbf9-4cdd-9ffe-c1e7e3236ca9 tempest-TestServerVolumeAttachScenarioOldVersion-673194571 tempest-TestServerVolumeAttachScenarioOldVersion-673194571-project-member] [instance: 5221f9b9-e4db-406b-ae82-4a7c6522ee64] End _get_guest_xml xml=<domain type="kvm">
Nov 29 17:59:26 user nova-compute[74613]:   <uuid>5221f9b9-e4db-406b-ae82-4a7c6522ee64</uuid>
Nov 29 17:59:26 user nova-compute[74613]:   <name>instance-00000016</name>
Nov 29 17:59:26 user nova-compute[74613]:   <memory>524288</memory>
Nov 29 17:59:26 user nova-compute[74613]:   <vcpu>1</vcpu>
Nov 29 17:59:26 user nova-compute[74613]:   <metadata>
Nov 29 17:59:26 user nova-compute[74613]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 29 17:59:26 user nova-compute[74613]:       <nova:package version="0.0.0"/>
Nov 29 17:59:26 user nova-compute[74613]:       <nova:name>tempest-TestServerVolumeAttachScenarioOldVersion-server-1307106681</nova:name>
Nov 29 17:59:26 user nova-compute[74613]:       <nova:creationTime>2023-11-29 17:59:26</nova:creationTime>
Nov 29 17:59:26 user nova-compute[74613]:       <nova:flavor name="m1.tiny">
Nov 29 17:59:26 user nova-compute[74613]:         <nova:memory>512</nova:memory>
Nov 29 17:59:26 user nova-compute[74613]:         <nova:disk>1</nova:disk>
Nov 29 17:59:26 user nova-compute[74613]:         <nova:swap>0</nova:swap>
Nov 29 17:59:26 user nova-compute[74613]:         <nova:ephemeral>0</nova:ephemeral>
Nov 29 17:59:26 user nova-compute[74613]:         <nova:vcpus>1</nova:vcpus>
Nov 29 17:59:26 user nova-compute[74613]:       </nova:flavor>
Nov 29 17:59:26 user nova-compute[74613]:       <nova:owner>
Nov 29 17:59:26 user nova-compute[74613]:         <nova:user uuid="811b6a61f2d2428c8c179ba4bf3b5fa6">tempest-TestServerVolumeAttachScenarioOldVersion-673194571-project-member</nova:user>
Nov 29 17:59:26 user nova-compute[74613]:         <nova:project uuid="0634597a325d46c18743626c2334e455">tempest-TestServerVolumeAttachScenarioOldVersion-673194571</nova:project>
Nov 29 17:59:26 user nova-compute[74613]:       </nova:owner>
Nov 29 17:59:26 user nova-compute[74613]:       <nova:root type="image" uuid="4217f428-8d9d-4ee1-9614-642d26d90c46"/>
Nov 29 17:59:26 user nova-compute[74613]:       <nova:ports>
Nov 29 17:59:26 user nova-compute[74613]:         <nova:port uuid="2b04c4cf-f85a-4089-8f4a-e2a1c4eec1ae">
Nov 29 17:59:26 user nova-compute[74613]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Nov 29 17:59:26 user nova-compute[74613]:         </nova:port>
Nov 29 17:59:26 user nova-compute[74613]:       </nova:ports>
Nov 29 17:59:26 user nova-compute[74613]:     </nova:instance>
Nov 29 17:59:26 user nova-compute[74613]:   </metadata>
Nov 29 17:59:26 user nova-compute[74613]:   <sysinfo type="smbios">
Nov 29 17:59:26 user nova-compute[74613]:     <system>
Nov 29 17:59:26 user nova-compute[74613]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 29 17:59:26 user nova-compute[74613]:       <entry name="product">OpenStack Nova</entry>
Nov 29 17:59:26 user nova-compute[74613]:       <entry name="version">0.0.0</entry>
Nov 29 17:59:26 user nova-compute[74613]:       <entry name="serial">5221f9b9-e4db-406b-ae82-4a7c6522ee64</entry>
Nov 29 17:59:26 user nova-compute[74613]:       <entry name="uuid">5221f9b9-e4db-406b-ae82-4a7c6522ee64</entry>
Nov 29 17:59:26 user nova-compute[74613]:       <entry name="family">Virtual Machine</entry>
Nov 29 17:59:26 user nova-compute[74613]:     </system>
Nov 29 17:59:26 user nova-compute[74613]:   </sysinfo>
Nov 29 17:59:26 user nova-compute[74613]:   <os>
Nov 29 17:59:26 user nova-compute[74613]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 29 17:59:26 user nova-compute[74613]:     <boot dev="hd"/>
Nov 29 17:59:26 user nova-compute[74613]:     <smbios mode="sysinfo"/>
Nov 29 17:59:26 user nova-compute[74613]:   </os>
Nov 29 17:59:26 user nova-compute[74613]:   <features>
Nov 29 17:59:26 user nova-compute[74613]:     <acpi/>
Nov 29 17:59:26 user nova-compute[74613]:     <apic/>
Nov 29 17:59:26 user nova-compute[74613]:     <vmcoreinfo/>
Nov 29 17:59:26 user nova-compute[74613]:   </features>
Nov 29 17:59:26 user nova-compute[74613]:   <clock offset="utc">
Nov 29 17:59:26 user nova-compute[74613]:     <timer name="pit" tickpolicy="delay"/>
Nov 29 17:59:26 user nova-compute[74613]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 29 17:59:26 user nova-compute[74613]:     <timer name="hpet" present="no"/>
Nov 29 17:59:26 user nova-compute[74613]:   </clock>
Nov 29 17:59:26 user nova-compute[74613]:   <cpu mode="custom" match="exact">
Nov 29 17:59:26 user nova-compute[74613]:     <model>Nehalem</model>
Nov 29 17:59:26 user nova-compute[74613]:     <topology sockets="1" cores="1" threads="1"/>
Nov 29 17:59:26 user nova-compute[74613]:   </cpu>
Nov 29 17:59:26 user nova-compute[74613]:   <devices>
Nov 29 17:59:26 user nova-compute[74613]:     <disk type="file" device="disk">
Nov 29 17:59:26 user nova-compute[74613]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 29 17:59:26 user nova-compute[74613]:       <source file="/opt/stack/data/nova/instances/5221f9b9-e4db-406b-ae82-4a7c6522ee64/disk"/>
Nov 29 17:59:26 user nova-compute[74613]:       <target dev="vda" bus="virtio"/>
Nov 29 17:59:26 user nova-compute[74613]:     </disk>
Nov 29 17:59:26 user nova-compute[74613]:     <interface type="ethernet">
Nov 29 17:59:26 user nova-compute[74613]:       <mac address="fa:16:3e:bc:57:f9"/>
Nov 29 17:59:26 user nova-compute[74613]:       <model type="virtio"/>
Nov 29 17:59:26 user nova-compute[74613]:       <mtu size="1442"/>
Nov 29 17:59:26 user nova-compute[74613]:       <target dev="tap2b04c4cf-f8"/>
Nov 29 17:59:26 user nova-compute[74613]:     </interface>
Nov 29 17:59:26 user nova-compute[74613]:     <serial type="pty">
Nov 29 17:59:26 user nova-compute[74613]:       <log file="/opt/stack/data/nova/instances/5221f9b9-e4db-406b-ae82-4a7c6522ee64/console.log" append="off"/>
Nov 29 17:59:26 user nova-compute[74613]:     </serial>
Nov 29 17:59:26 user nova-compute[74613]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 29 17:59:26 user nova-compute[74613]:     <video>
Nov 29 17:59:26 user nova-compute[74613]:       <model type="virtio"/>
Nov 29 17:59:26 user nova-compute[74613]:     </video>
Nov 29 17:59:26 user nova-compute[74613]:     <rng model="virtio">
Nov 29 17:59:26 user nova-compute[74613]:       <backend model="random">/dev/urandom</backend>
Nov 29 17:59:26 user nova-compute[74613]:     </rng>
Nov 29 17:59:26 user nova-compute[74613]:     <controller type="usb" index="0" model="none"/>
Nov 29 17:59:26 user nova-compute[74613]:     <memballoon model="virtio">
Nov 29 17:59:26 user nova-compute[74613]:       <stats period="10"/>
Nov 29 17:59:26 user nova-compute[74613]:     </memballoon>
Nov 29 17:59:26 user nova-compute[74613]:   </devices>
Nov 29 17:59:26 user nova-compute[74613]: </domain>
Nov 29 17:59:26 user nova-compute[74613]:  {{(pid=74613) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 29 17:59:26 user nova-compute[74613]: DEBUG nova.virt.libvirt.vif [None req-8ef6e5c3-bbf9-4cdd-9ffe-c1e7e3236ca9 tempest-TestServerVolumeAttachScenarioOldVersion-673194571 tempest-TestServerVolumeAttachScenarioOldVersion-673194571-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T17:59:21Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestServerVolumeAttachScenarioOldVersion-server-1307106681',display_name='tempest-TestServerVolumeAttachScenarioOldVersion-server-1307106681',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachscenariooldversion-server-1307106',id=22,image_ref='4217f428-8d9d-4ee1-9614-642d26d90c46',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHp8I+7uFr6Myqto3Nvd4gevnTd55R+Vz8IzGZkzkbGsIqi9dm9N180ux9n95dcFjYBG6Ptof2ppf6OWO6/f2sYeBwi6BQf2QGH5A+F/q1TeKBwNzzppk1xSYSHzRISxwA==',key_name='tempest-keypair-121927362',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0634597a325d46c18743626c2334e455',ramdisk_id='',reservation_id='r-pygyphy8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='4217f428-8d9d-4ee1-9614-642d26d90c46',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestServerVolumeAttachScenarioOldVersion-673194571',owner_user_name='tempest-TestServerVolumeAttachScenarioOldVersion-673194571-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T17:59:25Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='811b6a61f2d2428c8c179ba4bf3b5fa6',uuid=5221f9b9-e4db-406b-ae82-4a7c6522ee64,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2b04c4cf-f85a-4089-8f4a-e2a1c4eec1ae", "address": "fa:16:3e:bc:57:f9", "network": {"id": "c8bdb714-50af-4c1d-9e06-9c71a384b633", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-489594897-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0634597a325d46c18743626c2334e455", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2b04c4cf-f8", "ovs_interfaceid": "2b04c4cf-f85a-4089-8f4a-e2a1c4eec1ae", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74613) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 29 17:59:26 user nova-compute[74613]: DEBUG nova.network.os_vif_util [None req-8ef6e5c3-bbf9-4cdd-9ffe-c1e7e3236ca9 tempest-TestServerVolumeAttachScenarioOldVersion-673194571 tempest-TestServerVolumeAttachScenarioOldVersion-673194571-project-member] Converting VIF {"id": "2b04c4cf-f85a-4089-8f4a-e2a1c4eec1ae", "address": "fa:16:3e:bc:57:f9", "network": {"id": "c8bdb714-50af-4c1d-9e06-9c71a384b633", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-489594897-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0634597a325d46c18743626c2334e455", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2b04c4cf-f8", "ovs_interfaceid": "2b04c4cf-f85a-4089-8f4a-e2a1c4eec1ae", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74613) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 17:59:26 user nova-compute[74613]: DEBUG nova.network.os_vif_util [None req-8ef6e5c3-bbf9-4cdd-9ffe-c1e7e3236ca9 tempest-TestServerVolumeAttachScenarioOldVersion-673194571 tempest-TestServerVolumeAttachScenarioOldVersion-673194571-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:bc:57:f9,bridge_name='br-int',has_traffic_filtering=True,id=2b04c4cf-f85a-4089-8f4a-e2a1c4eec1ae,network=Network(c8bdb714-50af-4c1d-9e06-9c71a384b633),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2b04c4cf-f8') {{(pid=74613) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 17:59:26 user nova-compute[74613]: DEBUG os_vif [None req-8ef6e5c3-bbf9-4cdd-9ffe-c1e7e3236ca9 tempest-TestServerVolumeAttachScenarioOldVersion-673194571 tempest-TestServerVolumeAttachScenarioOldVersion-673194571-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:bc:57:f9,bridge_name='br-int',has_traffic_filtering=True,id=2b04c4cf-f85a-4089-8f4a-e2a1c4eec1ae,network=Network(c8bdb714-50af-4c1d-9e06-9c71a384b633),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2b04c4cf-f8') {{(pid=74613) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 29 17:59:26 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:59:26 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74613) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 17:59:26 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74613) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 29 17:59:26 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:59:26 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '58deedbd-a3ca-5f58-8ed0-b99f38f30dee', '_type': 'linux-noop'}}, row=False) {{(pid=74613) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 17:59:26 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:59:26 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 17:59:26 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:59:26 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap2b04c4cf-f8, may_exist=True, interface_attrs={}) {{(pid=74613) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 17:59:26 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap2b04c4cf-f8, col_values=(('qos', UUID('e2aa64b9-f9e9-4e61-b299-cd24a8dbf0f5')),), if_exists=True) {{(pid=74613) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 17:59:26 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap2b04c4cf-f8, col_values=(('external_ids', {'iface-id': '2b04c4cf-f85a-4089-8f4a-e2a1c4eec1ae', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:bc:57:f9', 'vm-uuid': '5221f9b9-e4db-406b-ae82-4a7c6522ee64'}),), if_exists=True) {{(pid=74613) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 17:59:27 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:59:27 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 17:59:27 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:59:27 user nova-compute[74613]: INFO os_vif [None req-8ef6e5c3-bbf9-4cdd-9ffe-c1e7e3236ca9 tempest-TestServerVolumeAttachScenarioOldVersion-673194571 tempest-TestServerVolumeAttachScenarioOldVersion-673194571-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:bc:57:f9,bridge_name='br-int',has_traffic_filtering=True,id=2b04c4cf-f85a-4089-8f4a-e2a1c4eec1ae,network=Network(c8bdb714-50af-4c1d-9e06-9c71a384b633),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2b04c4cf-f8')
Nov 29 17:59:27 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-8ef6e5c3-bbf9-4cdd-9ffe-c1e7e3236ca9 tempest-TestServerVolumeAttachScenarioOldVersion-673194571 tempest-TestServerVolumeAttachScenarioOldVersion-673194571-project-member] No BDM found with device name vda, not building metadata. {{(pid=74613) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 17:59:27 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-8ef6e5c3-bbf9-4cdd-9ffe-c1e7e3236ca9 tempest-TestServerVolumeAttachScenarioOldVersion-673194571 tempest-TestServerVolumeAttachScenarioOldVersion-673194571-project-member] No VIF found with MAC fa:16:3e:bc:57:f9, not building metadata {{(pid=74613) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 29 17:59:27 user nova-compute[74613]: DEBUG nova.network.neutron [req-544416a4-6329-45a0-9036-53fc59037a53 req-c15ea046-e85f-4b00-a572-f4b793dc50ee service nova] [instance: 5221f9b9-e4db-406b-ae82-4a7c6522ee64] Updated VIF entry in instance network info cache for port 2b04c4cf-f85a-4089-8f4a-e2a1c4eec1ae. {{(pid=74613) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 17:59:27 user nova-compute[74613]: DEBUG nova.network.neutron [req-544416a4-6329-45a0-9036-53fc59037a53 req-c15ea046-e85f-4b00-a572-f4b793dc50ee service nova] [instance: 5221f9b9-e4db-406b-ae82-4a7c6522ee64] Updating instance_info_cache with network_info: [{"id": "2b04c4cf-f85a-4089-8f4a-e2a1c4eec1ae", "address": "fa:16:3e:bc:57:f9", "network": {"id": "c8bdb714-50af-4c1d-9e06-9c71a384b633", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-489594897-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0634597a325d46c18743626c2334e455", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2b04c4cf-f8", "ovs_interfaceid": "2b04c4cf-f85a-4089-8f4a-e2a1c4eec1ae", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74613) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 17:59:27 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-544416a4-6329-45a0-9036-53fc59037a53 req-c15ea046-e85f-4b00-a572-f4b793dc50ee service nova] Releasing lock "refresh_cache-5221f9b9-e4db-406b-ae82-4a7c6522ee64" {{(pid=74613) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 17:59:28 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:59:28 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:59:28 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:59:28 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:59:28 user nova-compute[74613]: DEBUG nova.compute.manager [req-20b73f6b-3479-4c15-b68b-bf21b7f0d676 req-30cc0787-f247-4c09-9f49-0d474644a36b service nova] [instance: 5221f9b9-e4db-406b-ae82-4a7c6522ee64] Received event network-vif-plugged-2b04c4cf-f85a-4089-8f4a-e2a1c4eec1ae {{(pid=74613) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 17:59:28 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-20b73f6b-3479-4c15-b68b-bf21b7f0d676 req-30cc0787-f247-4c09-9f49-0d474644a36b service nova] Acquiring lock "5221f9b9-e4db-406b-ae82-4a7c6522ee64-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 17:59:28 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-20b73f6b-3479-4c15-b68b-bf21b7f0d676 req-30cc0787-f247-4c09-9f49-0d474644a36b service nova] Lock "5221f9b9-e4db-406b-ae82-4a7c6522ee64-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 17:59:28 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-20b73f6b-3479-4c15-b68b-bf21b7f0d676 req-30cc0787-f247-4c09-9f49-0d474644a36b service nova] Lock "5221f9b9-e4db-406b-ae82-4a7c6522ee64-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 17:59:28 user nova-compute[74613]: DEBUG nova.compute.manager [req-20b73f6b-3479-4c15-b68b-bf21b7f0d676 req-30cc0787-f247-4c09-9f49-0d474644a36b service nova] [instance: 5221f9b9-e4db-406b-ae82-4a7c6522ee64] No waiting events found dispatching network-vif-plugged-2b04c4cf-f85a-4089-8f4a-e2a1c4eec1ae {{(pid=74613) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 17:59:28 user nova-compute[74613]: WARNING nova.compute.manager [req-20b73f6b-3479-4c15-b68b-bf21b7f0d676 req-30cc0787-f247-4c09-9f49-0d474644a36b service nova] [instance: 5221f9b9-e4db-406b-ae82-4a7c6522ee64] Received unexpected event network-vif-plugged-2b04c4cf-f85a-4089-8f4a-e2a1c4eec1ae for instance with vm_state building and task_state spawning.
Nov 29 17:59:29 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-072587f2-b661-42ab-ac94-9aca37a3fe5e tempest-ServersNegativeTestJSON-1631676891 tempest-ServersNegativeTestJSON-1631676891-project-member] Acquiring lock "fce4b456-c108-439f-b0ff-7619aaf77e69" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 17:59:29 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-072587f2-b661-42ab-ac94-9aca37a3fe5e tempest-ServersNegativeTestJSON-1631676891 tempest-ServersNegativeTestJSON-1631676891-project-member] Lock "fce4b456-c108-439f-b0ff-7619aaf77e69" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 17:59:29 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-072587f2-b661-42ab-ac94-9aca37a3fe5e tempest-ServersNegativeTestJSON-1631676891 tempest-ServersNegativeTestJSON-1631676891-project-member] Acquiring lock "fce4b456-c108-439f-b0ff-7619aaf77e69-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 17:59:29 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-072587f2-b661-42ab-ac94-9aca37a3fe5e tempest-ServersNegativeTestJSON-1631676891 tempest-ServersNegativeTestJSON-1631676891-project-member] Lock "fce4b456-c108-439f-b0ff-7619aaf77e69-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 17:59:29 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-072587f2-b661-42ab-ac94-9aca37a3fe5e tempest-ServersNegativeTestJSON-1631676891 tempest-ServersNegativeTestJSON-1631676891-project-member] Lock "fce4b456-c108-439f-b0ff-7619aaf77e69-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 17:59:29 user nova-compute[74613]: INFO nova.compute.manager [None req-072587f2-b661-42ab-ac94-9aca37a3fe5e tempest-ServersNegativeTestJSON-1631676891 tempest-ServersNegativeTestJSON-1631676891-project-member] [instance: fce4b456-c108-439f-b0ff-7619aaf77e69] Terminating instance
Nov 29 17:59:29 user nova-compute[74613]: DEBUG nova.compute.manager [None req-072587f2-b661-42ab-ac94-9aca37a3fe5e tempest-ServersNegativeTestJSON-1631676891 tempest-ServersNegativeTestJSON-1631676891-project-member] [instance: fce4b456-c108-439f-b0ff-7619aaf77e69] Start destroying the instance on the hypervisor. {{(pid=74613) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 29 17:59:29 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:59:29 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:59:29 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:59:29 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:59:29 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:59:29 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:59:29 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:59:29 user nova-compute[74613]: DEBUG nova.compute.manager [req-96ebb11c-840f-41a7-87b3-2f11ff666d74 req-a202efff-0686-44ce-b0d5-b38c39595c53 service nova] [instance: fce4b456-c108-439f-b0ff-7619aaf77e69] Received event network-vif-unplugged-3e7fadc1-cfec-4ced-8078-8056d61d96a5 {{(pid=74613) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 17:59:29 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-96ebb11c-840f-41a7-87b3-2f11ff666d74 req-a202efff-0686-44ce-b0d5-b38c39595c53 service nova] Acquiring lock "fce4b456-c108-439f-b0ff-7619aaf77e69-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 17:59:29 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-96ebb11c-840f-41a7-87b3-2f11ff666d74 req-a202efff-0686-44ce-b0d5-b38c39595c53 service nova] Lock "fce4b456-c108-439f-b0ff-7619aaf77e69-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 17:59:29 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-96ebb11c-840f-41a7-87b3-2f11ff666d74 req-a202efff-0686-44ce-b0d5-b38c39595c53 service nova] Lock "fce4b456-c108-439f-b0ff-7619aaf77e69-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 17:59:29 user nova-compute[74613]: DEBUG nova.compute.manager [req-96ebb11c-840f-41a7-87b3-2f11ff666d74 req-a202efff-0686-44ce-b0d5-b38c39595c53 service nova] [instance: fce4b456-c108-439f-b0ff-7619aaf77e69] No waiting events found dispatching network-vif-unplugged-3e7fadc1-cfec-4ced-8078-8056d61d96a5 {{(pid=74613) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 17:59:29 user nova-compute[74613]: DEBUG nova.compute.manager [req-96ebb11c-840f-41a7-87b3-2f11ff666d74 req-a202efff-0686-44ce-b0d5-b38c39595c53 service nova] [instance: fce4b456-c108-439f-b0ff-7619aaf77e69] Received event network-vif-unplugged-3e7fadc1-cfec-4ced-8078-8056d61d96a5 for instance with task_state deleting. {{(pid=74613) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 29 17:59:29 user nova-compute[74613]: INFO nova.virt.libvirt.driver [-] [instance: fce4b456-c108-439f-b0ff-7619aaf77e69] Instance destroyed successfully.
Nov 29 17:59:29 user nova-compute[74613]: DEBUG nova.objects.instance [None req-072587f2-b661-42ab-ac94-9aca37a3fe5e tempest-ServersNegativeTestJSON-1631676891 tempest-ServersNegativeTestJSON-1631676891-project-member] Lazy-loading 'resources' on Instance uuid fce4b456-c108-439f-b0ff-7619aaf77e69 {{(pid=74613) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 17:59:29 user nova-compute[74613]: DEBUG nova.virt.libvirt.vif [None req-072587f2-b661-42ab-ac94-9aca37a3fe5e tempest-ServersNegativeTestJSON-1631676891 tempest-ServersNegativeTestJSON-1631676891-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T17:57:38Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-1802770032',display_name='tempest-ServersNegativeTestJSON-server-1802770032',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-1802770032',id=19,image_ref='4217f428-8d9d-4ee1-9614-642d26d90c46',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-29T17:57:45Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='68aabefe0c4340ce8408e386748fa0cf',ramdisk_id='',reservation_id='r-6tdmy1m6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='4217f428-8d9d-4ee1-9614-642d26d90c46',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServersNegativeTestJSON-1631676891',owner_user_name='tempest-ServersNegativeTestJSON-1631676891-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-29T17:57:45Z,user_data=None,user_id='4b4c259dfbf244c6b48374ab04e6d694',uuid=fce4b456-c108-439f-b0ff-7619aaf77e69,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "3e7fadc1-cfec-4ced-8078-8056d61d96a5", "address": "fa:16:3e:c2:a1:c4", "network": {"id": "4d31e03e-697a-44c2-a03e-77eed3dbce43", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-629140279-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "68aabefe0c4340ce8408e386748fa0cf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3e7fadc1-cf", "ovs_interfaceid": "3e7fadc1-cfec-4ced-8078-8056d61d96a5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74613) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 29 17:59:29 user nova-compute[74613]: DEBUG nova.network.os_vif_util [None req-072587f2-b661-42ab-ac94-9aca37a3fe5e tempest-ServersNegativeTestJSON-1631676891 tempest-ServersNegativeTestJSON-1631676891-project-member] Converting VIF {"id": "3e7fadc1-cfec-4ced-8078-8056d61d96a5", "address": "fa:16:3e:c2:a1:c4", "network": {"id": "4d31e03e-697a-44c2-a03e-77eed3dbce43", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-629140279-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "68aabefe0c4340ce8408e386748fa0cf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3e7fadc1-cf", "ovs_interfaceid": "3e7fadc1-cfec-4ced-8078-8056d61d96a5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74613) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 17:59:29 user nova-compute[74613]: DEBUG nova.network.os_vif_util [None req-072587f2-b661-42ab-ac94-9aca37a3fe5e tempest-ServersNegativeTestJSON-1631676891 tempest-ServersNegativeTestJSON-1631676891-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c2:a1:c4,bridge_name='br-int',has_traffic_filtering=True,id=3e7fadc1-cfec-4ced-8078-8056d61d96a5,network=Network(4d31e03e-697a-44c2-a03e-77eed3dbce43),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3e7fadc1-cf') {{(pid=74613) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 17:59:29 user nova-compute[74613]: DEBUG os_vif [None req-072587f2-b661-42ab-ac94-9aca37a3fe5e tempest-ServersNegativeTestJSON-1631676891 tempest-ServersNegativeTestJSON-1631676891-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c2:a1:c4,bridge_name='br-int',has_traffic_filtering=True,id=3e7fadc1-cfec-4ced-8078-8056d61d96a5,network=Network(4d31e03e-697a-44c2-a03e-77eed3dbce43),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3e7fadc1-cf') {{(pid=74613) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 29 17:59:29 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:59:29 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap3e7fadc1-cf, bridge=br-int, if_exists=True) {{(pid=74613) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 17:59:29 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:59:29 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 17:59:29 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:59:29 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=6f95491c-8cf2-411b-a66a-ae41ed3e3e0c) {{(pid=74613) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 17:59:29 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:59:29 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 17:59:29 user nova-compute[74613]: INFO os_vif [None req-072587f2-b661-42ab-ac94-9aca37a3fe5e tempest-ServersNegativeTestJSON-1631676891 tempest-ServersNegativeTestJSON-1631676891-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c2:a1:c4,bridge_name='br-int',has_traffic_filtering=True,id=3e7fadc1-cfec-4ced-8078-8056d61d96a5,network=Network(4d31e03e-697a-44c2-a03e-77eed3dbce43),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3e7fadc1-cf')
Nov 29 17:59:29 user nova-compute[74613]: INFO nova.virt.libvirt.driver [None req-072587f2-b661-42ab-ac94-9aca37a3fe5e tempest-ServersNegativeTestJSON-1631676891 tempest-ServersNegativeTestJSON-1631676891-project-member] [instance: fce4b456-c108-439f-b0ff-7619aaf77e69] Deleting instance files /opt/stack/data/nova/instances/fce4b456-c108-439f-b0ff-7619aaf77e69_del
Nov 29 17:59:29 user nova-compute[74613]: INFO nova.virt.libvirt.driver [None req-072587f2-b661-42ab-ac94-9aca37a3fe5e tempest-ServersNegativeTestJSON-1631676891 tempest-ServersNegativeTestJSON-1631676891-project-member] [instance: fce4b456-c108-439f-b0ff-7619aaf77e69] Deletion of /opt/stack/data/nova/instances/fce4b456-c108-439f-b0ff-7619aaf77e69_del complete
Nov 29 17:59:30 user nova-compute[74613]: INFO nova.compute.manager [None req-072587f2-b661-42ab-ac94-9aca37a3fe5e tempest-ServersNegativeTestJSON-1631676891 tempest-ServersNegativeTestJSON-1631676891-project-member] [instance: fce4b456-c108-439f-b0ff-7619aaf77e69] Took 0.93 seconds to destroy the instance on the hypervisor.
Nov 29 17:59:30 user nova-compute[74613]: DEBUG oslo.service.loopingcall [None req-072587f2-b661-42ab-ac94-9aca37a3fe5e tempest-ServersNegativeTestJSON-1631676891 tempest-ServersNegativeTestJSON-1631676891-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74613) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 29 17:59:30 user nova-compute[74613]: DEBUG nova.compute.manager [-] [instance: fce4b456-c108-439f-b0ff-7619aaf77e69] Deallocating network for instance {{(pid=74613) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 29 17:59:30 user nova-compute[74613]: DEBUG nova.network.neutron [-] [instance: fce4b456-c108-439f-b0ff-7619aaf77e69] deallocate_for_instance() {{(pid=74613) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 29 17:59:30 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:59:30 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:59:30 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:59:30 user nova-compute[74613]: DEBUG nova.network.neutron [-] [instance: fce4b456-c108-439f-b0ff-7619aaf77e69] Updating instance_info_cache with network_info: [] {{(pid=74613) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 17:59:30 user nova-compute[74613]: INFO nova.compute.manager [-] [instance: fce4b456-c108-439f-b0ff-7619aaf77e69] Took 0.44 seconds to deallocate network for instance.
Nov 29 17:59:30 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-072587f2-b661-42ab-ac94-9aca37a3fe5e tempest-ServersNegativeTestJSON-1631676891 tempest-ServersNegativeTestJSON-1631676891-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 17:59:30 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-072587f2-b661-42ab-ac94-9aca37a3fe5e tempest-ServersNegativeTestJSON-1631676891 tempest-ServersNegativeTestJSON-1631676891-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 17:59:30 user nova-compute[74613]: DEBUG nova.compute.provider_tree [None req-072587f2-b661-42ab-ac94-9aca37a3fe5e tempest-ServersNegativeTestJSON-1631676891 tempest-ServersNegativeTestJSON-1631676891-project-member] Inventory has not changed in ProviderTree for provider: 639d980e-3b12-44b1-b8f4-1812416fa4dd {{(pid=74613) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 17:59:30 user nova-compute[74613]: DEBUG nova.scheduler.client.report [None req-072587f2-b661-42ab-ac94-9aca37a3fe5e tempest-ServersNegativeTestJSON-1631676891 tempest-ServersNegativeTestJSON-1631676891-project-member] Inventory has not changed for provider 639d980e-3b12-44b1-b8f4-1812416fa4dd based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74613) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 17:59:30 user nova-compute[74613]: DEBUG nova.compute.manager [req-e4d5d41b-8c98-494b-b95b-d40d871a159f req-cfb26ba5-3126-4d5f-a99d-7e5589a3a649 service nova] [instance: 5221f9b9-e4db-406b-ae82-4a7c6522ee64] Received event network-vif-plugged-2b04c4cf-f85a-4089-8f4a-e2a1c4eec1ae {{(pid=74613) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 17:59:30 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-e4d5d41b-8c98-494b-b95b-d40d871a159f req-cfb26ba5-3126-4d5f-a99d-7e5589a3a649 service nova] Acquiring lock "5221f9b9-e4db-406b-ae82-4a7c6522ee64-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 17:59:30 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-e4d5d41b-8c98-494b-b95b-d40d871a159f req-cfb26ba5-3126-4d5f-a99d-7e5589a3a649 service nova] Lock "5221f9b9-e4db-406b-ae82-4a7c6522ee64-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 17:59:30 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-e4d5d41b-8c98-494b-b95b-d40d871a159f req-cfb26ba5-3126-4d5f-a99d-7e5589a3a649 service nova] Lock "5221f9b9-e4db-406b-ae82-4a7c6522ee64-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 17:59:30 user nova-compute[74613]: DEBUG nova.compute.manager [req-e4d5d41b-8c98-494b-b95b-d40d871a159f req-cfb26ba5-3126-4d5f-a99d-7e5589a3a649 service nova] [instance: 5221f9b9-e4db-406b-ae82-4a7c6522ee64] No waiting events found dispatching network-vif-plugged-2b04c4cf-f85a-4089-8f4a-e2a1c4eec1ae {{(pid=74613) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 17:59:30 user nova-compute[74613]: WARNING nova.compute.manager [req-e4d5d41b-8c98-494b-b95b-d40d871a159f req-cfb26ba5-3126-4d5f-a99d-7e5589a3a649 service nova] [instance: 5221f9b9-e4db-406b-ae82-4a7c6522ee64] Received unexpected event network-vif-plugged-2b04c4cf-f85a-4089-8f4a-e2a1c4eec1ae for instance with vm_state building and task_state spawning.
Nov 29 17:59:30 user nova-compute[74613]: DEBUG nova.compute.manager [None req-8ef6e5c3-bbf9-4cdd-9ffe-c1e7e3236ca9 tempest-TestServerVolumeAttachScenarioOldVersion-673194571 tempest-TestServerVolumeAttachScenarioOldVersion-673194571-project-member] [instance: 5221f9b9-e4db-406b-ae82-4a7c6522ee64] Instance event wait completed in 0 seconds for  {{(pid=74613) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 29 17:59:30 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-8ef6e5c3-bbf9-4cdd-9ffe-c1e7e3236ca9 tempest-TestServerVolumeAttachScenarioOldVersion-673194571 tempest-TestServerVolumeAttachScenarioOldVersion-673194571-project-member] [instance: 5221f9b9-e4db-406b-ae82-4a7c6522ee64] Guest created on hypervisor {{(pid=74613) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 29 17:59:30 user nova-compute[74613]: INFO nova.virt.libvirt.driver [-] [instance: 5221f9b9-e4db-406b-ae82-4a7c6522ee64] Instance spawned successfully.
Nov 29 17:59:30 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-8ef6e5c3-bbf9-4cdd-9ffe-c1e7e3236ca9 tempest-TestServerVolumeAttachScenarioOldVersion-673194571 tempest-TestServerVolumeAttachScenarioOldVersion-673194571-project-member] [instance: 5221f9b9-e4db-406b-ae82-4a7c6522ee64] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74613) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 29 17:59:30 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-072587f2-b661-42ab-ac94-9aca37a3fe5e tempest-ServersNegativeTestJSON-1631676891 tempest-ServersNegativeTestJSON-1631676891-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.441s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 17:59:30 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-8ef6e5c3-bbf9-4cdd-9ffe-c1e7e3236ca9 tempest-TestServerVolumeAttachScenarioOldVersion-673194571 tempest-TestServerVolumeAttachScenarioOldVersion-673194571-project-member] [instance: 5221f9b9-e4db-406b-ae82-4a7c6522ee64] Found default for hw_cdrom_bus of ide {{(pid=74613) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 17:59:30 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-8ef6e5c3-bbf9-4cdd-9ffe-c1e7e3236ca9 tempest-TestServerVolumeAttachScenarioOldVersion-673194571 tempest-TestServerVolumeAttachScenarioOldVersion-673194571-project-member] [instance: 5221f9b9-e4db-406b-ae82-4a7c6522ee64] Found default for hw_disk_bus of virtio {{(pid=74613) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 17:59:30 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-8ef6e5c3-bbf9-4cdd-9ffe-c1e7e3236ca9 tempest-TestServerVolumeAttachScenarioOldVersion-673194571 tempest-TestServerVolumeAttachScenarioOldVersion-673194571-project-member] [instance: 5221f9b9-e4db-406b-ae82-4a7c6522ee64] Found default for hw_input_bus of None {{(pid=74613) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 17:59:30 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-8ef6e5c3-bbf9-4cdd-9ffe-c1e7e3236ca9 tempest-TestServerVolumeAttachScenarioOldVersion-673194571 tempest-TestServerVolumeAttachScenarioOldVersion-673194571-project-member] [instance: 5221f9b9-e4db-406b-ae82-4a7c6522ee64] Found default for hw_pointer_model of None {{(pid=74613) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 17:59:30 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-8ef6e5c3-bbf9-4cdd-9ffe-c1e7e3236ca9 tempest-TestServerVolumeAttachScenarioOldVersion-673194571 tempest-TestServerVolumeAttachScenarioOldVersion-673194571-project-member] [instance: 5221f9b9-e4db-406b-ae82-4a7c6522ee64] Found default for hw_video_model of virtio {{(pid=74613) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 17:59:30 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-8ef6e5c3-bbf9-4cdd-9ffe-c1e7e3236ca9 tempest-TestServerVolumeAttachScenarioOldVersion-673194571 tempest-TestServerVolumeAttachScenarioOldVersion-673194571-project-member] [instance: 5221f9b9-e4db-406b-ae82-4a7c6522ee64] Found default for hw_vif_model of virtio {{(pid=74613) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 17:59:31 user nova-compute[74613]: INFO nova.scheduler.client.report [None req-072587f2-b661-42ab-ac94-9aca37a3fe5e tempest-ServersNegativeTestJSON-1631676891 tempest-ServersNegativeTestJSON-1631676891-project-member] Deleted allocations for instance fce4b456-c108-439f-b0ff-7619aaf77e69
Nov 29 17:59:31 user nova-compute[74613]: INFO nova.compute.manager [None req-8ef6e5c3-bbf9-4cdd-9ffe-c1e7e3236ca9 tempest-TestServerVolumeAttachScenarioOldVersion-673194571 tempest-TestServerVolumeAttachScenarioOldVersion-673194571-project-member] [instance: 5221f9b9-e4db-406b-ae82-4a7c6522ee64] Took 5.94 seconds to spawn the instance on the hypervisor.
Nov 29 17:59:31 user nova-compute[74613]: DEBUG nova.compute.manager [None req-8ef6e5c3-bbf9-4cdd-9ffe-c1e7e3236ca9 tempest-TestServerVolumeAttachScenarioOldVersion-673194571 tempest-TestServerVolumeAttachScenarioOldVersion-673194571-project-member] [instance: 5221f9b9-e4db-406b-ae82-4a7c6522ee64] Checking state {{(pid=74613) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 29 17:59:31 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-072587f2-b661-42ab-ac94-9aca37a3fe5e tempest-ServersNegativeTestJSON-1631676891 tempest-ServersNegativeTestJSON-1631676891-project-member] Lock "fce4b456-c108-439f-b0ff-7619aaf77e69" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.016s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 17:59:31 user nova-compute[74613]: INFO nova.compute.manager [None req-8ef6e5c3-bbf9-4cdd-9ffe-c1e7e3236ca9 tempest-TestServerVolumeAttachScenarioOldVersion-673194571 tempest-TestServerVolumeAttachScenarioOldVersion-673194571-project-member] [instance: 5221f9b9-e4db-406b-ae82-4a7c6522ee64] Took 7.37 seconds to build instance.
Nov 29 17:59:31 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-8ef6e5c3-bbf9-4cdd-9ffe-c1e7e3236ca9 tempest-TestServerVolumeAttachScenarioOldVersion-673194571 tempest-TestServerVolumeAttachScenarioOldVersion-673194571-project-member] Lock "5221f9b9-e4db-406b-ae82-4a7c6522ee64" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.588s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 17:59:31 user nova-compute[74613]: DEBUG nova.compute.manager [req-015e63d5-43eb-410b-a060-fbd14f195528 req-c5978095-f9bf-4f9f-9551-e6c73eacc5f3 service nova] [instance: fce4b456-c108-439f-b0ff-7619aaf77e69] Received event network-vif-plugged-3e7fadc1-cfec-4ced-8078-8056d61d96a5 {{(pid=74613) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 17:59:31 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-015e63d5-43eb-410b-a060-fbd14f195528 req-c5978095-f9bf-4f9f-9551-e6c73eacc5f3 service nova] Acquiring lock "fce4b456-c108-439f-b0ff-7619aaf77e69-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 17:59:31 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-015e63d5-43eb-410b-a060-fbd14f195528 req-c5978095-f9bf-4f9f-9551-e6c73eacc5f3 service nova] Lock "fce4b456-c108-439f-b0ff-7619aaf77e69-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 17:59:31 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-015e63d5-43eb-410b-a060-fbd14f195528 req-c5978095-f9bf-4f9f-9551-e6c73eacc5f3 service nova] Lock "fce4b456-c108-439f-b0ff-7619aaf77e69-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 17:59:31 user nova-compute[74613]: DEBUG nova.compute.manager [req-015e63d5-43eb-410b-a060-fbd14f195528 req-c5978095-f9bf-4f9f-9551-e6c73eacc5f3 service nova] [instance: fce4b456-c108-439f-b0ff-7619aaf77e69] No waiting events found dispatching network-vif-plugged-3e7fadc1-cfec-4ced-8078-8056d61d96a5 {{(pid=74613) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 17:59:31 user nova-compute[74613]: WARNING nova.compute.manager [req-015e63d5-43eb-410b-a060-fbd14f195528 req-c5978095-f9bf-4f9f-9551-e6c73eacc5f3 service nova] [instance: fce4b456-c108-439f-b0ff-7619aaf77e69] Received unexpected event network-vif-plugged-3e7fadc1-cfec-4ced-8078-8056d61d96a5 for instance with vm_state deleted and task_state None.
Nov 29 17:59:31 user nova-compute[74613]: DEBUG nova.compute.manager [req-015e63d5-43eb-410b-a060-fbd14f195528 req-c5978095-f9bf-4f9f-9551-e6c73eacc5f3 service nova] [instance: fce4b456-c108-439f-b0ff-7619aaf77e69] Received event network-vif-deleted-3e7fadc1-cfec-4ced-8078-8056d61d96a5 {{(pid=74613) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 17:59:32 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-0a890434-0980-4d06-bbc6-361af9948a80 tempest-VolumesSnapshotTestJSON-1388493826 tempest-VolumesSnapshotTestJSON-1388493826-project-member] Acquiring lock "356478b0-e233-46aa-a1bd-45ce1f9eca8f" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 17:59:32 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-0a890434-0980-4d06-bbc6-361af9948a80 tempest-VolumesSnapshotTestJSON-1388493826 tempest-VolumesSnapshotTestJSON-1388493826-project-member] Lock "356478b0-e233-46aa-a1bd-45ce1f9eca8f" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 17:59:32 user nova-compute[74613]: INFO nova.compute.manager [None req-0a890434-0980-4d06-bbc6-361af9948a80 tempest-VolumesSnapshotTestJSON-1388493826 tempest-VolumesSnapshotTestJSON-1388493826-project-member] [instance: 356478b0-e233-46aa-a1bd-45ce1f9eca8f] Detaching volume 97d30677-4d07-468f-99d9-de70cdd5053e
Nov 29 17:59:32 user nova-compute[74613]: INFO nova.virt.block_device [None req-0a890434-0980-4d06-bbc6-361af9948a80 tempest-VolumesSnapshotTestJSON-1388493826 tempest-VolumesSnapshotTestJSON-1388493826-project-member] [instance: 356478b0-e233-46aa-a1bd-45ce1f9eca8f] Attempting to driver detach volume 97d30677-4d07-468f-99d9-de70cdd5053e from mountpoint /dev/vdb
Nov 29 17:59:32 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-0a890434-0980-4d06-bbc6-361af9948a80 tempest-VolumesSnapshotTestJSON-1388493826 tempest-VolumesSnapshotTestJSON-1388493826-project-member] Attempting to detach device vdb from instance 356478b0-e233-46aa-a1bd-45ce1f9eca8f from the persistent domain config. {{(pid=74613) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 29 17:59:32 user nova-compute[74613]: DEBUG nova.virt.libvirt.guest [None req-0a890434-0980-4d06-bbc6-361af9948a80 tempest-VolumesSnapshotTestJSON-1388493826 tempest-VolumesSnapshotTestJSON-1388493826-project-member] detach device xml: <disk type="block" device="disk">
Nov 29 17:59:32 user nova-compute[74613]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 17:59:32 user nova-compute[74613]:   <source dev="/dev/sde"/>
Nov 29 17:59:32 user nova-compute[74613]:   <target dev="vdb" bus="virtio"/>
Nov 29 17:59:32 user nova-compute[74613]:   <serial>97d30677-4d07-468f-99d9-de70cdd5053e</serial>
Nov 29 17:59:32 user nova-compute[74613]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 29 17:59:32 user nova-compute[74613]: </disk>
Nov 29 17:59:32 user nova-compute[74613]:  {{(pid=74613) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 29 17:59:32 user nova-compute[74613]: INFO nova.virt.libvirt.driver [None req-0a890434-0980-4d06-bbc6-361af9948a80 tempest-VolumesSnapshotTestJSON-1388493826 tempest-VolumesSnapshotTestJSON-1388493826-project-member] Successfully detached device vdb from instance 356478b0-e233-46aa-a1bd-45ce1f9eca8f from the persistent domain config.
Nov 29 17:59:32 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-0a890434-0980-4d06-bbc6-361af9948a80 tempest-VolumesSnapshotTestJSON-1388493826 tempest-VolumesSnapshotTestJSON-1388493826-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 356478b0-e233-46aa-a1bd-45ce1f9eca8f from the live domain config. {{(pid=74613) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 29 17:59:32 user nova-compute[74613]: DEBUG nova.virt.libvirt.guest [None req-0a890434-0980-4d06-bbc6-361af9948a80 tempest-VolumesSnapshotTestJSON-1388493826 tempest-VolumesSnapshotTestJSON-1388493826-project-member] detach device xml: <disk type="block" device="disk">
Nov 29 17:59:32 user nova-compute[74613]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 17:59:32 user nova-compute[74613]:   <source dev="/dev/sde"/>
Nov 29 17:59:32 user nova-compute[74613]:   <target dev="vdb" bus="virtio"/>
Nov 29 17:59:32 user nova-compute[74613]:   <serial>97d30677-4d07-468f-99d9-de70cdd5053e</serial>
Nov 29 17:59:32 user nova-compute[74613]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 29 17:59:32 user nova-compute[74613]: </disk>
Nov 29 17:59:32 user nova-compute[74613]:  {{(pid=74613) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 29 17:59:32 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-4e6f7694-58ef-4abe-818c-d5c81c2d096e tempest-VolumesSnapshotTestJSON-1388493826 tempest-VolumesSnapshotTestJSON-1388493826-project-member] Acquiring lock "356478b0-e233-46aa-a1bd-45ce1f9eca8f" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 17:59:32 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-0a890434-0980-4d06-bbc6-361af9948a80 tempest-VolumesSnapshotTestJSON-1388493826 tempest-VolumesSnapshotTestJSON-1388493826-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 356478b0-e233-46aa-a1bd-45ce1f9eca8f {{(pid=74613) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 29 17:59:34 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:59:35 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:59:39 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:59:40 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:59:40 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:59:44 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:59:45 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:59:49 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:59:50 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:59:52 user nova-compute[74613]: WARNING nova.virt.libvirt.driver [None req-0a890434-0980-4d06-bbc6-361af9948a80 tempest-VolumesSnapshotTestJSON-1388493826 tempest-VolumesSnapshotTestJSON-1388493826-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 356478b0-e233-46aa-a1bd-45ce1f9eca8f is timed out.
Nov 29 17:59:52 user nova-compute[74613]: INFO nova.virt.libvirt.driver [None req-0a890434-0980-4d06-bbc6-361af9948a80 tempest-VolumesSnapshotTestJSON-1388493826 tempest-VolumesSnapshotTestJSON-1388493826-project-member] Successfully detached device vdb from instance 356478b0-e233-46aa-a1bd-45ce1f9eca8f from the live domain config.
Nov 29 17:59:52 user nova-compute[74613]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0a890434-0980-4d06-bbc6-361af9948a80 tempest-VolumesSnapshotTestJSON-1388493826 tempest-VolumesSnapshotTestJSON-1388493826-project-member] [instance: 356478b0-e233-46aa-a1bd-45ce1f9eca8f] calling os-brick to detach iSCSI Volume {{(pid=74613) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 29 17:59:52 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a890434-0980-4d06-bbc6-361af9948a80 tempest-VolumesSnapshotTestJSON-1388493826 tempest-VolumesSnapshotTestJSON-1388493826-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff828156890>, {'target_iqn': 'iqn.2010-10.org.openstack:97d30677-4d07-468f-99d9-de70cdd5053e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'bUOvuZlz', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': False}}" {{(pid=74613) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 17:59:52 user nova-compute[74613]: WARNING os_brick.initiator.connectors.base [None req-0a890434-0980-4d06-bbc6-361af9948a80 tempest-VolumesSnapshotTestJSON-1388493826 tempest-VolumesSnapshotTestJSON-1388493826-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 17:59:52 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.base [None req-0a890434-0980-4d06-bbc6-361af9948a80 tempest-VolumesSnapshotTestJSON-1388493826 tempest-VolumesSnapshotTestJSON-1388493826-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 17:59:52 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.base [None req-0a890434-0980-4d06-bbc6-361af9948a80 tempest-VolumesSnapshotTestJSON-1388493826 tempest-VolumesSnapshotTestJSON-1388493826-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 17:59:52 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 17:59:52 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 17:59:52 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[60ca5735-d81b-4520-ab41-3888a2b037cf]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:9511387c-8772-40f2-bf2d-6b6387649e9f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:72d22ffa-f425-4575-86a5-afbd8bb9cdd6\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:97d30677-4d07-468f-99d9-de70cdd5053e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:bb526b54-3017-4f30-b5c7-88027b146d52\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 17:59:52 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a890434-0980-4d06-bbc6-361af9948a80 tempest-VolumesSnapshotTestJSON-1388493826 tempest-VolumesSnapshotTestJSON-1388493826-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 29 17:59:52 user nova-compute[74613]: No targets found.
Nov 29 17:59:52 user nova-compute[74613]: iSNS:
Nov 29 17:59:52 user nova-compute[74613]: No targets found.
Nov 29 17:59:52 user nova-compute[74613]: STATIC:
Nov 29 17:59:52 user nova-compute[74613]: Target: iqn.2010-10.org.openstack:9511387c-8772-40f2-bf2d-6b6387649e9f
Nov 29 17:59:52 user nova-compute[74613]:         Portal: 172.16.0.220:3260,-1
Nov 29 17:59:52 user nova-compute[74613]:                 Iface Name: default
Nov 29 17:59:52 user nova-compute[74613]: Target: iqn.2010-10.org.openstack:72d22ffa-f425-4575-86a5-afbd8bb9cdd6
Nov 29 17:59:52 user nova-compute[74613]:         Portal: 172.16.0.220:3260,-1
Nov 29 17:59:52 user nova-compute[74613]:                 Iface Name: default
Nov 29 17:59:52 user nova-compute[74613]: Target: iqn.2010-10.org.openstack:97d30677-4d07-468f-99d9-de70cdd5053e
Nov 29 17:59:52 user nova-compute[74613]:         Portal: 172.16.0.220:3260,-1
Nov 29 17:59:52 user nova-compute[74613]:                 Iface Name: default
Nov 29 17:59:52 user nova-compute[74613]: Target: iqn.2010-10.org.openstack:bb526b54-3017-4f30-b5c7-88027b146d52
Nov 29 17:59:52 user nova-compute[74613]:         Portal: 172.16.0.220:3260,-1
Nov 29 17:59:52 user nova-compute[74613]:                 Iface Name: default
Nov 29 17:59:52 user nova-compute[74613]: FIRMWARE:
Nov 29 17:59:52 user nova-compute[74613]: No targets found.
Nov 29 17:59:52 user nova-compute[74613]:  stderr= {{(pid=74613) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 17:59:52 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a890434-0980-4d06-bbc6-361af9948a80 tempest-VolumesSnapshotTestJSON-1388493826 tempest-VolumesSnapshotTestJSON-1388493826-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 29 17:59:52 user nova-compute[74613]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 29 17:59:52 user nova-compute[74613]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74613) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 29 17:59:52 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a890434-0980-4d06-bbc6-361af9948a80 tempest-VolumesSnapshotTestJSON-1388493826 tempest-VolumesSnapshotTestJSON-1388493826-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:97d30677-4d07-468f-99d9-de70cdd5053e', 0)] {{(pid=74613) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 29 17:59:52 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 17:59:52 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.022s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 17:59:52 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a4171f2-d12a-4c7f-baa1-9537980d7095]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:72d22ffa-f425-4575-86a5-afbd8bb9cdd6\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9511387c-8772-40f2-bf2d-6b6387649e9f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:97d30677-4d07-468f-99d9-de70cdd5053e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:bb526b54-3017-4f30-b5c7-88027b146d52\n', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 17:59:52 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 17:59:52 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 17:59:52 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac7152b7-b27e-4da9-8d58-04c547e5e715]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9511387c-8772-40f2-bf2d-6b6387649e9f (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:72d22ffa-f425-4575-86a5-afbd8bb9cdd6 (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb526b54-3017-4f30-b5c7-88027b146d52 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:97d30677-4d07-468f-99d9-de70cdd5053e (non-flash)\n', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 17:59:52 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a890434-0980-4d06-bbc6-361af9948a80 tempest-VolumesSnapshotTestJSON-1388493826 tempest-VolumesSnapshotTestJSON-1388493826-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9511387c-8772-40f2-bf2d-6b6387649e9f (non-flash)
Nov 29 17:59:52 user nova-compute[74613]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:72d22ffa-f425-4575-86a5-afbd8bb9cdd6 (non-flash)
Nov 29 17:59:52 user nova-compute[74613]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb526b54-3017-4f30-b5c7-88027b146d52 (non-flash)
Nov 29 17:59:52 user nova-compute[74613]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:97d30677-4d07-468f-99d9-de70cdd5053e (non-flash)
Nov 29 17:59:52 user nova-compute[74613]:  stderr= {{(pid=74613) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 17:59:52 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a890434-0980-4d06-bbc6-361af9948a80 tempest-VolumesSnapshotTestJSON-1388493826 tempest-VolumesSnapshotTestJSON-1388493826-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9511387c-8772-40f2-bf2d-6b6387649e9f (non-flash)
Nov 29 17:59:52 user nova-compute[74613]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:72d22ffa-f425-4575-86a5-afbd8bb9cdd6 (non-flash)
Nov 29 17:59:52 user nova-compute[74613]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb526b54-3017-4f30-b5c7-88027b146d52 (non-flash)
Nov 29 17:59:52 user nova-compute[74613]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:97d30677-4d07-468f-99d9-de70cdd5053e (non-flash)
Nov 29 17:59:52 user nova-compute[74613]:  stderr= {{(pid=74613) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 17:59:52 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a890434-0980-4d06-bbc6-361af9948a80 tempest-VolumesSnapshotTestJSON-1388493826 tempest-VolumesSnapshotTestJSON-1388493826-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7ff8181100d0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:97d30677-4d07-468f-99d9-de70cdd5053e'): ({'sde'}, set())}) {{(pid=74613) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 29 17:59:52 user nova-compute[74613]: DEBUG os_brick.initiator.linuxscsi [None req-0a890434-0980-4d06-bbc6-361af9948a80 tempest-VolumesSnapshotTestJSON-1388493826 tempest-VolumesSnapshotTestJSON-1388493826-project-member] Removing single pathed devices sde {{(pid=74613) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 29 17:59:52 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 17:59:52 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 17:59:52 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[edea8d63-597c-4bb0-b44e-f932223c95fe]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 17:59:52 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 17:59:52 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.025s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 17:59:52 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[49841e18-c476-4986-847b-29b081f4b8fa]: (4, ('ok\n', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 17:59:52 user nova-compute[74613]: DEBUG os_brick.initiator.linuxscsi [None req-0a890434-0980-4d06-bbc6-361af9948a80 tempest-VolumesSnapshotTestJSON-1388493826 tempest-VolumesSnapshotTestJSON-1388493826-project-member] Flushing IO for device /dev/sde {{(pid=74613) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 29 17:59:52 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 17:59:52 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.016s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 17:59:52 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[83d5942d-05a9-4a81-86a0-c305f63a7fb1]: (4, ('', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 17:59:52 user nova-compute[74613]: DEBUG os_brick.initiator.linuxscsi [None req-0a890434-0980-4d06-bbc6-361af9948a80 tempest-VolumesSnapshotTestJSON-1388493826 tempest-VolumesSnapshotTestJSON-1388493826-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=74613) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 29 17:59:52 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 17:59:52 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.028s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 17:59:52 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[81711327-956a-4a0c-8114-bf65dc39661f]: (4, ('1', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 17:59:52 user nova-compute[74613]: DEBUG os_brick.initiator.linuxscsi [None req-0a890434-0980-4d06-bbc6-361af9948a80 tempest-VolumesSnapshotTestJSON-1388493826 tempest-VolumesSnapshotTestJSON-1388493826-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=74613) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 29 17:59:52 user nova-compute[74613]: DEBUG os_brick.initiator.linuxscsi [None req-0a890434-0980-4d06-bbc6-361af9948a80 tempest-VolumesSnapshotTestJSON-1388493826 tempest-VolumesSnapshotTestJSON-1388493826-project-member] SCSI volumes sde have been removed. {{(pid=74613) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 29 17:59:52 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a890434-0980-4d06-bbc6-361af9948a80 tempest-VolumesSnapshotTestJSON-1388493826 tempest-VolumesSnapshotTestJSON-1388493826-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:97d30677-4d07-468f-99d9-de70cdd5053e')] {{(pid=74613) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 29 17:59:52 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:97d30677-4d07-468f-99d9-de70cdd5053e -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 17:59:52 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:97d30677-4d07-468f-99d9-de70cdd5053e -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 17:59:52 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[643a2641-d1e5-4906-abcd-199af2e8bdea]: (4, ('', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 17:59:52 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a890434-0980-4d06-bbc6-361af9948a80 tempest-VolumesSnapshotTestJSON-1388493826 tempest-VolumesSnapshotTestJSON-1388493826-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74613) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 17:59:52 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:97d30677-4d07-468f-99d9-de70cdd5053e -p 172.16.0.220:3260 --logout {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 17:59:52 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:97d30677-4d07-468f-99d9-de70cdd5053e -p 172.16.0.220:3260 --logout" returned: 0 in 0.063s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 17:59:52 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c3e9f85-0a5c-45f1-a299-904d76ed8b71]: (4, ('Logging out of session [sid: 23, target: iqn.2010-10.org.openstack:97d30677-4d07-468f-99d9-de70cdd5053e, portal: 172.16.0.220,3260]\nLogout of [sid: 23, target: iqn.2010-10.org.openstack:97d30677-4d07-468f-99d9-de70cdd5053e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 17:59:52 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a890434-0980-4d06-bbc6-361af9948a80 tempest-VolumesSnapshotTestJSON-1388493826 tempest-VolumesSnapshotTestJSON-1388493826-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 23, target: iqn.2010-10.org.openstack:97d30677-4d07-468f-99d9-de70cdd5053e, portal: 172.16.0.220,3260]
Nov 29 17:59:52 user nova-compute[74613]: Logout of [sid: 23, target: iqn.2010-10.org.openstack:97d30677-4d07-468f-99d9-de70cdd5053e, portal: 172.16.0.220,3260] successful.
Nov 29 17:59:52 user nova-compute[74613]:  stderr= {{(pid=74613) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 17:59:52 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:97d30677-4d07-468f-99d9-de70cdd5053e -p 172.16.0.220:3260 --op delete {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 17:59:52 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:97d30677-4d07-468f-99d9-de70cdd5053e -p 172.16.0.220:3260 --op delete" returned: 0 in 0.028s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 17:59:52 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a5d7af5-e2d2-4b64-9808-cdad0d411fbc]: (4, ('', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 17:59:52 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a890434-0980-4d06-bbc6-361af9948a80 tempest-VolumesSnapshotTestJSON-1388493826 tempest-VolumesSnapshotTestJSON-1388493826-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74613) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 17:59:52 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.base [None req-0a890434-0980-4d06-bbc6-361af9948a80 tempest-VolumesSnapshotTestJSON-1388493826 tempest-VolumesSnapshotTestJSON-1388493826-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.317s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 17:59:52 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a890434-0980-4d06-bbc6-361af9948a80 tempest-VolumesSnapshotTestJSON-1388493826 tempest-VolumesSnapshotTestJSON-1388493826-project-member] <== disconnect_volume: return (318ms) None {{(pid=74613) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 17:59:52 user nova-compute[74613]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0a890434-0980-4d06-bbc6-361af9948a80 tempest-VolumesSnapshotTestJSON-1388493826 tempest-VolumesSnapshotTestJSON-1388493826-project-member] [instance: 356478b0-e233-46aa-a1bd-45ce1f9eca8f] Disconnected iSCSI Volume {{(pid=74613) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 29 17:59:53 user nova-compute[74613]: DEBUG nova.objects.instance [None req-0a890434-0980-4d06-bbc6-361af9948a80 tempest-VolumesSnapshotTestJSON-1388493826 tempest-VolumesSnapshotTestJSON-1388493826-project-member] Lazy-loading 'flavor' on Instance uuid 356478b0-e233-46aa-a1bd-45ce1f9eca8f {{(pid=74613) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 17:59:53 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-0a890434-0980-4d06-bbc6-361af9948a80 tempest-VolumesSnapshotTestJSON-1388493826 tempest-VolumesSnapshotTestJSON-1388493826-project-member] Lock "356478b0-e233-46aa-a1bd-45ce1f9eca8f" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.647s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 17:59:53 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-4e6f7694-58ef-4abe-818c-d5c81c2d096e tempest-VolumesSnapshotTestJSON-1388493826 tempest-VolumesSnapshotTestJSON-1388493826-project-member] Lock "356478b0-e233-46aa-a1bd-45ce1f9eca8f" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 21.519s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 17:59:53 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-4e6f7694-58ef-4abe-818c-d5c81c2d096e tempest-VolumesSnapshotTestJSON-1388493826 tempest-VolumesSnapshotTestJSON-1388493826-project-member] Acquiring lock "356478b0-e233-46aa-a1bd-45ce1f9eca8f-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 17:59:53 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-4e6f7694-58ef-4abe-818c-d5c81c2d096e tempest-VolumesSnapshotTestJSON-1388493826 tempest-VolumesSnapshotTestJSON-1388493826-project-member] Lock "356478b0-e233-46aa-a1bd-45ce1f9eca8f-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 17:59:53 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-4e6f7694-58ef-4abe-818c-d5c81c2d096e tempest-VolumesSnapshotTestJSON-1388493826 tempest-VolumesSnapshotTestJSON-1388493826-project-member] Lock "356478b0-e233-46aa-a1bd-45ce1f9eca8f-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 17:59:53 user nova-compute[74613]: INFO nova.compute.manager [None req-4e6f7694-58ef-4abe-818c-d5c81c2d096e tempest-VolumesSnapshotTestJSON-1388493826 tempest-VolumesSnapshotTestJSON-1388493826-project-member] [instance: 356478b0-e233-46aa-a1bd-45ce1f9eca8f] Terminating instance
Nov 29 17:59:53 user nova-compute[74613]: DEBUG nova.compute.manager [None req-4e6f7694-58ef-4abe-818c-d5c81c2d096e tempest-VolumesSnapshotTestJSON-1388493826 tempest-VolumesSnapshotTestJSON-1388493826-project-member] [instance: 356478b0-e233-46aa-a1bd-45ce1f9eca8f] Start destroying the instance on the hypervisor. {{(pid=74613) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 29 17:59:53 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:59:53 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:59:53 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:59:53 user nova-compute[74613]: DEBUG nova.compute.manager [req-5ece73c2-da97-4098-bc68-88c2315b5bf3 req-819411e8-c41c-4fe3-9594-06b4f942e26c service nova] [instance: 356478b0-e233-46aa-a1bd-45ce1f9eca8f] Received event network-vif-unplugged-22b97a14-1376-4183-a2ef-27a98a891bb9 {{(pid=74613) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 17:59:53 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-5ece73c2-da97-4098-bc68-88c2315b5bf3 req-819411e8-c41c-4fe3-9594-06b4f942e26c service nova] Acquiring lock "356478b0-e233-46aa-a1bd-45ce1f9eca8f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 17:59:53 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-5ece73c2-da97-4098-bc68-88c2315b5bf3 req-819411e8-c41c-4fe3-9594-06b4f942e26c service nova] Lock "356478b0-e233-46aa-a1bd-45ce1f9eca8f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 17:59:53 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-5ece73c2-da97-4098-bc68-88c2315b5bf3 req-819411e8-c41c-4fe3-9594-06b4f942e26c service nova] Lock "356478b0-e233-46aa-a1bd-45ce1f9eca8f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 17:59:53 user nova-compute[74613]: DEBUG nova.compute.manager [req-5ece73c2-da97-4098-bc68-88c2315b5bf3 req-819411e8-c41c-4fe3-9594-06b4f942e26c service nova] [instance: 356478b0-e233-46aa-a1bd-45ce1f9eca8f] No waiting events found dispatching network-vif-unplugged-22b97a14-1376-4183-a2ef-27a98a891bb9 {{(pid=74613) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 17:59:53 user nova-compute[74613]: DEBUG nova.compute.manager [req-5ece73c2-da97-4098-bc68-88c2315b5bf3 req-819411e8-c41c-4fe3-9594-06b4f942e26c service nova] [instance: 356478b0-e233-46aa-a1bd-45ce1f9eca8f] Received event network-vif-unplugged-22b97a14-1376-4183-a2ef-27a98a891bb9 for instance with task_state deleting. {{(pid=74613) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 29 17:59:54 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:59:54 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:59:54 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:59:54 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:59:54 user nova-compute[74613]: INFO nova.virt.libvirt.driver [-] [instance: 356478b0-e233-46aa-a1bd-45ce1f9eca8f] Instance destroyed successfully.
Nov 29 17:59:54 user nova-compute[74613]: DEBUG nova.objects.instance [None req-4e6f7694-58ef-4abe-818c-d5c81c2d096e tempest-VolumesSnapshotTestJSON-1388493826 tempest-VolumesSnapshotTestJSON-1388493826-project-member] Lazy-loading 'resources' on Instance uuid 356478b0-e233-46aa-a1bd-45ce1f9eca8f {{(pid=74613) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 17:59:54 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:59:54 user nova-compute[74613]: DEBUG nova.virt.libvirt.vif [None req-4e6f7694-58ef-4abe-818c-d5c81c2d096e tempest-VolumesSnapshotTestJSON-1388493826 tempest-VolumesSnapshotTestJSON-1388493826-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T17:57:02Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-1467786171',display_name='tempest-VolumesSnapshotTestJSON-instance-1467786171',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-1467786171',id=18,image_ref='4217f428-8d9d-4ee1-9614-642d26d90c46',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBItcjyQv5JE5O5Bk4IFr8DNRQUnKsWBNks6GyV9R8gRqwRwhS6Bnv5C1qXLJC8jbTDF7hA1uMgoah1kQfiVWn2WhmC5JGbECo8euuya+VYnBksW+a3r58TXU1UJ4eIp9wg==',key_name='tempest-keypair-1251454955',keypairs=<?>,launch_index=0,launched_at=2023-11-29T17:57:09Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='a9ec113a97bd40c4b68d3738c64ece01',ramdisk_id='',reservation_id='r-jx9w3kac',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='4217f428-8d9d-4ee1-9614-642d26d90c46',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesSnapshotTestJSON-1388493826',owner_user_name='tempest-VolumesSnapshotTestJSON-1388493826-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-29T17:57:10Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5fd84795e6684327998b0f52f5941f86',uuid=356478b0-e233-46aa-a1bd-45ce1f9eca8f,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "22b97a14-1376-4183-a2ef-27a98a891bb9", "address": "fa:16:3e:42:a7:9e", "network": {"id": "4cc7e4ab-28a3-431a-9855-22009278b949", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1066409623-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.47", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a9ec113a97bd40c4b68d3738c64ece01", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap22b97a14-13", "ovs_interfaceid": "22b97a14-1376-4183-a2ef-27a98a891bb9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74613) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 29 17:59:54 user nova-compute[74613]: DEBUG nova.network.os_vif_util [None req-4e6f7694-58ef-4abe-818c-d5c81c2d096e tempest-VolumesSnapshotTestJSON-1388493826 tempest-VolumesSnapshotTestJSON-1388493826-project-member] Converting VIF {"id": "22b97a14-1376-4183-a2ef-27a98a891bb9", "address": "fa:16:3e:42:a7:9e", "network": {"id": "4cc7e4ab-28a3-431a-9855-22009278b949", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1066409623-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.47", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a9ec113a97bd40c4b68d3738c64ece01", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap22b97a14-13", "ovs_interfaceid": "22b97a14-1376-4183-a2ef-27a98a891bb9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74613) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 17:59:54 user nova-compute[74613]: DEBUG nova.network.os_vif_util [None req-4e6f7694-58ef-4abe-818c-d5c81c2d096e tempest-VolumesSnapshotTestJSON-1388493826 tempest-VolumesSnapshotTestJSON-1388493826-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:42:a7:9e,bridge_name='br-int',has_traffic_filtering=True,id=22b97a14-1376-4183-a2ef-27a98a891bb9,network=Network(4cc7e4ab-28a3-431a-9855-22009278b949),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap22b97a14-13') {{(pid=74613) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 17:59:54 user nova-compute[74613]: DEBUG os_vif [None req-4e6f7694-58ef-4abe-818c-d5c81c2d096e tempest-VolumesSnapshotTestJSON-1388493826 tempest-VolumesSnapshotTestJSON-1388493826-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:42:a7:9e,bridge_name='br-int',has_traffic_filtering=True,id=22b97a14-1376-4183-a2ef-27a98a891bb9,network=Network(4cc7e4ab-28a3-431a-9855-22009278b949),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap22b97a14-13') {{(pid=74613) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 29 17:59:54 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:59:54 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap22b97a14-13, bridge=br-int, if_exists=True) {{(pid=74613) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 17:59:54 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:59:54 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 17:59:54 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:59:54 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=055ba8fb-98bb-4a65-b8da-c21cc2967077) {{(pid=74613) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 17:59:54 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:59:54 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:59:54 user nova-compute[74613]: INFO os_vif [None req-4e6f7694-58ef-4abe-818c-d5c81c2d096e tempest-VolumesSnapshotTestJSON-1388493826 tempest-VolumesSnapshotTestJSON-1388493826-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:42:a7:9e,bridge_name='br-int',has_traffic_filtering=True,id=22b97a14-1376-4183-a2ef-27a98a891bb9,network=Network(4cc7e4ab-28a3-431a-9855-22009278b949),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap22b97a14-13')
Nov 29 17:59:54 user nova-compute[74613]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4e6f7694-58ef-4abe-818c-d5c81c2d096e tempest-VolumesSnapshotTestJSON-1388493826 tempest-VolumesSnapshotTestJSON-1388493826-project-member] [instance: 356478b0-e233-46aa-a1bd-45ce1f9eca8f] calling os-brick to detach iSCSI Volume {{(pid=74613) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 29 17:59:54 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e6f7694-58ef-4abe-818c-d5c81c2d096e tempest-VolumesSnapshotTestJSON-1388493826 tempest-VolumesSnapshotTestJSON-1388493826-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff828156890>, {'target_iqn': 'iqn.2010-10.org.openstack:97d30677-4d07-468f-99d9-de70cdd5053e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'bUOvuZlz', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': True}}" {{(pid=74613) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 17:59:54 user nova-compute[74613]: WARNING os_brick.initiator.connectors.base [None req-4e6f7694-58ef-4abe-818c-d5c81c2d096e tempest-VolumesSnapshotTestJSON-1388493826 tempest-VolumesSnapshotTestJSON-1388493826-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 17:59:54 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.base [None req-4e6f7694-58ef-4abe-818c-d5c81c2d096e tempest-VolumesSnapshotTestJSON-1388493826 tempest-VolumesSnapshotTestJSON-1388493826-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 17:59:54 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.base [None req-4e6f7694-58ef-4abe-818c-d5c81c2d096e tempest-VolumesSnapshotTestJSON-1388493826 tempest-VolumesSnapshotTestJSON-1388493826-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 17:59:54 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 17:59:54 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 17:59:54 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d5a9a5e-85f8-4ba1-8f08-eb607412712d]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:9511387c-8772-40f2-bf2d-6b6387649e9f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:72d22ffa-f425-4575-86a5-afbd8bb9cdd6\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:bb526b54-3017-4f30-b5c7-88027b146d52\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 17:59:54 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e6f7694-58ef-4abe-818c-d5c81c2d096e tempest-VolumesSnapshotTestJSON-1388493826 tempest-VolumesSnapshotTestJSON-1388493826-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 29 17:59:54 user nova-compute[74613]: No targets found.
Nov 29 17:59:54 user nova-compute[74613]: iSNS:
Nov 29 17:59:54 user nova-compute[74613]: No targets found.
Nov 29 17:59:54 user nova-compute[74613]: STATIC:
Nov 29 17:59:54 user nova-compute[74613]: Target: iqn.2010-10.org.openstack:9511387c-8772-40f2-bf2d-6b6387649e9f
Nov 29 17:59:54 user nova-compute[74613]:         Portal: 172.16.0.220:3260,-1
Nov 29 17:59:54 user nova-compute[74613]:                 Iface Name: default
Nov 29 17:59:54 user nova-compute[74613]: Target: iqn.2010-10.org.openstack:72d22ffa-f425-4575-86a5-afbd8bb9cdd6
Nov 29 17:59:54 user nova-compute[74613]:         Portal: 172.16.0.220:3260,-1
Nov 29 17:59:54 user nova-compute[74613]:                 Iface Name: default
Nov 29 17:59:54 user nova-compute[74613]: Target: iqn.2010-10.org.openstack:bb526b54-3017-4f30-b5c7-88027b146d52
Nov 29 17:59:54 user nova-compute[74613]:         Portal: 172.16.0.220:3260,-1
Nov 29 17:59:54 user nova-compute[74613]:                 Iface Name: default
Nov 29 17:59:54 user nova-compute[74613]: FIRMWARE:
Nov 29 17:59:54 user nova-compute[74613]: No targets found.
Nov 29 17:59:54 user nova-compute[74613]:  stderr= {{(pid=74613) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 17:59:54 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e6f7694-58ef-4abe-818c-d5c81c2d096e tempest-VolumesSnapshotTestJSON-1388493826 tempest-VolumesSnapshotTestJSON-1388493826-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 29 17:59:54 user nova-compute[74613]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 29 17:59:54 user nova-compute[74613]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74613) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 29 17:59:54 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e6f7694-58ef-4abe-818c-d5c81c2d096e tempest-VolumesSnapshotTestJSON-1388493826 tempest-VolumesSnapshotTestJSON-1388493826-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:97d30677-4d07-468f-99d9-de70cdd5053e', 0)] {{(pid=74613) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 29 17:59:54 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 17:59:54 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 17:59:54 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc1c54db-98bf-480e-aa4a-977de5eb9dda]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:72d22ffa-f425-4575-86a5-afbd8bb9cdd6\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9511387c-8772-40f2-bf2d-6b6387649e9f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:bb526b54-3017-4f30-b5c7-88027b146d52\n', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 17:59:54 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 17:59:54 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 17:59:54 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c49d038-a7ef-4bef-af3b-98d9b50e59b5]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9511387c-8772-40f2-bf2d-6b6387649e9f (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:72d22ffa-f425-4575-86a5-afbd8bb9cdd6 (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb526b54-3017-4f30-b5c7-88027b146d52 (non-flash)\n', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 17:59:54 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e6f7694-58ef-4abe-818c-d5c81c2d096e tempest-VolumesSnapshotTestJSON-1388493826 tempest-VolumesSnapshotTestJSON-1388493826-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9511387c-8772-40f2-bf2d-6b6387649e9f (non-flash)
Nov 29 17:59:54 user nova-compute[74613]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:72d22ffa-f425-4575-86a5-afbd8bb9cdd6 (non-flash)
Nov 29 17:59:54 user nova-compute[74613]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb526b54-3017-4f30-b5c7-88027b146d52 (non-flash)
Nov 29 17:59:54 user nova-compute[74613]:  stderr= {{(pid=74613) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 17:59:54 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e6f7694-58ef-4abe-818c-d5c81c2d096e tempest-VolumesSnapshotTestJSON-1388493826 tempest-VolumesSnapshotTestJSON-1388493826-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9511387c-8772-40f2-bf2d-6b6387649e9f (non-flash)
Nov 29 17:59:54 user nova-compute[74613]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:72d22ffa-f425-4575-86a5-afbd8bb9cdd6 (non-flash)
Nov 29 17:59:54 user nova-compute[74613]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb526b54-3017-4f30-b5c7-88027b146d52 (non-flash)
Nov 29 17:59:54 user nova-compute[74613]:  stderr= {{(pid=74613) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 17:59:54 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e6f7694-58ef-4abe-818c-d5c81c2d096e tempest-VolumesSnapshotTestJSON-1388493826 tempest-VolumesSnapshotTestJSON-1388493826-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7ff818110b80>, {}) {{(pid=74613) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 29 17:59:54 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e6f7694-58ef-4abe-818c-d5c81c2d096e tempest-VolumesSnapshotTestJSON-1388493826 tempest-VolumesSnapshotTestJSON-1388493826-project-member] Disconnecting from: [] {{(pid=74613) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 29 17:59:54 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.base [None req-4e6f7694-58ef-4abe-818c-d5c81c2d096e tempest-VolumesSnapshotTestJSON-1388493826 tempest-VolumesSnapshotTestJSON-1388493826-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.079s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 17:59:54 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e6f7694-58ef-4abe-818c-d5c81c2d096e tempest-VolumesSnapshotTestJSON-1388493826 tempest-VolumesSnapshotTestJSON-1388493826-project-member] <== disconnect_volume: return (80ms) None {{(pid=74613) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 17:59:54 user nova-compute[74613]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4e6f7694-58ef-4abe-818c-d5c81c2d096e tempest-VolumesSnapshotTestJSON-1388493826 tempest-VolumesSnapshotTestJSON-1388493826-project-member] [instance: 356478b0-e233-46aa-a1bd-45ce1f9eca8f] Disconnected iSCSI Volume {{(pid=74613) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 29 17:59:54 user nova-compute[74613]: INFO nova.virt.libvirt.driver [None req-4e6f7694-58ef-4abe-818c-d5c81c2d096e tempest-VolumesSnapshotTestJSON-1388493826 tempest-VolumesSnapshotTestJSON-1388493826-project-member] [instance: 356478b0-e233-46aa-a1bd-45ce1f9eca8f] Deleting instance files /opt/stack/data/nova/instances/356478b0-e233-46aa-a1bd-45ce1f9eca8f_del
Nov 29 17:59:54 user nova-compute[74613]: INFO nova.virt.libvirt.driver [None req-4e6f7694-58ef-4abe-818c-d5c81c2d096e tempest-VolumesSnapshotTestJSON-1388493826 tempest-VolumesSnapshotTestJSON-1388493826-project-member] [instance: 356478b0-e233-46aa-a1bd-45ce1f9eca8f] Deletion of /opt/stack/data/nova/instances/356478b0-e233-46aa-a1bd-45ce1f9eca8f_del complete
Nov 29 17:59:54 user nova-compute[74613]: INFO nova.compute.manager [None req-4e6f7694-58ef-4abe-818c-d5c81c2d096e tempest-VolumesSnapshotTestJSON-1388493826 tempest-VolumesSnapshotTestJSON-1388493826-project-member] [instance: 356478b0-e233-46aa-a1bd-45ce1f9eca8f] Took 0.97 seconds to destroy the instance on the hypervisor.
Nov 29 17:59:54 user nova-compute[74613]: DEBUG oslo.service.loopingcall [None req-4e6f7694-58ef-4abe-818c-d5c81c2d096e tempest-VolumesSnapshotTestJSON-1388493826 tempest-VolumesSnapshotTestJSON-1388493826-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74613) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 29 17:59:54 user nova-compute[74613]: DEBUG nova.compute.manager [-] [instance: 356478b0-e233-46aa-a1bd-45ce1f9eca8f] Deallocating network for instance {{(pid=74613) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 29 17:59:54 user nova-compute[74613]: DEBUG nova.network.neutron [-] [instance: 356478b0-e233-46aa-a1bd-45ce1f9eca8f] deallocate_for_instance() {{(pid=74613) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 29 17:59:55 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:59:55 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:59:55 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:59:55 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:59:55 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:59:55 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 17:59:55 user nova-compute[74613]: DEBUG nova.network.neutron [-] [instance: 356478b0-e233-46aa-a1bd-45ce1f9eca8f] Updating instance_info_cache with network_info: [] {{(pid=74613) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 17:59:55 user nova-compute[74613]: INFO nova.compute.manager [-] [instance: 356478b0-e233-46aa-a1bd-45ce1f9eca8f] Took 0.82 seconds to deallocate network for instance.
Nov 29 17:59:55 user nova-compute[74613]: DEBUG nova.compute.manager [req-4b347704-4838-498b-b968-1c4c560269de req-44c6c6e4-28c2-47f9-8c9f-cd6447c16989 service nova] [instance: 356478b0-e233-46aa-a1bd-45ce1f9eca8f] Received event network-vif-deleted-22b97a14-1376-4183-a2ef-27a98a891bb9 {{(pid=74613) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 17:59:55 user nova-compute[74613]: INFO nova.compute.manager [req-4b347704-4838-498b-b968-1c4c560269de req-44c6c6e4-28c2-47f9-8c9f-cd6447c16989 service nova] [instance: 356478b0-e233-46aa-a1bd-45ce1f9eca8f] Neutron deleted interface 22b97a14-1376-4183-a2ef-27a98a891bb9; detaching it from the instance and deleting it from the info cache
Nov 29 17:59:55 user nova-compute[74613]: DEBUG nova.network.neutron [req-4b347704-4838-498b-b968-1c4c560269de req-44c6c6e4-28c2-47f9-8c9f-cd6447c16989 service nova] [instance: 356478b0-e233-46aa-a1bd-45ce1f9eca8f] Updating instance_info_cache with network_info: [] {{(pid=74613) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 17:59:55 user nova-compute[74613]: DEBUG nova.compute.manager [req-4b347704-4838-498b-b968-1c4c560269de req-44c6c6e4-28c2-47f9-8c9f-cd6447c16989 service nova] [instance: 356478b0-e233-46aa-a1bd-45ce1f9eca8f] Detach interface failed, port_id=22b97a14-1376-4183-a2ef-27a98a891bb9, reason: Instance 356478b0-e233-46aa-a1bd-45ce1f9eca8f could not be found. {{(pid=74613) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 29 17:59:55 user nova-compute[74613]: WARNING nova.volume.cinder [None req-4e6f7694-58ef-4abe-818c-d5c81c2d096e tempest-VolumesSnapshotTestJSON-1388493826 tempest-VolumesSnapshotTestJSON-1388493826-project-member] Attachment 37c4f832-7ca8-4e10-8c52-a9d309c8f392 does not exist. Ignoring.: cinderclient.exceptions.NotFound: Volume attachment could not be found with filter: attachment_id = 37c4f832-7ca8-4e10-8c52-a9d309c8f392. (HTTP 404) (Request-ID: req-2d6601b8-f874-4418-b222-ac44518e9707)
Nov 29 17:59:55 user nova-compute[74613]: INFO nova.compute.manager [None req-4e6f7694-58ef-4abe-818c-d5c81c2d096e tempest-VolumesSnapshotTestJSON-1388493826 tempest-VolumesSnapshotTestJSON-1388493826-project-member] [instance: 356478b0-e233-46aa-a1bd-45ce1f9eca8f] Took 0.04 seconds to detach 1 volumes for instance.
Nov 29 17:59:55 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-4e6f7694-58ef-4abe-818c-d5c81c2d096e tempest-VolumesSnapshotTestJSON-1388493826 tempest-VolumesSnapshotTestJSON-1388493826-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 17:59:55 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-4e6f7694-58ef-4abe-818c-d5c81c2d096e tempest-VolumesSnapshotTestJSON-1388493826 tempest-VolumesSnapshotTestJSON-1388493826-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 17:59:55 user nova-compute[74613]: DEBUG nova.compute.provider_tree [None req-4e6f7694-58ef-4abe-818c-d5c81c2d096e tempest-VolumesSnapshotTestJSON-1388493826 tempest-VolumesSnapshotTestJSON-1388493826-project-member] Inventory has not changed in ProviderTree for provider: 639d980e-3b12-44b1-b8f4-1812416fa4dd {{(pid=74613) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 17:59:55 user nova-compute[74613]: DEBUG nova.scheduler.client.report [None req-4e6f7694-58ef-4abe-818c-d5c81c2d096e tempest-VolumesSnapshotTestJSON-1388493826 tempest-VolumesSnapshotTestJSON-1388493826-project-member] Inventory has not changed for provider 639d980e-3b12-44b1-b8f4-1812416fa4dd based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74613) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 17:59:56 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-4e6f7694-58ef-4abe-818c-d5c81c2d096e tempest-VolumesSnapshotTestJSON-1388493826 tempest-VolumesSnapshotTestJSON-1388493826-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.407s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 17:59:56 user nova-compute[74613]: DEBUG nova.compute.manager [req-43601b2b-d3cf-4bb2-988c-57be3df7c268 req-4f18afc1-43a7-4b8a-b9c5-a308fde20818 service nova] [instance: 356478b0-e233-46aa-a1bd-45ce1f9eca8f] Received event network-vif-plugged-22b97a14-1376-4183-a2ef-27a98a891bb9 {{(pid=74613) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 17:59:56 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-43601b2b-d3cf-4bb2-988c-57be3df7c268 req-4f18afc1-43a7-4b8a-b9c5-a308fde20818 service nova] Acquiring lock "356478b0-e233-46aa-a1bd-45ce1f9eca8f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 17:59:56 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-43601b2b-d3cf-4bb2-988c-57be3df7c268 req-4f18afc1-43a7-4b8a-b9c5-a308fde20818 service nova] Lock "356478b0-e233-46aa-a1bd-45ce1f9eca8f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 17:59:56 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-43601b2b-d3cf-4bb2-988c-57be3df7c268 req-4f18afc1-43a7-4b8a-b9c5-a308fde20818 service nova] Lock "356478b0-e233-46aa-a1bd-45ce1f9eca8f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 17:59:56 user nova-compute[74613]: DEBUG nova.compute.manager [req-43601b2b-d3cf-4bb2-988c-57be3df7c268 req-4f18afc1-43a7-4b8a-b9c5-a308fde20818 service nova] [instance: 356478b0-e233-46aa-a1bd-45ce1f9eca8f] No waiting events found dispatching network-vif-plugged-22b97a14-1376-4183-a2ef-27a98a891bb9 {{(pid=74613) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 17:59:56 user nova-compute[74613]: WARNING nova.compute.manager [req-43601b2b-d3cf-4bb2-988c-57be3df7c268 req-4f18afc1-43a7-4b8a-b9c5-a308fde20818 service nova] [instance: 356478b0-e233-46aa-a1bd-45ce1f9eca8f] Received unexpected event network-vif-plugged-22b97a14-1376-4183-a2ef-27a98a891bb9 for instance with vm_state deleted and task_state None.
Nov 29 17:59:56 user nova-compute[74613]: DEBUG nova.compute.manager [req-43601b2b-d3cf-4bb2-988c-57be3df7c268 req-4f18afc1-43a7-4b8a-b9c5-a308fde20818 service nova] [instance: 356478b0-e233-46aa-a1bd-45ce1f9eca8f] Received event network-vif-plugged-22b97a14-1376-4183-a2ef-27a98a891bb9 {{(pid=74613) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 17:59:56 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-43601b2b-d3cf-4bb2-988c-57be3df7c268 req-4f18afc1-43a7-4b8a-b9c5-a308fde20818 service nova] Acquiring lock "356478b0-e233-46aa-a1bd-45ce1f9eca8f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 17:59:56 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-43601b2b-d3cf-4bb2-988c-57be3df7c268 req-4f18afc1-43a7-4b8a-b9c5-a308fde20818 service nova] Lock "356478b0-e233-46aa-a1bd-45ce1f9eca8f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 17:59:56 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-43601b2b-d3cf-4bb2-988c-57be3df7c268 req-4f18afc1-43a7-4b8a-b9c5-a308fde20818 service nova] Lock "356478b0-e233-46aa-a1bd-45ce1f9eca8f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 17:59:56 user nova-compute[74613]: DEBUG nova.compute.manager [req-43601b2b-d3cf-4bb2-988c-57be3df7c268 req-4f18afc1-43a7-4b8a-b9c5-a308fde20818 service nova] [instance: 356478b0-e233-46aa-a1bd-45ce1f9eca8f] No waiting events found dispatching network-vif-plugged-22b97a14-1376-4183-a2ef-27a98a891bb9 {{(pid=74613) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 17:59:56 user nova-compute[74613]: WARNING nova.compute.manager [req-43601b2b-d3cf-4bb2-988c-57be3df7c268 req-4f18afc1-43a7-4b8a-b9c5-a308fde20818 service nova] [instance: 356478b0-e233-46aa-a1bd-45ce1f9eca8f] Received unexpected event network-vif-plugged-22b97a14-1376-4183-a2ef-27a98a891bb9 for instance with vm_state deleted and task_state None.
Nov 29 17:59:56 user nova-compute[74613]: DEBUG nova.compute.manager [req-43601b2b-d3cf-4bb2-988c-57be3df7c268 req-4f18afc1-43a7-4b8a-b9c5-a308fde20818 service nova] [instance: 356478b0-e233-46aa-a1bd-45ce1f9eca8f] Received event network-vif-plugged-22b97a14-1376-4183-a2ef-27a98a891bb9 {{(pid=74613) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 17:59:56 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-43601b2b-d3cf-4bb2-988c-57be3df7c268 req-4f18afc1-43a7-4b8a-b9c5-a308fde20818 service nova] Acquiring lock "356478b0-e233-46aa-a1bd-45ce1f9eca8f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 17:59:56 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-43601b2b-d3cf-4bb2-988c-57be3df7c268 req-4f18afc1-43a7-4b8a-b9c5-a308fde20818 service nova] Lock "356478b0-e233-46aa-a1bd-45ce1f9eca8f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 17:59:56 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-43601b2b-d3cf-4bb2-988c-57be3df7c268 req-4f18afc1-43a7-4b8a-b9c5-a308fde20818 service nova] Lock "356478b0-e233-46aa-a1bd-45ce1f9eca8f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 17:59:56 user nova-compute[74613]: DEBUG nova.compute.manager [req-43601b2b-d3cf-4bb2-988c-57be3df7c268 req-4f18afc1-43a7-4b8a-b9c5-a308fde20818 service nova] [instance: 356478b0-e233-46aa-a1bd-45ce1f9eca8f] No waiting events found dispatching network-vif-plugged-22b97a14-1376-4183-a2ef-27a98a891bb9 {{(pid=74613) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 17:59:56 user nova-compute[74613]: WARNING nova.compute.manager [req-43601b2b-d3cf-4bb2-988c-57be3df7c268 req-4f18afc1-43a7-4b8a-b9c5-a308fde20818 service nova] [instance: 356478b0-e233-46aa-a1bd-45ce1f9eca8f] Received unexpected event network-vif-plugged-22b97a14-1376-4183-a2ef-27a98a891bb9 for instance with vm_state deleted and task_state None.
Nov 29 17:59:56 user nova-compute[74613]: DEBUG nova.compute.manager [req-43601b2b-d3cf-4bb2-988c-57be3df7c268 req-4f18afc1-43a7-4b8a-b9c5-a308fde20818 service nova] [instance: 356478b0-e233-46aa-a1bd-45ce1f9eca8f] Received event network-vif-unplugged-22b97a14-1376-4183-a2ef-27a98a891bb9 {{(pid=74613) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 17:59:56 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-43601b2b-d3cf-4bb2-988c-57be3df7c268 req-4f18afc1-43a7-4b8a-b9c5-a308fde20818 service nova] Acquiring lock "356478b0-e233-46aa-a1bd-45ce1f9eca8f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 17:59:56 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-43601b2b-d3cf-4bb2-988c-57be3df7c268 req-4f18afc1-43a7-4b8a-b9c5-a308fde20818 service nova] Lock "356478b0-e233-46aa-a1bd-45ce1f9eca8f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 17:59:56 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-43601b2b-d3cf-4bb2-988c-57be3df7c268 req-4f18afc1-43a7-4b8a-b9c5-a308fde20818 service nova] Lock "356478b0-e233-46aa-a1bd-45ce1f9eca8f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 17:59:56 user nova-compute[74613]: DEBUG nova.compute.manager [req-43601b2b-d3cf-4bb2-988c-57be3df7c268 req-4f18afc1-43a7-4b8a-b9c5-a308fde20818 service nova] [instance: 356478b0-e233-46aa-a1bd-45ce1f9eca8f] No waiting events found dispatching network-vif-unplugged-22b97a14-1376-4183-a2ef-27a98a891bb9 {{(pid=74613) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 17:59:56 user nova-compute[74613]: WARNING nova.compute.manager [req-43601b2b-d3cf-4bb2-988c-57be3df7c268 req-4f18afc1-43a7-4b8a-b9c5-a308fde20818 service nova] [instance: 356478b0-e233-46aa-a1bd-45ce1f9eca8f] Received unexpected event network-vif-unplugged-22b97a14-1376-4183-a2ef-27a98a891bb9 for instance with vm_state deleted and task_state None.
Nov 29 17:59:56 user nova-compute[74613]: DEBUG nova.compute.manager [req-43601b2b-d3cf-4bb2-988c-57be3df7c268 req-4f18afc1-43a7-4b8a-b9c5-a308fde20818 service nova] [instance: 356478b0-e233-46aa-a1bd-45ce1f9eca8f] Received event network-vif-plugged-22b97a14-1376-4183-a2ef-27a98a891bb9 {{(pid=74613) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 17:59:56 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-43601b2b-d3cf-4bb2-988c-57be3df7c268 req-4f18afc1-43a7-4b8a-b9c5-a308fde20818 service nova] Acquiring lock "356478b0-e233-46aa-a1bd-45ce1f9eca8f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 17:59:56 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-43601b2b-d3cf-4bb2-988c-57be3df7c268 req-4f18afc1-43a7-4b8a-b9c5-a308fde20818 service nova] Lock "356478b0-e233-46aa-a1bd-45ce1f9eca8f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 17:59:56 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-43601b2b-d3cf-4bb2-988c-57be3df7c268 req-4f18afc1-43a7-4b8a-b9c5-a308fde20818 service nova] Lock "356478b0-e233-46aa-a1bd-45ce1f9eca8f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 17:59:56 user nova-compute[74613]: DEBUG nova.compute.manager [req-43601b2b-d3cf-4bb2-988c-57be3df7c268 req-4f18afc1-43a7-4b8a-b9c5-a308fde20818 service nova] [instance: 356478b0-e233-46aa-a1bd-45ce1f9eca8f] No waiting events found dispatching network-vif-plugged-22b97a14-1376-4183-a2ef-27a98a891bb9 {{(pid=74613) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 17:59:56 user nova-compute[74613]: WARNING nova.compute.manager [req-43601b2b-d3cf-4bb2-988c-57be3df7c268 req-4f18afc1-43a7-4b8a-b9c5-a308fde20818 service nova] [instance: 356478b0-e233-46aa-a1bd-45ce1f9eca8f] Received unexpected event network-vif-plugged-22b97a14-1376-4183-a2ef-27a98a891bb9 for instance with vm_state deleted and task_state None.
Nov 29 17:59:56 user nova-compute[74613]: INFO nova.scheduler.client.report [None req-4e6f7694-58ef-4abe-818c-d5c81c2d096e tempest-VolumesSnapshotTestJSON-1388493826 tempest-VolumesSnapshotTestJSON-1388493826-project-member] Deleted allocations for instance 356478b0-e233-46aa-a1bd-45ce1f9eca8f
Nov 29 17:59:56 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-4e6f7694-58ef-4abe-818c-d5c81c2d096e tempest-VolumesSnapshotTestJSON-1388493826 tempest-VolumesSnapshotTestJSON-1388493826-project-member] Lock "356478b0-e233-46aa-a1bd-45ce1f9eca8f" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.434s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 17:59:59 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:00:00 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:00:00 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-79cda9f1-69ee-450a-b11f-60ade93a2a30 tempest-ServerBootFromVolumeStableRescueTest-414665510 tempest-ServerBootFromVolumeStableRescueTest-414665510-project-member] Acquiring lock "8fc8496b-1435-4b5f-8977-6c0d7467ef65" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 18:00:00 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-79cda9f1-69ee-450a-b11f-60ade93a2a30 tempest-ServerBootFromVolumeStableRescueTest-414665510 tempest-ServerBootFromVolumeStableRescueTest-414665510-project-member] Lock "8fc8496b-1435-4b5f-8977-6c0d7467ef65" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.002s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 18:00:00 user nova-compute[74613]: DEBUG nova.compute.manager [None req-79cda9f1-69ee-450a-b11f-60ade93a2a30 tempest-ServerBootFromVolumeStableRescueTest-414665510 tempest-ServerBootFromVolumeStableRescueTest-414665510-project-member] [instance: 8fc8496b-1435-4b5f-8977-6c0d7467ef65] Starting instance... {{(pid=74613) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 29 18:00:00 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-79cda9f1-69ee-450a-b11f-60ade93a2a30 tempest-ServerBootFromVolumeStableRescueTest-414665510 tempest-ServerBootFromVolumeStableRescueTest-414665510-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 18:00:00 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-79cda9f1-69ee-450a-b11f-60ade93a2a30 tempest-ServerBootFromVolumeStableRescueTest-414665510 tempest-ServerBootFromVolumeStableRescueTest-414665510-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 18:00:00 user nova-compute[74613]: DEBUG nova.virt.hardware [None req-79cda9f1-69ee-450a-b11f-60ade93a2a30 tempest-ServerBootFromVolumeStableRescueTest-414665510 tempest-ServerBootFromVolumeStableRescueTest-414665510-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74613) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 29 18:00:00 user nova-compute[74613]: INFO nova.compute.claims [None req-79cda9f1-69ee-450a-b11f-60ade93a2a30 tempest-ServerBootFromVolumeStableRescueTest-414665510 tempest-ServerBootFromVolumeStableRescueTest-414665510-project-member] [instance: 8fc8496b-1435-4b5f-8977-6c0d7467ef65] Claim successful on node user
Nov 29 18:00:01 user nova-compute[74613]: DEBUG nova.compute.provider_tree [None req-79cda9f1-69ee-450a-b11f-60ade93a2a30 tempest-ServerBootFromVolumeStableRescueTest-414665510 tempest-ServerBootFromVolumeStableRescueTest-414665510-project-member] Inventory has not changed in ProviderTree for provider: 639d980e-3b12-44b1-b8f4-1812416fa4dd {{(pid=74613) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 18:00:01 user nova-compute[74613]: DEBUG nova.scheduler.client.report [None req-79cda9f1-69ee-450a-b11f-60ade93a2a30 tempest-ServerBootFromVolumeStableRescueTest-414665510 tempest-ServerBootFromVolumeStableRescueTest-414665510-project-member] Inventory has not changed for provider 639d980e-3b12-44b1-b8f4-1812416fa4dd based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74613) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 18:00:01 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-79cda9f1-69ee-450a-b11f-60ade93a2a30 tempest-ServerBootFromVolumeStableRescueTest-414665510 tempest-ServerBootFromVolumeStableRescueTest-414665510-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.483s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 18:00:01 user nova-compute[74613]: DEBUG nova.compute.manager [None req-79cda9f1-69ee-450a-b11f-60ade93a2a30 tempest-ServerBootFromVolumeStableRescueTest-414665510 tempest-ServerBootFromVolumeStableRescueTest-414665510-project-member] [instance: 8fc8496b-1435-4b5f-8977-6c0d7467ef65] Start building networks asynchronously for instance. {{(pid=74613) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 29 18:00:01 user nova-compute[74613]: DEBUG nova.compute.manager [None req-79cda9f1-69ee-450a-b11f-60ade93a2a30 tempest-ServerBootFromVolumeStableRescueTest-414665510 tempest-ServerBootFromVolumeStableRescueTest-414665510-project-member] [instance: 8fc8496b-1435-4b5f-8977-6c0d7467ef65] Allocating IP information in the background. {{(pid=74613) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 29 18:00:01 user nova-compute[74613]: DEBUG nova.network.neutron [None req-79cda9f1-69ee-450a-b11f-60ade93a2a30 tempest-ServerBootFromVolumeStableRescueTest-414665510 tempest-ServerBootFromVolumeStableRescueTest-414665510-project-member] [instance: 8fc8496b-1435-4b5f-8977-6c0d7467ef65] allocate_for_instance() {{(pid=74613) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 29 18:00:01 user nova-compute[74613]: INFO nova.virt.libvirt.driver [None req-79cda9f1-69ee-450a-b11f-60ade93a2a30 tempest-ServerBootFromVolumeStableRescueTest-414665510 tempest-ServerBootFromVolumeStableRescueTest-414665510-project-member] [instance: 8fc8496b-1435-4b5f-8977-6c0d7467ef65] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 29 18:00:01 user nova-compute[74613]: DEBUG nova.compute.manager [None req-79cda9f1-69ee-450a-b11f-60ade93a2a30 tempest-ServerBootFromVolumeStableRescueTest-414665510 tempest-ServerBootFromVolumeStableRescueTest-414665510-project-member] [instance: 8fc8496b-1435-4b5f-8977-6c0d7467ef65] Start building block device mappings for instance. {{(pid=74613) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 29 18:00:01 user nova-compute[74613]: DEBUG nova.policy [None req-79cda9f1-69ee-450a-b11f-60ade93a2a30 tempest-ServerBootFromVolumeStableRescueTest-414665510 tempest-ServerBootFromVolumeStableRescueTest-414665510-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'c65bc922e04d4d1385e48f70c460c441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b820dd795dfe46cd804772f0e71f98e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74613) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 29 18:00:01 user nova-compute[74613]: DEBUG nova.compute.manager [None req-79cda9f1-69ee-450a-b11f-60ade93a2a30 tempest-ServerBootFromVolumeStableRescueTest-414665510 tempest-ServerBootFromVolumeStableRescueTest-414665510-project-member] [instance: 8fc8496b-1435-4b5f-8977-6c0d7467ef65] Start spawning the instance on the hypervisor. {{(pid=74613) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 29 18:00:01 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-79cda9f1-69ee-450a-b11f-60ade93a2a30 tempest-ServerBootFromVolumeStableRescueTest-414665510 tempest-ServerBootFromVolumeStableRescueTest-414665510-project-member] [instance: 8fc8496b-1435-4b5f-8977-6c0d7467ef65] Creating instance directory {{(pid=74613) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 29 18:00:01 user nova-compute[74613]: INFO nova.virt.libvirt.driver [None req-79cda9f1-69ee-450a-b11f-60ade93a2a30 tempest-ServerBootFromVolumeStableRescueTest-414665510 tempest-ServerBootFromVolumeStableRescueTest-414665510-project-member] [instance: 8fc8496b-1435-4b5f-8977-6c0d7467ef65] Creating image(s)
Nov 29 18:00:01 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-79cda9f1-69ee-450a-b11f-60ade93a2a30 tempest-ServerBootFromVolumeStableRescueTest-414665510 tempest-ServerBootFromVolumeStableRescueTest-414665510-project-member] Acquiring lock "/opt/stack/data/nova/instances/8fc8496b-1435-4b5f-8977-6c0d7467ef65/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 18:00:01 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-79cda9f1-69ee-450a-b11f-60ade93a2a30 tempest-ServerBootFromVolumeStableRescueTest-414665510 tempest-ServerBootFromVolumeStableRescueTest-414665510-project-member] Lock "/opt/stack/data/nova/instances/8fc8496b-1435-4b5f-8977-6c0d7467ef65/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 18:00:01 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-79cda9f1-69ee-450a-b11f-60ade93a2a30 tempest-ServerBootFromVolumeStableRescueTest-414665510 tempest-ServerBootFromVolumeStableRescueTest-414665510-project-member] Lock "/opt/stack/data/nova/instances/8fc8496b-1435-4b5f-8977-6c0d7467ef65/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 18:00:01 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-79cda9f1-69ee-450a-b11f-60ade93a2a30 tempest-ServerBootFromVolumeStableRescueTest-414665510 tempest-ServerBootFromVolumeStableRescueTest-414665510-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/21faea9e6951f3bdd0153b76ac89fe1a60a34758 --force-share --output=json {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:00:01 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-79cda9f1-69ee-450a-b11f-60ade93a2a30 tempest-ServerBootFromVolumeStableRescueTest-414665510 tempest-ServerBootFromVolumeStableRescueTest-414665510-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/21faea9e6951f3bdd0153b76ac89fe1a60a34758 --force-share --output=json" returned: 0 in 0.186s {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:00:01 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-79cda9f1-69ee-450a-b11f-60ade93a2a30 tempest-ServerBootFromVolumeStableRescueTest-414665510 tempest-ServerBootFromVolumeStableRescueTest-414665510-project-member] Acquiring lock "21faea9e6951f3bdd0153b76ac89fe1a60a34758" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 18:00:01 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-79cda9f1-69ee-450a-b11f-60ade93a2a30 tempest-ServerBootFromVolumeStableRescueTest-414665510 tempest-ServerBootFromVolumeStableRescueTest-414665510-project-member] Lock "21faea9e6951f3bdd0153b76ac89fe1a60a34758" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 18:00:01 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-79cda9f1-69ee-450a-b11f-60ade93a2a30 tempest-ServerBootFromVolumeStableRescueTest-414665510 tempest-ServerBootFromVolumeStableRescueTest-414665510-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/21faea9e6951f3bdd0153b76ac89fe1a60a34758 --force-share --output=json {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:00:01 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-79cda9f1-69ee-450a-b11f-60ade93a2a30 tempest-ServerBootFromVolumeStableRescueTest-414665510 tempest-ServerBootFromVolumeStableRescueTest-414665510-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/21faea9e6951f3bdd0153b76ac89fe1a60a34758 --force-share --output=json" returned: 0 in 0.207s {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:00:01 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-79cda9f1-69ee-450a-b11f-60ade93a2a30 tempest-ServerBootFromVolumeStableRescueTest-414665510 tempest-ServerBootFromVolumeStableRescueTest-414665510-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/21faea9e6951f3bdd0153b76ac89fe1a60a34758,backing_fmt=raw /opt/stack/data/nova/instances/8fc8496b-1435-4b5f-8977-6c0d7467ef65/disk 1073741824 {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:00:01 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-79cda9f1-69ee-450a-b11f-60ade93a2a30 tempest-ServerBootFromVolumeStableRescueTest-414665510 tempest-ServerBootFromVolumeStableRescueTest-414665510-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/21faea9e6951f3bdd0153b76ac89fe1a60a34758,backing_fmt=raw /opt/stack/data/nova/instances/8fc8496b-1435-4b5f-8977-6c0d7467ef65/disk 1073741824" returned: 0 in 0.108s {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:00:01 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-79cda9f1-69ee-450a-b11f-60ade93a2a30 tempest-ServerBootFromVolumeStableRescueTest-414665510 tempest-ServerBootFromVolumeStableRescueTest-414665510-project-member] Lock "21faea9e6951f3bdd0153b76ac89fe1a60a34758" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.323s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 18:00:01 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-79cda9f1-69ee-450a-b11f-60ade93a2a30 tempest-ServerBootFromVolumeStableRescueTest-414665510 tempest-ServerBootFromVolumeStableRescueTest-414665510-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/21faea9e6951f3bdd0153b76ac89fe1a60a34758 --force-share --output=json {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:00:01 user nova-compute[74613]: DEBUG nova.network.neutron [None req-79cda9f1-69ee-450a-b11f-60ade93a2a30 tempest-ServerBootFromVolumeStableRescueTest-414665510 tempest-ServerBootFromVolumeStableRescueTest-414665510-project-member] [instance: 8fc8496b-1435-4b5f-8977-6c0d7467ef65] Successfully created port: ddd4e4e3-180b-42bd-8c21-d3bb61438395 {{(pid=74613) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 29 18:00:02 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-79cda9f1-69ee-450a-b11f-60ade93a2a30 tempest-ServerBootFromVolumeStableRescueTest-414665510 tempest-ServerBootFromVolumeStableRescueTest-414665510-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/21faea9e6951f3bdd0153b76ac89fe1a60a34758 --force-share --output=json" returned: 0 in 0.176s {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:00:02 user nova-compute[74613]: DEBUG nova.virt.disk.api [None req-79cda9f1-69ee-450a-b11f-60ade93a2a30 tempest-ServerBootFromVolumeStableRescueTest-414665510 tempest-ServerBootFromVolumeStableRescueTest-414665510-project-member] Checking if we can resize image /opt/stack/data/nova/instances/8fc8496b-1435-4b5f-8977-6c0d7467ef65/disk. size=1073741824 {{(pid=74613) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 29 18:00:02 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-79cda9f1-69ee-450a-b11f-60ade93a2a30 tempest-ServerBootFromVolumeStableRescueTest-414665510 tempest-ServerBootFromVolumeStableRescueTest-414665510-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8fc8496b-1435-4b5f-8977-6c0d7467ef65/disk --force-share --output=json {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:00:02 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-79cda9f1-69ee-450a-b11f-60ade93a2a30 tempest-ServerBootFromVolumeStableRescueTest-414665510 tempest-ServerBootFromVolumeStableRescueTest-414665510-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8fc8496b-1435-4b5f-8977-6c0d7467ef65/disk --force-share --output=json" returned: 0 in 0.217s {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:00:02 user nova-compute[74613]: DEBUG nova.virt.disk.api [None req-79cda9f1-69ee-450a-b11f-60ade93a2a30 tempest-ServerBootFromVolumeStableRescueTest-414665510 tempest-ServerBootFromVolumeStableRescueTest-414665510-project-member] Cannot resize image /opt/stack/data/nova/instances/8fc8496b-1435-4b5f-8977-6c0d7467ef65/disk to a smaller size. {{(pid=74613) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 29 18:00:02 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-79cda9f1-69ee-450a-b11f-60ade93a2a30 tempest-ServerBootFromVolumeStableRescueTest-414665510 tempest-ServerBootFromVolumeStableRescueTest-414665510-project-member] [instance: 8fc8496b-1435-4b5f-8977-6c0d7467ef65] Created local disks {{(pid=74613) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 29 18:00:02 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-79cda9f1-69ee-450a-b11f-60ade93a2a30 tempest-ServerBootFromVolumeStableRescueTest-414665510 tempest-ServerBootFromVolumeStableRescueTest-414665510-project-member] [instance: 8fc8496b-1435-4b5f-8977-6c0d7467ef65] Ensure instance console log exists: /opt/stack/data/nova/instances/8fc8496b-1435-4b5f-8977-6c0d7467ef65/console.log {{(pid=74613) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 29 18:00:02 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-79cda9f1-69ee-450a-b11f-60ade93a2a30 tempest-ServerBootFromVolumeStableRescueTest-414665510 tempest-ServerBootFromVolumeStableRescueTest-414665510-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 18:00:02 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-79cda9f1-69ee-450a-b11f-60ade93a2a30 tempest-ServerBootFromVolumeStableRescueTest-414665510 tempest-ServerBootFromVolumeStableRescueTest-414665510-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 18:00:02 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-79cda9f1-69ee-450a-b11f-60ade93a2a30 tempest-ServerBootFromVolumeStableRescueTest-414665510 tempest-ServerBootFromVolumeStableRescueTest-414665510-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 18:00:02 user nova-compute[74613]: DEBUG nova.network.neutron [None req-79cda9f1-69ee-450a-b11f-60ade93a2a30 tempest-ServerBootFromVolumeStableRescueTest-414665510 tempest-ServerBootFromVolumeStableRescueTest-414665510-project-member] [instance: 8fc8496b-1435-4b5f-8977-6c0d7467ef65] Successfully updated port: ddd4e4e3-180b-42bd-8c21-d3bb61438395 {{(pid=74613) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 29 18:00:02 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-79cda9f1-69ee-450a-b11f-60ade93a2a30 tempest-ServerBootFromVolumeStableRescueTest-414665510 tempest-ServerBootFromVolumeStableRescueTest-414665510-project-member] Acquiring lock "refresh_cache-8fc8496b-1435-4b5f-8977-6c0d7467ef65" {{(pid=74613) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 18:00:02 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-79cda9f1-69ee-450a-b11f-60ade93a2a30 tempest-ServerBootFromVolumeStableRescueTest-414665510 tempest-ServerBootFromVolumeStableRescueTest-414665510-project-member] Acquired lock "refresh_cache-8fc8496b-1435-4b5f-8977-6c0d7467ef65" {{(pid=74613) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 18:00:02 user nova-compute[74613]: DEBUG nova.network.neutron [None req-79cda9f1-69ee-450a-b11f-60ade93a2a30 tempest-ServerBootFromVolumeStableRescueTest-414665510 tempest-ServerBootFromVolumeStableRescueTest-414665510-project-member] [instance: 8fc8496b-1435-4b5f-8977-6c0d7467ef65] Building network info cache for instance {{(pid=74613) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 29 18:00:02 user nova-compute[74613]: DEBUG nova.compute.manager [req-7805bbab-86d6-498b-a1f0-555a1b10e30a req-c4ecf7f1-e2c3-4558-be22-4e149ebc5518 service nova] [instance: 8fc8496b-1435-4b5f-8977-6c0d7467ef65] Received event network-changed-ddd4e4e3-180b-42bd-8c21-d3bb61438395 {{(pid=74613) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 18:00:02 user nova-compute[74613]: DEBUG nova.compute.manager [req-7805bbab-86d6-498b-a1f0-555a1b10e30a req-c4ecf7f1-e2c3-4558-be22-4e149ebc5518 service nova] [instance: 8fc8496b-1435-4b5f-8977-6c0d7467ef65] Refreshing instance network info cache due to event network-changed-ddd4e4e3-180b-42bd-8c21-d3bb61438395. {{(pid=74613) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 18:00:02 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-7805bbab-86d6-498b-a1f0-555a1b10e30a req-c4ecf7f1-e2c3-4558-be22-4e149ebc5518 service nova] Acquiring lock "refresh_cache-8fc8496b-1435-4b5f-8977-6c0d7467ef65" {{(pid=74613) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 18:00:02 user nova-compute[74613]: DEBUG nova.network.neutron [None req-79cda9f1-69ee-450a-b11f-60ade93a2a30 tempest-ServerBootFromVolumeStableRescueTest-414665510 tempest-ServerBootFromVolumeStableRescueTest-414665510-project-member] [instance: 8fc8496b-1435-4b5f-8977-6c0d7467ef65] Instance cache missing network info. {{(pid=74613) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 29 18:00:02 user nova-compute[74613]: DEBUG nova.network.neutron [None req-79cda9f1-69ee-450a-b11f-60ade93a2a30 tempest-ServerBootFromVolumeStableRescueTest-414665510 tempest-ServerBootFromVolumeStableRescueTest-414665510-project-member] [instance: 8fc8496b-1435-4b5f-8977-6c0d7467ef65] Updating instance_info_cache with network_info: [{"id": "ddd4e4e3-180b-42bd-8c21-d3bb61438395", "address": "fa:16:3e:43:4c:c1", "network": {"id": "0722b02d-a357-4360-87e8-580913723985", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-579793494-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b820dd795dfe46cd804772f0e71f98e9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapddd4e4e3-18", "ovs_interfaceid": "ddd4e4e3-180b-42bd-8c21-d3bb61438395", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74613) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 18:00:02 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-79cda9f1-69ee-450a-b11f-60ade93a2a30 tempest-ServerBootFromVolumeStableRescueTest-414665510 tempest-ServerBootFromVolumeStableRescueTest-414665510-project-member] Releasing lock "refresh_cache-8fc8496b-1435-4b5f-8977-6c0d7467ef65" {{(pid=74613) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 18:00:02 user nova-compute[74613]: DEBUG nova.compute.manager [None req-79cda9f1-69ee-450a-b11f-60ade93a2a30 tempest-ServerBootFromVolumeStableRescueTest-414665510 tempest-ServerBootFromVolumeStableRescueTest-414665510-project-member] [instance: 8fc8496b-1435-4b5f-8977-6c0d7467ef65] Instance network_info: |[{"id": "ddd4e4e3-180b-42bd-8c21-d3bb61438395", "address": "fa:16:3e:43:4c:c1", "network": {"id": "0722b02d-a357-4360-87e8-580913723985", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-579793494-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b820dd795dfe46cd804772f0e71f98e9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapddd4e4e3-18", "ovs_interfaceid": "ddd4e4e3-180b-42bd-8c21-d3bb61438395", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74613) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 29 18:00:02 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-7805bbab-86d6-498b-a1f0-555a1b10e30a req-c4ecf7f1-e2c3-4558-be22-4e149ebc5518 service nova] Acquired lock "refresh_cache-8fc8496b-1435-4b5f-8977-6c0d7467ef65" {{(pid=74613) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 18:00:02 user nova-compute[74613]: DEBUG nova.network.neutron [req-7805bbab-86d6-498b-a1f0-555a1b10e30a req-c4ecf7f1-e2c3-4558-be22-4e149ebc5518 service nova] [instance: 8fc8496b-1435-4b5f-8977-6c0d7467ef65] Refreshing network info cache for port ddd4e4e3-180b-42bd-8c21-d3bb61438395 {{(pid=74613) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 18:00:02 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-79cda9f1-69ee-450a-b11f-60ade93a2a30 tempest-ServerBootFromVolumeStableRescueTest-414665510 tempest-ServerBootFromVolumeStableRescueTest-414665510-project-member] [instance: 8fc8496b-1435-4b5f-8977-6c0d7467ef65] Start _get_guest_xml network_info=[{"id": "ddd4e4e3-180b-42bd-8c21-d3bb61438395", "address": "fa:16:3e:43:4c:c1", "network": {"id": "0722b02d-a357-4360-87e8-580913723985", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-579793494-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b820dd795dfe46cd804772f0e71f98e9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapddd4e4e3-18", "ovs_interfaceid": "ddd4e4e3-180b-42bd-8c21-d3bb61438395", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-29T17:47:38Z,direct_url=<?>,disk_format='qcow2',id=4217f428-8d9d-4ee1-9614-642d26d90c46,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='794b07cbd46a44b5865cfda741036bae',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-29T17:47:40Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'size': 0, 'device_type': 'disk', 'boot_index': 0, 'guest_format': None, 'encrypted': False, 'encryption_format': None, 'disk_bus': 'virtio', 'image_id': '4217f428-8d9d-4ee1-9614-642d26d90c46'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74613) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 29 18:00:02 user nova-compute[74613]: WARNING nova.virt.libvirt.driver [None req-79cda9f1-69ee-450a-b11f-60ade93a2a30 tempest-ServerBootFromVolumeStableRescueTest-414665510 tempest-ServerBootFromVolumeStableRescueTest-414665510-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 18:00:02 user nova-compute[74613]: WARNING nova.virt.libvirt.driver [None req-79cda9f1-69ee-450a-b11f-60ade93a2a30 tempest-ServerBootFromVolumeStableRescueTest-414665510 tempest-ServerBootFromVolumeStableRescueTest-414665510-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 18:00:02 user nova-compute[74613]: DEBUG nova.virt.libvirt.host [None req-79cda9f1-69ee-450a-b11f-60ade93a2a30 tempest-ServerBootFromVolumeStableRescueTest-414665510 tempest-ServerBootFromVolumeStableRescueTest-414665510-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74613) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 29 18:00:02 user nova-compute[74613]: DEBUG nova.virt.libvirt.host [None req-79cda9f1-69ee-450a-b11f-60ade93a2a30 tempest-ServerBootFromVolumeStableRescueTest-414665510 tempest-ServerBootFromVolumeStableRescueTest-414665510-project-member] CPU controller missing on host. {{(pid=74613) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 29 18:00:02 user nova-compute[74613]: DEBUG nova.virt.libvirt.host [None req-79cda9f1-69ee-450a-b11f-60ade93a2a30 tempest-ServerBootFromVolumeStableRescueTest-414665510 tempest-ServerBootFromVolumeStableRescueTest-414665510-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74613) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 29 18:00:02 user nova-compute[74613]: DEBUG nova.virt.libvirt.host [None req-79cda9f1-69ee-450a-b11f-60ade93a2a30 tempest-ServerBootFromVolumeStableRescueTest-414665510 tempest-ServerBootFromVolumeStableRescueTest-414665510-project-member] CPU controller found on host. {{(pid=74613) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 29 18:00:02 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-79cda9f1-69ee-450a-b11f-60ade93a2a30 tempest-ServerBootFromVolumeStableRescueTest-414665510 tempest-ServerBootFromVolumeStableRescueTest-414665510-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74613) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 29 18:00:02 user nova-compute[74613]: DEBUG nova.virt.hardware [None req-79cda9f1-69ee-450a-b11f-60ade93a2a30 tempest-ServerBootFromVolumeStableRescueTest-414665510 tempest-ServerBootFromVolumeStableRescueTest-414665510-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-29T17:47:27Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-29T17:47:38Z,direct_url=<?>,disk_format='qcow2',id=4217f428-8d9d-4ee1-9614-642d26d90c46,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='794b07cbd46a44b5865cfda741036bae',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-29T17:47:40Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74613) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 29 18:00:02 user nova-compute[74613]: DEBUG nova.virt.hardware [None req-79cda9f1-69ee-450a-b11f-60ade93a2a30 tempest-ServerBootFromVolumeStableRescueTest-414665510 tempest-ServerBootFromVolumeStableRescueTest-414665510-project-member] Flavor limits 0:0:0 {{(pid=74613) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 29 18:00:02 user nova-compute[74613]: DEBUG nova.virt.hardware [None req-79cda9f1-69ee-450a-b11f-60ade93a2a30 tempest-ServerBootFromVolumeStableRescueTest-414665510 tempest-ServerBootFromVolumeStableRescueTest-414665510-project-member] Image limits 0:0:0 {{(pid=74613) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 29 18:00:02 user nova-compute[74613]: DEBUG nova.virt.hardware [None req-79cda9f1-69ee-450a-b11f-60ade93a2a30 tempest-ServerBootFromVolumeStableRescueTest-414665510 tempest-ServerBootFromVolumeStableRescueTest-414665510-project-member] Flavor pref 0:0:0 {{(pid=74613) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 29 18:00:02 user nova-compute[74613]: DEBUG nova.virt.hardware [None req-79cda9f1-69ee-450a-b11f-60ade93a2a30 tempest-ServerBootFromVolumeStableRescueTest-414665510 tempest-ServerBootFromVolumeStableRescueTest-414665510-project-member] Image pref 0:0:0 {{(pid=74613) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 29 18:00:02 user nova-compute[74613]: DEBUG nova.virt.hardware [None req-79cda9f1-69ee-450a-b11f-60ade93a2a30 tempest-ServerBootFromVolumeStableRescueTest-414665510 tempest-ServerBootFromVolumeStableRescueTest-414665510-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74613) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 29 18:00:02 user nova-compute[74613]: DEBUG nova.virt.hardware [None req-79cda9f1-69ee-450a-b11f-60ade93a2a30 tempest-ServerBootFromVolumeStableRescueTest-414665510 tempest-ServerBootFromVolumeStableRescueTest-414665510-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74613) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 29 18:00:02 user nova-compute[74613]: DEBUG nova.virt.hardware [None req-79cda9f1-69ee-450a-b11f-60ade93a2a30 tempest-ServerBootFromVolumeStableRescueTest-414665510 tempest-ServerBootFromVolumeStableRescueTest-414665510-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74613) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 29 18:00:02 user nova-compute[74613]: DEBUG nova.virt.hardware [None req-79cda9f1-69ee-450a-b11f-60ade93a2a30 tempest-ServerBootFromVolumeStableRescueTest-414665510 tempest-ServerBootFromVolumeStableRescueTest-414665510-project-member] Got 1 possible topologies {{(pid=74613) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 29 18:00:02 user nova-compute[74613]: DEBUG nova.virt.hardware [None req-79cda9f1-69ee-450a-b11f-60ade93a2a30 tempest-ServerBootFromVolumeStableRescueTest-414665510 tempest-ServerBootFromVolumeStableRescueTest-414665510-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74613) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 29 18:00:02 user nova-compute[74613]: DEBUG nova.virt.hardware [None req-79cda9f1-69ee-450a-b11f-60ade93a2a30 tempest-ServerBootFromVolumeStableRescueTest-414665510 tempest-ServerBootFromVolumeStableRescueTest-414665510-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74613) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 29 18:00:02 user nova-compute[74613]: DEBUG nova.virt.libvirt.vif [None req-79cda9f1-69ee-450a-b11f-60ade93a2a30 tempest-ServerBootFromVolumeStableRescueTest-414665510 tempest-ServerBootFromVolumeStableRescueTest-414665510-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T18:00:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-469660568',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-469660568',id=23,image_ref='4217f428-8d9d-4ee1-9614-642d26d90c46',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b820dd795dfe46cd804772f0e71f98e9',ramdisk_id='',reservation_id='r-ej2u8uj7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='4217f428-8d9d-4ee1-9614-642d26d90c46',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-414665510',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-414665510-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T18:00:01Z,user_data=None,user_id='c65bc922e04d4d1385e48f70c460c441',uuid=8fc8496b-1435-4b5f-8977-6c0d7467ef65,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ddd4e4e3-180b-42bd-8c21-d3bb61438395", "address": "fa:16:3e:43:4c:c1", "network": {"id": "0722b02d-a357-4360-87e8-580913723985", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-579793494-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b820dd795dfe46cd804772f0e71f98e9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapddd4e4e3-18", "ovs_interfaceid": "ddd4e4e3-180b-42bd-8c21-d3bb61438395", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74613) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 29 18:00:02 user nova-compute[74613]: DEBUG nova.network.os_vif_util [None req-79cda9f1-69ee-450a-b11f-60ade93a2a30 tempest-ServerBootFromVolumeStableRescueTest-414665510 tempest-ServerBootFromVolumeStableRescueTest-414665510-project-member] Converting VIF {"id": "ddd4e4e3-180b-42bd-8c21-d3bb61438395", "address": "fa:16:3e:43:4c:c1", "network": {"id": "0722b02d-a357-4360-87e8-580913723985", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-579793494-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b820dd795dfe46cd804772f0e71f98e9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapddd4e4e3-18", "ovs_interfaceid": "ddd4e4e3-180b-42bd-8c21-d3bb61438395", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74613) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 18:00:02 user nova-compute[74613]: DEBUG nova.network.os_vif_util [None req-79cda9f1-69ee-450a-b11f-60ade93a2a30 tempest-ServerBootFromVolumeStableRescueTest-414665510 tempest-ServerBootFromVolumeStableRescueTest-414665510-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:43:4c:c1,bridge_name='br-int',has_traffic_filtering=True,id=ddd4e4e3-180b-42bd-8c21-d3bb61438395,network=Network(0722b02d-a357-4360-87e8-580913723985),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapddd4e4e3-18') {{(pid=74613) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 18:00:02 user nova-compute[74613]: DEBUG nova.objects.instance [None req-79cda9f1-69ee-450a-b11f-60ade93a2a30 tempest-ServerBootFromVolumeStableRescueTest-414665510 tempest-ServerBootFromVolumeStableRescueTest-414665510-project-member] Lazy-loading 'pci_devices' on Instance uuid 8fc8496b-1435-4b5f-8977-6c0d7467ef65 {{(pid=74613) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 18:00:02 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-79cda9f1-69ee-450a-b11f-60ade93a2a30 tempest-ServerBootFromVolumeStableRescueTest-414665510 tempest-ServerBootFromVolumeStableRescueTest-414665510-project-member] [instance: 8fc8496b-1435-4b5f-8977-6c0d7467ef65] End _get_guest_xml xml=<domain type="kvm">
Nov 29 18:00:02 user nova-compute[74613]:   <uuid>8fc8496b-1435-4b5f-8977-6c0d7467ef65</uuid>
Nov 29 18:00:02 user nova-compute[74613]:   <name>instance-00000017</name>
Nov 29 18:00:02 user nova-compute[74613]:   <memory>524288</memory>
Nov 29 18:00:02 user nova-compute[74613]:   <vcpu>1</vcpu>
Nov 29 18:00:02 user nova-compute[74613]:   <metadata>
Nov 29 18:00:02 user nova-compute[74613]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 29 18:00:02 user nova-compute[74613]:       <nova:package version="0.0.0"/>
Nov 29 18:00:02 user nova-compute[74613]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-469660568</nova:name>
Nov 29 18:00:02 user nova-compute[74613]:       <nova:creationTime>2023-11-29 18:00:02</nova:creationTime>
Nov 29 18:00:02 user nova-compute[74613]:       <nova:flavor name="m1.tiny">
Nov 29 18:00:02 user nova-compute[74613]:         <nova:memory>512</nova:memory>
Nov 29 18:00:02 user nova-compute[74613]:         <nova:disk>1</nova:disk>
Nov 29 18:00:02 user nova-compute[74613]:         <nova:swap>0</nova:swap>
Nov 29 18:00:02 user nova-compute[74613]:         <nova:ephemeral>0</nova:ephemeral>
Nov 29 18:00:02 user nova-compute[74613]:         <nova:vcpus>1</nova:vcpus>
Nov 29 18:00:02 user nova-compute[74613]:       </nova:flavor>
Nov 29 18:00:02 user nova-compute[74613]:       <nova:owner>
Nov 29 18:00:02 user nova-compute[74613]:         <nova:user uuid="c65bc922e04d4d1385e48f70c460c441">tempest-ServerBootFromVolumeStableRescueTest-414665510-project-member</nova:user>
Nov 29 18:00:02 user nova-compute[74613]:         <nova:project uuid="b820dd795dfe46cd804772f0e71f98e9">tempest-ServerBootFromVolumeStableRescueTest-414665510</nova:project>
Nov 29 18:00:02 user nova-compute[74613]:       </nova:owner>
Nov 29 18:00:02 user nova-compute[74613]:       <nova:root type="image" uuid="4217f428-8d9d-4ee1-9614-642d26d90c46"/>
Nov 29 18:00:02 user nova-compute[74613]:       <nova:ports>
Nov 29 18:00:02 user nova-compute[74613]:         <nova:port uuid="ddd4e4e3-180b-42bd-8c21-d3bb61438395">
Nov 29 18:00:02 user nova-compute[74613]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Nov 29 18:00:02 user nova-compute[74613]:         </nova:port>
Nov 29 18:00:02 user nova-compute[74613]:       </nova:ports>
Nov 29 18:00:02 user nova-compute[74613]:     </nova:instance>
Nov 29 18:00:02 user nova-compute[74613]:   </metadata>
Nov 29 18:00:02 user nova-compute[74613]:   <sysinfo type="smbios">
Nov 29 18:00:02 user nova-compute[74613]:     <system>
Nov 29 18:00:02 user nova-compute[74613]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 29 18:00:02 user nova-compute[74613]:       <entry name="product">OpenStack Nova</entry>
Nov 29 18:00:02 user nova-compute[74613]:       <entry name="version">0.0.0</entry>
Nov 29 18:00:02 user nova-compute[74613]:       <entry name="serial">8fc8496b-1435-4b5f-8977-6c0d7467ef65</entry>
Nov 29 18:00:02 user nova-compute[74613]:       <entry name="uuid">8fc8496b-1435-4b5f-8977-6c0d7467ef65</entry>
Nov 29 18:00:02 user nova-compute[74613]:       <entry name="family">Virtual Machine</entry>
Nov 29 18:00:02 user nova-compute[74613]:     </system>
Nov 29 18:00:02 user nova-compute[74613]:   </sysinfo>
Nov 29 18:00:02 user nova-compute[74613]:   <os>
Nov 29 18:00:02 user nova-compute[74613]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 29 18:00:02 user nova-compute[74613]:     <boot dev="hd"/>
Nov 29 18:00:02 user nova-compute[74613]:     <smbios mode="sysinfo"/>
Nov 29 18:00:02 user nova-compute[74613]:   </os>
Nov 29 18:00:02 user nova-compute[74613]:   <features>
Nov 29 18:00:02 user nova-compute[74613]:     <acpi/>
Nov 29 18:00:02 user nova-compute[74613]:     <apic/>
Nov 29 18:00:02 user nova-compute[74613]:     <vmcoreinfo/>
Nov 29 18:00:02 user nova-compute[74613]:   </features>
Nov 29 18:00:02 user nova-compute[74613]:   <clock offset="utc">
Nov 29 18:00:02 user nova-compute[74613]:     <timer name="pit" tickpolicy="delay"/>
Nov 29 18:00:02 user nova-compute[74613]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 29 18:00:02 user nova-compute[74613]:     <timer name="hpet" present="no"/>
Nov 29 18:00:02 user nova-compute[74613]:   </clock>
Nov 29 18:00:02 user nova-compute[74613]:   <cpu mode="custom" match="exact">
Nov 29 18:00:02 user nova-compute[74613]:     <model>Nehalem</model>
Nov 29 18:00:02 user nova-compute[74613]:     <topology sockets="1" cores="1" threads="1"/>
Nov 29 18:00:02 user nova-compute[74613]:   </cpu>
Nov 29 18:00:02 user nova-compute[74613]:   <devices>
Nov 29 18:00:02 user nova-compute[74613]:     <disk type="file" device="disk">
Nov 29 18:00:02 user nova-compute[74613]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 29 18:00:02 user nova-compute[74613]:       <source file="/opt/stack/data/nova/instances/8fc8496b-1435-4b5f-8977-6c0d7467ef65/disk"/>
Nov 29 18:00:02 user nova-compute[74613]:       <target dev="vda" bus="virtio"/>
Nov 29 18:00:02 user nova-compute[74613]:     </disk>
Nov 29 18:00:02 user nova-compute[74613]:     <interface type="ethernet">
Nov 29 18:00:02 user nova-compute[74613]:       <mac address="fa:16:3e:43:4c:c1"/>
Nov 29 18:00:02 user nova-compute[74613]:       <model type="virtio"/>
Nov 29 18:00:02 user nova-compute[74613]:       <mtu size="1442"/>
Nov 29 18:00:02 user nova-compute[74613]:       <target dev="tapddd4e4e3-18"/>
Nov 29 18:00:02 user nova-compute[74613]:     </interface>
Nov 29 18:00:02 user nova-compute[74613]:     <serial type="pty">
Nov 29 18:00:02 user nova-compute[74613]:       <log file="/opt/stack/data/nova/instances/8fc8496b-1435-4b5f-8977-6c0d7467ef65/console.log" append="off"/>
Nov 29 18:00:02 user nova-compute[74613]:     </serial>
Nov 29 18:00:02 user nova-compute[74613]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 29 18:00:02 user nova-compute[74613]:     <video>
Nov 29 18:00:02 user nova-compute[74613]:       <model type="virtio"/>
Nov 29 18:00:02 user nova-compute[74613]:     </video>
Nov 29 18:00:02 user nova-compute[74613]:     <rng model="virtio">
Nov 29 18:00:02 user nova-compute[74613]:       <backend model="random">/dev/urandom</backend>
Nov 29 18:00:02 user nova-compute[74613]:     </rng>
Nov 29 18:00:02 user nova-compute[74613]:     <controller type="usb" index="0" model="none"/>
Nov 29 18:00:02 user nova-compute[74613]:     <memballoon model="virtio">
Nov 29 18:00:02 user nova-compute[74613]:       <stats period="10"/>
Nov 29 18:00:02 user nova-compute[74613]:     </memballoon>
Nov 29 18:00:02 user nova-compute[74613]:   </devices>
Nov 29 18:00:02 user nova-compute[74613]: </domain>
Nov 29 18:00:02 user nova-compute[74613]:  {{(pid=74613) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 29 18:00:02 user nova-compute[74613]: DEBUG nova.virt.libvirt.vif [None req-79cda9f1-69ee-450a-b11f-60ade93a2a30 tempest-ServerBootFromVolumeStableRescueTest-414665510 tempest-ServerBootFromVolumeStableRescueTest-414665510-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T18:00:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-469660568',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-469660568',id=23,image_ref='4217f428-8d9d-4ee1-9614-642d26d90c46',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b820dd795dfe46cd804772f0e71f98e9',ramdisk_id='',reservation_id='r-ej2u8uj7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='4217f428-8d9d-4ee1-9614-642d26d90c46',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-414665510',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-414665510-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T18:00:01Z,user_data=None,user_id='c65bc922e04d4d1385e48f70c460c441',uuid=8fc8496b-1435-4b5f-8977-6c0d7467ef65,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ddd4e4e3-180b-42bd-8c21-d3bb61438395", "address": "fa:16:3e:43:4c:c1", "network": {"id": "0722b02d-a357-4360-87e8-580913723985", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-579793494-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b820dd795dfe46cd804772f0e71f98e9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapddd4e4e3-18", "ovs_interfaceid": "ddd4e4e3-180b-42bd-8c21-d3bb61438395", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74613) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 29 18:00:02 user nova-compute[74613]: DEBUG nova.network.os_vif_util [None req-79cda9f1-69ee-450a-b11f-60ade93a2a30 tempest-ServerBootFromVolumeStableRescueTest-414665510 tempest-ServerBootFromVolumeStableRescueTest-414665510-project-member] Converting VIF {"id": "ddd4e4e3-180b-42bd-8c21-d3bb61438395", "address": "fa:16:3e:43:4c:c1", "network": {"id": "0722b02d-a357-4360-87e8-580913723985", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-579793494-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b820dd795dfe46cd804772f0e71f98e9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapddd4e4e3-18", "ovs_interfaceid": "ddd4e4e3-180b-42bd-8c21-d3bb61438395", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74613) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 18:00:02 user nova-compute[74613]: DEBUG nova.network.os_vif_util [None req-79cda9f1-69ee-450a-b11f-60ade93a2a30 tempest-ServerBootFromVolumeStableRescueTest-414665510 tempest-ServerBootFromVolumeStableRescueTest-414665510-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:43:4c:c1,bridge_name='br-int',has_traffic_filtering=True,id=ddd4e4e3-180b-42bd-8c21-d3bb61438395,network=Network(0722b02d-a357-4360-87e8-580913723985),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapddd4e4e3-18') {{(pid=74613) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 18:00:02 user nova-compute[74613]: DEBUG os_vif [None req-79cda9f1-69ee-450a-b11f-60ade93a2a30 tempest-ServerBootFromVolumeStableRescueTest-414665510 tempest-ServerBootFromVolumeStableRescueTest-414665510-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:43:4c:c1,bridge_name='br-int',has_traffic_filtering=True,id=ddd4e4e3-180b-42bd-8c21-d3bb61438395,network=Network(0722b02d-a357-4360-87e8-580913723985),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapddd4e4e3-18') {{(pid=74613) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 29 18:00:02 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:00:02 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74613) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 18:00:02 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74613) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 29 18:00:02 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:00:02 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'b62a6f22-7af0-5894-991f-b6422656cebb', '_type': 'linux-noop'}}, row=False) {{(pid=74613) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 18:00:02 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:00:02 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 18:00:02 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:00:02 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapddd4e4e3-18, may_exist=True, interface_attrs={}) {{(pid=74613) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 18:00:02 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapddd4e4e3-18, col_values=(('qos', UUID('4a7a9541-4f6e-45ed-9cbf-ddd6df02c1bb')),), if_exists=True) {{(pid=74613) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 18:00:02 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapddd4e4e3-18, col_values=(('external_ids', {'iface-id': 'ddd4e4e3-180b-42bd-8c21-d3bb61438395', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:43:4c:c1', 'vm-uuid': '8fc8496b-1435-4b5f-8977-6c0d7467ef65'}),), if_exists=True) {{(pid=74613) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 18:00:02 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:00:02 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 18:00:02 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:00:02 user nova-compute[74613]: INFO os_vif [None req-79cda9f1-69ee-450a-b11f-60ade93a2a30 tempest-ServerBootFromVolumeStableRescueTest-414665510 tempest-ServerBootFromVolumeStableRescueTest-414665510-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:43:4c:c1,bridge_name='br-int',has_traffic_filtering=True,id=ddd4e4e3-180b-42bd-8c21-d3bb61438395,network=Network(0722b02d-a357-4360-87e8-580913723985),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapddd4e4e3-18')
Nov 29 18:00:03 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-79cda9f1-69ee-450a-b11f-60ade93a2a30 tempest-ServerBootFromVolumeStableRescueTest-414665510 tempest-ServerBootFromVolumeStableRescueTest-414665510-project-member] No BDM found with device name vda, not building metadata. {{(pid=74613) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 18:00:03 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-79cda9f1-69ee-450a-b11f-60ade93a2a30 tempest-ServerBootFromVolumeStableRescueTest-414665510 tempest-ServerBootFromVolumeStableRescueTest-414665510-project-member] No VIF found with MAC fa:16:3e:43:4c:c1, not building metadata {{(pid=74613) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 29 18:00:03 user nova-compute[74613]: DEBUG nova.network.neutron [req-7805bbab-86d6-498b-a1f0-555a1b10e30a req-c4ecf7f1-e2c3-4558-be22-4e149ebc5518 service nova] [instance: 8fc8496b-1435-4b5f-8977-6c0d7467ef65] Updated VIF entry in instance network info cache for port ddd4e4e3-180b-42bd-8c21-d3bb61438395. {{(pid=74613) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 18:00:03 user nova-compute[74613]: DEBUG nova.network.neutron [req-7805bbab-86d6-498b-a1f0-555a1b10e30a req-c4ecf7f1-e2c3-4558-be22-4e149ebc5518 service nova] [instance: 8fc8496b-1435-4b5f-8977-6c0d7467ef65] Updating instance_info_cache with network_info: [{"id": "ddd4e4e3-180b-42bd-8c21-d3bb61438395", "address": "fa:16:3e:43:4c:c1", "network": {"id": "0722b02d-a357-4360-87e8-580913723985", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-579793494-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b820dd795dfe46cd804772f0e71f98e9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapddd4e4e3-18", "ovs_interfaceid": "ddd4e4e3-180b-42bd-8c21-d3bb61438395", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74613) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 18:00:03 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-7805bbab-86d6-498b-a1f0-555a1b10e30a req-c4ecf7f1-e2c3-4558-be22-4e149ebc5518 service nova] Releasing lock "refresh_cache-8fc8496b-1435-4b5f-8977-6c0d7467ef65" {{(pid=74613) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 18:00:04 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:00:04 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:00:04 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:00:04 user nova-compute[74613]: DEBUG nova.compute.manager [req-e0282b2e-e7d8-4793-bc01-56647921341f req-5fb5b512-d113-4d86-8c2e-62b68510e7cc service nova] [instance: 8fc8496b-1435-4b5f-8977-6c0d7467ef65] Received event network-vif-plugged-ddd4e4e3-180b-42bd-8c21-d3bb61438395 {{(pid=74613) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 18:00:04 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-e0282b2e-e7d8-4793-bc01-56647921341f req-5fb5b512-d113-4d86-8c2e-62b68510e7cc service nova] Acquiring lock "8fc8496b-1435-4b5f-8977-6c0d7467ef65-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 18:00:04 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-e0282b2e-e7d8-4793-bc01-56647921341f req-5fb5b512-d113-4d86-8c2e-62b68510e7cc service nova] Lock "8fc8496b-1435-4b5f-8977-6c0d7467ef65-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 18:00:04 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-e0282b2e-e7d8-4793-bc01-56647921341f req-5fb5b512-d113-4d86-8c2e-62b68510e7cc service nova] Lock "8fc8496b-1435-4b5f-8977-6c0d7467ef65-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 18:00:04 user nova-compute[74613]: DEBUG nova.compute.manager [req-e0282b2e-e7d8-4793-bc01-56647921341f req-5fb5b512-d113-4d86-8c2e-62b68510e7cc service nova] [instance: 8fc8496b-1435-4b5f-8977-6c0d7467ef65] No waiting events found dispatching network-vif-plugged-ddd4e4e3-180b-42bd-8c21-d3bb61438395 {{(pid=74613) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 18:00:04 user nova-compute[74613]: WARNING nova.compute.manager [req-e0282b2e-e7d8-4793-bc01-56647921341f req-5fb5b512-d113-4d86-8c2e-62b68510e7cc service nova] [instance: 8fc8496b-1435-4b5f-8977-6c0d7467ef65] Received unexpected event network-vif-plugged-ddd4e4e3-180b-42bd-8c21-d3bb61438395 for instance with vm_state building and task_state spawning.
Nov 29 18:00:04 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:00:04 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:00:05 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:00:06 user nova-compute[74613]: DEBUG nova.compute.manager [None req-79cda9f1-69ee-450a-b11f-60ade93a2a30 tempest-ServerBootFromVolumeStableRescueTest-414665510 tempest-ServerBootFromVolumeStableRescueTest-414665510-project-member] [instance: 8fc8496b-1435-4b5f-8977-6c0d7467ef65] Instance event wait completed in 0 seconds for  {{(pid=74613) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 29 18:00:06 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-79cda9f1-69ee-450a-b11f-60ade93a2a30 tempest-ServerBootFromVolumeStableRescueTest-414665510 tempest-ServerBootFromVolumeStableRescueTest-414665510-project-member] [instance: 8fc8496b-1435-4b5f-8977-6c0d7467ef65] Guest created on hypervisor {{(pid=74613) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 29 18:00:06 user nova-compute[74613]: INFO nova.virt.libvirt.driver [-] [instance: 8fc8496b-1435-4b5f-8977-6c0d7467ef65] Instance spawned successfully.
Nov 29 18:00:06 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-79cda9f1-69ee-450a-b11f-60ade93a2a30 tempest-ServerBootFromVolumeStableRescueTest-414665510 tempest-ServerBootFromVolumeStableRescueTest-414665510-project-member] [instance: 8fc8496b-1435-4b5f-8977-6c0d7467ef65] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74613) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 29 18:00:06 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-79cda9f1-69ee-450a-b11f-60ade93a2a30 tempest-ServerBootFromVolumeStableRescueTest-414665510 tempest-ServerBootFromVolumeStableRescueTest-414665510-project-member] [instance: 8fc8496b-1435-4b5f-8977-6c0d7467ef65] Found default for hw_cdrom_bus of ide {{(pid=74613) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 18:00:06 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-79cda9f1-69ee-450a-b11f-60ade93a2a30 tempest-ServerBootFromVolumeStableRescueTest-414665510 tempest-ServerBootFromVolumeStableRescueTest-414665510-project-member] [instance: 8fc8496b-1435-4b5f-8977-6c0d7467ef65] Found default for hw_disk_bus of virtio {{(pid=74613) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 18:00:06 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-79cda9f1-69ee-450a-b11f-60ade93a2a30 tempest-ServerBootFromVolumeStableRescueTest-414665510 tempest-ServerBootFromVolumeStableRescueTest-414665510-project-member] [instance: 8fc8496b-1435-4b5f-8977-6c0d7467ef65] Found default for hw_input_bus of None {{(pid=74613) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 18:00:06 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-79cda9f1-69ee-450a-b11f-60ade93a2a30 tempest-ServerBootFromVolumeStableRescueTest-414665510 tempest-ServerBootFromVolumeStableRescueTest-414665510-project-member] [instance: 8fc8496b-1435-4b5f-8977-6c0d7467ef65] Found default for hw_pointer_model of None {{(pid=74613) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 18:00:06 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-79cda9f1-69ee-450a-b11f-60ade93a2a30 tempest-ServerBootFromVolumeStableRescueTest-414665510 tempest-ServerBootFromVolumeStableRescueTest-414665510-project-member] [instance: 8fc8496b-1435-4b5f-8977-6c0d7467ef65] Found default for hw_video_model of virtio {{(pid=74613) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 18:00:06 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-79cda9f1-69ee-450a-b11f-60ade93a2a30 tempest-ServerBootFromVolumeStableRescueTest-414665510 tempest-ServerBootFromVolumeStableRescueTest-414665510-project-member] [instance: 8fc8496b-1435-4b5f-8977-6c0d7467ef65] Found default for hw_vif_model of virtio {{(pid=74613) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 18:00:06 user nova-compute[74613]: INFO nova.compute.manager [None req-79cda9f1-69ee-450a-b11f-60ade93a2a30 tempest-ServerBootFromVolumeStableRescueTest-414665510 tempest-ServerBootFromVolumeStableRescueTest-414665510-project-member] [instance: 8fc8496b-1435-4b5f-8977-6c0d7467ef65] Took 5.32 seconds to spawn the instance on the hypervisor.
Nov 29 18:00:06 user nova-compute[74613]: DEBUG nova.compute.manager [None req-79cda9f1-69ee-450a-b11f-60ade93a2a30 tempest-ServerBootFromVolumeStableRescueTest-414665510 tempest-ServerBootFromVolumeStableRescueTest-414665510-project-member] [instance: 8fc8496b-1435-4b5f-8977-6c0d7467ef65] Checking state {{(pid=74613) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 29 18:00:06 user nova-compute[74613]: DEBUG nova.compute.manager [req-275af24f-173b-4af4-85e3-de3905436848 req-299415f0-5a6c-489c-9744-b390a75d1396 service nova] [instance: 8fc8496b-1435-4b5f-8977-6c0d7467ef65] Received event network-vif-plugged-ddd4e4e3-180b-42bd-8c21-d3bb61438395 {{(pid=74613) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 18:00:06 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-275af24f-173b-4af4-85e3-de3905436848 req-299415f0-5a6c-489c-9744-b390a75d1396 service nova] Acquiring lock "8fc8496b-1435-4b5f-8977-6c0d7467ef65-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 18:00:06 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-275af24f-173b-4af4-85e3-de3905436848 req-299415f0-5a6c-489c-9744-b390a75d1396 service nova] Lock "8fc8496b-1435-4b5f-8977-6c0d7467ef65-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 18:00:06 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-275af24f-173b-4af4-85e3-de3905436848 req-299415f0-5a6c-489c-9744-b390a75d1396 service nova] Lock "8fc8496b-1435-4b5f-8977-6c0d7467ef65-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 18:00:06 user nova-compute[74613]: DEBUG nova.compute.manager [req-275af24f-173b-4af4-85e3-de3905436848 req-299415f0-5a6c-489c-9744-b390a75d1396 service nova] [instance: 8fc8496b-1435-4b5f-8977-6c0d7467ef65] No waiting events found dispatching network-vif-plugged-ddd4e4e3-180b-42bd-8c21-d3bb61438395 {{(pid=74613) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 18:00:06 user nova-compute[74613]: WARNING nova.compute.manager [req-275af24f-173b-4af4-85e3-de3905436848 req-299415f0-5a6c-489c-9744-b390a75d1396 service nova] [instance: 8fc8496b-1435-4b5f-8977-6c0d7467ef65] Received unexpected event network-vif-plugged-ddd4e4e3-180b-42bd-8c21-d3bb61438395 for instance with vm_state building and task_state spawning.
Nov 29 18:00:06 user nova-compute[74613]: INFO nova.compute.manager [None req-79cda9f1-69ee-450a-b11f-60ade93a2a30 tempest-ServerBootFromVolumeStableRescueTest-414665510 tempest-ServerBootFromVolumeStableRescueTest-414665510-project-member] [instance: 8fc8496b-1435-4b5f-8977-6c0d7467ef65] Took 6.12 seconds to build instance.
Nov 29 18:00:06 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-79cda9f1-69ee-450a-b11f-60ade93a2a30 tempest-ServerBootFromVolumeStableRescueTest-414665510 tempest-ServerBootFromVolumeStableRescueTest-414665510-project-member] Lock "8fc8496b-1435-4b5f-8977-6c0d7467ef65" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.224s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 18:00:07 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:00:07 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-462abe71-2fe8-4435-b5f3-d1ac7e70d6fa tempest-ServerActionsTestOtherA-1784608629 tempest-ServerActionsTestOtherA-1784608629-project-member] Acquiring lock "71f2a1ab-3df7-411c-93fa-b0a1a5a44f0a" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 18:00:07 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-462abe71-2fe8-4435-b5f3-d1ac7e70d6fa tempest-ServerActionsTestOtherA-1784608629 tempest-ServerActionsTestOtherA-1784608629-project-member] Lock "71f2a1ab-3df7-411c-93fa-b0a1a5a44f0a" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.002s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 18:00:08 user nova-compute[74613]: INFO nova.compute.manager [None req-462abe71-2fe8-4435-b5f3-d1ac7e70d6fa tempest-ServerActionsTestOtherA-1784608629 tempest-ServerActionsTestOtherA-1784608629-project-member] [instance: 71f2a1ab-3df7-411c-93fa-b0a1a5a44f0a] Detaching volume 72d22ffa-f425-4575-86a5-afbd8bb9cdd6
Nov 29 18:00:08 user nova-compute[74613]: INFO nova.virt.block_device [None req-462abe71-2fe8-4435-b5f3-d1ac7e70d6fa tempest-ServerActionsTestOtherA-1784608629 tempest-ServerActionsTestOtherA-1784608629-project-member] [instance: 71f2a1ab-3df7-411c-93fa-b0a1a5a44f0a] Attempting to driver detach volume 72d22ffa-f425-4575-86a5-afbd8bb9cdd6 from mountpoint /dev/vdb
Nov 29 18:00:08 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-462abe71-2fe8-4435-b5f3-d1ac7e70d6fa tempest-ServerActionsTestOtherA-1784608629 tempest-ServerActionsTestOtherA-1784608629-project-member] Attempting to detach device vdb from instance 71f2a1ab-3df7-411c-93fa-b0a1a5a44f0a from the persistent domain config. {{(pid=74613) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 29 18:00:08 user nova-compute[74613]: DEBUG nova.virt.libvirt.guest [None req-462abe71-2fe8-4435-b5f3-d1ac7e70d6fa tempest-ServerActionsTestOtherA-1784608629 tempest-ServerActionsTestOtherA-1784608629-project-member] detach device xml: <disk type="block" device="disk">
Nov 29 18:00:08 user nova-compute[74613]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 18:00:08 user nova-compute[74613]:   <source dev="/dev/sdd"/>
Nov 29 18:00:08 user nova-compute[74613]:   <target dev="vdb" bus="virtio"/>
Nov 29 18:00:08 user nova-compute[74613]:   <serial>72d22ffa-f425-4575-86a5-afbd8bb9cdd6</serial>
Nov 29 18:00:08 user nova-compute[74613]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Nov 29 18:00:08 user nova-compute[74613]: </disk>
Nov 29 18:00:08 user nova-compute[74613]:  {{(pid=74613) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 29 18:00:08 user nova-compute[74613]: INFO nova.virt.libvirt.driver [None req-462abe71-2fe8-4435-b5f3-d1ac7e70d6fa tempest-ServerActionsTestOtherA-1784608629 tempest-ServerActionsTestOtherA-1784608629-project-member] Successfully detached device vdb from instance 71f2a1ab-3df7-411c-93fa-b0a1a5a44f0a from the persistent domain config.
Nov 29 18:00:08 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-462abe71-2fe8-4435-b5f3-d1ac7e70d6fa tempest-ServerActionsTestOtherA-1784608629 tempest-ServerActionsTestOtherA-1784608629-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 71f2a1ab-3df7-411c-93fa-b0a1a5a44f0a from the live domain config. {{(pid=74613) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 29 18:00:08 user nova-compute[74613]: DEBUG nova.virt.libvirt.guest [None req-462abe71-2fe8-4435-b5f3-d1ac7e70d6fa tempest-ServerActionsTestOtherA-1784608629 tempest-ServerActionsTestOtherA-1784608629-project-member] detach device xml: <disk type="block" device="disk">
Nov 29 18:00:08 user nova-compute[74613]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 18:00:08 user nova-compute[74613]:   <source dev="/dev/sdd"/>
Nov 29 18:00:08 user nova-compute[74613]:   <target dev="vdb" bus="virtio"/>
Nov 29 18:00:08 user nova-compute[74613]:   <serial>72d22ffa-f425-4575-86a5-afbd8bb9cdd6</serial>
Nov 29 18:00:08 user nova-compute[74613]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Nov 29 18:00:08 user nova-compute[74613]: </disk>
Nov 29 18:00:08 user nova-compute[74613]:  {{(pid=74613) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 29 18:00:08 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-462abe71-2fe8-4435-b5f3-d1ac7e70d6fa tempest-ServerActionsTestOtherA-1784608629 tempest-ServerActionsTestOtherA-1784608629-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 71f2a1ab-3df7-411c-93fa-b0a1a5a44f0a {{(pid=74613) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 29 18:00:12 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-f85b99ac-8ee6-47d4-8cfb-e35892b3bcc5 tempest-TestShelveInstance-765407413 tempest-TestShelveInstance-765407413-project-member] Acquiring lock "fae10c60-f989-4c99-bde4-60cd9f3e2055" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 18:00:12 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-f85b99ac-8ee6-47d4-8cfb-e35892b3bcc5 tempest-TestShelveInstance-765407413 tempest-TestShelveInstance-765407413-project-member] Lock "fae10c60-f989-4c99-bde4-60cd9f3e2055" acquired by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: waited 0.002s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 18:00:12 user nova-compute[74613]: INFO nova.compute.manager [None req-f85b99ac-8ee6-47d4-8cfb-e35892b3bcc5 tempest-TestShelveInstance-765407413 tempest-TestShelveInstance-765407413-project-member] [instance: fae10c60-f989-4c99-bde4-60cd9f3e2055] Unshelving
Nov 29 18:00:12 user nova-compute[74613]: INFO nova.virt.block_device [None req-f85b99ac-8ee6-47d4-8cfb-e35892b3bcc5 tempest-TestShelveInstance-765407413 tempest-TestShelveInstance-765407413-project-member] [instance: fae10c60-f989-4c99-bde4-60cd9f3e2055] Booting with volume 6a07b572-6430-4d0f-9aaf-8a8dbc39831e at /dev/vda
Nov 29 18:00:12 user nova-compute[74613]: DEBUG os_brick.utils [None req-f85b99ac-8ee6-47d4-8cfb-e35892b3bcc5 tempest-TestShelveInstance-765407413 tempest-TestShelveInstance-765407413-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74613) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 18:00:12 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:00:12 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:00:12 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[3954df48-8e00-4cb0-b46a-fa7412b588cb]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:400972819b5\n', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 18:00:12 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:00:12 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:00:12 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a9b1ec3-a334-432e-8189-f8e4ad6f350f]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 18:00:12 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:00:12 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:00:12 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e71988b-6c80-46f0-b745-272e06ccfe1d]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 18:00:12 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4f4531a-89eb-48a5-95f4-a70e2f7042dc]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 18:00:12 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-f85b99ac-8ee6-47d4-8cfb-e35892b3bcc5 tempest-TestShelveInstance-765407413 tempest-TestShelveInstance-765407413-project-member] Running cmd (subprocess): nvme version {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:00:12 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-f85b99ac-8ee6-47d4-8cfb-e35892b3bcc5 tempest-TestShelveInstance-765407413 tempest-TestShelveInstance-765407413-project-member] 'nvme version' failed. Not Retrying. {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 18:00:12 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.nvmeof [None req-f85b99ac-8ee6-47d4-8cfb-e35892b3bcc5 tempest-TestShelveInstance-765407413 tempest-TestShelveInstance-765407413-project-member] nvme not present on system {{(pid=74613) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 29 18:00:12 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:00:12 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 18:00:12 user nova-compute[74613]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 29 18:00:12 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2cd60b5-041a-4e60-89a4-ccec453fb64e]: (4, '') {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 18:00:12 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.lightos [None req-f85b99ac-8ee6-47d4-8cfb-e35892b3bcc5 tempest-TestShelveInstance-765407413 tempest-TestShelveInstance-765407413-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74613) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 29 18:00:12 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.lightos [None req-f85b99ac-8ee6-47d4-8cfb-e35892b3bcc5 tempest-TestShelveInstance-765407413 tempest-TestShelveInstance-765407413-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74613) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 29 18:00:12 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.lightos [None req-f85b99ac-8ee6-47d4-8cfb-e35892b3bcc5 tempest-TestShelveInstance-765407413 tempest-TestShelveInstance-765407413-project-member] LIGHTOS: no hostnqn found. {{(pid=74613) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 29 18:00:12 user nova-compute[74613]: DEBUG os_brick.utils [None req-f85b99ac-8ee6-47d4-8cfb-e35892b3bcc5 tempest-TestShelveInstance-765407413 tempest-TestShelveInstance-765407413-project-member] <== get_connector_properties: return (134ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:400972819b5', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74613) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 18:00:12 user nova-compute[74613]: DEBUG nova.virt.block_device [None req-f85b99ac-8ee6-47d4-8cfb-e35892b3bcc5 tempest-TestShelveInstance-765407413 tempest-TestShelveInstance-765407413-project-member] [instance: fae10c60-f989-4c99-bde4-60cd9f3e2055] Updating existing volume attachment record: 56a4bb87-3d9b-45cc-87f5-66a4bfb4d4c1 {{(pid=74613) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 29 18:00:12 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 18:00:17 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 18:00:17 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:00:17 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74613) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 29 18:00:17 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74613) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 18:00:17 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74613) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 18:00:17 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:00:18 user nova-compute[74613]: DEBUG oslo_service.periodic_task [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74613) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 18:00:18 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 18:00:18 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 18:00:18 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 18:00:18 user nova-compute[74613]: DEBUG nova.compute.resource_tracker [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Auditing locally available compute resources for user (node: user) {{(pid=74613) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 29 18:00:18 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/481055d5-0f19-4637-9b00-869967ea7889/disk --force-share --output=json {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:00:19 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/481055d5-0f19-4637-9b00-869967ea7889/disk --force-share --output=json" returned: 0 in 0.229s {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:00:19 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/481055d5-0f19-4637-9b00-869967ea7889/disk --force-share --output=json {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:00:19 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/481055d5-0f19-4637-9b00-869967ea7889/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:00:19 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c4bdb712-e1f9-4fc0-b527-87088d7eddf8/disk --force-share --output=json {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:00:19 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c4bdb712-e1f9-4fc0-b527-87088d7eddf8/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:00:19 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c4bdb712-e1f9-4fc0-b527-87088d7eddf8/disk --force-share --output=json {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:00:19 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c4bdb712-e1f9-4fc0-b527-87088d7eddf8/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:00:19 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f9be53df-54e6-4f59-9cef-0ba7434f0c29/disk --force-share --output=json {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:00:19 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f9be53df-54e6-4f59-9cef-0ba7434f0c29/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:00:19 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f9be53df-54e6-4f59-9cef-0ba7434f0c29/disk --force-share --output=json {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:00:19 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f9be53df-54e6-4f59-9cef-0ba7434f0c29/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:00:20 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/71f2a1ab-3df7-411c-93fa-b0a1a5a44f0a/disk --force-share --output=json {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:00:20 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/71f2a1ab-3df7-411c-93fa-b0a1a5a44f0a/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:00:20 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/71f2a1ab-3df7-411c-93fa-b0a1a5a44f0a/disk --force-share --output=json {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:00:20 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/71f2a1ab-3df7-411c-93fa-b0a1a5a44f0a/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:00:20 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3b828860-5cc5-40b0-b845-8e560211794e/disk --force-share --output=json {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:00:20 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3b828860-5cc5-40b0-b845-8e560211794e/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:00:20 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3b828860-5cc5-40b0-b845-8e560211794e/disk --force-share --output=json {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:00:20 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3b828860-5cc5-40b0-b845-8e560211794e/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:00:20 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/abc9e2b8-f467-4cd0-b40f-de511fde1ec1/disk --force-share --output=json {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:00:20 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/abc9e2b8-f467-4cd0-b40f-de511fde1ec1/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:00:20 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/abc9e2b8-f467-4cd0-b40f-de511fde1ec1/disk --force-share --output=json {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:00:21 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/abc9e2b8-f467-4cd0-b40f-de511fde1ec1/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:00:21 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0aa463c6-01e7-48e5-b082-e083558342e3/disk --force-share --output=json {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:00:21 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0aa463c6-01e7-48e5-b082-e083558342e3/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:00:21 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0aa463c6-01e7-48e5-b082-e083558342e3/disk --force-share --output=json {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:00:21 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0aa463c6-01e7-48e5-b082-e083558342e3/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:00:21 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74613) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 29 18:00:21 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8fc8496b-1435-4b5f-8977-6c0d7467ef65/disk --force-share --output=json {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:00:21 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8fc8496b-1435-4b5f-8977-6c0d7467ef65/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:00:21 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8fc8496b-1435-4b5f-8977-6c0d7467ef65/disk --force-share --output=json {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:00:21 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8fc8496b-1435-4b5f-8977-6c0d7467ef65/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:00:21 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5221f9b9-e4db-406b-ae82-4a7c6522ee64/disk --force-share --output=json {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:00:22 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5221f9b9-e4db-406b-ae82-4a7c6522ee64/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:00:22 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5221f9b9-e4db-406b-ae82-4a7c6522ee64/disk --force-share --output=json {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:00:22 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5221f9b9-e4db-406b-ae82-4a7c6522ee64/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:00:22 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/74ac9703-1cd7-4983-b7d4-c69b01fec7b2/disk --force-share --output=json {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:00:22 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/74ac9703-1cd7-4983-b7d4-c69b01fec7b2/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:00:22 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/74ac9703-1cd7-4983-b7d4-c69b01fec7b2/disk --force-share --output=json {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:00:22 user nova-compute[74613]: DEBUG nova.network.neutron [None req-7f41620a-b66e-40f2-b568-e11ab877cb6d tempest-ServerActionsTestOtherB-894551005 tempest-ServerActionsTestOtherB-894551005-project-member] [instance: 74ac9703-1cd7-4983-b7d4-c69b01fec7b2] Port c63b6577-fb46-437a-95b3-8321fab45d0c binding to destination host user is already ACTIVE {{(pid=74613) migrate_instance_start /opt/stack/nova/nova/network/neutron.py:3170}}
Nov 29 18:00:22 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-7f41620a-b66e-40f2-b568-e11ab877cb6d tempest-ServerActionsTestOtherB-894551005 tempest-ServerActionsTestOtherB-894551005-project-member] Acquiring lock "refresh_cache-74ac9703-1cd7-4983-b7d4-c69b01fec7b2" {{(pid=74613) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 18:00:22 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-7f41620a-b66e-40f2-b568-e11ab877cb6d tempest-ServerActionsTestOtherB-894551005 tempest-ServerActionsTestOtherB-894551005-project-member] Acquired lock "refresh_cache-74ac9703-1cd7-4983-b7d4-c69b01fec7b2" {{(pid=74613) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 18:00:22 user nova-compute[74613]: DEBUG nova.network.neutron [None req-7f41620a-b66e-40f2-b568-e11ab877cb6d tempest-ServerActionsTestOtherB-894551005 tempest-ServerActionsTestOtherB-894551005-project-member] [instance: 74ac9703-1cd7-4983-b7d4-c69b01fec7b2] Building network info cache for instance {{(pid=74613) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 29 18:00:22 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/74ac9703-1cd7-4983-b7d4-c69b01fec7b2/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:00:22 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=74613) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 29 18:00:23 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:00:23 user nova-compute[74613]: WARNING nova.virt.libvirt.driver [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 18:00:23 user nova-compute[74613]: WARNING nova.virt.libvirt.driver [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 18:00:23 user nova-compute[74613]: DEBUG nova.compute.resource_tracker [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Hypervisor/Node resource view: name=user free_ram=7388MB free_disk=24.948314666748047GB free_vcpus=1 pci_devices=[{"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74613) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 29 18:00:23 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 18:00:23 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 18:00:23 user nova-compute[74613]: DEBUG nova.compute.resource_tracker [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Applying migration context for instance 74ac9703-1cd7-4983-b7d4-c69b01fec7b2 as it has an incoming, in-progress migration 8810a11f-ec67-4d25-b99d-d74f186c3a86. Migration status is reverting {{(pid=74613) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1016}}
Nov 29 18:00:23 user nova-compute[74613]: INFO nova.compute.resource_tracker [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] [instance: 74ac9703-1cd7-4983-b7d4-c69b01fec7b2] Updating resource usage from migration 8810a11f-ec67-4d25-b99d-d74f186c3a86
Nov 29 18:00:23 user nova-compute[74613]: DEBUG nova.compute.resource_tracker [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Instance 3b828860-5cc5-40b0-b845-8e560211794e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74613) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 18:00:23 user nova-compute[74613]: DEBUG nova.compute.resource_tracker [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Instance abc9e2b8-f467-4cd0-b40f-de511fde1ec1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74613) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 18:00:23 user nova-compute[74613]: DEBUG nova.compute.resource_tracker [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Instance cd22685a-028c-4e0c-834d-e7b20f6d06ab actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74613) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 18:00:23 user nova-compute[74613]: DEBUG nova.compute.resource_tracker [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Instance 71f2a1ab-3df7-411c-93fa-b0a1a5a44f0a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74613) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 18:00:23 user nova-compute[74613]: DEBUG nova.compute.resource_tracker [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Instance c4bdb712-e1f9-4fc0-b527-87088d7eddf8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74613) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 18:00:23 user nova-compute[74613]: DEBUG nova.compute.resource_tracker [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Instance 0aa463c6-01e7-48e5-b082-e083558342e3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74613) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 18:00:23 user nova-compute[74613]: DEBUG nova.compute.resource_tracker [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Migration 8810a11f-ec67-4d25-b99d-d74f186c3a86 is active on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74613) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1709}}
Nov 29 18:00:23 user nova-compute[74613]: DEBUG nova.compute.resource_tracker [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Instance 74ac9703-1cd7-4983-b7d4-c69b01fec7b2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 20, 'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=74613) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 18:00:23 user nova-compute[74613]: DEBUG nova.compute.resource_tracker [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Instance f9be53df-54e6-4f59-9cef-0ba7434f0c29 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74613) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 18:00:23 user nova-compute[74613]: DEBUG nova.compute.resource_tracker [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Instance 481055d5-0f19-4637-9b00-869967ea7889 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74613) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 18:00:23 user nova-compute[74613]: DEBUG nova.compute.resource_tracker [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Instance 5221f9b9-e4db-406b-ae82-4a7c6522ee64 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74613) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 18:00:23 user nova-compute[74613]: DEBUG nova.compute.resource_tracker [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Instance 8fc8496b-1435-4b5f-8977-6c0d7467ef65 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74613) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 18:00:23 user nova-compute[74613]: DEBUG nova.compute.resource_tracker [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Instance fae10c60-f989-4c99-bde4-60cd9f3e2055 has been scheduled to this compute host, the scheduler has made an allocation against this compute node but the instance has yet to start. Skipping heal of allocation: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74613) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1761}}
Nov 29 18:00:23 user nova-compute[74613]: DEBUG nova.compute.resource_tracker [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Total usable vcpus: 12, total allocated vcpus: 12 {{(pid=74613) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 29 18:00:23 user nova-compute[74613]: DEBUG nova.compute.resource_tracker [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Final resource view: name=user phys_ram=16011MB used_ram=8192MB phys_disk=40GB used_disk=30GB total_vcpus=12 used_vcpus=12 pci_stats=[] {{(pid=74613) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 29 18:00:23 user nova-compute[74613]: DEBUG nova.network.neutron [None req-7f41620a-b66e-40f2-b568-e11ab877cb6d tempest-ServerActionsTestOtherB-894551005 tempest-ServerActionsTestOtherB-894551005-project-member] [instance: 74ac9703-1cd7-4983-b7d4-c69b01fec7b2] Updating instance_info_cache with network_info: [{"id": "c63b6577-fb46-437a-95b3-8321fab45d0c", "address": "fa:16:3e:c3:2e:71", "network": {"id": "e687ed60-2592-4836-b97e-0828527b1b9f", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1938956411-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.143", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b392ca87608940c0ae467318b66453b2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc63b6577-fb", "ovs_interfaceid": "c63b6577-fb46-437a-95b3-8321fab45d0c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74613) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 18:00:23 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-7f41620a-b66e-40f2-b568-e11ab877cb6d tempest-ServerActionsTestOtherB-894551005 tempest-ServerActionsTestOtherB-894551005-project-member] Releasing lock "refresh_cache-74ac9703-1cd7-4983-b7d4-c69b01fec7b2" {{(pid=74613) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 18:00:23 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-7f41620a-b66e-40f2-b568-e11ab877cb6d tempest-ServerActionsTestOtherB-894551005 tempest-ServerActionsTestOtherB-894551005-project-member] [instance: 74ac9703-1cd7-4983-b7d4-c69b01fec7b2] Creating tmpfile /opt/stack/data/nova/instances/74ac9703-1cd7-4983-b7d4-c69b01fec7b2/tmp4carecg8 to verify with other compute node that the instance is on the same shared storage. {{(pid=74613) check_instance_shared_storage_local /opt/stack/nova/nova/virt/libvirt/driver.py:9625}}
Nov 29 18:00:23 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:00:23 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:00:23 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:00:23 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:00:23 user nova-compute[74613]: DEBUG nova.compute.provider_tree [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Inventory has not changed in ProviderTree for provider: 639d980e-3b12-44b1-b8f4-1812416fa4dd {{(pid=74613) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 18:00:23 user nova-compute[74613]: DEBUG nova.scheduler.client.report [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Inventory has not changed for provider 639d980e-3b12-44b1-b8f4-1812416fa4dd based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74613) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 18:00:23 user nova-compute[74613]: DEBUG nova.compute.resource_tracker [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Compute_service record updated for user:user {{(pid=74613) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 29 18:00:23 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.787s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 18:00:23 user nova-compute[74613]: DEBUG nova.compute.manager [req-38fc038d-357d-4fb0-8dc4-a4276a2a5871 req-b8d8e300-c87a-4658-836f-8700de5504c3 service nova] [instance: 74ac9703-1cd7-4983-b7d4-c69b01fec7b2] Received event network-vif-unplugged-c63b6577-fb46-437a-95b3-8321fab45d0c {{(pid=74613) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 18:00:23 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-38fc038d-357d-4fb0-8dc4-a4276a2a5871 req-b8d8e300-c87a-4658-836f-8700de5504c3 service nova] Acquiring lock "74ac9703-1cd7-4983-b7d4-c69b01fec7b2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 18:00:23 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-38fc038d-357d-4fb0-8dc4-a4276a2a5871 req-b8d8e300-c87a-4658-836f-8700de5504c3 service nova] Lock "74ac9703-1cd7-4983-b7d4-c69b01fec7b2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 18:00:23 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-38fc038d-357d-4fb0-8dc4-a4276a2a5871 req-b8d8e300-c87a-4658-836f-8700de5504c3 service nova] Lock "74ac9703-1cd7-4983-b7d4-c69b01fec7b2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 18:00:23 user nova-compute[74613]: DEBUG nova.compute.manager [req-38fc038d-357d-4fb0-8dc4-a4276a2a5871 req-b8d8e300-c87a-4658-836f-8700de5504c3 service nova] [instance: 74ac9703-1cd7-4983-b7d4-c69b01fec7b2] No waiting events found dispatching network-vif-unplugged-c63b6577-fb46-437a-95b3-8321fab45d0c {{(pid=74613) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 18:00:23 user nova-compute[74613]: WARNING nova.compute.manager [req-38fc038d-357d-4fb0-8dc4-a4276a2a5871 req-b8d8e300-c87a-4658-836f-8700de5504c3 service nova] [instance: 74ac9703-1cd7-4983-b7d4-c69b01fec7b2] Received unexpected event network-vif-unplugged-c63b6577-fb46-437a-95b3-8321fab45d0c for instance with vm_state resized and task_state resize_reverting.
Nov 29 18:00:24 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:00:24 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:00:24 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:00:24 user nova-compute[74613]: INFO nova.virt.libvirt.driver [-] [instance: 74ac9703-1cd7-4983-b7d4-c69b01fec7b2] Instance destroyed successfully.
Nov 29 18:00:24 user nova-compute[74613]: DEBUG nova.objects.instance [None req-7f41620a-b66e-40f2-b568-e11ab877cb6d tempest-ServerActionsTestOtherB-894551005 tempest-ServerActionsTestOtherB-894551005-project-member] Lazy-loading 'resources' on Instance uuid 74ac9703-1cd7-4983-b7d4-c69b01fec7b2 {{(pid=74613) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 18:00:24 user nova-compute[74613]: DEBUG nova.virt.libvirt.vif [None req-7f41620a-b66e-40f2-b568-e11ab877cb6d tempest-ServerActionsTestOtherB-894551005 tempest-ServerActionsTestOtherB-894551005-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T17:55:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-931769463',display_name='tempest-ServerActionsTestOtherB-server-931769463',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-931769463',id=14,image_ref='4217f428-8d9d-4ee1-9614-642d26d90c46',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBE0p3wmKXoOCABzKEPJ0MsHfAtC1JQfzjVn7a3OeQC65p309Te6g/AbiDIZbrFAX7j9aAJfq/HNC8gx1yP/V9/PHfR3o28o9EgbHEcoTtW/dEJGkpFGjjy+hrqfOfHYCnA==',key_name='tempest-keypair-464492783',keypairs=<?>,launch_index=0,launched_at=2023-11-29T17:58:52Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=<?>,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='b392ca87608940c0ae467318b66453b2',ramdisk_id='',reservation_id='r-0wzexjb0',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='4217f428-8d9d-4ee1-9614-642d26d90c46',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-894551005',owner_user_name='tempest-ServerActionsTestOtherB-894551005-project-member'},tags=<?>,task_state='resize_reverting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-29T17:58:52Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1a6eb590fed440729b45b8db79eb7c2f',uuid=74ac9703-1cd7-4983-b7d4-c69b01fec7b2,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='resized') vif={"id": "c63b6577-fb46-437a-95b3-8321fab45d0c", "address": "fa:16:3e:c3:2e:71", "network": {"id": "e687ed60-2592-4836-b97e-0828527b1b9f", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1938956411-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.143", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b392ca87608940c0ae467318b66453b2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc63b6577-fb", "ovs_interfaceid": "c63b6577-fb46-437a-95b3-8321fab45d0c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74613) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 29 18:00:24 user nova-compute[74613]: DEBUG nova.network.os_vif_util [None req-7f41620a-b66e-40f2-b568-e11ab877cb6d tempest-ServerActionsTestOtherB-894551005 tempest-ServerActionsTestOtherB-894551005-project-member] Converting VIF {"id": "c63b6577-fb46-437a-95b3-8321fab45d0c", "address": "fa:16:3e:c3:2e:71", "network": {"id": "e687ed60-2592-4836-b97e-0828527b1b9f", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1938956411-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.143", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b392ca87608940c0ae467318b66453b2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc63b6577-fb", "ovs_interfaceid": "c63b6577-fb46-437a-95b3-8321fab45d0c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74613) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 18:00:24 user nova-compute[74613]: DEBUG nova.network.os_vif_util [None req-7f41620a-b66e-40f2-b568-e11ab877cb6d tempest-ServerActionsTestOtherB-894551005 tempest-ServerActionsTestOtherB-894551005-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:c3:2e:71,bridge_name='br-int',has_traffic_filtering=True,id=c63b6577-fb46-437a-95b3-8321fab45d0c,network=Network(e687ed60-2592-4836-b97e-0828527b1b9f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc63b6577-fb') {{(pid=74613) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 18:00:24 user nova-compute[74613]: DEBUG os_vif [None req-7f41620a-b66e-40f2-b568-e11ab877cb6d tempest-ServerActionsTestOtherB-894551005 tempest-ServerActionsTestOtherB-894551005-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:c3:2e:71,bridge_name='br-int',has_traffic_filtering=True,id=c63b6577-fb46-437a-95b3-8321fab45d0c,network=Network(e687ed60-2592-4836-b97e-0828527b1b9f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc63b6577-fb') {{(pid=74613) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 29 18:00:24 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:00:24 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapc63b6577-fb, bridge=br-int, if_exists=True) {{(pid=74613) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 18:00:24 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:00:24 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 18:00:24 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:00:24 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=5d18044f-2f0c-4131-af2e-7f7807e4fa8a) {{(pid=74613) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 18:00:24 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:00:24 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:00:24 user nova-compute[74613]: INFO os_vif [None req-7f41620a-b66e-40f2-b568-e11ab877cb6d tempest-ServerActionsTestOtherB-894551005 tempest-ServerActionsTestOtherB-894551005-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:c3:2e:71,bridge_name='br-int',has_traffic_filtering=True,id=c63b6577-fb46-437a-95b3-8321fab45d0c,network=Network(e687ed60-2592-4836-b97e-0828527b1b9f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc63b6577-fb')
Nov 29 18:00:24 user nova-compute[74613]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7f41620a-b66e-40f2-b568-e11ab877cb6d tempest-ServerActionsTestOtherB-894551005 tempest-ServerActionsTestOtherB-894551005-project-member] [instance: 74ac9703-1cd7-4983-b7d4-c69b01fec7b2] calling os-brick to detach iSCSI Volume {{(pid=74613) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 29 18:00:24 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f41620a-b66e-40f2-b568-e11ab877cb6d tempest-ServerActionsTestOtherB-894551005 tempest-ServerActionsTestOtherB-894551005-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff828156890>, {'target_iqn': 'iqn.2010-10.org.openstack:bb526b54-3017-4f30-b5c7-88027b146d52', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RtrxDocV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=74613) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 18:00:24 user nova-compute[74613]: WARNING os_brick.initiator.connectors.base [None req-7f41620a-b66e-40f2-b568-e11ab877cb6d tempest-ServerActionsTestOtherB-894551005 tempest-ServerActionsTestOtherB-894551005-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 18:00:24 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.base [None req-7f41620a-b66e-40f2-b568-e11ab877cb6d tempest-ServerActionsTestOtherB-894551005 tempest-ServerActionsTestOtherB-894551005-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 18:00:24 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.base [None req-7f41620a-b66e-40f2-b568-e11ab877cb6d tempest-ServerActionsTestOtherB-894551005 tempest-ServerActionsTestOtherB-894551005-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 18:00:24 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:00:24 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:00:24 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a131694-bbae-49ff-bf70-f63d4d8a829c]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:9511387c-8772-40f2-bf2d-6b6387649e9f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:72d22ffa-f425-4575-86a5-afbd8bb9cdd6\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:bb526b54-3017-4f30-b5c7-88027b146d52\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 18:00:24 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f41620a-b66e-40f2-b568-e11ab877cb6d tempest-ServerActionsTestOtherB-894551005 tempest-ServerActionsTestOtherB-894551005-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 29 18:00:24 user nova-compute[74613]: No targets found.
Nov 29 18:00:24 user nova-compute[74613]: iSNS:
Nov 29 18:00:24 user nova-compute[74613]: No targets found.
Nov 29 18:00:24 user nova-compute[74613]: STATIC:
Nov 29 18:00:24 user nova-compute[74613]: Target: iqn.2010-10.org.openstack:9511387c-8772-40f2-bf2d-6b6387649e9f
Nov 29 18:00:24 user nova-compute[74613]:         Portal: 172.16.0.220:3260,-1
Nov 29 18:00:24 user nova-compute[74613]:                 Iface Name: default
Nov 29 18:00:24 user nova-compute[74613]: Target: iqn.2010-10.org.openstack:72d22ffa-f425-4575-86a5-afbd8bb9cdd6
Nov 29 18:00:24 user nova-compute[74613]:         Portal: 172.16.0.220:3260,-1
Nov 29 18:00:24 user nova-compute[74613]:                 Iface Name: default
Nov 29 18:00:24 user nova-compute[74613]: Target: iqn.2010-10.org.openstack:bb526b54-3017-4f30-b5c7-88027b146d52
Nov 29 18:00:24 user nova-compute[74613]:         Portal: 172.16.0.220:3260,-1
Nov 29 18:00:24 user nova-compute[74613]:                 Iface Name: default
Nov 29 18:00:24 user nova-compute[74613]: FIRMWARE:
Nov 29 18:00:24 user nova-compute[74613]: No targets found.
Nov 29 18:00:24 user nova-compute[74613]:  stderr= {{(pid=74613) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 18:00:24 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f41620a-b66e-40f2-b568-e11ab877cb6d tempest-ServerActionsTestOtherB-894551005 tempest-ServerActionsTestOtherB-894551005-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 29 18:00:24 user nova-compute[74613]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 29 18:00:24 user nova-compute[74613]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74613) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 29 18:00:24 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f41620a-b66e-40f2-b568-e11ab877cb6d tempest-ServerActionsTestOtherB-894551005 tempest-ServerActionsTestOtherB-894551005-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:bb526b54-3017-4f30-b5c7-88027b146d52', 0)] {{(pid=74613) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 29 18:00:24 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:00:24 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:00:24 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[77f8289f-74db-4775-82a8-a4f6158395dd]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:72d22ffa-f425-4575-86a5-afbd8bb9cdd6\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9511387c-8772-40f2-bf2d-6b6387649e9f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:bb526b54-3017-4f30-b5c7-88027b146d52\n', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 18:00:24 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:00:24 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:00:24 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.033s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:00:24 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[01423c02-bbd2-4172-9b88-1460b0b220e5]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9511387c-8772-40f2-bf2d-6b6387649e9f (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:72d22ffa-f425-4575-86a5-afbd8bb9cdd6 (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb526b54-3017-4f30-b5c7-88027b146d52 (non-flash)\n', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 18:00:24 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f41620a-b66e-40f2-b568-e11ab877cb6d tempest-ServerActionsTestOtherB-894551005 tempest-ServerActionsTestOtherB-894551005-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9511387c-8772-40f2-bf2d-6b6387649e9f (non-flash)
Nov 29 18:00:24 user nova-compute[74613]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:72d22ffa-f425-4575-86a5-afbd8bb9cdd6 (non-flash)
Nov 29 18:00:24 user nova-compute[74613]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb526b54-3017-4f30-b5c7-88027b146d52 (non-flash)
Nov 29 18:00:24 user nova-compute[74613]:  stderr= {{(pid=74613) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 18:00:24 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f41620a-b66e-40f2-b568-e11ab877cb6d tempest-ServerActionsTestOtherB-894551005 tempest-ServerActionsTestOtherB-894551005-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9511387c-8772-40f2-bf2d-6b6387649e9f (non-flash)
Nov 29 18:00:24 user nova-compute[74613]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:72d22ffa-f425-4575-86a5-afbd8bb9cdd6 (non-flash)
Nov 29 18:00:24 user nova-compute[74613]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb526b54-3017-4f30-b5c7-88027b146d52 (non-flash)
Nov 29 18:00:24 user nova-compute[74613]:  stderr= {{(pid=74613) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 18:00:24 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f41620a-b66e-40f2-b568-e11ab877cb6d tempest-ServerActionsTestOtherB-894551005 tempest-ServerActionsTestOtherB-894551005-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7ff818113640>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:bb526b54-3017-4f30-b5c7-88027b146d52'): ({'sdc'}, set())}) {{(pid=74613) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 29 18:00:24 user nova-compute[74613]: DEBUG os_brick.initiator.linuxscsi [None req-7f41620a-b66e-40f2-b568-e11ab877cb6d tempest-ServerActionsTestOtherB-894551005 tempest-ServerActionsTestOtherB-894551005-project-member] Removing single pathed devices sdc {{(pid=74613) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 29 18:00:24 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:00:24 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.025s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:00:24 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[aeed436e-ff3d-45b6-ad38-c8277d7a1e4f]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 18:00:24 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:00:24 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.019s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:00:24 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c10b2d6-4dcb-4ed9-9d21-0b4daca6873a]: (4, ('ok\n', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 18:00:24 user nova-compute[74613]: DEBUG os_brick.initiator.linuxscsi [None req-7f41620a-b66e-40f2-b568-e11ab877cb6d tempest-ServerActionsTestOtherB-894551005 tempest-ServerActionsTestOtherB-894551005-project-member] Flushing IO for device /dev/sdc {{(pid=74613) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 29 18:00:24 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:00:24 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.018s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:00:24 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[69d5a707-e3a1-4404-8588-e2408d72ceb1]: (4, ('', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 18:00:24 user nova-compute[74613]: DEBUG os_brick.initiator.linuxscsi [None req-7f41620a-b66e-40f2-b568-e11ab877cb6d tempest-ServerActionsTestOtherB-894551005 tempest-ServerActionsTestOtherB-894551005-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=74613) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 29 18:00:24 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:00:24 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.035s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:00:24 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb8a5ad2-9f36-4afb-b61d-2c31d6fca297]: (4, ('1', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 18:00:24 user nova-compute[74613]: DEBUG os_brick.initiator.linuxscsi [None req-7f41620a-b66e-40f2-b568-e11ab877cb6d tempest-ServerActionsTestOtherB-894551005 tempest-ServerActionsTestOtherB-894551005-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=74613) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 29 18:00:24 user nova-compute[74613]: DEBUG os_brick.initiator.linuxscsi [None req-7f41620a-b66e-40f2-b568-e11ab877cb6d tempest-ServerActionsTestOtherB-894551005 tempest-ServerActionsTestOtherB-894551005-project-member] SCSI volumes sdc have been removed. {{(pid=74613) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 29 18:00:24 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f41620a-b66e-40f2-b568-e11ab877cb6d tempest-ServerActionsTestOtherB-894551005 tempest-ServerActionsTestOtherB-894551005-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:bb526b54-3017-4f30-b5c7-88027b146d52')] {{(pid=74613) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 29 18:00:24 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bb526b54-3017-4f30-b5c7-88027b146d52 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:00:24 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bb526b54-3017-4f30-b5c7-88027b146d52 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:00:24 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[99432cde-393d-46ef-90c5-fd1460f11e76]: (4, ('', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 18:00:24 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f41620a-b66e-40f2-b568-e11ab877cb6d tempest-ServerActionsTestOtherB-894551005 tempest-ServerActionsTestOtherB-894551005-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74613) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 18:00:24 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bb526b54-3017-4f30-b5c7-88027b146d52 -p 172.16.0.220:3260 --logout {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:00:24 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bb526b54-3017-4f30-b5c7-88027b146d52 -p 172.16.0.220:3260 --logout" returned: 0 in 0.072s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:00:24 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[61f0be0b-c1ee-4d6a-a0a8-e293b724eaad]: (4, ('Logging out of session [sid: 22, target: iqn.2010-10.org.openstack:bb526b54-3017-4f30-b5c7-88027b146d52, portal: 172.16.0.220,3260]\nLogout of [sid: 22, target: iqn.2010-10.org.openstack:bb526b54-3017-4f30-b5c7-88027b146d52, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 18:00:24 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f41620a-b66e-40f2-b568-e11ab877cb6d tempest-ServerActionsTestOtherB-894551005 tempest-ServerActionsTestOtherB-894551005-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 22, target: iqn.2010-10.org.openstack:bb526b54-3017-4f30-b5c7-88027b146d52, portal: 172.16.0.220,3260]
Nov 29 18:00:24 user nova-compute[74613]: Logout of [sid: 22, target: iqn.2010-10.org.openstack:bb526b54-3017-4f30-b5c7-88027b146d52, portal: 172.16.0.220,3260] successful.
Nov 29 18:00:24 user nova-compute[74613]:  stderr= {{(pid=74613) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 18:00:24 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bb526b54-3017-4f30-b5c7-88027b146d52 -p 172.16.0.220:3260 --op delete {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:00:24 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bb526b54-3017-4f30-b5c7-88027b146d52 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.024s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:00:24 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[00b3dc6c-e091-423a-9dc1-b626f31b599e]: (4, ('', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 18:00:24 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f41620a-b66e-40f2-b568-e11ab877cb6d tempest-ServerActionsTestOtherB-894551005 tempest-ServerActionsTestOtherB-894551005-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74613) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 18:00:24 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.base [None req-7f41620a-b66e-40f2-b568-e11ab877cb6d tempest-ServerActionsTestOtherB-894551005 tempest-ServerActionsTestOtherB-894551005-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.350s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 18:00:24 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f41620a-b66e-40f2-b568-e11ab877cb6d tempest-ServerActionsTestOtherB-894551005 tempest-ServerActionsTestOtherB-894551005-project-member] <== disconnect_volume: return (351ms) None {{(pid=74613) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 18:00:24 user nova-compute[74613]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7f41620a-b66e-40f2-b568-e11ab877cb6d tempest-ServerActionsTestOtherB-894551005 tempest-ServerActionsTestOtherB-894551005-project-member] [instance: 74ac9703-1cd7-4983-b7d4-c69b01fec7b2] Disconnected iSCSI Volume {{(pid=74613) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 29 18:00:24 user nova-compute[74613]: DEBUG oslo_service.periodic_task [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74613) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 18:00:24 user nova-compute[74613]: DEBUG oslo_service.periodic_task [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74613) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 18:00:24 user nova-compute[74613]: DEBUG nova.compute.manager [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Starting heal instance info cache {{(pid=74613) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 29 18:00:24 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:00:24 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:00:24 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:00:25 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Acquiring lock "refresh_cache-cd22685a-028c-4e0c-834d-e7b20f6d06ab" {{(pid=74613) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 18:00:25 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Acquired lock "refresh_cache-cd22685a-028c-4e0c-834d-e7b20f6d06ab" {{(pid=74613) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 18:00:25 user nova-compute[74613]: DEBUG nova.network.neutron [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] [instance: cd22685a-028c-4e0c-834d-e7b20f6d06ab] Forcefully refreshing network info cache for instance {{(pid=74613) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 29 18:00:25 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:00:25 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:00:25 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:00:25 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:00:25 user nova-compute[74613]: DEBUG nova.network.neutron [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] [instance: cd22685a-028c-4e0c-834d-e7b20f6d06ab] Updating instance_info_cache with network_info: [{"id": "5b08bd65-707e-48a5-800b-dd0670c88d61", "address": "fa:16:3e:28:d8:3d", "network": {"id": "0722b02d-a357-4360-87e8-580913723985", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-579793494-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b820dd795dfe46cd804772f0e71f98e9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5b08bd65-70", "ovs_interfaceid": "5b08bd65-707e-48a5-800b-dd0670c88d61", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74613) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 18:00:25 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Releasing lock "refresh_cache-cd22685a-028c-4e0c-834d-e7b20f6d06ab" {{(pid=74613) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 18:00:25 user nova-compute[74613]: DEBUG nova.compute.manager [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] [instance: cd22685a-028c-4e0c-834d-e7b20f6d06ab] Updated the network info_cache for instance {{(pid=74613) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 29 18:00:25 user nova-compute[74613]: DEBUG oslo_service.periodic_task [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74613) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 18:00:25 user nova-compute[74613]: DEBUG oslo_service.periodic_task [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74613) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 18:00:25 user nova-compute[74613]: DEBUG oslo_service.periodic_task [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74613) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 18:00:25 user nova-compute[74613]: DEBUG oslo_service.periodic_task [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74613) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 18:00:25 user nova-compute[74613]: DEBUG oslo_service.periodic_task [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74613) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 18:00:25 user nova-compute[74613]: DEBUG oslo_service.periodic_task [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74613) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 18:00:25 user nova-compute[74613]: DEBUG nova.compute.manager [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74613) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 29 18:00:25 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-f85b99ac-8ee6-47d4-8cfb-e35892b3bcc5 tempest-TestShelveInstance-765407413 tempest-TestShelveInstance-765407413-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 18:00:25 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-f85b99ac-8ee6-47d4-8cfb-e35892b3bcc5 tempest-TestShelveInstance-765407413 tempest-TestShelveInstance-765407413-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 18:00:25 user nova-compute[74613]: DEBUG nova.objects.instance [None req-f85b99ac-8ee6-47d4-8cfb-e35892b3bcc5 tempest-TestShelveInstance-765407413 tempest-TestShelveInstance-765407413-project-member] Lazy-loading 'pci_requests' on Instance uuid fae10c60-f989-4c99-bde4-60cd9f3e2055 {{(pid=74613) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 18:00:25 user nova-compute[74613]: DEBUG nova.objects.instance [None req-f85b99ac-8ee6-47d4-8cfb-e35892b3bcc5 tempest-TestShelveInstance-765407413 tempest-TestShelveInstance-765407413-project-member] Lazy-loading 'numa_topology' on Instance uuid fae10c60-f989-4c99-bde4-60cd9f3e2055 {{(pid=74613) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 18:00:25 user nova-compute[74613]: DEBUG nova.virt.hardware [None req-f85b99ac-8ee6-47d4-8cfb-e35892b3bcc5 tempest-TestShelveInstance-765407413 tempest-TestShelveInstance-765407413-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74613) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 29 18:00:25 user nova-compute[74613]: INFO nova.compute.claims [None req-f85b99ac-8ee6-47d4-8cfb-e35892b3bcc5 tempest-TestShelveInstance-765407413 tempest-TestShelveInstance-765407413-project-member] [instance: fae10c60-f989-4c99-bde4-60cd9f3e2055] Claim successful on node user
Nov 29 18:00:25 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-7f41620a-b66e-40f2-b568-e11ab877cb6d tempest-ServerActionsTestOtherB-894551005 tempest-ServerActionsTestOtherB-894551005-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_dest" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 18:00:26 user nova-compute[74613]: DEBUG nova.compute.manager [req-aba49475-9953-4b0a-a95e-d111631b08f4 req-70470ffc-3874-4ac4-a54c-385f2ec6bb6e service nova] [instance: 74ac9703-1cd7-4983-b7d4-c69b01fec7b2] Received event network-vif-plugged-c63b6577-fb46-437a-95b3-8321fab45d0c {{(pid=74613) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 18:00:26 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-aba49475-9953-4b0a-a95e-d111631b08f4 req-70470ffc-3874-4ac4-a54c-385f2ec6bb6e service nova] Acquiring lock "74ac9703-1cd7-4983-b7d4-c69b01fec7b2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 18:00:26 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-aba49475-9953-4b0a-a95e-d111631b08f4 req-70470ffc-3874-4ac4-a54c-385f2ec6bb6e service nova] Lock "74ac9703-1cd7-4983-b7d4-c69b01fec7b2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 18:00:26 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-aba49475-9953-4b0a-a95e-d111631b08f4 req-70470ffc-3874-4ac4-a54c-385f2ec6bb6e service nova] Lock "74ac9703-1cd7-4983-b7d4-c69b01fec7b2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 18:00:26 user nova-compute[74613]: DEBUG nova.compute.manager [req-aba49475-9953-4b0a-a95e-d111631b08f4 req-70470ffc-3874-4ac4-a54c-385f2ec6bb6e service nova] [instance: 74ac9703-1cd7-4983-b7d4-c69b01fec7b2] No waiting events found dispatching network-vif-plugged-c63b6577-fb46-437a-95b3-8321fab45d0c {{(pid=74613) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 18:00:26 user nova-compute[74613]: WARNING nova.compute.manager [req-aba49475-9953-4b0a-a95e-d111631b08f4 req-70470ffc-3874-4ac4-a54c-385f2ec6bb6e service nova] [instance: 74ac9703-1cd7-4983-b7d4-c69b01fec7b2] Received unexpected event network-vif-plugged-c63b6577-fb46-437a-95b3-8321fab45d0c for instance with vm_state resized and task_state resize_reverting.
Nov 29 18:00:26 user nova-compute[74613]: DEBUG nova.compute.manager [req-aba49475-9953-4b0a-a95e-d111631b08f4 req-70470ffc-3874-4ac4-a54c-385f2ec6bb6e service nova] [instance: 74ac9703-1cd7-4983-b7d4-c69b01fec7b2] Received event network-vif-plugged-c63b6577-fb46-437a-95b3-8321fab45d0c {{(pid=74613) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 18:00:26 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-aba49475-9953-4b0a-a95e-d111631b08f4 req-70470ffc-3874-4ac4-a54c-385f2ec6bb6e service nova] Acquiring lock "74ac9703-1cd7-4983-b7d4-c69b01fec7b2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 18:00:26 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-aba49475-9953-4b0a-a95e-d111631b08f4 req-70470ffc-3874-4ac4-a54c-385f2ec6bb6e service nova] Lock "74ac9703-1cd7-4983-b7d4-c69b01fec7b2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 18:00:26 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-aba49475-9953-4b0a-a95e-d111631b08f4 req-70470ffc-3874-4ac4-a54c-385f2ec6bb6e service nova] Lock "74ac9703-1cd7-4983-b7d4-c69b01fec7b2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 18:00:26 user nova-compute[74613]: DEBUG nova.compute.manager [req-aba49475-9953-4b0a-a95e-d111631b08f4 req-70470ffc-3874-4ac4-a54c-385f2ec6bb6e service nova] [instance: 74ac9703-1cd7-4983-b7d4-c69b01fec7b2] No waiting events found dispatching network-vif-plugged-c63b6577-fb46-437a-95b3-8321fab45d0c {{(pid=74613) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 18:00:26 user nova-compute[74613]: WARNING nova.compute.manager [req-aba49475-9953-4b0a-a95e-d111631b08f4 req-70470ffc-3874-4ac4-a54c-385f2ec6bb6e service nova] [instance: 74ac9703-1cd7-4983-b7d4-c69b01fec7b2] Received unexpected event network-vif-plugged-c63b6577-fb46-437a-95b3-8321fab45d0c for instance with vm_state resized and task_state resize_reverting.
Nov 29 18:00:26 user nova-compute[74613]: DEBUG nova.compute.manager [req-aba49475-9953-4b0a-a95e-d111631b08f4 req-70470ffc-3874-4ac4-a54c-385f2ec6bb6e service nova] [instance: 74ac9703-1cd7-4983-b7d4-c69b01fec7b2] Received event network-vif-plugged-c63b6577-fb46-437a-95b3-8321fab45d0c {{(pid=74613) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 18:00:26 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-aba49475-9953-4b0a-a95e-d111631b08f4 req-70470ffc-3874-4ac4-a54c-385f2ec6bb6e service nova] Acquiring lock "74ac9703-1cd7-4983-b7d4-c69b01fec7b2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 18:00:26 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-aba49475-9953-4b0a-a95e-d111631b08f4 req-70470ffc-3874-4ac4-a54c-385f2ec6bb6e service nova] Lock "74ac9703-1cd7-4983-b7d4-c69b01fec7b2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 18:00:26 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-aba49475-9953-4b0a-a95e-d111631b08f4 req-70470ffc-3874-4ac4-a54c-385f2ec6bb6e service nova] Lock "74ac9703-1cd7-4983-b7d4-c69b01fec7b2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 18:00:26 user nova-compute[74613]: DEBUG nova.compute.manager [req-aba49475-9953-4b0a-a95e-d111631b08f4 req-70470ffc-3874-4ac4-a54c-385f2ec6bb6e service nova] [instance: 74ac9703-1cd7-4983-b7d4-c69b01fec7b2] No waiting events found dispatching network-vif-plugged-c63b6577-fb46-437a-95b3-8321fab45d0c {{(pid=74613) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 18:00:26 user nova-compute[74613]: WARNING nova.compute.manager [req-aba49475-9953-4b0a-a95e-d111631b08f4 req-70470ffc-3874-4ac4-a54c-385f2ec6bb6e service nova] [instance: 74ac9703-1cd7-4983-b7d4-c69b01fec7b2] Received unexpected event network-vif-plugged-c63b6577-fb46-437a-95b3-8321fab45d0c for instance with vm_state resized and task_state resize_reverting.
Nov 29 18:00:26 user nova-compute[74613]: DEBUG nova.compute.manager [req-aba49475-9953-4b0a-a95e-d111631b08f4 req-70470ffc-3874-4ac4-a54c-385f2ec6bb6e service nova] [instance: 74ac9703-1cd7-4983-b7d4-c69b01fec7b2] Received event network-vif-unplugged-c63b6577-fb46-437a-95b3-8321fab45d0c {{(pid=74613) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 18:00:26 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-aba49475-9953-4b0a-a95e-d111631b08f4 req-70470ffc-3874-4ac4-a54c-385f2ec6bb6e service nova] Acquiring lock "74ac9703-1cd7-4983-b7d4-c69b01fec7b2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 18:00:26 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-aba49475-9953-4b0a-a95e-d111631b08f4 req-70470ffc-3874-4ac4-a54c-385f2ec6bb6e service nova] Lock "74ac9703-1cd7-4983-b7d4-c69b01fec7b2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 18:00:26 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-aba49475-9953-4b0a-a95e-d111631b08f4 req-70470ffc-3874-4ac4-a54c-385f2ec6bb6e service nova] Lock "74ac9703-1cd7-4983-b7d4-c69b01fec7b2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 18:00:26 user nova-compute[74613]: DEBUG nova.compute.manager [req-aba49475-9953-4b0a-a95e-d111631b08f4 req-70470ffc-3874-4ac4-a54c-385f2ec6bb6e service nova] [instance: 74ac9703-1cd7-4983-b7d4-c69b01fec7b2] No waiting events found dispatching network-vif-unplugged-c63b6577-fb46-437a-95b3-8321fab45d0c {{(pid=74613) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 18:00:26 user nova-compute[74613]: WARNING nova.compute.manager [req-aba49475-9953-4b0a-a95e-d111631b08f4 req-70470ffc-3874-4ac4-a54c-385f2ec6bb6e service nova] [instance: 74ac9703-1cd7-4983-b7d4-c69b01fec7b2] Received unexpected event network-vif-unplugged-c63b6577-fb46-437a-95b3-8321fab45d0c for instance with vm_state resized and task_state resize_reverting.
Nov 29 18:00:26 user nova-compute[74613]: DEBUG nova.compute.manager [req-aba49475-9953-4b0a-a95e-d111631b08f4 req-70470ffc-3874-4ac4-a54c-385f2ec6bb6e service nova] [instance: 74ac9703-1cd7-4983-b7d4-c69b01fec7b2] Received event network-vif-plugged-c63b6577-fb46-437a-95b3-8321fab45d0c {{(pid=74613) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 18:00:26 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-aba49475-9953-4b0a-a95e-d111631b08f4 req-70470ffc-3874-4ac4-a54c-385f2ec6bb6e service nova] Acquiring lock "74ac9703-1cd7-4983-b7d4-c69b01fec7b2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 18:00:26 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-aba49475-9953-4b0a-a95e-d111631b08f4 req-70470ffc-3874-4ac4-a54c-385f2ec6bb6e service nova] Lock "74ac9703-1cd7-4983-b7d4-c69b01fec7b2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 18:00:26 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-aba49475-9953-4b0a-a95e-d111631b08f4 req-70470ffc-3874-4ac4-a54c-385f2ec6bb6e service nova] Lock "74ac9703-1cd7-4983-b7d4-c69b01fec7b2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 18:00:26 user nova-compute[74613]: DEBUG nova.compute.manager [req-aba49475-9953-4b0a-a95e-d111631b08f4 req-70470ffc-3874-4ac4-a54c-385f2ec6bb6e service nova] [instance: 74ac9703-1cd7-4983-b7d4-c69b01fec7b2] No waiting events found dispatching network-vif-plugged-c63b6577-fb46-437a-95b3-8321fab45d0c {{(pid=74613) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 18:00:26 user nova-compute[74613]: WARNING nova.compute.manager [req-aba49475-9953-4b0a-a95e-d111631b08f4 req-70470ffc-3874-4ac4-a54c-385f2ec6bb6e service nova] [instance: 74ac9703-1cd7-4983-b7d4-c69b01fec7b2] Received unexpected event network-vif-plugged-c63b6577-fb46-437a-95b3-8321fab45d0c for instance with vm_state resized and task_state resize_reverting.
Nov 29 18:00:26 user nova-compute[74613]: DEBUG nova.compute.provider_tree [None req-f85b99ac-8ee6-47d4-8cfb-e35892b3bcc5 tempest-TestShelveInstance-765407413 tempest-TestShelveInstance-765407413-project-member] Inventory has not changed in ProviderTree for provider: 639d980e-3b12-44b1-b8f4-1812416fa4dd {{(pid=74613) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 18:00:26 user nova-compute[74613]: DEBUG nova.scheduler.client.report [None req-f85b99ac-8ee6-47d4-8cfb-e35892b3bcc5 tempest-TestShelveInstance-765407413 tempest-TestShelveInstance-765407413-project-member] Inventory has not changed for provider 639d980e-3b12-44b1-b8f4-1812416fa4dd based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74613) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 18:00:26 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-f85b99ac-8ee6-47d4-8cfb-e35892b3bcc5 tempest-TestShelveInstance-765407413 tempest-TestShelveInstance-765407413-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.541s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 18:00:26 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-7f41620a-b66e-40f2-b568-e11ab877cb6d tempest-ServerActionsTestOtherB-894551005 tempest-ServerActionsTestOtherB-894551005-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_dest" :: waited 0.447s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 18:00:26 user nova-compute[74613]: DEBUG nova.objects.instance [None req-7f41620a-b66e-40f2-b568-e11ab877cb6d tempest-ServerActionsTestOtherB-894551005 tempest-ServerActionsTestOtherB-894551005-project-member] Lazy-loading 'migration_context' on Instance uuid 74ac9703-1cd7-4983-b7d4-c69b01fec7b2 {{(pid=74613) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 18:00:26 user nova-compute[74613]: DEBUG nova.objects.base [None req-7f41620a-b66e-40f2-b568-e11ab877cb6d tempest-ServerActionsTestOtherB-894551005 tempest-ServerActionsTestOtherB-894551005-project-member] Object Instance<74ac9703-1cd7-4983-b7d4-c69b01fec7b2> lazy-loaded attributes: resources,migration_context {{(pid=74613) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 29 18:00:26 user nova-compute[74613]: INFO nova.network.neutron [None req-f85b99ac-8ee6-47d4-8cfb-e35892b3bcc5 tempest-TestShelveInstance-765407413 tempest-TestShelveInstance-765407413-project-member] [instance: fae10c60-f989-4c99-bde4-60cd9f3e2055] Updating port 435f55bd-6b68-4466-96d8-7ca838b0a594 with attributes {'binding:host_id': 'user', 'device_owner': 'compute:nova'}
Nov 29 18:00:26 user nova-compute[74613]: DEBUG nova.compute.provider_tree [None req-7f41620a-b66e-40f2-b568-e11ab877cb6d tempest-ServerActionsTestOtherB-894551005 tempest-ServerActionsTestOtherB-894551005-project-member] Inventory has not changed in ProviderTree for provider: 639d980e-3b12-44b1-b8f4-1812416fa4dd {{(pid=74613) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 18:00:26 user nova-compute[74613]: DEBUG nova.scheduler.client.report [None req-7f41620a-b66e-40f2-b568-e11ab877cb6d tempest-ServerActionsTestOtherB-894551005 tempest-ServerActionsTestOtherB-894551005-project-member] Inventory has not changed for provider 639d980e-3b12-44b1-b8f4-1812416fa4dd based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74613) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 18:00:26 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-7f41620a-b66e-40f2-b568-e11ab877cb6d tempest-ServerActionsTestOtherB-894551005 tempest-ServerActionsTestOtherB-894551005-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_dest" :: held 0.542s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 18:00:26 user nova-compute[74613]: INFO nova.compute.manager [None req-7f41620a-b66e-40f2-b568-e11ab877cb6d tempest-ServerActionsTestOtherB-894551005 tempest-ServerActionsTestOtherB-894551005-project-member] [instance: 74ac9703-1cd7-4983-b7d4-c69b01fec7b2] Swapping old allocation on dict_keys(['639d980e-3b12-44b1-b8f4-1812416fa4dd']) held by migration 8810a11f-ec67-4d25-b99d-d74f186c3a86 for instance
Nov 29 18:00:27 user nova-compute[74613]: DEBUG nova.scheduler.client.report [None req-7f41620a-b66e-40f2-b568-e11ab877cb6d tempest-ServerActionsTestOtherB-894551005 tempest-ServerActionsTestOtherB-894551005-project-member] Overwriting current allocation {'allocations': {'639d980e-3b12-44b1-b8f4-1812416fa4dd': {'resources': {'VCPU': 1, 'MEMORY_MB': 2048, 'DISK_GB': 20}, 'generation': 30}}, 'project_id': 'b392ca87608940c0ae467318b66453b2', 'user_id': '1a6eb590fed440729b45b8db79eb7c2f', 'consumer_generation': 1} on consumer 74ac9703-1cd7-4983-b7d4-c69b01fec7b2 {{(pid=74613) move_allocations /opt/stack/nova/nova/scheduler/client/report.py:2018}}
Nov 29 18:00:27 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-7f41620a-b66e-40f2-b568-e11ab877cb6d tempest-ServerActionsTestOtherB-894551005 tempest-ServerActionsTestOtherB-894551005-project-member] Acquiring lock "refresh_cache-74ac9703-1cd7-4983-b7d4-c69b01fec7b2" {{(pid=74613) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 18:00:27 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-7f41620a-b66e-40f2-b568-e11ab877cb6d tempest-ServerActionsTestOtherB-894551005 tempest-ServerActionsTestOtherB-894551005-project-member] Acquired lock "refresh_cache-74ac9703-1cd7-4983-b7d4-c69b01fec7b2" {{(pid=74613) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 18:00:27 user nova-compute[74613]: DEBUG nova.network.neutron [None req-7f41620a-b66e-40f2-b568-e11ab877cb6d tempest-ServerActionsTestOtherB-894551005 tempest-ServerActionsTestOtherB-894551005-project-member] [instance: 74ac9703-1cd7-4983-b7d4-c69b01fec7b2] Building network info cache for instance {{(pid=74613) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 29 18:00:27 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-f85b99ac-8ee6-47d4-8cfb-e35892b3bcc5 tempest-TestShelveInstance-765407413 tempest-TestShelveInstance-765407413-project-member] Acquiring lock "refresh_cache-fae10c60-f989-4c99-bde4-60cd9f3e2055" {{(pid=74613) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 18:00:27 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-f85b99ac-8ee6-47d4-8cfb-e35892b3bcc5 tempest-TestShelveInstance-765407413 tempest-TestShelveInstance-765407413-project-member] Acquired lock "refresh_cache-fae10c60-f989-4c99-bde4-60cd9f3e2055" {{(pid=74613) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 18:00:27 user nova-compute[74613]: DEBUG nova.network.neutron [None req-f85b99ac-8ee6-47d4-8cfb-e35892b3bcc5 tempest-TestShelveInstance-765407413 tempest-TestShelveInstance-765407413-project-member] [instance: fae10c60-f989-4c99-bde4-60cd9f3e2055] Building network info cache for instance {{(pid=74613) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 29 18:00:27 user nova-compute[74613]: DEBUG nova.compute.manager [req-47ff9d58-2484-4bf4-b44e-37fc25614878 req-e9ec8633-17c2-491f-89c2-fb06a67800cd service nova] [instance: fae10c60-f989-4c99-bde4-60cd9f3e2055] Received event network-changed-435f55bd-6b68-4466-96d8-7ca838b0a594 {{(pid=74613) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 18:00:27 user nova-compute[74613]: DEBUG nova.compute.manager [req-47ff9d58-2484-4bf4-b44e-37fc25614878 req-e9ec8633-17c2-491f-89c2-fb06a67800cd service nova] [instance: fae10c60-f989-4c99-bde4-60cd9f3e2055] Refreshing instance network info cache due to event network-changed-435f55bd-6b68-4466-96d8-7ca838b0a594. {{(pid=74613) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 18:00:27 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-47ff9d58-2484-4bf4-b44e-37fc25614878 req-e9ec8633-17c2-491f-89c2-fb06a67800cd service nova] Acquiring lock "refresh_cache-fae10c60-f989-4c99-bde4-60cd9f3e2055" {{(pid=74613) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 18:00:27 user nova-compute[74613]: DEBUG nova.network.neutron [None req-7f41620a-b66e-40f2-b568-e11ab877cb6d tempest-ServerActionsTestOtherB-894551005 tempest-ServerActionsTestOtherB-894551005-project-member] [instance: 74ac9703-1cd7-4983-b7d4-c69b01fec7b2] Updating instance_info_cache with network_info: [{"id": "c63b6577-fb46-437a-95b3-8321fab45d0c", "address": "fa:16:3e:c3:2e:71", "network": {"id": "e687ed60-2592-4836-b97e-0828527b1b9f", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1938956411-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.143", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b392ca87608940c0ae467318b66453b2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc63b6577-fb", "ovs_interfaceid": "c63b6577-fb46-437a-95b3-8321fab45d0c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74613) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 18:00:27 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-7f41620a-b66e-40f2-b568-e11ab877cb6d tempest-ServerActionsTestOtherB-894551005 tempest-ServerActionsTestOtherB-894551005-project-member] Releasing lock "refresh_cache-74ac9703-1cd7-4983-b7d4-c69b01fec7b2" {{(pid=74613) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 18:00:27 user nova-compute[74613]: DEBUG os_brick.utils [None req-7f41620a-b66e-40f2-b568-e11ab877cb6d tempest-ServerActionsTestOtherB-894551005 tempest-ServerActionsTestOtherB-894551005-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74613) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 18:00:27 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:00:27 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.018s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:00:27 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e435d62-6a8a-45d2-9432-2e5882046505]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:400972819b5\n', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 18:00:27 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:00:27 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:00:27 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[02a231af-9080-40fe-b810-f654e989d049]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 18:00:27 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:00:27 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:00:27 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[667c6059-7848-4e2c-bc96-083c882bf947]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 18:00:27 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[aab96be3-15be-4c64-9ad2-a66e5910fb67]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 18:00:27 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-7f41620a-b66e-40f2-b568-e11ab877cb6d tempest-ServerActionsTestOtherB-894551005 tempest-ServerActionsTestOtherB-894551005-project-member] Running cmd (subprocess): nvme version {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:00:27 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-7f41620a-b66e-40f2-b568-e11ab877cb6d tempest-ServerActionsTestOtherB-894551005 tempest-ServerActionsTestOtherB-894551005-project-member] 'nvme version' failed. Not Retrying. {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 18:00:27 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.nvmeof [None req-7f41620a-b66e-40f2-b568-e11ab877cb6d tempest-ServerActionsTestOtherB-894551005 tempest-ServerActionsTestOtherB-894551005-project-member] nvme not present on system {{(pid=74613) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 29 18:00:27 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:00:27 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 18:00:27 user nova-compute[74613]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 29 18:00:27 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[aba9a7cd-02c9-44e5-abf9-f5912ea48349]: (4, '') {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 18:00:27 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.lightos [None req-7f41620a-b66e-40f2-b568-e11ab877cb6d tempest-ServerActionsTestOtherB-894551005 tempest-ServerActionsTestOtherB-894551005-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74613) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 29 18:00:27 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.lightos [None req-7f41620a-b66e-40f2-b568-e11ab877cb6d tempest-ServerActionsTestOtherB-894551005 tempest-ServerActionsTestOtherB-894551005-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74613) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 29 18:00:27 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.lightos [None req-7f41620a-b66e-40f2-b568-e11ab877cb6d tempest-ServerActionsTestOtherB-894551005 tempest-ServerActionsTestOtherB-894551005-project-member] LIGHTOS: no hostnqn found. {{(pid=74613) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 29 18:00:27 user nova-compute[74613]: DEBUG os_brick.utils [None req-7f41620a-b66e-40f2-b568-e11ab877cb6d tempest-ServerActionsTestOtherB-894551005 tempest-ServerActionsTestOtherB-894551005-project-member] <== get_connector_properties: return (139ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:400972819b5', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74613) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 18:00:27 user nova-compute[74613]: DEBUG nova.network.neutron [None req-f85b99ac-8ee6-47d4-8cfb-e35892b3bcc5 tempest-TestShelveInstance-765407413 tempest-TestShelveInstance-765407413-project-member] [instance: fae10c60-f989-4c99-bde4-60cd9f3e2055] Updating instance_info_cache with network_info: [{"id": "435f55bd-6b68-4466-96d8-7ca838b0a594", "address": "fa:16:3e:d5:66:27", "network": {"id": "3f3e011f-3d5c-4e32-bcae-cc1424ebf2d7", "bridge": "br-int", "label": "tempest-TestShelveInstance-1657844818-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.13", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5c079293283c4f248bc8bae125dcfbe9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap435f55bd-6b", "ovs_interfaceid": "435f55bd-6b68-4466-96d8-7ca838b0a594", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74613) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 18:00:27 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-f85b99ac-8ee6-47d4-8cfb-e35892b3bcc5 tempest-TestShelveInstance-765407413 tempest-TestShelveInstance-765407413-project-member] Releasing lock "refresh_cache-fae10c60-f989-4c99-bde4-60cd9f3e2055" {{(pid=74613) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 18:00:27 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-f85b99ac-8ee6-47d4-8cfb-e35892b3bcc5 tempest-TestShelveInstance-765407413 tempest-TestShelveInstance-765407413-project-member] [instance: fae10c60-f989-4c99-bde4-60cd9f3e2055] Creating instance directory {{(pid=74613) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 29 18:00:27 user nova-compute[74613]: INFO nova.virt.libvirt.driver [None req-f85b99ac-8ee6-47d4-8cfb-e35892b3bcc5 tempest-TestShelveInstance-765407413 tempest-TestShelveInstance-765407413-project-member] [instance: fae10c60-f989-4c99-bde4-60cd9f3e2055] Creating image(s)
Nov 29 18:00:27 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-f85b99ac-8ee6-47d4-8cfb-e35892b3bcc5 tempest-TestShelveInstance-765407413 tempest-TestShelveInstance-765407413-project-member] [instance: fae10c60-f989-4c99-bde4-60cd9f3e2055] Did not create local disks {{(pid=74613) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 29 18:00:27 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-f85b99ac-8ee6-47d4-8cfb-e35892b3bcc5 tempest-TestShelveInstance-765407413 tempest-TestShelveInstance-765407413-project-member] [instance: fae10c60-f989-4c99-bde4-60cd9f3e2055] Ensure instance console log exists: /opt/stack/data/nova/instances/fae10c60-f989-4c99-bde4-60cd9f3e2055/console.log {{(pid=74613) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 29 18:00:27 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-f85b99ac-8ee6-47d4-8cfb-e35892b3bcc5 tempest-TestShelveInstance-765407413 tempest-TestShelveInstance-765407413-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 18:00:27 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-f85b99ac-8ee6-47d4-8cfb-e35892b3bcc5 tempest-TestShelveInstance-765407413 tempest-TestShelveInstance-765407413-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 18:00:27 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-f85b99ac-8ee6-47d4-8cfb-e35892b3bcc5 tempest-TestShelveInstance-765407413 tempest-TestShelveInstance-765407413-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 18:00:27 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-f85b99ac-8ee6-47d4-8cfb-e35892b3bcc5 tempest-TestShelveInstance-765407413 tempest-TestShelveInstance-765407413-project-member] [instance: fae10c60-f989-4c99-bde4-60cd9f3e2055] Start _get_guest_xml network_info=[{"id": "435f55bd-6b68-4466-96d8-7ca838b0a594", "address": "fa:16:3e:d5:66:27", "network": {"id": "3f3e011f-3d5c-4e32-bcae-cc1424ebf2d7", "bridge": "br-int", "label": "tempest-TestShelveInstance-1657844818-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.13", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5c079293283c4f248bc8bae125dcfbe9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap435f55bd-6b", "ovs_interfaceid": "435f55bd-6b68-4466-96d8-7ca838b0a594", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:6a07b572-6430-4d0f-9aaf-8a8dbc39831e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BZedJSro', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'fae10c60-f989-4c99-bde4-60cd9f3e2055', 'attached_at': '', 'detached_at': '', 'volume_id': '6a07b572-6430-4d0f-9aaf-8a8dbc39831e', 'serial': '6a07b572-6430-4d0f-9aaf-8a8dbc39831e'}, 'mount_device': '/dev/vda', 'delete_on_termination': True, 'device_type': 'disk', 'boot_index': 0, 'guest_format': None, 'attachment_id': '56a4bb87-3d9b-45cc-87f5-66a4bfb4d4c1', 'disk_bus': 'virtio', 'volume_type': None} {{(pid=74613) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 29 18:00:27 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-47ff9d58-2484-4bf4-b44e-37fc25614878 req-e9ec8633-17c2-491f-89c2-fb06a67800cd service nova] Acquired lock "refresh_cache-fae10c60-f989-4c99-bde4-60cd9f3e2055" {{(pid=74613) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 18:00:27 user nova-compute[74613]: DEBUG nova.network.neutron [req-47ff9d58-2484-4bf4-b44e-37fc25614878 req-e9ec8633-17c2-491f-89c2-fb06a67800cd service nova] [instance: fae10c60-f989-4c99-bde4-60cd9f3e2055] Refreshing network info cache for port 435f55bd-6b68-4466-96d8-7ca838b0a594 {{(pid=74613) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 18:00:27 user nova-compute[74613]: WARNING nova.virt.libvirt.driver [None req-f85b99ac-8ee6-47d4-8cfb-e35892b3bcc5 tempest-TestShelveInstance-765407413 tempest-TestShelveInstance-765407413-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 18:00:27 user nova-compute[74613]: WARNING nova.virt.libvirt.driver [None req-f85b99ac-8ee6-47d4-8cfb-e35892b3bcc5 tempest-TestShelveInstance-765407413 tempest-TestShelveInstance-765407413-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 18:00:27 user nova-compute[74613]: DEBUG nova.virt.libvirt.host [None req-f85b99ac-8ee6-47d4-8cfb-e35892b3bcc5 tempest-TestShelveInstance-765407413 tempest-TestShelveInstance-765407413-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74613) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 29 18:00:27 user nova-compute[74613]: DEBUG nova.virt.libvirt.host [None req-f85b99ac-8ee6-47d4-8cfb-e35892b3bcc5 tempest-TestShelveInstance-765407413 tempest-TestShelveInstance-765407413-project-member] CPU controller missing on host. {{(pid=74613) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 29 18:00:27 user nova-compute[74613]: DEBUG nova.virt.libvirt.host [None req-f85b99ac-8ee6-47d4-8cfb-e35892b3bcc5 tempest-TestShelveInstance-765407413 tempest-TestShelveInstance-765407413-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74613) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 29 18:00:27 user nova-compute[74613]: DEBUG nova.virt.libvirt.host [None req-f85b99ac-8ee6-47d4-8cfb-e35892b3bcc5 tempest-TestShelveInstance-765407413 tempest-TestShelveInstance-765407413-project-member] CPU controller found on host. {{(pid=74613) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 29 18:00:27 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-f85b99ac-8ee6-47d4-8cfb-e35892b3bcc5 tempest-TestShelveInstance-765407413 tempest-TestShelveInstance-765407413-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74613) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 29 18:00:27 user nova-compute[74613]: DEBUG nova.virt.hardware [None req-f85b99ac-8ee6-47d4-8cfb-e35892b3bcc5 tempest-TestShelveInstance-765407413 tempest-TestShelveInstance-765407413-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-29T17:47:27Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74613) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 29 18:00:27 user nova-compute[74613]: DEBUG nova.virt.hardware [None req-f85b99ac-8ee6-47d4-8cfb-e35892b3bcc5 tempest-TestShelveInstance-765407413 tempest-TestShelveInstance-765407413-project-member] Flavor limits 0:0:0 {{(pid=74613) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 29 18:00:27 user nova-compute[74613]: DEBUG nova.virt.hardware [None req-f85b99ac-8ee6-47d4-8cfb-e35892b3bcc5 tempest-TestShelveInstance-765407413 tempest-TestShelveInstance-765407413-project-member] Image limits 0:0:0 {{(pid=74613) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 29 18:00:27 user nova-compute[74613]: DEBUG nova.virt.hardware [None req-f85b99ac-8ee6-47d4-8cfb-e35892b3bcc5 tempest-TestShelveInstance-765407413 tempest-TestShelveInstance-765407413-project-member] Flavor pref 0:0:0 {{(pid=74613) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 29 18:00:27 user nova-compute[74613]: DEBUG nova.virt.hardware [None req-f85b99ac-8ee6-47d4-8cfb-e35892b3bcc5 tempest-TestShelveInstance-765407413 tempest-TestShelveInstance-765407413-project-member] Image pref 0:0:0 {{(pid=74613) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 29 18:00:27 user nova-compute[74613]: DEBUG nova.virt.hardware [None req-f85b99ac-8ee6-47d4-8cfb-e35892b3bcc5 tempest-TestShelveInstance-765407413 tempest-TestShelveInstance-765407413-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74613) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 29 18:00:27 user nova-compute[74613]: DEBUG nova.virt.hardware [None req-f85b99ac-8ee6-47d4-8cfb-e35892b3bcc5 tempest-TestShelveInstance-765407413 tempest-TestShelveInstance-765407413-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74613) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 29 18:00:27 user nova-compute[74613]: DEBUG nova.virt.hardware [None req-f85b99ac-8ee6-47d4-8cfb-e35892b3bcc5 tempest-TestShelveInstance-765407413 tempest-TestShelveInstance-765407413-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74613) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 29 18:00:27 user nova-compute[74613]: DEBUG nova.virt.hardware [None req-f85b99ac-8ee6-47d4-8cfb-e35892b3bcc5 tempest-TestShelveInstance-765407413 tempest-TestShelveInstance-765407413-project-member] Got 1 possible topologies {{(pid=74613) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 29 18:00:27 user nova-compute[74613]: DEBUG nova.virt.hardware [None req-f85b99ac-8ee6-47d4-8cfb-e35892b3bcc5 tempest-TestShelveInstance-765407413 tempest-TestShelveInstance-765407413-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74613) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 29 18:00:27 user nova-compute[74613]: DEBUG nova.virt.hardware [None req-f85b99ac-8ee6-47d4-8cfb-e35892b3bcc5 tempest-TestShelveInstance-765407413 tempest-TestShelveInstance-765407413-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74613) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 29 18:00:27 user nova-compute[74613]: DEBUG nova.objects.instance [None req-f85b99ac-8ee6-47d4-8cfb-e35892b3bcc5 tempest-TestShelveInstance-765407413 tempest-TestShelveInstance-765407413-project-member] Lazy-loading 'vcpu_model' on Instance uuid fae10c60-f989-4c99-bde4-60cd9f3e2055 {{(pid=74613) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 18:00:27 user nova-compute[74613]: DEBUG nova.objects.base [None req-f85b99ac-8ee6-47d4-8cfb-e35892b3bcc5 tempest-TestShelveInstance-765407413 tempest-TestShelveInstance-765407413-project-member] Object Instance<fae10c60-f989-4c99-bde4-60cd9f3e2055> lazy-loaded attributes: pci_requests,vcpu_model {{(pid=74613) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 29 18:00:28 user nova-compute[74613]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f85b99ac-8ee6-47d4-8cfb-e35892b3bcc5 tempest-TestShelveInstance-765407413 tempest-TestShelveInstance-765407413-project-member] [instance: fae10c60-f989-4c99-bde4-60cd9f3e2055] Calling os-brick to attach iSCSI Volume {{(pid=74613) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 29 18:00:28 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-f85b99ac-8ee6-47d4-8cfb-e35892b3bcc5 tempest-TestShelveInstance-765407413 tempest-TestShelveInstance-765407413-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff828156890>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:6a07b572-6430-4d0f-9aaf-8a8dbc39831e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BZedJSro', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74613) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 18:00:28 user nova-compute[74613]: WARNING os_brick.initiator.connectors.base [None req-f85b99ac-8ee6-47d4-8cfb-e35892b3bcc5 tempest-TestShelveInstance-765407413 tempest-TestShelveInstance-765407413-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 18:00:28 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.base [None req-f85b99ac-8ee6-47d4-8cfb-e35892b3bcc5 tempest-TestShelveInstance-765407413 tempest-TestShelveInstance-765407413-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 18:00:28 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.base [None req-f85b99ac-8ee6-47d4-8cfb-e35892b3bcc5 tempest-TestShelveInstance-765407413 tempest-TestShelveInstance-765407413-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 18:00:28 user nova-compute[74613]: WARNING os_brick.initiator.connectors.base [None req-f85b99ac-8ee6-47d4-8cfb-e35892b3bcc5 tempest-TestShelveInstance-765407413 tempest-TestShelveInstance-765407413-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 18:00:28 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.base [None req-f85b99ac-8ee6-47d4-8cfb-e35892b3bcc5 tempest-TestShelveInstance-765407413 tempest-TestShelveInstance-765407413-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6a07b572-6430-4d0f-9aaf-8a8dbc39831e" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 18:00:28 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.base [None req-f85b99ac-8ee6-47d4-8cfb-e35892b3bcc5 tempest-TestShelveInstance-765407413 tempest-TestShelveInstance-765407413-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6a07b572-6430-4d0f-9aaf-8a8dbc39831e" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 18:00:28 user nova-compute[74613]: INFO os_brick.initiator.connectors.iscsi [None req-f85b99ac-8ee6-47d4-8cfb-e35892b3bcc5 tempest-TestShelveInstance-765407413 tempest-TestShelveInstance-765407413-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 29 18:00:28 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6a07b572-6430-4d0f-9aaf-8a8dbc39831e -p 172.16.0.220:3260 {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:00:28 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6a07b572-6430-4d0f-9aaf-8a8dbc39831e -p 172.16.0.220:3260" returned: 21 in 0.027s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:00:28 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[d740df3e-291b-4b28-b12e-6ffd8de8e393]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 18:00:28 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-f85b99ac-8ee6-47d4-8cfb-e35892b3bcc5 tempest-TestShelveInstance-765407413 tempest-TestShelveInstance-765407413-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 29 18:00:28 user nova-compute[74613]:  {{(pid=74613) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 18:00:28 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6a07b572-6430-4d0f-9aaf-8a8dbc39831e -p 172.16.0.220:3260 --interface default --op new {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:00:28 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6a07b572-6430-4d0f-9aaf-8a8dbc39831e -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.024s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:00:28 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1c32b3b-ecb8-4a9d-ae64-9f0fe35b7a29]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:6a07b572-6430-4d0f-9aaf-8a8dbc39831e] added\n', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 18:00:28 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-f85b99ac-8ee6-47d4-8cfb-e35892b3bcc5 tempest-TestShelveInstance-765407413 tempest-TestShelveInstance-765407413-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:6a07b572-6430-4d0f-9aaf-8a8dbc39831e] added
Nov 29 18:00:28 user nova-compute[74613]:  stderr= {{(pid=74613) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 18:00:28 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6a07b572-6430-4d0f-9aaf-8a8dbc39831e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:00:28 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6a07b572-6430-4d0f-9aaf-8a8dbc39831e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:00:28 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[46334848-be2c-48e7-8407-75b0103b6d9a]: (4, ('', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 18:00:28 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-f85b99ac-8ee6-47d4-8cfb-e35892b3bcc5 tempest-TestShelveInstance-765407413 tempest-TestShelveInstance-765407413-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74613) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 18:00:28 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6a07b572-6430-4d0f-9aaf-8a8dbc39831e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:00:28 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6a07b572-6430-4d0f-9aaf-8a8dbc39831e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.023s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:00:28 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d5e36f7-3550-4ed3-8f84-d7dbc902a1fe]: (4, ('', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 18:00:28 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-f85b99ac-8ee6-47d4-8cfb-e35892b3bcc5 tempest-TestShelveInstance-765407413 tempest-TestShelveInstance-765407413-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74613) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 18:00:28 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6a07b572-6430-4d0f-9aaf-8a8dbc39831e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v BZedJSro {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:00:28 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6a07b572-6430-4d0f-9aaf-8a8dbc39831e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v BZedJSro" returned: 0 in 0.019s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:00:28 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[db908306-4f70-48e1-a8a7-12919d562a30]: (4, ('', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 18:00:28 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-f85b99ac-8ee6-47d4-8cfb-e35892b3bcc5 tempest-TestShelveInstance-765407413 tempest-TestShelveInstance-765407413-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'BZedJSro'): stdout= stderr= {{(pid=74613) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 18:00:28 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6a07b572-6430-4d0f-9aaf-8a8dbc39831e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:00:28 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6a07b572-6430-4d0f-9aaf-8a8dbc39831e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:00:28 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[613414df-ad66-495d-a627-70367b4a7fa6]: (4, ('', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 18:00:28 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-f85b99ac-8ee6-47d4-8cfb-e35892b3bcc5 tempest-TestShelveInstance-765407413 tempest-TestShelveInstance-765407413-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74613) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 18:00:28 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:00:28 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:00:28 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[d236bcc8-e916-4999-b46e-c793aada81e6]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9511387c-8772-40f2-bf2d-6b6387649e9f (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:72d22ffa-f425-4575-86a5-afbd8bb9cdd6 (non-flash)\n', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 18:00:28 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-f85b99ac-8ee6-47d4-8cfb-e35892b3bcc5 tempest-TestShelveInstance-765407413 tempest-TestShelveInstance-765407413-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9511387c-8772-40f2-bf2d-6b6387649e9f (non-flash)
Nov 29 18:00:28 user nova-compute[74613]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:72d22ffa-f425-4575-86a5-afbd8bb9cdd6 (non-flash)
Nov 29 18:00:28 user nova-compute[74613]:  stderr= {{(pid=74613) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 18:00:28 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-f85b99ac-8ee6-47d4-8cfb-e35892b3bcc5 tempest-TestShelveInstance-765407413 tempest-TestShelveInstance-765407413-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9511387c-8772-40f2-bf2d-6b6387649e9f (non-flash)
Nov 29 18:00:28 user nova-compute[74613]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:72d22ffa-f425-4575-86a5-afbd8bb9cdd6 (non-flash)
Nov 29 18:00:28 user nova-compute[74613]:  stderr= {{(pid=74613) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 18:00:28 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6a07b572-6430-4d0f-9aaf-8a8dbc39831e -p 172.16.0.220:3260 --login {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:00:28 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6a07b572-6430-4d0f-9aaf-8a8dbc39831e -p 172.16.0.220:3260 --login" returned: 0 in 0.058s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:00:28 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac92404c-8c47-4211-bfab-06477e2c7dc2]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:6a07b572-6430-4d0f-9aaf-8a8dbc39831e, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:6a07b572-6430-4d0f-9aaf-8a8dbc39831e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 18:00:28 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-f85b99ac-8ee6-47d4-8cfb-e35892b3bcc5 tempest-TestShelveInstance-765407413 tempest-TestShelveInstance-765407413-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:6a07b572-6430-4d0f-9aaf-8a8dbc39831e, portal: 172.16.0.220,3260]
Nov 29 18:00:28 user nova-compute[74613]: Login to [iface: default, target: iqn.2010-10.org.openstack:6a07b572-6430-4d0f-9aaf-8a8dbc39831e, portal: 172.16.0.220,3260] successful.
Nov 29 18:00:28 user nova-compute[74613]:  stderr= {{(pid=74613) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 18:00:28 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6a07b572-6430-4d0f-9aaf-8a8dbc39831e -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:00:28 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6a07b572-6430-4d0f-9aaf-8a8dbc39831e -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:00:28 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[6afb9bda-aae2-468b-bcfa-12c69395c571]: (4, ('', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 18:00:28 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-f85b99ac-8ee6-47d4-8cfb-e35892b3bcc5 tempest-TestShelveInstance-765407413 tempest-TestShelveInstance-765407413-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74613) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 18:00:28 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:00:28 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:00:28 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ecae6aa-034b-4f43-8826-5ecf294d7a7d]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9511387c-8772-40f2-bf2d-6b6387649e9f (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:72d22ffa-f425-4575-86a5-afbd8bb9cdd6 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a07b572-6430-4d0f-9aaf-8a8dbc39831e (non-flash)\n', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 18:00:28 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-f85b99ac-8ee6-47d4-8cfb-e35892b3bcc5 tempest-TestShelveInstance-765407413 tempest-TestShelveInstance-765407413-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9511387c-8772-40f2-bf2d-6b6387649e9f (non-flash)
Nov 29 18:00:28 user nova-compute[74613]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:72d22ffa-f425-4575-86a5-afbd8bb9cdd6 (non-flash)
Nov 29 18:00:28 user nova-compute[74613]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a07b572-6430-4d0f-9aaf-8a8dbc39831e (non-flash)
Nov 29 18:00:28 user nova-compute[74613]:  stderr= {{(pid=74613) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 18:00:28 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-f85b99ac-8ee6-47d4-8cfb-e35892b3bcc5 tempest-TestShelveInstance-765407413 tempest-TestShelveInstance-765407413-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9511387c-8772-40f2-bf2d-6b6387649e9f (non-flash)
Nov 29 18:00:28 user nova-compute[74613]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:72d22ffa-f425-4575-86a5-afbd8bb9cdd6 (non-flash)
Nov 29 18:00:28 user nova-compute[74613]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a07b572-6430-4d0f-9aaf-8a8dbc39831e (non-flash)
Nov 29 18:00:28 user nova-compute[74613]:  stderr= {{(pid=74613) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 18:00:28 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.base [None req-f85b99ac-8ee6-47d4-8cfb-e35892b3bcc5 tempest-TestShelveInstance-765407413 tempest-TestShelveInstance-765407413-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6a07b572-6430-4d0f-9aaf-8a8dbc39831e" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.295s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 18:00:28 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-f85b99ac-8ee6-47d4-8cfb-e35892b3bcc5 tempest-TestShelveInstance-765407413 tempest-TestShelveInstance-765407413-project-member] Connected to 172.16.0.220:3260 {{(pid=74613) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 29 18:00:28 user nova-compute[74613]: DEBUG os_brick.initiator.linuxscsi [None req-f85b99ac-8ee6-47d4-8cfb-e35892b3bcc5 tempest-TestShelveInstance-765407413 tempest-TestShelveInstance-765407413-project-member] HCTL ('34', '-', '-', 0) found on session 24 with lun 0 {{(pid=74613) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 29 18:00:28 user nova-compute[74613]: DEBUG os_brick.initiator.linuxscsi [None req-f85b99ac-8ee6-47d4-8cfb-e35892b3bcc5 tempest-TestShelveInstance-765407413 tempest-TestShelveInstance-765407413-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=74613) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 29 18:00:28 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:00:28 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.017s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:00:28 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[7665f34b-4942-4337-beab-3f4cc65f8ec0]: (4, ('- - 0', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 18:00:28 user nova-compute[74613]: DEBUG os_brick.initiator.linuxscsi [None req-f85b99ac-8ee6-47d4-8cfb-e35892b3bcc5 tempest-TestShelveInstance-765407413 tempest-TestShelveInstance-765407413-project-member] Searching for a device in session 24 and hctl ['34', '*', '*', 0] yield: None {{(pid=74613) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 29 18:00:28 user nova-compute[74613]: DEBUG nova.network.neutron [req-47ff9d58-2484-4bf4-b44e-37fc25614878 req-e9ec8633-17c2-491f-89c2-fb06a67800cd service nova] [instance: fae10c60-f989-4c99-bde4-60cd9f3e2055] Updated VIF entry in instance network info cache for port 435f55bd-6b68-4466-96d8-7ca838b0a594. {{(pid=74613) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 18:00:28 user nova-compute[74613]: DEBUG nova.network.neutron [req-47ff9d58-2484-4bf4-b44e-37fc25614878 req-e9ec8633-17c2-491f-89c2-fb06a67800cd service nova] [instance: fae10c60-f989-4c99-bde4-60cd9f3e2055] Updating instance_info_cache with network_info: [{"id": "435f55bd-6b68-4466-96d8-7ca838b0a594", "address": "fa:16:3e:d5:66:27", "network": {"id": "3f3e011f-3d5c-4e32-bcae-cc1424ebf2d7", "bridge": "br-int", "label": "tempest-TestShelveInstance-1657844818-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.13", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5c079293283c4f248bc8bae125dcfbe9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap435f55bd-6b", "ovs_interfaceid": "435f55bd-6b68-4466-96d8-7ca838b0a594", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74613) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 18:00:28 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-47ff9d58-2484-4bf4-b44e-37fc25614878 req-e9ec8633-17c2-491f-89c2-fb06a67800cd service nova] Releasing lock "refresh_cache-fae10c60-f989-4c99-bde4-60cd9f3e2055" {{(pid=74613) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 18:00:28 user nova-compute[74613]: WARNING nova.virt.libvirt.driver [None req-462abe71-2fe8-4435-b5f3-d1ac7e70d6fa tempest-ServerActionsTestOtherA-1784608629 tempest-ServerActionsTestOtherA-1784608629-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 71f2a1ab-3df7-411c-93fa-b0a1a5a44f0a is timed out.
Nov 29 18:00:28 user nova-compute[74613]: INFO nova.virt.libvirt.driver [None req-462abe71-2fe8-4435-b5f3-d1ac7e70d6fa tempest-ServerActionsTestOtherA-1784608629 tempest-ServerActionsTestOtherA-1784608629-project-member] Successfully detached device vdb from instance 71f2a1ab-3df7-411c-93fa-b0a1a5a44f0a from the live domain config.
Nov 29 18:00:28 user nova-compute[74613]: DEBUG nova.virt.libvirt.volume.iscsi [None req-462abe71-2fe8-4435-b5f3-d1ac7e70d6fa tempest-ServerActionsTestOtherA-1784608629 tempest-ServerActionsTestOtherA-1784608629-project-member] [instance: 71f2a1ab-3df7-411c-93fa-b0a1a5a44f0a] calling os-brick to detach iSCSI Volume {{(pid=74613) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 29 18:00:28 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-462abe71-2fe8-4435-b5f3-d1ac7e70d6fa tempest-ServerActionsTestOtherA-1784608629 tempest-ServerActionsTestOtherA-1784608629-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff828156890>, {'target_iqn': 'iqn.2010-10.org.openstack:72d22ffa-f425-4575-86a5-afbd8bb9cdd6', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'hUFVkcjz', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=74613) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 18:00:28 user nova-compute[74613]: WARNING os_brick.initiator.connectors.base [None req-462abe71-2fe8-4435-b5f3-d1ac7e70d6fa tempest-ServerActionsTestOtherA-1784608629 tempest-ServerActionsTestOtherA-1784608629-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 18:00:28 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.base [None req-462abe71-2fe8-4435-b5f3-d1ac7e70d6fa tempest-ServerActionsTestOtherA-1784608629 tempest-ServerActionsTestOtherA-1784608629-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 18:00:29 user nova-compute[74613]: DEBUG os_brick.initiator.linuxscsi [None req-f85b99ac-8ee6-47d4-8cfb-e35892b3bcc5 tempest-TestShelveInstance-765407413 tempest-TestShelveInstance-765407413-project-member] Searching for a device in session 24 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=74613) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 29 18:00:29 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-f85b99ac-8ee6-47d4-8cfb-e35892b3bcc5 tempest-TestShelveInstance-765407413 tempest-TestShelveInstance-765407413-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:6a07b572-6430-4d0f-9aaf-8a8dbc39831e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BZedJSro', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74613) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 29 18:00:29 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.base [None req-f85b99ac-8ee6-47d4-8cfb-e35892b3bcc5 tempest-TestShelveInstance-765407413 tempest-TestShelveInstance-765407413-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.324s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 18:00:29 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-f85b99ac-8ee6-47d4-8cfb-e35892b3bcc5 tempest-TestShelveInstance-765407413 tempest-TestShelveInstance-765407413-project-member] <== connect_volume: return (1327ms) {'type': 'block', 'scsi_wwn': '23739313463633162', 'path': '/dev/sdc'} {{(pid=74613) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 18:00:29 user nova-compute[74613]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f85b99ac-8ee6-47d4-8cfb-e35892b3bcc5 tempest-TestShelveInstance-765407413 tempest-TestShelveInstance-765407413-project-member] [instance: fae10c60-f989-4c99-bde4-60cd9f3e2055] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23739313463633162', 'path': '/dev/sdc'} {{(pid=74613) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 29 18:00:29 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.base [None req-462abe71-2fe8-4435-b5f3-d1ac7e70d6fa tempest-ServerActionsTestOtherA-1784608629 tempest-ServerActionsTestOtherA-1784608629-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.823s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 18:00:29 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:00:29 user nova-compute[74613]: DEBUG nova.virt.libvirt.vif [None req-f85b99ac-8ee6-47d4-8cfb-e35892b3bcc5 tempest-TestShelveInstance-765407413 tempest-TestShelveInstance-765407413-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-29T17:56:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-1000519643',display_name='tempest-TestShelveInstance-server-1000519643',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-1000519643',id=17,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-TestShelveInstance-195591000',keypairs=<?>,launch_index=0,launched_at=2023-11-29T17:56:44Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='5c079293283c4f248bc8bae125dcfbe9',ramdisk_id='',reservation_id='r-a58ey1iu',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-765407413',owner_user_name='tempest-TestShelveInstance-765407413-project-member'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-29T18:00:12Z,user_data=None,user_id='b4bdd0503dbb42e3a9fc3c7d3cfe3b08',uuid=fae10c60-f989-4c99-bde4-60cd9f3e2055,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "435f55bd-6b68-4466-96d8-7ca838b0a594", "address": "fa:16:3e:d5:66:27", "network": {"id": "3f3e011f-3d5c-4e32-bcae-cc1424ebf2d7", "bridge": "br-int", "label": "tempest-TestShelveInstance-1657844818-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.13", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5c079293283c4f248bc8bae125dcfbe9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap435f55bd-6b", "ovs_interfaceid": "435f55bd-6b68-4466-96d8-7ca838b0a594", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74613) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 29 18:00:29 user nova-compute[74613]: DEBUG nova.network.os_vif_util [None req-f85b99ac-8ee6-47d4-8cfb-e35892b3bcc5 tempest-TestShelveInstance-765407413 tempest-TestShelveInstance-765407413-project-member] Converting VIF {"id": "435f55bd-6b68-4466-96d8-7ca838b0a594", "address": "fa:16:3e:d5:66:27", "network": {"id": "3f3e011f-3d5c-4e32-bcae-cc1424ebf2d7", "bridge": "br-int", "label": "tempest-TestShelveInstance-1657844818-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.13", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5c079293283c4f248bc8bae125dcfbe9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap435f55bd-6b", "ovs_interfaceid": "435f55bd-6b68-4466-96d8-7ca838b0a594", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74613) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 18:00:29 user nova-compute[74613]: DEBUG nova.network.os_vif_util [None req-f85b99ac-8ee6-47d4-8cfb-e35892b3bcc5 tempest-TestShelveInstance-765407413 tempest-TestShelveInstance-765407413-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d5:66:27,bridge_name='br-int',has_traffic_filtering=True,id=435f55bd-6b68-4466-96d8-7ca838b0a594,network=Network(3f3e011f-3d5c-4e32-bcae-cc1424ebf2d7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap435f55bd-6b') {{(pid=74613) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 18:00:29 user nova-compute[74613]: DEBUG nova.objects.instance [None req-f85b99ac-8ee6-47d4-8cfb-e35892b3bcc5 tempest-TestShelveInstance-765407413 tempest-TestShelveInstance-765407413-project-member] Lazy-loading 'pci_devices' on Instance uuid fae10c60-f989-4c99-bde4-60cd9f3e2055 {{(pid=74613) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 18:00:29 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.026s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:00:29 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[936e7fe5-4e81-453a-aaa2-c6465d86bdb0]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:9511387c-8772-40f2-bf2d-6b6387649e9f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:6a07b572-6430-4d0f-9aaf-8a8dbc39831e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:72d22ffa-f425-4575-86a5-afbd8bb9cdd6\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 18:00:29 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-462abe71-2fe8-4435-b5f3-d1ac7e70d6fa tempest-ServerActionsTestOtherA-1784608629 tempest-ServerActionsTestOtherA-1784608629-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 29 18:00:29 user nova-compute[74613]: No targets found.
Nov 29 18:00:29 user nova-compute[74613]: iSNS:
Nov 29 18:00:29 user nova-compute[74613]: No targets found.
Nov 29 18:00:29 user nova-compute[74613]: STATIC:
Nov 29 18:00:29 user nova-compute[74613]: Target: iqn.2010-10.org.openstack:9511387c-8772-40f2-bf2d-6b6387649e9f
Nov 29 18:00:29 user nova-compute[74613]:         Portal: 172.16.0.220:3260,-1
Nov 29 18:00:29 user nova-compute[74613]:                 Iface Name: default
Nov 29 18:00:29 user nova-compute[74613]: Target: iqn.2010-10.org.openstack:6a07b572-6430-4d0f-9aaf-8a8dbc39831e
Nov 29 18:00:29 user nova-compute[74613]:         Portal: 172.16.0.220:3260,-1
Nov 29 18:00:29 user nova-compute[74613]:                 Iface Name: default
Nov 29 18:00:29 user nova-compute[74613]: Target: iqn.2010-10.org.openstack:72d22ffa-f425-4575-86a5-afbd8bb9cdd6
Nov 29 18:00:29 user nova-compute[74613]:         Portal: 172.16.0.220:3260,-1
Nov 29 18:00:29 user nova-compute[74613]:                 Iface Name: default
Nov 29 18:00:29 user nova-compute[74613]: FIRMWARE:
Nov 29 18:00:29 user nova-compute[74613]: No targets found.
Nov 29 18:00:29 user nova-compute[74613]:  stderr= {{(pid=74613) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 18:00:29 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-462abe71-2fe8-4435-b5f3-d1ac7e70d6fa tempest-ServerActionsTestOtherA-1784608629 tempest-ServerActionsTestOtherA-1784608629-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 29 18:00:29 user nova-compute[74613]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 29 18:00:29 user nova-compute[74613]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74613) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 29 18:00:29 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-462abe71-2fe8-4435-b5f3-d1ac7e70d6fa tempest-ServerActionsTestOtherA-1784608629 tempest-ServerActionsTestOtherA-1784608629-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:72d22ffa-f425-4575-86a5-afbd8bb9cdd6', 0)] {{(pid=74613) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 29 18:00:29 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:00:29 user nova-compute[74613]: DEBUG nova.objects.base [None req-f85b99ac-8ee6-47d4-8cfb-e35892b3bcc5 tempest-TestShelveInstance-765407413 tempest-TestShelveInstance-765407413-project-member] Object Instance<fae10c60-f989-4c99-bde4-60cd9f3e2055> lazy-loaded attributes: pci_requests,vcpu_model,pci_devices {{(pid=74613) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 29 18:00:29 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-f85b99ac-8ee6-47d4-8cfb-e35892b3bcc5 tempest-TestShelveInstance-765407413 tempest-TestShelveInstance-765407413-project-member] [instance: fae10c60-f989-4c99-bde4-60cd9f3e2055] End _get_guest_xml xml=<domain type="kvm">
Nov 29 18:00:29 user nova-compute[74613]:   <uuid>fae10c60-f989-4c99-bde4-60cd9f3e2055</uuid>
Nov 29 18:00:29 user nova-compute[74613]:   <name>instance-00000011</name>
Nov 29 18:00:29 user nova-compute[74613]:   <memory>524288</memory>
Nov 29 18:00:29 user nova-compute[74613]:   <vcpu>1</vcpu>
Nov 29 18:00:29 user nova-compute[74613]:   <metadata>
Nov 29 18:00:29 user nova-compute[74613]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 29 18:00:29 user nova-compute[74613]:       <nova:package version="0.0.0"/>
Nov 29 18:00:29 user nova-compute[74613]:       <nova:name>tempest-TestShelveInstance-server-1000519643</nova:name>
Nov 29 18:00:29 user nova-compute[74613]:       <nova:creationTime>2023-11-29 18:00:27</nova:creationTime>
Nov 29 18:00:29 user nova-compute[74613]:       <nova:flavor name="m1.tiny">
Nov 29 18:00:29 user nova-compute[74613]:         <nova:memory>512</nova:memory>
Nov 29 18:00:29 user nova-compute[74613]:         <nova:disk>1</nova:disk>
Nov 29 18:00:29 user nova-compute[74613]:         <nova:swap>0</nova:swap>
Nov 29 18:00:29 user nova-compute[74613]:         <nova:ephemeral>0</nova:ephemeral>
Nov 29 18:00:29 user nova-compute[74613]:         <nova:vcpus>1</nova:vcpus>
Nov 29 18:00:29 user nova-compute[74613]:       </nova:flavor>
Nov 29 18:00:29 user nova-compute[74613]:       <nova:owner>
Nov 29 18:00:29 user nova-compute[74613]:         <nova:user uuid="b4bdd0503dbb42e3a9fc3c7d3cfe3b08">tempest-TestShelveInstance-765407413-project-member</nova:user>
Nov 29 18:00:29 user nova-compute[74613]:         <nova:project uuid="5c079293283c4f248bc8bae125dcfbe9">tempest-TestShelveInstance-765407413</nova:project>
Nov 29 18:00:29 user nova-compute[74613]:       </nova:owner>
Nov 29 18:00:29 user nova-compute[74613]:       <nova:ports>
Nov 29 18:00:29 user nova-compute[74613]:         <nova:port uuid="435f55bd-6b68-4466-96d8-7ca838b0a594">
Nov 29 18:00:29 user nova-compute[74613]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Nov 29 18:00:29 user nova-compute[74613]:         </nova:port>
Nov 29 18:00:29 user nova-compute[74613]:       </nova:ports>
Nov 29 18:00:29 user nova-compute[74613]:     </nova:instance>
Nov 29 18:00:29 user nova-compute[74613]:   </metadata>
Nov 29 18:00:29 user nova-compute[74613]:   <sysinfo type="smbios">
Nov 29 18:00:29 user nova-compute[74613]:     <system>
Nov 29 18:00:29 user nova-compute[74613]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 29 18:00:29 user nova-compute[74613]:       <entry name="product">OpenStack Nova</entry>
Nov 29 18:00:29 user nova-compute[74613]:       <entry name="version">0.0.0</entry>
Nov 29 18:00:29 user nova-compute[74613]:       <entry name="serial">fae10c60-f989-4c99-bde4-60cd9f3e2055</entry>
Nov 29 18:00:29 user nova-compute[74613]:       <entry name="uuid">fae10c60-f989-4c99-bde4-60cd9f3e2055</entry>
Nov 29 18:00:29 user nova-compute[74613]:       <entry name="family">Virtual Machine</entry>
Nov 29 18:00:29 user nova-compute[74613]:     </system>
Nov 29 18:00:29 user nova-compute[74613]:   </sysinfo>
Nov 29 18:00:29 user nova-compute[74613]:   <os>
Nov 29 18:00:29 user nova-compute[74613]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 29 18:00:29 user nova-compute[74613]:     <boot dev="hd"/>
Nov 29 18:00:29 user nova-compute[74613]:     <smbios mode="sysinfo"/>
Nov 29 18:00:29 user nova-compute[74613]:   </os>
Nov 29 18:00:29 user nova-compute[74613]:   <features>
Nov 29 18:00:29 user nova-compute[74613]:     <acpi/>
Nov 29 18:00:29 user nova-compute[74613]:     <apic/>
Nov 29 18:00:29 user nova-compute[74613]:     <vmcoreinfo/>
Nov 29 18:00:29 user nova-compute[74613]:   </features>
Nov 29 18:00:29 user nova-compute[74613]:   <clock offset="utc">
Nov 29 18:00:29 user nova-compute[74613]:     <timer name="pit" tickpolicy="delay"/>
Nov 29 18:00:29 user nova-compute[74613]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 29 18:00:29 user nova-compute[74613]:     <timer name="hpet" present="no"/>
Nov 29 18:00:29 user nova-compute[74613]:   </clock>
Nov 29 18:00:29 user nova-compute[74613]:   <cpu mode="custom" match="exact">
Nov 29 18:00:29 user nova-compute[74613]:     <model>Nehalem</model>
Nov 29 18:00:29 user nova-compute[74613]:     <topology sockets="1" cores="1" threads="1"/>
Nov 29 18:00:29 user nova-compute[74613]:   </cpu>
Nov 29 18:00:29 user nova-compute[74613]:   <devices>
Nov 29 18:00:29 user nova-compute[74613]:     <disk type="block" device="disk">
Nov 29 18:00:29 user nova-compute[74613]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 18:00:29 user nova-compute[74613]:       <source dev="/dev/sdc"/>
Nov 29 18:00:29 user nova-compute[74613]:       <target dev="vda" bus="virtio"/>
Nov 29 18:00:29 user nova-compute[74613]:       <serial>6a07b572-6430-4d0f-9aaf-8a8dbc39831e</serial>
Nov 29 18:00:29 user nova-compute[74613]:     </disk>
Nov 29 18:00:29 user nova-compute[74613]:     <interface type="ethernet">
Nov 29 18:00:29 user nova-compute[74613]:       <mac address="fa:16:3e:d5:66:27"/>
Nov 29 18:00:29 user nova-compute[74613]:       <model type="virtio"/>
Nov 29 18:00:29 user nova-compute[74613]:       <mtu size="1442"/>
Nov 29 18:00:29 user nova-compute[74613]:       <target dev="tap435f55bd-6b"/>
Nov 29 18:00:29 user nova-compute[74613]:     </interface>
Nov 29 18:00:29 user nova-compute[74613]:     <serial type="pty">
Nov 29 18:00:29 user nova-compute[74613]:       <log file="/opt/stack/data/nova/instances/fae10c60-f989-4c99-bde4-60cd9f3e2055/console.log" append="off"/>
Nov 29 18:00:29 user nova-compute[74613]:     </serial>
Nov 29 18:00:29 user nova-compute[74613]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 29 18:00:29 user nova-compute[74613]:     <video>
Nov 29 18:00:29 user nova-compute[74613]:       <model type="virtio"/>
Nov 29 18:00:29 user nova-compute[74613]:     </video>
Nov 29 18:00:29 user nova-compute[74613]:     <rng model="virtio">
Nov 29 18:00:29 user nova-compute[74613]:       <backend model="random">/dev/urandom</backend>
Nov 29 18:00:29 user nova-compute[74613]:     </rng>
Nov 29 18:00:29 user nova-compute[74613]:     <controller type="usb" index="0" model="none"/>
Nov 29 18:00:29 user nova-compute[74613]:     <memballoon model="virtio">
Nov 29 18:00:29 user nova-compute[74613]:       <stats period="10"/>
Nov 29 18:00:29 user nova-compute[74613]:     </memballoon>
Nov 29 18:00:29 user nova-compute[74613]:   </devices>
Nov 29 18:00:29 user nova-compute[74613]: </domain>
Nov 29 18:00:29 user nova-compute[74613]:  {{(pid=74613) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 29 18:00:29 user nova-compute[74613]: DEBUG nova.virt.libvirt.vif [None req-f85b99ac-8ee6-47d4-8cfb-e35892b3bcc5 tempest-TestShelveInstance-765407413 tempest-TestShelveInstance-765407413-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-29T17:56:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-1000519643',display_name='tempest-TestShelveInstance-server-1000519643',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-1000519643',id=17,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-TestShelveInstance-195591000',keypairs=<?>,launch_index=0,launched_at=2023-11-29T17:56:44Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='5c079293283c4f248bc8bae125dcfbe9',ramdisk_id='',reservation_id='r-a58ey1iu',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-765407413',owner_user_name='tempest-TestShelveInstance-765407413-project-member'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-29T18:00:12Z,user_data=None,user_id='b4bdd0503dbb42e3a9fc3c7d3cfe3b08',uuid=fae10c60-f989-4c99-bde4-60cd9f3e2055,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "435f55bd-6b68-4466-96d8-7ca838b0a594", "address": "fa:16:3e:d5:66:27", "network": {"id": "3f3e011f-3d5c-4e32-bcae-cc1424ebf2d7", "bridge": "br-int", "label": "tempest-TestShelveInstance-1657844818-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.13", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5c079293283c4f248bc8bae125dcfbe9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap435f55bd-6b", "ovs_interfaceid": "435f55bd-6b68-4466-96d8-7ca838b0a594", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74613) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 29 18:00:29 user nova-compute[74613]: DEBUG nova.network.os_vif_util [None req-f85b99ac-8ee6-47d4-8cfb-e35892b3bcc5 tempest-TestShelveInstance-765407413 tempest-TestShelveInstance-765407413-project-member] Converting VIF {"id": "435f55bd-6b68-4466-96d8-7ca838b0a594", "address": "fa:16:3e:d5:66:27", "network": {"id": "3f3e011f-3d5c-4e32-bcae-cc1424ebf2d7", "bridge": "br-int", "label": "tempest-TestShelveInstance-1657844818-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.13", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5c079293283c4f248bc8bae125dcfbe9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap435f55bd-6b", "ovs_interfaceid": "435f55bd-6b68-4466-96d8-7ca838b0a594", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74613) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 18:00:29 user nova-compute[74613]: DEBUG nova.network.os_vif_util [None req-f85b99ac-8ee6-47d4-8cfb-e35892b3bcc5 tempest-TestShelveInstance-765407413 tempest-TestShelveInstance-765407413-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d5:66:27,bridge_name='br-int',has_traffic_filtering=True,id=435f55bd-6b68-4466-96d8-7ca838b0a594,network=Network(3f3e011f-3d5c-4e32-bcae-cc1424ebf2d7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap435f55bd-6b') {{(pid=74613) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 18:00:29 user nova-compute[74613]: DEBUG os_vif [None req-f85b99ac-8ee6-47d4-8cfb-e35892b3bcc5 tempest-TestShelveInstance-765407413 tempest-TestShelveInstance-765407413-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d5:66:27,bridge_name='br-int',has_traffic_filtering=True,id=435f55bd-6b68-4466-96d8-7ca838b0a594,network=Network(3f3e011f-3d5c-4e32-bcae-cc1424ebf2d7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap435f55bd-6b') {{(pid=74613) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 29 18:00:29 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:00:29 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74613) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 18:00:29 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74613) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 29 18:00:29 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:00:29 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '81c689ce-ad1f-577d-adfc-c08fb241bfc7', '_type': 'linux-noop'}}, row=False) {{(pid=74613) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 18:00:29 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:00:29 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 18:00:29 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:00:29 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap435f55bd-6b, may_exist=True, interface_attrs={}) {{(pid=74613) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 18:00:29 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap435f55bd-6b, col_values=(('qos', UUID('973ac8a5-fb80-4f49-a9a3-690c761278e7')),), if_exists=True) {{(pid=74613) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 18:00:29 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap435f55bd-6b, col_values=(('external_ids', {'iface-id': '435f55bd-6b68-4466-96d8-7ca838b0a594', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:d5:66:27', 'vm-uuid': 'fae10c60-f989-4c99-bde4-60cd9f3e2055'}),), if_exists=True) {{(pid=74613) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 18:00:29 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.027s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:00:29 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf9f9001-d23a-4af7-8260-71966b0ae98e]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6a07b572-6430-4d0f-9aaf-8a8dbc39831e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:72d22ffa-f425-4575-86a5-afbd8bb9cdd6\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9511387c-8772-40f2-bf2d-6b6387649e9f\n', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 18:00:29 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:00:29 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:00:29 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 18:00:29 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:00:29 user nova-compute[74613]: INFO os_vif [None req-f85b99ac-8ee6-47d4-8cfb-e35892b3bcc5 tempest-TestShelveInstance-765407413 tempest-TestShelveInstance-765407413-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d5:66:27,bridge_name='br-int',has_traffic_filtering=True,id=435f55bd-6b68-4466-96d8-7ca838b0a594,network=Network(3f3e011f-3d5c-4e32-bcae-cc1424ebf2d7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap435f55bd-6b')
Nov 29 18:00:29 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:00:29 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[c348a6a3-1847-4e1e-84c8-7cf905ecf49d]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9511387c-8772-40f2-bf2d-6b6387649e9f (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:72d22ffa-f425-4575-86a5-afbd8bb9cdd6 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a07b572-6430-4d0f-9aaf-8a8dbc39831e (non-flash)\n', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 18:00:29 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-462abe71-2fe8-4435-b5f3-d1ac7e70d6fa tempest-ServerActionsTestOtherA-1784608629 tempest-ServerActionsTestOtherA-1784608629-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9511387c-8772-40f2-bf2d-6b6387649e9f (non-flash)
Nov 29 18:00:29 user nova-compute[74613]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:72d22ffa-f425-4575-86a5-afbd8bb9cdd6 (non-flash)
Nov 29 18:00:29 user nova-compute[74613]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a07b572-6430-4d0f-9aaf-8a8dbc39831e (non-flash)
Nov 29 18:00:29 user nova-compute[74613]:  stderr= {{(pid=74613) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 18:00:29 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-462abe71-2fe8-4435-b5f3-d1ac7e70d6fa tempest-ServerActionsTestOtherA-1784608629 tempest-ServerActionsTestOtherA-1784608629-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9511387c-8772-40f2-bf2d-6b6387649e9f (non-flash)
Nov 29 18:00:29 user nova-compute[74613]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:72d22ffa-f425-4575-86a5-afbd8bb9cdd6 (non-flash)
Nov 29 18:00:29 user nova-compute[74613]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a07b572-6430-4d0f-9aaf-8a8dbc39831e (non-flash)
Nov 29 18:00:29 user nova-compute[74613]:  stderr= {{(pid=74613) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 18:00:29 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-462abe71-2fe8-4435-b5f3-d1ac7e70d6fa tempest-ServerActionsTestOtherA-1784608629 tempest-ServerActionsTestOtherA-1784608629-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7ff8280fa5f0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:72d22ffa-f425-4575-86a5-afbd8bb9cdd6'): ({'sdd'}, set())}) {{(pid=74613) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 29 18:00:29 user nova-compute[74613]: DEBUG os_brick.initiator.linuxscsi [None req-462abe71-2fe8-4435-b5f3-d1ac7e70d6fa tempest-ServerActionsTestOtherA-1784608629 tempest-ServerActionsTestOtherA-1784608629-project-member] Removing single pathed devices sdd {{(pid=74613) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 29 18:00:29 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:00:29 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:00:29 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[241de728-97bb-4958-94ed-3885af6d8fd7]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 18:00:29 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:00:29 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.024s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:00:29 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ec40b39-a096-46c6-b06a-bf005db1b46b]: (4, ('ok\n', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 18:00:29 user nova-compute[74613]: DEBUG os_brick.initiator.linuxscsi [None req-462abe71-2fe8-4435-b5f3-d1ac7e70d6fa tempest-ServerActionsTestOtherA-1784608629 tempest-ServerActionsTestOtherA-1784608629-project-member] Flushing IO for device /dev/sdd {{(pid=74613) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 29 18:00:29 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:00:29 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-f85b99ac-8ee6-47d4-8cfb-e35892b3bcc5 tempest-TestShelveInstance-765407413 tempest-TestShelveInstance-765407413-project-member] No BDM found with device name vda, not building metadata. {{(pid=74613) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 18:00:29 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-f85b99ac-8ee6-47d4-8cfb-e35892b3bcc5 tempest-TestShelveInstance-765407413 tempest-TestShelveInstance-765407413-project-member] No VIF found with MAC fa:16:3e:d5:66:27, not building metadata {{(pid=74613) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 29 18:00:29 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.015s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:00:29 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa71c286-9fd6-4825-8c0d-3cce44378930]: (4, ('', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 18:00:29 user nova-compute[74613]: DEBUG os_brick.initiator.linuxscsi [None req-462abe71-2fe8-4435-b5f3-d1ac7e70d6fa tempest-ServerActionsTestOtherA-1784608629 tempest-ServerActionsTestOtherA-1784608629-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=74613) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 29 18:00:29 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:00:29 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.042s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:00:29 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[06618882-822f-4f22-9e4f-32cfde82d3b7]: (4, ('1', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 18:00:29 user nova-compute[74613]: DEBUG os_brick.initiator.linuxscsi [None req-462abe71-2fe8-4435-b5f3-d1ac7e70d6fa tempest-ServerActionsTestOtherA-1784608629 tempest-ServerActionsTestOtherA-1784608629-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=74613) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 29 18:00:29 user nova-compute[74613]: DEBUG os_brick.initiator.linuxscsi [None req-462abe71-2fe8-4435-b5f3-d1ac7e70d6fa tempest-ServerActionsTestOtherA-1784608629 tempest-ServerActionsTestOtherA-1784608629-project-member] SCSI volumes sdd have been removed. {{(pid=74613) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 29 18:00:29 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-462abe71-2fe8-4435-b5f3-d1ac7e70d6fa tempest-ServerActionsTestOtherA-1784608629 tempest-ServerActionsTestOtherA-1784608629-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:72d22ffa-f425-4575-86a5-afbd8bb9cdd6')] {{(pid=74613) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 29 18:00:29 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:72d22ffa-f425-4575-86a5-afbd8bb9cdd6 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:00:29 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:72d22ffa-f425-4575-86a5-afbd8bb9cdd6 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:00:29 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[73e025ca-5c1d-41cc-b687-f91e32b9966e]: (4, ('', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 18:00:29 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-462abe71-2fe8-4435-b5f3-d1ac7e70d6fa tempest-ServerActionsTestOtherA-1784608629 tempest-ServerActionsTestOtherA-1784608629-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74613) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 18:00:29 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:72d22ffa-f425-4575-86a5-afbd8bb9cdd6 -p 172.16.0.220:3260 --logout {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:00:29 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:72d22ffa-f425-4575-86a5-afbd8bb9cdd6 -p 172.16.0.220:3260 --logout" returned: 0 in 0.116s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:00:29 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6ebd65d-ab97-4ce7-9e6d-0d217a6e5074]: (4, ('Logging out of session [sid: 19, target: iqn.2010-10.org.openstack:72d22ffa-f425-4575-86a5-afbd8bb9cdd6, portal: 172.16.0.220,3260]\nLogout of [sid: 19, target: iqn.2010-10.org.openstack:72d22ffa-f425-4575-86a5-afbd8bb9cdd6, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 18:00:29 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-462abe71-2fe8-4435-b5f3-d1ac7e70d6fa tempest-ServerActionsTestOtherA-1784608629 tempest-ServerActionsTestOtherA-1784608629-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 19, target: iqn.2010-10.org.openstack:72d22ffa-f425-4575-86a5-afbd8bb9cdd6, portal: 172.16.0.220,3260]
Nov 29 18:00:29 user nova-compute[74613]: Logout of [sid: 19, target: iqn.2010-10.org.openstack:72d22ffa-f425-4575-86a5-afbd8bb9cdd6, portal: 172.16.0.220,3260] successful.
Nov 29 18:00:29 user nova-compute[74613]:  stderr= {{(pid=74613) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 18:00:29 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:72d22ffa-f425-4575-86a5-afbd8bb9cdd6 -p 172.16.0.220:3260 --op delete {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:00:29 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:72d22ffa-f425-4575-86a5-afbd8bb9cdd6 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.025s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:00:29 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[72ddda02-177d-4f07-a0f4-0265323648d5]: (4, ('', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 18:00:29 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-462abe71-2fe8-4435-b5f3-d1ac7e70d6fa tempest-ServerActionsTestOtherA-1784608629 tempest-ServerActionsTestOtherA-1784608629-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74613) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 18:00:29 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.base [None req-462abe71-2fe8-4435-b5f3-d1ac7e70d6fa tempest-ServerActionsTestOtherA-1784608629 tempest-ServerActionsTestOtherA-1784608629-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.398s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 18:00:29 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-462abe71-2fe8-4435-b5f3-d1ac7e70d6fa tempest-ServerActionsTestOtherA-1784608629 tempest-ServerActionsTestOtherA-1784608629-project-member] <== disconnect_volume: return (1222ms) None {{(pid=74613) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 18:00:29 user nova-compute[74613]: DEBUG nova.virt.libvirt.volume.iscsi [None req-462abe71-2fe8-4435-b5f3-d1ac7e70d6fa tempest-ServerActionsTestOtherA-1784608629 tempest-ServerActionsTestOtherA-1784608629-project-member] [instance: 71f2a1ab-3df7-411c-93fa-b0a1a5a44f0a] Disconnected iSCSI Volume {{(pid=74613) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 29 18:00:30 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:00:30 user nova-compute[74613]: DEBUG nova.objects.instance [None req-462abe71-2fe8-4435-b5f3-d1ac7e70d6fa tempest-ServerActionsTestOtherA-1784608629 tempest-ServerActionsTestOtherA-1784608629-project-member] Lazy-loading 'flavor' on Instance uuid 71f2a1ab-3df7-411c-93fa-b0a1a5a44f0a {{(pid=74613) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 18:00:30 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-462abe71-2fe8-4435-b5f3-d1ac7e70d6fa tempest-ServerActionsTestOtherA-1784608629 tempest-ServerActionsTestOtherA-1784608629-project-member] Lock "71f2a1ab-3df7-411c-93fa-b0a1a5a44f0a" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.610s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 18:00:30 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:00:30 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:00:30 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:00:31 user nova-compute[74613]: DEBUG nova.compute.manager [req-0b7ccfd7-cda7-4437-be2d-10c3099738e2 req-2072670a-64a5-43fd-9738-82bdf2e4e770 service nova] [instance: fae10c60-f989-4c99-bde4-60cd9f3e2055] Received event network-vif-plugged-435f55bd-6b68-4466-96d8-7ca838b0a594 {{(pid=74613) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 18:00:31 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-0b7ccfd7-cda7-4437-be2d-10c3099738e2 req-2072670a-64a5-43fd-9738-82bdf2e4e770 service nova] Acquiring lock "fae10c60-f989-4c99-bde4-60cd9f3e2055-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 18:00:31 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-0b7ccfd7-cda7-4437-be2d-10c3099738e2 req-2072670a-64a5-43fd-9738-82bdf2e4e770 service nova] Lock "fae10c60-f989-4c99-bde4-60cd9f3e2055-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 18:00:31 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-0b7ccfd7-cda7-4437-be2d-10c3099738e2 req-2072670a-64a5-43fd-9738-82bdf2e4e770 service nova] Lock "fae10c60-f989-4c99-bde4-60cd9f3e2055-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 18:00:31 user nova-compute[74613]: DEBUG nova.compute.manager [req-0b7ccfd7-cda7-4437-be2d-10c3099738e2 req-2072670a-64a5-43fd-9738-82bdf2e4e770 service nova] [instance: fae10c60-f989-4c99-bde4-60cd9f3e2055] No waiting events found dispatching network-vif-plugged-435f55bd-6b68-4466-96d8-7ca838b0a594 {{(pid=74613) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 18:00:31 user nova-compute[74613]: WARNING nova.compute.manager [req-0b7ccfd7-cda7-4437-be2d-10c3099738e2 req-2072670a-64a5-43fd-9738-82bdf2e4e770 service nova] [instance: fae10c60-f989-4c99-bde4-60cd9f3e2055] Received unexpected event network-vif-plugged-435f55bd-6b68-4466-96d8-7ca838b0a594 for instance with vm_state shelved_offloaded and task_state spawning.
Nov 29 18:00:31 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:00:31 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:00:31 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:00:31 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:00:33 user nova-compute[74613]: DEBUG nova.compute.manager [None req-f85b99ac-8ee6-47d4-8cfb-e35892b3bcc5 tempest-TestShelveInstance-765407413 tempest-TestShelveInstance-765407413-project-member] [instance: fae10c60-f989-4c99-bde4-60cd9f3e2055] Instance event wait completed in 0 seconds for  {{(pid=74613) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 29 18:00:33 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-f85b99ac-8ee6-47d4-8cfb-e35892b3bcc5 tempest-TestShelveInstance-765407413 tempest-TestShelveInstance-765407413-project-member] [instance: fae10c60-f989-4c99-bde4-60cd9f3e2055] Guest created on hypervisor {{(pid=74613) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 29 18:00:33 user nova-compute[74613]: INFO nova.virt.libvirt.driver [-] [instance: fae10c60-f989-4c99-bde4-60cd9f3e2055] Instance spawned successfully.
Nov 29 18:00:33 user nova-compute[74613]: DEBUG nova.compute.manager [None req-f85b99ac-8ee6-47d4-8cfb-e35892b3bcc5 tempest-TestShelveInstance-765407413 tempest-TestShelveInstance-765407413-project-member] [instance: fae10c60-f989-4c99-bde4-60cd9f3e2055] Checking state {{(pid=74613) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 29 18:00:33 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-f85b99ac-8ee6-47d4-8cfb-e35892b3bcc5 tempest-TestShelveInstance-765407413 tempest-TestShelveInstance-765407413-project-member] Lock "fae10c60-f989-4c99-bde4-60cd9f3e2055" "released" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: held 20.819s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 18:00:33 user nova-compute[74613]: DEBUG nova.compute.manager [req-068bf077-4228-4ba1-bca9-57ee946c09cc req-b21de99b-41a9-430a-ae39-5181e10071d6 service nova] [instance: fae10c60-f989-4c99-bde4-60cd9f3e2055] Received event network-vif-plugged-435f55bd-6b68-4466-96d8-7ca838b0a594 {{(pid=74613) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 18:00:33 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-068bf077-4228-4ba1-bca9-57ee946c09cc req-b21de99b-41a9-430a-ae39-5181e10071d6 service nova] Acquiring lock "fae10c60-f989-4c99-bde4-60cd9f3e2055-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 18:00:33 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-068bf077-4228-4ba1-bca9-57ee946c09cc req-b21de99b-41a9-430a-ae39-5181e10071d6 service nova] Lock "fae10c60-f989-4c99-bde4-60cd9f3e2055-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 18:00:33 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-068bf077-4228-4ba1-bca9-57ee946c09cc req-b21de99b-41a9-430a-ae39-5181e10071d6 service nova] Lock "fae10c60-f989-4c99-bde4-60cd9f3e2055-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 18:00:33 user nova-compute[74613]: DEBUG nova.compute.manager [req-068bf077-4228-4ba1-bca9-57ee946c09cc req-b21de99b-41a9-430a-ae39-5181e10071d6 service nova] [instance: fae10c60-f989-4c99-bde4-60cd9f3e2055] No waiting events found dispatching network-vif-plugged-435f55bd-6b68-4466-96d8-7ca838b0a594 {{(pid=74613) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 18:00:33 user nova-compute[74613]: WARNING nova.compute.manager [req-068bf077-4228-4ba1-bca9-57ee946c09cc req-b21de99b-41a9-430a-ae39-5181e10071d6 service nova] [instance: fae10c60-f989-4c99-bde4-60cd9f3e2055] Received unexpected event network-vif-plugged-435f55bd-6b68-4466-96d8-7ca838b0a594 for instance with vm_state active and task_state None.
Nov 29 18:00:34 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:00:35 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:00:35 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-7f41620a-b66e-40f2-b568-e11ab877cb6d tempest-ServerActionsTestOtherB-894551005 tempest-ServerActionsTestOtherB-894551005-project-member] [instance: 74ac9703-1cd7-4983-b7d4-c69b01fec7b2] Starting finish_revert_migration {{(pid=74613) finish_revert_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11816}}
Nov 29 18:00:35 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-7f41620a-b66e-40f2-b568-e11ab877cb6d tempest-ServerActionsTestOtherB-894551005 tempest-ServerActionsTestOtherB-894551005-project-member] [instance: 74ac9703-1cd7-4983-b7d4-c69b01fec7b2] Start _get_guest_xml network_info=[{"id": "c63b6577-fb46-437a-95b3-8321fab45d0c", "address": "fa:16:3e:c3:2e:71", "network": {"id": "e687ed60-2592-4836-b97e-0828527b1b9f", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1938956411-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.143", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b392ca87608940c0ae467318b66453b2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc63b6577-fb", "ovs_interfaceid": "c63b6577-fb46-437a-95b3-8321fab45d0c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=4217f428-8d9d-4ee1-9614-642d26d90c46,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'size': 0, 'device_type': 'disk', 'boot_index': 0, 'guest_format': None, 'encrypted': False, 'encryption_format': None, 'disk_bus': 'virtio', 'image_id': '4217f428-8d9d-4ee1-9614-642d26d90c46'}], 'ephemerals': [], 'block_device_mapping': [{'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:bb526b54-3017-4f30-b5c7-88027b146d52', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RtrxDocV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'attaching', 'instance': '74ac9703-1cd7-4983-b7d4-c69b01fec7b2', 'attached_at': '2023-11-29T18:00:35.000000', 'detached_at': '', 'volume_id': 'bb526b54-3017-4f30-b5c7-88027b146d52', 'serial': 'bb526b54-3017-4f30-b5c7-88027b146d52'}, 'mount_device': '/dev/vdb', 'delete_on_termination': False, 'device_type': 'disk', 'boot_index': None, 'guest_format': None, 'attachment_id': '3f111527-c8da-483b-b283-5365c20c146c', 'disk_bus': 'virtio', 'volume_type': None} {{(pid=74613) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 29 18:00:35 user nova-compute[74613]: WARNING nova.virt.libvirt.driver [None req-7f41620a-b66e-40f2-b568-e11ab877cb6d tempest-ServerActionsTestOtherB-894551005 tempest-ServerActionsTestOtherB-894551005-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 18:00:35 user nova-compute[74613]: WARNING nova.virt.libvirt.driver [None req-7f41620a-b66e-40f2-b568-e11ab877cb6d tempest-ServerActionsTestOtherB-894551005 tempest-ServerActionsTestOtherB-894551005-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 18:00:35 user nova-compute[74613]: DEBUG nova.virt.libvirt.host [None req-7f41620a-b66e-40f2-b568-e11ab877cb6d tempest-ServerActionsTestOtherB-894551005 tempest-ServerActionsTestOtherB-894551005-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74613) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 29 18:00:35 user nova-compute[74613]: DEBUG nova.virt.libvirt.host [None req-7f41620a-b66e-40f2-b568-e11ab877cb6d tempest-ServerActionsTestOtherB-894551005 tempest-ServerActionsTestOtherB-894551005-project-member] CPU controller missing on host. {{(pid=74613) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 29 18:00:35 user nova-compute[74613]: DEBUG nova.virt.libvirt.host [None req-7f41620a-b66e-40f2-b568-e11ab877cb6d tempest-ServerActionsTestOtherB-894551005 tempest-ServerActionsTestOtherB-894551005-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74613) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 29 18:00:35 user nova-compute[74613]: DEBUG nova.virt.libvirt.host [None req-7f41620a-b66e-40f2-b568-e11ab877cb6d tempest-ServerActionsTestOtherB-894551005 tempest-ServerActionsTestOtherB-894551005-project-member] CPU controller found on host. {{(pid=74613) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 29 18:00:35 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-7f41620a-b66e-40f2-b568-e11ab877cb6d tempest-ServerActionsTestOtherB-894551005 tempest-ServerActionsTestOtherB-894551005-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74613) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 29 18:00:35 user nova-compute[74613]: DEBUG nova.virt.hardware [None req-7f41620a-b66e-40f2-b568-e11ab877cb6d tempest-ServerActionsTestOtherB-894551005 tempest-ServerActionsTestOtherB-894551005-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-29T17:47:27Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=4217f428-8d9d-4ee1-9614-642d26d90c46,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74613) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 29 18:00:35 user nova-compute[74613]: DEBUG nova.virt.hardware [None req-7f41620a-b66e-40f2-b568-e11ab877cb6d tempest-ServerActionsTestOtherB-894551005 tempest-ServerActionsTestOtherB-894551005-project-member] Flavor limits 0:0:0 {{(pid=74613) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 29 18:00:35 user nova-compute[74613]: DEBUG nova.virt.hardware [None req-7f41620a-b66e-40f2-b568-e11ab877cb6d tempest-ServerActionsTestOtherB-894551005 tempest-ServerActionsTestOtherB-894551005-project-member] Image limits 0:0:0 {{(pid=74613) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 29 18:00:35 user nova-compute[74613]: DEBUG nova.virt.hardware [None req-7f41620a-b66e-40f2-b568-e11ab877cb6d tempest-ServerActionsTestOtherB-894551005 tempest-ServerActionsTestOtherB-894551005-project-member] Flavor pref 0:0:0 {{(pid=74613) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 29 18:00:35 user nova-compute[74613]: DEBUG nova.virt.hardware [None req-7f41620a-b66e-40f2-b568-e11ab877cb6d tempest-ServerActionsTestOtherB-894551005 tempest-ServerActionsTestOtherB-894551005-project-member] Image pref 0:0:0 {{(pid=74613) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 29 18:00:35 user nova-compute[74613]: DEBUG nova.virt.hardware [None req-7f41620a-b66e-40f2-b568-e11ab877cb6d tempest-ServerActionsTestOtherB-894551005 tempest-ServerActionsTestOtherB-894551005-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74613) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 29 18:00:35 user nova-compute[74613]: DEBUG nova.virt.hardware [None req-7f41620a-b66e-40f2-b568-e11ab877cb6d tempest-ServerActionsTestOtherB-894551005 tempest-ServerActionsTestOtherB-894551005-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74613) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 29 18:00:35 user nova-compute[74613]: DEBUG nova.virt.hardware [None req-7f41620a-b66e-40f2-b568-e11ab877cb6d tempest-ServerActionsTestOtherB-894551005 tempest-ServerActionsTestOtherB-894551005-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74613) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 29 18:00:35 user nova-compute[74613]: DEBUG nova.virt.hardware [None req-7f41620a-b66e-40f2-b568-e11ab877cb6d tempest-ServerActionsTestOtherB-894551005 tempest-ServerActionsTestOtherB-894551005-project-member] Got 1 possible topologies {{(pid=74613) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 29 18:00:35 user nova-compute[74613]: DEBUG nova.virt.hardware [None req-7f41620a-b66e-40f2-b568-e11ab877cb6d tempest-ServerActionsTestOtherB-894551005 tempest-ServerActionsTestOtherB-894551005-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74613) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 29 18:00:35 user nova-compute[74613]: DEBUG nova.virt.hardware [None req-7f41620a-b66e-40f2-b568-e11ab877cb6d tempest-ServerActionsTestOtherB-894551005 tempest-ServerActionsTestOtherB-894551005-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74613) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 29 18:00:35 user nova-compute[74613]: DEBUG nova.objects.instance [None req-7f41620a-b66e-40f2-b568-e11ab877cb6d tempest-ServerActionsTestOtherB-894551005 tempest-ServerActionsTestOtherB-894551005-project-member] Lazy-loading 'vcpu_model' on Instance uuid 74ac9703-1cd7-4983-b7d4-c69b01fec7b2 {{(pid=74613) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 18:00:35 user nova-compute[74613]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7f41620a-b66e-40f2-b568-e11ab877cb6d tempest-ServerActionsTestOtherB-894551005 tempest-ServerActionsTestOtherB-894551005-project-member] [instance: 74ac9703-1cd7-4983-b7d4-c69b01fec7b2] Calling os-brick to attach iSCSI Volume {{(pid=74613) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 29 18:00:35 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f41620a-b66e-40f2-b568-e11ab877cb6d tempest-ServerActionsTestOtherB-894551005 tempest-ServerActionsTestOtherB-894551005-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff828156890>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:bb526b54-3017-4f30-b5c7-88027b146d52', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RtrxDocV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74613) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 18:00:35 user nova-compute[74613]: WARNING os_brick.initiator.connectors.base [None req-7f41620a-b66e-40f2-b568-e11ab877cb6d tempest-ServerActionsTestOtherB-894551005 tempest-ServerActionsTestOtherB-894551005-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 18:00:35 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.base [None req-7f41620a-b66e-40f2-b568-e11ab877cb6d tempest-ServerActionsTestOtherB-894551005 tempest-ServerActionsTestOtherB-894551005-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 18:00:35 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.base [None req-7f41620a-b66e-40f2-b568-e11ab877cb6d tempest-ServerActionsTestOtherB-894551005 tempest-ServerActionsTestOtherB-894551005-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 18:00:35 user nova-compute[74613]: WARNING os_brick.initiator.connectors.base [None req-7f41620a-b66e-40f2-b568-e11ab877cb6d tempest-ServerActionsTestOtherB-894551005 tempest-ServerActionsTestOtherB-894551005-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 18:00:35 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.base [None req-7f41620a-b66e-40f2-b568-e11ab877cb6d tempest-ServerActionsTestOtherB-894551005 tempest-ServerActionsTestOtherB-894551005-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:bb526b54-3017-4f30-b5c7-88027b146d52" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 18:00:35 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.base [None req-7f41620a-b66e-40f2-b568-e11ab877cb6d tempest-ServerActionsTestOtherB-894551005 tempest-ServerActionsTestOtherB-894551005-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:bb526b54-3017-4f30-b5c7-88027b146d52" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 18:00:35 user nova-compute[74613]: INFO os_brick.initiator.connectors.iscsi [None req-7f41620a-b66e-40f2-b568-e11ab877cb6d tempest-ServerActionsTestOtherB-894551005 tempest-ServerActionsTestOtherB-894551005-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 29 18:00:35 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bb526b54-3017-4f30-b5c7-88027b146d52 -p 172.16.0.220:3260 {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:00:35 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bb526b54-3017-4f30-b5c7-88027b146d52 -p 172.16.0.220:3260" returned: 21 in 0.028s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:00:35 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ec87602-f7ef-4985-b267-dae267cac38c]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 18:00:35 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f41620a-b66e-40f2-b568-e11ab877cb6d tempest-ServerActionsTestOtherB-894551005 tempest-ServerActionsTestOtherB-894551005-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 29 18:00:35 user nova-compute[74613]:  {{(pid=74613) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 18:00:35 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bb526b54-3017-4f30-b5c7-88027b146d52 -p 172.16.0.220:3260 --interface default --op new {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:00:35 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bb526b54-3017-4f30-b5c7-88027b146d52 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:00:35 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[77fcddcb-6fdc-4d30-8f9f-02b519f9e5bb]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:bb526b54-3017-4f30-b5c7-88027b146d52] added\n', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 18:00:35 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f41620a-b66e-40f2-b568-e11ab877cb6d tempest-ServerActionsTestOtherB-894551005 tempest-ServerActionsTestOtherB-894551005-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:bb526b54-3017-4f30-b5c7-88027b146d52] added
Nov 29 18:00:35 user nova-compute[74613]:  stderr= {{(pid=74613) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 18:00:35 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bb526b54-3017-4f30-b5c7-88027b146d52 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:00:35 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bb526b54-3017-4f30-b5c7-88027b146d52 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.027s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:00:35 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4a50380-6542-4b54-9676-517be5db3842]: (4, ('', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 18:00:35 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f41620a-b66e-40f2-b568-e11ab877cb6d tempest-ServerActionsTestOtherB-894551005 tempest-ServerActionsTestOtherB-894551005-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74613) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 18:00:35 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bb526b54-3017-4f30-b5c7-88027b146d52 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:00:35 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bb526b54-3017-4f30-b5c7-88027b146d52 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.023s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:00:35 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c3d70a6-93d0-47cb-ace5-5f3edc4a311d]: (4, ('', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 18:00:35 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f41620a-b66e-40f2-b568-e11ab877cb6d tempest-ServerActionsTestOtherB-894551005 tempest-ServerActionsTestOtherB-894551005-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74613) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 18:00:35 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bb526b54-3017-4f30-b5c7-88027b146d52 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v RtrxDocV {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:00:35 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bb526b54-3017-4f30-b5c7-88027b146d52 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v RtrxDocV" returned: 0 in 0.026s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:00:35 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[02e6982e-c2f7-4b94-9a4d-587635f03214]: (4, ('', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 18:00:35 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f41620a-b66e-40f2-b568-e11ab877cb6d tempest-ServerActionsTestOtherB-894551005 tempest-ServerActionsTestOtherB-894551005-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'RtrxDocV'): stdout= stderr= {{(pid=74613) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 18:00:35 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bb526b54-3017-4f30-b5c7-88027b146d52 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:00:35 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bb526b54-3017-4f30-b5c7-88027b146d52 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.026s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:00:35 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[2552da91-eb2d-4356-8e10-7f19a08c6ef3]: (4, ('', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 18:00:35 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f41620a-b66e-40f2-b568-e11ab877cb6d tempest-ServerActionsTestOtherB-894551005 tempest-ServerActionsTestOtherB-894551005-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74613) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 18:00:35 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:00:35 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:00:35 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[baaec29d-81df-4955-8b05-6cc92bc4c5c6]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9511387c-8772-40f2-bf2d-6b6387649e9f (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a07b572-6430-4d0f-9aaf-8a8dbc39831e (non-flash)\n', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 18:00:35 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f41620a-b66e-40f2-b568-e11ab877cb6d tempest-ServerActionsTestOtherB-894551005 tempest-ServerActionsTestOtherB-894551005-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9511387c-8772-40f2-bf2d-6b6387649e9f (non-flash)
Nov 29 18:00:35 user nova-compute[74613]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a07b572-6430-4d0f-9aaf-8a8dbc39831e (non-flash)
Nov 29 18:00:35 user nova-compute[74613]:  stderr= {{(pid=74613) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 18:00:35 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f41620a-b66e-40f2-b568-e11ab877cb6d tempest-ServerActionsTestOtherB-894551005 tempest-ServerActionsTestOtherB-894551005-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9511387c-8772-40f2-bf2d-6b6387649e9f (non-flash)
Nov 29 18:00:35 user nova-compute[74613]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a07b572-6430-4d0f-9aaf-8a8dbc39831e (non-flash)
Nov 29 18:00:35 user nova-compute[74613]:  stderr= {{(pid=74613) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 18:00:35 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bb526b54-3017-4f30-b5c7-88027b146d52 -p 172.16.0.220:3260 --login {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:00:36 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bb526b54-3017-4f30-b5c7-88027b146d52 -p 172.16.0.220:3260 --login" returned: 0 in 0.074s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:00:36 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[f90b643f-e6d8-4fe8-961a-ac2a7c98c34d]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:bb526b54-3017-4f30-b5c7-88027b146d52, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:bb526b54-3017-4f30-b5c7-88027b146d52, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 18:00:36 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f41620a-b66e-40f2-b568-e11ab877cb6d tempest-ServerActionsTestOtherB-894551005 tempest-ServerActionsTestOtherB-894551005-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:bb526b54-3017-4f30-b5c7-88027b146d52, portal: 172.16.0.220,3260]
Nov 29 18:00:36 user nova-compute[74613]: Login to [iface: default, target: iqn.2010-10.org.openstack:bb526b54-3017-4f30-b5c7-88027b146d52, portal: 172.16.0.220,3260] successful.
Nov 29 18:00:36 user nova-compute[74613]:  stderr= {{(pid=74613) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 18:00:36 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bb526b54-3017-4f30-b5c7-88027b146d52 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:00:36 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bb526b54-3017-4f30-b5c7-88027b146d52 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.026s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:00:36 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[e39697a8-b59a-4c51-8fe7-097da0b6b35e]: (4, ('', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 18:00:36 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f41620a-b66e-40f2-b568-e11ab877cb6d tempest-ServerActionsTestOtherB-894551005 tempest-ServerActionsTestOtherB-894551005-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74613) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 18:00:36 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:00:36 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:00:36 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[37acb34b-07b0-4d9d-b883-5e4add151a1f]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9511387c-8772-40f2-bf2d-6b6387649e9f (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a07b572-6430-4d0f-9aaf-8a8dbc39831e (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb526b54-3017-4f30-b5c7-88027b146d52 (non-flash)\n', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 18:00:36 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f41620a-b66e-40f2-b568-e11ab877cb6d tempest-ServerActionsTestOtherB-894551005 tempest-ServerActionsTestOtherB-894551005-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9511387c-8772-40f2-bf2d-6b6387649e9f (non-flash)
Nov 29 18:00:36 user nova-compute[74613]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a07b572-6430-4d0f-9aaf-8a8dbc39831e (non-flash)
Nov 29 18:00:36 user nova-compute[74613]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb526b54-3017-4f30-b5c7-88027b146d52 (non-flash)
Nov 29 18:00:36 user nova-compute[74613]:  stderr= {{(pid=74613) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 18:00:36 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f41620a-b66e-40f2-b568-e11ab877cb6d tempest-ServerActionsTestOtherB-894551005 tempest-ServerActionsTestOtherB-894551005-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9511387c-8772-40f2-bf2d-6b6387649e9f (non-flash)
Nov 29 18:00:36 user nova-compute[74613]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a07b572-6430-4d0f-9aaf-8a8dbc39831e (non-flash)
Nov 29 18:00:36 user nova-compute[74613]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb526b54-3017-4f30-b5c7-88027b146d52 (non-flash)
Nov 29 18:00:36 user nova-compute[74613]:  stderr= {{(pid=74613) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 18:00:36 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.base [None req-7f41620a-b66e-40f2-b568-e11ab877cb6d tempest-ServerActionsTestOtherB-894551005 tempest-ServerActionsTestOtherB-894551005-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:bb526b54-3017-4f30-b5c7-88027b146d52" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.353s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 18:00:36 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f41620a-b66e-40f2-b568-e11ab877cb6d tempest-ServerActionsTestOtherB-894551005 tempest-ServerActionsTestOtherB-894551005-project-member] Connected to 172.16.0.220:3260 {{(pid=74613) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 29 18:00:36 user nova-compute[74613]: DEBUG os_brick.initiator.linuxscsi [None req-7f41620a-b66e-40f2-b568-e11ab877cb6d tempest-ServerActionsTestOtherB-894551005 tempest-ServerActionsTestOtherB-894551005-project-member] HCTL ('35', '-', '-', 0) found on session 25 with lun 0 {{(pid=74613) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 29 18:00:36 user nova-compute[74613]: DEBUG os_brick.initiator.linuxscsi [None req-7f41620a-b66e-40f2-b568-e11ab877cb6d tempest-ServerActionsTestOtherB-894551005 tempest-ServerActionsTestOtherB-894551005-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=74613) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 29 18:00:36 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:00:36 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.021s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:00:36 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[4db9d5cd-f8be-419a-9bb3-3b0eb87d7e18]: (4, ('- - 0', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 18:00:36 user nova-compute[74613]: DEBUG os_brick.initiator.linuxscsi [None req-7f41620a-b66e-40f2-b568-e11ab877cb6d tempest-ServerActionsTestOtherB-894551005 tempest-ServerActionsTestOtherB-894551005-project-member] Searching for a device in session 25 and hctl ['35', '*', '*', 0] yield: None {{(pid=74613) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 29 18:00:37 user nova-compute[74613]: DEBUG os_brick.initiator.linuxscsi [None req-7f41620a-b66e-40f2-b568-e11ab877cb6d tempest-ServerActionsTestOtherB-894551005 tempest-ServerActionsTestOtherB-894551005-project-member] Searching for a device in session 25 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=74613) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 29 18:00:37 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f41620a-b66e-40f2-b568-e11ab877cb6d tempest-ServerActionsTestOtherB-894551005 tempest-ServerActionsTestOtherB-894551005-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:bb526b54-3017-4f30-b5c7-88027b146d52', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RtrxDocV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74613) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 29 18:00:37 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.base [None req-7f41620a-b66e-40f2-b568-e11ab877cb6d tempest-ServerActionsTestOtherB-894551005 tempest-ServerActionsTestOtherB-894551005-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.388s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 18:00:37 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f41620a-b66e-40f2-b568-e11ab877cb6d tempest-ServerActionsTestOtherB-894551005 tempest-ServerActionsTestOtherB-894551005-project-member] <== connect_volume: return (1388ms) {'type': 'block', 'scsi_wwn': '23763623539386230', 'path': '/dev/sdd'} {{(pid=74613) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 18:00:37 user nova-compute[74613]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7f41620a-b66e-40f2-b568-e11ab877cb6d tempest-ServerActionsTestOtherB-894551005 tempest-ServerActionsTestOtherB-894551005-project-member] [instance: 74ac9703-1cd7-4983-b7d4-c69b01fec7b2] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23763623539386230', 'path': '/dev/sdd'} {{(pid=74613) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 29 18:00:37 user nova-compute[74613]: DEBUG nova.virt.libvirt.vif [None req-7f41620a-b66e-40f2-b568-e11ab877cb6d tempest-ServerActionsTestOtherB-894551005 tempest-ServerActionsTestOtherB-894551005-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T17:55:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-931769463',display_name='tempest-ServerActionsTestOtherB-server-931769463',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-931769463',id=14,image_ref='4217f428-8d9d-4ee1-9614-642d26d90c46',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBE0p3wmKXoOCABzKEPJ0MsHfAtC1JQfzjVn7a3OeQC65p309Te6g/AbiDIZbrFAX7j9aAJfq/HNC8gx1yP/V9/PHfR3o28o9EgbHEcoTtW/dEJGkpFGjjy+hrqfOfHYCnA==',key_name='tempest-keypair-464492783',keypairs=<?>,launch_index=0,launched_at=2023-11-29T17:58:52Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='b392ca87608940c0ae467318b66453b2',ramdisk_id='',reservation_id='r-0wzexjb0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='4217f428-8d9d-4ee1-9614-642d26d90c46',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-894551005',owner_user_name='tempest-ServerActionsTestOtherB-894551005-project-member'},tags=<?>,task_state='resize_reverting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-29T18:00:22Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1a6eb590fed440729b45b8db79eb7c2f',uuid=74ac9703-1cd7-4983-b7d4-c69b01fec7b2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='resized') vif={"id": "c63b6577-fb46-437a-95b3-8321fab45d0c", "address": "fa:16:3e:c3:2e:71", "network": {"id": "e687ed60-2592-4836-b97e-0828527b1b9f", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1938956411-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.143", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b392ca87608940c0ae467318b66453b2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc63b6577-fb", "ovs_interfaceid": "c63b6577-fb46-437a-95b3-8321fab45d0c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74613) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 29 18:00:37 user nova-compute[74613]: DEBUG nova.network.os_vif_util [None req-7f41620a-b66e-40f2-b568-e11ab877cb6d tempest-ServerActionsTestOtherB-894551005 tempest-ServerActionsTestOtherB-894551005-project-member] Converting VIF {"id": "c63b6577-fb46-437a-95b3-8321fab45d0c", "address": "fa:16:3e:c3:2e:71", "network": {"id": "e687ed60-2592-4836-b97e-0828527b1b9f", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1938956411-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.143", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b392ca87608940c0ae467318b66453b2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc63b6577-fb", "ovs_interfaceid": "c63b6577-fb46-437a-95b3-8321fab45d0c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74613) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 18:00:37 user nova-compute[74613]: DEBUG nova.network.os_vif_util [None req-7f41620a-b66e-40f2-b568-e11ab877cb6d tempest-ServerActionsTestOtherB-894551005 tempest-ServerActionsTestOtherB-894551005-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c3:2e:71,bridge_name='br-int',has_traffic_filtering=True,id=c63b6577-fb46-437a-95b3-8321fab45d0c,network=Network(e687ed60-2592-4836-b97e-0828527b1b9f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc63b6577-fb') {{(pid=74613) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 18:00:37 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-7f41620a-b66e-40f2-b568-e11ab877cb6d tempest-ServerActionsTestOtherB-894551005 tempest-ServerActionsTestOtherB-894551005-project-member] [instance: 74ac9703-1cd7-4983-b7d4-c69b01fec7b2] End _get_guest_xml xml=<domain type="kvm">
Nov 29 18:00:37 user nova-compute[74613]:   <uuid>74ac9703-1cd7-4983-b7d4-c69b01fec7b2</uuid>
Nov 29 18:00:37 user nova-compute[74613]:   <name>instance-0000000e</name>
Nov 29 18:00:37 user nova-compute[74613]:   <memory>524288</memory>
Nov 29 18:00:37 user nova-compute[74613]:   <vcpu>1</vcpu>
Nov 29 18:00:37 user nova-compute[74613]:   <metadata>
Nov 29 18:00:37 user nova-compute[74613]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 29 18:00:37 user nova-compute[74613]:       <nova:package version="0.0.0"/>
Nov 29 18:00:37 user nova-compute[74613]:       <nova:name>tempest-ServerActionsTestOtherB-server-931769463</nova:name>
Nov 29 18:00:37 user nova-compute[74613]:       <nova:creationTime>2023-11-29 18:00:35</nova:creationTime>
Nov 29 18:00:37 user nova-compute[74613]:       <nova:flavor name="m1.tiny">
Nov 29 18:00:37 user nova-compute[74613]:         <nova:memory>512</nova:memory>
Nov 29 18:00:37 user nova-compute[74613]:         <nova:disk>1</nova:disk>
Nov 29 18:00:37 user nova-compute[74613]:         <nova:swap>0</nova:swap>
Nov 29 18:00:37 user nova-compute[74613]:         <nova:ephemeral>0</nova:ephemeral>
Nov 29 18:00:37 user nova-compute[74613]:         <nova:vcpus>1</nova:vcpus>
Nov 29 18:00:37 user nova-compute[74613]:       </nova:flavor>
Nov 29 18:00:37 user nova-compute[74613]:       <nova:owner>
Nov 29 18:00:37 user nova-compute[74613]:         <nova:user uuid="1a6eb590fed440729b45b8db79eb7c2f">tempest-ServerActionsTestOtherB-894551005-project-member</nova:user>
Nov 29 18:00:37 user nova-compute[74613]:         <nova:project uuid="b392ca87608940c0ae467318b66453b2">tempest-ServerActionsTestOtherB-894551005</nova:project>
Nov 29 18:00:37 user nova-compute[74613]:       </nova:owner>
Nov 29 18:00:37 user nova-compute[74613]:       <nova:root type="image" uuid="4217f428-8d9d-4ee1-9614-642d26d90c46"/>
Nov 29 18:00:37 user nova-compute[74613]:       <nova:ports>
Nov 29 18:00:37 user nova-compute[74613]:         <nova:port uuid="c63b6577-fb46-437a-95b3-8321fab45d0c">
Nov 29 18:00:37 user nova-compute[74613]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Nov 29 18:00:37 user nova-compute[74613]:         </nova:port>
Nov 29 18:00:37 user nova-compute[74613]:       </nova:ports>
Nov 29 18:00:37 user nova-compute[74613]:     </nova:instance>
Nov 29 18:00:37 user nova-compute[74613]:   </metadata>
Nov 29 18:00:37 user nova-compute[74613]:   <sysinfo type="smbios">
Nov 29 18:00:37 user nova-compute[74613]:     <system>
Nov 29 18:00:37 user nova-compute[74613]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 29 18:00:37 user nova-compute[74613]:       <entry name="product">OpenStack Nova</entry>
Nov 29 18:00:37 user nova-compute[74613]:       <entry name="version">0.0.0</entry>
Nov 29 18:00:37 user nova-compute[74613]:       <entry name="serial">74ac9703-1cd7-4983-b7d4-c69b01fec7b2</entry>
Nov 29 18:00:37 user nova-compute[74613]:       <entry name="uuid">74ac9703-1cd7-4983-b7d4-c69b01fec7b2</entry>
Nov 29 18:00:37 user nova-compute[74613]:       <entry name="family">Virtual Machine</entry>
Nov 29 18:00:37 user nova-compute[74613]:     </system>
Nov 29 18:00:37 user nova-compute[74613]:   </sysinfo>
Nov 29 18:00:37 user nova-compute[74613]:   <os>
Nov 29 18:00:37 user nova-compute[74613]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 29 18:00:37 user nova-compute[74613]:     <boot dev="hd"/>
Nov 29 18:00:37 user nova-compute[74613]:     <smbios mode="sysinfo"/>
Nov 29 18:00:37 user nova-compute[74613]:   </os>
Nov 29 18:00:37 user nova-compute[74613]:   <features>
Nov 29 18:00:37 user nova-compute[74613]:     <acpi/>
Nov 29 18:00:37 user nova-compute[74613]:     <apic/>
Nov 29 18:00:37 user nova-compute[74613]:     <vmcoreinfo/>
Nov 29 18:00:37 user nova-compute[74613]:   </features>
Nov 29 18:00:37 user nova-compute[74613]:   <clock offset="utc">
Nov 29 18:00:37 user nova-compute[74613]:     <timer name="pit" tickpolicy="delay"/>
Nov 29 18:00:37 user nova-compute[74613]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 29 18:00:37 user nova-compute[74613]:     <timer name="hpet" present="no"/>
Nov 29 18:00:37 user nova-compute[74613]:   </clock>
Nov 29 18:00:37 user nova-compute[74613]:   <cpu mode="custom" match="exact">
Nov 29 18:00:37 user nova-compute[74613]:     <model>Nehalem</model>
Nov 29 18:00:37 user nova-compute[74613]:     <topology sockets="1" cores="1" threads="1"/>
Nov 29 18:00:37 user nova-compute[74613]:   </cpu>
Nov 29 18:00:37 user nova-compute[74613]:   <devices>
Nov 29 18:00:37 user nova-compute[74613]:     <disk type="file" device="disk">
Nov 29 18:00:37 user nova-compute[74613]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 29 18:00:37 user nova-compute[74613]:       <source file="/opt/stack/data/nova/instances/74ac9703-1cd7-4983-b7d4-c69b01fec7b2/disk"/>
Nov 29 18:00:37 user nova-compute[74613]:       <target dev="vda" bus="virtio"/>
Nov 29 18:00:37 user nova-compute[74613]:     </disk>
Nov 29 18:00:37 user nova-compute[74613]:     <disk type="block" device="disk">
Nov 29 18:00:37 user nova-compute[74613]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 18:00:37 user nova-compute[74613]:       <source dev="/dev/sdd"/>
Nov 29 18:00:37 user nova-compute[74613]:       <target dev="vdb" bus="virtio"/>
Nov 29 18:00:37 user nova-compute[74613]:       <serial>bb526b54-3017-4f30-b5c7-88027b146d52</serial>
Nov 29 18:00:37 user nova-compute[74613]:     </disk>
Nov 29 18:00:37 user nova-compute[74613]:     <interface type="ethernet">
Nov 29 18:00:37 user nova-compute[74613]:       <mac address="fa:16:3e:c3:2e:71"/>
Nov 29 18:00:37 user nova-compute[74613]:       <model type="virtio"/>
Nov 29 18:00:37 user nova-compute[74613]:       <mtu size="1442"/>
Nov 29 18:00:37 user nova-compute[74613]:       <target dev="tapc63b6577-fb"/>
Nov 29 18:00:37 user nova-compute[74613]:     </interface>
Nov 29 18:00:37 user nova-compute[74613]:     <serial type="pty">
Nov 29 18:00:37 user nova-compute[74613]:       <log file="/opt/stack/data/nova/instances/74ac9703-1cd7-4983-b7d4-c69b01fec7b2/console.log" append="off"/>
Nov 29 18:00:37 user nova-compute[74613]:     </serial>
Nov 29 18:00:37 user nova-compute[74613]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 29 18:00:37 user nova-compute[74613]:     <video>
Nov 29 18:00:37 user nova-compute[74613]:       <model type="virtio"/>
Nov 29 18:00:37 user nova-compute[74613]:     </video>
Nov 29 18:00:37 user nova-compute[74613]:     <rng model="virtio">
Nov 29 18:00:37 user nova-compute[74613]:       <backend model="random">/dev/urandom</backend>
Nov 29 18:00:37 user nova-compute[74613]:     </rng>
Nov 29 18:00:37 user nova-compute[74613]:     <controller type="usb" index="0" model="none"/>
Nov 29 18:00:37 user nova-compute[74613]:     <memballoon model="virtio">
Nov 29 18:00:37 user nova-compute[74613]:       <stats period="10"/>
Nov 29 18:00:37 user nova-compute[74613]:     </memballoon>
Nov 29 18:00:37 user nova-compute[74613]:   </devices>
Nov 29 18:00:37 user nova-compute[74613]: </domain>
Nov 29 18:00:37 user nova-compute[74613]:  {{(pid=74613) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 29 18:00:37 user nova-compute[74613]: DEBUG nova.virt.libvirt.vif [None req-7f41620a-b66e-40f2-b568-e11ab877cb6d tempest-ServerActionsTestOtherB-894551005 tempest-ServerActionsTestOtherB-894551005-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T17:55:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-931769463',display_name='tempest-ServerActionsTestOtherB-server-931769463',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-931769463',id=14,image_ref='4217f428-8d9d-4ee1-9614-642d26d90c46',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBE0p3wmKXoOCABzKEPJ0MsHfAtC1JQfzjVn7a3OeQC65p309Te6g/AbiDIZbrFAX7j9aAJfq/HNC8gx1yP/V9/PHfR3o28o9EgbHEcoTtW/dEJGkpFGjjy+hrqfOfHYCnA==',key_name='tempest-keypair-464492783',keypairs=<?>,launch_index=0,launched_at=2023-11-29T17:58:52Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='b392ca87608940c0ae467318b66453b2',ramdisk_id='',reservation_id='r-0wzexjb0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='4217f428-8d9d-4ee1-9614-642d26d90c46',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-894551005',owner_user_name='tempest-ServerActionsTestOtherB-894551005-project-member'},tags=<?>,task_state='resize_reverting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-29T18:00:22Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1a6eb590fed440729b45b8db79eb7c2f',uuid=74ac9703-1cd7-4983-b7d4-c69b01fec7b2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='resized') vif={"id": "c63b6577-fb46-437a-95b3-8321fab45d0c", "address": "fa:16:3e:c3:2e:71", "network": {"id": "e687ed60-2592-4836-b97e-0828527b1b9f", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1938956411-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.143", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b392ca87608940c0ae467318b66453b2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc63b6577-fb", "ovs_interfaceid": "c63b6577-fb46-437a-95b3-8321fab45d0c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74613) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 29 18:00:37 user nova-compute[74613]: DEBUG nova.network.os_vif_util [None req-7f41620a-b66e-40f2-b568-e11ab877cb6d tempest-ServerActionsTestOtherB-894551005 tempest-ServerActionsTestOtherB-894551005-project-member] Converting VIF {"id": "c63b6577-fb46-437a-95b3-8321fab45d0c", "address": "fa:16:3e:c3:2e:71", "network": {"id": "e687ed60-2592-4836-b97e-0828527b1b9f", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1938956411-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.143", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b392ca87608940c0ae467318b66453b2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc63b6577-fb", "ovs_interfaceid": "c63b6577-fb46-437a-95b3-8321fab45d0c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74613) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 18:00:37 user nova-compute[74613]: DEBUG nova.network.os_vif_util [None req-7f41620a-b66e-40f2-b568-e11ab877cb6d tempest-ServerActionsTestOtherB-894551005 tempest-ServerActionsTestOtherB-894551005-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c3:2e:71,bridge_name='br-int',has_traffic_filtering=True,id=c63b6577-fb46-437a-95b3-8321fab45d0c,network=Network(e687ed60-2592-4836-b97e-0828527b1b9f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc63b6577-fb') {{(pid=74613) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 18:00:37 user nova-compute[74613]: DEBUG os_vif [None req-7f41620a-b66e-40f2-b568-e11ab877cb6d tempest-ServerActionsTestOtherB-894551005 tempest-ServerActionsTestOtherB-894551005-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c3:2e:71,bridge_name='br-int',has_traffic_filtering=True,id=c63b6577-fb46-437a-95b3-8321fab45d0c,network=Network(e687ed60-2592-4836-b97e-0828527b1b9f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc63b6577-fb') {{(pid=74613) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 29 18:00:37 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:00:37 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74613) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 18:00:37 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74613) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 29 18:00:37 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:00:37 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '0a1a518d-0115-5f9b-8d7d-237989c4884e', '_type': 'linux-noop'}}, row=False) {{(pid=74613) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 18:00:37 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:00:37 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 18:00:37 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:00:37 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapc63b6577-fb, may_exist=True, interface_attrs={}) {{(pid=74613) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 18:00:37 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapc63b6577-fb, col_values=(('qos', UUID('ef0bfeb2-3dc2-4f23-824b-d65673f07ee0')),), if_exists=True) {{(pid=74613) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 18:00:37 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapc63b6577-fb, col_values=(('external_ids', {'iface-id': 'c63b6577-fb46-437a-95b3-8321fab45d0c', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:c3:2e:71', 'vm-uuid': '74ac9703-1cd7-4983-b7d4-c69b01fec7b2'}),), if_exists=True) {{(pid=74613) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 18:00:37 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:00:37 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 18:00:37 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:00:37 user nova-compute[74613]: INFO os_vif [None req-7f41620a-b66e-40f2-b568-e11ab877cb6d tempest-ServerActionsTestOtherB-894551005 tempest-ServerActionsTestOtherB-894551005-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c3:2e:71,bridge_name='br-int',has_traffic_filtering=True,id=c63b6577-fb46-437a-95b3-8321fab45d0c,network=Network(e687ed60-2592-4836-b97e-0828527b1b9f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc63b6577-fb')
Nov 29 18:00:38 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:00:38 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:00:38 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:00:38 user nova-compute[74613]: DEBUG nova.compute.manager [req-8a3f7ad5-25f4-4f9d-b6bd-b99f3cc0ec71 req-c8e1bd9a-abcb-4a50-9be5-3076f720b114 service nova] [instance: 74ac9703-1cd7-4983-b7d4-c69b01fec7b2] Received event network-vif-plugged-c63b6577-fb46-437a-95b3-8321fab45d0c {{(pid=74613) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 18:00:38 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-8a3f7ad5-25f4-4f9d-b6bd-b99f3cc0ec71 req-c8e1bd9a-abcb-4a50-9be5-3076f720b114 service nova] Acquiring lock "74ac9703-1cd7-4983-b7d4-c69b01fec7b2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 18:00:38 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-8a3f7ad5-25f4-4f9d-b6bd-b99f3cc0ec71 req-c8e1bd9a-abcb-4a50-9be5-3076f720b114 service nova] Lock "74ac9703-1cd7-4983-b7d4-c69b01fec7b2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 18:00:38 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-8a3f7ad5-25f4-4f9d-b6bd-b99f3cc0ec71 req-c8e1bd9a-abcb-4a50-9be5-3076f720b114 service nova] Lock "74ac9703-1cd7-4983-b7d4-c69b01fec7b2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 18:00:38 user nova-compute[74613]: DEBUG nova.compute.manager [req-8a3f7ad5-25f4-4f9d-b6bd-b99f3cc0ec71 req-c8e1bd9a-abcb-4a50-9be5-3076f720b114 service nova] [instance: 74ac9703-1cd7-4983-b7d4-c69b01fec7b2] No waiting events found dispatching network-vif-plugged-c63b6577-fb46-437a-95b3-8321fab45d0c {{(pid=74613) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 18:00:38 user nova-compute[74613]: WARNING nova.compute.manager [req-8a3f7ad5-25f4-4f9d-b6bd-b99f3cc0ec71 req-c8e1bd9a-abcb-4a50-9be5-3076f720b114 service nova] [instance: 74ac9703-1cd7-4983-b7d4-c69b01fec7b2] Received unexpected event network-vif-plugged-c63b6577-fb46-437a-95b3-8321fab45d0c for instance with vm_state resized and task_state resize_reverting.
Nov 29 18:00:39 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:00:39 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:00:39 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:00:40 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:00:40 user nova-compute[74613]: DEBUG nova.compute.manager [req-9736da02-748b-4092-b601-7f0555588020 req-06c43976-7d8c-4a1d-b460-957d25987919 service nova] [instance: f9be53df-54e6-4f59-9cef-0ba7434f0c29] Received event network-changed-175b56ab-750b-4dbf-a981-2a32d749d445 {{(pid=74613) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 18:00:40 user nova-compute[74613]: DEBUG nova.compute.manager [req-9736da02-748b-4092-b601-7f0555588020 req-06c43976-7d8c-4a1d-b460-957d25987919 service nova] [instance: f9be53df-54e6-4f59-9cef-0ba7434f0c29] Refreshing instance network info cache due to event network-changed-175b56ab-750b-4dbf-a981-2a32d749d445. {{(pid=74613) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 18:00:40 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-9736da02-748b-4092-b601-7f0555588020 req-06c43976-7d8c-4a1d-b460-957d25987919 service nova] Acquiring lock "refresh_cache-f9be53df-54e6-4f59-9cef-0ba7434f0c29" {{(pid=74613) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 18:00:40 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-9736da02-748b-4092-b601-7f0555588020 req-06c43976-7d8c-4a1d-b460-957d25987919 service nova] Acquired lock "refresh_cache-f9be53df-54e6-4f59-9cef-0ba7434f0c29" {{(pid=74613) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 18:00:40 user nova-compute[74613]: DEBUG nova.network.neutron [req-9736da02-748b-4092-b601-7f0555588020 req-06c43976-7d8c-4a1d-b460-957d25987919 service nova] [instance: f9be53df-54e6-4f59-9cef-0ba7434f0c29] Refreshing network info cache for port 175b56ab-750b-4dbf-a981-2a32d749d445 {{(pid=74613) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 18:00:40 user nova-compute[74613]: DEBUG nova.compute.manager [None req-7f41620a-b66e-40f2-b568-e11ab877cb6d tempest-ServerActionsTestOtherB-894551005 tempest-ServerActionsTestOtherB-894551005-project-member] [instance: 74ac9703-1cd7-4983-b7d4-c69b01fec7b2] Instance event wait completed in 0 seconds for  {{(pid=74613) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 29 18:00:40 user nova-compute[74613]: INFO nova.virt.libvirt.driver [-] [instance: 74ac9703-1cd7-4983-b7d4-c69b01fec7b2] Instance running successfully.
Nov 29 18:00:40 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-7f41620a-b66e-40f2-b568-e11ab877cb6d tempest-ServerActionsTestOtherB-894551005 tempest-ServerActionsTestOtherB-894551005-project-member] [instance: 74ac9703-1cd7-4983-b7d4-c69b01fec7b2] finish_revert_migration finished successfully. {{(pid=74613) finish_revert_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11860}}
Nov 29 18:00:41 user nova-compute[74613]: DEBUG nova.compute.manager [req-60666254-7ea9-42a6-a6a8-e0a82c6793d4 req-064c0c8c-3a95-484c-95aa-9189d67e9dcd service nova] [instance: 74ac9703-1cd7-4983-b7d4-c69b01fec7b2] Received event network-vif-plugged-c63b6577-fb46-437a-95b3-8321fab45d0c {{(pid=74613) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 18:00:41 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-60666254-7ea9-42a6-a6a8-e0a82c6793d4 req-064c0c8c-3a95-484c-95aa-9189d67e9dcd service nova] Acquiring lock "74ac9703-1cd7-4983-b7d4-c69b01fec7b2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 18:00:41 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-60666254-7ea9-42a6-a6a8-e0a82c6793d4 req-064c0c8c-3a95-484c-95aa-9189d67e9dcd service nova] Lock "74ac9703-1cd7-4983-b7d4-c69b01fec7b2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 18:00:41 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-60666254-7ea9-42a6-a6a8-e0a82c6793d4 req-064c0c8c-3a95-484c-95aa-9189d67e9dcd service nova] Lock "74ac9703-1cd7-4983-b7d4-c69b01fec7b2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 18:00:41 user nova-compute[74613]: DEBUG nova.compute.manager [req-60666254-7ea9-42a6-a6a8-e0a82c6793d4 req-064c0c8c-3a95-484c-95aa-9189d67e9dcd service nova] [instance: 74ac9703-1cd7-4983-b7d4-c69b01fec7b2] No waiting events found dispatching network-vif-plugged-c63b6577-fb46-437a-95b3-8321fab45d0c {{(pid=74613) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 18:00:41 user nova-compute[74613]: WARNING nova.compute.manager [req-60666254-7ea9-42a6-a6a8-e0a82c6793d4 req-064c0c8c-3a95-484c-95aa-9189d67e9dcd service nova] [instance: 74ac9703-1cd7-4983-b7d4-c69b01fec7b2] Received unexpected event network-vif-plugged-c63b6577-fb46-437a-95b3-8321fab45d0c for instance with vm_state resized and task_state resize_reverting.
Nov 29 18:00:41 user nova-compute[74613]: INFO nova.compute.manager [None req-7f41620a-b66e-40f2-b568-e11ab877cb6d tempest-ServerActionsTestOtherB-894551005 tempest-ServerActionsTestOtherB-894551005-project-member] [instance: 74ac9703-1cd7-4983-b7d4-c69b01fec7b2] Updating instance to original state: 'active'
Nov 29 18:00:41 user nova-compute[74613]: DEBUG nova.network.neutron [req-9736da02-748b-4092-b601-7f0555588020 req-06c43976-7d8c-4a1d-b460-957d25987919 service nova] [instance: f9be53df-54e6-4f59-9cef-0ba7434f0c29] Updated VIF entry in instance network info cache for port 175b56ab-750b-4dbf-a981-2a32d749d445. {{(pid=74613) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 18:00:41 user nova-compute[74613]: DEBUG nova.network.neutron [req-9736da02-748b-4092-b601-7f0555588020 req-06c43976-7d8c-4a1d-b460-957d25987919 service nova] [instance: f9be53df-54e6-4f59-9cef-0ba7434f0c29] Updating instance_info_cache with network_info: [{"id": "175b56ab-750b-4dbf-a981-2a32d749d445", "address": "fa:16:3e:e8:f3:9e", "network": {"id": "4a101f3e-d23e-4198-bc3c-b4f9b4d2b4c4", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-864151424-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.246", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1c0c1c71400549369c1b11ca7d5f43ec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap175b56ab-75", "ovs_interfaceid": "175b56ab-750b-4dbf-a981-2a32d749d445", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74613) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 18:00:41 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-9736da02-748b-4092-b601-7f0555588020 req-06c43976-7d8c-4a1d-b460-957d25987919 service nova] Releasing lock "refresh_cache-f9be53df-54e6-4f59-9cef-0ba7434f0c29" {{(pid=74613) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 18:00:42 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:00:44 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-11700925-dccf-43ef-9e6b-4f450fc35712 tempest-AttachVolumeShelveTestJSON-1452861425 tempest-AttachVolumeShelveTestJSON-1452861425-project-member] Acquiring lock "f9be53df-54e6-4f59-9cef-0ba7434f0c29" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 18:00:44 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-11700925-dccf-43ef-9e6b-4f450fc35712 tempest-AttachVolumeShelveTestJSON-1452861425 tempest-AttachVolumeShelveTestJSON-1452861425-project-member] Lock "f9be53df-54e6-4f59-9cef-0ba7434f0c29" acquired by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: waited 0.001s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 18:00:44 user nova-compute[74613]: INFO nova.compute.manager [None req-11700925-dccf-43ef-9e6b-4f450fc35712 tempest-AttachVolumeShelveTestJSON-1452861425 tempest-AttachVolumeShelveTestJSON-1452861425-project-member] [instance: f9be53df-54e6-4f59-9cef-0ba7434f0c29] Shelving
Nov 29 18:00:44 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:00:44 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:00:44 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:00:44 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:00:44 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:00:44 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-d3c2c843-c34e-46c2-bcb2-5d67c3331a1b tempest-VolumesSnapshotTestJSON-1388493826 tempest-VolumesSnapshotTestJSON-1388493826-project-member] Acquiring lock "6c2ea311-0404-4ecf-8086-65f65186f858" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 18:00:44 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-d3c2c843-c34e-46c2-bcb2-5d67c3331a1b tempest-VolumesSnapshotTestJSON-1388493826 tempest-VolumesSnapshotTestJSON-1388493826-project-member] Lock "6c2ea311-0404-4ecf-8086-65f65186f858" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 18:00:44 user nova-compute[74613]: DEBUG nova.compute.manager [None req-d3c2c843-c34e-46c2-bcb2-5d67c3331a1b tempest-VolumesSnapshotTestJSON-1388493826 tempest-VolumesSnapshotTestJSON-1388493826-project-member] [instance: 6c2ea311-0404-4ecf-8086-65f65186f858] Starting instance... {{(pid=74613) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 29 18:00:44 user nova-compute[74613]: DEBUG nova.compute.manager [req-5a3632e3-5b46-495c-8c5b-6b3a23c79dee req-bed2d555-10ef-431d-8f2b-f9f3d41d9e38 service nova] [instance: f9be53df-54e6-4f59-9cef-0ba7434f0c29] Received event network-vif-unplugged-175b56ab-750b-4dbf-a981-2a32d749d445 {{(pid=74613) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 18:00:44 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-5a3632e3-5b46-495c-8c5b-6b3a23c79dee req-bed2d555-10ef-431d-8f2b-f9f3d41d9e38 service nova] Acquiring lock "f9be53df-54e6-4f59-9cef-0ba7434f0c29-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 18:00:44 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-5a3632e3-5b46-495c-8c5b-6b3a23c79dee req-bed2d555-10ef-431d-8f2b-f9f3d41d9e38 service nova] Lock "f9be53df-54e6-4f59-9cef-0ba7434f0c29-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 18:00:44 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-5a3632e3-5b46-495c-8c5b-6b3a23c79dee req-bed2d555-10ef-431d-8f2b-f9f3d41d9e38 service nova] Lock "f9be53df-54e6-4f59-9cef-0ba7434f0c29-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 18:00:44 user nova-compute[74613]: DEBUG nova.compute.manager [req-5a3632e3-5b46-495c-8c5b-6b3a23c79dee req-bed2d555-10ef-431d-8f2b-f9f3d41d9e38 service nova] [instance: f9be53df-54e6-4f59-9cef-0ba7434f0c29] No waiting events found dispatching network-vif-unplugged-175b56ab-750b-4dbf-a981-2a32d749d445 {{(pid=74613) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 18:00:44 user nova-compute[74613]: WARNING nova.compute.manager [req-5a3632e3-5b46-495c-8c5b-6b3a23c79dee req-bed2d555-10ef-431d-8f2b-f9f3d41d9e38 service nova] [instance: f9be53df-54e6-4f59-9cef-0ba7434f0c29] Received unexpected event network-vif-unplugged-175b56ab-750b-4dbf-a981-2a32d749d445 for instance with vm_state active and task_state shelving.
Nov 29 18:00:44 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-d3c2c843-c34e-46c2-bcb2-5d67c3331a1b tempest-VolumesSnapshotTestJSON-1388493826 tempest-VolumesSnapshotTestJSON-1388493826-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 18:00:44 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-d3c2c843-c34e-46c2-bcb2-5d67c3331a1b tempest-VolumesSnapshotTestJSON-1388493826 tempest-VolumesSnapshotTestJSON-1388493826-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 18:00:44 user nova-compute[74613]: DEBUG nova.virt.hardware [None req-d3c2c843-c34e-46c2-bcb2-5d67c3331a1b tempest-VolumesSnapshotTestJSON-1388493826 tempest-VolumesSnapshotTestJSON-1388493826-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74613) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 29 18:00:44 user nova-compute[74613]: INFO nova.compute.claims [None req-d3c2c843-c34e-46c2-bcb2-5d67c3331a1b tempest-VolumesSnapshotTestJSON-1388493826 tempest-VolumesSnapshotTestJSON-1388493826-project-member] [instance: 6c2ea311-0404-4ecf-8086-65f65186f858] Claim successful on node user
Nov 29 18:00:45 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:00:45 user nova-compute[74613]: INFO nova.virt.libvirt.driver [-] [instance: f9be53df-54e6-4f59-9cef-0ba7434f0c29] Instance destroyed successfully.
Nov 29 18:00:45 user nova-compute[74613]: INFO nova.virt.libvirt.driver [None req-11700925-dccf-43ef-9e6b-4f450fc35712 tempest-AttachVolumeShelveTestJSON-1452861425 tempest-AttachVolumeShelveTestJSON-1452861425-project-member] [instance: f9be53df-54e6-4f59-9cef-0ba7434f0c29] Beginning cold snapshot process
Nov 29 18:00:45 user nova-compute[74613]: DEBUG nova.compute.provider_tree [None req-d3c2c843-c34e-46c2-bcb2-5d67c3331a1b tempest-VolumesSnapshotTestJSON-1388493826 tempest-VolumesSnapshotTestJSON-1388493826-project-member] Inventory has not changed in ProviderTree for provider: 639d980e-3b12-44b1-b8f4-1812416fa4dd {{(pid=74613) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 18:00:45 user nova-compute[74613]: DEBUG nova.scheduler.client.report [None req-d3c2c843-c34e-46c2-bcb2-5d67c3331a1b tempest-VolumesSnapshotTestJSON-1388493826 tempest-VolumesSnapshotTestJSON-1388493826-project-member] Inventory has not changed for provider 639d980e-3b12-44b1-b8f4-1812416fa4dd based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74613) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 18:00:45 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-d3c2c843-c34e-46c2-bcb2-5d67c3331a1b tempest-VolumesSnapshotTestJSON-1388493826 tempest-VolumesSnapshotTestJSON-1388493826-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.558s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 18:00:45 user nova-compute[74613]: DEBUG nova.compute.manager [None req-d3c2c843-c34e-46c2-bcb2-5d67c3331a1b tempest-VolumesSnapshotTestJSON-1388493826 tempest-VolumesSnapshotTestJSON-1388493826-project-member] [instance: 6c2ea311-0404-4ecf-8086-65f65186f858] Start building networks asynchronously for instance. {{(pid=74613) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 29 18:00:45 user nova-compute[74613]: DEBUG nova.compute.manager [None req-d3c2c843-c34e-46c2-bcb2-5d67c3331a1b tempest-VolumesSnapshotTestJSON-1388493826 tempest-VolumesSnapshotTestJSON-1388493826-project-member] [instance: 6c2ea311-0404-4ecf-8086-65f65186f858] Allocating IP information in the background. {{(pid=74613) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 29 18:00:45 user nova-compute[74613]: DEBUG nova.network.neutron [None req-d3c2c843-c34e-46c2-bcb2-5d67c3331a1b tempest-VolumesSnapshotTestJSON-1388493826 tempest-VolumesSnapshotTestJSON-1388493826-project-member] [instance: 6c2ea311-0404-4ecf-8086-65f65186f858] allocate_for_instance() {{(pid=74613) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 29 18:00:45 user nova-compute[74613]: INFO nova.virt.libvirt.driver [None req-d3c2c843-c34e-46c2-bcb2-5d67c3331a1b tempest-VolumesSnapshotTestJSON-1388493826 tempest-VolumesSnapshotTestJSON-1388493826-project-member] [instance: 6c2ea311-0404-4ecf-8086-65f65186f858] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 29 18:00:45 user nova-compute[74613]: DEBUG nova.compute.manager [None req-d3c2c843-c34e-46c2-bcb2-5d67c3331a1b tempest-VolumesSnapshotTestJSON-1388493826 tempest-VolumesSnapshotTestJSON-1388493826-project-member] [instance: 6c2ea311-0404-4ecf-8086-65f65186f858] Start building block device mappings for instance. {{(pid=74613) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 29 18:00:45 user nova-compute[74613]: DEBUG nova.privsep.utils [None req-11700925-dccf-43ef-9e6b-4f450fc35712 tempest-AttachVolumeShelveTestJSON-1452861425 tempest-AttachVolumeShelveTestJSON-1452861425-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74613) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 29 18:00:45 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-11700925-dccf-43ef-9e6b-4f450fc35712 tempest-AttachVolumeShelveTestJSON-1452861425 tempest-AttachVolumeShelveTestJSON-1452861425-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/f9be53df-54e6-4f59-9cef-0ba7434f0c29/disk /opt/stack/data/nova/instances/snapshots/tmpxjc3o0mz/fae158a1300d4081aea8df0140e34356 {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:00:45 user nova-compute[74613]: DEBUG nova.policy [None req-d3c2c843-c34e-46c2-bcb2-5d67c3331a1b tempest-VolumesSnapshotTestJSON-1388493826 tempest-VolumesSnapshotTestJSON-1388493826-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '5fd84795e6684327998b0f52f5941f86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9ec113a97bd40c4b68d3738c64ece01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74613) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 29 18:00:45 user nova-compute[74613]: DEBUG nova.compute.manager [None req-d3c2c843-c34e-46c2-bcb2-5d67c3331a1b tempest-VolumesSnapshotTestJSON-1388493826 tempest-VolumesSnapshotTestJSON-1388493826-project-member] [instance: 6c2ea311-0404-4ecf-8086-65f65186f858] Start spawning the instance on the hypervisor. {{(pid=74613) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 29 18:00:45 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-d3c2c843-c34e-46c2-bcb2-5d67c3331a1b tempest-VolumesSnapshotTestJSON-1388493826 tempest-VolumesSnapshotTestJSON-1388493826-project-member] [instance: 6c2ea311-0404-4ecf-8086-65f65186f858] Creating instance directory {{(pid=74613) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 29 18:00:45 user nova-compute[74613]: INFO nova.virt.libvirt.driver [None req-d3c2c843-c34e-46c2-bcb2-5d67c3331a1b tempest-VolumesSnapshotTestJSON-1388493826 tempest-VolumesSnapshotTestJSON-1388493826-project-member] [instance: 6c2ea311-0404-4ecf-8086-65f65186f858] Creating image(s)
Nov 29 18:00:45 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-d3c2c843-c34e-46c2-bcb2-5d67c3331a1b tempest-VolumesSnapshotTestJSON-1388493826 tempest-VolumesSnapshotTestJSON-1388493826-project-member] Acquiring lock "/opt/stack/data/nova/instances/6c2ea311-0404-4ecf-8086-65f65186f858/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 18:00:45 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-d3c2c843-c34e-46c2-bcb2-5d67c3331a1b tempest-VolumesSnapshotTestJSON-1388493826 tempest-VolumesSnapshotTestJSON-1388493826-project-member] Lock "/opt/stack/data/nova/instances/6c2ea311-0404-4ecf-8086-65f65186f858/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 18:00:45 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-d3c2c843-c34e-46c2-bcb2-5d67c3331a1b tempest-VolumesSnapshotTestJSON-1388493826 tempest-VolumesSnapshotTestJSON-1388493826-project-member] Lock "/opt/stack/data/nova/instances/6c2ea311-0404-4ecf-8086-65f65186f858/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.007s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 18:00:45 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-d3c2c843-c34e-46c2-bcb2-5d67c3331a1b tempest-VolumesSnapshotTestJSON-1388493826 tempest-VolumesSnapshotTestJSON-1388493826-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/21faea9e6951f3bdd0153b76ac89fe1a60a34758 --force-share --output=json {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:00:46 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-d3c2c843-c34e-46c2-bcb2-5d67c3331a1b tempest-VolumesSnapshotTestJSON-1388493826 tempest-VolumesSnapshotTestJSON-1388493826-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/21faea9e6951f3bdd0153b76ac89fe1a60a34758 --force-share --output=json" returned: 0 in 0.188s {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:00:46 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-d3c2c843-c34e-46c2-bcb2-5d67c3331a1b tempest-VolumesSnapshotTestJSON-1388493826 tempest-VolumesSnapshotTestJSON-1388493826-project-member] Acquiring lock "21faea9e6951f3bdd0153b76ac89fe1a60a34758" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 18:00:46 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-d3c2c843-c34e-46c2-bcb2-5d67c3331a1b tempest-VolumesSnapshotTestJSON-1388493826 tempest-VolumesSnapshotTestJSON-1388493826-project-member] Lock "21faea9e6951f3bdd0153b76ac89fe1a60a34758" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 18:00:46 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-d3c2c843-c34e-46c2-bcb2-5d67c3331a1b tempest-VolumesSnapshotTestJSON-1388493826 tempest-VolumesSnapshotTestJSON-1388493826-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/21faea9e6951f3bdd0153b76ac89fe1a60a34758 --force-share --output=json {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:00:46 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-d3c2c843-c34e-46c2-bcb2-5d67c3331a1b tempest-VolumesSnapshotTestJSON-1388493826 tempest-VolumesSnapshotTestJSON-1388493826-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/21faea9e6951f3bdd0153b76ac89fe1a60a34758 --force-share --output=json" returned: 0 in 0.226s {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:00:46 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-d3c2c843-c34e-46c2-bcb2-5d67c3331a1b tempest-VolumesSnapshotTestJSON-1388493826 tempest-VolumesSnapshotTestJSON-1388493826-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/21faea9e6951f3bdd0153b76ac89fe1a60a34758,backing_fmt=raw /opt/stack/data/nova/instances/6c2ea311-0404-4ecf-8086-65f65186f858/disk 1073741824 {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:00:46 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-d3c2c843-c34e-46c2-bcb2-5d67c3331a1b tempest-VolumesSnapshotTestJSON-1388493826 tempest-VolumesSnapshotTestJSON-1388493826-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/21faea9e6951f3bdd0153b76ac89fe1a60a34758,backing_fmt=raw /opt/stack/data/nova/instances/6c2ea311-0404-4ecf-8086-65f65186f858/disk 1073741824" returned: 0 in 0.059s {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:00:46 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-d3c2c843-c34e-46c2-bcb2-5d67c3331a1b tempest-VolumesSnapshotTestJSON-1388493826 tempest-VolumesSnapshotTestJSON-1388493826-project-member] Lock "21faea9e6951f3bdd0153b76ac89fe1a60a34758" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.295s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 18:00:46 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-d3c2c843-c34e-46c2-bcb2-5d67c3331a1b tempest-VolumesSnapshotTestJSON-1388493826 tempest-VolumesSnapshotTestJSON-1388493826-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/21faea9e6951f3bdd0153b76ac89fe1a60a34758 --force-share --output=json {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:00:46 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-11700925-dccf-43ef-9e6b-4f450fc35712 tempest-AttachVolumeShelveTestJSON-1452861425 tempest-AttachVolumeShelveTestJSON-1452861425-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/f9be53df-54e6-4f59-9cef-0ba7434f0c29/disk /opt/stack/data/nova/instances/snapshots/tmpxjc3o0mz/fae158a1300d4081aea8df0140e34356" returned: 0 in 0.824s {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:00:46 user nova-compute[74613]: INFO nova.virt.libvirt.driver [None req-11700925-dccf-43ef-9e6b-4f450fc35712 tempest-AttachVolumeShelveTestJSON-1452861425 tempest-AttachVolumeShelveTestJSON-1452861425-project-member] [instance: f9be53df-54e6-4f59-9cef-0ba7434f0c29] Snapshot extracted, beginning image upload
Nov 29 18:00:46 user nova-compute[74613]: DEBUG nova.network.neutron [None req-d3c2c843-c34e-46c2-bcb2-5d67c3331a1b tempest-VolumesSnapshotTestJSON-1388493826 tempest-VolumesSnapshotTestJSON-1388493826-project-member] [instance: 6c2ea311-0404-4ecf-8086-65f65186f858] Successfully created port: ec533dd5-c792-49a7-b497-7995a406838a {{(pid=74613) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 29 18:00:46 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-d3c2c843-c34e-46c2-bcb2-5d67c3331a1b tempest-VolumesSnapshotTestJSON-1388493826 tempest-VolumesSnapshotTestJSON-1388493826-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/21faea9e6951f3bdd0153b76ac89fe1a60a34758 --force-share --output=json" returned: 0 in 0.206s {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:00:46 user nova-compute[74613]: DEBUG nova.virt.disk.api [None req-d3c2c843-c34e-46c2-bcb2-5d67c3331a1b tempest-VolumesSnapshotTestJSON-1388493826 tempest-VolumesSnapshotTestJSON-1388493826-project-member] Checking if we can resize image /opt/stack/data/nova/instances/6c2ea311-0404-4ecf-8086-65f65186f858/disk. size=1073741824 {{(pid=74613) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 29 18:00:46 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-d3c2c843-c34e-46c2-bcb2-5d67c3331a1b tempest-VolumesSnapshotTestJSON-1388493826 tempest-VolumesSnapshotTestJSON-1388493826-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6c2ea311-0404-4ecf-8086-65f65186f858/disk --force-share --output=json {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:00:46 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-d3c2c843-c34e-46c2-bcb2-5d67c3331a1b tempest-VolumesSnapshotTestJSON-1388493826 tempest-VolumesSnapshotTestJSON-1388493826-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6c2ea311-0404-4ecf-8086-65f65186f858/disk --force-share --output=json" returned: 0 in 0.224s {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:00:46 user nova-compute[74613]: DEBUG nova.virt.disk.api [None req-d3c2c843-c34e-46c2-bcb2-5d67c3331a1b tempest-VolumesSnapshotTestJSON-1388493826 tempest-VolumesSnapshotTestJSON-1388493826-project-member] Cannot resize image /opt/stack/data/nova/instances/6c2ea311-0404-4ecf-8086-65f65186f858/disk to a smaller size. {{(pid=74613) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 29 18:00:46 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-d3c2c843-c34e-46c2-bcb2-5d67c3331a1b tempest-VolumesSnapshotTestJSON-1388493826 tempest-VolumesSnapshotTestJSON-1388493826-project-member] [instance: 6c2ea311-0404-4ecf-8086-65f65186f858] Created local disks {{(pid=74613) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 29 18:00:46 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-d3c2c843-c34e-46c2-bcb2-5d67c3331a1b tempest-VolumesSnapshotTestJSON-1388493826 tempest-VolumesSnapshotTestJSON-1388493826-project-member] [instance: 6c2ea311-0404-4ecf-8086-65f65186f858] Ensure instance console log exists: /opt/stack/data/nova/instances/6c2ea311-0404-4ecf-8086-65f65186f858/console.log {{(pid=74613) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 29 18:00:46 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-d3c2c843-c34e-46c2-bcb2-5d67c3331a1b tempest-VolumesSnapshotTestJSON-1388493826 tempest-VolumesSnapshotTestJSON-1388493826-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 18:00:46 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-d3c2c843-c34e-46c2-bcb2-5d67c3331a1b tempest-VolumesSnapshotTestJSON-1388493826 tempest-VolumesSnapshotTestJSON-1388493826-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 18:00:46 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-d3c2c843-c34e-46c2-bcb2-5d67c3331a1b tempest-VolumesSnapshotTestJSON-1388493826 tempest-VolumesSnapshotTestJSON-1388493826-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 18:00:46 user nova-compute[74613]: DEBUG nova.compute.manager [req-de137f78-02be-49cd-80f8-2df2cfa94d13 req-54868c68-a949-4c2a-b993-7884de46d399 service nova] [instance: f9be53df-54e6-4f59-9cef-0ba7434f0c29] Received event network-vif-plugged-175b56ab-750b-4dbf-a981-2a32d749d445 {{(pid=74613) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 18:00:46 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-de137f78-02be-49cd-80f8-2df2cfa94d13 req-54868c68-a949-4c2a-b993-7884de46d399 service nova] Acquiring lock "f9be53df-54e6-4f59-9cef-0ba7434f0c29-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 18:00:46 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-de137f78-02be-49cd-80f8-2df2cfa94d13 req-54868c68-a949-4c2a-b993-7884de46d399 service nova] Lock "f9be53df-54e6-4f59-9cef-0ba7434f0c29-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 18:00:46 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-de137f78-02be-49cd-80f8-2df2cfa94d13 req-54868c68-a949-4c2a-b993-7884de46d399 service nova] Lock "f9be53df-54e6-4f59-9cef-0ba7434f0c29-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 18:00:46 user nova-compute[74613]: DEBUG nova.compute.manager [req-de137f78-02be-49cd-80f8-2df2cfa94d13 req-54868c68-a949-4c2a-b993-7884de46d399 service nova] [instance: f9be53df-54e6-4f59-9cef-0ba7434f0c29] No waiting events found dispatching network-vif-plugged-175b56ab-750b-4dbf-a981-2a32d749d445 {{(pid=74613) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 18:00:46 user nova-compute[74613]: WARNING nova.compute.manager [req-de137f78-02be-49cd-80f8-2df2cfa94d13 req-54868c68-a949-4c2a-b993-7884de46d399 service nova] [instance: f9be53df-54e6-4f59-9cef-0ba7434f0c29] Received unexpected event network-vif-plugged-175b56ab-750b-4dbf-a981-2a32d749d445 for instance with vm_state active and task_state shelving_image_uploading.
Nov 29 18:00:47 user nova-compute[74613]: DEBUG nova.network.neutron [None req-d3c2c843-c34e-46c2-bcb2-5d67c3331a1b tempest-VolumesSnapshotTestJSON-1388493826 tempest-VolumesSnapshotTestJSON-1388493826-project-member] [instance: 6c2ea311-0404-4ecf-8086-65f65186f858] Successfully updated port: ec533dd5-c792-49a7-b497-7995a406838a {{(pid=74613) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 29 18:00:47 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-d3c2c843-c34e-46c2-bcb2-5d67c3331a1b tempest-VolumesSnapshotTestJSON-1388493826 tempest-VolumesSnapshotTestJSON-1388493826-project-member] Acquiring lock "refresh_cache-6c2ea311-0404-4ecf-8086-65f65186f858" {{(pid=74613) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 18:00:47 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-d3c2c843-c34e-46c2-bcb2-5d67c3331a1b tempest-VolumesSnapshotTestJSON-1388493826 tempest-VolumesSnapshotTestJSON-1388493826-project-member] Acquired lock "refresh_cache-6c2ea311-0404-4ecf-8086-65f65186f858" {{(pid=74613) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 18:00:47 user nova-compute[74613]: DEBUG nova.network.neutron [None req-d3c2c843-c34e-46c2-bcb2-5d67c3331a1b tempest-VolumesSnapshotTestJSON-1388493826 tempest-VolumesSnapshotTestJSON-1388493826-project-member] [instance: 6c2ea311-0404-4ecf-8086-65f65186f858] Building network info cache for instance {{(pid=74613) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 29 18:00:47 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:00:47 user nova-compute[74613]: DEBUG nova.network.neutron [None req-d3c2c843-c34e-46c2-bcb2-5d67c3331a1b tempest-VolumesSnapshotTestJSON-1388493826 tempest-VolumesSnapshotTestJSON-1388493826-project-member] [instance: 6c2ea311-0404-4ecf-8086-65f65186f858] Instance cache missing network info. {{(pid=74613) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 29 18:00:47 user nova-compute[74613]: DEBUG nova.network.neutron [None req-d3c2c843-c34e-46c2-bcb2-5d67c3331a1b tempest-VolumesSnapshotTestJSON-1388493826 tempest-VolumesSnapshotTestJSON-1388493826-project-member] [instance: 6c2ea311-0404-4ecf-8086-65f65186f858] Updating instance_info_cache with network_info: [{"id": "ec533dd5-c792-49a7-b497-7995a406838a", "address": "fa:16:3e:75:15:43", "network": {"id": "4cc7e4ab-28a3-431a-9855-22009278b949", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1066409623-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a9ec113a97bd40c4b68d3738c64ece01", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapec533dd5-c7", "ovs_interfaceid": "ec533dd5-c792-49a7-b497-7995a406838a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74613) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 18:00:47 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-d3c2c843-c34e-46c2-bcb2-5d67c3331a1b tempest-VolumesSnapshotTestJSON-1388493826 tempest-VolumesSnapshotTestJSON-1388493826-project-member] Releasing lock "refresh_cache-6c2ea311-0404-4ecf-8086-65f65186f858" {{(pid=74613) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 18:00:47 user nova-compute[74613]: DEBUG nova.compute.manager [None req-d3c2c843-c34e-46c2-bcb2-5d67c3331a1b tempest-VolumesSnapshotTestJSON-1388493826 tempest-VolumesSnapshotTestJSON-1388493826-project-member] [instance: 6c2ea311-0404-4ecf-8086-65f65186f858] Instance network_info: |[{"id": "ec533dd5-c792-49a7-b497-7995a406838a", "address": "fa:16:3e:75:15:43", "network": {"id": "4cc7e4ab-28a3-431a-9855-22009278b949", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1066409623-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a9ec113a97bd40c4b68d3738c64ece01", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapec533dd5-c7", "ovs_interfaceid": "ec533dd5-c792-49a7-b497-7995a406838a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74613) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 29 18:00:47 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-d3c2c843-c34e-46c2-bcb2-5d67c3331a1b tempest-VolumesSnapshotTestJSON-1388493826 tempest-VolumesSnapshotTestJSON-1388493826-project-member] [instance: 6c2ea311-0404-4ecf-8086-65f65186f858] Start _get_guest_xml network_info=[{"id": "ec533dd5-c792-49a7-b497-7995a406838a", "address": "fa:16:3e:75:15:43", "network": {"id": "4cc7e4ab-28a3-431a-9855-22009278b949", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1066409623-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a9ec113a97bd40c4b68d3738c64ece01", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapec533dd5-c7", "ovs_interfaceid": "ec533dd5-c792-49a7-b497-7995a406838a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-29T17:47:38Z,direct_url=<?>,disk_format='qcow2',id=4217f428-8d9d-4ee1-9614-642d26d90c46,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='794b07cbd46a44b5865cfda741036bae',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-29T17:47:40Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'size': 0, 'device_type': 'disk', 'boot_index': 0, 'guest_format': None, 'encrypted': False, 'encryption_format': None, 'disk_bus': 'virtio', 'image_id': '4217f428-8d9d-4ee1-9614-642d26d90c46'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74613) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 29 18:00:47 user nova-compute[74613]: WARNING nova.virt.libvirt.driver [None req-d3c2c843-c34e-46c2-bcb2-5d67c3331a1b tempest-VolumesSnapshotTestJSON-1388493826 tempest-VolumesSnapshotTestJSON-1388493826-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 18:00:47 user nova-compute[74613]: WARNING nova.virt.libvirt.driver [None req-d3c2c843-c34e-46c2-bcb2-5d67c3331a1b tempest-VolumesSnapshotTestJSON-1388493826 tempest-VolumesSnapshotTestJSON-1388493826-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 18:00:47 user nova-compute[74613]: DEBUG nova.virt.libvirt.host [None req-d3c2c843-c34e-46c2-bcb2-5d67c3331a1b tempest-VolumesSnapshotTestJSON-1388493826 tempest-VolumesSnapshotTestJSON-1388493826-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74613) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 29 18:00:47 user nova-compute[74613]: DEBUG nova.virt.libvirt.host [None req-d3c2c843-c34e-46c2-bcb2-5d67c3331a1b tempest-VolumesSnapshotTestJSON-1388493826 tempest-VolumesSnapshotTestJSON-1388493826-project-member] CPU controller missing on host. {{(pid=74613) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 29 18:00:47 user nova-compute[74613]: DEBUG nova.virt.libvirt.host [None req-d3c2c843-c34e-46c2-bcb2-5d67c3331a1b tempest-VolumesSnapshotTestJSON-1388493826 tempest-VolumesSnapshotTestJSON-1388493826-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74613) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 29 18:00:47 user nova-compute[74613]: DEBUG nova.virt.libvirt.host [None req-d3c2c843-c34e-46c2-bcb2-5d67c3331a1b tempest-VolumesSnapshotTestJSON-1388493826 tempest-VolumesSnapshotTestJSON-1388493826-project-member] CPU controller found on host. {{(pid=74613) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 29 18:00:47 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-d3c2c843-c34e-46c2-bcb2-5d67c3331a1b tempest-VolumesSnapshotTestJSON-1388493826 tempest-VolumesSnapshotTestJSON-1388493826-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74613) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 29 18:00:47 user nova-compute[74613]: DEBUG nova.virt.hardware [None req-d3c2c843-c34e-46c2-bcb2-5d67c3331a1b tempest-VolumesSnapshotTestJSON-1388493826 tempest-VolumesSnapshotTestJSON-1388493826-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-29T17:47:27Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-29T17:47:38Z,direct_url=<?>,disk_format='qcow2',id=4217f428-8d9d-4ee1-9614-642d26d90c46,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='794b07cbd46a44b5865cfda741036bae',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-29T17:47:40Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74613) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 29 18:00:47 user nova-compute[74613]: DEBUG nova.virt.hardware [None req-d3c2c843-c34e-46c2-bcb2-5d67c3331a1b tempest-VolumesSnapshotTestJSON-1388493826 tempest-VolumesSnapshotTestJSON-1388493826-project-member] Flavor limits 0:0:0 {{(pid=74613) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 29 18:00:47 user nova-compute[74613]: DEBUG nova.virt.hardware [None req-d3c2c843-c34e-46c2-bcb2-5d67c3331a1b tempest-VolumesSnapshotTestJSON-1388493826 tempest-VolumesSnapshotTestJSON-1388493826-project-member] Image limits 0:0:0 {{(pid=74613) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 29 18:00:47 user nova-compute[74613]: DEBUG nova.virt.hardware [None req-d3c2c843-c34e-46c2-bcb2-5d67c3331a1b tempest-VolumesSnapshotTestJSON-1388493826 tempest-VolumesSnapshotTestJSON-1388493826-project-member] Flavor pref 0:0:0 {{(pid=74613) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 29 18:00:47 user nova-compute[74613]: DEBUG nova.virt.hardware [None req-d3c2c843-c34e-46c2-bcb2-5d67c3331a1b tempest-VolumesSnapshotTestJSON-1388493826 tempest-VolumesSnapshotTestJSON-1388493826-project-member] Image pref 0:0:0 {{(pid=74613) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 29 18:00:47 user nova-compute[74613]: DEBUG nova.virt.hardware [None req-d3c2c843-c34e-46c2-bcb2-5d67c3331a1b tempest-VolumesSnapshotTestJSON-1388493826 tempest-VolumesSnapshotTestJSON-1388493826-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74613) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 29 18:00:47 user nova-compute[74613]: DEBUG nova.virt.hardware [None req-d3c2c843-c34e-46c2-bcb2-5d67c3331a1b tempest-VolumesSnapshotTestJSON-1388493826 tempest-VolumesSnapshotTestJSON-1388493826-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74613) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 29 18:00:47 user nova-compute[74613]: DEBUG nova.virt.hardware [None req-d3c2c843-c34e-46c2-bcb2-5d67c3331a1b tempest-VolumesSnapshotTestJSON-1388493826 tempest-VolumesSnapshotTestJSON-1388493826-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74613) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 29 18:00:47 user nova-compute[74613]: DEBUG nova.virt.hardware [None req-d3c2c843-c34e-46c2-bcb2-5d67c3331a1b tempest-VolumesSnapshotTestJSON-1388493826 tempest-VolumesSnapshotTestJSON-1388493826-project-member] Got 1 possible topologies {{(pid=74613) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 29 18:00:47 user nova-compute[74613]: DEBUG nova.virt.hardware [None req-d3c2c843-c34e-46c2-bcb2-5d67c3331a1b tempest-VolumesSnapshotTestJSON-1388493826 tempest-VolumesSnapshotTestJSON-1388493826-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74613) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 29 18:00:47 user nova-compute[74613]: DEBUG nova.virt.hardware [None req-d3c2c843-c34e-46c2-bcb2-5d67c3331a1b tempest-VolumesSnapshotTestJSON-1388493826 tempest-VolumesSnapshotTestJSON-1388493826-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74613) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 29 18:00:47 user nova-compute[74613]: DEBUG nova.virt.libvirt.vif [None req-d3c2c843-c34e-46c2-bcb2-5d67c3331a1b tempest-VolumesSnapshotTestJSON-1388493826 tempest-VolumesSnapshotTestJSON-1388493826-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T18:00:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-899305642',display_name='tempest-VolumesSnapshotTestJSON-instance-899305642',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-899305642',id=24,image_ref='4217f428-8d9d-4ee1-9614-642d26d90c46',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBDbbE1cSh9/Rdbf9KDUssVEy9Q77UHVGA7A+YcsHGCVQokCnji0wVZ1MYpWlht+gSpcxBcP6Y0NVLYU2Da5HN8MwYRxUzJj2K1qJ2Ct0MAsSb5eUDYPIk0tAlgw/00p4A==',key_name='tempest-keypair-1551195618',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a9ec113a97bd40c4b68d3738c64ece01',ramdisk_id='',reservation_id='r-8marhme9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='4217f428-8d9d-4ee1-9614-642d26d90c46',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-1388493826',owner_user_name='tempest-VolumesSnapshotTestJSON-1388493826-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T18:00:46Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5fd84795e6684327998b0f52f5941f86',uuid=6c2ea311-0404-4ecf-8086-65f65186f858,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ec533dd5-c792-49a7-b497-7995a406838a", "address": "fa:16:3e:75:15:43", "network": {"id": "4cc7e4ab-28a3-431a-9855-22009278b949", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1066409623-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a9ec113a97bd40c4b68d3738c64ece01", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapec533dd5-c7", "ovs_interfaceid": "ec533dd5-c792-49a7-b497-7995a406838a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74613) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 29 18:00:47 user nova-compute[74613]: DEBUG nova.network.os_vif_util [None req-d3c2c843-c34e-46c2-bcb2-5d67c3331a1b tempest-VolumesSnapshotTestJSON-1388493826 tempest-VolumesSnapshotTestJSON-1388493826-project-member] Converting VIF {"id": "ec533dd5-c792-49a7-b497-7995a406838a", "address": "fa:16:3e:75:15:43", "network": {"id": "4cc7e4ab-28a3-431a-9855-22009278b949", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1066409623-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a9ec113a97bd40c4b68d3738c64ece01", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapec533dd5-c7", "ovs_interfaceid": "ec533dd5-c792-49a7-b497-7995a406838a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74613) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 18:00:47 user nova-compute[74613]: DEBUG nova.network.os_vif_util [None req-d3c2c843-c34e-46c2-bcb2-5d67c3331a1b tempest-VolumesSnapshotTestJSON-1388493826 tempest-VolumesSnapshotTestJSON-1388493826-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:75:15:43,bridge_name='br-int',has_traffic_filtering=True,id=ec533dd5-c792-49a7-b497-7995a406838a,network=Network(4cc7e4ab-28a3-431a-9855-22009278b949),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapec533dd5-c7') {{(pid=74613) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 18:00:47 user nova-compute[74613]: DEBUG nova.objects.instance [None req-d3c2c843-c34e-46c2-bcb2-5d67c3331a1b tempest-VolumesSnapshotTestJSON-1388493826 tempest-VolumesSnapshotTestJSON-1388493826-project-member] Lazy-loading 'pci_devices' on Instance uuid 6c2ea311-0404-4ecf-8086-65f65186f858 {{(pid=74613) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 18:00:47 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-d3c2c843-c34e-46c2-bcb2-5d67c3331a1b tempest-VolumesSnapshotTestJSON-1388493826 tempest-VolumesSnapshotTestJSON-1388493826-project-member] [instance: 6c2ea311-0404-4ecf-8086-65f65186f858] End _get_guest_xml xml=<domain type="kvm">
Nov 29 18:00:47 user nova-compute[74613]:   <uuid>6c2ea311-0404-4ecf-8086-65f65186f858</uuid>
Nov 29 18:00:47 user nova-compute[74613]:   <name>instance-00000018</name>
Nov 29 18:00:47 user nova-compute[74613]:   <memory>524288</memory>
Nov 29 18:00:47 user nova-compute[74613]:   <vcpu>1</vcpu>
Nov 29 18:00:47 user nova-compute[74613]:   <metadata>
Nov 29 18:00:47 user nova-compute[74613]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 29 18:00:47 user nova-compute[74613]:       <nova:package version="0.0.0"/>
Nov 29 18:00:47 user nova-compute[74613]:       <nova:name>tempest-VolumesSnapshotTestJSON-instance-899305642</nova:name>
Nov 29 18:00:47 user nova-compute[74613]:       <nova:creationTime>2023-11-29 18:00:47</nova:creationTime>
Nov 29 18:00:47 user nova-compute[74613]:       <nova:flavor name="m1.tiny">
Nov 29 18:00:47 user nova-compute[74613]:         <nova:memory>512</nova:memory>
Nov 29 18:00:47 user nova-compute[74613]:         <nova:disk>1</nova:disk>
Nov 29 18:00:47 user nova-compute[74613]:         <nova:swap>0</nova:swap>
Nov 29 18:00:47 user nova-compute[74613]:         <nova:ephemeral>0</nova:ephemeral>
Nov 29 18:00:47 user nova-compute[74613]:         <nova:vcpus>1</nova:vcpus>
Nov 29 18:00:47 user nova-compute[74613]:       </nova:flavor>
Nov 29 18:00:47 user nova-compute[74613]:       <nova:owner>
Nov 29 18:00:47 user nova-compute[74613]:         <nova:user uuid="5fd84795e6684327998b0f52f5941f86">tempest-VolumesSnapshotTestJSON-1388493826-project-member</nova:user>
Nov 29 18:00:47 user nova-compute[74613]:         <nova:project uuid="a9ec113a97bd40c4b68d3738c64ece01">tempest-VolumesSnapshotTestJSON-1388493826</nova:project>
Nov 29 18:00:47 user nova-compute[74613]:       </nova:owner>
Nov 29 18:00:47 user nova-compute[74613]:       <nova:root type="image" uuid="4217f428-8d9d-4ee1-9614-642d26d90c46"/>
Nov 29 18:00:47 user nova-compute[74613]:       <nova:ports>
Nov 29 18:00:47 user nova-compute[74613]:         <nova:port uuid="ec533dd5-c792-49a7-b497-7995a406838a">
Nov 29 18:00:47 user nova-compute[74613]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Nov 29 18:00:47 user nova-compute[74613]:         </nova:port>
Nov 29 18:00:47 user nova-compute[74613]:       </nova:ports>
Nov 29 18:00:47 user nova-compute[74613]:     </nova:instance>
Nov 29 18:00:47 user nova-compute[74613]:   </metadata>
Nov 29 18:00:47 user nova-compute[74613]:   <sysinfo type="smbios">
Nov 29 18:00:47 user nova-compute[74613]:     <system>
Nov 29 18:00:47 user nova-compute[74613]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 29 18:00:47 user nova-compute[74613]:       <entry name="product">OpenStack Nova</entry>
Nov 29 18:00:47 user nova-compute[74613]:       <entry name="version">0.0.0</entry>
Nov 29 18:00:47 user nova-compute[74613]:       <entry name="serial">6c2ea311-0404-4ecf-8086-65f65186f858</entry>
Nov 29 18:00:47 user nova-compute[74613]:       <entry name="uuid">6c2ea311-0404-4ecf-8086-65f65186f858</entry>
Nov 29 18:00:47 user nova-compute[74613]:       <entry name="family">Virtual Machine</entry>
Nov 29 18:00:47 user nova-compute[74613]:     </system>
Nov 29 18:00:47 user nova-compute[74613]:   </sysinfo>
Nov 29 18:00:47 user nova-compute[74613]:   <os>
Nov 29 18:00:47 user nova-compute[74613]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 29 18:00:47 user nova-compute[74613]:     <boot dev="hd"/>
Nov 29 18:00:47 user nova-compute[74613]:     <smbios mode="sysinfo"/>
Nov 29 18:00:47 user nova-compute[74613]:   </os>
Nov 29 18:00:47 user nova-compute[74613]:   <features>
Nov 29 18:00:47 user nova-compute[74613]:     <acpi/>
Nov 29 18:00:47 user nova-compute[74613]:     <apic/>
Nov 29 18:00:47 user nova-compute[74613]:     <vmcoreinfo/>
Nov 29 18:00:47 user nova-compute[74613]:   </features>
Nov 29 18:00:47 user nova-compute[74613]:   <clock offset="utc">
Nov 29 18:00:47 user nova-compute[74613]:     <timer name="pit" tickpolicy="delay"/>
Nov 29 18:00:47 user nova-compute[74613]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 29 18:00:47 user nova-compute[74613]:     <timer name="hpet" present="no"/>
Nov 29 18:00:47 user nova-compute[74613]:   </clock>
Nov 29 18:00:47 user nova-compute[74613]:   <cpu mode="custom" match="exact">
Nov 29 18:00:47 user nova-compute[74613]:     <model>Nehalem</model>
Nov 29 18:00:47 user nova-compute[74613]:     <topology sockets="1" cores="1" threads="1"/>
Nov 29 18:00:47 user nova-compute[74613]:   </cpu>
Nov 29 18:00:47 user nova-compute[74613]:   <devices>
Nov 29 18:00:47 user nova-compute[74613]:     <disk type="file" device="disk">
Nov 29 18:00:47 user nova-compute[74613]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 29 18:00:47 user nova-compute[74613]:       <source file="/opt/stack/data/nova/instances/6c2ea311-0404-4ecf-8086-65f65186f858/disk"/>
Nov 29 18:00:47 user nova-compute[74613]:       <target dev="vda" bus="virtio"/>
Nov 29 18:00:47 user nova-compute[74613]:     </disk>
Nov 29 18:00:47 user nova-compute[74613]:     <interface type="ethernet">
Nov 29 18:00:47 user nova-compute[74613]:       <mac address="fa:16:3e:75:15:43"/>
Nov 29 18:00:47 user nova-compute[74613]:       <model type="virtio"/>
Nov 29 18:00:47 user nova-compute[74613]:       <mtu size="1442"/>
Nov 29 18:00:47 user nova-compute[74613]:       <target dev="tapec533dd5-c7"/>
Nov 29 18:00:47 user nova-compute[74613]:     </interface>
Nov 29 18:00:47 user nova-compute[74613]:     <serial type="pty">
Nov 29 18:00:47 user nova-compute[74613]:       <log file="/opt/stack/data/nova/instances/6c2ea311-0404-4ecf-8086-65f65186f858/console.log" append="off"/>
Nov 29 18:00:47 user nova-compute[74613]:     </serial>
Nov 29 18:00:47 user nova-compute[74613]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 29 18:00:47 user nova-compute[74613]:     <video>
Nov 29 18:00:47 user nova-compute[74613]:       <model type="virtio"/>
Nov 29 18:00:47 user nova-compute[74613]:     </video>
Nov 29 18:00:47 user nova-compute[74613]:     <rng model="virtio">
Nov 29 18:00:47 user nova-compute[74613]:       <backend model="random">/dev/urandom</backend>
Nov 29 18:00:47 user nova-compute[74613]:     </rng>
Nov 29 18:00:47 user nova-compute[74613]:     <controller type="usb" index="0" model="none"/>
Nov 29 18:00:47 user nova-compute[74613]:     <memballoon model="virtio">
Nov 29 18:00:47 user nova-compute[74613]:       <stats period="10"/>
Nov 29 18:00:47 user nova-compute[74613]:     </memballoon>
Nov 29 18:00:47 user nova-compute[74613]:   </devices>
Nov 29 18:00:47 user nova-compute[74613]: </domain>
Nov 29 18:00:47 user nova-compute[74613]:  {{(pid=74613) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 29 18:00:47 user nova-compute[74613]: DEBUG nova.virt.libvirt.vif [None req-d3c2c843-c34e-46c2-bcb2-5d67c3331a1b tempest-VolumesSnapshotTestJSON-1388493826 tempest-VolumesSnapshotTestJSON-1388493826-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T18:00:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-899305642',display_name='tempest-VolumesSnapshotTestJSON-instance-899305642',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-899305642',id=24,image_ref='4217f428-8d9d-4ee1-9614-642d26d90c46',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBDbbE1cSh9/Rdbf9KDUssVEy9Q77UHVGA7A+YcsHGCVQokCnji0wVZ1MYpWlht+gSpcxBcP6Y0NVLYU2Da5HN8MwYRxUzJj2K1qJ2Ct0MAsSb5eUDYPIk0tAlgw/00p4A==',key_name='tempest-keypair-1551195618',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a9ec113a97bd40c4b68d3738c64ece01',ramdisk_id='',reservation_id='r-8marhme9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='4217f428-8d9d-4ee1-9614-642d26d90c46',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-1388493826',owner_user_name='tempest-VolumesSnapshotTestJSON-1388493826-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T18:00:46Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5fd84795e6684327998b0f52f5941f86',uuid=6c2ea311-0404-4ecf-8086-65f65186f858,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ec533dd5-c792-49a7-b497-7995a406838a", "address": "fa:16:3e:75:15:43", "network": {"id": "4cc7e4ab-28a3-431a-9855-22009278b949", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1066409623-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a9ec113a97bd40c4b68d3738c64ece01", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapec533dd5-c7", "ovs_interfaceid": "ec533dd5-c792-49a7-b497-7995a406838a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74613) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 29 18:00:47 user nova-compute[74613]: DEBUG nova.network.os_vif_util [None req-d3c2c843-c34e-46c2-bcb2-5d67c3331a1b tempest-VolumesSnapshotTestJSON-1388493826 tempest-VolumesSnapshotTestJSON-1388493826-project-member] Converting VIF {"id": "ec533dd5-c792-49a7-b497-7995a406838a", "address": "fa:16:3e:75:15:43", "network": {"id": "4cc7e4ab-28a3-431a-9855-22009278b949", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1066409623-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a9ec113a97bd40c4b68d3738c64ece01", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapec533dd5-c7", "ovs_interfaceid": "ec533dd5-c792-49a7-b497-7995a406838a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74613) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 18:00:47 user nova-compute[74613]: DEBUG nova.network.os_vif_util [None req-d3c2c843-c34e-46c2-bcb2-5d67c3331a1b tempest-VolumesSnapshotTestJSON-1388493826 tempest-VolumesSnapshotTestJSON-1388493826-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:75:15:43,bridge_name='br-int',has_traffic_filtering=True,id=ec533dd5-c792-49a7-b497-7995a406838a,network=Network(4cc7e4ab-28a3-431a-9855-22009278b949),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapec533dd5-c7') {{(pid=74613) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 18:00:47 user nova-compute[74613]: DEBUG os_vif [None req-d3c2c843-c34e-46c2-bcb2-5d67c3331a1b tempest-VolumesSnapshotTestJSON-1388493826 tempest-VolumesSnapshotTestJSON-1388493826-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:75:15:43,bridge_name='br-int',has_traffic_filtering=True,id=ec533dd5-c792-49a7-b497-7995a406838a,network=Network(4cc7e4ab-28a3-431a-9855-22009278b949),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapec533dd5-c7') {{(pid=74613) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 29 18:00:47 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:00:47 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74613) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 18:00:47 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74613) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 29 18:00:47 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:00:47 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '5581e99d-af4d-5042-a7cf-67b5a9ad79ce', '_type': 'linux-noop'}}, row=False) {{(pid=74613) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 18:00:47 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:00:47 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 18:00:47 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:00:47 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:00:47 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapec533dd5-c7, may_exist=True, interface_attrs={}) {{(pid=74613) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 18:00:47 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapec533dd5-c7, col_values=(('qos', UUID('25db5f33-28c8-4c7b-a618-1cef2dfa5bac')),), if_exists=True) {{(pid=74613) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 18:00:47 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapec533dd5-c7, col_values=(('external_ids', {'iface-id': 'ec533dd5-c792-49a7-b497-7995a406838a', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:75:15:43', 'vm-uuid': '6c2ea311-0404-4ecf-8086-65f65186f858'}),), if_exists=True) {{(pid=74613) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 18:00:47 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:00:47 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 18:00:47 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:00:47 user nova-compute[74613]: INFO os_vif [None req-d3c2c843-c34e-46c2-bcb2-5d67c3331a1b tempest-VolumesSnapshotTestJSON-1388493826 tempest-VolumesSnapshotTestJSON-1388493826-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:75:15:43,bridge_name='br-int',has_traffic_filtering=True,id=ec533dd5-c792-49a7-b497-7995a406838a,network=Network(4cc7e4ab-28a3-431a-9855-22009278b949),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapec533dd5-c7')
Nov 29 18:00:47 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-d3c2c843-c34e-46c2-bcb2-5d67c3331a1b tempest-VolumesSnapshotTestJSON-1388493826 tempest-VolumesSnapshotTestJSON-1388493826-project-member] No BDM found with device name vda, not building metadata. {{(pid=74613) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 18:00:47 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-d3c2c843-c34e-46c2-bcb2-5d67c3331a1b tempest-VolumesSnapshotTestJSON-1388493826 tempest-VolumesSnapshotTestJSON-1388493826-project-member] No VIF found with MAC fa:16:3e:75:15:43, not building metadata {{(pid=74613) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 29 18:00:48 user nova-compute[74613]: INFO nova.virt.libvirt.driver [None req-11700925-dccf-43ef-9e6b-4f450fc35712 tempest-AttachVolumeShelveTestJSON-1452861425 tempest-AttachVolumeShelveTestJSON-1452861425-project-member] [instance: f9be53df-54e6-4f59-9cef-0ba7434f0c29] Snapshot image upload complete
Nov 29 18:00:48 user nova-compute[74613]: DEBUG nova.compute.manager [None req-11700925-dccf-43ef-9e6b-4f450fc35712 tempest-AttachVolumeShelveTestJSON-1452861425 tempest-AttachVolumeShelveTestJSON-1452861425-project-member] [instance: f9be53df-54e6-4f59-9cef-0ba7434f0c29] Checking state {{(pid=74613) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 29 18:00:48 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:00:49 user nova-compute[74613]: DEBUG nova.compute.manager [req-00334b63-2fdd-48c8-a1d0-de91853fd766 req-28c3fece-28f6-4a7d-bde8-55cb0d468bdd service nova] [instance: 6c2ea311-0404-4ecf-8086-65f65186f858] Received event network-changed-ec533dd5-c792-49a7-b497-7995a406838a {{(pid=74613) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 18:00:49 user nova-compute[74613]: DEBUG nova.compute.manager [req-00334b63-2fdd-48c8-a1d0-de91853fd766 req-28c3fece-28f6-4a7d-bde8-55cb0d468bdd service nova] [instance: 6c2ea311-0404-4ecf-8086-65f65186f858] Refreshing instance network info cache due to event network-changed-ec533dd5-c792-49a7-b497-7995a406838a. {{(pid=74613) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 18:00:49 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-00334b63-2fdd-48c8-a1d0-de91853fd766 req-28c3fece-28f6-4a7d-bde8-55cb0d468bdd service nova] Acquiring lock "refresh_cache-6c2ea311-0404-4ecf-8086-65f65186f858" {{(pid=74613) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 18:00:49 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-00334b63-2fdd-48c8-a1d0-de91853fd766 req-28c3fece-28f6-4a7d-bde8-55cb0d468bdd service nova] Acquired lock "refresh_cache-6c2ea311-0404-4ecf-8086-65f65186f858" {{(pid=74613) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 18:00:49 user nova-compute[74613]: DEBUG nova.network.neutron [req-00334b63-2fdd-48c8-a1d0-de91853fd766 req-28c3fece-28f6-4a7d-bde8-55cb0d468bdd service nova] [instance: 6c2ea311-0404-4ecf-8086-65f65186f858] Refreshing network info cache for port ec533dd5-c792-49a7-b497-7995a406838a {{(pid=74613) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 18:00:49 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:00:49 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:00:49 user nova-compute[74613]: INFO nova.compute.manager [None req-11700925-dccf-43ef-9e6b-4f450fc35712 tempest-AttachVolumeShelveTestJSON-1452861425 tempest-AttachVolumeShelveTestJSON-1452861425-project-member] [instance: f9be53df-54e6-4f59-9cef-0ba7434f0c29] Shelve offloading
Nov 29 18:00:49 user nova-compute[74613]: INFO nova.virt.libvirt.driver [-] [instance: f9be53df-54e6-4f59-9cef-0ba7434f0c29] Instance destroyed successfully.
Nov 29 18:00:49 user nova-compute[74613]: DEBUG nova.compute.manager [None req-11700925-dccf-43ef-9e6b-4f450fc35712 tempest-AttachVolumeShelveTestJSON-1452861425 tempest-AttachVolumeShelveTestJSON-1452861425-project-member] [instance: f9be53df-54e6-4f59-9cef-0ba7434f0c29] Checking state {{(pid=74613) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 29 18:00:49 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-11700925-dccf-43ef-9e6b-4f450fc35712 tempest-AttachVolumeShelveTestJSON-1452861425 tempest-AttachVolumeShelveTestJSON-1452861425-project-member] Acquiring lock "refresh_cache-f9be53df-54e6-4f59-9cef-0ba7434f0c29" {{(pid=74613) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 18:00:49 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-11700925-dccf-43ef-9e6b-4f450fc35712 tempest-AttachVolumeShelveTestJSON-1452861425 tempest-AttachVolumeShelveTestJSON-1452861425-project-member] Acquired lock "refresh_cache-f9be53df-54e6-4f59-9cef-0ba7434f0c29" {{(pid=74613) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 18:00:49 user nova-compute[74613]: DEBUG nova.network.neutron [None req-11700925-dccf-43ef-9e6b-4f450fc35712 tempest-AttachVolumeShelveTestJSON-1452861425 tempest-AttachVolumeShelveTestJSON-1452861425-project-member] [instance: f9be53df-54e6-4f59-9cef-0ba7434f0c29] Building network info cache for instance {{(pid=74613) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 29 18:00:49 user nova-compute[74613]: DEBUG nova.compute.manager [req-5c17577c-814e-4c2f-b587-8cc0ad3d7140 req-a626818f-e921-4bb5-883f-4c5e1e92307c service nova] [instance: 6c2ea311-0404-4ecf-8086-65f65186f858] Received event network-vif-plugged-ec533dd5-c792-49a7-b497-7995a406838a {{(pid=74613) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 18:00:49 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-5c17577c-814e-4c2f-b587-8cc0ad3d7140 req-a626818f-e921-4bb5-883f-4c5e1e92307c service nova] Acquiring lock "6c2ea311-0404-4ecf-8086-65f65186f858-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 18:00:49 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-5c17577c-814e-4c2f-b587-8cc0ad3d7140 req-a626818f-e921-4bb5-883f-4c5e1e92307c service nova] Lock "6c2ea311-0404-4ecf-8086-65f65186f858-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 18:00:49 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-5c17577c-814e-4c2f-b587-8cc0ad3d7140 req-a626818f-e921-4bb5-883f-4c5e1e92307c service nova] Lock "6c2ea311-0404-4ecf-8086-65f65186f858-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 18:00:49 user nova-compute[74613]: DEBUG nova.compute.manager [req-5c17577c-814e-4c2f-b587-8cc0ad3d7140 req-a626818f-e921-4bb5-883f-4c5e1e92307c service nova] [instance: 6c2ea311-0404-4ecf-8086-65f65186f858] No waiting events found dispatching network-vif-plugged-ec533dd5-c792-49a7-b497-7995a406838a {{(pid=74613) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 18:00:49 user nova-compute[74613]: WARNING nova.compute.manager [req-5c17577c-814e-4c2f-b587-8cc0ad3d7140 req-a626818f-e921-4bb5-883f-4c5e1e92307c service nova] [instance: 6c2ea311-0404-4ecf-8086-65f65186f858] Received unexpected event network-vif-plugged-ec533dd5-c792-49a7-b497-7995a406838a for instance with vm_state building and task_state spawning.
Nov 29 18:00:49 user nova-compute[74613]: DEBUG nova.network.neutron [req-00334b63-2fdd-48c8-a1d0-de91853fd766 req-28c3fece-28f6-4a7d-bde8-55cb0d468bdd service nova] [instance: 6c2ea311-0404-4ecf-8086-65f65186f858] Updated VIF entry in instance network info cache for port ec533dd5-c792-49a7-b497-7995a406838a. {{(pid=74613) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 18:00:49 user nova-compute[74613]: DEBUG nova.network.neutron [req-00334b63-2fdd-48c8-a1d0-de91853fd766 req-28c3fece-28f6-4a7d-bde8-55cb0d468bdd service nova] [instance: 6c2ea311-0404-4ecf-8086-65f65186f858] Updating instance_info_cache with network_info: [{"id": "ec533dd5-c792-49a7-b497-7995a406838a", "address": "fa:16:3e:75:15:43", "network": {"id": "4cc7e4ab-28a3-431a-9855-22009278b949", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1066409623-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a9ec113a97bd40c4b68d3738c64ece01", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapec533dd5-c7", "ovs_interfaceid": "ec533dd5-c792-49a7-b497-7995a406838a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74613) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 18:00:49 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-00334b63-2fdd-48c8-a1d0-de91853fd766 req-28c3fece-28f6-4a7d-bde8-55cb0d468bdd service nova] Releasing lock "refresh_cache-6c2ea311-0404-4ecf-8086-65f65186f858" {{(pid=74613) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 18:00:49 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:00:49 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:00:49 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:00:49 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:00:49 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:00:50 user nova-compute[74613]: DEBUG nova.network.neutron [None req-11700925-dccf-43ef-9e6b-4f450fc35712 tempest-AttachVolumeShelveTestJSON-1452861425 tempest-AttachVolumeShelveTestJSON-1452861425-project-member] [instance: f9be53df-54e6-4f59-9cef-0ba7434f0c29] Updating instance_info_cache with network_info: [{"id": "175b56ab-750b-4dbf-a981-2a32d749d445", "address": "fa:16:3e:e8:f3:9e", "network": {"id": "4a101f3e-d23e-4198-bc3c-b4f9b4d2b4c4", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-864151424-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.246", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1c0c1c71400549369c1b11ca7d5f43ec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap175b56ab-75", "ovs_interfaceid": "175b56ab-750b-4dbf-a981-2a32d749d445", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74613) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 18:00:50 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-11700925-dccf-43ef-9e6b-4f450fc35712 tempest-AttachVolumeShelveTestJSON-1452861425 tempest-AttachVolumeShelveTestJSON-1452861425-project-member] Releasing lock "refresh_cache-f9be53df-54e6-4f59-9cef-0ba7434f0c29" {{(pid=74613) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 18:00:50 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:00:50 user nova-compute[74613]: INFO nova.virt.libvirt.driver [-] [instance: f9be53df-54e6-4f59-9cef-0ba7434f0c29] Instance destroyed successfully.
Nov 29 18:00:50 user nova-compute[74613]: DEBUG nova.objects.instance [None req-11700925-dccf-43ef-9e6b-4f450fc35712 tempest-AttachVolumeShelveTestJSON-1452861425 tempest-AttachVolumeShelveTestJSON-1452861425-project-member] Lazy-loading 'resources' on Instance uuid f9be53df-54e6-4f59-9cef-0ba7434f0c29 {{(pid=74613) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 18:00:50 user nova-compute[74613]: DEBUG nova.virt.libvirt.vif [None req-11700925-dccf-43ef-9e6b-4f450fc35712 tempest-AttachVolumeShelveTestJSON-1452861425 tempest-AttachVolumeShelveTestJSON-1452861425-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T17:58:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1968314827',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1968314827',id=20,image_ref='4217f428-8d9d-4ee1-9614-642d26d90c46',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBD3+ii+PLRizYlFkb7wD/B1NviUyG/AGb0OGXzoabE7BPGjgfwRJuzQbYeCpnCbXJJxRZe//IQydP4sQ1W/jCdBIdEU1Q9Gq/9zv5qMuBOIzCzGmDAMD8rdWn1s7sD+8mw==',key_name='tempest-keypair-1048982870',keypairs=<?>,launch_index=0,launched_at=2023-11-29T17:58:56Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='1c0c1c71400549369c1b11ca7d5f43ec',ramdisk_id='',reservation_id='r-crz26r0v',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='4217f428-8d9d-4ee1-9614-642d26d90c46',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1452861425',owner_user_name='tempest-AttachVolumeShelveTestJSON-1452861425-project-member',shelved_at='2023-11-29T18:00:48.988892',shelved_host='user',shelved_image_id='e5f40838-1165-44d9-858a-fb5bda721c22'},tags=<?>,task_state='shelving_offloading',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-29T18:00:47Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='45192488dde84ebfbcacfdbd4f898799',uuid=f9be53df-54e6-4f59-9cef-0ba7434f0c29,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='shelved') vif={"id": "175b56ab-750b-4dbf-a981-2a32d749d445", "address": "fa:16:3e:e8:f3:9e", "network": {"id": "4a101f3e-d23e-4198-bc3c-b4f9b4d2b4c4", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-864151424-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.246", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1c0c1c71400549369c1b11ca7d5f43ec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap175b56ab-75", "ovs_interfaceid": "175b56ab-750b-4dbf-a981-2a32d749d445", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74613) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 29 18:00:50 user nova-compute[74613]: DEBUG nova.network.os_vif_util [None req-11700925-dccf-43ef-9e6b-4f450fc35712 tempest-AttachVolumeShelveTestJSON-1452861425 tempest-AttachVolumeShelveTestJSON-1452861425-project-member] Converting VIF {"id": "175b56ab-750b-4dbf-a981-2a32d749d445", "address": "fa:16:3e:e8:f3:9e", "network": {"id": "4a101f3e-d23e-4198-bc3c-b4f9b4d2b4c4", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-864151424-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.246", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1c0c1c71400549369c1b11ca7d5f43ec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap175b56ab-75", "ovs_interfaceid": "175b56ab-750b-4dbf-a981-2a32d749d445", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74613) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 18:00:50 user nova-compute[74613]: DEBUG nova.network.os_vif_util [None req-11700925-dccf-43ef-9e6b-4f450fc35712 tempest-AttachVolumeShelveTestJSON-1452861425 tempest-AttachVolumeShelveTestJSON-1452861425-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e8:f3:9e,bridge_name='br-int',has_traffic_filtering=True,id=175b56ab-750b-4dbf-a981-2a32d749d445,network=Network(4a101f3e-d23e-4198-bc3c-b4f9b4d2b4c4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap175b56ab-75') {{(pid=74613) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 18:00:50 user nova-compute[74613]: DEBUG os_vif [None req-11700925-dccf-43ef-9e6b-4f450fc35712 tempest-AttachVolumeShelveTestJSON-1452861425 tempest-AttachVolumeShelveTestJSON-1452861425-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e8:f3:9e,bridge_name='br-int',has_traffic_filtering=True,id=175b56ab-750b-4dbf-a981-2a32d749d445,network=Network(4a101f3e-d23e-4198-bc3c-b4f9b4d2b4c4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap175b56ab-75') {{(pid=74613) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 29 18:00:50 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:00:50 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap175b56ab-75, bridge=br-int, if_exists=True) {{(pid=74613) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 18:00:50 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:00:50 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:00:50 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:00:50 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=08ffbbf7-e739-4b07-be46-f7648ccd1011) {{(pid=74613) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 18:00:50 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 18:00:50 user nova-compute[74613]: INFO os_vif [None req-11700925-dccf-43ef-9e6b-4f450fc35712 tempest-AttachVolumeShelveTestJSON-1452861425 tempest-AttachVolumeShelveTestJSON-1452861425-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e8:f3:9e,bridge_name='br-int',has_traffic_filtering=True,id=175b56ab-750b-4dbf-a981-2a32d749d445,network=Network(4a101f3e-d23e-4198-bc3c-b4f9b4d2b4c4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap175b56ab-75')
Nov 29 18:00:50 user nova-compute[74613]: INFO nova.virt.libvirt.driver [None req-11700925-dccf-43ef-9e6b-4f450fc35712 tempest-AttachVolumeShelveTestJSON-1452861425 tempest-AttachVolumeShelveTestJSON-1452861425-project-member] [instance: f9be53df-54e6-4f59-9cef-0ba7434f0c29] Deleting instance files /opt/stack/data/nova/instances/f9be53df-54e6-4f59-9cef-0ba7434f0c29_del
Nov 29 18:00:50 user nova-compute[74613]: INFO nova.virt.libvirt.driver [None req-11700925-dccf-43ef-9e6b-4f450fc35712 tempest-AttachVolumeShelveTestJSON-1452861425 tempest-AttachVolumeShelveTestJSON-1452861425-project-member] [instance: f9be53df-54e6-4f59-9cef-0ba7434f0c29] Deletion of /opt/stack/data/nova/instances/f9be53df-54e6-4f59-9cef-0ba7434f0c29_del complete
Nov 29 18:00:51 user nova-compute[74613]: INFO nova.scheduler.client.report [None req-11700925-dccf-43ef-9e6b-4f450fc35712 tempest-AttachVolumeShelveTestJSON-1452861425 tempest-AttachVolumeShelveTestJSON-1452861425-project-member] Deleted allocations for instance f9be53df-54e6-4f59-9cef-0ba7434f0c29
Nov 29 18:00:51 user nova-compute[74613]: DEBUG nova.compute.manager [None req-d3c2c843-c34e-46c2-bcb2-5d67c3331a1b tempest-VolumesSnapshotTestJSON-1388493826 tempest-VolumesSnapshotTestJSON-1388493826-project-member] [instance: 6c2ea311-0404-4ecf-8086-65f65186f858] Instance event wait completed in 0 seconds for  {{(pid=74613) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 29 18:00:51 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-d3c2c843-c34e-46c2-bcb2-5d67c3331a1b tempest-VolumesSnapshotTestJSON-1388493826 tempest-VolumesSnapshotTestJSON-1388493826-project-member] [instance: 6c2ea311-0404-4ecf-8086-65f65186f858] Guest created on hypervisor {{(pid=74613) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 29 18:00:51 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-11700925-dccf-43ef-9e6b-4f450fc35712 tempest-AttachVolumeShelveTestJSON-1452861425 tempest-AttachVolumeShelveTestJSON-1452861425-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 18:00:51 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-11700925-dccf-43ef-9e6b-4f450fc35712 tempest-AttachVolumeShelveTestJSON-1452861425 tempest-AttachVolumeShelveTestJSON-1452861425-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 18:00:51 user nova-compute[74613]: INFO nova.virt.libvirt.driver [-] [instance: 6c2ea311-0404-4ecf-8086-65f65186f858] Instance spawned successfully.
Nov 29 18:00:51 user nova-compute[74613]: DEBUG nova.objects.instance [None req-11700925-dccf-43ef-9e6b-4f450fc35712 tempest-AttachVolumeShelveTestJSON-1452861425 tempest-AttachVolumeShelveTestJSON-1452861425-project-member] Lazy-loading 'numa_topology' on Instance uuid f9be53df-54e6-4f59-9cef-0ba7434f0c29 {{(pid=74613) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 18:00:51 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-d3c2c843-c34e-46c2-bcb2-5d67c3331a1b tempest-VolumesSnapshotTestJSON-1388493826 tempest-VolumesSnapshotTestJSON-1388493826-project-member] [instance: 6c2ea311-0404-4ecf-8086-65f65186f858] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74613) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 29 18:00:51 user nova-compute[74613]: DEBUG nova.objects.base [None req-11700925-dccf-43ef-9e6b-4f450fc35712 tempest-AttachVolumeShelveTestJSON-1452861425 tempest-AttachVolumeShelveTestJSON-1452861425-project-member] Object Instance<f9be53df-54e6-4f59-9cef-0ba7434f0c29> lazy-loaded attributes: resources,numa_topology {{(pid=74613) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 29 18:00:51 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-d3c2c843-c34e-46c2-bcb2-5d67c3331a1b tempest-VolumesSnapshotTestJSON-1388493826 tempest-VolumesSnapshotTestJSON-1388493826-project-member] [instance: 6c2ea311-0404-4ecf-8086-65f65186f858] Found default for hw_cdrom_bus of ide {{(pid=74613) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 18:00:51 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-d3c2c843-c34e-46c2-bcb2-5d67c3331a1b tempest-VolumesSnapshotTestJSON-1388493826 tempest-VolumesSnapshotTestJSON-1388493826-project-member] [instance: 6c2ea311-0404-4ecf-8086-65f65186f858] Found default for hw_disk_bus of virtio {{(pid=74613) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 18:00:51 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-d3c2c843-c34e-46c2-bcb2-5d67c3331a1b tempest-VolumesSnapshotTestJSON-1388493826 tempest-VolumesSnapshotTestJSON-1388493826-project-member] [instance: 6c2ea311-0404-4ecf-8086-65f65186f858] Found default for hw_input_bus of None {{(pid=74613) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 18:00:51 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-d3c2c843-c34e-46c2-bcb2-5d67c3331a1b tempest-VolumesSnapshotTestJSON-1388493826 tempest-VolumesSnapshotTestJSON-1388493826-project-member] [instance: 6c2ea311-0404-4ecf-8086-65f65186f858] Found default for hw_pointer_model of None {{(pid=74613) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 18:00:51 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-d3c2c843-c34e-46c2-bcb2-5d67c3331a1b tempest-VolumesSnapshotTestJSON-1388493826 tempest-VolumesSnapshotTestJSON-1388493826-project-member] [instance: 6c2ea311-0404-4ecf-8086-65f65186f858] Found default for hw_video_model of virtio {{(pid=74613) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 18:00:51 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-d3c2c843-c34e-46c2-bcb2-5d67c3331a1b tempest-VolumesSnapshotTestJSON-1388493826 tempest-VolumesSnapshotTestJSON-1388493826-project-member] [instance: 6c2ea311-0404-4ecf-8086-65f65186f858] Found default for hw_vif_model of virtio {{(pid=74613) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 18:00:51 user nova-compute[74613]: INFO nova.compute.manager [None req-d3c2c843-c34e-46c2-bcb2-5d67c3331a1b tempest-VolumesSnapshotTestJSON-1388493826 tempest-VolumesSnapshotTestJSON-1388493826-project-member] [instance: 6c2ea311-0404-4ecf-8086-65f65186f858] Took 5.48 seconds to spawn the instance on the hypervisor.
Nov 29 18:00:51 user nova-compute[74613]: DEBUG nova.compute.manager [None req-d3c2c843-c34e-46c2-bcb2-5d67c3331a1b tempest-VolumesSnapshotTestJSON-1388493826 tempest-VolumesSnapshotTestJSON-1388493826-project-member] [instance: 6c2ea311-0404-4ecf-8086-65f65186f858] Checking state {{(pid=74613) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 29 18:00:51 user nova-compute[74613]: DEBUG nova.compute.manager [req-ac3d15f1-5da8-4889-ae71-7bab91ed2fc2 req-154de1de-3aeb-4af4-a3c5-ead468cdd0ba service nova] [instance: 6c2ea311-0404-4ecf-8086-65f65186f858] Received event network-vif-plugged-ec533dd5-c792-49a7-b497-7995a406838a {{(pid=74613) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 18:00:51 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-ac3d15f1-5da8-4889-ae71-7bab91ed2fc2 req-154de1de-3aeb-4af4-a3c5-ead468cdd0ba service nova] Acquiring lock "6c2ea311-0404-4ecf-8086-65f65186f858-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 18:00:51 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-ac3d15f1-5da8-4889-ae71-7bab91ed2fc2 req-154de1de-3aeb-4af4-a3c5-ead468cdd0ba service nova] Lock "6c2ea311-0404-4ecf-8086-65f65186f858-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 18:00:51 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-ac3d15f1-5da8-4889-ae71-7bab91ed2fc2 req-154de1de-3aeb-4af4-a3c5-ead468cdd0ba service nova] Lock "6c2ea311-0404-4ecf-8086-65f65186f858-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 18:00:51 user nova-compute[74613]: DEBUG nova.compute.manager [req-ac3d15f1-5da8-4889-ae71-7bab91ed2fc2 req-154de1de-3aeb-4af4-a3c5-ead468cdd0ba service nova] [instance: 6c2ea311-0404-4ecf-8086-65f65186f858] No waiting events found dispatching network-vif-plugged-ec533dd5-c792-49a7-b497-7995a406838a {{(pid=74613) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 18:00:51 user nova-compute[74613]: WARNING nova.compute.manager [req-ac3d15f1-5da8-4889-ae71-7bab91ed2fc2 req-154de1de-3aeb-4af4-a3c5-ead468cdd0ba service nova] [instance: 6c2ea311-0404-4ecf-8086-65f65186f858] Received unexpected event network-vif-plugged-ec533dd5-c792-49a7-b497-7995a406838a for instance with vm_state building and task_state spawning.
Nov 29 18:00:51 user nova-compute[74613]: DEBUG nova.compute.manager [req-ac3d15f1-5da8-4889-ae71-7bab91ed2fc2 req-154de1de-3aeb-4af4-a3c5-ead468cdd0ba service nova] [instance: f9be53df-54e6-4f59-9cef-0ba7434f0c29] Received event network-changed-175b56ab-750b-4dbf-a981-2a32d749d445 {{(pid=74613) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 18:00:51 user nova-compute[74613]: DEBUG nova.compute.manager [req-ac3d15f1-5da8-4889-ae71-7bab91ed2fc2 req-154de1de-3aeb-4af4-a3c5-ead468cdd0ba service nova] [instance: f9be53df-54e6-4f59-9cef-0ba7434f0c29] Refreshing instance network info cache due to event network-changed-175b56ab-750b-4dbf-a981-2a32d749d445. {{(pid=74613) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 18:00:51 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-ac3d15f1-5da8-4889-ae71-7bab91ed2fc2 req-154de1de-3aeb-4af4-a3c5-ead468cdd0ba service nova] Acquiring lock "refresh_cache-f9be53df-54e6-4f59-9cef-0ba7434f0c29" {{(pid=74613) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 18:00:51 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-ac3d15f1-5da8-4889-ae71-7bab91ed2fc2 req-154de1de-3aeb-4af4-a3c5-ead468cdd0ba service nova] Acquired lock "refresh_cache-f9be53df-54e6-4f59-9cef-0ba7434f0c29" {{(pid=74613) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 18:00:51 user nova-compute[74613]: DEBUG nova.network.neutron [req-ac3d15f1-5da8-4889-ae71-7bab91ed2fc2 req-154de1de-3aeb-4af4-a3c5-ead468cdd0ba service nova] [instance: f9be53df-54e6-4f59-9cef-0ba7434f0c29] Refreshing network info cache for port 175b56ab-750b-4dbf-a981-2a32d749d445 {{(pid=74613) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 18:00:51 user nova-compute[74613]: INFO nova.compute.manager [None req-d3c2c843-c34e-46c2-bcb2-5d67c3331a1b tempest-VolumesSnapshotTestJSON-1388493826 tempest-VolumesSnapshotTestJSON-1388493826-project-member] [instance: 6c2ea311-0404-4ecf-8086-65f65186f858] Took 6.57 seconds to build instance.
Nov 29 18:00:51 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-d3c2c843-c34e-46c2-bcb2-5d67c3331a1b tempest-VolumesSnapshotTestJSON-1388493826 tempest-VolumesSnapshotTestJSON-1388493826-project-member] Lock "6c2ea311-0404-4ecf-8086-65f65186f858" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.671s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 18:00:51 user nova-compute[74613]: DEBUG nova.compute.provider_tree [None req-11700925-dccf-43ef-9e6b-4f450fc35712 tempest-AttachVolumeShelveTestJSON-1452861425 tempest-AttachVolumeShelveTestJSON-1452861425-project-member] Inventory has not changed in ProviderTree for provider: 639d980e-3b12-44b1-b8f4-1812416fa4dd {{(pid=74613) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 18:00:51 user nova-compute[74613]: DEBUG nova.scheduler.client.report [None req-11700925-dccf-43ef-9e6b-4f450fc35712 tempest-AttachVolumeShelveTestJSON-1452861425 tempest-AttachVolumeShelveTestJSON-1452861425-project-member] Inventory has not changed for provider 639d980e-3b12-44b1-b8f4-1812416fa4dd based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74613) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 18:00:51 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-11700925-dccf-43ef-9e6b-4f450fc35712 tempest-AttachVolumeShelveTestJSON-1452861425 tempest-AttachVolumeShelveTestJSON-1452861425-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.467s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 18:00:51 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-11700925-dccf-43ef-9e6b-4f450fc35712 tempest-AttachVolumeShelveTestJSON-1452861425 tempest-AttachVolumeShelveTestJSON-1452861425-project-member] Lock "f9be53df-54e6-4f59-9cef-0ba7434f0c29" "released" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: held 7.239s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 18:00:51 user nova-compute[74613]: DEBUG nova.network.neutron [req-ac3d15f1-5da8-4889-ae71-7bab91ed2fc2 req-154de1de-3aeb-4af4-a3c5-ead468cdd0ba service nova] [instance: f9be53df-54e6-4f59-9cef-0ba7434f0c29] Updated VIF entry in instance network info cache for port 175b56ab-750b-4dbf-a981-2a32d749d445. {{(pid=74613) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 18:00:51 user nova-compute[74613]: DEBUG nova.network.neutron [req-ac3d15f1-5da8-4889-ae71-7bab91ed2fc2 req-154de1de-3aeb-4af4-a3c5-ead468cdd0ba service nova] [instance: f9be53df-54e6-4f59-9cef-0ba7434f0c29] Updating instance_info_cache with network_info: [{"id": "175b56ab-750b-4dbf-a981-2a32d749d445", "address": "fa:16:3e:e8:f3:9e", "network": {"id": "4a101f3e-d23e-4198-bc3c-b4f9b4d2b4c4", "bridge": null, "label": "tempest-AttachVolumeShelveTestJSON-864151424-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.246", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1c0c1c71400549369c1b11ca7d5f43ec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "unbound", "details": {}, "devname": "tap175b56ab-75", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74613) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 18:00:51 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-ac3d15f1-5da8-4889-ae71-7bab91ed2fc2 req-154de1de-3aeb-4af4-a3c5-ead468cdd0ba service nova] Releasing lock "refresh_cache-f9be53df-54e6-4f59-9cef-0ba7434f0c29" {{(pid=74613) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 18:00:55 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:00:55 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:00:58 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-85834603-4332-41c8-a2cd-6ce2bb8b4106 tempest-ServerActionsTestOtherA-1784608629 tempest-ServerActionsTestOtherA-1784608629-project-member] Acquiring lock "71f2a1ab-3df7-411c-93fa-b0a1a5a44f0a" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 18:00:58 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-85834603-4332-41c8-a2cd-6ce2bb8b4106 tempest-ServerActionsTestOtherA-1784608629 tempest-ServerActionsTestOtherA-1784608629-project-member] Lock "71f2a1ab-3df7-411c-93fa-b0a1a5a44f0a" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 18:00:58 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-85834603-4332-41c8-a2cd-6ce2bb8b4106 tempest-ServerActionsTestOtherA-1784608629 tempest-ServerActionsTestOtherA-1784608629-project-member] Acquiring lock "71f2a1ab-3df7-411c-93fa-b0a1a5a44f0a-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 18:00:58 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-85834603-4332-41c8-a2cd-6ce2bb8b4106 tempest-ServerActionsTestOtherA-1784608629 tempest-ServerActionsTestOtherA-1784608629-project-member] Lock "71f2a1ab-3df7-411c-93fa-b0a1a5a44f0a-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 18:00:58 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-85834603-4332-41c8-a2cd-6ce2bb8b4106 tempest-ServerActionsTestOtherA-1784608629 tempest-ServerActionsTestOtherA-1784608629-project-member] Lock "71f2a1ab-3df7-411c-93fa-b0a1a5a44f0a-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 18:00:58 user nova-compute[74613]: INFO nova.compute.manager [None req-85834603-4332-41c8-a2cd-6ce2bb8b4106 tempest-ServerActionsTestOtherA-1784608629 tempest-ServerActionsTestOtherA-1784608629-project-member] [instance: 71f2a1ab-3df7-411c-93fa-b0a1a5a44f0a] Terminating instance
Nov 29 18:00:58 user nova-compute[74613]: DEBUG nova.compute.manager [None req-85834603-4332-41c8-a2cd-6ce2bb8b4106 tempest-ServerActionsTestOtherA-1784608629 tempest-ServerActionsTestOtherA-1784608629-project-member] [instance: 71f2a1ab-3df7-411c-93fa-b0a1a5a44f0a] Start destroying the instance on the hypervisor. {{(pid=74613) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 29 18:00:58 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:00:58 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:00:58 user nova-compute[74613]: DEBUG nova.compute.manager [req-8a79bb7a-135a-4a1c-8c0f-e20f50bdd90c req-aecaf13a-3ebb-49c7-a771-820951885c09 service nova] [instance: 71f2a1ab-3df7-411c-93fa-b0a1a5a44f0a] Received event network-vif-unplugged-d40a5800-7391-4206-a661-fbce50c35a65 {{(pid=74613) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 18:00:58 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-8a79bb7a-135a-4a1c-8c0f-e20f50bdd90c req-aecaf13a-3ebb-49c7-a771-820951885c09 service nova] Acquiring lock "71f2a1ab-3df7-411c-93fa-b0a1a5a44f0a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 18:00:58 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-8a79bb7a-135a-4a1c-8c0f-e20f50bdd90c req-aecaf13a-3ebb-49c7-a771-820951885c09 service nova] Lock "71f2a1ab-3df7-411c-93fa-b0a1a5a44f0a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 18:00:58 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-8a79bb7a-135a-4a1c-8c0f-e20f50bdd90c req-aecaf13a-3ebb-49c7-a771-820951885c09 service nova] Lock "71f2a1ab-3df7-411c-93fa-b0a1a5a44f0a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 18:00:58 user nova-compute[74613]: DEBUG nova.compute.manager [req-8a79bb7a-135a-4a1c-8c0f-e20f50bdd90c req-aecaf13a-3ebb-49c7-a771-820951885c09 service nova] [instance: 71f2a1ab-3df7-411c-93fa-b0a1a5a44f0a] No waiting events found dispatching network-vif-unplugged-d40a5800-7391-4206-a661-fbce50c35a65 {{(pid=74613) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 18:00:58 user nova-compute[74613]: DEBUG nova.compute.manager [req-8a79bb7a-135a-4a1c-8c0f-e20f50bdd90c req-aecaf13a-3ebb-49c7-a771-820951885c09 service nova] [instance: 71f2a1ab-3df7-411c-93fa-b0a1a5a44f0a] Received event network-vif-unplugged-d40a5800-7391-4206-a661-fbce50c35a65 for instance with task_state deleting. {{(pid=74613) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 29 18:00:58 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:00:58 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:00:58 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:00:59 user nova-compute[74613]: INFO nova.virt.libvirt.driver [-] [instance: 71f2a1ab-3df7-411c-93fa-b0a1a5a44f0a] Instance destroyed successfully.
Nov 29 18:00:59 user nova-compute[74613]: DEBUG nova.objects.instance [None req-85834603-4332-41c8-a2cd-6ce2bb8b4106 tempest-ServerActionsTestOtherA-1784608629 tempest-ServerActionsTestOtherA-1784608629-project-member] Lazy-loading 'resources' on Instance uuid 71f2a1ab-3df7-411c-93fa-b0a1a5a44f0a {{(pid=74613) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 18:00:59 user nova-compute[74613]: DEBUG nova.virt.libvirt.vif [None req-85834603-4332-41c8-a2cd-6ce2bb8b4106 tempest-ServerActionsTestOtherA-1784608629 tempest-ServerActionsTestOtherA-1784608629-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-29T17:55:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-767391492',display_name='tempest-ServerActionsTestOtherA-server-1095947964',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-767391492',id=13,image_ref='4217f428-8d9d-4ee1-9614-642d26d90c46',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBoePbDdVpJCaWjh90UecUnwFAFq/eT9sMeustkjBwKAq8nn0Q72xeUImjY1HRKXOBeHYZZlO4bbO6ME7GeXyIhuiGXR5A0ys2izZvXx2IXQIIRGKFd1AzRXZiys4DgmVA==',key_name='tempest-keypair-218978152',keypairs=<?>,launch_index=0,launched_at=2023-11-29T17:57:34Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='b1f70c311d4941c986de21ac458d11ab',ramdisk_id='',reservation_id='r-adqmslmn',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='4217f428-8d9d-4ee1-9614-642d26d90c46',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-1784608629',owner_user_name='tempest-ServerActionsTestOtherA-1784608629-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-29T17:57:35Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='368555c72103480b82c5c0bf64b07360',uuid=71f2a1ab-3df7-411c-93fa-b0a1a5a44f0a,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "d40a5800-7391-4206-a661-fbce50c35a65", "address": "fa:16:3e:1a:53:06", "network": {"id": "7c2c368e-4c7d-4d70-9a40-c10fe9541af9", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1287934102-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.120", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b1f70c311d4941c986de21ac458d11ab", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd40a5800-73", "ovs_interfaceid": "d40a5800-7391-4206-a661-fbce50c35a65", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74613) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 29 18:00:59 user nova-compute[74613]: DEBUG nova.network.os_vif_util [None req-85834603-4332-41c8-a2cd-6ce2bb8b4106 tempest-ServerActionsTestOtherA-1784608629 tempest-ServerActionsTestOtherA-1784608629-project-member] Converting VIF {"id": "d40a5800-7391-4206-a661-fbce50c35a65", "address": "fa:16:3e:1a:53:06", "network": {"id": "7c2c368e-4c7d-4d70-9a40-c10fe9541af9", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1287934102-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.120", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b1f70c311d4941c986de21ac458d11ab", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd40a5800-73", "ovs_interfaceid": "d40a5800-7391-4206-a661-fbce50c35a65", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74613) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 18:00:59 user nova-compute[74613]: DEBUG nova.network.os_vif_util [None req-85834603-4332-41c8-a2cd-6ce2bb8b4106 tempest-ServerActionsTestOtherA-1784608629 tempest-ServerActionsTestOtherA-1784608629-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:1a:53:06,bridge_name='br-int',has_traffic_filtering=True,id=d40a5800-7391-4206-a661-fbce50c35a65,network=Network(7c2c368e-4c7d-4d70-9a40-c10fe9541af9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd40a5800-73') {{(pid=74613) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 18:00:59 user nova-compute[74613]: DEBUG os_vif [None req-85834603-4332-41c8-a2cd-6ce2bb8b4106 tempest-ServerActionsTestOtherA-1784608629 tempest-ServerActionsTestOtherA-1784608629-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:1a:53:06,bridge_name='br-int',has_traffic_filtering=True,id=d40a5800-7391-4206-a661-fbce50c35a65,network=Network(7c2c368e-4c7d-4d70-9a40-c10fe9541af9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd40a5800-73') {{(pid=74613) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 29 18:00:59 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:00:59 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapd40a5800-73, bridge=br-int, if_exists=True) {{(pid=74613) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 18:00:59 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:00:59 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 18:00:59 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:00:59 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=9f548cfa-9c5b-4385-ba3c-5dde23ec57c1) {{(pid=74613) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 18:00:59 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:00:59 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:00:59 user nova-compute[74613]: INFO os_vif [None req-85834603-4332-41c8-a2cd-6ce2bb8b4106 tempest-ServerActionsTestOtherA-1784608629 tempest-ServerActionsTestOtherA-1784608629-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:1a:53:06,bridge_name='br-int',has_traffic_filtering=True,id=d40a5800-7391-4206-a661-fbce50c35a65,network=Network(7c2c368e-4c7d-4d70-9a40-c10fe9541af9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd40a5800-73')
Nov 29 18:00:59 user nova-compute[74613]: INFO nova.virt.libvirt.driver [None req-85834603-4332-41c8-a2cd-6ce2bb8b4106 tempest-ServerActionsTestOtherA-1784608629 tempest-ServerActionsTestOtherA-1784608629-project-member] [instance: 71f2a1ab-3df7-411c-93fa-b0a1a5a44f0a] Deleting instance files /opt/stack/data/nova/instances/71f2a1ab-3df7-411c-93fa-b0a1a5a44f0a_del
Nov 29 18:00:59 user nova-compute[74613]: INFO nova.virt.libvirt.driver [None req-85834603-4332-41c8-a2cd-6ce2bb8b4106 tempest-ServerActionsTestOtherA-1784608629 tempest-ServerActionsTestOtherA-1784608629-project-member] [instance: 71f2a1ab-3df7-411c-93fa-b0a1a5a44f0a] Deletion of /opt/stack/data/nova/instances/71f2a1ab-3df7-411c-93fa-b0a1a5a44f0a_del complete
Nov 29 18:00:59 user nova-compute[74613]: INFO nova.compute.manager [None req-85834603-4332-41c8-a2cd-6ce2bb8b4106 tempest-ServerActionsTestOtherA-1784608629 tempest-ServerActionsTestOtherA-1784608629-project-member] [instance: 71f2a1ab-3df7-411c-93fa-b0a1a5a44f0a] Took 0.83 seconds to destroy the instance on the hypervisor.
Nov 29 18:00:59 user nova-compute[74613]: DEBUG oslo.service.loopingcall [None req-85834603-4332-41c8-a2cd-6ce2bb8b4106 tempest-ServerActionsTestOtherA-1784608629 tempest-ServerActionsTestOtherA-1784608629-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74613) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 29 18:00:59 user nova-compute[74613]: DEBUG nova.compute.manager [-] [instance: 71f2a1ab-3df7-411c-93fa-b0a1a5a44f0a] Deallocating network for instance {{(pid=74613) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 29 18:00:59 user nova-compute[74613]: DEBUG nova.network.neutron [-] [instance: 71f2a1ab-3df7-411c-93fa-b0a1a5a44f0a] deallocate_for_instance() {{(pid=74613) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 29 18:00:59 user nova-compute[74613]: DEBUG nova.network.neutron [-] [instance: 71f2a1ab-3df7-411c-93fa-b0a1a5a44f0a] Updating instance_info_cache with network_info: [] {{(pid=74613) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 18:00:59 user nova-compute[74613]: INFO nova.compute.manager [-] [instance: 71f2a1ab-3df7-411c-93fa-b0a1a5a44f0a] Took 0.71 seconds to deallocate network for instance.
Nov 29 18:00:59 user nova-compute[74613]: DEBUG nova.compute.manager [req-036661b2-2ada-4b4f-8e66-ec065e8b1809 req-47579877-9ac3-4c03-9a31-2c0d39b0694e service nova] [instance: 71f2a1ab-3df7-411c-93fa-b0a1a5a44f0a] Received event network-vif-deleted-d40a5800-7391-4206-a661-fbce50c35a65 {{(pid=74613) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 18:00:59 user nova-compute[74613]: INFO nova.compute.manager [req-036661b2-2ada-4b4f-8e66-ec065e8b1809 req-47579877-9ac3-4c03-9a31-2c0d39b0694e service nova] [instance: 71f2a1ab-3df7-411c-93fa-b0a1a5a44f0a] Neutron deleted interface d40a5800-7391-4206-a661-fbce50c35a65; detaching it from the instance and deleting it from the info cache
Nov 29 18:00:59 user nova-compute[74613]: DEBUG nova.network.neutron [req-036661b2-2ada-4b4f-8e66-ec065e8b1809 req-47579877-9ac3-4c03-9a31-2c0d39b0694e service nova] [instance: 71f2a1ab-3df7-411c-93fa-b0a1a5a44f0a] Updating instance_info_cache with network_info: [] {{(pid=74613) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 18:00:59 user nova-compute[74613]: DEBUG nova.compute.manager [req-036661b2-2ada-4b4f-8e66-ec065e8b1809 req-47579877-9ac3-4c03-9a31-2c0d39b0694e service nova] [instance: 71f2a1ab-3df7-411c-93fa-b0a1a5a44f0a] Detach interface failed, port_id=d40a5800-7391-4206-a661-fbce50c35a65, reason: Instance 71f2a1ab-3df7-411c-93fa-b0a1a5a44f0a could not be found. {{(pid=74613) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 29 18:00:59 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-85834603-4332-41c8-a2cd-6ce2bb8b4106 tempest-ServerActionsTestOtherA-1784608629 tempest-ServerActionsTestOtherA-1784608629-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 18:00:59 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-85834603-4332-41c8-a2cd-6ce2bb8b4106 tempest-ServerActionsTestOtherA-1784608629 tempest-ServerActionsTestOtherA-1784608629-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 18:01:00 user nova-compute[74613]: DEBUG nova.compute.provider_tree [None req-85834603-4332-41c8-a2cd-6ce2bb8b4106 tempest-ServerActionsTestOtherA-1784608629 tempest-ServerActionsTestOtherA-1784608629-project-member] Inventory has not changed in ProviderTree for provider: 639d980e-3b12-44b1-b8f4-1812416fa4dd {{(pid=74613) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 18:01:00 user nova-compute[74613]: DEBUG nova.scheduler.client.report [None req-85834603-4332-41c8-a2cd-6ce2bb8b4106 tempest-ServerActionsTestOtherA-1784608629 tempest-ServerActionsTestOtherA-1784608629-project-member] Inventory has not changed for provider 639d980e-3b12-44b1-b8f4-1812416fa4dd based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74613) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 18:01:00 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-85834603-4332-41c8-a2cd-6ce2bb8b4106 tempest-ServerActionsTestOtherA-1784608629 tempest-ServerActionsTestOtherA-1784608629-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.333s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 18:01:00 user nova-compute[74613]: INFO nova.scheduler.client.report [None req-85834603-4332-41c8-a2cd-6ce2bb8b4106 tempest-ServerActionsTestOtherA-1784608629 tempest-ServerActionsTestOtherA-1784608629-project-member] Deleted allocations for instance 71f2a1ab-3df7-411c-93fa-b0a1a5a44f0a
Nov 29 18:01:00 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:01:00 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-85834603-4332-41c8-a2cd-6ce2bb8b4106 tempest-ServerActionsTestOtherA-1784608629 tempest-ServerActionsTestOtherA-1784608629-project-member] Lock "71f2a1ab-3df7-411c-93fa-b0a1a5a44f0a" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.156s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 18:01:00 user nova-compute[74613]: DEBUG nova.compute.manager [req-5da65691-ab3a-4a86-abbf-55fe118dfb66 req-594b991e-5641-4242-b151-5b2c2ca7de61 service nova] [instance: 71f2a1ab-3df7-411c-93fa-b0a1a5a44f0a] Received event network-vif-plugged-d40a5800-7391-4206-a661-fbce50c35a65 {{(pid=74613) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 18:01:00 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-5da65691-ab3a-4a86-abbf-55fe118dfb66 req-594b991e-5641-4242-b151-5b2c2ca7de61 service nova] Acquiring lock "71f2a1ab-3df7-411c-93fa-b0a1a5a44f0a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 18:01:00 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-5da65691-ab3a-4a86-abbf-55fe118dfb66 req-594b991e-5641-4242-b151-5b2c2ca7de61 service nova] Lock "71f2a1ab-3df7-411c-93fa-b0a1a5a44f0a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 18:01:00 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-5da65691-ab3a-4a86-abbf-55fe118dfb66 req-594b991e-5641-4242-b151-5b2c2ca7de61 service nova] Lock "71f2a1ab-3df7-411c-93fa-b0a1a5a44f0a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 18:01:00 user nova-compute[74613]: DEBUG nova.compute.manager [req-5da65691-ab3a-4a86-abbf-55fe118dfb66 req-594b991e-5641-4242-b151-5b2c2ca7de61 service nova] [instance: 71f2a1ab-3df7-411c-93fa-b0a1a5a44f0a] No waiting events found dispatching network-vif-plugged-d40a5800-7391-4206-a661-fbce50c35a65 {{(pid=74613) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 18:01:00 user nova-compute[74613]: WARNING nova.compute.manager [req-5da65691-ab3a-4a86-abbf-55fe118dfb66 req-594b991e-5641-4242-b151-5b2c2ca7de61 service nova] [instance: 71f2a1ab-3df7-411c-93fa-b0a1a5a44f0a] Received unexpected event network-vif-plugged-d40a5800-7391-4206-a661-fbce50c35a65 for instance with vm_state deleted and task_state None.
Nov 29 18:01:04 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:01:05 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:01:09 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:01:10 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:01:13 user nova-compute[74613]: DEBUG nova.compute.manager [req-57564165-bbc6-43ad-8e86-235d09e28eb8 req-e1c04ec5-f963-4870-981b-9be4ec5618df service nova] [instance: 5221f9b9-e4db-406b-ae82-4a7c6522ee64] Received event network-changed-2b04c4cf-f85a-4089-8f4a-e2a1c4eec1ae {{(pid=74613) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 18:01:13 user nova-compute[74613]: DEBUG nova.compute.manager [req-57564165-bbc6-43ad-8e86-235d09e28eb8 req-e1c04ec5-f963-4870-981b-9be4ec5618df service nova] [instance: 5221f9b9-e4db-406b-ae82-4a7c6522ee64] Refreshing instance network info cache due to event network-changed-2b04c4cf-f85a-4089-8f4a-e2a1c4eec1ae. {{(pid=74613) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 18:01:13 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-57564165-bbc6-43ad-8e86-235d09e28eb8 req-e1c04ec5-f963-4870-981b-9be4ec5618df service nova] Acquiring lock "refresh_cache-5221f9b9-e4db-406b-ae82-4a7c6522ee64" {{(pid=74613) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 18:01:13 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-57564165-bbc6-43ad-8e86-235d09e28eb8 req-e1c04ec5-f963-4870-981b-9be4ec5618df service nova] Acquired lock "refresh_cache-5221f9b9-e4db-406b-ae82-4a7c6522ee64" {{(pid=74613) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 18:01:13 user nova-compute[74613]: DEBUG nova.network.neutron [req-57564165-bbc6-43ad-8e86-235d09e28eb8 req-e1c04ec5-f963-4870-981b-9be4ec5618df service nova] [instance: 5221f9b9-e4db-406b-ae82-4a7c6522ee64] Refreshing network info cache for port 2b04c4cf-f85a-4089-8f4a-e2a1c4eec1ae {{(pid=74613) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 18:01:13 user nova-compute[74613]: DEBUG nova.network.neutron [req-57564165-bbc6-43ad-8e86-235d09e28eb8 req-e1c04ec5-f963-4870-981b-9be4ec5618df service nova] [instance: 5221f9b9-e4db-406b-ae82-4a7c6522ee64] Updated VIF entry in instance network info cache for port 2b04c4cf-f85a-4089-8f4a-e2a1c4eec1ae. {{(pid=74613) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 18:01:13 user nova-compute[74613]: DEBUG nova.network.neutron [req-57564165-bbc6-43ad-8e86-235d09e28eb8 req-e1c04ec5-f963-4870-981b-9be4ec5618df service nova] [instance: 5221f9b9-e4db-406b-ae82-4a7c6522ee64] Updating instance_info_cache with network_info: [{"id": "2b04c4cf-f85a-4089-8f4a-e2a1c4eec1ae", "address": "fa:16:3e:bc:57:f9", "network": {"id": "c8bdb714-50af-4c1d-9e06-9c71a384b633", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-489594897-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.221", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0634597a325d46c18743626c2334e455", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2b04c4cf-f8", "ovs_interfaceid": "2b04c4cf-f85a-4089-8f4a-e2a1c4eec1ae", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74613) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 18:01:13 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-57564165-bbc6-43ad-8e86-235d09e28eb8 req-e1c04ec5-f963-4870-981b-9be4ec5618df service nova] Releasing lock "refresh_cache-5221f9b9-e4db-406b-ae82-4a7c6522ee64" {{(pid=74613) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 18:01:13 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-b088923d-6a5e-47b5-857e-8e5316db80f5 tempest-VolumesAdminNegativeTest-636556351 tempest-VolumesAdminNegativeTest-636556351-project-member] Acquiring lock "481055d5-0f19-4637-9b00-869967ea7889" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 18:01:13 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-b088923d-6a5e-47b5-857e-8e5316db80f5 tempest-VolumesAdminNegativeTest-636556351 tempest-VolumesAdminNegativeTest-636556351-project-member] Lock "481055d5-0f19-4637-9b00-869967ea7889" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 18:01:13 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-b088923d-6a5e-47b5-857e-8e5316db80f5 tempest-VolumesAdminNegativeTest-636556351 tempest-VolumesAdminNegativeTest-636556351-project-member] Acquiring lock "481055d5-0f19-4637-9b00-869967ea7889-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 18:01:13 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-b088923d-6a5e-47b5-857e-8e5316db80f5 tempest-VolumesAdminNegativeTest-636556351 tempest-VolumesAdminNegativeTest-636556351-project-member] Lock "481055d5-0f19-4637-9b00-869967ea7889-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 18:01:13 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-b088923d-6a5e-47b5-857e-8e5316db80f5 tempest-VolumesAdminNegativeTest-636556351 tempest-VolumesAdminNegativeTest-636556351-project-member] Lock "481055d5-0f19-4637-9b00-869967ea7889-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 18:01:13 user nova-compute[74613]: INFO nova.compute.manager [None req-b088923d-6a5e-47b5-857e-8e5316db80f5 tempest-VolumesAdminNegativeTest-636556351 tempest-VolumesAdminNegativeTest-636556351-project-member] [instance: 481055d5-0f19-4637-9b00-869967ea7889] Terminating instance
Nov 29 18:01:13 user nova-compute[74613]: DEBUG nova.compute.manager [None req-b088923d-6a5e-47b5-857e-8e5316db80f5 tempest-VolumesAdminNegativeTest-636556351 tempest-VolumesAdminNegativeTest-636556351-project-member] [instance: 481055d5-0f19-4637-9b00-869967ea7889] Start destroying the instance on the hypervisor. {{(pid=74613) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 29 18:01:14 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:01:14 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:01:14 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:01:14 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:01:14 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:01:14 user nova-compute[74613]: INFO nova.virt.libvirt.driver [-] [instance: 481055d5-0f19-4637-9b00-869967ea7889] Instance destroyed successfully.
Nov 29 18:01:14 user nova-compute[74613]: DEBUG nova.objects.instance [None req-b088923d-6a5e-47b5-857e-8e5316db80f5 tempest-VolumesAdminNegativeTest-636556351 tempest-VolumesAdminNegativeTest-636556351-project-member] Lazy-loading 'resources' on Instance uuid 481055d5-0f19-4637-9b00-869967ea7889 {{(pid=74613) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 18:01:14 user nova-compute[74613]: DEBUG nova.virt.libvirt.vif [None req-b088923d-6a5e-47b5-857e-8e5316db80f5 tempest-VolumesAdminNegativeTest-636556351 tempest-VolumesAdminNegativeTest-636556351-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T17:59:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-537972870',display_name='tempest-VolumesAdminNegativeTest-server-537972870',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-537972870',id=21,image_ref='4217f428-8d9d-4ee1-9614-642d26d90c46',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-29T17:59:23Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='3832a80aaabc42ba8400823aa6b76c29',ramdisk_id='',reservation_id='r-6rumhxs6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='4217f428-8d9d-4ee1-9614-642d26d90c46',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesAdminNegativeTest-636556351',owner_user_name='tempest-VolumesAdminNegativeTest-636556351-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-29T17:59:24Z,user_data=None,user_id='30b382b3a0c44bdf8ea91ea3ae780243',uuid=481055d5-0f19-4637-9b00-869967ea7889,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "93e35c24-f93e-4a63-bffb-845d31c63cde", "address": "fa:16:3e:96:ed:fa", "network": {"id": "485e1e0d-aa2c-47c2-a010-c84e83dbcc9c", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-686908926-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3832a80aaabc42ba8400823aa6b76c29", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap93e35c24-f9", "ovs_interfaceid": "93e35c24-f93e-4a63-bffb-845d31c63cde", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74613) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 29 18:01:14 user nova-compute[74613]: DEBUG nova.network.os_vif_util [None req-b088923d-6a5e-47b5-857e-8e5316db80f5 tempest-VolumesAdminNegativeTest-636556351 tempest-VolumesAdminNegativeTest-636556351-project-member] Converting VIF {"id": "93e35c24-f93e-4a63-bffb-845d31c63cde", "address": "fa:16:3e:96:ed:fa", "network": {"id": "485e1e0d-aa2c-47c2-a010-c84e83dbcc9c", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-686908926-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3832a80aaabc42ba8400823aa6b76c29", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap93e35c24-f9", "ovs_interfaceid": "93e35c24-f93e-4a63-bffb-845d31c63cde", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74613) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 18:01:14 user nova-compute[74613]: DEBUG nova.network.os_vif_util [None req-b088923d-6a5e-47b5-857e-8e5316db80f5 tempest-VolumesAdminNegativeTest-636556351 tempest-VolumesAdminNegativeTest-636556351-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:96:ed:fa,bridge_name='br-int',has_traffic_filtering=True,id=93e35c24-f93e-4a63-bffb-845d31c63cde,network=Network(485e1e0d-aa2c-47c2-a010-c84e83dbcc9c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap93e35c24-f9') {{(pid=74613) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 18:01:14 user nova-compute[74613]: DEBUG os_vif [None req-b088923d-6a5e-47b5-857e-8e5316db80f5 tempest-VolumesAdminNegativeTest-636556351 tempest-VolumesAdminNegativeTest-636556351-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:96:ed:fa,bridge_name='br-int',has_traffic_filtering=True,id=93e35c24-f93e-4a63-bffb-845d31c63cde,network=Network(485e1e0d-aa2c-47c2-a010-c84e83dbcc9c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap93e35c24-f9') {{(pid=74613) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 29 18:01:14 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:01:14 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap93e35c24-f9, bridge=br-int, if_exists=True) {{(pid=74613) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 18:01:14 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:01:14 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 18:01:14 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:01:14 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:01:14 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=5e277923-1b3b-467a-ac56-1ea8caed00f6) {{(pid=74613) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 18:01:14 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:01:14 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:01:14 user nova-compute[74613]: INFO os_vif [None req-b088923d-6a5e-47b5-857e-8e5316db80f5 tempest-VolumesAdminNegativeTest-636556351 tempest-VolumesAdminNegativeTest-636556351-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:96:ed:fa,bridge_name='br-int',has_traffic_filtering=True,id=93e35c24-f93e-4a63-bffb-845d31c63cde,network=Network(485e1e0d-aa2c-47c2-a010-c84e83dbcc9c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap93e35c24-f9')
Nov 29 18:01:14 user nova-compute[74613]: INFO nova.virt.libvirt.driver [None req-b088923d-6a5e-47b5-857e-8e5316db80f5 tempest-VolumesAdminNegativeTest-636556351 tempest-VolumesAdminNegativeTest-636556351-project-member] [instance: 481055d5-0f19-4637-9b00-869967ea7889] Deleting instance files /opt/stack/data/nova/instances/481055d5-0f19-4637-9b00-869967ea7889_del
Nov 29 18:01:14 user nova-compute[74613]: INFO nova.virt.libvirt.driver [None req-b088923d-6a5e-47b5-857e-8e5316db80f5 tempest-VolumesAdminNegativeTest-636556351 tempest-VolumesAdminNegativeTest-636556351-project-member] [instance: 481055d5-0f19-4637-9b00-869967ea7889] Deletion of /opt/stack/data/nova/instances/481055d5-0f19-4637-9b00-869967ea7889_del complete
Nov 29 18:01:14 user nova-compute[74613]: INFO nova.compute.manager [None req-b088923d-6a5e-47b5-857e-8e5316db80f5 tempest-VolumesAdminNegativeTest-636556351 tempest-VolumesAdminNegativeTest-636556351-project-member] [instance: 481055d5-0f19-4637-9b00-869967ea7889] Took 0.70 seconds to destroy the instance on the hypervisor.
Nov 29 18:01:14 user nova-compute[74613]: DEBUG oslo.service.loopingcall [None req-b088923d-6a5e-47b5-857e-8e5316db80f5 tempest-VolumesAdminNegativeTest-636556351 tempest-VolumesAdminNegativeTest-636556351-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74613) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 29 18:01:14 user nova-compute[74613]: DEBUG nova.compute.manager [-] [instance: 481055d5-0f19-4637-9b00-869967ea7889] Deallocating network for instance {{(pid=74613) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 29 18:01:14 user nova-compute[74613]: DEBUG nova.network.neutron [-] [instance: 481055d5-0f19-4637-9b00-869967ea7889] deallocate_for_instance() {{(pid=74613) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 29 18:01:15 user nova-compute[74613]: DEBUG nova.network.neutron [-] [instance: 481055d5-0f19-4637-9b00-869967ea7889] Updating instance_info_cache with network_info: [] {{(pid=74613) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 18:01:15 user nova-compute[74613]: INFO nova.compute.manager [-] [instance: 481055d5-0f19-4637-9b00-869967ea7889] Took 0.50 seconds to deallocate network for instance.
Nov 29 18:01:15 user nova-compute[74613]: DEBUG nova.compute.manager [req-db1d0d9b-9538-4002-9267-5e8bb0af4486 req-f1135d23-0a58-44af-88a5-c53b5e73242e service nova] [instance: 481055d5-0f19-4637-9b00-869967ea7889] Received event network-vif-deleted-93e35c24-f93e-4a63-bffb-845d31c63cde {{(pid=74613) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 18:01:15 user nova-compute[74613]: INFO nova.compute.manager [req-db1d0d9b-9538-4002-9267-5e8bb0af4486 req-f1135d23-0a58-44af-88a5-c53b5e73242e service nova] [instance: 481055d5-0f19-4637-9b00-869967ea7889] Neutron deleted interface 93e35c24-f93e-4a63-bffb-845d31c63cde; detaching it from the instance and deleting it from the info cache
Nov 29 18:01:15 user nova-compute[74613]: DEBUG nova.network.neutron [req-db1d0d9b-9538-4002-9267-5e8bb0af4486 req-f1135d23-0a58-44af-88a5-c53b5e73242e service nova] [instance: 481055d5-0f19-4637-9b00-869967ea7889] Updating instance_info_cache with network_info: [] {{(pid=74613) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 18:01:15 user nova-compute[74613]: DEBUG nova.compute.manager [req-db1d0d9b-9538-4002-9267-5e8bb0af4486 req-f1135d23-0a58-44af-88a5-c53b5e73242e service nova] [instance: 481055d5-0f19-4637-9b00-869967ea7889] Detach interface failed, port_id=93e35c24-f93e-4a63-bffb-845d31c63cde, reason: Instance 481055d5-0f19-4637-9b00-869967ea7889 could not be found. {{(pid=74613) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 29 18:01:15 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-b088923d-6a5e-47b5-857e-8e5316db80f5 tempest-VolumesAdminNegativeTest-636556351 tempest-VolumesAdminNegativeTest-636556351-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 18:01:15 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-b088923d-6a5e-47b5-857e-8e5316db80f5 tempest-VolumesAdminNegativeTest-636556351 tempest-VolumesAdminNegativeTest-636556351-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 18:01:15 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:01:15 user nova-compute[74613]: DEBUG nova.compute.manager [req-a3225928-01c5-4f27-b8db-6b700b7c727e req-9bbcbf6d-c429-4f32-9e9c-6e350d8b1569 service nova] [instance: 481055d5-0f19-4637-9b00-869967ea7889] Received event network-vif-unplugged-93e35c24-f93e-4a63-bffb-845d31c63cde {{(pid=74613) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 18:01:15 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-a3225928-01c5-4f27-b8db-6b700b7c727e req-9bbcbf6d-c429-4f32-9e9c-6e350d8b1569 service nova] Acquiring lock "481055d5-0f19-4637-9b00-869967ea7889-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 18:01:15 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-a3225928-01c5-4f27-b8db-6b700b7c727e req-9bbcbf6d-c429-4f32-9e9c-6e350d8b1569 service nova] Lock "481055d5-0f19-4637-9b00-869967ea7889-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 18:01:15 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-a3225928-01c5-4f27-b8db-6b700b7c727e req-9bbcbf6d-c429-4f32-9e9c-6e350d8b1569 service nova] Lock "481055d5-0f19-4637-9b00-869967ea7889-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 18:01:15 user nova-compute[74613]: DEBUG nova.compute.manager [req-a3225928-01c5-4f27-b8db-6b700b7c727e req-9bbcbf6d-c429-4f32-9e9c-6e350d8b1569 service nova] [instance: 481055d5-0f19-4637-9b00-869967ea7889] No waiting events found dispatching network-vif-unplugged-93e35c24-f93e-4a63-bffb-845d31c63cde {{(pid=74613) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 18:01:15 user nova-compute[74613]: WARNING nova.compute.manager [req-a3225928-01c5-4f27-b8db-6b700b7c727e req-9bbcbf6d-c429-4f32-9e9c-6e350d8b1569 service nova] [instance: 481055d5-0f19-4637-9b00-869967ea7889] Received unexpected event network-vif-unplugged-93e35c24-f93e-4a63-bffb-845d31c63cde for instance with vm_state deleted and task_state None.
Nov 29 18:01:15 user nova-compute[74613]: DEBUG nova.compute.manager [req-a3225928-01c5-4f27-b8db-6b700b7c727e req-9bbcbf6d-c429-4f32-9e9c-6e350d8b1569 service nova] [instance: 481055d5-0f19-4637-9b00-869967ea7889] Received event network-vif-plugged-93e35c24-f93e-4a63-bffb-845d31c63cde {{(pid=74613) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 18:01:15 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-a3225928-01c5-4f27-b8db-6b700b7c727e req-9bbcbf6d-c429-4f32-9e9c-6e350d8b1569 service nova] Acquiring lock "481055d5-0f19-4637-9b00-869967ea7889-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 18:01:15 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-a3225928-01c5-4f27-b8db-6b700b7c727e req-9bbcbf6d-c429-4f32-9e9c-6e350d8b1569 service nova] Lock "481055d5-0f19-4637-9b00-869967ea7889-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 18:01:15 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-a3225928-01c5-4f27-b8db-6b700b7c727e req-9bbcbf6d-c429-4f32-9e9c-6e350d8b1569 service nova] Lock "481055d5-0f19-4637-9b00-869967ea7889-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 18:01:15 user nova-compute[74613]: DEBUG nova.compute.manager [req-a3225928-01c5-4f27-b8db-6b700b7c727e req-9bbcbf6d-c429-4f32-9e9c-6e350d8b1569 service nova] [instance: 481055d5-0f19-4637-9b00-869967ea7889] No waiting events found dispatching network-vif-plugged-93e35c24-f93e-4a63-bffb-845d31c63cde {{(pid=74613) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 18:01:15 user nova-compute[74613]: WARNING nova.compute.manager [req-a3225928-01c5-4f27-b8db-6b700b7c727e req-9bbcbf6d-c429-4f32-9e9c-6e350d8b1569 service nova] [instance: 481055d5-0f19-4637-9b00-869967ea7889] Received unexpected event network-vif-plugged-93e35c24-f93e-4a63-bffb-845d31c63cde for instance with vm_state deleted and task_state None.
Nov 29 18:01:15 user nova-compute[74613]: DEBUG nova.compute.provider_tree [None req-b088923d-6a5e-47b5-857e-8e5316db80f5 tempest-VolumesAdminNegativeTest-636556351 tempest-VolumesAdminNegativeTest-636556351-project-member] Inventory has not changed in ProviderTree for provider: 639d980e-3b12-44b1-b8f4-1812416fa4dd {{(pid=74613) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 18:01:15 user nova-compute[74613]: DEBUG nova.scheduler.client.report [None req-b088923d-6a5e-47b5-857e-8e5316db80f5 tempest-VolumesAdminNegativeTest-636556351 tempest-VolumesAdminNegativeTest-636556351-project-member] Inventory has not changed for provider 639d980e-3b12-44b1-b8f4-1812416fa4dd based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74613) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 18:01:15 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-b088923d-6a5e-47b5-857e-8e5316db80f5 tempest-VolumesAdminNegativeTest-636556351 tempest-VolumesAdminNegativeTest-636556351-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.392s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 18:01:15 user nova-compute[74613]: INFO nova.scheduler.client.report [None req-b088923d-6a5e-47b5-857e-8e5316db80f5 tempest-VolumesAdminNegativeTest-636556351 tempest-VolumesAdminNegativeTest-636556351-project-member] Deleted allocations for instance 481055d5-0f19-4637-9b00-869967ea7889
Nov 29 18:01:15 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-b088923d-6a5e-47b5-857e-8e5316db80f5 tempest-VolumesAdminNegativeTest-636556351 tempest-VolumesAdminNegativeTest-636556351-project-member] Lock "481055d5-0f19-4637-9b00-869967ea7889" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.816s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 18:01:16 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-5e7985cd-09c5-418d-aaa8-501285537cbe tempest-TestServerVolumeAttachScenarioOldVersion-673194571 tempest-TestServerVolumeAttachScenarioOldVersion-673194571-project-member] Acquiring lock "5221f9b9-e4db-406b-ae82-4a7c6522ee64" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 18:01:16 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-5e7985cd-09c5-418d-aaa8-501285537cbe tempest-TestServerVolumeAttachScenarioOldVersion-673194571 tempest-TestServerVolumeAttachScenarioOldVersion-673194571-project-member] Lock "5221f9b9-e4db-406b-ae82-4a7c6522ee64" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 18:01:16 user nova-compute[74613]: DEBUG nova.objects.instance [None req-5e7985cd-09c5-418d-aaa8-501285537cbe tempest-TestServerVolumeAttachScenarioOldVersion-673194571 tempest-TestServerVolumeAttachScenarioOldVersion-673194571-project-member] Lazy-loading 'flavor' on Instance uuid 5221f9b9-e4db-406b-ae82-4a7c6522ee64 {{(pid=74613) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 18:01:16 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-5e7985cd-09c5-418d-aaa8-501285537cbe tempest-TestServerVolumeAttachScenarioOldVersion-673194571 tempest-TestServerVolumeAttachScenarioOldVersion-673194571-project-member] Lock "5221f9b9-e4db-406b-ae82-4a7c6522ee64" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.053s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 18:01:16 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-5e7985cd-09c5-418d-aaa8-501285537cbe tempest-TestServerVolumeAttachScenarioOldVersion-673194571 tempest-TestServerVolumeAttachScenarioOldVersion-673194571-project-member] Acquiring lock "5221f9b9-e4db-406b-ae82-4a7c6522ee64" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 18:01:16 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-5e7985cd-09c5-418d-aaa8-501285537cbe tempest-TestServerVolumeAttachScenarioOldVersion-673194571 tempest-TestServerVolumeAttachScenarioOldVersion-673194571-project-member] Lock "5221f9b9-e4db-406b-ae82-4a7c6522ee64" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 18:01:16 user nova-compute[74613]: INFO nova.compute.manager [None req-5e7985cd-09c5-418d-aaa8-501285537cbe tempest-TestServerVolumeAttachScenarioOldVersion-673194571 tempest-TestServerVolumeAttachScenarioOldVersion-673194571-project-member] [instance: 5221f9b9-e4db-406b-ae82-4a7c6522ee64] Attaching volume 20ab0918-fec2-4fb1-a347-e54c77fd253f to /dev/vdb
Nov 29 18:01:16 user nova-compute[74613]: DEBUG os_brick.utils [None req-5e7985cd-09c5-418d-aaa8-501285537cbe tempest-TestServerVolumeAttachScenarioOldVersion-673194571 tempest-TestServerVolumeAttachScenarioOldVersion-673194571-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74613) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 18:01:16 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:01:16 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:01:16 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[2310915f-f494-4042-a7ac-d9673373c0c9]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:400972819b5\n', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 18:01:16 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:01:16 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:01:16 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[c82228e5-ff86-4340-bbc6-3ce6f047270c]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 18:01:16 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:01:16 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:01:16 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[c07c75db-21cb-4e83-9f6d-f71663d4211b]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 18:01:16 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[83c02200-5000-4cca-b43b-9eb31a18fffd]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 18:01:16 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-5e7985cd-09c5-418d-aaa8-501285537cbe tempest-TestServerVolumeAttachScenarioOldVersion-673194571 tempest-TestServerVolumeAttachScenarioOldVersion-673194571-project-member] Running cmd (subprocess): nvme version {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:01:16 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-5e7985cd-09c5-418d-aaa8-501285537cbe tempest-TestServerVolumeAttachScenarioOldVersion-673194571 tempest-TestServerVolumeAttachScenarioOldVersion-673194571-project-member] 'nvme version' failed. Not Retrying. {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 18:01:16 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.nvmeof [None req-5e7985cd-09c5-418d-aaa8-501285537cbe tempest-TestServerVolumeAttachScenarioOldVersion-673194571 tempest-TestServerVolumeAttachScenarioOldVersion-673194571-project-member] nvme not present on system {{(pid=74613) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 29 18:01:16 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:01:16 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 18:01:16 user nova-compute[74613]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 29 18:01:16 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e3fffe9-188c-4b95-aa9a-9877911b1845]: (4, '') {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 18:01:16 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.lightos [None req-5e7985cd-09c5-418d-aaa8-501285537cbe tempest-TestServerVolumeAttachScenarioOldVersion-673194571 tempest-TestServerVolumeAttachScenarioOldVersion-673194571-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74613) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 29 18:01:16 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.lightos [None req-5e7985cd-09c5-418d-aaa8-501285537cbe tempest-TestServerVolumeAttachScenarioOldVersion-673194571 tempest-TestServerVolumeAttachScenarioOldVersion-673194571-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74613) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 29 18:01:16 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.lightos [None req-5e7985cd-09c5-418d-aaa8-501285537cbe tempest-TestServerVolumeAttachScenarioOldVersion-673194571 tempest-TestServerVolumeAttachScenarioOldVersion-673194571-project-member] LIGHTOS: no hostnqn found. {{(pid=74613) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 29 18:01:16 user nova-compute[74613]: DEBUG os_brick.utils [None req-5e7985cd-09c5-418d-aaa8-501285537cbe tempest-TestServerVolumeAttachScenarioOldVersion-673194571 tempest-TestServerVolumeAttachScenarioOldVersion-673194571-project-member] <== get_connector_properties: return (115ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:400972819b5', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74613) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 18:01:16 user nova-compute[74613]: DEBUG nova.virt.block_device [None req-5e7985cd-09c5-418d-aaa8-501285537cbe tempest-TestServerVolumeAttachScenarioOldVersion-673194571 tempest-TestServerVolumeAttachScenarioOldVersion-673194571-project-member] [instance: 5221f9b9-e4db-406b-ae82-4a7c6522ee64] Updating existing volume attachment record: 06e0c810-331f-4031-bcc6-2eddf7f3573e {{(pid=74613) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 29 18:01:18 user nova-compute[74613]: DEBUG oslo_service.periodic_task [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74613) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 18:01:18 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 18:01:18 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 18:01:18 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 18:01:18 user nova-compute[74613]: DEBUG nova.compute.resource_tracker [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Auditing locally available compute resources for user (node: user) {{(pid=74613) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 29 18:01:18 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6c2ea311-0404-4ecf-8086-65f65186f858/disk --force-share --output=json {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:01:18 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6c2ea311-0404-4ecf-8086-65f65186f858/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:01:18 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6c2ea311-0404-4ecf-8086-65f65186f858/disk --force-share --output=json {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:01:19 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6c2ea311-0404-4ecf-8086-65f65186f858/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:01:19 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c4bdb712-e1f9-4fc0-b527-87088d7eddf8/disk --force-share --output=json {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:01:19 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c4bdb712-e1f9-4fc0-b527-87088d7eddf8/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:01:19 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c4bdb712-e1f9-4fc0-b527-87088d7eddf8/disk --force-share --output=json {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:01:19 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c4bdb712-e1f9-4fc0-b527-87088d7eddf8/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:01:19 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=74613) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 29 18:01:19 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3b828860-5cc5-40b0-b845-8e560211794e/disk --force-share --output=json {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:01:19 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:01:19 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3b828860-5cc5-40b0-b845-8e560211794e/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:01:19 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3b828860-5cc5-40b0-b845-8e560211794e/disk --force-share --output=json {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:01:19 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3b828860-5cc5-40b0-b845-8e560211794e/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:01:19 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/abc9e2b8-f467-4cd0-b40f-de511fde1ec1/disk --force-share --output=json {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:01:20 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/abc9e2b8-f467-4cd0-b40f-de511fde1ec1/disk --force-share --output=json" returned: 0 in 0.209s {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:01:20 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/abc9e2b8-f467-4cd0-b40f-de511fde1ec1/disk --force-share --output=json {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:01:20 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/abc9e2b8-f467-4cd0-b40f-de511fde1ec1/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:01:20 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0aa463c6-01e7-48e5-b082-e083558342e3/disk --force-share --output=json {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:01:20 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:01:20 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0aa463c6-01e7-48e5-b082-e083558342e3/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:01:20 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0aa463c6-01e7-48e5-b082-e083558342e3/disk --force-share --output=json {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:01:20 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0aa463c6-01e7-48e5-b082-e083558342e3/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:01:20 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74613) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 29 18:01:20 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8fc8496b-1435-4b5f-8977-6c0d7467ef65/disk --force-share --output=json {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:01:20 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8fc8496b-1435-4b5f-8977-6c0d7467ef65/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:01:20 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8fc8496b-1435-4b5f-8977-6c0d7467ef65/disk --force-share --output=json {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:01:21 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8fc8496b-1435-4b5f-8977-6c0d7467ef65/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:01:21 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5221f9b9-e4db-406b-ae82-4a7c6522ee64/disk --force-share --output=json {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:01:21 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5221f9b9-e4db-406b-ae82-4a7c6522ee64/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:01:21 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5221f9b9-e4db-406b-ae82-4a7c6522ee64/disk --force-share --output=json {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:01:21 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5221f9b9-e4db-406b-ae82-4a7c6522ee64/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:01:21 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/74ac9703-1cd7-4983-b7d4-c69b01fec7b2/disk --force-share --output=json {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:01:21 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/74ac9703-1cd7-4983-b7d4-c69b01fec7b2/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:01:21 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/74ac9703-1cd7-4983-b7d4-c69b01fec7b2/disk --force-share --output=json {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:01:21 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/74ac9703-1cd7-4983-b7d4-c69b01fec7b2/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:01:21 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=74613) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 29 18:01:22 user nova-compute[74613]: WARNING nova.virt.libvirt.driver [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 18:01:22 user nova-compute[74613]: WARNING nova.virt.libvirt.driver [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 18:01:22 user nova-compute[74613]: DEBUG nova.compute.resource_tracker [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Hypervisor/Node resource view: name=user free_ram=7491MB free_disk=24.942676544189453GB free_vcpus=2 pci_devices=[{"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74613) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 29 18:01:22 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 18:01:22 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 18:01:22 user nova-compute[74613]: DEBUG nova.compute.resource_tracker [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Instance 3b828860-5cc5-40b0-b845-8e560211794e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74613) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 18:01:22 user nova-compute[74613]: DEBUG nova.compute.resource_tracker [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Instance abc9e2b8-f467-4cd0-b40f-de511fde1ec1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74613) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 18:01:22 user nova-compute[74613]: DEBUG nova.compute.resource_tracker [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Instance cd22685a-028c-4e0c-834d-e7b20f6d06ab actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74613) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 18:01:22 user nova-compute[74613]: DEBUG nova.compute.resource_tracker [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Instance c4bdb712-e1f9-4fc0-b527-87088d7eddf8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74613) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 18:01:22 user nova-compute[74613]: DEBUG nova.compute.resource_tracker [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Instance 0aa463c6-01e7-48e5-b082-e083558342e3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74613) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 18:01:22 user nova-compute[74613]: DEBUG nova.compute.resource_tracker [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Instance 74ac9703-1cd7-4983-b7d4-c69b01fec7b2 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74613) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 18:01:22 user nova-compute[74613]: DEBUG nova.compute.resource_tracker [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Instance 5221f9b9-e4db-406b-ae82-4a7c6522ee64 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74613) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 18:01:22 user nova-compute[74613]: DEBUG nova.compute.resource_tracker [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Instance 8fc8496b-1435-4b5f-8977-6c0d7467ef65 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74613) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 18:01:22 user nova-compute[74613]: DEBUG nova.compute.resource_tracker [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Instance fae10c60-f989-4c99-bde4-60cd9f3e2055 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74613) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 18:01:22 user nova-compute[74613]: DEBUG nova.compute.resource_tracker [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Instance 6c2ea311-0404-4ecf-8086-65f65186f858 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74613) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 18:01:22 user nova-compute[74613]: DEBUG nova.compute.resource_tracker [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Total usable vcpus: 12, total allocated vcpus: 10 {{(pid=74613) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 29 18:01:22 user nova-compute[74613]: DEBUG nova.compute.resource_tracker [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Final resource view: name=user phys_ram=16011MB used_ram=5632MB phys_disk=40GB used_disk=8GB total_vcpus=12 used_vcpus=10 pci_stats=[] {{(pid=74613) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 29 18:01:22 user nova-compute[74613]: DEBUG nova.compute.provider_tree [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Inventory has not changed in ProviderTree for provider: 639d980e-3b12-44b1-b8f4-1812416fa4dd {{(pid=74613) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 18:01:22 user nova-compute[74613]: DEBUG nova.scheduler.client.report [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Inventory has not changed for provider 639d980e-3b12-44b1-b8f4-1812416fa4dd based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74613) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 18:01:22 user nova-compute[74613]: DEBUG nova.compute.resource_tracker [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Compute_service record updated for user:user {{(pid=74613) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 29 18:01:22 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.493s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 18:01:24 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:01:24 user nova-compute[74613]: DEBUG oslo_service.periodic_task [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74613) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 18:01:24 user nova-compute[74613]: DEBUG oslo_service.periodic_task [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74613) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 18:01:24 user nova-compute[74613]: DEBUG nova.compute.manager [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Starting heal instance info cache {{(pid=74613) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 29 18:01:24 user nova-compute[74613]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5e7985cd-09c5-418d-aaa8-501285537cbe tempest-TestServerVolumeAttachScenarioOldVersion-673194571 tempest-TestServerVolumeAttachScenarioOldVersion-673194571-project-member] [instance: 5221f9b9-e4db-406b-ae82-4a7c6522ee64] Calling os-brick to attach iSCSI Volume {{(pid=74613) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 29 18:01:24 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e7985cd-09c5-418d-aaa8-501285537cbe tempest-TestServerVolumeAttachScenarioOldVersion-673194571 tempest-TestServerVolumeAttachScenarioOldVersion-673194571-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff828156890>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:20ab0918-fec2-4fb1-a347-e54c77fd253f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ZlpCYuEk', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74613) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 18:01:24 user nova-compute[74613]: WARNING os_brick.initiator.connectors.base [None req-5e7985cd-09c5-418d-aaa8-501285537cbe tempest-TestServerVolumeAttachScenarioOldVersion-673194571 tempest-TestServerVolumeAttachScenarioOldVersion-673194571-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 18:01:24 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.base [None req-5e7985cd-09c5-418d-aaa8-501285537cbe tempest-TestServerVolumeAttachScenarioOldVersion-673194571 tempest-TestServerVolumeAttachScenarioOldVersion-673194571-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 18:01:24 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.base [None req-5e7985cd-09c5-418d-aaa8-501285537cbe tempest-TestServerVolumeAttachScenarioOldVersion-673194571 tempest-TestServerVolumeAttachScenarioOldVersion-673194571-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 18:01:24 user nova-compute[74613]: WARNING os_brick.initiator.connectors.base [None req-5e7985cd-09c5-418d-aaa8-501285537cbe tempest-TestServerVolumeAttachScenarioOldVersion-673194571 tempest-TestServerVolumeAttachScenarioOldVersion-673194571-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 18:01:24 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.base [None req-5e7985cd-09c5-418d-aaa8-501285537cbe tempest-TestServerVolumeAttachScenarioOldVersion-673194571 tempest-TestServerVolumeAttachScenarioOldVersion-673194571-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:20ab0918-fec2-4fb1-a347-e54c77fd253f" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 18:01:24 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.base [None req-5e7985cd-09c5-418d-aaa8-501285537cbe tempest-TestServerVolumeAttachScenarioOldVersion-673194571 tempest-TestServerVolumeAttachScenarioOldVersion-673194571-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:20ab0918-fec2-4fb1-a347-e54c77fd253f" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 18:01:24 user nova-compute[74613]: INFO os_brick.initiator.connectors.iscsi [None req-5e7985cd-09c5-418d-aaa8-501285537cbe tempest-TestServerVolumeAttachScenarioOldVersion-673194571 tempest-TestServerVolumeAttachScenarioOldVersion-673194571-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 29 18:01:24 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:20ab0918-fec2-4fb1-a347-e54c77fd253f -p 172.16.0.220:3260 {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:01:24 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:20ab0918-fec2-4fb1-a347-e54c77fd253f -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:01:24 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[51a0206d-cdfc-42ee-8a22-0b4ad47c2176]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 18:01:24 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e7985cd-09c5-418d-aaa8-501285537cbe tempest-TestServerVolumeAttachScenarioOldVersion-673194571 tempest-TestServerVolumeAttachScenarioOldVersion-673194571-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 29 18:01:24 user nova-compute[74613]:  {{(pid=74613) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 18:01:24 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:20ab0918-fec2-4fb1-a347-e54c77fd253f -p 172.16.0.220:3260 --interface default --op new {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:01:24 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:20ab0918-fec2-4fb1-a347-e54c77fd253f -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:01:24 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[228d4800-4444-4d0f-ad5e-5160a6126a9f]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:20ab0918-fec2-4fb1-a347-e54c77fd253f] added\n', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 18:01:24 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e7985cd-09c5-418d-aaa8-501285537cbe tempest-TestServerVolumeAttachScenarioOldVersion-673194571 tempest-TestServerVolumeAttachScenarioOldVersion-673194571-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:20ab0918-fec2-4fb1-a347-e54c77fd253f] added
Nov 29 18:01:24 user nova-compute[74613]:  stderr= {{(pid=74613) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 18:01:24 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:20ab0918-fec2-4fb1-a347-e54c77fd253f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:01:24 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:20ab0918-fec2-4fb1-a347-e54c77fd253f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:01:24 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[629dd279-ee4d-4389-b0d9-5fdf5e4816ec]: (4, ('', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 18:01:24 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e7985cd-09c5-418d-aaa8-501285537cbe tempest-TestServerVolumeAttachScenarioOldVersion-673194571 tempest-TestServerVolumeAttachScenarioOldVersion-673194571-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74613) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 18:01:24 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Acquiring lock "refresh_cache-74ac9703-1cd7-4983-b7d4-c69b01fec7b2" {{(pid=74613) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 18:01:24 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Acquired lock "refresh_cache-74ac9703-1cd7-4983-b7d4-c69b01fec7b2" {{(pid=74613) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 18:01:24 user nova-compute[74613]: DEBUG nova.network.neutron [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] [instance: 74ac9703-1cd7-4983-b7d4-c69b01fec7b2] Forcefully refreshing network info cache for instance {{(pid=74613) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 29 18:01:24 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:20ab0918-fec2-4fb1-a347-e54c77fd253f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:01:24 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:20ab0918-fec2-4fb1-a347-e54c77fd253f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.025s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:01:24 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ab76ad8-7f60-407a-8884-112bf68d2e50]: (4, ('', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 18:01:24 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e7985cd-09c5-418d-aaa8-501285537cbe tempest-TestServerVolumeAttachScenarioOldVersion-673194571 tempest-TestServerVolumeAttachScenarioOldVersion-673194571-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74613) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 18:01:24 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:20ab0918-fec2-4fb1-a347-e54c77fd253f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ZlpCYuEk {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:01:24 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:20ab0918-fec2-4fb1-a347-e54c77fd253f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ZlpCYuEk" returned: 0 in 0.021s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:01:24 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[d955d53a-0996-424e-9316-d5759dca9b61]: (4, ('', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 18:01:24 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e7985cd-09c5-418d-aaa8-501285537cbe tempest-TestServerVolumeAttachScenarioOldVersion-673194571 tempest-TestServerVolumeAttachScenarioOldVersion-673194571-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'ZlpCYuEk'): stdout= stderr= {{(pid=74613) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 18:01:24 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:20ab0918-fec2-4fb1-a347-e54c77fd253f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:01:24 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:20ab0918-fec2-4fb1-a347-e54c77fd253f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:01:24 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[6205452b-b6db-49a2-a060-f7cfdeb8adcd]: (4, ('', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 18:01:24 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e7985cd-09c5-418d-aaa8-501285537cbe tempest-TestServerVolumeAttachScenarioOldVersion-673194571 tempest-TestServerVolumeAttachScenarioOldVersion-673194571-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74613) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 18:01:24 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:01:24 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:01:24 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d9a617a-e096-4588-9354-71541c19a983]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9511387c-8772-40f2-bf2d-6b6387649e9f (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a07b572-6430-4d0f-9aaf-8a8dbc39831e (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb526b54-3017-4f30-b5c7-88027b146d52 (non-flash)\n', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 18:01:24 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e7985cd-09c5-418d-aaa8-501285537cbe tempest-TestServerVolumeAttachScenarioOldVersion-673194571 tempest-TestServerVolumeAttachScenarioOldVersion-673194571-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9511387c-8772-40f2-bf2d-6b6387649e9f (non-flash)
Nov 29 18:01:24 user nova-compute[74613]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a07b572-6430-4d0f-9aaf-8a8dbc39831e (non-flash)
Nov 29 18:01:24 user nova-compute[74613]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb526b54-3017-4f30-b5c7-88027b146d52 (non-flash)
Nov 29 18:01:24 user nova-compute[74613]:  stderr= {{(pid=74613) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 18:01:24 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e7985cd-09c5-418d-aaa8-501285537cbe tempest-TestServerVolumeAttachScenarioOldVersion-673194571 tempest-TestServerVolumeAttachScenarioOldVersion-673194571-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9511387c-8772-40f2-bf2d-6b6387649e9f (non-flash)
Nov 29 18:01:24 user nova-compute[74613]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a07b572-6430-4d0f-9aaf-8a8dbc39831e (non-flash)
Nov 29 18:01:24 user nova-compute[74613]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb526b54-3017-4f30-b5c7-88027b146d52 (non-flash)
Nov 29 18:01:24 user nova-compute[74613]:  stderr= {{(pid=74613) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 18:01:24 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:20ab0918-fec2-4fb1-a347-e54c77fd253f -p 172.16.0.220:3260 --login {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:01:25 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:20ab0918-fec2-4fb1-a347-e54c77fd253f -p 172.16.0.220:3260 --login" returned: 0 in 0.066s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:01:25 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[175c3e2e-b439-42ed-afac-114f5eeb59f6]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:20ab0918-fec2-4fb1-a347-e54c77fd253f, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:20ab0918-fec2-4fb1-a347-e54c77fd253f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 18:01:25 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e7985cd-09c5-418d-aaa8-501285537cbe tempest-TestServerVolumeAttachScenarioOldVersion-673194571 tempest-TestServerVolumeAttachScenarioOldVersion-673194571-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:20ab0918-fec2-4fb1-a347-e54c77fd253f, portal: 172.16.0.220,3260]
Nov 29 18:01:25 user nova-compute[74613]: Login to [iface: default, target: iqn.2010-10.org.openstack:20ab0918-fec2-4fb1-a347-e54c77fd253f, portal: 172.16.0.220,3260] successful.
Nov 29 18:01:25 user nova-compute[74613]:  stderr= {{(pid=74613) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 18:01:25 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:20ab0918-fec2-4fb1-a347-e54c77fd253f -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:01:25 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:20ab0918-fec2-4fb1-a347-e54c77fd253f -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:01:25 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4dd62bd-b6a7-4381-b4f4-d84d3c51233b]: (4, ('', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 18:01:25 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e7985cd-09c5-418d-aaa8-501285537cbe tempest-TestServerVolumeAttachScenarioOldVersion-673194571 tempest-TestServerVolumeAttachScenarioOldVersion-673194571-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74613) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 18:01:25 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:01:25 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:01:25 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5dcab2e-24fc-4c99-a364-5fbbf2cec461]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9511387c-8772-40f2-bf2d-6b6387649e9f (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a07b572-6430-4d0f-9aaf-8a8dbc39831e (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb526b54-3017-4f30-b5c7-88027b146d52 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20ab0918-fec2-4fb1-a347-e54c77fd253f (non-flash)\n', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 18:01:25 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e7985cd-09c5-418d-aaa8-501285537cbe tempest-TestServerVolumeAttachScenarioOldVersion-673194571 tempest-TestServerVolumeAttachScenarioOldVersion-673194571-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9511387c-8772-40f2-bf2d-6b6387649e9f (non-flash)
Nov 29 18:01:25 user nova-compute[74613]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a07b572-6430-4d0f-9aaf-8a8dbc39831e (non-flash)
Nov 29 18:01:25 user nova-compute[74613]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb526b54-3017-4f30-b5c7-88027b146d52 (non-flash)
Nov 29 18:01:25 user nova-compute[74613]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20ab0918-fec2-4fb1-a347-e54c77fd253f (non-flash)
Nov 29 18:01:25 user nova-compute[74613]:  stderr= {{(pid=74613) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 18:01:25 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e7985cd-09c5-418d-aaa8-501285537cbe tempest-TestServerVolumeAttachScenarioOldVersion-673194571 tempest-TestServerVolumeAttachScenarioOldVersion-673194571-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9511387c-8772-40f2-bf2d-6b6387649e9f (non-flash)
Nov 29 18:01:25 user nova-compute[74613]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a07b572-6430-4d0f-9aaf-8a8dbc39831e (non-flash)
Nov 29 18:01:25 user nova-compute[74613]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb526b54-3017-4f30-b5c7-88027b146d52 (non-flash)
Nov 29 18:01:25 user nova-compute[74613]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20ab0918-fec2-4fb1-a347-e54c77fd253f (non-flash)
Nov 29 18:01:25 user nova-compute[74613]:  stderr= {{(pid=74613) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 18:01:25 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.base [None req-5e7985cd-09c5-418d-aaa8-501285537cbe tempest-TestServerVolumeAttachScenarioOldVersion-673194571 tempest-TestServerVolumeAttachScenarioOldVersion-673194571-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:20ab0918-fec2-4fb1-a347-e54c77fd253f" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.297s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 18:01:25 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e7985cd-09c5-418d-aaa8-501285537cbe tempest-TestServerVolumeAttachScenarioOldVersion-673194571 tempest-TestServerVolumeAttachScenarioOldVersion-673194571-project-member] Connected to 172.16.0.220:3260 {{(pid=74613) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 29 18:01:25 user nova-compute[74613]: DEBUG os_brick.initiator.linuxscsi [None req-5e7985cd-09c5-418d-aaa8-501285537cbe tempest-TestServerVolumeAttachScenarioOldVersion-673194571 tempest-TestServerVolumeAttachScenarioOldVersion-673194571-project-member] HCTL ('36', '-', '-', 0) found on session 26 with lun 0 {{(pid=74613) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 29 18:01:25 user nova-compute[74613]: DEBUG os_brick.initiator.linuxscsi [None req-5e7985cd-09c5-418d-aaa8-501285537cbe tempest-TestServerVolumeAttachScenarioOldVersion-673194571 tempest-TestServerVolumeAttachScenarioOldVersion-673194571-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=74613) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 29 18:01:25 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:01:25 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.016s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:01:25 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[4bd6eb0a-8812-4618-9243-dc00f9e3ff20]: (4, ('- - 0', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 18:01:25 user nova-compute[74613]: DEBUG os_brick.initiator.linuxscsi [None req-5e7985cd-09c5-418d-aaa8-501285537cbe tempest-TestServerVolumeAttachScenarioOldVersion-673194571 tempest-TestServerVolumeAttachScenarioOldVersion-673194571-project-member] Searching for a device in session 26 and hctl ['36', '*', '*', 0] yield: sde {{(pid=74613) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 29 18:01:25 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e7985cd-09c5-418d-aaa8-501285537cbe tempest-TestServerVolumeAttachScenarioOldVersion-673194571 tempest-TestServerVolumeAttachScenarioOldVersion-673194571-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:20ab0918-fec2-4fb1-a347-e54c77fd253f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ZlpCYuEk', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74613) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 29 18:01:25 user nova-compute[74613]: DEBUG nova.network.neutron [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] [instance: 74ac9703-1cd7-4983-b7d4-c69b01fec7b2] Updating instance_info_cache with network_info: [{"id": "c63b6577-fb46-437a-95b3-8321fab45d0c", "address": "fa:16:3e:c3:2e:71", "network": {"id": "e687ed60-2592-4836-b97e-0828527b1b9f", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1938956411-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.143", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b392ca87608940c0ae467318b66453b2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc63b6577-fb", "ovs_interfaceid": "c63b6577-fb46-437a-95b3-8321fab45d0c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74613) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 18:01:25 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Releasing lock "refresh_cache-74ac9703-1cd7-4983-b7d4-c69b01fec7b2" {{(pid=74613) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 18:01:25 user nova-compute[74613]: DEBUG nova.compute.manager [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] [instance: 74ac9703-1cd7-4983-b7d4-c69b01fec7b2] Updated the network info_cache for instance {{(pid=74613) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 29 18:01:25 user nova-compute[74613]: DEBUG oslo_service.periodic_task [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74613) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 18:01:25 user nova-compute[74613]: DEBUG oslo_service.periodic_task [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74613) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 18:01:25 user nova-compute[74613]: DEBUG oslo_service.periodic_task [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74613) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 18:01:25 user nova-compute[74613]: DEBUG oslo_service.periodic_task [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74613) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 18:01:25 user nova-compute[74613]: DEBUG nova.compute.manager [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74613) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 29 18:01:25 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:01:25 user nova-compute[74613]: DEBUG oslo_service.periodic_task [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74613) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 18:01:25 user nova-compute[74613]: DEBUG oslo_service.periodic_task [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74613) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 18:01:26 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.base [None req-5e7985cd-09c5-418d-aaa8-501285537cbe tempest-TestServerVolumeAttachScenarioOldVersion-673194571 tempest-TestServerVolumeAttachScenarioOldVersion-673194571-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.334s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 18:01:26 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e7985cd-09c5-418d-aaa8-501285537cbe tempest-TestServerVolumeAttachScenarioOldVersion-673194571 tempest-TestServerVolumeAttachScenarioOldVersion-673194571-project-member] <== connect_volume: return (1336ms) {'type': 'block', 'scsi_wwn': '26438653737346662', 'path': '/dev/sde'} {{(pid=74613) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 18:01:26 user nova-compute[74613]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5e7985cd-09c5-418d-aaa8-501285537cbe tempest-TestServerVolumeAttachScenarioOldVersion-673194571 tempest-TestServerVolumeAttachScenarioOldVersion-673194571-project-member] [instance: 5221f9b9-e4db-406b-ae82-4a7c6522ee64] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26438653737346662', 'path': '/dev/sde'} {{(pid=74613) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 29 18:01:26 user nova-compute[74613]: DEBUG nova.objects.instance [None req-5e7985cd-09c5-418d-aaa8-501285537cbe tempest-TestServerVolumeAttachScenarioOldVersion-673194571 tempest-TestServerVolumeAttachScenarioOldVersion-673194571-project-member] Lazy-loading 'flavor' on Instance uuid 5221f9b9-e4db-406b-ae82-4a7c6522ee64 {{(pid=74613) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 18:01:26 user nova-compute[74613]: DEBUG nova.virt.libvirt.guest [None req-5e7985cd-09c5-418d-aaa8-501285537cbe tempest-TestServerVolumeAttachScenarioOldVersion-673194571 tempest-TestServerVolumeAttachScenarioOldVersion-673194571-project-member] attach device xml: <disk type="block" device="disk">
Nov 29 18:01:26 user nova-compute[74613]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 18:01:26 user nova-compute[74613]:   <source dev="/dev/sde"/>
Nov 29 18:01:26 user nova-compute[74613]:   <target dev="vdb" bus="virtio"/>
Nov 29 18:01:26 user nova-compute[74613]:   <serial>20ab0918-fec2-4fb1-a347-e54c77fd253f</serial>
Nov 29 18:01:26 user nova-compute[74613]: </disk>
Nov 29 18:01:26 user nova-compute[74613]:  {{(pid=74613) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 29 18:01:26 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-5e7985cd-09c5-418d-aaa8-501285537cbe tempest-TestServerVolumeAttachScenarioOldVersion-673194571 tempest-TestServerVolumeAttachScenarioOldVersion-673194571-project-member] No BDM found with device name vda, not building metadata. {{(pid=74613) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 18:01:26 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-5e7985cd-09c5-418d-aaa8-501285537cbe tempest-TestServerVolumeAttachScenarioOldVersion-673194571 tempest-TestServerVolumeAttachScenarioOldVersion-673194571-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74613) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 18:01:26 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-5e7985cd-09c5-418d-aaa8-501285537cbe tempest-TestServerVolumeAttachScenarioOldVersion-673194571 tempest-TestServerVolumeAttachScenarioOldVersion-673194571-project-member] No VIF found with MAC fa:16:3e:bc:57:f9, not building metadata {{(pid=74613) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 29 18:01:26 user nova-compute[74613]: DEBUG oslo_service.periodic_task [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74613) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 18:01:26 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-5e7985cd-09c5-418d-aaa8-501285537cbe tempest-TestServerVolumeAttachScenarioOldVersion-673194571 tempest-TestServerVolumeAttachScenarioOldVersion-673194571-project-member] Lock "5221f9b9-e4db-406b-ae82-4a7c6522ee64" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 9.965s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 18:01:29 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-1e79b6f5-f288-4658-a811-77316fc11125 tempest-TestServerVolumeAttachScenarioOldVersion-673194571 tempest-TestServerVolumeAttachScenarioOldVersion-673194571-project-member] Acquiring lock "5221f9b9-e4db-406b-ae82-4a7c6522ee64" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 18:01:29 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-1e79b6f5-f288-4658-a811-77316fc11125 tempest-TestServerVolumeAttachScenarioOldVersion-673194571 tempest-TestServerVolumeAttachScenarioOldVersion-673194571-project-member] Lock "5221f9b9-e4db-406b-ae82-4a7c6522ee64" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 18:01:29 user nova-compute[74613]: INFO nova.compute.manager [None req-1e79b6f5-f288-4658-a811-77316fc11125 tempest-TestServerVolumeAttachScenarioOldVersion-673194571 tempest-TestServerVolumeAttachScenarioOldVersion-673194571-project-member] [instance: 5221f9b9-e4db-406b-ae82-4a7c6522ee64] Detaching volume 20ab0918-fec2-4fb1-a347-e54c77fd253f
Nov 29 18:01:29 user nova-compute[74613]: INFO nova.virt.block_device [None req-1e79b6f5-f288-4658-a811-77316fc11125 tempest-TestServerVolumeAttachScenarioOldVersion-673194571 tempest-TestServerVolumeAttachScenarioOldVersion-673194571-project-member] [instance: 5221f9b9-e4db-406b-ae82-4a7c6522ee64] Attempting to driver detach volume 20ab0918-fec2-4fb1-a347-e54c77fd253f from mountpoint /dev/vdb
Nov 29 18:01:29 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-1e79b6f5-f288-4658-a811-77316fc11125 tempest-TestServerVolumeAttachScenarioOldVersion-673194571 tempest-TestServerVolumeAttachScenarioOldVersion-673194571-project-member] Attempting to detach device vdb from instance 5221f9b9-e4db-406b-ae82-4a7c6522ee64 from the persistent domain config. {{(pid=74613) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 29 18:01:29 user nova-compute[74613]: DEBUG nova.virt.libvirt.guest [None req-1e79b6f5-f288-4658-a811-77316fc11125 tempest-TestServerVolumeAttachScenarioOldVersion-673194571 tempest-TestServerVolumeAttachScenarioOldVersion-673194571-project-member] detach device xml: <disk type="block" device="disk">
Nov 29 18:01:29 user nova-compute[74613]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 18:01:29 user nova-compute[74613]:   <source dev="/dev/sde"/>
Nov 29 18:01:29 user nova-compute[74613]:   <target dev="vdb" bus="virtio"/>
Nov 29 18:01:29 user nova-compute[74613]:   <serial>20ab0918-fec2-4fb1-a347-e54c77fd253f</serial>
Nov 29 18:01:29 user nova-compute[74613]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 29 18:01:29 user nova-compute[74613]: </disk>
Nov 29 18:01:29 user nova-compute[74613]:  {{(pid=74613) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 29 18:01:29 user nova-compute[74613]: INFO nova.virt.libvirt.driver [None req-1e79b6f5-f288-4658-a811-77316fc11125 tempest-TestServerVolumeAttachScenarioOldVersion-673194571 tempest-TestServerVolumeAttachScenarioOldVersion-673194571-project-member] Successfully detached device vdb from instance 5221f9b9-e4db-406b-ae82-4a7c6522ee64 from the persistent domain config.
Nov 29 18:01:29 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-1e79b6f5-f288-4658-a811-77316fc11125 tempest-TestServerVolumeAttachScenarioOldVersion-673194571 tempest-TestServerVolumeAttachScenarioOldVersion-673194571-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 5221f9b9-e4db-406b-ae82-4a7c6522ee64 from the live domain config. {{(pid=74613) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 29 18:01:29 user nova-compute[74613]: DEBUG nova.virt.libvirt.guest [None req-1e79b6f5-f288-4658-a811-77316fc11125 tempest-TestServerVolumeAttachScenarioOldVersion-673194571 tempest-TestServerVolumeAttachScenarioOldVersion-673194571-project-member] detach device xml: <disk type="block" device="disk">
Nov 29 18:01:29 user nova-compute[74613]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 18:01:29 user nova-compute[74613]:   <source dev="/dev/sde"/>
Nov 29 18:01:29 user nova-compute[74613]:   <target dev="vdb" bus="virtio"/>
Nov 29 18:01:29 user nova-compute[74613]:   <serial>20ab0918-fec2-4fb1-a347-e54c77fd253f</serial>
Nov 29 18:01:29 user nova-compute[74613]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 29 18:01:29 user nova-compute[74613]: </disk>
Nov 29 18:01:29 user nova-compute[74613]:  {{(pid=74613) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 29 18:01:29 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:01:29 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-1e79b6f5-f288-4658-a811-77316fc11125 tempest-TestServerVolumeAttachScenarioOldVersion-673194571 tempest-TestServerVolumeAttachScenarioOldVersion-673194571-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 5221f9b9-e4db-406b-ae82-4a7c6522ee64 {{(pid=74613) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 29 18:01:30 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:01:34 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:01:39 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:01:44 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 18:01:45 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:01:48 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:01:49 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:01:49 user nova-compute[74613]: WARNING nova.virt.libvirt.driver [None req-1e79b6f5-f288-4658-a811-77316fc11125 tempest-TestServerVolumeAttachScenarioOldVersion-673194571 tempest-TestServerVolumeAttachScenarioOldVersion-673194571-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 5221f9b9-e4db-406b-ae82-4a7c6522ee64 is timed out.
Nov 29 18:01:49 user nova-compute[74613]: INFO nova.virt.libvirt.driver [None req-1e79b6f5-f288-4658-a811-77316fc11125 tempest-TestServerVolumeAttachScenarioOldVersion-673194571 tempest-TestServerVolumeAttachScenarioOldVersion-673194571-project-member] Successfully detached device vdb from instance 5221f9b9-e4db-406b-ae82-4a7c6522ee64 from the live domain config.
Nov 29 18:01:49 user nova-compute[74613]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1e79b6f5-f288-4658-a811-77316fc11125 tempest-TestServerVolumeAttachScenarioOldVersion-673194571 tempest-TestServerVolumeAttachScenarioOldVersion-673194571-project-member] [instance: 5221f9b9-e4db-406b-ae82-4a7c6522ee64] calling os-brick to detach iSCSI Volume {{(pid=74613) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 29 18:01:49 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-1e79b6f5-f288-4658-a811-77316fc11125 tempest-TestServerVolumeAttachScenarioOldVersion-673194571 tempest-TestServerVolumeAttachScenarioOldVersion-673194571-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff828156890>, {'target_iqn': 'iqn.2010-10.org.openstack:20ab0918-fec2-4fb1-a347-e54c77fd253f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ZlpCYuEk', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': False}}" {{(pid=74613) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 18:01:49 user nova-compute[74613]: WARNING os_brick.initiator.connectors.base [None req-1e79b6f5-f288-4658-a811-77316fc11125 tempest-TestServerVolumeAttachScenarioOldVersion-673194571 tempest-TestServerVolumeAttachScenarioOldVersion-673194571-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 18:01:49 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.base [None req-1e79b6f5-f288-4658-a811-77316fc11125 tempest-TestServerVolumeAttachScenarioOldVersion-673194571 tempest-TestServerVolumeAttachScenarioOldVersion-673194571-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 18:01:49 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.base [None req-1e79b6f5-f288-4658-a811-77316fc11125 tempest-TestServerVolumeAttachScenarioOldVersion-673194571 tempest-TestServerVolumeAttachScenarioOldVersion-673194571-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 18:01:49 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:01:49 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:01:49 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[051301e1-b2e1-4bf2-b337-3fb6731f47c7]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:20ab0918-fec2-4fb1-a347-e54c77fd253f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:9511387c-8772-40f2-bf2d-6b6387649e9f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:6a07b572-6430-4d0f-9aaf-8a8dbc39831e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:bb526b54-3017-4f30-b5c7-88027b146d52\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 18:01:49 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-1e79b6f5-f288-4658-a811-77316fc11125 tempest-TestServerVolumeAttachScenarioOldVersion-673194571 tempest-TestServerVolumeAttachScenarioOldVersion-673194571-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 29 18:01:49 user nova-compute[74613]: No targets found.
Nov 29 18:01:49 user nova-compute[74613]: iSNS:
Nov 29 18:01:49 user nova-compute[74613]: No targets found.
Nov 29 18:01:49 user nova-compute[74613]: STATIC:
Nov 29 18:01:49 user nova-compute[74613]: Target: iqn.2010-10.org.openstack:20ab0918-fec2-4fb1-a347-e54c77fd253f
Nov 29 18:01:49 user nova-compute[74613]:         Portal: 172.16.0.220:3260,-1
Nov 29 18:01:49 user nova-compute[74613]:                 Iface Name: default
Nov 29 18:01:49 user nova-compute[74613]: Target: iqn.2010-10.org.openstack:9511387c-8772-40f2-bf2d-6b6387649e9f
Nov 29 18:01:49 user nova-compute[74613]:         Portal: 172.16.0.220:3260,-1
Nov 29 18:01:49 user nova-compute[74613]:                 Iface Name: default
Nov 29 18:01:49 user nova-compute[74613]: Target: iqn.2010-10.org.openstack:6a07b572-6430-4d0f-9aaf-8a8dbc39831e
Nov 29 18:01:49 user nova-compute[74613]:         Portal: 172.16.0.220:3260,-1
Nov 29 18:01:49 user nova-compute[74613]:                 Iface Name: default
Nov 29 18:01:49 user nova-compute[74613]: Target: iqn.2010-10.org.openstack:bb526b54-3017-4f30-b5c7-88027b146d52
Nov 29 18:01:49 user nova-compute[74613]:         Portal: 172.16.0.220:3260,-1
Nov 29 18:01:49 user nova-compute[74613]:                 Iface Name: default
Nov 29 18:01:49 user nova-compute[74613]: FIRMWARE:
Nov 29 18:01:49 user nova-compute[74613]: No targets found.
Nov 29 18:01:49 user nova-compute[74613]:  stderr= {{(pid=74613) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 18:01:49 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-1e79b6f5-f288-4658-a811-77316fc11125 tempest-TestServerVolumeAttachScenarioOldVersion-673194571 tempest-TestServerVolumeAttachScenarioOldVersion-673194571-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 29 18:01:49 user nova-compute[74613]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 29 18:01:49 user nova-compute[74613]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74613) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 29 18:01:49 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-1e79b6f5-f288-4658-a811-77316fc11125 tempest-TestServerVolumeAttachScenarioOldVersion-673194571 tempest-TestServerVolumeAttachScenarioOldVersion-673194571-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:20ab0918-fec2-4fb1-a347-e54c77fd253f', 0)] {{(pid=74613) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 29 18:01:49 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:01:49 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:01:49 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c813c1e-cb0f-4cb8-b3fe-c577f15b032c]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:20ab0918-fec2-4fb1-a347-e54c77fd253f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6a07b572-6430-4d0f-9aaf-8a8dbc39831e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9511387c-8772-40f2-bf2d-6b6387649e9f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:bb526b54-3017-4f30-b5c7-88027b146d52\n', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 18:01:49 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:01:49 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:01:49 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[03c8c573-b109-426f-b4f4-f79f513d84ed]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9511387c-8772-40f2-bf2d-6b6387649e9f (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a07b572-6430-4d0f-9aaf-8a8dbc39831e (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb526b54-3017-4f30-b5c7-88027b146d52 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20ab0918-fec2-4fb1-a347-e54c77fd253f (non-flash)\n', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 18:01:49 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-1e79b6f5-f288-4658-a811-77316fc11125 tempest-TestServerVolumeAttachScenarioOldVersion-673194571 tempest-TestServerVolumeAttachScenarioOldVersion-673194571-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9511387c-8772-40f2-bf2d-6b6387649e9f (non-flash)
Nov 29 18:01:49 user nova-compute[74613]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a07b572-6430-4d0f-9aaf-8a8dbc39831e (non-flash)
Nov 29 18:01:49 user nova-compute[74613]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb526b54-3017-4f30-b5c7-88027b146d52 (non-flash)
Nov 29 18:01:49 user nova-compute[74613]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20ab0918-fec2-4fb1-a347-e54c77fd253f (non-flash)
Nov 29 18:01:49 user nova-compute[74613]:  stderr= {{(pid=74613) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 18:01:49 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-1e79b6f5-f288-4658-a811-77316fc11125 tempest-TestServerVolumeAttachScenarioOldVersion-673194571 tempest-TestServerVolumeAttachScenarioOldVersion-673194571-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9511387c-8772-40f2-bf2d-6b6387649e9f (non-flash)
Nov 29 18:01:49 user nova-compute[74613]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a07b572-6430-4d0f-9aaf-8a8dbc39831e (non-flash)
Nov 29 18:01:49 user nova-compute[74613]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb526b54-3017-4f30-b5c7-88027b146d52 (non-flash)
Nov 29 18:01:49 user nova-compute[74613]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20ab0918-fec2-4fb1-a347-e54c77fd253f (non-flash)
Nov 29 18:01:49 user nova-compute[74613]:  stderr= {{(pid=74613) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 18:01:49 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-1e79b6f5-f288-4658-a811-77316fc11125 tempest-TestServerVolumeAttachScenarioOldVersion-673194571 tempest-TestServerVolumeAttachScenarioOldVersion-673194571-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7ff81811b640>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:20ab0918-fec2-4fb1-a347-e54c77fd253f'): ({'sde'}, set())}) {{(pid=74613) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 29 18:01:49 user nova-compute[74613]: DEBUG os_brick.initiator.linuxscsi [None req-1e79b6f5-f288-4658-a811-77316fc11125 tempest-TestServerVolumeAttachScenarioOldVersion-673194571 tempest-TestServerVolumeAttachScenarioOldVersion-673194571-project-member] Removing single pathed devices sde {{(pid=74613) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 29 18:01:49 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:01:49 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:01:49 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[b01e1338-d7a7-4a40-869f-0f1a8799b8b0]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 18:01:49 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:01:49 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.018s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:01:49 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[df9af194-4b5a-4c1c-a084-79e948643505]: (4, ('ok\n', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 18:01:49 user nova-compute[74613]: DEBUG os_brick.initiator.linuxscsi [None req-1e79b6f5-f288-4658-a811-77316fc11125 tempest-TestServerVolumeAttachScenarioOldVersion-673194571 tempest-TestServerVolumeAttachScenarioOldVersion-673194571-project-member] Flushing IO for device /dev/sde {{(pid=74613) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 29 18:01:49 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:01:49 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.012s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:01:49 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f0373f9-ead8-464b-85cf-d9dfafc1f051]: (4, ('', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 18:01:49 user nova-compute[74613]: DEBUG os_brick.initiator.linuxscsi [None req-1e79b6f5-f288-4658-a811-77316fc11125 tempest-TestServerVolumeAttachScenarioOldVersion-673194571 tempest-TestServerVolumeAttachScenarioOldVersion-673194571-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=74613) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 29 18:01:49 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:01:50 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.046s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:01:50 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9974a1c-712e-42f6-b6c9-bbf41a67c6c4]: (4, ('1', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 18:01:50 user nova-compute[74613]: DEBUG os_brick.initiator.linuxscsi [None req-1e79b6f5-f288-4658-a811-77316fc11125 tempest-TestServerVolumeAttachScenarioOldVersion-673194571 tempest-TestServerVolumeAttachScenarioOldVersion-673194571-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=74613) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 29 18:01:50 user nova-compute[74613]: DEBUG os_brick.initiator.linuxscsi [None req-1e79b6f5-f288-4658-a811-77316fc11125 tempest-TestServerVolumeAttachScenarioOldVersion-673194571 tempest-TestServerVolumeAttachScenarioOldVersion-673194571-project-member] SCSI volumes sde have been removed. {{(pid=74613) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 29 18:01:50 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-1e79b6f5-f288-4658-a811-77316fc11125 tempest-TestServerVolumeAttachScenarioOldVersion-673194571 tempest-TestServerVolumeAttachScenarioOldVersion-673194571-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:20ab0918-fec2-4fb1-a347-e54c77fd253f')] {{(pid=74613) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 29 18:01:50 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:20ab0918-fec2-4fb1-a347-e54c77fd253f -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:01:50 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:20ab0918-fec2-4fb1-a347-e54c77fd253f -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.025s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:01:50 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d45781b-8290-45ba-974c-065ace096a47]: (4, ('', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 18:01:50 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-1e79b6f5-f288-4658-a811-77316fc11125 tempest-TestServerVolumeAttachScenarioOldVersion-673194571 tempest-TestServerVolumeAttachScenarioOldVersion-673194571-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74613) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 18:01:50 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:20ab0918-fec2-4fb1-a347-e54c77fd253f -p 172.16.0.220:3260 --logout {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:01:50 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:20ab0918-fec2-4fb1-a347-e54c77fd253f -p 172.16.0.220:3260 --logout" returned: 0 in 0.061s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:01:50 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[067eeaad-7c32-4704-bfbd-4fd0bca3ed87]: (4, ('Logging out of session [sid: 26, target: iqn.2010-10.org.openstack:20ab0918-fec2-4fb1-a347-e54c77fd253f, portal: 172.16.0.220,3260]\nLogout of [sid: 26, target: iqn.2010-10.org.openstack:20ab0918-fec2-4fb1-a347-e54c77fd253f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 18:01:50 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-1e79b6f5-f288-4658-a811-77316fc11125 tempest-TestServerVolumeAttachScenarioOldVersion-673194571 tempest-TestServerVolumeAttachScenarioOldVersion-673194571-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 26, target: iqn.2010-10.org.openstack:20ab0918-fec2-4fb1-a347-e54c77fd253f, portal: 172.16.0.220,3260]
Nov 29 18:01:50 user nova-compute[74613]: Logout of [sid: 26, target: iqn.2010-10.org.openstack:20ab0918-fec2-4fb1-a347-e54c77fd253f, portal: 172.16.0.220,3260] successful.
Nov 29 18:01:50 user nova-compute[74613]:  stderr= {{(pid=74613) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 18:01:50 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:20ab0918-fec2-4fb1-a347-e54c77fd253f -p 172.16.0.220:3260 --op delete {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:01:50 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:20ab0918-fec2-4fb1-a347-e54c77fd253f -p 172.16.0.220:3260 --op delete" returned: 0 in 0.025s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:01:50 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[cdd04005-3d3e-4961-b122-74520a1dcd87]: (4, ('', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 18:01:50 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-1e79b6f5-f288-4658-a811-77316fc11125 tempest-TestServerVolumeAttachScenarioOldVersion-673194571 tempest-TestServerVolumeAttachScenarioOldVersion-673194571-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74613) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 18:01:50 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.base [None req-1e79b6f5-f288-4658-a811-77316fc11125 tempest-TestServerVolumeAttachScenarioOldVersion-673194571 tempest-TestServerVolumeAttachScenarioOldVersion-673194571-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.310s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 18:01:50 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-1e79b6f5-f288-4658-a811-77316fc11125 tempest-TestServerVolumeAttachScenarioOldVersion-673194571 tempest-TestServerVolumeAttachScenarioOldVersion-673194571-project-member] <== disconnect_volume: return (312ms) None {{(pid=74613) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 18:01:50 user nova-compute[74613]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1e79b6f5-f288-4658-a811-77316fc11125 tempest-TestServerVolumeAttachScenarioOldVersion-673194571 tempest-TestServerVolumeAttachScenarioOldVersion-673194571-project-member] [instance: 5221f9b9-e4db-406b-ae82-4a7c6522ee64] Disconnected iSCSI Volume {{(pid=74613) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 29 18:01:50 user nova-compute[74613]: DEBUG nova.objects.instance [None req-1e79b6f5-f288-4658-a811-77316fc11125 tempest-TestServerVolumeAttachScenarioOldVersion-673194571 tempest-TestServerVolumeAttachScenarioOldVersion-673194571-project-member] Lazy-loading 'flavor' on Instance uuid 5221f9b9-e4db-406b-ae82-4a7c6522ee64 {{(pid=74613) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 18:01:51 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-1e79b6f5-f288-4658-a811-77316fc11125 tempest-TestServerVolumeAttachScenarioOldVersion-673194571 tempest-TestServerVolumeAttachScenarioOldVersion-673194571-project-member] Lock "5221f9b9-e4db-406b-ae82-4a7c6522ee64" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.753s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 18:01:51 user nova-compute[74613]: DEBUG nova.compute.manager [None req-9ac00fe9-fd85-4de4-9d34-3a250599272d tempest-ServerBootFromVolumeStableRescueTest-414665510 tempest-ServerBootFromVolumeStableRescueTest-414665510-project-member] [instance: 8fc8496b-1435-4b5f-8977-6c0d7467ef65] Checking state {{(pid=74613) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 29 18:01:51 user nova-compute[74613]: INFO nova.compute.manager [None req-9ac00fe9-fd85-4de4-9d34-3a250599272d tempest-ServerBootFromVolumeStableRescueTest-414665510 tempest-ServerBootFromVolumeStableRescueTest-414665510-project-member] [instance: 8fc8496b-1435-4b5f-8977-6c0d7467ef65] instance snapshotting
Nov 29 18:01:51 user nova-compute[74613]: INFO nova.virt.libvirt.driver [None req-9ac00fe9-fd85-4de4-9d34-3a250599272d tempest-ServerBootFromVolumeStableRescueTest-414665510 tempest-ServerBootFromVolumeStableRescueTest-414665510-project-member] [instance: 8fc8496b-1435-4b5f-8977-6c0d7467ef65] Beginning live snapshot process
Nov 29 18:01:52 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-9ac00fe9-fd85-4de4-9d34-3a250599272d tempest-ServerBootFromVolumeStableRescueTest-414665510 tempest-ServerBootFromVolumeStableRescueTest-414665510-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8fc8496b-1435-4b5f-8977-6c0d7467ef65/disk --force-share --output=json -f qcow2 {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:01:52 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-9ac00fe9-fd85-4de4-9d34-3a250599272d tempest-ServerBootFromVolumeStableRescueTest-414665510 tempest-ServerBootFromVolumeStableRescueTest-414665510-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8fc8496b-1435-4b5f-8977-6c0d7467ef65/disk --force-share --output=json -f qcow2" returned: 0 in 0.182s {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:01:52 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-9ac00fe9-fd85-4de4-9d34-3a250599272d tempest-ServerBootFromVolumeStableRescueTest-414665510 tempest-ServerBootFromVolumeStableRescueTest-414665510-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8fc8496b-1435-4b5f-8977-6c0d7467ef65/disk --force-share --output=json -f qcow2 {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:01:52 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-9ac00fe9-fd85-4de4-9d34-3a250599272d tempest-ServerBootFromVolumeStableRescueTest-414665510 tempest-ServerBootFromVolumeStableRescueTest-414665510-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8fc8496b-1435-4b5f-8977-6c0d7467ef65/disk --force-share --output=json -f qcow2" returned: 0 in 0.176s {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:01:52 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-9ac00fe9-fd85-4de4-9d34-3a250599272d tempest-ServerBootFromVolumeStableRescueTest-414665510 tempest-ServerBootFromVolumeStableRescueTest-414665510-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/21faea9e6951f3bdd0153b76ac89fe1a60a34758 --force-share --output=json {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:01:52 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-9ac00fe9-fd85-4de4-9d34-3a250599272d tempest-ServerBootFromVolumeStableRescueTest-414665510 tempest-ServerBootFromVolumeStableRescueTest-414665510-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/21faea9e6951f3bdd0153b76ac89fe1a60a34758 --force-share --output=json" returned: 0 in 0.169s {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:01:52 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-9ac00fe9-fd85-4de4-9d34-3a250599272d tempest-ServerBootFromVolumeStableRescueTest-414665510 tempest-ServerBootFromVolumeStableRescueTest-414665510-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/21faea9e6951f3bdd0153b76ac89fe1a60a34758,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpsmxfoq2r/31ecc24bff3b41cdabf613a71c1b4dcf.delta 1073741824 {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:01:52 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-9ac00fe9-fd85-4de4-9d34-3a250599272d tempest-ServerBootFromVolumeStableRescueTest-414665510 tempest-ServerBootFromVolumeStableRescueTest-414665510-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/21faea9e6951f3bdd0153b76ac89fe1a60a34758,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpsmxfoq2r/31ecc24bff3b41cdabf613a71c1b4dcf.delta 1073741824" returned: 0 in 0.047s {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:01:52 user nova-compute[74613]: INFO nova.virt.libvirt.driver [None req-9ac00fe9-fd85-4de4-9d34-3a250599272d tempest-ServerBootFromVolumeStableRescueTest-414665510 tempest-ServerBootFromVolumeStableRescueTest-414665510-project-member] [instance: 8fc8496b-1435-4b5f-8977-6c0d7467ef65] Quiescing instance not available: QEMU guest agent is not enabled.
Nov 29 18:01:53 user nova-compute[74613]: DEBUG nova.virt.libvirt.guest [None req-9ac00fe9-fd85-4de4-9d34-3a250599272d tempest-ServerBootFromVolumeStableRescueTest-414665510 tempest-ServerBootFromVolumeStableRescueTest-414665510-project-member] COPY block job progress, current cursor: 0 final cursor: 75497472 {{(pid=74613) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 29 18:01:53 user nova-compute[74613]: DEBUG nova.virt.libvirt.guest [None req-9ac00fe9-fd85-4de4-9d34-3a250599272d tempest-ServerBootFromVolumeStableRescueTest-414665510 tempest-ServerBootFromVolumeStableRescueTest-414665510-project-member] COPY block job progress, current cursor: 75497472 final cursor: 75497472 {{(pid=74613) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 29 18:01:53 user nova-compute[74613]: INFO nova.virt.libvirt.driver [None req-9ac00fe9-fd85-4de4-9d34-3a250599272d tempest-ServerBootFromVolumeStableRescueTest-414665510 tempest-ServerBootFromVolumeStableRescueTest-414665510-project-member] [instance: 8fc8496b-1435-4b5f-8977-6c0d7467ef65] Skipping quiescing instance: QEMU guest agent is not enabled.
Nov 29 18:01:53 user nova-compute[74613]: DEBUG nova.privsep.utils [None req-9ac00fe9-fd85-4de4-9d34-3a250599272d tempest-ServerBootFromVolumeStableRescueTest-414665510 tempest-ServerBootFromVolumeStableRescueTest-414665510-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74613) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 29 18:01:53 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-9ac00fe9-fd85-4de4-9d34-3a250599272d tempest-ServerBootFromVolumeStableRescueTest-414665510 tempest-ServerBootFromVolumeStableRescueTest-414665510-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpsmxfoq2r/31ecc24bff3b41cdabf613a71c1b4dcf.delta /opt/stack/data/nova/instances/snapshots/tmpsmxfoq2r/31ecc24bff3b41cdabf613a71c1b4dcf {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:01:54 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-9ac00fe9-fd85-4de4-9d34-3a250599272d tempest-ServerBootFromVolumeStableRescueTest-414665510 tempest-ServerBootFromVolumeStableRescueTest-414665510-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpsmxfoq2r/31ecc24bff3b41cdabf613a71c1b4dcf.delta /opt/stack/data/nova/instances/snapshots/tmpsmxfoq2r/31ecc24bff3b41cdabf613a71c1b4dcf" returned: 0 in 0.604s {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:01:54 user nova-compute[74613]: INFO nova.virt.libvirt.driver [None req-9ac00fe9-fd85-4de4-9d34-3a250599272d tempest-ServerBootFromVolumeStableRescueTest-414665510 tempest-ServerBootFromVolumeStableRescueTest-414665510-project-member] [instance: 8fc8496b-1435-4b5f-8977-6c0d7467ef65] Snapshot extracted, beginning image upload
Nov 29 18:01:54 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 18:01:56 user nova-compute[74613]: INFO nova.virt.libvirt.driver [None req-9ac00fe9-fd85-4de4-9d34-3a250599272d tempest-ServerBootFromVolumeStableRescueTest-414665510 tempest-ServerBootFromVolumeStableRescueTest-414665510-project-member] [instance: 8fc8496b-1435-4b5f-8977-6c0d7467ef65] Snapshot image upload complete
Nov 29 18:01:56 user nova-compute[74613]: INFO nova.compute.manager [None req-9ac00fe9-fd85-4de4-9d34-3a250599272d tempest-ServerBootFromVolumeStableRescueTest-414665510 tempest-ServerBootFromVolumeStableRescueTest-414665510-project-member] [instance: 8fc8496b-1435-4b5f-8977-6c0d7467ef65] Took 5.08 seconds to snapshot the instance on the hypervisor.
Nov 29 18:01:59 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 18:02:03 user nova-compute[74613]: DEBUG nova.compute.manager [req-5184d948-846b-4fbe-89e6-ac7bf2fe6f36 req-32fa07af-da5b-4a4d-945b-dd4f19cf8517 service nova] [instance: fae10c60-f989-4c99-bde4-60cd9f3e2055] Received event network-changed-435f55bd-6b68-4466-96d8-7ca838b0a594 {{(pid=74613) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 18:02:03 user nova-compute[74613]: DEBUG nova.compute.manager [req-5184d948-846b-4fbe-89e6-ac7bf2fe6f36 req-32fa07af-da5b-4a4d-945b-dd4f19cf8517 service nova] [instance: fae10c60-f989-4c99-bde4-60cd9f3e2055] Refreshing instance network info cache due to event network-changed-435f55bd-6b68-4466-96d8-7ca838b0a594. {{(pid=74613) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 18:02:03 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-5184d948-846b-4fbe-89e6-ac7bf2fe6f36 req-32fa07af-da5b-4a4d-945b-dd4f19cf8517 service nova] Acquiring lock "refresh_cache-fae10c60-f989-4c99-bde4-60cd9f3e2055" {{(pid=74613) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 18:02:03 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-5184d948-846b-4fbe-89e6-ac7bf2fe6f36 req-32fa07af-da5b-4a4d-945b-dd4f19cf8517 service nova] Acquired lock "refresh_cache-fae10c60-f989-4c99-bde4-60cd9f3e2055" {{(pid=74613) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 18:02:03 user nova-compute[74613]: DEBUG nova.network.neutron [req-5184d948-846b-4fbe-89e6-ac7bf2fe6f36 req-32fa07af-da5b-4a4d-945b-dd4f19cf8517 service nova] [instance: fae10c60-f989-4c99-bde4-60cd9f3e2055] Refreshing network info cache for port 435f55bd-6b68-4466-96d8-7ca838b0a594 {{(pid=74613) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 18:02:03 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-370dd5a9-5a25-4ba9-aad8-3384420f5da1 tempest-TestShelveInstance-765407413 tempest-TestShelveInstance-765407413-project-member] Acquiring lock "fae10c60-f989-4c99-bde4-60cd9f3e2055" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 18:02:03 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-370dd5a9-5a25-4ba9-aad8-3384420f5da1 tempest-TestShelveInstance-765407413 tempest-TestShelveInstance-765407413-project-member] Lock "fae10c60-f989-4c99-bde4-60cd9f3e2055" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 18:02:03 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-370dd5a9-5a25-4ba9-aad8-3384420f5da1 tempest-TestShelveInstance-765407413 tempest-TestShelveInstance-765407413-project-member] Acquiring lock "fae10c60-f989-4c99-bde4-60cd9f3e2055-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 18:02:03 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-370dd5a9-5a25-4ba9-aad8-3384420f5da1 tempest-TestShelveInstance-765407413 tempest-TestShelveInstance-765407413-project-member] Lock "fae10c60-f989-4c99-bde4-60cd9f3e2055-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 18:02:03 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-370dd5a9-5a25-4ba9-aad8-3384420f5da1 tempest-TestShelveInstance-765407413 tempest-TestShelveInstance-765407413-project-member] Lock "fae10c60-f989-4c99-bde4-60cd9f3e2055-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 18:02:03 user nova-compute[74613]: INFO nova.compute.manager [None req-370dd5a9-5a25-4ba9-aad8-3384420f5da1 tempest-TestShelveInstance-765407413 tempest-TestShelveInstance-765407413-project-member] [instance: fae10c60-f989-4c99-bde4-60cd9f3e2055] Terminating instance
Nov 29 18:02:03 user nova-compute[74613]: DEBUG nova.compute.manager [None req-370dd5a9-5a25-4ba9-aad8-3384420f5da1 tempest-TestShelveInstance-765407413 tempest-TestShelveInstance-765407413-project-member] [instance: fae10c60-f989-4c99-bde4-60cd9f3e2055] Start destroying the instance on the hypervisor. {{(pid=74613) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 29 18:02:03 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:02:03 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:02:03 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:02:03 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:02:03 user nova-compute[74613]: DEBUG nova.compute.manager [req-ad997c96-7e4e-4998-9cd1-94ecd695b696 req-419891e1-da41-48df-a7f4-103f04d1fe76 service nova] [instance: fae10c60-f989-4c99-bde4-60cd9f3e2055] Received event network-vif-unplugged-435f55bd-6b68-4466-96d8-7ca838b0a594 {{(pid=74613) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 18:02:03 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-ad997c96-7e4e-4998-9cd1-94ecd695b696 req-419891e1-da41-48df-a7f4-103f04d1fe76 service nova] Acquiring lock "fae10c60-f989-4c99-bde4-60cd9f3e2055-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 18:02:03 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-ad997c96-7e4e-4998-9cd1-94ecd695b696 req-419891e1-da41-48df-a7f4-103f04d1fe76 service nova] Lock "fae10c60-f989-4c99-bde4-60cd9f3e2055-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 18:02:03 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-ad997c96-7e4e-4998-9cd1-94ecd695b696 req-419891e1-da41-48df-a7f4-103f04d1fe76 service nova] Lock "fae10c60-f989-4c99-bde4-60cd9f3e2055-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 18:02:03 user nova-compute[74613]: DEBUG nova.compute.manager [req-ad997c96-7e4e-4998-9cd1-94ecd695b696 req-419891e1-da41-48df-a7f4-103f04d1fe76 service nova] [instance: fae10c60-f989-4c99-bde4-60cd9f3e2055] No waiting events found dispatching network-vif-unplugged-435f55bd-6b68-4466-96d8-7ca838b0a594 {{(pid=74613) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 18:02:03 user nova-compute[74613]: DEBUG nova.compute.manager [req-ad997c96-7e4e-4998-9cd1-94ecd695b696 req-419891e1-da41-48df-a7f4-103f04d1fe76 service nova] [instance: fae10c60-f989-4c99-bde4-60cd9f3e2055] Received event network-vif-unplugged-435f55bd-6b68-4466-96d8-7ca838b0a594 for instance with task_state deleting. {{(pid=74613) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 29 18:02:03 user nova-compute[74613]: DEBUG nova.network.neutron [req-5184d948-846b-4fbe-89e6-ac7bf2fe6f36 req-32fa07af-da5b-4a4d-945b-dd4f19cf8517 service nova] [instance: fae10c60-f989-4c99-bde4-60cd9f3e2055] Updated VIF entry in instance network info cache for port 435f55bd-6b68-4466-96d8-7ca838b0a594. {{(pid=74613) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 18:02:03 user nova-compute[74613]: DEBUG nova.network.neutron [req-5184d948-846b-4fbe-89e6-ac7bf2fe6f36 req-32fa07af-da5b-4a4d-945b-dd4f19cf8517 service nova] [instance: fae10c60-f989-4c99-bde4-60cd9f3e2055] Updating instance_info_cache with network_info: [{"id": "435f55bd-6b68-4466-96d8-7ca838b0a594", "address": "fa:16:3e:d5:66:27", "network": {"id": "3f3e011f-3d5c-4e32-bcae-cc1424ebf2d7", "bridge": "br-int", "label": "tempest-TestShelveInstance-1657844818-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5c079293283c4f248bc8bae125dcfbe9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap435f55bd-6b", "ovs_interfaceid": "435f55bd-6b68-4466-96d8-7ca838b0a594", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74613) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 18:02:03 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-5184d948-846b-4fbe-89e6-ac7bf2fe6f36 req-32fa07af-da5b-4a4d-945b-dd4f19cf8517 service nova] Releasing lock "refresh_cache-fae10c60-f989-4c99-bde4-60cd9f3e2055" {{(pid=74613) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 18:02:03 user nova-compute[74613]: INFO nova.virt.libvirt.driver [-] [instance: fae10c60-f989-4c99-bde4-60cd9f3e2055] Instance destroyed successfully.
Nov 29 18:02:03 user nova-compute[74613]: DEBUG nova.objects.instance [None req-370dd5a9-5a25-4ba9-aad8-3384420f5da1 tempest-TestShelveInstance-765407413 tempest-TestShelveInstance-765407413-project-member] Lazy-loading 'resources' on Instance uuid fae10c60-f989-4c99-bde4-60cd9f3e2055 {{(pid=74613) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 18:02:03 user nova-compute[74613]: DEBUG nova.virt.libvirt.vif [None req-370dd5a9-5a25-4ba9-aad8-3384420f5da1 tempest-TestShelveInstance-765407413 tempest-TestShelveInstance-765407413-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-29T17:56:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-1000519643',display_name='tempest-TestShelveInstance-server-1000519643',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-1000519643',id=17,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIf0ckq9VTzT5zGxHlDNferoBY2qwcYhFAXkrikI+NkgwSPctxoKzz9bP5zmVCPOQOOhQGndx3fZHEpLC6hFyIVKKa+ebw7eRNhm0TtBMSe+I3x4HRsQTY3UyYkb58qQfQ==',key_name='tempest-TestShelveInstance-195591000',keypairs=<?>,launch_index=0,launched_at=2023-11-29T18:00:33Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='5c079293283c4f248bc8bae125dcfbe9',ramdisk_id='',reservation_id='r-a58ey1iu',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-765407413',owner_user_name='tempest-TestShelveInstance-765407413-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-29T18:00:33Z,user_data=None,user_id='b4bdd0503dbb42e3a9fc3c7d3cfe3b08',uuid=fae10c60-f989-4c99-bde4-60cd9f3e2055,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "435f55bd-6b68-4466-96d8-7ca838b0a594", "address": "fa:16:3e:d5:66:27", "network": {"id": "3f3e011f-3d5c-4e32-bcae-cc1424ebf2d7", "bridge": "br-int", "label": "tempest-TestShelveInstance-1657844818-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.13", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5c079293283c4f248bc8bae125dcfbe9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap435f55bd-6b", "ovs_interfaceid": "435f55bd-6b68-4466-96d8-7ca838b0a594", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74613) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 29 18:02:03 user nova-compute[74613]: DEBUG nova.network.os_vif_util [None req-370dd5a9-5a25-4ba9-aad8-3384420f5da1 tempest-TestShelveInstance-765407413 tempest-TestShelveInstance-765407413-project-member] Converting VIF {"id": "435f55bd-6b68-4466-96d8-7ca838b0a594", "address": "fa:16:3e:d5:66:27", "network": {"id": "3f3e011f-3d5c-4e32-bcae-cc1424ebf2d7", "bridge": "br-int", "label": "tempest-TestShelveInstance-1657844818-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.13", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5c079293283c4f248bc8bae125dcfbe9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap435f55bd-6b", "ovs_interfaceid": "435f55bd-6b68-4466-96d8-7ca838b0a594", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74613) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 18:02:03 user nova-compute[74613]: DEBUG nova.network.os_vif_util [None req-370dd5a9-5a25-4ba9-aad8-3384420f5da1 tempest-TestShelveInstance-765407413 tempest-TestShelveInstance-765407413-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d5:66:27,bridge_name='br-int',has_traffic_filtering=True,id=435f55bd-6b68-4466-96d8-7ca838b0a594,network=Network(3f3e011f-3d5c-4e32-bcae-cc1424ebf2d7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap435f55bd-6b') {{(pid=74613) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 18:02:03 user nova-compute[74613]: DEBUG os_vif [None req-370dd5a9-5a25-4ba9-aad8-3384420f5da1 tempest-TestShelveInstance-765407413 tempest-TestShelveInstance-765407413-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d5:66:27,bridge_name='br-int',has_traffic_filtering=True,id=435f55bd-6b68-4466-96d8-7ca838b0a594,network=Network(3f3e011f-3d5c-4e32-bcae-cc1424ebf2d7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap435f55bd-6b') {{(pid=74613) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 29 18:02:03 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:02:03 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap435f55bd-6b, bridge=br-int, if_exists=True) {{(pid=74613) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 18:02:03 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:02:03 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:02:03 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:02:03 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=973ac8a5-fb80-4f49-a9a3-690c761278e7) {{(pid=74613) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 18:02:03 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:02:03 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:02:03 user nova-compute[74613]: INFO os_vif [None req-370dd5a9-5a25-4ba9-aad8-3384420f5da1 tempest-TestShelveInstance-765407413 tempest-TestShelveInstance-765407413-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d5:66:27,bridge_name='br-int',has_traffic_filtering=True,id=435f55bd-6b68-4466-96d8-7ca838b0a594,network=Network(3f3e011f-3d5c-4e32-bcae-cc1424ebf2d7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap435f55bd-6b')
Nov 29 18:02:03 user nova-compute[74613]: DEBUG nova.virt.libvirt.volume.iscsi [None req-370dd5a9-5a25-4ba9-aad8-3384420f5da1 tempest-TestShelveInstance-765407413 tempest-TestShelveInstance-765407413-project-member] [instance: fae10c60-f989-4c99-bde4-60cd9f3e2055] calling os-brick to detach iSCSI Volume {{(pid=74613) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 29 18:02:03 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-370dd5a9-5a25-4ba9-aad8-3384420f5da1 tempest-TestShelveInstance-765407413 tempest-TestShelveInstance-765407413-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff828156890>, {'target_iqn': 'iqn.2010-10.org.openstack:6a07b572-6430-4d0f-9aaf-8a8dbc39831e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BZedJSro', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=74613) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 18:02:03 user nova-compute[74613]: WARNING os_brick.initiator.connectors.base [None req-370dd5a9-5a25-4ba9-aad8-3384420f5da1 tempest-TestShelveInstance-765407413 tempest-TestShelveInstance-765407413-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 18:02:03 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.base [None req-370dd5a9-5a25-4ba9-aad8-3384420f5da1 tempest-TestShelveInstance-765407413 tempest-TestShelveInstance-765407413-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 18:02:03 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.base [None req-370dd5a9-5a25-4ba9-aad8-3384420f5da1 tempest-TestShelveInstance-765407413 tempest-TestShelveInstance-765407413-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 18:02:03 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:02:03 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:02:03 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea4b7578-182f-41cd-89eb-a9564ef3a7a5]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:9511387c-8772-40f2-bf2d-6b6387649e9f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:6a07b572-6430-4d0f-9aaf-8a8dbc39831e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:bb526b54-3017-4f30-b5c7-88027b146d52\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 18:02:03 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-370dd5a9-5a25-4ba9-aad8-3384420f5da1 tempest-TestShelveInstance-765407413 tempest-TestShelveInstance-765407413-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 29 18:02:03 user nova-compute[74613]: No targets found.
Nov 29 18:02:03 user nova-compute[74613]: iSNS:
Nov 29 18:02:03 user nova-compute[74613]: No targets found.
Nov 29 18:02:03 user nova-compute[74613]: STATIC:
Nov 29 18:02:03 user nova-compute[74613]: Target: iqn.2010-10.org.openstack:9511387c-8772-40f2-bf2d-6b6387649e9f
Nov 29 18:02:03 user nova-compute[74613]:         Portal: 172.16.0.220:3260,-1
Nov 29 18:02:03 user nova-compute[74613]:                 Iface Name: default
Nov 29 18:02:03 user nova-compute[74613]: Target: iqn.2010-10.org.openstack:6a07b572-6430-4d0f-9aaf-8a8dbc39831e
Nov 29 18:02:03 user nova-compute[74613]:         Portal: 172.16.0.220:3260,-1
Nov 29 18:02:03 user nova-compute[74613]:                 Iface Name: default
Nov 29 18:02:03 user nova-compute[74613]: Target: iqn.2010-10.org.openstack:bb526b54-3017-4f30-b5c7-88027b146d52
Nov 29 18:02:03 user nova-compute[74613]:         Portal: 172.16.0.220:3260,-1
Nov 29 18:02:03 user nova-compute[74613]:                 Iface Name: default
Nov 29 18:02:03 user nova-compute[74613]: FIRMWARE:
Nov 29 18:02:03 user nova-compute[74613]: No targets found.
Nov 29 18:02:03 user nova-compute[74613]:  stderr= {{(pid=74613) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 18:02:03 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-370dd5a9-5a25-4ba9-aad8-3384420f5da1 tempest-TestShelveInstance-765407413 tempest-TestShelveInstance-765407413-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 29 18:02:03 user nova-compute[74613]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 29 18:02:03 user nova-compute[74613]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74613) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 29 18:02:03 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-370dd5a9-5a25-4ba9-aad8-3384420f5da1 tempest-TestShelveInstance-765407413 tempest-TestShelveInstance-765407413-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6a07b572-6430-4d0f-9aaf-8a8dbc39831e', 0)] {{(pid=74613) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 29 18:02:03 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:02:03 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:02:03 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e3e8b54-fb0b-4be1-a0e7-a3f08f5a5a6d]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6a07b572-6430-4d0f-9aaf-8a8dbc39831e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9511387c-8772-40f2-bf2d-6b6387649e9f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:bb526b54-3017-4f30-b5c7-88027b146d52\n', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 18:02:03 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:02:03 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:02:03 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[57538b74-d86c-4c7f-8617-108a180ab05a]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9511387c-8772-40f2-bf2d-6b6387649e9f (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a07b572-6430-4d0f-9aaf-8a8dbc39831e (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb526b54-3017-4f30-b5c7-88027b146d52 (non-flash)\n', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 18:02:03 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-370dd5a9-5a25-4ba9-aad8-3384420f5da1 tempest-TestShelveInstance-765407413 tempest-TestShelveInstance-765407413-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9511387c-8772-40f2-bf2d-6b6387649e9f (non-flash)
Nov 29 18:02:03 user nova-compute[74613]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a07b572-6430-4d0f-9aaf-8a8dbc39831e (non-flash)
Nov 29 18:02:03 user nova-compute[74613]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb526b54-3017-4f30-b5c7-88027b146d52 (non-flash)
Nov 29 18:02:03 user nova-compute[74613]:  stderr= {{(pid=74613) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 18:02:03 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-370dd5a9-5a25-4ba9-aad8-3384420f5da1 tempest-TestShelveInstance-765407413 tempest-TestShelveInstance-765407413-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9511387c-8772-40f2-bf2d-6b6387649e9f (non-flash)
Nov 29 18:02:03 user nova-compute[74613]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a07b572-6430-4d0f-9aaf-8a8dbc39831e (non-flash)
Nov 29 18:02:03 user nova-compute[74613]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb526b54-3017-4f30-b5c7-88027b146d52 (non-flash)
Nov 29 18:02:03 user nova-compute[74613]:  stderr= {{(pid=74613) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 18:02:03 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-370dd5a9-5a25-4ba9-aad8-3384420f5da1 tempest-TestShelveInstance-765407413 tempest-TestShelveInstance-765407413-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7ff8181e9120>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6a07b572-6430-4d0f-9aaf-8a8dbc39831e'): ({'sdc'}, set())}) {{(pid=74613) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 29 18:02:03 user nova-compute[74613]: DEBUG os_brick.initiator.linuxscsi [None req-370dd5a9-5a25-4ba9-aad8-3384420f5da1 tempest-TestShelveInstance-765407413 tempest-TestShelveInstance-765407413-project-member] Removing single pathed devices sdc {{(pid=74613) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 29 18:02:03 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:02:04 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:02:04 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[bcdaf99d-5c95-4649-b8bc-4e0d545b564a]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 18:02:04 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:02:04 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.020s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:02:04 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[9021f67b-1566-41cc-a865-c97fdcf50a8c]: (4, ('ok\n', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 18:02:04 user nova-compute[74613]: DEBUG os_brick.initiator.linuxscsi [None req-370dd5a9-5a25-4ba9-aad8-3384420f5da1 tempest-TestShelveInstance-765407413 tempest-TestShelveInstance-765407413-project-member] Flushing IO for device /dev/sdc {{(pid=74613) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 29 18:02:04 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:02:04 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.015s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:02:04 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[86cb14af-bb24-4896-90f8-eb10c1296abd]: (4, ('', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 18:02:04 user nova-compute[74613]: DEBUG os_brick.initiator.linuxscsi [None req-370dd5a9-5a25-4ba9-aad8-3384420f5da1 tempest-TestShelveInstance-765407413 tempest-TestShelveInstance-765407413-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=74613) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 29 18:02:04 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:02:04 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.062s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:02:04 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[589eab01-6277-4334-b5ce-493aaf072a34]: (4, ('1', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 18:02:04 user nova-compute[74613]: DEBUG os_brick.initiator.linuxscsi [None req-370dd5a9-5a25-4ba9-aad8-3384420f5da1 tempest-TestShelveInstance-765407413 tempest-TestShelveInstance-765407413-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=74613) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 29 18:02:04 user nova-compute[74613]: DEBUG os_brick.initiator.linuxscsi [None req-370dd5a9-5a25-4ba9-aad8-3384420f5da1 tempest-TestShelveInstance-765407413 tempest-TestShelveInstance-765407413-project-member] SCSI volumes sdc have been removed. {{(pid=74613) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 29 18:02:04 user nova-compute[74613]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-SSCST_BIO_Storage_6ac8197f',) {{(pid=85376) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Nov 29 18:02:04 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[f70a7d72-fa1a-4537-a2c0-8710cd672367]: (4, None) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 18:02:04 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-370dd5a9-5a25-4ba9-aad8-3384420f5da1 tempest-TestShelveInstance-765407413 tempest-TestShelveInstance-765407413-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6a07b572-6430-4d0f-9aaf-8a8dbc39831e')] {{(pid=74613) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 29 18:02:04 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6a07b572-6430-4d0f-9aaf-8a8dbc39831e -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:02:04 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6a07b572-6430-4d0f-9aaf-8a8dbc39831e -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:02:04 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ff83b5d-a6d0-4dac-8a48-1abf1402be63]: (4, ('', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 18:02:04 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-370dd5a9-5a25-4ba9-aad8-3384420f5da1 tempest-TestShelveInstance-765407413 tempest-TestShelveInstance-765407413-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74613) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 18:02:04 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6a07b572-6430-4d0f-9aaf-8a8dbc39831e -p 172.16.0.220:3260 --logout {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:02:04 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6a07b572-6430-4d0f-9aaf-8a8dbc39831e -p 172.16.0.220:3260 --logout" returned: 0 in 0.053s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:02:04 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5b738ba-25ac-41b4-8c47-f93e8cb397ef]: (4, ('Logging out of session [sid: 24, target: iqn.2010-10.org.openstack:6a07b572-6430-4d0f-9aaf-8a8dbc39831e, portal: 172.16.0.220,3260]\nLogout of [sid: 24, target: iqn.2010-10.org.openstack:6a07b572-6430-4d0f-9aaf-8a8dbc39831e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 18:02:04 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-370dd5a9-5a25-4ba9-aad8-3384420f5da1 tempest-TestShelveInstance-765407413 tempest-TestShelveInstance-765407413-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 24, target: iqn.2010-10.org.openstack:6a07b572-6430-4d0f-9aaf-8a8dbc39831e, portal: 172.16.0.220,3260]
Nov 29 18:02:04 user nova-compute[74613]: Logout of [sid: 24, target: iqn.2010-10.org.openstack:6a07b572-6430-4d0f-9aaf-8a8dbc39831e, portal: 172.16.0.220,3260] successful.
Nov 29 18:02:04 user nova-compute[74613]:  stderr= {{(pid=74613) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 18:02:04 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6a07b572-6430-4d0f-9aaf-8a8dbc39831e -p 172.16.0.220:3260 --op delete {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:02:04 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6a07b572-6430-4d0f-9aaf-8a8dbc39831e -p 172.16.0.220:3260 --op delete" returned: 0 in 0.026s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:02:04 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[c75998aa-51bc-475f-99ef-08674d5ef497]: (4, ('', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 18:02:04 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-370dd5a9-5a25-4ba9-aad8-3384420f5da1 tempest-TestShelveInstance-765407413 tempest-TestShelveInstance-765407413-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74613) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 18:02:04 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.base [None req-370dd5a9-5a25-4ba9-aad8-3384420f5da1 tempest-TestShelveInstance-765407413 tempest-TestShelveInstance-765407413-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.348s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 18:02:04 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-370dd5a9-5a25-4ba9-aad8-3384420f5da1 tempest-TestShelveInstance-765407413 tempest-TestShelveInstance-765407413-project-member] <== disconnect_volume: return (349ms) None {{(pid=74613) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 18:02:04 user nova-compute[74613]: DEBUG nova.virt.libvirt.volume.iscsi [None req-370dd5a9-5a25-4ba9-aad8-3384420f5da1 tempest-TestShelveInstance-765407413 tempest-TestShelveInstance-765407413-project-member] [instance: fae10c60-f989-4c99-bde4-60cd9f3e2055] Disconnected iSCSI Volume {{(pid=74613) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 29 18:02:04 user nova-compute[74613]: INFO nova.virt.libvirt.driver [None req-370dd5a9-5a25-4ba9-aad8-3384420f5da1 tempest-TestShelveInstance-765407413 tempest-TestShelveInstance-765407413-project-member] [instance: fae10c60-f989-4c99-bde4-60cd9f3e2055] Deleting instance files /opt/stack/data/nova/instances/fae10c60-f989-4c99-bde4-60cd9f3e2055_del
Nov 29 18:02:04 user nova-compute[74613]: INFO nova.virt.libvirt.driver [None req-370dd5a9-5a25-4ba9-aad8-3384420f5da1 tempest-TestShelveInstance-765407413 tempest-TestShelveInstance-765407413-project-member] [instance: fae10c60-f989-4c99-bde4-60cd9f3e2055] Deletion of /opt/stack/data/nova/instances/fae10c60-f989-4c99-bde4-60cd9f3e2055_del complete
Nov 29 18:02:04 user nova-compute[74613]: INFO nova.compute.manager [None req-370dd5a9-5a25-4ba9-aad8-3384420f5da1 tempest-TestShelveInstance-765407413 tempest-TestShelveInstance-765407413-project-member] [instance: fae10c60-f989-4c99-bde4-60cd9f3e2055] Took 1.20 seconds to destroy the instance on the hypervisor.
Nov 29 18:02:04 user nova-compute[74613]: DEBUG oslo.service.loopingcall [None req-370dd5a9-5a25-4ba9-aad8-3384420f5da1 tempest-TestShelveInstance-765407413 tempest-TestShelveInstance-765407413-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74613) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 29 18:02:04 user nova-compute[74613]: DEBUG nova.compute.manager [-] [instance: fae10c60-f989-4c99-bde4-60cd9f3e2055] Deallocating network for instance {{(pid=74613) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 29 18:02:04 user nova-compute[74613]: DEBUG nova.network.neutron [-] [instance: fae10c60-f989-4c99-bde4-60cd9f3e2055] deallocate_for_instance() {{(pid=74613) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 29 18:02:04 user nova-compute[74613]: DEBUG nova.network.neutron [-] [instance: fae10c60-f989-4c99-bde4-60cd9f3e2055] Updating instance_info_cache with network_info: [] {{(pid=74613) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 18:02:04 user nova-compute[74613]: INFO nova.compute.manager [-] [instance: fae10c60-f989-4c99-bde4-60cd9f3e2055] Took 0.56 seconds to deallocate network for instance.
Nov 29 18:02:05 user nova-compute[74613]: DEBUG nova.compute.manager [req-7ba3368f-1b97-4d79-9429-a3044d3090a9 req-39510ca9-0361-40f1-b266-c9f00c7e4423 service nova] [instance: fae10c60-f989-4c99-bde4-60cd9f3e2055] Received event network-vif-deleted-435f55bd-6b68-4466-96d8-7ca838b0a594 {{(pid=74613) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 18:02:05 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:02:05 user nova-compute[74613]: DEBUG nova.compute.manager [req-624ed7d2-8267-4f5a-b0b9-feb153926f3d req-2b906244-ed88-4cb1-a9ad-71d5ddea8a84 service nova] [instance: fae10c60-f989-4c99-bde4-60cd9f3e2055] Received event network-vif-plugged-435f55bd-6b68-4466-96d8-7ca838b0a594 {{(pid=74613) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 18:02:05 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-624ed7d2-8267-4f5a-b0b9-feb153926f3d req-2b906244-ed88-4cb1-a9ad-71d5ddea8a84 service nova] Acquiring lock "fae10c60-f989-4c99-bde4-60cd9f3e2055-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 18:02:05 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-624ed7d2-8267-4f5a-b0b9-feb153926f3d req-2b906244-ed88-4cb1-a9ad-71d5ddea8a84 service nova] Lock "fae10c60-f989-4c99-bde4-60cd9f3e2055-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 18:02:05 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-624ed7d2-8267-4f5a-b0b9-feb153926f3d req-2b906244-ed88-4cb1-a9ad-71d5ddea8a84 service nova] Lock "fae10c60-f989-4c99-bde4-60cd9f3e2055-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 18:02:05 user nova-compute[74613]: DEBUG nova.compute.manager [req-624ed7d2-8267-4f5a-b0b9-feb153926f3d req-2b906244-ed88-4cb1-a9ad-71d5ddea8a84 service nova] [instance: fae10c60-f989-4c99-bde4-60cd9f3e2055] No waiting events found dispatching network-vif-plugged-435f55bd-6b68-4466-96d8-7ca838b0a594 {{(pid=74613) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 18:02:05 user nova-compute[74613]: WARNING nova.compute.manager [req-624ed7d2-8267-4f5a-b0b9-feb153926f3d req-2b906244-ed88-4cb1-a9ad-71d5ddea8a84 service nova] [instance: fae10c60-f989-4c99-bde4-60cd9f3e2055] Received unexpected event network-vif-plugged-435f55bd-6b68-4466-96d8-7ca838b0a594 for instance with vm_state active and task_state deleting.
Nov 29 18:02:05 user nova-compute[74613]: INFO nova.compute.manager [None req-370dd5a9-5a25-4ba9-aad8-3384420f5da1 tempest-TestShelveInstance-765407413 tempest-TestShelveInstance-765407413-project-member] [instance: fae10c60-f989-4c99-bde4-60cd9f3e2055] Took 0.77 seconds to detach 1 volumes for instance.
Nov 29 18:02:05 user nova-compute[74613]: DEBUG nova.compute.manager [None req-370dd5a9-5a25-4ba9-aad8-3384420f5da1 tempest-TestShelveInstance-765407413 tempest-TestShelveInstance-765407413-project-member] [instance: fae10c60-f989-4c99-bde4-60cd9f3e2055] Deleting volume: 6a07b572-6430-4d0f-9aaf-8a8dbc39831e {{(pid=74613) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3237}}
Nov 29 18:02:05 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-370dd5a9-5a25-4ba9-aad8-3384420f5da1 tempest-TestShelveInstance-765407413 tempest-TestShelveInstance-765407413-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 18:02:05 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-370dd5a9-5a25-4ba9-aad8-3384420f5da1 tempest-TestShelveInstance-765407413 tempest-TestShelveInstance-765407413-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 18:02:06 user nova-compute[74613]: DEBUG nova.compute.provider_tree [None req-370dd5a9-5a25-4ba9-aad8-3384420f5da1 tempest-TestShelveInstance-765407413 tempest-TestShelveInstance-765407413-project-member] Inventory has not changed in ProviderTree for provider: 639d980e-3b12-44b1-b8f4-1812416fa4dd {{(pid=74613) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 18:02:06 user nova-compute[74613]: DEBUG nova.scheduler.client.report [None req-370dd5a9-5a25-4ba9-aad8-3384420f5da1 tempest-TestShelveInstance-765407413 tempest-TestShelveInstance-765407413-project-member] Inventory has not changed for provider 639d980e-3b12-44b1-b8f4-1812416fa4dd based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74613) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 18:02:06 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-370dd5a9-5a25-4ba9-aad8-3384420f5da1 tempest-TestShelveInstance-765407413 tempest-TestShelveInstance-765407413-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.306s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 18:02:06 user nova-compute[74613]: INFO nova.scheduler.client.report [None req-370dd5a9-5a25-4ba9-aad8-3384420f5da1 tempest-TestShelveInstance-765407413 tempest-TestShelveInstance-765407413-project-member] Deleted allocations for instance fae10c60-f989-4c99-bde4-60cd9f3e2055
Nov 29 18:02:06 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-370dd5a9-5a25-4ba9-aad8-3384420f5da1 tempest-TestShelveInstance-765407413 tempest-TestShelveInstance-765407413-project-member] Lock "fae10c60-f989-4c99-bde4-60cd9f3e2055" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.086s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 18:02:08 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:02:08 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-603b4fd6-5c7e-4ec0-aa34-d338b3ebeb78 tempest-VolumesAdminNegativeTest-636556351 tempest-VolumesAdminNegativeTest-636556351-project-member] Acquiring lock "0aa463c6-01e7-48e5-b082-e083558342e3" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 18:02:08 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-603b4fd6-5c7e-4ec0-aa34-d338b3ebeb78 tempest-VolumesAdminNegativeTest-636556351 tempest-VolumesAdminNegativeTest-636556351-project-member] Lock "0aa463c6-01e7-48e5-b082-e083558342e3" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 18:02:08 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-603b4fd6-5c7e-4ec0-aa34-d338b3ebeb78 tempest-VolumesAdminNegativeTest-636556351 tempest-VolumesAdminNegativeTest-636556351-project-member] Acquiring lock "0aa463c6-01e7-48e5-b082-e083558342e3-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 18:02:08 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-603b4fd6-5c7e-4ec0-aa34-d338b3ebeb78 tempest-VolumesAdminNegativeTest-636556351 tempest-VolumesAdminNegativeTest-636556351-project-member] Lock "0aa463c6-01e7-48e5-b082-e083558342e3-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 18:02:08 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-603b4fd6-5c7e-4ec0-aa34-d338b3ebeb78 tempest-VolumesAdminNegativeTest-636556351 tempest-VolumesAdminNegativeTest-636556351-project-member] Lock "0aa463c6-01e7-48e5-b082-e083558342e3-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 18:02:08 user nova-compute[74613]: INFO nova.compute.manager [None req-603b4fd6-5c7e-4ec0-aa34-d338b3ebeb78 tempest-VolumesAdminNegativeTest-636556351 tempest-VolumesAdminNegativeTest-636556351-project-member] [instance: 0aa463c6-01e7-48e5-b082-e083558342e3] Terminating instance
Nov 29 18:02:08 user nova-compute[74613]: DEBUG nova.compute.manager [None req-603b4fd6-5c7e-4ec0-aa34-d338b3ebeb78 tempest-VolumesAdminNegativeTest-636556351 tempest-VolumesAdminNegativeTest-636556351-project-member] [instance: 0aa463c6-01e7-48e5-b082-e083558342e3] Start destroying the instance on the hypervisor. {{(pid=74613) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 29 18:02:09 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:02:09 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:02:09 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:02:09 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:02:09 user nova-compute[74613]: DEBUG nova.compute.manager [req-8565355d-6780-401a-92d9-e6afdd9edc29 req-7d579709-1869-478f-b24f-296eac5c0db9 service nova] [instance: 0aa463c6-01e7-48e5-b082-e083558342e3] Received event network-vif-unplugged-9e74da09-a403-40b9-aad1-3cba1f7bd9d5 {{(pid=74613) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 18:02:09 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-8565355d-6780-401a-92d9-e6afdd9edc29 req-7d579709-1869-478f-b24f-296eac5c0db9 service nova] Acquiring lock "0aa463c6-01e7-48e5-b082-e083558342e3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 18:02:09 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-8565355d-6780-401a-92d9-e6afdd9edc29 req-7d579709-1869-478f-b24f-296eac5c0db9 service nova] Lock "0aa463c6-01e7-48e5-b082-e083558342e3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 18:02:09 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-8565355d-6780-401a-92d9-e6afdd9edc29 req-7d579709-1869-478f-b24f-296eac5c0db9 service nova] Lock "0aa463c6-01e7-48e5-b082-e083558342e3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 18:02:09 user nova-compute[74613]: DEBUG nova.compute.manager [req-8565355d-6780-401a-92d9-e6afdd9edc29 req-7d579709-1869-478f-b24f-296eac5c0db9 service nova] [instance: 0aa463c6-01e7-48e5-b082-e083558342e3] No waiting events found dispatching network-vif-unplugged-9e74da09-a403-40b9-aad1-3cba1f7bd9d5 {{(pid=74613) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 18:02:09 user nova-compute[74613]: DEBUG nova.compute.manager [req-8565355d-6780-401a-92d9-e6afdd9edc29 req-7d579709-1869-478f-b24f-296eac5c0db9 service nova] [instance: 0aa463c6-01e7-48e5-b082-e083558342e3] Received event network-vif-unplugged-9e74da09-a403-40b9-aad1-3cba1f7bd9d5 for instance with task_state deleting. {{(pid=74613) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 29 18:02:09 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:02:09 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:02:09 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:02:09 user nova-compute[74613]: INFO nova.virt.libvirt.driver [-] [instance: 0aa463c6-01e7-48e5-b082-e083558342e3] Instance destroyed successfully.
Nov 29 18:02:09 user nova-compute[74613]: DEBUG nova.objects.instance [None req-603b4fd6-5c7e-4ec0-aa34-d338b3ebeb78 tempest-VolumesAdminNegativeTest-636556351 tempest-VolumesAdminNegativeTest-636556351-project-member] Lazy-loading 'resources' on Instance uuid 0aa463c6-01e7-48e5-b082-e083558342e3 {{(pid=74613) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 18:02:09 user nova-compute[74613]: DEBUG nova.virt.libvirt.vif [None req-603b4fd6-5c7e-4ec0-aa34-d338b3ebeb78 tempest-VolumesAdminNegativeTest-636556351 tempest-VolumesAdminNegativeTest-636556351-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T17:56:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-1171036164',display_name='tempest-VolumesAdminNegativeTest-server-1171036164',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-1171036164',id=16,image_ref='4217f428-8d9d-4ee1-9614-642d26d90c46',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJzEcx+pvIzWz9B0zsP6HNvpl08xJtvEPhXbMpRmrj+5h08SDzgAu/NTTVld6GHJalJRL6Fv8WGccfo6wX6sGwc1fKKi6HWbUjd0peJDc6RTT1Q4FQVNIPosU9KceOmOgg==',key_name='tempest-keypair-1561426885',keypairs=<?>,launch_index=0,launched_at=2023-11-29T17:56:30Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='3832a80aaabc42ba8400823aa6b76c29',ramdisk_id='',reservation_id='r-ty4441no',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='4217f428-8d9d-4ee1-9614-642d26d90c46',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesAdminNegativeTest-636556351',owner_user_name='tempest-VolumesAdminNegativeTest-636556351-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-29T17:56:31Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='30b382b3a0c44bdf8ea91ea3ae780243',uuid=0aa463c6-01e7-48e5-b082-e083558342e3,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "9e74da09-a403-40b9-aad1-3cba1f7bd9d5", "address": "fa:16:3e:78:6a:83", "network": {"id": "485e1e0d-aa2c-47c2-a010-c84e83dbcc9c", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-686908926-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.230", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3832a80aaabc42ba8400823aa6b76c29", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9e74da09-a4", "ovs_interfaceid": "9e74da09-a403-40b9-aad1-3cba1f7bd9d5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74613) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 29 18:02:09 user nova-compute[74613]: DEBUG nova.network.os_vif_util [None req-603b4fd6-5c7e-4ec0-aa34-d338b3ebeb78 tempest-VolumesAdminNegativeTest-636556351 tempest-VolumesAdminNegativeTest-636556351-project-member] Converting VIF {"id": "9e74da09-a403-40b9-aad1-3cba1f7bd9d5", "address": "fa:16:3e:78:6a:83", "network": {"id": "485e1e0d-aa2c-47c2-a010-c84e83dbcc9c", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-686908926-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.230", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3832a80aaabc42ba8400823aa6b76c29", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9e74da09-a4", "ovs_interfaceid": "9e74da09-a403-40b9-aad1-3cba1f7bd9d5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74613) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 18:02:09 user nova-compute[74613]: DEBUG nova.network.os_vif_util [None req-603b4fd6-5c7e-4ec0-aa34-d338b3ebeb78 tempest-VolumesAdminNegativeTest-636556351 tempest-VolumesAdminNegativeTest-636556351-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:78:6a:83,bridge_name='br-int',has_traffic_filtering=True,id=9e74da09-a403-40b9-aad1-3cba1f7bd9d5,network=Network(485e1e0d-aa2c-47c2-a010-c84e83dbcc9c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9e74da09-a4') {{(pid=74613) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 18:02:09 user nova-compute[74613]: DEBUG os_vif [None req-603b4fd6-5c7e-4ec0-aa34-d338b3ebeb78 tempest-VolumesAdminNegativeTest-636556351 tempest-VolumesAdminNegativeTest-636556351-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:78:6a:83,bridge_name='br-int',has_traffic_filtering=True,id=9e74da09-a403-40b9-aad1-3cba1f7bd9d5,network=Network(485e1e0d-aa2c-47c2-a010-c84e83dbcc9c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9e74da09-a4') {{(pid=74613) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 29 18:02:09 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:02:09 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap9e74da09-a4, bridge=br-int, if_exists=True) {{(pid=74613) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 18:02:09 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 18:02:09 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:02:09 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=babeb884-fd37-42cc-8346-cb1284f10d35) {{(pid=74613) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 18:02:09 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:02:09 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 18:02:09 user nova-compute[74613]: INFO os_vif [None req-603b4fd6-5c7e-4ec0-aa34-d338b3ebeb78 tempest-VolumesAdminNegativeTest-636556351 tempest-VolumesAdminNegativeTest-636556351-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:78:6a:83,bridge_name='br-int',has_traffic_filtering=True,id=9e74da09-a403-40b9-aad1-3cba1f7bd9d5,network=Network(485e1e0d-aa2c-47c2-a010-c84e83dbcc9c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9e74da09-a4')
Nov 29 18:02:09 user nova-compute[74613]: INFO nova.virt.libvirt.driver [None req-603b4fd6-5c7e-4ec0-aa34-d338b3ebeb78 tempest-VolumesAdminNegativeTest-636556351 tempest-VolumesAdminNegativeTest-636556351-project-member] [instance: 0aa463c6-01e7-48e5-b082-e083558342e3] Deleting instance files /opt/stack/data/nova/instances/0aa463c6-01e7-48e5-b082-e083558342e3_del
Nov 29 18:02:09 user nova-compute[74613]: INFO nova.virt.libvirt.driver [None req-603b4fd6-5c7e-4ec0-aa34-d338b3ebeb78 tempest-VolumesAdminNegativeTest-636556351 tempest-VolumesAdminNegativeTest-636556351-project-member] [instance: 0aa463c6-01e7-48e5-b082-e083558342e3] Deletion of /opt/stack/data/nova/instances/0aa463c6-01e7-48e5-b082-e083558342e3_del complete
Nov 29 18:02:09 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:02:09 user nova-compute[74613]: INFO nova.compute.manager [None req-603b4fd6-5c7e-4ec0-aa34-d338b3ebeb78 tempest-VolumesAdminNegativeTest-636556351 tempest-VolumesAdminNegativeTest-636556351-project-member] [instance: 0aa463c6-01e7-48e5-b082-e083558342e3] Took 0.86 seconds to destroy the instance on the hypervisor.
Nov 29 18:02:09 user nova-compute[74613]: DEBUG oslo.service.loopingcall [None req-603b4fd6-5c7e-4ec0-aa34-d338b3ebeb78 tempest-VolumesAdminNegativeTest-636556351 tempest-VolumesAdminNegativeTest-636556351-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74613) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 29 18:02:09 user nova-compute[74613]: DEBUG nova.compute.manager [-] [instance: 0aa463c6-01e7-48e5-b082-e083558342e3] Deallocating network for instance {{(pid=74613) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 29 18:02:09 user nova-compute[74613]: DEBUG nova.network.neutron [-] [instance: 0aa463c6-01e7-48e5-b082-e083558342e3] deallocate_for_instance() {{(pid=74613) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 29 18:02:10 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:02:10 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:02:10 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:02:10 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:02:10 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:02:10 user nova-compute[74613]: DEBUG nova.network.neutron [-] [instance: 0aa463c6-01e7-48e5-b082-e083558342e3] Updating instance_info_cache with network_info: [] {{(pid=74613) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 18:02:10 user nova-compute[74613]: INFO nova.compute.manager [-] [instance: 0aa463c6-01e7-48e5-b082-e083558342e3] Took 0.87 seconds to deallocate network for instance.
Nov 29 18:02:10 user nova-compute[74613]: DEBUG nova.compute.manager [req-fc2386e2-2fd0-4c05-9c26-ef0f3265012c req-e4c727a6-6130-4fed-8a6e-a1196fe43fec service nova] [instance: 0aa463c6-01e7-48e5-b082-e083558342e3] Received event network-vif-deleted-9e74da09-a403-40b9-aad1-3cba1f7bd9d5 {{(pid=74613) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 18:02:10 user nova-compute[74613]: INFO nova.compute.manager [req-fc2386e2-2fd0-4c05-9c26-ef0f3265012c req-e4c727a6-6130-4fed-8a6e-a1196fe43fec service nova] [instance: 0aa463c6-01e7-48e5-b082-e083558342e3] Neutron deleted interface 9e74da09-a403-40b9-aad1-3cba1f7bd9d5; detaching it from the instance and deleting it from the info cache
Nov 29 18:02:10 user nova-compute[74613]: DEBUG nova.network.neutron [req-fc2386e2-2fd0-4c05-9c26-ef0f3265012c req-e4c727a6-6130-4fed-8a6e-a1196fe43fec service nova] [instance: 0aa463c6-01e7-48e5-b082-e083558342e3] Updating instance_info_cache with network_info: [] {{(pid=74613) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 18:02:10 user nova-compute[74613]: DEBUG nova.compute.manager [req-fc2386e2-2fd0-4c05-9c26-ef0f3265012c req-e4c727a6-6130-4fed-8a6e-a1196fe43fec service nova] [instance: 0aa463c6-01e7-48e5-b082-e083558342e3] Detach interface failed, port_id=9e74da09-a403-40b9-aad1-3cba1f7bd9d5, reason: Instance 0aa463c6-01e7-48e5-b082-e083558342e3 could not be found. {{(pid=74613) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 29 18:02:10 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-603b4fd6-5c7e-4ec0-aa34-d338b3ebeb78 tempest-VolumesAdminNegativeTest-636556351 tempest-VolumesAdminNegativeTest-636556351-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 18:02:10 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-603b4fd6-5c7e-4ec0-aa34-d338b3ebeb78 tempest-VolumesAdminNegativeTest-636556351 tempest-VolumesAdminNegativeTest-636556351-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 18:02:11 user nova-compute[74613]: DEBUG nova.compute.provider_tree [None req-603b4fd6-5c7e-4ec0-aa34-d338b3ebeb78 tempest-VolumesAdminNegativeTest-636556351 tempest-VolumesAdminNegativeTest-636556351-project-member] Inventory has not changed in ProviderTree for provider: 639d980e-3b12-44b1-b8f4-1812416fa4dd {{(pid=74613) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 18:02:11 user nova-compute[74613]: DEBUG nova.scheduler.client.report [None req-603b4fd6-5c7e-4ec0-aa34-d338b3ebeb78 tempest-VolumesAdminNegativeTest-636556351 tempest-VolumesAdminNegativeTest-636556351-project-member] Inventory has not changed for provider 639d980e-3b12-44b1-b8f4-1812416fa4dd based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74613) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 18:02:11 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-603b4fd6-5c7e-4ec0-aa34-d338b3ebeb78 tempest-VolumesAdminNegativeTest-636556351 tempest-VolumesAdminNegativeTest-636556351-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.316s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 18:02:11 user nova-compute[74613]: INFO nova.scheduler.client.report [None req-603b4fd6-5c7e-4ec0-aa34-d338b3ebeb78 tempest-VolumesAdminNegativeTest-636556351 tempest-VolumesAdminNegativeTest-636556351-project-member] Deleted allocations for instance 0aa463c6-01e7-48e5-b082-e083558342e3
Nov 29 18:02:11 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-603b4fd6-5c7e-4ec0-aa34-d338b3ebeb78 tempest-VolumesAdminNegativeTest-636556351 tempest-VolumesAdminNegativeTest-636556351-project-member] Lock "0aa463c6-01e7-48e5-b082-e083558342e3" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.224s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 18:02:11 user nova-compute[74613]: DEBUG nova.compute.manager [req-8d7a7154-486c-425d-8bd6-7c5aa984b229 req-15ac7415-87b8-4494-94c3-cd54d268293e service nova] [instance: 0aa463c6-01e7-48e5-b082-e083558342e3] Received event network-vif-plugged-9e74da09-a403-40b9-aad1-3cba1f7bd9d5 {{(pid=74613) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 18:02:11 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-8d7a7154-486c-425d-8bd6-7c5aa984b229 req-15ac7415-87b8-4494-94c3-cd54d268293e service nova] Acquiring lock "0aa463c6-01e7-48e5-b082-e083558342e3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 18:02:11 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-8d7a7154-486c-425d-8bd6-7c5aa984b229 req-15ac7415-87b8-4494-94c3-cd54d268293e service nova] Lock "0aa463c6-01e7-48e5-b082-e083558342e3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 18:02:11 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-8d7a7154-486c-425d-8bd6-7c5aa984b229 req-15ac7415-87b8-4494-94c3-cd54d268293e service nova] Lock "0aa463c6-01e7-48e5-b082-e083558342e3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 18:02:11 user nova-compute[74613]: DEBUG nova.compute.manager [req-8d7a7154-486c-425d-8bd6-7c5aa984b229 req-15ac7415-87b8-4494-94c3-cd54d268293e service nova] [instance: 0aa463c6-01e7-48e5-b082-e083558342e3] No waiting events found dispatching network-vif-plugged-9e74da09-a403-40b9-aad1-3cba1f7bd9d5 {{(pid=74613) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 18:02:11 user nova-compute[74613]: WARNING nova.compute.manager [req-8d7a7154-486c-425d-8bd6-7c5aa984b229 req-15ac7415-87b8-4494-94c3-cd54d268293e service nova] [instance: 0aa463c6-01e7-48e5-b082-e083558342e3] Received unexpected event network-vif-plugged-9e74da09-a403-40b9-aad1-3cba1f7bd9d5 for instance with vm_state deleted and task_state None.
Nov 29 18:02:11 user nova-compute[74613]: DEBUG nova.compute.manager [req-8d7a7154-486c-425d-8bd6-7c5aa984b229 req-15ac7415-87b8-4494-94c3-cd54d268293e service nova] [instance: 0aa463c6-01e7-48e5-b082-e083558342e3] Received event network-vif-plugged-9e74da09-a403-40b9-aad1-3cba1f7bd9d5 {{(pid=74613) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 18:02:11 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-8d7a7154-486c-425d-8bd6-7c5aa984b229 req-15ac7415-87b8-4494-94c3-cd54d268293e service nova] Acquiring lock "0aa463c6-01e7-48e5-b082-e083558342e3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 18:02:11 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-8d7a7154-486c-425d-8bd6-7c5aa984b229 req-15ac7415-87b8-4494-94c3-cd54d268293e service nova] Lock "0aa463c6-01e7-48e5-b082-e083558342e3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 18:02:11 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-8d7a7154-486c-425d-8bd6-7c5aa984b229 req-15ac7415-87b8-4494-94c3-cd54d268293e service nova] Lock "0aa463c6-01e7-48e5-b082-e083558342e3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 18:02:11 user nova-compute[74613]: DEBUG nova.compute.manager [req-8d7a7154-486c-425d-8bd6-7c5aa984b229 req-15ac7415-87b8-4494-94c3-cd54d268293e service nova] [instance: 0aa463c6-01e7-48e5-b082-e083558342e3] No waiting events found dispatching network-vif-plugged-9e74da09-a403-40b9-aad1-3cba1f7bd9d5 {{(pid=74613) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 18:02:11 user nova-compute[74613]: WARNING nova.compute.manager [req-8d7a7154-486c-425d-8bd6-7c5aa984b229 req-15ac7415-87b8-4494-94c3-cd54d268293e service nova] [instance: 0aa463c6-01e7-48e5-b082-e083558342e3] Received unexpected event network-vif-plugged-9e74da09-a403-40b9-aad1-3cba1f7bd9d5 for instance with vm_state deleted and task_state None.
Nov 29 18:02:11 user nova-compute[74613]: DEBUG nova.compute.manager [req-8d7a7154-486c-425d-8bd6-7c5aa984b229 req-15ac7415-87b8-4494-94c3-cd54d268293e service nova] [instance: 0aa463c6-01e7-48e5-b082-e083558342e3] Received event network-vif-plugged-9e74da09-a403-40b9-aad1-3cba1f7bd9d5 {{(pid=74613) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 18:02:11 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-8d7a7154-486c-425d-8bd6-7c5aa984b229 req-15ac7415-87b8-4494-94c3-cd54d268293e service nova] Acquiring lock "0aa463c6-01e7-48e5-b082-e083558342e3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 18:02:11 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-8d7a7154-486c-425d-8bd6-7c5aa984b229 req-15ac7415-87b8-4494-94c3-cd54d268293e service nova] Lock "0aa463c6-01e7-48e5-b082-e083558342e3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 18:02:11 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-8d7a7154-486c-425d-8bd6-7c5aa984b229 req-15ac7415-87b8-4494-94c3-cd54d268293e service nova] Lock "0aa463c6-01e7-48e5-b082-e083558342e3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 18:02:11 user nova-compute[74613]: DEBUG nova.compute.manager [req-8d7a7154-486c-425d-8bd6-7c5aa984b229 req-15ac7415-87b8-4494-94c3-cd54d268293e service nova] [instance: 0aa463c6-01e7-48e5-b082-e083558342e3] No waiting events found dispatching network-vif-plugged-9e74da09-a403-40b9-aad1-3cba1f7bd9d5 {{(pid=74613) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 18:02:11 user nova-compute[74613]: WARNING nova.compute.manager [req-8d7a7154-486c-425d-8bd6-7c5aa984b229 req-15ac7415-87b8-4494-94c3-cd54d268293e service nova] [instance: 0aa463c6-01e7-48e5-b082-e083558342e3] Received unexpected event network-vif-plugged-9e74da09-a403-40b9-aad1-3cba1f7bd9d5 for instance with vm_state deleted and task_state None.
Nov 29 18:02:11 user nova-compute[74613]: DEBUG nova.compute.manager [req-8d7a7154-486c-425d-8bd6-7c5aa984b229 req-15ac7415-87b8-4494-94c3-cd54d268293e service nova] [instance: 0aa463c6-01e7-48e5-b082-e083558342e3] Received event network-vif-unplugged-9e74da09-a403-40b9-aad1-3cba1f7bd9d5 {{(pid=74613) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 18:02:11 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-8d7a7154-486c-425d-8bd6-7c5aa984b229 req-15ac7415-87b8-4494-94c3-cd54d268293e service nova] Acquiring lock "0aa463c6-01e7-48e5-b082-e083558342e3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 18:02:11 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-8d7a7154-486c-425d-8bd6-7c5aa984b229 req-15ac7415-87b8-4494-94c3-cd54d268293e service nova] Lock "0aa463c6-01e7-48e5-b082-e083558342e3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 18:02:11 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-8d7a7154-486c-425d-8bd6-7c5aa984b229 req-15ac7415-87b8-4494-94c3-cd54d268293e service nova] Lock "0aa463c6-01e7-48e5-b082-e083558342e3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 18:02:11 user nova-compute[74613]: DEBUG nova.compute.manager [req-8d7a7154-486c-425d-8bd6-7c5aa984b229 req-15ac7415-87b8-4494-94c3-cd54d268293e service nova] [instance: 0aa463c6-01e7-48e5-b082-e083558342e3] No waiting events found dispatching network-vif-unplugged-9e74da09-a403-40b9-aad1-3cba1f7bd9d5 {{(pid=74613) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 18:02:11 user nova-compute[74613]: WARNING nova.compute.manager [req-8d7a7154-486c-425d-8bd6-7c5aa984b229 req-15ac7415-87b8-4494-94c3-cd54d268293e service nova] [instance: 0aa463c6-01e7-48e5-b082-e083558342e3] Received unexpected event network-vif-unplugged-9e74da09-a403-40b9-aad1-3cba1f7bd9d5 for instance with vm_state deleted and task_state None.
Nov 29 18:02:11 user nova-compute[74613]: DEBUG nova.compute.manager [req-8d7a7154-486c-425d-8bd6-7c5aa984b229 req-15ac7415-87b8-4494-94c3-cd54d268293e service nova] [instance: 0aa463c6-01e7-48e5-b082-e083558342e3] Received event network-vif-plugged-9e74da09-a403-40b9-aad1-3cba1f7bd9d5 {{(pid=74613) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 18:02:11 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-8d7a7154-486c-425d-8bd6-7c5aa984b229 req-15ac7415-87b8-4494-94c3-cd54d268293e service nova] Acquiring lock "0aa463c6-01e7-48e5-b082-e083558342e3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 18:02:11 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-8d7a7154-486c-425d-8bd6-7c5aa984b229 req-15ac7415-87b8-4494-94c3-cd54d268293e service nova] Lock "0aa463c6-01e7-48e5-b082-e083558342e3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 18:02:11 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-8d7a7154-486c-425d-8bd6-7c5aa984b229 req-15ac7415-87b8-4494-94c3-cd54d268293e service nova] Lock "0aa463c6-01e7-48e5-b082-e083558342e3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 18:02:11 user nova-compute[74613]: DEBUG nova.compute.manager [req-8d7a7154-486c-425d-8bd6-7c5aa984b229 req-15ac7415-87b8-4494-94c3-cd54d268293e service nova] [instance: 0aa463c6-01e7-48e5-b082-e083558342e3] No waiting events found dispatching network-vif-plugged-9e74da09-a403-40b9-aad1-3cba1f7bd9d5 {{(pid=74613) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 18:02:11 user nova-compute[74613]: WARNING nova.compute.manager [req-8d7a7154-486c-425d-8bd6-7c5aa984b229 req-15ac7415-87b8-4494-94c3-cd54d268293e service nova] [instance: 0aa463c6-01e7-48e5-b082-e083558342e3] Received unexpected event network-vif-plugged-9e74da09-a403-40b9-aad1-3cba1f7bd9d5 for instance with vm_state deleted and task_state None.
Nov 29 18:02:14 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:02:19 user nova-compute[74613]: DEBUG oslo_service.periodic_task [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74613) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 18:02:19 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 18:02:19 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 18:02:19 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 18:02:19 user nova-compute[74613]: DEBUG nova.compute.resource_tracker [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Auditing locally available compute resources for user (node: user) {{(pid=74613) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 29 18:02:19 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:02:19 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6c2ea311-0404-4ecf-8086-65f65186f858/disk --force-share --output=json {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:02:19 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6c2ea311-0404-4ecf-8086-65f65186f858/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:02:19 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6c2ea311-0404-4ecf-8086-65f65186f858/disk --force-share --output=json {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:02:20 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6c2ea311-0404-4ecf-8086-65f65186f858/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:02:20 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c4bdb712-e1f9-4fc0-b527-87088d7eddf8/disk --force-share --output=json {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:02:20 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c4bdb712-e1f9-4fc0-b527-87088d7eddf8/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:02:20 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c4bdb712-e1f9-4fc0-b527-87088d7eddf8/disk --force-share --output=json {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:02:20 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c4bdb712-e1f9-4fc0-b527-87088d7eddf8/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:02:20 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3b828860-5cc5-40b0-b845-8e560211794e/disk --force-share --output=json {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:02:20 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3b828860-5cc5-40b0-b845-8e560211794e/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:02:20 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3b828860-5cc5-40b0-b845-8e560211794e/disk --force-share --output=json {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:02:20 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3b828860-5cc5-40b0-b845-8e560211794e/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:02:20 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/abc9e2b8-f467-4cd0-b40f-de511fde1ec1/disk --force-share --output=json {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:02:21 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/abc9e2b8-f467-4cd0-b40f-de511fde1ec1/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:02:21 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/abc9e2b8-f467-4cd0-b40f-de511fde1ec1/disk --force-share --output=json {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:02:21 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/abc9e2b8-f467-4cd0-b40f-de511fde1ec1/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:02:21 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74613) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 29 18:02:21 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8fc8496b-1435-4b5f-8977-6c0d7467ef65/disk --force-share --output=json {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:02:21 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8fc8496b-1435-4b5f-8977-6c0d7467ef65/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:02:21 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8fc8496b-1435-4b5f-8977-6c0d7467ef65/disk --force-share --output=json {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:02:21 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8fc8496b-1435-4b5f-8977-6c0d7467ef65/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:02:21 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5221f9b9-e4db-406b-ae82-4a7c6522ee64/disk --force-share --output=json {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:02:21 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5221f9b9-e4db-406b-ae82-4a7c6522ee64/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:02:21 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5221f9b9-e4db-406b-ae82-4a7c6522ee64/disk --force-share --output=json {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:02:22 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5221f9b9-e4db-406b-ae82-4a7c6522ee64/disk --force-share --output=json" returned: 0 in 0.211s {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:02:22 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/74ac9703-1cd7-4983-b7d4-c69b01fec7b2/disk --force-share --output=json {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:02:22 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/74ac9703-1cd7-4983-b7d4-c69b01fec7b2/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:02:22 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/74ac9703-1cd7-4983-b7d4-c69b01fec7b2/disk --force-share --output=json {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:02:22 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/74ac9703-1cd7-4983-b7d4-c69b01fec7b2/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:02:22 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=74613) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 29 18:02:22 user nova-compute[74613]: WARNING nova.virt.libvirt.driver [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 18:02:22 user nova-compute[74613]: WARNING nova.virt.libvirt.driver [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 18:02:22 user nova-compute[74613]: DEBUG nova.compute.resource_tracker [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Hypervisor/Node resource view: name=user free_ram=7923MB free_disk=24.91946029663086GB free_vcpus=4 pci_devices=[{"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74613) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 29 18:02:22 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 18:02:22 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 18:02:22 user nova-compute[74613]: DEBUG nova.compute.resource_tracker [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Instance 3b828860-5cc5-40b0-b845-8e560211794e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74613) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 18:02:22 user nova-compute[74613]: DEBUG nova.compute.resource_tracker [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Instance abc9e2b8-f467-4cd0-b40f-de511fde1ec1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74613) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 18:02:22 user nova-compute[74613]: DEBUG nova.compute.resource_tracker [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Instance cd22685a-028c-4e0c-834d-e7b20f6d06ab actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74613) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 18:02:22 user nova-compute[74613]: DEBUG nova.compute.resource_tracker [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Instance c4bdb712-e1f9-4fc0-b527-87088d7eddf8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74613) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 18:02:22 user nova-compute[74613]: DEBUG nova.compute.resource_tracker [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Instance 74ac9703-1cd7-4983-b7d4-c69b01fec7b2 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74613) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 18:02:22 user nova-compute[74613]: DEBUG nova.compute.resource_tracker [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Instance 5221f9b9-e4db-406b-ae82-4a7c6522ee64 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74613) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 18:02:22 user nova-compute[74613]: DEBUG nova.compute.resource_tracker [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Instance 8fc8496b-1435-4b5f-8977-6c0d7467ef65 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74613) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 18:02:22 user nova-compute[74613]: DEBUG nova.compute.resource_tracker [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Instance 6c2ea311-0404-4ecf-8086-65f65186f858 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74613) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 18:02:22 user nova-compute[74613]: DEBUG nova.compute.resource_tracker [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Total usable vcpus: 12, total allocated vcpus: 8 {{(pid=74613) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 29 18:02:22 user nova-compute[74613]: DEBUG nova.compute.resource_tracker [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Final resource view: name=user phys_ram=16011MB used_ram=4608MB phys_disk=40GB used_disk=7GB total_vcpus=12 used_vcpus=8 pci_stats=[] {{(pid=74613) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 29 18:02:23 user nova-compute[74613]: DEBUG nova.compute.provider_tree [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Inventory has not changed in ProviderTree for provider: 639d980e-3b12-44b1-b8f4-1812416fa4dd {{(pid=74613) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 18:02:23 user nova-compute[74613]: DEBUG nova.scheduler.client.report [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Inventory has not changed for provider 639d980e-3b12-44b1-b8f4-1812416fa4dd based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74613) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 18:02:23 user nova-compute[74613]: DEBUG nova.compute.resource_tracker [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Compute_service record updated for user:user {{(pid=74613) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 29 18:02:23 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.474s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 18:02:23 user nova-compute[74613]: DEBUG oslo_service.periodic_task [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=74613) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 18:02:23 user nova-compute[74613]: DEBUG nova.compute.manager [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Cleaning up deleted instances with incomplete migration  {{(pid=74613) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 29 18:02:23 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-0e17657b-f985-4c05-9f48-e2c357c49cd9 tempest-TestServerVolumeAttachScenarioOldVersion-673194571 tempest-TestServerVolumeAttachScenarioOldVersion-673194571-project-member] Acquiring lock "5221f9b9-e4db-406b-ae82-4a7c6522ee64" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 18:02:23 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-0e17657b-f985-4c05-9f48-e2c357c49cd9 tempest-TestServerVolumeAttachScenarioOldVersion-673194571 tempest-TestServerVolumeAttachScenarioOldVersion-673194571-project-member] Lock "5221f9b9-e4db-406b-ae82-4a7c6522ee64" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 18:02:23 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-0e17657b-f985-4c05-9f48-e2c357c49cd9 tempest-TestServerVolumeAttachScenarioOldVersion-673194571 tempest-TestServerVolumeAttachScenarioOldVersion-673194571-project-member] Acquiring lock "5221f9b9-e4db-406b-ae82-4a7c6522ee64-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 18:02:23 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-0e17657b-f985-4c05-9f48-e2c357c49cd9 tempest-TestServerVolumeAttachScenarioOldVersion-673194571 tempest-TestServerVolumeAttachScenarioOldVersion-673194571-project-member] Lock "5221f9b9-e4db-406b-ae82-4a7c6522ee64-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 18:02:23 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-0e17657b-f985-4c05-9f48-e2c357c49cd9 tempest-TestServerVolumeAttachScenarioOldVersion-673194571 tempest-TestServerVolumeAttachScenarioOldVersion-673194571-project-member] Lock "5221f9b9-e4db-406b-ae82-4a7c6522ee64-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 18:02:23 user nova-compute[74613]: INFO nova.compute.manager [None req-0e17657b-f985-4c05-9f48-e2c357c49cd9 tempest-TestServerVolumeAttachScenarioOldVersion-673194571 tempest-TestServerVolumeAttachScenarioOldVersion-673194571-project-member] [instance: 5221f9b9-e4db-406b-ae82-4a7c6522ee64] Terminating instance
Nov 29 18:02:23 user nova-compute[74613]: DEBUG nova.compute.manager [None req-0e17657b-f985-4c05-9f48-e2c357c49cd9 tempest-TestServerVolumeAttachScenarioOldVersion-673194571 tempest-TestServerVolumeAttachScenarioOldVersion-673194571-project-member] [instance: 5221f9b9-e4db-406b-ae82-4a7c6522ee64] Start destroying the instance on the hypervisor. {{(pid=74613) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 29 18:02:24 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:02:24 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:02:24 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:02:24 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:02:24 user nova-compute[74613]: DEBUG nova.compute.manager [req-5fee37da-82d9-40d9-99dc-343b70f29f3e req-22f4f06e-4728-4374-9d46-982104079a3e service nova] [instance: 5221f9b9-e4db-406b-ae82-4a7c6522ee64] Received event network-vif-unplugged-2b04c4cf-f85a-4089-8f4a-e2a1c4eec1ae {{(pid=74613) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 18:02:24 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-5fee37da-82d9-40d9-99dc-343b70f29f3e req-22f4f06e-4728-4374-9d46-982104079a3e service nova] Acquiring lock "5221f9b9-e4db-406b-ae82-4a7c6522ee64-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 18:02:24 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-5fee37da-82d9-40d9-99dc-343b70f29f3e req-22f4f06e-4728-4374-9d46-982104079a3e service nova] Lock "5221f9b9-e4db-406b-ae82-4a7c6522ee64-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.003s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 18:02:24 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-5fee37da-82d9-40d9-99dc-343b70f29f3e req-22f4f06e-4728-4374-9d46-982104079a3e service nova] Lock "5221f9b9-e4db-406b-ae82-4a7c6522ee64-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 18:02:24 user nova-compute[74613]: DEBUG nova.compute.manager [req-5fee37da-82d9-40d9-99dc-343b70f29f3e req-22f4f06e-4728-4374-9d46-982104079a3e service nova] [instance: 5221f9b9-e4db-406b-ae82-4a7c6522ee64] No waiting events found dispatching network-vif-unplugged-2b04c4cf-f85a-4089-8f4a-e2a1c4eec1ae {{(pid=74613) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 18:02:24 user nova-compute[74613]: DEBUG nova.compute.manager [req-5fee37da-82d9-40d9-99dc-343b70f29f3e req-22f4f06e-4728-4374-9d46-982104079a3e service nova] [instance: 5221f9b9-e4db-406b-ae82-4a7c6522ee64] Received event network-vif-unplugged-2b04c4cf-f85a-4089-8f4a-e2a1c4eec1ae for instance with task_state deleting. {{(pid=74613) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 29 18:02:24 user nova-compute[74613]: DEBUG oslo_service.periodic_task [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74613) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 18:02:24 user nova-compute[74613]: DEBUG oslo_service.periodic_task [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74613) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 18:02:24 user nova-compute[74613]: DEBUG nova.compute.manager [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Starting heal instance info cache {{(pid=74613) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 29 18:02:24 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:02:24 user nova-compute[74613]: INFO nova.virt.libvirt.driver [-] [instance: 5221f9b9-e4db-406b-ae82-4a7c6522ee64] Instance destroyed successfully.
Nov 29 18:02:24 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Acquiring lock "refresh_cache-c4bdb712-e1f9-4fc0-b527-87088d7eddf8" {{(pid=74613) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 18:02:24 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Acquired lock "refresh_cache-c4bdb712-e1f9-4fc0-b527-87088d7eddf8" {{(pid=74613) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 18:02:24 user nova-compute[74613]: DEBUG nova.network.neutron [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] [instance: c4bdb712-e1f9-4fc0-b527-87088d7eddf8] Forcefully refreshing network info cache for instance {{(pid=74613) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 29 18:02:24 user nova-compute[74613]: DEBUG nova.objects.instance [None req-0e17657b-f985-4c05-9f48-e2c357c49cd9 tempest-TestServerVolumeAttachScenarioOldVersion-673194571 tempest-TestServerVolumeAttachScenarioOldVersion-673194571-project-member] Lazy-loading 'resources' on Instance uuid 5221f9b9-e4db-406b-ae82-4a7c6522ee64 {{(pid=74613) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 18:02:24 user nova-compute[74613]: DEBUG nova.virt.libvirt.vif [None req-0e17657b-f985-4c05-9f48-e2c357c49cd9 tempest-TestServerVolumeAttachScenarioOldVersion-673194571 tempest-TestServerVolumeAttachScenarioOldVersion-673194571-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T17:59:21Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestServerVolumeAttachScenarioOldVersion-server-1307106681',display_name='tempest-TestServerVolumeAttachScenarioOldVersion-server-1307106681',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachscenariooldversion-server-1307106',id=22,image_ref='4217f428-8d9d-4ee1-9614-642d26d90c46',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHp8I+7uFr6Myqto3Nvd4gevnTd55R+Vz8IzGZkzkbGsIqi9dm9N180ux9n95dcFjYBG6Ptof2ppf6OWO6/f2sYeBwi6BQf2QGH5A+F/q1TeKBwNzzppk1xSYSHzRISxwA==',key_name='tempest-keypair-121927362',keypairs=<?>,launch_index=0,launched_at=2023-11-29T17:59:31Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='0634597a325d46c18743626c2334e455',ramdisk_id='',reservation_id='r-pygyphy8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='4217f428-8d9d-4ee1-9614-642d26d90c46',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestServerVolumeAttachScenarioOldVersion-673194571',owner_user_name='tempest-TestServerVolumeAttachScenarioOldVersion-673194571-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-29T17:59:31Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='811b6a61f2d2428c8c179ba4bf3b5fa6',uuid=5221f9b9-e4db-406b-ae82-4a7c6522ee64,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "2b04c4cf-f85a-4089-8f4a-e2a1c4eec1ae", "address": "fa:16:3e:bc:57:f9", "network": {"id": "c8bdb714-50af-4c1d-9e06-9c71a384b633", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-489594897-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.221", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0634597a325d46c18743626c2334e455", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2b04c4cf-f8", "ovs_interfaceid": "2b04c4cf-f85a-4089-8f4a-e2a1c4eec1ae", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74613) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 29 18:02:24 user nova-compute[74613]: DEBUG nova.network.os_vif_util [None req-0e17657b-f985-4c05-9f48-e2c357c49cd9 tempest-TestServerVolumeAttachScenarioOldVersion-673194571 tempest-TestServerVolumeAttachScenarioOldVersion-673194571-project-member] Converting VIF {"id": "2b04c4cf-f85a-4089-8f4a-e2a1c4eec1ae", "address": "fa:16:3e:bc:57:f9", "network": {"id": "c8bdb714-50af-4c1d-9e06-9c71a384b633", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-489594897-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.221", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0634597a325d46c18743626c2334e455", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2b04c4cf-f8", "ovs_interfaceid": "2b04c4cf-f85a-4089-8f4a-e2a1c4eec1ae", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74613) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 18:02:24 user nova-compute[74613]: DEBUG nova.network.os_vif_util [None req-0e17657b-f985-4c05-9f48-e2c357c49cd9 tempest-TestServerVolumeAttachScenarioOldVersion-673194571 tempest-TestServerVolumeAttachScenarioOldVersion-673194571-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:bc:57:f9,bridge_name='br-int',has_traffic_filtering=True,id=2b04c4cf-f85a-4089-8f4a-e2a1c4eec1ae,network=Network(c8bdb714-50af-4c1d-9e06-9c71a384b633),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2b04c4cf-f8') {{(pid=74613) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 18:02:24 user nova-compute[74613]: DEBUG os_vif [None req-0e17657b-f985-4c05-9f48-e2c357c49cd9 tempest-TestServerVolumeAttachScenarioOldVersion-673194571 tempest-TestServerVolumeAttachScenarioOldVersion-673194571-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:bc:57:f9,bridge_name='br-int',has_traffic_filtering=True,id=2b04c4cf-f85a-4089-8f4a-e2a1c4eec1ae,network=Network(c8bdb714-50af-4c1d-9e06-9c71a384b633),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2b04c4cf-f8') {{(pid=74613) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 29 18:02:24 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:02:24 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap2b04c4cf-f8, bridge=br-int, if_exists=True) {{(pid=74613) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 18:02:24 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:02:24 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 18:02:24 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:02:24 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=e2aa64b9-f9e9-4e61-b299-cd24a8dbf0f5) {{(pid=74613) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 18:02:24 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:02:24 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:02:24 user nova-compute[74613]: INFO os_vif [None req-0e17657b-f985-4c05-9f48-e2c357c49cd9 tempest-TestServerVolumeAttachScenarioOldVersion-673194571 tempest-TestServerVolumeAttachScenarioOldVersion-673194571-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:bc:57:f9,bridge_name='br-int',has_traffic_filtering=True,id=2b04c4cf-f85a-4089-8f4a-e2a1c4eec1ae,network=Network(c8bdb714-50af-4c1d-9e06-9c71a384b633),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2b04c4cf-f8')
Nov 29 18:02:24 user nova-compute[74613]: INFO nova.virt.libvirt.driver [None req-0e17657b-f985-4c05-9f48-e2c357c49cd9 tempest-TestServerVolumeAttachScenarioOldVersion-673194571 tempest-TestServerVolumeAttachScenarioOldVersion-673194571-project-member] [instance: 5221f9b9-e4db-406b-ae82-4a7c6522ee64] Deleting instance files /opt/stack/data/nova/instances/5221f9b9-e4db-406b-ae82-4a7c6522ee64_del
Nov 29 18:02:24 user nova-compute[74613]: INFO nova.virt.libvirt.driver [None req-0e17657b-f985-4c05-9f48-e2c357c49cd9 tempest-TestServerVolumeAttachScenarioOldVersion-673194571 tempest-TestServerVolumeAttachScenarioOldVersion-673194571-project-member] [instance: 5221f9b9-e4db-406b-ae82-4a7c6522ee64] Deletion of /opt/stack/data/nova/instances/5221f9b9-e4db-406b-ae82-4a7c6522ee64_del complete
Nov 29 18:02:24 user nova-compute[74613]: INFO nova.compute.manager [None req-0e17657b-f985-4c05-9f48-e2c357c49cd9 tempest-TestServerVolumeAttachScenarioOldVersion-673194571 tempest-TestServerVolumeAttachScenarioOldVersion-673194571-project-member] [instance: 5221f9b9-e4db-406b-ae82-4a7c6522ee64] Took 0.90 seconds to destroy the instance on the hypervisor.
Nov 29 18:02:24 user nova-compute[74613]: DEBUG oslo.service.loopingcall [None req-0e17657b-f985-4c05-9f48-e2c357c49cd9 tempest-TestServerVolumeAttachScenarioOldVersion-673194571 tempest-TestServerVolumeAttachScenarioOldVersion-673194571-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74613) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 29 18:02:24 user nova-compute[74613]: DEBUG nova.compute.manager [-] [instance: 5221f9b9-e4db-406b-ae82-4a7c6522ee64] Deallocating network for instance {{(pid=74613) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 29 18:02:24 user nova-compute[74613]: DEBUG nova.network.neutron [-] [instance: 5221f9b9-e4db-406b-ae82-4a7c6522ee64] deallocate_for_instance() {{(pid=74613) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 29 18:02:25 user nova-compute[74613]: DEBUG nova.network.neutron [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] [instance: c4bdb712-e1f9-4fc0-b527-87088d7eddf8] Updating instance_info_cache with network_info: [{"id": "1261dd8b-2514-475b-bbbc-7a83ce22c7c0", "address": "fa:16:3e:7f:98:93", "network": {"id": "4d31e03e-697a-44c2-a03e-77eed3dbce43", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-629140279-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "68aabefe0c4340ce8408e386748fa0cf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1261dd8b-25", "ovs_interfaceid": "1261dd8b-2514-475b-bbbc-7a83ce22c7c0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74613) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 18:02:25 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Releasing lock "refresh_cache-c4bdb712-e1f9-4fc0-b527-87088d7eddf8" {{(pid=74613) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 18:02:25 user nova-compute[74613]: DEBUG nova.compute.manager [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] [instance: c4bdb712-e1f9-4fc0-b527-87088d7eddf8] Updated the network info_cache for instance {{(pid=74613) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 29 18:02:25 user nova-compute[74613]: DEBUG oslo_service.periodic_task [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74613) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 18:02:25 user nova-compute[74613]: DEBUG oslo_service.periodic_task [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74613) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 18:02:25 user nova-compute[74613]: DEBUG oslo_service.periodic_task [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74613) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 18:02:25 user nova-compute[74613]: DEBUG oslo_service.periodic_task [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74613) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 18:02:25 user nova-compute[74613]: DEBUG nova.compute.manager [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74613) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 29 18:02:25 user nova-compute[74613]: DEBUG oslo_service.periodic_task [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=74613) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 18:02:25 user nova-compute[74613]: DEBUG nova.compute.manager [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Cleaning up deleted instances {{(pid=74613) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 29 18:02:25 user nova-compute[74613]: DEBUG nova.compute.manager [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] There are 0 instances to clean {{(pid=74613) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 29 18:02:25 user nova-compute[74613]: DEBUG nova.network.neutron [-] [instance: 5221f9b9-e4db-406b-ae82-4a7c6522ee64] Updating instance_info_cache with network_info: [] {{(pid=74613) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 18:02:25 user nova-compute[74613]: INFO nova.compute.manager [-] [instance: 5221f9b9-e4db-406b-ae82-4a7c6522ee64] Took 0.73 seconds to deallocate network for instance.
Nov 29 18:02:25 user nova-compute[74613]: DEBUG nova.compute.manager [req-f11bbc36-0ad9-488c-a003-796f7e55e003 req-8a9a65e3-4d1c-4633-8fe1-9f7d5d49cb25 service nova] [instance: 5221f9b9-e4db-406b-ae82-4a7c6522ee64] Received event network-vif-deleted-2b04c4cf-f85a-4089-8f4a-e2a1c4eec1ae {{(pid=74613) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 18:02:25 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-0e17657b-f985-4c05-9f48-e2c357c49cd9 tempest-TestServerVolumeAttachScenarioOldVersion-673194571 tempest-TestServerVolumeAttachScenarioOldVersion-673194571-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 18:02:25 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-0e17657b-f985-4c05-9f48-e2c357c49cd9 tempest-TestServerVolumeAttachScenarioOldVersion-673194571 tempest-TestServerVolumeAttachScenarioOldVersion-673194571-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 18:02:25 user nova-compute[74613]: DEBUG nova.scheduler.client.report [None req-0e17657b-f985-4c05-9f48-e2c357c49cd9 tempest-TestServerVolumeAttachScenarioOldVersion-673194571 tempest-TestServerVolumeAttachScenarioOldVersion-673194571-project-member] Refreshing inventories for resource provider 639d980e-3b12-44b1-b8f4-1812416fa4dd {{(pid=74613) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 29 18:02:25 user nova-compute[74613]: DEBUG nova.scheduler.client.report [None req-0e17657b-f985-4c05-9f48-e2c357c49cd9 tempest-TestServerVolumeAttachScenarioOldVersion-673194571 tempest-TestServerVolumeAttachScenarioOldVersion-673194571-project-member] Updating ProviderTree inventory for provider 639d980e-3b12-44b1-b8f4-1812416fa4dd from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74613) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 29 18:02:25 user nova-compute[74613]: DEBUG nova.compute.provider_tree [None req-0e17657b-f985-4c05-9f48-e2c357c49cd9 tempest-TestServerVolumeAttachScenarioOldVersion-673194571 tempest-TestServerVolumeAttachScenarioOldVersion-673194571-project-member] Updating inventory in ProviderTree for provider 639d980e-3b12-44b1-b8f4-1812416fa4dd with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74613) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 29 18:02:25 user nova-compute[74613]: DEBUG nova.scheduler.client.report [None req-0e17657b-f985-4c05-9f48-e2c357c49cd9 tempest-TestServerVolumeAttachScenarioOldVersion-673194571 tempest-TestServerVolumeAttachScenarioOldVersion-673194571-project-member] Refreshing aggregate associations for resource provider 639d980e-3b12-44b1-b8f4-1812416fa4dd, aggregates: None {{(pid=74613) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 29 18:02:25 user nova-compute[74613]: DEBUG nova.scheduler.client.report [None req-0e17657b-f985-4c05-9f48-e2c357c49cd9 tempest-TestServerVolumeAttachScenarioOldVersion-673194571 tempest-TestServerVolumeAttachScenarioOldVersion-673194571-project-member] Refreshing trait associations for resource provider 639d980e-3b12-44b1-b8f4-1812416fa4dd, traits: HW_CPU_X86_SSE,COMPUTE_VOLUME_EXTEND,COMPUTE_ACCELERATORS,HW_CPU_X86_SSE41,COMPUTE_STORAGE_BUS_IDE,COMPUTE_NODE,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,HW_CPU_X86_MMX,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,HW_CPU_X86_SSE2,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_STORAGE_BUS_USB,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_STORAGE_BUS_SATA,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_DEVICE_TAGGING,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_RESCUE_BFV,HW_CPU_X86_SSSE3,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_TRUSTED_CERTS,HW_CPU_X86_SSE42,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_STORAGE_BUS_FDC {{(pid=74613) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 29 18:02:26 user nova-compute[74613]: DEBUG nova.compute.provider_tree [None req-0e17657b-f985-4c05-9f48-e2c357c49cd9 tempest-TestServerVolumeAttachScenarioOldVersion-673194571 tempest-TestServerVolumeAttachScenarioOldVersion-673194571-project-member] Inventory has not changed in ProviderTree for provider: 639d980e-3b12-44b1-b8f4-1812416fa4dd {{(pid=74613) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 18:02:26 user nova-compute[74613]: DEBUG nova.scheduler.client.report [None req-0e17657b-f985-4c05-9f48-e2c357c49cd9 tempest-TestServerVolumeAttachScenarioOldVersion-673194571 tempest-TestServerVolumeAttachScenarioOldVersion-673194571-project-member] Inventory has not changed for provider 639d980e-3b12-44b1-b8f4-1812416fa4dd based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74613) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 18:02:26 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-0e17657b-f985-4c05-9f48-e2c357c49cd9 tempest-TestServerVolumeAttachScenarioOldVersion-673194571 tempest-TestServerVolumeAttachScenarioOldVersion-673194571-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.528s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 18:02:26 user nova-compute[74613]: INFO nova.scheduler.client.report [None req-0e17657b-f985-4c05-9f48-e2c357c49cd9 tempest-TestServerVolumeAttachScenarioOldVersion-673194571 tempest-TestServerVolumeAttachScenarioOldVersion-673194571-project-member] Deleted allocations for instance 5221f9b9-e4db-406b-ae82-4a7c6522ee64
Nov 29 18:02:26 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-0e17657b-f985-4c05-9f48-e2c357c49cd9 tempest-TestServerVolumeAttachScenarioOldVersion-673194571 tempest-TestServerVolumeAttachScenarioOldVersion-673194571-project-member] Lock "5221f9b9-e4db-406b-ae82-4a7c6522ee64" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.339s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 18:02:26 user nova-compute[74613]: DEBUG nova.compute.manager [req-5b3cd6cf-5567-4844-9254-8b35618550ba req-99a17911-76e3-471b-96ad-9a0b9d795449 service nova] [instance: 5221f9b9-e4db-406b-ae82-4a7c6522ee64] Received event network-vif-plugged-2b04c4cf-f85a-4089-8f4a-e2a1c4eec1ae {{(pid=74613) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 18:02:26 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-5b3cd6cf-5567-4844-9254-8b35618550ba req-99a17911-76e3-471b-96ad-9a0b9d795449 service nova] Acquiring lock "5221f9b9-e4db-406b-ae82-4a7c6522ee64-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 18:02:26 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-5b3cd6cf-5567-4844-9254-8b35618550ba req-99a17911-76e3-471b-96ad-9a0b9d795449 service nova] Lock "5221f9b9-e4db-406b-ae82-4a7c6522ee64-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 18:02:26 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-5b3cd6cf-5567-4844-9254-8b35618550ba req-99a17911-76e3-471b-96ad-9a0b9d795449 service nova] Lock "5221f9b9-e4db-406b-ae82-4a7c6522ee64-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 18:02:26 user nova-compute[74613]: DEBUG nova.compute.manager [req-5b3cd6cf-5567-4844-9254-8b35618550ba req-99a17911-76e3-471b-96ad-9a0b9d795449 service nova] [instance: 5221f9b9-e4db-406b-ae82-4a7c6522ee64] No waiting events found dispatching network-vif-plugged-2b04c4cf-f85a-4089-8f4a-e2a1c4eec1ae {{(pid=74613) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 18:02:26 user nova-compute[74613]: WARNING nova.compute.manager [req-5b3cd6cf-5567-4844-9254-8b35618550ba req-99a17911-76e3-471b-96ad-9a0b9d795449 service nova] [instance: 5221f9b9-e4db-406b-ae82-4a7c6522ee64] Received unexpected event network-vif-plugged-2b04c4cf-f85a-4089-8f4a-e2a1c4eec1ae for instance with vm_state deleted and task_state None.
Nov 29 18:02:26 user nova-compute[74613]: DEBUG oslo_service.periodic_task [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74613) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 18:02:26 user nova-compute[74613]: DEBUG oslo_service.periodic_task [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74613) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 18:02:29 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:02:32 user nova-compute[74613]: DEBUG oslo_service.periodic_task [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=74613) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 18:02:34 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 18:02:35 user nova-compute[74613]: DEBUG nova.compute.manager [req-21f4c27e-154e-4879-8ced-0e69031c0fc9 req-f81afbe4-1e94-4d54-80a3-e80563b84e3d service nova] [instance: 6c2ea311-0404-4ecf-8086-65f65186f858] Received event network-changed-ec533dd5-c792-49a7-b497-7995a406838a {{(pid=74613) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 18:02:35 user nova-compute[74613]: DEBUG nova.compute.manager [req-21f4c27e-154e-4879-8ced-0e69031c0fc9 req-f81afbe4-1e94-4d54-80a3-e80563b84e3d service nova] [instance: 6c2ea311-0404-4ecf-8086-65f65186f858] Refreshing instance network info cache due to event network-changed-ec533dd5-c792-49a7-b497-7995a406838a. {{(pid=74613) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 18:02:35 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-21f4c27e-154e-4879-8ced-0e69031c0fc9 req-f81afbe4-1e94-4d54-80a3-e80563b84e3d service nova] Acquiring lock "refresh_cache-6c2ea311-0404-4ecf-8086-65f65186f858" {{(pid=74613) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 18:02:35 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-21f4c27e-154e-4879-8ced-0e69031c0fc9 req-f81afbe4-1e94-4d54-80a3-e80563b84e3d service nova] Acquired lock "refresh_cache-6c2ea311-0404-4ecf-8086-65f65186f858" {{(pid=74613) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 18:02:35 user nova-compute[74613]: DEBUG nova.network.neutron [req-21f4c27e-154e-4879-8ced-0e69031c0fc9 req-f81afbe4-1e94-4d54-80a3-e80563b84e3d service nova] [instance: 6c2ea311-0404-4ecf-8086-65f65186f858] Refreshing network info cache for port ec533dd5-c792-49a7-b497-7995a406838a {{(pid=74613) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 18:02:35 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-b83da953-763b-43d8-a139-6529c77a9402 tempest-VolumesSnapshotTestJSON-1388493826 tempest-VolumesSnapshotTestJSON-1388493826-project-member] Acquiring lock "6c2ea311-0404-4ecf-8086-65f65186f858" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 18:02:35 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-b83da953-763b-43d8-a139-6529c77a9402 tempest-VolumesSnapshotTestJSON-1388493826 tempest-VolumesSnapshotTestJSON-1388493826-project-member] Lock "6c2ea311-0404-4ecf-8086-65f65186f858" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 18:02:35 user nova-compute[74613]: DEBUG nova.objects.instance [None req-b83da953-763b-43d8-a139-6529c77a9402 tempest-VolumesSnapshotTestJSON-1388493826 tempest-VolumesSnapshotTestJSON-1388493826-project-member] Lazy-loading 'flavor' on Instance uuid 6c2ea311-0404-4ecf-8086-65f65186f858 {{(pid=74613) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 18:02:35 user nova-compute[74613]: INFO nova.virt.libvirt.driver [None req-b83da953-763b-43d8-a139-6529c77a9402 tempest-VolumesSnapshotTestJSON-1388493826 tempest-VolumesSnapshotTestJSON-1388493826-project-member] [instance: 6c2ea311-0404-4ecf-8086-65f65186f858] Ignoring supplied device name: /dev/vdb
Nov 29 18:02:35 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-b83da953-763b-43d8-a139-6529c77a9402 tempest-VolumesSnapshotTestJSON-1388493826 tempest-VolumesSnapshotTestJSON-1388493826-project-member] Lock "6c2ea311-0404-4ecf-8086-65f65186f858" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.071s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 18:02:36 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-b83da953-763b-43d8-a139-6529c77a9402 tempest-VolumesSnapshotTestJSON-1388493826 tempest-VolumesSnapshotTestJSON-1388493826-project-member] Acquiring lock "6c2ea311-0404-4ecf-8086-65f65186f858" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 18:02:36 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-b83da953-763b-43d8-a139-6529c77a9402 tempest-VolumesSnapshotTestJSON-1388493826 tempest-VolumesSnapshotTestJSON-1388493826-project-member] Lock "6c2ea311-0404-4ecf-8086-65f65186f858" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 18:02:36 user nova-compute[74613]: INFO nova.compute.manager [None req-b83da953-763b-43d8-a139-6529c77a9402 tempest-VolumesSnapshotTestJSON-1388493826 tempest-VolumesSnapshotTestJSON-1388493826-project-member] [instance: 6c2ea311-0404-4ecf-8086-65f65186f858] Attaching volume 86badab9-1598-4740-a73c-ba9d48b37dce to /dev/vdb
Nov 29 18:02:36 user nova-compute[74613]: DEBUG os_brick.utils [None req-b83da953-763b-43d8-a139-6529c77a9402 tempest-VolumesSnapshotTestJSON-1388493826 tempest-VolumesSnapshotTestJSON-1388493826-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74613) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 18:02:36 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:02:36 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:02:36 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ecaeb3a-028f-4005-af27-2ad5ece4f9a1]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:400972819b5\n', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 18:02:36 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:02:36 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.024s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:02:36 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[8849b863-3c6b-484d-b948-f476aa4b49c3]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 18:02:36 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:02:36 user nova-compute[74613]: DEBUG nova.network.neutron [req-21f4c27e-154e-4879-8ced-0e69031c0fc9 req-f81afbe4-1e94-4d54-80a3-e80563b84e3d service nova] [instance: 6c2ea311-0404-4ecf-8086-65f65186f858] Updated VIF entry in instance network info cache for port ec533dd5-c792-49a7-b497-7995a406838a. {{(pid=74613) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 18:02:36 user nova-compute[74613]: DEBUG nova.network.neutron [req-21f4c27e-154e-4879-8ced-0e69031c0fc9 req-f81afbe4-1e94-4d54-80a3-e80563b84e3d service nova] [instance: 6c2ea311-0404-4ecf-8086-65f65186f858] Updating instance_info_cache with network_info: [{"id": "ec533dd5-c792-49a7-b497-7995a406838a", "address": "fa:16:3e:75:15:43", "network": {"id": "4cc7e4ab-28a3-431a-9855-22009278b949", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1066409623-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.48", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a9ec113a97bd40c4b68d3738c64ece01", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapec533dd5-c7", "ovs_interfaceid": "ec533dd5-c792-49a7-b497-7995a406838a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74613) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 18:02:36 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:02:36 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[73228637-6b3d-4ccd-b944-75e56d091980]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 18:02:36 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ebbbbb3-eca3-4bf1-acb1-5db7c9fad9a9]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 18:02:36 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-b83da953-763b-43d8-a139-6529c77a9402 tempest-VolumesSnapshotTestJSON-1388493826 tempest-VolumesSnapshotTestJSON-1388493826-project-member] Running cmd (subprocess): nvme version {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:02:36 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-b83da953-763b-43d8-a139-6529c77a9402 tempest-VolumesSnapshotTestJSON-1388493826 tempest-VolumesSnapshotTestJSON-1388493826-project-member] 'nvme version' failed. Not Retrying. {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 18:02:36 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.nvmeof [None req-b83da953-763b-43d8-a139-6529c77a9402 tempest-VolumesSnapshotTestJSON-1388493826 tempest-VolumesSnapshotTestJSON-1388493826-project-member] nvme not present on system {{(pid=74613) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 29 18:02:36 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-21f4c27e-154e-4879-8ced-0e69031c0fc9 req-f81afbe4-1e94-4d54-80a3-e80563b84e3d service nova] Releasing lock "refresh_cache-6c2ea311-0404-4ecf-8086-65f65186f858" {{(pid=74613) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 18:02:36 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:02:36 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 18:02:36 user nova-compute[74613]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 29 18:02:36 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[4bc62491-d6af-4af1-8f49-798f62226bef]: (4, '') {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 18:02:36 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.lightos [None req-b83da953-763b-43d8-a139-6529c77a9402 tempest-VolumesSnapshotTestJSON-1388493826 tempest-VolumesSnapshotTestJSON-1388493826-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74613) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 29 18:02:36 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.lightos [None req-b83da953-763b-43d8-a139-6529c77a9402 tempest-VolumesSnapshotTestJSON-1388493826 tempest-VolumesSnapshotTestJSON-1388493826-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74613) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 29 18:02:36 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.lightos [None req-b83da953-763b-43d8-a139-6529c77a9402 tempest-VolumesSnapshotTestJSON-1388493826 tempest-VolumesSnapshotTestJSON-1388493826-project-member] LIGHTOS: no hostnqn found. {{(pid=74613) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 29 18:02:36 user nova-compute[74613]: DEBUG os_brick.utils [None req-b83da953-763b-43d8-a139-6529c77a9402 tempest-VolumesSnapshotTestJSON-1388493826 tempest-VolumesSnapshotTestJSON-1388493826-project-member] <== get_connector_properties: return (155ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:400972819b5', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74613) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 18:02:36 user nova-compute[74613]: DEBUG nova.virt.block_device [None req-b83da953-763b-43d8-a139-6529c77a9402 tempest-VolumesSnapshotTestJSON-1388493826 tempest-VolumesSnapshotTestJSON-1388493826-project-member] [instance: 6c2ea311-0404-4ecf-8086-65f65186f858] Updating existing volume attachment record: 140bff4f-c914-454b-82c9-2192b1ccea3b {{(pid=74613) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 29 18:02:37 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-b80f692d-3bff-4df4-90e6-d1cff53e4da7 tempest-AttachVolumeShelveTestJSON-1452861425 tempest-AttachVolumeShelveTestJSON-1452861425-project-member] Acquiring lock "f9be53df-54e6-4f59-9cef-0ba7434f0c29" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 18:02:37 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-b80f692d-3bff-4df4-90e6-d1cff53e4da7 tempest-AttachVolumeShelveTestJSON-1452861425 tempest-AttachVolumeShelveTestJSON-1452861425-project-member] Lock "f9be53df-54e6-4f59-9cef-0ba7434f0c29" acquired by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: waited 0.001s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 18:02:37 user nova-compute[74613]: INFO nova.compute.manager [None req-b80f692d-3bff-4df4-90e6-d1cff53e4da7 tempest-AttachVolumeShelveTestJSON-1452861425 tempest-AttachVolumeShelveTestJSON-1452861425-project-member] [instance: f9be53df-54e6-4f59-9cef-0ba7434f0c29] Unshelving
Nov 29 18:02:37 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-b80f692d-3bff-4df4-90e6-d1cff53e4da7 tempest-AttachVolumeShelveTestJSON-1452861425 tempest-AttachVolumeShelveTestJSON-1452861425-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 18:02:37 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-b80f692d-3bff-4df4-90e6-d1cff53e4da7 tempest-AttachVolumeShelveTestJSON-1452861425 tempest-AttachVolumeShelveTestJSON-1452861425-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 18:02:37 user nova-compute[74613]: DEBUG nova.objects.instance [None req-b80f692d-3bff-4df4-90e6-d1cff53e4da7 tempest-AttachVolumeShelveTestJSON-1452861425 tempest-AttachVolumeShelveTestJSON-1452861425-project-member] Lazy-loading 'pci_requests' on Instance uuid f9be53df-54e6-4f59-9cef-0ba7434f0c29 {{(pid=74613) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 18:02:37 user nova-compute[74613]: DEBUG nova.objects.instance [None req-b80f692d-3bff-4df4-90e6-d1cff53e4da7 tempest-AttachVolumeShelveTestJSON-1452861425 tempest-AttachVolumeShelveTestJSON-1452861425-project-member] Lazy-loading 'numa_topology' on Instance uuid f9be53df-54e6-4f59-9cef-0ba7434f0c29 {{(pid=74613) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 18:02:37 user nova-compute[74613]: DEBUG nova.virt.hardware [None req-b80f692d-3bff-4df4-90e6-d1cff53e4da7 tempest-AttachVolumeShelveTestJSON-1452861425 tempest-AttachVolumeShelveTestJSON-1452861425-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74613) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 29 18:02:37 user nova-compute[74613]: INFO nova.compute.claims [None req-b80f692d-3bff-4df4-90e6-d1cff53e4da7 tempest-AttachVolumeShelveTestJSON-1452861425 tempest-AttachVolumeShelveTestJSON-1452861425-project-member] [instance: f9be53df-54e6-4f59-9cef-0ba7434f0c29] Claim successful on node user
Nov 29 18:02:37 user nova-compute[74613]: DEBUG nova.compute.provider_tree [None req-b80f692d-3bff-4df4-90e6-d1cff53e4da7 tempest-AttachVolumeShelveTestJSON-1452861425 tempest-AttachVolumeShelveTestJSON-1452861425-project-member] Inventory has not changed in ProviderTree for provider: 639d980e-3b12-44b1-b8f4-1812416fa4dd {{(pid=74613) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 18:02:37 user nova-compute[74613]: DEBUG nova.scheduler.client.report [None req-b80f692d-3bff-4df4-90e6-d1cff53e4da7 tempest-AttachVolumeShelveTestJSON-1452861425 tempest-AttachVolumeShelveTestJSON-1452861425-project-member] Inventory has not changed for provider 639d980e-3b12-44b1-b8f4-1812416fa4dd based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74613) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 18:02:37 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-b80f692d-3bff-4df4-90e6-d1cff53e4da7 tempest-AttachVolumeShelveTestJSON-1452861425 tempest-AttachVolumeShelveTestJSON-1452861425-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.387s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 18:02:37 user nova-compute[74613]: INFO nova.network.neutron [None req-b80f692d-3bff-4df4-90e6-d1cff53e4da7 tempest-AttachVolumeShelveTestJSON-1452861425 tempest-AttachVolumeShelveTestJSON-1452861425-project-member] [instance: f9be53df-54e6-4f59-9cef-0ba7434f0c29] Updating port 175b56ab-750b-4dbf-a981-2a32d749d445 with attributes {'binding:host_id': 'user', 'device_owner': 'compute:nova'}
Nov 29 18:02:38 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-b80f692d-3bff-4df4-90e6-d1cff53e4da7 tempest-AttachVolumeShelveTestJSON-1452861425 tempest-AttachVolumeShelveTestJSON-1452861425-project-member] Acquiring lock "refresh_cache-f9be53df-54e6-4f59-9cef-0ba7434f0c29" {{(pid=74613) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 18:02:38 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-b80f692d-3bff-4df4-90e6-d1cff53e4da7 tempest-AttachVolumeShelveTestJSON-1452861425 tempest-AttachVolumeShelveTestJSON-1452861425-project-member] Acquired lock "refresh_cache-f9be53df-54e6-4f59-9cef-0ba7434f0c29" {{(pid=74613) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 18:02:38 user nova-compute[74613]: DEBUG nova.network.neutron [None req-b80f692d-3bff-4df4-90e6-d1cff53e4da7 tempest-AttachVolumeShelveTestJSON-1452861425 tempest-AttachVolumeShelveTestJSON-1452861425-project-member] [instance: f9be53df-54e6-4f59-9cef-0ba7434f0c29] Building network info cache for instance {{(pid=74613) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 29 18:02:38 user nova-compute[74613]: DEBUG nova.compute.manager [req-10fa769c-0b0b-40ab-b58d-e88f03b5e466 req-616238a4-87a8-4a80-a835-007d509f7f29 service nova] [instance: f9be53df-54e6-4f59-9cef-0ba7434f0c29] Received event network-changed-175b56ab-750b-4dbf-a981-2a32d749d445 {{(pid=74613) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 18:02:38 user nova-compute[74613]: DEBUG nova.compute.manager [req-10fa769c-0b0b-40ab-b58d-e88f03b5e466 req-616238a4-87a8-4a80-a835-007d509f7f29 service nova] [instance: f9be53df-54e6-4f59-9cef-0ba7434f0c29] Refreshing instance network info cache due to event network-changed-175b56ab-750b-4dbf-a981-2a32d749d445. {{(pid=74613) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 18:02:38 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-10fa769c-0b0b-40ab-b58d-e88f03b5e466 req-616238a4-87a8-4a80-a835-007d509f7f29 service nova] Acquiring lock "refresh_cache-f9be53df-54e6-4f59-9cef-0ba7434f0c29" {{(pid=74613) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 18:02:38 user nova-compute[74613]: DEBUG nova.network.neutron [None req-b80f692d-3bff-4df4-90e6-d1cff53e4da7 tempest-AttachVolumeShelveTestJSON-1452861425 tempest-AttachVolumeShelveTestJSON-1452861425-project-member] [instance: f9be53df-54e6-4f59-9cef-0ba7434f0c29] Updating instance_info_cache with network_info: [{"id": "175b56ab-750b-4dbf-a981-2a32d749d445", "address": "fa:16:3e:e8:f3:9e", "network": {"id": "4a101f3e-d23e-4198-bc3c-b4f9b4d2b4c4", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-864151424-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.246", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1c0c1c71400549369c1b11ca7d5f43ec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap175b56ab-75", "ovs_interfaceid": "175b56ab-750b-4dbf-a981-2a32d749d445", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74613) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 18:02:38 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-b80f692d-3bff-4df4-90e6-d1cff53e4da7 tempest-AttachVolumeShelveTestJSON-1452861425 tempest-AttachVolumeShelveTestJSON-1452861425-project-member] Releasing lock "refresh_cache-f9be53df-54e6-4f59-9cef-0ba7434f0c29" {{(pid=74613) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 18:02:38 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-b80f692d-3bff-4df4-90e6-d1cff53e4da7 tempest-AttachVolumeShelveTestJSON-1452861425 tempest-AttachVolumeShelveTestJSON-1452861425-project-member] [instance: f9be53df-54e6-4f59-9cef-0ba7434f0c29] Creating instance directory {{(pid=74613) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 29 18:02:38 user nova-compute[74613]: INFO nova.virt.libvirt.driver [None req-b80f692d-3bff-4df4-90e6-d1cff53e4da7 tempest-AttachVolumeShelveTestJSON-1452861425 tempest-AttachVolumeShelveTestJSON-1452861425-project-member] [instance: f9be53df-54e6-4f59-9cef-0ba7434f0c29] Creating image(s)
Nov 29 18:02:38 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-b80f692d-3bff-4df4-90e6-d1cff53e4da7 tempest-AttachVolumeShelveTestJSON-1452861425 tempest-AttachVolumeShelveTestJSON-1452861425-project-member] Acquiring lock "/opt/stack/data/nova/instances/f9be53df-54e6-4f59-9cef-0ba7434f0c29/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 18:02:38 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-b80f692d-3bff-4df4-90e6-d1cff53e4da7 tempest-AttachVolumeShelveTestJSON-1452861425 tempest-AttachVolumeShelveTestJSON-1452861425-project-member] Lock "/opt/stack/data/nova/instances/f9be53df-54e6-4f59-9cef-0ba7434f0c29/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 18:02:38 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-b80f692d-3bff-4df4-90e6-d1cff53e4da7 tempest-AttachVolumeShelveTestJSON-1452861425 tempest-AttachVolumeShelveTestJSON-1452861425-project-member] Lock "/opt/stack/data/nova/instances/f9be53df-54e6-4f59-9cef-0ba7434f0c29/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 18:02:38 user nova-compute[74613]: DEBUG nova.objects.instance [None req-b80f692d-3bff-4df4-90e6-d1cff53e4da7 tempest-AttachVolumeShelveTestJSON-1452861425 tempest-AttachVolumeShelveTestJSON-1452861425-project-member] Lazy-loading 'trusted_certs' on Instance uuid f9be53df-54e6-4f59-9cef-0ba7434f0c29 {{(pid=74613) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 18:02:38 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-10fa769c-0b0b-40ab-b58d-e88f03b5e466 req-616238a4-87a8-4a80-a835-007d509f7f29 service nova] Acquired lock "refresh_cache-f9be53df-54e6-4f59-9cef-0ba7434f0c29" {{(pid=74613) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 18:02:38 user nova-compute[74613]: DEBUG nova.network.neutron [req-10fa769c-0b0b-40ab-b58d-e88f03b5e466 req-616238a4-87a8-4a80-a835-007d509f7f29 service nova] [instance: f9be53df-54e6-4f59-9cef-0ba7434f0c29] Refreshing network info cache for port 175b56ab-750b-4dbf-a981-2a32d749d445 {{(pid=74613) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 18:02:38 user nova-compute[74613]: DEBUG nova.objects.base [None req-b80f692d-3bff-4df4-90e6-d1cff53e4da7 tempest-AttachVolumeShelveTestJSON-1452861425 tempest-AttachVolumeShelveTestJSON-1452861425-project-member] Object Instance<f9be53df-54e6-4f59-9cef-0ba7434f0c29> lazy-loaded attributes: pci_requests,trusted_certs {{(pid=74613) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 29 18:02:38 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-b80f692d-3bff-4df4-90e6-d1cff53e4da7 tempest-AttachVolumeShelveTestJSON-1452861425 tempest-AttachVolumeShelveTestJSON-1452861425-project-member] Acquiring lock "373425078c28309c9e5f9061b6ed4f3b9a080def" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 18:02:38 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-b80f692d-3bff-4df4-90e6-d1cff53e4da7 tempest-AttachVolumeShelveTestJSON-1452861425 tempest-AttachVolumeShelveTestJSON-1452861425-project-member] Lock "373425078c28309c9e5f9061b6ed4f3b9a080def" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 18:02:39 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-b80f692d-3bff-4df4-90e6-d1cff53e4da7 tempest-AttachVolumeShelveTestJSON-1452861425 tempest-AttachVolumeShelveTestJSON-1452861425-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/373425078c28309c9e5f9061b6ed4f3b9a080def.part --force-share --output=json {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:02:39 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:02:40 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-b80f692d-3bff-4df4-90e6-d1cff53e4da7 tempest-AttachVolumeShelveTestJSON-1452861425 tempest-AttachVolumeShelveTestJSON-1452861425-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/373425078c28309c9e5f9061b6ed4f3b9a080def.part --force-share --output=json" returned: 0 in 0.172s {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:02:40 user nova-compute[74613]: DEBUG nova.virt.images [None req-b80f692d-3bff-4df4-90e6-d1cff53e4da7 tempest-AttachVolumeShelveTestJSON-1452861425 tempest-AttachVolumeShelveTestJSON-1452861425-project-member] e5f40838-1165-44d9-858a-fb5bda721c22 was qcow2, converting to raw {{(pid=74613) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 29 18:02:40 user nova-compute[74613]: DEBUG nova.privsep.utils [None req-b80f692d-3bff-4df4-90e6-d1cff53e4da7 tempest-AttachVolumeShelveTestJSON-1452861425 tempest-AttachVolumeShelveTestJSON-1452861425-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74613) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 29 18:02:40 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-b80f692d-3bff-4df4-90e6-d1cff53e4da7 tempest-AttachVolumeShelveTestJSON-1452861425 tempest-AttachVolumeShelveTestJSON-1452861425-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/373425078c28309c9e5f9061b6ed4f3b9a080def.part /opt/stack/data/nova/instances/_base/373425078c28309c9e5f9061b6ed4f3b9a080def.converted {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:02:40 user nova-compute[74613]: DEBUG nova.network.neutron [req-10fa769c-0b0b-40ab-b58d-e88f03b5e466 req-616238a4-87a8-4a80-a835-007d509f7f29 service nova] [instance: f9be53df-54e6-4f59-9cef-0ba7434f0c29] Updated VIF entry in instance network info cache for port 175b56ab-750b-4dbf-a981-2a32d749d445. {{(pid=74613) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 18:02:40 user nova-compute[74613]: DEBUG nova.network.neutron [req-10fa769c-0b0b-40ab-b58d-e88f03b5e466 req-616238a4-87a8-4a80-a835-007d509f7f29 service nova] [instance: f9be53df-54e6-4f59-9cef-0ba7434f0c29] Updating instance_info_cache with network_info: [{"id": "175b56ab-750b-4dbf-a981-2a32d749d445", "address": "fa:16:3e:e8:f3:9e", "network": {"id": "4a101f3e-d23e-4198-bc3c-b4f9b4d2b4c4", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-864151424-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.246", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1c0c1c71400549369c1b11ca7d5f43ec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap175b56ab-75", "ovs_interfaceid": "175b56ab-750b-4dbf-a981-2a32d749d445", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74613) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 18:02:40 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-10fa769c-0b0b-40ab-b58d-e88f03b5e466 req-616238a4-87a8-4a80-a835-007d509f7f29 service nova] Releasing lock "refresh_cache-f9be53df-54e6-4f59-9cef-0ba7434f0c29" {{(pid=74613) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 18:02:40 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-b80f692d-3bff-4df4-90e6-d1cff53e4da7 tempest-AttachVolumeShelveTestJSON-1452861425 tempest-AttachVolumeShelveTestJSON-1452861425-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/373425078c28309c9e5f9061b6ed4f3b9a080def.part /opt/stack/data/nova/instances/_base/373425078c28309c9e5f9061b6ed4f3b9a080def.converted" returned: 0 in 0.333s {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:02:40 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-b80f692d-3bff-4df4-90e6-d1cff53e4da7 tempest-AttachVolumeShelveTestJSON-1452861425 tempest-AttachVolumeShelveTestJSON-1452861425-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/373425078c28309c9e5f9061b6ed4f3b9a080def.converted --force-share --output=json {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:02:40 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:02:40 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-b80f692d-3bff-4df4-90e6-d1cff53e4da7 tempest-AttachVolumeShelveTestJSON-1452861425 tempest-AttachVolumeShelveTestJSON-1452861425-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/373425078c28309c9e5f9061b6ed4f3b9a080def.converted --force-share --output=json" returned: 0 in 0.190s {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:02:40 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-b80f692d-3bff-4df4-90e6-d1cff53e4da7 tempest-AttachVolumeShelveTestJSON-1452861425 tempest-AttachVolumeShelveTestJSON-1452861425-project-member] Lock "373425078c28309c9e5f9061b6ed4f3b9a080def" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.675s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 18:02:40 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-b80f692d-3bff-4df4-90e6-d1cff53e4da7 tempest-AttachVolumeShelveTestJSON-1452861425 tempest-AttachVolumeShelveTestJSON-1452861425-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/373425078c28309c9e5f9061b6ed4f3b9a080def --force-share --output=json {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:02:40 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-b80f692d-3bff-4df4-90e6-d1cff53e4da7 tempest-AttachVolumeShelveTestJSON-1452861425 tempest-AttachVolumeShelveTestJSON-1452861425-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/373425078c28309c9e5f9061b6ed4f3b9a080def --force-share --output=json" returned: 0 in 0.178s {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:02:40 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-b80f692d-3bff-4df4-90e6-d1cff53e4da7 tempest-AttachVolumeShelveTestJSON-1452861425 tempest-AttachVolumeShelveTestJSON-1452861425-project-member] Acquiring lock "373425078c28309c9e5f9061b6ed4f3b9a080def" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 18:02:40 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-b80f692d-3bff-4df4-90e6-d1cff53e4da7 tempest-AttachVolumeShelveTestJSON-1452861425 tempest-AttachVolumeShelveTestJSON-1452861425-project-member] Lock "373425078c28309c9e5f9061b6ed4f3b9a080def" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 18:02:40 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-b80f692d-3bff-4df4-90e6-d1cff53e4da7 tempest-AttachVolumeShelveTestJSON-1452861425 tempest-AttachVolumeShelveTestJSON-1452861425-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/373425078c28309c9e5f9061b6ed4f3b9a080def --force-share --output=json {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:02:40 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-b80f692d-3bff-4df4-90e6-d1cff53e4da7 tempest-AttachVolumeShelveTestJSON-1452861425 tempest-AttachVolumeShelveTestJSON-1452861425-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/373425078c28309c9e5f9061b6ed4f3b9a080def --force-share --output=json" returned: 0 in 0.178s {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:02:40 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-b80f692d-3bff-4df4-90e6-d1cff53e4da7 tempest-AttachVolumeShelveTestJSON-1452861425 tempest-AttachVolumeShelveTestJSON-1452861425-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/373425078c28309c9e5f9061b6ed4f3b9a080def,backing_fmt=raw /opt/stack/data/nova/instances/f9be53df-54e6-4f59-9cef-0ba7434f0c29/disk 1073741824 {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:02:41 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-b80f692d-3bff-4df4-90e6-d1cff53e4da7 tempest-AttachVolumeShelveTestJSON-1452861425 tempest-AttachVolumeShelveTestJSON-1452861425-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/373425078c28309c9e5f9061b6ed4f3b9a080def,backing_fmt=raw /opt/stack/data/nova/instances/f9be53df-54e6-4f59-9cef-0ba7434f0c29/disk 1073741824" returned: 0 in 0.049s {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:02:41 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-b80f692d-3bff-4df4-90e6-d1cff53e4da7 tempest-AttachVolumeShelveTestJSON-1452861425 tempest-AttachVolumeShelveTestJSON-1452861425-project-member] Lock "373425078c28309c9e5f9061b6ed4f3b9a080def" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.234s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 18:02:41 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-b80f692d-3bff-4df4-90e6-d1cff53e4da7 tempest-AttachVolumeShelveTestJSON-1452861425 tempest-AttachVolumeShelveTestJSON-1452861425-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/373425078c28309c9e5f9061b6ed4f3b9a080def --force-share --output=json {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:02:41 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-b80f692d-3bff-4df4-90e6-d1cff53e4da7 tempest-AttachVolumeShelveTestJSON-1452861425 tempest-AttachVolumeShelveTestJSON-1452861425-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/373425078c28309c9e5f9061b6ed4f3b9a080def --force-share --output=json" returned: 0 in 0.174s {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:02:41 user nova-compute[74613]: DEBUG nova.objects.instance [None req-b80f692d-3bff-4df4-90e6-d1cff53e4da7 tempest-AttachVolumeShelveTestJSON-1452861425 tempest-AttachVolumeShelveTestJSON-1452861425-project-member] Lazy-loading 'migration_context' on Instance uuid f9be53df-54e6-4f59-9cef-0ba7434f0c29 {{(pid=74613) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 18:02:41 user nova-compute[74613]: DEBUG nova.objects.base [None req-b80f692d-3bff-4df4-90e6-d1cff53e4da7 tempest-AttachVolumeShelveTestJSON-1452861425 tempest-AttachVolumeShelveTestJSON-1452861425-project-member] Object Instance<f9be53df-54e6-4f59-9cef-0ba7434f0c29> lazy-loaded attributes: pci_requests,trusted_certs,migration_context {{(pid=74613) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 29 18:02:41 user nova-compute[74613]: INFO nova.virt.libvirt.driver [None req-b80f692d-3bff-4df4-90e6-d1cff53e4da7 tempest-AttachVolumeShelveTestJSON-1452861425 tempest-AttachVolumeShelveTestJSON-1452861425-project-member] [instance: f9be53df-54e6-4f59-9cef-0ba7434f0c29] Rebasing disk image.
Nov 29 18:02:41 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-b80f692d-3bff-4df4-90e6-d1cff53e4da7 tempest-AttachVolumeShelveTestJSON-1452861425 tempest-AttachVolumeShelveTestJSON-1452861425-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/21faea9e6951f3bdd0153b76ac89fe1a60a34758 --force-share --output=json {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:02:41 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-b80f692d-3bff-4df4-90e6-d1cff53e4da7 tempest-AttachVolumeShelveTestJSON-1452861425 tempest-AttachVolumeShelveTestJSON-1452861425-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/21faea9e6951f3bdd0153b76ac89fe1a60a34758 --force-share --output=json" returned: 0 in 0.192s {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:02:41 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-b80f692d-3bff-4df4-90e6-d1cff53e4da7 tempest-AttachVolumeShelveTestJSON-1452861425 tempest-AttachVolumeShelveTestJSON-1452861425-project-member] Running cmd (subprocess): qemu-img rebase -b /opt/stack/data/nova/instances/_base/21faea9e6951f3bdd0153b76ac89fe1a60a34758 -F raw /opt/stack/data/nova/instances/f9be53df-54e6-4f59-9cef-0ba7434f0c29/disk {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:02:43 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-b80f692d-3bff-4df4-90e6-d1cff53e4da7 tempest-AttachVolumeShelveTestJSON-1452861425 tempest-AttachVolumeShelveTestJSON-1452861425-project-member] CMD "qemu-img rebase -b /opt/stack/data/nova/instances/_base/21faea9e6951f3bdd0153b76ac89fe1a60a34758 -F raw /opt/stack/data/nova/instances/f9be53df-54e6-4f59-9cef-0ba7434f0c29/disk" returned: 0 in 2.025s {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:02:43 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-b80f692d-3bff-4df4-90e6-d1cff53e4da7 tempest-AttachVolumeShelveTestJSON-1452861425 tempest-AttachVolumeShelveTestJSON-1452861425-project-member] [instance: f9be53df-54e6-4f59-9cef-0ba7434f0c29] Created local disks {{(pid=74613) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 29 18:02:43 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-b80f692d-3bff-4df4-90e6-d1cff53e4da7 tempest-AttachVolumeShelveTestJSON-1452861425 tempest-AttachVolumeShelveTestJSON-1452861425-project-member] [instance: f9be53df-54e6-4f59-9cef-0ba7434f0c29] Ensure instance console log exists: /opt/stack/data/nova/instances/f9be53df-54e6-4f59-9cef-0ba7434f0c29/console.log {{(pid=74613) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 29 18:02:43 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-b80f692d-3bff-4df4-90e6-d1cff53e4da7 tempest-AttachVolumeShelveTestJSON-1452861425 tempest-AttachVolumeShelveTestJSON-1452861425-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 18:02:43 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-b80f692d-3bff-4df4-90e6-d1cff53e4da7 tempest-AttachVolumeShelveTestJSON-1452861425 tempest-AttachVolumeShelveTestJSON-1452861425-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 18:02:43 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-b80f692d-3bff-4df4-90e6-d1cff53e4da7 tempest-AttachVolumeShelveTestJSON-1452861425 tempest-AttachVolumeShelveTestJSON-1452861425-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 18:02:43 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-b80f692d-3bff-4df4-90e6-d1cff53e4da7 tempest-AttachVolumeShelveTestJSON-1452861425 tempest-AttachVolumeShelveTestJSON-1452861425-project-member] [instance: f9be53df-54e6-4f59-9cef-0ba7434f0c29] Start _get_guest_xml network_info=[{"id": "175b56ab-750b-4dbf-a981-2a32d749d445", "address": "fa:16:3e:e8:f3:9e", "network": {"id": "4a101f3e-d23e-4198-bc3c-b4f9b4d2b4c4", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-864151424-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.246", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1c0c1c71400549369c1b11ca7d5f43ec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap175b56ab-75", "ovs_interfaceid": "175b56ab-750b-4dbf-a981-2a32d749d445", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='8000e03a44747527918d466a2c92e2d5',container_format='bare',created_at=2023-11-29T18:00:44Z,direct_url=<?>,disk_format='qcow2',id=e5f40838-1165-44d9-858a-fb5bda721c22,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-1968314827-shelved',owner='1c0c1c71400549369c1b11ca7d5f43ec',properties=ImageMetaProps,protected=<?>,size=52297728,status='active',tags=<?>,updated_at=2023-11-29T18:00:49Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'size': 0, 'device_type': 'disk', 'boot_index': 0, 'guest_format': None, 'encrypted': False, 'encryption_format': None, 'disk_bus': 'virtio', 'image_id': '4217f428-8d9d-4ee1-9614-642d26d90c46'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74613) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 29 18:02:43 user nova-compute[74613]: WARNING nova.virt.libvirt.driver [None req-b80f692d-3bff-4df4-90e6-d1cff53e4da7 tempest-AttachVolumeShelveTestJSON-1452861425 tempest-AttachVolumeShelveTestJSON-1452861425-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 18:02:43 user nova-compute[74613]: WARNING nova.virt.libvirt.driver [None req-b80f692d-3bff-4df4-90e6-d1cff53e4da7 tempest-AttachVolumeShelveTestJSON-1452861425 tempest-AttachVolumeShelveTestJSON-1452861425-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 18:02:43 user nova-compute[74613]: DEBUG nova.virt.libvirt.host [None req-b80f692d-3bff-4df4-90e6-d1cff53e4da7 tempest-AttachVolumeShelveTestJSON-1452861425 tempest-AttachVolumeShelveTestJSON-1452861425-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74613) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 29 18:02:43 user nova-compute[74613]: DEBUG nova.virt.libvirt.host [None req-b80f692d-3bff-4df4-90e6-d1cff53e4da7 tempest-AttachVolumeShelveTestJSON-1452861425 tempest-AttachVolumeShelveTestJSON-1452861425-project-member] CPU controller missing on host. {{(pid=74613) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 29 18:02:43 user nova-compute[74613]: DEBUG nova.virt.libvirt.host [None req-b80f692d-3bff-4df4-90e6-d1cff53e4da7 tempest-AttachVolumeShelveTestJSON-1452861425 tempest-AttachVolumeShelveTestJSON-1452861425-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74613) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 29 18:02:43 user nova-compute[74613]: DEBUG nova.virt.libvirt.host [None req-b80f692d-3bff-4df4-90e6-d1cff53e4da7 tempest-AttachVolumeShelveTestJSON-1452861425 tempest-AttachVolumeShelveTestJSON-1452861425-project-member] CPU controller found on host. {{(pid=74613) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 29 18:02:43 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-b80f692d-3bff-4df4-90e6-d1cff53e4da7 tempest-AttachVolumeShelveTestJSON-1452861425 tempest-AttachVolumeShelveTestJSON-1452861425-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74613) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 29 18:02:43 user nova-compute[74613]: DEBUG nova.virt.hardware [None req-b80f692d-3bff-4df4-90e6-d1cff53e4da7 tempest-AttachVolumeShelveTestJSON-1452861425 tempest-AttachVolumeShelveTestJSON-1452861425-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-29T17:47:27Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='8000e03a44747527918d466a2c92e2d5',container_format='bare',created_at=2023-11-29T18:00:44Z,direct_url=<?>,disk_format='qcow2',id=e5f40838-1165-44d9-858a-fb5bda721c22,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-1968314827-shelved',owner='1c0c1c71400549369c1b11ca7d5f43ec',properties=ImageMetaProps,protected=<?>,size=52297728,status='active',tags=<?>,updated_at=2023-11-29T18:00:49Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74613) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 29 18:02:43 user nova-compute[74613]: DEBUG nova.virt.hardware [None req-b80f692d-3bff-4df4-90e6-d1cff53e4da7 tempest-AttachVolumeShelveTestJSON-1452861425 tempest-AttachVolumeShelveTestJSON-1452861425-project-member] Flavor limits 0:0:0 {{(pid=74613) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 29 18:02:43 user nova-compute[74613]: DEBUG nova.virt.hardware [None req-b80f692d-3bff-4df4-90e6-d1cff53e4da7 tempest-AttachVolumeShelveTestJSON-1452861425 tempest-AttachVolumeShelveTestJSON-1452861425-project-member] Image limits 0:0:0 {{(pid=74613) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 29 18:02:43 user nova-compute[74613]: DEBUG nova.virt.hardware [None req-b80f692d-3bff-4df4-90e6-d1cff53e4da7 tempest-AttachVolumeShelveTestJSON-1452861425 tempest-AttachVolumeShelveTestJSON-1452861425-project-member] Flavor pref 0:0:0 {{(pid=74613) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 29 18:02:43 user nova-compute[74613]: DEBUG nova.virt.hardware [None req-b80f692d-3bff-4df4-90e6-d1cff53e4da7 tempest-AttachVolumeShelveTestJSON-1452861425 tempest-AttachVolumeShelveTestJSON-1452861425-project-member] Image pref 0:0:0 {{(pid=74613) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 29 18:02:43 user nova-compute[74613]: DEBUG nova.virt.hardware [None req-b80f692d-3bff-4df4-90e6-d1cff53e4da7 tempest-AttachVolumeShelveTestJSON-1452861425 tempest-AttachVolumeShelveTestJSON-1452861425-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74613) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 29 18:02:43 user nova-compute[74613]: DEBUG nova.virt.hardware [None req-b80f692d-3bff-4df4-90e6-d1cff53e4da7 tempest-AttachVolumeShelveTestJSON-1452861425 tempest-AttachVolumeShelveTestJSON-1452861425-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74613) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 29 18:02:43 user nova-compute[74613]: DEBUG nova.virt.hardware [None req-b80f692d-3bff-4df4-90e6-d1cff53e4da7 tempest-AttachVolumeShelveTestJSON-1452861425 tempest-AttachVolumeShelveTestJSON-1452861425-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74613) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 29 18:02:43 user nova-compute[74613]: DEBUG nova.virt.hardware [None req-b80f692d-3bff-4df4-90e6-d1cff53e4da7 tempest-AttachVolumeShelveTestJSON-1452861425 tempest-AttachVolumeShelveTestJSON-1452861425-project-member] Got 1 possible topologies {{(pid=74613) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 29 18:02:43 user nova-compute[74613]: DEBUG nova.virt.hardware [None req-b80f692d-3bff-4df4-90e6-d1cff53e4da7 tempest-AttachVolumeShelveTestJSON-1452861425 tempest-AttachVolumeShelveTestJSON-1452861425-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74613) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 29 18:02:43 user nova-compute[74613]: DEBUG nova.virt.hardware [None req-b80f692d-3bff-4df4-90e6-d1cff53e4da7 tempest-AttachVolumeShelveTestJSON-1452861425 tempest-AttachVolumeShelveTestJSON-1452861425-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74613) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 29 18:02:43 user nova-compute[74613]: DEBUG nova.objects.instance [None req-b80f692d-3bff-4df4-90e6-d1cff53e4da7 tempest-AttachVolumeShelveTestJSON-1452861425 tempest-AttachVolumeShelveTestJSON-1452861425-project-member] Lazy-loading 'vcpu_model' on Instance uuid f9be53df-54e6-4f59-9cef-0ba7434f0c29 {{(pid=74613) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 18:02:43 user nova-compute[74613]: DEBUG nova.objects.base [None req-b80f692d-3bff-4df4-90e6-d1cff53e4da7 tempest-AttachVolumeShelveTestJSON-1452861425 tempest-AttachVolumeShelveTestJSON-1452861425-project-member] Object Instance<f9be53df-54e6-4f59-9cef-0ba7434f0c29> lazy-loaded attributes: pci_requests,trusted_certs,migration_context,vcpu_model {{(pid=74613) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 29 18:02:43 user nova-compute[74613]: DEBUG nova.virt.libvirt.vif [None req-b80f692d-3bff-4df4-90e6-d1cff53e4da7 tempest-AttachVolumeShelveTestJSON-1452861425 tempest-AttachVolumeShelveTestJSON-1452861425-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-29T17:58:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1968314827',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1968314827',id=20,image_ref='e5f40838-1165-44d9-858a-fb5bda721c22',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-keypair-1048982870',keypairs=<?>,launch_index=0,launched_at=2023-11-29T17:58:56Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='1c0c1c71400549369c1b11ca7d5f43ec',ramdisk_id='',reservation_id='r-crz26r0v',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='4217f428-8d9d-4ee1-9614-642d26d90c46',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1452861425',owner_user_name='tempest-AttachVolumeShelveTestJSON-1452861425-project-member',shelved_at='2023-11-29T18:00:48.988892',shelved_host='user',shelved_image_id='e5f40838-1165-44d9-858a-fb5bda721c22'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T18:02:37Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='45192488dde84ebfbcacfdbd4f898799',uuid=f9be53df-54e6-4f59-9cef-0ba7434f0c29,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "175b56ab-750b-4dbf-a981-2a32d749d445", "address": "fa:16:3e:e8:f3:9e", "network": {"id": "4a101f3e-d23e-4198-bc3c-b4f9b4d2b4c4", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-864151424-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.246", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1c0c1c71400549369c1b11ca7d5f43ec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap175b56ab-75", "ovs_interfaceid": "175b56ab-750b-4dbf-a981-2a32d749d445", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74613) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 29 18:02:43 user nova-compute[74613]: DEBUG nova.network.os_vif_util [None req-b80f692d-3bff-4df4-90e6-d1cff53e4da7 tempest-AttachVolumeShelveTestJSON-1452861425 tempest-AttachVolumeShelveTestJSON-1452861425-project-member] Converting VIF {"id": "175b56ab-750b-4dbf-a981-2a32d749d445", "address": "fa:16:3e:e8:f3:9e", "network": {"id": "4a101f3e-d23e-4198-bc3c-b4f9b4d2b4c4", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-864151424-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.246", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1c0c1c71400549369c1b11ca7d5f43ec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap175b56ab-75", "ovs_interfaceid": "175b56ab-750b-4dbf-a981-2a32d749d445", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74613) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 18:02:43 user nova-compute[74613]: DEBUG nova.network.os_vif_util [None req-b80f692d-3bff-4df4-90e6-d1cff53e4da7 tempest-AttachVolumeShelveTestJSON-1452861425 tempest-AttachVolumeShelveTestJSON-1452861425-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e8:f3:9e,bridge_name='br-int',has_traffic_filtering=True,id=175b56ab-750b-4dbf-a981-2a32d749d445,network=Network(4a101f3e-d23e-4198-bc3c-b4f9b4d2b4c4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap175b56ab-75') {{(pid=74613) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 18:02:43 user nova-compute[74613]: DEBUG nova.objects.instance [None req-b80f692d-3bff-4df4-90e6-d1cff53e4da7 tempest-AttachVolumeShelveTestJSON-1452861425 tempest-AttachVolumeShelveTestJSON-1452861425-project-member] Lazy-loading 'pci_devices' on Instance uuid f9be53df-54e6-4f59-9cef-0ba7434f0c29 {{(pid=74613) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 18:02:43 user nova-compute[74613]: DEBUG nova.objects.base [None req-b80f692d-3bff-4df4-90e6-d1cff53e4da7 tempest-AttachVolumeShelveTestJSON-1452861425 tempest-AttachVolumeShelveTestJSON-1452861425-project-member] Object Instance<f9be53df-54e6-4f59-9cef-0ba7434f0c29> lazy-loaded attributes: pci_requests,trusted_certs,migration_context,vcpu_model,pci_devices {{(pid=74613) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 29 18:02:43 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-b80f692d-3bff-4df4-90e6-d1cff53e4da7 tempest-AttachVolumeShelveTestJSON-1452861425 tempest-AttachVolumeShelveTestJSON-1452861425-project-member] [instance: f9be53df-54e6-4f59-9cef-0ba7434f0c29] End _get_guest_xml xml=<domain type="kvm">
Nov 29 18:02:43 user nova-compute[74613]:   <uuid>f9be53df-54e6-4f59-9cef-0ba7434f0c29</uuid>
Nov 29 18:02:43 user nova-compute[74613]:   <name>instance-00000014</name>
Nov 29 18:02:43 user nova-compute[74613]:   <memory>524288</memory>
Nov 29 18:02:43 user nova-compute[74613]:   <vcpu>1</vcpu>
Nov 29 18:02:43 user nova-compute[74613]:   <metadata>
Nov 29 18:02:43 user nova-compute[74613]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 29 18:02:43 user nova-compute[74613]:       <nova:package version="0.0.0"/>
Nov 29 18:02:43 user nova-compute[74613]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-1968314827</nova:name>
Nov 29 18:02:43 user nova-compute[74613]:       <nova:creationTime>2023-11-29 18:02:43</nova:creationTime>
Nov 29 18:02:43 user nova-compute[74613]:       <nova:flavor name="m1.tiny">
Nov 29 18:02:43 user nova-compute[74613]:         <nova:memory>512</nova:memory>
Nov 29 18:02:43 user nova-compute[74613]:         <nova:disk>1</nova:disk>
Nov 29 18:02:43 user nova-compute[74613]:         <nova:swap>0</nova:swap>
Nov 29 18:02:43 user nova-compute[74613]:         <nova:ephemeral>0</nova:ephemeral>
Nov 29 18:02:43 user nova-compute[74613]:         <nova:vcpus>1</nova:vcpus>
Nov 29 18:02:43 user nova-compute[74613]:       </nova:flavor>
Nov 29 18:02:43 user nova-compute[74613]:       <nova:owner>
Nov 29 18:02:43 user nova-compute[74613]:         <nova:user uuid="45192488dde84ebfbcacfdbd4f898799">tempest-AttachVolumeShelveTestJSON-1452861425-project-member</nova:user>
Nov 29 18:02:43 user nova-compute[74613]:         <nova:project uuid="1c0c1c71400549369c1b11ca7d5f43ec">tempest-AttachVolumeShelveTestJSON-1452861425</nova:project>
Nov 29 18:02:43 user nova-compute[74613]:       </nova:owner>
Nov 29 18:02:43 user nova-compute[74613]:       <nova:root type="image" uuid="e5f40838-1165-44d9-858a-fb5bda721c22"/>
Nov 29 18:02:43 user nova-compute[74613]:       <nova:ports>
Nov 29 18:02:43 user nova-compute[74613]:         <nova:port uuid="175b56ab-750b-4dbf-a981-2a32d749d445">
Nov 29 18:02:43 user nova-compute[74613]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Nov 29 18:02:43 user nova-compute[74613]:         </nova:port>
Nov 29 18:02:43 user nova-compute[74613]:       </nova:ports>
Nov 29 18:02:43 user nova-compute[74613]:     </nova:instance>
Nov 29 18:02:43 user nova-compute[74613]:   </metadata>
Nov 29 18:02:43 user nova-compute[74613]:   <sysinfo type="smbios">
Nov 29 18:02:43 user nova-compute[74613]:     <system>
Nov 29 18:02:43 user nova-compute[74613]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 29 18:02:43 user nova-compute[74613]:       <entry name="product">OpenStack Nova</entry>
Nov 29 18:02:43 user nova-compute[74613]:       <entry name="version">0.0.0</entry>
Nov 29 18:02:43 user nova-compute[74613]:       <entry name="serial">f9be53df-54e6-4f59-9cef-0ba7434f0c29</entry>
Nov 29 18:02:43 user nova-compute[74613]:       <entry name="uuid">f9be53df-54e6-4f59-9cef-0ba7434f0c29</entry>
Nov 29 18:02:43 user nova-compute[74613]:       <entry name="family">Virtual Machine</entry>
Nov 29 18:02:43 user nova-compute[74613]:     </system>
Nov 29 18:02:43 user nova-compute[74613]:   </sysinfo>
Nov 29 18:02:43 user nova-compute[74613]:   <os>
Nov 29 18:02:43 user nova-compute[74613]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 29 18:02:43 user nova-compute[74613]:     <boot dev="hd"/>
Nov 29 18:02:43 user nova-compute[74613]:     <smbios mode="sysinfo"/>
Nov 29 18:02:43 user nova-compute[74613]:   </os>
Nov 29 18:02:43 user nova-compute[74613]:   <features>
Nov 29 18:02:43 user nova-compute[74613]:     <acpi/>
Nov 29 18:02:43 user nova-compute[74613]:     <apic/>
Nov 29 18:02:43 user nova-compute[74613]:     <vmcoreinfo/>
Nov 29 18:02:43 user nova-compute[74613]:   </features>
Nov 29 18:02:43 user nova-compute[74613]:   <clock offset="utc">
Nov 29 18:02:43 user nova-compute[74613]:     <timer name="pit" tickpolicy="delay"/>
Nov 29 18:02:43 user nova-compute[74613]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 29 18:02:43 user nova-compute[74613]:     <timer name="hpet" present="no"/>
Nov 29 18:02:43 user nova-compute[74613]:   </clock>
Nov 29 18:02:43 user nova-compute[74613]:   <cpu mode="custom" match="exact">
Nov 29 18:02:43 user nova-compute[74613]:     <model>Nehalem</model>
Nov 29 18:02:43 user nova-compute[74613]:     <topology sockets="1" cores="1" threads="1"/>
Nov 29 18:02:43 user nova-compute[74613]:   </cpu>
Nov 29 18:02:43 user nova-compute[74613]:   <devices>
Nov 29 18:02:43 user nova-compute[74613]:     <disk type="file" device="disk">
Nov 29 18:02:43 user nova-compute[74613]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 29 18:02:43 user nova-compute[74613]:       <source file="/opt/stack/data/nova/instances/f9be53df-54e6-4f59-9cef-0ba7434f0c29/disk"/>
Nov 29 18:02:43 user nova-compute[74613]:       <target dev="vda" bus="virtio"/>
Nov 29 18:02:43 user nova-compute[74613]:     </disk>
Nov 29 18:02:43 user nova-compute[74613]:     <interface type="ethernet">
Nov 29 18:02:43 user nova-compute[74613]:       <mac address="fa:16:3e:e8:f3:9e"/>
Nov 29 18:02:43 user nova-compute[74613]:       <model type="virtio"/>
Nov 29 18:02:43 user nova-compute[74613]:       <mtu size="1442"/>
Nov 29 18:02:43 user nova-compute[74613]:       <target dev="tap175b56ab-75"/>
Nov 29 18:02:43 user nova-compute[74613]:     </interface>
Nov 29 18:02:43 user nova-compute[74613]:     <serial type="pty">
Nov 29 18:02:43 user nova-compute[74613]:       <log file="/opt/stack/data/nova/instances/f9be53df-54e6-4f59-9cef-0ba7434f0c29/console.log" append="off"/>
Nov 29 18:02:43 user nova-compute[74613]:     </serial>
Nov 29 18:02:43 user nova-compute[74613]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 29 18:02:43 user nova-compute[74613]:     <video>
Nov 29 18:02:43 user nova-compute[74613]:       <model type="virtio"/>
Nov 29 18:02:43 user nova-compute[74613]:     </video>
Nov 29 18:02:43 user nova-compute[74613]:     <rng model="virtio">
Nov 29 18:02:43 user nova-compute[74613]:       <backend model="random">/dev/urandom</backend>
Nov 29 18:02:43 user nova-compute[74613]:     </rng>
Nov 29 18:02:43 user nova-compute[74613]:     <controller type="usb" index="0" model="none"/>
Nov 29 18:02:43 user nova-compute[74613]:     <memballoon model="virtio">
Nov 29 18:02:43 user nova-compute[74613]:       <stats period="10"/>
Nov 29 18:02:43 user nova-compute[74613]:     </memballoon>
Nov 29 18:02:43 user nova-compute[74613]:   </devices>
Nov 29 18:02:43 user nova-compute[74613]: </domain>
Nov 29 18:02:43 user nova-compute[74613]:  {{(pid=74613) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 29 18:02:43 user nova-compute[74613]: DEBUG nova.virt.libvirt.vif [None req-b80f692d-3bff-4df4-90e6-d1cff53e4da7 tempest-AttachVolumeShelveTestJSON-1452861425 tempest-AttachVolumeShelveTestJSON-1452861425-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-29T17:58:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1968314827',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1968314827',id=20,image_ref='e5f40838-1165-44d9-858a-fb5bda721c22',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-keypair-1048982870',keypairs=<?>,launch_index=0,launched_at=2023-11-29T17:58:56Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='1c0c1c71400549369c1b11ca7d5f43ec',ramdisk_id='',reservation_id='r-crz26r0v',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='4217f428-8d9d-4ee1-9614-642d26d90c46',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1452861425',owner_user_name='tempest-AttachVolumeShelveTestJSON-1452861425-project-member',shelved_at='2023-11-29T18:00:48.988892',shelved_host='user',shelved_image_id='e5f40838-1165-44d9-858a-fb5bda721c22'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T18:02:37Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='45192488dde84ebfbcacfdbd4f898799',uuid=f9be53df-54e6-4f59-9cef-0ba7434f0c29,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "175b56ab-750b-4dbf-a981-2a32d749d445", "address": "fa:16:3e:e8:f3:9e", "network": {"id": "4a101f3e-d23e-4198-bc3c-b4f9b4d2b4c4", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-864151424-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.246", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1c0c1c71400549369c1b11ca7d5f43ec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap175b56ab-75", "ovs_interfaceid": "175b56ab-750b-4dbf-a981-2a32d749d445", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74613) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 29 18:02:43 user nova-compute[74613]: DEBUG nova.network.os_vif_util [None req-b80f692d-3bff-4df4-90e6-d1cff53e4da7 tempest-AttachVolumeShelveTestJSON-1452861425 tempest-AttachVolumeShelveTestJSON-1452861425-project-member] Converting VIF {"id": "175b56ab-750b-4dbf-a981-2a32d749d445", "address": "fa:16:3e:e8:f3:9e", "network": {"id": "4a101f3e-d23e-4198-bc3c-b4f9b4d2b4c4", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-864151424-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.246", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1c0c1c71400549369c1b11ca7d5f43ec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap175b56ab-75", "ovs_interfaceid": "175b56ab-750b-4dbf-a981-2a32d749d445", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74613) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 18:02:43 user nova-compute[74613]: DEBUG nova.network.os_vif_util [None req-b80f692d-3bff-4df4-90e6-d1cff53e4da7 tempest-AttachVolumeShelveTestJSON-1452861425 tempest-AttachVolumeShelveTestJSON-1452861425-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e8:f3:9e,bridge_name='br-int',has_traffic_filtering=True,id=175b56ab-750b-4dbf-a981-2a32d749d445,network=Network(4a101f3e-d23e-4198-bc3c-b4f9b4d2b4c4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap175b56ab-75') {{(pid=74613) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 18:02:43 user nova-compute[74613]: DEBUG os_vif [None req-b80f692d-3bff-4df4-90e6-d1cff53e4da7 tempest-AttachVolumeShelveTestJSON-1452861425 tempest-AttachVolumeShelveTestJSON-1452861425-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e8:f3:9e,bridge_name='br-int',has_traffic_filtering=True,id=175b56ab-750b-4dbf-a981-2a32d749d445,network=Network(4a101f3e-d23e-4198-bc3c-b4f9b4d2b4c4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap175b56ab-75') {{(pid=74613) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 29 18:02:43 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:02:43 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74613) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 18:02:43 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74613) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 29 18:02:43 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:02:43 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'fccbc867-50ef-57d4-86dd-8752796efd8b', '_type': 'linux-noop'}}, row=False) {{(pid=74613) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 18:02:43 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:02:43 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 18:02:43 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:02:43 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap175b56ab-75, may_exist=True, interface_attrs={}) {{(pid=74613) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 18:02:43 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap175b56ab-75, col_values=(('qos', UUID('41429a19-ba0d-4921-b841-131cb42b7990')),), if_exists=True) {{(pid=74613) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 18:02:43 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap175b56ab-75, col_values=(('external_ids', {'iface-id': '175b56ab-750b-4dbf-a981-2a32d749d445', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:e8:f3:9e', 'vm-uuid': 'f9be53df-54e6-4f59-9cef-0ba7434f0c29'}),), if_exists=True) {{(pid=74613) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 18:02:43 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 18:02:43 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:02:43 user nova-compute[74613]: INFO os_vif [None req-b80f692d-3bff-4df4-90e6-d1cff53e4da7 tempest-AttachVolumeShelveTestJSON-1452861425 tempest-AttachVolumeShelveTestJSON-1452861425-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e8:f3:9e,bridge_name='br-int',has_traffic_filtering=True,id=175b56ab-750b-4dbf-a981-2a32d749d445,network=Network(4a101f3e-d23e-4198-bc3c-b4f9b4d2b4c4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap175b56ab-75')
Nov 29 18:02:43 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-b80f692d-3bff-4df4-90e6-d1cff53e4da7 tempest-AttachVolumeShelveTestJSON-1452861425 tempest-AttachVolumeShelveTestJSON-1452861425-project-member] No BDM found with device name vda, not building metadata. {{(pid=74613) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 18:02:43 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-b80f692d-3bff-4df4-90e6-d1cff53e4da7 tempest-AttachVolumeShelveTestJSON-1452861425 tempest-AttachVolumeShelveTestJSON-1452861425-project-member] No VIF found with MAC fa:16:3e:e8:f3:9e, not building metadata {{(pid=74613) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 29 18:02:44 user nova-compute[74613]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b83da953-763b-43d8-a139-6529c77a9402 tempest-VolumesSnapshotTestJSON-1388493826 tempest-VolumesSnapshotTestJSON-1388493826-project-member] [instance: 6c2ea311-0404-4ecf-8086-65f65186f858] Calling os-brick to attach iSCSI Volume {{(pid=74613) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 29 18:02:44 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-b83da953-763b-43d8-a139-6529c77a9402 tempest-VolumesSnapshotTestJSON-1388493826 tempest-VolumesSnapshotTestJSON-1388493826-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff828156890>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:86badab9-1598-4740-a73c-ba9d48b37dce', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ZntsUoGK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74613) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 18:02:44 user nova-compute[74613]: WARNING os_brick.initiator.connectors.base [None req-b83da953-763b-43d8-a139-6529c77a9402 tempest-VolumesSnapshotTestJSON-1388493826 tempest-VolumesSnapshotTestJSON-1388493826-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 18:02:44 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.base [None req-b83da953-763b-43d8-a139-6529c77a9402 tempest-VolumesSnapshotTestJSON-1388493826 tempest-VolumesSnapshotTestJSON-1388493826-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 18:02:44 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.base [None req-b83da953-763b-43d8-a139-6529c77a9402 tempest-VolumesSnapshotTestJSON-1388493826 tempest-VolumesSnapshotTestJSON-1388493826-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 18:02:44 user nova-compute[74613]: WARNING os_brick.initiator.connectors.base [None req-b83da953-763b-43d8-a139-6529c77a9402 tempest-VolumesSnapshotTestJSON-1388493826 tempest-VolumesSnapshotTestJSON-1388493826-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 18:02:44 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.base [None req-b83da953-763b-43d8-a139-6529c77a9402 tempest-VolumesSnapshotTestJSON-1388493826 tempest-VolumesSnapshotTestJSON-1388493826-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:86badab9-1598-4740-a73c-ba9d48b37dce" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 18:02:44 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.base [None req-b83da953-763b-43d8-a139-6529c77a9402 tempest-VolumesSnapshotTestJSON-1388493826 tempest-VolumesSnapshotTestJSON-1388493826-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:86badab9-1598-4740-a73c-ba9d48b37dce" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 18:02:44 user nova-compute[74613]: INFO os_brick.initiator.connectors.iscsi [None req-b83da953-763b-43d8-a139-6529c77a9402 tempest-VolumesSnapshotTestJSON-1388493826 tempest-VolumesSnapshotTestJSON-1388493826-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 29 18:02:44 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:86badab9-1598-4740-a73c-ba9d48b37dce -p 172.16.0.220:3260 {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:02:44 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:86badab9-1598-4740-a73c-ba9d48b37dce -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:02:44 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f832d5c-4a68-4503-bb5c-1c0ea168f516]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 18:02:44 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-b83da953-763b-43d8-a139-6529c77a9402 tempest-VolumesSnapshotTestJSON-1388493826 tempest-VolumesSnapshotTestJSON-1388493826-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 29 18:02:44 user nova-compute[74613]:  {{(pid=74613) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 18:02:44 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:86badab9-1598-4740-a73c-ba9d48b37dce -p 172.16.0.220:3260 --interface default --op new {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:02:44 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:86badab9-1598-4740-a73c-ba9d48b37dce -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.017s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:02:44 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[f51f0c66-f0db-4d2a-b087-9a93e08beeaa]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:86badab9-1598-4740-a73c-ba9d48b37dce] added\n', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 18:02:44 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-b83da953-763b-43d8-a139-6529c77a9402 tempest-VolumesSnapshotTestJSON-1388493826 tempest-VolumesSnapshotTestJSON-1388493826-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:86badab9-1598-4740-a73c-ba9d48b37dce] added
Nov 29 18:02:44 user nova-compute[74613]:  stderr= {{(pid=74613) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 18:02:44 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:86badab9-1598-4740-a73c-ba9d48b37dce -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:02:44 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:86badab9-1598-4740-a73c-ba9d48b37dce -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:02:44 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6e24c3b-78ed-4990-bf33-3d05e20b2f0a]: (4, ('', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 18:02:44 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-b83da953-763b-43d8-a139-6529c77a9402 tempest-VolumesSnapshotTestJSON-1388493826 tempest-VolumesSnapshotTestJSON-1388493826-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74613) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 18:02:44 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:86badab9-1598-4740-a73c-ba9d48b37dce -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:02:44 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:86badab9-1598-4740-a73c-ba9d48b37dce -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:02:44 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[59d24751-e8d7-4816-aed9-233a8757d76a]: (4, ('', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 18:02:44 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-b83da953-763b-43d8-a139-6529c77a9402 tempest-VolumesSnapshotTestJSON-1388493826 tempest-VolumesSnapshotTestJSON-1388493826-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74613) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 18:02:44 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:86badab9-1598-4740-a73c-ba9d48b37dce -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ZntsUoGK {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:02:44 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:86badab9-1598-4740-a73c-ba9d48b37dce -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ZntsUoGK" returned: 0 in 0.018s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:02:44 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[10c03f19-4a13-4b9a-a2d7-1c5fbabcfeb3]: (4, ('', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 18:02:44 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-b83da953-763b-43d8-a139-6529c77a9402 tempest-VolumesSnapshotTestJSON-1388493826 tempest-VolumesSnapshotTestJSON-1388493826-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'ZntsUoGK'): stdout= stderr= {{(pid=74613) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 18:02:44 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:86badab9-1598-4740-a73c-ba9d48b37dce -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:02:44 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:86badab9-1598-4740-a73c-ba9d48b37dce -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:02:44 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e9bb868-f962-42ed-9ffc-b7bb1ef4718c]: (4, ('', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 18:02:44 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-b83da953-763b-43d8-a139-6529c77a9402 tempest-VolumesSnapshotTestJSON-1388493826 tempest-VolumesSnapshotTestJSON-1388493826-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74613) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 18:02:44 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:02:44 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:02:44 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[004dee76-1ba6-468b-9330-f763e7673d4f]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9511387c-8772-40f2-bf2d-6b6387649e9f (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb526b54-3017-4f30-b5c7-88027b146d52 (non-flash)\n', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 18:02:44 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-b83da953-763b-43d8-a139-6529c77a9402 tempest-VolumesSnapshotTestJSON-1388493826 tempest-VolumesSnapshotTestJSON-1388493826-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9511387c-8772-40f2-bf2d-6b6387649e9f (non-flash)
Nov 29 18:02:44 user nova-compute[74613]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb526b54-3017-4f30-b5c7-88027b146d52 (non-flash)
Nov 29 18:02:44 user nova-compute[74613]:  stderr= {{(pid=74613) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 18:02:44 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-b83da953-763b-43d8-a139-6529c77a9402 tempest-VolumesSnapshotTestJSON-1388493826 tempest-VolumesSnapshotTestJSON-1388493826-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9511387c-8772-40f2-bf2d-6b6387649e9f (non-flash)
Nov 29 18:02:44 user nova-compute[74613]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb526b54-3017-4f30-b5c7-88027b146d52 (non-flash)
Nov 29 18:02:44 user nova-compute[74613]:  stderr= {{(pid=74613) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 18:02:44 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:86badab9-1598-4740-a73c-ba9d48b37dce -p 172.16.0.220:3260 --login {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:02:44 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:86badab9-1598-4740-a73c-ba9d48b37dce -p 172.16.0.220:3260 --login" returned: 0 in 0.068s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:02:44 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4cac46f-9012-4d9a-9e47-b7b7bc8844c8]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:86badab9-1598-4740-a73c-ba9d48b37dce, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:86badab9-1598-4740-a73c-ba9d48b37dce, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 18:02:44 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-b83da953-763b-43d8-a139-6529c77a9402 tempest-VolumesSnapshotTestJSON-1388493826 tempest-VolumesSnapshotTestJSON-1388493826-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:86badab9-1598-4740-a73c-ba9d48b37dce, portal: 172.16.0.220,3260]
Nov 29 18:02:44 user nova-compute[74613]: Login to [iface: default, target: iqn.2010-10.org.openstack:86badab9-1598-4740-a73c-ba9d48b37dce, portal: 172.16.0.220,3260] successful.
Nov 29 18:02:44 user nova-compute[74613]:  stderr= {{(pid=74613) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 18:02:44 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:86badab9-1598-4740-a73c-ba9d48b37dce -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:02:44 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:86badab9-1598-4740-a73c-ba9d48b37dce -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:02:44 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff611a08-e81f-4cf0-a0bd-542cdd245810]: (4, ('', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 18:02:44 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-b83da953-763b-43d8-a139-6529c77a9402 tempest-VolumesSnapshotTestJSON-1388493826 tempest-VolumesSnapshotTestJSON-1388493826-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74613) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 18:02:44 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:02:44 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:02:44 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[f95640d4-25cc-463c-8f23-005c7b35a850]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9511387c-8772-40f2-bf2d-6b6387649e9f (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb526b54-3017-4f30-b5c7-88027b146d52 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:86badab9-1598-4740-a73c-ba9d48b37dce (non-flash)\n', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 18:02:44 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-b83da953-763b-43d8-a139-6529c77a9402 tempest-VolumesSnapshotTestJSON-1388493826 tempest-VolumesSnapshotTestJSON-1388493826-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9511387c-8772-40f2-bf2d-6b6387649e9f (non-flash)
Nov 29 18:02:44 user nova-compute[74613]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb526b54-3017-4f30-b5c7-88027b146d52 (non-flash)
Nov 29 18:02:44 user nova-compute[74613]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:86badab9-1598-4740-a73c-ba9d48b37dce (non-flash)
Nov 29 18:02:44 user nova-compute[74613]:  stderr= {{(pid=74613) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 18:02:44 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-b83da953-763b-43d8-a139-6529c77a9402 tempest-VolumesSnapshotTestJSON-1388493826 tempest-VolumesSnapshotTestJSON-1388493826-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9511387c-8772-40f2-bf2d-6b6387649e9f (non-flash)
Nov 29 18:02:44 user nova-compute[74613]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb526b54-3017-4f30-b5c7-88027b146d52 (non-flash)
Nov 29 18:02:44 user nova-compute[74613]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:86badab9-1598-4740-a73c-ba9d48b37dce (non-flash)
Nov 29 18:02:44 user nova-compute[74613]:  stderr= {{(pid=74613) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 18:02:44 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.base [None req-b83da953-763b-43d8-a139-6529c77a9402 tempest-VolumesSnapshotTestJSON-1388493826 tempest-VolumesSnapshotTestJSON-1388493826-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:86badab9-1598-4740-a73c-ba9d48b37dce" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.268s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 18:02:44 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-b83da953-763b-43d8-a139-6529c77a9402 tempest-VolumesSnapshotTestJSON-1388493826 tempest-VolumesSnapshotTestJSON-1388493826-project-member] Connected to 172.16.0.220:3260 {{(pid=74613) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 29 18:02:44 user nova-compute[74613]: DEBUG os_brick.initiator.linuxscsi [None req-b83da953-763b-43d8-a139-6529c77a9402 tempest-VolumesSnapshotTestJSON-1388493826 tempest-VolumesSnapshotTestJSON-1388493826-project-member] HCTL ('34', '-', '-', 0) found on session 27 with lun 0 {{(pid=74613) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 29 18:02:44 user nova-compute[74613]: DEBUG os_brick.initiator.linuxscsi [None req-b83da953-763b-43d8-a139-6529c77a9402 tempest-VolumesSnapshotTestJSON-1388493826 tempest-VolumesSnapshotTestJSON-1388493826-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=74613) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 29 18:02:44 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:02:44 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.016s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:02:44 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[05259869-4548-41e3-b58e-3b253c9d7be6]: (4, ('- - 0', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 18:02:44 user nova-compute[74613]: DEBUG os_brick.initiator.linuxscsi [None req-b83da953-763b-43d8-a139-6529c77a9402 tempest-VolumesSnapshotTestJSON-1388493826 tempest-VolumesSnapshotTestJSON-1388493826-project-member] Searching for a device in session 27 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=74613) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 29 18:02:44 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-b83da953-763b-43d8-a139-6529c77a9402 tempest-VolumesSnapshotTestJSON-1388493826 tempest-VolumesSnapshotTestJSON-1388493826-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:86badab9-1598-4740-a73c-ba9d48b37dce', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ZntsUoGK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74613) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 29 18:02:44 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:02:45 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:02:45 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:02:45 user nova-compute[74613]: DEBUG nova.compute.manager [req-fb85d3ec-156b-4bdb-940f-2e80aabcb615 req-a776786d-b595-432d-8f1a-8fdaca654d07 service nova] [instance: f9be53df-54e6-4f59-9cef-0ba7434f0c29] Received event network-vif-plugged-175b56ab-750b-4dbf-a981-2a32d749d445 {{(pid=74613) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 18:02:45 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-fb85d3ec-156b-4bdb-940f-2e80aabcb615 req-a776786d-b595-432d-8f1a-8fdaca654d07 service nova] Acquiring lock "f9be53df-54e6-4f59-9cef-0ba7434f0c29-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 18:02:45 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-fb85d3ec-156b-4bdb-940f-2e80aabcb615 req-a776786d-b595-432d-8f1a-8fdaca654d07 service nova] Lock "f9be53df-54e6-4f59-9cef-0ba7434f0c29-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 18:02:45 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-fb85d3ec-156b-4bdb-940f-2e80aabcb615 req-a776786d-b595-432d-8f1a-8fdaca654d07 service nova] Lock "f9be53df-54e6-4f59-9cef-0ba7434f0c29-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 18:02:45 user nova-compute[74613]: DEBUG nova.compute.manager [req-fb85d3ec-156b-4bdb-940f-2e80aabcb615 req-a776786d-b595-432d-8f1a-8fdaca654d07 service nova] [instance: f9be53df-54e6-4f59-9cef-0ba7434f0c29] No waiting events found dispatching network-vif-plugged-175b56ab-750b-4dbf-a981-2a32d749d445 {{(pid=74613) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 18:02:45 user nova-compute[74613]: WARNING nova.compute.manager [req-fb85d3ec-156b-4bdb-940f-2e80aabcb615 req-a776786d-b595-432d-8f1a-8fdaca654d07 service nova] [instance: f9be53df-54e6-4f59-9cef-0ba7434f0c29] Received unexpected event network-vif-plugged-175b56ab-750b-4dbf-a981-2a32d749d445 for instance with vm_state shelved_offloaded and task_state spawning.
Nov 29 18:02:45 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.base [None req-b83da953-763b-43d8-a139-6529c77a9402 tempest-VolumesSnapshotTestJSON-1388493826 tempest-VolumesSnapshotTestJSON-1388493826-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.301s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 18:02:45 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-b83da953-763b-43d8-a139-6529c77a9402 tempest-VolumesSnapshotTestJSON-1388493826 tempest-VolumesSnapshotTestJSON-1388493826-project-member] <== connect_volume: return (1302ms) {'type': 'block', 'scsi_wwn': '23561663137363063', 'path': '/dev/sdc'} {{(pid=74613) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 18:02:45 user nova-compute[74613]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b83da953-763b-43d8-a139-6529c77a9402 tempest-VolumesSnapshotTestJSON-1388493826 tempest-VolumesSnapshotTestJSON-1388493826-project-member] [instance: 6c2ea311-0404-4ecf-8086-65f65186f858] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23561663137363063', 'path': '/dev/sdc'} {{(pid=74613) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 29 18:02:45 user nova-compute[74613]: DEBUG nova.objects.instance [None req-b83da953-763b-43d8-a139-6529c77a9402 tempest-VolumesSnapshotTestJSON-1388493826 tempest-VolumesSnapshotTestJSON-1388493826-project-member] Lazy-loading 'flavor' on Instance uuid 6c2ea311-0404-4ecf-8086-65f65186f858 {{(pid=74613) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 18:02:45 user nova-compute[74613]: DEBUG nova.virt.libvirt.guest [None req-b83da953-763b-43d8-a139-6529c77a9402 tempest-VolumesSnapshotTestJSON-1388493826 tempest-VolumesSnapshotTestJSON-1388493826-project-member] attach device xml: <disk type="block" device="disk">
Nov 29 18:02:45 user nova-compute[74613]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 18:02:45 user nova-compute[74613]:   <source dev="/dev/sdc"/>
Nov 29 18:02:45 user nova-compute[74613]:   <target dev="vdb" bus="virtio"/>
Nov 29 18:02:45 user nova-compute[74613]:   <serial>86badab9-1598-4740-a73c-ba9d48b37dce</serial>
Nov 29 18:02:45 user nova-compute[74613]: </disk>
Nov 29 18:02:45 user nova-compute[74613]:  {{(pid=74613) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 29 18:02:45 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:02:45 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-b83da953-763b-43d8-a139-6529c77a9402 tempest-VolumesSnapshotTestJSON-1388493826 tempest-VolumesSnapshotTestJSON-1388493826-project-member] No BDM found with device name vda, not building metadata. {{(pid=74613) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 18:02:45 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-b83da953-763b-43d8-a139-6529c77a9402 tempest-VolumesSnapshotTestJSON-1388493826 tempest-VolumesSnapshotTestJSON-1388493826-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74613) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 18:02:45 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-b83da953-763b-43d8-a139-6529c77a9402 tempest-VolumesSnapshotTestJSON-1388493826 tempest-VolumesSnapshotTestJSON-1388493826-project-member] No VIF found with MAC fa:16:3e:75:15:43, not building metadata {{(pid=74613) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 29 18:02:45 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:02:45 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:02:45 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-b83da953-763b-43d8-a139-6529c77a9402 tempest-VolumesSnapshotTestJSON-1388493826 tempest-VolumesSnapshotTestJSON-1388493826-project-member] Lock "6c2ea311-0404-4ecf-8086-65f65186f858" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 9.796s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 18:02:47 user nova-compute[74613]: DEBUG nova.compute.manager [None req-b80f692d-3bff-4df4-90e6-d1cff53e4da7 tempest-AttachVolumeShelveTestJSON-1452861425 tempest-AttachVolumeShelveTestJSON-1452861425-project-member] [instance: f9be53df-54e6-4f59-9cef-0ba7434f0c29] Instance event wait completed in 0 seconds for  {{(pid=74613) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 29 18:02:47 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-b80f692d-3bff-4df4-90e6-d1cff53e4da7 tempest-AttachVolumeShelveTestJSON-1452861425 tempest-AttachVolumeShelveTestJSON-1452861425-project-member] [instance: f9be53df-54e6-4f59-9cef-0ba7434f0c29] Guest created on hypervisor {{(pid=74613) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 29 18:02:47 user nova-compute[74613]: INFO nova.virt.libvirt.driver [-] [instance: f9be53df-54e6-4f59-9cef-0ba7434f0c29] Instance spawned successfully.
Nov 29 18:02:47 user nova-compute[74613]: DEBUG nova.compute.manager [req-12080a40-0302-4cc3-b3ea-0dce18dffcbb req-5fb40f0b-7f0f-4385-b324-cd7878194a74 service nova] [instance: f9be53df-54e6-4f59-9cef-0ba7434f0c29] Received event network-vif-plugged-175b56ab-750b-4dbf-a981-2a32d749d445 {{(pid=74613) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 18:02:47 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-12080a40-0302-4cc3-b3ea-0dce18dffcbb req-5fb40f0b-7f0f-4385-b324-cd7878194a74 service nova] Acquiring lock "f9be53df-54e6-4f59-9cef-0ba7434f0c29-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 18:02:47 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-12080a40-0302-4cc3-b3ea-0dce18dffcbb req-5fb40f0b-7f0f-4385-b324-cd7878194a74 service nova] Lock "f9be53df-54e6-4f59-9cef-0ba7434f0c29-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 18:02:47 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-12080a40-0302-4cc3-b3ea-0dce18dffcbb req-5fb40f0b-7f0f-4385-b324-cd7878194a74 service nova] Lock "f9be53df-54e6-4f59-9cef-0ba7434f0c29-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 18:02:47 user nova-compute[74613]: DEBUG nova.compute.manager [req-12080a40-0302-4cc3-b3ea-0dce18dffcbb req-5fb40f0b-7f0f-4385-b324-cd7878194a74 service nova] [instance: f9be53df-54e6-4f59-9cef-0ba7434f0c29] No waiting events found dispatching network-vif-plugged-175b56ab-750b-4dbf-a981-2a32d749d445 {{(pid=74613) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 18:02:47 user nova-compute[74613]: WARNING nova.compute.manager [req-12080a40-0302-4cc3-b3ea-0dce18dffcbb req-5fb40f0b-7f0f-4385-b324-cd7878194a74 service nova] [instance: f9be53df-54e6-4f59-9cef-0ba7434f0c29] Received unexpected event network-vif-plugged-175b56ab-750b-4dbf-a981-2a32d749d445 for instance with vm_state shelved_offloaded and task_state spawning.
Nov 29 18:02:47 user nova-compute[74613]: DEBUG nova.compute.manager [None req-b80f692d-3bff-4df4-90e6-d1cff53e4da7 tempest-AttachVolumeShelveTestJSON-1452861425 tempest-AttachVolumeShelveTestJSON-1452861425-project-member] [instance: f9be53df-54e6-4f59-9cef-0ba7434f0c29] Checking state {{(pid=74613) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 29 18:02:47 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-b80f692d-3bff-4df4-90e6-d1cff53e4da7 tempest-AttachVolumeShelveTestJSON-1452861425 tempest-AttachVolumeShelveTestJSON-1452861425-project-member] Lock "f9be53df-54e6-4f59-9cef-0ba7434f0c29" "released" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: held 10.195s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 18:02:48 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:02:50 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:02:53 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:02:53 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:02:55 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:02:56 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:02:58 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-6ac3a70e-0d16-4a1e-bce9-4a3ccdb0e944 tempest-ServerActionsTestOtherA-1784608629 tempest-ServerActionsTestOtherA-1784608629-project-member] Acquiring lock "e9acfa30-4ec2-4540-ac34-4c66db3228e1" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 18:02:58 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-6ac3a70e-0d16-4a1e-bce9-4a3ccdb0e944 tempest-ServerActionsTestOtherA-1784608629 tempest-ServerActionsTestOtherA-1784608629-project-member] Lock "e9acfa30-4ec2-4540-ac34-4c66db3228e1" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 18:02:58 user nova-compute[74613]: DEBUG nova.compute.manager [None req-6ac3a70e-0d16-4a1e-bce9-4a3ccdb0e944 tempest-ServerActionsTestOtherA-1784608629 tempest-ServerActionsTestOtherA-1784608629-project-member] [instance: e9acfa30-4ec2-4540-ac34-4c66db3228e1] Starting instance... {{(pid=74613) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 29 18:02:58 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-6ac3a70e-0d16-4a1e-bce9-4a3ccdb0e944 tempest-ServerActionsTestOtherA-1784608629 tempest-ServerActionsTestOtherA-1784608629-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 18:02:58 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-6ac3a70e-0d16-4a1e-bce9-4a3ccdb0e944 tempest-ServerActionsTestOtherA-1784608629 tempest-ServerActionsTestOtherA-1784608629-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 18:02:58 user nova-compute[74613]: DEBUG nova.virt.hardware [None req-6ac3a70e-0d16-4a1e-bce9-4a3ccdb0e944 tempest-ServerActionsTestOtherA-1784608629 tempest-ServerActionsTestOtherA-1784608629-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74613) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 29 18:02:58 user nova-compute[74613]: INFO nova.compute.claims [None req-6ac3a70e-0d16-4a1e-bce9-4a3ccdb0e944 tempest-ServerActionsTestOtherA-1784608629 tempest-ServerActionsTestOtherA-1784608629-project-member] [instance: e9acfa30-4ec2-4540-ac34-4c66db3228e1] Claim successful on node user
Nov 29 18:02:58 user nova-compute[74613]: DEBUG nova.compute.provider_tree [None req-6ac3a70e-0d16-4a1e-bce9-4a3ccdb0e944 tempest-ServerActionsTestOtherA-1784608629 tempest-ServerActionsTestOtherA-1784608629-project-member] Inventory has not changed in ProviderTree for provider: 639d980e-3b12-44b1-b8f4-1812416fa4dd {{(pid=74613) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 18:02:58 user nova-compute[74613]: DEBUG nova.scheduler.client.report [None req-6ac3a70e-0d16-4a1e-bce9-4a3ccdb0e944 tempest-ServerActionsTestOtherA-1784608629 tempest-ServerActionsTestOtherA-1784608629-project-member] Inventory has not changed for provider 639d980e-3b12-44b1-b8f4-1812416fa4dd based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74613) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 18:02:58 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-6ac3a70e-0d16-4a1e-bce9-4a3ccdb0e944 tempest-ServerActionsTestOtherA-1784608629 tempest-ServerActionsTestOtherA-1784608629-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.430s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 18:02:58 user nova-compute[74613]: DEBUG nova.compute.manager [None req-6ac3a70e-0d16-4a1e-bce9-4a3ccdb0e944 tempest-ServerActionsTestOtherA-1784608629 tempest-ServerActionsTestOtherA-1784608629-project-member] [instance: e9acfa30-4ec2-4540-ac34-4c66db3228e1] Start building networks asynchronously for instance. {{(pid=74613) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 29 18:02:58 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:02:58 user nova-compute[74613]: DEBUG nova.compute.manager [None req-6ac3a70e-0d16-4a1e-bce9-4a3ccdb0e944 tempest-ServerActionsTestOtherA-1784608629 tempest-ServerActionsTestOtherA-1784608629-project-member] [instance: e9acfa30-4ec2-4540-ac34-4c66db3228e1] Allocating IP information in the background. {{(pid=74613) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 29 18:02:58 user nova-compute[74613]: DEBUG nova.network.neutron [None req-6ac3a70e-0d16-4a1e-bce9-4a3ccdb0e944 tempest-ServerActionsTestOtherA-1784608629 tempest-ServerActionsTestOtherA-1784608629-project-member] [instance: e9acfa30-4ec2-4540-ac34-4c66db3228e1] allocate_for_instance() {{(pid=74613) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 29 18:02:58 user nova-compute[74613]: INFO nova.virt.libvirt.driver [None req-6ac3a70e-0d16-4a1e-bce9-4a3ccdb0e944 tempest-ServerActionsTestOtherA-1784608629 tempest-ServerActionsTestOtherA-1784608629-project-member] [instance: e9acfa30-4ec2-4540-ac34-4c66db3228e1] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 29 18:02:58 user nova-compute[74613]: DEBUG nova.compute.manager [None req-6ac3a70e-0d16-4a1e-bce9-4a3ccdb0e944 tempest-ServerActionsTestOtherA-1784608629 tempest-ServerActionsTestOtherA-1784608629-project-member] [instance: e9acfa30-4ec2-4540-ac34-4c66db3228e1] Start building block device mappings for instance. {{(pid=74613) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 29 18:02:58 user nova-compute[74613]: INFO nova.virt.block_device [None req-6ac3a70e-0d16-4a1e-bce9-4a3ccdb0e944 tempest-ServerActionsTestOtherA-1784608629 tempest-ServerActionsTestOtherA-1784608629-project-member] [instance: e9acfa30-4ec2-4540-ac34-4c66db3228e1] Booting with volume a8c53a27-dcde-402b-a9bb-d8642f7db0da at /dev/vda
Nov 29 18:02:58 user nova-compute[74613]: DEBUG os_brick.utils [None req-6ac3a70e-0d16-4a1e-bce9-4a3ccdb0e944 tempest-ServerActionsTestOtherA-1784608629 tempest-ServerActionsTestOtherA-1784608629-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74613) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 18:02:58 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:02:58 user nova-compute[74613]: DEBUG nova.policy [None req-6ac3a70e-0d16-4a1e-bce9-4a3ccdb0e944 tempest-ServerActionsTestOtherA-1784608629 tempest-ServerActionsTestOtherA-1784608629-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '368555c72103480b82c5c0bf64b07360', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1f70c311d4941c986de21ac458d11ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74613) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 29 18:02:58 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:02:58 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9654636-4bf4-45bd-828c-847b9545c18e]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:400972819b5\n', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 18:02:58 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:02:58 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:02:58 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[44d7d456-1759-48da-a8ab-cfc8eb8dbbd5]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 18:02:58 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:02:58 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:02:58 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6e81b2b-e1a7-4b2a-b987-def64ac4555c]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 18:02:58 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[8879a4c6-0361-4dbf-aa40-9651b63566f5]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 18:02:58 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-6ac3a70e-0d16-4a1e-bce9-4a3ccdb0e944 tempest-ServerActionsTestOtherA-1784608629 tempest-ServerActionsTestOtherA-1784608629-project-member] Running cmd (subprocess): nvme version {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:02:58 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-6ac3a70e-0d16-4a1e-bce9-4a3ccdb0e944 tempest-ServerActionsTestOtherA-1784608629 tempest-ServerActionsTestOtherA-1784608629-project-member] 'nvme version' failed. Not Retrying. {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 18:02:58 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.nvmeof [None req-6ac3a70e-0d16-4a1e-bce9-4a3ccdb0e944 tempest-ServerActionsTestOtherA-1784608629 tempest-ServerActionsTestOtherA-1784608629-project-member] nvme not present on system {{(pid=74613) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 29 18:02:58 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:02:59 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 18:02:59 user nova-compute[74613]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 29 18:02:59 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a47bf36-df21-45a9-aefd-d757f2ec6b6c]: (4, '') {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 18:02:59 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.lightos [None req-6ac3a70e-0d16-4a1e-bce9-4a3ccdb0e944 tempest-ServerActionsTestOtherA-1784608629 tempest-ServerActionsTestOtherA-1784608629-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74613) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 29 18:02:59 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.lightos [None req-6ac3a70e-0d16-4a1e-bce9-4a3ccdb0e944 tempest-ServerActionsTestOtherA-1784608629 tempest-ServerActionsTestOtherA-1784608629-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74613) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 29 18:02:59 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.lightos [None req-6ac3a70e-0d16-4a1e-bce9-4a3ccdb0e944 tempest-ServerActionsTestOtherA-1784608629 tempest-ServerActionsTestOtherA-1784608629-project-member] LIGHTOS: no hostnqn found. {{(pid=74613) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 29 18:02:59 user nova-compute[74613]: DEBUG os_brick.utils [None req-6ac3a70e-0d16-4a1e-bce9-4a3ccdb0e944 tempest-ServerActionsTestOtherA-1784608629 tempest-ServerActionsTestOtherA-1784608629-project-member] <== get_connector_properties: return (136ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:400972819b5', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74613) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 18:02:59 user nova-compute[74613]: DEBUG nova.virt.block_device [None req-6ac3a70e-0d16-4a1e-bce9-4a3ccdb0e944 tempest-ServerActionsTestOtherA-1784608629 tempest-ServerActionsTestOtherA-1784608629-project-member] [instance: e9acfa30-4ec2-4540-ac34-4c66db3228e1] Updating existing volume attachment record: 13f1a99c-4574-4a6d-892e-da9cb279ddf4 {{(pid=74613) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 29 18:02:59 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:02:59 user nova-compute[74613]: DEBUG nova.network.neutron [None req-6ac3a70e-0d16-4a1e-bce9-4a3ccdb0e944 tempest-ServerActionsTestOtherA-1784608629 tempest-ServerActionsTestOtherA-1784608629-project-member] [instance: e9acfa30-4ec2-4540-ac34-4c66db3228e1] Successfully created port: 8cd31427-1812-40fb-8018-d8f24a5b1792 {{(pid=74613) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 29 18:03:00 user nova-compute[74613]: DEBUG nova.network.neutron [None req-6ac3a70e-0d16-4a1e-bce9-4a3ccdb0e944 tempest-ServerActionsTestOtherA-1784608629 tempest-ServerActionsTestOtherA-1784608629-project-member] [instance: e9acfa30-4ec2-4540-ac34-4c66db3228e1] Successfully updated port: 8cd31427-1812-40fb-8018-d8f24a5b1792 {{(pid=74613) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 29 18:03:00 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-6ac3a70e-0d16-4a1e-bce9-4a3ccdb0e944 tempest-ServerActionsTestOtherA-1784608629 tempest-ServerActionsTestOtherA-1784608629-project-member] Acquiring lock "refresh_cache-e9acfa30-4ec2-4540-ac34-4c66db3228e1" {{(pid=74613) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 18:03:00 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-6ac3a70e-0d16-4a1e-bce9-4a3ccdb0e944 tempest-ServerActionsTestOtherA-1784608629 tempest-ServerActionsTestOtherA-1784608629-project-member] Acquired lock "refresh_cache-e9acfa30-4ec2-4540-ac34-4c66db3228e1" {{(pid=74613) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 18:03:00 user nova-compute[74613]: DEBUG nova.network.neutron [None req-6ac3a70e-0d16-4a1e-bce9-4a3ccdb0e944 tempest-ServerActionsTestOtherA-1784608629 tempest-ServerActionsTestOtherA-1784608629-project-member] [instance: e9acfa30-4ec2-4540-ac34-4c66db3228e1] Building network info cache for instance {{(pid=74613) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 29 18:03:00 user nova-compute[74613]: DEBUG nova.compute.manager [req-4bb43fe3-ea41-48f9-a2e3-b424aeb25363 req-bb21e097-f7f9-4919-a62a-0682f6ab9143 service nova] [instance: e9acfa30-4ec2-4540-ac34-4c66db3228e1] Received event network-changed-8cd31427-1812-40fb-8018-d8f24a5b1792 {{(pid=74613) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 18:03:00 user nova-compute[74613]: DEBUG nova.compute.manager [req-4bb43fe3-ea41-48f9-a2e3-b424aeb25363 req-bb21e097-f7f9-4919-a62a-0682f6ab9143 service nova] [instance: e9acfa30-4ec2-4540-ac34-4c66db3228e1] Refreshing instance network info cache due to event network-changed-8cd31427-1812-40fb-8018-d8f24a5b1792. {{(pid=74613) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 18:03:00 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-4bb43fe3-ea41-48f9-a2e3-b424aeb25363 req-bb21e097-f7f9-4919-a62a-0682f6ab9143 service nova] Acquiring lock "refresh_cache-e9acfa30-4ec2-4540-ac34-4c66db3228e1" {{(pid=74613) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 18:03:00 user nova-compute[74613]: DEBUG nova.network.neutron [None req-6ac3a70e-0d16-4a1e-bce9-4a3ccdb0e944 tempest-ServerActionsTestOtherA-1784608629 tempest-ServerActionsTestOtherA-1784608629-project-member] [instance: e9acfa30-4ec2-4540-ac34-4c66db3228e1] Instance cache missing network info. {{(pid=74613) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 29 18:03:01 user nova-compute[74613]: DEBUG nova.network.neutron [None req-6ac3a70e-0d16-4a1e-bce9-4a3ccdb0e944 tempest-ServerActionsTestOtherA-1784608629 tempest-ServerActionsTestOtherA-1784608629-project-member] [instance: e9acfa30-4ec2-4540-ac34-4c66db3228e1] Updating instance_info_cache with network_info: [{"id": "8cd31427-1812-40fb-8018-d8f24a5b1792", "address": "fa:16:3e:97:0e:ed", "network": {"id": "7c2c368e-4c7d-4d70-9a40-c10fe9541af9", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1287934102-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b1f70c311d4941c986de21ac458d11ab", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8cd31427-18", "ovs_interfaceid": "8cd31427-1812-40fb-8018-d8f24a5b1792", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74613) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 18:03:01 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-6ac3a70e-0d16-4a1e-bce9-4a3ccdb0e944 tempest-ServerActionsTestOtherA-1784608629 tempest-ServerActionsTestOtherA-1784608629-project-member] Releasing lock "refresh_cache-e9acfa30-4ec2-4540-ac34-4c66db3228e1" {{(pid=74613) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 18:03:01 user nova-compute[74613]: DEBUG nova.compute.manager [None req-6ac3a70e-0d16-4a1e-bce9-4a3ccdb0e944 tempest-ServerActionsTestOtherA-1784608629 tempest-ServerActionsTestOtherA-1784608629-project-member] [instance: e9acfa30-4ec2-4540-ac34-4c66db3228e1] Instance network_info: |[{"id": "8cd31427-1812-40fb-8018-d8f24a5b1792", "address": "fa:16:3e:97:0e:ed", "network": {"id": "7c2c368e-4c7d-4d70-9a40-c10fe9541af9", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1287934102-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b1f70c311d4941c986de21ac458d11ab", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8cd31427-18", "ovs_interfaceid": "8cd31427-1812-40fb-8018-d8f24a5b1792", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74613) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 29 18:03:01 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-4bb43fe3-ea41-48f9-a2e3-b424aeb25363 req-bb21e097-f7f9-4919-a62a-0682f6ab9143 service nova] Acquired lock "refresh_cache-e9acfa30-4ec2-4540-ac34-4c66db3228e1" {{(pid=74613) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 18:03:01 user nova-compute[74613]: DEBUG nova.network.neutron [req-4bb43fe3-ea41-48f9-a2e3-b424aeb25363 req-bb21e097-f7f9-4919-a62a-0682f6ab9143 service nova] [instance: e9acfa30-4ec2-4540-ac34-4c66db3228e1] Refreshing network info cache for port 8cd31427-1812-40fb-8018-d8f24a5b1792 {{(pid=74613) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 18:03:01 user nova-compute[74613]: DEBUG nova.network.neutron [req-4bb43fe3-ea41-48f9-a2e3-b424aeb25363 req-bb21e097-f7f9-4919-a62a-0682f6ab9143 service nova] [instance: e9acfa30-4ec2-4540-ac34-4c66db3228e1] Updated VIF entry in instance network info cache for port 8cd31427-1812-40fb-8018-d8f24a5b1792. {{(pid=74613) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 18:03:01 user nova-compute[74613]: DEBUG nova.network.neutron [req-4bb43fe3-ea41-48f9-a2e3-b424aeb25363 req-bb21e097-f7f9-4919-a62a-0682f6ab9143 service nova] [instance: e9acfa30-4ec2-4540-ac34-4c66db3228e1] Updating instance_info_cache with network_info: [{"id": "8cd31427-1812-40fb-8018-d8f24a5b1792", "address": "fa:16:3e:97:0e:ed", "network": {"id": "7c2c368e-4c7d-4d70-9a40-c10fe9541af9", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1287934102-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b1f70c311d4941c986de21ac458d11ab", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8cd31427-18", "ovs_interfaceid": "8cd31427-1812-40fb-8018-d8f24a5b1792", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74613) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 18:03:01 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-4bb43fe3-ea41-48f9-a2e3-b424aeb25363 req-bb21e097-f7f9-4919-a62a-0682f6ab9143 service nova] Releasing lock "refresh_cache-e9acfa30-4ec2-4540-ac34-4c66db3228e1" {{(pid=74613) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 18:03:02 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:03:03 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:03:05 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:03:05 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:03:06 user nova-compute[74613]: DEBUG nova.compute.manager [None req-6ac3a70e-0d16-4a1e-bce9-4a3ccdb0e944 tempest-ServerActionsTestOtherA-1784608629 tempest-ServerActionsTestOtherA-1784608629-project-member] [instance: e9acfa30-4ec2-4540-ac34-4c66db3228e1] Start spawning the instance on the hypervisor. {{(pid=74613) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 29 18:03:06 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-6ac3a70e-0d16-4a1e-bce9-4a3ccdb0e944 tempest-ServerActionsTestOtherA-1784608629 tempest-ServerActionsTestOtherA-1784608629-project-member] [instance: e9acfa30-4ec2-4540-ac34-4c66db3228e1] Creating instance directory {{(pid=74613) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 29 18:03:06 user nova-compute[74613]: INFO nova.virt.libvirt.driver [None req-6ac3a70e-0d16-4a1e-bce9-4a3ccdb0e944 tempest-ServerActionsTestOtherA-1784608629 tempest-ServerActionsTestOtherA-1784608629-project-member] [instance: e9acfa30-4ec2-4540-ac34-4c66db3228e1] Creating image(s)
Nov 29 18:03:06 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-6ac3a70e-0d16-4a1e-bce9-4a3ccdb0e944 tempest-ServerActionsTestOtherA-1784608629 tempest-ServerActionsTestOtherA-1784608629-project-member] [instance: e9acfa30-4ec2-4540-ac34-4c66db3228e1] Did not create local disks {{(pid=74613) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 29 18:03:06 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-6ac3a70e-0d16-4a1e-bce9-4a3ccdb0e944 tempest-ServerActionsTestOtherA-1784608629 tempest-ServerActionsTestOtherA-1784608629-project-member] [instance: e9acfa30-4ec2-4540-ac34-4c66db3228e1] Ensure instance console log exists: /opt/stack/data/nova/instances/e9acfa30-4ec2-4540-ac34-4c66db3228e1/console.log {{(pid=74613) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 29 18:03:06 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-6ac3a70e-0d16-4a1e-bce9-4a3ccdb0e944 tempest-ServerActionsTestOtherA-1784608629 tempest-ServerActionsTestOtherA-1784608629-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 18:03:06 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-6ac3a70e-0d16-4a1e-bce9-4a3ccdb0e944 tempest-ServerActionsTestOtherA-1784608629 tempest-ServerActionsTestOtherA-1784608629-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 18:03:06 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-6ac3a70e-0d16-4a1e-bce9-4a3ccdb0e944 tempest-ServerActionsTestOtherA-1784608629 tempest-ServerActionsTestOtherA-1784608629-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 18:03:06 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-6ac3a70e-0d16-4a1e-bce9-4a3ccdb0e944 tempest-ServerActionsTestOtherA-1784608629 tempest-ServerActionsTestOtherA-1784608629-project-member] [instance: e9acfa30-4ec2-4540-ac34-4c66db3228e1] Start _get_guest_xml network_info=[{"id": "8cd31427-1812-40fb-8018-d8f24a5b1792", "address": "fa:16:3e:97:0e:ed", "network": {"id": "7c2c368e-4c7d-4d70-9a40-c10fe9541af9", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1287934102-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b1f70c311d4941c986de21ac458d11ab", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8cd31427-18", "ovs_interfaceid": "8cd31427-1812-40fb-8018-d8f24a5b1792", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:a8c53a27-dcde-402b-a9bb-d8642f7db0da', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'SLOlKdrc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'e9acfa30-4ec2-4540-ac34-4c66db3228e1', 'attached_at': '', 'detached_at': '', 'volume_id': 'a8c53a27-dcde-402b-a9bb-d8642f7db0da', 'serial': 'a8c53a27-dcde-402b-a9bb-d8642f7db0da'}, 'mount_device': '/dev/vda', 'delete_on_termination': True, 'device_type': 'disk', 'boot_index': 0, 'guest_format': None, 'attachment_id': '13f1a99c-4574-4a6d-892e-da9cb279ddf4', 'disk_bus': 'virtio', 'volume_type': None} {{(pid=74613) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 29 18:03:06 user nova-compute[74613]: WARNING nova.virt.libvirt.driver [None req-6ac3a70e-0d16-4a1e-bce9-4a3ccdb0e944 tempest-ServerActionsTestOtherA-1784608629 tempest-ServerActionsTestOtherA-1784608629-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 18:03:06 user nova-compute[74613]: WARNING nova.virt.libvirt.driver [None req-6ac3a70e-0d16-4a1e-bce9-4a3ccdb0e944 tempest-ServerActionsTestOtherA-1784608629 tempest-ServerActionsTestOtherA-1784608629-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 18:03:06 user nova-compute[74613]: DEBUG nova.virt.libvirt.host [None req-6ac3a70e-0d16-4a1e-bce9-4a3ccdb0e944 tempest-ServerActionsTestOtherA-1784608629 tempest-ServerActionsTestOtherA-1784608629-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74613) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 29 18:03:06 user nova-compute[74613]: DEBUG nova.virt.libvirt.host [None req-6ac3a70e-0d16-4a1e-bce9-4a3ccdb0e944 tempest-ServerActionsTestOtherA-1784608629 tempest-ServerActionsTestOtherA-1784608629-project-member] CPU controller missing on host. {{(pid=74613) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 29 18:03:06 user nova-compute[74613]: DEBUG nova.virt.libvirt.host [None req-6ac3a70e-0d16-4a1e-bce9-4a3ccdb0e944 tempest-ServerActionsTestOtherA-1784608629 tempest-ServerActionsTestOtherA-1784608629-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74613) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 29 18:03:06 user nova-compute[74613]: DEBUG nova.virt.libvirt.host [None req-6ac3a70e-0d16-4a1e-bce9-4a3ccdb0e944 tempest-ServerActionsTestOtherA-1784608629 tempest-ServerActionsTestOtherA-1784608629-project-member] CPU controller found on host. {{(pid=74613) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 29 18:03:06 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-6ac3a70e-0d16-4a1e-bce9-4a3ccdb0e944 tempest-ServerActionsTestOtherA-1784608629 tempest-ServerActionsTestOtherA-1784608629-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74613) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 29 18:03:06 user nova-compute[74613]: DEBUG nova.virt.hardware [None req-6ac3a70e-0d16-4a1e-bce9-4a3ccdb0e944 tempest-ServerActionsTestOtherA-1784608629 tempest-ServerActionsTestOtherA-1784608629-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-29T17:47:27Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74613) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 29 18:03:06 user nova-compute[74613]: DEBUG nova.virt.hardware [None req-6ac3a70e-0d16-4a1e-bce9-4a3ccdb0e944 tempest-ServerActionsTestOtherA-1784608629 tempest-ServerActionsTestOtherA-1784608629-project-member] Flavor limits 0:0:0 {{(pid=74613) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 29 18:03:06 user nova-compute[74613]: DEBUG nova.virt.hardware [None req-6ac3a70e-0d16-4a1e-bce9-4a3ccdb0e944 tempest-ServerActionsTestOtherA-1784608629 tempest-ServerActionsTestOtherA-1784608629-project-member] Image limits 0:0:0 {{(pid=74613) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 29 18:03:06 user nova-compute[74613]: DEBUG nova.virt.hardware [None req-6ac3a70e-0d16-4a1e-bce9-4a3ccdb0e944 tempest-ServerActionsTestOtherA-1784608629 tempest-ServerActionsTestOtherA-1784608629-project-member] Flavor pref 0:0:0 {{(pid=74613) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 29 18:03:06 user nova-compute[74613]: DEBUG nova.virt.hardware [None req-6ac3a70e-0d16-4a1e-bce9-4a3ccdb0e944 tempest-ServerActionsTestOtherA-1784608629 tempest-ServerActionsTestOtherA-1784608629-project-member] Image pref 0:0:0 {{(pid=74613) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 29 18:03:06 user nova-compute[74613]: DEBUG nova.virt.hardware [None req-6ac3a70e-0d16-4a1e-bce9-4a3ccdb0e944 tempest-ServerActionsTestOtherA-1784608629 tempest-ServerActionsTestOtherA-1784608629-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74613) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 29 18:03:06 user nova-compute[74613]: DEBUG nova.virt.hardware [None req-6ac3a70e-0d16-4a1e-bce9-4a3ccdb0e944 tempest-ServerActionsTestOtherA-1784608629 tempest-ServerActionsTestOtherA-1784608629-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74613) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 29 18:03:06 user nova-compute[74613]: DEBUG nova.virt.hardware [None req-6ac3a70e-0d16-4a1e-bce9-4a3ccdb0e944 tempest-ServerActionsTestOtherA-1784608629 tempest-ServerActionsTestOtherA-1784608629-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74613) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 29 18:03:06 user nova-compute[74613]: DEBUG nova.virt.hardware [None req-6ac3a70e-0d16-4a1e-bce9-4a3ccdb0e944 tempest-ServerActionsTestOtherA-1784608629 tempest-ServerActionsTestOtherA-1784608629-project-member] Got 1 possible topologies {{(pid=74613) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 29 18:03:06 user nova-compute[74613]: DEBUG nova.virt.hardware [None req-6ac3a70e-0d16-4a1e-bce9-4a3ccdb0e944 tempest-ServerActionsTestOtherA-1784608629 tempest-ServerActionsTestOtherA-1784608629-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74613) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 29 18:03:06 user nova-compute[74613]: DEBUG nova.virt.hardware [None req-6ac3a70e-0d16-4a1e-bce9-4a3ccdb0e944 tempest-ServerActionsTestOtherA-1784608629 tempest-ServerActionsTestOtherA-1784608629-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74613) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 29 18:03:06 user nova-compute[74613]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6ac3a70e-0d16-4a1e-bce9-4a3ccdb0e944 tempest-ServerActionsTestOtherA-1784608629 tempest-ServerActionsTestOtherA-1784608629-project-member] [instance: e9acfa30-4ec2-4540-ac34-4c66db3228e1] Calling os-brick to attach iSCSI Volume {{(pid=74613) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 29 18:03:06 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ac3a70e-0d16-4a1e-bce9-4a3ccdb0e944 tempest-ServerActionsTestOtherA-1784608629 tempest-ServerActionsTestOtherA-1784608629-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff828156890>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:a8c53a27-dcde-402b-a9bb-d8642f7db0da', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'SLOlKdrc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74613) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 18:03:06 user nova-compute[74613]: WARNING os_brick.initiator.connectors.base [None req-6ac3a70e-0d16-4a1e-bce9-4a3ccdb0e944 tempest-ServerActionsTestOtherA-1784608629 tempest-ServerActionsTestOtherA-1784608629-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 18:03:06 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.base [None req-6ac3a70e-0d16-4a1e-bce9-4a3ccdb0e944 tempest-ServerActionsTestOtherA-1784608629 tempest-ServerActionsTestOtherA-1784608629-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 18:03:06 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.base [None req-6ac3a70e-0d16-4a1e-bce9-4a3ccdb0e944 tempest-ServerActionsTestOtherA-1784608629 tempest-ServerActionsTestOtherA-1784608629-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 18:03:06 user nova-compute[74613]: WARNING os_brick.initiator.connectors.base [None req-6ac3a70e-0d16-4a1e-bce9-4a3ccdb0e944 tempest-ServerActionsTestOtherA-1784608629 tempest-ServerActionsTestOtherA-1784608629-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 18:03:06 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.base [None req-6ac3a70e-0d16-4a1e-bce9-4a3ccdb0e944 tempest-ServerActionsTestOtherA-1784608629 tempest-ServerActionsTestOtherA-1784608629-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a8c53a27-dcde-402b-a9bb-d8642f7db0da" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 18:03:06 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.base [None req-6ac3a70e-0d16-4a1e-bce9-4a3ccdb0e944 tempest-ServerActionsTestOtherA-1784608629 tempest-ServerActionsTestOtherA-1784608629-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a8c53a27-dcde-402b-a9bb-d8642f7db0da" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 18:03:06 user nova-compute[74613]: INFO os_brick.initiator.connectors.iscsi [None req-6ac3a70e-0d16-4a1e-bce9-4a3ccdb0e944 tempest-ServerActionsTestOtherA-1784608629 tempest-ServerActionsTestOtherA-1784608629-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 29 18:03:06 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a8c53a27-dcde-402b-a9bb-d8642f7db0da -p 172.16.0.220:3260 {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:03:06 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a8c53a27-dcde-402b-a9bb-d8642f7db0da -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:03:06 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f2b3f2e-1674-4f6e-adb6-ab18b7138c2f]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 18:03:06 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ac3a70e-0d16-4a1e-bce9-4a3ccdb0e944 tempest-ServerActionsTestOtherA-1784608629 tempest-ServerActionsTestOtherA-1784608629-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 29 18:03:06 user nova-compute[74613]:  {{(pid=74613) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 18:03:06 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a8c53a27-dcde-402b-a9bb-d8642f7db0da -p 172.16.0.220:3260 --interface default --op new {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:03:07 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a8c53a27-dcde-402b-a9bb-d8642f7db0da -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:03:07 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[125f1988-185e-4741-80c9-395936f4f3f9]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a8c53a27-dcde-402b-a9bb-d8642f7db0da] added\n', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 18:03:07 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ac3a70e-0d16-4a1e-bce9-4a3ccdb0e944 tempest-ServerActionsTestOtherA-1784608629 tempest-ServerActionsTestOtherA-1784608629-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a8c53a27-dcde-402b-a9bb-d8642f7db0da] added
Nov 29 18:03:07 user nova-compute[74613]:  stderr= {{(pid=74613) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 18:03:07 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a8c53a27-dcde-402b-a9bb-d8642f7db0da -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:03:07 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a8c53a27-dcde-402b-a9bb-d8642f7db0da -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:03:07 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf995883-cbb5-4966-b56f-574b5d7b32c1]: (4, ('', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 18:03:07 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ac3a70e-0d16-4a1e-bce9-4a3ccdb0e944 tempest-ServerActionsTestOtherA-1784608629 tempest-ServerActionsTestOtherA-1784608629-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74613) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 18:03:07 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a8c53a27-dcde-402b-a9bb-d8642f7db0da -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:03:07 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a8c53a27-dcde-402b-a9bb-d8642f7db0da -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.024s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:03:07 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[15128c88-0090-43b9-bfcd-1b6a65d8fe2d]: (4, ('', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 18:03:07 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ac3a70e-0d16-4a1e-bce9-4a3ccdb0e944 tempest-ServerActionsTestOtherA-1784608629 tempest-ServerActionsTestOtherA-1784608629-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74613) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 18:03:07 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a8c53a27-dcde-402b-a9bb-d8642f7db0da -p 172.16.0.220:3260 --op update -n node.session.auth.username -v SLOlKdrc {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:03:07 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a8c53a27-dcde-402b-a9bb-d8642f7db0da -p 172.16.0.220:3260 --op update -n node.session.auth.username -v SLOlKdrc" returned: 0 in 0.022s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:03:07 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[72382314-5e08-445f-8ed5-83336ac1cdf9]: (4, ('', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 18:03:07 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ac3a70e-0d16-4a1e-bce9-4a3ccdb0e944 tempest-ServerActionsTestOtherA-1784608629 tempest-ServerActionsTestOtherA-1784608629-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'SLOlKdrc'): stdout= stderr= {{(pid=74613) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 18:03:07 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a8c53a27-dcde-402b-a9bb-d8642f7db0da -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:03:07 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a8c53a27-dcde-402b-a9bb-d8642f7db0da -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:03:07 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[00080d77-465f-4a91-a534-d26876812adb]: (4, ('', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 18:03:07 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ac3a70e-0d16-4a1e-bce9-4a3ccdb0e944 tempest-ServerActionsTestOtherA-1784608629 tempest-ServerActionsTestOtherA-1784608629-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74613) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 18:03:07 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:03:07 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:03:07 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[9686e7e5-2187-4114-b882-b494a719b80e]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9511387c-8772-40f2-bf2d-6b6387649e9f (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb526b54-3017-4f30-b5c7-88027b146d52 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:86badab9-1598-4740-a73c-ba9d48b37dce (non-flash)\n', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 18:03:07 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ac3a70e-0d16-4a1e-bce9-4a3ccdb0e944 tempest-ServerActionsTestOtherA-1784608629 tempest-ServerActionsTestOtherA-1784608629-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9511387c-8772-40f2-bf2d-6b6387649e9f (non-flash)
Nov 29 18:03:07 user nova-compute[74613]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb526b54-3017-4f30-b5c7-88027b146d52 (non-flash)
Nov 29 18:03:07 user nova-compute[74613]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:86badab9-1598-4740-a73c-ba9d48b37dce (non-flash)
Nov 29 18:03:07 user nova-compute[74613]:  stderr= {{(pid=74613) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 18:03:07 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ac3a70e-0d16-4a1e-bce9-4a3ccdb0e944 tempest-ServerActionsTestOtherA-1784608629 tempest-ServerActionsTestOtherA-1784608629-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9511387c-8772-40f2-bf2d-6b6387649e9f (non-flash)
Nov 29 18:03:07 user nova-compute[74613]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb526b54-3017-4f30-b5c7-88027b146d52 (non-flash)
Nov 29 18:03:07 user nova-compute[74613]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:86badab9-1598-4740-a73c-ba9d48b37dce (non-flash)
Nov 29 18:03:07 user nova-compute[74613]:  stderr= {{(pid=74613) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 18:03:07 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a8c53a27-dcde-402b-a9bb-d8642f7db0da -p 172.16.0.220:3260 --login {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:03:07 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a8c53a27-dcde-402b-a9bb-d8642f7db0da -p 172.16.0.220:3260 --login" returned: 0 in 0.069s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:03:07 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[0de1aa28-8581-4600-97cd-f2ba9ae4211b]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:a8c53a27-dcde-402b-a9bb-d8642f7db0da, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:a8c53a27-dcde-402b-a9bb-d8642f7db0da, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 18:03:07 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ac3a70e-0d16-4a1e-bce9-4a3ccdb0e944 tempest-ServerActionsTestOtherA-1784608629 tempest-ServerActionsTestOtherA-1784608629-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:a8c53a27-dcde-402b-a9bb-d8642f7db0da, portal: 172.16.0.220,3260]
Nov 29 18:03:07 user nova-compute[74613]: Login to [iface: default, target: iqn.2010-10.org.openstack:a8c53a27-dcde-402b-a9bb-d8642f7db0da, portal: 172.16.0.220,3260] successful.
Nov 29 18:03:07 user nova-compute[74613]:  stderr= {{(pid=74613) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 18:03:07 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a8c53a27-dcde-402b-a9bb-d8642f7db0da -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:03:07 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a8c53a27-dcde-402b-a9bb-d8642f7db0da -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.027s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:03:07 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce493a2b-65ab-4524-9694-6503869f5b3b]: (4, ('', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 18:03:07 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ac3a70e-0d16-4a1e-bce9-4a3ccdb0e944 tempest-ServerActionsTestOtherA-1784608629 tempest-ServerActionsTestOtherA-1784608629-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74613) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 18:03:07 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:03:07 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:03:07 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[defe0741-ba32-4cbe-bd92-0498c3a12163]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9511387c-8772-40f2-bf2d-6b6387649e9f (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb526b54-3017-4f30-b5c7-88027b146d52 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:86badab9-1598-4740-a73c-ba9d48b37dce (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8c53a27-dcde-402b-a9bb-d8642f7db0da (non-flash)\n', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 18:03:07 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ac3a70e-0d16-4a1e-bce9-4a3ccdb0e944 tempest-ServerActionsTestOtherA-1784608629 tempest-ServerActionsTestOtherA-1784608629-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9511387c-8772-40f2-bf2d-6b6387649e9f (non-flash)
Nov 29 18:03:07 user nova-compute[74613]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb526b54-3017-4f30-b5c7-88027b146d52 (non-flash)
Nov 29 18:03:07 user nova-compute[74613]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:86badab9-1598-4740-a73c-ba9d48b37dce (non-flash)
Nov 29 18:03:07 user nova-compute[74613]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8c53a27-dcde-402b-a9bb-d8642f7db0da (non-flash)
Nov 29 18:03:07 user nova-compute[74613]:  stderr= {{(pid=74613) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 18:03:07 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ac3a70e-0d16-4a1e-bce9-4a3ccdb0e944 tempest-ServerActionsTestOtherA-1784608629 tempest-ServerActionsTestOtherA-1784608629-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9511387c-8772-40f2-bf2d-6b6387649e9f (non-flash)
Nov 29 18:03:07 user nova-compute[74613]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb526b54-3017-4f30-b5c7-88027b146d52 (non-flash)
Nov 29 18:03:07 user nova-compute[74613]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:86badab9-1598-4740-a73c-ba9d48b37dce (non-flash)
Nov 29 18:03:07 user nova-compute[74613]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8c53a27-dcde-402b-a9bb-d8642f7db0da (non-flash)
Nov 29 18:03:07 user nova-compute[74613]:  stderr= {{(pid=74613) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 18:03:07 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.base [None req-6ac3a70e-0d16-4a1e-bce9-4a3ccdb0e944 tempest-ServerActionsTestOtherA-1784608629 tempest-ServerActionsTestOtherA-1784608629-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a8c53a27-dcde-402b-a9bb-d8642f7db0da" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.316s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 18:03:07 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ac3a70e-0d16-4a1e-bce9-4a3ccdb0e944 tempest-ServerActionsTestOtherA-1784608629 tempest-ServerActionsTestOtherA-1784608629-project-member] Connected to 172.16.0.220:3260 {{(pid=74613) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 29 18:03:07 user nova-compute[74613]: DEBUG os_brick.initiator.linuxscsi [None req-6ac3a70e-0d16-4a1e-bce9-4a3ccdb0e944 tempest-ServerActionsTestOtherA-1784608629 tempest-ServerActionsTestOtherA-1784608629-project-member] HCTL ('36', '-', '-', 0) found on session 28 with lun 0 {{(pid=74613) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 29 18:03:07 user nova-compute[74613]: DEBUG os_brick.initiator.linuxscsi [None req-6ac3a70e-0d16-4a1e-bce9-4a3ccdb0e944 tempest-ServerActionsTestOtherA-1784608629 tempest-ServerActionsTestOtherA-1784608629-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=74613) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 29 18:03:07 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:03:07 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.016s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:03:07 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[59397150-635c-4599-aacf-b935622d172e]: (4, ('- - 0', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 18:03:07 user nova-compute[74613]: DEBUG os_brick.initiator.linuxscsi [None req-6ac3a70e-0d16-4a1e-bce9-4a3ccdb0e944 tempest-ServerActionsTestOtherA-1784608629 tempest-ServerActionsTestOtherA-1784608629-project-member] Searching for a device in session 28 and hctl ['36', '*', '*', 0] yield: sde {{(pid=74613) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 29 18:03:07 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ac3a70e-0d16-4a1e-bce9-4a3ccdb0e944 tempest-ServerActionsTestOtherA-1784608629 tempest-ServerActionsTestOtherA-1784608629-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:a8c53a27-dcde-402b-a9bb-d8642f7db0da', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'SLOlKdrc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74613) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 29 18:03:08 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.base [None req-6ac3a70e-0d16-4a1e-bce9-4a3ccdb0e944 tempest-ServerActionsTestOtherA-1784608629 tempest-ServerActionsTestOtherA-1784608629-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.347s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 18:03:08 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ac3a70e-0d16-4a1e-bce9-4a3ccdb0e944 tempest-ServerActionsTestOtherA-1784608629 tempest-ServerActionsTestOtherA-1784608629-project-member] <== connect_volume: return (1349ms) {'type': 'block', 'scsi_wwn': '26236623632373761', 'path': '/dev/sde'} {{(pid=74613) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 18:03:08 user nova-compute[74613]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6ac3a70e-0d16-4a1e-bce9-4a3ccdb0e944 tempest-ServerActionsTestOtherA-1784608629 tempest-ServerActionsTestOtherA-1784608629-project-member] [instance: e9acfa30-4ec2-4540-ac34-4c66db3228e1] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26236623632373761', 'path': '/dev/sde'} {{(pid=74613) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 29 18:03:08 user nova-compute[74613]: DEBUG nova.virt.libvirt.vif [None req-6ac3a70e-0d16-4a1e-bce9-4a3ccdb0e944 tempest-ServerActionsTestOtherA-1784608629 tempest-ServerActionsTestOtherA-1784608629-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T18:02:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1745064093',display_name='tempest-ServerActionsTestOtherA-server-1745064093',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-1745064093',id=25,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIpucl9TdiuMtgo2HD8A0S0XK6/wskQQSBMcoxjyazAtLZUlGJCbAbNEhyc7Esm1yWePtzGTrNFIbg4z5HCtj+7HLtHc8+57P9i9m4iI8l/z1ZnWm+BWBA3bkBkjzP6q3Q==',key_name='tempest-keypair-1839431126',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b1f70c311d4941c986de21ac458d11ab',ramdisk_id='',reservation_id='r-cod9xl0z',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-1784608629',owner_user_name='tempest-ServerActionsTestOtherA-1784608629-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T18:02:59Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='368555c72103480b82c5c0bf64b07360',uuid=e9acfa30-4ec2-4540-ac34-4c66db3228e1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8cd31427-1812-40fb-8018-d8f24a5b1792", "address": "fa:16:3e:97:0e:ed", "network": {"id": "7c2c368e-4c7d-4d70-9a40-c10fe9541af9", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1287934102-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b1f70c311d4941c986de21ac458d11ab", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8cd31427-18", "ovs_interfaceid": "8cd31427-1812-40fb-8018-d8f24a5b1792", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74613) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 29 18:03:08 user nova-compute[74613]: DEBUG nova.network.os_vif_util [None req-6ac3a70e-0d16-4a1e-bce9-4a3ccdb0e944 tempest-ServerActionsTestOtherA-1784608629 tempest-ServerActionsTestOtherA-1784608629-project-member] Converting VIF {"id": "8cd31427-1812-40fb-8018-d8f24a5b1792", "address": "fa:16:3e:97:0e:ed", "network": {"id": "7c2c368e-4c7d-4d70-9a40-c10fe9541af9", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1287934102-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b1f70c311d4941c986de21ac458d11ab", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8cd31427-18", "ovs_interfaceid": "8cd31427-1812-40fb-8018-d8f24a5b1792", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74613) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 18:03:08 user nova-compute[74613]: DEBUG nova.network.os_vif_util [None req-6ac3a70e-0d16-4a1e-bce9-4a3ccdb0e944 tempest-ServerActionsTestOtherA-1784608629 tempest-ServerActionsTestOtherA-1784608629-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:97:0e:ed,bridge_name='br-int',has_traffic_filtering=True,id=8cd31427-1812-40fb-8018-d8f24a5b1792,network=Network(7c2c368e-4c7d-4d70-9a40-c10fe9541af9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8cd31427-18') {{(pid=74613) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 18:03:08 user nova-compute[74613]: DEBUG nova.objects.instance [None req-6ac3a70e-0d16-4a1e-bce9-4a3ccdb0e944 tempest-ServerActionsTestOtherA-1784608629 tempest-ServerActionsTestOtherA-1784608629-project-member] Lazy-loading 'pci_devices' on Instance uuid e9acfa30-4ec2-4540-ac34-4c66db3228e1 {{(pid=74613) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 18:03:08 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-6ac3a70e-0d16-4a1e-bce9-4a3ccdb0e944 tempest-ServerActionsTestOtherA-1784608629 tempest-ServerActionsTestOtherA-1784608629-project-member] [instance: e9acfa30-4ec2-4540-ac34-4c66db3228e1] End _get_guest_xml xml=<domain type="kvm">
Nov 29 18:03:08 user nova-compute[74613]:   <uuid>e9acfa30-4ec2-4540-ac34-4c66db3228e1</uuid>
Nov 29 18:03:08 user nova-compute[74613]:   <name>instance-00000019</name>
Nov 29 18:03:08 user nova-compute[74613]:   <memory>524288</memory>
Nov 29 18:03:08 user nova-compute[74613]:   <vcpu>1</vcpu>
Nov 29 18:03:08 user nova-compute[74613]:   <metadata>
Nov 29 18:03:08 user nova-compute[74613]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 29 18:03:08 user nova-compute[74613]:       <nova:package version="0.0.0"/>
Nov 29 18:03:08 user nova-compute[74613]:       <nova:name>tempest-ServerActionsTestOtherA-server-1745064093</nova:name>
Nov 29 18:03:08 user nova-compute[74613]:       <nova:creationTime>2023-11-29 18:03:06</nova:creationTime>
Nov 29 18:03:08 user nova-compute[74613]:       <nova:flavor name="m1.tiny">
Nov 29 18:03:08 user nova-compute[74613]:         <nova:memory>512</nova:memory>
Nov 29 18:03:08 user nova-compute[74613]:         <nova:disk>1</nova:disk>
Nov 29 18:03:08 user nova-compute[74613]:         <nova:swap>0</nova:swap>
Nov 29 18:03:08 user nova-compute[74613]:         <nova:ephemeral>0</nova:ephemeral>
Nov 29 18:03:08 user nova-compute[74613]:         <nova:vcpus>1</nova:vcpus>
Nov 29 18:03:08 user nova-compute[74613]:       </nova:flavor>
Nov 29 18:03:08 user nova-compute[74613]:       <nova:owner>
Nov 29 18:03:08 user nova-compute[74613]:         <nova:user uuid="368555c72103480b82c5c0bf64b07360">tempest-ServerActionsTestOtherA-1784608629-project-member</nova:user>
Nov 29 18:03:08 user nova-compute[74613]:         <nova:project uuid="b1f70c311d4941c986de21ac458d11ab">tempest-ServerActionsTestOtherA-1784608629</nova:project>
Nov 29 18:03:08 user nova-compute[74613]:       </nova:owner>
Nov 29 18:03:08 user nova-compute[74613]:       <nova:ports>
Nov 29 18:03:08 user nova-compute[74613]:         <nova:port uuid="8cd31427-1812-40fb-8018-d8f24a5b1792">
Nov 29 18:03:08 user nova-compute[74613]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Nov 29 18:03:08 user nova-compute[74613]:         </nova:port>
Nov 29 18:03:08 user nova-compute[74613]:       </nova:ports>
Nov 29 18:03:08 user nova-compute[74613]:     </nova:instance>
Nov 29 18:03:08 user nova-compute[74613]:   </metadata>
Nov 29 18:03:08 user nova-compute[74613]:   <sysinfo type="smbios">
Nov 29 18:03:08 user nova-compute[74613]:     <system>
Nov 29 18:03:08 user nova-compute[74613]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 29 18:03:08 user nova-compute[74613]:       <entry name="product">OpenStack Nova</entry>
Nov 29 18:03:08 user nova-compute[74613]:       <entry name="version">0.0.0</entry>
Nov 29 18:03:08 user nova-compute[74613]:       <entry name="serial">e9acfa30-4ec2-4540-ac34-4c66db3228e1</entry>
Nov 29 18:03:08 user nova-compute[74613]:       <entry name="uuid">e9acfa30-4ec2-4540-ac34-4c66db3228e1</entry>
Nov 29 18:03:08 user nova-compute[74613]:       <entry name="family">Virtual Machine</entry>
Nov 29 18:03:08 user nova-compute[74613]:     </system>
Nov 29 18:03:08 user nova-compute[74613]:   </sysinfo>
Nov 29 18:03:08 user nova-compute[74613]:   <os>
Nov 29 18:03:08 user nova-compute[74613]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 29 18:03:08 user nova-compute[74613]:     <boot dev="hd"/>
Nov 29 18:03:08 user nova-compute[74613]:     <smbios mode="sysinfo"/>
Nov 29 18:03:08 user nova-compute[74613]:   </os>
Nov 29 18:03:08 user nova-compute[74613]:   <features>
Nov 29 18:03:08 user nova-compute[74613]:     <acpi/>
Nov 29 18:03:08 user nova-compute[74613]:     <apic/>
Nov 29 18:03:08 user nova-compute[74613]:     <vmcoreinfo/>
Nov 29 18:03:08 user nova-compute[74613]:   </features>
Nov 29 18:03:08 user nova-compute[74613]:   <clock offset="utc">
Nov 29 18:03:08 user nova-compute[74613]:     <timer name="pit" tickpolicy="delay"/>
Nov 29 18:03:08 user nova-compute[74613]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 29 18:03:08 user nova-compute[74613]:     <timer name="hpet" present="no"/>
Nov 29 18:03:08 user nova-compute[74613]:   </clock>
Nov 29 18:03:08 user nova-compute[74613]:   <cpu mode="custom" match="exact">
Nov 29 18:03:08 user nova-compute[74613]:     <model>Nehalem</model>
Nov 29 18:03:08 user nova-compute[74613]:     <topology sockets="1" cores="1" threads="1"/>
Nov 29 18:03:08 user nova-compute[74613]:   </cpu>
Nov 29 18:03:08 user nova-compute[74613]:   <devices>
Nov 29 18:03:08 user nova-compute[74613]:     <disk type="block" device="disk">
Nov 29 18:03:08 user nova-compute[74613]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 18:03:08 user nova-compute[74613]:       <source dev="/dev/sde"/>
Nov 29 18:03:08 user nova-compute[74613]:       <target dev="vda" bus="virtio"/>
Nov 29 18:03:08 user nova-compute[74613]:       <serial>a8c53a27-dcde-402b-a9bb-d8642f7db0da</serial>
Nov 29 18:03:08 user nova-compute[74613]:     </disk>
Nov 29 18:03:08 user nova-compute[74613]:     <interface type="ethernet">
Nov 29 18:03:08 user nova-compute[74613]:       <mac address="fa:16:3e:97:0e:ed"/>
Nov 29 18:03:08 user nova-compute[74613]:       <model type="virtio"/>
Nov 29 18:03:08 user nova-compute[74613]:       <mtu size="1442"/>
Nov 29 18:03:08 user nova-compute[74613]:       <target dev="tap8cd31427-18"/>
Nov 29 18:03:08 user nova-compute[74613]:     </interface>
Nov 29 18:03:08 user nova-compute[74613]:     <serial type="pty">
Nov 29 18:03:08 user nova-compute[74613]:       <log file="/opt/stack/data/nova/instances/e9acfa30-4ec2-4540-ac34-4c66db3228e1/console.log" append="off"/>
Nov 29 18:03:08 user nova-compute[74613]:     </serial>
Nov 29 18:03:08 user nova-compute[74613]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 29 18:03:08 user nova-compute[74613]:     <video>
Nov 29 18:03:08 user nova-compute[74613]:       <model type="virtio"/>
Nov 29 18:03:08 user nova-compute[74613]:     </video>
Nov 29 18:03:08 user nova-compute[74613]:     <rng model="virtio">
Nov 29 18:03:08 user nova-compute[74613]:       <backend model="random">/dev/urandom</backend>
Nov 29 18:03:08 user nova-compute[74613]:     </rng>
Nov 29 18:03:08 user nova-compute[74613]:     <controller type="usb" index="0" model="none"/>
Nov 29 18:03:08 user nova-compute[74613]:     <memballoon model="virtio">
Nov 29 18:03:08 user nova-compute[74613]:       <stats period="10"/>
Nov 29 18:03:08 user nova-compute[74613]:     </memballoon>
Nov 29 18:03:08 user nova-compute[74613]:   </devices>
Nov 29 18:03:08 user nova-compute[74613]: </domain>
Nov 29 18:03:08 user nova-compute[74613]:  {{(pid=74613) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 29 18:03:08 user nova-compute[74613]: DEBUG nova.virt.libvirt.vif [None req-6ac3a70e-0d16-4a1e-bce9-4a3ccdb0e944 tempest-ServerActionsTestOtherA-1784608629 tempest-ServerActionsTestOtherA-1784608629-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T18:02:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1745064093',display_name='tempest-ServerActionsTestOtherA-server-1745064093',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-1745064093',id=25,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIpucl9TdiuMtgo2HD8A0S0XK6/wskQQSBMcoxjyazAtLZUlGJCbAbNEhyc7Esm1yWePtzGTrNFIbg4z5HCtj+7HLtHc8+57P9i9m4iI8l/z1ZnWm+BWBA3bkBkjzP6q3Q==',key_name='tempest-keypair-1839431126',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b1f70c311d4941c986de21ac458d11ab',ramdisk_id='',reservation_id='r-cod9xl0z',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-1784608629',owner_user_name='tempest-ServerActionsTestOtherA-1784608629-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T18:02:59Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='368555c72103480b82c5c0bf64b07360',uuid=e9acfa30-4ec2-4540-ac34-4c66db3228e1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8cd31427-1812-40fb-8018-d8f24a5b1792", "address": "fa:16:3e:97:0e:ed", "network": {"id": "7c2c368e-4c7d-4d70-9a40-c10fe9541af9", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1287934102-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b1f70c311d4941c986de21ac458d11ab", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8cd31427-18", "ovs_interfaceid": "8cd31427-1812-40fb-8018-d8f24a5b1792", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74613) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 29 18:03:08 user nova-compute[74613]: DEBUG nova.network.os_vif_util [None req-6ac3a70e-0d16-4a1e-bce9-4a3ccdb0e944 tempest-ServerActionsTestOtherA-1784608629 tempest-ServerActionsTestOtherA-1784608629-project-member] Converting VIF {"id": "8cd31427-1812-40fb-8018-d8f24a5b1792", "address": "fa:16:3e:97:0e:ed", "network": {"id": "7c2c368e-4c7d-4d70-9a40-c10fe9541af9", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1287934102-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b1f70c311d4941c986de21ac458d11ab", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8cd31427-18", "ovs_interfaceid": "8cd31427-1812-40fb-8018-d8f24a5b1792", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74613) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 18:03:08 user nova-compute[74613]: DEBUG nova.network.os_vif_util [None req-6ac3a70e-0d16-4a1e-bce9-4a3ccdb0e944 tempest-ServerActionsTestOtherA-1784608629 tempest-ServerActionsTestOtherA-1784608629-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:97:0e:ed,bridge_name='br-int',has_traffic_filtering=True,id=8cd31427-1812-40fb-8018-d8f24a5b1792,network=Network(7c2c368e-4c7d-4d70-9a40-c10fe9541af9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8cd31427-18') {{(pid=74613) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 18:03:08 user nova-compute[74613]: DEBUG os_vif [None req-6ac3a70e-0d16-4a1e-bce9-4a3ccdb0e944 tempest-ServerActionsTestOtherA-1784608629 tempest-ServerActionsTestOtherA-1784608629-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:97:0e:ed,bridge_name='br-int',has_traffic_filtering=True,id=8cd31427-1812-40fb-8018-d8f24a5b1792,network=Network(7c2c368e-4c7d-4d70-9a40-c10fe9541af9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8cd31427-18') {{(pid=74613) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 29 18:03:08 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:03:08 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74613) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 18:03:08 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74613) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 29 18:03:08 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:03:08 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'f65a5320-42e5-57de-9e64-ebdcb1f0eab8', '_type': 'linux-noop'}}, row=False) {{(pid=74613) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 18:03:08 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:03:08 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 18:03:08 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:03:08 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap8cd31427-18, may_exist=True, interface_attrs={}) {{(pid=74613) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 18:03:08 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap8cd31427-18, col_values=(('qos', UUID('4c7d16f1-3507-4294-a933-d7ce4664f5c4')),), if_exists=True) {{(pid=74613) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 18:03:08 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap8cd31427-18, col_values=(('external_ids', {'iface-id': '8cd31427-1812-40fb-8018-d8f24a5b1792', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:97:0e:ed', 'vm-uuid': 'e9acfa30-4ec2-4540-ac34-4c66db3228e1'}),), if_exists=True) {{(pid=74613) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 18:03:08 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:03:08 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 18:03:08 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:03:08 user nova-compute[74613]: INFO os_vif [None req-6ac3a70e-0d16-4a1e-bce9-4a3ccdb0e944 tempest-ServerActionsTestOtherA-1784608629 tempest-ServerActionsTestOtherA-1784608629-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:97:0e:ed,bridge_name='br-int',has_traffic_filtering=True,id=8cd31427-1812-40fb-8018-d8f24a5b1792,network=Network(7c2c368e-4c7d-4d70-9a40-c10fe9541af9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8cd31427-18')
Nov 29 18:03:08 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-6ac3a70e-0d16-4a1e-bce9-4a3ccdb0e944 tempest-ServerActionsTestOtherA-1784608629 tempest-ServerActionsTestOtherA-1784608629-project-member] No BDM found with device name vda, not building metadata. {{(pid=74613) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 18:03:08 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-6ac3a70e-0d16-4a1e-bce9-4a3ccdb0e944 tempest-ServerActionsTestOtherA-1784608629 tempest-ServerActionsTestOtherA-1784608629-project-member] No VIF found with MAC fa:16:3e:97:0e:ed, not building metadata {{(pid=74613) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 29 18:03:08 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-4a8e5087-4382-40fd-bc7d-7fdb2abfae22 tempest-VolumesSnapshotTestJSON-1388493826 tempest-VolumesSnapshotTestJSON-1388493826-project-member] Acquiring lock "6c2ea311-0404-4ecf-8086-65f65186f858" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 18:03:08 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-4a8e5087-4382-40fd-bc7d-7fdb2abfae22 tempest-VolumesSnapshotTestJSON-1388493826 tempest-VolumesSnapshotTestJSON-1388493826-project-member] Lock "6c2ea311-0404-4ecf-8086-65f65186f858" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 18:03:08 user nova-compute[74613]: INFO nova.compute.manager [None req-4a8e5087-4382-40fd-bc7d-7fdb2abfae22 tempest-VolumesSnapshotTestJSON-1388493826 tempest-VolumesSnapshotTestJSON-1388493826-project-member] [instance: 6c2ea311-0404-4ecf-8086-65f65186f858] Detaching volume 86badab9-1598-4740-a73c-ba9d48b37dce
Nov 29 18:03:08 user nova-compute[74613]: INFO nova.virt.block_device [None req-4a8e5087-4382-40fd-bc7d-7fdb2abfae22 tempest-VolumesSnapshotTestJSON-1388493826 tempest-VolumesSnapshotTestJSON-1388493826-project-member] [instance: 6c2ea311-0404-4ecf-8086-65f65186f858] Attempting to driver detach volume 86badab9-1598-4740-a73c-ba9d48b37dce from mountpoint /dev/vdb
Nov 29 18:03:08 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-4a8e5087-4382-40fd-bc7d-7fdb2abfae22 tempest-VolumesSnapshotTestJSON-1388493826 tempest-VolumesSnapshotTestJSON-1388493826-project-member] Attempting to detach device vdb from instance 6c2ea311-0404-4ecf-8086-65f65186f858 from the persistent domain config. {{(pid=74613) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 29 18:03:08 user nova-compute[74613]: DEBUG nova.virt.libvirt.guest [None req-4a8e5087-4382-40fd-bc7d-7fdb2abfae22 tempest-VolumesSnapshotTestJSON-1388493826 tempest-VolumesSnapshotTestJSON-1388493826-project-member] detach device xml: <disk type="block" device="disk">
Nov 29 18:03:08 user nova-compute[74613]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 18:03:08 user nova-compute[74613]:   <source dev="/dev/sdc"/>
Nov 29 18:03:08 user nova-compute[74613]:   <target dev="vdb" bus="virtio"/>
Nov 29 18:03:08 user nova-compute[74613]:   <serial>86badab9-1598-4740-a73c-ba9d48b37dce</serial>
Nov 29 18:03:08 user nova-compute[74613]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 29 18:03:08 user nova-compute[74613]: </disk>
Nov 29 18:03:08 user nova-compute[74613]:  {{(pid=74613) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 29 18:03:08 user nova-compute[74613]: INFO nova.virt.libvirt.driver [None req-4a8e5087-4382-40fd-bc7d-7fdb2abfae22 tempest-VolumesSnapshotTestJSON-1388493826 tempest-VolumesSnapshotTestJSON-1388493826-project-member] Successfully detached device vdb from instance 6c2ea311-0404-4ecf-8086-65f65186f858 from the persistent domain config.
Nov 29 18:03:08 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-4a8e5087-4382-40fd-bc7d-7fdb2abfae22 tempest-VolumesSnapshotTestJSON-1388493826 tempest-VolumesSnapshotTestJSON-1388493826-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 6c2ea311-0404-4ecf-8086-65f65186f858 from the live domain config. {{(pid=74613) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 29 18:03:08 user nova-compute[74613]: DEBUG nova.virt.libvirt.guest [None req-4a8e5087-4382-40fd-bc7d-7fdb2abfae22 tempest-VolumesSnapshotTestJSON-1388493826 tempest-VolumesSnapshotTestJSON-1388493826-project-member] detach device xml: <disk type="block" device="disk">
Nov 29 18:03:08 user nova-compute[74613]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 18:03:08 user nova-compute[74613]:   <source dev="/dev/sdc"/>
Nov 29 18:03:08 user nova-compute[74613]:   <target dev="vdb" bus="virtio"/>
Nov 29 18:03:08 user nova-compute[74613]:   <serial>86badab9-1598-4740-a73c-ba9d48b37dce</serial>
Nov 29 18:03:08 user nova-compute[74613]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 29 18:03:08 user nova-compute[74613]: </disk>
Nov 29 18:03:08 user nova-compute[74613]:  {{(pid=74613) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 29 18:03:08 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-70c3baf5-acec-44ca-b62e-42cb6ed6f073 tempest-VolumesSnapshotTestJSON-1388493826 tempest-VolumesSnapshotTestJSON-1388493826-project-member] Acquiring lock "6c2ea311-0404-4ecf-8086-65f65186f858" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 18:03:09 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-4a8e5087-4382-40fd-bc7d-7fdb2abfae22 tempest-VolumesSnapshotTestJSON-1388493826 tempest-VolumesSnapshotTestJSON-1388493826-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 6c2ea311-0404-4ecf-8086-65f65186f858 {{(pid=74613) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 29 18:03:10 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:03:10 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:03:10 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:03:10 user nova-compute[74613]: DEBUG nova.compute.manager [req-95974868-162d-4afd-a703-124bdf39ee3c req-c3181555-aa53-4859-a96d-0ee64763fe25 service nova] [instance: e9acfa30-4ec2-4540-ac34-4c66db3228e1] Received event network-vif-plugged-8cd31427-1812-40fb-8018-d8f24a5b1792 {{(pid=74613) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 18:03:10 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-95974868-162d-4afd-a703-124bdf39ee3c req-c3181555-aa53-4859-a96d-0ee64763fe25 service nova] Acquiring lock "e9acfa30-4ec2-4540-ac34-4c66db3228e1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 18:03:10 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-95974868-162d-4afd-a703-124bdf39ee3c req-c3181555-aa53-4859-a96d-0ee64763fe25 service nova] Lock "e9acfa30-4ec2-4540-ac34-4c66db3228e1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 18:03:10 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-95974868-162d-4afd-a703-124bdf39ee3c req-c3181555-aa53-4859-a96d-0ee64763fe25 service nova] Lock "e9acfa30-4ec2-4540-ac34-4c66db3228e1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 18:03:10 user nova-compute[74613]: DEBUG nova.compute.manager [req-95974868-162d-4afd-a703-124bdf39ee3c req-c3181555-aa53-4859-a96d-0ee64763fe25 service nova] [instance: e9acfa30-4ec2-4540-ac34-4c66db3228e1] No waiting events found dispatching network-vif-plugged-8cd31427-1812-40fb-8018-d8f24a5b1792 {{(pid=74613) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 18:03:10 user nova-compute[74613]: WARNING nova.compute.manager [req-95974868-162d-4afd-a703-124bdf39ee3c req-c3181555-aa53-4859-a96d-0ee64763fe25 service nova] [instance: e9acfa30-4ec2-4540-ac34-4c66db3228e1] Received unexpected event network-vif-plugged-8cd31427-1812-40fb-8018-d8f24a5b1792 for instance with vm_state building and task_state spawning.
Nov 29 18:03:10 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:03:10 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:03:10 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:03:11 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:03:12 user nova-compute[74613]: DEBUG nova.compute.manager [None req-6ac3a70e-0d16-4a1e-bce9-4a3ccdb0e944 tempest-ServerActionsTestOtherA-1784608629 tempest-ServerActionsTestOtherA-1784608629-project-member] [instance: e9acfa30-4ec2-4540-ac34-4c66db3228e1] Instance event wait completed in 0 seconds for  {{(pid=74613) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 29 18:03:12 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-6ac3a70e-0d16-4a1e-bce9-4a3ccdb0e944 tempest-ServerActionsTestOtherA-1784608629 tempest-ServerActionsTestOtherA-1784608629-project-member] [instance: e9acfa30-4ec2-4540-ac34-4c66db3228e1] Guest created on hypervisor {{(pid=74613) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 29 18:03:12 user nova-compute[74613]: INFO nova.virt.libvirt.driver [-] [instance: e9acfa30-4ec2-4540-ac34-4c66db3228e1] Instance spawned successfully.
Nov 29 18:03:12 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-6ac3a70e-0d16-4a1e-bce9-4a3ccdb0e944 tempest-ServerActionsTestOtherA-1784608629 tempest-ServerActionsTestOtherA-1784608629-project-member] [instance: e9acfa30-4ec2-4540-ac34-4c66db3228e1] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74613) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 29 18:03:12 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-6ac3a70e-0d16-4a1e-bce9-4a3ccdb0e944 tempest-ServerActionsTestOtherA-1784608629 tempest-ServerActionsTestOtherA-1784608629-project-member] [instance: e9acfa30-4ec2-4540-ac34-4c66db3228e1] Found default for hw_cdrom_bus of ide {{(pid=74613) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 18:03:12 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-6ac3a70e-0d16-4a1e-bce9-4a3ccdb0e944 tempest-ServerActionsTestOtherA-1784608629 tempest-ServerActionsTestOtherA-1784608629-project-member] [instance: e9acfa30-4ec2-4540-ac34-4c66db3228e1] Found default for hw_disk_bus of virtio {{(pid=74613) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 18:03:12 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-6ac3a70e-0d16-4a1e-bce9-4a3ccdb0e944 tempest-ServerActionsTestOtherA-1784608629 tempest-ServerActionsTestOtherA-1784608629-project-member] [instance: e9acfa30-4ec2-4540-ac34-4c66db3228e1] Found default for hw_input_bus of None {{(pid=74613) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 18:03:12 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-6ac3a70e-0d16-4a1e-bce9-4a3ccdb0e944 tempest-ServerActionsTestOtherA-1784608629 tempest-ServerActionsTestOtherA-1784608629-project-member] [instance: e9acfa30-4ec2-4540-ac34-4c66db3228e1] Found default for hw_pointer_model of None {{(pid=74613) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 18:03:12 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-6ac3a70e-0d16-4a1e-bce9-4a3ccdb0e944 tempest-ServerActionsTestOtherA-1784608629 tempest-ServerActionsTestOtherA-1784608629-project-member] [instance: e9acfa30-4ec2-4540-ac34-4c66db3228e1] Found default for hw_video_model of virtio {{(pid=74613) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 18:03:12 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-6ac3a70e-0d16-4a1e-bce9-4a3ccdb0e944 tempest-ServerActionsTestOtherA-1784608629 tempest-ServerActionsTestOtherA-1784608629-project-member] [instance: e9acfa30-4ec2-4540-ac34-4c66db3228e1] Found default for hw_vif_model of virtio {{(pid=74613) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 18:03:12 user nova-compute[74613]: INFO nova.compute.manager [None req-6ac3a70e-0d16-4a1e-bce9-4a3ccdb0e944 tempest-ServerActionsTestOtherA-1784608629 tempest-ServerActionsTestOtherA-1784608629-project-member] [instance: e9acfa30-4ec2-4540-ac34-4c66db3228e1] Took 5.43 seconds to spawn the instance on the hypervisor.
Nov 29 18:03:12 user nova-compute[74613]: DEBUG nova.compute.manager [None req-6ac3a70e-0d16-4a1e-bce9-4a3ccdb0e944 tempest-ServerActionsTestOtherA-1784608629 tempest-ServerActionsTestOtherA-1784608629-project-member] [instance: e9acfa30-4ec2-4540-ac34-4c66db3228e1] Checking state {{(pid=74613) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 29 18:03:12 user nova-compute[74613]: DEBUG nova.compute.manager [req-e889109f-9b94-4d52-b178-4ccc53fea66e req-bf0c5845-c626-49da-8faf-61759690bb3f service nova] [instance: e9acfa30-4ec2-4540-ac34-4c66db3228e1] Received event network-vif-plugged-8cd31427-1812-40fb-8018-d8f24a5b1792 {{(pid=74613) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 18:03:12 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-e889109f-9b94-4d52-b178-4ccc53fea66e req-bf0c5845-c626-49da-8faf-61759690bb3f service nova] Acquiring lock "e9acfa30-4ec2-4540-ac34-4c66db3228e1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 18:03:12 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-e889109f-9b94-4d52-b178-4ccc53fea66e req-bf0c5845-c626-49da-8faf-61759690bb3f service nova] Lock "e9acfa30-4ec2-4540-ac34-4c66db3228e1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 18:03:12 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-e889109f-9b94-4d52-b178-4ccc53fea66e req-bf0c5845-c626-49da-8faf-61759690bb3f service nova] Lock "e9acfa30-4ec2-4540-ac34-4c66db3228e1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 18:03:12 user nova-compute[74613]: DEBUG nova.compute.manager [req-e889109f-9b94-4d52-b178-4ccc53fea66e req-bf0c5845-c626-49da-8faf-61759690bb3f service nova] [instance: e9acfa30-4ec2-4540-ac34-4c66db3228e1] No waiting events found dispatching network-vif-plugged-8cd31427-1812-40fb-8018-d8f24a5b1792 {{(pid=74613) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 18:03:12 user nova-compute[74613]: WARNING nova.compute.manager [req-e889109f-9b94-4d52-b178-4ccc53fea66e req-bf0c5845-c626-49da-8faf-61759690bb3f service nova] [instance: e9acfa30-4ec2-4540-ac34-4c66db3228e1] Received unexpected event network-vif-plugged-8cd31427-1812-40fb-8018-d8f24a5b1792 for instance with vm_state building and task_state spawning.
Nov 29 18:03:12 user nova-compute[74613]: INFO nova.compute.manager [None req-6ac3a70e-0d16-4a1e-bce9-4a3ccdb0e944 tempest-ServerActionsTestOtherA-1784608629 tempest-ServerActionsTestOtherA-1784608629-project-member] [instance: e9acfa30-4ec2-4540-ac34-4c66db3228e1] Took 14.32 seconds to build instance.
Nov 29 18:03:12 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-6ac3a70e-0d16-4a1e-bce9-4a3ccdb0e944 tempest-ServerActionsTestOtherA-1784608629 tempest-ServerActionsTestOtherA-1784608629-project-member] Lock "e9acfa30-4ec2-4540-ac34-4c66db3228e1" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 14.433s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 18:03:13 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:03:13 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:03:13 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-29b00ed9-84f7-4ebc-8056-7f15d761e725 tempest-ServerActionsTestOtherB-894551005 tempest-ServerActionsTestOtherB-894551005-project-member] Acquiring lock "74ac9703-1cd7-4983-b7d4-c69b01fec7b2" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 18:03:13 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-29b00ed9-84f7-4ebc-8056-7f15d761e725 tempest-ServerActionsTestOtherB-894551005 tempest-ServerActionsTestOtherB-894551005-project-member] Lock "74ac9703-1cd7-4983-b7d4-c69b01fec7b2" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 18:03:13 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-29b00ed9-84f7-4ebc-8056-7f15d761e725 tempest-ServerActionsTestOtherB-894551005 tempest-ServerActionsTestOtherB-894551005-project-member] Acquiring lock "74ac9703-1cd7-4983-b7d4-c69b01fec7b2-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 18:03:13 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-29b00ed9-84f7-4ebc-8056-7f15d761e725 tempest-ServerActionsTestOtherB-894551005 tempest-ServerActionsTestOtherB-894551005-project-member] Lock "74ac9703-1cd7-4983-b7d4-c69b01fec7b2-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 18:03:13 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-29b00ed9-84f7-4ebc-8056-7f15d761e725 tempest-ServerActionsTestOtherB-894551005 tempest-ServerActionsTestOtherB-894551005-project-member] Lock "74ac9703-1cd7-4983-b7d4-c69b01fec7b2-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 18:03:13 user nova-compute[74613]: INFO nova.compute.manager [None req-29b00ed9-84f7-4ebc-8056-7f15d761e725 tempest-ServerActionsTestOtherB-894551005 tempest-ServerActionsTestOtherB-894551005-project-member] [instance: 74ac9703-1cd7-4983-b7d4-c69b01fec7b2] Terminating instance
Nov 29 18:03:13 user nova-compute[74613]: DEBUG nova.compute.manager [None req-29b00ed9-84f7-4ebc-8056-7f15d761e725 tempest-ServerActionsTestOtherB-894551005 tempest-ServerActionsTestOtherB-894551005-project-member] [instance: 74ac9703-1cd7-4983-b7d4-c69b01fec7b2] Start destroying the instance on the hypervisor. {{(pid=74613) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 29 18:03:13 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:03:13 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:03:13 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:03:13 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:03:14 user nova-compute[74613]: DEBUG nova.compute.manager [req-6ddd625c-4cce-44c2-8491-5d9268aa3eb1 req-ba658c33-76b2-4d19-962b-86758cbf5b6f service nova] [instance: 74ac9703-1cd7-4983-b7d4-c69b01fec7b2] Received event network-vif-unplugged-c63b6577-fb46-437a-95b3-8321fab45d0c {{(pid=74613) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 18:03:14 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-6ddd625c-4cce-44c2-8491-5d9268aa3eb1 req-ba658c33-76b2-4d19-962b-86758cbf5b6f service nova] Acquiring lock "74ac9703-1cd7-4983-b7d4-c69b01fec7b2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 18:03:14 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-6ddd625c-4cce-44c2-8491-5d9268aa3eb1 req-ba658c33-76b2-4d19-962b-86758cbf5b6f service nova] Lock "74ac9703-1cd7-4983-b7d4-c69b01fec7b2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 18:03:14 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-6ddd625c-4cce-44c2-8491-5d9268aa3eb1 req-ba658c33-76b2-4d19-962b-86758cbf5b6f service nova] Lock "74ac9703-1cd7-4983-b7d4-c69b01fec7b2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 18:03:14 user nova-compute[74613]: DEBUG nova.compute.manager [req-6ddd625c-4cce-44c2-8491-5d9268aa3eb1 req-ba658c33-76b2-4d19-962b-86758cbf5b6f service nova] [instance: 74ac9703-1cd7-4983-b7d4-c69b01fec7b2] No waiting events found dispatching network-vif-unplugged-c63b6577-fb46-437a-95b3-8321fab45d0c {{(pid=74613) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 18:03:14 user nova-compute[74613]: DEBUG nova.compute.manager [req-6ddd625c-4cce-44c2-8491-5d9268aa3eb1 req-ba658c33-76b2-4d19-962b-86758cbf5b6f service nova] [instance: 74ac9703-1cd7-4983-b7d4-c69b01fec7b2] Received event network-vif-unplugged-c63b6577-fb46-437a-95b3-8321fab45d0c for instance with task_state deleting. {{(pid=74613) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 29 18:03:14 user nova-compute[74613]: INFO nova.virt.libvirt.driver [-] [instance: 74ac9703-1cd7-4983-b7d4-c69b01fec7b2] Instance destroyed successfully.
Nov 29 18:03:14 user nova-compute[74613]: DEBUG nova.objects.instance [None req-29b00ed9-84f7-4ebc-8056-7f15d761e725 tempest-ServerActionsTestOtherB-894551005 tempest-ServerActionsTestOtherB-894551005-project-member] Lazy-loading 'resources' on Instance uuid 74ac9703-1cd7-4983-b7d4-c69b01fec7b2 {{(pid=74613) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 18:03:14 user nova-compute[74613]: DEBUG nova.virt.libvirt.vif [None req-29b00ed9-84f7-4ebc-8056-7f15d761e725 tempest-ServerActionsTestOtherB-894551005 tempest-ServerActionsTestOtherB-894551005-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T17:55:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-931769463',display_name='tempest-ServerActionsTestOtherB-server-931769463',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-931769463',id=14,image_ref='4217f428-8d9d-4ee1-9614-642d26d90c46',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBE0p3wmKXoOCABzKEPJ0MsHfAtC1JQfzjVn7a3OeQC65p309Te6g/AbiDIZbrFAX7j9aAJfq/HNC8gx1yP/V9/PHfR3o28o9EgbHEcoTtW/dEJGkpFGjjy+hrqfOfHYCnA==',key_name='tempest-keypair-464492783',keypairs=<?>,launch_index=0,launched_at=2023-11-29T18:00:41Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='b392ca87608940c0ae467318b66453b2',ramdisk_id='',reservation_id='r-0wzexjb0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='4217f428-8d9d-4ee1-9614-642d26d90c46',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherB-894551005',owner_user_name='tempest-ServerActionsTestOtherB-894551005-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-29T18:00:41Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1a6eb590fed440729b45b8db79eb7c2f',uuid=74ac9703-1cd7-4983-b7d4-c69b01fec7b2,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "c63b6577-fb46-437a-95b3-8321fab45d0c", "address": "fa:16:3e:c3:2e:71", "network": {"id": "e687ed60-2592-4836-b97e-0828527b1b9f", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1938956411-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.143", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b392ca87608940c0ae467318b66453b2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc63b6577-fb", "ovs_interfaceid": "c63b6577-fb46-437a-95b3-8321fab45d0c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74613) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 29 18:03:14 user nova-compute[74613]: DEBUG nova.network.os_vif_util [None req-29b00ed9-84f7-4ebc-8056-7f15d761e725 tempest-ServerActionsTestOtherB-894551005 tempest-ServerActionsTestOtherB-894551005-project-member] Converting VIF {"id": "c63b6577-fb46-437a-95b3-8321fab45d0c", "address": "fa:16:3e:c3:2e:71", "network": {"id": "e687ed60-2592-4836-b97e-0828527b1b9f", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1938956411-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.143", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b392ca87608940c0ae467318b66453b2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc63b6577-fb", "ovs_interfaceid": "c63b6577-fb46-437a-95b3-8321fab45d0c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74613) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 18:03:14 user nova-compute[74613]: DEBUG nova.network.os_vif_util [None req-29b00ed9-84f7-4ebc-8056-7f15d761e725 tempest-ServerActionsTestOtherB-894551005 tempest-ServerActionsTestOtherB-894551005-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:c3:2e:71,bridge_name='br-int',has_traffic_filtering=True,id=c63b6577-fb46-437a-95b3-8321fab45d0c,network=Network(e687ed60-2592-4836-b97e-0828527b1b9f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc63b6577-fb') {{(pid=74613) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 18:03:14 user nova-compute[74613]: DEBUG os_vif [None req-29b00ed9-84f7-4ebc-8056-7f15d761e725 tempest-ServerActionsTestOtherB-894551005 tempest-ServerActionsTestOtherB-894551005-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:c3:2e:71,bridge_name='br-int',has_traffic_filtering=True,id=c63b6577-fb46-437a-95b3-8321fab45d0c,network=Network(e687ed60-2592-4836-b97e-0828527b1b9f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc63b6577-fb') {{(pid=74613) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 29 18:03:14 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:03:14 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapc63b6577-fb, bridge=br-int, if_exists=True) {{(pid=74613) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 18:03:14 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:03:14 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:03:14 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:03:14 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=ef0bfeb2-3dc2-4f23-824b-d65673f07ee0) {{(pid=74613) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 18:03:14 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:03:14 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 18:03:14 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:03:14 user nova-compute[74613]: INFO os_vif [None req-29b00ed9-84f7-4ebc-8056-7f15d761e725 tempest-ServerActionsTestOtherB-894551005 tempest-ServerActionsTestOtherB-894551005-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:c3:2e:71,bridge_name='br-int',has_traffic_filtering=True,id=c63b6577-fb46-437a-95b3-8321fab45d0c,network=Network(e687ed60-2592-4836-b97e-0828527b1b9f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc63b6577-fb')
Nov 29 18:03:14 user nova-compute[74613]: DEBUG nova.virt.libvirt.volume.iscsi [None req-29b00ed9-84f7-4ebc-8056-7f15d761e725 tempest-ServerActionsTestOtherB-894551005 tempest-ServerActionsTestOtherB-894551005-project-member] [instance: 74ac9703-1cd7-4983-b7d4-c69b01fec7b2] calling os-brick to detach iSCSI Volume {{(pid=74613) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 29 18:03:14 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-29b00ed9-84f7-4ebc-8056-7f15d761e725 tempest-ServerActionsTestOtherB-894551005 tempest-ServerActionsTestOtherB-894551005-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff828156890>, {'target_iqn': 'iqn.2010-10.org.openstack:bb526b54-3017-4f30-b5c7-88027b146d52', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RtrxDocV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': True}}" {{(pid=74613) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 18:03:14 user nova-compute[74613]: WARNING os_brick.initiator.connectors.base [None req-29b00ed9-84f7-4ebc-8056-7f15d761e725 tempest-ServerActionsTestOtherB-894551005 tempest-ServerActionsTestOtherB-894551005-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 18:03:14 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.base [None req-29b00ed9-84f7-4ebc-8056-7f15d761e725 tempest-ServerActionsTestOtherB-894551005 tempest-ServerActionsTestOtherB-894551005-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 18:03:14 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.base [None req-29b00ed9-84f7-4ebc-8056-7f15d761e725 tempest-ServerActionsTestOtherB-894551005 tempest-ServerActionsTestOtherB-894551005-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 18:03:14 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:03:14 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.027s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:03:14 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[24e31a30-a650-4b74-8335-32d5135db053]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:9511387c-8772-40f2-bf2d-6b6387649e9f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:86badab9-1598-4740-a73c-ba9d48b37dce\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:bb526b54-3017-4f30-b5c7-88027b146d52\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a8c53a27-dcde-402b-a9bb-d8642f7db0da\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 18:03:14 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-29b00ed9-84f7-4ebc-8056-7f15d761e725 tempest-ServerActionsTestOtherB-894551005 tempest-ServerActionsTestOtherB-894551005-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 29 18:03:14 user nova-compute[74613]: No targets found.
Nov 29 18:03:14 user nova-compute[74613]: iSNS:
Nov 29 18:03:14 user nova-compute[74613]: No targets found.
Nov 29 18:03:14 user nova-compute[74613]: STATIC:
Nov 29 18:03:14 user nova-compute[74613]: Target: iqn.2010-10.org.openstack:9511387c-8772-40f2-bf2d-6b6387649e9f
Nov 29 18:03:14 user nova-compute[74613]:         Portal: 172.16.0.220:3260,-1
Nov 29 18:03:14 user nova-compute[74613]:                 Iface Name: default
Nov 29 18:03:14 user nova-compute[74613]: Target: iqn.2010-10.org.openstack:86badab9-1598-4740-a73c-ba9d48b37dce
Nov 29 18:03:14 user nova-compute[74613]:         Portal: 172.16.0.220:3260,-1
Nov 29 18:03:14 user nova-compute[74613]:                 Iface Name: default
Nov 29 18:03:14 user nova-compute[74613]: Target: iqn.2010-10.org.openstack:bb526b54-3017-4f30-b5c7-88027b146d52
Nov 29 18:03:14 user nova-compute[74613]:         Portal: 172.16.0.220:3260,-1
Nov 29 18:03:14 user nova-compute[74613]:                 Iface Name: default
Nov 29 18:03:14 user nova-compute[74613]: Target: iqn.2010-10.org.openstack:a8c53a27-dcde-402b-a9bb-d8642f7db0da
Nov 29 18:03:14 user nova-compute[74613]:         Portal: 172.16.0.220:3260,-1
Nov 29 18:03:14 user nova-compute[74613]:                 Iface Name: default
Nov 29 18:03:14 user nova-compute[74613]: FIRMWARE:
Nov 29 18:03:14 user nova-compute[74613]: No targets found.
Nov 29 18:03:14 user nova-compute[74613]:  stderr= {{(pid=74613) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 18:03:14 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-29b00ed9-84f7-4ebc-8056-7f15d761e725 tempest-ServerActionsTestOtherB-894551005 tempest-ServerActionsTestOtherB-894551005-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 29 18:03:14 user nova-compute[74613]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 29 18:03:14 user nova-compute[74613]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74613) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 29 18:03:14 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-29b00ed9-84f7-4ebc-8056-7f15d761e725 tempest-ServerActionsTestOtherB-894551005 tempest-ServerActionsTestOtherB-894551005-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:bb526b54-3017-4f30-b5c7-88027b146d52', 0)] {{(pid=74613) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 29 18:03:14 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:03:14 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.022s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:03:14 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf48b6ed-074c-4cad-988e-ca985736d862]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:86badab9-1598-4740-a73c-ba9d48b37dce\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9511387c-8772-40f2-bf2d-6b6387649e9f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a8c53a27-dcde-402b-a9bb-d8642f7db0da\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:bb526b54-3017-4f30-b5c7-88027b146d52\n', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 18:03:14 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:03:14 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:03:14 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a8a6490-7f13-46cf-b9bf-9453090ac309]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9511387c-8772-40f2-bf2d-6b6387649e9f (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb526b54-3017-4f30-b5c7-88027b146d52 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:86badab9-1598-4740-a73c-ba9d48b37dce (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8c53a27-dcde-402b-a9bb-d8642f7db0da (non-flash)\n', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 18:03:14 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-29b00ed9-84f7-4ebc-8056-7f15d761e725 tempest-ServerActionsTestOtherB-894551005 tempest-ServerActionsTestOtherB-894551005-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9511387c-8772-40f2-bf2d-6b6387649e9f (non-flash)
Nov 29 18:03:14 user nova-compute[74613]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb526b54-3017-4f30-b5c7-88027b146d52 (non-flash)
Nov 29 18:03:14 user nova-compute[74613]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:86badab9-1598-4740-a73c-ba9d48b37dce (non-flash)
Nov 29 18:03:14 user nova-compute[74613]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8c53a27-dcde-402b-a9bb-d8642f7db0da (non-flash)
Nov 29 18:03:14 user nova-compute[74613]:  stderr= {{(pid=74613) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 18:03:14 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-29b00ed9-84f7-4ebc-8056-7f15d761e725 tempest-ServerActionsTestOtherB-894551005 tempest-ServerActionsTestOtherB-894551005-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9511387c-8772-40f2-bf2d-6b6387649e9f (non-flash)
Nov 29 18:03:14 user nova-compute[74613]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb526b54-3017-4f30-b5c7-88027b146d52 (non-flash)
Nov 29 18:03:14 user nova-compute[74613]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:86badab9-1598-4740-a73c-ba9d48b37dce (non-flash)
Nov 29 18:03:14 user nova-compute[74613]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8c53a27-dcde-402b-a9bb-d8642f7db0da (non-flash)
Nov 29 18:03:14 user nova-compute[74613]:  stderr= {{(pid=74613) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 18:03:14 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-29b00ed9-84f7-4ebc-8056-7f15d761e725 tempest-ServerActionsTestOtherB-894551005 tempest-ServerActionsTestOtherB-894551005-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7ff7f87b15a0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:bb526b54-3017-4f30-b5c7-88027b146d52'): ({'sdd'}, set())}) {{(pid=74613) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 29 18:03:14 user nova-compute[74613]: DEBUG os_brick.initiator.linuxscsi [None req-29b00ed9-84f7-4ebc-8056-7f15d761e725 tempest-ServerActionsTestOtherB-894551005 tempest-ServerActionsTestOtherB-894551005-project-member] Removing single pathed devices sdd {{(pid=74613) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 29 18:03:14 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:03:14 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.025s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:03:14 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f1c52e9-1873-44e2-be51-2c29b4657035]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 18:03:14 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:03:14 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.019s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:03:14 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[d498aa41-ff97-4c05-b5dc-69abe6c87bcd]: (4, ('ok\n', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 18:03:14 user nova-compute[74613]: DEBUG os_brick.initiator.linuxscsi [None req-29b00ed9-84f7-4ebc-8056-7f15d761e725 tempest-ServerActionsTestOtherB-894551005 tempest-ServerActionsTestOtherB-894551005-project-member] Flushing IO for device /dev/sdd {{(pid=74613) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 29 18:03:14 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:03:14 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.015s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:03:14 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0d707f6-d32b-4a86-b8c7-ef6b1f8f64cc]: (4, ('', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 18:03:14 user nova-compute[74613]: DEBUG os_brick.initiator.linuxscsi [None req-29b00ed9-84f7-4ebc-8056-7f15d761e725 tempest-ServerActionsTestOtherB-894551005 tempest-ServerActionsTestOtherB-894551005-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=74613) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 29 18:03:14 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:03:14 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.048s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:03:14 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2add259-b002-4d9b-a659-4840c3ec7565]: (4, ('1', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 18:03:14 user nova-compute[74613]: DEBUG os_brick.initiator.linuxscsi [None req-29b00ed9-84f7-4ebc-8056-7f15d761e725 tempest-ServerActionsTestOtherB-894551005 tempest-ServerActionsTestOtherB-894551005-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=74613) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 29 18:03:14 user nova-compute[74613]: DEBUG os_brick.initiator.linuxscsi [None req-29b00ed9-84f7-4ebc-8056-7f15d761e725 tempest-ServerActionsTestOtherB-894551005 tempest-ServerActionsTestOtherB-894551005-project-member] SCSI volumes sdd have been removed. {{(pid=74613) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 29 18:03:14 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-29b00ed9-84f7-4ebc-8056-7f15d761e725 tempest-ServerActionsTestOtherB-894551005 tempest-ServerActionsTestOtherB-894551005-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:bb526b54-3017-4f30-b5c7-88027b146d52')] {{(pid=74613) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 29 18:03:14 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bb526b54-3017-4f30-b5c7-88027b146d52 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:03:14 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bb526b54-3017-4f30-b5c7-88027b146d52 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:03:14 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[f64c55af-3746-46d8-b5ac-a909ae5342f0]: (4, ('', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 18:03:14 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-29b00ed9-84f7-4ebc-8056-7f15d761e725 tempest-ServerActionsTestOtherB-894551005 tempest-ServerActionsTestOtherB-894551005-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74613) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 18:03:14 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bb526b54-3017-4f30-b5c7-88027b146d52 -p 172.16.0.220:3260 --logout {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:03:14 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bb526b54-3017-4f30-b5c7-88027b146d52 -p 172.16.0.220:3260 --logout" returned: 0 in 0.058s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:03:14 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[78c52bfd-f89e-4525-91fc-027e309e750c]: (4, ('Logging out of session [sid: 25, target: iqn.2010-10.org.openstack:bb526b54-3017-4f30-b5c7-88027b146d52, portal: 172.16.0.220,3260]\nLogout of [sid: 25, target: iqn.2010-10.org.openstack:bb526b54-3017-4f30-b5c7-88027b146d52, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 18:03:14 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-29b00ed9-84f7-4ebc-8056-7f15d761e725 tempest-ServerActionsTestOtherB-894551005 tempest-ServerActionsTestOtherB-894551005-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 25, target: iqn.2010-10.org.openstack:bb526b54-3017-4f30-b5c7-88027b146d52, portal: 172.16.0.220,3260]
Nov 29 18:03:14 user nova-compute[74613]: Logout of [sid: 25, target: iqn.2010-10.org.openstack:bb526b54-3017-4f30-b5c7-88027b146d52, portal: 172.16.0.220,3260] successful.
Nov 29 18:03:14 user nova-compute[74613]:  stderr= {{(pid=74613) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 18:03:14 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bb526b54-3017-4f30-b5c7-88027b146d52 -p 172.16.0.220:3260 --op delete {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:03:14 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bb526b54-3017-4f30-b5c7-88027b146d52 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.033s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:03:14 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d38cb44-def1-44f1-ba8e-058b40898051]: (4, ('', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 18:03:14 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-29b00ed9-84f7-4ebc-8056-7f15d761e725 tempest-ServerActionsTestOtherB-894551005 tempest-ServerActionsTestOtherB-894551005-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74613) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 18:03:14 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.base [None req-29b00ed9-84f7-4ebc-8056-7f15d761e725 tempest-ServerActionsTestOtherB-894551005 tempest-ServerActionsTestOtherB-894551005-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.358s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 18:03:14 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-29b00ed9-84f7-4ebc-8056-7f15d761e725 tempest-ServerActionsTestOtherB-894551005 tempest-ServerActionsTestOtherB-894551005-project-member] <== disconnect_volume: return (360ms) None {{(pid=74613) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 18:03:14 user nova-compute[74613]: DEBUG nova.virt.libvirt.volume.iscsi [None req-29b00ed9-84f7-4ebc-8056-7f15d761e725 tempest-ServerActionsTestOtherB-894551005 tempest-ServerActionsTestOtherB-894551005-project-member] [instance: 74ac9703-1cd7-4983-b7d4-c69b01fec7b2] Disconnected iSCSI Volume {{(pid=74613) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 29 18:03:14 user nova-compute[74613]: INFO nova.virt.libvirt.driver [None req-29b00ed9-84f7-4ebc-8056-7f15d761e725 tempest-ServerActionsTestOtherB-894551005 tempest-ServerActionsTestOtherB-894551005-project-member] [instance: 74ac9703-1cd7-4983-b7d4-c69b01fec7b2] Deleting instance files /opt/stack/data/nova/instances/74ac9703-1cd7-4983-b7d4-c69b01fec7b2_del
Nov 29 18:03:14 user nova-compute[74613]: INFO nova.virt.libvirt.driver [None req-29b00ed9-84f7-4ebc-8056-7f15d761e725 tempest-ServerActionsTestOtherB-894551005 tempest-ServerActionsTestOtherB-894551005-project-member] [instance: 74ac9703-1cd7-4983-b7d4-c69b01fec7b2] Deletion of /opt/stack/data/nova/instances/74ac9703-1cd7-4983-b7d4-c69b01fec7b2_del complete
Nov 29 18:03:14 user nova-compute[74613]: INFO nova.compute.manager [None req-29b00ed9-84f7-4ebc-8056-7f15d761e725 tempest-ServerActionsTestOtherB-894551005 tempest-ServerActionsTestOtherB-894551005-project-member] [instance: 74ac9703-1cd7-4983-b7d4-c69b01fec7b2] Took 1.30 seconds to destroy the instance on the hypervisor.
Nov 29 18:03:14 user nova-compute[74613]: DEBUG oslo.service.loopingcall [None req-29b00ed9-84f7-4ebc-8056-7f15d761e725 tempest-ServerActionsTestOtherB-894551005 tempest-ServerActionsTestOtherB-894551005-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74613) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 29 18:03:14 user nova-compute[74613]: DEBUG nova.compute.manager [-] [instance: 74ac9703-1cd7-4983-b7d4-c69b01fec7b2] Deallocating network for instance {{(pid=74613) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 29 18:03:14 user nova-compute[74613]: DEBUG nova.network.neutron [-] [instance: 74ac9703-1cd7-4983-b7d4-c69b01fec7b2] deallocate_for_instance() {{(pid=74613) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 29 18:03:15 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:03:15 user nova-compute[74613]: DEBUG nova.network.neutron [-] [instance: 74ac9703-1cd7-4983-b7d4-c69b01fec7b2] Updating instance_info_cache with network_info: [] {{(pid=74613) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 18:03:15 user nova-compute[74613]: INFO nova.compute.manager [-] [instance: 74ac9703-1cd7-4983-b7d4-c69b01fec7b2] Took 0.97 seconds to deallocate network for instance.
Nov 29 18:03:15 user nova-compute[74613]: DEBUG nova.compute.manager [req-f254058a-2dcb-4c41-bf5d-455f3165115b req-398f5eaa-b413-4e49-8d65-0468fb64981b service nova] [instance: 74ac9703-1cd7-4983-b7d4-c69b01fec7b2] Received event network-vif-deleted-c63b6577-fb46-437a-95b3-8321fab45d0c {{(pid=74613) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 18:03:16 user nova-compute[74613]: DEBUG nova.compute.manager [req-3f3b4bf7-3bf7-47fb-a656-882910a3ca72 req-d8840464-07e1-4416-ae31-c26b3abe5ad2 service nova] [instance: 74ac9703-1cd7-4983-b7d4-c69b01fec7b2] Received event network-vif-plugged-c63b6577-fb46-437a-95b3-8321fab45d0c {{(pid=74613) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 18:03:16 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-3f3b4bf7-3bf7-47fb-a656-882910a3ca72 req-d8840464-07e1-4416-ae31-c26b3abe5ad2 service nova] Acquiring lock "74ac9703-1cd7-4983-b7d4-c69b01fec7b2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 18:03:16 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-3f3b4bf7-3bf7-47fb-a656-882910a3ca72 req-d8840464-07e1-4416-ae31-c26b3abe5ad2 service nova] Lock "74ac9703-1cd7-4983-b7d4-c69b01fec7b2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 18:03:16 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-3f3b4bf7-3bf7-47fb-a656-882910a3ca72 req-d8840464-07e1-4416-ae31-c26b3abe5ad2 service nova] Lock "74ac9703-1cd7-4983-b7d4-c69b01fec7b2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 18:03:16 user nova-compute[74613]: DEBUG nova.compute.manager [req-3f3b4bf7-3bf7-47fb-a656-882910a3ca72 req-d8840464-07e1-4416-ae31-c26b3abe5ad2 service nova] [instance: 74ac9703-1cd7-4983-b7d4-c69b01fec7b2] No waiting events found dispatching network-vif-plugged-c63b6577-fb46-437a-95b3-8321fab45d0c {{(pid=74613) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 18:03:16 user nova-compute[74613]: WARNING nova.compute.manager [req-3f3b4bf7-3bf7-47fb-a656-882910a3ca72 req-d8840464-07e1-4416-ae31-c26b3abe5ad2 service nova] [instance: 74ac9703-1cd7-4983-b7d4-c69b01fec7b2] Received unexpected event network-vif-plugged-c63b6577-fb46-437a-95b3-8321fab45d0c for instance with vm_state active and task_state deleting.
Nov 29 18:03:16 user nova-compute[74613]: INFO nova.compute.manager [None req-29b00ed9-84f7-4ebc-8056-7f15d761e725 tempest-ServerActionsTestOtherB-894551005 tempest-ServerActionsTestOtherB-894551005-project-member] [instance: 74ac9703-1cd7-4983-b7d4-c69b01fec7b2] Took 0.87 seconds to detach 1 volumes for instance.
Nov 29 18:03:16 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-29b00ed9-84f7-4ebc-8056-7f15d761e725 tempest-ServerActionsTestOtherB-894551005 tempest-ServerActionsTestOtherB-894551005-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 18:03:16 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-29b00ed9-84f7-4ebc-8056-7f15d761e725 tempest-ServerActionsTestOtherB-894551005 tempest-ServerActionsTestOtherB-894551005-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 18:03:17 user nova-compute[74613]: DEBUG nova.compute.provider_tree [None req-29b00ed9-84f7-4ebc-8056-7f15d761e725 tempest-ServerActionsTestOtherB-894551005 tempest-ServerActionsTestOtherB-894551005-project-member] Inventory has not changed in ProviderTree for provider: 639d980e-3b12-44b1-b8f4-1812416fa4dd {{(pid=74613) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 18:03:17 user nova-compute[74613]: DEBUG nova.scheduler.client.report [None req-29b00ed9-84f7-4ebc-8056-7f15d761e725 tempest-ServerActionsTestOtherB-894551005 tempest-ServerActionsTestOtherB-894551005-project-member] Inventory has not changed for provider 639d980e-3b12-44b1-b8f4-1812416fa4dd based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74613) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 18:03:17 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:03:17 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-29b00ed9-84f7-4ebc-8056-7f15d761e725 tempest-ServerActionsTestOtherB-894551005 tempest-ServerActionsTestOtherB-894551005-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.367s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 18:03:17 user nova-compute[74613]: INFO nova.scheduler.client.report [None req-29b00ed9-84f7-4ebc-8056-7f15d761e725 tempest-ServerActionsTestOtherB-894551005 tempest-ServerActionsTestOtherB-894551005-project-member] Deleted allocations for instance 74ac9703-1cd7-4983-b7d4-c69b01fec7b2
Nov 29 18:03:17 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-29b00ed9-84f7-4ebc-8056-7f15d761e725 tempest-ServerActionsTestOtherB-894551005 tempest-ServerActionsTestOtherB-894551005-project-member] Lock "74ac9703-1cd7-4983-b7d4-c69b01fec7b2" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.749s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 18:03:17 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:03:19 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:03:19 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:03:19 user nova-compute[74613]: DEBUG oslo_service.periodic_task [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74613) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 18:03:19 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 18:03:19 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 18:03:19 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 18:03:19 user nova-compute[74613]: DEBUG nova.compute.resource_tracker [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Auditing locally available compute resources for user (node: user) {{(pid=74613) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 29 18:03:19 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=74613) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 29 18:03:19 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6c2ea311-0404-4ecf-8086-65f65186f858/disk --force-share --output=json {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:03:20 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6c2ea311-0404-4ecf-8086-65f65186f858/disk --force-share --output=json" returned: 0 in 0.209s {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:03:20 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6c2ea311-0404-4ecf-8086-65f65186f858/disk --force-share --output=json {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:03:20 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6c2ea311-0404-4ecf-8086-65f65186f858/disk --force-share --output=json" returned: 0 in 0.209s {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:03:20 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c4bdb712-e1f9-4fc0-b527-87088d7eddf8/disk --force-share --output=json {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:03:20 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c4bdb712-e1f9-4fc0-b527-87088d7eddf8/disk --force-share --output=json" returned: 0 in 0.206s {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:03:20 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c4bdb712-e1f9-4fc0-b527-87088d7eddf8/disk --force-share --output=json {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:03:20 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:03:20 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c4bdb712-e1f9-4fc0-b527-87088d7eddf8/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:03:20 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f9be53df-54e6-4f59-9cef-0ba7434f0c29/disk --force-share --output=json {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:03:20 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f9be53df-54e6-4f59-9cef-0ba7434f0c29/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:03:20 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f9be53df-54e6-4f59-9cef-0ba7434f0c29/disk --force-share --output=json {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:03:21 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f9be53df-54e6-4f59-9cef-0ba7434f0c29/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:03:21 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3b828860-5cc5-40b0-b845-8e560211794e/disk --force-share --output=json {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:03:21 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3b828860-5cc5-40b0-b845-8e560211794e/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:03:21 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3b828860-5cc5-40b0-b845-8e560211794e/disk --force-share --output=json {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:03:21 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3b828860-5cc5-40b0-b845-8e560211794e/disk --force-share --output=json" returned: 0 in 0.213s {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:03:21 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/abc9e2b8-f467-4cd0-b40f-de511fde1ec1/disk --force-share --output=json {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:03:21 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:03:21 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/abc9e2b8-f467-4cd0-b40f-de511fde1ec1/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:03:21 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/abc9e2b8-f467-4cd0-b40f-de511fde1ec1/disk --force-share --output=json {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:03:21 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/abc9e2b8-f467-4cd0-b40f-de511fde1ec1/disk --force-share --output=json" returned: 0 in 0.221s {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:03:21 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74613) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 29 18:03:21 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8fc8496b-1435-4b5f-8977-6c0d7467ef65/disk --force-share --output=json {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:03:22 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8fc8496b-1435-4b5f-8977-6c0d7467ef65/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:03:22 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8fc8496b-1435-4b5f-8977-6c0d7467ef65/disk --force-share --output=json {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:03:22 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8fc8496b-1435-4b5f-8977-6c0d7467ef65/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:03:22 user nova-compute[74613]: WARNING nova.virt.libvirt.driver [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 18:03:22 user nova-compute[74613]: WARNING nova.virt.libvirt.driver [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 18:03:22 user nova-compute[74613]: DEBUG nova.compute.resource_tracker [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Hypervisor/Node resource view: name=user free_ram=8092MB free_disk=24.937206268310547GB free_vcpus=4 pci_devices=[{"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74613) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 29 18:03:22 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 18:03:22 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 18:03:22 user nova-compute[74613]: DEBUG nova.compute.resource_tracker [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Instance 3b828860-5cc5-40b0-b845-8e560211794e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74613) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 18:03:22 user nova-compute[74613]: DEBUG nova.compute.resource_tracker [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Instance abc9e2b8-f467-4cd0-b40f-de511fde1ec1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74613) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 18:03:22 user nova-compute[74613]: DEBUG nova.compute.resource_tracker [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Instance cd22685a-028c-4e0c-834d-e7b20f6d06ab actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74613) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 18:03:22 user nova-compute[74613]: DEBUG nova.compute.resource_tracker [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Instance c4bdb712-e1f9-4fc0-b527-87088d7eddf8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74613) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 18:03:22 user nova-compute[74613]: DEBUG nova.compute.resource_tracker [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Instance 8fc8496b-1435-4b5f-8977-6c0d7467ef65 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74613) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 18:03:22 user nova-compute[74613]: DEBUG nova.compute.resource_tracker [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Instance 6c2ea311-0404-4ecf-8086-65f65186f858 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74613) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 18:03:22 user nova-compute[74613]: DEBUG nova.compute.resource_tracker [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Instance f9be53df-54e6-4f59-9cef-0ba7434f0c29 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74613) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 18:03:22 user nova-compute[74613]: DEBUG nova.compute.resource_tracker [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Instance e9acfa30-4ec2-4540-ac34-4c66db3228e1 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74613) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 18:03:22 user nova-compute[74613]: DEBUG nova.compute.resource_tracker [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Total usable vcpus: 12, total allocated vcpus: 8 {{(pid=74613) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 29 18:03:22 user nova-compute[74613]: DEBUG nova.compute.resource_tracker [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Final resource view: name=user phys_ram=16011MB used_ram=4608MB phys_disk=40GB used_disk=6GB total_vcpus=12 used_vcpus=8 pci_stats=[] {{(pid=74613) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 29 18:03:23 user nova-compute[74613]: DEBUG nova.compute.provider_tree [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Inventory has not changed in ProviderTree for provider: 639d980e-3b12-44b1-b8f4-1812416fa4dd {{(pid=74613) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 18:03:23 user nova-compute[74613]: DEBUG nova.scheduler.client.report [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Inventory has not changed for provider 639d980e-3b12-44b1-b8f4-1812416fa4dd based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74613) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 18:03:23 user nova-compute[74613]: DEBUG nova.compute.resource_tracker [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Compute_service record updated for user:user {{(pid=74613) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 29 18:03:23 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.401s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 18:03:24 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:03:25 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:03:26 user nova-compute[74613]: DEBUG oslo_service.periodic_task [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74613) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 18:03:26 user nova-compute[74613]: DEBUG oslo_service.periodic_task [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74613) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 18:03:26 user nova-compute[74613]: DEBUG oslo_service.periodic_task [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74613) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 18:03:26 user nova-compute[74613]: DEBUG nova.compute.manager [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Starting heal instance info cache {{(pid=74613) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 29 18:03:26 user nova-compute[74613]: DEBUG nova.compute.manager [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Didn't find any instances for network info cache update. {{(pid=74613) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 29 18:03:26 user nova-compute[74613]: DEBUG oslo_service.periodic_task [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74613) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 18:03:26 user nova-compute[74613]: DEBUG oslo_service.periodic_task [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74613) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 18:03:26 user nova-compute[74613]: DEBUG oslo_service.periodic_task [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74613) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 18:03:26 user nova-compute[74613]: DEBUG oslo_service.periodic_task [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74613) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 18:03:26 user nova-compute[74613]: DEBUG nova.compute.manager [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74613) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 29 18:03:26 user nova-compute[74613]: DEBUG oslo_service.periodic_task [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74613) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 18:03:28 user nova-compute[74613]: DEBUG oslo_service.periodic_task [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74613) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 18:03:29 user nova-compute[74613]: WARNING nova.virt.libvirt.driver [None req-4a8e5087-4382-40fd-bc7d-7fdb2abfae22 tempest-VolumesSnapshotTestJSON-1388493826 tempest-VolumesSnapshotTestJSON-1388493826-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 6c2ea311-0404-4ecf-8086-65f65186f858 is timed out.
Nov 29 18:03:29 user nova-compute[74613]: INFO nova.virt.libvirt.driver [None req-4a8e5087-4382-40fd-bc7d-7fdb2abfae22 tempest-VolumesSnapshotTestJSON-1388493826 tempest-VolumesSnapshotTestJSON-1388493826-project-member] Successfully detached device vdb from instance 6c2ea311-0404-4ecf-8086-65f65186f858 from the live domain config.
Nov 29 18:03:29 user nova-compute[74613]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4a8e5087-4382-40fd-bc7d-7fdb2abfae22 tempest-VolumesSnapshotTestJSON-1388493826 tempest-VolumesSnapshotTestJSON-1388493826-project-member] [instance: 6c2ea311-0404-4ecf-8086-65f65186f858] calling os-brick to detach iSCSI Volume {{(pid=74613) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 29 18:03:29 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a8e5087-4382-40fd-bc7d-7fdb2abfae22 tempest-VolumesSnapshotTestJSON-1388493826 tempest-VolumesSnapshotTestJSON-1388493826-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff828156890>, {'target_iqn': 'iqn.2010-10.org.openstack:86badab9-1598-4740-a73c-ba9d48b37dce', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ZntsUoGK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=74613) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 18:03:29 user nova-compute[74613]: WARNING os_brick.initiator.connectors.base [None req-4a8e5087-4382-40fd-bc7d-7fdb2abfae22 tempest-VolumesSnapshotTestJSON-1388493826 tempest-VolumesSnapshotTestJSON-1388493826-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 18:03:29 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.base [None req-4a8e5087-4382-40fd-bc7d-7fdb2abfae22 tempest-VolumesSnapshotTestJSON-1388493826 tempest-VolumesSnapshotTestJSON-1388493826-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 18:03:29 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.base [None req-4a8e5087-4382-40fd-bc7d-7fdb2abfae22 tempest-VolumesSnapshotTestJSON-1388493826 tempest-VolumesSnapshotTestJSON-1388493826-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 18:03:29 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:03:29 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:03:29 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[def03050-48e5-4567-8056-bc642976481d]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:9511387c-8772-40f2-bf2d-6b6387649e9f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:86badab9-1598-4740-a73c-ba9d48b37dce\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a8c53a27-dcde-402b-a9bb-d8642f7db0da\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 18:03:29 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a8e5087-4382-40fd-bc7d-7fdb2abfae22 tempest-VolumesSnapshotTestJSON-1388493826 tempest-VolumesSnapshotTestJSON-1388493826-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 29 18:03:29 user nova-compute[74613]: No targets found.
Nov 29 18:03:29 user nova-compute[74613]: iSNS:
Nov 29 18:03:29 user nova-compute[74613]: No targets found.
Nov 29 18:03:29 user nova-compute[74613]: STATIC:
Nov 29 18:03:29 user nova-compute[74613]: Target: iqn.2010-10.org.openstack:9511387c-8772-40f2-bf2d-6b6387649e9f
Nov 29 18:03:29 user nova-compute[74613]:         Portal: 172.16.0.220:3260,-1
Nov 29 18:03:29 user nova-compute[74613]:                 Iface Name: default
Nov 29 18:03:29 user nova-compute[74613]: Target: iqn.2010-10.org.openstack:86badab9-1598-4740-a73c-ba9d48b37dce
Nov 29 18:03:29 user nova-compute[74613]:         Portal: 172.16.0.220:3260,-1
Nov 29 18:03:29 user nova-compute[74613]:                 Iface Name: default
Nov 29 18:03:29 user nova-compute[74613]: Target: iqn.2010-10.org.openstack:a8c53a27-dcde-402b-a9bb-d8642f7db0da
Nov 29 18:03:29 user nova-compute[74613]:         Portal: 172.16.0.220:3260,-1
Nov 29 18:03:29 user nova-compute[74613]:                 Iface Name: default
Nov 29 18:03:29 user nova-compute[74613]: FIRMWARE:
Nov 29 18:03:29 user nova-compute[74613]: No targets found.
Nov 29 18:03:29 user nova-compute[74613]:  stderr= {{(pid=74613) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 18:03:29 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a8e5087-4382-40fd-bc7d-7fdb2abfae22 tempest-VolumesSnapshotTestJSON-1388493826 tempest-VolumesSnapshotTestJSON-1388493826-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 29 18:03:29 user nova-compute[74613]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 29 18:03:29 user nova-compute[74613]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74613) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 29 18:03:29 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a8e5087-4382-40fd-bc7d-7fdb2abfae22 tempest-VolumesSnapshotTestJSON-1388493826 tempest-VolumesSnapshotTestJSON-1388493826-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:86badab9-1598-4740-a73c-ba9d48b37dce', 0)] {{(pid=74613) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 29 18:03:29 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:03:29 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:03:29 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e730753-3527-4ce9-8f79-f8a028a345e4]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:86badab9-1598-4740-a73c-ba9d48b37dce\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9511387c-8772-40f2-bf2d-6b6387649e9f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a8c53a27-dcde-402b-a9bb-d8642f7db0da\n', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 18:03:29 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:03:29 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:03:29 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[0cc8e76e-5f39-40bd-97c2-4cd790f6c2e1]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9511387c-8772-40f2-bf2d-6b6387649e9f (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:86badab9-1598-4740-a73c-ba9d48b37dce (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8c53a27-dcde-402b-a9bb-d8642f7db0da (non-flash)\n', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 18:03:29 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a8e5087-4382-40fd-bc7d-7fdb2abfae22 tempest-VolumesSnapshotTestJSON-1388493826 tempest-VolumesSnapshotTestJSON-1388493826-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9511387c-8772-40f2-bf2d-6b6387649e9f (non-flash)
Nov 29 18:03:29 user nova-compute[74613]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:86badab9-1598-4740-a73c-ba9d48b37dce (non-flash)
Nov 29 18:03:29 user nova-compute[74613]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8c53a27-dcde-402b-a9bb-d8642f7db0da (non-flash)
Nov 29 18:03:29 user nova-compute[74613]:  stderr= {{(pid=74613) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 18:03:29 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a8e5087-4382-40fd-bc7d-7fdb2abfae22 tempest-VolumesSnapshotTestJSON-1388493826 tempest-VolumesSnapshotTestJSON-1388493826-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9511387c-8772-40f2-bf2d-6b6387649e9f (non-flash)
Nov 29 18:03:29 user nova-compute[74613]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:86badab9-1598-4740-a73c-ba9d48b37dce (non-flash)
Nov 29 18:03:29 user nova-compute[74613]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8c53a27-dcde-402b-a9bb-d8642f7db0da (non-flash)
Nov 29 18:03:29 user nova-compute[74613]:  stderr= {{(pid=74613) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 18:03:29 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a8e5087-4382-40fd-bc7d-7fdb2abfae22 tempest-VolumesSnapshotTestJSON-1388493826 tempest-VolumesSnapshotTestJSON-1388493826-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7ff7f8769ea0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:86badab9-1598-4740-a73c-ba9d48b37dce'): ({'sdc'}, set())}) {{(pid=74613) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 29 18:03:29 user nova-compute[74613]: DEBUG os_brick.initiator.linuxscsi [None req-4a8e5087-4382-40fd-bc7d-7fdb2abfae22 tempest-VolumesSnapshotTestJSON-1388493826 tempest-VolumesSnapshotTestJSON-1388493826-project-member] Removing single pathed devices sdc {{(pid=74613) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 29 18:03:29 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:03:29 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:03:29 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[6dd2cf9b-d9e1-44a3-bd9e-95075ed1162b]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 18:03:29 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:03:29 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.021s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:03:29 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[92801829-6a52-45cc-ad16-42226ebf259e]: (4, ('ok\n', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 18:03:29 user nova-compute[74613]: DEBUG os_brick.initiator.linuxscsi [None req-4a8e5087-4382-40fd-bc7d-7fdb2abfae22 tempest-VolumesSnapshotTestJSON-1388493826 tempest-VolumesSnapshotTestJSON-1388493826-project-member] Flushing IO for device /dev/sdc {{(pid=74613) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 29 18:03:29 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:03:29 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.013s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:03:29 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf0b8b43-28cc-409a-8788-09bbaaf80036]: (4, ('', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 18:03:29 user nova-compute[74613]: DEBUG os_brick.initiator.linuxscsi [None req-4a8e5087-4382-40fd-bc7d-7fdb2abfae22 tempest-VolumesSnapshotTestJSON-1388493826 tempest-VolumesSnapshotTestJSON-1388493826-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=74613) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 29 18:03:29 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:03:29 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.052s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:03:29 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b2288bb-0285-408e-b117-2b5a18499a7b]: (4, ('1', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 18:03:29 user nova-compute[74613]: DEBUG os_brick.initiator.linuxscsi [None req-4a8e5087-4382-40fd-bc7d-7fdb2abfae22 tempest-VolumesSnapshotTestJSON-1388493826 tempest-VolumesSnapshotTestJSON-1388493826-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=74613) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 29 18:03:29 user nova-compute[74613]: DEBUG os_brick.initiator.linuxscsi [None req-4a8e5087-4382-40fd-bc7d-7fdb2abfae22 tempest-VolumesSnapshotTestJSON-1388493826 tempest-VolumesSnapshotTestJSON-1388493826-project-member] SCSI volumes sdc have been removed. {{(pid=74613) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 29 18:03:29 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a8e5087-4382-40fd-bc7d-7fdb2abfae22 tempest-VolumesSnapshotTestJSON-1388493826 tempest-VolumesSnapshotTestJSON-1388493826-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:86badab9-1598-4740-a73c-ba9d48b37dce')] {{(pid=74613) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 29 18:03:29 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:86badab9-1598-4740-a73c-ba9d48b37dce -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:03:29 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:86badab9-1598-4740-a73c-ba9d48b37dce -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:03:29 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[84df8ba2-1ac8-4a82-9639-a537adc26655]: (4, ('', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 18:03:29 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a8e5087-4382-40fd-bc7d-7fdb2abfae22 tempest-VolumesSnapshotTestJSON-1388493826 tempest-VolumesSnapshotTestJSON-1388493826-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74613) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 18:03:29 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:86badab9-1598-4740-a73c-ba9d48b37dce -p 172.16.0.220:3260 --logout {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:03:29 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:86badab9-1598-4740-a73c-ba9d48b37dce -p 172.16.0.220:3260 --logout" returned: 0 in 0.060s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:03:29 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[54ed9976-c5bd-4f0e-975c-aee5ad307798]: (4, ('Logging out of session [sid: 27, target: iqn.2010-10.org.openstack:86badab9-1598-4740-a73c-ba9d48b37dce, portal: 172.16.0.220,3260]\nLogout of [sid: 27, target: iqn.2010-10.org.openstack:86badab9-1598-4740-a73c-ba9d48b37dce, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 18:03:29 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a8e5087-4382-40fd-bc7d-7fdb2abfae22 tempest-VolumesSnapshotTestJSON-1388493826 tempest-VolumesSnapshotTestJSON-1388493826-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 27, target: iqn.2010-10.org.openstack:86badab9-1598-4740-a73c-ba9d48b37dce, portal: 172.16.0.220,3260]
Nov 29 18:03:29 user nova-compute[74613]: Logout of [sid: 27, target: iqn.2010-10.org.openstack:86badab9-1598-4740-a73c-ba9d48b37dce, portal: 172.16.0.220,3260] successful.
Nov 29 18:03:29 user nova-compute[74613]:  stderr= {{(pid=74613) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 18:03:29 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:86badab9-1598-4740-a73c-ba9d48b37dce -p 172.16.0.220:3260 --op delete {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:03:29 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:86badab9-1598-4740-a73c-ba9d48b37dce -p 172.16.0.220:3260 --op delete" returned: 0 in 0.023s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:03:29 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[b08d50eb-5930-413b-babb-5c9438473334]: (4, ('', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 18:03:29 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a8e5087-4382-40fd-bc7d-7fdb2abfae22 tempest-VolumesSnapshotTestJSON-1388493826 tempest-VolumesSnapshotTestJSON-1388493826-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74613) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 18:03:29 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.base [None req-4a8e5087-4382-40fd-bc7d-7fdb2abfae22 tempest-VolumesSnapshotTestJSON-1388493826 tempest-VolumesSnapshotTestJSON-1388493826-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.319s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 18:03:29 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a8e5087-4382-40fd-bc7d-7fdb2abfae22 tempest-VolumesSnapshotTestJSON-1388493826 tempest-VolumesSnapshotTestJSON-1388493826-project-member] <== disconnect_volume: return (320ms) None {{(pid=74613) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 18:03:29 user nova-compute[74613]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4a8e5087-4382-40fd-bc7d-7fdb2abfae22 tempest-VolumesSnapshotTestJSON-1388493826 tempest-VolumesSnapshotTestJSON-1388493826-project-member] [instance: 6c2ea311-0404-4ecf-8086-65f65186f858] Disconnected iSCSI Volume {{(pid=74613) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 29 18:03:29 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:03:30 user nova-compute[74613]: DEBUG nova.objects.instance [None req-4a8e5087-4382-40fd-bc7d-7fdb2abfae22 tempest-VolumesSnapshotTestJSON-1388493826 tempest-VolumesSnapshotTestJSON-1388493826-project-member] Lazy-loading 'flavor' on Instance uuid 6c2ea311-0404-4ecf-8086-65f65186f858 {{(pid=74613) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 18:03:30 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-4a8e5087-4382-40fd-bc7d-7fdb2abfae22 tempest-VolumesSnapshotTestJSON-1388493826 tempest-VolumesSnapshotTestJSON-1388493826-project-member] Lock "6c2ea311-0404-4ecf-8086-65f65186f858" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.807s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 18:03:30 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-70c3baf5-acec-44ca-b62e-42cb6ed6f073 tempest-VolumesSnapshotTestJSON-1388493826 tempest-VolumesSnapshotTestJSON-1388493826-project-member] Lock "6c2ea311-0404-4ecf-8086-65f65186f858" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 21.440s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 18:03:30 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-70c3baf5-acec-44ca-b62e-42cb6ed6f073 tempest-VolumesSnapshotTestJSON-1388493826 tempest-VolumesSnapshotTestJSON-1388493826-project-member] Acquiring lock "6c2ea311-0404-4ecf-8086-65f65186f858-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 18:03:30 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-70c3baf5-acec-44ca-b62e-42cb6ed6f073 tempest-VolumesSnapshotTestJSON-1388493826 tempest-VolumesSnapshotTestJSON-1388493826-project-member] Lock "6c2ea311-0404-4ecf-8086-65f65186f858-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 18:03:30 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-70c3baf5-acec-44ca-b62e-42cb6ed6f073 tempest-VolumesSnapshotTestJSON-1388493826 tempest-VolumesSnapshotTestJSON-1388493826-project-member] Lock "6c2ea311-0404-4ecf-8086-65f65186f858-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 18:03:30 user nova-compute[74613]: INFO nova.compute.manager [None req-70c3baf5-acec-44ca-b62e-42cb6ed6f073 tempest-VolumesSnapshotTestJSON-1388493826 tempest-VolumesSnapshotTestJSON-1388493826-project-member] [instance: 6c2ea311-0404-4ecf-8086-65f65186f858] Terminating instance
Nov 29 18:03:30 user nova-compute[74613]: DEBUG nova.compute.manager [None req-70c3baf5-acec-44ca-b62e-42cb6ed6f073 tempest-VolumesSnapshotTestJSON-1388493826 tempest-VolumesSnapshotTestJSON-1388493826-project-member] [instance: 6c2ea311-0404-4ecf-8086-65f65186f858] Start destroying the instance on the hypervisor. {{(pid=74613) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 29 18:03:30 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:03:30 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:03:30 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:03:30 user nova-compute[74613]: DEBUG nova.compute.manager [req-e6969086-5ec2-4157-a837-08fb71f60405 req-46ea7265-d8da-4b9c-af84-fb0447b2d25a service nova] [instance: 6c2ea311-0404-4ecf-8086-65f65186f858] Received event network-vif-unplugged-ec533dd5-c792-49a7-b497-7995a406838a {{(pid=74613) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 18:03:30 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-e6969086-5ec2-4157-a837-08fb71f60405 req-46ea7265-d8da-4b9c-af84-fb0447b2d25a service nova] Acquiring lock "6c2ea311-0404-4ecf-8086-65f65186f858-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 18:03:30 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-e6969086-5ec2-4157-a837-08fb71f60405 req-46ea7265-d8da-4b9c-af84-fb0447b2d25a service nova] Lock "6c2ea311-0404-4ecf-8086-65f65186f858-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 18:03:30 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-e6969086-5ec2-4157-a837-08fb71f60405 req-46ea7265-d8da-4b9c-af84-fb0447b2d25a service nova] Lock "6c2ea311-0404-4ecf-8086-65f65186f858-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 18:03:30 user nova-compute[74613]: DEBUG nova.compute.manager [req-e6969086-5ec2-4157-a837-08fb71f60405 req-46ea7265-d8da-4b9c-af84-fb0447b2d25a service nova] [instance: 6c2ea311-0404-4ecf-8086-65f65186f858] No waiting events found dispatching network-vif-unplugged-ec533dd5-c792-49a7-b497-7995a406838a {{(pid=74613) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 18:03:30 user nova-compute[74613]: DEBUG nova.compute.manager [req-e6969086-5ec2-4157-a837-08fb71f60405 req-46ea7265-d8da-4b9c-af84-fb0447b2d25a service nova] [instance: 6c2ea311-0404-4ecf-8086-65f65186f858] Received event network-vif-unplugged-ec533dd5-c792-49a7-b497-7995a406838a for instance with task_state deleting. {{(pid=74613) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 29 18:03:31 user nova-compute[74613]: INFO nova.virt.libvirt.driver [-] [instance: 6c2ea311-0404-4ecf-8086-65f65186f858] Instance destroyed successfully.
Nov 29 18:03:31 user nova-compute[74613]: DEBUG nova.objects.instance [None req-70c3baf5-acec-44ca-b62e-42cb6ed6f073 tempest-VolumesSnapshotTestJSON-1388493826 tempest-VolumesSnapshotTestJSON-1388493826-project-member] Lazy-loading 'resources' on Instance uuid 6c2ea311-0404-4ecf-8086-65f65186f858 {{(pid=74613) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 18:03:31 user nova-compute[74613]: DEBUG nova.virt.libvirt.vif [None req-70c3baf5-acec-44ca-b62e-42cb6ed6f073 tempest-VolumesSnapshotTestJSON-1388493826 tempest-VolumesSnapshotTestJSON-1388493826-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T18:00:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-899305642',display_name='tempest-VolumesSnapshotTestJSON-instance-899305642',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-899305642',id=24,image_ref='4217f428-8d9d-4ee1-9614-642d26d90c46',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBDbbE1cSh9/Rdbf9KDUssVEy9Q77UHVGA7A+YcsHGCVQokCnji0wVZ1MYpWlht+gSpcxBcP6Y0NVLYU2Da5HN8MwYRxUzJj2K1qJ2Ct0MAsSb5eUDYPIk0tAlgw/00p4A==',key_name='tempest-keypair-1551195618',keypairs=<?>,launch_index=0,launched_at=2023-11-29T18:00:51Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='a9ec113a97bd40c4b68d3738c64ece01',ramdisk_id='',reservation_id='r-8marhme9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='4217f428-8d9d-4ee1-9614-642d26d90c46',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesSnapshotTestJSON-1388493826',owner_user_name='tempest-VolumesSnapshotTestJSON-1388493826-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-29T18:00:51Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5fd84795e6684327998b0f52f5941f86',uuid=6c2ea311-0404-4ecf-8086-65f65186f858,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "ec533dd5-c792-49a7-b497-7995a406838a", "address": "fa:16:3e:75:15:43", "network": {"id": "4cc7e4ab-28a3-431a-9855-22009278b949", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1066409623-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.48", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a9ec113a97bd40c4b68d3738c64ece01", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapec533dd5-c7", "ovs_interfaceid": "ec533dd5-c792-49a7-b497-7995a406838a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74613) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 29 18:03:31 user nova-compute[74613]: DEBUG nova.network.os_vif_util [None req-70c3baf5-acec-44ca-b62e-42cb6ed6f073 tempest-VolumesSnapshotTestJSON-1388493826 tempest-VolumesSnapshotTestJSON-1388493826-project-member] Converting VIF {"id": "ec533dd5-c792-49a7-b497-7995a406838a", "address": "fa:16:3e:75:15:43", "network": {"id": "4cc7e4ab-28a3-431a-9855-22009278b949", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1066409623-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.48", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a9ec113a97bd40c4b68d3738c64ece01", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapec533dd5-c7", "ovs_interfaceid": "ec533dd5-c792-49a7-b497-7995a406838a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74613) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 18:03:31 user nova-compute[74613]: DEBUG nova.network.os_vif_util [None req-70c3baf5-acec-44ca-b62e-42cb6ed6f073 tempest-VolumesSnapshotTestJSON-1388493826 tempest-VolumesSnapshotTestJSON-1388493826-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:75:15:43,bridge_name='br-int',has_traffic_filtering=True,id=ec533dd5-c792-49a7-b497-7995a406838a,network=Network(4cc7e4ab-28a3-431a-9855-22009278b949),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapec533dd5-c7') {{(pid=74613) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 18:03:31 user nova-compute[74613]: DEBUG os_vif [None req-70c3baf5-acec-44ca-b62e-42cb6ed6f073 tempest-VolumesSnapshotTestJSON-1388493826 tempest-VolumesSnapshotTestJSON-1388493826-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:75:15:43,bridge_name='br-int',has_traffic_filtering=True,id=ec533dd5-c792-49a7-b497-7995a406838a,network=Network(4cc7e4ab-28a3-431a-9855-22009278b949),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapec533dd5-c7') {{(pid=74613) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 29 18:03:31 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:03:31 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapec533dd5-c7, bridge=br-int, if_exists=True) {{(pid=74613) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 18:03:31 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:03:31 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:03:31 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=25db5f33-28c8-4c7b-a618-1cef2dfa5bac) {{(pid=74613) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 18:03:31 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:03:31 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 18:03:31 user nova-compute[74613]: INFO os_vif [None req-70c3baf5-acec-44ca-b62e-42cb6ed6f073 tempest-VolumesSnapshotTestJSON-1388493826 tempest-VolumesSnapshotTestJSON-1388493826-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:75:15:43,bridge_name='br-int',has_traffic_filtering=True,id=ec533dd5-c792-49a7-b497-7995a406838a,network=Network(4cc7e4ab-28a3-431a-9855-22009278b949),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapec533dd5-c7')
Nov 29 18:03:31 user nova-compute[74613]: DEBUG nova.virt.libvirt.volume.iscsi [None req-70c3baf5-acec-44ca-b62e-42cb6ed6f073 tempest-VolumesSnapshotTestJSON-1388493826 tempest-VolumesSnapshotTestJSON-1388493826-project-member] [instance: 6c2ea311-0404-4ecf-8086-65f65186f858] calling os-brick to detach iSCSI Volume {{(pid=74613) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 29 18:03:31 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-70c3baf5-acec-44ca-b62e-42cb6ed6f073 tempest-VolumesSnapshotTestJSON-1388493826 tempest-VolumesSnapshotTestJSON-1388493826-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff828156890>, {'target_iqn': 'iqn.2010-10.org.openstack:86badab9-1598-4740-a73c-ba9d48b37dce', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ZntsUoGK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=74613) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 18:03:31 user nova-compute[74613]: WARNING os_brick.initiator.connectors.base [None req-70c3baf5-acec-44ca-b62e-42cb6ed6f073 tempest-VolumesSnapshotTestJSON-1388493826 tempest-VolumesSnapshotTestJSON-1388493826-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 18:03:31 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.base [None req-70c3baf5-acec-44ca-b62e-42cb6ed6f073 tempest-VolumesSnapshotTestJSON-1388493826 tempest-VolumesSnapshotTestJSON-1388493826-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 18:03:31 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.base [None req-70c3baf5-acec-44ca-b62e-42cb6ed6f073 tempest-VolumesSnapshotTestJSON-1388493826 tempest-VolumesSnapshotTestJSON-1388493826-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 18:03:31 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:03:31 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:03:31 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[22355b07-ed40-4ef1-9612-9f641f96af98]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:9511387c-8772-40f2-bf2d-6b6387649e9f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a8c53a27-dcde-402b-a9bb-d8642f7db0da\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 18:03:31 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-70c3baf5-acec-44ca-b62e-42cb6ed6f073 tempest-VolumesSnapshotTestJSON-1388493826 tempest-VolumesSnapshotTestJSON-1388493826-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 29 18:03:31 user nova-compute[74613]: No targets found.
Nov 29 18:03:31 user nova-compute[74613]: iSNS:
Nov 29 18:03:31 user nova-compute[74613]: No targets found.
Nov 29 18:03:31 user nova-compute[74613]: STATIC:
Nov 29 18:03:31 user nova-compute[74613]: Target: iqn.2010-10.org.openstack:9511387c-8772-40f2-bf2d-6b6387649e9f
Nov 29 18:03:31 user nova-compute[74613]:         Portal: 172.16.0.220:3260,-1
Nov 29 18:03:31 user nova-compute[74613]:                 Iface Name: default
Nov 29 18:03:31 user nova-compute[74613]: Target: iqn.2010-10.org.openstack:a8c53a27-dcde-402b-a9bb-d8642f7db0da
Nov 29 18:03:31 user nova-compute[74613]:         Portal: 172.16.0.220:3260,-1
Nov 29 18:03:31 user nova-compute[74613]:                 Iface Name: default
Nov 29 18:03:31 user nova-compute[74613]: FIRMWARE:
Nov 29 18:03:31 user nova-compute[74613]: No targets found.
Nov 29 18:03:31 user nova-compute[74613]:  stderr= {{(pid=74613) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 18:03:31 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-70c3baf5-acec-44ca-b62e-42cb6ed6f073 tempest-VolumesSnapshotTestJSON-1388493826 tempest-VolumesSnapshotTestJSON-1388493826-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 29 18:03:31 user nova-compute[74613]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 29 18:03:31 user nova-compute[74613]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74613) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 29 18:03:31 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-70c3baf5-acec-44ca-b62e-42cb6ed6f073 tempest-VolumesSnapshotTestJSON-1388493826 tempest-VolumesSnapshotTestJSON-1388493826-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:86badab9-1598-4740-a73c-ba9d48b37dce', 0)] {{(pid=74613) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 29 18:03:31 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:03:31 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:03:31 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[febcf1b5-9445-4256-9208-9aaf825d3959]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9511387c-8772-40f2-bf2d-6b6387649e9f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a8c53a27-dcde-402b-a9bb-d8642f7db0da\n', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 18:03:31 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:03:31 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:03:31 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[a75f8019-98b9-4faf-95df-50547124733d]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9511387c-8772-40f2-bf2d-6b6387649e9f (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8c53a27-dcde-402b-a9bb-d8642f7db0da (non-flash)\n', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 18:03:31 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-70c3baf5-acec-44ca-b62e-42cb6ed6f073 tempest-VolumesSnapshotTestJSON-1388493826 tempest-VolumesSnapshotTestJSON-1388493826-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9511387c-8772-40f2-bf2d-6b6387649e9f (non-flash)
Nov 29 18:03:31 user nova-compute[74613]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8c53a27-dcde-402b-a9bb-d8642f7db0da (non-flash)
Nov 29 18:03:31 user nova-compute[74613]:  stderr= {{(pid=74613) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 18:03:31 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-70c3baf5-acec-44ca-b62e-42cb6ed6f073 tempest-VolumesSnapshotTestJSON-1388493826 tempest-VolumesSnapshotTestJSON-1388493826-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9511387c-8772-40f2-bf2d-6b6387649e9f (non-flash)
Nov 29 18:03:31 user nova-compute[74613]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8c53a27-dcde-402b-a9bb-d8642f7db0da (non-flash)
Nov 29 18:03:31 user nova-compute[74613]:  stderr= {{(pid=74613) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 18:03:31 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-70c3baf5-acec-44ca-b62e-42cb6ed6f073 tempest-VolumesSnapshotTestJSON-1388493826 tempest-VolumesSnapshotTestJSON-1388493826-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7ff7f876b490>, {}) {{(pid=74613) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 29 18:03:31 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-70c3baf5-acec-44ca-b62e-42cb6ed6f073 tempest-VolumesSnapshotTestJSON-1388493826 tempest-VolumesSnapshotTestJSON-1388493826-project-member] Disconnecting from: [] {{(pid=74613) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 29 18:03:31 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.base [None req-70c3baf5-acec-44ca-b62e-42cb6ed6f073 tempest-VolumesSnapshotTestJSON-1388493826 tempest-VolumesSnapshotTestJSON-1388493826-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.072s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 18:03:31 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-70c3baf5-acec-44ca-b62e-42cb6ed6f073 tempest-VolumesSnapshotTestJSON-1388493826 tempest-VolumesSnapshotTestJSON-1388493826-project-member] <== disconnect_volume: return (73ms) None {{(pid=74613) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 18:03:31 user nova-compute[74613]: DEBUG nova.virt.libvirt.volume.iscsi [None req-70c3baf5-acec-44ca-b62e-42cb6ed6f073 tempest-VolumesSnapshotTestJSON-1388493826 tempest-VolumesSnapshotTestJSON-1388493826-project-member] [instance: 6c2ea311-0404-4ecf-8086-65f65186f858] Disconnected iSCSI Volume {{(pid=74613) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 29 18:03:31 user nova-compute[74613]: INFO nova.virt.libvirt.driver [None req-70c3baf5-acec-44ca-b62e-42cb6ed6f073 tempest-VolumesSnapshotTestJSON-1388493826 tempest-VolumesSnapshotTestJSON-1388493826-project-member] [instance: 6c2ea311-0404-4ecf-8086-65f65186f858] Deleting instance files /opt/stack/data/nova/instances/6c2ea311-0404-4ecf-8086-65f65186f858_del
Nov 29 18:03:31 user nova-compute[74613]: INFO nova.virt.libvirt.driver [None req-70c3baf5-acec-44ca-b62e-42cb6ed6f073 tempest-VolumesSnapshotTestJSON-1388493826 tempest-VolumesSnapshotTestJSON-1388493826-project-member] [instance: 6c2ea311-0404-4ecf-8086-65f65186f858] Deletion of /opt/stack/data/nova/instances/6c2ea311-0404-4ecf-8086-65f65186f858_del complete
Nov 29 18:03:31 user nova-compute[74613]: INFO nova.compute.manager [None req-70c3baf5-acec-44ca-b62e-42cb6ed6f073 tempest-VolumesSnapshotTestJSON-1388493826 tempest-VolumesSnapshotTestJSON-1388493826-project-member] [instance: 6c2ea311-0404-4ecf-8086-65f65186f858] Took 0.96 seconds to destroy the instance on the hypervisor.
Nov 29 18:03:31 user nova-compute[74613]: DEBUG oslo.service.loopingcall [None req-70c3baf5-acec-44ca-b62e-42cb6ed6f073 tempest-VolumesSnapshotTestJSON-1388493826 tempest-VolumesSnapshotTestJSON-1388493826-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74613) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 29 18:03:31 user nova-compute[74613]: DEBUG nova.compute.manager [-] [instance: 6c2ea311-0404-4ecf-8086-65f65186f858] Deallocating network for instance {{(pid=74613) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 29 18:03:31 user nova-compute[74613]: DEBUG nova.network.neutron [-] [instance: 6c2ea311-0404-4ecf-8086-65f65186f858] deallocate_for_instance() {{(pid=74613) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 29 18:03:32 user nova-compute[74613]: DEBUG nova.network.neutron [-] [instance: 6c2ea311-0404-4ecf-8086-65f65186f858] Updating instance_info_cache with network_info: [] {{(pid=74613) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 18:03:32 user nova-compute[74613]: INFO nova.compute.manager [-] [instance: 6c2ea311-0404-4ecf-8086-65f65186f858] Took 1.11 seconds to deallocate network for instance.
Nov 29 18:03:32 user nova-compute[74613]: DEBUG nova.compute.manager [req-78255fbc-056e-4d94-bb18-a681c03c257e req-61610cda-2463-487b-b71b-ad131737f19c service nova] [instance: 6c2ea311-0404-4ecf-8086-65f65186f858] Received event network-vif-deleted-ec533dd5-c792-49a7-b497-7995a406838a {{(pid=74613) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 18:03:32 user nova-compute[74613]: WARNING nova.volume.cinder [None req-70c3baf5-acec-44ca-b62e-42cb6ed6f073 tempest-VolumesSnapshotTestJSON-1388493826 tempest-VolumesSnapshotTestJSON-1388493826-project-member] Attachment 140bff4f-c914-454b-82c9-2192b1ccea3b does not exist. Ignoring.: cinderclient.exceptions.NotFound: Volume attachment could not be found with filter: attachment_id = 140bff4f-c914-454b-82c9-2192b1ccea3b. (HTTP 404) (Request-ID: req-3fe05062-33fe-4ccf-97e9-b755276d1ec4)
Nov 29 18:03:32 user nova-compute[74613]: INFO nova.compute.manager [None req-70c3baf5-acec-44ca-b62e-42cb6ed6f073 tempest-VolumesSnapshotTestJSON-1388493826 tempest-VolumesSnapshotTestJSON-1388493826-project-member] [instance: 6c2ea311-0404-4ecf-8086-65f65186f858] Took 0.02 seconds to detach 1 volumes for instance.
Nov 29 18:03:32 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-70c3baf5-acec-44ca-b62e-42cb6ed6f073 tempest-VolumesSnapshotTestJSON-1388493826 tempest-VolumesSnapshotTestJSON-1388493826-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 18:03:32 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-70c3baf5-acec-44ca-b62e-42cb6ed6f073 tempest-VolumesSnapshotTestJSON-1388493826 tempest-VolumesSnapshotTestJSON-1388493826-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 18:03:32 user nova-compute[74613]: DEBUG nova.compute.manager [req-e6c20202-e609-4d61-96cc-e3b442221b13 req-a3d0af75-2bb7-45ea-9ee4-56571f5a541e service nova] [instance: 6c2ea311-0404-4ecf-8086-65f65186f858] Received event network-vif-plugged-ec533dd5-c792-49a7-b497-7995a406838a {{(pid=74613) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 18:03:32 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-e6c20202-e609-4d61-96cc-e3b442221b13 req-a3d0af75-2bb7-45ea-9ee4-56571f5a541e service nova] Acquiring lock "6c2ea311-0404-4ecf-8086-65f65186f858-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 18:03:32 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-e6c20202-e609-4d61-96cc-e3b442221b13 req-a3d0af75-2bb7-45ea-9ee4-56571f5a541e service nova] Lock "6c2ea311-0404-4ecf-8086-65f65186f858-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 18:03:32 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-e6c20202-e609-4d61-96cc-e3b442221b13 req-a3d0af75-2bb7-45ea-9ee4-56571f5a541e service nova] Lock "6c2ea311-0404-4ecf-8086-65f65186f858-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 18:03:32 user nova-compute[74613]: DEBUG nova.compute.manager [req-e6c20202-e609-4d61-96cc-e3b442221b13 req-a3d0af75-2bb7-45ea-9ee4-56571f5a541e service nova] [instance: 6c2ea311-0404-4ecf-8086-65f65186f858] No waiting events found dispatching network-vif-plugged-ec533dd5-c792-49a7-b497-7995a406838a {{(pid=74613) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 18:03:32 user nova-compute[74613]: WARNING nova.compute.manager [req-e6c20202-e609-4d61-96cc-e3b442221b13 req-a3d0af75-2bb7-45ea-9ee4-56571f5a541e service nova] [instance: 6c2ea311-0404-4ecf-8086-65f65186f858] Received unexpected event network-vif-plugged-ec533dd5-c792-49a7-b497-7995a406838a for instance with vm_state deleted and task_state None.
Nov 29 18:03:32 user nova-compute[74613]: DEBUG nova.compute.provider_tree [None req-70c3baf5-acec-44ca-b62e-42cb6ed6f073 tempest-VolumesSnapshotTestJSON-1388493826 tempest-VolumesSnapshotTestJSON-1388493826-project-member] Inventory has not changed in ProviderTree for provider: 639d980e-3b12-44b1-b8f4-1812416fa4dd {{(pid=74613) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 18:03:32 user nova-compute[74613]: DEBUG nova.scheduler.client.report [None req-70c3baf5-acec-44ca-b62e-42cb6ed6f073 tempest-VolumesSnapshotTestJSON-1388493826 tempest-VolumesSnapshotTestJSON-1388493826-project-member] Inventory has not changed for provider 639d980e-3b12-44b1-b8f4-1812416fa4dd based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74613) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 18:03:32 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-70c3baf5-acec-44ca-b62e-42cb6ed6f073 tempest-VolumesSnapshotTestJSON-1388493826 tempest-VolumesSnapshotTestJSON-1388493826-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.415s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 18:03:32 user nova-compute[74613]: INFO nova.scheduler.client.report [None req-70c3baf5-acec-44ca-b62e-42cb6ed6f073 tempest-VolumesSnapshotTestJSON-1388493826 tempest-VolumesSnapshotTestJSON-1388493826-project-member] Deleted allocations for instance 6c2ea311-0404-4ecf-8086-65f65186f858
Nov 29 18:03:33 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-70c3baf5-acec-44ca-b62e-42cb6ed6f073 tempest-VolumesSnapshotTestJSON-1388493826 tempest-VolumesSnapshotTestJSON-1388493826-project-member] Lock "6c2ea311-0404-4ecf-8086-65f65186f858" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.709s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 18:03:35 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:03:36 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:03:40 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:03:41 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:03:44 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-5d8a83ba-92bc-4e1d-9331-d030cb74bfa2 tempest-TaggedBootDevicesTest-477858861 tempest-TaggedBootDevicesTest-477858861-project-member] Acquiring lock "56de3dd1-6873-4c0a-9d80-58518dfd671e" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 18:03:44 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-5d8a83ba-92bc-4e1d-9331-d030cb74bfa2 tempest-TaggedBootDevicesTest-477858861 tempest-TaggedBootDevicesTest-477858861-project-member] Lock "56de3dd1-6873-4c0a-9d80-58518dfd671e" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 18:03:44 user nova-compute[74613]: DEBUG nova.compute.manager [None req-5d8a83ba-92bc-4e1d-9331-d030cb74bfa2 tempest-TaggedBootDevicesTest-477858861 tempest-TaggedBootDevicesTest-477858861-project-member] [instance: 56de3dd1-6873-4c0a-9d80-58518dfd671e] Starting instance... {{(pid=74613) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 29 18:03:44 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-5d8a83ba-92bc-4e1d-9331-d030cb74bfa2 tempest-TaggedBootDevicesTest-477858861 tempest-TaggedBootDevicesTest-477858861-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 18:03:44 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-5d8a83ba-92bc-4e1d-9331-d030cb74bfa2 tempest-TaggedBootDevicesTest-477858861 tempest-TaggedBootDevicesTest-477858861-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 18:03:44 user nova-compute[74613]: DEBUG nova.virt.hardware [None req-5d8a83ba-92bc-4e1d-9331-d030cb74bfa2 tempest-TaggedBootDevicesTest-477858861 tempest-TaggedBootDevicesTest-477858861-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74613) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 29 18:03:44 user nova-compute[74613]: INFO nova.compute.claims [None req-5d8a83ba-92bc-4e1d-9331-d030cb74bfa2 tempest-TaggedBootDevicesTest-477858861 tempest-TaggedBootDevicesTest-477858861-project-member] [instance: 56de3dd1-6873-4c0a-9d80-58518dfd671e] Claim successful on node user
Nov 29 18:03:44 user nova-compute[74613]: DEBUG nova.compute.provider_tree [None req-5d8a83ba-92bc-4e1d-9331-d030cb74bfa2 tempest-TaggedBootDevicesTest-477858861 tempest-TaggedBootDevicesTest-477858861-project-member] Inventory has not changed in ProviderTree for provider: 639d980e-3b12-44b1-b8f4-1812416fa4dd {{(pid=74613) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 18:03:44 user nova-compute[74613]: DEBUG nova.scheduler.client.report [None req-5d8a83ba-92bc-4e1d-9331-d030cb74bfa2 tempest-TaggedBootDevicesTest-477858861 tempest-TaggedBootDevicesTest-477858861-project-member] Inventory has not changed for provider 639d980e-3b12-44b1-b8f4-1812416fa4dd based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74613) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 18:03:44 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-5d8a83ba-92bc-4e1d-9331-d030cb74bfa2 tempest-TaggedBootDevicesTest-477858861 tempest-TaggedBootDevicesTest-477858861-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.395s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 18:03:44 user nova-compute[74613]: DEBUG nova.compute.manager [None req-5d8a83ba-92bc-4e1d-9331-d030cb74bfa2 tempest-TaggedBootDevicesTest-477858861 tempest-TaggedBootDevicesTest-477858861-project-member] [instance: 56de3dd1-6873-4c0a-9d80-58518dfd671e] Start building networks asynchronously for instance. {{(pid=74613) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 29 18:03:45 user nova-compute[74613]: DEBUG nova.compute.manager [None req-5d8a83ba-92bc-4e1d-9331-d030cb74bfa2 tempest-TaggedBootDevicesTest-477858861 tempest-TaggedBootDevicesTest-477858861-project-member] [instance: 56de3dd1-6873-4c0a-9d80-58518dfd671e] Allocating IP information in the background. {{(pid=74613) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 29 18:03:45 user nova-compute[74613]: DEBUG nova.network.neutron [None req-5d8a83ba-92bc-4e1d-9331-d030cb74bfa2 tempest-TaggedBootDevicesTest-477858861 tempest-TaggedBootDevicesTest-477858861-project-member] [instance: 56de3dd1-6873-4c0a-9d80-58518dfd671e] allocate_for_instance() {{(pid=74613) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 29 18:03:45 user nova-compute[74613]: INFO nova.virt.libvirt.driver [None req-5d8a83ba-92bc-4e1d-9331-d030cb74bfa2 tempest-TaggedBootDevicesTest-477858861 tempest-TaggedBootDevicesTest-477858861-project-member] [instance: 56de3dd1-6873-4c0a-9d80-58518dfd671e] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 29 18:03:45 user nova-compute[74613]: DEBUG nova.compute.manager [None req-5d8a83ba-92bc-4e1d-9331-d030cb74bfa2 tempest-TaggedBootDevicesTest-477858861 tempest-TaggedBootDevicesTest-477858861-project-member] [instance: 56de3dd1-6873-4c0a-9d80-58518dfd671e] Start building block device mappings for instance. {{(pid=74613) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 29 18:03:45 user nova-compute[74613]: INFO nova.virt.block_device [None req-5d8a83ba-92bc-4e1d-9331-d030cb74bfa2 tempest-TaggedBootDevicesTest-477858861 tempest-TaggedBootDevicesTest-477858861-project-member] [instance: 56de3dd1-6873-4c0a-9d80-58518dfd671e] Booting with volume 32c4a58d-da1b-468d-b32a-6ff5cdc8993d at /dev/vda
Nov 29 18:03:45 user nova-compute[74613]: DEBUG nova.policy [None req-5d8a83ba-92bc-4e1d-9331-d030cb74bfa2 tempest-TaggedBootDevicesTest-477858861 tempest-TaggedBootDevicesTest-477858861-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '5e784791fe274eb7bf8e7b31fdff19f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9fa0da4ffc3447795c69b31e4e9a8d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74613) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 29 18:03:45 user nova-compute[74613]: DEBUG os_brick.utils [None req-5d8a83ba-92bc-4e1d-9331-d030cb74bfa2 tempest-TaggedBootDevicesTest-477858861 tempest-TaggedBootDevicesTest-477858861-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74613) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 18:03:45 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:03:45 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:03:45 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f7c77b5-949f-4767-ad46-0000887ecc88]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:400972819b5\n', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 18:03:45 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:03:45 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.018s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:03:45 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[8163d8d8-c5a3-40bf-b768-7d210aa569d7]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 18:03:45 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:03:45 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:03:45 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[b74fd436-6ba5-4a1c-a49c-1c995bba043a]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 18:03:45 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[2717ed64-a730-48c8-a235-8e8f8ca6cffb]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 18:03:45 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-5d8a83ba-92bc-4e1d-9331-d030cb74bfa2 tempest-TaggedBootDevicesTest-477858861 tempest-TaggedBootDevicesTest-477858861-project-member] Running cmd (subprocess): nvme version {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:03:45 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-5d8a83ba-92bc-4e1d-9331-d030cb74bfa2 tempest-TaggedBootDevicesTest-477858861 tempest-TaggedBootDevicesTest-477858861-project-member] 'nvme version' failed. Not Retrying. {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 18:03:45 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.nvmeof [None req-5d8a83ba-92bc-4e1d-9331-d030cb74bfa2 tempest-TaggedBootDevicesTest-477858861 tempest-TaggedBootDevicesTest-477858861-project-member] nvme not present on system {{(pid=74613) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 29 18:03:45 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:03:45 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 18:03:45 user nova-compute[74613]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 29 18:03:45 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ce9e417-fefd-46fe-94b8-9224aefd56c3]: (4, '') {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 18:03:45 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.lightos [None req-5d8a83ba-92bc-4e1d-9331-d030cb74bfa2 tempest-TaggedBootDevicesTest-477858861 tempest-TaggedBootDevicesTest-477858861-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74613) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 29 18:03:45 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.lightos [None req-5d8a83ba-92bc-4e1d-9331-d030cb74bfa2 tempest-TaggedBootDevicesTest-477858861 tempest-TaggedBootDevicesTest-477858861-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74613) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 29 18:03:45 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.lightos [None req-5d8a83ba-92bc-4e1d-9331-d030cb74bfa2 tempest-TaggedBootDevicesTest-477858861 tempest-TaggedBootDevicesTest-477858861-project-member] LIGHTOS: no hostnqn found. {{(pid=74613) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 29 18:03:45 user nova-compute[74613]: DEBUG os_brick.utils [None req-5d8a83ba-92bc-4e1d-9331-d030cb74bfa2 tempest-TaggedBootDevicesTest-477858861 tempest-TaggedBootDevicesTest-477858861-project-member] <== get_connector_properties: return (132ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:400972819b5', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74613) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 18:03:45 user nova-compute[74613]: DEBUG nova.virt.block_device [None req-5d8a83ba-92bc-4e1d-9331-d030cb74bfa2 tempest-TaggedBootDevicesTest-477858861 tempest-TaggedBootDevicesTest-477858861-project-member] [instance: 56de3dd1-6873-4c0a-9d80-58518dfd671e] Updating existing volume attachment record: de3c309b-8615-4381-a2b8-e9a12f36b7f4 {{(pid=74613) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 29 18:03:45 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:03:45 user nova-compute[74613]: DEBUG nova.network.neutron [None req-5d8a83ba-92bc-4e1d-9331-d030cb74bfa2 tempest-TaggedBootDevicesTest-477858861 tempest-TaggedBootDevicesTest-477858861-project-member] [instance: 56de3dd1-6873-4c0a-9d80-58518dfd671e] Successfully created port: fd1eeb3e-46e9-441a-90e1-048c5ad64d0e {{(pid=74613) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 29 18:03:46 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:03:46 user nova-compute[74613]: DEBUG nova.network.neutron [None req-5d8a83ba-92bc-4e1d-9331-d030cb74bfa2 tempest-TaggedBootDevicesTest-477858861 tempest-TaggedBootDevicesTest-477858861-project-member] [instance: 56de3dd1-6873-4c0a-9d80-58518dfd671e] Successfully created port: bfeedb02-28d2-4e4c-8a6b-da87e4b8f9cb {{(pid=74613) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 29 18:03:46 user nova-compute[74613]: DEBUG nova.network.neutron [None req-5d8a83ba-92bc-4e1d-9331-d030cb74bfa2 tempest-TaggedBootDevicesTest-477858861 tempest-TaggedBootDevicesTest-477858861-project-member] [instance: 56de3dd1-6873-4c0a-9d80-58518dfd671e] Successfully created port: a41dc4d4-b94a-4659-8709-566b029d2b20 {{(pid=74613) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 29 18:03:47 user nova-compute[74613]: DEBUG nova.network.neutron [None req-5d8a83ba-92bc-4e1d-9331-d030cb74bfa2 tempest-TaggedBootDevicesTest-477858861 tempest-TaggedBootDevicesTest-477858861-project-member] [instance: 56de3dd1-6873-4c0a-9d80-58518dfd671e] Successfully created port: 4e39483b-3a24-4948-8025-ab381a1a6eee {{(pid=74613) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 29 18:03:48 user nova-compute[74613]: DEBUG nova.network.neutron [None req-5d8a83ba-92bc-4e1d-9331-d030cb74bfa2 tempest-TaggedBootDevicesTest-477858861 tempest-TaggedBootDevicesTest-477858861-project-member] [instance: 56de3dd1-6873-4c0a-9d80-58518dfd671e] Successfully created port: 30db35d4-e78c-414e-bae8-593d9aaadda8 {{(pid=74613) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 29 18:03:48 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-47de4061-32fc-432c-a5e2-b796d21354d4 tempest-ServerBootFromVolumeStableRescueTest-414665510 tempest-ServerBootFromVolumeStableRescueTest-414665510-project-member] Acquiring lock "d3c285cd-9f39-423c-a324-30a48a9c66be" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 18:03:48 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-47de4061-32fc-432c-a5e2-b796d21354d4 tempest-ServerBootFromVolumeStableRescueTest-414665510 tempest-ServerBootFromVolumeStableRescueTest-414665510-project-member] Lock "d3c285cd-9f39-423c-a324-30a48a9c66be" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 18:03:48 user nova-compute[74613]: DEBUG nova.compute.manager [None req-47de4061-32fc-432c-a5e2-b796d21354d4 tempest-ServerBootFromVolumeStableRescueTest-414665510 tempest-ServerBootFromVolumeStableRescueTest-414665510-project-member] [instance: d3c285cd-9f39-423c-a324-30a48a9c66be] Starting instance... {{(pid=74613) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 29 18:03:48 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-47de4061-32fc-432c-a5e2-b796d21354d4 tempest-ServerBootFromVolumeStableRescueTest-414665510 tempest-ServerBootFromVolumeStableRescueTest-414665510-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 18:03:48 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-47de4061-32fc-432c-a5e2-b796d21354d4 tempest-ServerBootFromVolumeStableRescueTest-414665510 tempest-ServerBootFromVolumeStableRescueTest-414665510-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 18:03:48 user nova-compute[74613]: DEBUG nova.virt.hardware [None req-47de4061-32fc-432c-a5e2-b796d21354d4 tempest-ServerBootFromVolumeStableRescueTest-414665510 tempest-ServerBootFromVolumeStableRescueTest-414665510-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74613) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 29 18:03:48 user nova-compute[74613]: INFO nova.compute.claims [None req-47de4061-32fc-432c-a5e2-b796d21354d4 tempest-ServerBootFromVolumeStableRescueTest-414665510 tempest-ServerBootFromVolumeStableRescueTest-414665510-project-member] [instance: d3c285cd-9f39-423c-a324-30a48a9c66be] Claim successful on node user
Nov 29 18:03:49 user nova-compute[74613]: DEBUG nova.network.neutron [None req-5d8a83ba-92bc-4e1d-9331-d030cb74bfa2 tempest-TaggedBootDevicesTest-477858861 tempest-TaggedBootDevicesTest-477858861-project-member] [instance: 56de3dd1-6873-4c0a-9d80-58518dfd671e] Successfully updated port: fd1eeb3e-46e9-441a-90e1-048c5ad64d0e {{(pid=74613) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 29 18:03:49 user nova-compute[74613]: DEBUG nova.compute.manager [req-8fdccf77-c745-4098-bfd6-4baf56c69b7e req-ce3e4c71-ba71-4e45-ac32-b173e279d061 service nova] [instance: 56de3dd1-6873-4c0a-9d80-58518dfd671e] Received event network-changed-fd1eeb3e-46e9-441a-90e1-048c5ad64d0e {{(pid=74613) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 18:03:49 user nova-compute[74613]: DEBUG nova.compute.manager [req-8fdccf77-c745-4098-bfd6-4baf56c69b7e req-ce3e4c71-ba71-4e45-ac32-b173e279d061 service nova] [instance: 56de3dd1-6873-4c0a-9d80-58518dfd671e] Refreshing instance network info cache due to event network-changed-fd1eeb3e-46e9-441a-90e1-048c5ad64d0e. {{(pid=74613) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 18:03:49 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-8fdccf77-c745-4098-bfd6-4baf56c69b7e req-ce3e4c71-ba71-4e45-ac32-b173e279d061 service nova] Acquiring lock "refresh_cache-56de3dd1-6873-4c0a-9d80-58518dfd671e" {{(pid=74613) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 18:03:49 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-8fdccf77-c745-4098-bfd6-4baf56c69b7e req-ce3e4c71-ba71-4e45-ac32-b173e279d061 service nova] Acquired lock "refresh_cache-56de3dd1-6873-4c0a-9d80-58518dfd671e" {{(pid=74613) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 18:03:49 user nova-compute[74613]: DEBUG nova.network.neutron [req-8fdccf77-c745-4098-bfd6-4baf56c69b7e req-ce3e4c71-ba71-4e45-ac32-b173e279d061 service nova] [instance: 56de3dd1-6873-4c0a-9d80-58518dfd671e] Refreshing network info cache for port fd1eeb3e-46e9-441a-90e1-048c5ad64d0e {{(pid=74613) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 18:03:49 user nova-compute[74613]: DEBUG nova.network.neutron [req-8fdccf77-c745-4098-bfd6-4baf56c69b7e req-ce3e4c71-ba71-4e45-ac32-b173e279d061 service nova] [instance: 56de3dd1-6873-4c0a-9d80-58518dfd671e] Instance cache missing network info. {{(pid=74613) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 29 18:03:49 user nova-compute[74613]: DEBUG nova.compute.provider_tree [None req-47de4061-32fc-432c-a5e2-b796d21354d4 tempest-ServerBootFromVolumeStableRescueTest-414665510 tempest-ServerBootFromVolumeStableRescueTest-414665510-project-member] Inventory has not changed in ProviderTree for provider: 639d980e-3b12-44b1-b8f4-1812416fa4dd {{(pid=74613) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 18:03:49 user nova-compute[74613]: DEBUG nova.scheduler.client.report [None req-47de4061-32fc-432c-a5e2-b796d21354d4 tempest-ServerBootFromVolumeStableRescueTest-414665510 tempest-ServerBootFromVolumeStableRescueTest-414665510-project-member] Inventory has not changed for provider 639d980e-3b12-44b1-b8f4-1812416fa4dd based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74613) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 18:03:49 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-47de4061-32fc-432c-a5e2-b796d21354d4 tempest-ServerBootFromVolumeStableRescueTest-414665510 tempest-ServerBootFromVolumeStableRescueTest-414665510-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.480s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 18:03:49 user nova-compute[74613]: DEBUG nova.compute.manager [None req-47de4061-32fc-432c-a5e2-b796d21354d4 tempest-ServerBootFromVolumeStableRescueTest-414665510 tempest-ServerBootFromVolumeStableRescueTest-414665510-project-member] [instance: d3c285cd-9f39-423c-a324-30a48a9c66be] Start building networks asynchronously for instance. {{(pid=74613) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 29 18:03:49 user nova-compute[74613]: DEBUG nova.network.neutron [req-8fdccf77-c745-4098-bfd6-4baf56c69b7e req-ce3e4c71-ba71-4e45-ac32-b173e279d061 service nova] [instance: 56de3dd1-6873-4c0a-9d80-58518dfd671e] Updating instance_info_cache with network_info: [] {{(pid=74613) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 18:03:49 user nova-compute[74613]: DEBUG nova.compute.manager [None req-47de4061-32fc-432c-a5e2-b796d21354d4 tempest-ServerBootFromVolumeStableRescueTest-414665510 tempest-ServerBootFromVolumeStableRescueTest-414665510-project-member] [instance: d3c285cd-9f39-423c-a324-30a48a9c66be] Allocating IP information in the background. {{(pid=74613) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 29 18:03:49 user nova-compute[74613]: DEBUG nova.network.neutron [None req-47de4061-32fc-432c-a5e2-b796d21354d4 tempest-ServerBootFromVolumeStableRescueTest-414665510 tempest-ServerBootFromVolumeStableRescueTest-414665510-project-member] [instance: d3c285cd-9f39-423c-a324-30a48a9c66be] allocate_for_instance() {{(pid=74613) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 29 18:03:49 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-8fdccf77-c745-4098-bfd6-4baf56c69b7e req-ce3e4c71-ba71-4e45-ac32-b173e279d061 service nova] Releasing lock "refresh_cache-56de3dd1-6873-4c0a-9d80-58518dfd671e" {{(pid=74613) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 18:03:49 user nova-compute[74613]: INFO nova.virt.libvirt.driver [None req-47de4061-32fc-432c-a5e2-b796d21354d4 tempest-ServerBootFromVolumeStableRescueTest-414665510 tempest-ServerBootFromVolumeStableRescueTest-414665510-project-member] [instance: d3c285cd-9f39-423c-a324-30a48a9c66be] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 29 18:03:49 user nova-compute[74613]: DEBUG nova.compute.manager [None req-47de4061-32fc-432c-a5e2-b796d21354d4 tempest-ServerBootFromVolumeStableRescueTest-414665510 tempest-ServerBootFromVolumeStableRescueTest-414665510-project-member] [instance: d3c285cd-9f39-423c-a324-30a48a9c66be] Start building block device mappings for instance. {{(pid=74613) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 29 18:03:49 user nova-compute[74613]: DEBUG nova.policy [None req-47de4061-32fc-432c-a5e2-b796d21354d4 tempest-ServerBootFromVolumeStableRescueTest-414665510 tempest-ServerBootFromVolumeStableRescueTest-414665510-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'c65bc922e04d4d1385e48f70c460c441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b820dd795dfe46cd804772f0e71f98e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74613) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 29 18:03:49 user nova-compute[74613]: INFO nova.virt.block_device [None req-47de4061-32fc-432c-a5e2-b796d21354d4 tempest-ServerBootFromVolumeStableRescueTest-414665510 tempest-ServerBootFromVolumeStableRescueTest-414665510-project-member] [instance: d3c285cd-9f39-423c-a324-30a48a9c66be] Booting with volume-backed-image 4217f428-8d9d-4ee1-9614-642d26d90c46 at /dev/vda
Nov 29 18:03:49 user nova-compute[74613]: DEBUG nova.network.neutron [None req-5d8a83ba-92bc-4e1d-9331-d030cb74bfa2 tempest-TaggedBootDevicesTest-477858861 tempest-TaggedBootDevicesTest-477858861-project-member] [instance: 56de3dd1-6873-4c0a-9d80-58518dfd671e] Successfully updated port: 7d1e40a2-4a06-4e8e-935c-3d66553dac82 {{(pid=74613) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 29 18:03:50 user nova-compute[74613]: DEBUG nova.network.neutron [None req-47de4061-32fc-432c-a5e2-b796d21354d4 tempest-ServerBootFromVolumeStableRescueTest-414665510 tempest-ServerBootFromVolumeStableRescueTest-414665510-project-member] [instance: d3c285cd-9f39-423c-a324-30a48a9c66be] Successfully created port: 663e4724-b31b-469d-a5ea-c2802db1e0c8 {{(pid=74613) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 29 18:03:50 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:03:50 user nova-compute[74613]: DEBUG nova.network.neutron [None req-5d8a83ba-92bc-4e1d-9331-d030cb74bfa2 tempest-TaggedBootDevicesTest-477858861 tempest-TaggedBootDevicesTest-477858861-project-member] [instance: 56de3dd1-6873-4c0a-9d80-58518dfd671e] Successfully updated port: 70ada3a3-186a-425a-8c4c-7af3b2d647ef {{(pid=74613) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 29 18:03:50 user nova-compute[74613]: DEBUG nova.network.neutron [None req-47de4061-32fc-432c-a5e2-b796d21354d4 tempest-ServerBootFromVolumeStableRescueTest-414665510 tempest-ServerBootFromVolumeStableRescueTest-414665510-project-member] [instance: d3c285cd-9f39-423c-a324-30a48a9c66be] Successfully updated port: 663e4724-b31b-469d-a5ea-c2802db1e0c8 {{(pid=74613) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 29 18:03:50 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-47de4061-32fc-432c-a5e2-b796d21354d4 tempest-ServerBootFromVolumeStableRescueTest-414665510 tempest-ServerBootFromVolumeStableRescueTest-414665510-project-member] Acquiring lock "refresh_cache-d3c285cd-9f39-423c-a324-30a48a9c66be" {{(pid=74613) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 18:03:50 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-47de4061-32fc-432c-a5e2-b796d21354d4 tempest-ServerBootFromVolumeStableRescueTest-414665510 tempest-ServerBootFromVolumeStableRescueTest-414665510-project-member] Acquired lock "refresh_cache-d3c285cd-9f39-423c-a324-30a48a9c66be" {{(pid=74613) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 18:03:50 user nova-compute[74613]: DEBUG nova.network.neutron [None req-47de4061-32fc-432c-a5e2-b796d21354d4 tempest-ServerBootFromVolumeStableRescueTest-414665510 tempest-ServerBootFromVolumeStableRescueTest-414665510-project-member] [instance: d3c285cd-9f39-423c-a324-30a48a9c66be] Building network info cache for instance {{(pid=74613) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 29 18:03:51 user nova-compute[74613]: DEBUG nova.compute.manager [req-2bc119b3-6c60-4456-ac92-14a053b9d64e req-8adfed4b-1de8-45c9-974e-ad8f3cf757ab service nova] [instance: d3c285cd-9f39-423c-a324-30a48a9c66be] Received event network-changed-663e4724-b31b-469d-a5ea-c2802db1e0c8 {{(pid=74613) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 18:03:51 user nova-compute[74613]: DEBUG nova.compute.manager [req-2bc119b3-6c60-4456-ac92-14a053b9d64e req-8adfed4b-1de8-45c9-974e-ad8f3cf757ab service nova] [instance: d3c285cd-9f39-423c-a324-30a48a9c66be] Refreshing instance network info cache due to event network-changed-663e4724-b31b-469d-a5ea-c2802db1e0c8. {{(pid=74613) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 18:03:51 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-2bc119b3-6c60-4456-ac92-14a053b9d64e req-8adfed4b-1de8-45c9-974e-ad8f3cf757ab service nova] Acquiring lock "refresh_cache-d3c285cd-9f39-423c-a324-30a48a9c66be" {{(pid=74613) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 18:03:51 user nova-compute[74613]: DEBUG nova.network.neutron [None req-47de4061-32fc-432c-a5e2-b796d21354d4 tempest-ServerBootFromVolumeStableRescueTest-414665510 tempest-ServerBootFromVolumeStableRescueTest-414665510-project-member] [instance: d3c285cd-9f39-423c-a324-30a48a9c66be] Instance cache missing network info. {{(pid=74613) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 29 18:03:51 user nova-compute[74613]: DEBUG nova.compute.manager [req-b1933faa-a797-4a31-9646-0540786f2b03 req-a4dc31fe-5094-44c9-8b98-aa50d243f963 service nova] [instance: 56de3dd1-6873-4c0a-9d80-58518dfd671e] Received event network-changed-7d1e40a2-4a06-4e8e-935c-3d66553dac82 {{(pid=74613) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 18:03:51 user nova-compute[74613]: DEBUG nova.compute.manager [req-b1933faa-a797-4a31-9646-0540786f2b03 req-a4dc31fe-5094-44c9-8b98-aa50d243f963 service nova] [instance: 56de3dd1-6873-4c0a-9d80-58518dfd671e] Refreshing instance network info cache due to event network-changed-7d1e40a2-4a06-4e8e-935c-3d66553dac82. {{(pid=74613) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 18:03:51 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-b1933faa-a797-4a31-9646-0540786f2b03 req-a4dc31fe-5094-44c9-8b98-aa50d243f963 service nova] Acquiring lock "refresh_cache-56de3dd1-6873-4c0a-9d80-58518dfd671e" {{(pid=74613) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 18:03:51 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-b1933faa-a797-4a31-9646-0540786f2b03 req-a4dc31fe-5094-44c9-8b98-aa50d243f963 service nova] Acquired lock "refresh_cache-56de3dd1-6873-4c0a-9d80-58518dfd671e" {{(pid=74613) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 18:03:51 user nova-compute[74613]: DEBUG nova.network.neutron [req-b1933faa-a797-4a31-9646-0540786f2b03 req-a4dc31fe-5094-44c9-8b98-aa50d243f963 service nova] [instance: 56de3dd1-6873-4c0a-9d80-58518dfd671e] Refreshing network info cache for port 7d1e40a2-4a06-4e8e-935c-3d66553dac82 {{(pid=74613) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 18:03:51 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:03:51 user nova-compute[74613]: DEBUG nova.network.neutron [req-b1933faa-a797-4a31-9646-0540786f2b03 req-a4dc31fe-5094-44c9-8b98-aa50d243f963 service nova] [instance: 56de3dd1-6873-4c0a-9d80-58518dfd671e] Instance cache missing network info. {{(pid=74613) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 29 18:03:51 user nova-compute[74613]: DEBUG nova.network.neutron [None req-47de4061-32fc-432c-a5e2-b796d21354d4 tempest-ServerBootFromVolumeStableRescueTest-414665510 tempest-ServerBootFromVolumeStableRescueTest-414665510-project-member] [instance: d3c285cd-9f39-423c-a324-30a48a9c66be] Updating instance_info_cache with network_info: [{"id": "663e4724-b31b-469d-a5ea-c2802db1e0c8", "address": "fa:16:3e:11:80:42", "network": {"id": "0722b02d-a357-4360-87e8-580913723985", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-579793494-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b820dd795dfe46cd804772f0e71f98e9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap663e4724-b3", "ovs_interfaceid": "663e4724-b31b-469d-a5ea-c2802db1e0c8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74613) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 18:03:51 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-47de4061-32fc-432c-a5e2-b796d21354d4 tempest-ServerBootFromVolumeStableRescueTest-414665510 tempest-ServerBootFromVolumeStableRescueTest-414665510-project-member] Releasing lock "refresh_cache-d3c285cd-9f39-423c-a324-30a48a9c66be" {{(pid=74613) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 18:03:51 user nova-compute[74613]: DEBUG nova.compute.manager [None req-47de4061-32fc-432c-a5e2-b796d21354d4 tempest-ServerBootFromVolumeStableRescueTest-414665510 tempest-ServerBootFromVolumeStableRescueTest-414665510-project-member] [instance: d3c285cd-9f39-423c-a324-30a48a9c66be] Instance network_info: |[{"id": "663e4724-b31b-469d-a5ea-c2802db1e0c8", "address": "fa:16:3e:11:80:42", "network": {"id": "0722b02d-a357-4360-87e8-580913723985", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-579793494-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b820dd795dfe46cd804772f0e71f98e9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap663e4724-b3", "ovs_interfaceid": "663e4724-b31b-469d-a5ea-c2802db1e0c8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74613) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 29 18:03:51 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-2bc119b3-6c60-4456-ac92-14a053b9d64e req-8adfed4b-1de8-45c9-974e-ad8f3cf757ab service nova] Acquired lock "refresh_cache-d3c285cd-9f39-423c-a324-30a48a9c66be" {{(pid=74613) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 18:03:51 user nova-compute[74613]: DEBUG nova.network.neutron [req-2bc119b3-6c60-4456-ac92-14a053b9d64e req-8adfed4b-1de8-45c9-974e-ad8f3cf757ab service nova] [instance: d3c285cd-9f39-423c-a324-30a48a9c66be] Refreshing network info cache for port 663e4724-b31b-469d-a5ea-c2802db1e0c8 {{(pid=74613) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 18:03:51 user nova-compute[74613]: DEBUG nova.network.neutron [None req-5d8a83ba-92bc-4e1d-9331-d030cb74bfa2 tempest-TaggedBootDevicesTest-477858861 tempest-TaggedBootDevicesTest-477858861-project-member] [instance: 56de3dd1-6873-4c0a-9d80-58518dfd671e] Successfully updated port: bfeedb02-28d2-4e4c-8a6b-da87e4b8f9cb {{(pid=74613) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 29 18:03:51 user nova-compute[74613]: DEBUG nova.network.neutron [req-b1933faa-a797-4a31-9646-0540786f2b03 req-a4dc31fe-5094-44c9-8b98-aa50d243f963 service nova] [instance: 56de3dd1-6873-4c0a-9d80-58518dfd671e] Updating instance_info_cache with network_info: [] {{(pid=74613) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 18:03:51 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-b1933faa-a797-4a31-9646-0540786f2b03 req-a4dc31fe-5094-44c9-8b98-aa50d243f963 service nova] Releasing lock "refresh_cache-56de3dd1-6873-4c0a-9d80-58518dfd671e" {{(pid=74613) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 18:03:51 user nova-compute[74613]: DEBUG nova.compute.manager [req-b1933faa-a797-4a31-9646-0540786f2b03 req-a4dc31fe-5094-44c9-8b98-aa50d243f963 service nova] [instance: 56de3dd1-6873-4c0a-9d80-58518dfd671e] Received event network-changed-70ada3a3-186a-425a-8c4c-7af3b2d647ef {{(pid=74613) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 18:03:51 user nova-compute[74613]: DEBUG nova.compute.manager [req-b1933faa-a797-4a31-9646-0540786f2b03 req-a4dc31fe-5094-44c9-8b98-aa50d243f963 service nova] [instance: 56de3dd1-6873-4c0a-9d80-58518dfd671e] Refreshing instance network info cache due to event network-changed-70ada3a3-186a-425a-8c4c-7af3b2d647ef. {{(pid=74613) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 18:03:51 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-b1933faa-a797-4a31-9646-0540786f2b03 req-a4dc31fe-5094-44c9-8b98-aa50d243f963 service nova] Acquiring lock "refresh_cache-56de3dd1-6873-4c0a-9d80-58518dfd671e" {{(pid=74613) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 18:03:51 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-b1933faa-a797-4a31-9646-0540786f2b03 req-a4dc31fe-5094-44c9-8b98-aa50d243f963 service nova] Acquired lock "refresh_cache-56de3dd1-6873-4c0a-9d80-58518dfd671e" {{(pid=74613) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 18:03:51 user nova-compute[74613]: DEBUG nova.network.neutron [req-b1933faa-a797-4a31-9646-0540786f2b03 req-a4dc31fe-5094-44c9-8b98-aa50d243f963 service nova] [instance: 56de3dd1-6873-4c0a-9d80-58518dfd671e] Refreshing network info cache for port 70ada3a3-186a-425a-8c4c-7af3b2d647ef {{(pid=74613) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 18:03:51 user nova-compute[74613]: DEBUG nova.network.neutron [req-b1933faa-a797-4a31-9646-0540786f2b03 req-a4dc31fe-5094-44c9-8b98-aa50d243f963 service nova] [instance: 56de3dd1-6873-4c0a-9d80-58518dfd671e] Instance cache missing network info. {{(pid=74613) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 29 18:03:51 user nova-compute[74613]: DEBUG nova.network.neutron [req-b1933faa-a797-4a31-9646-0540786f2b03 req-a4dc31fe-5094-44c9-8b98-aa50d243f963 service nova] [instance: 56de3dd1-6873-4c0a-9d80-58518dfd671e] Updating instance_info_cache with network_info: [] {{(pid=74613) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 18:03:51 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-b1933faa-a797-4a31-9646-0540786f2b03 req-a4dc31fe-5094-44c9-8b98-aa50d243f963 service nova] Releasing lock "refresh_cache-56de3dd1-6873-4c0a-9d80-58518dfd671e" {{(pid=74613) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 18:03:52 user nova-compute[74613]: DEBUG nova.network.neutron [None req-5d8a83ba-92bc-4e1d-9331-d030cb74bfa2 tempest-TaggedBootDevicesTest-477858861 tempest-TaggedBootDevicesTest-477858861-project-member] [instance: 56de3dd1-6873-4c0a-9d80-58518dfd671e] Successfully updated port: a41dc4d4-b94a-4659-8709-566b029d2b20 {{(pid=74613) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 29 18:03:52 user nova-compute[74613]: DEBUG nova.network.neutron [req-2bc119b3-6c60-4456-ac92-14a053b9d64e req-8adfed4b-1de8-45c9-974e-ad8f3cf757ab service nova] [instance: d3c285cd-9f39-423c-a324-30a48a9c66be] Updated VIF entry in instance network info cache for port 663e4724-b31b-469d-a5ea-c2802db1e0c8. {{(pid=74613) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 18:03:52 user nova-compute[74613]: DEBUG nova.network.neutron [req-2bc119b3-6c60-4456-ac92-14a053b9d64e req-8adfed4b-1de8-45c9-974e-ad8f3cf757ab service nova] [instance: d3c285cd-9f39-423c-a324-30a48a9c66be] Updating instance_info_cache with network_info: [{"id": "663e4724-b31b-469d-a5ea-c2802db1e0c8", "address": "fa:16:3e:11:80:42", "network": {"id": "0722b02d-a357-4360-87e8-580913723985", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-579793494-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b820dd795dfe46cd804772f0e71f98e9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap663e4724-b3", "ovs_interfaceid": "663e4724-b31b-469d-a5ea-c2802db1e0c8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74613) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 18:03:52 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-2bc119b3-6c60-4456-ac92-14a053b9d64e req-8adfed4b-1de8-45c9-974e-ad8f3cf757ab service nova] Releasing lock "refresh_cache-d3c285cd-9f39-423c-a324-30a48a9c66be" {{(pid=74613) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 18:03:52 user nova-compute[74613]: DEBUG nova.network.neutron [None req-5d8a83ba-92bc-4e1d-9331-d030cb74bfa2 tempest-TaggedBootDevicesTest-477858861 tempest-TaggedBootDevicesTest-477858861-project-member] [instance: 56de3dd1-6873-4c0a-9d80-58518dfd671e] Successfully updated port: 4e39483b-3a24-4948-8025-ab381a1a6eee {{(pid=74613) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 29 18:03:53 user nova-compute[74613]: DEBUG nova.compute.manager [req-76ba656b-d186-4bdd-82ae-f51cf7b33de0 req-e9d8de10-b8b6-48e4-8c0c-8d5ac08210e0 service nova] [instance: 56de3dd1-6873-4c0a-9d80-58518dfd671e] Received event network-changed-bfeedb02-28d2-4e4c-8a6b-da87e4b8f9cb {{(pid=74613) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 18:03:53 user nova-compute[74613]: DEBUG nova.compute.manager [req-76ba656b-d186-4bdd-82ae-f51cf7b33de0 req-e9d8de10-b8b6-48e4-8c0c-8d5ac08210e0 service nova] [instance: 56de3dd1-6873-4c0a-9d80-58518dfd671e] Refreshing instance network info cache due to event network-changed-bfeedb02-28d2-4e4c-8a6b-da87e4b8f9cb. {{(pid=74613) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 18:03:53 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-76ba656b-d186-4bdd-82ae-f51cf7b33de0 req-e9d8de10-b8b6-48e4-8c0c-8d5ac08210e0 service nova] Acquiring lock "refresh_cache-56de3dd1-6873-4c0a-9d80-58518dfd671e" {{(pid=74613) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 18:03:53 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-76ba656b-d186-4bdd-82ae-f51cf7b33de0 req-e9d8de10-b8b6-48e4-8c0c-8d5ac08210e0 service nova] Acquired lock "refresh_cache-56de3dd1-6873-4c0a-9d80-58518dfd671e" {{(pid=74613) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 18:03:53 user nova-compute[74613]: DEBUG nova.network.neutron [req-76ba656b-d186-4bdd-82ae-f51cf7b33de0 req-e9d8de10-b8b6-48e4-8c0c-8d5ac08210e0 service nova] [instance: 56de3dd1-6873-4c0a-9d80-58518dfd671e] Refreshing network info cache for port bfeedb02-28d2-4e4c-8a6b-da87e4b8f9cb {{(pid=74613) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 18:03:53 user nova-compute[74613]: DEBUG nova.network.neutron [req-76ba656b-d186-4bdd-82ae-f51cf7b33de0 req-e9d8de10-b8b6-48e4-8c0c-8d5ac08210e0 service nova] [instance: 56de3dd1-6873-4c0a-9d80-58518dfd671e] Instance cache missing network info. {{(pid=74613) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 29 18:03:53 user nova-compute[74613]: DEBUG nova.network.neutron [req-76ba656b-d186-4bdd-82ae-f51cf7b33de0 req-e9d8de10-b8b6-48e4-8c0c-8d5ac08210e0 service nova] [instance: 56de3dd1-6873-4c0a-9d80-58518dfd671e] Updating instance_info_cache with network_info: [] {{(pid=74613) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 18:03:53 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-76ba656b-d186-4bdd-82ae-f51cf7b33de0 req-e9d8de10-b8b6-48e4-8c0c-8d5ac08210e0 service nova] Releasing lock "refresh_cache-56de3dd1-6873-4c0a-9d80-58518dfd671e" {{(pid=74613) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 18:03:53 user nova-compute[74613]: DEBUG nova.compute.manager [req-76ba656b-d186-4bdd-82ae-f51cf7b33de0 req-e9d8de10-b8b6-48e4-8c0c-8d5ac08210e0 service nova] [instance: 56de3dd1-6873-4c0a-9d80-58518dfd671e] Received event network-changed-a41dc4d4-b94a-4659-8709-566b029d2b20 {{(pid=74613) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 18:03:53 user nova-compute[74613]: DEBUG nova.compute.manager [req-76ba656b-d186-4bdd-82ae-f51cf7b33de0 req-e9d8de10-b8b6-48e4-8c0c-8d5ac08210e0 service nova] [instance: 56de3dd1-6873-4c0a-9d80-58518dfd671e] Refreshing instance network info cache due to event network-changed-a41dc4d4-b94a-4659-8709-566b029d2b20. {{(pid=74613) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 18:03:53 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-76ba656b-d186-4bdd-82ae-f51cf7b33de0 req-e9d8de10-b8b6-48e4-8c0c-8d5ac08210e0 service nova] Acquiring lock "refresh_cache-56de3dd1-6873-4c0a-9d80-58518dfd671e" {{(pid=74613) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 18:03:53 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-76ba656b-d186-4bdd-82ae-f51cf7b33de0 req-e9d8de10-b8b6-48e4-8c0c-8d5ac08210e0 service nova] Acquired lock "refresh_cache-56de3dd1-6873-4c0a-9d80-58518dfd671e" {{(pid=74613) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 18:03:53 user nova-compute[74613]: DEBUG nova.network.neutron [req-76ba656b-d186-4bdd-82ae-f51cf7b33de0 req-e9d8de10-b8b6-48e4-8c0c-8d5ac08210e0 service nova] [instance: 56de3dd1-6873-4c0a-9d80-58518dfd671e] Refreshing network info cache for port a41dc4d4-b94a-4659-8709-566b029d2b20 {{(pid=74613) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 18:03:53 user nova-compute[74613]: INFO nova.virt.block_device [None req-5d8a83ba-92bc-4e1d-9331-d030cb74bfa2 tempest-TaggedBootDevicesTest-477858861 tempest-TaggedBootDevicesTest-477858861-project-member] [instance: 56de3dd1-6873-4c0a-9d80-58518dfd671e] Booting with volume b4a04a56-f988-4ae8-a3d3-271caf058c33 at /dev/vdb
Nov 29 18:03:53 user nova-compute[74613]: DEBUG nova.network.neutron [req-76ba656b-d186-4bdd-82ae-f51cf7b33de0 req-e9d8de10-b8b6-48e4-8c0c-8d5ac08210e0 service nova] [instance: 56de3dd1-6873-4c0a-9d80-58518dfd671e] Instance cache missing network info. {{(pid=74613) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 29 18:03:53 user nova-compute[74613]: DEBUG nova.network.neutron [None req-5d8a83ba-92bc-4e1d-9331-d030cb74bfa2 tempest-TaggedBootDevicesTest-477858861 tempest-TaggedBootDevicesTest-477858861-project-member] [instance: 56de3dd1-6873-4c0a-9d80-58518dfd671e] Successfully updated port: 30db35d4-e78c-414e-bae8-593d9aaadda8 {{(pid=74613) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 29 18:03:53 user nova-compute[74613]: DEBUG os_brick.utils [None req-5d8a83ba-92bc-4e1d-9331-d030cb74bfa2 tempest-TaggedBootDevicesTest-477858861 tempest-TaggedBootDevicesTest-477858861-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74613) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 18:03:53 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-5d8a83ba-92bc-4e1d-9331-d030cb74bfa2 tempest-TaggedBootDevicesTest-477858861 tempest-TaggedBootDevicesTest-477858861-project-member] Acquiring lock "refresh_cache-56de3dd1-6873-4c0a-9d80-58518dfd671e" {{(pid=74613) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 18:03:53 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:03:53 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:03:53 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[fbc5072f-6c11-4168-ad42-0ac6d0aebe12]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:400972819b5\n', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 18:03:53 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:03:53 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:03:53 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[b129f92b-bbe0-4080-b1a7-a25b43374892]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 18:03:53 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:03:53 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:03:53 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[08faadee-dfb4-43b5-a276-47cd84c57a1a]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 18:03:53 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[122eba55-89a7-46ae-aa08-c6961dffeff0]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 18:03:53 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-5d8a83ba-92bc-4e1d-9331-d030cb74bfa2 tempest-TaggedBootDevicesTest-477858861 tempest-TaggedBootDevicesTest-477858861-project-member] Running cmd (subprocess): nvme version {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:03:53 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-5d8a83ba-92bc-4e1d-9331-d030cb74bfa2 tempest-TaggedBootDevicesTest-477858861 tempest-TaggedBootDevicesTest-477858861-project-member] 'nvme version' failed. Not Retrying. {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 18:03:53 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.nvmeof [None req-5d8a83ba-92bc-4e1d-9331-d030cb74bfa2 tempest-TaggedBootDevicesTest-477858861 tempest-TaggedBootDevicesTest-477858861-project-member] nvme not present on system {{(pid=74613) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 29 18:03:53 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:03:53 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 18:03:53 user nova-compute[74613]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 29 18:03:53 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9ed2495-1f35-4e6f-abf4-43b7c1524b19]: (4, '') {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 18:03:53 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.lightos [None req-5d8a83ba-92bc-4e1d-9331-d030cb74bfa2 tempest-TaggedBootDevicesTest-477858861 tempest-TaggedBootDevicesTest-477858861-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74613) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 29 18:03:53 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.lightos [None req-5d8a83ba-92bc-4e1d-9331-d030cb74bfa2 tempest-TaggedBootDevicesTest-477858861 tempest-TaggedBootDevicesTest-477858861-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74613) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 29 18:03:53 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.lightos [None req-5d8a83ba-92bc-4e1d-9331-d030cb74bfa2 tempest-TaggedBootDevicesTest-477858861 tempest-TaggedBootDevicesTest-477858861-project-member] LIGHTOS: no hostnqn found. {{(pid=74613) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 29 18:03:53 user nova-compute[74613]: DEBUG os_brick.utils [None req-5d8a83ba-92bc-4e1d-9331-d030cb74bfa2 tempest-TaggedBootDevicesTest-477858861 tempest-TaggedBootDevicesTest-477858861-project-member] <== get_connector_properties: return (123ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:400972819b5', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74613) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 18:03:53 user nova-compute[74613]: DEBUG nova.virt.block_device [None req-5d8a83ba-92bc-4e1d-9331-d030cb74bfa2 tempest-TaggedBootDevicesTest-477858861 tempest-TaggedBootDevicesTest-477858861-project-member] [instance: 56de3dd1-6873-4c0a-9d80-58518dfd671e] Updating existing volume attachment record: 50feb43e-e17e-4a55-900e-b7743105cb19 {{(pid=74613) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 29 18:03:53 user nova-compute[74613]: DEBUG nova.network.neutron [req-76ba656b-d186-4bdd-82ae-f51cf7b33de0 req-e9d8de10-b8b6-48e4-8c0c-8d5ac08210e0 service nova] [instance: 56de3dd1-6873-4c0a-9d80-58518dfd671e] Updating instance_info_cache with network_info: [] {{(pid=74613) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 18:03:53 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-76ba656b-d186-4bdd-82ae-f51cf7b33de0 req-e9d8de10-b8b6-48e4-8c0c-8d5ac08210e0 service nova] Releasing lock "refresh_cache-56de3dd1-6873-4c0a-9d80-58518dfd671e" {{(pid=74613) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 18:03:53 user nova-compute[74613]: DEBUG nova.compute.manager [req-76ba656b-d186-4bdd-82ae-f51cf7b33de0 req-e9d8de10-b8b6-48e4-8c0c-8d5ac08210e0 service nova] [instance: 56de3dd1-6873-4c0a-9d80-58518dfd671e] Received event network-changed-4e39483b-3a24-4948-8025-ab381a1a6eee {{(pid=74613) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 18:03:53 user nova-compute[74613]: DEBUG nova.compute.manager [req-76ba656b-d186-4bdd-82ae-f51cf7b33de0 req-e9d8de10-b8b6-48e4-8c0c-8d5ac08210e0 service nova] [instance: 56de3dd1-6873-4c0a-9d80-58518dfd671e] Refreshing instance network info cache due to event network-changed-4e39483b-3a24-4948-8025-ab381a1a6eee. {{(pid=74613) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 18:03:53 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-76ba656b-d186-4bdd-82ae-f51cf7b33de0 req-e9d8de10-b8b6-48e4-8c0c-8d5ac08210e0 service nova] Acquiring lock "refresh_cache-56de3dd1-6873-4c0a-9d80-58518dfd671e" {{(pid=74613) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 18:03:53 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-76ba656b-d186-4bdd-82ae-f51cf7b33de0 req-e9d8de10-b8b6-48e4-8c0c-8d5ac08210e0 service nova] Acquired lock "refresh_cache-56de3dd1-6873-4c0a-9d80-58518dfd671e" {{(pid=74613) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 18:03:53 user nova-compute[74613]: DEBUG nova.network.neutron [req-76ba656b-d186-4bdd-82ae-f51cf7b33de0 req-e9d8de10-b8b6-48e4-8c0c-8d5ac08210e0 service nova] [instance: 56de3dd1-6873-4c0a-9d80-58518dfd671e] Refreshing network info cache for port 4e39483b-3a24-4948-8025-ab381a1a6eee {{(pid=74613) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 18:03:53 user nova-compute[74613]: DEBUG nova.network.neutron [req-76ba656b-d186-4bdd-82ae-f51cf7b33de0 req-e9d8de10-b8b6-48e4-8c0c-8d5ac08210e0 service nova] [instance: 56de3dd1-6873-4c0a-9d80-58518dfd671e] Instance cache missing network info. {{(pid=74613) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 29 18:03:54 user nova-compute[74613]: DEBUG nova.network.neutron [req-76ba656b-d186-4bdd-82ae-f51cf7b33de0 req-e9d8de10-b8b6-48e4-8c0c-8d5ac08210e0 service nova] [instance: 56de3dd1-6873-4c0a-9d80-58518dfd671e] Updating instance_info_cache with network_info: [] {{(pid=74613) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 18:03:54 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-76ba656b-d186-4bdd-82ae-f51cf7b33de0 req-e9d8de10-b8b6-48e4-8c0c-8d5ac08210e0 service nova] Releasing lock "refresh_cache-56de3dd1-6873-4c0a-9d80-58518dfd671e" {{(pid=74613) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 18:03:54 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-5d8a83ba-92bc-4e1d-9331-d030cb74bfa2 tempest-TaggedBootDevicesTest-477858861 tempest-TaggedBootDevicesTest-477858861-project-member] Acquired lock "refresh_cache-56de3dd1-6873-4c0a-9d80-58518dfd671e" {{(pid=74613) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 18:03:54 user nova-compute[74613]: DEBUG nova.network.neutron [None req-5d8a83ba-92bc-4e1d-9331-d030cb74bfa2 tempest-TaggedBootDevicesTest-477858861 tempest-TaggedBootDevicesTest-477858861-project-member] [instance: 56de3dd1-6873-4c0a-9d80-58518dfd671e] Building network info cache for instance {{(pid=74613) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 29 18:03:54 user nova-compute[74613]: DEBUG nova.network.neutron [None req-5d8a83ba-92bc-4e1d-9331-d030cb74bfa2 tempest-TaggedBootDevicesTest-477858861 tempest-TaggedBootDevicesTest-477858861-project-member] [instance: 56de3dd1-6873-4c0a-9d80-58518dfd671e] Instance cache missing network info. {{(pid=74613) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 29 18:03:55 user nova-compute[74613]: DEBUG nova.compute.manager [req-cd59cc03-6eb8-483d-84ca-897423765a34 req-6cb85706-361d-4d76-9606-2498a748625e service nova] [instance: 56de3dd1-6873-4c0a-9d80-58518dfd671e] Received event network-changed-30db35d4-e78c-414e-bae8-593d9aaadda8 {{(pid=74613) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 18:03:55 user nova-compute[74613]: DEBUG nova.compute.manager [req-cd59cc03-6eb8-483d-84ca-897423765a34 req-6cb85706-361d-4d76-9606-2498a748625e service nova] [instance: 56de3dd1-6873-4c0a-9d80-58518dfd671e] Refreshing instance network info cache due to event network-changed-30db35d4-e78c-414e-bae8-593d9aaadda8. {{(pid=74613) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 18:03:55 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-cd59cc03-6eb8-483d-84ca-897423765a34 req-6cb85706-361d-4d76-9606-2498a748625e service nova] Acquiring lock "refresh_cache-56de3dd1-6873-4c0a-9d80-58518dfd671e" {{(pid=74613) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 18:03:55 user nova-compute[74613]: DEBUG nova.network.neutron [None req-5d8a83ba-92bc-4e1d-9331-d030cb74bfa2 tempest-TaggedBootDevicesTest-477858861 tempest-TaggedBootDevicesTest-477858861-project-member] [instance: 56de3dd1-6873-4c0a-9d80-58518dfd671e] Updating instance_info_cache with network_info: [{"id": "fd1eeb3e-46e9-441a-90e1-048c5ad64d0e", "address": "fa:16:3e:23:fc:5e", "network": {"id": "de42d2ca-c48c-4dc3-8b92-61dc7cbafb64", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-203953398-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a9fa0da4ffc3447795c69b31e4e9a8d0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfd1eeb3e-46", "ovs_interfaceid": "fd1eeb3e-46e9-441a-90e1-048c5ad64d0e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "7d1e40a2-4a06-4e8e-935c-3d66553dac82", "address": "fa:16:3e:a9:89:7f", "network": {"id": "3143fa56-ddfb-4a80-8df7-33d38513cf4b", "bridge": "br-int", "label": "tempest-device-tagging-net1-2047429033", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.201", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "a9fa0da4ffc3447795c69b31e4e9a8d0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7d1e40a2-4a", "ovs_interfaceid": "7d1e40a2-4a06-4e8e-935c-3d66553dac82", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "70ada3a3-186a-425a-8c4c-7af3b2d647ef", "address": "fa:16:3e:7f:89:6c", "network": {"id": "3143fa56-ddfb-4a80-8df7-33d38513cf4b", "bridge": "br-int", "label": "tempest-device-tagging-net1-2047429033", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.230", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "a9fa0da4ffc3447795c69b31e4e9a8d0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap70ada3a3-18", "ovs_interfaceid": "70ada3a3-186a-425a-8c4c-7af3b2d647ef", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "bfeedb02-28d2-4e4c-8a6b-da87e4b8f9cb", "address": "fa:16:3e:c9:00:90", "network": {"id": "3143fa56-ddfb-4a80-8df7-33d38513cf4b", "bridge": "br-int", "label": "tempest-device-tagging-net1-2047429033", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.251", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "a9fa0da4ffc3447795c69b31e4e9a8d0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbfeedb02-28", "ovs_interfaceid": "bfeedb02-28d2-4e4c-8a6b-da87e4b8f9cb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "a41dc4d4-b94a-4659-8709-566b029d2b20", "address": "fa:16:3e:c3:19:36", "network": {"id": "3143fa56-ddfb-4a80-8df7-33d38513cf4b", "bridge": "br-int", "label": "tempest-device-tagging-net1-2047429033", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.253", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "a9fa0da4ffc3447795c69b31e4e9a8d0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa41dc4d4-b9", "ovs_interfaceid": "a41dc4d4-b94a-4659-8709-566b029d2b20", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "4e39483b-3a24-4948-8025-ab381a1a6eee", "address": "fa:16:3e:b3:40:e7", "network": {"id": "e20648c0-8ed3-4009-b577-e6af59d212cd", "bridge": "br-int", "label": "tempest-device-tagging-net2-1059246863", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "a9fa0da4ffc3447795c69b31e4e9a8d0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4e39483b-3a", "ovs_interfaceid": "4e39483b-3a24-4948-8025-ab381a1a6eee", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "30db35d4-e78c-414e-bae8-593d9aaadda8", "address": "fa:16:3e:a3:1f:b8", "network": {"id": "e20648c0-8ed3-4009-b577-e6af59d212cd", "bridge": "br-int", "label": "tempest-device-tagging-net2-1059246863", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "a9fa0da4ffc3447795c69b31e4e9a8d0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap30db35d4-e7", "ovs_interfaceid": "30db35d4-e78c-414e-bae8-593d9aaadda8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74613) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 18:03:55 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-5d8a83ba-92bc-4e1d-9331-d030cb74bfa2 tempest-TaggedBootDevicesTest-477858861 tempest-TaggedBootDevicesTest-477858861-project-member] Releasing lock "refresh_cache-56de3dd1-6873-4c0a-9d80-58518dfd671e" {{(pid=74613) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 18:03:55 user nova-compute[74613]: DEBUG nova.compute.manager [None req-5d8a83ba-92bc-4e1d-9331-d030cb74bfa2 tempest-TaggedBootDevicesTest-477858861 tempest-TaggedBootDevicesTest-477858861-project-member] [instance: 56de3dd1-6873-4c0a-9d80-58518dfd671e] Instance network_info: |[{"id": "fd1eeb3e-46e9-441a-90e1-048c5ad64d0e", "address": "fa:16:3e:23:fc:5e", "network": {"id": "de42d2ca-c48c-4dc3-8b92-61dc7cbafb64", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-203953398-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a9fa0da4ffc3447795c69b31e4e9a8d0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfd1eeb3e-46", "ovs_interfaceid": "fd1eeb3e-46e9-441a-90e1-048c5ad64d0e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "7d1e40a2-4a06-4e8e-935c-3d66553dac82", "address": "fa:16:3e:a9:89:7f", "network": {"id": "3143fa56-ddfb-4a80-8df7-33d38513cf4b", "bridge": "br-int", "label": "tempest-device-tagging-net1-2047429033", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.201", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "a9fa0da4ffc3447795c69b31e4e9a8d0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7d1e40a2-4a", "ovs_interfaceid": "7d1e40a2-4a06-4e8e-935c-3d66553dac82", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "70ada3a3-186a-425a-8c4c-7af3b2d647ef", "address": "fa:16:3e:7f:89:6c", "network": {"id": "3143fa56-ddfb-4a80-8df7-33d38513cf4b", "bridge": "br-int", "label": "tempest-device-tagging-net1-2047429033", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.230", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "a9fa0da4ffc3447795c69b31e4e9a8d0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap70ada3a3-18", "ovs_interfaceid": "70ada3a3-186a-425a-8c4c-7af3b2d647ef", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "bfeedb02-28d2-4e4c-8a6b-da87e4b8f9cb", "address": "fa:16:3e:c9:00:90", "network": {"id": "3143fa56-ddfb-4a80-8df7-33d38513cf4b", "bridge": "br-int", "label": "tempest-device-tagging-net1-2047429033", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.251", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "a9fa0da4ffc3447795c69b31e4e9a8d0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbfeedb02-28", "ovs_interfaceid": "bfeedb02-28d2-4e4c-8a6b-da87e4b8f9cb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "a41dc4d4-b94a-4659-8709-566b029d2b20", "address": "fa:16:3e:c3:19:36", "network": {"id": "3143fa56-ddfb-4a80-8df7-33d38513cf4b", "bridge": "br-int", "label": "tempest-device-tagging-net1-2047429033", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.253", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "a9fa0da4ffc3447795c69b31e4e9a8d0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa41dc4d4-b9", "ovs_interfaceid": "a41dc4d4-b94a-4659-8709-566b029d2b20", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "4e39483b-3a24-4948-8025-ab381a1a6eee", "address": "fa:16:3e:b3:40:e7", "network": {"id": "e20648c0-8ed3-4009-b577-e6af59d212cd", "bridge": "br-int", "label": "tempest-device-tagging-net2-1059246863", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "a9fa0da4ffc3447795c69b31e4e9a8d0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4e39483b-3a", "ovs_interfaceid": "4e39483b-3a24-4948-8025-ab381a1a6eee", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "30db35d4-e78c-414e-bae8-593d9aaadda8", "address": "fa:16:3e:a3:1f:b8", "network": {"id": "e20648c0-8ed3-4009-b577-e6af59d212cd", "bridge": "br-int", "label": "tempest-device-tagging-net2-1059246863", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "a9fa0da4ffc3447795c69b31e4e9a8d0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap30db35d4-e7", "ovs_interfaceid": "30db35d4-e78c-414e-bae8-593d9aaadda8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74613) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 29 18:03:55 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-cd59cc03-6eb8-483d-84ca-897423765a34 req-6cb85706-361d-4d76-9606-2498a748625e service nova] Acquired lock "refresh_cache-56de3dd1-6873-4c0a-9d80-58518dfd671e" {{(pid=74613) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 18:03:55 user nova-compute[74613]: DEBUG nova.network.neutron [req-cd59cc03-6eb8-483d-84ca-897423765a34 req-6cb85706-361d-4d76-9606-2498a748625e service nova] [instance: 56de3dd1-6873-4c0a-9d80-58518dfd671e] Refreshing network info cache for port 30db35d4-e78c-414e-bae8-593d9aaadda8 {{(pid=74613) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 18:03:56 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 18:03:56 user nova-compute[74613]: DEBUG nova.network.neutron [req-cd59cc03-6eb8-483d-84ca-897423765a34 req-6cb85706-361d-4d76-9606-2498a748625e service nova] [instance: 56de3dd1-6873-4c0a-9d80-58518dfd671e] Updated VIF entry in instance network info cache for port 30db35d4-e78c-414e-bae8-593d9aaadda8. {{(pid=74613) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 18:03:56 user nova-compute[74613]: DEBUG nova.network.neutron [req-cd59cc03-6eb8-483d-84ca-897423765a34 req-6cb85706-361d-4d76-9606-2498a748625e service nova] [instance: 56de3dd1-6873-4c0a-9d80-58518dfd671e] Updating instance_info_cache with network_info: [{"id": "fd1eeb3e-46e9-441a-90e1-048c5ad64d0e", "address": "fa:16:3e:23:fc:5e", "network": {"id": "de42d2ca-c48c-4dc3-8b92-61dc7cbafb64", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-203953398-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a9fa0da4ffc3447795c69b31e4e9a8d0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfd1eeb3e-46", "ovs_interfaceid": "fd1eeb3e-46e9-441a-90e1-048c5ad64d0e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "7d1e40a2-4a06-4e8e-935c-3d66553dac82", "address": "fa:16:3e:a9:89:7f", "network": {"id": "3143fa56-ddfb-4a80-8df7-33d38513cf4b", "bridge": "br-int", "label": "tempest-device-tagging-net1-2047429033", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.201", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "a9fa0da4ffc3447795c69b31e4e9a8d0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7d1e40a2-4a", "ovs_interfaceid": "7d1e40a2-4a06-4e8e-935c-3d66553dac82", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "70ada3a3-186a-425a-8c4c-7af3b2d647ef", "address": "fa:16:3e:7f:89:6c", "network": {"id": "3143fa56-ddfb-4a80-8df7-33d38513cf4b", "bridge": "br-int", "label": "tempest-device-tagging-net1-2047429033", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.230", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "a9fa0da4ffc3447795c69b31e4e9a8d0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap70ada3a3-18", "ovs_interfaceid": "70ada3a3-186a-425a-8c4c-7af3b2d647ef", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "bfeedb02-28d2-4e4c-8a6b-da87e4b8f9cb", "address": "fa:16:3e:c9:00:90", "network": {"id": "3143fa56-ddfb-4a80-8df7-33d38513cf4b", "bridge": "br-int", "label": "tempest-device-tagging-net1-2047429033", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.251", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "a9fa0da4ffc3447795c69b31e4e9a8d0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbfeedb02-28", "ovs_interfaceid": "bfeedb02-28d2-4e4c-8a6b-da87e4b8f9cb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "a41dc4d4-b94a-4659-8709-566b029d2b20", "address": "fa:16:3e:c3:19:36", "network": {"id": "3143fa56-ddfb-4a80-8df7-33d38513cf4b", "bridge": "br-int", "label": "tempest-device-tagging-net1-2047429033", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.253", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "a9fa0da4ffc3447795c69b31e4e9a8d0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa41dc4d4-b9", "ovs_interfaceid": "a41dc4d4-b94a-4659-8709-566b029d2b20", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "4e39483b-3a24-4948-8025-ab381a1a6eee", "address": "fa:16:3e:b3:40:e7", "network": {"id": "e20648c0-8ed3-4009-b577-e6af59d212cd", "bridge": "br-int", "label": "tempest-device-tagging-net2-1059246863", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "a9fa0da4ffc3447795c69b31e4e9a8d0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4e39483b-3a", "ovs_interfaceid": "4e39483b-3a24-4948-8025-ab381a1a6eee", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "30db35d4-e78c-414e-bae8-593d9aaadda8", "address": "fa:16:3e:a3:1f:b8", "network": {"id": "e20648c0-8ed3-4009-b577-e6af59d212cd", "bridge": "br-int", "label": "tempest-device-tagging-net2-1059246863", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "a9fa0da4ffc3447795c69b31e4e9a8d0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap30db35d4-e7", "ovs_interfaceid": "30db35d4-e78c-414e-bae8-593d9aaadda8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74613) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 18:03:56 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-cd59cc03-6eb8-483d-84ca-897423765a34 req-6cb85706-361d-4d76-9606-2498a748625e service nova] Releasing lock "refresh_cache-56de3dd1-6873-4c0a-9d80-58518dfd671e" {{(pid=74613) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 18:03:59 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:04:00 user nova-compute[74613]: DEBUG os_brick.utils [None req-47de4061-32fc-432c-a5e2-b796d21354d4 tempest-ServerBootFromVolumeStableRescueTest-414665510 tempest-ServerBootFromVolumeStableRescueTest-414665510-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74613) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 18:04:00 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:04:00 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:04:00 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[1fbc1199-2990-47ff-9631-1b6bf119eec3]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:400972819b5\n', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 18:04:00 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:04:00 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:04:00 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d35e921-f472-4851-a230-19ac81c7edc6]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 18:04:00 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:04:00 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:04:00 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e0d80a9-7035-4756-bdc7-0181b88023f5]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 18:04:00 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9f981d4-5c00-437a-aafb-6af3cae6fca5]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 18:04:00 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-47de4061-32fc-432c-a5e2-b796d21354d4 tempest-ServerBootFromVolumeStableRescueTest-414665510 tempest-ServerBootFromVolumeStableRescueTest-414665510-project-member] Running cmd (subprocess): nvme version {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:04:00 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-47de4061-32fc-432c-a5e2-b796d21354d4 tempest-ServerBootFromVolumeStableRescueTest-414665510 tempest-ServerBootFromVolumeStableRescueTest-414665510-project-member] 'nvme version' failed. Not Retrying. {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 18:04:00 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.nvmeof [None req-47de4061-32fc-432c-a5e2-b796d21354d4 tempest-ServerBootFromVolumeStableRescueTest-414665510 tempest-ServerBootFromVolumeStableRescueTest-414665510-project-member] nvme not present on system {{(pid=74613) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 29 18:04:00 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:04:00 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 18:04:00 user nova-compute[74613]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 29 18:04:00 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[674af7dd-abe6-4b58-b1fa-bdbf0173afa7]: (4, '') {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 18:04:00 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.lightos [None req-47de4061-32fc-432c-a5e2-b796d21354d4 tempest-ServerBootFromVolumeStableRescueTest-414665510 tempest-ServerBootFromVolumeStableRescueTest-414665510-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74613) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 29 18:04:00 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.lightos [None req-47de4061-32fc-432c-a5e2-b796d21354d4 tempest-ServerBootFromVolumeStableRescueTest-414665510 tempest-ServerBootFromVolumeStableRescueTest-414665510-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74613) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 29 18:04:00 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.lightos [None req-47de4061-32fc-432c-a5e2-b796d21354d4 tempest-ServerBootFromVolumeStableRescueTest-414665510 tempest-ServerBootFromVolumeStableRescueTest-414665510-project-member] LIGHTOS: no hostnqn found. {{(pid=74613) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 29 18:04:00 user nova-compute[74613]: DEBUG os_brick.utils [None req-47de4061-32fc-432c-a5e2-b796d21354d4 tempest-ServerBootFromVolumeStableRescueTest-414665510 tempest-ServerBootFromVolumeStableRescueTest-414665510-project-member] <== get_connector_properties: return (118ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:400972819b5', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74613) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 18:04:00 user nova-compute[74613]: DEBUG nova.virt.block_device [None req-47de4061-32fc-432c-a5e2-b796d21354d4 tempest-ServerBootFromVolumeStableRescueTest-414665510 tempest-ServerBootFromVolumeStableRescueTest-414665510-project-member] [instance: d3c285cd-9f39-423c-a324-30a48a9c66be] Updating existing volume attachment record: 6480a3ea-ad01-4fc4-a799-a149b073445c {{(pid=74613) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 29 18:04:01 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:04:01 user nova-compute[74613]: INFO nova.virt.block_device [None req-5d8a83ba-92bc-4e1d-9331-d030cb74bfa2 tempest-TaggedBootDevicesTest-477858861 tempest-TaggedBootDevicesTest-477858861-project-member] [instance: 56de3dd1-6873-4c0a-9d80-58518dfd671e] Booting with volume 01de4abf-62b4-4200-97dc-9a38d07324e5 at /dev/vdc
Nov 29 18:04:01 user nova-compute[74613]: DEBUG os_brick.utils [None req-5d8a83ba-92bc-4e1d-9331-d030cb74bfa2 tempest-TaggedBootDevicesTest-477858861 tempest-TaggedBootDevicesTest-477858861-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74613) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 18:04:01 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:04:01 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:04:01 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[9765adbf-4618-4394-aaab-09033666459f]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:400972819b5\n', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 18:04:01 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:04:01 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:04:01 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[535bbb65-579e-4b22-91da-2c7858e31821]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 18:04:01 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:04:01 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:04:01 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[5982b1f4-8fe2-4a29-a57d-70303fc1c63a]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 18:04:01 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[9cd41d15-e04f-4cf6-9b04-2449e3b4228b]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 18:04:01 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-5d8a83ba-92bc-4e1d-9331-d030cb74bfa2 tempest-TaggedBootDevicesTest-477858861 tempest-TaggedBootDevicesTest-477858861-project-member] Running cmd (subprocess): nvme version {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:04:01 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-5d8a83ba-92bc-4e1d-9331-d030cb74bfa2 tempest-TaggedBootDevicesTest-477858861 tempest-TaggedBootDevicesTest-477858861-project-member] 'nvme version' failed. Not Retrying. {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 18:04:01 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.nvmeof [None req-5d8a83ba-92bc-4e1d-9331-d030cb74bfa2 tempest-TaggedBootDevicesTest-477858861 tempest-TaggedBootDevicesTest-477858861-project-member] nvme not present on system {{(pid=74613) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 29 18:04:01 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:04:01 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 18:04:01 user nova-compute[74613]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 29 18:04:01 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a5e2a23-8054-48c2-aa74-a6a411a17893]: (4, '') {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 18:04:01 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.lightos [None req-5d8a83ba-92bc-4e1d-9331-d030cb74bfa2 tempest-TaggedBootDevicesTest-477858861 tempest-TaggedBootDevicesTest-477858861-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74613) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 29 18:04:01 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.lightos [None req-5d8a83ba-92bc-4e1d-9331-d030cb74bfa2 tempest-TaggedBootDevicesTest-477858861 tempest-TaggedBootDevicesTest-477858861-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74613) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 29 18:04:01 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.lightos [None req-5d8a83ba-92bc-4e1d-9331-d030cb74bfa2 tempest-TaggedBootDevicesTest-477858861 tempest-TaggedBootDevicesTest-477858861-project-member] LIGHTOS: no hostnqn found. {{(pid=74613) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 29 18:04:01 user nova-compute[74613]: DEBUG os_brick.utils [None req-5d8a83ba-92bc-4e1d-9331-d030cb74bfa2 tempest-TaggedBootDevicesTest-477858861 tempest-TaggedBootDevicesTest-477858861-project-member] <== get_connector_properties: return (117ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:400972819b5', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74613) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 18:04:01 user nova-compute[74613]: DEBUG nova.virt.block_device [None req-5d8a83ba-92bc-4e1d-9331-d030cb74bfa2 tempest-TaggedBootDevicesTest-477858861 tempest-TaggedBootDevicesTest-477858861-project-member] [instance: 56de3dd1-6873-4c0a-9d80-58518dfd671e] Updating existing volume attachment record: 623b5677-f4ed-4dba-8128-bc47d4fbe33a {{(pid=74613) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 29 18:04:06 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:04:08 user nova-compute[74613]: DEBUG nova.compute.manager [None req-47de4061-32fc-432c-a5e2-b796d21354d4 tempest-ServerBootFromVolumeStableRescueTest-414665510 tempest-ServerBootFromVolumeStableRescueTest-414665510-project-member] [instance: d3c285cd-9f39-423c-a324-30a48a9c66be] Start spawning the instance on the hypervisor. {{(pid=74613) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 29 18:04:08 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-47de4061-32fc-432c-a5e2-b796d21354d4 tempest-ServerBootFromVolumeStableRescueTest-414665510 tempest-ServerBootFromVolumeStableRescueTest-414665510-project-member] [instance: d3c285cd-9f39-423c-a324-30a48a9c66be] Creating instance directory {{(pid=74613) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 29 18:04:08 user nova-compute[74613]: INFO nova.virt.libvirt.driver [None req-47de4061-32fc-432c-a5e2-b796d21354d4 tempest-ServerBootFromVolumeStableRescueTest-414665510 tempest-ServerBootFromVolumeStableRescueTest-414665510-project-member] [instance: d3c285cd-9f39-423c-a324-30a48a9c66be] Creating image(s)
Nov 29 18:04:08 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-47de4061-32fc-432c-a5e2-b796d21354d4 tempest-ServerBootFromVolumeStableRescueTest-414665510 tempest-ServerBootFromVolumeStableRescueTest-414665510-project-member] [instance: d3c285cd-9f39-423c-a324-30a48a9c66be] Did not create local disks {{(pid=74613) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 29 18:04:08 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-47de4061-32fc-432c-a5e2-b796d21354d4 tempest-ServerBootFromVolumeStableRescueTest-414665510 tempest-ServerBootFromVolumeStableRescueTest-414665510-project-member] [instance: d3c285cd-9f39-423c-a324-30a48a9c66be] Ensure instance console log exists: /opt/stack/data/nova/instances/d3c285cd-9f39-423c-a324-30a48a9c66be/console.log {{(pid=74613) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 29 18:04:08 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-47de4061-32fc-432c-a5e2-b796d21354d4 tempest-ServerBootFromVolumeStableRescueTest-414665510 tempest-ServerBootFromVolumeStableRescueTest-414665510-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 18:04:08 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-47de4061-32fc-432c-a5e2-b796d21354d4 tempest-ServerBootFromVolumeStableRescueTest-414665510 tempest-ServerBootFromVolumeStableRescueTest-414665510-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 18:04:08 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-47de4061-32fc-432c-a5e2-b796d21354d4 tempest-ServerBootFromVolumeStableRescueTest-414665510 tempest-ServerBootFromVolumeStableRescueTest-414665510-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 18:04:08 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-47de4061-32fc-432c-a5e2-b796d21354d4 tempest-ServerBootFromVolumeStableRescueTest-414665510 tempest-ServerBootFromVolumeStableRescueTest-414665510-project-member] [instance: d3c285cd-9f39-423c-a324-30a48a9c66be] Start _get_guest_xml network_info=[{"id": "663e4724-b31b-469d-a5ea-c2802db1e0c8", "address": "fa:16:3e:11:80:42", "network": {"id": "0722b02d-a357-4360-87e8-580913723985", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-579793494-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b820dd795dfe46cd804772f0e71f98e9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap663e4724-b3", "ovs_interfaceid": "663e4724-b31b-469d-a5ea-c2802db1e0c8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-29T17:47:38Z,direct_url=<?>,disk_format='qcow2',id=4217f428-8d9d-4ee1-9614-642d26d90c46,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='794b07cbd46a44b5865cfda741036bae',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-29T17:47:40Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:b9aad94d-fe0d-415d-9761-9aff25cc6099', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UhRblKdm', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'd3c285cd-9f39-423c-a324-30a48a9c66be', 'attached_at': '', 'detached_at': '', 'volume_id': 'b9aad94d-fe0d-415d-9761-9aff25cc6099', 'serial': 'b9aad94d-fe0d-415d-9761-9aff25cc6099'}, 'mount_device': '/dev/vda', 'delete_on_termination': False, 'device_type': 'disk', 'boot_index': 0, 'guest_format': None, 'attachment_id': '6480a3ea-ad01-4fc4-a799-a149b073445c', 'disk_bus': 'virtio', 'volume_type': None} {{(pid=74613) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 29 18:04:08 user nova-compute[74613]: WARNING nova.virt.libvirt.driver [None req-47de4061-32fc-432c-a5e2-b796d21354d4 tempest-ServerBootFromVolumeStableRescueTest-414665510 tempest-ServerBootFromVolumeStableRescueTest-414665510-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 18:04:08 user nova-compute[74613]: WARNING nova.virt.libvirt.driver [None req-47de4061-32fc-432c-a5e2-b796d21354d4 tempest-ServerBootFromVolumeStableRescueTest-414665510 tempest-ServerBootFromVolumeStableRescueTest-414665510-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 18:04:08 user nova-compute[74613]: DEBUG nova.virt.libvirt.host [None req-47de4061-32fc-432c-a5e2-b796d21354d4 tempest-ServerBootFromVolumeStableRescueTest-414665510 tempest-ServerBootFromVolumeStableRescueTest-414665510-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74613) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 29 18:04:08 user nova-compute[74613]: DEBUG nova.virt.libvirt.host [None req-47de4061-32fc-432c-a5e2-b796d21354d4 tempest-ServerBootFromVolumeStableRescueTest-414665510 tempest-ServerBootFromVolumeStableRescueTest-414665510-project-member] CPU controller missing on host. {{(pid=74613) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 29 18:04:08 user nova-compute[74613]: DEBUG nova.virt.libvirt.host [None req-47de4061-32fc-432c-a5e2-b796d21354d4 tempest-ServerBootFromVolumeStableRescueTest-414665510 tempest-ServerBootFromVolumeStableRescueTest-414665510-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74613) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 29 18:04:08 user nova-compute[74613]: DEBUG nova.virt.libvirt.host [None req-47de4061-32fc-432c-a5e2-b796d21354d4 tempest-ServerBootFromVolumeStableRescueTest-414665510 tempest-ServerBootFromVolumeStableRescueTest-414665510-project-member] CPU controller found on host. {{(pid=74613) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 29 18:04:08 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-47de4061-32fc-432c-a5e2-b796d21354d4 tempest-ServerBootFromVolumeStableRescueTest-414665510 tempest-ServerBootFromVolumeStableRescueTest-414665510-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74613) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 29 18:04:08 user nova-compute[74613]: DEBUG nova.virt.hardware [None req-47de4061-32fc-432c-a5e2-b796d21354d4 tempest-ServerBootFromVolumeStableRescueTest-414665510 tempest-ServerBootFromVolumeStableRescueTest-414665510-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-29T17:47:27Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-29T17:47:38Z,direct_url=<?>,disk_format='qcow2',id=4217f428-8d9d-4ee1-9614-642d26d90c46,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='794b07cbd46a44b5865cfda741036bae',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-29T17:47:40Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74613) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 29 18:04:08 user nova-compute[74613]: DEBUG nova.virt.hardware [None req-47de4061-32fc-432c-a5e2-b796d21354d4 tempest-ServerBootFromVolumeStableRescueTest-414665510 tempest-ServerBootFromVolumeStableRescueTest-414665510-project-member] Flavor limits 0:0:0 {{(pid=74613) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 29 18:04:08 user nova-compute[74613]: DEBUG nova.virt.hardware [None req-47de4061-32fc-432c-a5e2-b796d21354d4 tempest-ServerBootFromVolumeStableRescueTest-414665510 tempest-ServerBootFromVolumeStableRescueTest-414665510-project-member] Image limits 0:0:0 {{(pid=74613) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 29 18:04:08 user nova-compute[74613]: DEBUG nova.virt.hardware [None req-47de4061-32fc-432c-a5e2-b796d21354d4 tempest-ServerBootFromVolumeStableRescueTest-414665510 tempest-ServerBootFromVolumeStableRescueTest-414665510-project-member] Flavor pref 0:0:0 {{(pid=74613) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 29 18:04:08 user nova-compute[74613]: DEBUG nova.virt.hardware [None req-47de4061-32fc-432c-a5e2-b796d21354d4 tempest-ServerBootFromVolumeStableRescueTest-414665510 tempest-ServerBootFromVolumeStableRescueTest-414665510-project-member] Image pref 0:0:0 {{(pid=74613) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 29 18:04:08 user nova-compute[74613]: DEBUG nova.virt.hardware [None req-47de4061-32fc-432c-a5e2-b796d21354d4 tempest-ServerBootFromVolumeStableRescueTest-414665510 tempest-ServerBootFromVolumeStableRescueTest-414665510-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74613) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 29 18:04:08 user nova-compute[74613]: DEBUG nova.virt.hardware [None req-47de4061-32fc-432c-a5e2-b796d21354d4 tempest-ServerBootFromVolumeStableRescueTest-414665510 tempest-ServerBootFromVolumeStableRescueTest-414665510-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74613) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 29 18:04:08 user nova-compute[74613]: DEBUG nova.virt.hardware [None req-47de4061-32fc-432c-a5e2-b796d21354d4 tempest-ServerBootFromVolumeStableRescueTest-414665510 tempest-ServerBootFromVolumeStableRescueTest-414665510-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74613) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 29 18:04:08 user nova-compute[74613]: DEBUG nova.virt.hardware [None req-47de4061-32fc-432c-a5e2-b796d21354d4 tempest-ServerBootFromVolumeStableRescueTest-414665510 tempest-ServerBootFromVolumeStableRescueTest-414665510-project-member] Got 1 possible topologies {{(pid=74613) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 29 18:04:08 user nova-compute[74613]: DEBUG nova.virt.hardware [None req-47de4061-32fc-432c-a5e2-b796d21354d4 tempest-ServerBootFromVolumeStableRescueTest-414665510 tempest-ServerBootFromVolumeStableRescueTest-414665510-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74613) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 29 18:04:08 user nova-compute[74613]: DEBUG nova.virt.hardware [None req-47de4061-32fc-432c-a5e2-b796d21354d4 tempest-ServerBootFromVolumeStableRescueTest-414665510 tempest-ServerBootFromVolumeStableRescueTest-414665510-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74613) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 29 18:04:09 user nova-compute[74613]: DEBUG nova.virt.libvirt.volume.iscsi [None req-47de4061-32fc-432c-a5e2-b796d21354d4 tempest-ServerBootFromVolumeStableRescueTest-414665510 tempest-ServerBootFromVolumeStableRescueTest-414665510-project-member] [instance: d3c285cd-9f39-423c-a324-30a48a9c66be] Calling os-brick to attach iSCSI Volume {{(pid=74613) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 29 18:04:09 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-47de4061-32fc-432c-a5e2-b796d21354d4 tempest-ServerBootFromVolumeStableRescueTest-414665510 tempest-ServerBootFromVolumeStableRescueTest-414665510-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff828156890>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:b9aad94d-fe0d-415d-9761-9aff25cc6099', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UhRblKdm', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74613) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 18:04:09 user nova-compute[74613]: WARNING os_brick.initiator.connectors.base [None req-47de4061-32fc-432c-a5e2-b796d21354d4 tempest-ServerBootFromVolumeStableRescueTest-414665510 tempest-ServerBootFromVolumeStableRescueTest-414665510-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 18:04:09 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.base [None req-47de4061-32fc-432c-a5e2-b796d21354d4 tempest-ServerBootFromVolumeStableRescueTest-414665510 tempest-ServerBootFromVolumeStableRescueTest-414665510-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 18:04:09 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.base [None req-47de4061-32fc-432c-a5e2-b796d21354d4 tempest-ServerBootFromVolumeStableRescueTest-414665510 tempest-ServerBootFromVolumeStableRescueTest-414665510-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 18:04:09 user nova-compute[74613]: WARNING os_brick.initiator.connectors.base [None req-47de4061-32fc-432c-a5e2-b796d21354d4 tempest-ServerBootFromVolumeStableRescueTest-414665510 tempest-ServerBootFromVolumeStableRescueTest-414665510-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 18:04:09 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.base [None req-47de4061-32fc-432c-a5e2-b796d21354d4 tempest-ServerBootFromVolumeStableRescueTest-414665510 tempest-ServerBootFromVolumeStableRescueTest-414665510-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b9aad94d-fe0d-415d-9761-9aff25cc6099" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 18:04:09 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.base [None req-47de4061-32fc-432c-a5e2-b796d21354d4 tempest-ServerBootFromVolumeStableRescueTest-414665510 tempest-ServerBootFromVolumeStableRescueTest-414665510-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b9aad94d-fe0d-415d-9761-9aff25cc6099" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 18:04:09 user nova-compute[74613]: INFO os_brick.initiator.connectors.iscsi [None req-47de4061-32fc-432c-a5e2-b796d21354d4 tempest-ServerBootFromVolumeStableRescueTest-414665510 tempest-ServerBootFromVolumeStableRescueTest-414665510-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 29 18:04:09 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b9aad94d-fe0d-415d-9761-9aff25cc6099 -p 172.16.0.220:3260 {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:04:09 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b9aad94d-fe0d-415d-9761-9aff25cc6099 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:04:09 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f8fe038-bde9-4936-931a-ca2f496b1323]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 18:04:09 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-47de4061-32fc-432c-a5e2-b796d21354d4 tempest-ServerBootFromVolumeStableRescueTest-414665510 tempest-ServerBootFromVolumeStableRescueTest-414665510-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 29 18:04:09 user nova-compute[74613]:  {{(pid=74613) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 18:04:09 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b9aad94d-fe0d-415d-9761-9aff25cc6099 -p 172.16.0.220:3260 --interface default --op new {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:04:09 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b9aad94d-fe0d-415d-9761-9aff25cc6099 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:04:09 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3c546eb-94b7-4e46-bbe4-6804c36867a2]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b9aad94d-fe0d-415d-9761-9aff25cc6099] added\n', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 18:04:09 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-47de4061-32fc-432c-a5e2-b796d21354d4 tempest-ServerBootFromVolumeStableRescueTest-414665510 tempest-ServerBootFromVolumeStableRescueTest-414665510-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b9aad94d-fe0d-415d-9761-9aff25cc6099] added
Nov 29 18:04:09 user nova-compute[74613]:  stderr= {{(pid=74613) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 18:04:09 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b9aad94d-fe0d-415d-9761-9aff25cc6099 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:04:09 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b9aad94d-fe0d-415d-9761-9aff25cc6099 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:04:09 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3577115-590f-4cce-803e-f6f9fafe9bd6]: (4, ('', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 18:04:09 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-47de4061-32fc-432c-a5e2-b796d21354d4 tempest-ServerBootFromVolumeStableRescueTest-414665510 tempest-ServerBootFromVolumeStableRescueTest-414665510-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74613) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 18:04:09 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b9aad94d-fe0d-415d-9761-9aff25cc6099 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:04:09 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b9aad94d-fe0d-415d-9761-9aff25cc6099 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.139s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:04:09 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[04956bb3-5a82-433f-8533-965359b246c6]: (4, ('', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 18:04:09 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-47de4061-32fc-432c-a5e2-b796d21354d4 tempest-ServerBootFromVolumeStableRescueTest-414665510 tempest-ServerBootFromVolumeStableRescueTest-414665510-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74613) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 18:04:09 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b9aad94d-fe0d-415d-9761-9aff25cc6099 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v UhRblKdm {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:04:09 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b9aad94d-fe0d-415d-9761-9aff25cc6099 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v UhRblKdm" returned: 0 in 0.021s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:04:09 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[a02648ee-0ef4-4a53-888a-915dfdc3e969]: (4, ('', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 18:04:09 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-47de4061-32fc-432c-a5e2-b796d21354d4 tempest-ServerBootFromVolumeStableRescueTest-414665510 tempest-ServerBootFromVolumeStableRescueTest-414665510-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'UhRblKdm'): stdout= stderr= {{(pid=74613) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 18:04:09 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b9aad94d-fe0d-415d-9761-9aff25cc6099 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:04:09 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b9aad94d-fe0d-415d-9761-9aff25cc6099 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.037s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:04:09 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[69dc1c52-906d-4f23-b13e-e0565daba025]: (4, ('', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 18:04:09 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-47de4061-32fc-432c-a5e2-b796d21354d4 tempest-ServerBootFromVolumeStableRescueTest-414665510 tempest-ServerBootFromVolumeStableRescueTest-414665510-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74613) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 18:04:09 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:04:09 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:04:09 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc10eefc-67e6-4638-b52a-b1387c1c07c8]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9511387c-8772-40f2-bf2d-6b6387649e9f (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8c53a27-dcde-402b-a9bb-d8642f7db0da (non-flash)\n', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 18:04:09 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-47de4061-32fc-432c-a5e2-b796d21354d4 tempest-ServerBootFromVolumeStableRescueTest-414665510 tempest-ServerBootFromVolumeStableRescueTest-414665510-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9511387c-8772-40f2-bf2d-6b6387649e9f (non-flash)
Nov 29 18:04:09 user nova-compute[74613]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8c53a27-dcde-402b-a9bb-d8642f7db0da (non-flash)
Nov 29 18:04:09 user nova-compute[74613]:  stderr= {{(pid=74613) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 18:04:09 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-47de4061-32fc-432c-a5e2-b796d21354d4 tempest-ServerBootFromVolumeStableRescueTest-414665510 tempest-ServerBootFromVolumeStableRescueTest-414665510-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9511387c-8772-40f2-bf2d-6b6387649e9f (non-flash)
Nov 29 18:04:09 user nova-compute[74613]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8c53a27-dcde-402b-a9bb-d8642f7db0da (non-flash)
Nov 29 18:04:09 user nova-compute[74613]:  stderr= {{(pid=74613) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 18:04:09 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b9aad94d-fe0d-415d-9761-9aff25cc6099 -p 172.16.0.220:3260 --login {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:04:09 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b9aad94d-fe0d-415d-9761-9aff25cc6099 -p 172.16.0.220:3260 --login" returned: 0 in 0.059s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:04:09 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae2ff06b-6759-4c03-8688-5676af36221e]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:b9aad94d-fe0d-415d-9761-9aff25cc6099, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:b9aad94d-fe0d-415d-9761-9aff25cc6099, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 18:04:09 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-47de4061-32fc-432c-a5e2-b796d21354d4 tempest-ServerBootFromVolumeStableRescueTest-414665510 tempest-ServerBootFromVolumeStableRescueTest-414665510-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:b9aad94d-fe0d-415d-9761-9aff25cc6099, portal: 172.16.0.220,3260]
Nov 29 18:04:09 user nova-compute[74613]: Login to [iface: default, target: iqn.2010-10.org.openstack:b9aad94d-fe0d-415d-9761-9aff25cc6099, portal: 172.16.0.220,3260] successful.
Nov 29 18:04:09 user nova-compute[74613]:  stderr= {{(pid=74613) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 18:04:09 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b9aad94d-fe0d-415d-9761-9aff25cc6099 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:04:09 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b9aad94d-fe0d-415d-9761-9aff25cc6099 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:04:09 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c3a5e9d-0b84-40f9-92ac-ea1a7a655a82]: (4, ('', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 18:04:09 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-47de4061-32fc-432c-a5e2-b796d21354d4 tempest-ServerBootFromVolumeStableRescueTest-414665510 tempest-ServerBootFromVolumeStableRescueTest-414665510-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74613) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 18:04:09 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:04:09 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:04:09 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a075377-13b1-4d5c-a33d-ab0031b267d1]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9511387c-8772-40f2-bf2d-6b6387649e9f (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8c53a27-dcde-402b-a9bb-d8642f7db0da (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9aad94d-fe0d-415d-9761-9aff25cc6099 (non-flash)\n', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 18:04:09 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-47de4061-32fc-432c-a5e2-b796d21354d4 tempest-ServerBootFromVolumeStableRescueTest-414665510 tempest-ServerBootFromVolumeStableRescueTest-414665510-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9511387c-8772-40f2-bf2d-6b6387649e9f (non-flash)
Nov 29 18:04:09 user nova-compute[74613]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8c53a27-dcde-402b-a9bb-d8642f7db0da (non-flash)
Nov 29 18:04:09 user nova-compute[74613]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9aad94d-fe0d-415d-9761-9aff25cc6099 (non-flash)
Nov 29 18:04:09 user nova-compute[74613]:  stderr= {{(pid=74613) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 18:04:09 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-47de4061-32fc-432c-a5e2-b796d21354d4 tempest-ServerBootFromVolumeStableRescueTest-414665510 tempest-ServerBootFromVolumeStableRescueTest-414665510-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9511387c-8772-40f2-bf2d-6b6387649e9f (non-flash)
Nov 29 18:04:09 user nova-compute[74613]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8c53a27-dcde-402b-a9bb-d8642f7db0da (non-flash)
Nov 29 18:04:09 user nova-compute[74613]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9aad94d-fe0d-415d-9761-9aff25cc6099 (non-flash)
Nov 29 18:04:09 user nova-compute[74613]:  stderr= {{(pid=74613) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 18:04:09 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.base [None req-47de4061-32fc-432c-a5e2-b796d21354d4 tempest-ServerBootFromVolumeStableRescueTest-414665510 tempest-ServerBootFromVolumeStableRescueTest-414665510-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b9aad94d-fe0d-415d-9761-9aff25cc6099" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.430s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 18:04:09 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-47de4061-32fc-432c-a5e2-b796d21354d4 tempest-ServerBootFromVolumeStableRescueTest-414665510 tempest-ServerBootFromVolumeStableRescueTest-414665510-project-member] Connected to 172.16.0.220:3260 {{(pid=74613) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 29 18:04:09 user nova-compute[74613]: DEBUG os_brick.initiator.linuxscsi [None req-47de4061-32fc-432c-a5e2-b796d21354d4 tempest-ServerBootFromVolumeStableRescueTest-414665510 tempest-ServerBootFromVolumeStableRescueTest-414665510-project-member] HCTL ('34', '-', '-', 0) found on session 29 with lun 0 {{(pid=74613) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 29 18:04:09 user nova-compute[74613]: DEBUG os_brick.initiator.linuxscsi [None req-47de4061-32fc-432c-a5e2-b796d21354d4 tempest-ServerBootFromVolumeStableRescueTest-414665510 tempest-ServerBootFromVolumeStableRescueTest-414665510-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=74613) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 29 18:04:09 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:04:09 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.017s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:04:09 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[78ee3d64-b861-4ddb-95a8-e8c1ad50bdc2]: (4, ('- - 0', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 18:04:09 user nova-compute[74613]: DEBUG os_brick.initiator.linuxscsi [None req-47de4061-32fc-432c-a5e2-b796d21354d4 tempest-ServerBootFromVolumeStableRescueTest-414665510 tempest-ServerBootFromVolumeStableRescueTest-414665510-project-member] Searching for a device in session 29 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=74613) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 29 18:04:09 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-47de4061-32fc-432c-a5e2-b796d21354d4 tempest-ServerBootFromVolumeStableRescueTest-414665510 tempest-ServerBootFromVolumeStableRescueTest-414665510-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:b9aad94d-fe0d-415d-9761-9aff25cc6099', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UhRblKdm', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74613) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 29 18:04:10 user nova-compute[74613]: DEBUG nova.compute.manager [None req-5d8a83ba-92bc-4e1d-9331-d030cb74bfa2 tempest-TaggedBootDevicesTest-477858861 tempest-TaggedBootDevicesTest-477858861-project-member] [instance: 56de3dd1-6873-4c0a-9d80-58518dfd671e] Start spawning the instance on the hypervisor. {{(pid=74613) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 29 18:04:10 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-5d8a83ba-92bc-4e1d-9331-d030cb74bfa2 tempest-TaggedBootDevicesTest-477858861 tempest-TaggedBootDevicesTest-477858861-project-member] [instance: 56de3dd1-6873-4c0a-9d80-58518dfd671e] Creating instance directory {{(pid=74613) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 29 18:04:10 user nova-compute[74613]: INFO nova.virt.libvirt.driver [None req-5d8a83ba-92bc-4e1d-9331-d030cb74bfa2 tempest-TaggedBootDevicesTest-477858861 tempest-TaggedBootDevicesTest-477858861-project-member] [instance: 56de3dd1-6873-4c0a-9d80-58518dfd671e] Creating image(s)
Nov 29 18:04:10 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-5d8a83ba-92bc-4e1d-9331-d030cb74bfa2 tempest-TaggedBootDevicesTest-477858861 tempest-TaggedBootDevicesTest-477858861-project-member] [instance: 56de3dd1-6873-4c0a-9d80-58518dfd671e] Did not create local disks {{(pid=74613) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 29 18:04:10 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-5d8a83ba-92bc-4e1d-9331-d030cb74bfa2 tempest-TaggedBootDevicesTest-477858861 tempest-TaggedBootDevicesTest-477858861-project-member] [instance: 56de3dd1-6873-4c0a-9d80-58518dfd671e] Ensure instance console log exists: /opt/stack/data/nova/instances/56de3dd1-6873-4c0a-9d80-58518dfd671e/console.log {{(pid=74613) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 29 18:04:10 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-5d8a83ba-92bc-4e1d-9331-d030cb74bfa2 tempest-TaggedBootDevicesTest-477858861 tempest-TaggedBootDevicesTest-477858861-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 18:04:10 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-5d8a83ba-92bc-4e1d-9331-d030cb74bfa2 tempest-TaggedBootDevicesTest-477858861 tempest-TaggedBootDevicesTest-477858861-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 18:04:10 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-5d8a83ba-92bc-4e1d-9331-d030cb74bfa2 tempest-TaggedBootDevicesTest-477858861 tempest-TaggedBootDevicesTest-477858861-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 18:04:10 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-5d8a83ba-92bc-4e1d-9331-d030cb74bfa2 tempest-TaggedBootDevicesTest-477858861 tempest-TaggedBootDevicesTest-477858861-project-member] [instance: 56de3dd1-6873-4c0a-9d80-58518dfd671e] Start _get_guest_xml network_info=[{"id": "fd1eeb3e-46e9-441a-90e1-048c5ad64d0e", "address": "fa:16:3e:23:fc:5e", "network": {"id": "de42d2ca-c48c-4dc3-8b92-61dc7cbafb64", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-203953398-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a9fa0da4ffc3447795c69b31e4e9a8d0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfd1eeb3e-46", "ovs_interfaceid": "fd1eeb3e-46e9-441a-90e1-048c5ad64d0e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "7d1e40a2-4a06-4e8e-935c-3d66553dac82", "address": "fa:16:3e:a9:89:7f", "network": {"id": "3143fa56-ddfb-4a80-8df7-33d38513cf4b", "bridge": "br-int", "label": "tempest-device-tagging-net1-2047429033", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.201", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "a9fa0da4ffc3447795c69b31e4e9a8d0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7d1e40a2-4a", "ovs_interfaceid": "7d1e40a2-4a06-4e8e-935c-3d66553dac82", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "70ada3a3-186a-425a-8c4c-7af3b2d647ef", "address": "fa:16:3e:7f:89:6c", "network": {"id": "3143fa56-ddfb-4a80-8df7-33d38513cf4b", "bridge": "br-int", "label": "tempest-device-tagging-net1-2047429033", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.230", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "a9fa0da4ffc3447795c69b31e4e9a8d0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap70ada3a3-18", "ovs_interfaceid": "70ada3a3-186a-425a-8c4c-7af3b2d647ef", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "bfeedb02-28d2-4e4c-8a6b-da87e4b8f9cb", "address": "fa:16:3e:c9:00:90", "network": {"id": "3143fa56-ddfb-4a80-8df7-33d38513cf4b", "bridge": "br-int", "label": "tempest-device-tagging-net1-2047429033", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.251", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "a9fa0da4ffc3447795c69b31e4e9a8d0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbfeedb02-28", "ovs_interfaceid": "bfeedb02-28d2-4e4c-8a6b-da87e4b8f9cb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "a41dc4d4-b94a-4659-8709-566b029d2b20", "address": "fa:16:3e:c3:19:36", "network": {"id": "3143fa56-ddfb-4a80-8df7-33d38513cf4b", "bridge": "br-int", "label": "tempest-device-tagging-net1-2047429033", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.253", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "a9fa0da4ffc3447795c69b31e4e9a8d0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa41dc4d4-b9", "ovs_interfaceid": "a41dc4d4-b94a-4659-8709-566b029d2b20", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "4e39483b-3a24-4948-8025-ab381a1a6eee", "address": "fa:16:3e:b3:40:e7", "network": {"id": "e20648c0-8ed3-4009-b577-e6af59d212cd", "bridge": "br-int", "label": "tempest-device-tagging-net2-1059246863", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "a9fa0da4ffc3447795c69b31e4e9a8d0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4e39483b-3a", "ovs_interfaceid": "4e39483b-3a24-4948-8025-ab381a1a6eee", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "30db35d4-e78c-414e-bae8-593d9aaadda8", "address": "fa:16:3e:a3:1f:b8", "network": {"id": "e20648c0-8ed3-4009-b577-e6af59d212cd", "bridge": "br-int", "label": "tempest-device-tagging-net2-1059246863", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "a9fa0da4ffc3447795c69b31e4e9a8d0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap30db35d4-e7", "ovs_interfaceid": "30db35d4-e78c-414e-bae8-593d9aaadda8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk', 'boot_index': '2'}, '/dev/vdc': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk', 'boot_index': '3'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-29T17:47:38Z,direct_url=<?>,disk_format='qcow2',id=4217f428-8d9d-4ee1-9614-642d26d90c46,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='794b07cbd46a44b5865cfda741036bae',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-29T17:47:40Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:32c4a58d-da1b-468d-b32a-6ff5cdc8993d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DEfHXlJY', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '56de3dd1-6873-4c0a-9d80-58518dfd671e', 'attached_at': '', 'detached_at': '', 'volume_id': '32c4a58d-da1b-468d-b32a-6ff5cdc8993d', 'serial': '32c4a58d-da1b-468d-b32a-6ff5cdc8993d'}, 'mount_device': '/dev/vda', 'delete_on_termination': False, 'device_type': 'disk', 'boot_index': 0, 'guest_format': None, 'attachment_id': 'de3c309b-8615-4381-a2b8-e9a12f36b7f4', 'disk_bus': 'virtio', 'volume_type': None}, {'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:b4a04a56-f988-4ae8-a3d3-271caf058c33', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'sMoBSTmE', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '56de3dd1-6873-4c0a-9d80-58518dfd671e', 'attached_at': '', 'detached_at': '', 'volume_id': 'b4a04a56-f988-4ae8-a3d3-271caf058c33', 'serial': 'b4a04a56-f988-4ae8-a3d3-271caf058c33'}, 'mount_device': '/dev/vdb', 'delete_on_termination': False, 'device_type': 'disk', 'boot_index': 1, 'guest_format': None, 'attachment_id': '50feb43e-e17e-4a55-900e-b7743105cb19', 'disk_bus': 'virtio', 'volume_type': None}, {'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:01de4abf-62b4-4200-97dc-9a38d07324e5', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'aCZvhqSV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '56de3dd1-6873-4c0a-9d80-58518dfd671e', 'attached_at': '', 'detached_at': '', 'volume_id': '01de4abf-62b4-4200-97dc-9a38d07324e5', 'serial': '01de4abf-62b4-4200-97dc-9a38d07324e5'}, 'mount_device': '/dev/vdc', 'delete_on_termination': False, 'device_type': 'disk', 'boot_index': 2, 'guest_format': None, 'attachment_id': '623b5677-f4ed-4dba-8128-bc47d4fbe33a', 'disk_bus': 'virtio', 'volume_type': None} {{(pid=74613) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 29 18:04:10 user nova-compute[74613]: WARNING nova.virt.libvirt.driver [None req-5d8a83ba-92bc-4e1d-9331-d030cb74bfa2 tempest-TaggedBootDevicesTest-477858861 tempest-TaggedBootDevicesTest-477858861-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 18:04:10 user nova-compute[74613]: WARNING nova.virt.libvirt.driver [None req-5d8a83ba-92bc-4e1d-9331-d030cb74bfa2 tempest-TaggedBootDevicesTest-477858861 tempest-TaggedBootDevicesTest-477858861-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 18:04:10 user nova-compute[74613]: DEBUG nova.virt.libvirt.host [None req-5d8a83ba-92bc-4e1d-9331-d030cb74bfa2 tempest-TaggedBootDevicesTest-477858861 tempest-TaggedBootDevicesTest-477858861-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74613) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 29 18:04:10 user nova-compute[74613]: DEBUG nova.virt.libvirt.host [None req-5d8a83ba-92bc-4e1d-9331-d030cb74bfa2 tempest-TaggedBootDevicesTest-477858861 tempest-TaggedBootDevicesTest-477858861-project-member] CPU controller missing on host. {{(pid=74613) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 29 18:04:10 user nova-compute[74613]: DEBUG nova.virt.libvirt.host [None req-5d8a83ba-92bc-4e1d-9331-d030cb74bfa2 tempest-TaggedBootDevicesTest-477858861 tempest-TaggedBootDevicesTest-477858861-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74613) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 29 18:04:10 user nova-compute[74613]: DEBUG nova.virt.libvirt.host [None req-5d8a83ba-92bc-4e1d-9331-d030cb74bfa2 tempest-TaggedBootDevicesTest-477858861 tempest-TaggedBootDevicesTest-477858861-project-member] CPU controller found on host. {{(pid=74613) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 29 18:04:10 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-5d8a83ba-92bc-4e1d-9331-d030cb74bfa2 tempest-TaggedBootDevicesTest-477858861 tempest-TaggedBootDevicesTest-477858861-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74613) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 29 18:04:10 user nova-compute[74613]: DEBUG nova.virt.hardware [None req-5d8a83ba-92bc-4e1d-9331-d030cb74bfa2 tempest-TaggedBootDevicesTest-477858861 tempest-TaggedBootDevicesTest-477858861-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-29T17:47:27Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-29T17:47:38Z,direct_url=<?>,disk_format='qcow2',id=4217f428-8d9d-4ee1-9614-642d26d90c46,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='794b07cbd46a44b5865cfda741036bae',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-29T17:47:40Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74613) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 29 18:04:10 user nova-compute[74613]: DEBUG nova.virt.hardware [None req-5d8a83ba-92bc-4e1d-9331-d030cb74bfa2 tempest-TaggedBootDevicesTest-477858861 tempest-TaggedBootDevicesTest-477858861-project-member] Flavor limits 0:0:0 {{(pid=74613) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 29 18:04:10 user nova-compute[74613]: DEBUG nova.virt.hardware [None req-5d8a83ba-92bc-4e1d-9331-d030cb74bfa2 tempest-TaggedBootDevicesTest-477858861 tempest-TaggedBootDevicesTest-477858861-project-member] Image limits 0:0:0 {{(pid=74613) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 29 18:04:10 user nova-compute[74613]: DEBUG nova.virt.hardware [None req-5d8a83ba-92bc-4e1d-9331-d030cb74bfa2 tempest-TaggedBootDevicesTest-477858861 tempest-TaggedBootDevicesTest-477858861-project-member] Flavor pref 0:0:0 {{(pid=74613) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 29 18:04:10 user nova-compute[74613]: DEBUG nova.virt.hardware [None req-5d8a83ba-92bc-4e1d-9331-d030cb74bfa2 tempest-TaggedBootDevicesTest-477858861 tempest-TaggedBootDevicesTest-477858861-project-member] Image pref 0:0:0 {{(pid=74613) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 29 18:04:10 user nova-compute[74613]: DEBUG nova.virt.hardware [None req-5d8a83ba-92bc-4e1d-9331-d030cb74bfa2 tempest-TaggedBootDevicesTest-477858861 tempest-TaggedBootDevicesTest-477858861-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74613) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 29 18:04:10 user nova-compute[74613]: DEBUG nova.virt.hardware [None req-5d8a83ba-92bc-4e1d-9331-d030cb74bfa2 tempest-TaggedBootDevicesTest-477858861 tempest-TaggedBootDevicesTest-477858861-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74613) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 29 18:04:10 user nova-compute[74613]: DEBUG nova.virt.hardware [None req-5d8a83ba-92bc-4e1d-9331-d030cb74bfa2 tempest-TaggedBootDevicesTest-477858861 tempest-TaggedBootDevicesTest-477858861-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74613) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 29 18:04:10 user nova-compute[74613]: DEBUG nova.virt.hardware [None req-5d8a83ba-92bc-4e1d-9331-d030cb74bfa2 tempest-TaggedBootDevicesTest-477858861 tempest-TaggedBootDevicesTest-477858861-project-member] Got 1 possible topologies {{(pid=74613) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 29 18:04:10 user nova-compute[74613]: DEBUG nova.virt.hardware [None req-5d8a83ba-92bc-4e1d-9331-d030cb74bfa2 tempest-TaggedBootDevicesTest-477858861 tempest-TaggedBootDevicesTest-477858861-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74613) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 29 18:04:10 user nova-compute[74613]: DEBUG nova.virt.hardware [None req-5d8a83ba-92bc-4e1d-9331-d030cb74bfa2 tempest-TaggedBootDevicesTest-477858861 tempest-TaggedBootDevicesTest-477858861-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74613) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 29 18:04:10 user nova-compute[74613]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5d8a83ba-92bc-4e1d-9331-d030cb74bfa2 tempest-TaggedBootDevicesTest-477858861 tempest-TaggedBootDevicesTest-477858861-project-member] [instance: 56de3dd1-6873-4c0a-9d80-58518dfd671e] Calling os-brick to attach iSCSI Volume {{(pid=74613) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 29 18:04:10 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d8a83ba-92bc-4e1d-9331-d030cb74bfa2 tempest-TaggedBootDevicesTest-477858861 tempest-TaggedBootDevicesTest-477858861-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff828156890>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:32c4a58d-da1b-468d-b32a-6ff5cdc8993d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DEfHXlJY', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74613) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 18:04:10 user nova-compute[74613]: WARNING os_brick.initiator.connectors.base [None req-5d8a83ba-92bc-4e1d-9331-d030cb74bfa2 tempest-TaggedBootDevicesTest-477858861 tempest-TaggedBootDevicesTest-477858861-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 18:04:10 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.base [None req-5d8a83ba-92bc-4e1d-9331-d030cb74bfa2 tempest-TaggedBootDevicesTest-477858861 tempest-TaggedBootDevicesTest-477858861-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 18:04:10 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.base [None req-47de4061-32fc-432c-a5e2-b796d21354d4 tempest-ServerBootFromVolumeStableRescueTest-414665510 tempest-ServerBootFromVolumeStableRescueTest-414665510-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.463s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 18:04:10 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-47de4061-32fc-432c-a5e2-b796d21354d4 tempest-ServerBootFromVolumeStableRescueTest-414665510 tempest-ServerBootFromVolumeStableRescueTest-414665510-project-member] <== connect_volume: return (1464ms) {'type': 'block', 'scsi_wwn': '23561616463656333', 'path': '/dev/sdc'} {{(pid=74613) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 18:04:10 user nova-compute[74613]: DEBUG nova.virt.libvirt.volume.iscsi [None req-47de4061-32fc-432c-a5e2-b796d21354d4 tempest-ServerBootFromVolumeStableRescueTest-414665510 tempest-ServerBootFromVolumeStableRescueTest-414665510-project-member] [instance: d3c285cd-9f39-423c-a324-30a48a9c66be] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23561616463656333', 'path': '/dev/sdc'} {{(pid=74613) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 29 18:04:10 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.base [None req-5d8a83ba-92bc-4e1d-9331-d030cb74bfa2 tempest-TaggedBootDevicesTest-477858861 tempest-TaggedBootDevicesTest-477858861-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.078s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 18:04:10 user nova-compute[74613]: WARNING os_brick.initiator.connectors.base [None req-5d8a83ba-92bc-4e1d-9331-d030cb74bfa2 tempest-TaggedBootDevicesTest-477858861 tempest-TaggedBootDevicesTest-477858861-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 18:04:10 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.base [None req-5d8a83ba-92bc-4e1d-9331-d030cb74bfa2 tempest-TaggedBootDevicesTest-477858861 tempest-TaggedBootDevicesTest-477858861-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:32c4a58d-da1b-468d-b32a-6ff5cdc8993d" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 18:04:10 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.base [None req-5d8a83ba-92bc-4e1d-9331-d030cb74bfa2 tempest-TaggedBootDevicesTest-477858861 tempest-TaggedBootDevicesTest-477858861-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:32c4a58d-da1b-468d-b32a-6ff5cdc8993d" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 18:04:10 user nova-compute[74613]: INFO os_brick.initiator.connectors.iscsi [None req-5d8a83ba-92bc-4e1d-9331-d030cb74bfa2 tempest-TaggedBootDevicesTest-477858861 tempest-TaggedBootDevicesTest-477858861-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 29 18:04:10 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:32c4a58d-da1b-468d-b32a-6ff5cdc8993d -p 172.16.0.220:3260 {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:04:10 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:32c4a58d-da1b-468d-b32a-6ff5cdc8993d -p 172.16.0.220:3260" returned: 21 in 0.024s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:04:10 user nova-compute[74613]: DEBUG nova.virt.libvirt.vif [None req-47de4061-32fc-432c-a5e2-b796d21354d4 tempest-ServerBootFromVolumeStableRescueTest-414665510 tempest-ServerBootFromVolumeStableRescueTest-414665510-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T18:03:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1343284375',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1343284375',id=27,image_ref='4217f428-8d9d-4ee1-9614-642d26d90c46',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b820dd795dfe46cd804772f0e71f98e9',ramdisk_id='',reservation_id='r-aaektgy8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='4217f428-8d9d-4ee1-9614-642d26d90c46',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-414665510',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-414665510-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T18:03:50Z,user_data=None,user_id='c65bc922e04d4d1385e48f70c460c441',uuid=d3c285cd-9f39-423c-a324-30a48a9c66be,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "663e4724-b31b-469d-a5ea-c2802db1e0c8", "address": "fa:16:3e:11:80:42", "network": {"id": "0722b02d-a357-4360-87e8-580913723985", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-579793494-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b820dd795dfe46cd804772f0e71f98e9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap663e4724-b3", "ovs_interfaceid": "663e4724-b31b-469d-a5ea-c2802db1e0c8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74613) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 29 18:04:10 user nova-compute[74613]: DEBUG nova.network.os_vif_util [None req-47de4061-32fc-432c-a5e2-b796d21354d4 tempest-ServerBootFromVolumeStableRescueTest-414665510 tempest-ServerBootFromVolumeStableRescueTest-414665510-project-member] Converting VIF {"id": "663e4724-b31b-469d-a5ea-c2802db1e0c8", "address": "fa:16:3e:11:80:42", "network": {"id": "0722b02d-a357-4360-87e8-580913723985", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-579793494-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b820dd795dfe46cd804772f0e71f98e9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap663e4724-b3", "ovs_interfaceid": "663e4724-b31b-469d-a5ea-c2802db1e0c8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74613) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 18:04:10 user nova-compute[74613]: DEBUG nova.network.os_vif_util [None req-47de4061-32fc-432c-a5e2-b796d21354d4 tempest-ServerBootFromVolumeStableRescueTest-414665510 tempest-ServerBootFromVolumeStableRescueTest-414665510-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:11:80:42,bridge_name='br-int',has_traffic_filtering=True,id=663e4724-b31b-469d-a5ea-c2802db1e0c8,network=Network(0722b02d-a357-4360-87e8-580913723985),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap663e4724-b3') {{(pid=74613) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 18:04:10 user nova-compute[74613]: DEBUG nova.objects.instance [None req-47de4061-32fc-432c-a5e2-b796d21354d4 tempest-ServerBootFromVolumeStableRescueTest-414665510 tempest-ServerBootFromVolumeStableRescueTest-414665510-project-member] Lazy-loading 'pci_devices' on Instance uuid d3c285cd-9f39-423c-a324-30a48a9c66be {{(pid=74613) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 18:04:10 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[94af74b8-0a4f-47ff-a22c-295f0ecabc63]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 18:04:10 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d8a83ba-92bc-4e1d-9331-d030cb74bfa2 tempest-TaggedBootDevicesTest-477858861 tempest-TaggedBootDevicesTest-477858861-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 29 18:04:10 user nova-compute[74613]:  {{(pid=74613) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 18:04:10 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:32c4a58d-da1b-468d-b32a-6ff5cdc8993d -p 172.16.0.220:3260 --interface default --op new {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:04:10 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-47de4061-32fc-432c-a5e2-b796d21354d4 tempest-ServerBootFromVolumeStableRescueTest-414665510 tempest-ServerBootFromVolumeStableRescueTest-414665510-project-member] [instance: d3c285cd-9f39-423c-a324-30a48a9c66be] End _get_guest_xml xml=<domain type="kvm">
Nov 29 18:04:10 user nova-compute[74613]:   <uuid>d3c285cd-9f39-423c-a324-30a48a9c66be</uuid>
Nov 29 18:04:10 user nova-compute[74613]:   <name>instance-0000001b</name>
Nov 29 18:04:10 user nova-compute[74613]:   <memory>524288</memory>
Nov 29 18:04:10 user nova-compute[74613]:   <vcpu>1</vcpu>
Nov 29 18:04:10 user nova-compute[74613]:   <metadata>
Nov 29 18:04:10 user nova-compute[74613]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 29 18:04:10 user nova-compute[74613]:       <nova:package version="0.0.0"/>
Nov 29 18:04:10 user nova-compute[74613]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-1343284375</nova:name>
Nov 29 18:04:10 user nova-compute[74613]:       <nova:creationTime>2023-11-29 18:04:08</nova:creationTime>
Nov 29 18:04:10 user nova-compute[74613]:       <nova:flavor name="m1.tiny">
Nov 29 18:04:10 user nova-compute[74613]:         <nova:memory>512</nova:memory>
Nov 29 18:04:10 user nova-compute[74613]:         <nova:disk>1</nova:disk>
Nov 29 18:04:10 user nova-compute[74613]:         <nova:swap>0</nova:swap>
Nov 29 18:04:10 user nova-compute[74613]:         <nova:ephemeral>0</nova:ephemeral>
Nov 29 18:04:10 user nova-compute[74613]:         <nova:vcpus>1</nova:vcpus>
Nov 29 18:04:10 user nova-compute[74613]:       </nova:flavor>
Nov 29 18:04:10 user nova-compute[74613]:       <nova:owner>
Nov 29 18:04:10 user nova-compute[74613]:         <nova:user uuid="c65bc922e04d4d1385e48f70c460c441">tempest-ServerBootFromVolumeStableRescueTest-414665510-project-member</nova:user>
Nov 29 18:04:10 user nova-compute[74613]:         <nova:project uuid="b820dd795dfe46cd804772f0e71f98e9">tempest-ServerBootFromVolumeStableRescueTest-414665510</nova:project>
Nov 29 18:04:10 user nova-compute[74613]:       </nova:owner>
Nov 29 18:04:10 user nova-compute[74613]:       <nova:root type="image" uuid="4217f428-8d9d-4ee1-9614-642d26d90c46"/>
Nov 29 18:04:10 user nova-compute[74613]:       <nova:ports>
Nov 29 18:04:10 user nova-compute[74613]:         <nova:port uuid="663e4724-b31b-469d-a5ea-c2802db1e0c8">
Nov 29 18:04:10 user nova-compute[74613]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Nov 29 18:04:10 user nova-compute[74613]:         </nova:port>
Nov 29 18:04:10 user nova-compute[74613]:       </nova:ports>
Nov 29 18:04:10 user nova-compute[74613]:     </nova:instance>
Nov 29 18:04:10 user nova-compute[74613]:   </metadata>
Nov 29 18:04:10 user nova-compute[74613]:   <sysinfo type="smbios">
Nov 29 18:04:10 user nova-compute[74613]:     <system>
Nov 29 18:04:10 user nova-compute[74613]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 29 18:04:10 user nova-compute[74613]:       <entry name="product">OpenStack Nova</entry>
Nov 29 18:04:10 user nova-compute[74613]:       <entry name="version">0.0.0</entry>
Nov 29 18:04:10 user nova-compute[74613]:       <entry name="serial">d3c285cd-9f39-423c-a324-30a48a9c66be</entry>
Nov 29 18:04:10 user nova-compute[74613]:       <entry name="uuid">d3c285cd-9f39-423c-a324-30a48a9c66be</entry>
Nov 29 18:04:10 user nova-compute[74613]:       <entry name="family">Virtual Machine</entry>
Nov 29 18:04:10 user nova-compute[74613]:     </system>
Nov 29 18:04:10 user nova-compute[74613]:   </sysinfo>
Nov 29 18:04:10 user nova-compute[74613]:   <os>
Nov 29 18:04:10 user nova-compute[74613]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 29 18:04:10 user nova-compute[74613]:     <boot dev="hd"/>
Nov 29 18:04:10 user nova-compute[74613]:     <smbios mode="sysinfo"/>
Nov 29 18:04:10 user nova-compute[74613]:   </os>
Nov 29 18:04:10 user nova-compute[74613]:   <features>
Nov 29 18:04:10 user nova-compute[74613]:     <acpi/>
Nov 29 18:04:10 user nova-compute[74613]:     <apic/>
Nov 29 18:04:10 user nova-compute[74613]:     <vmcoreinfo/>
Nov 29 18:04:10 user nova-compute[74613]:   </features>
Nov 29 18:04:10 user nova-compute[74613]:   <clock offset="utc">
Nov 29 18:04:10 user nova-compute[74613]:     <timer name="pit" tickpolicy="delay"/>
Nov 29 18:04:10 user nova-compute[74613]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 29 18:04:10 user nova-compute[74613]:     <timer name="hpet" present="no"/>
Nov 29 18:04:10 user nova-compute[74613]:   </clock>
Nov 29 18:04:10 user nova-compute[74613]:   <cpu mode="custom" match="exact">
Nov 29 18:04:10 user nova-compute[74613]:     <model>Nehalem</model>
Nov 29 18:04:10 user nova-compute[74613]:     <topology sockets="1" cores="1" threads="1"/>
Nov 29 18:04:10 user nova-compute[74613]:   </cpu>
Nov 29 18:04:10 user nova-compute[74613]:   <devices>
Nov 29 18:04:10 user nova-compute[74613]:     <disk type="block" device="disk">
Nov 29 18:04:10 user nova-compute[74613]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 18:04:10 user nova-compute[74613]:       <source dev="/dev/sdc"/>
Nov 29 18:04:10 user nova-compute[74613]:       <target dev="vda" bus="virtio"/>
Nov 29 18:04:10 user nova-compute[74613]:       <serial>b9aad94d-fe0d-415d-9761-9aff25cc6099</serial>
Nov 29 18:04:10 user nova-compute[74613]:     </disk>
Nov 29 18:04:10 user nova-compute[74613]:     <interface type="ethernet">
Nov 29 18:04:10 user nova-compute[74613]:       <mac address="fa:16:3e:11:80:42"/>
Nov 29 18:04:10 user nova-compute[74613]:       <model type="virtio"/>
Nov 29 18:04:10 user nova-compute[74613]:       <mtu size="1442"/>
Nov 29 18:04:10 user nova-compute[74613]:       <target dev="tap663e4724-b3"/>
Nov 29 18:04:10 user nova-compute[74613]:     </interface>
Nov 29 18:04:10 user nova-compute[74613]:     <serial type="pty">
Nov 29 18:04:10 user nova-compute[74613]:       <log file="/opt/stack/data/nova/instances/d3c285cd-9f39-423c-a324-30a48a9c66be/console.log" append="off"/>
Nov 29 18:04:10 user nova-compute[74613]:     </serial>
Nov 29 18:04:10 user nova-compute[74613]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 29 18:04:10 user nova-compute[74613]:     <video>
Nov 29 18:04:10 user nova-compute[74613]:       <model type="virtio"/>
Nov 29 18:04:10 user nova-compute[74613]:     </video>
Nov 29 18:04:10 user nova-compute[74613]:     <rng model="virtio">
Nov 29 18:04:10 user nova-compute[74613]:       <backend model="random">/dev/urandom</backend>
Nov 29 18:04:10 user nova-compute[74613]:     </rng>
Nov 29 18:04:10 user nova-compute[74613]:     <controller type="usb" index="0" model="none"/>
Nov 29 18:04:10 user nova-compute[74613]:     <memballoon model="virtio">
Nov 29 18:04:10 user nova-compute[74613]:       <stats period="10"/>
Nov 29 18:04:10 user nova-compute[74613]:     </memballoon>
Nov 29 18:04:10 user nova-compute[74613]:   </devices>
Nov 29 18:04:10 user nova-compute[74613]: </domain>
Nov 29 18:04:10 user nova-compute[74613]:  {{(pid=74613) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 29 18:04:10 user nova-compute[74613]: DEBUG nova.virt.libvirt.vif [None req-47de4061-32fc-432c-a5e2-b796d21354d4 tempest-ServerBootFromVolumeStableRescueTest-414665510 tempest-ServerBootFromVolumeStableRescueTest-414665510-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T18:03:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1343284375',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1343284375',id=27,image_ref='4217f428-8d9d-4ee1-9614-642d26d90c46',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b820dd795dfe46cd804772f0e71f98e9',ramdisk_id='',reservation_id='r-aaektgy8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='4217f428-8d9d-4ee1-9614-642d26d90c46',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-414665510',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-414665510-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T18:03:50Z,user_data=None,user_id='c65bc922e04d4d1385e48f70c460c441',uuid=d3c285cd-9f39-423c-a324-30a48a9c66be,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "663e4724-b31b-469d-a5ea-c2802db1e0c8", "address": "fa:16:3e:11:80:42", "network": {"id": "0722b02d-a357-4360-87e8-580913723985", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-579793494-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b820dd795dfe46cd804772f0e71f98e9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap663e4724-b3", "ovs_interfaceid": "663e4724-b31b-469d-a5ea-c2802db1e0c8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74613) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 29 18:04:10 user nova-compute[74613]: DEBUG nova.network.os_vif_util [None req-47de4061-32fc-432c-a5e2-b796d21354d4 tempest-ServerBootFromVolumeStableRescueTest-414665510 tempest-ServerBootFromVolumeStableRescueTest-414665510-project-member] Converting VIF {"id": "663e4724-b31b-469d-a5ea-c2802db1e0c8", "address": "fa:16:3e:11:80:42", "network": {"id": "0722b02d-a357-4360-87e8-580913723985", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-579793494-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b820dd795dfe46cd804772f0e71f98e9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap663e4724-b3", "ovs_interfaceid": "663e4724-b31b-469d-a5ea-c2802db1e0c8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74613) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 18:04:10 user nova-compute[74613]: DEBUG nova.network.os_vif_util [None req-47de4061-32fc-432c-a5e2-b796d21354d4 tempest-ServerBootFromVolumeStableRescueTest-414665510 tempest-ServerBootFromVolumeStableRescueTest-414665510-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:11:80:42,bridge_name='br-int',has_traffic_filtering=True,id=663e4724-b31b-469d-a5ea-c2802db1e0c8,network=Network(0722b02d-a357-4360-87e8-580913723985),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap663e4724-b3') {{(pid=74613) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 18:04:10 user nova-compute[74613]: DEBUG os_vif [None req-47de4061-32fc-432c-a5e2-b796d21354d4 tempest-ServerBootFromVolumeStableRescueTest-414665510 tempest-ServerBootFromVolumeStableRescueTest-414665510-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:11:80:42,bridge_name='br-int',has_traffic_filtering=True,id=663e4724-b31b-469d-a5ea-c2802db1e0c8,network=Network(0722b02d-a357-4360-87e8-580913723985),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap663e4724-b3') {{(pid=74613) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 29 18:04:10 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:32c4a58d-da1b-468d-b32a-6ff5cdc8993d -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:04:10 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[369e389c-cf2a-4701-9ed3-84446cb12841]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:32c4a58d-da1b-468d-b32a-6ff5cdc8993d] added\n', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 18:04:10 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:04:10 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74613) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 18:04:10 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74613) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 29 18:04:10 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d8a83ba-92bc-4e1d-9331-d030cb74bfa2 tempest-TaggedBootDevicesTest-477858861 tempest-TaggedBootDevicesTest-477858861-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:32c4a58d-da1b-468d-b32a-6ff5cdc8993d] added
Nov 29 18:04:10 user nova-compute[74613]:  stderr= {{(pid=74613) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 18:04:10 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:32c4a58d-da1b-468d-b32a-6ff5cdc8993d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:04:10 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:04:10 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '3247b325-e32e-5402-911e-4da4d33813db', '_type': 'linux-noop'}}, row=False) {{(pid=74613) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 18:04:10 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:04:10 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 18:04:10 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:04:10 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap663e4724-b3, may_exist=True, interface_attrs={}) {{(pid=74613) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 18:04:10 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap663e4724-b3, col_values=(('qos', UUID('8f809c86-18f0-45f4-bd4f-dc6a43754cef')),), if_exists=True) {{(pid=74613) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 18:04:10 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap663e4724-b3, col_values=(('external_ids', {'iface-id': '663e4724-b31b-469d-a5ea-c2802db1e0c8', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:11:80:42', 'vm-uuid': 'd3c285cd-9f39-423c-a324-30a48a9c66be'}),), if_exists=True) {{(pid=74613) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 18:04:10 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:04:10 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 18:04:10 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:32c4a58d-da1b-468d-b32a-6ff5cdc8993d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:04:10 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a194eec-e520-4753-9e15-720c01b008c6]: (4, ('', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 18:04:10 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d8a83ba-92bc-4e1d-9331-d030cb74bfa2 tempest-TaggedBootDevicesTest-477858861 tempest-TaggedBootDevicesTest-477858861-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74613) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 18:04:10 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:32c4a58d-da1b-468d-b32a-6ff5cdc8993d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:04:10 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:04:10 user nova-compute[74613]: INFO os_vif [None req-47de4061-32fc-432c-a5e2-b796d21354d4 tempest-ServerBootFromVolumeStableRescueTest-414665510 tempest-ServerBootFromVolumeStableRescueTest-414665510-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:11:80:42,bridge_name='br-int',has_traffic_filtering=True,id=663e4724-b31b-469d-a5ea-c2802db1e0c8,network=Network(0722b02d-a357-4360-87e8-580913723985),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap663e4724-b3')
Nov 29 18:04:10 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:32c4a58d-da1b-468d-b32a-6ff5cdc8993d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:04:10 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c74c229-bbd8-4660-b8dd-cb421838dec0]: (4, ('', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 18:04:10 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d8a83ba-92bc-4e1d-9331-d030cb74bfa2 tempest-TaggedBootDevicesTest-477858861 tempest-TaggedBootDevicesTest-477858861-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74613) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 18:04:10 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:32c4a58d-da1b-468d-b32a-6ff5cdc8993d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v DEfHXlJY {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:04:10 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:32c4a58d-da1b-468d-b32a-6ff5cdc8993d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v DEfHXlJY" returned: 0 in 0.019s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:04:10 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b02245d-7195-482c-b52e-080f504344c6]: (4, ('', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 18:04:10 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d8a83ba-92bc-4e1d-9331-d030cb74bfa2 tempest-TaggedBootDevicesTest-477858861 tempest-TaggedBootDevicesTest-477858861-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'DEfHXlJY'): stdout= stderr= {{(pid=74613) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 18:04:10 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:32c4a58d-da1b-468d-b32a-6ff5cdc8993d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:04:10 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:32c4a58d-da1b-468d-b32a-6ff5cdc8993d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:04:10 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ebe7ad6-9b58-4704-af1d-1cbe24f62597]: (4, ('', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 18:04:10 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d8a83ba-92bc-4e1d-9331-d030cb74bfa2 tempest-TaggedBootDevicesTest-477858861 tempest-TaggedBootDevicesTest-477858861-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74613) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 18:04:10 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:04:10 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-47de4061-32fc-432c-a5e2-b796d21354d4 tempest-ServerBootFromVolumeStableRescueTest-414665510 tempest-ServerBootFromVolumeStableRescueTest-414665510-project-member] No BDM found with device name vda, not building metadata. {{(pid=74613) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 18:04:10 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-47de4061-32fc-432c-a5e2-b796d21354d4 tempest-ServerBootFromVolumeStableRescueTest-414665510 tempest-ServerBootFromVolumeStableRescueTest-414665510-project-member] No VIF found with MAC fa:16:3e:11:80:42, not building metadata {{(pid=74613) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 29 18:04:10 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:04:10 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a367e3b-f788-4c8e-a618-a363a49659e6]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9511387c-8772-40f2-bf2d-6b6387649e9f (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8c53a27-dcde-402b-a9bb-d8642f7db0da (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9aad94d-fe0d-415d-9761-9aff25cc6099 (non-flash)\n', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 18:04:10 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d8a83ba-92bc-4e1d-9331-d030cb74bfa2 tempest-TaggedBootDevicesTest-477858861 tempest-TaggedBootDevicesTest-477858861-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9511387c-8772-40f2-bf2d-6b6387649e9f (non-flash)
Nov 29 18:04:10 user nova-compute[74613]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8c53a27-dcde-402b-a9bb-d8642f7db0da (non-flash)
Nov 29 18:04:10 user nova-compute[74613]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9aad94d-fe0d-415d-9761-9aff25cc6099 (non-flash)
Nov 29 18:04:10 user nova-compute[74613]:  stderr= {{(pid=74613) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 18:04:10 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d8a83ba-92bc-4e1d-9331-d030cb74bfa2 tempest-TaggedBootDevicesTest-477858861 tempest-TaggedBootDevicesTest-477858861-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9511387c-8772-40f2-bf2d-6b6387649e9f (non-flash)
Nov 29 18:04:10 user nova-compute[74613]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8c53a27-dcde-402b-a9bb-d8642f7db0da (non-flash)
Nov 29 18:04:10 user nova-compute[74613]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9aad94d-fe0d-415d-9761-9aff25cc6099 (non-flash)
Nov 29 18:04:10 user nova-compute[74613]:  stderr= {{(pid=74613) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 18:04:10 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:32c4a58d-da1b-468d-b32a-6ff5cdc8993d -p 172.16.0.220:3260 --login {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:04:10 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:32c4a58d-da1b-468d-b32a-6ff5cdc8993d -p 172.16.0.220:3260 --login" returned: 0 in 0.064s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:04:10 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[503958ea-a29c-41e8-9041-1f4557202517]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:32c4a58d-da1b-468d-b32a-6ff5cdc8993d, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:32c4a58d-da1b-468d-b32a-6ff5cdc8993d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 18:04:10 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d8a83ba-92bc-4e1d-9331-d030cb74bfa2 tempest-TaggedBootDevicesTest-477858861 tempest-TaggedBootDevicesTest-477858861-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:32c4a58d-da1b-468d-b32a-6ff5cdc8993d, portal: 172.16.0.220,3260]
Nov 29 18:04:10 user nova-compute[74613]: Login to [iface: default, target: iqn.2010-10.org.openstack:32c4a58d-da1b-468d-b32a-6ff5cdc8993d, portal: 172.16.0.220,3260] successful.
Nov 29 18:04:10 user nova-compute[74613]:  stderr= {{(pid=74613) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 18:04:10 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:32c4a58d-da1b-468d-b32a-6ff5cdc8993d -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:04:10 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:32c4a58d-da1b-468d-b32a-6ff5cdc8993d -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.017s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:04:10 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[e91fc950-714f-4195-aaf1-d46550ae0a25]: (4, ('', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 18:04:10 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d8a83ba-92bc-4e1d-9331-d030cb74bfa2 tempest-TaggedBootDevicesTest-477858861 tempest-TaggedBootDevicesTest-477858861-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74613) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 18:04:10 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:04:10 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:04:10 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[c442edf3-d0b3-40bb-a9a0-74297fe3b229]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9511387c-8772-40f2-bf2d-6b6387649e9f (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8c53a27-dcde-402b-a9bb-d8642f7db0da (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9aad94d-fe0d-415d-9761-9aff25cc6099 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:32c4a58d-da1b-468d-b32a-6ff5cdc8993d (non-flash)\n', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 18:04:10 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d8a83ba-92bc-4e1d-9331-d030cb74bfa2 tempest-TaggedBootDevicesTest-477858861 tempest-TaggedBootDevicesTest-477858861-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9511387c-8772-40f2-bf2d-6b6387649e9f (non-flash)
Nov 29 18:04:10 user nova-compute[74613]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8c53a27-dcde-402b-a9bb-d8642f7db0da (non-flash)
Nov 29 18:04:10 user nova-compute[74613]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9aad94d-fe0d-415d-9761-9aff25cc6099 (non-flash)
Nov 29 18:04:10 user nova-compute[74613]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:32c4a58d-da1b-468d-b32a-6ff5cdc8993d (non-flash)
Nov 29 18:04:10 user nova-compute[74613]:  stderr= {{(pid=74613) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 18:04:10 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d8a83ba-92bc-4e1d-9331-d030cb74bfa2 tempest-TaggedBootDevicesTest-477858861 tempest-TaggedBootDevicesTest-477858861-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9511387c-8772-40f2-bf2d-6b6387649e9f (non-flash)
Nov 29 18:04:10 user nova-compute[74613]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8c53a27-dcde-402b-a9bb-d8642f7db0da (non-flash)
Nov 29 18:04:10 user nova-compute[74613]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9aad94d-fe0d-415d-9761-9aff25cc6099 (non-flash)
Nov 29 18:04:10 user nova-compute[74613]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:32c4a58d-da1b-468d-b32a-6ff5cdc8993d (non-flash)
Nov 29 18:04:10 user nova-compute[74613]:  stderr= {{(pid=74613) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 18:04:10 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.base [None req-5d8a83ba-92bc-4e1d-9331-d030cb74bfa2 tempest-TaggedBootDevicesTest-477858861 tempest-TaggedBootDevicesTest-477858861-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:32c4a58d-da1b-468d-b32a-6ff5cdc8993d" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.297s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 18:04:10 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d8a83ba-92bc-4e1d-9331-d030cb74bfa2 tempest-TaggedBootDevicesTest-477858861 tempest-TaggedBootDevicesTest-477858861-project-member] Connected to 172.16.0.220:3260 {{(pid=74613) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 29 18:04:10 user nova-compute[74613]: DEBUG os_brick.initiator.linuxscsi [None req-5d8a83ba-92bc-4e1d-9331-d030cb74bfa2 tempest-TaggedBootDevicesTest-477858861 tempest-TaggedBootDevicesTest-477858861-project-member] HCTL ('35', '-', '-', 0) found on session 30 with lun 0 {{(pid=74613) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 29 18:04:10 user nova-compute[74613]: DEBUG os_brick.initiator.linuxscsi [None req-5d8a83ba-92bc-4e1d-9331-d030cb74bfa2 tempest-TaggedBootDevicesTest-477858861 tempest-TaggedBootDevicesTest-477858861-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=74613) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 29 18:04:10 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:04:10 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.016s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:04:10 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4e93eb3-4b23-429a-a790-3d531eb51908]: (4, ('- - 0', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 18:04:10 user nova-compute[74613]: DEBUG os_brick.initiator.linuxscsi [None req-5d8a83ba-92bc-4e1d-9331-d030cb74bfa2 tempest-TaggedBootDevicesTest-477858861 tempest-TaggedBootDevicesTest-477858861-project-member] Searching for a device in session 30 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=74613) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 29 18:04:10 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d8a83ba-92bc-4e1d-9331-d030cb74bfa2 tempest-TaggedBootDevicesTest-477858861 tempest-TaggedBootDevicesTest-477858861-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:32c4a58d-da1b-468d-b32a-6ff5cdc8993d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DEfHXlJY', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74613) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 29 18:04:11 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.base [None req-5d8a83ba-92bc-4e1d-9331-d030cb74bfa2 tempest-TaggedBootDevicesTest-477858861 tempest-TaggedBootDevicesTest-477858861-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.328s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 18:04:11 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d8a83ba-92bc-4e1d-9331-d030cb74bfa2 tempest-TaggedBootDevicesTest-477858861 tempest-TaggedBootDevicesTest-477858861-project-member] <== connect_volume: return (1406ms) {'type': 'block', 'scsi_wwn': '26232343833393633', 'path': '/dev/sdd'} {{(pid=74613) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 18:04:11 user nova-compute[74613]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5d8a83ba-92bc-4e1d-9331-d030cb74bfa2 tempest-TaggedBootDevicesTest-477858861 tempest-TaggedBootDevicesTest-477858861-project-member] [instance: 56de3dd1-6873-4c0a-9d80-58518dfd671e] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26232343833393633', 'path': '/dev/sdd'} {{(pid=74613) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 29 18:04:11 user nova-compute[74613]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5d8a83ba-92bc-4e1d-9331-d030cb74bfa2 tempest-TaggedBootDevicesTest-477858861 tempest-TaggedBootDevicesTest-477858861-project-member] [instance: 56de3dd1-6873-4c0a-9d80-58518dfd671e] Calling os-brick to attach iSCSI Volume {{(pid=74613) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 29 18:04:11 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d8a83ba-92bc-4e1d-9331-d030cb74bfa2 tempest-TaggedBootDevicesTest-477858861 tempest-TaggedBootDevicesTest-477858861-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff828156890>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:b4a04a56-f988-4ae8-a3d3-271caf058c33', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'sMoBSTmE', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74613) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 18:04:11 user nova-compute[74613]: WARNING os_brick.initiator.connectors.base [None req-5d8a83ba-92bc-4e1d-9331-d030cb74bfa2 tempest-TaggedBootDevicesTest-477858861 tempest-TaggedBootDevicesTest-477858861-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 18:04:11 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.base [None req-5d8a83ba-92bc-4e1d-9331-d030cb74bfa2 tempest-TaggedBootDevicesTest-477858861 tempest-TaggedBootDevicesTest-477858861-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 18:04:11 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.base [None req-5d8a83ba-92bc-4e1d-9331-d030cb74bfa2 tempest-TaggedBootDevicesTest-477858861 tempest-TaggedBootDevicesTest-477858861-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 18:04:11 user nova-compute[74613]: WARNING os_brick.initiator.connectors.base [None req-5d8a83ba-92bc-4e1d-9331-d030cb74bfa2 tempest-TaggedBootDevicesTest-477858861 tempest-TaggedBootDevicesTest-477858861-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 18:04:11 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.base [None req-5d8a83ba-92bc-4e1d-9331-d030cb74bfa2 tempest-TaggedBootDevicesTest-477858861 tempest-TaggedBootDevicesTest-477858861-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b4a04a56-f988-4ae8-a3d3-271caf058c33" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 18:04:11 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.base [None req-5d8a83ba-92bc-4e1d-9331-d030cb74bfa2 tempest-TaggedBootDevicesTest-477858861 tempest-TaggedBootDevicesTest-477858861-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b4a04a56-f988-4ae8-a3d3-271caf058c33" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 18:04:11 user nova-compute[74613]: INFO os_brick.initiator.connectors.iscsi [None req-5d8a83ba-92bc-4e1d-9331-d030cb74bfa2 tempest-TaggedBootDevicesTest-477858861 tempest-TaggedBootDevicesTest-477858861-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 29 18:04:11 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b4a04a56-f988-4ae8-a3d3-271caf058c33 -p 172.16.0.220:3260 {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:04:11 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:04:11 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b4a04a56-f988-4ae8-a3d3-271caf058c33 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:04:11 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4e00eaf-494d-4fb9-a073-8a0112a7a0c1]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 18:04:11 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d8a83ba-92bc-4e1d-9331-d030cb74bfa2 tempest-TaggedBootDevicesTest-477858861 tempest-TaggedBootDevicesTest-477858861-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 29 18:04:11 user nova-compute[74613]:  {{(pid=74613) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 18:04:11 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b4a04a56-f988-4ae8-a3d3-271caf058c33 -p 172.16.0.220:3260 --interface default --op new {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:04:11 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:04:11 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:04:11 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b4a04a56-f988-4ae8-a3d3-271caf058c33 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.024s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:04:11 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3429a87-6738-4639-b0c6-1b45af051fc5]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b4a04a56-f988-4ae8-a3d3-271caf058c33] added\n', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 18:04:11 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d8a83ba-92bc-4e1d-9331-d030cb74bfa2 tempest-TaggedBootDevicesTest-477858861 tempest-TaggedBootDevicesTest-477858861-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b4a04a56-f988-4ae8-a3d3-271caf058c33] added
Nov 29 18:04:11 user nova-compute[74613]:  stderr= {{(pid=74613) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 18:04:11 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b4a04a56-f988-4ae8-a3d3-271caf058c33 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:04:11 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b4a04a56-f988-4ae8-a3d3-271caf058c33 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.024s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:04:11 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[de56b3a5-fc65-45ae-923e-258efb9b73a6]: (4, ('', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 18:04:11 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d8a83ba-92bc-4e1d-9331-d030cb74bfa2 tempest-TaggedBootDevicesTest-477858861 tempest-TaggedBootDevicesTest-477858861-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74613) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 18:04:11 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b4a04a56-f988-4ae8-a3d3-271caf058c33 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:04:11 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b4a04a56-f988-4ae8-a3d3-271caf058c33 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:04:11 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f2a343d-1d0a-4e2f-8fbb-d87b8aeb54b7]: (4, ('', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 18:04:11 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d8a83ba-92bc-4e1d-9331-d030cb74bfa2 tempest-TaggedBootDevicesTest-477858861 tempest-TaggedBootDevicesTest-477858861-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74613) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 18:04:11 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b4a04a56-f988-4ae8-a3d3-271caf058c33 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v sMoBSTmE {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:04:11 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b4a04a56-f988-4ae8-a3d3-271caf058c33 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v sMoBSTmE" returned: 0 in 0.020s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:04:11 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[088d354a-68c7-4d17-80e5-9fd5e5f4cf07]: (4, ('', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 18:04:11 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d8a83ba-92bc-4e1d-9331-d030cb74bfa2 tempest-TaggedBootDevicesTest-477858861 tempest-TaggedBootDevicesTest-477858861-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'sMoBSTmE'): stdout= stderr= {{(pid=74613) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 18:04:11 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b4a04a56-f988-4ae8-a3d3-271caf058c33 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:04:12 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b4a04a56-f988-4ae8-a3d3-271caf058c33 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.029s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:04:12 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8d7ccb5-879a-432d-9520-8c525d1d8141]: (4, ('', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 18:04:12 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d8a83ba-92bc-4e1d-9331-d030cb74bfa2 tempest-TaggedBootDevicesTest-477858861 tempest-TaggedBootDevicesTest-477858861-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74613) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 18:04:12 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:04:12 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:04:12 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[a583a64b-8d55-4b4e-b72a-39398ec1aef4]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9511387c-8772-40f2-bf2d-6b6387649e9f (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8c53a27-dcde-402b-a9bb-d8642f7db0da (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9aad94d-fe0d-415d-9761-9aff25cc6099 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:32c4a58d-da1b-468d-b32a-6ff5cdc8993d (non-flash)\n', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 18:04:12 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d8a83ba-92bc-4e1d-9331-d030cb74bfa2 tempest-TaggedBootDevicesTest-477858861 tempest-TaggedBootDevicesTest-477858861-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9511387c-8772-40f2-bf2d-6b6387649e9f (non-flash)
Nov 29 18:04:12 user nova-compute[74613]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8c53a27-dcde-402b-a9bb-d8642f7db0da (non-flash)
Nov 29 18:04:12 user nova-compute[74613]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9aad94d-fe0d-415d-9761-9aff25cc6099 (non-flash)
Nov 29 18:04:12 user nova-compute[74613]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:32c4a58d-da1b-468d-b32a-6ff5cdc8993d (non-flash)
Nov 29 18:04:12 user nova-compute[74613]:  stderr= {{(pid=74613) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 18:04:12 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d8a83ba-92bc-4e1d-9331-d030cb74bfa2 tempest-TaggedBootDevicesTest-477858861 tempest-TaggedBootDevicesTest-477858861-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9511387c-8772-40f2-bf2d-6b6387649e9f (non-flash)
Nov 29 18:04:12 user nova-compute[74613]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8c53a27-dcde-402b-a9bb-d8642f7db0da (non-flash)
Nov 29 18:04:12 user nova-compute[74613]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9aad94d-fe0d-415d-9761-9aff25cc6099 (non-flash)
Nov 29 18:04:12 user nova-compute[74613]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:32c4a58d-da1b-468d-b32a-6ff5cdc8993d (non-flash)
Nov 29 18:04:12 user nova-compute[74613]:  stderr= {{(pid=74613) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 18:04:12 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b4a04a56-f988-4ae8-a3d3-271caf058c33 -p 172.16.0.220:3260 --login {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:04:12 user nova-compute[74613]: DEBUG nova.compute.manager [req-2c2de800-88ad-4da8-b8c3-c881502282fa req-949c3b4d-bff0-4a28-b3be-1cf10446dd30 service nova] [instance: d3c285cd-9f39-423c-a324-30a48a9c66be] Received event network-vif-plugged-663e4724-b31b-469d-a5ea-c2802db1e0c8 {{(pid=74613) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 18:04:12 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-2c2de800-88ad-4da8-b8c3-c881502282fa req-949c3b4d-bff0-4a28-b3be-1cf10446dd30 service nova] Acquiring lock "d3c285cd-9f39-423c-a324-30a48a9c66be-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 18:04:12 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-2c2de800-88ad-4da8-b8c3-c881502282fa req-949c3b4d-bff0-4a28-b3be-1cf10446dd30 service nova] Lock "d3c285cd-9f39-423c-a324-30a48a9c66be-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 18:04:12 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-2c2de800-88ad-4da8-b8c3-c881502282fa req-949c3b4d-bff0-4a28-b3be-1cf10446dd30 service nova] Lock "d3c285cd-9f39-423c-a324-30a48a9c66be-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 18:04:12 user nova-compute[74613]: DEBUG nova.compute.manager [req-2c2de800-88ad-4da8-b8c3-c881502282fa req-949c3b4d-bff0-4a28-b3be-1cf10446dd30 service nova] [instance: d3c285cd-9f39-423c-a324-30a48a9c66be] No waiting events found dispatching network-vif-plugged-663e4724-b31b-469d-a5ea-c2802db1e0c8 {{(pid=74613) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 18:04:12 user nova-compute[74613]: WARNING nova.compute.manager [req-2c2de800-88ad-4da8-b8c3-c881502282fa req-949c3b4d-bff0-4a28-b3be-1cf10446dd30 service nova] [instance: d3c285cd-9f39-423c-a324-30a48a9c66be] Received unexpected event network-vif-plugged-663e4724-b31b-469d-a5ea-c2802db1e0c8 for instance with vm_state building and task_state spawning.
Nov 29 18:04:12 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b4a04a56-f988-4ae8-a3d3-271caf058c33 -p 172.16.0.220:3260 --login" returned: 0 in 0.072s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:04:12 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd903030-f358-453f-a345-5bf681e612b1]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:b4a04a56-f988-4ae8-a3d3-271caf058c33, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:b4a04a56-f988-4ae8-a3d3-271caf058c33, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 18:04:12 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d8a83ba-92bc-4e1d-9331-d030cb74bfa2 tempest-TaggedBootDevicesTest-477858861 tempest-TaggedBootDevicesTest-477858861-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:b4a04a56-f988-4ae8-a3d3-271caf058c33, portal: 172.16.0.220,3260]
Nov 29 18:04:12 user nova-compute[74613]: Login to [iface: default, target: iqn.2010-10.org.openstack:b4a04a56-f988-4ae8-a3d3-271caf058c33, portal: 172.16.0.220,3260] successful.
Nov 29 18:04:12 user nova-compute[74613]:  stderr= {{(pid=74613) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 18:04:12 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:04:12 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b4a04a56-f988-4ae8-a3d3-271caf058c33 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:04:12 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b4a04a56-f988-4ae8-a3d3-271caf058c33 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:04:12 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[3bf6a9b0-fb12-4d4a-b3a8-faca0ae6bf82]: (4, ('', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 18:04:12 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d8a83ba-92bc-4e1d-9331-d030cb74bfa2 tempest-TaggedBootDevicesTest-477858861 tempest-TaggedBootDevicesTest-477858861-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74613) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 18:04:12 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:04:12 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:04:12 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5d796e9-5efd-43dc-8377-5efc7bc182e0]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9511387c-8772-40f2-bf2d-6b6387649e9f (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8c53a27-dcde-402b-a9bb-d8642f7db0da (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9aad94d-fe0d-415d-9761-9aff25cc6099 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:32c4a58d-da1b-468d-b32a-6ff5cdc8993d (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4a04a56-f988-4ae8-a3d3-271caf058c33 (non-flash)\n', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 18:04:12 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d8a83ba-92bc-4e1d-9331-d030cb74bfa2 tempest-TaggedBootDevicesTest-477858861 tempest-TaggedBootDevicesTest-477858861-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9511387c-8772-40f2-bf2d-6b6387649e9f (non-flash)
Nov 29 18:04:12 user nova-compute[74613]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8c53a27-dcde-402b-a9bb-d8642f7db0da (non-flash)
Nov 29 18:04:12 user nova-compute[74613]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9aad94d-fe0d-415d-9761-9aff25cc6099 (non-flash)
Nov 29 18:04:12 user nova-compute[74613]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:32c4a58d-da1b-468d-b32a-6ff5cdc8993d (non-flash)
Nov 29 18:04:12 user nova-compute[74613]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4a04a56-f988-4ae8-a3d3-271caf058c33 (non-flash)
Nov 29 18:04:12 user nova-compute[74613]:  stderr= {{(pid=74613) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 18:04:12 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d8a83ba-92bc-4e1d-9331-d030cb74bfa2 tempest-TaggedBootDevicesTest-477858861 tempest-TaggedBootDevicesTest-477858861-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9511387c-8772-40f2-bf2d-6b6387649e9f (non-flash)
Nov 29 18:04:12 user nova-compute[74613]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8c53a27-dcde-402b-a9bb-d8642f7db0da (non-flash)
Nov 29 18:04:12 user nova-compute[74613]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9aad94d-fe0d-415d-9761-9aff25cc6099 (non-flash)
Nov 29 18:04:12 user nova-compute[74613]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:32c4a58d-da1b-468d-b32a-6ff5cdc8993d (non-flash)
Nov 29 18:04:12 user nova-compute[74613]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4a04a56-f988-4ae8-a3d3-271caf058c33 (non-flash)
Nov 29 18:04:12 user nova-compute[74613]:  stderr= {{(pid=74613) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 18:04:12 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.base [None req-5d8a83ba-92bc-4e1d-9331-d030cb74bfa2 tempest-TaggedBootDevicesTest-477858861 tempest-TaggedBootDevicesTest-477858861-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b4a04a56-f988-4ae8-a3d3-271caf058c33" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.327s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 18:04:12 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d8a83ba-92bc-4e1d-9331-d030cb74bfa2 tempest-TaggedBootDevicesTest-477858861 tempest-TaggedBootDevicesTest-477858861-project-member] Connected to 172.16.0.220:3260 {{(pid=74613) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 29 18:04:12 user nova-compute[74613]: DEBUG os_brick.initiator.linuxscsi [None req-5d8a83ba-92bc-4e1d-9331-d030cb74bfa2 tempest-TaggedBootDevicesTest-477858861 tempest-TaggedBootDevicesTest-477858861-project-member] HCTL ('37', '-', '-', 0) found on session 31 with lun 0 {{(pid=74613) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 29 18:04:12 user nova-compute[74613]: DEBUG os_brick.initiator.linuxscsi [None req-5d8a83ba-92bc-4e1d-9331-d030cb74bfa2 tempest-TaggedBootDevicesTest-477858861 tempest-TaggedBootDevicesTest-477858861-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=74613) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 29 18:04:12 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:04:12 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.019s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:04:12 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[b246a9ae-9bd3-41f0-ab0d-ef8ae27aff27]: (4, ('- - 0', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 18:04:12 user nova-compute[74613]: DEBUG os_brick.initiator.linuxscsi [None req-5d8a83ba-92bc-4e1d-9331-d030cb74bfa2 tempest-TaggedBootDevicesTest-477858861 tempest-TaggedBootDevicesTest-477858861-project-member] Searching for a device in session 31 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=74613) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 29 18:04:12 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d8a83ba-92bc-4e1d-9331-d030cb74bfa2 tempest-TaggedBootDevicesTest-477858861 tempest-TaggedBootDevicesTest-477858861-project-member] Connected to sdf using {'target_iqn': 'iqn.2010-10.org.openstack:b4a04a56-f988-4ae8-a3d3-271caf058c33', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'sMoBSTmE', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74613) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 29 18:04:12 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:04:13 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.base [None req-5d8a83ba-92bc-4e1d-9331-d030cb74bfa2 tempest-TaggedBootDevicesTest-477858861 tempest-TaggedBootDevicesTest-477858861-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.362s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 18:04:13 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d8a83ba-92bc-4e1d-9331-d030cb74bfa2 tempest-TaggedBootDevicesTest-477858861 tempest-TaggedBootDevicesTest-477858861-project-member] <== connect_volume: return (1363ms) {'type': 'block', 'scsi_wwn': '26431646330313864', 'path': '/dev/sdf'} {{(pid=74613) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 18:04:13 user nova-compute[74613]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5d8a83ba-92bc-4e1d-9331-d030cb74bfa2 tempest-TaggedBootDevicesTest-477858861 tempest-TaggedBootDevicesTest-477858861-project-member] [instance: 56de3dd1-6873-4c0a-9d80-58518dfd671e] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26431646330313864', 'path': '/dev/sdf'} {{(pid=74613) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 29 18:04:13 user nova-compute[74613]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5d8a83ba-92bc-4e1d-9331-d030cb74bfa2 tempest-TaggedBootDevicesTest-477858861 tempest-TaggedBootDevicesTest-477858861-project-member] [instance: 56de3dd1-6873-4c0a-9d80-58518dfd671e] Calling os-brick to attach iSCSI Volume {{(pid=74613) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 29 18:04:13 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d8a83ba-92bc-4e1d-9331-d030cb74bfa2 tempest-TaggedBootDevicesTest-477858861 tempest-TaggedBootDevicesTest-477858861-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff828156890>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:01de4abf-62b4-4200-97dc-9a38d07324e5', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'aCZvhqSV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74613) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 18:04:13 user nova-compute[74613]: WARNING os_brick.initiator.connectors.base [None req-5d8a83ba-92bc-4e1d-9331-d030cb74bfa2 tempest-TaggedBootDevicesTest-477858861 tempest-TaggedBootDevicesTest-477858861-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 18:04:13 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.base [None req-5d8a83ba-92bc-4e1d-9331-d030cb74bfa2 tempest-TaggedBootDevicesTest-477858861 tempest-TaggedBootDevicesTest-477858861-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 18:04:13 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.base [None req-5d8a83ba-92bc-4e1d-9331-d030cb74bfa2 tempest-TaggedBootDevicesTest-477858861 tempest-TaggedBootDevicesTest-477858861-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 18:04:13 user nova-compute[74613]: WARNING os_brick.initiator.connectors.base [None req-5d8a83ba-92bc-4e1d-9331-d030cb74bfa2 tempest-TaggedBootDevicesTest-477858861 tempest-TaggedBootDevicesTest-477858861-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 18:04:13 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.base [None req-5d8a83ba-92bc-4e1d-9331-d030cb74bfa2 tempest-TaggedBootDevicesTest-477858861 tempest-TaggedBootDevicesTest-477858861-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:01de4abf-62b4-4200-97dc-9a38d07324e5" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 18:04:13 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.base [None req-5d8a83ba-92bc-4e1d-9331-d030cb74bfa2 tempest-TaggedBootDevicesTest-477858861 tempest-TaggedBootDevicesTest-477858861-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:01de4abf-62b4-4200-97dc-9a38d07324e5" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 18:04:13 user nova-compute[74613]: INFO os_brick.initiator.connectors.iscsi [None req-5d8a83ba-92bc-4e1d-9331-d030cb74bfa2 tempest-TaggedBootDevicesTest-477858861 tempest-TaggedBootDevicesTest-477858861-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 29 18:04:13 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:01de4abf-62b4-4200-97dc-9a38d07324e5 -p 172.16.0.220:3260 {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:04:13 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:01de4abf-62b4-4200-97dc-9a38d07324e5 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:04:13 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[552aba15-4efb-4e3d-8cad-887e352a82e8]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 18:04:13 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d8a83ba-92bc-4e1d-9331-d030cb74bfa2 tempest-TaggedBootDevicesTest-477858861 tempest-TaggedBootDevicesTest-477858861-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 29 18:04:13 user nova-compute[74613]:  {{(pid=74613) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 18:04:13 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:01de4abf-62b4-4200-97dc-9a38d07324e5 -p 172.16.0.220:3260 --interface default --op new {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:04:13 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:01de4abf-62b4-4200-97dc-9a38d07324e5 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.023s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:04:13 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[567275f1-8cdf-4fea-8c54-3ffc594c1158]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:01de4abf-62b4-4200-97dc-9a38d07324e5] added\n', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 18:04:13 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d8a83ba-92bc-4e1d-9331-d030cb74bfa2 tempest-TaggedBootDevicesTest-477858861 tempest-TaggedBootDevicesTest-477858861-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:01de4abf-62b4-4200-97dc-9a38d07324e5] added
Nov 29 18:04:13 user nova-compute[74613]:  stderr= {{(pid=74613) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 18:04:13 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:01de4abf-62b4-4200-97dc-9a38d07324e5 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:04:13 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:01de4abf-62b4-4200-97dc-9a38d07324e5 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:04:13 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[2327c6c2-a67d-4345-9272-fb976b731dda]: (4, ('', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 18:04:13 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d8a83ba-92bc-4e1d-9331-d030cb74bfa2 tempest-TaggedBootDevicesTest-477858861 tempest-TaggedBootDevicesTest-477858861-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74613) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 18:04:13 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:01de4abf-62b4-4200-97dc-9a38d07324e5 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:04:13 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:01de4abf-62b4-4200-97dc-9a38d07324e5 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:04:13 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b51a53e-ec1e-4a7d-9dc5-9a4c0355217e]: (4, ('', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 18:04:13 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d8a83ba-92bc-4e1d-9331-d030cb74bfa2 tempest-TaggedBootDevicesTest-477858861 tempest-TaggedBootDevicesTest-477858861-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74613) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 18:04:13 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:01de4abf-62b4-4200-97dc-9a38d07324e5 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v aCZvhqSV {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:04:13 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:01de4abf-62b4-4200-97dc-9a38d07324e5 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v aCZvhqSV" returned: 0 in 0.020s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:04:13 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[ddf2f797-d4a6-4e60-a4e4-91d5fd13280f]: (4, ('', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 18:04:13 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d8a83ba-92bc-4e1d-9331-d030cb74bfa2 tempest-TaggedBootDevicesTest-477858861 tempest-TaggedBootDevicesTest-477858861-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'aCZvhqSV'): stdout= stderr= {{(pid=74613) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 18:04:13 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:01de4abf-62b4-4200-97dc-9a38d07324e5 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:04:13 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:01de4abf-62b4-4200-97dc-9a38d07324e5 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:04:13 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d5f7ccc-221f-4b1a-b012-8c729fc313a8]: (4, ('', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 18:04:13 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d8a83ba-92bc-4e1d-9331-d030cb74bfa2 tempest-TaggedBootDevicesTest-477858861 tempest-TaggedBootDevicesTest-477858861-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74613) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 18:04:13 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:04:13 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:04:13 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[396312cf-8243-407b-8b51-3423e2f0f1f8]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9511387c-8772-40f2-bf2d-6b6387649e9f (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8c53a27-dcde-402b-a9bb-d8642f7db0da (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9aad94d-fe0d-415d-9761-9aff25cc6099 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:32c4a58d-da1b-468d-b32a-6ff5cdc8993d (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4a04a56-f988-4ae8-a3d3-271caf058c33 (non-flash)\n', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 18:04:13 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d8a83ba-92bc-4e1d-9331-d030cb74bfa2 tempest-TaggedBootDevicesTest-477858861 tempest-TaggedBootDevicesTest-477858861-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9511387c-8772-40f2-bf2d-6b6387649e9f (non-flash)
Nov 29 18:04:13 user nova-compute[74613]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8c53a27-dcde-402b-a9bb-d8642f7db0da (non-flash)
Nov 29 18:04:13 user nova-compute[74613]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9aad94d-fe0d-415d-9761-9aff25cc6099 (non-flash)
Nov 29 18:04:13 user nova-compute[74613]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:32c4a58d-da1b-468d-b32a-6ff5cdc8993d (non-flash)
Nov 29 18:04:13 user nova-compute[74613]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4a04a56-f988-4ae8-a3d3-271caf058c33 (non-flash)
Nov 29 18:04:13 user nova-compute[74613]:  stderr= {{(pid=74613) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 18:04:13 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d8a83ba-92bc-4e1d-9331-d030cb74bfa2 tempest-TaggedBootDevicesTest-477858861 tempest-TaggedBootDevicesTest-477858861-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9511387c-8772-40f2-bf2d-6b6387649e9f (non-flash)
Nov 29 18:04:13 user nova-compute[74613]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8c53a27-dcde-402b-a9bb-d8642f7db0da (non-flash)
Nov 29 18:04:13 user nova-compute[74613]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9aad94d-fe0d-415d-9761-9aff25cc6099 (non-flash)
Nov 29 18:04:13 user nova-compute[74613]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:32c4a58d-da1b-468d-b32a-6ff5cdc8993d (non-flash)
Nov 29 18:04:13 user nova-compute[74613]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4a04a56-f988-4ae8-a3d3-271caf058c33 (non-flash)
Nov 29 18:04:13 user nova-compute[74613]:  stderr= {{(pid=74613) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 18:04:13 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:01de4abf-62b4-4200-97dc-9a38d07324e5 -p 172.16.0.220:3260 --login {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:04:13 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:01de4abf-62b4-4200-97dc-9a38d07324e5 -p 172.16.0.220:3260 --login" returned: 0 in 0.070s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:04:13 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[497b6094-d142-4e3d-b035-4a84b2f77b1c]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:01de4abf-62b4-4200-97dc-9a38d07324e5, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:01de4abf-62b4-4200-97dc-9a38d07324e5, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 18:04:13 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d8a83ba-92bc-4e1d-9331-d030cb74bfa2 tempest-TaggedBootDevicesTest-477858861 tempest-TaggedBootDevicesTest-477858861-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:01de4abf-62b4-4200-97dc-9a38d07324e5, portal: 172.16.0.220,3260]
Nov 29 18:04:13 user nova-compute[74613]: Login to [iface: default, target: iqn.2010-10.org.openstack:01de4abf-62b4-4200-97dc-9a38d07324e5, portal: 172.16.0.220,3260] successful.
Nov 29 18:04:13 user nova-compute[74613]:  stderr= {{(pid=74613) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 18:04:13 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:01de4abf-62b4-4200-97dc-9a38d07324e5 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:04:13 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:01de4abf-62b4-4200-97dc-9a38d07324e5 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:04:13 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[84b29819-f7d5-4138-933a-2cf33312656e]: (4, ('', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 18:04:13 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d8a83ba-92bc-4e1d-9331-d030cb74bfa2 tempest-TaggedBootDevicesTest-477858861 tempest-TaggedBootDevicesTest-477858861-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74613) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 18:04:13 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:04:13 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:04:13 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e74ad15-06be-4f85-8f10-6f729b48f571]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9511387c-8772-40f2-bf2d-6b6387649e9f (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8c53a27-dcde-402b-a9bb-d8642f7db0da (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9aad94d-fe0d-415d-9761-9aff25cc6099 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:32c4a58d-da1b-468d-b32a-6ff5cdc8993d (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4a04a56-f988-4ae8-a3d3-271caf058c33 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01de4abf-62b4-4200-97dc-9a38d07324e5 (non-flash)\n', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 18:04:13 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d8a83ba-92bc-4e1d-9331-d030cb74bfa2 tempest-TaggedBootDevicesTest-477858861 tempest-TaggedBootDevicesTest-477858861-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9511387c-8772-40f2-bf2d-6b6387649e9f (non-flash)
Nov 29 18:04:13 user nova-compute[74613]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8c53a27-dcde-402b-a9bb-d8642f7db0da (non-flash)
Nov 29 18:04:13 user nova-compute[74613]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9aad94d-fe0d-415d-9761-9aff25cc6099 (non-flash)
Nov 29 18:04:13 user nova-compute[74613]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:32c4a58d-da1b-468d-b32a-6ff5cdc8993d (non-flash)
Nov 29 18:04:13 user nova-compute[74613]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4a04a56-f988-4ae8-a3d3-271caf058c33 (non-flash)
Nov 29 18:04:13 user nova-compute[74613]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01de4abf-62b4-4200-97dc-9a38d07324e5 (non-flash)
Nov 29 18:04:13 user nova-compute[74613]:  stderr= {{(pid=74613) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 18:04:13 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d8a83ba-92bc-4e1d-9331-d030cb74bfa2 tempest-TaggedBootDevicesTest-477858861 tempest-TaggedBootDevicesTest-477858861-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9511387c-8772-40f2-bf2d-6b6387649e9f (non-flash)
Nov 29 18:04:13 user nova-compute[74613]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8c53a27-dcde-402b-a9bb-d8642f7db0da (non-flash)
Nov 29 18:04:13 user nova-compute[74613]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9aad94d-fe0d-415d-9761-9aff25cc6099 (non-flash)
Nov 29 18:04:13 user nova-compute[74613]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:32c4a58d-da1b-468d-b32a-6ff5cdc8993d (non-flash)
Nov 29 18:04:13 user nova-compute[74613]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4a04a56-f988-4ae8-a3d3-271caf058c33 (non-flash)
Nov 29 18:04:13 user nova-compute[74613]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01de4abf-62b4-4200-97dc-9a38d07324e5 (non-flash)
Nov 29 18:04:13 user nova-compute[74613]:  stderr= {{(pid=74613) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 18:04:13 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.base [None req-5d8a83ba-92bc-4e1d-9331-d030cb74bfa2 tempest-TaggedBootDevicesTest-477858861 tempest-TaggedBootDevicesTest-477858861-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:01de4abf-62b4-4200-97dc-9a38d07324e5" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.308s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 18:04:13 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d8a83ba-92bc-4e1d-9331-d030cb74bfa2 tempest-TaggedBootDevicesTest-477858861 tempest-TaggedBootDevicesTest-477858861-project-member] Connected to 172.16.0.220:3260 {{(pid=74613) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 29 18:04:13 user nova-compute[74613]: DEBUG os_brick.initiator.linuxscsi [None req-5d8a83ba-92bc-4e1d-9331-d030cb74bfa2 tempest-TaggedBootDevicesTest-477858861 tempest-TaggedBootDevicesTest-477858861-project-member] HCTL ('38', '-', '-', 0) found on session 32 with lun 0 {{(pid=74613) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 29 18:04:13 user nova-compute[74613]: DEBUG os_brick.initiator.linuxscsi [None req-5d8a83ba-92bc-4e1d-9331-d030cb74bfa2 tempest-TaggedBootDevicesTest-477858861 tempest-TaggedBootDevicesTest-477858861-project-member] Scanning host 38 c: -, t: -, l: 0) {{(pid=74613) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 29 18:04:13 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host38/scan {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:04:13 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host38/scan" returned: 0 in 0.017s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:04:13 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[c79f3d3b-0af5-4b66-a181-ef502fb3f3d5]: (4, ('- - 0', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 18:04:13 user nova-compute[74613]: DEBUG os_brick.initiator.linuxscsi [None req-5d8a83ba-92bc-4e1d-9331-d030cb74bfa2 tempest-TaggedBootDevicesTest-477858861 tempest-TaggedBootDevicesTest-477858861-project-member] Searching for a device in session 32 and hctl ['38', '*', '*', 0] yield: None {{(pid=74613) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 29 18:04:14 user nova-compute[74613]: DEBUG nova.compute.manager [None req-47de4061-32fc-432c-a5e2-b796d21354d4 tempest-ServerBootFromVolumeStableRescueTest-414665510 tempest-ServerBootFromVolumeStableRescueTest-414665510-project-member] [instance: d3c285cd-9f39-423c-a324-30a48a9c66be] Instance event wait completed in 0 seconds for  {{(pid=74613) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 29 18:04:14 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-47de4061-32fc-432c-a5e2-b796d21354d4 tempest-ServerBootFromVolumeStableRescueTest-414665510 tempest-ServerBootFromVolumeStableRescueTest-414665510-project-member] [instance: d3c285cd-9f39-423c-a324-30a48a9c66be] Guest created on hypervisor {{(pid=74613) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 29 18:04:14 user nova-compute[74613]: INFO nova.virt.libvirt.driver [-] [instance: d3c285cd-9f39-423c-a324-30a48a9c66be] Instance spawned successfully.
Nov 29 18:04:14 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-47de4061-32fc-432c-a5e2-b796d21354d4 tempest-ServerBootFromVolumeStableRescueTest-414665510 tempest-ServerBootFromVolumeStableRescueTest-414665510-project-member] [instance: d3c285cd-9f39-423c-a324-30a48a9c66be] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74613) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 29 18:04:14 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-47de4061-32fc-432c-a5e2-b796d21354d4 tempest-ServerBootFromVolumeStableRescueTest-414665510 tempest-ServerBootFromVolumeStableRescueTest-414665510-project-member] [instance: d3c285cd-9f39-423c-a324-30a48a9c66be] Found default for hw_cdrom_bus of ide {{(pid=74613) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 18:04:14 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-47de4061-32fc-432c-a5e2-b796d21354d4 tempest-ServerBootFromVolumeStableRescueTest-414665510 tempest-ServerBootFromVolumeStableRescueTest-414665510-project-member] [instance: d3c285cd-9f39-423c-a324-30a48a9c66be] Found default for hw_disk_bus of virtio {{(pid=74613) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 18:04:14 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-47de4061-32fc-432c-a5e2-b796d21354d4 tempest-ServerBootFromVolumeStableRescueTest-414665510 tempest-ServerBootFromVolumeStableRescueTest-414665510-project-member] [instance: d3c285cd-9f39-423c-a324-30a48a9c66be] Found default for hw_input_bus of None {{(pid=74613) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 18:04:14 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-47de4061-32fc-432c-a5e2-b796d21354d4 tempest-ServerBootFromVolumeStableRescueTest-414665510 tempest-ServerBootFromVolumeStableRescueTest-414665510-project-member] [instance: d3c285cd-9f39-423c-a324-30a48a9c66be] Found default for hw_pointer_model of None {{(pid=74613) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 18:04:14 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-47de4061-32fc-432c-a5e2-b796d21354d4 tempest-ServerBootFromVolumeStableRescueTest-414665510 tempest-ServerBootFromVolumeStableRescueTest-414665510-project-member] [instance: d3c285cd-9f39-423c-a324-30a48a9c66be] Found default for hw_video_model of virtio {{(pid=74613) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 18:04:14 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-47de4061-32fc-432c-a5e2-b796d21354d4 tempest-ServerBootFromVolumeStableRescueTest-414665510 tempest-ServerBootFromVolumeStableRescueTest-414665510-project-member] [instance: d3c285cd-9f39-423c-a324-30a48a9c66be] Found default for hw_vif_model of virtio {{(pid=74613) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 18:04:14 user nova-compute[74613]: DEBUG nova.compute.manager [req-2acdef85-1031-4aeb-90ad-84e250a5fc9d req-90cb6a92-fad7-4433-99af-e964d34e89eb service nova] [instance: d3c285cd-9f39-423c-a324-30a48a9c66be] Received event network-vif-plugged-663e4724-b31b-469d-a5ea-c2802db1e0c8 {{(pid=74613) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 18:04:14 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-2acdef85-1031-4aeb-90ad-84e250a5fc9d req-90cb6a92-fad7-4433-99af-e964d34e89eb service nova] Acquiring lock "d3c285cd-9f39-423c-a324-30a48a9c66be-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 18:04:14 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-2acdef85-1031-4aeb-90ad-84e250a5fc9d req-90cb6a92-fad7-4433-99af-e964d34e89eb service nova] Lock "d3c285cd-9f39-423c-a324-30a48a9c66be-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 18:04:14 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-2acdef85-1031-4aeb-90ad-84e250a5fc9d req-90cb6a92-fad7-4433-99af-e964d34e89eb service nova] Lock "d3c285cd-9f39-423c-a324-30a48a9c66be-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 18:04:14 user nova-compute[74613]: DEBUG nova.compute.manager [req-2acdef85-1031-4aeb-90ad-84e250a5fc9d req-90cb6a92-fad7-4433-99af-e964d34e89eb service nova] [instance: d3c285cd-9f39-423c-a324-30a48a9c66be] No waiting events found dispatching network-vif-plugged-663e4724-b31b-469d-a5ea-c2802db1e0c8 {{(pid=74613) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 18:04:14 user nova-compute[74613]: WARNING nova.compute.manager [req-2acdef85-1031-4aeb-90ad-84e250a5fc9d req-90cb6a92-fad7-4433-99af-e964d34e89eb service nova] [instance: d3c285cd-9f39-423c-a324-30a48a9c66be] Received unexpected event network-vif-plugged-663e4724-b31b-469d-a5ea-c2802db1e0c8 for instance with vm_state building and task_state spawning.
Nov 29 18:04:14 user nova-compute[74613]: INFO nova.compute.manager [None req-47de4061-32fc-432c-a5e2-b796d21354d4 tempest-ServerBootFromVolumeStableRescueTest-414665510 tempest-ServerBootFromVolumeStableRescueTest-414665510-project-member] [instance: d3c285cd-9f39-423c-a324-30a48a9c66be] Took 5.24 seconds to spawn the instance on the hypervisor.
Nov 29 18:04:14 user nova-compute[74613]: DEBUG nova.compute.manager [None req-47de4061-32fc-432c-a5e2-b796d21354d4 tempest-ServerBootFromVolumeStableRescueTest-414665510 tempest-ServerBootFromVolumeStableRescueTest-414665510-project-member] [instance: d3c285cd-9f39-423c-a324-30a48a9c66be] Checking state {{(pid=74613) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 29 18:04:14 user nova-compute[74613]: INFO nova.compute.manager [None req-47de4061-32fc-432c-a5e2-b796d21354d4 tempest-ServerBootFromVolumeStableRescueTest-414665510 tempest-ServerBootFromVolumeStableRescueTest-414665510-project-member] [instance: d3c285cd-9f39-423c-a324-30a48a9c66be] Took 25.35 seconds to build instance.
Nov 29 18:04:14 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-47de4061-32fc-432c-a5e2-b796d21354d4 tempest-ServerBootFromVolumeStableRescueTest-414665510 tempest-ServerBootFromVolumeStableRescueTest-414665510-project-member] Lock "d3c285cd-9f39-423c-a324-30a48a9c66be" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 25.448s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 18:04:14 user nova-compute[74613]: DEBUG os_brick.initiator.linuxscsi [None req-5d8a83ba-92bc-4e1d-9331-d030cb74bfa2 tempest-TaggedBootDevicesTest-477858861 tempest-TaggedBootDevicesTest-477858861-project-member] Searching for a device in session 32 and hctl ['38', '*', '*', 0] yield: sdg {{(pid=74613) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 29 18:04:14 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d8a83ba-92bc-4e1d-9331-d030cb74bfa2 tempest-TaggedBootDevicesTest-477858861 tempest-TaggedBootDevicesTest-477858861-project-member] Connected to sdg using {'target_iqn': 'iqn.2010-10.org.openstack:01de4abf-62b4-4200-97dc-9a38d07324e5', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'aCZvhqSV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74613) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 29 18:04:14 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.base [None req-5d8a83ba-92bc-4e1d-9331-d030cb74bfa2 tempest-TaggedBootDevicesTest-477858861 tempest-TaggedBootDevicesTest-477858861-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.339s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 18:04:14 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d8a83ba-92bc-4e1d-9331-d030cb74bfa2 tempest-TaggedBootDevicesTest-477858861 tempest-TaggedBootDevicesTest-477858861-project-member] <== connect_volume: return (1340ms) {'type': 'block', 'scsi_wwn': '23632363735386566', 'path': '/dev/sdg'} {{(pid=74613) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 18:04:14 user nova-compute[74613]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5d8a83ba-92bc-4e1d-9331-d030cb74bfa2 tempest-TaggedBootDevicesTest-477858861 tempest-TaggedBootDevicesTest-477858861-project-member] [instance: 56de3dd1-6873-4c0a-9d80-58518dfd671e] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23632363735386566', 'path': '/dev/sdg'} {{(pid=74613) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 29 18:04:14 user nova-compute[74613]: DEBUG nova.virt.libvirt.vif [None req-5d8a83ba-92bc-4e1d-9331-d030cb74bfa2 tempest-TaggedBootDevicesTest-477858861 tempest-TaggedBootDevicesTest-477858861-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-29T18:03:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-673218276',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-673218276',id=26,image_ref='4217f428-8d9d-4ee1-9614-642d26d90c46',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGL96hGsOikLqEHhsj9njCpyfE8e3V+KiaQzlnoRrJRaG1J/31X2lFl/ghui5RIyt0tbBjgF9ySvX5PG4tyErQ1KUFBDp+LZCscA6MDkYFpNo0AlMS+hxWRKFmIZybqZvg==',key_name='tempest-keypair-1703547228',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a9fa0da4ffc3447795c69b31e4e9a8d0',ramdisk_id='',reservation_id='r-9nbsmznw',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='4217f428-8d9d-4ee1-9614-642d26d90c46',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-477858861',owner_user_name='tempest-TaggedBootDevicesTest-477858861-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T18:03:45Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5e784791fe274eb7bf8e7b31fdff19f9',uuid=56de3dd1-6873-4c0a-9d80-58518dfd671e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "fd1eeb3e-46e9-441a-90e1-048c5ad64d0e", "address": "fa:16:3e:23:fc:5e", "network": {"id": "de42d2ca-c48c-4dc3-8b92-61dc7cbafb64", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-203953398-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a9fa0da4ffc3447795c69b31e4e9a8d0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfd1eeb3e-46", "ovs_interfaceid": "fd1eeb3e-46e9-441a-90e1-048c5ad64d0e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74613) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 29 18:04:14 user nova-compute[74613]: DEBUG nova.network.os_vif_util [None req-5d8a83ba-92bc-4e1d-9331-d030cb74bfa2 tempest-TaggedBootDevicesTest-477858861 tempest-TaggedBootDevicesTest-477858861-project-member] Converting VIF {"id": "fd1eeb3e-46e9-441a-90e1-048c5ad64d0e", "address": "fa:16:3e:23:fc:5e", "network": {"id": "de42d2ca-c48c-4dc3-8b92-61dc7cbafb64", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-203953398-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a9fa0da4ffc3447795c69b31e4e9a8d0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfd1eeb3e-46", "ovs_interfaceid": "fd1eeb3e-46e9-441a-90e1-048c5ad64d0e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74613) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 18:04:14 user nova-compute[74613]: DEBUG nova.network.os_vif_util [None req-5d8a83ba-92bc-4e1d-9331-d030cb74bfa2 tempest-TaggedBootDevicesTest-477858861 tempest-TaggedBootDevicesTest-477858861-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:23:fc:5e,bridge_name='br-int',has_traffic_filtering=True,id=fd1eeb3e-46e9-441a-90e1-048c5ad64d0e,network=Network(de42d2ca-c48c-4dc3-8b92-61dc7cbafb64),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfd1eeb3e-46') {{(pid=74613) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 18:04:14 user nova-compute[74613]: DEBUG nova.virt.libvirt.vif [None req-5d8a83ba-92bc-4e1d-9331-d030cb74bfa2 tempest-TaggedBootDevicesTest-477858861 tempest-TaggedBootDevicesTest-477858861-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-29T18:03:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-673218276',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-673218276',id=26,image_ref='4217f428-8d9d-4ee1-9614-642d26d90c46',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGL96hGsOikLqEHhsj9njCpyfE8e3V+KiaQzlnoRrJRaG1J/31X2lFl/ghui5RIyt0tbBjgF9ySvX5PG4tyErQ1KUFBDp+LZCscA6MDkYFpNo0AlMS+hxWRKFmIZybqZvg==',key_name='tempest-keypair-1703547228',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a9fa0da4ffc3447795c69b31e4e9a8d0',ramdisk_id='',reservation_id='r-9nbsmznw',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='4217f428-8d9d-4ee1-9614-642d26d90c46',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-477858861',owner_user_name='tempest-TaggedBootDevicesTest-477858861-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T18:03:45Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5e784791fe274eb7bf8e7b31fdff19f9',uuid=56de3dd1-6873-4c0a-9d80-58518dfd671e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7d1e40a2-4a06-4e8e-935c-3d66553dac82", "address": "fa:16:3e:a9:89:7f", "network": {"id": "3143fa56-ddfb-4a80-8df7-33d38513cf4b", "bridge": "br-int", "label": "tempest-device-tagging-net1-2047429033", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.201", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "a9fa0da4ffc3447795c69b31e4e9a8d0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7d1e40a2-4a", "ovs_interfaceid": "7d1e40a2-4a06-4e8e-935c-3d66553dac82", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74613) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 29 18:04:14 user nova-compute[74613]: DEBUG nova.network.os_vif_util [None req-5d8a83ba-92bc-4e1d-9331-d030cb74bfa2 tempest-TaggedBootDevicesTest-477858861 tempest-TaggedBootDevicesTest-477858861-project-member] Converting VIF {"id": "7d1e40a2-4a06-4e8e-935c-3d66553dac82", "address": "fa:16:3e:a9:89:7f", "network": {"id": "3143fa56-ddfb-4a80-8df7-33d38513cf4b", "bridge": "br-int", "label": "tempest-device-tagging-net1-2047429033", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.201", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "a9fa0da4ffc3447795c69b31e4e9a8d0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7d1e40a2-4a", "ovs_interfaceid": "7d1e40a2-4a06-4e8e-935c-3d66553dac82", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74613) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 18:04:14 user nova-compute[74613]: DEBUG nova.network.os_vif_util [None req-5d8a83ba-92bc-4e1d-9331-d030cb74bfa2 tempest-TaggedBootDevicesTest-477858861 tempest-TaggedBootDevicesTest-477858861-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a9:89:7f,bridge_name='br-int',has_traffic_filtering=True,id=7d1e40a2-4a06-4e8e-935c-3d66553dac82,network=Network(3143fa56-ddfb-4a80-8df7-33d38513cf4b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap7d1e40a2-4a') {{(pid=74613) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 18:04:14 user nova-compute[74613]: DEBUG nova.virt.libvirt.vif [None req-5d8a83ba-92bc-4e1d-9331-d030cb74bfa2 tempest-TaggedBootDevicesTest-477858861 tempest-TaggedBootDevicesTest-477858861-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-29T18:03:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-673218276',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-673218276',id=26,image_ref='4217f428-8d9d-4ee1-9614-642d26d90c46',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGL96hGsOikLqEHhsj9njCpyfE8e3V+KiaQzlnoRrJRaG1J/31X2lFl/ghui5RIyt0tbBjgF9ySvX5PG4tyErQ1KUFBDp+LZCscA6MDkYFpNo0AlMS+hxWRKFmIZybqZvg==',key_name='tempest-keypair-1703547228',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a9fa0da4ffc3447795c69b31e4e9a8d0',ramdisk_id='',reservation_id='r-9nbsmznw',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='4217f428-8d9d-4ee1-9614-642d26d90c46',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-477858861',owner_user_name='tempest-TaggedBootDevicesTest-477858861-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T18:03:45Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5e784791fe274eb7bf8e7b31fdff19f9',uuid=56de3dd1-6873-4c0a-9d80-58518dfd671e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "70ada3a3-186a-425a-8c4c-7af3b2d647ef", "address": "fa:16:3e:7f:89:6c", "network": {"id": "3143fa56-ddfb-4a80-8df7-33d38513cf4b", "bridge": "br-int", "label": "tempest-device-tagging-net1-2047429033", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.230", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "a9fa0da4ffc3447795c69b31e4e9a8d0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap70ada3a3-18", "ovs_interfaceid": "70ada3a3-186a-425a-8c4c-7af3b2d647ef", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74613) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 29 18:04:14 user nova-compute[74613]: DEBUG nova.network.os_vif_util [None req-5d8a83ba-92bc-4e1d-9331-d030cb74bfa2 tempest-TaggedBootDevicesTest-477858861 tempest-TaggedBootDevicesTest-477858861-project-member] Converting VIF {"id": "70ada3a3-186a-425a-8c4c-7af3b2d647ef", "address": "fa:16:3e:7f:89:6c", "network": {"id": "3143fa56-ddfb-4a80-8df7-33d38513cf4b", "bridge": "br-int", "label": "tempest-device-tagging-net1-2047429033", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.230", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "a9fa0da4ffc3447795c69b31e4e9a8d0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap70ada3a3-18", "ovs_interfaceid": "70ada3a3-186a-425a-8c4c-7af3b2d647ef", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74613) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 18:04:14 user nova-compute[74613]: DEBUG nova.network.os_vif_util [None req-5d8a83ba-92bc-4e1d-9331-d030cb74bfa2 tempest-TaggedBootDevicesTest-477858861 tempest-TaggedBootDevicesTest-477858861-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7f:89:6c,bridge_name='br-int',has_traffic_filtering=True,id=70ada3a3-186a-425a-8c4c-7af3b2d647ef,network=Network(3143fa56-ddfb-4a80-8df7-33d38513cf4b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap70ada3a3-18') {{(pid=74613) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 18:04:14 user nova-compute[74613]: DEBUG nova.virt.libvirt.vif [None req-5d8a83ba-92bc-4e1d-9331-d030cb74bfa2 tempest-TaggedBootDevicesTest-477858861 tempest-TaggedBootDevicesTest-477858861-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-29T18:03:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-673218276',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-673218276',id=26,image_ref='4217f428-8d9d-4ee1-9614-642d26d90c46',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGL96hGsOikLqEHhsj9njCpyfE8e3V+KiaQzlnoRrJRaG1J/31X2lFl/ghui5RIyt0tbBjgF9ySvX5PG4tyErQ1KUFBDp+LZCscA6MDkYFpNo0AlMS+hxWRKFmIZybqZvg==',key_name='tempest-keypair-1703547228',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a9fa0da4ffc3447795c69b31e4e9a8d0',ramdisk_id='',reservation_id='r-9nbsmznw',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='4217f428-8d9d-4ee1-9614-642d26d90c46',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-477858861',owner_user_name='tempest-TaggedBootDevicesTest-477858861-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T18:03:45Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5e784791fe274eb7bf8e7b31fdff19f9',uuid=56de3dd1-6873-4c0a-9d80-58518dfd671e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "bfeedb02-28d2-4e4c-8a6b-da87e4b8f9cb", "address": "fa:16:3e:c9:00:90", "network": {"id": "3143fa56-ddfb-4a80-8df7-33d38513cf4b", "bridge": "br-int", "label": "tempest-device-tagging-net1-2047429033", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.251", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "a9fa0da4ffc3447795c69b31e4e9a8d0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbfeedb02-28", "ovs_interfaceid": "bfeedb02-28d2-4e4c-8a6b-da87e4b8f9cb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74613) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 29 18:04:14 user nova-compute[74613]: DEBUG nova.network.os_vif_util [None req-5d8a83ba-92bc-4e1d-9331-d030cb74bfa2 tempest-TaggedBootDevicesTest-477858861 tempest-TaggedBootDevicesTest-477858861-project-member] Converting VIF {"id": "bfeedb02-28d2-4e4c-8a6b-da87e4b8f9cb", "address": "fa:16:3e:c9:00:90", "network": {"id": "3143fa56-ddfb-4a80-8df7-33d38513cf4b", "bridge": "br-int", "label": "tempest-device-tagging-net1-2047429033", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.251", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "a9fa0da4ffc3447795c69b31e4e9a8d0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbfeedb02-28", "ovs_interfaceid": "bfeedb02-28d2-4e4c-8a6b-da87e4b8f9cb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74613) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 18:04:14 user nova-compute[74613]: DEBUG nova.network.os_vif_util [None req-5d8a83ba-92bc-4e1d-9331-d030cb74bfa2 tempest-TaggedBootDevicesTest-477858861 tempest-TaggedBootDevicesTest-477858861-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c9:00:90,bridge_name='br-int',has_traffic_filtering=True,id=bfeedb02-28d2-4e4c-8a6b-da87e4b8f9cb,network=Network(3143fa56-ddfb-4a80-8df7-33d38513cf4b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbfeedb02-28') {{(pid=74613) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 18:04:14 user nova-compute[74613]: DEBUG nova.virt.libvirt.vif [None req-5d8a83ba-92bc-4e1d-9331-d030cb74bfa2 tempest-TaggedBootDevicesTest-477858861 tempest-TaggedBootDevicesTest-477858861-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-29T18:03:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-673218276',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-673218276',id=26,image_ref='4217f428-8d9d-4ee1-9614-642d26d90c46',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGL96hGsOikLqEHhsj9njCpyfE8e3V+KiaQzlnoRrJRaG1J/31X2lFl/ghui5RIyt0tbBjgF9ySvX5PG4tyErQ1KUFBDp+LZCscA6MDkYFpNo0AlMS+hxWRKFmIZybqZvg==',key_name='tempest-keypair-1703547228',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a9fa0da4ffc3447795c69b31e4e9a8d0',ramdisk_id='',reservation_id='r-9nbsmznw',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='4217f428-8d9d-4ee1-9614-642d26d90c46',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-477858861',owner_user_name='tempest-TaggedBootDevicesTest-477858861-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T18:03:45Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5e784791fe274eb7bf8e7b31fdff19f9',uuid=56de3dd1-6873-4c0a-9d80-58518dfd671e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a41dc4d4-b94a-4659-8709-566b029d2b20", "address": "fa:16:3e:c3:19:36", "network": {"id": "3143fa56-ddfb-4a80-8df7-33d38513cf4b", "bridge": "br-int", "label": "tempest-device-tagging-net1-2047429033", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.253", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "a9fa0da4ffc3447795c69b31e4e9a8d0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa41dc4d4-b9", "ovs_interfaceid": "a41dc4d4-b94a-4659-8709-566b029d2b20", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74613) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 29 18:04:14 user nova-compute[74613]: DEBUG nova.network.os_vif_util [None req-5d8a83ba-92bc-4e1d-9331-d030cb74bfa2 tempest-TaggedBootDevicesTest-477858861 tempest-TaggedBootDevicesTest-477858861-project-member] Converting VIF {"id": "a41dc4d4-b94a-4659-8709-566b029d2b20", "address": "fa:16:3e:c3:19:36", "network": {"id": "3143fa56-ddfb-4a80-8df7-33d38513cf4b", "bridge": "br-int", "label": "tempest-device-tagging-net1-2047429033", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.253", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "a9fa0da4ffc3447795c69b31e4e9a8d0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa41dc4d4-b9", "ovs_interfaceid": "a41dc4d4-b94a-4659-8709-566b029d2b20", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74613) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 18:04:14 user nova-compute[74613]: DEBUG nova.network.os_vif_util [None req-5d8a83ba-92bc-4e1d-9331-d030cb74bfa2 tempest-TaggedBootDevicesTest-477858861 tempest-TaggedBootDevicesTest-477858861-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c3:19:36,bridge_name='br-int',has_traffic_filtering=True,id=a41dc4d4-b94a-4659-8709-566b029d2b20,network=Network(3143fa56-ddfb-4a80-8df7-33d38513cf4b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa41dc4d4-b9') {{(pid=74613) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 18:04:14 user nova-compute[74613]: DEBUG nova.virt.libvirt.vif [None req-5d8a83ba-92bc-4e1d-9331-d030cb74bfa2 tempest-TaggedBootDevicesTest-477858861 tempest-TaggedBootDevicesTest-477858861-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-29T18:03:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-673218276',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-673218276',id=26,image_ref='4217f428-8d9d-4ee1-9614-642d26d90c46',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGL96hGsOikLqEHhsj9njCpyfE8e3V+KiaQzlnoRrJRaG1J/31X2lFl/ghui5RIyt0tbBjgF9ySvX5PG4tyErQ1KUFBDp+LZCscA6MDkYFpNo0AlMS+hxWRKFmIZybqZvg==',key_name='tempest-keypair-1703547228',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a9fa0da4ffc3447795c69b31e4e9a8d0',ramdisk_id='',reservation_id='r-9nbsmznw',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='4217f428-8d9d-4ee1-9614-642d26d90c46',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-477858861',owner_user_name='tempest-TaggedBootDevicesTest-477858861-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T18:03:45Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5e784791fe274eb7bf8e7b31fdff19f9',uuid=56de3dd1-6873-4c0a-9d80-58518dfd671e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4e39483b-3a24-4948-8025-ab381a1a6eee", "address": "fa:16:3e:b3:40:e7", "network": {"id": "e20648c0-8ed3-4009-b577-e6af59d212cd", "bridge": "br-int", "label": "tempest-device-tagging-net2-1059246863", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "a9fa0da4ffc3447795c69b31e4e9a8d0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4e39483b-3a", "ovs_interfaceid": "4e39483b-3a24-4948-8025-ab381a1a6eee", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74613) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 29 18:04:14 user nova-compute[74613]: DEBUG nova.network.os_vif_util [None req-5d8a83ba-92bc-4e1d-9331-d030cb74bfa2 tempest-TaggedBootDevicesTest-477858861 tempest-TaggedBootDevicesTest-477858861-project-member] Converting VIF {"id": "4e39483b-3a24-4948-8025-ab381a1a6eee", "address": "fa:16:3e:b3:40:e7", "network": {"id": "e20648c0-8ed3-4009-b577-e6af59d212cd", "bridge": "br-int", "label": "tempest-device-tagging-net2-1059246863", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "a9fa0da4ffc3447795c69b31e4e9a8d0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4e39483b-3a", "ovs_interfaceid": "4e39483b-3a24-4948-8025-ab381a1a6eee", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74613) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 18:04:14 user nova-compute[74613]: DEBUG nova.network.os_vif_util [None req-5d8a83ba-92bc-4e1d-9331-d030cb74bfa2 tempest-TaggedBootDevicesTest-477858861 tempest-TaggedBootDevicesTest-477858861-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b3:40:e7,bridge_name='br-int',has_traffic_filtering=True,id=4e39483b-3a24-4948-8025-ab381a1a6eee,network=Network(e20648c0-8ed3-4009-b577-e6af59d212cd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4e39483b-3a') {{(pid=74613) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 18:04:14 user nova-compute[74613]: DEBUG nova.virt.libvirt.vif [None req-5d8a83ba-92bc-4e1d-9331-d030cb74bfa2 tempest-TaggedBootDevicesTest-477858861 tempest-TaggedBootDevicesTest-477858861-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-29T18:03:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-673218276',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-673218276',id=26,image_ref='4217f428-8d9d-4ee1-9614-642d26d90c46',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGL96hGsOikLqEHhsj9njCpyfE8e3V+KiaQzlnoRrJRaG1J/31X2lFl/ghui5RIyt0tbBjgF9ySvX5PG4tyErQ1KUFBDp+LZCscA6MDkYFpNo0AlMS+hxWRKFmIZybqZvg==',key_name='tempest-keypair-1703547228',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a9fa0da4ffc3447795c69b31e4e9a8d0',ramdisk_id='',reservation_id='r-9nbsmznw',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='4217f428-8d9d-4ee1-9614-642d26d90c46',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-477858861',owner_user_name='tempest-TaggedBootDevicesTest-477858861-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T18:03:45Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5e784791fe274eb7bf8e7b31fdff19f9',uuid=56de3dd1-6873-4c0a-9d80-58518dfd671e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "30db35d4-e78c-414e-bae8-593d9aaadda8", "address": "fa:16:3e:a3:1f:b8", "network": {"id": "e20648c0-8ed3-4009-b577-e6af59d212cd", "bridge": "br-int", "label": "tempest-device-tagging-net2-1059246863", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "a9fa0da4ffc3447795c69b31e4e9a8d0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap30db35d4-e7", "ovs_interfaceid": "30db35d4-e78c-414e-bae8-593d9aaadda8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74613) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 29 18:04:14 user nova-compute[74613]: DEBUG nova.network.os_vif_util [None req-5d8a83ba-92bc-4e1d-9331-d030cb74bfa2 tempest-TaggedBootDevicesTest-477858861 tempest-TaggedBootDevicesTest-477858861-project-member] Converting VIF {"id": "30db35d4-e78c-414e-bae8-593d9aaadda8", "address": "fa:16:3e:a3:1f:b8", "network": {"id": "e20648c0-8ed3-4009-b577-e6af59d212cd", "bridge": "br-int", "label": "tempest-device-tagging-net2-1059246863", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "a9fa0da4ffc3447795c69b31e4e9a8d0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap30db35d4-e7", "ovs_interfaceid": "30db35d4-e78c-414e-bae8-593d9aaadda8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74613) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 18:04:14 user nova-compute[74613]: DEBUG nova.network.os_vif_util [None req-5d8a83ba-92bc-4e1d-9331-d030cb74bfa2 tempest-TaggedBootDevicesTest-477858861 tempest-TaggedBootDevicesTest-477858861-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a3:1f:b8,bridge_name='br-int',has_traffic_filtering=True,id=30db35d4-e78c-414e-bae8-593d9aaadda8,network=Network(e20648c0-8ed3-4009-b577-e6af59d212cd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap30db35d4-e7') {{(pid=74613) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 18:04:14 user nova-compute[74613]: DEBUG nova.objects.instance [None req-5d8a83ba-92bc-4e1d-9331-d030cb74bfa2 tempest-TaggedBootDevicesTest-477858861 tempest-TaggedBootDevicesTest-477858861-project-member] Lazy-loading 'pci_devices' on Instance uuid 56de3dd1-6873-4c0a-9d80-58518dfd671e {{(pid=74613) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 18:04:14 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-5d8a83ba-92bc-4e1d-9331-d030cb74bfa2 tempest-TaggedBootDevicesTest-477858861 tempest-TaggedBootDevicesTest-477858861-project-member] [instance: 56de3dd1-6873-4c0a-9d80-58518dfd671e] End _get_guest_xml xml=<domain type="kvm">
Nov 29 18:04:14 user nova-compute[74613]:   <uuid>56de3dd1-6873-4c0a-9d80-58518dfd671e</uuid>
Nov 29 18:04:14 user nova-compute[74613]:   <name>instance-0000001a</name>
Nov 29 18:04:14 user nova-compute[74613]:   <memory>524288</memory>
Nov 29 18:04:14 user nova-compute[74613]:   <vcpu>1</vcpu>
Nov 29 18:04:14 user nova-compute[74613]:   <metadata>
Nov 29 18:04:14 user nova-compute[74613]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 29 18:04:14 user nova-compute[74613]:       <nova:package version="0.0.0"/>
Nov 29 18:04:14 user nova-compute[74613]:       <nova:name>tempest-device-tagging-server-673218276</nova:name>
Nov 29 18:04:14 user nova-compute[74613]:       <nova:creationTime>2023-11-29 18:04:10</nova:creationTime>
Nov 29 18:04:14 user nova-compute[74613]:       <nova:flavor name="m1.tiny">
Nov 29 18:04:14 user nova-compute[74613]:         <nova:memory>512</nova:memory>
Nov 29 18:04:14 user nova-compute[74613]:         <nova:disk>1</nova:disk>
Nov 29 18:04:14 user nova-compute[74613]:         <nova:swap>0</nova:swap>
Nov 29 18:04:14 user nova-compute[74613]:         <nova:ephemeral>0</nova:ephemeral>
Nov 29 18:04:14 user nova-compute[74613]:         <nova:vcpus>1</nova:vcpus>
Nov 29 18:04:14 user nova-compute[74613]:       </nova:flavor>
Nov 29 18:04:14 user nova-compute[74613]:       <nova:owner>
Nov 29 18:04:14 user nova-compute[74613]:         <nova:user uuid="5e784791fe274eb7bf8e7b31fdff19f9">tempest-TaggedBootDevicesTest-477858861-project-member</nova:user>
Nov 29 18:04:14 user nova-compute[74613]:         <nova:project uuid="a9fa0da4ffc3447795c69b31e4e9a8d0">tempest-TaggedBootDevicesTest-477858861</nova:project>
Nov 29 18:04:14 user nova-compute[74613]:       </nova:owner>
Nov 29 18:04:14 user nova-compute[74613]:       <nova:root type="image" uuid="4217f428-8d9d-4ee1-9614-642d26d90c46"/>
Nov 29 18:04:14 user nova-compute[74613]:       <nova:ports>
Nov 29 18:04:14 user nova-compute[74613]:         <nova:port uuid="fd1eeb3e-46e9-441a-90e1-048c5ad64d0e">
Nov 29 18:04:14 user nova-compute[74613]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Nov 29 18:04:14 user nova-compute[74613]:         </nova:port>
Nov 29 18:04:14 user nova-compute[74613]:         <nova:port uuid="7d1e40a2-4a06-4e8e-935c-3d66553dac82">
Nov 29 18:04:14 user nova-compute[74613]:           <nova:ip type="fixed" address="10.1.1.201" ipVersion="4"/>
Nov 29 18:04:14 user nova-compute[74613]:         </nova:port>
Nov 29 18:04:14 user nova-compute[74613]:         <nova:port uuid="70ada3a3-186a-425a-8c4c-7af3b2d647ef">
Nov 29 18:04:14 user nova-compute[74613]:           <nova:ip type="fixed" address="10.1.1.230" ipVersion="4"/>
Nov 29 18:04:14 user nova-compute[74613]:         </nova:port>
Nov 29 18:04:14 user nova-compute[74613]:         <nova:port uuid="bfeedb02-28d2-4e4c-8a6b-da87e4b8f9cb">
Nov 29 18:04:14 user nova-compute[74613]:           <nova:ip type="fixed" address="10.1.1.251" ipVersion="4"/>
Nov 29 18:04:14 user nova-compute[74613]:         </nova:port>
Nov 29 18:04:14 user nova-compute[74613]:         <nova:port uuid="a41dc4d4-b94a-4659-8709-566b029d2b20">
Nov 29 18:04:14 user nova-compute[74613]:           <nova:ip type="fixed" address="10.1.1.253" ipVersion="4"/>
Nov 29 18:04:14 user nova-compute[74613]:         </nova:port>
Nov 29 18:04:14 user nova-compute[74613]:         <nova:port uuid="4e39483b-3a24-4948-8025-ab381a1a6eee">
Nov 29 18:04:14 user nova-compute[74613]:           <nova:ip type="fixed" address="10.2.2.100" ipVersion="4"/>
Nov 29 18:04:14 user nova-compute[74613]:         </nova:port>
Nov 29 18:04:14 user nova-compute[74613]:         <nova:port uuid="30db35d4-e78c-414e-bae8-593d9aaadda8">
Nov 29 18:04:14 user nova-compute[74613]:           <nova:ip type="fixed" address="10.2.2.200" ipVersion="4"/>
Nov 29 18:04:14 user nova-compute[74613]:         </nova:port>
Nov 29 18:04:14 user nova-compute[74613]:       </nova:ports>
Nov 29 18:04:14 user nova-compute[74613]:     </nova:instance>
Nov 29 18:04:14 user nova-compute[74613]:   </metadata>
Nov 29 18:04:14 user nova-compute[74613]:   <sysinfo type="smbios">
Nov 29 18:04:14 user nova-compute[74613]:     <system>
Nov 29 18:04:14 user nova-compute[74613]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 29 18:04:14 user nova-compute[74613]:       <entry name="product">OpenStack Nova</entry>
Nov 29 18:04:14 user nova-compute[74613]:       <entry name="version">0.0.0</entry>
Nov 29 18:04:14 user nova-compute[74613]:       <entry name="serial">56de3dd1-6873-4c0a-9d80-58518dfd671e</entry>
Nov 29 18:04:14 user nova-compute[74613]:       <entry name="uuid">56de3dd1-6873-4c0a-9d80-58518dfd671e</entry>
Nov 29 18:04:14 user nova-compute[74613]:       <entry name="family">Virtual Machine</entry>
Nov 29 18:04:14 user nova-compute[74613]:     </system>
Nov 29 18:04:14 user nova-compute[74613]:   </sysinfo>
Nov 29 18:04:14 user nova-compute[74613]:   <os>
Nov 29 18:04:14 user nova-compute[74613]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 29 18:04:14 user nova-compute[74613]:     <boot dev="hd"/>
Nov 29 18:04:14 user nova-compute[74613]:     <smbios mode="sysinfo"/>
Nov 29 18:04:14 user nova-compute[74613]:   </os>
Nov 29 18:04:14 user nova-compute[74613]:   <features>
Nov 29 18:04:14 user nova-compute[74613]:     <acpi/>
Nov 29 18:04:14 user nova-compute[74613]:     <apic/>
Nov 29 18:04:14 user nova-compute[74613]:     <vmcoreinfo/>
Nov 29 18:04:14 user nova-compute[74613]:   </features>
Nov 29 18:04:14 user nova-compute[74613]:   <clock offset="utc">
Nov 29 18:04:14 user nova-compute[74613]:     <timer name="pit" tickpolicy="delay"/>
Nov 29 18:04:14 user nova-compute[74613]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 29 18:04:14 user nova-compute[74613]:     <timer name="hpet" present="no"/>
Nov 29 18:04:14 user nova-compute[74613]:   </clock>
Nov 29 18:04:14 user nova-compute[74613]:   <cpu mode="custom" match="exact">
Nov 29 18:04:14 user nova-compute[74613]:     <model>Nehalem</model>
Nov 29 18:04:14 user nova-compute[74613]:     <topology sockets="1" cores="1" threads="1"/>
Nov 29 18:04:14 user nova-compute[74613]:   </cpu>
Nov 29 18:04:14 user nova-compute[74613]:   <devices>
Nov 29 18:04:14 user nova-compute[74613]:     <disk type="file" device="cdrom">
Nov 29 18:04:14 user nova-compute[74613]:       <driver name="qemu" type="raw" cache="none"/>
Nov 29 18:04:14 user nova-compute[74613]:       <source file="/opt/stack/data/nova/instances/56de3dd1-6873-4c0a-9d80-58518dfd671e/disk.config"/>
Nov 29 18:04:14 user nova-compute[74613]:       <target dev="hda" bus="ide"/>
Nov 29 18:04:14 user nova-compute[74613]:     </disk>
Nov 29 18:04:14 user nova-compute[74613]:     <disk type="block" device="disk">
Nov 29 18:04:14 user nova-compute[74613]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 18:04:14 user nova-compute[74613]:       <source dev="/dev/sdd"/>
Nov 29 18:04:14 user nova-compute[74613]:       <target dev="vda" bus="virtio"/>
Nov 29 18:04:14 user nova-compute[74613]:       <serial>32c4a58d-da1b-468d-b32a-6ff5cdc8993d</serial>
Nov 29 18:04:14 user nova-compute[74613]:     </disk>
Nov 29 18:04:14 user nova-compute[74613]:     <disk type="block" device="disk">
Nov 29 18:04:14 user nova-compute[74613]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 18:04:14 user nova-compute[74613]:       <source dev="/dev/sdf"/>
Nov 29 18:04:14 user nova-compute[74613]:       <target dev="vdb" bus="virtio"/>
Nov 29 18:04:14 user nova-compute[74613]:       <serial>b4a04a56-f988-4ae8-a3d3-271caf058c33</serial>
Nov 29 18:04:14 user nova-compute[74613]:     </disk>
Nov 29 18:04:14 user nova-compute[74613]:     <disk type="block" device="disk">
Nov 29 18:04:14 user nova-compute[74613]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 18:04:14 user nova-compute[74613]:       <source dev="/dev/sdg"/>
Nov 29 18:04:14 user nova-compute[74613]:       <target dev="vdc" bus="virtio"/>
Nov 29 18:04:14 user nova-compute[74613]:       <serial>01de4abf-62b4-4200-97dc-9a38d07324e5</serial>
Nov 29 18:04:14 user nova-compute[74613]:     </disk>
Nov 29 18:04:14 user nova-compute[74613]:     <interface type="ethernet">
Nov 29 18:04:14 user nova-compute[74613]:       <mac address="fa:16:3e:23:fc:5e"/>
Nov 29 18:04:14 user nova-compute[74613]:       <model type="virtio"/>
Nov 29 18:04:14 user nova-compute[74613]:       <mtu size="1442"/>
Nov 29 18:04:14 user nova-compute[74613]:       <target dev="tapfd1eeb3e-46"/>
Nov 29 18:04:14 user nova-compute[74613]:     </interface>
Nov 29 18:04:14 user nova-compute[74613]:     <interface type="ethernet">
Nov 29 18:04:14 user nova-compute[74613]:       <mac address="fa:16:3e:a9:89:7f"/>
Nov 29 18:04:14 user nova-compute[74613]:       <model type="virtio"/>
Nov 29 18:04:14 user nova-compute[74613]:       <mtu size="1442"/>
Nov 29 18:04:14 user nova-compute[74613]:       <target dev="tap7d1e40a2-4a"/>
Nov 29 18:04:14 user nova-compute[74613]:     </interface>
Nov 29 18:04:14 user nova-compute[74613]:     <interface type="ethernet">
Nov 29 18:04:14 user nova-compute[74613]:       <mac address="fa:16:3e:7f:89:6c"/>
Nov 29 18:04:14 user nova-compute[74613]:       <model type="virtio"/>
Nov 29 18:04:14 user nova-compute[74613]:       <mtu size="1442"/>
Nov 29 18:04:14 user nova-compute[74613]:       <target dev="tap70ada3a3-18"/>
Nov 29 18:04:14 user nova-compute[74613]:     </interface>
Nov 29 18:04:14 user nova-compute[74613]:     <interface type="ethernet">
Nov 29 18:04:14 user nova-compute[74613]:       <mac address="fa:16:3e:c9:00:90"/>
Nov 29 18:04:14 user nova-compute[74613]:       <model type="virtio"/>
Nov 29 18:04:14 user nova-compute[74613]:       <mtu size="1442"/>
Nov 29 18:04:14 user nova-compute[74613]:       <target dev="tapbfeedb02-28"/>
Nov 29 18:04:14 user nova-compute[74613]:     </interface>
Nov 29 18:04:14 user nova-compute[74613]:     <interface type="ethernet">
Nov 29 18:04:14 user nova-compute[74613]:       <mac address="fa:16:3e:c3:19:36"/>
Nov 29 18:04:14 user nova-compute[74613]:       <model type="virtio"/>
Nov 29 18:04:14 user nova-compute[74613]:       <mtu size="1442"/>
Nov 29 18:04:14 user nova-compute[74613]:       <target dev="tapa41dc4d4-b9"/>
Nov 29 18:04:14 user nova-compute[74613]:     </interface>
Nov 29 18:04:14 user nova-compute[74613]:     <interface type="ethernet">
Nov 29 18:04:14 user nova-compute[74613]:       <mac address="fa:16:3e:b3:40:e7"/>
Nov 29 18:04:14 user nova-compute[74613]:       <model type="virtio"/>
Nov 29 18:04:14 user nova-compute[74613]:       <mtu size="1442"/>
Nov 29 18:04:14 user nova-compute[74613]:       <target dev="tap4e39483b-3a"/>
Nov 29 18:04:14 user nova-compute[74613]:     </interface>
Nov 29 18:04:14 user nova-compute[74613]:     <interface type="ethernet">
Nov 29 18:04:14 user nova-compute[74613]:       <mac address="fa:16:3e:a3:1f:b8"/>
Nov 29 18:04:14 user nova-compute[74613]:       <model type="virtio"/>
Nov 29 18:04:14 user nova-compute[74613]:       <mtu size="1442"/>
Nov 29 18:04:14 user nova-compute[74613]:       <target dev="tap30db35d4-e7"/>
Nov 29 18:04:14 user nova-compute[74613]:     </interface>
Nov 29 18:04:14 user nova-compute[74613]:     <serial type="pty">
Nov 29 18:04:14 user nova-compute[74613]:       <log file="/opt/stack/data/nova/instances/56de3dd1-6873-4c0a-9d80-58518dfd671e/console.log" append="off"/>
Nov 29 18:04:14 user nova-compute[74613]:     </serial>
Nov 29 18:04:14 user nova-compute[74613]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 29 18:04:14 user nova-compute[74613]:     <video>
Nov 29 18:04:14 user nova-compute[74613]:       <model type="virtio"/>
Nov 29 18:04:14 user nova-compute[74613]:     </video>
Nov 29 18:04:14 user nova-compute[74613]:     <rng model="virtio">
Nov 29 18:04:14 user nova-compute[74613]:       <backend model="random">/dev/urandom</backend>
Nov 29 18:04:14 user nova-compute[74613]:     </rng>
Nov 29 18:04:14 user nova-compute[74613]:     <controller type="usb" index="0" model="none"/>
Nov 29 18:04:14 user nova-compute[74613]:     <memballoon model="virtio">
Nov 29 18:04:14 user nova-compute[74613]:       <stats period="10"/>
Nov 29 18:04:14 user nova-compute[74613]:     </memballoon>
Nov 29 18:04:14 user nova-compute[74613]:   </devices>
Nov 29 18:04:14 user nova-compute[74613]: </domain>
Nov 29 18:04:14 user nova-compute[74613]:  {{(pid=74613) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 29 18:04:14 user nova-compute[74613]: DEBUG nova.virt.libvirt.vif [None req-5d8a83ba-92bc-4e1d-9331-d030cb74bfa2 tempest-TaggedBootDevicesTest-477858861 tempest-TaggedBootDevicesTest-477858861-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-29T18:03:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-673218276',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-673218276',id=26,image_ref='4217f428-8d9d-4ee1-9614-642d26d90c46',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGL96hGsOikLqEHhsj9njCpyfE8e3V+KiaQzlnoRrJRaG1J/31X2lFl/ghui5RIyt0tbBjgF9ySvX5PG4tyErQ1KUFBDp+LZCscA6MDkYFpNo0AlMS+hxWRKFmIZybqZvg==',key_name='tempest-keypair-1703547228',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a9fa0da4ffc3447795c69b31e4e9a8d0',ramdisk_id='',reservation_id='r-9nbsmznw',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='4217f428-8d9d-4ee1-9614-642d26d90c46',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-477858861',owner_user_name='tempest-TaggedBootDevicesTest-477858861-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T18:03:45Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5e784791fe274eb7bf8e7b31fdff19f9',uuid=56de3dd1-6873-4c0a-9d80-58518dfd671e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "fd1eeb3e-46e9-441a-90e1-048c5ad64d0e", "address": "fa:16:3e:23:fc:5e", "network": {"id": "de42d2ca-c48c-4dc3-8b92-61dc7cbafb64", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-203953398-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a9fa0da4ffc3447795c69b31e4e9a8d0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfd1eeb3e-46", "ovs_interfaceid": "fd1eeb3e-46e9-441a-90e1-048c5ad64d0e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74613) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 29 18:04:14 user nova-compute[74613]: DEBUG nova.network.os_vif_util [None req-5d8a83ba-92bc-4e1d-9331-d030cb74bfa2 tempest-TaggedBootDevicesTest-477858861 tempest-TaggedBootDevicesTest-477858861-project-member] Converting VIF {"id": "fd1eeb3e-46e9-441a-90e1-048c5ad64d0e", "address": "fa:16:3e:23:fc:5e", "network": {"id": "de42d2ca-c48c-4dc3-8b92-61dc7cbafb64", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-203953398-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a9fa0da4ffc3447795c69b31e4e9a8d0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfd1eeb3e-46", "ovs_interfaceid": "fd1eeb3e-46e9-441a-90e1-048c5ad64d0e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74613) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 18:04:14 user nova-compute[74613]: DEBUG nova.network.os_vif_util [None req-5d8a83ba-92bc-4e1d-9331-d030cb74bfa2 tempest-TaggedBootDevicesTest-477858861 tempest-TaggedBootDevicesTest-477858861-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:23:fc:5e,bridge_name='br-int',has_traffic_filtering=True,id=fd1eeb3e-46e9-441a-90e1-048c5ad64d0e,network=Network(de42d2ca-c48c-4dc3-8b92-61dc7cbafb64),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfd1eeb3e-46') {{(pid=74613) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 18:04:14 user nova-compute[74613]: DEBUG os_vif [None req-5d8a83ba-92bc-4e1d-9331-d030cb74bfa2 tempest-TaggedBootDevicesTest-477858861 tempest-TaggedBootDevicesTest-477858861-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:23:fc:5e,bridge_name='br-int',has_traffic_filtering=True,id=fd1eeb3e-46e9-441a-90e1-048c5ad64d0e,network=Network(de42d2ca-c48c-4dc3-8b92-61dc7cbafb64),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfd1eeb3e-46') {{(pid=74613) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 29 18:04:14 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:04:14 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74613) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 18:04:14 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74613) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 29 18:04:14 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:04:14 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '4dfcf38a-e222-5a3f-b093-8ab3e14a0e9f', '_type': 'linux-noop'}}, row=False) {{(pid=74613) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 18:04:14 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:04:14 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 18:04:14 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:04:14 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapfd1eeb3e-46, may_exist=True, interface_attrs={}) {{(pid=74613) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 18:04:14 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapfd1eeb3e-46, col_values=(('qos', UUID('0b578eb5-96bb-47e3-af46-49c6f4f395b8')),), if_exists=True) {{(pid=74613) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 18:04:14 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapfd1eeb3e-46, col_values=(('external_ids', {'iface-id': 'fd1eeb3e-46e9-441a-90e1-048c5ad64d0e', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:23:fc:5e', 'vm-uuid': '56de3dd1-6873-4c0a-9d80-58518dfd671e'}),), if_exists=True) {{(pid=74613) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 18:04:14 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:04:14 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 18:04:14 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:04:14 user nova-compute[74613]: INFO os_vif [None req-5d8a83ba-92bc-4e1d-9331-d030cb74bfa2 tempest-TaggedBootDevicesTest-477858861 tempest-TaggedBootDevicesTest-477858861-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:23:fc:5e,bridge_name='br-int',has_traffic_filtering=True,id=fd1eeb3e-46e9-441a-90e1-048c5ad64d0e,network=Network(de42d2ca-c48c-4dc3-8b92-61dc7cbafb64),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfd1eeb3e-46')
Nov 29 18:04:14 user nova-compute[74613]: DEBUG nova.virt.libvirt.vif [None req-5d8a83ba-92bc-4e1d-9331-d030cb74bfa2 tempest-TaggedBootDevicesTest-477858861 tempest-TaggedBootDevicesTest-477858861-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-29T18:03:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-673218276',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-673218276',id=26,image_ref='4217f428-8d9d-4ee1-9614-642d26d90c46',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGL96hGsOikLqEHhsj9njCpyfE8e3V+KiaQzlnoRrJRaG1J/31X2lFl/ghui5RIyt0tbBjgF9ySvX5PG4tyErQ1KUFBDp+LZCscA6MDkYFpNo0AlMS+hxWRKFmIZybqZvg==',key_name='tempest-keypair-1703547228',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a9fa0da4ffc3447795c69b31e4e9a8d0',ramdisk_id='',reservation_id='r-9nbsmznw',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='4217f428-8d9d-4ee1-9614-642d26d90c46',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-477858861',owner_user_name='tempest-TaggedBootDevicesTest-477858861-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T18:03:45Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5e784791fe274eb7bf8e7b31fdff19f9',uuid=56de3dd1-6873-4c0a-9d80-58518dfd671e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7d1e40a2-4a06-4e8e-935c-3d66553dac82", "address": "fa:16:3e:a9:89:7f", "network": {"id": "3143fa56-ddfb-4a80-8df7-33d38513cf4b", "bridge": "br-int", "label": "tempest-device-tagging-net1-2047429033", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.201", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "a9fa0da4ffc3447795c69b31e4e9a8d0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7d1e40a2-4a", "ovs_interfaceid": "7d1e40a2-4a06-4e8e-935c-3d66553dac82", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74613) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 29 18:04:14 user nova-compute[74613]: DEBUG nova.network.os_vif_util [None req-5d8a83ba-92bc-4e1d-9331-d030cb74bfa2 tempest-TaggedBootDevicesTest-477858861 tempest-TaggedBootDevicesTest-477858861-project-member] Converting VIF {"id": "7d1e40a2-4a06-4e8e-935c-3d66553dac82", "address": "fa:16:3e:a9:89:7f", "network": {"id": "3143fa56-ddfb-4a80-8df7-33d38513cf4b", "bridge": "br-int", "label": "tempest-device-tagging-net1-2047429033", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.201", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "a9fa0da4ffc3447795c69b31e4e9a8d0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7d1e40a2-4a", "ovs_interfaceid": "7d1e40a2-4a06-4e8e-935c-3d66553dac82", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74613) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 18:04:14 user nova-compute[74613]: DEBUG nova.network.os_vif_util [None req-5d8a83ba-92bc-4e1d-9331-d030cb74bfa2 tempest-TaggedBootDevicesTest-477858861 tempest-TaggedBootDevicesTest-477858861-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a9:89:7f,bridge_name='br-int',has_traffic_filtering=True,id=7d1e40a2-4a06-4e8e-935c-3d66553dac82,network=Network(3143fa56-ddfb-4a80-8df7-33d38513cf4b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap7d1e40a2-4a') {{(pid=74613) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 18:04:14 user nova-compute[74613]: DEBUG os_vif [None req-5d8a83ba-92bc-4e1d-9331-d030cb74bfa2 tempest-TaggedBootDevicesTest-477858861 tempest-TaggedBootDevicesTest-477858861-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a9:89:7f,bridge_name='br-int',has_traffic_filtering=True,id=7d1e40a2-4a06-4e8e-935c-3d66553dac82,network=Network(3143fa56-ddfb-4a80-8df7-33d38513cf4b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap7d1e40a2-4a') {{(pid=74613) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 29 18:04:14 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:04:14 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74613) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 18:04:14 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74613) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 29 18:04:14 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:04:14 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '585d4bcd-97ea-514d-bfbc-85c85cfcb34f', '_type': 'linux-noop'}}, row=False) {{(pid=74613) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 18:04:14 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:04:14 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 18:04:14 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:04:14 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:04:14 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap7d1e40a2-4a, may_exist=True, interface_attrs={}) {{(pid=74613) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 18:04:14 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap7d1e40a2-4a, col_values=(('qos', UUID('e7343578-e224-4932-b7a7-78cf11f9e4ba')),), if_exists=True) {{(pid=74613) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 18:04:14 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap7d1e40a2-4a, col_values=(('external_ids', {'iface-id': '7d1e40a2-4a06-4e8e-935c-3d66553dac82', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:a9:89:7f', 'vm-uuid': '56de3dd1-6873-4c0a-9d80-58518dfd671e'}),), if_exists=True) {{(pid=74613) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 18:04:14 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:04:14 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 18:04:14 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:04:14 user nova-compute[74613]: INFO os_vif [None req-5d8a83ba-92bc-4e1d-9331-d030cb74bfa2 tempest-TaggedBootDevicesTest-477858861 tempest-TaggedBootDevicesTest-477858861-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a9:89:7f,bridge_name='br-int',has_traffic_filtering=True,id=7d1e40a2-4a06-4e8e-935c-3d66553dac82,network=Network(3143fa56-ddfb-4a80-8df7-33d38513cf4b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap7d1e40a2-4a')
Nov 29 18:04:14 user nova-compute[74613]: DEBUG nova.virt.libvirt.vif [None req-5d8a83ba-92bc-4e1d-9331-d030cb74bfa2 tempest-TaggedBootDevicesTest-477858861 tempest-TaggedBootDevicesTest-477858861-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-29T18:03:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-673218276',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-673218276',id=26,image_ref='4217f428-8d9d-4ee1-9614-642d26d90c46',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGL96hGsOikLqEHhsj9njCpyfE8e3V+KiaQzlnoRrJRaG1J/31X2lFl/ghui5RIyt0tbBjgF9ySvX5PG4tyErQ1KUFBDp+LZCscA6MDkYFpNo0AlMS+hxWRKFmIZybqZvg==',key_name='tempest-keypair-1703547228',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a9fa0da4ffc3447795c69b31e4e9a8d0',ramdisk_id='',reservation_id='r-9nbsmznw',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='4217f428-8d9d-4ee1-9614-642d26d90c46',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-477858861',owner_user_name='tempest-TaggedBootDevicesTest-477858861-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T18:03:45Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5e784791fe274eb7bf8e7b31fdff19f9',uuid=56de3dd1-6873-4c0a-9d80-58518dfd671e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "70ada3a3-186a-425a-8c4c-7af3b2d647ef", "address": "fa:16:3e:7f:89:6c", "network": {"id": "3143fa56-ddfb-4a80-8df7-33d38513cf4b", "bridge": "br-int", "label": "tempest-device-tagging-net1-2047429033", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.230", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "a9fa0da4ffc3447795c69b31e4e9a8d0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap70ada3a3-18", "ovs_interfaceid": "70ada3a3-186a-425a-8c4c-7af3b2d647ef", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74613) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 29 18:04:14 user nova-compute[74613]: DEBUG nova.network.os_vif_util [None req-5d8a83ba-92bc-4e1d-9331-d030cb74bfa2 tempest-TaggedBootDevicesTest-477858861 tempest-TaggedBootDevicesTest-477858861-project-member] Converting VIF {"id": "70ada3a3-186a-425a-8c4c-7af3b2d647ef", "address": "fa:16:3e:7f:89:6c", "network": {"id": "3143fa56-ddfb-4a80-8df7-33d38513cf4b", "bridge": "br-int", "label": "tempest-device-tagging-net1-2047429033", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.230", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "a9fa0da4ffc3447795c69b31e4e9a8d0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap70ada3a3-18", "ovs_interfaceid": "70ada3a3-186a-425a-8c4c-7af3b2d647ef", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74613) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 18:04:14 user nova-compute[74613]: DEBUG nova.network.os_vif_util [None req-5d8a83ba-92bc-4e1d-9331-d030cb74bfa2 tempest-TaggedBootDevicesTest-477858861 tempest-TaggedBootDevicesTest-477858861-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7f:89:6c,bridge_name='br-int',has_traffic_filtering=True,id=70ada3a3-186a-425a-8c4c-7af3b2d647ef,network=Network(3143fa56-ddfb-4a80-8df7-33d38513cf4b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap70ada3a3-18') {{(pid=74613) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 18:04:14 user nova-compute[74613]: DEBUG os_vif [None req-5d8a83ba-92bc-4e1d-9331-d030cb74bfa2 tempest-TaggedBootDevicesTest-477858861 tempest-TaggedBootDevicesTest-477858861-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:7f:89:6c,bridge_name='br-int',has_traffic_filtering=True,id=70ada3a3-186a-425a-8c4c-7af3b2d647ef,network=Network(3143fa56-ddfb-4a80-8df7-33d38513cf4b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap70ada3a3-18') {{(pid=74613) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 29 18:04:14 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:04:14 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74613) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 18:04:14 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74613) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 29 18:04:14 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:04:14 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '86c9e122-b433-5711-92a9-477144f68424', '_type': 'linux-noop'}}, row=False) {{(pid=74613) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 18:04:14 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:04:14 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 18:04:14 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:04:14 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:04:14 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap70ada3a3-18, may_exist=True, interface_attrs={}) {{(pid=74613) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 18:04:14 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap70ada3a3-18, col_values=(('qos', UUID('5ada9aa8-666e-4b1f-a360-f444450e15ef')),), if_exists=True) {{(pid=74613) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 18:04:14 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap70ada3a3-18, col_values=(('external_ids', {'iface-id': '70ada3a3-186a-425a-8c4c-7af3b2d647ef', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:7f:89:6c', 'vm-uuid': '56de3dd1-6873-4c0a-9d80-58518dfd671e'}),), if_exists=True) {{(pid=74613) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 18:04:14 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:04:14 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 18:04:14 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:04:14 user nova-compute[74613]: INFO os_vif [None req-5d8a83ba-92bc-4e1d-9331-d030cb74bfa2 tempest-TaggedBootDevicesTest-477858861 tempest-TaggedBootDevicesTest-477858861-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:7f:89:6c,bridge_name='br-int',has_traffic_filtering=True,id=70ada3a3-186a-425a-8c4c-7af3b2d647ef,network=Network(3143fa56-ddfb-4a80-8df7-33d38513cf4b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap70ada3a3-18')
Nov 29 18:04:14 user nova-compute[74613]: DEBUG nova.virt.libvirt.vif [None req-5d8a83ba-92bc-4e1d-9331-d030cb74bfa2 tempest-TaggedBootDevicesTest-477858861 tempest-TaggedBootDevicesTest-477858861-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-29T18:03:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-673218276',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-673218276',id=26,image_ref='4217f428-8d9d-4ee1-9614-642d26d90c46',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGL96hGsOikLqEHhsj9njCpyfE8e3V+KiaQzlnoRrJRaG1J/31X2lFl/ghui5RIyt0tbBjgF9ySvX5PG4tyErQ1KUFBDp+LZCscA6MDkYFpNo0AlMS+hxWRKFmIZybqZvg==',key_name='tempest-keypair-1703547228',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a9fa0da4ffc3447795c69b31e4e9a8d0',ramdisk_id='',reservation_id='r-9nbsmznw',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='4217f428-8d9d-4ee1-9614-642d26d90c46',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-477858861',owner_user_name='tempest-TaggedBootDevicesTest-477858861-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T18:03:45Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5e784791fe274eb7bf8e7b31fdff19f9',uuid=56de3dd1-6873-4c0a-9d80-58518dfd671e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "bfeedb02-28d2-4e4c-8a6b-da87e4b8f9cb", "address": "fa:16:3e:c9:00:90", "network": {"id": "3143fa56-ddfb-4a80-8df7-33d38513cf4b", "bridge": "br-int", "label": "tempest-device-tagging-net1-2047429033", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.251", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "a9fa0da4ffc3447795c69b31e4e9a8d0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbfeedb02-28", "ovs_interfaceid": "bfeedb02-28d2-4e4c-8a6b-da87e4b8f9cb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74613) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 29 18:04:14 user nova-compute[74613]: DEBUG nova.network.os_vif_util [None req-5d8a83ba-92bc-4e1d-9331-d030cb74bfa2 tempest-TaggedBootDevicesTest-477858861 tempest-TaggedBootDevicesTest-477858861-project-member] Converting VIF {"id": "bfeedb02-28d2-4e4c-8a6b-da87e4b8f9cb", "address": "fa:16:3e:c9:00:90", "network": {"id": "3143fa56-ddfb-4a80-8df7-33d38513cf4b", "bridge": "br-int", "label": "tempest-device-tagging-net1-2047429033", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.251", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "a9fa0da4ffc3447795c69b31e4e9a8d0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbfeedb02-28", "ovs_interfaceid": "bfeedb02-28d2-4e4c-8a6b-da87e4b8f9cb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74613) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 18:04:14 user nova-compute[74613]: DEBUG nova.network.os_vif_util [None req-5d8a83ba-92bc-4e1d-9331-d030cb74bfa2 tempest-TaggedBootDevicesTest-477858861 tempest-TaggedBootDevicesTest-477858861-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c9:00:90,bridge_name='br-int',has_traffic_filtering=True,id=bfeedb02-28d2-4e4c-8a6b-da87e4b8f9cb,network=Network(3143fa56-ddfb-4a80-8df7-33d38513cf4b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbfeedb02-28') {{(pid=74613) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 18:04:14 user nova-compute[74613]: DEBUG os_vif [None req-5d8a83ba-92bc-4e1d-9331-d030cb74bfa2 tempest-TaggedBootDevicesTest-477858861 tempest-TaggedBootDevicesTest-477858861-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c9:00:90,bridge_name='br-int',has_traffic_filtering=True,id=bfeedb02-28d2-4e4c-8a6b-da87e4b8f9cb,network=Network(3143fa56-ddfb-4a80-8df7-33d38513cf4b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbfeedb02-28') {{(pid=74613) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 29 18:04:14 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:04:14 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74613) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 18:04:14 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74613) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 29 18:04:14 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:04:14 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '240bd653-4ad4-51fe-a68a-b5eaef820c88', '_type': 'linux-noop'}}, row=False) {{(pid=74613) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 18:04:14 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:04:14 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 18:04:14 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:04:14 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:04:14 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapbfeedb02-28, may_exist=True, interface_attrs={}) {{(pid=74613) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 18:04:14 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapbfeedb02-28, col_values=(('qos', UUID('ac2ecfe0-889d-4619-bd69-2ea1840c3366')),), if_exists=True) {{(pid=74613) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 18:04:14 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapbfeedb02-28, col_values=(('external_ids', {'iface-id': 'bfeedb02-28d2-4e4c-8a6b-da87e4b8f9cb', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:c9:00:90', 'vm-uuid': '56de3dd1-6873-4c0a-9d80-58518dfd671e'}),), if_exists=True) {{(pid=74613) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 18:04:14 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:04:14 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 18:04:14 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:04:14 user nova-compute[74613]: INFO os_vif [None req-5d8a83ba-92bc-4e1d-9331-d030cb74bfa2 tempest-TaggedBootDevicesTest-477858861 tempest-TaggedBootDevicesTest-477858861-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c9:00:90,bridge_name='br-int',has_traffic_filtering=True,id=bfeedb02-28d2-4e4c-8a6b-da87e4b8f9cb,network=Network(3143fa56-ddfb-4a80-8df7-33d38513cf4b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbfeedb02-28')
Nov 29 18:04:14 user nova-compute[74613]: DEBUG nova.virt.libvirt.vif [None req-5d8a83ba-92bc-4e1d-9331-d030cb74bfa2 tempest-TaggedBootDevicesTest-477858861 tempest-TaggedBootDevicesTest-477858861-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-29T18:03:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-673218276',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-673218276',id=26,image_ref='4217f428-8d9d-4ee1-9614-642d26d90c46',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGL96hGsOikLqEHhsj9njCpyfE8e3V+KiaQzlnoRrJRaG1J/31X2lFl/ghui5RIyt0tbBjgF9ySvX5PG4tyErQ1KUFBDp+LZCscA6MDkYFpNo0AlMS+hxWRKFmIZybqZvg==',key_name='tempest-keypair-1703547228',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a9fa0da4ffc3447795c69b31e4e9a8d0',ramdisk_id='',reservation_id='r-9nbsmznw',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='4217f428-8d9d-4ee1-9614-642d26d90c46',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-477858861',owner_user_name='tempest-TaggedBootDevicesTest-477858861-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T18:03:45Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5e784791fe274eb7bf8e7b31fdff19f9',uuid=56de3dd1-6873-4c0a-9d80-58518dfd671e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a41dc4d4-b94a-4659-8709-566b029d2b20", "address": "fa:16:3e:c3:19:36", "network": {"id": "3143fa56-ddfb-4a80-8df7-33d38513cf4b", "bridge": "br-int", "label": "tempest-device-tagging-net1-2047429033", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.253", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "a9fa0da4ffc3447795c69b31e4e9a8d0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa41dc4d4-b9", "ovs_interfaceid": "a41dc4d4-b94a-4659-8709-566b029d2b20", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74613) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 29 18:04:14 user nova-compute[74613]: DEBUG nova.network.os_vif_util [None req-5d8a83ba-92bc-4e1d-9331-d030cb74bfa2 tempest-TaggedBootDevicesTest-477858861 tempest-TaggedBootDevicesTest-477858861-project-member] Converting VIF {"id": "a41dc4d4-b94a-4659-8709-566b029d2b20", "address": "fa:16:3e:c3:19:36", "network": {"id": "3143fa56-ddfb-4a80-8df7-33d38513cf4b", "bridge": "br-int", "label": "tempest-device-tagging-net1-2047429033", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.253", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "a9fa0da4ffc3447795c69b31e4e9a8d0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa41dc4d4-b9", "ovs_interfaceid": "a41dc4d4-b94a-4659-8709-566b029d2b20", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74613) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 18:04:14 user nova-compute[74613]: DEBUG nova.network.os_vif_util [None req-5d8a83ba-92bc-4e1d-9331-d030cb74bfa2 tempest-TaggedBootDevicesTest-477858861 tempest-TaggedBootDevicesTest-477858861-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c3:19:36,bridge_name='br-int',has_traffic_filtering=True,id=a41dc4d4-b94a-4659-8709-566b029d2b20,network=Network(3143fa56-ddfb-4a80-8df7-33d38513cf4b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa41dc4d4-b9') {{(pid=74613) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 18:04:14 user nova-compute[74613]: DEBUG os_vif [None req-5d8a83ba-92bc-4e1d-9331-d030cb74bfa2 tempest-TaggedBootDevicesTest-477858861 tempest-TaggedBootDevicesTest-477858861-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c3:19:36,bridge_name='br-int',has_traffic_filtering=True,id=a41dc4d4-b94a-4659-8709-566b029d2b20,network=Network(3143fa56-ddfb-4a80-8df7-33d38513cf4b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa41dc4d4-b9') {{(pid=74613) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 29 18:04:14 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:04:14 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74613) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 18:04:14 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74613) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 29 18:04:14 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:04:14 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'b404143d-6894-5ae7-abcc-363d552d9d74', '_type': 'linux-noop'}}, row=False) {{(pid=74613) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 18:04:14 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:04:14 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 18:04:14 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:04:14 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:04:14 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapa41dc4d4-b9, may_exist=True, interface_attrs={}) {{(pid=74613) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 18:04:14 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapa41dc4d4-b9, col_values=(('qos', UUID('a7047048-e359-482d-a0f4-2c8a1a88dae1')),), if_exists=True) {{(pid=74613) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 18:04:14 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapa41dc4d4-b9, col_values=(('external_ids', {'iface-id': 'a41dc4d4-b94a-4659-8709-566b029d2b20', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:c3:19:36', 'vm-uuid': '56de3dd1-6873-4c0a-9d80-58518dfd671e'}),), if_exists=True) {{(pid=74613) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 18:04:14 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:04:14 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 18:04:15 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:04:15 user nova-compute[74613]: INFO os_vif [None req-5d8a83ba-92bc-4e1d-9331-d030cb74bfa2 tempest-TaggedBootDevicesTest-477858861 tempest-TaggedBootDevicesTest-477858861-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c3:19:36,bridge_name='br-int',has_traffic_filtering=True,id=a41dc4d4-b94a-4659-8709-566b029d2b20,network=Network(3143fa56-ddfb-4a80-8df7-33d38513cf4b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa41dc4d4-b9')
Nov 29 18:04:15 user nova-compute[74613]: DEBUG nova.virt.libvirt.vif [None req-5d8a83ba-92bc-4e1d-9331-d030cb74bfa2 tempest-TaggedBootDevicesTest-477858861 tempest-TaggedBootDevicesTest-477858861-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-29T18:03:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-673218276',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-673218276',id=26,image_ref='4217f428-8d9d-4ee1-9614-642d26d90c46',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGL96hGsOikLqEHhsj9njCpyfE8e3V+KiaQzlnoRrJRaG1J/31X2lFl/ghui5RIyt0tbBjgF9ySvX5PG4tyErQ1KUFBDp+LZCscA6MDkYFpNo0AlMS+hxWRKFmIZybqZvg==',key_name='tempest-keypair-1703547228',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a9fa0da4ffc3447795c69b31e4e9a8d0',ramdisk_id='',reservation_id='r-9nbsmznw',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='4217f428-8d9d-4ee1-9614-642d26d90c46',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-477858861',owner_user_name='tempest-TaggedBootDevicesTest-477858861-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T18:03:45Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5e784791fe274eb7bf8e7b31fdff19f9',uuid=56de3dd1-6873-4c0a-9d80-58518dfd671e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4e39483b-3a24-4948-8025-ab381a1a6eee", "address": "fa:16:3e:b3:40:e7", "network": {"id": "e20648c0-8ed3-4009-b577-e6af59d212cd", "bridge": "br-int", "label": "tempest-device-tagging-net2-1059246863", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "a9fa0da4ffc3447795c69b31e4e9a8d0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4e39483b-3a", "ovs_interfaceid": "4e39483b-3a24-4948-8025-ab381a1a6eee", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74613) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 29 18:04:15 user nova-compute[74613]: DEBUG nova.network.os_vif_util [None req-5d8a83ba-92bc-4e1d-9331-d030cb74bfa2 tempest-TaggedBootDevicesTest-477858861 tempest-TaggedBootDevicesTest-477858861-project-member] Converting VIF {"id": "4e39483b-3a24-4948-8025-ab381a1a6eee", "address": "fa:16:3e:b3:40:e7", "network": {"id": "e20648c0-8ed3-4009-b577-e6af59d212cd", "bridge": "br-int", "label": "tempest-device-tagging-net2-1059246863", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "a9fa0da4ffc3447795c69b31e4e9a8d0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4e39483b-3a", "ovs_interfaceid": "4e39483b-3a24-4948-8025-ab381a1a6eee", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74613) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 18:04:15 user nova-compute[74613]: DEBUG nova.network.os_vif_util [None req-5d8a83ba-92bc-4e1d-9331-d030cb74bfa2 tempest-TaggedBootDevicesTest-477858861 tempest-TaggedBootDevicesTest-477858861-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b3:40:e7,bridge_name='br-int',has_traffic_filtering=True,id=4e39483b-3a24-4948-8025-ab381a1a6eee,network=Network(e20648c0-8ed3-4009-b577-e6af59d212cd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4e39483b-3a') {{(pid=74613) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 18:04:15 user nova-compute[74613]: DEBUG os_vif [None req-5d8a83ba-92bc-4e1d-9331-d030cb74bfa2 tempest-TaggedBootDevicesTest-477858861 tempest-TaggedBootDevicesTest-477858861-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b3:40:e7,bridge_name='br-int',has_traffic_filtering=True,id=4e39483b-3a24-4948-8025-ab381a1a6eee,network=Network(e20648c0-8ed3-4009-b577-e6af59d212cd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4e39483b-3a') {{(pid=74613) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 29 18:04:15 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:04:15 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74613) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 18:04:15 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74613) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 29 18:04:15 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:04:15 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '866b2766-ba5a-5de8-8628-a5efd85e0e3d', '_type': 'linux-noop'}}, row=False) {{(pid=74613) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 18:04:15 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:04:15 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 18:04:15 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:04:15 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:04:15 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap4e39483b-3a, may_exist=True, interface_attrs={}) {{(pid=74613) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 18:04:15 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap4e39483b-3a, col_values=(('qos', UUID('17f88e1a-98dc-459b-8ffd-d7e7c58a7585')),), if_exists=True) {{(pid=74613) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 18:04:15 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap4e39483b-3a, col_values=(('external_ids', {'iface-id': '4e39483b-3a24-4948-8025-ab381a1a6eee', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:b3:40:e7', 'vm-uuid': '56de3dd1-6873-4c0a-9d80-58518dfd671e'}),), if_exists=True) {{(pid=74613) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 18:04:15 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:04:15 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 18:04:15 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:04:15 user nova-compute[74613]: INFO os_vif [None req-5d8a83ba-92bc-4e1d-9331-d030cb74bfa2 tempest-TaggedBootDevicesTest-477858861 tempest-TaggedBootDevicesTest-477858861-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b3:40:e7,bridge_name='br-int',has_traffic_filtering=True,id=4e39483b-3a24-4948-8025-ab381a1a6eee,network=Network(e20648c0-8ed3-4009-b577-e6af59d212cd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4e39483b-3a')
Nov 29 18:04:15 user nova-compute[74613]: DEBUG nova.virt.libvirt.vif [None req-5d8a83ba-92bc-4e1d-9331-d030cb74bfa2 tempest-TaggedBootDevicesTest-477858861 tempest-TaggedBootDevicesTest-477858861-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-29T18:03:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-673218276',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-673218276',id=26,image_ref='4217f428-8d9d-4ee1-9614-642d26d90c46',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGL96hGsOikLqEHhsj9njCpyfE8e3V+KiaQzlnoRrJRaG1J/31X2lFl/ghui5RIyt0tbBjgF9ySvX5PG4tyErQ1KUFBDp+LZCscA6MDkYFpNo0AlMS+hxWRKFmIZybqZvg==',key_name='tempest-keypair-1703547228',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a9fa0da4ffc3447795c69b31e4e9a8d0',ramdisk_id='',reservation_id='r-9nbsmznw',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='4217f428-8d9d-4ee1-9614-642d26d90c46',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-477858861',owner_user_name='tempest-TaggedBootDevicesTest-477858861-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T18:03:45Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5e784791fe274eb7bf8e7b31fdff19f9',uuid=56de3dd1-6873-4c0a-9d80-58518dfd671e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "30db35d4-e78c-414e-bae8-593d9aaadda8", "address": "fa:16:3e:a3:1f:b8", "network": {"id": "e20648c0-8ed3-4009-b577-e6af59d212cd", "bridge": "br-int", "label": "tempest-device-tagging-net2-1059246863", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "a9fa0da4ffc3447795c69b31e4e9a8d0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap30db35d4-e7", "ovs_interfaceid": "30db35d4-e78c-414e-bae8-593d9aaadda8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74613) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 29 18:04:15 user nova-compute[74613]: DEBUG nova.network.os_vif_util [None req-5d8a83ba-92bc-4e1d-9331-d030cb74bfa2 tempest-TaggedBootDevicesTest-477858861 tempest-TaggedBootDevicesTest-477858861-project-member] Converting VIF {"id": "30db35d4-e78c-414e-bae8-593d9aaadda8", "address": "fa:16:3e:a3:1f:b8", "network": {"id": "e20648c0-8ed3-4009-b577-e6af59d212cd", "bridge": "br-int", "label": "tempest-device-tagging-net2-1059246863", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "a9fa0da4ffc3447795c69b31e4e9a8d0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap30db35d4-e7", "ovs_interfaceid": "30db35d4-e78c-414e-bae8-593d9aaadda8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74613) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 18:04:15 user nova-compute[74613]: DEBUG nova.network.os_vif_util [None req-5d8a83ba-92bc-4e1d-9331-d030cb74bfa2 tempest-TaggedBootDevicesTest-477858861 tempest-TaggedBootDevicesTest-477858861-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a3:1f:b8,bridge_name='br-int',has_traffic_filtering=True,id=30db35d4-e78c-414e-bae8-593d9aaadda8,network=Network(e20648c0-8ed3-4009-b577-e6af59d212cd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap30db35d4-e7') {{(pid=74613) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 18:04:15 user nova-compute[74613]: DEBUG os_vif [None req-5d8a83ba-92bc-4e1d-9331-d030cb74bfa2 tempest-TaggedBootDevicesTest-477858861 tempest-TaggedBootDevicesTest-477858861-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a3:1f:b8,bridge_name='br-int',has_traffic_filtering=True,id=30db35d4-e78c-414e-bae8-593d9aaadda8,network=Network(e20648c0-8ed3-4009-b577-e6af59d212cd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap30db35d4-e7') {{(pid=74613) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 29 18:04:15 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:04:15 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74613) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 18:04:15 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74613) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 29 18:04:15 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:04:15 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'ba635e9b-84a9-558d-8200-16d3b7c4ee26', '_type': 'linux-noop'}}, row=False) {{(pid=74613) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 18:04:15 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:04:15 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 18:04:15 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:04:15 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:04:15 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap30db35d4-e7, may_exist=True, interface_attrs={}) {{(pid=74613) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 18:04:15 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap30db35d4-e7, col_values=(('qos', UUID('88b87ad9-0db4-4689-af24-315e6ea1e036')),), if_exists=True) {{(pid=74613) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 18:04:15 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap30db35d4-e7, col_values=(('external_ids', {'iface-id': '30db35d4-e78c-414e-bae8-593d9aaadda8', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:a3:1f:b8', 'vm-uuid': '56de3dd1-6873-4c0a-9d80-58518dfd671e'}),), if_exists=True) {{(pid=74613) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 18:04:15 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:04:15 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 18:04:15 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:04:15 user nova-compute[74613]: INFO os_vif [None req-5d8a83ba-92bc-4e1d-9331-d030cb74bfa2 tempest-TaggedBootDevicesTest-477858861 tempest-TaggedBootDevicesTest-477858861-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a3:1f:b8,bridge_name='br-int',has_traffic_filtering=True,id=30db35d4-e78c-414e-bae8-593d9aaadda8,network=Network(e20648c0-8ed3-4009-b577-e6af59d212cd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap30db35d4-e7')
Nov 29 18:04:15 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:04:15 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-5d8a83ba-92bc-4e1d-9331-d030cb74bfa2 tempest-TaggedBootDevicesTest-477858861 tempest-TaggedBootDevicesTest-477858861-project-member] No BDM found with device name hda, not building metadata. {{(pid=74613) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 18:04:15 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-5d8a83ba-92bc-4e1d-9331-d030cb74bfa2 tempest-TaggedBootDevicesTest-477858861 tempest-TaggedBootDevicesTest-477858861-project-member] No BDM found with device name vdc, not building metadata. {{(pid=74613) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 18:04:15 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-5d8a83ba-92bc-4e1d-9331-d030cb74bfa2 tempest-TaggedBootDevicesTest-477858861 tempest-TaggedBootDevicesTest-477858861-project-member] No VIF found with MAC fa:16:3e:23:fc:5e, not building metadata {{(pid=74613) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 29 18:04:15 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-5d8a83ba-92bc-4e1d-9331-d030cb74bfa2 tempest-TaggedBootDevicesTest-477858861 tempest-TaggedBootDevicesTest-477858861-project-member] No VIF found with MAC fa:16:3e:c3:19:36, not building metadata {{(pid=74613) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 29 18:04:15 user nova-compute[74613]: INFO nova.virt.libvirt.driver [None req-5d8a83ba-92bc-4e1d-9331-d030cb74bfa2 tempest-TaggedBootDevicesTest-477858861 tempest-TaggedBootDevicesTest-477858861-project-member] [instance: 56de3dd1-6873-4c0a-9d80-58518dfd671e] Using config drive
Nov 29 18:04:15 user nova-compute[74613]: INFO nova.virt.libvirt.driver [None req-5d8a83ba-92bc-4e1d-9331-d030cb74bfa2 tempest-TaggedBootDevicesTest-477858861 tempest-TaggedBootDevicesTest-477858861-project-member] [instance: 56de3dd1-6873-4c0a-9d80-58518dfd671e] Creating config drive at /opt/stack/data/nova/instances/56de3dd1-6873-4c0a-9d80-58518dfd671e/disk.config
Nov 29 18:04:15 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-5d8a83ba-92bc-4e1d-9331-d030cb74bfa2 tempest-TaggedBootDevicesTest-477858861 tempest-TaggedBootDevicesTest-477858861-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/56de3dd1-6873-4c0a-9d80-58518dfd671e/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpaslmly41 {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:04:15 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-5d8a83ba-92bc-4e1d-9331-d030cb74bfa2 tempest-TaggedBootDevicesTest-477858861 tempest-TaggedBootDevicesTest-477858861-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/56de3dd1-6873-4c0a-9d80-58518dfd671e/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpaslmly41" returned: 0 in 0.096s {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:04:17 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:04:17 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:04:17 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:04:17 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:04:17 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:04:17 user nova-compute[74613]: DEBUG nova.compute.manager [req-df13196a-7985-4652-99c4-0681d8acdda2 req-c7c77ae6-38e1-41ac-82b5-6feb1ca9f255 service nova] [instance: 56de3dd1-6873-4c0a-9d80-58518dfd671e] Received event network-vif-plugged-fd1eeb3e-46e9-441a-90e1-048c5ad64d0e {{(pid=74613) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 18:04:17 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-df13196a-7985-4652-99c4-0681d8acdda2 req-c7c77ae6-38e1-41ac-82b5-6feb1ca9f255 service nova] Acquiring lock "56de3dd1-6873-4c0a-9d80-58518dfd671e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 18:04:17 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-df13196a-7985-4652-99c4-0681d8acdda2 req-c7c77ae6-38e1-41ac-82b5-6feb1ca9f255 service nova] Lock "56de3dd1-6873-4c0a-9d80-58518dfd671e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 18:04:17 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-df13196a-7985-4652-99c4-0681d8acdda2 req-c7c77ae6-38e1-41ac-82b5-6feb1ca9f255 service nova] Lock "56de3dd1-6873-4c0a-9d80-58518dfd671e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 18:04:17 user nova-compute[74613]: DEBUG nova.compute.manager [req-df13196a-7985-4652-99c4-0681d8acdda2 req-c7c77ae6-38e1-41ac-82b5-6feb1ca9f255 service nova] [instance: 56de3dd1-6873-4c0a-9d80-58518dfd671e] No waiting events found dispatching network-vif-plugged-fd1eeb3e-46e9-441a-90e1-048c5ad64d0e {{(pid=74613) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 18:04:17 user nova-compute[74613]: WARNING nova.compute.manager [req-df13196a-7985-4652-99c4-0681d8acdda2 req-c7c77ae6-38e1-41ac-82b5-6feb1ca9f255 service nova] [instance: 56de3dd1-6873-4c0a-9d80-58518dfd671e] Received unexpected event network-vif-plugged-fd1eeb3e-46e9-441a-90e1-048c5ad64d0e for instance with vm_state building and task_state spawning.
Nov 29 18:04:17 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:04:18 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:04:18 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:04:18 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:04:18 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:04:18 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:04:18 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:04:18 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:04:18 user nova-compute[74613]: DEBUG nova.compute.manager [req-c44b2571-4fbe-40d9-b99d-9ae49dc7d867 req-67cecc0f-b81f-44e8-8389-3a205ffb5eaf service nova] [instance: 56de3dd1-6873-4c0a-9d80-58518dfd671e] Received event network-vif-plugged-70ada3a3-186a-425a-8c4c-7af3b2d647ef {{(pid=74613) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 18:04:18 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-c44b2571-4fbe-40d9-b99d-9ae49dc7d867 req-67cecc0f-b81f-44e8-8389-3a205ffb5eaf service nova] Acquiring lock "56de3dd1-6873-4c0a-9d80-58518dfd671e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 18:04:18 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-c44b2571-4fbe-40d9-b99d-9ae49dc7d867 req-67cecc0f-b81f-44e8-8389-3a205ffb5eaf service nova] Lock "56de3dd1-6873-4c0a-9d80-58518dfd671e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 18:04:18 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-c44b2571-4fbe-40d9-b99d-9ae49dc7d867 req-67cecc0f-b81f-44e8-8389-3a205ffb5eaf service nova] Lock "56de3dd1-6873-4c0a-9d80-58518dfd671e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 18:04:18 user nova-compute[74613]: DEBUG nova.compute.manager [req-c44b2571-4fbe-40d9-b99d-9ae49dc7d867 req-67cecc0f-b81f-44e8-8389-3a205ffb5eaf service nova] [instance: 56de3dd1-6873-4c0a-9d80-58518dfd671e] No waiting events found dispatching network-vif-plugged-70ada3a3-186a-425a-8c4c-7af3b2d647ef {{(pid=74613) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 18:04:18 user nova-compute[74613]: WARNING nova.compute.manager [req-c44b2571-4fbe-40d9-b99d-9ae49dc7d867 req-67cecc0f-b81f-44e8-8389-3a205ffb5eaf service nova] [instance: 56de3dd1-6873-4c0a-9d80-58518dfd671e] Received unexpected event network-vif-plugged-70ada3a3-186a-425a-8c4c-7af3b2d647ef for instance with vm_state building and task_state spawning.
Nov 29 18:04:18 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:04:18 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:04:18 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:04:18 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:04:18 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:04:18 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:04:18 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:04:18 user nova-compute[74613]: DEBUG nova.compute.manager [req-4e412c79-d6f9-444f-a1eb-53ca7e9a5292 req-ca722115-87c2-4c7c-ae6e-558d0e89ee34 service nova] [instance: 56de3dd1-6873-4c0a-9d80-58518dfd671e] Received event network-vif-plugged-bfeedb02-28d2-4e4c-8a6b-da87e4b8f9cb {{(pid=74613) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 18:04:18 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-4e412c79-d6f9-444f-a1eb-53ca7e9a5292 req-ca722115-87c2-4c7c-ae6e-558d0e89ee34 service nova] Acquiring lock "56de3dd1-6873-4c0a-9d80-58518dfd671e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 18:04:18 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-4e412c79-d6f9-444f-a1eb-53ca7e9a5292 req-ca722115-87c2-4c7c-ae6e-558d0e89ee34 service nova] Lock "56de3dd1-6873-4c0a-9d80-58518dfd671e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 18:04:18 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-4e412c79-d6f9-444f-a1eb-53ca7e9a5292 req-ca722115-87c2-4c7c-ae6e-558d0e89ee34 service nova] Lock "56de3dd1-6873-4c0a-9d80-58518dfd671e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 18:04:18 user nova-compute[74613]: DEBUG nova.compute.manager [req-4e412c79-d6f9-444f-a1eb-53ca7e9a5292 req-ca722115-87c2-4c7c-ae6e-558d0e89ee34 service nova] [instance: 56de3dd1-6873-4c0a-9d80-58518dfd671e] No waiting events found dispatching network-vif-plugged-bfeedb02-28d2-4e4c-8a6b-da87e4b8f9cb {{(pid=74613) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 18:04:18 user nova-compute[74613]: WARNING nova.compute.manager [req-4e412c79-d6f9-444f-a1eb-53ca7e9a5292 req-ca722115-87c2-4c7c-ae6e-558d0e89ee34 service nova] [instance: 56de3dd1-6873-4c0a-9d80-58518dfd671e] Received unexpected event network-vif-plugged-bfeedb02-28d2-4e4c-8a6b-da87e4b8f9cb for instance with vm_state building and task_state spawning.
Nov 29 18:04:18 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:04:19 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:04:19 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:04:19 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:04:19 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:04:19 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:04:19 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:04:19 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:04:19 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:04:19 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:04:19 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:04:19 user nova-compute[74613]: DEBUG oslo_service.periodic_task [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74613) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 18:04:19 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 18:04:19 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 18:04:19 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 18:04:19 user nova-compute[74613]: DEBUG nova.compute.resource_tracker [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Auditing locally available compute resources for user (node: user) {{(pid=74613) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 29 18:04:19 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:04:19 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:04:19 user nova-compute[74613]: DEBUG nova.compute.manager [req-a36cd644-305b-4130-a0c1-cba6a7e4e477 req-e63f2414-811d-453a-bbf2-e13f7540f04f service nova] [instance: 56de3dd1-6873-4c0a-9d80-58518dfd671e] Received event network-vif-plugged-fd1eeb3e-46e9-441a-90e1-048c5ad64d0e {{(pid=74613) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 18:04:19 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-a36cd644-305b-4130-a0c1-cba6a7e4e477 req-e63f2414-811d-453a-bbf2-e13f7540f04f service nova] Acquiring lock "56de3dd1-6873-4c0a-9d80-58518dfd671e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 18:04:19 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-a36cd644-305b-4130-a0c1-cba6a7e4e477 req-e63f2414-811d-453a-bbf2-e13f7540f04f service nova] Lock "56de3dd1-6873-4c0a-9d80-58518dfd671e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 18:04:19 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-a36cd644-305b-4130-a0c1-cba6a7e4e477 req-e63f2414-811d-453a-bbf2-e13f7540f04f service nova] Lock "56de3dd1-6873-4c0a-9d80-58518dfd671e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 18:04:19 user nova-compute[74613]: DEBUG nova.compute.manager [req-a36cd644-305b-4130-a0c1-cba6a7e4e477 req-e63f2414-811d-453a-bbf2-e13f7540f04f service nova] [instance: 56de3dd1-6873-4c0a-9d80-58518dfd671e] No waiting events found dispatching network-vif-plugged-fd1eeb3e-46e9-441a-90e1-048c5ad64d0e {{(pid=74613) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 18:04:19 user nova-compute[74613]: WARNING nova.compute.manager [req-a36cd644-305b-4130-a0c1-cba6a7e4e477 req-e63f2414-811d-453a-bbf2-e13f7540f04f service nova] [instance: 56de3dd1-6873-4c0a-9d80-58518dfd671e] Received unexpected event network-vif-plugged-fd1eeb3e-46e9-441a-90e1-048c5ad64d0e for instance with vm_state building and task_state spawning.
Nov 29 18:04:19 user nova-compute[74613]: DEBUG nova.compute.manager [req-a36cd644-305b-4130-a0c1-cba6a7e4e477 req-e63f2414-811d-453a-bbf2-e13f7540f04f service nova] [instance: 56de3dd1-6873-4c0a-9d80-58518dfd671e] Received event network-vif-plugged-7d1e40a2-4a06-4e8e-935c-3d66553dac82 {{(pid=74613) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 18:04:19 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-a36cd644-305b-4130-a0c1-cba6a7e4e477 req-e63f2414-811d-453a-bbf2-e13f7540f04f service nova] Acquiring lock "56de3dd1-6873-4c0a-9d80-58518dfd671e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 18:04:19 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-a36cd644-305b-4130-a0c1-cba6a7e4e477 req-e63f2414-811d-453a-bbf2-e13f7540f04f service nova] Lock "56de3dd1-6873-4c0a-9d80-58518dfd671e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 18:04:19 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-a36cd644-305b-4130-a0c1-cba6a7e4e477 req-e63f2414-811d-453a-bbf2-e13f7540f04f service nova] Lock "56de3dd1-6873-4c0a-9d80-58518dfd671e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 18:04:19 user nova-compute[74613]: DEBUG nova.compute.manager [req-a36cd644-305b-4130-a0c1-cba6a7e4e477 req-e63f2414-811d-453a-bbf2-e13f7540f04f service nova] [instance: 56de3dd1-6873-4c0a-9d80-58518dfd671e] No waiting events found dispatching network-vif-plugged-7d1e40a2-4a06-4e8e-935c-3d66553dac82 {{(pid=74613) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 18:04:19 user nova-compute[74613]: WARNING nova.compute.manager [req-a36cd644-305b-4130-a0c1-cba6a7e4e477 req-e63f2414-811d-453a-bbf2-e13f7540f04f service nova] [instance: 56de3dd1-6873-4c0a-9d80-58518dfd671e] Received unexpected event network-vif-plugged-7d1e40a2-4a06-4e8e-935c-3d66553dac82 for instance with vm_state building and task_state spawning.
Nov 29 18:04:19 user nova-compute[74613]: DEBUG nova.compute.manager [req-a36cd644-305b-4130-a0c1-cba6a7e4e477 req-e63f2414-811d-453a-bbf2-e13f7540f04f service nova] [instance: 56de3dd1-6873-4c0a-9d80-58518dfd671e] Received event network-vif-plugged-7d1e40a2-4a06-4e8e-935c-3d66553dac82 {{(pid=74613) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 18:04:19 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-a36cd644-305b-4130-a0c1-cba6a7e4e477 req-e63f2414-811d-453a-bbf2-e13f7540f04f service nova] Acquiring lock "56de3dd1-6873-4c0a-9d80-58518dfd671e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 18:04:19 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-a36cd644-305b-4130-a0c1-cba6a7e4e477 req-e63f2414-811d-453a-bbf2-e13f7540f04f service nova] Lock "56de3dd1-6873-4c0a-9d80-58518dfd671e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 18:04:19 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-a36cd644-305b-4130-a0c1-cba6a7e4e477 req-e63f2414-811d-453a-bbf2-e13f7540f04f service nova] Lock "56de3dd1-6873-4c0a-9d80-58518dfd671e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 18:04:19 user nova-compute[74613]: DEBUG nova.compute.manager [req-a36cd644-305b-4130-a0c1-cba6a7e4e477 req-e63f2414-811d-453a-bbf2-e13f7540f04f service nova] [instance: 56de3dd1-6873-4c0a-9d80-58518dfd671e] No waiting events found dispatching network-vif-plugged-7d1e40a2-4a06-4e8e-935c-3d66553dac82 {{(pid=74613) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 18:04:19 user nova-compute[74613]: WARNING nova.compute.manager [req-a36cd644-305b-4130-a0c1-cba6a7e4e477 req-e63f2414-811d-453a-bbf2-e13f7540f04f service nova] [instance: 56de3dd1-6873-4c0a-9d80-58518dfd671e] Received unexpected event network-vif-plugged-7d1e40a2-4a06-4e8e-935c-3d66553dac82 for instance with vm_state building and task_state spawning.
Nov 29 18:04:19 user nova-compute[74613]: DEBUG nova.compute.manager [req-a36cd644-305b-4130-a0c1-cba6a7e4e477 req-e63f2414-811d-453a-bbf2-e13f7540f04f service nova] [instance: 56de3dd1-6873-4c0a-9d80-58518dfd671e] Received event network-vif-plugged-a41dc4d4-b94a-4659-8709-566b029d2b20 {{(pid=74613) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 18:04:19 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-a36cd644-305b-4130-a0c1-cba6a7e4e477 req-e63f2414-811d-453a-bbf2-e13f7540f04f service nova] Acquiring lock "56de3dd1-6873-4c0a-9d80-58518dfd671e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 18:04:19 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-a36cd644-305b-4130-a0c1-cba6a7e4e477 req-e63f2414-811d-453a-bbf2-e13f7540f04f service nova] Lock "56de3dd1-6873-4c0a-9d80-58518dfd671e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 18:04:19 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-a36cd644-305b-4130-a0c1-cba6a7e4e477 req-e63f2414-811d-453a-bbf2-e13f7540f04f service nova] Lock "56de3dd1-6873-4c0a-9d80-58518dfd671e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 18:04:19 user nova-compute[74613]: DEBUG nova.compute.manager [req-a36cd644-305b-4130-a0c1-cba6a7e4e477 req-e63f2414-811d-453a-bbf2-e13f7540f04f service nova] [instance: 56de3dd1-6873-4c0a-9d80-58518dfd671e] No waiting events found dispatching network-vif-plugged-a41dc4d4-b94a-4659-8709-566b029d2b20 {{(pid=74613) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 18:04:19 user nova-compute[74613]: WARNING nova.compute.manager [req-a36cd644-305b-4130-a0c1-cba6a7e4e477 req-e63f2414-811d-453a-bbf2-e13f7540f04f service nova] [instance: 56de3dd1-6873-4c0a-9d80-58518dfd671e] Received unexpected event network-vif-plugged-a41dc4d4-b94a-4659-8709-566b029d2b20 for instance with vm_state building and task_state spawning.
Nov 29 18:04:20 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=74613) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 29 18:04:20 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c4bdb712-e1f9-4fc0-b527-87088d7eddf8/disk --force-share --output=json {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:04:20 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:04:20 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:04:20 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c4bdb712-e1f9-4fc0-b527-87088d7eddf8/disk --force-share --output=json" returned: 0 in 0.215s {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:04:20 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c4bdb712-e1f9-4fc0-b527-87088d7eddf8/disk --force-share --output=json {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:04:20 user nova-compute[74613]: DEBUG nova.compute.manager [req-23696324-13d8-4236-ba13-0617d3e9a01a req-8588f87d-2f24-4fb6-8b6f-6dba9a015fba service nova] [instance: 56de3dd1-6873-4c0a-9d80-58518dfd671e] Received event network-vif-plugged-70ada3a3-186a-425a-8c4c-7af3b2d647ef {{(pid=74613) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 18:04:20 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-23696324-13d8-4236-ba13-0617d3e9a01a req-8588f87d-2f24-4fb6-8b6f-6dba9a015fba service nova] Acquiring lock "56de3dd1-6873-4c0a-9d80-58518dfd671e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 18:04:20 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-23696324-13d8-4236-ba13-0617d3e9a01a req-8588f87d-2f24-4fb6-8b6f-6dba9a015fba service nova] Lock "56de3dd1-6873-4c0a-9d80-58518dfd671e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 18:04:20 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-23696324-13d8-4236-ba13-0617d3e9a01a req-8588f87d-2f24-4fb6-8b6f-6dba9a015fba service nova] Lock "56de3dd1-6873-4c0a-9d80-58518dfd671e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 18:04:20 user nova-compute[74613]: DEBUG nova.compute.manager [req-23696324-13d8-4236-ba13-0617d3e9a01a req-8588f87d-2f24-4fb6-8b6f-6dba9a015fba service nova] [instance: 56de3dd1-6873-4c0a-9d80-58518dfd671e] No waiting events found dispatching network-vif-plugged-70ada3a3-186a-425a-8c4c-7af3b2d647ef {{(pid=74613) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 18:04:20 user nova-compute[74613]: WARNING nova.compute.manager [req-23696324-13d8-4236-ba13-0617d3e9a01a req-8588f87d-2f24-4fb6-8b6f-6dba9a015fba service nova] [instance: 56de3dd1-6873-4c0a-9d80-58518dfd671e] Received unexpected event network-vif-plugged-70ada3a3-186a-425a-8c4c-7af3b2d647ef for instance with vm_state building and task_state spawning.
Nov 29 18:04:20 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:04:20 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c4bdb712-e1f9-4fc0-b527-87088d7eddf8/disk --force-share --output=json" returned: 0 in 0.215s {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:04:20 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=74613) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 29 18:04:20 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] skipping disk /dev/sdf (vdb) as it is a volume {{(pid=74613) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 29 18:04:20 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] skipping disk /dev/sdg (vdc) as it is a volume {{(pid=74613) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 29 18:04:20 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f9be53df-54e6-4f59-9cef-0ba7434f0c29/disk --force-share --output=json {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:04:20 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:04:20 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f9be53df-54e6-4f59-9cef-0ba7434f0c29/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:04:20 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f9be53df-54e6-4f59-9cef-0ba7434f0c29/disk --force-share --output=json {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:04:20 user nova-compute[74613]: DEBUG nova.compute.manager [req-e294446a-7d65-4523-b653-73ce3183ff3f req-454a155e-b7b7-4810-b832-9fd7da63c748 service nova] [instance: 56de3dd1-6873-4c0a-9d80-58518dfd671e] Received event network-vif-plugged-bfeedb02-28d2-4e4c-8a6b-da87e4b8f9cb {{(pid=74613) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 18:04:20 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-e294446a-7d65-4523-b653-73ce3183ff3f req-454a155e-b7b7-4810-b832-9fd7da63c748 service nova] Acquiring lock "56de3dd1-6873-4c0a-9d80-58518dfd671e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 18:04:20 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-e294446a-7d65-4523-b653-73ce3183ff3f req-454a155e-b7b7-4810-b832-9fd7da63c748 service nova] Lock "56de3dd1-6873-4c0a-9d80-58518dfd671e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 18:04:20 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-e294446a-7d65-4523-b653-73ce3183ff3f req-454a155e-b7b7-4810-b832-9fd7da63c748 service nova] Lock "56de3dd1-6873-4c0a-9d80-58518dfd671e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 18:04:20 user nova-compute[74613]: DEBUG nova.compute.manager [req-e294446a-7d65-4523-b653-73ce3183ff3f req-454a155e-b7b7-4810-b832-9fd7da63c748 service nova] [instance: 56de3dd1-6873-4c0a-9d80-58518dfd671e] No waiting events found dispatching network-vif-plugged-bfeedb02-28d2-4e4c-8a6b-da87e4b8f9cb {{(pid=74613) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 18:04:20 user nova-compute[74613]: WARNING nova.compute.manager [req-e294446a-7d65-4523-b653-73ce3183ff3f req-454a155e-b7b7-4810-b832-9fd7da63c748 service nova] [instance: 56de3dd1-6873-4c0a-9d80-58518dfd671e] Received unexpected event network-vif-plugged-bfeedb02-28d2-4e4c-8a6b-da87e4b8f9cb for instance with vm_state building and task_state spawning.
Nov 29 18:04:20 user nova-compute[74613]: DEBUG nova.compute.manager [req-e294446a-7d65-4523-b653-73ce3183ff3f req-454a155e-b7b7-4810-b832-9fd7da63c748 service nova] [instance: 56de3dd1-6873-4c0a-9d80-58518dfd671e] Received event network-vif-plugged-30db35d4-e78c-414e-bae8-593d9aaadda8 {{(pid=74613) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 18:04:20 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-e294446a-7d65-4523-b653-73ce3183ff3f req-454a155e-b7b7-4810-b832-9fd7da63c748 service nova] Acquiring lock "56de3dd1-6873-4c0a-9d80-58518dfd671e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 18:04:20 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-e294446a-7d65-4523-b653-73ce3183ff3f req-454a155e-b7b7-4810-b832-9fd7da63c748 service nova] Lock "56de3dd1-6873-4c0a-9d80-58518dfd671e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 18:04:20 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-e294446a-7d65-4523-b653-73ce3183ff3f req-454a155e-b7b7-4810-b832-9fd7da63c748 service nova] Lock "56de3dd1-6873-4c0a-9d80-58518dfd671e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 18:04:20 user nova-compute[74613]: DEBUG nova.compute.manager [req-e294446a-7d65-4523-b653-73ce3183ff3f req-454a155e-b7b7-4810-b832-9fd7da63c748 service nova] [instance: 56de3dd1-6873-4c0a-9d80-58518dfd671e] No waiting events found dispatching network-vif-plugged-30db35d4-e78c-414e-bae8-593d9aaadda8 {{(pid=74613) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 18:04:20 user nova-compute[74613]: WARNING nova.compute.manager [req-e294446a-7d65-4523-b653-73ce3183ff3f req-454a155e-b7b7-4810-b832-9fd7da63c748 service nova] [instance: 56de3dd1-6873-4c0a-9d80-58518dfd671e] Received unexpected event network-vif-plugged-30db35d4-e78c-414e-bae8-593d9aaadda8 for instance with vm_state building and task_state spawning.
Nov 29 18:04:20 user nova-compute[74613]: DEBUG nova.compute.manager [req-e294446a-7d65-4523-b653-73ce3183ff3f req-454a155e-b7b7-4810-b832-9fd7da63c748 service nova] [instance: 56de3dd1-6873-4c0a-9d80-58518dfd671e] Received event network-vif-plugged-30db35d4-e78c-414e-bae8-593d9aaadda8 {{(pid=74613) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 18:04:20 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-e294446a-7d65-4523-b653-73ce3183ff3f req-454a155e-b7b7-4810-b832-9fd7da63c748 service nova] Acquiring lock "56de3dd1-6873-4c0a-9d80-58518dfd671e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 18:04:20 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-e294446a-7d65-4523-b653-73ce3183ff3f req-454a155e-b7b7-4810-b832-9fd7da63c748 service nova] Lock "56de3dd1-6873-4c0a-9d80-58518dfd671e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 18:04:20 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-e294446a-7d65-4523-b653-73ce3183ff3f req-454a155e-b7b7-4810-b832-9fd7da63c748 service nova] Lock "56de3dd1-6873-4c0a-9d80-58518dfd671e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 18:04:20 user nova-compute[74613]: DEBUG nova.compute.manager [req-e294446a-7d65-4523-b653-73ce3183ff3f req-454a155e-b7b7-4810-b832-9fd7da63c748 service nova] [instance: 56de3dd1-6873-4c0a-9d80-58518dfd671e] No waiting events found dispatching network-vif-plugged-30db35d4-e78c-414e-bae8-593d9aaadda8 {{(pid=74613) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 18:04:20 user nova-compute[74613]: WARNING nova.compute.manager [req-e294446a-7d65-4523-b653-73ce3183ff3f req-454a155e-b7b7-4810-b832-9fd7da63c748 service nova] [instance: 56de3dd1-6873-4c0a-9d80-58518dfd671e] Received unexpected event network-vif-plugged-30db35d4-e78c-414e-bae8-593d9aaadda8 for instance with vm_state building and task_state spawning.
Nov 29 18:04:20 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:04:20 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:04:20 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f9be53df-54e6-4f59-9cef-0ba7434f0c29/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:04:20 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=74613) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 29 18:04:20 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3b828860-5cc5-40b0-b845-8e560211794e/disk --force-share --output=json {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:04:21 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3b828860-5cc5-40b0-b845-8e560211794e/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:04:21 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3b828860-5cc5-40b0-b845-8e560211794e/disk --force-share --output=json {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:04:21 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:04:21 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3b828860-5cc5-40b0-b845-8e560211794e/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:04:21 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/abc9e2b8-f467-4cd0-b40f-de511fde1ec1/disk --force-share --output=json {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:04:21 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/abc9e2b8-f467-4cd0-b40f-de511fde1ec1/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:04:21 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/abc9e2b8-f467-4cd0-b40f-de511fde1ec1/disk --force-share --output=json {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:04:21 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/abc9e2b8-f467-4cd0-b40f-de511fde1ec1/disk --force-share --output=json" returned: 0 in 0.242s {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:04:21 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74613) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 29 18:04:21 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8fc8496b-1435-4b5f-8977-6c0d7467ef65/disk --force-share --output=json {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:04:21 user nova-compute[74613]: DEBUG nova.compute.manager [req-f3942aaa-458f-4d83-9b69-38e4e683f1f9 req-41adb835-9961-4278-9db4-a77291ebeec0 service nova] [instance: 56de3dd1-6873-4c0a-9d80-58518dfd671e] Received event network-vif-plugged-a41dc4d4-b94a-4659-8709-566b029d2b20 {{(pid=74613) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 18:04:21 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-f3942aaa-458f-4d83-9b69-38e4e683f1f9 req-41adb835-9961-4278-9db4-a77291ebeec0 service nova] Acquiring lock "56de3dd1-6873-4c0a-9d80-58518dfd671e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 18:04:21 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-f3942aaa-458f-4d83-9b69-38e4e683f1f9 req-41adb835-9961-4278-9db4-a77291ebeec0 service nova] Lock "56de3dd1-6873-4c0a-9d80-58518dfd671e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 18:04:21 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-f3942aaa-458f-4d83-9b69-38e4e683f1f9 req-41adb835-9961-4278-9db4-a77291ebeec0 service nova] Lock "56de3dd1-6873-4c0a-9d80-58518dfd671e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 18:04:21 user nova-compute[74613]: DEBUG nova.compute.manager [req-f3942aaa-458f-4d83-9b69-38e4e683f1f9 req-41adb835-9961-4278-9db4-a77291ebeec0 service nova] [instance: 56de3dd1-6873-4c0a-9d80-58518dfd671e] No waiting events found dispatching network-vif-plugged-a41dc4d4-b94a-4659-8709-566b029d2b20 {{(pid=74613) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 18:04:21 user nova-compute[74613]: WARNING nova.compute.manager [req-f3942aaa-458f-4d83-9b69-38e4e683f1f9 req-41adb835-9961-4278-9db4-a77291ebeec0 service nova] [instance: 56de3dd1-6873-4c0a-9d80-58518dfd671e] Received unexpected event network-vif-plugged-a41dc4d4-b94a-4659-8709-566b029d2b20 for instance with vm_state building and task_state spawning.
Nov 29 18:04:21 user nova-compute[74613]: DEBUG nova.compute.manager [req-f3942aaa-458f-4d83-9b69-38e4e683f1f9 req-41adb835-9961-4278-9db4-a77291ebeec0 service nova] [instance: 56de3dd1-6873-4c0a-9d80-58518dfd671e] Received event network-vif-plugged-4e39483b-3a24-4948-8025-ab381a1a6eee {{(pid=74613) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 18:04:21 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-f3942aaa-458f-4d83-9b69-38e4e683f1f9 req-41adb835-9961-4278-9db4-a77291ebeec0 service nova] Acquiring lock "56de3dd1-6873-4c0a-9d80-58518dfd671e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 18:04:21 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-f3942aaa-458f-4d83-9b69-38e4e683f1f9 req-41adb835-9961-4278-9db4-a77291ebeec0 service nova] Lock "56de3dd1-6873-4c0a-9d80-58518dfd671e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 18:04:21 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-f3942aaa-458f-4d83-9b69-38e4e683f1f9 req-41adb835-9961-4278-9db4-a77291ebeec0 service nova] Lock "56de3dd1-6873-4c0a-9d80-58518dfd671e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 18:04:21 user nova-compute[74613]: DEBUG nova.compute.manager [req-f3942aaa-458f-4d83-9b69-38e4e683f1f9 req-41adb835-9961-4278-9db4-a77291ebeec0 service nova] [instance: 56de3dd1-6873-4c0a-9d80-58518dfd671e] No waiting events found dispatching network-vif-plugged-4e39483b-3a24-4948-8025-ab381a1a6eee {{(pid=74613) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 18:04:21 user nova-compute[74613]: WARNING nova.compute.manager [req-f3942aaa-458f-4d83-9b69-38e4e683f1f9 req-41adb835-9961-4278-9db4-a77291ebeec0 service nova] [instance: 56de3dd1-6873-4c0a-9d80-58518dfd671e] Received unexpected event network-vif-plugged-4e39483b-3a24-4948-8025-ab381a1a6eee for instance with vm_state building and task_state spawning.
Nov 29 18:04:21 user nova-compute[74613]: DEBUG nova.compute.manager [req-f3942aaa-458f-4d83-9b69-38e4e683f1f9 req-41adb835-9961-4278-9db4-a77291ebeec0 service nova] [instance: 56de3dd1-6873-4c0a-9d80-58518dfd671e] Received event network-vif-plugged-4e39483b-3a24-4948-8025-ab381a1a6eee {{(pid=74613) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 18:04:21 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-f3942aaa-458f-4d83-9b69-38e4e683f1f9 req-41adb835-9961-4278-9db4-a77291ebeec0 service nova] Acquiring lock "56de3dd1-6873-4c0a-9d80-58518dfd671e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 18:04:21 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-f3942aaa-458f-4d83-9b69-38e4e683f1f9 req-41adb835-9961-4278-9db4-a77291ebeec0 service nova] Lock "56de3dd1-6873-4c0a-9d80-58518dfd671e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 18:04:21 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-f3942aaa-458f-4d83-9b69-38e4e683f1f9 req-41adb835-9961-4278-9db4-a77291ebeec0 service nova] Lock "56de3dd1-6873-4c0a-9d80-58518dfd671e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 18:04:21 user nova-compute[74613]: DEBUG nova.compute.manager [req-f3942aaa-458f-4d83-9b69-38e4e683f1f9 req-41adb835-9961-4278-9db4-a77291ebeec0 service nova] [instance: 56de3dd1-6873-4c0a-9d80-58518dfd671e] No waiting events found dispatching network-vif-plugged-4e39483b-3a24-4948-8025-ab381a1a6eee {{(pid=74613) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 18:04:21 user nova-compute[74613]: WARNING nova.compute.manager [req-f3942aaa-458f-4d83-9b69-38e4e683f1f9 req-41adb835-9961-4278-9db4-a77291ebeec0 service nova] [instance: 56de3dd1-6873-4c0a-9d80-58518dfd671e] Received unexpected event network-vif-plugged-4e39483b-3a24-4948-8025-ab381a1a6eee for instance with vm_state building and task_state spawning.
Nov 29 18:04:21 user nova-compute[74613]: DEBUG nova.compute.manager [None req-5d8a83ba-92bc-4e1d-9331-d030cb74bfa2 tempest-TaggedBootDevicesTest-477858861 tempest-TaggedBootDevicesTest-477858861-project-member] [instance: 56de3dd1-6873-4c0a-9d80-58518dfd671e] Instance event wait completed in 0 seconds for  {{(pid=74613) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 29 18:04:21 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-5d8a83ba-92bc-4e1d-9331-d030cb74bfa2 tempest-TaggedBootDevicesTest-477858861 tempest-TaggedBootDevicesTest-477858861-project-member] [instance: 56de3dd1-6873-4c0a-9d80-58518dfd671e] Guest created on hypervisor {{(pid=74613) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 29 18:04:21 user nova-compute[74613]: INFO nova.virt.libvirt.driver [-] [instance: 56de3dd1-6873-4c0a-9d80-58518dfd671e] Instance spawned successfully.
Nov 29 18:04:21 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-5d8a83ba-92bc-4e1d-9331-d030cb74bfa2 tempest-TaggedBootDevicesTest-477858861 tempest-TaggedBootDevicesTest-477858861-project-member] [instance: 56de3dd1-6873-4c0a-9d80-58518dfd671e] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74613) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 29 18:04:22 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-5d8a83ba-92bc-4e1d-9331-d030cb74bfa2 tempest-TaggedBootDevicesTest-477858861 tempest-TaggedBootDevicesTest-477858861-project-member] [instance: 56de3dd1-6873-4c0a-9d80-58518dfd671e] Found default for hw_cdrom_bus of ide {{(pid=74613) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 18:04:22 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-5d8a83ba-92bc-4e1d-9331-d030cb74bfa2 tempest-TaggedBootDevicesTest-477858861 tempest-TaggedBootDevicesTest-477858861-project-member] [instance: 56de3dd1-6873-4c0a-9d80-58518dfd671e] Found default for hw_disk_bus of virtio {{(pid=74613) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 18:04:22 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-5d8a83ba-92bc-4e1d-9331-d030cb74bfa2 tempest-TaggedBootDevicesTest-477858861 tempest-TaggedBootDevicesTest-477858861-project-member] [instance: 56de3dd1-6873-4c0a-9d80-58518dfd671e] Found default for hw_input_bus of None {{(pid=74613) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 18:04:22 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-5d8a83ba-92bc-4e1d-9331-d030cb74bfa2 tempest-TaggedBootDevicesTest-477858861 tempest-TaggedBootDevicesTest-477858861-project-member] [instance: 56de3dd1-6873-4c0a-9d80-58518dfd671e] Found default for hw_pointer_model of None {{(pid=74613) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 18:04:22 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-5d8a83ba-92bc-4e1d-9331-d030cb74bfa2 tempest-TaggedBootDevicesTest-477858861 tempest-TaggedBootDevicesTest-477858861-project-member] [instance: 56de3dd1-6873-4c0a-9d80-58518dfd671e] Found default for hw_video_model of virtio {{(pid=74613) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 18:04:22 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-5d8a83ba-92bc-4e1d-9331-d030cb74bfa2 tempest-TaggedBootDevicesTest-477858861 tempest-TaggedBootDevicesTest-477858861-project-member] [instance: 56de3dd1-6873-4c0a-9d80-58518dfd671e] Found default for hw_vif_model of virtio {{(pid=74613) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 18:04:22 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8fc8496b-1435-4b5f-8977-6c0d7467ef65/disk --force-share --output=json" returned: 0 in 0.232s {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:04:22 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8fc8496b-1435-4b5f-8977-6c0d7467ef65/disk --force-share --output=json {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:04:22 user nova-compute[74613]: INFO nova.compute.manager [None req-5d8a83ba-92bc-4e1d-9331-d030cb74bfa2 tempest-TaggedBootDevicesTest-477858861 tempest-TaggedBootDevicesTest-477858861-project-member] [instance: 56de3dd1-6873-4c0a-9d80-58518dfd671e] Took 11.80 seconds to spawn the instance on the hypervisor.
Nov 29 18:04:22 user nova-compute[74613]: DEBUG nova.compute.manager [None req-5d8a83ba-92bc-4e1d-9331-d030cb74bfa2 tempest-TaggedBootDevicesTest-477858861 tempest-TaggedBootDevicesTest-477858861-project-member] [instance: 56de3dd1-6873-4c0a-9d80-58518dfd671e] Checking state {{(pid=74613) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 29 18:04:22 user nova-compute[74613]: INFO nova.compute.manager [None req-5d8a83ba-92bc-4e1d-9331-d030cb74bfa2 tempest-TaggedBootDevicesTest-477858861 tempest-TaggedBootDevicesTest-477858861-project-member] [instance: 56de3dd1-6873-4c0a-9d80-58518dfd671e] Took 37.69 seconds to build instance.
Nov 29 18:04:22 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-5d8a83ba-92bc-4e1d-9331-d030cb74bfa2 tempest-TaggedBootDevicesTest-477858861 tempest-TaggedBootDevicesTest-477858861-project-member] Lock "56de3dd1-6873-4c0a-9d80-58518dfd671e" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 37.794s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 18:04:22 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8fc8496b-1435-4b5f-8977-6c0d7467ef65/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:04:22 user nova-compute[74613]: WARNING nova.virt.libvirt.driver [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 18:04:22 user nova-compute[74613]: WARNING nova.virt.libvirt.driver [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 18:04:22 user nova-compute[74613]: DEBUG nova.compute.resource_tracker [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Hypervisor/Node resource view: name=user free_ram=8060MB free_disk=24.95028305053711GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74613) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 29 18:04:22 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 18:04:22 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.002s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 18:04:23 user nova-compute[74613]: DEBUG nova.compute.resource_tracker [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Instance 3b828860-5cc5-40b0-b845-8e560211794e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74613) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 18:04:23 user nova-compute[74613]: DEBUG nova.compute.resource_tracker [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Instance abc9e2b8-f467-4cd0-b40f-de511fde1ec1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74613) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 18:04:23 user nova-compute[74613]: DEBUG nova.compute.resource_tracker [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Instance cd22685a-028c-4e0c-834d-e7b20f6d06ab actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74613) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 18:04:23 user nova-compute[74613]: DEBUG nova.compute.resource_tracker [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Instance c4bdb712-e1f9-4fc0-b527-87088d7eddf8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74613) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 18:04:23 user nova-compute[74613]: DEBUG nova.compute.resource_tracker [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Instance 8fc8496b-1435-4b5f-8977-6c0d7467ef65 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74613) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 18:04:23 user nova-compute[74613]: DEBUG nova.compute.resource_tracker [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Instance f9be53df-54e6-4f59-9cef-0ba7434f0c29 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74613) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 18:04:23 user nova-compute[74613]: DEBUG nova.compute.resource_tracker [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Instance e9acfa30-4ec2-4540-ac34-4c66db3228e1 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74613) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 18:04:23 user nova-compute[74613]: DEBUG nova.compute.resource_tracker [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Instance 56de3dd1-6873-4c0a-9d80-58518dfd671e actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74613) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 18:04:23 user nova-compute[74613]: DEBUG nova.compute.resource_tracker [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Instance d3c285cd-9f39-423c-a324-30a48a9c66be actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74613) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 18:04:23 user nova-compute[74613]: DEBUG nova.compute.resource_tracker [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Total usable vcpus: 12, total allocated vcpus: 9 {{(pid=74613) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 29 18:04:23 user nova-compute[74613]: DEBUG nova.compute.resource_tracker [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Final resource view: name=user phys_ram=16011MB used_ram=5120MB phys_disk=40GB used_disk=5GB total_vcpus=12 used_vcpus=9 pci_stats=[] {{(pid=74613) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 29 18:04:23 user nova-compute[74613]: DEBUG nova.compute.provider_tree [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Inventory has not changed in ProviderTree for provider: 639d980e-3b12-44b1-b8f4-1812416fa4dd {{(pid=74613) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 18:04:23 user nova-compute[74613]: DEBUG nova.scheduler.client.report [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Inventory has not changed for provider 639d980e-3b12-44b1-b8f4-1812416fa4dd based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74613) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 18:04:23 user nova-compute[74613]: DEBUG nova.compute.resource_tracker [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Compute_service record updated for user:user {{(pid=74613) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 29 18:04:23 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.622s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 18:04:24 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:04:25 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:04:25 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:04:25 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-23557d9f-f23b-4650-a063-667e4e235412 tempest-ServerRescueNegativeTestJSON-1891426908 tempest-ServerRescueNegativeTestJSON-1891426908-project-member] Acquiring lock "6993e2e7-7e03-45b4-9d3d-3742589b6078" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 18:04:25 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-23557d9f-f23b-4650-a063-667e4e235412 tempest-ServerRescueNegativeTestJSON-1891426908 tempest-ServerRescueNegativeTestJSON-1891426908-project-member] Lock "6993e2e7-7e03-45b4-9d3d-3742589b6078" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 18:04:25 user nova-compute[74613]: DEBUG nova.compute.manager [None req-23557d9f-f23b-4650-a063-667e4e235412 tempest-ServerRescueNegativeTestJSON-1891426908 tempest-ServerRescueNegativeTestJSON-1891426908-project-member] [instance: 6993e2e7-7e03-45b4-9d3d-3742589b6078] Starting instance... {{(pid=74613) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 29 18:04:25 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-23557d9f-f23b-4650-a063-667e4e235412 tempest-ServerRescueNegativeTestJSON-1891426908 tempest-ServerRescueNegativeTestJSON-1891426908-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 18:04:25 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-23557d9f-f23b-4650-a063-667e4e235412 tempest-ServerRescueNegativeTestJSON-1891426908 tempest-ServerRescueNegativeTestJSON-1891426908-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 18:04:25 user nova-compute[74613]: DEBUG nova.virt.hardware [None req-23557d9f-f23b-4650-a063-667e4e235412 tempest-ServerRescueNegativeTestJSON-1891426908 tempest-ServerRescueNegativeTestJSON-1891426908-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74613) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 29 18:04:25 user nova-compute[74613]: INFO nova.compute.claims [None req-23557d9f-f23b-4650-a063-667e4e235412 tempest-ServerRescueNegativeTestJSON-1891426908 tempest-ServerRescueNegativeTestJSON-1891426908-project-member] [instance: 6993e2e7-7e03-45b4-9d3d-3742589b6078] Claim successful on node user
Nov 29 18:04:26 user nova-compute[74613]: DEBUG nova.compute.provider_tree [None req-23557d9f-f23b-4650-a063-667e4e235412 tempest-ServerRescueNegativeTestJSON-1891426908 tempest-ServerRescueNegativeTestJSON-1891426908-project-member] Inventory has not changed in ProviderTree for provider: 639d980e-3b12-44b1-b8f4-1812416fa4dd {{(pid=74613) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 18:04:26 user nova-compute[74613]: DEBUG nova.scheduler.client.report [None req-23557d9f-f23b-4650-a063-667e4e235412 tempest-ServerRescueNegativeTestJSON-1891426908 tempest-ServerRescueNegativeTestJSON-1891426908-project-member] Inventory has not changed for provider 639d980e-3b12-44b1-b8f4-1812416fa4dd based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74613) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 18:04:26 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-23557d9f-f23b-4650-a063-667e4e235412 tempest-ServerRescueNegativeTestJSON-1891426908 tempest-ServerRescueNegativeTestJSON-1891426908-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.477s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 18:04:26 user nova-compute[74613]: DEBUG nova.compute.manager [None req-23557d9f-f23b-4650-a063-667e4e235412 tempest-ServerRescueNegativeTestJSON-1891426908 tempest-ServerRescueNegativeTestJSON-1891426908-project-member] [instance: 6993e2e7-7e03-45b4-9d3d-3742589b6078] Start building networks asynchronously for instance. {{(pid=74613) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 29 18:04:26 user nova-compute[74613]: DEBUG nova.compute.manager [None req-23557d9f-f23b-4650-a063-667e4e235412 tempest-ServerRescueNegativeTestJSON-1891426908 tempest-ServerRescueNegativeTestJSON-1891426908-project-member] [instance: 6993e2e7-7e03-45b4-9d3d-3742589b6078] Allocating IP information in the background. {{(pid=74613) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 29 18:04:26 user nova-compute[74613]: DEBUG nova.network.neutron [None req-23557d9f-f23b-4650-a063-667e4e235412 tempest-ServerRescueNegativeTestJSON-1891426908 tempest-ServerRescueNegativeTestJSON-1891426908-project-member] [instance: 6993e2e7-7e03-45b4-9d3d-3742589b6078] allocate_for_instance() {{(pid=74613) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 29 18:04:26 user nova-compute[74613]: INFO nova.virt.libvirt.driver [None req-23557d9f-f23b-4650-a063-667e4e235412 tempest-ServerRescueNegativeTestJSON-1891426908 tempest-ServerRescueNegativeTestJSON-1891426908-project-member] [instance: 6993e2e7-7e03-45b4-9d3d-3742589b6078] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 29 18:04:26 user nova-compute[74613]: DEBUG nova.compute.manager [None req-23557d9f-f23b-4650-a063-667e4e235412 tempest-ServerRescueNegativeTestJSON-1891426908 tempest-ServerRescueNegativeTestJSON-1891426908-project-member] [instance: 6993e2e7-7e03-45b4-9d3d-3742589b6078] Start building block device mappings for instance. {{(pid=74613) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 29 18:04:26 user nova-compute[74613]: DEBUG nova.policy [None req-23557d9f-f23b-4650-a063-667e4e235412 tempest-ServerRescueNegativeTestJSON-1891426908 tempest-ServerRescueNegativeTestJSON-1891426908-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '4e984d45838e441680b9948c213728fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6a3eb6ea0294f9da705dca72ec2789a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74613) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 29 18:04:26 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-27abc84e-78fb-4613-bf69-a6062abd2ab3 tempest-ServerRescueNegativeTestJSON-1891426908 tempest-ServerRescueNegativeTestJSON-1891426908-project-member] Acquiring lock "6f4a1329-b3b9-4d1c-8735-abddabc359fd" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 18:04:26 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-27abc84e-78fb-4613-bf69-a6062abd2ab3 tempest-ServerRescueNegativeTestJSON-1891426908 tempest-ServerRescueNegativeTestJSON-1891426908-project-member] Lock "6f4a1329-b3b9-4d1c-8735-abddabc359fd" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 18:04:26 user nova-compute[74613]: DEBUG nova.compute.manager [None req-27abc84e-78fb-4613-bf69-a6062abd2ab3 tempest-ServerRescueNegativeTestJSON-1891426908 tempest-ServerRescueNegativeTestJSON-1891426908-project-member] [instance: 6f4a1329-b3b9-4d1c-8735-abddabc359fd] Starting instance... {{(pid=74613) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 29 18:04:26 user nova-compute[74613]: DEBUG nova.compute.manager [None req-23557d9f-f23b-4650-a063-667e4e235412 tempest-ServerRescueNegativeTestJSON-1891426908 tempest-ServerRescueNegativeTestJSON-1891426908-project-member] [instance: 6993e2e7-7e03-45b4-9d3d-3742589b6078] Start spawning the instance on the hypervisor. {{(pid=74613) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 29 18:04:26 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-23557d9f-f23b-4650-a063-667e4e235412 tempest-ServerRescueNegativeTestJSON-1891426908 tempest-ServerRescueNegativeTestJSON-1891426908-project-member] [instance: 6993e2e7-7e03-45b4-9d3d-3742589b6078] Creating instance directory {{(pid=74613) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 29 18:04:26 user nova-compute[74613]: INFO nova.virt.libvirt.driver [None req-23557d9f-f23b-4650-a063-667e4e235412 tempest-ServerRescueNegativeTestJSON-1891426908 tempest-ServerRescueNegativeTestJSON-1891426908-project-member] [instance: 6993e2e7-7e03-45b4-9d3d-3742589b6078] Creating image(s)
Nov 29 18:04:26 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-23557d9f-f23b-4650-a063-667e4e235412 tempest-ServerRescueNegativeTestJSON-1891426908 tempest-ServerRescueNegativeTestJSON-1891426908-project-member] Acquiring lock "/opt/stack/data/nova/instances/6993e2e7-7e03-45b4-9d3d-3742589b6078/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 18:04:26 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-23557d9f-f23b-4650-a063-667e4e235412 tempest-ServerRescueNegativeTestJSON-1891426908 tempest-ServerRescueNegativeTestJSON-1891426908-project-member] Lock "/opt/stack/data/nova/instances/6993e2e7-7e03-45b4-9d3d-3742589b6078/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 18:04:26 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-23557d9f-f23b-4650-a063-667e4e235412 tempest-ServerRescueNegativeTestJSON-1891426908 tempest-ServerRescueNegativeTestJSON-1891426908-project-member] Lock "/opt/stack/data/nova/instances/6993e2e7-7e03-45b4-9d3d-3742589b6078/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 18:04:26 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-23557d9f-f23b-4650-a063-667e4e235412 tempest-ServerRescueNegativeTestJSON-1891426908 tempest-ServerRescueNegativeTestJSON-1891426908-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/21faea9e6951f3bdd0153b76ac89fe1a60a34758 --force-share --output=json {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:04:26 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-27abc84e-78fb-4613-bf69-a6062abd2ab3 tempest-ServerRescueNegativeTestJSON-1891426908 tempest-ServerRescueNegativeTestJSON-1891426908-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 18:04:26 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-27abc84e-78fb-4613-bf69-a6062abd2ab3 tempest-ServerRescueNegativeTestJSON-1891426908 tempest-ServerRescueNegativeTestJSON-1891426908-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.002s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 18:04:26 user nova-compute[74613]: DEBUG nova.virt.hardware [None req-27abc84e-78fb-4613-bf69-a6062abd2ab3 tempest-ServerRescueNegativeTestJSON-1891426908 tempest-ServerRescueNegativeTestJSON-1891426908-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74613) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 29 18:04:26 user nova-compute[74613]: INFO nova.compute.claims [None req-27abc84e-78fb-4613-bf69-a6062abd2ab3 tempest-ServerRescueNegativeTestJSON-1891426908 tempest-ServerRescueNegativeTestJSON-1891426908-project-member] [instance: 6f4a1329-b3b9-4d1c-8735-abddabc359fd] Claim successful on node user
Nov 29 18:04:26 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-23557d9f-f23b-4650-a063-667e4e235412 tempest-ServerRescueNegativeTestJSON-1891426908 tempest-ServerRescueNegativeTestJSON-1891426908-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/21faea9e6951f3bdd0153b76ac89fe1a60a34758 --force-share --output=json" returned: 0 in 0.199s {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:04:26 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-23557d9f-f23b-4650-a063-667e4e235412 tempest-ServerRescueNegativeTestJSON-1891426908 tempest-ServerRescueNegativeTestJSON-1891426908-project-member] Acquiring lock "21faea9e6951f3bdd0153b76ac89fe1a60a34758" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 18:04:26 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-23557d9f-f23b-4650-a063-667e4e235412 tempest-ServerRescueNegativeTestJSON-1891426908 tempest-ServerRescueNegativeTestJSON-1891426908-project-member] Lock "21faea9e6951f3bdd0153b76ac89fe1a60a34758" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 18:04:26 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-23557d9f-f23b-4650-a063-667e4e235412 tempest-ServerRescueNegativeTestJSON-1891426908 tempest-ServerRescueNegativeTestJSON-1891426908-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/21faea9e6951f3bdd0153b76ac89fe1a60a34758 --force-share --output=json {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:04:27 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-23557d9f-f23b-4650-a063-667e4e235412 tempest-ServerRescueNegativeTestJSON-1891426908 tempest-ServerRescueNegativeTestJSON-1891426908-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/21faea9e6951f3bdd0153b76ac89fe1a60a34758 --force-share --output=json" returned: 0 in 0.175s {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:04:27 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-23557d9f-f23b-4650-a063-667e4e235412 tempest-ServerRescueNegativeTestJSON-1891426908 tempest-ServerRescueNegativeTestJSON-1891426908-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/21faea9e6951f3bdd0153b76ac89fe1a60a34758,backing_fmt=raw /opt/stack/data/nova/instances/6993e2e7-7e03-45b4-9d3d-3742589b6078/disk 1073741824 {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:04:27 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-23557d9f-f23b-4650-a063-667e4e235412 tempest-ServerRescueNegativeTestJSON-1891426908 tempest-ServerRescueNegativeTestJSON-1891426908-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/21faea9e6951f3bdd0153b76ac89fe1a60a34758,backing_fmt=raw /opt/stack/data/nova/instances/6993e2e7-7e03-45b4-9d3d-3742589b6078/disk 1073741824" returned: 0 in 0.061s {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:04:27 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-23557d9f-f23b-4650-a063-667e4e235412 tempest-ServerRescueNegativeTestJSON-1891426908 tempest-ServerRescueNegativeTestJSON-1891426908-project-member] Lock "21faea9e6951f3bdd0153b76ac89fe1a60a34758" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.242s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 18:04:27 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-23557d9f-f23b-4650-a063-667e4e235412 tempest-ServerRescueNegativeTestJSON-1891426908 tempest-ServerRescueNegativeTestJSON-1891426908-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/21faea9e6951f3bdd0153b76ac89fe1a60a34758 --force-share --output=json {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:04:27 user nova-compute[74613]: DEBUG nova.network.neutron [None req-23557d9f-f23b-4650-a063-667e4e235412 tempest-ServerRescueNegativeTestJSON-1891426908 tempest-ServerRescueNegativeTestJSON-1891426908-project-member] [instance: 6993e2e7-7e03-45b4-9d3d-3742589b6078] Successfully created port: 5216b7ab-6e2b-4d7f-8c7f-e52b03d282b9 {{(pid=74613) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 29 18:04:27 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-23557d9f-f23b-4650-a063-667e4e235412 tempest-ServerRescueNegativeTestJSON-1891426908 tempest-ServerRescueNegativeTestJSON-1891426908-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/21faea9e6951f3bdd0153b76ac89fe1a60a34758 --force-share --output=json" returned: 0 in 0.209s {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:04:27 user nova-compute[74613]: DEBUG nova.virt.disk.api [None req-23557d9f-f23b-4650-a063-667e4e235412 tempest-ServerRescueNegativeTestJSON-1891426908 tempest-ServerRescueNegativeTestJSON-1891426908-project-member] Checking if we can resize image /opt/stack/data/nova/instances/6993e2e7-7e03-45b4-9d3d-3742589b6078/disk. size=1073741824 {{(pid=74613) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 29 18:04:27 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-23557d9f-f23b-4650-a063-667e4e235412 tempest-ServerRescueNegativeTestJSON-1891426908 tempest-ServerRescueNegativeTestJSON-1891426908-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6993e2e7-7e03-45b4-9d3d-3742589b6078/disk --force-share --output=json {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:04:27 user nova-compute[74613]: DEBUG oslo_service.periodic_task [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74613) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 18:04:27 user nova-compute[74613]: DEBUG oslo_service.periodic_task [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74613) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 18:04:27 user nova-compute[74613]: DEBUG nova.compute.manager [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Starting heal instance info cache {{(pid=74613) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 29 18:04:27 user nova-compute[74613]: DEBUG nova.compute.manager [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Rebuilding the list of instances to heal {{(pid=74613) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 29 18:04:27 user nova-compute[74613]: DEBUG nova.compute.manager [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] [instance: 6993e2e7-7e03-45b4-9d3d-3742589b6078] Skipping network cache update for instance because it is Building. {{(pid=74613) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9935}}
Nov 29 18:04:27 user nova-compute[74613]: DEBUG nova.compute.manager [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] [instance: 6f4a1329-b3b9-4d1c-8735-abddabc359fd] Skipping network cache update for instance because it is Building. {{(pid=74613) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9935}}
Nov 29 18:04:27 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-23557d9f-f23b-4650-a063-667e4e235412 tempest-ServerRescueNegativeTestJSON-1891426908 tempest-ServerRescueNegativeTestJSON-1891426908-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6993e2e7-7e03-45b4-9d3d-3742589b6078/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:04:27 user nova-compute[74613]: DEBUG nova.virt.disk.api [None req-23557d9f-f23b-4650-a063-667e4e235412 tempest-ServerRescueNegativeTestJSON-1891426908 tempest-ServerRescueNegativeTestJSON-1891426908-project-member] Cannot resize image /opt/stack/data/nova/instances/6993e2e7-7e03-45b4-9d3d-3742589b6078/disk to a smaller size. {{(pid=74613) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 29 18:04:27 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-23557d9f-f23b-4650-a063-667e4e235412 tempest-ServerRescueNegativeTestJSON-1891426908 tempest-ServerRescueNegativeTestJSON-1891426908-project-member] [instance: 6993e2e7-7e03-45b4-9d3d-3742589b6078] Created local disks {{(pid=74613) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 29 18:04:27 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-23557d9f-f23b-4650-a063-667e4e235412 tempest-ServerRescueNegativeTestJSON-1891426908 tempest-ServerRescueNegativeTestJSON-1891426908-project-member] [instance: 6993e2e7-7e03-45b4-9d3d-3742589b6078] Ensure instance console log exists: /opt/stack/data/nova/instances/6993e2e7-7e03-45b4-9d3d-3742589b6078/console.log {{(pid=74613) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 29 18:04:27 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-23557d9f-f23b-4650-a063-667e4e235412 tempest-ServerRescueNegativeTestJSON-1891426908 tempest-ServerRescueNegativeTestJSON-1891426908-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 18:04:27 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-23557d9f-f23b-4650-a063-667e4e235412 tempest-ServerRescueNegativeTestJSON-1891426908 tempest-ServerRescueNegativeTestJSON-1891426908-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 18:04:27 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-23557d9f-f23b-4650-a063-667e4e235412 tempest-ServerRescueNegativeTestJSON-1891426908 tempest-ServerRescueNegativeTestJSON-1891426908-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 18:04:27 user nova-compute[74613]: DEBUG nova.compute.provider_tree [None req-27abc84e-78fb-4613-bf69-a6062abd2ab3 tempest-ServerRescueNegativeTestJSON-1891426908 tempest-ServerRescueNegativeTestJSON-1891426908-project-member] Inventory has not changed in ProviderTree for provider: 639d980e-3b12-44b1-b8f4-1812416fa4dd {{(pid=74613) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 18:04:27 user nova-compute[74613]: DEBUG nova.scheduler.client.report [None req-27abc84e-78fb-4613-bf69-a6062abd2ab3 tempest-ServerRescueNegativeTestJSON-1891426908 tempest-ServerRescueNegativeTestJSON-1891426908-project-member] Inventory has not changed for provider 639d980e-3b12-44b1-b8f4-1812416fa4dd based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74613) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 18:04:27 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Acquiring lock "refresh_cache-3b828860-5cc5-40b0-b845-8e560211794e" {{(pid=74613) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 18:04:27 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Acquired lock "refresh_cache-3b828860-5cc5-40b0-b845-8e560211794e" {{(pid=74613) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 18:04:27 user nova-compute[74613]: DEBUG nova.network.neutron [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] [instance: 3b828860-5cc5-40b0-b845-8e560211794e] Forcefully refreshing network info cache for instance {{(pid=74613) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 29 18:04:27 user nova-compute[74613]: DEBUG nova.objects.instance [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Lazy-loading 'info_cache' on Instance uuid 3b828860-5cc5-40b0-b845-8e560211794e {{(pid=74613) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 18:04:27 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-27abc84e-78fb-4613-bf69-a6062abd2ab3 tempest-ServerRescueNegativeTestJSON-1891426908 tempest-ServerRescueNegativeTestJSON-1891426908-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.865s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 18:04:27 user nova-compute[74613]: DEBUG nova.compute.manager [None req-27abc84e-78fb-4613-bf69-a6062abd2ab3 tempest-ServerRescueNegativeTestJSON-1891426908 tempest-ServerRescueNegativeTestJSON-1891426908-project-member] [instance: 6f4a1329-b3b9-4d1c-8735-abddabc359fd] Start building networks asynchronously for instance. {{(pid=74613) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 29 18:04:27 user nova-compute[74613]: DEBUG nova.compute.manager [None req-27abc84e-78fb-4613-bf69-a6062abd2ab3 tempest-ServerRescueNegativeTestJSON-1891426908 tempest-ServerRescueNegativeTestJSON-1891426908-project-member] [instance: 6f4a1329-b3b9-4d1c-8735-abddabc359fd] Allocating IP information in the background. {{(pid=74613) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 29 18:04:27 user nova-compute[74613]: DEBUG nova.network.neutron [None req-27abc84e-78fb-4613-bf69-a6062abd2ab3 tempest-ServerRescueNegativeTestJSON-1891426908 tempest-ServerRescueNegativeTestJSON-1891426908-project-member] [instance: 6f4a1329-b3b9-4d1c-8735-abddabc359fd] allocate_for_instance() {{(pid=74613) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 29 18:04:27 user nova-compute[74613]: INFO nova.virt.libvirt.driver [None req-27abc84e-78fb-4613-bf69-a6062abd2ab3 tempest-ServerRescueNegativeTestJSON-1891426908 tempest-ServerRescueNegativeTestJSON-1891426908-project-member] [instance: 6f4a1329-b3b9-4d1c-8735-abddabc359fd] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 29 18:04:27 user nova-compute[74613]: DEBUG nova.compute.manager [None req-27abc84e-78fb-4613-bf69-a6062abd2ab3 tempest-ServerRescueNegativeTestJSON-1891426908 tempest-ServerRescueNegativeTestJSON-1891426908-project-member] [instance: 6f4a1329-b3b9-4d1c-8735-abddabc359fd] Start building block device mappings for instance. {{(pid=74613) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 29 18:04:27 user nova-compute[74613]: DEBUG nova.policy [None req-27abc84e-78fb-4613-bf69-a6062abd2ab3 tempest-ServerRescueNegativeTestJSON-1891426908 tempest-ServerRescueNegativeTestJSON-1891426908-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '4e984d45838e441680b9948c213728fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6a3eb6ea0294f9da705dca72ec2789a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74613) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 29 18:04:27 user nova-compute[74613]: DEBUG nova.compute.manager [None req-27abc84e-78fb-4613-bf69-a6062abd2ab3 tempest-ServerRescueNegativeTestJSON-1891426908 tempest-ServerRescueNegativeTestJSON-1891426908-project-member] [instance: 6f4a1329-b3b9-4d1c-8735-abddabc359fd] Start spawning the instance on the hypervisor. {{(pid=74613) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 29 18:04:27 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-27abc84e-78fb-4613-bf69-a6062abd2ab3 tempest-ServerRescueNegativeTestJSON-1891426908 tempest-ServerRescueNegativeTestJSON-1891426908-project-member] [instance: 6f4a1329-b3b9-4d1c-8735-abddabc359fd] Creating instance directory {{(pid=74613) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 29 18:04:27 user nova-compute[74613]: INFO nova.virt.libvirt.driver [None req-27abc84e-78fb-4613-bf69-a6062abd2ab3 tempest-ServerRescueNegativeTestJSON-1891426908 tempest-ServerRescueNegativeTestJSON-1891426908-project-member] [instance: 6f4a1329-b3b9-4d1c-8735-abddabc359fd] Creating image(s)
Nov 29 18:04:27 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-27abc84e-78fb-4613-bf69-a6062abd2ab3 tempest-ServerRescueNegativeTestJSON-1891426908 tempest-ServerRescueNegativeTestJSON-1891426908-project-member] Acquiring lock "/opt/stack/data/nova/instances/6f4a1329-b3b9-4d1c-8735-abddabc359fd/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 18:04:27 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-27abc84e-78fb-4613-bf69-a6062abd2ab3 tempest-ServerRescueNegativeTestJSON-1891426908 tempest-ServerRescueNegativeTestJSON-1891426908-project-member] Lock "/opt/stack/data/nova/instances/6f4a1329-b3b9-4d1c-8735-abddabc359fd/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.004s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 18:04:27 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-27abc84e-78fb-4613-bf69-a6062abd2ab3 tempest-ServerRescueNegativeTestJSON-1891426908 tempest-ServerRescueNegativeTestJSON-1891426908-project-member] Lock "/opt/stack/data/nova/instances/6f4a1329-b3b9-4d1c-8735-abddabc359fd/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 18:04:27 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-27abc84e-78fb-4613-bf69-a6062abd2ab3 tempest-ServerRescueNegativeTestJSON-1891426908 tempest-ServerRescueNegativeTestJSON-1891426908-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/21faea9e6951f3bdd0153b76ac89fe1a60a34758 --force-share --output=json {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:04:28 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-aa622d18-654d-4700-885d-f7e5dda34b2b tempest-AttachVolumeShelveTestJSON-1452861425 tempest-AttachVolumeShelveTestJSON-1452861425-project-member] Acquiring lock "f9be53df-54e6-4f59-9cef-0ba7434f0c29" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 18:04:28 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-aa622d18-654d-4700-885d-f7e5dda34b2b tempest-AttachVolumeShelveTestJSON-1452861425 tempest-AttachVolumeShelveTestJSON-1452861425-project-member] Lock "f9be53df-54e6-4f59-9cef-0ba7434f0c29" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 18:04:28 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-aa622d18-654d-4700-885d-f7e5dda34b2b tempest-AttachVolumeShelveTestJSON-1452861425 tempest-AttachVolumeShelveTestJSON-1452861425-project-member] Acquiring lock "f9be53df-54e6-4f59-9cef-0ba7434f0c29-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 18:04:28 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-aa622d18-654d-4700-885d-f7e5dda34b2b tempest-AttachVolumeShelveTestJSON-1452861425 tempest-AttachVolumeShelveTestJSON-1452861425-project-member] Lock "f9be53df-54e6-4f59-9cef-0ba7434f0c29-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 18:04:28 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-aa622d18-654d-4700-885d-f7e5dda34b2b tempest-AttachVolumeShelveTestJSON-1452861425 tempest-AttachVolumeShelveTestJSON-1452861425-project-member] Lock "f9be53df-54e6-4f59-9cef-0ba7434f0c29-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 18:04:28 user nova-compute[74613]: INFO nova.compute.manager [None req-aa622d18-654d-4700-885d-f7e5dda34b2b tempest-AttachVolumeShelveTestJSON-1452861425 tempest-AttachVolumeShelveTestJSON-1452861425-project-member] [instance: f9be53df-54e6-4f59-9cef-0ba7434f0c29] Terminating instance
Nov 29 18:04:28 user nova-compute[74613]: DEBUG nova.compute.manager [None req-aa622d18-654d-4700-885d-f7e5dda34b2b tempest-AttachVolumeShelveTestJSON-1452861425 tempest-AttachVolumeShelveTestJSON-1452861425-project-member] [instance: f9be53df-54e6-4f59-9cef-0ba7434f0c29] Start destroying the instance on the hypervisor. {{(pid=74613) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 29 18:04:28 user nova-compute[74613]: DEBUG nova.network.neutron [None req-23557d9f-f23b-4650-a063-667e4e235412 tempest-ServerRescueNegativeTestJSON-1891426908 tempest-ServerRescueNegativeTestJSON-1891426908-project-member] [instance: 6993e2e7-7e03-45b4-9d3d-3742589b6078] Successfully updated port: 5216b7ab-6e2b-4d7f-8c7f-e52b03d282b9 {{(pid=74613) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 29 18:04:28 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:04:28 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-23557d9f-f23b-4650-a063-667e4e235412 tempest-ServerRescueNegativeTestJSON-1891426908 tempest-ServerRescueNegativeTestJSON-1891426908-project-member] Acquiring lock "refresh_cache-6993e2e7-7e03-45b4-9d3d-3742589b6078" {{(pid=74613) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 18:04:28 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-23557d9f-f23b-4650-a063-667e4e235412 tempest-ServerRescueNegativeTestJSON-1891426908 tempest-ServerRescueNegativeTestJSON-1891426908-project-member] Acquired lock "refresh_cache-6993e2e7-7e03-45b4-9d3d-3742589b6078" {{(pid=74613) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 18:04:28 user nova-compute[74613]: DEBUG nova.network.neutron [None req-23557d9f-f23b-4650-a063-667e4e235412 tempest-ServerRescueNegativeTestJSON-1891426908 tempest-ServerRescueNegativeTestJSON-1891426908-project-member] [instance: 6993e2e7-7e03-45b4-9d3d-3742589b6078] Building network info cache for instance {{(pid=74613) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 29 18:04:28 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:04:28 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-27abc84e-78fb-4613-bf69-a6062abd2ab3 tempest-ServerRescueNegativeTestJSON-1891426908 tempest-ServerRescueNegativeTestJSON-1891426908-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/21faea9e6951f3bdd0153b76ac89fe1a60a34758 --force-share --output=json" returned: 0 in 0.241s {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:04:28 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-27abc84e-78fb-4613-bf69-a6062abd2ab3 tempest-ServerRescueNegativeTestJSON-1891426908 tempest-ServerRescueNegativeTestJSON-1891426908-project-member] Acquiring lock "21faea9e6951f3bdd0153b76ac89fe1a60a34758" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 18:04:28 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-27abc84e-78fb-4613-bf69-a6062abd2ab3 tempest-ServerRescueNegativeTestJSON-1891426908 tempest-ServerRescueNegativeTestJSON-1891426908-project-member] Lock "21faea9e6951f3bdd0153b76ac89fe1a60a34758" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 18:04:28 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-27abc84e-78fb-4613-bf69-a6062abd2ab3 tempest-ServerRescueNegativeTestJSON-1891426908 tempest-ServerRescueNegativeTestJSON-1891426908-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/21faea9e6951f3bdd0153b76ac89fe1a60a34758 --force-share --output=json {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:04:28 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:04:28 user nova-compute[74613]: DEBUG nova.compute.manager [req-98575181-9366-4d6a-81b3-33d252db8786 req-4ed4f8c4-29c8-4738-b5c8-ff5c7432f349 service nova] [instance: 6993e2e7-7e03-45b4-9d3d-3742589b6078] Received event network-changed-5216b7ab-6e2b-4d7f-8c7f-e52b03d282b9 {{(pid=74613) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 18:04:28 user nova-compute[74613]: DEBUG nova.compute.manager [req-98575181-9366-4d6a-81b3-33d252db8786 req-4ed4f8c4-29c8-4738-b5c8-ff5c7432f349 service nova] [instance: 6993e2e7-7e03-45b4-9d3d-3742589b6078] Refreshing instance network info cache due to event network-changed-5216b7ab-6e2b-4d7f-8c7f-e52b03d282b9. {{(pid=74613) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 18:04:28 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-98575181-9366-4d6a-81b3-33d252db8786 req-4ed4f8c4-29c8-4738-b5c8-ff5c7432f349 service nova] Acquiring lock "refresh_cache-6993e2e7-7e03-45b4-9d3d-3742589b6078" {{(pid=74613) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 18:04:28 user nova-compute[74613]: DEBUG nova.network.neutron [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] [instance: 3b828860-5cc5-40b0-b845-8e560211794e] Updating instance_info_cache with network_info: [{"id": "dfe097e1-192f-47e2-96b7-0e9fe8320758", "address": "fa:16:3e:c2:a8:2f", "network": {"id": "0722b02d-a357-4360-87e8-580913723985", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-579793494-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b820dd795dfe46cd804772f0e71f98e9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdfe097e1-19", "ovs_interfaceid": "dfe097e1-192f-47e2-96b7-0e9fe8320758", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74613) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 18:04:28 user nova-compute[74613]: DEBUG nova.network.neutron [None req-23557d9f-f23b-4650-a063-667e4e235412 tempest-ServerRescueNegativeTestJSON-1891426908 tempest-ServerRescueNegativeTestJSON-1891426908-project-member] [instance: 6993e2e7-7e03-45b4-9d3d-3742589b6078] Instance cache missing network info. {{(pid=74613) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 29 18:04:28 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Releasing lock "refresh_cache-3b828860-5cc5-40b0-b845-8e560211794e" {{(pid=74613) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 18:04:28 user nova-compute[74613]: DEBUG nova.compute.manager [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] [instance: 3b828860-5cc5-40b0-b845-8e560211794e] Updated the network info_cache for instance {{(pid=74613) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 29 18:04:28 user nova-compute[74613]: DEBUG oslo_service.periodic_task [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74613) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 18:04:28 user nova-compute[74613]: DEBUG oslo_service.periodic_task [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74613) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 18:04:28 user nova-compute[74613]: DEBUG oslo_service.periodic_task [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74613) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 18:04:28 user nova-compute[74613]: DEBUG oslo_service.periodic_task [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74613) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 18:04:28 user nova-compute[74613]: DEBUG nova.compute.manager [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74613) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 29 18:04:28 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-27abc84e-78fb-4613-bf69-a6062abd2ab3 tempest-ServerRescueNegativeTestJSON-1891426908 tempest-ServerRescueNegativeTestJSON-1891426908-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/21faea9e6951f3bdd0153b76ac89fe1a60a34758 --force-share --output=json" returned: 0 in 0.246s {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:04:28 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-27abc84e-78fb-4613-bf69-a6062abd2ab3 tempest-ServerRescueNegativeTestJSON-1891426908 tempest-ServerRescueNegativeTestJSON-1891426908-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/21faea9e6951f3bdd0153b76ac89fe1a60a34758,backing_fmt=raw /opt/stack/data/nova/instances/6f4a1329-b3b9-4d1c-8735-abddabc359fd/disk 1073741824 {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:04:28 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-27abc84e-78fb-4613-bf69-a6062abd2ab3 tempest-ServerRescueNegativeTestJSON-1891426908 tempest-ServerRescueNegativeTestJSON-1891426908-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/21faea9e6951f3bdd0153b76ac89fe1a60a34758,backing_fmt=raw /opt/stack/data/nova/instances/6f4a1329-b3b9-4d1c-8735-abddabc359fd/disk 1073741824" returned: 0 in 0.067s {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:04:28 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-27abc84e-78fb-4613-bf69-a6062abd2ab3 tempest-ServerRescueNegativeTestJSON-1891426908 tempest-ServerRescueNegativeTestJSON-1891426908-project-member] Lock "21faea9e6951f3bdd0153b76ac89fe1a60a34758" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.320s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 18:04:28 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-27abc84e-78fb-4613-bf69-a6062abd2ab3 tempest-ServerRescueNegativeTestJSON-1891426908 tempest-ServerRescueNegativeTestJSON-1891426908-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/21faea9e6951f3bdd0153b76ac89fe1a60a34758 --force-share --output=json {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:04:28 user nova-compute[74613]: DEBUG oslo_service.periodic_task [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74613) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 18:04:28 user nova-compute[74613]: DEBUG nova.network.neutron [None req-27abc84e-78fb-4613-bf69-a6062abd2ab3 tempest-ServerRescueNegativeTestJSON-1891426908 tempest-ServerRescueNegativeTestJSON-1891426908-project-member] [instance: 6f4a1329-b3b9-4d1c-8735-abddabc359fd] Successfully created port: 6d82a9a2-81f2-4d4b-846e-178413db6ecf {{(pid=74613) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 29 18:04:28 user nova-compute[74613]: INFO nova.virt.libvirt.driver [-] [instance: f9be53df-54e6-4f59-9cef-0ba7434f0c29] Instance destroyed successfully.
Nov 29 18:04:28 user nova-compute[74613]: DEBUG nova.network.neutron [None req-23557d9f-f23b-4650-a063-667e4e235412 tempest-ServerRescueNegativeTestJSON-1891426908 tempest-ServerRescueNegativeTestJSON-1891426908-project-member] [instance: 6993e2e7-7e03-45b4-9d3d-3742589b6078] Updating instance_info_cache with network_info: [{"id": "5216b7ab-6e2b-4d7f-8c7f-e52b03d282b9", "address": "fa:16:3e:e8:7b:54", "network": {"id": "db79433c-b21c-4058-b98c-f62822abbf7a", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1715530752-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e6a3eb6ea0294f9da705dca72ec2789a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5216b7ab-6e", "ovs_interfaceid": "5216b7ab-6e2b-4d7f-8c7f-e52b03d282b9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74613) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 18:04:28 user nova-compute[74613]: DEBUG nova.objects.instance [None req-aa622d18-654d-4700-885d-f7e5dda34b2b tempest-AttachVolumeShelveTestJSON-1452861425 tempest-AttachVolumeShelveTestJSON-1452861425-project-member] Lazy-loading 'resources' on Instance uuid f9be53df-54e6-4f59-9cef-0ba7434f0c29 {{(pid=74613) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 18:04:28 user nova-compute[74613]: DEBUG nova.virt.libvirt.vif [None req-aa622d18-654d-4700-885d-f7e5dda34b2b tempest-AttachVolumeShelveTestJSON-1452861425 tempest-AttachVolumeShelveTestJSON-1452861425-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-29T17:58:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1968314827',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1968314827',id=20,image_ref='4217f428-8d9d-4ee1-9614-642d26d90c46',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBD3+ii+PLRizYlFkb7wD/B1NviUyG/AGb0OGXzoabE7BPGjgfwRJuzQbYeCpnCbXJJxRZe//IQydP4sQ1W/jCdBIdEU1Q9Gq/9zv5qMuBOIzCzGmDAMD8rdWn1s7sD+8mw==',key_name='tempest-keypair-1048982870',keypairs=<?>,launch_index=0,launched_at=2023-11-29T18:02:47Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='1c0c1c71400549369c1b11ca7d5f43ec',ramdisk_id='',reservation_id='r-crz26r0v',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='4217f428-8d9d-4ee1-9614-642d26d90c46',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1452861425',owner_user_name='tempest-AttachVolumeShelveTestJSON-1452861425-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-29T18:02:48Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='45192488dde84ebfbcacfdbd4f898799',uuid=f9be53df-54e6-4f59-9cef-0ba7434f0c29,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "175b56ab-750b-4dbf-a981-2a32d749d445", "address": "fa:16:3e:e8:f3:9e", "network": {"id": "4a101f3e-d23e-4198-bc3c-b4f9b4d2b4c4", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-864151424-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.246", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1c0c1c71400549369c1b11ca7d5f43ec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap175b56ab-75", "ovs_interfaceid": "175b56ab-750b-4dbf-a981-2a32d749d445", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74613) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 29 18:04:28 user nova-compute[74613]: DEBUG nova.network.os_vif_util [None req-aa622d18-654d-4700-885d-f7e5dda34b2b tempest-AttachVolumeShelveTestJSON-1452861425 tempest-AttachVolumeShelveTestJSON-1452861425-project-member] Converting VIF {"id": "175b56ab-750b-4dbf-a981-2a32d749d445", "address": "fa:16:3e:e8:f3:9e", "network": {"id": "4a101f3e-d23e-4198-bc3c-b4f9b4d2b4c4", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-864151424-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.246", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1c0c1c71400549369c1b11ca7d5f43ec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap175b56ab-75", "ovs_interfaceid": "175b56ab-750b-4dbf-a981-2a32d749d445", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74613) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 18:04:28 user nova-compute[74613]: DEBUG nova.network.os_vif_util [None req-aa622d18-654d-4700-885d-f7e5dda34b2b tempest-AttachVolumeShelveTestJSON-1452861425 tempest-AttachVolumeShelveTestJSON-1452861425-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e8:f3:9e,bridge_name='br-int',has_traffic_filtering=True,id=175b56ab-750b-4dbf-a981-2a32d749d445,network=Network(4a101f3e-d23e-4198-bc3c-b4f9b4d2b4c4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap175b56ab-75') {{(pid=74613) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 18:04:28 user nova-compute[74613]: DEBUG os_vif [None req-aa622d18-654d-4700-885d-f7e5dda34b2b tempest-AttachVolumeShelveTestJSON-1452861425 tempest-AttachVolumeShelveTestJSON-1452861425-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e8:f3:9e,bridge_name='br-int',has_traffic_filtering=True,id=175b56ab-750b-4dbf-a981-2a32d749d445,network=Network(4a101f3e-d23e-4198-bc3c-b4f9b4d2b4c4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap175b56ab-75') {{(pid=74613) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 29 18:04:28 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-23557d9f-f23b-4650-a063-667e4e235412 tempest-ServerRescueNegativeTestJSON-1891426908 tempest-ServerRescueNegativeTestJSON-1891426908-project-member] Releasing lock "refresh_cache-6993e2e7-7e03-45b4-9d3d-3742589b6078" {{(pid=74613) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 18:04:28 user nova-compute[74613]: DEBUG nova.compute.manager [None req-23557d9f-f23b-4650-a063-667e4e235412 tempest-ServerRescueNegativeTestJSON-1891426908 tempest-ServerRescueNegativeTestJSON-1891426908-project-member] [instance: 6993e2e7-7e03-45b4-9d3d-3742589b6078] Instance network_info: |[{"id": "5216b7ab-6e2b-4d7f-8c7f-e52b03d282b9", "address": "fa:16:3e:e8:7b:54", "network": {"id": "db79433c-b21c-4058-b98c-f62822abbf7a", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1715530752-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e6a3eb6ea0294f9da705dca72ec2789a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5216b7ab-6e", "ovs_interfaceid": "5216b7ab-6e2b-4d7f-8c7f-e52b03d282b9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74613) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 29 18:04:28 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-98575181-9366-4d6a-81b3-33d252db8786 req-4ed4f8c4-29c8-4738-b5c8-ff5c7432f349 service nova] Acquired lock "refresh_cache-6993e2e7-7e03-45b4-9d3d-3742589b6078" {{(pid=74613) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 18:04:28 user nova-compute[74613]: DEBUG nova.network.neutron [req-98575181-9366-4d6a-81b3-33d252db8786 req-4ed4f8c4-29c8-4738-b5c8-ff5c7432f349 service nova] [instance: 6993e2e7-7e03-45b4-9d3d-3742589b6078] Refreshing network info cache for port 5216b7ab-6e2b-4d7f-8c7f-e52b03d282b9 {{(pid=74613) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 18:04:28 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-23557d9f-f23b-4650-a063-667e4e235412 tempest-ServerRescueNegativeTestJSON-1891426908 tempest-ServerRescueNegativeTestJSON-1891426908-project-member] [instance: 6993e2e7-7e03-45b4-9d3d-3742589b6078] Start _get_guest_xml network_info=[{"id": "5216b7ab-6e2b-4d7f-8c7f-e52b03d282b9", "address": "fa:16:3e:e8:7b:54", "network": {"id": "db79433c-b21c-4058-b98c-f62822abbf7a", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1715530752-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e6a3eb6ea0294f9da705dca72ec2789a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5216b7ab-6e", "ovs_interfaceid": "5216b7ab-6e2b-4d7f-8c7f-e52b03d282b9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-29T17:47:38Z,direct_url=<?>,disk_format='qcow2',id=4217f428-8d9d-4ee1-9614-642d26d90c46,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='794b07cbd46a44b5865cfda741036bae',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-29T17:47:40Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'size': 0, 'device_type': 'disk', 'boot_index': 0, 'guest_format': None, 'encrypted': False, 'encryption_format': None, 'disk_bus': 'virtio', 'image_id': '4217f428-8d9d-4ee1-9614-642d26d90c46'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74613) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 29 18:04:28 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:04:28 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap175b56ab-75, bridge=br-int, if_exists=True) {{(pid=74613) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 18:04:28 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:04:28 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 18:04:28 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:04:28 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=41429a19-ba0d-4921-b841-131cb42b7990) {{(pid=74613) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 18:04:28 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-27abc84e-78fb-4613-bf69-a6062abd2ab3 tempest-ServerRescueNegativeTestJSON-1891426908 tempest-ServerRescueNegativeTestJSON-1891426908-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/21faea9e6951f3bdd0153b76ac89fe1a60a34758 --force-share --output=json" returned: 0 in 0.284s {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:04:28 user nova-compute[74613]: DEBUG nova.virt.disk.api [None req-27abc84e-78fb-4613-bf69-a6062abd2ab3 tempest-ServerRescueNegativeTestJSON-1891426908 tempest-ServerRescueNegativeTestJSON-1891426908-project-member] Checking if we can resize image /opt/stack/data/nova/instances/6f4a1329-b3b9-4d1c-8735-abddabc359fd/disk. size=1073741824 {{(pid=74613) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 29 18:04:28 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-27abc84e-78fb-4613-bf69-a6062abd2ab3 tempest-ServerRescueNegativeTestJSON-1891426908 tempest-ServerRescueNegativeTestJSON-1891426908-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f4a1329-b3b9-4d1c-8735-abddabc359fd/disk --force-share --output=json {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:04:28 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:04:28 user nova-compute[74613]: INFO os_vif [None req-aa622d18-654d-4700-885d-f7e5dda34b2b tempest-AttachVolumeShelveTestJSON-1452861425 tempest-AttachVolumeShelveTestJSON-1452861425-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e8:f3:9e,bridge_name='br-int',has_traffic_filtering=True,id=175b56ab-750b-4dbf-a981-2a32d749d445,network=Network(4a101f3e-d23e-4198-bc3c-b4f9b4d2b4c4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap175b56ab-75')
Nov 29 18:04:28 user nova-compute[74613]: INFO nova.virt.libvirt.driver [None req-aa622d18-654d-4700-885d-f7e5dda34b2b tempest-AttachVolumeShelveTestJSON-1452861425 tempest-AttachVolumeShelveTestJSON-1452861425-project-member] [instance: f9be53df-54e6-4f59-9cef-0ba7434f0c29] Deleting instance files /opt/stack/data/nova/instances/f9be53df-54e6-4f59-9cef-0ba7434f0c29_del
Nov 29 18:04:28 user nova-compute[74613]: INFO nova.virt.libvirt.driver [None req-aa622d18-654d-4700-885d-f7e5dda34b2b tempest-AttachVolumeShelveTestJSON-1452861425 tempest-AttachVolumeShelveTestJSON-1452861425-project-member] [instance: f9be53df-54e6-4f59-9cef-0ba7434f0c29] Deletion of /opt/stack/data/nova/instances/f9be53df-54e6-4f59-9cef-0ba7434f0c29_del complete
Nov 29 18:04:28 user nova-compute[74613]: WARNING nova.virt.libvirt.driver [None req-23557d9f-f23b-4650-a063-667e4e235412 tempest-ServerRescueNegativeTestJSON-1891426908 tempest-ServerRescueNegativeTestJSON-1891426908-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 18:04:28 user nova-compute[74613]: WARNING nova.virt.libvirt.driver [None req-23557d9f-f23b-4650-a063-667e4e235412 tempest-ServerRescueNegativeTestJSON-1891426908 tempest-ServerRescueNegativeTestJSON-1891426908-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 18:04:28 user nova-compute[74613]: DEBUG nova.virt.libvirt.host [None req-23557d9f-f23b-4650-a063-667e4e235412 tempest-ServerRescueNegativeTestJSON-1891426908 tempest-ServerRescueNegativeTestJSON-1891426908-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74613) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 29 18:04:28 user nova-compute[74613]: DEBUG nova.virt.libvirt.host [None req-23557d9f-f23b-4650-a063-667e4e235412 tempest-ServerRescueNegativeTestJSON-1891426908 tempest-ServerRescueNegativeTestJSON-1891426908-project-member] CPU controller missing on host. {{(pid=74613) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 29 18:04:28 user nova-compute[74613]: DEBUG nova.virt.libvirt.host [None req-23557d9f-f23b-4650-a063-667e4e235412 tempest-ServerRescueNegativeTestJSON-1891426908 tempest-ServerRescueNegativeTestJSON-1891426908-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74613) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 29 18:04:28 user nova-compute[74613]: DEBUG nova.virt.libvirt.host [None req-23557d9f-f23b-4650-a063-667e4e235412 tempest-ServerRescueNegativeTestJSON-1891426908 tempest-ServerRescueNegativeTestJSON-1891426908-project-member] CPU controller found on host. {{(pid=74613) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 29 18:04:28 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-23557d9f-f23b-4650-a063-667e4e235412 tempest-ServerRescueNegativeTestJSON-1891426908 tempest-ServerRescueNegativeTestJSON-1891426908-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74613) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 29 18:04:28 user nova-compute[74613]: DEBUG nova.virt.hardware [None req-23557d9f-f23b-4650-a063-667e4e235412 tempest-ServerRescueNegativeTestJSON-1891426908 tempest-ServerRescueNegativeTestJSON-1891426908-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-29T17:47:27Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-29T17:47:38Z,direct_url=<?>,disk_format='qcow2',id=4217f428-8d9d-4ee1-9614-642d26d90c46,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='794b07cbd46a44b5865cfda741036bae',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-29T17:47:40Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74613) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 29 18:04:28 user nova-compute[74613]: DEBUG nova.virt.hardware [None req-23557d9f-f23b-4650-a063-667e4e235412 tempest-ServerRescueNegativeTestJSON-1891426908 tempest-ServerRescueNegativeTestJSON-1891426908-project-member] Flavor limits 0:0:0 {{(pid=74613) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 29 18:04:28 user nova-compute[74613]: DEBUG nova.virt.hardware [None req-23557d9f-f23b-4650-a063-667e4e235412 tempest-ServerRescueNegativeTestJSON-1891426908 tempest-ServerRescueNegativeTestJSON-1891426908-project-member] Image limits 0:0:0 {{(pid=74613) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 29 18:04:28 user nova-compute[74613]: DEBUG nova.virt.hardware [None req-23557d9f-f23b-4650-a063-667e4e235412 tempest-ServerRescueNegativeTestJSON-1891426908 tempest-ServerRescueNegativeTestJSON-1891426908-project-member] Flavor pref 0:0:0 {{(pid=74613) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 29 18:04:28 user nova-compute[74613]: DEBUG nova.virt.hardware [None req-23557d9f-f23b-4650-a063-667e4e235412 tempest-ServerRescueNegativeTestJSON-1891426908 tempest-ServerRescueNegativeTestJSON-1891426908-project-member] Image pref 0:0:0 {{(pid=74613) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 29 18:04:28 user nova-compute[74613]: DEBUG nova.virt.hardware [None req-23557d9f-f23b-4650-a063-667e4e235412 tempest-ServerRescueNegativeTestJSON-1891426908 tempest-ServerRescueNegativeTestJSON-1891426908-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74613) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 29 18:04:28 user nova-compute[74613]: DEBUG nova.virt.hardware [None req-23557d9f-f23b-4650-a063-667e4e235412 tempest-ServerRescueNegativeTestJSON-1891426908 tempest-ServerRescueNegativeTestJSON-1891426908-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74613) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 29 18:04:28 user nova-compute[74613]: DEBUG nova.virt.hardware [None req-23557d9f-f23b-4650-a063-667e4e235412 tempest-ServerRescueNegativeTestJSON-1891426908 tempest-ServerRescueNegativeTestJSON-1891426908-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74613) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 29 18:04:28 user nova-compute[74613]: DEBUG nova.virt.hardware [None req-23557d9f-f23b-4650-a063-667e4e235412 tempest-ServerRescueNegativeTestJSON-1891426908 tempest-ServerRescueNegativeTestJSON-1891426908-project-member] Got 1 possible topologies {{(pid=74613) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 29 18:04:28 user nova-compute[74613]: DEBUG nova.virt.hardware [None req-23557d9f-f23b-4650-a063-667e4e235412 tempest-ServerRescueNegativeTestJSON-1891426908 tempest-ServerRescueNegativeTestJSON-1891426908-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74613) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 29 18:04:28 user nova-compute[74613]: DEBUG nova.virt.hardware [None req-23557d9f-f23b-4650-a063-667e4e235412 tempest-ServerRescueNegativeTestJSON-1891426908 tempest-ServerRescueNegativeTestJSON-1891426908-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74613) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 29 18:04:29 user nova-compute[74613]: DEBUG nova.virt.libvirt.vif [None req-23557d9f-f23b-4650-a063-667e4e235412 tempest-ServerRescueNegativeTestJSON-1891426908 tempest-ServerRescueNegativeTestJSON-1891426908-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T18:04:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1218880828',display_name='tempest-ServerRescueNegativeTestJSON-server-1218880828',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1218880828',id=28,image_ref='4217f428-8d9d-4ee1-9614-642d26d90c46',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e6a3eb6ea0294f9da705dca72ec2789a',ramdisk_id='',reservation_id='r-llk4pbtb',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='4217f428-8d9d-4ee1-9614-642d26d90c46',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-1891426908',owner_user_name='tempest-ServerRescueNegativeTestJSON-1891426908-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T18:04:27Z,user_data=None,user_id='4e984d45838e441680b9948c213728fb',uuid=6993e2e7-7e03-45b4-9d3d-3742589b6078,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5216b7ab-6e2b-4d7f-8c7f-e52b03d282b9", "address": "fa:16:3e:e8:7b:54", "network": {"id": "db79433c-b21c-4058-b98c-f62822abbf7a", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1715530752-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e6a3eb6ea0294f9da705dca72ec2789a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5216b7ab-6e", "ovs_interfaceid": "5216b7ab-6e2b-4d7f-8c7f-e52b03d282b9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74613) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 29 18:04:29 user nova-compute[74613]: DEBUG nova.network.os_vif_util [None req-23557d9f-f23b-4650-a063-667e4e235412 tempest-ServerRescueNegativeTestJSON-1891426908 tempest-ServerRescueNegativeTestJSON-1891426908-project-member] Converting VIF {"id": "5216b7ab-6e2b-4d7f-8c7f-e52b03d282b9", "address": "fa:16:3e:e8:7b:54", "network": {"id": "db79433c-b21c-4058-b98c-f62822abbf7a", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1715530752-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e6a3eb6ea0294f9da705dca72ec2789a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5216b7ab-6e", "ovs_interfaceid": "5216b7ab-6e2b-4d7f-8c7f-e52b03d282b9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74613) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 18:04:29 user nova-compute[74613]: DEBUG nova.network.os_vif_util [None req-23557d9f-f23b-4650-a063-667e4e235412 tempest-ServerRescueNegativeTestJSON-1891426908 tempest-ServerRescueNegativeTestJSON-1891426908-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e8:7b:54,bridge_name='br-int',has_traffic_filtering=True,id=5216b7ab-6e2b-4d7f-8c7f-e52b03d282b9,network=Network(db79433c-b21c-4058-b98c-f62822abbf7a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5216b7ab-6e') {{(pid=74613) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 18:04:29 user nova-compute[74613]: DEBUG nova.objects.instance [None req-23557d9f-f23b-4650-a063-667e4e235412 tempest-ServerRescueNegativeTestJSON-1891426908 tempest-ServerRescueNegativeTestJSON-1891426908-project-member] Lazy-loading 'pci_devices' on Instance uuid 6993e2e7-7e03-45b4-9d3d-3742589b6078 {{(pid=74613) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 18:04:29 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-27abc84e-78fb-4613-bf69-a6062abd2ab3 tempest-ServerRescueNegativeTestJSON-1891426908 tempest-ServerRescueNegativeTestJSON-1891426908-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f4a1329-b3b9-4d1c-8735-abddabc359fd/disk --force-share --output=json" returned: 0 in 0.238s {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:04:29 user nova-compute[74613]: DEBUG nova.virt.disk.api [None req-27abc84e-78fb-4613-bf69-a6062abd2ab3 tempest-ServerRescueNegativeTestJSON-1891426908 tempest-ServerRescueNegativeTestJSON-1891426908-project-member] Cannot resize image /opt/stack/data/nova/instances/6f4a1329-b3b9-4d1c-8735-abddabc359fd/disk to a smaller size. {{(pid=74613) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 29 18:04:29 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-27abc84e-78fb-4613-bf69-a6062abd2ab3 tempest-ServerRescueNegativeTestJSON-1891426908 tempest-ServerRescueNegativeTestJSON-1891426908-project-member] [instance: 6f4a1329-b3b9-4d1c-8735-abddabc359fd] Created local disks {{(pid=74613) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 29 18:04:29 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-27abc84e-78fb-4613-bf69-a6062abd2ab3 tempest-ServerRescueNegativeTestJSON-1891426908 tempest-ServerRescueNegativeTestJSON-1891426908-project-member] [instance: 6f4a1329-b3b9-4d1c-8735-abddabc359fd] Ensure instance console log exists: /opt/stack/data/nova/instances/6f4a1329-b3b9-4d1c-8735-abddabc359fd/console.log {{(pid=74613) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 29 18:04:29 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-27abc84e-78fb-4613-bf69-a6062abd2ab3 tempest-ServerRescueNegativeTestJSON-1891426908 tempest-ServerRescueNegativeTestJSON-1891426908-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 18:04:29 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-27abc84e-78fb-4613-bf69-a6062abd2ab3 tempest-ServerRescueNegativeTestJSON-1891426908 tempest-ServerRescueNegativeTestJSON-1891426908-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 18:04:29 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-27abc84e-78fb-4613-bf69-a6062abd2ab3 tempest-ServerRescueNegativeTestJSON-1891426908 tempest-ServerRescueNegativeTestJSON-1891426908-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 18:04:29 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-23557d9f-f23b-4650-a063-667e4e235412 tempest-ServerRescueNegativeTestJSON-1891426908 tempest-ServerRescueNegativeTestJSON-1891426908-project-member] [instance: 6993e2e7-7e03-45b4-9d3d-3742589b6078] End _get_guest_xml xml=<domain type="kvm">
Nov 29 18:04:29 user nova-compute[74613]:   <uuid>6993e2e7-7e03-45b4-9d3d-3742589b6078</uuid>
Nov 29 18:04:29 user nova-compute[74613]:   <name>instance-0000001c</name>
Nov 29 18:04:29 user nova-compute[74613]:   <memory>524288</memory>
Nov 29 18:04:29 user nova-compute[74613]:   <vcpu>1</vcpu>
Nov 29 18:04:29 user nova-compute[74613]:   <metadata>
Nov 29 18:04:29 user nova-compute[74613]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 29 18:04:29 user nova-compute[74613]:       <nova:package version="0.0.0"/>
Nov 29 18:04:29 user nova-compute[74613]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-1218880828</nova:name>
Nov 29 18:04:29 user nova-compute[74613]:       <nova:creationTime>2023-11-29 18:04:28</nova:creationTime>
Nov 29 18:04:29 user nova-compute[74613]:       <nova:flavor name="m1.tiny">
Nov 29 18:04:29 user nova-compute[74613]:         <nova:memory>512</nova:memory>
Nov 29 18:04:29 user nova-compute[74613]:         <nova:disk>1</nova:disk>
Nov 29 18:04:29 user nova-compute[74613]:         <nova:swap>0</nova:swap>
Nov 29 18:04:29 user nova-compute[74613]:         <nova:ephemeral>0</nova:ephemeral>
Nov 29 18:04:29 user nova-compute[74613]:         <nova:vcpus>1</nova:vcpus>
Nov 29 18:04:29 user nova-compute[74613]:       </nova:flavor>
Nov 29 18:04:29 user nova-compute[74613]:       <nova:owner>
Nov 29 18:04:29 user nova-compute[74613]:         <nova:user uuid="4e984d45838e441680b9948c213728fb">tempest-ServerRescueNegativeTestJSON-1891426908-project-member</nova:user>
Nov 29 18:04:29 user nova-compute[74613]:         <nova:project uuid="e6a3eb6ea0294f9da705dca72ec2789a">tempest-ServerRescueNegativeTestJSON-1891426908</nova:project>
Nov 29 18:04:29 user nova-compute[74613]:       </nova:owner>
Nov 29 18:04:29 user nova-compute[74613]:       <nova:root type="image" uuid="4217f428-8d9d-4ee1-9614-642d26d90c46"/>
Nov 29 18:04:29 user nova-compute[74613]:       <nova:ports>
Nov 29 18:04:29 user nova-compute[74613]:         <nova:port uuid="5216b7ab-6e2b-4d7f-8c7f-e52b03d282b9">
Nov 29 18:04:29 user nova-compute[74613]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Nov 29 18:04:29 user nova-compute[74613]:         </nova:port>
Nov 29 18:04:29 user nova-compute[74613]:       </nova:ports>
Nov 29 18:04:29 user nova-compute[74613]:     </nova:instance>
Nov 29 18:04:29 user nova-compute[74613]:   </metadata>
Nov 29 18:04:29 user nova-compute[74613]:   <sysinfo type="smbios">
Nov 29 18:04:29 user nova-compute[74613]:     <system>
Nov 29 18:04:29 user nova-compute[74613]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 29 18:04:29 user nova-compute[74613]:       <entry name="product">OpenStack Nova</entry>
Nov 29 18:04:29 user nova-compute[74613]:       <entry name="version">0.0.0</entry>
Nov 29 18:04:29 user nova-compute[74613]:       <entry name="serial">6993e2e7-7e03-45b4-9d3d-3742589b6078</entry>
Nov 29 18:04:29 user nova-compute[74613]:       <entry name="uuid">6993e2e7-7e03-45b4-9d3d-3742589b6078</entry>
Nov 29 18:04:29 user nova-compute[74613]:       <entry name="family">Virtual Machine</entry>
Nov 29 18:04:29 user nova-compute[74613]:     </system>
Nov 29 18:04:29 user nova-compute[74613]:   </sysinfo>
Nov 29 18:04:29 user nova-compute[74613]:   <os>
Nov 29 18:04:29 user nova-compute[74613]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 29 18:04:29 user nova-compute[74613]:     <boot dev="hd"/>
Nov 29 18:04:29 user nova-compute[74613]:     <smbios mode="sysinfo"/>
Nov 29 18:04:29 user nova-compute[74613]:   </os>
Nov 29 18:04:29 user nova-compute[74613]:   <features>
Nov 29 18:04:29 user nova-compute[74613]:     <acpi/>
Nov 29 18:04:29 user nova-compute[74613]:     <apic/>
Nov 29 18:04:29 user nova-compute[74613]:     <vmcoreinfo/>
Nov 29 18:04:29 user nova-compute[74613]:   </features>
Nov 29 18:04:29 user nova-compute[74613]:   <clock offset="utc">
Nov 29 18:04:29 user nova-compute[74613]:     <timer name="pit" tickpolicy="delay"/>
Nov 29 18:04:29 user nova-compute[74613]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 29 18:04:29 user nova-compute[74613]:     <timer name="hpet" present="no"/>
Nov 29 18:04:29 user nova-compute[74613]:   </clock>
Nov 29 18:04:29 user nova-compute[74613]:   <cpu mode="custom" match="exact">
Nov 29 18:04:29 user nova-compute[74613]:     <model>Nehalem</model>
Nov 29 18:04:29 user nova-compute[74613]:     <topology sockets="1" cores="1" threads="1"/>
Nov 29 18:04:29 user nova-compute[74613]:   </cpu>
Nov 29 18:04:29 user nova-compute[74613]:   <devices>
Nov 29 18:04:29 user nova-compute[74613]:     <disk type="file" device="disk">
Nov 29 18:04:29 user nova-compute[74613]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 29 18:04:29 user nova-compute[74613]:       <source file="/opt/stack/data/nova/instances/6993e2e7-7e03-45b4-9d3d-3742589b6078/disk"/>
Nov 29 18:04:29 user nova-compute[74613]:       <target dev="vda" bus="virtio"/>
Nov 29 18:04:29 user nova-compute[74613]:     </disk>
Nov 29 18:04:29 user nova-compute[74613]:     <interface type="ethernet">
Nov 29 18:04:29 user nova-compute[74613]:       <mac address="fa:16:3e:e8:7b:54"/>
Nov 29 18:04:29 user nova-compute[74613]:       <model type="virtio"/>
Nov 29 18:04:29 user nova-compute[74613]:       <mtu size="1442"/>
Nov 29 18:04:29 user nova-compute[74613]:       <target dev="tap5216b7ab-6e"/>
Nov 29 18:04:29 user nova-compute[74613]:     </interface>
Nov 29 18:04:29 user nova-compute[74613]:     <serial type="pty">
Nov 29 18:04:29 user nova-compute[74613]:       <log file="/opt/stack/data/nova/instances/6993e2e7-7e03-45b4-9d3d-3742589b6078/console.log" append="off"/>
Nov 29 18:04:29 user nova-compute[74613]:     </serial>
Nov 29 18:04:29 user nova-compute[74613]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 29 18:04:29 user nova-compute[74613]:     <video>
Nov 29 18:04:29 user nova-compute[74613]:       <model type="virtio"/>
Nov 29 18:04:29 user nova-compute[74613]:     </video>
Nov 29 18:04:29 user nova-compute[74613]:     <rng model="virtio">
Nov 29 18:04:29 user nova-compute[74613]:       <backend model="random">/dev/urandom</backend>
Nov 29 18:04:29 user nova-compute[74613]:     </rng>
Nov 29 18:04:29 user nova-compute[74613]:     <controller type="usb" index="0" model="none"/>
Nov 29 18:04:29 user nova-compute[74613]:     <memballoon model="virtio">
Nov 29 18:04:29 user nova-compute[74613]:       <stats period="10"/>
Nov 29 18:04:29 user nova-compute[74613]:     </memballoon>
Nov 29 18:04:29 user nova-compute[74613]:   </devices>
Nov 29 18:04:29 user nova-compute[74613]: </domain>
Nov 29 18:04:29 user nova-compute[74613]:  {{(pid=74613) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 29 18:04:29 user nova-compute[74613]: DEBUG nova.virt.libvirt.vif [None req-23557d9f-f23b-4650-a063-667e4e235412 tempest-ServerRescueNegativeTestJSON-1891426908 tempest-ServerRescueNegativeTestJSON-1891426908-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T18:04:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1218880828',display_name='tempest-ServerRescueNegativeTestJSON-server-1218880828',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1218880828',id=28,image_ref='4217f428-8d9d-4ee1-9614-642d26d90c46',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e6a3eb6ea0294f9da705dca72ec2789a',ramdisk_id='',reservation_id='r-llk4pbtb',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='4217f428-8d9d-4ee1-9614-642d26d90c46',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-1891426908',owner_user_name='tempest-ServerRescueNegativeTestJSON-1891426908-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T18:04:27Z,user_data=None,user_id='4e984d45838e441680b9948c213728fb',uuid=6993e2e7-7e03-45b4-9d3d-3742589b6078,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5216b7ab-6e2b-4d7f-8c7f-e52b03d282b9", "address": "fa:16:3e:e8:7b:54", "network": {"id": "db79433c-b21c-4058-b98c-f62822abbf7a", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1715530752-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e6a3eb6ea0294f9da705dca72ec2789a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5216b7ab-6e", "ovs_interfaceid": "5216b7ab-6e2b-4d7f-8c7f-e52b03d282b9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74613) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 29 18:04:29 user nova-compute[74613]: DEBUG nova.network.os_vif_util [None req-23557d9f-f23b-4650-a063-667e4e235412 tempest-ServerRescueNegativeTestJSON-1891426908 tempest-ServerRescueNegativeTestJSON-1891426908-project-member] Converting VIF {"id": "5216b7ab-6e2b-4d7f-8c7f-e52b03d282b9", "address": "fa:16:3e:e8:7b:54", "network": {"id": "db79433c-b21c-4058-b98c-f62822abbf7a", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1715530752-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e6a3eb6ea0294f9da705dca72ec2789a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5216b7ab-6e", "ovs_interfaceid": "5216b7ab-6e2b-4d7f-8c7f-e52b03d282b9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74613) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 18:04:29 user nova-compute[74613]: DEBUG nova.network.os_vif_util [None req-23557d9f-f23b-4650-a063-667e4e235412 tempest-ServerRescueNegativeTestJSON-1891426908 tempest-ServerRescueNegativeTestJSON-1891426908-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e8:7b:54,bridge_name='br-int',has_traffic_filtering=True,id=5216b7ab-6e2b-4d7f-8c7f-e52b03d282b9,network=Network(db79433c-b21c-4058-b98c-f62822abbf7a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5216b7ab-6e') {{(pid=74613) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 18:04:29 user nova-compute[74613]: DEBUG os_vif [None req-23557d9f-f23b-4650-a063-667e4e235412 tempest-ServerRescueNegativeTestJSON-1891426908 tempest-ServerRescueNegativeTestJSON-1891426908-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e8:7b:54,bridge_name='br-int',has_traffic_filtering=True,id=5216b7ab-6e2b-4d7f-8c7f-e52b03d282b9,network=Network(db79433c-b21c-4058-b98c-f62822abbf7a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5216b7ab-6e') {{(pid=74613) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 29 18:04:29 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:04:29 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74613) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 18:04:29 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74613) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 29 18:04:29 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:04:29 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'e85c0d20-b6b9-51a6-a784-ead508dd40ea', '_type': 'linux-noop'}}, row=False) {{(pid=74613) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 18:04:29 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:04:29 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:04:29 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:04:29 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap5216b7ab-6e, may_exist=True, interface_attrs={}) {{(pid=74613) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 18:04:29 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap5216b7ab-6e, col_values=(('qos', UUID('52edecc4-814f-489d-9f4e-67a1c410ac2f')),), if_exists=True) {{(pid=74613) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 18:04:29 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap5216b7ab-6e, col_values=(('external_ids', {'iface-id': '5216b7ab-6e2b-4d7f-8c7f-e52b03d282b9', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:e8:7b:54', 'vm-uuid': '6993e2e7-7e03-45b4-9d3d-3742589b6078'}),), if_exists=True) {{(pid=74613) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 18:04:29 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:04:29 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 18:04:29 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:04:29 user nova-compute[74613]: INFO os_vif [None req-23557d9f-f23b-4650-a063-667e4e235412 tempest-ServerRescueNegativeTestJSON-1891426908 tempest-ServerRescueNegativeTestJSON-1891426908-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e8:7b:54,bridge_name='br-int',has_traffic_filtering=True,id=5216b7ab-6e2b-4d7f-8c7f-e52b03d282b9,network=Network(db79433c-b21c-4058-b98c-f62822abbf7a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5216b7ab-6e')
Nov 29 18:04:29 user nova-compute[74613]: INFO nova.compute.manager [None req-aa622d18-654d-4700-885d-f7e5dda34b2b tempest-AttachVolumeShelveTestJSON-1452861425 tempest-AttachVolumeShelveTestJSON-1452861425-project-member] [instance: f9be53df-54e6-4f59-9cef-0ba7434f0c29] Took 1.04 seconds to destroy the instance on the hypervisor.
Nov 29 18:04:29 user nova-compute[74613]: DEBUG oslo.service.loopingcall [None req-aa622d18-654d-4700-885d-f7e5dda34b2b tempest-AttachVolumeShelveTestJSON-1452861425 tempest-AttachVolumeShelveTestJSON-1452861425-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74613) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 29 18:04:29 user nova-compute[74613]: DEBUG nova.compute.manager [-] [instance: f9be53df-54e6-4f59-9cef-0ba7434f0c29] Deallocating network for instance {{(pid=74613) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 29 18:04:29 user nova-compute[74613]: DEBUG nova.network.neutron [-] [instance: f9be53df-54e6-4f59-9cef-0ba7434f0c29] deallocate_for_instance() {{(pid=74613) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 29 18:04:29 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-23557d9f-f23b-4650-a063-667e4e235412 tempest-ServerRescueNegativeTestJSON-1891426908 tempest-ServerRescueNegativeTestJSON-1891426908-project-member] No BDM found with device name vda, not building metadata. {{(pid=74613) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 18:04:29 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-23557d9f-f23b-4650-a063-667e4e235412 tempest-ServerRescueNegativeTestJSON-1891426908 tempest-ServerRescueNegativeTestJSON-1891426908-project-member] No VIF found with MAC fa:16:3e:e8:7b:54, not building metadata {{(pid=74613) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 29 18:04:29 user nova-compute[74613]: DEBUG nova.compute.manager [req-d13668b6-5914-418d-a6c5-965afead842b req-366ec7ac-6301-4780-9bb0-e0253d9cac0b service nova] [instance: f9be53df-54e6-4f59-9cef-0ba7434f0c29] Received event network-vif-unplugged-175b56ab-750b-4dbf-a981-2a32d749d445 {{(pid=74613) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 18:04:29 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-d13668b6-5914-418d-a6c5-965afead842b req-366ec7ac-6301-4780-9bb0-e0253d9cac0b service nova] Acquiring lock "f9be53df-54e6-4f59-9cef-0ba7434f0c29-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 18:04:29 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-d13668b6-5914-418d-a6c5-965afead842b req-366ec7ac-6301-4780-9bb0-e0253d9cac0b service nova] Lock "f9be53df-54e6-4f59-9cef-0ba7434f0c29-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 18:04:29 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-d13668b6-5914-418d-a6c5-965afead842b req-366ec7ac-6301-4780-9bb0-e0253d9cac0b service nova] Lock "f9be53df-54e6-4f59-9cef-0ba7434f0c29-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 18:04:29 user nova-compute[74613]: DEBUG nova.compute.manager [req-d13668b6-5914-418d-a6c5-965afead842b req-366ec7ac-6301-4780-9bb0-e0253d9cac0b service nova] [instance: f9be53df-54e6-4f59-9cef-0ba7434f0c29] No waiting events found dispatching network-vif-unplugged-175b56ab-750b-4dbf-a981-2a32d749d445 {{(pid=74613) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 18:04:29 user nova-compute[74613]: DEBUG nova.compute.manager [req-d13668b6-5914-418d-a6c5-965afead842b req-366ec7ac-6301-4780-9bb0-e0253d9cac0b service nova] [instance: f9be53df-54e6-4f59-9cef-0ba7434f0c29] Received event network-vif-unplugged-175b56ab-750b-4dbf-a981-2a32d749d445 for instance with task_state deleting. {{(pid=74613) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 29 18:04:29 user nova-compute[74613]: DEBUG nova.network.neutron [req-98575181-9366-4d6a-81b3-33d252db8786 req-4ed4f8c4-29c8-4738-b5c8-ff5c7432f349 service nova] [instance: 6993e2e7-7e03-45b4-9d3d-3742589b6078] Updated VIF entry in instance network info cache for port 5216b7ab-6e2b-4d7f-8c7f-e52b03d282b9. {{(pid=74613) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 18:04:29 user nova-compute[74613]: DEBUG nova.network.neutron [req-98575181-9366-4d6a-81b3-33d252db8786 req-4ed4f8c4-29c8-4738-b5c8-ff5c7432f349 service nova] [instance: 6993e2e7-7e03-45b4-9d3d-3742589b6078] Updating instance_info_cache with network_info: [{"id": "5216b7ab-6e2b-4d7f-8c7f-e52b03d282b9", "address": "fa:16:3e:e8:7b:54", "network": {"id": "db79433c-b21c-4058-b98c-f62822abbf7a", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1715530752-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e6a3eb6ea0294f9da705dca72ec2789a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5216b7ab-6e", "ovs_interfaceid": "5216b7ab-6e2b-4d7f-8c7f-e52b03d282b9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74613) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 18:04:29 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-98575181-9366-4d6a-81b3-33d252db8786 req-4ed4f8c4-29c8-4738-b5c8-ff5c7432f349 service nova] Releasing lock "refresh_cache-6993e2e7-7e03-45b4-9d3d-3742589b6078" {{(pid=74613) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 18:04:29 user nova-compute[74613]: DEBUG oslo_service.periodic_task [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74613) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 18:04:29 user nova-compute[74613]: DEBUG nova.network.neutron [None req-27abc84e-78fb-4613-bf69-a6062abd2ab3 tempest-ServerRescueNegativeTestJSON-1891426908 tempest-ServerRescueNegativeTestJSON-1891426908-project-member] [instance: 6f4a1329-b3b9-4d1c-8735-abddabc359fd] Successfully updated port: 6d82a9a2-81f2-4d4b-846e-178413db6ecf {{(pid=74613) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 29 18:04:29 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-27abc84e-78fb-4613-bf69-a6062abd2ab3 tempest-ServerRescueNegativeTestJSON-1891426908 tempest-ServerRescueNegativeTestJSON-1891426908-project-member] Acquiring lock "refresh_cache-6f4a1329-b3b9-4d1c-8735-abddabc359fd" {{(pid=74613) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 18:04:29 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-27abc84e-78fb-4613-bf69-a6062abd2ab3 tempest-ServerRescueNegativeTestJSON-1891426908 tempest-ServerRescueNegativeTestJSON-1891426908-project-member] Acquired lock "refresh_cache-6f4a1329-b3b9-4d1c-8735-abddabc359fd" {{(pid=74613) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 18:04:29 user nova-compute[74613]: DEBUG nova.network.neutron [None req-27abc84e-78fb-4613-bf69-a6062abd2ab3 tempest-ServerRescueNegativeTestJSON-1891426908 tempest-ServerRescueNegativeTestJSON-1891426908-project-member] [instance: 6f4a1329-b3b9-4d1c-8735-abddabc359fd] Building network info cache for instance {{(pid=74613) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 29 18:04:29 user nova-compute[74613]: DEBUG nova.compute.manager [req-51255546-4454-4354-ac12-c41fbe7cb298 req-3c83cabf-04d7-4572-ad31-655a5b2e299e service nova] [instance: 6f4a1329-b3b9-4d1c-8735-abddabc359fd] Received event network-changed-6d82a9a2-81f2-4d4b-846e-178413db6ecf {{(pid=74613) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 18:04:29 user nova-compute[74613]: DEBUG nova.compute.manager [req-51255546-4454-4354-ac12-c41fbe7cb298 req-3c83cabf-04d7-4572-ad31-655a5b2e299e service nova] [instance: 6f4a1329-b3b9-4d1c-8735-abddabc359fd] Refreshing instance network info cache due to event network-changed-6d82a9a2-81f2-4d4b-846e-178413db6ecf. {{(pid=74613) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 18:04:29 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-51255546-4454-4354-ac12-c41fbe7cb298 req-3c83cabf-04d7-4572-ad31-655a5b2e299e service nova] Acquiring lock "refresh_cache-6f4a1329-b3b9-4d1c-8735-abddabc359fd" {{(pid=74613) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 18:04:29 user nova-compute[74613]: DEBUG nova.network.neutron [None req-27abc84e-78fb-4613-bf69-a6062abd2ab3 tempest-ServerRescueNegativeTestJSON-1891426908 tempest-ServerRescueNegativeTestJSON-1891426908-project-member] [instance: 6f4a1329-b3b9-4d1c-8735-abddabc359fd] Instance cache missing network info. {{(pid=74613) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 29 18:04:30 user nova-compute[74613]: DEBUG nova.network.neutron [None req-27abc84e-78fb-4613-bf69-a6062abd2ab3 tempest-ServerRescueNegativeTestJSON-1891426908 tempest-ServerRescueNegativeTestJSON-1891426908-project-member] [instance: 6f4a1329-b3b9-4d1c-8735-abddabc359fd] Updating instance_info_cache with network_info: [{"id": "6d82a9a2-81f2-4d4b-846e-178413db6ecf", "address": "fa:16:3e:53:4e:1d", "network": {"id": "db79433c-b21c-4058-b98c-f62822abbf7a", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1715530752-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e6a3eb6ea0294f9da705dca72ec2789a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6d82a9a2-81", "ovs_interfaceid": "6d82a9a2-81f2-4d4b-846e-178413db6ecf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74613) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 18:04:30 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-27abc84e-78fb-4613-bf69-a6062abd2ab3 tempest-ServerRescueNegativeTestJSON-1891426908 tempest-ServerRescueNegativeTestJSON-1891426908-project-member] Releasing lock "refresh_cache-6f4a1329-b3b9-4d1c-8735-abddabc359fd" {{(pid=74613) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 18:04:30 user nova-compute[74613]: DEBUG nova.compute.manager [None req-27abc84e-78fb-4613-bf69-a6062abd2ab3 tempest-ServerRescueNegativeTestJSON-1891426908 tempest-ServerRescueNegativeTestJSON-1891426908-project-member] [instance: 6f4a1329-b3b9-4d1c-8735-abddabc359fd] Instance network_info: |[{"id": "6d82a9a2-81f2-4d4b-846e-178413db6ecf", "address": "fa:16:3e:53:4e:1d", "network": {"id": "db79433c-b21c-4058-b98c-f62822abbf7a", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1715530752-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e6a3eb6ea0294f9da705dca72ec2789a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6d82a9a2-81", "ovs_interfaceid": "6d82a9a2-81f2-4d4b-846e-178413db6ecf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74613) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 29 18:04:30 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-51255546-4454-4354-ac12-c41fbe7cb298 req-3c83cabf-04d7-4572-ad31-655a5b2e299e service nova] Acquired lock "refresh_cache-6f4a1329-b3b9-4d1c-8735-abddabc359fd" {{(pid=74613) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 18:04:30 user nova-compute[74613]: DEBUG nova.network.neutron [req-51255546-4454-4354-ac12-c41fbe7cb298 req-3c83cabf-04d7-4572-ad31-655a5b2e299e service nova] [instance: 6f4a1329-b3b9-4d1c-8735-abddabc359fd] Refreshing network info cache for port 6d82a9a2-81f2-4d4b-846e-178413db6ecf {{(pid=74613) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 18:04:30 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-27abc84e-78fb-4613-bf69-a6062abd2ab3 tempest-ServerRescueNegativeTestJSON-1891426908 tempest-ServerRescueNegativeTestJSON-1891426908-project-member] [instance: 6f4a1329-b3b9-4d1c-8735-abddabc359fd] Start _get_guest_xml network_info=[{"id": "6d82a9a2-81f2-4d4b-846e-178413db6ecf", "address": "fa:16:3e:53:4e:1d", "network": {"id": "db79433c-b21c-4058-b98c-f62822abbf7a", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1715530752-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e6a3eb6ea0294f9da705dca72ec2789a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6d82a9a2-81", "ovs_interfaceid": "6d82a9a2-81f2-4d4b-846e-178413db6ecf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-29T17:47:38Z,direct_url=<?>,disk_format='qcow2',id=4217f428-8d9d-4ee1-9614-642d26d90c46,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='794b07cbd46a44b5865cfda741036bae',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-29T17:47:40Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'size': 0, 'device_type': 'disk', 'boot_index': 0, 'guest_format': None, 'encrypted': False, 'encryption_format': None, 'disk_bus': 'virtio', 'image_id': '4217f428-8d9d-4ee1-9614-642d26d90c46'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74613) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 29 18:04:30 user nova-compute[74613]: WARNING nova.virt.libvirt.driver [None req-27abc84e-78fb-4613-bf69-a6062abd2ab3 tempest-ServerRescueNegativeTestJSON-1891426908 tempest-ServerRescueNegativeTestJSON-1891426908-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 18:04:30 user nova-compute[74613]: WARNING nova.virt.libvirt.driver [None req-27abc84e-78fb-4613-bf69-a6062abd2ab3 tempest-ServerRescueNegativeTestJSON-1891426908 tempest-ServerRescueNegativeTestJSON-1891426908-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 18:04:30 user nova-compute[74613]: DEBUG nova.virt.libvirt.host [None req-27abc84e-78fb-4613-bf69-a6062abd2ab3 tempest-ServerRescueNegativeTestJSON-1891426908 tempest-ServerRescueNegativeTestJSON-1891426908-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74613) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 29 18:04:30 user nova-compute[74613]: DEBUG nova.virt.libvirt.host [None req-27abc84e-78fb-4613-bf69-a6062abd2ab3 tempest-ServerRescueNegativeTestJSON-1891426908 tempest-ServerRescueNegativeTestJSON-1891426908-project-member] CPU controller missing on host. {{(pid=74613) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 29 18:04:30 user nova-compute[74613]: DEBUG nova.virt.libvirt.host [None req-27abc84e-78fb-4613-bf69-a6062abd2ab3 tempest-ServerRescueNegativeTestJSON-1891426908 tempest-ServerRescueNegativeTestJSON-1891426908-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74613) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 29 18:04:30 user nova-compute[74613]: DEBUG nova.virt.libvirt.host [None req-27abc84e-78fb-4613-bf69-a6062abd2ab3 tempest-ServerRescueNegativeTestJSON-1891426908 tempest-ServerRescueNegativeTestJSON-1891426908-project-member] CPU controller found on host. {{(pid=74613) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 29 18:04:30 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-27abc84e-78fb-4613-bf69-a6062abd2ab3 tempest-ServerRescueNegativeTestJSON-1891426908 tempest-ServerRescueNegativeTestJSON-1891426908-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74613) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 29 18:04:30 user nova-compute[74613]: DEBUG nova.virt.hardware [None req-27abc84e-78fb-4613-bf69-a6062abd2ab3 tempest-ServerRescueNegativeTestJSON-1891426908 tempest-ServerRescueNegativeTestJSON-1891426908-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-29T17:47:27Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-29T17:47:38Z,direct_url=<?>,disk_format='qcow2',id=4217f428-8d9d-4ee1-9614-642d26d90c46,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='794b07cbd46a44b5865cfda741036bae',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-29T17:47:40Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74613) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 29 18:04:30 user nova-compute[74613]: DEBUG nova.virt.hardware [None req-27abc84e-78fb-4613-bf69-a6062abd2ab3 tempest-ServerRescueNegativeTestJSON-1891426908 tempest-ServerRescueNegativeTestJSON-1891426908-project-member] Flavor limits 0:0:0 {{(pid=74613) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 29 18:04:30 user nova-compute[74613]: DEBUG nova.virt.hardware [None req-27abc84e-78fb-4613-bf69-a6062abd2ab3 tempest-ServerRescueNegativeTestJSON-1891426908 tempest-ServerRescueNegativeTestJSON-1891426908-project-member] Image limits 0:0:0 {{(pid=74613) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 29 18:04:30 user nova-compute[74613]: DEBUG nova.virt.hardware [None req-27abc84e-78fb-4613-bf69-a6062abd2ab3 tempest-ServerRescueNegativeTestJSON-1891426908 tempest-ServerRescueNegativeTestJSON-1891426908-project-member] Flavor pref 0:0:0 {{(pid=74613) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 29 18:04:30 user nova-compute[74613]: DEBUG nova.virt.hardware [None req-27abc84e-78fb-4613-bf69-a6062abd2ab3 tempest-ServerRescueNegativeTestJSON-1891426908 tempest-ServerRescueNegativeTestJSON-1891426908-project-member] Image pref 0:0:0 {{(pid=74613) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 29 18:04:30 user nova-compute[74613]: DEBUG nova.virt.hardware [None req-27abc84e-78fb-4613-bf69-a6062abd2ab3 tempest-ServerRescueNegativeTestJSON-1891426908 tempest-ServerRescueNegativeTestJSON-1891426908-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74613) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 29 18:04:30 user nova-compute[74613]: DEBUG nova.virt.hardware [None req-27abc84e-78fb-4613-bf69-a6062abd2ab3 tempest-ServerRescueNegativeTestJSON-1891426908 tempest-ServerRescueNegativeTestJSON-1891426908-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74613) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 29 18:04:30 user nova-compute[74613]: DEBUG nova.virt.hardware [None req-27abc84e-78fb-4613-bf69-a6062abd2ab3 tempest-ServerRescueNegativeTestJSON-1891426908 tempest-ServerRescueNegativeTestJSON-1891426908-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74613) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 29 18:04:30 user nova-compute[74613]: DEBUG nova.virt.hardware [None req-27abc84e-78fb-4613-bf69-a6062abd2ab3 tempest-ServerRescueNegativeTestJSON-1891426908 tempest-ServerRescueNegativeTestJSON-1891426908-project-member] Got 1 possible topologies {{(pid=74613) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 29 18:04:30 user nova-compute[74613]: DEBUG nova.virt.hardware [None req-27abc84e-78fb-4613-bf69-a6062abd2ab3 tempest-ServerRescueNegativeTestJSON-1891426908 tempest-ServerRescueNegativeTestJSON-1891426908-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74613) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 29 18:04:30 user nova-compute[74613]: DEBUG nova.virt.hardware [None req-27abc84e-78fb-4613-bf69-a6062abd2ab3 tempest-ServerRescueNegativeTestJSON-1891426908 tempest-ServerRescueNegativeTestJSON-1891426908-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74613) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 29 18:04:30 user nova-compute[74613]: DEBUG nova.virt.libvirt.vif [None req-27abc84e-78fb-4613-bf69-a6062abd2ab3 tempest-ServerRescueNegativeTestJSON-1891426908 tempest-ServerRescueNegativeTestJSON-1891426908-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T18:04:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1233675414',display_name='tempest-ServerRescueNegativeTestJSON-server-1233675414',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1233675414',id=29,image_ref='4217f428-8d9d-4ee1-9614-642d26d90c46',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e6a3eb6ea0294f9da705dca72ec2789a',ramdisk_id='',reservation_id='r-17bsbhc1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='4217f428-8d9d-4ee1-9614-642d26d90c46',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-1891426908',owner_user_name='tempest-ServerRescueNegativeTestJSON-1891426908-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T18:04:28Z,user_data=None,user_id='4e984d45838e441680b9948c213728fb',uuid=6f4a1329-b3b9-4d1c-8735-abddabc359fd,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6d82a9a2-81f2-4d4b-846e-178413db6ecf", "address": "fa:16:3e:53:4e:1d", "network": {"id": "db79433c-b21c-4058-b98c-f62822abbf7a", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1715530752-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e6a3eb6ea0294f9da705dca72ec2789a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6d82a9a2-81", "ovs_interfaceid": "6d82a9a2-81f2-4d4b-846e-178413db6ecf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74613) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 29 18:04:30 user nova-compute[74613]: DEBUG nova.network.os_vif_util [None req-27abc84e-78fb-4613-bf69-a6062abd2ab3 tempest-ServerRescueNegativeTestJSON-1891426908 tempest-ServerRescueNegativeTestJSON-1891426908-project-member] Converting VIF {"id": "6d82a9a2-81f2-4d4b-846e-178413db6ecf", "address": "fa:16:3e:53:4e:1d", "network": {"id": "db79433c-b21c-4058-b98c-f62822abbf7a", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1715530752-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e6a3eb6ea0294f9da705dca72ec2789a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6d82a9a2-81", "ovs_interfaceid": "6d82a9a2-81f2-4d4b-846e-178413db6ecf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74613) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 18:04:30 user nova-compute[74613]: DEBUG nova.network.os_vif_util [None req-27abc84e-78fb-4613-bf69-a6062abd2ab3 tempest-ServerRescueNegativeTestJSON-1891426908 tempest-ServerRescueNegativeTestJSON-1891426908-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:53:4e:1d,bridge_name='br-int',has_traffic_filtering=True,id=6d82a9a2-81f2-4d4b-846e-178413db6ecf,network=Network(db79433c-b21c-4058-b98c-f62822abbf7a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6d82a9a2-81') {{(pid=74613) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 18:04:30 user nova-compute[74613]: DEBUG nova.objects.instance [None req-27abc84e-78fb-4613-bf69-a6062abd2ab3 tempest-ServerRescueNegativeTestJSON-1891426908 tempest-ServerRescueNegativeTestJSON-1891426908-project-member] Lazy-loading 'pci_devices' on Instance uuid 6f4a1329-b3b9-4d1c-8735-abddabc359fd {{(pid=74613) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 18:04:30 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-27abc84e-78fb-4613-bf69-a6062abd2ab3 tempest-ServerRescueNegativeTestJSON-1891426908 tempest-ServerRescueNegativeTestJSON-1891426908-project-member] [instance: 6f4a1329-b3b9-4d1c-8735-abddabc359fd] End _get_guest_xml xml=<domain type="kvm">
Nov 29 18:04:30 user nova-compute[74613]:   <uuid>6f4a1329-b3b9-4d1c-8735-abddabc359fd</uuid>
Nov 29 18:04:30 user nova-compute[74613]:   <name>instance-0000001d</name>
Nov 29 18:04:30 user nova-compute[74613]:   <memory>524288</memory>
Nov 29 18:04:30 user nova-compute[74613]:   <vcpu>1</vcpu>
Nov 29 18:04:30 user nova-compute[74613]:   <metadata>
Nov 29 18:04:30 user nova-compute[74613]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 29 18:04:30 user nova-compute[74613]:       <nova:package version="0.0.0"/>
Nov 29 18:04:30 user nova-compute[74613]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-1233675414</nova:name>
Nov 29 18:04:30 user nova-compute[74613]:       <nova:creationTime>2023-11-29 18:04:30</nova:creationTime>
Nov 29 18:04:30 user nova-compute[74613]:       <nova:flavor name="m1.tiny">
Nov 29 18:04:30 user nova-compute[74613]:         <nova:memory>512</nova:memory>
Nov 29 18:04:30 user nova-compute[74613]:         <nova:disk>1</nova:disk>
Nov 29 18:04:30 user nova-compute[74613]:         <nova:swap>0</nova:swap>
Nov 29 18:04:30 user nova-compute[74613]:         <nova:ephemeral>0</nova:ephemeral>
Nov 29 18:04:30 user nova-compute[74613]:         <nova:vcpus>1</nova:vcpus>
Nov 29 18:04:30 user nova-compute[74613]:       </nova:flavor>
Nov 29 18:04:30 user nova-compute[74613]:       <nova:owner>
Nov 29 18:04:30 user nova-compute[74613]:         <nova:user uuid="4e984d45838e441680b9948c213728fb">tempest-ServerRescueNegativeTestJSON-1891426908-project-member</nova:user>
Nov 29 18:04:30 user nova-compute[74613]:         <nova:project uuid="e6a3eb6ea0294f9da705dca72ec2789a">tempest-ServerRescueNegativeTestJSON-1891426908</nova:project>
Nov 29 18:04:30 user nova-compute[74613]:       </nova:owner>
Nov 29 18:04:30 user nova-compute[74613]:       <nova:root type="image" uuid="4217f428-8d9d-4ee1-9614-642d26d90c46"/>
Nov 29 18:04:30 user nova-compute[74613]:       <nova:ports>
Nov 29 18:04:30 user nova-compute[74613]:         <nova:port uuid="6d82a9a2-81f2-4d4b-846e-178413db6ecf">
Nov 29 18:04:30 user nova-compute[74613]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Nov 29 18:04:30 user nova-compute[74613]:         </nova:port>
Nov 29 18:04:30 user nova-compute[74613]:       </nova:ports>
Nov 29 18:04:30 user nova-compute[74613]:     </nova:instance>
Nov 29 18:04:30 user nova-compute[74613]:   </metadata>
Nov 29 18:04:30 user nova-compute[74613]:   <sysinfo type="smbios">
Nov 29 18:04:30 user nova-compute[74613]:     <system>
Nov 29 18:04:30 user nova-compute[74613]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 29 18:04:30 user nova-compute[74613]:       <entry name="product">OpenStack Nova</entry>
Nov 29 18:04:30 user nova-compute[74613]:       <entry name="version">0.0.0</entry>
Nov 29 18:04:30 user nova-compute[74613]:       <entry name="serial">6f4a1329-b3b9-4d1c-8735-abddabc359fd</entry>
Nov 29 18:04:30 user nova-compute[74613]:       <entry name="uuid">6f4a1329-b3b9-4d1c-8735-abddabc359fd</entry>
Nov 29 18:04:30 user nova-compute[74613]:       <entry name="family">Virtual Machine</entry>
Nov 29 18:04:30 user nova-compute[74613]:     </system>
Nov 29 18:04:30 user nova-compute[74613]:   </sysinfo>
Nov 29 18:04:30 user nova-compute[74613]:   <os>
Nov 29 18:04:30 user nova-compute[74613]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 29 18:04:30 user nova-compute[74613]:     <boot dev="hd"/>
Nov 29 18:04:30 user nova-compute[74613]:     <smbios mode="sysinfo"/>
Nov 29 18:04:30 user nova-compute[74613]:   </os>
Nov 29 18:04:30 user nova-compute[74613]:   <features>
Nov 29 18:04:30 user nova-compute[74613]:     <acpi/>
Nov 29 18:04:30 user nova-compute[74613]:     <apic/>
Nov 29 18:04:30 user nova-compute[74613]:     <vmcoreinfo/>
Nov 29 18:04:30 user nova-compute[74613]:   </features>
Nov 29 18:04:30 user nova-compute[74613]:   <clock offset="utc">
Nov 29 18:04:30 user nova-compute[74613]:     <timer name="pit" tickpolicy="delay"/>
Nov 29 18:04:30 user nova-compute[74613]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 29 18:04:30 user nova-compute[74613]:     <timer name="hpet" present="no"/>
Nov 29 18:04:30 user nova-compute[74613]:   </clock>
Nov 29 18:04:30 user nova-compute[74613]:   <cpu mode="custom" match="exact">
Nov 29 18:04:30 user nova-compute[74613]:     <model>Nehalem</model>
Nov 29 18:04:30 user nova-compute[74613]:     <topology sockets="1" cores="1" threads="1"/>
Nov 29 18:04:30 user nova-compute[74613]:   </cpu>
Nov 29 18:04:30 user nova-compute[74613]:   <devices>
Nov 29 18:04:30 user nova-compute[74613]:     <disk type="file" device="disk">
Nov 29 18:04:30 user nova-compute[74613]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 29 18:04:30 user nova-compute[74613]:       <source file="/opt/stack/data/nova/instances/6f4a1329-b3b9-4d1c-8735-abddabc359fd/disk"/>
Nov 29 18:04:30 user nova-compute[74613]:       <target dev="vda" bus="virtio"/>
Nov 29 18:04:30 user nova-compute[74613]:     </disk>
Nov 29 18:04:30 user nova-compute[74613]:     <interface type="ethernet">
Nov 29 18:04:30 user nova-compute[74613]:       <mac address="fa:16:3e:53:4e:1d"/>
Nov 29 18:04:30 user nova-compute[74613]:       <model type="virtio"/>
Nov 29 18:04:30 user nova-compute[74613]:       <mtu size="1442"/>
Nov 29 18:04:30 user nova-compute[74613]:       <target dev="tap6d82a9a2-81"/>
Nov 29 18:04:30 user nova-compute[74613]:     </interface>
Nov 29 18:04:30 user nova-compute[74613]:     <serial type="pty">
Nov 29 18:04:30 user nova-compute[74613]:       <log file="/opt/stack/data/nova/instances/6f4a1329-b3b9-4d1c-8735-abddabc359fd/console.log" append="off"/>
Nov 29 18:04:30 user nova-compute[74613]:     </serial>
Nov 29 18:04:30 user nova-compute[74613]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 29 18:04:30 user nova-compute[74613]:     <video>
Nov 29 18:04:30 user nova-compute[74613]:       <model type="virtio"/>
Nov 29 18:04:30 user nova-compute[74613]:     </video>
Nov 29 18:04:30 user nova-compute[74613]:     <rng model="virtio">
Nov 29 18:04:30 user nova-compute[74613]:       <backend model="random">/dev/urandom</backend>
Nov 29 18:04:30 user nova-compute[74613]:     </rng>
Nov 29 18:04:30 user nova-compute[74613]:     <controller type="usb" index="0" model="none"/>
Nov 29 18:04:30 user nova-compute[74613]:     <memballoon model="virtio">
Nov 29 18:04:30 user nova-compute[74613]:       <stats period="10"/>
Nov 29 18:04:30 user nova-compute[74613]:     </memballoon>
Nov 29 18:04:30 user nova-compute[74613]:   </devices>
Nov 29 18:04:30 user nova-compute[74613]: </domain>
Nov 29 18:04:30 user nova-compute[74613]:  {{(pid=74613) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 29 18:04:30 user nova-compute[74613]: DEBUG nova.virt.libvirt.vif [None req-27abc84e-78fb-4613-bf69-a6062abd2ab3 tempest-ServerRescueNegativeTestJSON-1891426908 tempest-ServerRescueNegativeTestJSON-1891426908-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T18:04:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1233675414',display_name='tempest-ServerRescueNegativeTestJSON-server-1233675414',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1233675414',id=29,image_ref='4217f428-8d9d-4ee1-9614-642d26d90c46',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e6a3eb6ea0294f9da705dca72ec2789a',ramdisk_id='',reservation_id='r-17bsbhc1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='4217f428-8d9d-4ee1-9614-642d26d90c46',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-1891426908',owner_user_name='tempest-ServerRescueNegativeTestJSON-1891426908-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T18:04:28Z,user_data=None,user_id='4e984d45838e441680b9948c213728fb',uuid=6f4a1329-b3b9-4d1c-8735-abddabc359fd,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6d82a9a2-81f2-4d4b-846e-178413db6ecf", "address": "fa:16:3e:53:4e:1d", "network": {"id": "db79433c-b21c-4058-b98c-f62822abbf7a", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1715530752-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e6a3eb6ea0294f9da705dca72ec2789a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6d82a9a2-81", "ovs_interfaceid": "6d82a9a2-81f2-4d4b-846e-178413db6ecf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74613) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 29 18:04:30 user nova-compute[74613]: DEBUG nova.network.os_vif_util [None req-27abc84e-78fb-4613-bf69-a6062abd2ab3 tempest-ServerRescueNegativeTestJSON-1891426908 tempest-ServerRescueNegativeTestJSON-1891426908-project-member] Converting VIF {"id": "6d82a9a2-81f2-4d4b-846e-178413db6ecf", "address": "fa:16:3e:53:4e:1d", "network": {"id": "db79433c-b21c-4058-b98c-f62822abbf7a", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1715530752-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e6a3eb6ea0294f9da705dca72ec2789a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6d82a9a2-81", "ovs_interfaceid": "6d82a9a2-81f2-4d4b-846e-178413db6ecf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74613) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 18:04:30 user nova-compute[74613]: DEBUG nova.network.os_vif_util [None req-27abc84e-78fb-4613-bf69-a6062abd2ab3 tempest-ServerRescueNegativeTestJSON-1891426908 tempest-ServerRescueNegativeTestJSON-1891426908-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:53:4e:1d,bridge_name='br-int',has_traffic_filtering=True,id=6d82a9a2-81f2-4d4b-846e-178413db6ecf,network=Network(db79433c-b21c-4058-b98c-f62822abbf7a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6d82a9a2-81') {{(pid=74613) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 18:04:30 user nova-compute[74613]: DEBUG os_vif [None req-27abc84e-78fb-4613-bf69-a6062abd2ab3 tempest-ServerRescueNegativeTestJSON-1891426908 tempest-ServerRescueNegativeTestJSON-1891426908-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:53:4e:1d,bridge_name='br-int',has_traffic_filtering=True,id=6d82a9a2-81f2-4d4b-846e-178413db6ecf,network=Network(db79433c-b21c-4058-b98c-f62822abbf7a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6d82a9a2-81') {{(pid=74613) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 29 18:04:30 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:04:30 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74613) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 18:04:30 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74613) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 29 18:04:30 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:04:30 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '30f335a0-f1fa-5190-bd8b-52c9e37a5e2f', '_type': 'linux-noop'}}, row=False) {{(pid=74613) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 18:04:30 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:04:30 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 18:04:30 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:04:30 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:04:30 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap6d82a9a2-81, may_exist=True, interface_attrs={}) {{(pid=74613) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 18:04:30 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap6d82a9a2-81, col_values=(('qos', UUID('60bad99e-602d-4a60-9cb8-65fa47fb1f40')),), if_exists=True) {{(pid=74613) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 18:04:30 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap6d82a9a2-81, col_values=(('external_ids', {'iface-id': '6d82a9a2-81f2-4d4b-846e-178413db6ecf', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:53:4e:1d', 'vm-uuid': '6f4a1329-b3b9-4d1c-8735-abddabc359fd'}),), if_exists=True) {{(pid=74613) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 18:04:30 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:04:30 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 18:04:30 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:04:30 user nova-compute[74613]: INFO os_vif [None req-27abc84e-78fb-4613-bf69-a6062abd2ab3 tempest-ServerRescueNegativeTestJSON-1891426908 tempest-ServerRescueNegativeTestJSON-1891426908-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:53:4e:1d,bridge_name='br-int',has_traffic_filtering=True,id=6d82a9a2-81f2-4d4b-846e-178413db6ecf,network=Network(db79433c-b21c-4058-b98c-f62822abbf7a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6d82a9a2-81')
Nov 29 18:04:30 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-27abc84e-78fb-4613-bf69-a6062abd2ab3 tempest-ServerRescueNegativeTestJSON-1891426908 tempest-ServerRescueNegativeTestJSON-1891426908-project-member] No BDM found with device name vda, not building metadata. {{(pid=74613) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 18:04:30 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-27abc84e-78fb-4613-bf69-a6062abd2ab3 tempest-ServerRescueNegativeTestJSON-1891426908 tempest-ServerRescueNegativeTestJSON-1891426908-project-member] No VIF found with MAC fa:16:3e:53:4e:1d, not building metadata {{(pid=74613) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 29 18:04:30 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:04:30 user nova-compute[74613]: DEBUG nova.network.neutron [req-51255546-4454-4354-ac12-c41fbe7cb298 req-3c83cabf-04d7-4572-ad31-655a5b2e299e service nova] [instance: 6f4a1329-b3b9-4d1c-8735-abddabc359fd] Updated VIF entry in instance network info cache for port 6d82a9a2-81f2-4d4b-846e-178413db6ecf. {{(pid=74613) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 18:04:30 user nova-compute[74613]: DEBUG nova.network.neutron [req-51255546-4454-4354-ac12-c41fbe7cb298 req-3c83cabf-04d7-4572-ad31-655a5b2e299e service nova] [instance: 6f4a1329-b3b9-4d1c-8735-abddabc359fd] Updating instance_info_cache with network_info: [{"id": "6d82a9a2-81f2-4d4b-846e-178413db6ecf", "address": "fa:16:3e:53:4e:1d", "network": {"id": "db79433c-b21c-4058-b98c-f62822abbf7a", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1715530752-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e6a3eb6ea0294f9da705dca72ec2789a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6d82a9a2-81", "ovs_interfaceid": "6d82a9a2-81f2-4d4b-846e-178413db6ecf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74613) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 18:04:30 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-51255546-4454-4354-ac12-c41fbe7cb298 req-3c83cabf-04d7-4572-ad31-655a5b2e299e service nova] Releasing lock "refresh_cache-6f4a1329-b3b9-4d1c-8735-abddabc359fd" {{(pid=74613) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 18:04:30 user nova-compute[74613]: DEBUG nova.network.neutron [-] [instance: f9be53df-54e6-4f59-9cef-0ba7434f0c29] Updating instance_info_cache with network_info: [] {{(pid=74613) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 18:04:30 user nova-compute[74613]: INFO nova.compute.manager [-] [instance: f9be53df-54e6-4f59-9cef-0ba7434f0c29] Took 1.54 seconds to deallocate network for instance.
Nov 29 18:04:30 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-aa622d18-654d-4700-885d-f7e5dda34b2b tempest-AttachVolumeShelveTestJSON-1452861425 tempest-AttachVolumeShelveTestJSON-1452861425-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 18:04:30 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-aa622d18-654d-4700-885d-f7e5dda34b2b tempest-AttachVolumeShelveTestJSON-1452861425 tempest-AttachVolumeShelveTestJSON-1452861425-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 18:04:30 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:04:30 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:04:30 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:04:31 user nova-compute[74613]: DEBUG nova.compute.manager [req-c72b1727-1a4b-4cd6-bbce-b89ff043f5c3 req-b849867b-f551-409a-a3ba-ca14a3e7c664 service nova] [instance: 6993e2e7-7e03-45b4-9d3d-3742589b6078] Received event network-vif-plugged-5216b7ab-6e2b-4d7f-8c7f-e52b03d282b9 {{(pid=74613) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 18:04:31 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-c72b1727-1a4b-4cd6-bbce-b89ff043f5c3 req-b849867b-f551-409a-a3ba-ca14a3e7c664 service nova] Acquiring lock "6993e2e7-7e03-45b4-9d3d-3742589b6078-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 18:04:31 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-c72b1727-1a4b-4cd6-bbce-b89ff043f5c3 req-b849867b-f551-409a-a3ba-ca14a3e7c664 service nova] Lock "6993e2e7-7e03-45b4-9d3d-3742589b6078-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 18:04:31 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-c72b1727-1a4b-4cd6-bbce-b89ff043f5c3 req-b849867b-f551-409a-a3ba-ca14a3e7c664 service nova] Lock "6993e2e7-7e03-45b4-9d3d-3742589b6078-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 18:04:31 user nova-compute[74613]: DEBUG nova.compute.manager [req-c72b1727-1a4b-4cd6-bbce-b89ff043f5c3 req-b849867b-f551-409a-a3ba-ca14a3e7c664 service nova] [instance: 6993e2e7-7e03-45b4-9d3d-3742589b6078] No waiting events found dispatching network-vif-plugged-5216b7ab-6e2b-4d7f-8c7f-e52b03d282b9 {{(pid=74613) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 18:04:31 user nova-compute[74613]: WARNING nova.compute.manager [req-c72b1727-1a4b-4cd6-bbce-b89ff043f5c3 req-b849867b-f551-409a-a3ba-ca14a3e7c664 service nova] [instance: 6993e2e7-7e03-45b4-9d3d-3742589b6078] Received unexpected event network-vif-plugged-5216b7ab-6e2b-4d7f-8c7f-e52b03d282b9 for instance with vm_state building and task_state spawning.
Nov 29 18:04:31 user nova-compute[74613]: DEBUG nova.compute.provider_tree [None req-aa622d18-654d-4700-885d-f7e5dda34b2b tempest-AttachVolumeShelveTestJSON-1452861425 tempest-AttachVolumeShelveTestJSON-1452861425-project-member] Inventory has not changed in ProviderTree for provider: 639d980e-3b12-44b1-b8f4-1812416fa4dd {{(pid=74613) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 18:04:31 user nova-compute[74613]: DEBUG nova.scheduler.client.report [None req-aa622d18-654d-4700-885d-f7e5dda34b2b tempest-AttachVolumeShelveTestJSON-1452861425 tempest-AttachVolumeShelveTestJSON-1452861425-project-member] Inventory has not changed for provider 639d980e-3b12-44b1-b8f4-1812416fa4dd based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74613) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 18:04:31 user nova-compute[74613]: DEBUG nova.compute.manager [req-893c789f-fce1-4f2f-b7a3-415f0236f4ae req-46bae692-6b45-47ac-9afd-7509e02523ef service nova] [instance: f9be53df-54e6-4f59-9cef-0ba7434f0c29] Received event network-vif-plugged-175b56ab-750b-4dbf-a981-2a32d749d445 {{(pid=74613) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 18:04:31 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-893c789f-fce1-4f2f-b7a3-415f0236f4ae req-46bae692-6b45-47ac-9afd-7509e02523ef service nova] Acquiring lock "f9be53df-54e6-4f59-9cef-0ba7434f0c29-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 18:04:31 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-893c789f-fce1-4f2f-b7a3-415f0236f4ae req-46bae692-6b45-47ac-9afd-7509e02523ef service nova] Lock "f9be53df-54e6-4f59-9cef-0ba7434f0c29-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 18:04:31 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-893c789f-fce1-4f2f-b7a3-415f0236f4ae req-46bae692-6b45-47ac-9afd-7509e02523ef service nova] Lock "f9be53df-54e6-4f59-9cef-0ba7434f0c29-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 18:04:31 user nova-compute[74613]: DEBUG nova.compute.manager [req-893c789f-fce1-4f2f-b7a3-415f0236f4ae req-46bae692-6b45-47ac-9afd-7509e02523ef service nova] [instance: f9be53df-54e6-4f59-9cef-0ba7434f0c29] No waiting events found dispatching network-vif-plugged-175b56ab-750b-4dbf-a981-2a32d749d445 {{(pid=74613) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 18:04:31 user nova-compute[74613]: WARNING nova.compute.manager [req-893c789f-fce1-4f2f-b7a3-415f0236f4ae req-46bae692-6b45-47ac-9afd-7509e02523ef service nova] [instance: f9be53df-54e6-4f59-9cef-0ba7434f0c29] Received unexpected event network-vif-plugged-175b56ab-750b-4dbf-a981-2a32d749d445 for instance with vm_state deleted and task_state None.
Nov 29 18:04:31 user nova-compute[74613]: DEBUG nova.compute.manager [req-893c789f-fce1-4f2f-b7a3-415f0236f4ae req-46bae692-6b45-47ac-9afd-7509e02523ef service nova] [instance: f9be53df-54e6-4f59-9cef-0ba7434f0c29] Received event network-vif-deleted-175b56ab-750b-4dbf-a981-2a32d749d445 {{(pid=74613) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 18:04:31 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-aa622d18-654d-4700-885d-f7e5dda34b2b tempest-AttachVolumeShelveTestJSON-1452861425 tempest-AttachVolumeShelveTestJSON-1452861425-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.559s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 18:04:31 user nova-compute[74613]: INFO nova.scheduler.client.report [None req-aa622d18-654d-4700-885d-f7e5dda34b2b tempest-AttachVolumeShelveTestJSON-1452861425 tempest-AttachVolumeShelveTestJSON-1452861425-project-member] Deleted allocations for instance f9be53df-54e6-4f59-9cef-0ba7434f0c29
Nov 29 18:04:31 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-aa622d18-654d-4700-885d-f7e5dda34b2b tempest-AttachVolumeShelveTestJSON-1452861425 tempest-AttachVolumeShelveTestJSON-1452861425-project-member] Lock "f9be53df-54e6-4f59-9cef-0ba7434f0c29" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.417s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 18:04:31 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:04:31 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:04:31 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:04:31 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:04:32 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:04:32 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:04:32 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:04:32 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:04:32 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:04:33 user nova-compute[74613]: DEBUG nova.compute.manager [req-7a2e29b8-b73a-4745-8702-0771572d5536 req-6846f0c3-97b4-413a-acb7-3cb584dc38e0 service nova] [instance: 6993e2e7-7e03-45b4-9d3d-3742589b6078] Received event network-vif-plugged-5216b7ab-6e2b-4d7f-8c7f-e52b03d282b9 {{(pid=74613) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 18:04:33 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-7a2e29b8-b73a-4745-8702-0771572d5536 req-6846f0c3-97b4-413a-acb7-3cb584dc38e0 service nova] Acquiring lock "6993e2e7-7e03-45b4-9d3d-3742589b6078-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 18:04:33 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-7a2e29b8-b73a-4745-8702-0771572d5536 req-6846f0c3-97b4-413a-acb7-3cb584dc38e0 service nova] Lock "6993e2e7-7e03-45b4-9d3d-3742589b6078-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 18:04:33 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-7a2e29b8-b73a-4745-8702-0771572d5536 req-6846f0c3-97b4-413a-acb7-3cb584dc38e0 service nova] Lock "6993e2e7-7e03-45b4-9d3d-3742589b6078-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 18:04:33 user nova-compute[74613]: DEBUG nova.compute.manager [req-7a2e29b8-b73a-4745-8702-0771572d5536 req-6846f0c3-97b4-413a-acb7-3cb584dc38e0 service nova] [instance: 6993e2e7-7e03-45b4-9d3d-3742589b6078] No waiting events found dispatching network-vif-plugged-5216b7ab-6e2b-4d7f-8c7f-e52b03d282b9 {{(pid=74613) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 18:04:33 user nova-compute[74613]: WARNING nova.compute.manager [req-7a2e29b8-b73a-4745-8702-0771572d5536 req-6846f0c3-97b4-413a-acb7-3cb584dc38e0 service nova] [instance: 6993e2e7-7e03-45b4-9d3d-3742589b6078] Received unexpected event network-vif-plugged-5216b7ab-6e2b-4d7f-8c7f-e52b03d282b9 for instance with vm_state building and task_state spawning.
Nov 29 18:04:33 user nova-compute[74613]: DEBUG nova.compute.manager [req-5d237bab-c4c8-4de3-af55-9299cdc8d768 req-d437b350-0929-447a-a4d8-61cb44769d81 service nova] [instance: 6f4a1329-b3b9-4d1c-8735-abddabc359fd] Received event network-vif-plugged-6d82a9a2-81f2-4d4b-846e-178413db6ecf {{(pid=74613) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 18:04:33 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-5d237bab-c4c8-4de3-af55-9299cdc8d768 req-d437b350-0929-447a-a4d8-61cb44769d81 service nova] Acquiring lock "6f4a1329-b3b9-4d1c-8735-abddabc359fd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 18:04:33 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-5d237bab-c4c8-4de3-af55-9299cdc8d768 req-d437b350-0929-447a-a4d8-61cb44769d81 service nova] Lock "6f4a1329-b3b9-4d1c-8735-abddabc359fd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 18:04:33 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-5d237bab-c4c8-4de3-af55-9299cdc8d768 req-d437b350-0929-447a-a4d8-61cb44769d81 service nova] Lock "6f4a1329-b3b9-4d1c-8735-abddabc359fd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 18:04:33 user nova-compute[74613]: DEBUG nova.compute.manager [req-5d237bab-c4c8-4de3-af55-9299cdc8d768 req-d437b350-0929-447a-a4d8-61cb44769d81 service nova] [instance: 6f4a1329-b3b9-4d1c-8735-abddabc359fd] No waiting events found dispatching network-vif-plugged-6d82a9a2-81f2-4d4b-846e-178413db6ecf {{(pid=74613) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 18:04:33 user nova-compute[74613]: WARNING nova.compute.manager [req-5d237bab-c4c8-4de3-af55-9299cdc8d768 req-d437b350-0929-447a-a4d8-61cb44769d81 service nova] [instance: 6f4a1329-b3b9-4d1c-8735-abddabc359fd] Received unexpected event network-vif-plugged-6d82a9a2-81f2-4d4b-846e-178413db6ecf for instance with vm_state building and task_state spawning.
Nov 29 18:04:33 user nova-compute[74613]: DEBUG nova.compute.manager [req-5d237bab-c4c8-4de3-af55-9299cdc8d768 req-d437b350-0929-447a-a4d8-61cb44769d81 service nova] [instance: 6f4a1329-b3b9-4d1c-8735-abddabc359fd] Received event network-vif-plugged-6d82a9a2-81f2-4d4b-846e-178413db6ecf {{(pid=74613) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 18:04:33 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-5d237bab-c4c8-4de3-af55-9299cdc8d768 req-d437b350-0929-447a-a4d8-61cb44769d81 service nova] Acquiring lock "6f4a1329-b3b9-4d1c-8735-abddabc359fd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 18:04:33 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-5d237bab-c4c8-4de3-af55-9299cdc8d768 req-d437b350-0929-447a-a4d8-61cb44769d81 service nova] Lock "6f4a1329-b3b9-4d1c-8735-abddabc359fd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 18:04:33 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-5d237bab-c4c8-4de3-af55-9299cdc8d768 req-d437b350-0929-447a-a4d8-61cb44769d81 service nova] Lock "6f4a1329-b3b9-4d1c-8735-abddabc359fd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 18:04:33 user nova-compute[74613]: DEBUG nova.compute.manager [req-5d237bab-c4c8-4de3-af55-9299cdc8d768 req-d437b350-0929-447a-a4d8-61cb44769d81 service nova] [instance: 6f4a1329-b3b9-4d1c-8735-abddabc359fd] No waiting events found dispatching network-vif-plugged-6d82a9a2-81f2-4d4b-846e-178413db6ecf {{(pid=74613) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 18:04:33 user nova-compute[74613]: WARNING nova.compute.manager [req-5d237bab-c4c8-4de3-af55-9299cdc8d768 req-d437b350-0929-447a-a4d8-61cb44769d81 service nova] [instance: 6f4a1329-b3b9-4d1c-8735-abddabc359fd] Received unexpected event network-vif-plugged-6d82a9a2-81f2-4d4b-846e-178413db6ecf for instance with vm_state building and task_state spawning.
Nov 29 18:04:34 user nova-compute[74613]: DEBUG nova.compute.manager [None req-23557d9f-f23b-4650-a063-667e4e235412 tempest-ServerRescueNegativeTestJSON-1891426908 tempest-ServerRescueNegativeTestJSON-1891426908-project-member] [instance: 6993e2e7-7e03-45b4-9d3d-3742589b6078] Instance event wait completed in 0 seconds for  {{(pid=74613) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 29 18:04:34 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-23557d9f-f23b-4650-a063-667e4e235412 tempest-ServerRescueNegativeTestJSON-1891426908 tempest-ServerRescueNegativeTestJSON-1891426908-project-member] [instance: 6993e2e7-7e03-45b4-9d3d-3742589b6078] Guest created on hypervisor {{(pid=74613) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 29 18:04:34 user nova-compute[74613]: INFO nova.virt.libvirt.driver [-] [instance: 6993e2e7-7e03-45b4-9d3d-3742589b6078] Instance spawned successfully.
Nov 29 18:04:34 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-23557d9f-f23b-4650-a063-667e4e235412 tempest-ServerRescueNegativeTestJSON-1891426908 tempest-ServerRescueNegativeTestJSON-1891426908-project-member] [instance: 6993e2e7-7e03-45b4-9d3d-3742589b6078] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74613) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 29 18:04:34 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-23557d9f-f23b-4650-a063-667e4e235412 tempest-ServerRescueNegativeTestJSON-1891426908 tempest-ServerRescueNegativeTestJSON-1891426908-project-member] [instance: 6993e2e7-7e03-45b4-9d3d-3742589b6078] Found default for hw_cdrom_bus of ide {{(pid=74613) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 18:04:34 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-23557d9f-f23b-4650-a063-667e4e235412 tempest-ServerRescueNegativeTestJSON-1891426908 tempest-ServerRescueNegativeTestJSON-1891426908-project-member] [instance: 6993e2e7-7e03-45b4-9d3d-3742589b6078] Found default for hw_disk_bus of virtio {{(pid=74613) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 18:04:34 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-23557d9f-f23b-4650-a063-667e4e235412 tempest-ServerRescueNegativeTestJSON-1891426908 tempest-ServerRescueNegativeTestJSON-1891426908-project-member] [instance: 6993e2e7-7e03-45b4-9d3d-3742589b6078] Found default for hw_input_bus of None {{(pid=74613) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 18:04:34 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-23557d9f-f23b-4650-a063-667e4e235412 tempest-ServerRescueNegativeTestJSON-1891426908 tempest-ServerRescueNegativeTestJSON-1891426908-project-member] [instance: 6993e2e7-7e03-45b4-9d3d-3742589b6078] Found default for hw_pointer_model of None {{(pid=74613) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 18:04:34 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-23557d9f-f23b-4650-a063-667e4e235412 tempest-ServerRescueNegativeTestJSON-1891426908 tempest-ServerRescueNegativeTestJSON-1891426908-project-member] [instance: 6993e2e7-7e03-45b4-9d3d-3742589b6078] Found default for hw_video_model of virtio {{(pid=74613) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 18:04:34 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-23557d9f-f23b-4650-a063-667e4e235412 tempest-ServerRescueNegativeTestJSON-1891426908 tempest-ServerRescueNegativeTestJSON-1891426908-project-member] [instance: 6993e2e7-7e03-45b4-9d3d-3742589b6078] Found default for hw_vif_model of virtio {{(pid=74613) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 18:04:34 user nova-compute[74613]: DEBUG nova.compute.manager [None req-27abc84e-78fb-4613-bf69-a6062abd2ab3 tempest-ServerRescueNegativeTestJSON-1891426908 tempest-ServerRescueNegativeTestJSON-1891426908-project-member] [instance: 6f4a1329-b3b9-4d1c-8735-abddabc359fd] Instance event wait completed in 0 seconds for  {{(pid=74613) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 29 18:04:34 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-27abc84e-78fb-4613-bf69-a6062abd2ab3 tempest-ServerRescueNegativeTestJSON-1891426908 tempest-ServerRescueNegativeTestJSON-1891426908-project-member] [instance: 6f4a1329-b3b9-4d1c-8735-abddabc359fd] Guest created on hypervisor {{(pid=74613) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 29 18:04:34 user nova-compute[74613]: INFO nova.compute.manager [None req-23557d9f-f23b-4650-a063-667e4e235412 tempest-ServerRescueNegativeTestJSON-1891426908 tempest-ServerRescueNegativeTestJSON-1891426908-project-member] [instance: 6993e2e7-7e03-45b4-9d3d-3742589b6078] Took 7.97 seconds to spawn the instance on the hypervisor.
Nov 29 18:04:34 user nova-compute[74613]: DEBUG nova.compute.manager [None req-23557d9f-f23b-4650-a063-667e4e235412 tempest-ServerRescueNegativeTestJSON-1891426908 tempest-ServerRescueNegativeTestJSON-1891426908-project-member] [instance: 6993e2e7-7e03-45b4-9d3d-3742589b6078] Checking state {{(pid=74613) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 29 18:04:34 user nova-compute[74613]: INFO nova.virt.libvirt.driver [-] [instance: 6f4a1329-b3b9-4d1c-8735-abddabc359fd] Instance spawned successfully.
Nov 29 18:04:34 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-27abc84e-78fb-4613-bf69-a6062abd2ab3 tempest-ServerRescueNegativeTestJSON-1891426908 tempest-ServerRescueNegativeTestJSON-1891426908-project-member] [instance: 6f4a1329-b3b9-4d1c-8735-abddabc359fd] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74613) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 29 18:04:34 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-27abc84e-78fb-4613-bf69-a6062abd2ab3 tempest-ServerRescueNegativeTestJSON-1891426908 tempest-ServerRescueNegativeTestJSON-1891426908-project-member] [instance: 6f4a1329-b3b9-4d1c-8735-abddabc359fd] Found default for hw_cdrom_bus of ide {{(pid=74613) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 18:04:34 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-27abc84e-78fb-4613-bf69-a6062abd2ab3 tempest-ServerRescueNegativeTestJSON-1891426908 tempest-ServerRescueNegativeTestJSON-1891426908-project-member] [instance: 6f4a1329-b3b9-4d1c-8735-abddabc359fd] Found default for hw_disk_bus of virtio {{(pid=74613) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 18:04:34 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-27abc84e-78fb-4613-bf69-a6062abd2ab3 tempest-ServerRescueNegativeTestJSON-1891426908 tempest-ServerRescueNegativeTestJSON-1891426908-project-member] [instance: 6f4a1329-b3b9-4d1c-8735-abddabc359fd] Found default for hw_input_bus of None {{(pid=74613) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 18:04:34 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-27abc84e-78fb-4613-bf69-a6062abd2ab3 tempest-ServerRescueNegativeTestJSON-1891426908 tempest-ServerRescueNegativeTestJSON-1891426908-project-member] [instance: 6f4a1329-b3b9-4d1c-8735-abddabc359fd] Found default for hw_pointer_model of None {{(pid=74613) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 18:04:34 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-27abc84e-78fb-4613-bf69-a6062abd2ab3 tempest-ServerRescueNegativeTestJSON-1891426908 tempest-ServerRescueNegativeTestJSON-1891426908-project-member] [instance: 6f4a1329-b3b9-4d1c-8735-abddabc359fd] Found default for hw_video_model of virtio {{(pid=74613) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 18:04:34 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-27abc84e-78fb-4613-bf69-a6062abd2ab3 tempest-ServerRescueNegativeTestJSON-1891426908 tempest-ServerRescueNegativeTestJSON-1891426908-project-member] [instance: 6f4a1329-b3b9-4d1c-8735-abddabc359fd] Found default for hw_vif_model of virtio {{(pid=74613) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 18:04:34 user nova-compute[74613]: INFO nova.compute.manager [None req-23557d9f-f23b-4650-a063-667e4e235412 tempest-ServerRescueNegativeTestJSON-1891426908 tempest-ServerRescueNegativeTestJSON-1891426908-project-member] [instance: 6993e2e7-7e03-45b4-9d3d-3742589b6078] Took 8.86 seconds to build instance.
Nov 29 18:04:34 user nova-compute[74613]: INFO nova.compute.manager [None req-27abc84e-78fb-4613-bf69-a6062abd2ab3 tempest-ServerRescueNegativeTestJSON-1891426908 tempest-ServerRescueNegativeTestJSON-1891426908-project-member] [instance: 6f4a1329-b3b9-4d1c-8735-abddabc359fd] Took 6.82 seconds to spawn the instance on the hypervisor.
Nov 29 18:04:34 user nova-compute[74613]: DEBUG nova.compute.manager [None req-27abc84e-78fb-4613-bf69-a6062abd2ab3 tempest-ServerRescueNegativeTestJSON-1891426908 tempest-ServerRescueNegativeTestJSON-1891426908-project-member] [instance: 6f4a1329-b3b9-4d1c-8735-abddabc359fd] Checking state {{(pid=74613) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 29 18:04:34 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-23557d9f-f23b-4650-a063-667e4e235412 tempest-ServerRescueNegativeTestJSON-1891426908 tempest-ServerRescueNegativeTestJSON-1891426908-project-member] Lock "6993e2e7-7e03-45b4-9d3d-3742589b6078" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 9.010s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 18:04:34 user nova-compute[74613]: INFO nova.compute.manager [None req-27abc84e-78fb-4613-bf69-a6062abd2ab3 tempest-ServerRescueNegativeTestJSON-1891426908 tempest-ServerRescueNegativeTestJSON-1891426908-project-member] [instance: 6f4a1329-b3b9-4d1c-8735-abddabc359fd] Took 8.21 seconds to build instance.
Nov 29 18:04:34 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-27abc84e-78fb-4613-bf69-a6062abd2ab3 tempest-ServerRescueNegativeTestJSON-1891426908 tempest-ServerRescueNegativeTestJSON-1891426908-project-member] Lock "6f4a1329-b3b9-4d1c-8735-abddabc359fd" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.321s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 18:04:35 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:04:35 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:04:39 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-126438d6-5067-4d77-ae09-1a687e592859 tempest-ServersNegativeTestJSON-1631676891 tempest-ServersNegativeTestJSON-1631676891-project-member] Acquiring lock "c4bdb712-e1f9-4fc0-b527-87088d7eddf8" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 18:04:39 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-126438d6-5067-4d77-ae09-1a687e592859 tempest-ServersNegativeTestJSON-1631676891 tempest-ServersNegativeTestJSON-1631676891-project-member] Lock "c4bdb712-e1f9-4fc0-b527-87088d7eddf8" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 18:04:39 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-126438d6-5067-4d77-ae09-1a687e592859 tempest-ServersNegativeTestJSON-1631676891 tempest-ServersNegativeTestJSON-1631676891-project-member] Acquiring lock "c4bdb712-e1f9-4fc0-b527-87088d7eddf8-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 18:04:39 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-126438d6-5067-4d77-ae09-1a687e592859 tempest-ServersNegativeTestJSON-1631676891 tempest-ServersNegativeTestJSON-1631676891-project-member] Lock "c4bdb712-e1f9-4fc0-b527-87088d7eddf8-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 18:04:39 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-126438d6-5067-4d77-ae09-1a687e592859 tempest-ServersNegativeTestJSON-1631676891 tempest-ServersNegativeTestJSON-1631676891-project-member] Lock "c4bdb712-e1f9-4fc0-b527-87088d7eddf8-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 18:04:39 user nova-compute[74613]: INFO nova.compute.manager [None req-126438d6-5067-4d77-ae09-1a687e592859 tempest-ServersNegativeTestJSON-1631676891 tempest-ServersNegativeTestJSON-1631676891-project-member] [instance: c4bdb712-e1f9-4fc0-b527-87088d7eddf8] Terminating instance
Nov 29 18:04:39 user nova-compute[74613]: DEBUG nova.compute.manager [None req-126438d6-5067-4d77-ae09-1a687e592859 tempest-ServersNegativeTestJSON-1631676891 tempest-ServersNegativeTestJSON-1631676891-project-member] [instance: c4bdb712-e1f9-4fc0-b527-87088d7eddf8] Start destroying the instance on the hypervisor. {{(pid=74613) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 29 18:04:39 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:04:39 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:04:39 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:04:39 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:04:39 user nova-compute[74613]: DEBUG nova.compute.manager [req-60889763-48c5-4211-b99e-e2583bff0a53 req-bfb8d1a6-73fa-4cb3-90ee-af92d94e1964 service nova] [instance: c4bdb712-e1f9-4fc0-b527-87088d7eddf8] Received event network-vif-unplugged-1261dd8b-2514-475b-bbbc-7a83ce22c7c0 {{(pid=74613) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 18:04:39 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-60889763-48c5-4211-b99e-e2583bff0a53 req-bfb8d1a6-73fa-4cb3-90ee-af92d94e1964 service nova] Acquiring lock "c4bdb712-e1f9-4fc0-b527-87088d7eddf8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 18:04:39 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-60889763-48c5-4211-b99e-e2583bff0a53 req-bfb8d1a6-73fa-4cb3-90ee-af92d94e1964 service nova] Lock "c4bdb712-e1f9-4fc0-b527-87088d7eddf8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 18:04:39 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-60889763-48c5-4211-b99e-e2583bff0a53 req-bfb8d1a6-73fa-4cb3-90ee-af92d94e1964 service nova] Lock "c4bdb712-e1f9-4fc0-b527-87088d7eddf8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 18:04:39 user nova-compute[74613]: DEBUG nova.compute.manager [req-60889763-48c5-4211-b99e-e2583bff0a53 req-bfb8d1a6-73fa-4cb3-90ee-af92d94e1964 service nova] [instance: c4bdb712-e1f9-4fc0-b527-87088d7eddf8] No waiting events found dispatching network-vif-unplugged-1261dd8b-2514-475b-bbbc-7a83ce22c7c0 {{(pid=74613) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 18:04:39 user nova-compute[74613]: DEBUG nova.compute.manager [req-60889763-48c5-4211-b99e-e2583bff0a53 req-bfb8d1a6-73fa-4cb3-90ee-af92d94e1964 service nova] [instance: c4bdb712-e1f9-4fc0-b527-87088d7eddf8] Received event network-vif-unplugged-1261dd8b-2514-475b-bbbc-7a83ce22c7c0 for instance with task_state deleting. {{(pid=74613) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 29 18:04:40 user nova-compute[74613]: INFO nova.virt.libvirt.driver [-] [instance: c4bdb712-e1f9-4fc0-b527-87088d7eddf8] Instance destroyed successfully.
Nov 29 18:04:40 user nova-compute[74613]: DEBUG nova.objects.instance [None req-126438d6-5067-4d77-ae09-1a687e592859 tempest-ServersNegativeTestJSON-1631676891 tempest-ServersNegativeTestJSON-1631676891-project-member] Lazy-loading 'resources' on Instance uuid c4bdb712-e1f9-4fc0-b527-87088d7eddf8 {{(pid=74613) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 18:04:40 user nova-compute[74613]: DEBUG nova.virt.libvirt.vif [None req-126438d6-5067-4d77-ae09-1a687e592859 tempest-ServersNegativeTestJSON-1631676891 tempest-ServersNegativeTestJSON-1631676891-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T17:55:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-611902795',display_name='tempest-ServersNegativeTestJSON-server-611902795',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-611902795',id=15,image_ref='4217f428-8d9d-4ee1-9614-642d26d90c46',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-29T17:55:55Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='68aabefe0c4340ce8408e386748fa0cf',ramdisk_id='',reservation_id='r-61eegonr',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='4217f428-8d9d-4ee1-9614-642d26d90c46',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServersNegativeTestJSON-1631676891',owner_user_name='tempest-ServersNegativeTestJSON-1631676891-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-29T17:55:55Z,user_data=None,user_id='4b4c259dfbf244c6b48374ab04e6d694',uuid=c4bdb712-e1f9-4fc0-b527-87088d7eddf8,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "1261dd8b-2514-475b-bbbc-7a83ce22c7c0", "address": "fa:16:3e:7f:98:93", "network": {"id": "4d31e03e-697a-44c2-a03e-77eed3dbce43", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-629140279-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "68aabefe0c4340ce8408e386748fa0cf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1261dd8b-25", "ovs_interfaceid": "1261dd8b-2514-475b-bbbc-7a83ce22c7c0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74613) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 29 18:04:40 user nova-compute[74613]: DEBUG nova.network.os_vif_util [None req-126438d6-5067-4d77-ae09-1a687e592859 tempest-ServersNegativeTestJSON-1631676891 tempest-ServersNegativeTestJSON-1631676891-project-member] Converting VIF {"id": "1261dd8b-2514-475b-bbbc-7a83ce22c7c0", "address": "fa:16:3e:7f:98:93", "network": {"id": "4d31e03e-697a-44c2-a03e-77eed3dbce43", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-629140279-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "68aabefe0c4340ce8408e386748fa0cf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1261dd8b-25", "ovs_interfaceid": "1261dd8b-2514-475b-bbbc-7a83ce22c7c0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74613) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 18:04:40 user nova-compute[74613]: DEBUG nova.network.os_vif_util [None req-126438d6-5067-4d77-ae09-1a687e592859 tempest-ServersNegativeTestJSON-1631676891 tempest-ServersNegativeTestJSON-1631676891-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:7f:98:93,bridge_name='br-int',has_traffic_filtering=True,id=1261dd8b-2514-475b-bbbc-7a83ce22c7c0,network=Network(4d31e03e-697a-44c2-a03e-77eed3dbce43),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1261dd8b-25') {{(pid=74613) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 18:04:40 user nova-compute[74613]: DEBUG os_vif [None req-126438d6-5067-4d77-ae09-1a687e592859 tempest-ServersNegativeTestJSON-1631676891 tempest-ServersNegativeTestJSON-1631676891-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:7f:98:93,bridge_name='br-int',has_traffic_filtering=True,id=1261dd8b-2514-475b-bbbc-7a83ce22c7c0,network=Network(4d31e03e-697a-44c2-a03e-77eed3dbce43),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1261dd8b-25') {{(pid=74613) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 29 18:04:40 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:04:40 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap1261dd8b-25, bridge=br-int, if_exists=True) {{(pid=74613) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 18:04:40 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:04:40 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:04:40 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:04:40 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=a6c2dbdb-753d-4b2c-9479-539fecf79f71) {{(pid=74613) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 18:04:40 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:04:40 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 18:04:40 user nova-compute[74613]: INFO os_vif [None req-126438d6-5067-4d77-ae09-1a687e592859 tempest-ServersNegativeTestJSON-1631676891 tempest-ServersNegativeTestJSON-1631676891-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:7f:98:93,bridge_name='br-int',has_traffic_filtering=True,id=1261dd8b-2514-475b-bbbc-7a83ce22c7c0,network=Network(4d31e03e-697a-44c2-a03e-77eed3dbce43),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1261dd8b-25')
Nov 29 18:04:40 user nova-compute[74613]: INFO nova.virt.libvirt.driver [None req-126438d6-5067-4d77-ae09-1a687e592859 tempest-ServersNegativeTestJSON-1631676891 tempest-ServersNegativeTestJSON-1631676891-project-member] [instance: c4bdb712-e1f9-4fc0-b527-87088d7eddf8] Deleting instance files /opt/stack/data/nova/instances/c4bdb712-e1f9-4fc0-b527-87088d7eddf8_del
Nov 29 18:04:40 user nova-compute[74613]: INFO nova.virt.libvirt.driver [None req-126438d6-5067-4d77-ae09-1a687e592859 tempest-ServersNegativeTestJSON-1631676891 tempest-ServersNegativeTestJSON-1631676891-project-member] [instance: c4bdb712-e1f9-4fc0-b527-87088d7eddf8] Deletion of /opt/stack/data/nova/instances/c4bdb712-e1f9-4fc0-b527-87088d7eddf8_del complete
Nov 29 18:04:40 user nova-compute[74613]: INFO nova.compute.manager [None req-126438d6-5067-4d77-ae09-1a687e592859 tempest-ServersNegativeTestJSON-1631676891 tempest-ServersNegativeTestJSON-1631676891-project-member] [instance: c4bdb712-e1f9-4fc0-b527-87088d7eddf8] Took 1.01 seconds to destroy the instance on the hypervisor.
Nov 29 18:04:40 user nova-compute[74613]: DEBUG oslo.service.loopingcall [None req-126438d6-5067-4d77-ae09-1a687e592859 tempest-ServersNegativeTestJSON-1631676891 tempest-ServersNegativeTestJSON-1631676891-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74613) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 29 18:04:40 user nova-compute[74613]: DEBUG nova.compute.manager [-] [instance: c4bdb712-e1f9-4fc0-b527-87088d7eddf8] Deallocating network for instance {{(pid=74613) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 29 18:04:40 user nova-compute[74613]: DEBUG nova.network.neutron [-] [instance: c4bdb712-e1f9-4fc0-b527-87088d7eddf8] deallocate_for_instance() {{(pid=74613) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 29 18:04:40 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:04:40 user nova-compute[74613]: DEBUG nova.network.neutron [-] [instance: c4bdb712-e1f9-4fc0-b527-87088d7eddf8] Updating instance_info_cache with network_info: [] {{(pid=74613) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 18:04:40 user nova-compute[74613]: INFO nova.compute.manager [-] [instance: c4bdb712-e1f9-4fc0-b527-87088d7eddf8] Took 0.55 seconds to deallocate network for instance.
Nov 29 18:04:40 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-126438d6-5067-4d77-ae09-1a687e592859 tempest-ServersNegativeTestJSON-1631676891 tempest-ServersNegativeTestJSON-1631676891-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 18:04:40 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-126438d6-5067-4d77-ae09-1a687e592859 tempest-ServersNegativeTestJSON-1631676891 tempest-ServersNegativeTestJSON-1631676891-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 18:04:41 user nova-compute[74613]: DEBUG nova.compute.provider_tree [None req-126438d6-5067-4d77-ae09-1a687e592859 tempest-ServersNegativeTestJSON-1631676891 tempest-ServersNegativeTestJSON-1631676891-project-member] Inventory has not changed in ProviderTree for provider: 639d980e-3b12-44b1-b8f4-1812416fa4dd {{(pid=74613) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 18:04:41 user nova-compute[74613]: DEBUG nova.scheduler.client.report [None req-126438d6-5067-4d77-ae09-1a687e592859 tempest-ServersNegativeTestJSON-1631676891 tempest-ServersNegativeTestJSON-1631676891-project-member] Inventory has not changed for provider 639d980e-3b12-44b1-b8f4-1812416fa4dd based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74613) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 18:04:41 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-126438d6-5067-4d77-ae09-1a687e592859 tempest-ServersNegativeTestJSON-1631676891 tempest-ServersNegativeTestJSON-1631676891-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.364s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 18:04:41 user nova-compute[74613]: INFO nova.scheduler.client.report [None req-126438d6-5067-4d77-ae09-1a687e592859 tempest-ServersNegativeTestJSON-1631676891 tempest-ServersNegativeTestJSON-1631676891-project-member] Deleted allocations for instance c4bdb712-e1f9-4fc0-b527-87088d7eddf8
Nov 29 18:04:41 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-126438d6-5067-4d77-ae09-1a687e592859 tempest-ServersNegativeTestJSON-1631676891 tempest-ServersNegativeTestJSON-1631676891-project-member] Lock "c4bdb712-e1f9-4fc0-b527-87088d7eddf8" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.168s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 18:04:41 user nova-compute[74613]: DEBUG nova.compute.manager [req-0d17a983-72c8-4f89-a941-4e7d11142bdb req-e2ed1c59-4a2b-497d-86b3-0facc5221399 service nova] [instance: c4bdb712-e1f9-4fc0-b527-87088d7eddf8] Received event network-vif-plugged-1261dd8b-2514-475b-bbbc-7a83ce22c7c0 {{(pid=74613) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 18:04:41 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-0d17a983-72c8-4f89-a941-4e7d11142bdb req-e2ed1c59-4a2b-497d-86b3-0facc5221399 service nova] Acquiring lock "c4bdb712-e1f9-4fc0-b527-87088d7eddf8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 18:04:41 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-0d17a983-72c8-4f89-a941-4e7d11142bdb req-e2ed1c59-4a2b-497d-86b3-0facc5221399 service nova] Lock "c4bdb712-e1f9-4fc0-b527-87088d7eddf8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 18:04:41 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-0d17a983-72c8-4f89-a941-4e7d11142bdb req-e2ed1c59-4a2b-497d-86b3-0facc5221399 service nova] Lock "c4bdb712-e1f9-4fc0-b527-87088d7eddf8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 18:04:41 user nova-compute[74613]: DEBUG nova.compute.manager [req-0d17a983-72c8-4f89-a941-4e7d11142bdb req-e2ed1c59-4a2b-497d-86b3-0facc5221399 service nova] [instance: c4bdb712-e1f9-4fc0-b527-87088d7eddf8] No waiting events found dispatching network-vif-plugged-1261dd8b-2514-475b-bbbc-7a83ce22c7c0 {{(pid=74613) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 18:04:41 user nova-compute[74613]: WARNING nova.compute.manager [req-0d17a983-72c8-4f89-a941-4e7d11142bdb req-e2ed1c59-4a2b-497d-86b3-0facc5221399 service nova] [instance: c4bdb712-e1f9-4fc0-b527-87088d7eddf8] Received unexpected event network-vif-plugged-1261dd8b-2514-475b-bbbc-7a83ce22c7c0 for instance with vm_state deleted and task_state None.
Nov 29 18:04:41 user nova-compute[74613]: DEBUG nova.compute.manager [req-0d17a983-72c8-4f89-a941-4e7d11142bdb req-e2ed1c59-4a2b-497d-86b3-0facc5221399 service nova] [instance: c4bdb712-e1f9-4fc0-b527-87088d7eddf8] Received event network-vif-deleted-1261dd8b-2514-475b-bbbc-7a83ce22c7c0 {{(pid=74613) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 18:04:45 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:04:45 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:04:49 user nova-compute[74613]: DEBUG nova.compute.manager [req-3ab424f3-1ccf-4f46-914c-62d055b79b53 req-18110f03-e427-4e70-b077-2296a12420cc service nova] [instance: abc9e2b8-f467-4cd0-b40f-de511fde1ec1] Received event network-changed-59a8bf1b-9fb1-4526-92d5-9ad1897c1ee8 {{(pid=74613) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 18:04:49 user nova-compute[74613]: DEBUG nova.compute.manager [req-3ab424f3-1ccf-4f46-914c-62d055b79b53 req-18110f03-e427-4e70-b077-2296a12420cc service nova] [instance: abc9e2b8-f467-4cd0-b40f-de511fde1ec1] Refreshing instance network info cache due to event network-changed-59a8bf1b-9fb1-4526-92d5-9ad1897c1ee8. {{(pid=74613) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 18:04:49 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-3ab424f3-1ccf-4f46-914c-62d055b79b53 req-18110f03-e427-4e70-b077-2296a12420cc service nova] Acquiring lock "refresh_cache-abc9e2b8-f467-4cd0-b40f-de511fde1ec1" {{(pid=74613) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 18:04:49 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-3ab424f3-1ccf-4f46-914c-62d055b79b53 req-18110f03-e427-4e70-b077-2296a12420cc service nova] Acquired lock "refresh_cache-abc9e2b8-f467-4cd0-b40f-de511fde1ec1" {{(pid=74613) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 18:04:49 user nova-compute[74613]: DEBUG nova.network.neutron [req-3ab424f3-1ccf-4f46-914c-62d055b79b53 req-18110f03-e427-4e70-b077-2296a12420cc service nova] [instance: abc9e2b8-f467-4cd0-b40f-de511fde1ec1] Refreshing network info cache for port 59a8bf1b-9fb1-4526-92d5-9ad1897c1ee8 {{(pid=74613) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 18:04:49 user nova-compute[74613]: DEBUG nova.network.neutron [req-3ab424f3-1ccf-4f46-914c-62d055b79b53 req-18110f03-e427-4e70-b077-2296a12420cc service nova] [instance: abc9e2b8-f467-4cd0-b40f-de511fde1ec1] Updated VIF entry in instance network info cache for port 59a8bf1b-9fb1-4526-92d5-9ad1897c1ee8. {{(pid=74613) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 18:04:49 user nova-compute[74613]: DEBUG nova.network.neutron [req-3ab424f3-1ccf-4f46-914c-62d055b79b53 req-18110f03-e427-4e70-b077-2296a12420cc service nova] [instance: abc9e2b8-f467-4cd0-b40f-de511fde1ec1] Updating instance_info_cache with network_info: [{"id": "59a8bf1b-9fb1-4526-92d5-9ad1897c1ee8", "address": "fa:16:3e:e3:5f:12", "network": {"id": "7c2c368e-4c7d-4d70-9a40-c10fe9541af9", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1287934102-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b1f70c311d4941c986de21ac458d11ab", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap59a8bf1b-9f", "ovs_interfaceid": "59a8bf1b-9fb1-4526-92d5-9ad1897c1ee8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74613) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 18:04:49 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-3ab424f3-1ccf-4f46-914c-62d055b79b53 req-18110f03-e427-4e70-b077-2296a12420cc service nova] Releasing lock "refresh_cache-abc9e2b8-f467-4cd0-b40f-de511fde1ec1" {{(pid=74613) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 18:04:50 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:04:50 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:04:50 user nova-compute[74613]: DEBUG nova.compute.manager [None req-8fdf4cec-5620-4a5a-8148-38328ce83814 tempest-ServerActionsTestOtherA-1784608629 tempest-ServerActionsTestOtherA-1784608629-project-member] [instance: e9acfa30-4ec2-4540-ac34-4c66db3228e1] Stashing vm_state: active {{(pid=74613) _prep_resize /opt/stack/nova/nova/compute/manager.py:5615}}
Nov 29 18:04:51 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-8fdf4cec-5620-4a5a-8148-38328ce83814 tempest-ServerActionsTestOtherA-1784608629 tempest-ServerActionsTestOtherA-1784608629-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 18:04:51 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-8fdf4cec-5620-4a5a-8148-38328ce83814 tempest-ServerActionsTestOtherA-1784608629 tempest-ServerActionsTestOtherA-1784608629-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: waited 0.001s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 18:04:51 user nova-compute[74613]: DEBUG nova.virt.hardware [None req-8fdf4cec-5620-4a5a-8148-38328ce83814 tempest-ServerActionsTestOtherA-1784608629 tempest-ServerActionsTestOtherA-1784608629-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74613) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 29 18:04:51 user nova-compute[74613]: INFO nova.compute.claims [None req-8fdf4cec-5620-4a5a-8148-38328ce83814 tempest-ServerActionsTestOtherA-1784608629 tempest-ServerActionsTestOtherA-1784608629-project-member] [instance: e9acfa30-4ec2-4540-ac34-4c66db3228e1] Claim successful on node user
Nov 29 18:04:51 user nova-compute[74613]: INFO nova.compute.resource_tracker [None req-8fdf4cec-5620-4a5a-8148-38328ce83814 tempest-ServerActionsTestOtherA-1784608629 tempest-ServerActionsTestOtherA-1784608629-project-member] [instance: e9acfa30-4ec2-4540-ac34-4c66db3228e1] Updating resource usage from migration 5c28fdb8-2306-491b-9a4c-9ea25116daee
Nov 29 18:04:51 user nova-compute[74613]: DEBUG nova.compute.manager [req-75d82079-8b46-49e6-aa70-241bd0c99b70 req-b0f40d58-ff91-48fb-a70f-2aea0cb47edb service nova] [instance: e9acfa30-4ec2-4540-ac34-4c66db3228e1] Received event network-changed-8cd31427-1812-40fb-8018-d8f24a5b1792 {{(pid=74613) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 18:04:51 user nova-compute[74613]: DEBUG nova.compute.manager [req-75d82079-8b46-49e6-aa70-241bd0c99b70 req-b0f40d58-ff91-48fb-a70f-2aea0cb47edb service nova] [instance: e9acfa30-4ec2-4540-ac34-4c66db3228e1] Refreshing instance network info cache due to event network-changed-8cd31427-1812-40fb-8018-d8f24a5b1792. {{(pid=74613) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 18:04:51 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-75d82079-8b46-49e6-aa70-241bd0c99b70 req-b0f40d58-ff91-48fb-a70f-2aea0cb47edb service nova] Acquiring lock "refresh_cache-e9acfa30-4ec2-4540-ac34-4c66db3228e1" {{(pid=74613) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 18:04:51 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-75d82079-8b46-49e6-aa70-241bd0c99b70 req-b0f40d58-ff91-48fb-a70f-2aea0cb47edb service nova] Acquired lock "refresh_cache-e9acfa30-4ec2-4540-ac34-4c66db3228e1" {{(pid=74613) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 18:04:51 user nova-compute[74613]: DEBUG nova.network.neutron [req-75d82079-8b46-49e6-aa70-241bd0c99b70 req-b0f40d58-ff91-48fb-a70f-2aea0cb47edb service nova] [instance: e9acfa30-4ec2-4540-ac34-4c66db3228e1] Refreshing network info cache for port 8cd31427-1812-40fb-8018-d8f24a5b1792 {{(pid=74613) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 18:04:51 user nova-compute[74613]: DEBUG nova.compute.provider_tree [None req-8fdf4cec-5620-4a5a-8148-38328ce83814 tempest-ServerActionsTestOtherA-1784608629 tempest-ServerActionsTestOtherA-1784608629-project-member] Inventory has not changed in ProviderTree for provider: 639d980e-3b12-44b1-b8f4-1812416fa4dd {{(pid=74613) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 18:04:51 user nova-compute[74613]: DEBUG nova.scheduler.client.report [None req-8fdf4cec-5620-4a5a-8148-38328ce83814 tempest-ServerActionsTestOtherA-1784608629 tempest-ServerActionsTestOtherA-1784608629-project-member] Inventory has not changed for provider 639d980e-3b12-44b1-b8f4-1812416fa4dd based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74613) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 18:04:51 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-8fdf4cec-5620-4a5a-8148-38328ce83814 tempest-ServerActionsTestOtherA-1784608629 tempest-ServerActionsTestOtherA-1784608629-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: held 0.392s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 18:04:51 user nova-compute[74613]: INFO nova.compute.manager [None req-8fdf4cec-5620-4a5a-8148-38328ce83814 tempest-ServerActionsTestOtherA-1784608629 tempest-ServerActionsTestOtherA-1784608629-project-member] [instance: e9acfa30-4ec2-4540-ac34-4c66db3228e1] Migrating
Nov 29 18:04:51 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-8fdf4cec-5620-4a5a-8148-38328ce83814 tempest-ServerActionsTestOtherA-1784608629 tempest-ServerActionsTestOtherA-1784608629-project-member] Acquiring lock "refresh_cache-e9acfa30-4ec2-4540-ac34-4c66db3228e1" {{(pid=74613) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 18:04:51 user nova-compute[74613]: DEBUG nova.network.neutron [req-75d82079-8b46-49e6-aa70-241bd0c99b70 req-b0f40d58-ff91-48fb-a70f-2aea0cb47edb service nova] [instance: e9acfa30-4ec2-4540-ac34-4c66db3228e1] Updated VIF entry in instance network info cache for port 8cd31427-1812-40fb-8018-d8f24a5b1792. {{(pid=74613) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 18:04:51 user nova-compute[74613]: DEBUG nova.network.neutron [req-75d82079-8b46-49e6-aa70-241bd0c99b70 req-b0f40d58-ff91-48fb-a70f-2aea0cb47edb service nova] [instance: e9acfa30-4ec2-4540-ac34-4c66db3228e1] Updating instance_info_cache with network_info: [{"id": "8cd31427-1812-40fb-8018-d8f24a5b1792", "address": "fa:16:3e:97:0e:ed", "network": {"id": "7c2c368e-4c7d-4d70-9a40-c10fe9541af9", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1287934102-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.103", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b1f70c311d4941c986de21ac458d11ab", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8cd31427-18", "ovs_interfaceid": "8cd31427-1812-40fb-8018-d8f24a5b1792", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74613) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 18:04:51 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-75d82079-8b46-49e6-aa70-241bd0c99b70 req-b0f40d58-ff91-48fb-a70f-2aea0cb47edb service nova] Releasing lock "refresh_cache-e9acfa30-4ec2-4540-ac34-4c66db3228e1" {{(pid=74613) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 18:04:51 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-8fdf4cec-5620-4a5a-8148-38328ce83814 tempest-ServerActionsTestOtherA-1784608629 tempest-ServerActionsTestOtherA-1784608629-project-member] Acquired lock "refresh_cache-e9acfa30-4ec2-4540-ac34-4c66db3228e1" {{(pid=74613) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 18:04:51 user nova-compute[74613]: DEBUG nova.network.neutron [None req-8fdf4cec-5620-4a5a-8148-38328ce83814 tempest-ServerActionsTestOtherA-1784608629 tempest-ServerActionsTestOtherA-1784608629-project-member] [instance: e9acfa30-4ec2-4540-ac34-4c66db3228e1] Building network info cache for instance {{(pid=74613) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 29 18:04:52 user nova-compute[74613]: DEBUG nova.network.neutron [None req-8fdf4cec-5620-4a5a-8148-38328ce83814 tempest-ServerActionsTestOtherA-1784608629 tempest-ServerActionsTestOtherA-1784608629-project-member] [instance: e9acfa30-4ec2-4540-ac34-4c66db3228e1] Updating instance_info_cache with network_info: [{"id": "8cd31427-1812-40fb-8018-d8f24a5b1792", "address": "fa:16:3e:97:0e:ed", "network": {"id": "7c2c368e-4c7d-4d70-9a40-c10fe9541af9", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1287934102-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.103", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b1f70c311d4941c986de21ac458d11ab", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8cd31427-18", "ovs_interfaceid": "8cd31427-1812-40fb-8018-d8f24a5b1792", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74613) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 18:04:52 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-8fdf4cec-5620-4a5a-8148-38328ce83814 tempest-ServerActionsTestOtherA-1784608629 tempest-ServerActionsTestOtherA-1784608629-project-member] Releasing lock "refresh_cache-e9acfa30-4ec2-4540-ac34-4c66db3228e1" {{(pid=74613) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 18:04:52 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-8fdf4cec-5620-4a5a-8148-38328ce83814 tempest-ServerActionsTestOtherA-1784608629 tempest-ServerActionsTestOtherA-1784608629-project-member] [instance: e9acfa30-4ec2-4540-ac34-4c66db3228e1] Starting migrate_disk_and_power_off {{(pid=74613) migrate_disk_and_power_off /opt/stack/nova/nova/virt/libvirt/driver.py:11484}}
Nov 29 18:04:52 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:04:52 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:04:52 user nova-compute[74613]: DEBUG nova.compute.manager [req-691e01c4-7510-47a9-8e3b-54be37f53c6f req-9b6d915f-2ebb-48f9-8566-339710bbb0f1 service nova] [instance: e9acfa30-4ec2-4540-ac34-4c66db3228e1] Received event network-vif-unplugged-8cd31427-1812-40fb-8018-d8f24a5b1792 {{(pid=74613) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 18:04:52 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-691e01c4-7510-47a9-8e3b-54be37f53c6f req-9b6d915f-2ebb-48f9-8566-339710bbb0f1 service nova] Acquiring lock "e9acfa30-4ec2-4540-ac34-4c66db3228e1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 18:04:52 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-691e01c4-7510-47a9-8e3b-54be37f53c6f req-9b6d915f-2ebb-48f9-8566-339710bbb0f1 service nova] Lock "e9acfa30-4ec2-4540-ac34-4c66db3228e1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 18:04:52 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-691e01c4-7510-47a9-8e3b-54be37f53c6f req-9b6d915f-2ebb-48f9-8566-339710bbb0f1 service nova] Lock "e9acfa30-4ec2-4540-ac34-4c66db3228e1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 18:04:52 user nova-compute[74613]: DEBUG nova.compute.manager [req-691e01c4-7510-47a9-8e3b-54be37f53c6f req-9b6d915f-2ebb-48f9-8566-339710bbb0f1 service nova] [instance: e9acfa30-4ec2-4540-ac34-4c66db3228e1] No waiting events found dispatching network-vif-unplugged-8cd31427-1812-40fb-8018-d8f24a5b1792 {{(pid=74613) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 18:04:52 user nova-compute[74613]: WARNING nova.compute.manager [req-691e01c4-7510-47a9-8e3b-54be37f53c6f req-9b6d915f-2ebb-48f9-8566-339710bbb0f1 service nova] [instance: e9acfa30-4ec2-4540-ac34-4c66db3228e1] Received unexpected event network-vif-unplugged-8cd31427-1812-40fb-8018-d8f24a5b1792 for instance with vm_state active and task_state resize_migrating.
Nov 29 18:04:52 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:04:52 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:04:53 user nova-compute[74613]: INFO nova.virt.libvirt.driver [-] [instance: e9acfa30-4ec2-4540-ac34-4c66db3228e1] Instance destroyed successfully.
Nov 29 18:04:53 user nova-compute[74613]: DEBUG nova.virt.libvirt.vif [None req-8fdf4cec-5620-4a5a-8148-38328ce83814 tempest-ServerActionsTestOtherA-1784608629 tempest-ServerActionsTestOtherA-1784608629-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T18:02:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1745064093',display_name='tempest-ServerActionsTestOtherA-server-1745064093',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-1745064093',id=25,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIpucl9TdiuMtgo2HD8A0S0XK6/wskQQSBMcoxjyazAtLZUlGJCbAbNEhyc7Esm1yWePtzGTrNFIbg4z5HCtj+7HLtHc8+57P9i9m4iI8l/z1ZnWm+BWBA3bkBkjzP6q3Q==',key_name='tempest-keypair-1839431126',keypairs=<?>,launch_index=0,launched_at=2023-11-29T18:03:12Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='b1f70c311d4941c986de21ac458d11ab',ramdisk_id='',reservation_id='r-cod9xl0z',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherA-1784608629',owner_user_name='tempest-ServerActionsTestOtherA-1784608629-project-member'},tags=<?>,task_state='resize_migrating',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T18:04:51Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='368555c72103480b82c5c0bf64b07360',uuid=e9acfa30-4ec2-4540-ac34-4c66db3228e1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "8cd31427-1812-40fb-8018-d8f24a5b1792", "address": "fa:16:3e:97:0e:ed", "network": {"id": "7c2c368e-4c7d-4d70-9a40-c10fe9541af9", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1287934102-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.103", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-1287934102-network", "vif_mac": "fa:16:3e:97:0e:ed"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b1f70c311d4941c986de21ac458d11ab", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8cd31427-18", "ovs_interfaceid": "8cd31427-1812-40fb-8018-d8f24a5b1792", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74613) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 29 18:04:53 user nova-compute[74613]: DEBUG nova.network.os_vif_util [None req-8fdf4cec-5620-4a5a-8148-38328ce83814 tempest-ServerActionsTestOtherA-1784608629 tempest-ServerActionsTestOtherA-1784608629-project-member] Converting VIF {"id": "8cd31427-1812-40fb-8018-d8f24a5b1792", "address": "fa:16:3e:97:0e:ed", "network": {"id": "7c2c368e-4c7d-4d70-9a40-c10fe9541af9", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1287934102-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.103", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-1287934102-network", "vif_mac": "fa:16:3e:97:0e:ed"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b1f70c311d4941c986de21ac458d11ab", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8cd31427-18", "ovs_interfaceid": "8cd31427-1812-40fb-8018-d8f24a5b1792", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74613) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 18:04:53 user nova-compute[74613]: DEBUG nova.network.os_vif_util [None req-8fdf4cec-5620-4a5a-8148-38328ce83814 tempest-ServerActionsTestOtherA-1784608629 tempest-ServerActionsTestOtherA-1784608629-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:97:0e:ed,bridge_name='br-int',has_traffic_filtering=True,id=8cd31427-1812-40fb-8018-d8f24a5b1792,network=Network(7c2c368e-4c7d-4d70-9a40-c10fe9541af9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8cd31427-18') {{(pid=74613) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 18:04:53 user nova-compute[74613]: DEBUG os_vif [None req-8fdf4cec-5620-4a5a-8148-38328ce83814 tempest-ServerActionsTestOtherA-1784608629 tempest-ServerActionsTestOtherA-1784608629-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:97:0e:ed,bridge_name='br-int',has_traffic_filtering=True,id=8cd31427-1812-40fb-8018-d8f24a5b1792,network=Network(7c2c368e-4c7d-4d70-9a40-c10fe9541af9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8cd31427-18') {{(pid=74613) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 29 18:04:53 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:04:53 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap8cd31427-18, bridge=br-int, if_exists=True) {{(pid=74613) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 18:04:53 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:04:53 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 18:04:53 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:04:53 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=4c7d16f1-3507-4294-a933-d7ce4664f5c4) {{(pid=74613) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 18:04:53 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:04:53 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 18:04:53 user nova-compute[74613]: INFO os_vif [None req-8fdf4cec-5620-4a5a-8148-38328ce83814 tempest-ServerActionsTestOtherA-1784608629 tempest-ServerActionsTestOtherA-1784608629-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:97:0e:ed,bridge_name='br-int',has_traffic_filtering=True,id=8cd31427-1812-40fb-8018-d8f24a5b1792,network=Network(7c2c368e-4c7d-4d70-9a40-c10fe9541af9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8cd31427-18')
Nov 29 18:04:53 user nova-compute[74613]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8fdf4cec-5620-4a5a-8148-38328ce83814 tempest-ServerActionsTestOtherA-1784608629 tempest-ServerActionsTestOtherA-1784608629-project-member] [instance: e9acfa30-4ec2-4540-ac34-4c66db3228e1] calling os-brick to detach iSCSI Volume {{(pid=74613) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 29 18:04:53 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-8fdf4cec-5620-4a5a-8148-38328ce83814 tempest-ServerActionsTestOtherA-1784608629 tempest-ServerActionsTestOtherA-1784608629-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff828156890>, {'target_iqn': 'iqn.2010-10.org.openstack:a8c53a27-dcde-402b-a9bb-d8642f7db0da', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'SLOlKdrc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': False}}" {{(pid=74613) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 18:04:53 user nova-compute[74613]: WARNING os_brick.initiator.connectors.base [None req-8fdf4cec-5620-4a5a-8148-38328ce83814 tempest-ServerActionsTestOtherA-1784608629 tempest-ServerActionsTestOtherA-1784608629-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 18:04:53 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.base [None req-8fdf4cec-5620-4a5a-8148-38328ce83814 tempest-ServerActionsTestOtherA-1784608629 tempest-ServerActionsTestOtherA-1784608629-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 18:04:53 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.base [None req-8fdf4cec-5620-4a5a-8148-38328ce83814 tempest-ServerActionsTestOtherA-1784608629 tempest-ServerActionsTestOtherA-1784608629-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 18:04:53 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:04:53 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.025s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:04:53 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[996371ce-941c-42e5-8021-6c70c3d91b6a]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:9511387c-8772-40f2-bf2d-6b6387649e9f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:01de4abf-62b4-4200-97dc-9a38d07324e5\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b4a04a56-f988-4ae8-a3d3-271caf058c33\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b9aad94d-fe0d-415d-9761-9aff25cc6099\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:32c4a58d-da1b-468d-b32a-6ff5cdc8993d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a8c53a27-dcde-402b-a9bb-d8642f7db0da\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 18:04:53 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-8fdf4cec-5620-4a5a-8148-38328ce83814 tempest-ServerActionsTestOtherA-1784608629 tempest-ServerActionsTestOtherA-1784608629-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 29 18:04:53 user nova-compute[74613]: No targets found.
Nov 29 18:04:53 user nova-compute[74613]: iSNS:
Nov 29 18:04:53 user nova-compute[74613]: No targets found.
Nov 29 18:04:53 user nova-compute[74613]: STATIC:
Nov 29 18:04:53 user nova-compute[74613]: Target: iqn.2010-10.org.openstack:9511387c-8772-40f2-bf2d-6b6387649e9f
Nov 29 18:04:53 user nova-compute[74613]:         Portal: 172.16.0.220:3260,-1
Nov 29 18:04:53 user nova-compute[74613]:                 Iface Name: default
Nov 29 18:04:53 user nova-compute[74613]: Target: iqn.2010-10.org.openstack:01de4abf-62b4-4200-97dc-9a38d07324e5
Nov 29 18:04:53 user nova-compute[74613]:         Portal: 172.16.0.220:3260,-1
Nov 29 18:04:53 user nova-compute[74613]:                 Iface Name: default
Nov 29 18:04:53 user nova-compute[74613]: Target: iqn.2010-10.org.openstack:b4a04a56-f988-4ae8-a3d3-271caf058c33
Nov 29 18:04:53 user nova-compute[74613]:         Portal: 172.16.0.220:3260,-1
Nov 29 18:04:53 user nova-compute[74613]:                 Iface Name: default
Nov 29 18:04:53 user nova-compute[74613]: Target: iqn.2010-10.org.openstack:b9aad94d-fe0d-415d-9761-9aff25cc6099
Nov 29 18:04:53 user nova-compute[74613]:         Portal: 172.16.0.220:3260,-1
Nov 29 18:04:53 user nova-compute[74613]:                 Iface Name: default
Nov 29 18:04:53 user nova-compute[74613]: Target: iqn.2010-10.org.openstack:32c4a58d-da1b-468d-b32a-6ff5cdc8993d
Nov 29 18:04:53 user nova-compute[74613]:         Portal: 172.16.0.220:3260,-1
Nov 29 18:04:53 user nova-compute[74613]:                 Iface Name: default
Nov 29 18:04:53 user nova-compute[74613]: Target: iqn.2010-10.org.openstack:a8c53a27-dcde-402b-a9bb-d8642f7db0da
Nov 29 18:04:53 user nova-compute[74613]:         Portal: 172.16.0.220:3260,-1
Nov 29 18:04:53 user nova-compute[74613]:                 Iface Name: default
Nov 29 18:04:53 user nova-compute[74613]: FIRMWARE:
Nov 29 18:04:53 user nova-compute[74613]: No targets found.
Nov 29 18:04:53 user nova-compute[74613]:  stderr= {{(pid=74613) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 18:04:53 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-8fdf4cec-5620-4a5a-8148-38328ce83814 tempest-ServerActionsTestOtherA-1784608629 tempest-ServerActionsTestOtherA-1784608629-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 29 18:04:53 user nova-compute[74613]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 29 18:04:53 user nova-compute[74613]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74613) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 29 18:04:53 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-8fdf4cec-5620-4a5a-8148-38328ce83814 tempest-ServerActionsTestOtherA-1784608629 tempest-ServerActionsTestOtherA-1784608629-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a8c53a27-dcde-402b-a9bb-d8642f7db0da', 0)] {{(pid=74613) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 29 18:04:53 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:04:53 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:04:53 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[e04df441-b5bc-4317-a79f-209b0910da09]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:01de4abf-62b4-4200-97dc-9a38d07324e5\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:32c4a58d-da1b-468d-b32a-6ff5cdc8993d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9511387c-8772-40f2-bf2d-6b6387649e9f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a8c53a27-dcde-402b-a9bb-d8642f7db0da\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b4a04a56-f988-4ae8-a3d3-271caf058c33\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b9aad94d-fe0d-415d-9761-9aff25cc6099\n', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 18:04:53 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:04:53 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:04:53 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[fae63e5d-ee52-45dd-bdce-d9e94207c013]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9511387c-8772-40f2-bf2d-6b6387649e9f (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8c53a27-dcde-402b-a9bb-d8642f7db0da (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9aad94d-fe0d-415d-9761-9aff25cc6099 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:32c4a58d-da1b-468d-b32a-6ff5cdc8993d (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4a04a56-f988-4ae8-a3d3-271caf058c33 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01de4abf-62b4-4200-97dc-9a38d07324e5 (non-flash)\n', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 18:04:53 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-8fdf4cec-5620-4a5a-8148-38328ce83814 tempest-ServerActionsTestOtherA-1784608629 tempest-ServerActionsTestOtherA-1784608629-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9511387c-8772-40f2-bf2d-6b6387649e9f (non-flash)
Nov 29 18:04:53 user nova-compute[74613]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8c53a27-dcde-402b-a9bb-d8642f7db0da (non-flash)
Nov 29 18:04:53 user nova-compute[74613]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9aad94d-fe0d-415d-9761-9aff25cc6099 (non-flash)
Nov 29 18:04:53 user nova-compute[74613]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:32c4a58d-da1b-468d-b32a-6ff5cdc8993d (non-flash)
Nov 29 18:04:53 user nova-compute[74613]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4a04a56-f988-4ae8-a3d3-271caf058c33 (non-flash)
Nov 29 18:04:53 user nova-compute[74613]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01de4abf-62b4-4200-97dc-9a38d07324e5 (non-flash)
Nov 29 18:04:53 user nova-compute[74613]:  stderr= {{(pid=74613) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 18:04:53 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-8fdf4cec-5620-4a5a-8148-38328ce83814 tempest-ServerActionsTestOtherA-1784608629 tempest-ServerActionsTestOtherA-1784608629-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9511387c-8772-40f2-bf2d-6b6387649e9f (non-flash)
Nov 29 18:04:53 user nova-compute[74613]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8c53a27-dcde-402b-a9bb-d8642f7db0da (non-flash)
Nov 29 18:04:53 user nova-compute[74613]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9aad94d-fe0d-415d-9761-9aff25cc6099 (non-flash)
Nov 29 18:04:53 user nova-compute[74613]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:32c4a58d-da1b-468d-b32a-6ff5cdc8993d (non-flash)
Nov 29 18:04:53 user nova-compute[74613]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4a04a56-f988-4ae8-a3d3-271caf058c33 (non-flash)
Nov 29 18:04:53 user nova-compute[74613]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01de4abf-62b4-4200-97dc-9a38d07324e5 (non-flash)
Nov 29 18:04:53 user nova-compute[74613]:  stderr= {{(pid=74613) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 18:04:53 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-8fdf4cec-5620-4a5a-8148-38328ce83814 tempest-ServerActionsTestOtherA-1784608629 tempest-ServerActionsTestOtherA-1784608629-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7ff8181100d0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a8c53a27-dcde-402b-a9bb-d8642f7db0da'): ({'sde'}, set())}) {{(pid=74613) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 29 18:04:53 user nova-compute[74613]: DEBUG os_brick.initiator.linuxscsi [None req-8fdf4cec-5620-4a5a-8148-38328ce83814 tempest-ServerActionsTestOtherA-1784608629 tempest-ServerActionsTestOtherA-1784608629-project-member] Removing single pathed devices sde {{(pid=74613) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 29 18:04:53 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:04:53 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:04:53 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b9ac818-4d8c-4c7a-89b8-ac981a9319aa]: (4, ('path checker states:\nup                  6\n\npaths: 0\nbusy: False\n', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 18:04:53 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:04:53 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.020s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:04:53 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e3e2082-92eb-4945-b062-476d42788f30]: (4, ('ok\n', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 18:04:53 user nova-compute[74613]: DEBUG os_brick.initiator.linuxscsi [None req-8fdf4cec-5620-4a5a-8148-38328ce83814 tempest-ServerActionsTestOtherA-1784608629 tempest-ServerActionsTestOtherA-1784608629-project-member] Flushing IO for device /dev/sde {{(pid=74613) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 29 18:04:53 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:04:53 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.013s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:04:53 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[179702b0-ef54-4d45-80bd-4d86f4c16bcf]: (4, ('', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 18:04:53 user nova-compute[74613]: DEBUG os_brick.initiator.linuxscsi [None req-8fdf4cec-5620-4a5a-8148-38328ce83814 tempest-ServerActionsTestOtherA-1784608629 tempest-ServerActionsTestOtherA-1784608629-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=74613) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 29 18:04:53 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:04:53 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.053s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:04:53 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[81184cb3-cb87-49af-abbe-ba76223a33af]: (4, ('1', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 18:04:53 user nova-compute[74613]: DEBUG os_brick.initiator.linuxscsi [None req-8fdf4cec-5620-4a5a-8148-38328ce83814 tempest-ServerActionsTestOtherA-1784608629 tempest-ServerActionsTestOtherA-1784608629-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=74613) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 29 18:04:53 user nova-compute[74613]: DEBUG os_brick.initiator.linuxscsi [None req-8fdf4cec-5620-4a5a-8148-38328ce83814 tempest-ServerActionsTestOtherA-1784608629 tempest-ServerActionsTestOtherA-1784608629-project-member] SCSI volumes sde have been removed. {{(pid=74613) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 29 18:04:53 user nova-compute[74613]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-1SCST_BIO75a1aea9-b6b6277a9666f87a', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_75a1aea9', '/dev/disk/by-id/scsi-26236623632373761') {{(pid=85376) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Nov 29 18:04:53 user nova-compute[74613]: WARNING os_brick.exception [-] Unlink failed for /dev/disk/by-id/scsi-1SCST_BIO75a1aea9-b6b6277a9666f87a
Nov 29 18:04:53 user nova-compute[74613]: WARNING os_brick.exception [-] Unlink failed for /dev/disk/by-id/scsi-SSCST_BIO_Storage_75a1aea9
Nov 29 18:04:53 user nova-compute[74613]: WARNING os_brick.exception [-] Unlink failed for /dev/disk/by-id/scsi-26236623632373761
Nov 29 18:04:53 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[538d97f7-94bd-49db-a239-83458cce105c]: (4, None) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 18:04:53 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-8fdf4cec-5620-4a5a-8148-38328ce83814 tempest-ServerActionsTestOtherA-1784608629 tempest-ServerActionsTestOtherA-1784608629-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a8c53a27-dcde-402b-a9bb-d8642f7db0da')] {{(pid=74613) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 29 18:04:53 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a8c53a27-dcde-402b-a9bb-d8642f7db0da -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:04:53 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a8c53a27-dcde-402b-a9bb-d8642f7db0da -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:04:53 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[6dd8e485-e09a-4839-a7a2-3099b5dde805]: (4, ('', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 18:04:53 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-8fdf4cec-5620-4a5a-8148-38328ce83814 tempest-ServerActionsTestOtherA-1784608629 tempest-ServerActionsTestOtherA-1784608629-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74613) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 18:04:53 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a8c53a27-dcde-402b-a9bb-d8642f7db0da -p 172.16.0.220:3260 --logout {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:04:53 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a8c53a27-dcde-402b-a9bb-d8642f7db0da -p 172.16.0.220:3260 --logout" returned: 0 in 0.077s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:04:53 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[caf1eed6-db87-4aa1-ac94-c505b9558214]: (4, ('Logging out of session [sid: 28, target: iqn.2010-10.org.openstack:a8c53a27-dcde-402b-a9bb-d8642f7db0da, portal: 172.16.0.220,3260]\nLogout of [sid: 28, target: iqn.2010-10.org.openstack:a8c53a27-dcde-402b-a9bb-d8642f7db0da, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 18:04:53 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-8fdf4cec-5620-4a5a-8148-38328ce83814 tempest-ServerActionsTestOtherA-1784608629 tempest-ServerActionsTestOtherA-1784608629-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 28, target: iqn.2010-10.org.openstack:a8c53a27-dcde-402b-a9bb-d8642f7db0da, portal: 172.16.0.220,3260]
Nov 29 18:04:53 user nova-compute[74613]: Logout of [sid: 28, target: iqn.2010-10.org.openstack:a8c53a27-dcde-402b-a9bb-d8642f7db0da, portal: 172.16.0.220,3260] successful.
Nov 29 18:04:53 user nova-compute[74613]:  stderr= {{(pid=74613) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 18:04:53 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a8c53a27-dcde-402b-a9bb-d8642f7db0da -p 172.16.0.220:3260 --op delete {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:04:53 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a8c53a27-dcde-402b-a9bb-d8642f7db0da -p 172.16.0.220:3260 --op delete" returned: 0 in 0.031s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:04:53 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[e02579b2-307c-4268-81fc-13744976c7fb]: (4, ('', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 18:04:53 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-8fdf4cec-5620-4a5a-8148-38328ce83814 tempest-ServerActionsTestOtherA-1784608629 tempest-ServerActionsTestOtherA-1784608629-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74613) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 18:04:53 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.base [None req-8fdf4cec-5620-4a5a-8148-38328ce83814 tempest-ServerActionsTestOtherA-1784608629 tempest-ServerActionsTestOtherA-1784608629-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.356s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 18:04:53 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-8fdf4cec-5620-4a5a-8148-38328ce83814 tempest-ServerActionsTestOtherA-1784608629 tempest-ServerActionsTestOtherA-1784608629-project-member] <== disconnect_volume: return (358ms) None {{(pid=74613) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 18:04:53 user nova-compute[74613]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8fdf4cec-5620-4a5a-8148-38328ce83814 tempest-ServerActionsTestOtherA-1784608629 tempest-ServerActionsTestOtherA-1784608629-project-member] [instance: e9acfa30-4ec2-4540-ac34-4c66db3228e1] Disconnected iSCSI Volume {{(pid=74613) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 29 18:04:53 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-8fdf4cec-5620-4a5a-8148-38328ce83814 tempest-ServerActionsTestOtherA-1784608629 tempest-ServerActionsTestOtherA-1784608629-project-member] skipping disk /dev/sde (vda) as it is a volume {{(pid=74613) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 29 18:04:53 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:04:54 user nova-compute[74613]: DEBUG nova.network.neutron [None req-8fdf4cec-5620-4a5a-8148-38328ce83814 tempest-ServerActionsTestOtherA-1784608629 tempest-ServerActionsTestOtherA-1784608629-project-member] [instance: e9acfa30-4ec2-4540-ac34-4c66db3228e1] Port 8cd31427-1812-40fb-8018-d8f24a5b1792 binding to destination host user is already ACTIVE {{(pid=74613) migrate_instance_start /opt/stack/nova/nova/network/neutron.py:3170}}
Nov 29 18:04:55 user nova-compute[74613]: DEBUG nova.compute.manager [req-cfad6a63-64fe-4b74-9f59-a5ce2589b200 req-d27ef8dc-de87-4ee4-b757-988787d150d6 service nova] [instance: e9acfa30-4ec2-4540-ac34-4c66db3228e1] Received event network-vif-plugged-8cd31427-1812-40fb-8018-d8f24a5b1792 {{(pid=74613) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 18:04:55 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-cfad6a63-64fe-4b74-9f59-a5ce2589b200 req-d27ef8dc-de87-4ee4-b757-988787d150d6 service nova] Acquiring lock "e9acfa30-4ec2-4540-ac34-4c66db3228e1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 18:04:55 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-cfad6a63-64fe-4b74-9f59-a5ce2589b200 req-d27ef8dc-de87-4ee4-b757-988787d150d6 service nova] Lock "e9acfa30-4ec2-4540-ac34-4c66db3228e1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 18:04:55 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-cfad6a63-64fe-4b74-9f59-a5ce2589b200 req-d27ef8dc-de87-4ee4-b757-988787d150d6 service nova] Lock "e9acfa30-4ec2-4540-ac34-4c66db3228e1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 18:04:55 user nova-compute[74613]: DEBUG nova.compute.manager [req-cfad6a63-64fe-4b74-9f59-a5ce2589b200 req-d27ef8dc-de87-4ee4-b757-988787d150d6 service nova] [instance: e9acfa30-4ec2-4540-ac34-4c66db3228e1] No waiting events found dispatching network-vif-plugged-8cd31427-1812-40fb-8018-d8f24a5b1792 {{(pid=74613) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 18:04:55 user nova-compute[74613]: WARNING nova.compute.manager [req-cfad6a63-64fe-4b74-9f59-a5ce2589b200 req-d27ef8dc-de87-4ee4-b757-988787d150d6 service nova] [instance: e9acfa30-4ec2-4540-ac34-4c66db3228e1] Received unexpected event network-vif-plugged-8cd31427-1812-40fb-8018-d8f24a5b1792 for instance with vm_state active and task_state resize_migrating.
Nov 29 18:04:55 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-8fdf4cec-5620-4a5a-8148-38328ce83814 tempest-ServerActionsTestOtherA-1784608629 tempest-ServerActionsTestOtherA-1784608629-project-member] Acquiring lock "e9acfa30-4ec2-4540-ac34-4c66db3228e1-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 18:04:55 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-8fdf4cec-5620-4a5a-8148-38328ce83814 tempest-ServerActionsTestOtherA-1784608629 tempest-ServerActionsTestOtherA-1784608629-project-member] Lock "e9acfa30-4ec2-4540-ac34-4c66db3228e1-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 18:04:55 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-8fdf4cec-5620-4a5a-8148-38328ce83814 tempest-ServerActionsTestOtherA-1784608629 tempest-ServerActionsTestOtherA-1784608629-project-member] Lock "e9acfa30-4ec2-4540-ac34-4c66db3228e1-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 18:04:55 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-8fdf4cec-5620-4a5a-8148-38328ce83814 tempest-ServerActionsTestOtherA-1784608629 tempest-ServerActionsTestOtherA-1784608629-project-member] Acquiring lock "refresh_cache-e9acfa30-4ec2-4540-ac34-4c66db3228e1" {{(pid=74613) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 18:04:55 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-8fdf4cec-5620-4a5a-8148-38328ce83814 tempest-ServerActionsTestOtherA-1784608629 tempest-ServerActionsTestOtherA-1784608629-project-member] Acquired lock "refresh_cache-e9acfa30-4ec2-4540-ac34-4c66db3228e1" {{(pid=74613) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 18:04:55 user nova-compute[74613]: DEBUG nova.network.neutron [None req-8fdf4cec-5620-4a5a-8148-38328ce83814 tempest-ServerActionsTestOtherA-1784608629 tempest-ServerActionsTestOtherA-1784608629-project-member] [instance: e9acfa30-4ec2-4540-ac34-4c66db3228e1] Building network info cache for instance {{(pid=74613) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 29 18:04:55 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:04:55 user nova-compute[74613]: DEBUG nova.network.neutron [None req-8fdf4cec-5620-4a5a-8148-38328ce83814 tempest-ServerActionsTestOtherA-1784608629 tempest-ServerActionsTestOtherA-1784608629-project-member] [instance: e9acfa30-4ec2-4540-ac34-4c66db3228e1] Updating instance_info_cache with network_info: [{"id": "8cd31427-1812-40fb-8018-d8f24a5b1792", "address": "fa:16:3e:97:0e:ed", "network": {"id": "7c2c368e-4c7d-4d70-9a40-c10fe9541af9", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1287934102-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.103", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b1f70c311d4941c986de21ac458d11ab", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8cd31427-18", "ovs_interfaceid": "8cd31427-1812-40fb-8018-d8f24a5b1792", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74613) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 18:04:55 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-8fdf4cec-5620-4a5a-8148-38328ce83814 tempest-ServerActionsTestOtherA-1784608629 tempest-ServerActionsTestOtherA-1784608629-project-member] Releasing lock "refresh_cache-e9acfa30-4ec2-4540-ac34-4c66db3228e1" {{(pid=74613) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 18:04:55 user nova-compute[74613]: DEBUG os_brick.utils [None req-8fdf4cec-5620-4a5a-8148-38328ce83814 tempest-ServerActionsTestOtherA-1784608629 tempest-ServerActionsTestOtherA-1784608629-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74613) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 18:04:55 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:04:55 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:04:55 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[403b409b-1b92-44d1-bc16-85cb7e4e2166]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:400972819b5\n', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 18:04:55 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:04:55 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.014s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:04:55 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[b91a92ca-e28b-4ae0-87f4-0658602da9d6]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 18:04:55 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:04:55 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:04:55 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[69a91a16-5730-470f-b5cd-01cf9c16aeff]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 18:04:55 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[0608ba5b-2879-4b0d-b88a-5b08bf4ba3eb]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 18:04:55 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-8fdf4cec-5620-4a5a-8148-38328ce83814 tempest-ServerActionsTestOtherA-1784608629 tempest-ServerActionsTestOtherA-1784608629-project-member] Running cmd (subprocess): nvme version {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:04:55 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-8fdf4cec-5620-4a5a-8148-38328ce83814 tempest-ServerActionsTestOtherA-1784608629 tempest-ServerActionsTestOtherA-1784608629-project-member] 'nvme version' failed. Not Retrying. {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 18:04:55 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.nvmeof [None req-8fdf4cec-5620-4a5a-8148-38328ce83814 tempest-ServerActionsTestOtherA-1784608629 tempest-ServerActionsTestOtherA-1784608629-project-member] nvme not present on system {{(pid=74613) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 29 18:04:55 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:04:55 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 18:04:55 user nova-compute[74613]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 29 18:04:55 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[a025062e-c461-4cf3-a4c9-2dd8b514704b]: (4, '') {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 18:04:55 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.lightos [None req-8fdf4cec-5620-4a5a-8148-38328ce83814 tempest-ServerActionsTestOtherA-1784608629 tempest-ServerActionsTestOtherA-1784608629-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74613) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 29 18:04:55 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.lightos [None req-8fdf4cec-5620-4a5a-8148-38328ce83814 tempest-ServerActionsTestOtherA-1784608629 tempest-ServerActionsTestOtherA-1784608629-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74613) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 29 18:04:55 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.lightos [None req-8fdf4cec-5620-4a5a-8148-38328ce83814 tempest-ServerActionsTestOtherA-1784608629 tempest-ServerActionsTestOtherA-1784608629-project-member] LIGHTOS: no hostnqn found. {{(pid=74613) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 29 18:04:55 user nova-compute[74613]: DEBUG os_brick.utils [None req-8fdf4cec-5620-4a5a-8148-38328ce83814 tempest-ServerActionsTestOtherA-1784608629 tempest-ServerActionsTestOtherA-1784608629-project-member] <== get_connector_properties: return (122ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:400972819b5', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74613) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 18:04:58 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:04:58 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:05:00 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:05:00 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:05:00 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:05:03 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:05:03 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-8fdf4cec-5620-4a5a-8148-38328ce83814 tempest-ServerActionsTestOtherA-1784608629 tempest-ServerActionsTestOtherA-1784608629-project-member] [instance: e9acfa30-4ec2-4540-ac34-4c66db3228e1] Starting finish_migration {{(pid=74613) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11671}}
Nov 29 18:05:03 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-8fdf4cec-5620-4a5a-8148-38328ce83814 tempest-ServerActionsTestOtherA-1784608629 tempest-ServerActionsTestOtherA-1784608629-project-member] [instance: e9acfa30-4ec2-4540-ac34-4c66db3228e1] Instance directory exists: not creating {{(pid=74613) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Nov 29 18:05:03 user nova-compute[74613]: INFO nova.virt.libvirt.driver [None req-8fdf4cec-5620-4a5a-8148-38328ce83814 tempest-ServerActionsTestOtherA-1784608629 tempest-ServerActionsTestOtherA-1784608629-project-member] [instance: e9acfa30-4ec2-4540-ac34-4c66db3228e1] Creating image(s)
Nov 29 18:05:03 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-8fdf4cec-5620-4a5a-8148-38328ce83814 tempest-ServerActionsTestOtherA-1784608629 tempest-ServerActionsTestOtherA-1784608629-project-member] [instance: e9acfa30-4ec2-4540-ac34-4c66db3228e1] Did not create local disks {{(pid=74613) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 29 18:05:03 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-8fdf4cec-5620-4a5a-8148-38328ce83814 tempest-ServerActionsTestOtherA-1784608629 tempest-ServerActionsTestOtherA-1784608629-project-member] [instance: e9acfa30-4ec2-4540-ac34-4c66db3228e1] Ensure instance console log exists: /opt/stack/data/nova/instances/e9acfa30-4ec2-4540-ac34-4c66db3228e1/console.log {{(pid=74613) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 29 18:05:03 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-8fdf4cec-5620-4a5a-8148-38328ce83814 tempest-ServerActionsTestOtherA-1784608629 tempest-ServerActionsTestOtherA-1784608629-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 18:05:03 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-8fdf4cec-5620-4a5a-8148-38328ce83814 tempest-ServerActionsTestOtherA-1784608629 tempest-ServerActionsTestOtherA-1784608629-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 18:05:03 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-8fdf4cec-5620-4a5a-8148-38328ce83814 tempest-ServerActionsTestOtherA-1784608629 tempest-ServerActionsTestOtherA-1784608629-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 18:05:03 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-8fdf4cec-5620-4a5a-8148-38328ce83814 tempest-ServerActionsTestOtherA-1784608629 tempest-ServerActionsTestOtherA-1784608629-project-member] [instance: e9acfa30-4ec2-4540-ac34-4c66db3228e1] Start _get_guest_xml network_info=[{"id": "8cd31427-1812-40fb-8018-d8f24a5b1792", "address": "fa:16:3e:97:0e:ed", "network": {"id": "7c2c368e-4c7d-4d70-9a40-c10fe9541af9", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1287934102-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.103", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-1287934102-network", "vif_mac": "fa:16:3e:97:0e:ed"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b1f70c311d4941c986de21ac458d11ab", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8cd31427-18", "ovs_interfaceid": "8cd31427-1812-40fb-8018-d8f24a5b1792", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:a8c53a27-dcde-402b-a9bb-d8642f7db0da', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'SLOlKdrc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'attaching', 'instance': 'e9acfa30-4ec2-4540-ac34-4c66db3228e1', 'attached_at': '2023-11-29T18:05:04.000000', 'detached_at': '', 'volume_id': 'a8c53a27-dcde-402b-a9bb-d8642f7db0da', 'serial': 'a8c53a27-dcde-402b-a9bb-d8642f7db0da'}, 'mount_device': '/dev/vda', 'delete_on_termination': True, 'device_type': 'disk', 'boot_index': 0, 'guest_format': None, 'attachment_id': '900ab11c-0745-4095-b41a-3ef010d8ad4a', 'disk_bus': 'virtio', 'volume_type': None} {{(pid=74613) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 29 18:05:03 user nova-compute[74613]: WARNING nova.virt.libvirt.driver [None req-8fdf4cec-5620-4a5a-8148-38328ce83814 tempest-ServerActionsTestOtherA-1784608629 tempest-ServerActionsTestOtherA-1784608629-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 18:05:03 user nova-compute[74613]: WARNING nova.virt.libvirt.driver [None req-8fdf4cec-5620-4a5a-8148-38328ce83814 tempest-ServerActionsTestOtherA-1784608629 tempest-ServerActionsTestOtherA-1784608629-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 18:05:03 user nova-compute[74613]: DEBUG nova.virt.libvirt.host [None req-8fdf4cec-5620-4a5a-8148-38328ce83814 tempest-ServerActionsTestOtherA-1784608629 tempest-ServerActionsTestOtherA-1784608629-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74613) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 29 18:05:03 user nova-compute[74613]: DEBUG nova.virt.libvirt.host [None req-8fdf4cec-5620-4a5a-8148-38328ce83814 tempest-ServerActionsTestOtherA-1784608629 tempest-ServerActionsTestOtherA-1784608629-project-member] CPU controller missing on host. {{(pid=74613) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 29 18:05:03 user nova-compute[74613]: DEBUG nova.virt.libvirt.host [None req-8fdf4cec-5620-4a5a-8148-38328ce83814 tempest-ServerActionsTestOtherA-1784608629 tempest-ServerActionsTestOtherA-1784608629-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74613) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 29 18:05:03 user nova-compute[74613]: DEBUG nova.virt.libvirt.host [None req-8fdf4cec-5620-4a5a-8148-38328ce83814 tempest-ServerActionsTestOtherA-1784608629 tempest-ServerActionsTestOtherA-1784608629-project-member] CPU controller found on host. {{(pid=74613) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 29 18:05:03 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-8fdf4cec-5620-4a5a-8148-38328ce83814 tempest-ServerActionsTestOtherA-1784608629 tempest-ServerActionsTestOtherA-1784608629-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74613) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 29 18:05:03 user nova-compute[74613]: DEBUG nova.virt.hardware [None req-8fdf4cec-5620-4a5a-8148-38328ce83814 tempest-ServerActionsTestOtherA-1784608629 tempest-ServerActionsTestOtherA-1784608629-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-29T17:47:29Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='2',id=7,is_public=True,memory_mb=2048,name='m1.small',projects=<?>,root_gb=20,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74613) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 29 18:05:03 user nova-compute[74613]: DEBUG nova.virt.hardware [None req-8fdf4cec-5620-4a5a-8148-38328ce83814 tempest-ServerActionsTestOtherA-1784608629 tempest-ServerActionsTestOtherA-1784608629-project-member] Flavor limits 0:0:0 {{(pid=74613) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 29 18:05:03 user nova-compute[74613]: DEBUG nova.virt.hardware [None req-8fdf4cec-5620-4a5a-8148-38328ce83814 tempest-ServerActionsTestOtherA-1784608629 tempest-ServerActionsTestOtherA-1784608629-project-member] Image limits 0:0:0 {{(pid=74613) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 29 18:05:03 user nova-compute[74613]: DEBUG nova.virt.hardware [None req-8fdf4cec-5620-4a5a-8148-38328ce83814 tempest-ServerActionsTestOtherA-1784608629 tempest-ServerActionsTestOtherA-1784608629-project-member] Flavor pref 0:0:0 {{(pid=74613) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 29 18:05:03 user nova-compute[74613]: DEBUG nova.virt.hardware [None req-8fdf4cec-5620-4a5a-8148-38328ce83814 tempest-ServerActionsTestOtherA-1784608629 tempest-ServerActionsTestOtherA-1784608629-project-member] Image pref 0:0:0 {{(pid=74613) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 29 18:05:03 user nova-compute[74613]: DEBUG nova.virt.hardware [None req-8fdf4cec-5620-4a5a-8148-38328ce83814 tempest-ServerActionsTestOtherA-1784608629 tempest-ServerActionsTestOtherA-1784608629-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74613) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 29 18:05:03 user nova-compute[74613]: DEBUG nova.virt.hardware [None req-8fdf4cec-5620-4a5a-8148-38328ce83814 tempest-ServerActionsTestOtherA-1784608629 tempest-ServerActionsTestOtherA-1784608629-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74613) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 29 18:05:03 user nova-compute[74613]: DEBUG nova.virt.hardware [None req-8fdf4cec-5620-4a5a-8148-38328ce83814 tempest-ServerActionsTestOtherA-1784608629 tempest-ServerActionsTestOtherA-1784608629-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74613) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 29 18:05:03 user nova-compute[74613]: DEBUG nova.virt.hardware [None req-8fdf4cec-5620-4a5a-8148-38328ce83814 tempest-ServerActionsTestOtherA-1784608629 tempest-ServerActionsTestOtherA-1784608629-project-member] Got 1 possible topologies {{(pid=74613) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 29 18:05:03 user nova-compute[74613]: DEBUG nova.virt.hardware [None req-8fdf4cec-5620-4a5a-8148-38328ce83814 tempest-ServerActionsTestOtherA-1784608629 tempest-ServerActionsTestOtherA-1784608629-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74613) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 29 18:05:03 user nova-compute[74613]: DEBUG nova.virt.hardware [None req-8fdf4cec-5620-4a5a-8148-38328ce83814 tempest-ServerActionsTestOtherA-1784608629 tempest-ServerActionsTestOtherA-1784608629-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74613) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 29 18:05:03 user nova-compute[74613]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8fdf4cec-5620-4a5a-8148-38328ce83814 tempest-ServerActionsTestOtherA-1784608629 tempest-ServerActionsTestOtherA-1784608629-project-member] [instance: e9acfa30-4ec2-4540-ac34-4c66db3228e1] Calling os-brick to attach iSCSI Volume {{(pid=74613) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 29 18:05:03 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-8fdf4cec-5620-4a5a-8148-38328ce83814 tempest-ServerActionsTestOtherA-1784608629 tempest-ServerActionsTestOtherA-1784608629-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff828156890>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:a8c53a27-dcde-402b-a9bb-d8642f7db0da', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'SLOlKdrc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74613) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 18:05:03 user nova-compute[74613]: WARNING os_brick.initiator.connectors.base [None req-8fdf4cec-5620-4a5a-8148-38328ce83814 tempest-ServerActionsTestOtherA-1784608629 tempest-ServerActionsTestOtherA-1784608629-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 18:05:03 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.base [None req-8fdf4cec-5620-4a5a-8148-38328ce83814 tempest-ServerActionsTestOtherA-1784608629 tempest-ServerActionsTestOtherA-1784608629-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 18:05:03 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.base [None req-8fdf4cec-5620-4a5a-8148-38328ce83814 tempest-ServerActionsTestOtherA-1784608629 tempest-ServerActionsTestOtherA-1784608629-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 18:05:03 user nova-compute[74613]: WARNING os_brick.initiator.connectors.base [None req-8fdf4cec-5620-4a5a-8148-38328ce83814 tempest-ServerActionsTestOtherA-1784608629 tempest-ServerActionsTestOtherA-1784608629-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 18:05:03 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.base [None req-8fdf4cec-5620-4a5a-8148-38328ce83814 tempest-ServerActionsTestOtherA-1784608629 tempest-ServerActionsTestOtherA-1784608629-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a8c53a27-dcde-402b-a9bb-d8642f7db0da" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 18:05:03 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.base [None req-8fdf4cec-5620-4a5a-8148-38328ce83814 tempest-ServerActionsTestOtherA-1784608629 tempest-ServerActionsTestOtherA-1784608629-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a8c53a27-dcde-402b-a9bb-d8642f7db0da" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 18:05:03 user nova-compute[74613]: INFO os_brick.initiator.connectors.iscsi [None req-8fdf4cec-5620-4a5a-8148-38328ce83814 tempest-ServerActionsTestOtherA-1784608629 tempest-ServerActionsTestOtherA-1784608629-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 29 18:05:03 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a8c53a27-dcde-402b-a9bb-d8642f7db0da -p 172.16.0.220:3260 {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:05:03 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a8c53a27-dcde-402b-a9bb-d8642f7db0da -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:05:03 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f076265-1d19-4dcb-8022-de9094662669]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 18:05:03 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-8fdf4cec-5620-4a5a-8148-38328ce83814 tempest-ServerActionsTestOtherA-1784608629 tempest-ServerActionsTestOtherA-1784608629-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 29 18:05:03 user nova-compute[74613]:  {{(pid=74613) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 18:05:03 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a8c53a27-dcde-402b-a9bb-d8642f7db0da -p 172.16.0.220:3260 --interface default --op new {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:05:03 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a8c53a27-dcde-402b-a9bb-d8642f7db0da -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:05:03 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a99f799-3995-4928-86df-788c2d55ba2a]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a8c53a27-dcde-402b-a9bb-d8642f7db0da] added\n', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 18:05:03 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-8fdf4cec-5620-4a5a-8148-38328ce83814 tempest-ServerActionsTestOtherA-1784608629 tempest-ServerActionsTestOtherA-1784608629-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a8c53a27-dcde-402b-a9bb-d8642f7db0da] added
Nov 29 18:05:03 user nova-compute[74613]:  stderr= {{(pid=74613) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 18:05:03 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a8c53a27-dcde-402b-a9bb-d8642f7db0da -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:05:03 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a8c53a27-dcde-402b-a9bb-d8642f7db0da -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.023s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:05:03 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0e6d414-6eaf-4d41-afd0-990c67dd06b1]: (4, ('', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 18:05:03 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-8fdf4cec-5620-4a5a-8148-38328ce83814 tempest-ServerActionsTestOtherA-1784608629 tempest-ServerActionsTestOtherA-1784608629-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74613) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 18:05:03 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a8c53a27-dcde-402b-a9bb-d8642f7db0da -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:05:03 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a8c53a27-dcde-402b-a9bb-d8642f7db0da -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:05:03 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[c49d662e-b061-4a3d-b2cc-a2a894843cae]: (4, ('', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 18:05:03 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-8fdf4cec-5620-4a5a-8148-38328ce83814 tempest-ServerActionsTestOtherA-1784608629 tempest-ServerActionsTestOtherA-1784608629-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74613) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 18:05:03 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a8c53a27-dcde-402b-a9bb-d8642f7db0da -p 172.16.0.220:3260 --op update -n node.session.auth.username -v SLOlKdrc {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:05:04 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a8c53a27-dcde-402b-a9bb-d8642f7db0da -p 172.16.0.220:3260 --op update -n node.session.auth.username -v SLOlKdrc" returned: 0 in 0.018s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:05:04 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[2232eb05-85e9-497b-8fc9-4b88f7cbf52f]: (4, ('', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 18:05:04 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-8fdf4cec-5620-4a5a-8148-38328ce83814 tempest-ServerActionsTestOtherA-1784608629 tempest-ServerActionsTestOtherA-1784608629-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'SLOlKdrc'): stdout= stderr= {{(pid=74613) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 18:05:04 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a8c53a27-dcde-402b-a9bb-d8642f7db0da -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:05:04 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a8c53a27-dcde-402b-a9bb-d8642f7db0da -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.023s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:05:04 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[e833ad55-271c-4cd3-8a88-e87bbb253cb5]: (4, ('', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 18:05:04 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-8fdf4cec-5620-4a5a-8148-38328ce83814 tempest-ServerActionsTestOtherA-1784608629 tempest-ServerActionsTestOtherA-1784608629-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74613) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 18:05:04 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:05:04 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:05:04 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[57a9beb8-a6ce-4001-90cd-0a1812ab1710]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9511387c-8772-40f2-bf2d-6b6387649e9f (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9aad94d-fe0d-415d-9761-9aff25cc6099 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:32c4a58d-da1b-468d-b32a-6ff5cdc8993d (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4a04a56-f988-4ae8-a3d3-271caf058c33 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01de4abf-62b4-4200-97dc-9a38d07324e5 (non-flash)\n', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 18:05:04 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-8fdf4cec-5620-4a5a-8148-38328ce83814 tempest-ServerActionsTestOtherA-1784608629 tempest-ServerActionsTestOtherA-1784608629-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9511387c-8772-40f2-bf2d-6b6387649e9f (non-flash)
Nov 29 18:05:04 user nova-compute[74613]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9aad94d-fe0d-415d-9761-9aff25cc6099 (non-flash)
Nov 29 18:05:04 user nova-compute[74613]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:32c4a58d-da1b-468d-b32a-6ff5cdc8993d (non-flash)
Nov 29 18:05:04 user nova-compute[74613]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4a04a56-f988-4ae8-a3d3-271caf058c33 (non-flash)
Nov 29 18:05:04 user nova-compute[74613]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01de4abf-62b4-4200-97dc-9a38d07324e5 (non-flash)
Nov 29 18:05:04 user nova-compute[74613]:  stderr= {{(pid=74613) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 18:05:04 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-8fdf4cec-5620-4a5a-8148-38328ce83814 tempest-ServerActionsTestOtherA-1784608629 tempest-ServerActionsTestOtherA-1784608629-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9511387c-8772-40f2-bf2d-6b6387649e9f (non-flash)
Nov 29 18:05:04 user nova-compute[74613]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9aad94d-fe0d-415d-9761-9aff25cc6099 (non-flash)
Nov 29 18:05:04 user nova-compute[74613]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:32c4a58d-da1b-468d-b32a-6ff5cdc8993d (non-flash)
Nov 29 18:05:04 user nova-compute[74613]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4a04a56-f988-4ae8-a3d3-271caf058c33 (non-flash)
Nov 29 18:05:04 user nova-compute[74613]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01de4abf-62b4-4200-97dc-9a38d07324e5 (non-flash)
Nov 29 18:05:04 user nova-compute[74613]:  stderr= {{(pid=74613) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 18:05:04 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a8c53a27-dcde-402b-a9bb-d8642f7db0da -p 172.16.0.220:3260 --login {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:05:04 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a8c53a27-dcde-402b-a9bb-d8642f7db0da -p 172.16.0.220:3260 --login" returned: 0 in 0.074s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:05:04 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[1135cd65-7942-4ca7-a0d7-b53852efd0ae]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:a8c53a27-dcde-402b-a9bb-d8642f7db0da, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:a8c53a27-dcde-402b-a9bb-d8642f7db0da, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 18:05:04 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-8fdf4cec-5620-4a5a-8148-38328ce83814 tempest-ServerActionsTestOtherA-1784608629 tempest-ServerActionsTestOtherA-1784608629-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:a8c53a27-dcde-402b-a9bb-d8642f7db0da, portal: 172.16.0.220,3260]
Nov 29 18:05:04 user nova-compute[74613]: Login to [iface: default, target: iqn.2010-10.org.openstack:a8c53a27-dcde-402b-a9bb-d8642f7db0da, portal: 172.16.0.220,3260] successful.
Nov 29 18:05:04 user nova-compute[74613]:  stderr= {{(pid=74613) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 18:05:04 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a8c53a27-dcde-402b-a9bb-d8642f7db0da -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:05:04 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a8c53a27-dcde-402b-a9bb-d8642f7db0da -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.025s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:05:04 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[68f77483-be5c-48a2-ab16-65c673e673ae]: (4, ('', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 18:05:04 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-8fdf4cec-5620-4a5a-8148-38328ce83814 tempest-ServerActionsTestOtherA-1784608629 tempest-ServerActionsTestOtherA-1784608629-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74613) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 18:05:04 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:05:04 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:05:04 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb8a9b1e-4c31-4b29-9354-86bd8c60a387]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9511387c-8772-40f2-bf2d-6b6387649e9f (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9aad94d-fe0d-415d-9761-9aff25cc6099 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:32c4a58d-da1b-468d-b32a-6ff5cdc8993d (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4a04a56-f988-4ae8-a3d3-271caf058c33 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01de4abf-62b4-4200-97dc-9a38d07324e5 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8c53a27-dcde-402b-a9bb-d8642f7db0da (non-flash)\n', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 18:05:04 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-8fdf4cec-5620-4a5a-8148-38328ce83814 tempest-ServerActionsTestOtherA-1784608629 tempest-ServerActionsTestOtherA-1784608629-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9511387c-8772-40f2-bf2d-6b6387649e9f (non-flash)
Nov 29 18:05:04 user nova-compute[74613]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9aad94d-fe0d-415d-9761-9aff25cc6099 (non-flash)
Nov 29 18:05:04 user nova-compute[74613]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:32c4a58d-da1b-468d-b32a-6ff5cdc8993d (non-flash)
Nov 29 18:05:04 user nova-compute[74613]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4a04a56-f988-4ae8-a3d3-271caf058c33 (non-flash)
Nov 29 18:05:04 user nova-compute[74613]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01de4abf-62b4-4200-97dc-9a38d07324e5 (non-flash)
Nov 29 18:05:04 user nova-compute[74613]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8c53a27-dcde-402b-a9bb-d8642f7db0da (non-flash)
Nov 29 18:05:04 user nova-compute[74613]:  stderr= {{(pid=74613) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 18:05:04 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-8fdf4cec-5620-4a5a-8148-38328ce83814 tempest-ServerActionsTestOtherA-1784608629 tempest-ServerActionsTestOtherA-1784608629-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9511387c-8772-40f2-bf2d-6b6387649e9f (non-flash)
Nov 29 18:05:04 user nova-compute[74613]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9aad94d-fe0d-415d-9761-9aff25cc6099 (non-flash)
Nov 29 18:05:04 user nova-compute[74613]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:32c4a58d-da1b-468d-b32a-6ff5cdc8993d (non-flash)
Nov 29 18:05:04 user nova-compute[74613]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4a04a56-f988-4ae8-a3d3-271caf058c33 (non-flash)
Nov 29 18:05:04 user nova-compute[74613]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01de4abf-62b4-4200-97dc-9a38d07324e5 (non-flash)
Nov 29 18:05:04 user nova-compute[74613]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8c53a27-dcde-402b-a9bb-d8642f7db0da (non-flash)
Nov 29 18:05:04 user nova-compute[74613]:  stderr= {{(pid=74613) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 18:05:04 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.base [None req-8fdf4cec-5620-4a5a-8148-38328ce83814 tempest-ServerActionsTestOtherA-1784608629 tempest-ServerActionsTestOtherA-1784608629-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a8c53a27-dcde-402b-a9bb-d8642f7db0da" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.312s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 18:05:04 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-8fdf4cec-5620-4a5a-8148-38328ce83814 tempest-ServerActionsTestOtherA-1784608629 tempest-ServerActionsTestOtherA-1784608629-project-member] Connected to 172.16.0.220:3260 {{(pid=74613) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 29 18:05:04 user nova-compute[74613]: DEBUG os_brick.initiator.linuxscsi [None req-8fdf4cec-5620-4a5a-8148-38328ce83814 tempest-ServerActionsTestOtherA-1784608629 tempest-ServerActionsTestOtherA-1784608629-project-member] HCTL ('36', '-', '-', 0) found on session 33 with lun 0 {{(pid=74613) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 29 18:05:04 user nova-compute[74613]: DEBUG os_brick.initiator.linuxscsi [None req-8fdf4cec-5620-4a5a-8148-38328ce83814 tempest-ServerActionsTestOtherA-1784608629 tempest-ServerActionsTestOtherA-1784608629-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=74613) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 29 18:05:04 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:05:04 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.017s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:05:04 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[438e3f9f-ce22-46f3-8963-b1ef192b6617]: (4, ('- - 0', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 18:05:04 user nova-compute[74613]: DEBUG os_brick.initiator.linuxscsi [None req-8fdf4cec-5620-4a5a-8148-38328ce83814 tempest-ServerActionsTestOtherA-1784608629 tempest-ServerActionsTestOtherA-1784608629-project-member] Searching for a device in session 33 and hctl ['36', '*', '*', 0] yield: sde {{(pid=74613) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 29 18:05:04 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-8fdf4cec-5620-4a5a-8148-38328ce83814 tempest-ServerActionsTestOtherA-1784608629 tempest-ServerActionsTestOtherA-1784608629-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:a8c53a27-dcde-402b-a9bb-d8642f7db0da', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'SLOlKdrc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74613) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 29 18:05:04 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:05:05 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.base [None req-8fdf4cec-5620-4a5a-8148-38328ce83814 tempest-ServerActionsTestOtherA-1784608629 tempest-ServerActionsTestOtherA-1784608629-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.347s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 18:05:05 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-8fdf4cec-5620-4a5a-8148-38328ce83814 tempest-ServerActionsTestOtherA-1784608629 tempest-ServerActionsTestOtherA-1784608629-project-member] <== connect_volume: return (1348ms) {'type': 'block', 'scsi_wwn': '26236623632373761', 'path': '/dev/sde'} {{(pid=74613) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 18:05:05 user nova-compute[74613]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8fdf4cec-5620-4a5a-8148-38328ce83814 tempest-ServerActionsTestOtherA-1784608629 tempest-ServerActionsTestOtherA-1784608629-project-member] [instance: e9acfa30-4ec2-4540-ac34-4c66db3228e1] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26236623632373761', 'path': '/dev/sde'} {{(pid=74613) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 29 18:05:05 user nova-compute[74613]: DEBUG nova.virt.libvirt.vif [None req-8fdf4cec-5620-4a5a-8148-38328ce83814 tempest-ServerActionsTestOtherA-1784608629 tempest-ServerActionsTestOtherA-1784608629-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T18:02:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1745064093',display_name='tempest-ServerActionsTestOtherA-server-1745064093',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-1745064093',id=25,image_ref='',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIpucl9TdiuMtgo2HD8A0S0XK6/wskQQSBMcoxjyazAtLZUlGJCbAbNEhyc7Esm1yWePtzGTrNFIbg4z5HCtj+7HLtHc8+57P9i9m4iI8l/z1ZnWm+BWBA3bkBkjzP6q3Q==',key_name='tempest-keypair-1839431126',keypairs=<?>,launch_index=0,launched_at=2023-11-29T18:03:12Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='b1f70c311d4941c986de21ac458d11ab',ramdisk_id='',reservation_id='r-cod9xl0z',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherA-1784608629',owner_user_name='tempest-ServerActionsTestOtherA-1784608629-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T18:04:55Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='368555c72103480b82c5c0bf64b07360',uuid=e9acfa30-4ec2-4540-ac34-4c66db3228e1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "8cd31427-1812-40fb-8018-d8f24a5b1792", "address": "fa:16:3e:97:0e:ed", "network": {"id": "7c2c368e-4c7d-4d70-9a40-c10fe9541af9", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1287934102-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.103", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-1287934102-network", "vif_mac": "fa:16:3e:97:0e:ed"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b1f70c311d4941c986de21ac458d11ab", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8cd31427-18", "ovs_interfaceid": "8cd31427-1812-40fb-8018-d8f24a5b1792", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74613) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 29 18:05:05 user nova-compute[74613]: DEBUG nova.network.os_vif_util [None req-8fdf4cec-5620-4a5a-8148-38328ce83814 tempest-ServerActionsTestOtherA-1784608629 tempest-ServerActionsTestOtherA-1784608629-project-member] Converting VIF {"id": "8cd31427-1812-40fb-8018-d8f24a5b1792", "address": "fa:16:3e:97:0e:ed", "network": {"id": "7c2c368e-4c7d-4d70-9a40-c10fe9541af9", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1287934102-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.103", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-1287934102-network", "vif_mac": "fa:16:3e:97:0e:ed"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b1f70c311d4941c986de21ac458d11ab", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8cd31427-18", "ovs_interfaceid": "8cd31427-1812-40fb-8018-d8f24a5b1792", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74613) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 18:05:05 user nova-compute[74613]: DEBUG nova.network.os_vif_util [None req-8fdf4cec-5620-4a5a-8148-38328ce83814 tempest-ServerActionsTestOtherA-1784608629 tempest-ServerActionsTestOtherA-1784608629-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:97:0e:ed,bridge_name='br-int',has_traffic_filtering=True,id=8cd31427-1812-40fb-8018-d8f24a5b1792,network=Network(7c2c368e-4c7d-4d70-9a40-c10fe9541af9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8cd31427-18') {{(pid=74613) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 18:05:05 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-8fdf4cec-5620-4a5a-8148-38328ce83814 tempest-ServerActionsTestOtherA-1784608629 tempest-ServerActionsTestOtherA-1784608629-project-member] [instance: e9acfa30-4ec2-4540-ac34-4c66db3228e1] End _get_guest_xml xml=<domain type="kvm">
Nov 29 18:05:05 user nova-compute[74613]:   <uuid>e9acfa30-4ec2-4540-ac34-4c66db3228e1</uuid>
Nov 29 18:05:05 user nova-compute[74613]:   <name>instance-00000019</name>
Nov 29 18:05:05 user nova-compute[74613]:   <memory>2097152</memory>
Nov 29 18:05:05 user nova-compute[74613]:   <vcpu>1</vcpu>
Nov 29 18:05:05 user nova-compute[74613]:   <metadata>
Nov 29 18:05:05 user nova-compute[74613]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 29 18:05:05 user nova-compute[74613]:       <nova:package version="0.0.0"/>
Nov 29 18:05:05 user nova-compute[74613]:       <nova:name>tempest-ServerActionsTestOtherA-server-1745064093</nova:name>
Nov 29 18:05:05 user nova-compute[74613]:       <nova:creationTime>2023-11-29 18:05:03</nova:creationTime>
Nov 29 18:05:05 user nova-compute[74613]:       <nova:flavor name="m1.small">
Nov 29 18:05:05 user nova-compute[74613]:         <nova:memory>2048</nova:memory>
Nov 29 18:05:05 user nova-compute[74613]:         <nova:disk>20</nova:disk>
Nov 29 18:05:05 user nova-compute[74613]:         <nova:swap>0</nova:swap>
Nov 29 18:05:05 user nova-compute[74613]:         <nova:ephemeral>0</nova:ephemeral>
Nov 29 18:05:05 user nova-compute[74613]:         <nova:vcpus>1</nova:vcpus>
Nov 29 18:05:05 user nova-compute[74613]:       </nova:flavor>
Nov 29 18:05:05 user nova-compute[74613]:       <nova:owner>
Nov 29 18:05:05 user nova-compute[74613]:         <nova:user uuid="368555c72103480b82c5c0bf64b07360">tempest-ServerActionsTestOtherA-1784608629-project-member</nova:user>
Nov 29 18:05:05 user nova-compute[74613]:         <nova:project uuid="b1f70c311d4941c986de21ac458d11ab">tempest-ServerActionsTestOtherA-1784608629</nova:project>
Nov 29 18:05:05 user nova-compute[74613]:       </nova:owner>
Nov 29 18:05:05 user nova-compute[74613]:       <nova:ports>
Nov 29 18:05:05 user nova-compute[74613]:         <nova:port uuid="8cd31427-1812-40fb-8018-d8f24a5b1792">
Nov 29 18:05:05 user nova-compute[74613]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Nov 29 18:05:05 user nova-compute[74613]:         </nova:port>
Nov 29 18:05:05 user nova-compute[74613]:       </nova:ports>
Nov 29 18:05:05 user nova-compute[74613]:     </nova:instance>
Nov 29 18:05:05 user nova-compute[74613]:   </metadata>
Nov 29 18:05:05 user nova-compute[74613]:   <sysinfo type="smbios">
Nov 29 18:05:05 user nova-compute[74613]:     <system>
Nov 29 18:05:05 user nova-compute[74613]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 29 18:05:05 user nova-compute[74613]:       <entry name="product">OpenStack Nova</entry>
Nov 29 18:05:05 user nova-compute[74613]:       <entry name="version">0.0.0</entry>
Nov 29 18:05:05 user nova-compute[74613]:       <entry name="serial">e9acfa30-4ec2-4540-ac34-4c66db3228e1</entry>
Nov 29 18:05:05 user nova-compute[74613]:       <entry name="uuid">e9acfa30-4ec2-4540-ac34-4c66db3228e1</entry>
Nov 29 18:05:05 user nova-compute[74613]:       <entry name="family">Virtual Machine</entry>
Nov 29 18:05:05 user nova-compute[74613]:     </system>
Nov 29 18:05:05 user nova-compute[74613]:   </sysinfo>
Nov 29 18:05:05 user nova-compute[74613]:   <os>
Nov 29 18:05:05 user nova-compute[74613]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 29 18:05:05 user nova-compute[74613]:     <boot dev="hd"/>
Nov 29 18:05:05 user nova-compute[74613]:     <smbios mode="sysinfo"/>
Nov 29 18:05:05 user nova-compute[74613]:   </os>
Nov 29 18:05:05 user nova-compute[74613]:   <features>
Nov 29 18:05:05 user nova-compute[74613]:     <acpi/>
Nov 29 18:05:05 user nova-compute[74613]:     <apic/>
Nov 29 18:05:05 user nova-compute[74613]:     <vmcoreinfo/>
Nov 29 18:05:05 user nova-compute[74613]:   </features>
Nov 29 18:05:05 user nova-compute[74613]:   <clock offset="utc">
Nov 29 18:05:05 user nova-compute[74613]:     <timer name="pit" tickpolicy="delay"/>
Nov 29 18:05:05 user nova-compute[74613]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 29 18:05:05 user nova-compute[74613]:     <timer name="hpet" present="no"/>
Nov 29 18:05:05 user nova-compute[74613]:   </clock>
Nov 29 18:05:05 user nova-compute[74613]:   <cpu mode="custom" match="exact">
Nov 29 18:05:05 user nova-compute[74613]:     <model>Nehalem</model>
Nov 29 18:05:05 user nova-compute[74613]:     <topology sockets="1" cores="1" threads="1"/>
Nov 29 18:05:05 user nova-compute[74613]:   </cpu>
Nov 29 18:05:05 user nova-compute[74613]:   <devices>
Nov 29 18:05:05 user nova-compute[74613]:     <disk type="block" device="disk">
Nov 29 18:05:05 user nova-compute[74613]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 18:05:05 user nova-compute[74613]:       <source dev="/dev/sde"/>
Nov 29 18:05:05 user nova-compute[74613]:       <target dev="vda" bus="virtio"/>
Nov 29 18:05:05 user nova-compute[74613]:       <serial>a8c53a27-dcde-402b-a9bb-d8642f7db0da</serial>
Nov 29 18:05:05 user nova-compute[74613]:     </disk>
Nov 29 18:05:05 user nova-compute[74613]:     <interface type="ethernet">
Nov 29 18:05:05 user nova-compute[74613]:       <mac address="fa:16:3e:97:0e:ed"/>
Nov 29 18:05:05 user nova-compute[74613]:       <model type="virtio"/>
Nov 29 18:05:05 user nova-compute[74613]:       <mtu size="1442"/>
Nov 29 18:05:05 user nova-compute[74613]:       <target dev="tap8cd31427-18"/>
Nov 29 18:05:05 user nova-compute[74613]:     </interface>
Nov 29 18:05:05 user nova-compute[74613]:     <serial type="pty">
Nov 29 18:05:05 user nova-compute[74613]:       <log file="/opt/stack/data/nova/instances/e9acfa30-4ec2-4540-ac34-4c66db3228e1/console.log" append="off"/>
Nov 29 18:05:05 user nova-compute[74613]:     </serial>
Nov 29 18:05:05 user nova-compute[74613]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 29 18:05:05 user nova-compute[74613]:     <video>
Nov 29 18:05:05 user nova-compute[74613]:       <model type="virtio"/>
Nov 29 18:05:05 user nova-compute[74613]:     </video>
Nov 29 18:05:05 user nova-compute[74613]:     <rng model="virtio">
Nov 29 18:05:05 user nova-compute[74613]:       <backend model="random">/dev/urandom</backend>
Nov 29 18:05:05 user nova-compute[74613]:     </rng>
Nov 29 18:05:05 user nova-compute[74613]:     <controller type="usb" index="0" model="none"/>
Nov 29 18:05:05 user nova-compute[74613]:     <memballoon model="virtio">
Nov 29 18:05:05 user nova-compute[74613]:       <stats period="10"/>
Nov 29 18:05:05 user nova-compute[74613]:     </memballoon>
Nov 29 18:05:05 user nova-compute[74613]:   </devices>
Nov 29 18:05:05 user nova-compute[74613]: </domain>
Nov 29 18:05:05 user nova-compute[74613]:  {{(pid=74613) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 29 18:05:05 user nova-compute[74613]: DEBUG nova.virt.libvirt.vif [None req-8fdf4cec-5620-4a5a-8148-38328ce83814 tempest-ServerActionsTestOtherA-1784608629 tempest-ServerActionsTestOtherA-1784608629-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T18:02:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1745064093',display_name='tempest-ServerActionsTestOtherA-server-1745064093',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-1745064093',id=25,image_ref='',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIpucl9TdiuMtgo2HD8A0S0XK6/wskQQSBMcoxjyazAtLZUlGJCbAbNEhyc7Esm1yWePtzGTrNFIbg4z5HCtj+7HLtHc8+57P9i9m4iI8l/z1ZnWm+BWBA3bkBkjzP6q3Q==',key_name='tempest-keypair-1839431126',keypairs=<?>,launch_index=0,launched_at=2023-11-29T18:03:12Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='b1f70c311d4941c986de21ac458d11ab',ramdisk_id='',reservation_id='r-cod9xl0z',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherA-1784608629',owner_user_name='tempest-ServerActionsTestOtherA-1784608629-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T18:04:55Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='368555c72103480b82c5c0bf64b07360',uuid=e9acfa30-4ec2-4540-ac34-4c66db3228e1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "8cd31427-1812-40fb-8018-d8f24a5b1792", "address": "fa:16:3e:97:0e:ed", "network": {"id": "7c2c368e-4c7d-4d70-9a40-c10fe9541af9", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1287934102-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.103", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-1287934102-network", "vif_mac": "fa:16:3e:97:0e:ed"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b1f70c311d4941c986de21ac458d11ab", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8cd31427-18", "ovs_interfaceid": "8cd31427-1812-40fb-8018-d8f24a5b1792", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74613) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 29 18:05:05 user nova-compute[74613]: DEBUG nova.network.os_vif_util [None req-8fdf4cec-5620-4a5a-8148-38328ce83814 tempest-ServerActionsTestOtherA-1784608629 tempest-ServerActionsTestOtherA-1784608629-project-member] Converting VIF {"id": "8cd31427-1812-40fb-8018-d8f24a5b1792", "address": "fa:16:3e:97:0e:ed", "network": {"id": "7c2c368e-4c7d-4d70-9a40-c10fe9541af9", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1287934102-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.103", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-1287934102-network", "vif_mac": "fa:16:3e:97:0e:ed"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b1f70c311d4941c986de21ac458d11ab", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8cd31427-18", "ovs_interfaceid": "8cd31427-1812-40fb-8018-d8f24a5b1792", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74613) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 18:05:05 user nova-compute[74613]: DEBUG nova.network.os_vif_util [None req-8fdf4cec-5620-4a5a-8148-38328ce83814 tempest-ServerActionsTestOtherA-1784608629 tempest-ServerActionsTestOtherA-1784608629-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:97:0e:ed,bridge_name='br-int',has_traffic_filtering=True,id=8cd31427-1812-40fb-8018-d8f24a5b1792,network=Network(7c2c368e-4c7d-4d70-9a40-c10fe9541af9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8cd31427-18') {{(pid=74613) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 18:05:05 user nova-compute[74613]: DEBUG os_vif [None req-8fdf4cec-5620-4a5a-8148-38328ce83814 tempest-ServerActionsTestOtherA-1784608629 tempest-ServerActionsTestOtherA-1784608629-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:97:0e:ed,bridge_name='br-int',has_traffic_filtering=True,id=8cd31427-1812-40fb-8018-d8f24a5b1792,network=Network(7c2c368e-4c7d-4d70-9a40-c10fe9541af9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8cd31427-18') {{(pid=74613) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 29 18:05:05 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:05:05 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74613) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 18:05:05 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74613) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 29 18:05:05 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:05:05 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'f65a5320-42e5-57de-9e64-ebdcb1f0eab8', '_type': 'linux-noop'}}, row=False) {{(pid=74613) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 18:05:05 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:05:05 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 18:05:05 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:05:05 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap8cd31427-18, may_exist=True, interface_attrs={}) {{(pid=74613) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 18:05:05 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap8cd31427-18, col_values=(('qos', UUID('e510c42b-1704-4b53-8b07-1b81982c57d9')),), if_exists=True) {{(pid=74613) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 18:05:05 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap8cd31427-18, col_values=(('external_ids', {'iface-id': '8cd31427-1812-40fb-8018-d8f24a5b1792', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:97:0e:ed', 'vm-uuid': 'e9acfa30-4ec2-4540-ac34-4c66db3228e1'}),), if_exists=True) {{(pid=74613) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 18:05:05 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:05:05 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 18:05:05 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:05:05 user nova-compute[74613]: INFO os_vif [None req-8fdf4cec-5620-4a5a-8148-38328ce83814 tempest-ServerActionsTestOtherA-1784608629 tempest-ServerActionsTestOtherA-1784608629-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:97:0e:ed,bridge_name='br-int',has_traffic_filtering=True,id=8cd31427-1812-40fb-8018-d8f24a5b1792,network=Network(7c2c368e-4c7d-4d70-9a40-c10fe9541af9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8cd31427-18')
Nov 29 18:05:05 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-8fdf4cec-5620-4a5a-8148-38328ce83814 tempest-ServerActionsTestOtherA-1784608629 tempest-ServerActionsTestOtherA-1784608629-project-member] No BDM found with device name vda, not building metadata. {{(pid=74613) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 18:05:05 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-8fdf4cec-5620-4a5a-8148-38328ce83814 tempest-ServerActionsTestOtherA-1784608629 tempest-ServerActionsTestOtherA-1784608629-project-member] No VIF found with MAC fa:16:3e:97:0e:ed, not building metadata {{(pid=74613) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 29 18:05:05 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:05:06 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:05:06 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:05:06 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:05:06 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:05:06 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:05:06 user nova-compute[74613]: DEBUG nova.compute.manager [req-b2bf0b3c-e98f-4f28-abb5-7ac2c0d1649d req-4390985f-c925-4c87-b9c9-299d721f5930 service nova] [instance: e9acfa30-4ec2-4540-ac34-4c66db3228e1] Received event network-vif-plugged-8cd31427-1812-40fb-8018-d8f24a5b1792 {{(pid=74613) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 18:05:06 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-b2bf0b3c-e98f-4f28-abb5-7ac2c0d1649d req-4390985f-c925-4c87-b9c9-299d721f5930 service nova] Acquiring lock "e9acfa30-4ec2-4540-ac34-4c66db3228e1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 18:05:06 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-b2bf0b3c-e98f-4f28-abb5-7ac2c0d1649d req-4390985f-c925-4c87-b9c9-299d721f5930 service nova] Lock "e9acfa30-4ec2-4540-ac34-4c66db3228e1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 18:05:06 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-b2bf0b3c-e98f-4f28-abb5-7ac2c0d1649d req-4390985f-c925-4c87-b9c9-299d721f5930 service nova] Lock "e9acfa30-4ec2-4540-ac34-4c66db3228e1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 18:05:06 user nova-compute[74613]: DEBUG nova.compute.manager [req-b2bf0b3c-e98f-4f28-abb5-7ac2c0d1649d req-4390985f-c925-4c87-b9c9-299d721f5930 service nova] [instance: e9acfa30-4ec2-4540-ac34-4c66db3228e1] No waiting events found dispatching network-vif-plugged-8cd31427-1812-40fb-8018-d8f24a5b1792 {{(pid=74613) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 18:05:06 user nova-compute[74613]: WARNING nova.compute.manager [req-b2bf0b3c-e98f-4f28-abb5-7ac2c0d1649d req-4390985f-c925-4c87-b9c9-299d721f5930 service nova] [instance: e9acfa30-4ec2-4540-ac34-4c66db3228e1] Received unexpected event network-vif-plugged-8cd31427-1812-40fb-8018-d8f24a5b1792 for instance with vm_state active and task_state resize_finish.
Nov 29 18:05:08 user nova-compute[74613]: DEBUG nova.compute.manager [None req-8fdf4cec-5620-4a5a-8148-38328ce83814 tempest-ServerActionsTestOtherA-1784608629 tempest-ServerActionsTestOtherA-1784608629-project-member] [instance: e9acfa30-4ec2-4540-ac34-4c66db3228e1] Instance event wait completed in 0 seconds for  {{(pid=74613) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 29 18:05:08 user nova-compute[74613]: INFO nova.virt.libvirt.driver [-] [instance: e9acfa30-4ec2-4540-ac34-4c66db3228e1] Instance running successfully.
Nov 29 18:05:08 user nova-compute[74613]: DEBUG nova.virt.libvirt.guest [None req-8fdf4cec-5620-4a5a-8148-38328ce83814 tempest-ServerActionsTestOtherA-1784608629 tempest-ServerActionsTestOtherA-1784608629-project-member] [instance: e9acfa30-4ec2-4540-ac34-4c66db3228e1] Failed to set time: agent not configured {{(pid=74613) sync_guest_time /opt/stack/nova/nova/virt/libvirt/guest.py:200}}
Nov 29 18:05:08 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-8fdf4cec-5620-4a5a-8148-38328ce83814 tempest-ServerActionsTestOtherA-1784608629 tempest-ServerActionsTestOtherA-1784608629-project-member] [instance: e9acfa30-4ec2-4540-ac34-4c66db3228e1] finish_migration finished successfully. {{(pid=74613) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11766}}
Nov 29 18:05:09 user nova-compute[74613]: DEBUG nova.compute.manager [req-b8441f27-42ba-4883-b31f-ef0d73f97cda req-5eb20648-856b-4a35-b6a8-dc41133e3498 service nova] [instance: e9acfa30-4ec2-4540-ac34-4c66db3228e1] Received event network-vif-plugged-8cd31427-1812-40fb-8018-d8f24a5b1792 {{(pid=74613) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 18:05:09 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-b8441f27-42ba-4883-b31f-ef0d73f97cda req-5eb20648-856b-4a35-b6a8-dc41133e3498 service nova] Acquiring lock "e9acfa30-4ec2-4540-ac34-4c66db3228e1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 18:05:09 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-b8441f27-42ba-4883-b31f-ef0d73f97cda req-5eb20648-856b-4a35-b6a8-dc41133e3498 service nova] Lock "e9acfa30-4ec2-4540-ac34-4c66db3228e1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 18:05:09 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-b8441f27-42ba-4883-b31f-ef0d73f97cda req-5eb20648-856b-4a35-b6a8-dc41133e3498 service nova] Lock "e9acfa30-4ec2-4540-ac34-4c66db3228e1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 18:05:09 user nova-compute[74613]: DEBUG nova.compute.manager [req-b8441f27-42ba-4883-b31f-ef0d73f97cda req-5eb20648-856b-4a35-b6a8-dc41133e3498 service nova] [instance: e9acfa30-4ec2-4540-ac34-4c66db3228e1] No waiting events found dispatching network-vif-plugged-8cd31427-1812-40fb-8018-d8f24a5b1792 {{(pid=74613) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 18:05:09 user nova-compute[74613]: WARNING nova.compute.manager [req-b8441f27-42ba-4883-b31f-ef0d73f97cda req-5eb20648-856b-4a35-b6a8-dc41133e3498 service nova] [instance: e9acfa30-4ec2-4540-ac34-4c66db3228e1] Received unexpected event network-vif-plugged-8cd31427-1812-40fb-8018-d8f24a5b1792 for instance with vm_state resized and task_state None.
Nov 29 18:05:09 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-e03c8684-1a20-4509-a8f2-5629f4c9fbc6 tempest-TestStampPattern-2144166935 tempest-TestStampPattern-2144166935-project-member] Acquiring lock "9eb14feb-f196-42b1-a6ba-2a049dea2d5e" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 18:05:09 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-e03c8684-1a20-4509-a8f2-5629f4c9fbc6 tempest-TestStampPattern-2144166935 tempest-TestStampPattern-2144166935-project-member] Lock "9eb14feb-f196-42b1-a6ba-2a049dea2d5e" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 18:05:09 user nova-compute[74613]: DEBUG nova.compute.manager [None req-e03c8684-1a20-4509-a8f2-5629f4c9fbc6 tempest-TestStampPattern-2144166935 tempest-TestStampPattern-2144166935-project-member] [instance: 9eb14feb-f196-42b1-a6ba-2a049dea2d5e] Starting instance... {{(pid=74613) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 29 18:05:10 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-e03c8684-1a20-4509-a8f2-5629f4c9fbc6 tempest-TestStampPattern-2144166935 tempest-TestStampPattern-2144166935-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 18:05:10 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-e03c8684-1a20-4509-a8f2-5629f4c9fbc6 tempest-TestStampPattern-2144166935 tempest-TestStampPattern-2144166935-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 18:05:10 user nova-compute[74613]: DEBUG nova.virt.hardware [None req-e03c8684-1a20-4509-a8f2-5629f4c9fbc6 tempest-TestStampPattern-2144166935 tempest-TestStampPattern-2144166935-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74613) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 29 18:05:10 user nova-compute[74613]: INFO nova.compute.claims [None req-e03c8684-1a20-4509-a8f2-5629f4c9fbc6 tempest-TestStampPattern-2144166935 tempest-TestStampPattern-2144166935-project-member] [instance: 9eb14feb-f196-42b1-a6ba-2a049dea2d5e] Claim successful on node user
Nov 29 18:05:10 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:05:10 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:05:10 user nova-compute[74613]: DEBUG nova.compute.provider_tree [None req-e03c8684-1a20-4509-a8f2-5629f4c9fbc6 tempest-TestStampPattern-2144166935 tempest-TestStampPattern-2144166935-project-member] Inventory has not changed in ProviderTree for provider: 639d980e-3b12-44b1-b8f4-1812416fa4dd {{(pid=74613) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 18:05:10 user nova-compute[74613]: DEBUG nova.scheduler.client.report [None req-e03c8684-1a20-4509-a8f2-5629f4c9fbc6 tempest-TestStampPattern-2144166935 tempest-TestStampPattern-2144166935-project-member] Inventory has not changed for provider 639d980e-3b12-44b1-b8f4-1812416fa4dd based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74613) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 18:05:10 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-e03c8684-1a20-4509-a8f2-5629f4c9fbc6 tempest-TestStampPattern-2144166935 tempest-TestStampPattern-2144166935-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.542s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 18:05:10 user nova-compute[74613]: DEBUG nova.compute.manager [None req-e03c8684-1a20-4509-a8f2-5629f4c9fbc6 tempest-TestStampPattern-2144166935 tempest-TestStampPattern-2144166935-project-member] [instance: 9eb14feb-f196-42b1-a6ba-2a049dea2d5e] Start building networks asynchronously for instance. {{(pid=74613) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 29 18:05:10 user nova-compute[74613]: DEBUG nova.compute.manager [None req-e03c8684-1a20-4509-a8f2-5629f4c9fbc6 tempest-TestStampPattern-2144166935 tempest-TestStampPattern-2144166935-project-member] [instance: 9eb14feb-f196-42b1-a6ba-2a049dea2d5e] Allocating IP information in the background. {{(pid=74613) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 29 18:05:10 user nova-compute[74613]: DEBUG nova.network.neutron [None req-e03c8684-1a20-4509-a8f2-5629f4c9fbc6 tempest-TestStampPattern-2144166935 tempest-TestStampPattern-2144166935-project-member] [instance: 9eb14feb-f196-42b1-a6ba-2a049dea2d5e] allocate_for_instance() {{(pid=74613) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 29 18:05:10 user nova-compute[74613]: INFO nova.virt.libvirt.driver [None req-e03c8684-1a20-4509-a8f2-5629f4c9fbc6 tempest-TestStampPattern-2144166935 tempest-TestStampPattern-2144166935-project-member] [instance: 9eb14feb-f196-42b1-a6ba-2a049dea2d5e] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 29 18:05:10 user nova-compute[74613]: DEBUG nova.compute.manager [None req-e03c8684-1a20-4509-a8f2-5629f4c9fbc6 tempest-TestStampPattern-2144166935 tempest-TestStampPattern-2144166935-project-member] [instance: 9eb14feb-f196-42b1-a6ba-2a049dea2d5e] Start building block device mappings for instance. {{(pid=74613) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 29 18:05:10 user nova-compute[74613]: DEBUG nova.policy [None req-e03c8684-1a20-4509-a8f2-5629f4c9fbc6 tempest-TestStampPattern-2144166935 tempest-TestStampPattern-2144166935-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '7be3452738104c44bc78152e00fe469d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6004d03e0fbd4684bc8f1d341afad3be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74613) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 29 18:05:10 user nova-compute[74613]: DEBUG nova.compute.manager [None req-e03c8684-1a20-4509-a8f2-5629f4c9fbc6 tempest-TestStampPattern-2144166935 tempest-TestStampPattern-2144166935-project-member] [instance: 9eb14feb-f196-42b1-a6ba-2a049dea2d5e] Start spawning the instance on the hypervisor. {{(pid=74613) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 29 18:05:10 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-e03c8684-1a20-4509-a8f2-5629f4c9fbc6 tempest-TestStampPattern-2144166935 tempest-TestStampPattern-2144166935-project-member] [instance: 9eb14feb-f196-42b1-a6ba-2a049dea2d5e] Creating instance directory {{(pid=74613) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 29 18:05:10 user nova-compute[74613]: INFO nova.virt.libvirt.driver [None req-e03c8684-1a20-4509-a8f2-5629f4c9fbc6 tempest-TestStampPattern-2144166935 tempest-TestStampPattern-2144166935-project-member] [instance: 9eb14feb-f196-42b1-a6ba-2a049dea2d5e] Creating image(s)
Nov 29 18:05:10 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-e03c8684-1a20-4509-a8f2-5629f4c9fbc6 tempest-TestStampPattern-2144166935 tempest-TestStampPattern-2144166935-project-member] Acquiring lock "/opt/stack/data/nova/instances/9eb14feb-f196-42b1-a6ba-2a049dea2d5e/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 18:05:10 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-e03c8684-1a20-4509-a8f2-5629f4c9fbc6 tempest-TestStampPattern-2144166935 tempest-TestStampPattern-2144166935-project-member] Lock "/opt/stack/data/nova/instances/9eb14feb-f196-42b1-a6ba-2a049dea2d5e/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 18:05:10 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-e03c8684-1a20-4509-a8f2-5629f4c9fbc6 tempest-TestStampPattern-2144166935 tempest-TestStampPattern-2144166935-project-member] Lock "/opt/stack/data/nova/instances/9eb14feb-f196-42b1-a6ba-2a049dea2d5e/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 18:05:10 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-e03c8684-1a20-4509-a8f2-5629f4c9fbc6 tempest-TestStampPattern-2144166935 tempest-TestStampPattern-2144166935-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/21faea9e6951f3bdd0153b76ac89fe1a60a34758 --force-share --output=json {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:05:11 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-e03c8684-1a20-4509-a8f2-5629f4c9fbc6 tempest-TestStampPattern-2144166935 tempest-TestStampPattern-2144166935-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/21faea9e6951f3bdd0153b76ac89fe1a60a34758 --force-share --output=json" returned: 0 in 0.189s {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:05:11 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-e03c8684-1a20-4509-a8f2-5629f4c9fbc6 tempest-TestStampPattern-2144166935 tempest-TestStampPattern-2144166935-project-member] Acquiring lock "21faea9e6951f3bdd0153b76ac89fe1a60a34758" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 18:05:11 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-e03c8684-1a20-4509-a8f2-5629f4c9fbc6 tempest-TestStampPattern-2144166935 tempest-TestStampPattern-2144166935-project-member] Lock "21faea9e6951f3bdd0153b76ac89fe1a60a34758" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 18:05:11 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-e03c8684-1a20-4509-a8f2-5629f4c9fbc6 tempest-TestStampPattern-2144166935 tempest-TestStampPattern-2144166935-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/21faea9e6951f3bdd0153b76ac89fe1a60a34758 --force-share --output=json {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:05:11 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-e03c8684-1a20-4509-a8f2-5629f4c9fbc6 tempest-TestStampPattern-2144166935 tempest-TestStampPattern-2144166935-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/21faea9e6951f3bdd0153b76ac89fe1a60a34758 --force-share --output=json" returned: 0 in 0.188s {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:05:11 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-e03c8684-1a20-4509-a8f2-5629f4c9fbc6 tempest-TestStampPattern-2144166935 tempest-TestStampPattern-2144166935-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/21faea9e6951f3bdd0153b76ac89fe1a60a34758,backing_fmt=raw /opt/stack/data/nova/instances/9eb14feb-f196-42b1-a6ba-2a049dea2d5e/disk 1073741824 {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:05:11 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-e03c8684-1a20-4509-a8f2-5629f4c9fbc6 tempest-TestStampPattern-2144166935 tempest-TestStampPattern-2144166935-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/21faea9e6951f3bdd0153b76ac89fe1a60a34758,backing_fmt=raw /opt/stack/data/nova/instances/9eb14feb-f196-42b1-a6ba-2a049dea2d5e/disk 1073741824" returned: 0 in 0.048s {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:05:11 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-e03c8684-1a20-4509-a8f2-5629f4c9fbc6 tempest-TestStampPattern-2144166935 tempest-TestStampPattern-2144166935-project-member] Lock "21faea9e6951f3bdd0153b76ac89fe1a60a34758" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.243s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 18:05:11 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-e03c8684-1a20-4509-a8f2-5629f4c9fbc6 tempest-TestStampPattern-2144166935 tempest-TestStampPattern-2144166935-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/21faea9e6951f3bdd0153b76ac89fe1a60a34758 --force-share --output=json {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:05:11 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-e03c8684-1a20-4509-a8f2-5629f4c9fbc6 tempest-TestStampPattern-2144166935 tempest-TestStampPattern-2144166935-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/21faea9e6951f3bdd0153b76ac89fe1a60a34758 --force-share --output=json" returned: 0 in 0.188s {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:05:11 user nova-compute[74613]: DEBUG nova.virt.disk.api [None req-e03c8684-1a20-4509-a8f2-5629f4c9fbc6 tempest-TestStampPattern-2144166935 tempest-TestStampPattern-2144166935-project-member] Checking if we can resize image /opt/stack/data/nova/instances/9eb14feb-f196-42b1-a6ba-2a049dea2d5e/disk. size=1073741824 {{(pid=74613) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 29 18:05:11 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-e03c8684-1a20-4509-a8f2-5629f4c9fbc6 tempest-TestStampPattern-2144166935 tempest-TestStampPattern-2144166935-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9eb14feb-f196-42b1-a6ba-2a049dea2d5e/disk --force-share --output=json {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:05:11 user nova-compute[74613]: DEBUG nova.network.neutron [None req-e03c8684-1a20-4509-a8f2-5629f4c9fbc6 tempest-TestStampPattern-2144166935 tempest-TestStampPattern-2144166935-project-member] [instance: 9eb14feb-f196-42b1-a6ba-2a049dea2d5e] Successfully created port: 02cedfee-7de8-4112-ad75-277367c11133 {{(pid=74613) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 29 18:05:11 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-e03c8684-1a20-4509-a8f2-5629f4c9fbc6 tempest-TestStampPattern-2144166935 tempest-TestStampPattern-2144166935-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9eb14feb-f196-42b1-a6ba-2a049dea2d5e/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:05:11 user nova-compute[74613]: DEBUG nova.virt.disk.api [None req-e03c8684-1a20-4509-a8f2-5629f4c9fbc6 tempest-TestStampPattern-2144166935 tempest-TestStampPattern-2144166935-project-member] Cannot resize image /opt/stack/data/nova/instances/9eb14feb-f196-42b1-a6ba-2a049dea2d5e/disk to a smaller size. {{(pid=74613) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 29 18:05:11 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-e03c8684-1a20-4509-a8f2-5629f4c9fbc6 tempest-TestStampPattern-2144166935 tempest-TestStampPattern-2144166935-project-member] [instance: 9eb14feb-f196-42b1-a6ba-2a049dea2d5e] Created local disks {{(pid=74613) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 29 18:05:11 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-e03c8684-1a20-4509-a8f2-5629f4c9fbc6 tempest-TestStampPattern-2144166935 tempest-TestStampPattern-2144166935-project-member] [instance: 9eb14feb-f196-42b1-a6ba-2a049dea2d5e] Ensure instance console log exists: /opt/stack/data/nova/instances/9eb14feb-f196-42b1-a6ba-2a049dea2d5e/console.log {{(pid=74613) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 29 18:05:11 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-e03c8684-1a20-4509-a8f2-5629f4c9fbc6 tempest-TestStampPattern-2144166935 tempest-TestStampPattern-2144166935-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 18:05:11 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-e03c8684-1a20-4509-a8f2-5629f4c9fbc6 tempest-TestStampPattern-2144166935 tempest-TestStampPattern-2144166935-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 18:05:11 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-e03c8684-1a20-4509-a8f2-5629f4c9fbc6 tempest-TestStampPattern-2144166935 tempest-TestStampPattern-2144166935-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 18:05:12 user nova-compute[74613]: DEBUG nova.network.neutron [None req-e03c8684-1a20-4509-a8f2-5629f4c9fbc6 tempest-TestStampPattern-2144166935 tempest-TestStampPattern-2144166935-project-member] [instance: 9eb14feb-f196-42b1-a6ba-2a049dea2d5e] Successfully updated port: 02cedfee-7de8-4112-ad75-277367c11133 {{(pid=74613) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 29 18:05:12 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-e03c8684-1a20-4509-a8f2-5629f4c9fbc6 tempest-TestStampPattern-2144166935 tempest-TestStampPattern-2144166935-project-member] Acquiring lock "refresh_cache-9eb14feb-f196-42b1-a6ba-2a049dea2d5e" {{(pid=74613) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 18:05:12 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-e03c8684-1a20-4509-a8f2-5629f4c9fbc6 tempest-TestStampPattern-2144166935 tempest-TestStampPattern-2144166935-project-member] Acquired lock "refresh_cache-9eb14feb-f196-42b1-a6ba-2a049dea2d5e" {{(pid=74613) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 18:05:12 user nova-compute[74613]: DEBUG nova.network.neutron [None req-e03c8684-1a20-4509-a8f2-5629f4c9fbc6 tempest-TestStampPattern-2144166935 tempest-TestStampPattern-2144166935-project-member] [instance: 9eb14feb-f196-42b1-a6ba-2a049dea2d5e] Building network info cache for instance {{(pid=74613) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 29 18:05:12 user nova-compute[74613]: DEBUG nova.compute.manager [req-162b2a1a-c6c4-45a9-96d2-feb473cfc7c7 req-a4063c78-daf9-457f-a218-c011fffc3e17 service nova] [instance: 9eb14feb-f196-42b1-a6ba-2a049dea2d5e] Received event network-changed-02cedfee-7de8-4112-ad75-277367c11133 {{(pid=74613) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 18:05:12 user nova-compute[74613]: DEBUG nova.compute.manager [req-162b2a1a-c6c4-45a9-96d2-feb473cfc7c7 req-a4063c78-daf9-457f-a218-c011fffc3e17 service nova] [instance: 9eb14feb-f196-42b1-a6ba-2a049dea2d5e] Refreshing instance network info cache due to event network-changed-02cedfee-7de8-4112-ad75-277367c11133. {{(pid=74613) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 18:05:12 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-162b2a1a-c6c4-45a9-96d2-feb473cfc7c7 req-a4063c78-daf9-457f-a218-c011fffc3e17 service nova] Acquiring lock "refresh_cache-9eb14feb-f196-42b1-a6ba-2a049dea2d5e" {{(pid=74613) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 18:05:12 user nova-compute[74613]: DEBUG nova.network.neutron [None req-e03c8684-1a20-4509-a8f2-5629f4c9fbc6 tempest-TestStampPattern-2144166935 tempest-TestStampPattern-2144166935-project-member] [instance: 9eb14feb-f196-42b1-a6ba-2a049dea2d5e] Instance cache missing network info. {{(pid=74613) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 29 18:05:12 user nova-compute[74613]: DEBUG nova.network.neutron [None req-e03c8684-1a20-4509-a8f2-5629f4c9fbc6 tempest-TestStampPattern-2144166935 tempest-TestStampPattern-2144166935-project-member] [instance: 9eb14feb-f196-42b1-a6ba-2a049dea2d5e] Updating instance_info_cache with network_info: [{"id": "02cedfee-7de8-4112-ad75-277367c11133", "address": "fa:16:3e:ba:49:9d", "network": {"id": "fed779df-aeaf-4b57-8336-be4c9d81f0be", "bridge": "br-int", "label": "tempest-TestStampPattern-1699172136-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6004d03e0fbd4684bc8f1d341afad3be", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap02cedfee-7d", "ovs_interfaceid": "02cedfee-7de8-4112-ad75-277367c11133", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74613) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 18:05:12 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-e03c8684-1a20-4509-a8f2-5629f4c9fbc6 tempest-TestStampPattern-2144166935 tempest-TestStampPattern-2144166935-project-member] Releasing lock "refresh_cache-9eb14feb-f196-42b1-a6ba-2a049dea2d5e" {{(pid=74613) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 18:05:12 user nova-compute[74613]: DEBUG nova.compute.manager [None req-e03c8684-1a20-4509-a8f2-5629f4c9fbc6 tempest-TestStampPattern-2144166935 tempest-TestStampPattern-2144166935-project-member] [instance: 9eb14feb-f196-42b1-a6ba-2a049dea2d5e] Instance network_info: |[{"id": "02cedfee-7de8-4112-ad75-277367c11133", "address": "fa:16:3e:ba:49:9d", "network": {"id": "fed779df-aeaf-4b57-8336-be4c9d81f0be", "bridge": "br-int", "label": "tempest-TestStampPattern-1699172136-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6004d03e0fbd4684bc8f1d341afad3be", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap02cedfee-7d", "ovs_interfaceid": "02cedfee-7de8-4112-ad75-277367c11133", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74613) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 29 18:05:12 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-162b2a1a-c6c4-45a9-96d2-feb473cfc7c7 req-a4063c78-daf9-457f-a218-c011fffc3e17 service nova] Acquired lock "refresh_cache-9eb14feb-f196-42b1-a6ba-2a049dea2d5e" {{(pid=74613) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 18:05:12 user nova-compute[74613]: DEBUG nova.network.neutron [req-162b2a1a-c6c4-45a9-96d2-feb473cfc7c7 req-a4063c78-daf9-457f-a218-c011fffc3e17 service nova] [instance: 9eb14feb-f196-42b1-a6ba-2a049dea2d5e] Refreshing network info cache for port 02cedfee-7de8-4112-ad75-277367c11133 {{(pid=74613) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 18:05:12 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-e03c8684-1a20-4509-a8f2-5629f4c9fbc6 tempest-TestStampPattern-2144166935 tempest-TestStampPattern-2144166935-project-member] [instance: 9eb14feb-f196-42b1-a6ba-2a049dea2d5e] Start _get_guest_xml network_info=[{"id": "02cedfee-7de8-4112-ad75-277367c11133", "address": "fa:16:3e:ba:49:9d", "network": {"id": "fed779df-aeaf-4b57-8336-be4c9d81f0be", "bridge": "br-int", "label": "tempest-TestStampPattern-1699172136-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6004d03e0fbd4684bc8f1d341afad3be", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap02cedfee-7d", "ovs_interfaceid": "02cedfee-7de8-4112-ad75-277367c11133", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-29T17:47:38Z,direct_url=<?>,disk_format='qcow2',id=4217f428-8d9d-4ee1-9614-642d26d90c46,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='794b07cbd46a44b5865cfda741036bae',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-29T17:47:40Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'size': 0, 'device_type': 'disk', 'boot_index': 0, 'guest_format': None, 'encrypted': False, 'encryption_format': None, 'disk_bus': 'virtio', 'image_id': '4217f428-8d9d-4ee1-9614-642d26d90c46'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74613) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 29 18:05:12 user nova-compute[74613]: WARNING nova.virt.libvirt.driver [None req-e03c8684-1a20-4509-a8f2-5629f4c9fbc6 tempest-TestStampPattern-2144166935 tempest-TestStampPattern-2144166935-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 18:05:12 user nova-compute[74613]: WARNING nova.virt.libvirt.driver [None req-e03c8684-1a20-4509-a8f2-5629f4c9fbc6 tempest-TestStampPattern-2144166935 tempest-TestStampPattern-2144166935-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 18:05:12 user nova-compute[74613]: DEBUG nova.virt.libvirt.host [None req-e03c8684-1a20-4509-a8f2-5629f4c9fbc6 tempest-TestStampPattern-2144166935 tempest-TestStampPattern-2144166935-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74613) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 29 18:05:12 user nova-compute[74613]: DEBUG nova.virt.libvirt.host [None req-e03c8684-1a20-4509-a8f2-5629f4c9fbc6 tempest-TestStampPattern-2144166935 tempest-TestStampPattern-2144166935-project-member] CPU controller missing on host. {{(pid=74613) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 29 18:05:12 user nova-compute[74613]: DEBUG nova.virt.libvirt.host [None req-e03c8684-1a20-4509-a8f2-5629f4c9fbc6 tempest-TestStampPattern-2144166935 tempest-TestStampPattern-2144166935-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74613) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 29 18:05:12 user nova-compute[74613]: DEBUG nova.virt.libvirt.host [None req-e03c8684-1a20-4509-a8f2-5629f4c9fbc6 tempest-TestStampPattern-2144166935 tempest-TestStampPattern-2144166935-project-member] CPU controller found on host. {{(pid=74613) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 29 18:05:12 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-e03c8684-1a20-4509-a8f2-5629f4c9fbc6 tempest-TestStampPattern-2144166935 tempest-TestStampPattern-2144166935-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74613) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 29 18:05:12 user nova-compute[74613]: DEBUG nova.virt.hardware [None req-e03c8684-1a20-4509-a8f2-5629f4c9fbc6 tempest-TestStampPattern-2144166935 tempest-TestStampPattern-2144166935-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-29T17:47:27Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-29T17:47:38Z,direct_url=<?>,disk_format='qcow2',id=4217f428-8d9d-4ee1-9614-642d26d90c46,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='794b07cbd46a44b5865cfda741036bae',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-29T17:47:40Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74613) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 29 18:05:12 user nova-compute[74613]: DEBUG nova.virt.hardware [None req-e03c8684-1a20-4509-a8f2-5629f4c9fbc6 tempest-TestStampPattern-2144166935 tempest-TestStampPattern-2144166935-project-member] Flavor limits 0:0:0 {{(pid=74613) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 29 18:05:12 user nova-compute[74613]: DEBUG nova.virt.hardware [None req-e03c8684-1a20-4509-a8f2-5629f4c9fbc6 tempest-TestStampPattern-2144166935 tempest-TestStampPattern-2144166935-project-member] Image limits 0:0:0 {{(pid=74613) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 29 18:05:12 user nova-compute[74613]: DEBUG nova.virt.hardware [None req-e03c8684-1a20-4509-a8f2-5629f4c9fbc6 tempest-TestStampPattern-2144166935 tempest-TestStampPattern-2144166935-project-member] Flavor pref 0:0:0 {{(pid=74613) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 29 18:05:12 user nova-compute[74613]: DEBUG nova.virt.hardware [None req-e03c8684-1a20-4509-a8f2-5629f4c9fbc6 tempest-TestStampPattern-2144166935 tempest-TestStampPattern-2144166935-project-member] Image pref 0:0:0 {{(pid=74613) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 29 18:05:12 user nova-compute[74613]: DEBUG nova.virt.hardware [None req-e03c8684-1a20-4509-a8f2-5629f4c9fbc6 tempest-TestStampPattern-2144166935 tempest-TestStampPattern-2144166935-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74613) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 29 18:05:12 user nova-compute[74613]: DEBUG nova.virt.hardware [None req-e03c8684-1a20-4509-a8f2-5629f4c9fbc6 tempest-TestStampPattern-2144166935 tempest-TestStampPattern-2144166935-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74613) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 29 18:05:12 user nova-compute[74613]: DEBUG nova.virt.hardware [None req-e03c8684-1a20-4509-a8f2-5629f4c9fbc6 tempest-TestStampPattern-2144166935 tempest-TestStampPattern-2144166935-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74613) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 29 18:05:12 user nova-compute[74613]: DEBUG nova.virt.hardware [None req-e03c8684-1a20-4509-a8f2-5629f4c9fbc6 tempest-TestStampPattern-2144166935 tempest-TestStampPattern-2144166935-project-member] Got 1 possible topologies {{(pid=74613) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 29 18:05:12 user nova-compute[74613]: DEBUG nova.virt.hardware [None req-e03c8684-1a20-4509-a8f2-5629f4c9fbc6 tempest-TestStampPattern-2144166935 tempest-TestStampPattern-2144166935-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74613) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 29 18:05:12 user nova-compute[74613]: DEBUG nova.virt.hardware [None req-e03c8684-1a20-4509-a8f2-5629f4c9fbc6 tempest-TestStampPattern-2144166935 tempest-TestStampPattern-2144166935-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74613) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 29 18:05:12 user nova-compute[74613]: DEBUG nova.virt.libvirt.vif [None req-e03c8684-1a20-4509-a8f2-5629f4c9fbc6 tempest-TestStampPattern-2144166935 tempest-TestStampPattern-2144166935-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T18:05:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-1271023988',display_name='tempest-TestStampPattern-server-1271023988',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-1271023988',id=30,image_ref='4217f428-8d9d-4ee1-9614-642d26d90c46',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBImheB4xIUp31my88WBnuldIYYO3ZplSdSxpARgEiu+bFOOTcjhJQqNcRzf7tbnmHy4961l14bqt6VjuQd2lyczJClyEX4yjcCet+qsyyrKz/utm1mx8LqakuBXZxsC2Hg==',key_name='tempest-TestStampPattern-1424901696',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6004d03e0fbd4684bc8f1d341afad3be',ramdisk_id='',reservation_id='r-uqpl4ynx',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='4217f428-8d9d-4ee1-9614-642d26d90c46',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestStampPattern-2144166935',owner_user_name='tempest-TestStampPattern-2144166935-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T18:05:11Z,user_data=None,user_id='7be3452738104c44bc78152e00fe469d',uuid=9eb14feb-f196-42b1-a6ba-2a049dea2d5e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "02cedfee-7de8-4112-ad75-277367c11133", "address": "fa:16:3e:ba:49:9d", "network": {"id": "fed779df-aeaf-4b57-8336-be4c9d81f0be", "bridge": "br-int", "label": "tempest-TestStampPattern-1699172136-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6004d03e0fbd4684bc8f1d341afad3be", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap02cedfee-7d", "ovs_interfaceid": "02cedfee-7de8-4112-ad75-277367c11133", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74613) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 29 18:05:12 user nova-compute[74613]: DEBUG nova.network.os_vif_util [None req-e03c8684-1a20-4509-a8f2-5629f4c9fbc6 tempest-TestStampPattern-2144166935 tempest-TestStampPattern-2144166935-project-member] Converting VIF {"id": "02cedfee-7de8-4112-ad75-277367c11133", "address": "fa:16:3e:ba:49:9d", "network": {"id": "fed779df-aeaf-4b57-8336-be4c9d81f0be", "bridge": "br-int", "label": "tempest-TestStampPattern-1699172136-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6004d03e0fbd4684bc8f1d341afad3be", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap02cedfee-7d", "ovs_interfaceid": "02cedfee-7de8-4112-ad75-277367c11133", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74613) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 18:05:12 user nova-compute[74613]: DEBUG nova.network.os_vif_util [None req-e03c8684-1a20-4509-a8f2-5629f4c9fbc6 tempest-TestStampPattern-2144166935 tempest-TestStampPattern-2144166935-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ba:49:9d,bridge_name='br-int',has_traffic_filtering=True,id=02cedfee-7de8-4112-ad75-277367c11133,network=Network(fed779df-aeaf-4b57-8336-be4c9d81f0be),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap02cedfee-7d') {{(pid=74613) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 18:05:12 user nova-compute[74613]: DEBUG nova.objects.instance [None req-e03c8684-1a20-4509-a8f2-5629f4c9fbc6 tempest-TestStampPattern-2144166935 tempest-TestStampPattern-2144166935-project-member] Lazy-loading 'pci_devices' on Instance uuid 9eb14feb-f196-42b1-a6ba-2a049dea2d5e {{(pid=74613) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 18:05:12 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-e03c8684-1a20-4509-a8f2-5629f4c9fbc6 tempest-TestStampPattern-2144166935 tempest-TestStampPattern-2144166935-project-member] [instance: 9eb14feb-f196-42b1-a6ba-2a049dea2d5e] End _get_guest_xml xml=<domain type="kvm">
Nov 29 18:05:12 user nova-compute[74613]:   <uuid>9eb14feb-f196-42b1-a6ba-2a049dea2d5e</uuid>
Nov 29 18:05:12 user nova-compute[74613]:   <name>instance-0000001e</name>
Nov 29 18:05:12 user nova-compute[74613]:   <memory>524288</memory>
Nov 29 18:05:12 user nova-compute[74613]:   <vcpu>1</vcpu>
Nov 29 18:05:12 user nova-compute[74613]:   <metadata>
Nov 29 18:05:12 user nova-compute[74613]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 29 18:05:12 user nova-compute[74613]:       <nova:package version="0.0.0"/>
Nov 29 18:05:12 user nova-compute[74613]:       <nova:name>tempest-TestStampPattern-server-1271023988</nova:name>
Nov 29 18:05:12 user nova-compute[74613]:       <nova:creationTime>2023-11-29 18:05:12</nova:creationTime>
Nov 29 18:05:12 user nova-compute[74613]:       <nova:flavor name="m1.tiny">
Nov 29 18:05:12 user nova-compute[74613]:         <nova:memory>512</nova:memory>
Nov 29 18:05:12 user nova-compute[74613]:         <nova:disk>1</nova:disk>
Nov 29 18:05:12 user nova-compute[74613]:         <nova:swap>0</nova:swap>
Nov 29 18:05:12 user nova-compute[74613]:         <nova:ephemeral>0</nova:ephemeral>
Nov 29 18:05:12 user nova-compute[74613]:         <nova:vcpus>1</nova:vcpus>
Nov 29 18:05:12 user nova-compute[74613]:       </nova:flavor>
Nov 29 18:05:12 user nova-compute[74613]:       <nova:owner>
Nov 29 18:05:12 user nova-compute[74613]:         <nova:user uuid="7be3452738104c44bc78152e00fe469d">tempest-TestStampPattern-2144166935-project-member</nova:user>
Nov 29 18:05:12 user nova-compute[74613]:         <nova:project uuid="6004d03e0fbd4684bc8f1d341afad3be">tempest-TestStampPattern-2144166935</nova:project>
Nov 29 18:05:12 user nova-compute[74613]:       </nova:owner>
Nov 29 18:05:12 user nova-compute[74613]:       <nova:root type="image" uuid="4217f428-8d9d-4ee1-9614-642d26d90c46"/>
Nov 29 18:05:12 user nova-compute[74613]:       <nova:ports>
Nov 29 18:05:12 user nova-compute[74613]:         <nova:port uuid="02cedfee-7de8-4112-ad75-277367c11133">
Nov 29 18:05:12 user nova-compute[74613]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Nov 29 18:05:12 user nova-compute[74613]:         </nova:port>
Nov 29 18:05:12 user nova-compute[74613]:       </nova:ports>
Nov 29 18:05:12 user nova-compute[74613]:     </nova:instance>
Nov 29 18:05:12 user nova-compute[74613]:   </metadata>
Nov 29 18:05:12 user nova-compute[74613]:   <sysinfo type="smbios">
Nov 29 18:05:12 user nova-compute[74613]:     <system>
Nov 29 18:05:12 user nova-compute[74613]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 29 18:05:12 user nova-compute[74613]:       <entry name="product">OpenStack Nova</entry>
Nov 29 18:05:12 user nova-compute[74613]:       <entry name="version">0.0.0</entry>
Nov 29 18:05:12 user nova-compute[74613]:       <entry name="serial">9eb14feb-f196-42b1-a6ba-2a049dea2d5e</entry>
Nov 29 18:05:12 user nova-compute[74613]:       <entry name="uuid">9eb14feb-f196-42b1-a6ba-2a049dea2d5e</entry>
Nov 29 18:05:12 user nova-compute[74613]:       <entry name="family">Virtual Machine</entry>
Nov 29 18:05:12 user nova-compute[74613]:     </system>
Nov 29 18:05:12 user nova-compute[74613]:   </sysinfo>
Nov 29 18:05:12 user nova-compute[74613]:   <os>
Nov 29 18:05:12 user nova-compute[74613]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 29 18:05:12 user nova-compute[74613]:     <boot dev="hd"/>
Nov 29 18:05:12 user nova-compute[74613]:     <smbios mode="sysinfo"/>
Nov 29 18:05:12 user nova-compute[74613]:   </os>
Nov 29 18:05:12 user nova-compute[74613]:   <features>
Nov 29 18:05:12 user nova-compute[74613]:     <acpi/>
Nov 29 18:05:12 user nova-compute[74613]:     <apic/>
Nov 29 18:05:12 user nova-compute[74613]:     <vmcoreinfo/>
Nov 29 18:05:12 user nova-compute[74613]:   </features>
Nov 29 18:05:12 user nova-compute[74613]:   <clock offset="utc">
Nov 29 18:05:12 user nova-compute[74613]:     <timer name="pit" tickpolicy="delay"/>
Nov 29 18:05:12 user nova-compute[74613]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 29 18:05:12 user nova-compute[74613]:     <timer name="hpet" present="no"/>
Nov 29 18:05:12 user nova-compute[74613]:   </clock>
Nov 29 18:05:12 user nova-compute[74613]:   <cpu mode="custom" match="exact">
Nov 29 18:05:12 user nova-compute[74613]:     <model>Nehalem</model>
Nov 29 18:05:12 user nova-compute[74613]:     <topology sockets="1" cores="1" threads="1"/>
Nov 29 18:05:12 user nova-compute[74613]:   </cpu>
Nov 29 18:05:12 user nova-compute[74613]:   <devices>
Nov 29 18:05:12 user nova-compute[74613]:     <disk type="file" device="disk">
Nov 29 18:05:12 user nova-compute[74613]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 29 18:05:12 user nova-compute[74613]:       <source file="/opt/stack/data/nova/instances/9eb14feb-f196-42b1-a6ba-2a049dea2d5e/disk"/>
Nov 29 18:05:12 user nova-compute[74613]:       <target dev="vda" bus="virtio"/>
Nov 29 18:05:12 user nova-compute[74613]:     </disk>
Nov 29 18:05:12 user nova-compute[74613]:     <interface type="ethernet">
Nov 29 18:05:12 user nova-compute[74613]:       <mac address="fa:16:3e:ba:49:9d"/>
Nov 29 18:05:12 user nova-compute[74613]:       <model type="virtio"/>
Nov 29 18:05:12 user nova-compute[74613]:       <mtu size="1442"/>
Nov 29 18:05:12 user nova-compute[74613]:       <target dev="tap02cedfee-7d"/>
Nov 29 18:05:12 user nova-compute[74613]:     </interface>
Nov 29 18:05:12 user nova-compute[74613]:     <serial type="pty">
Nov 29 18:05:12 user nova-compute[74613]:       <log file="/opt/stack/data/nova/instances/9eb14feb-f196-42b1-a6ba-2a049dea2d5e/console.log" append="off"/>
Nov 29 18:05:12 user nova-compute[74613]:     </serial>
Nov 29 18:05:12 user nova-compute[74613]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 29 18:05:12 user nova-compute[74613]:     <video>
Nov 29 18:05:12 user nova-compute[74613]:       <model type="virtio"/>
Nov 29 18:05:12 user nova-compute[74613]:     </video>
Nov 29 18:05:12 user nova-compute[74613]:     <rng model="virtio">
Nov 29 18:05:12 user nova-compute[74613]:       <backend model="random">/dev/urandom</backend>
Nov 29 18:05:12 user nova-compute[74613]:     </rng>
Nov 29 18:05:12 user nova-compute[74613]:     <controller type="usb" index="0" model="none"/>
Nov 29 18:05:12 user nova-compute[74613]:     <memballoon model="virtio">
Nov 29 18:05:12 user nova-compute[74613]:       <stats period="10"/>
Nov 29 18:05:12 user nova-compute[74613]:     </memballoon>
Nov 29 18:05:12 user nova-compute[74613]:   </devices>
Nov 29 18:05:12 user nova-compute[74613]: </domain>
Nov 29 18:05:12 user nova-compute[74613]:  {{(pid=74613) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 29 18:05:12 user nova-compute[74613]: DEBUG nova.virt.libvirt.vif [None req-e03c8684-1a20-4509-a8f2-5629f4c9fbc6 tempest-TestStampPattern-2144166935 tempest-TestStampPattern-2144166935-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T18:05:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-1271023988',display_name='tempest-TestStampPattern-server-1271023988',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-1271023988',id=30,image_ref='4217f428-8d9d-4ee1-9614-642d26d90c46',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBImheB4xIUp31my88WBnuldIYYO3ZplSdSxpARgEiu+bFOOTcjhJQqNcRzf7tbnmHy4961l14bqt6VjuQd2lyczJClyEX4yjcCet+qsyyrKz/utm1mx8LqakuBXZxsC2Hg==',key_name='tempest-TestStampPattern-1424901696',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6004d03e0fbd4684bc8f1d341afad3be',ramdisk_id='',reservation_id='r-uqpl4ynx',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='4217f428-8d9d-4ee1-9614-642d26d90c46',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestStampPattern-2144166935',owner_user_name='tempest-TestStampPattern-2144166935-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T18:05:11Z,user_data=None,user_id='7be3452738104c44bc78152e00fe469d',uuid=9eb14feb-f196-42b1-a6ba-2a049dea2d5e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "02cedfee-7de8-4112-ad75-277367c11133", "address": "fa:16:3e:ba:49:9d", "network": {"id": "fed779df-aeaf-4b57-8336-be4c9d81f0be", "bridge": "br-int", "label": "tempest-TestStampPattern-1699172136-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6004d03e0fbd4684bc8f1d341afad3be", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap02cedfee-7d", "ovs_interfaceid": "02cedfee-7de8-4112-ad75-277367c11133", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74613) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 29 18:05:12 user nova-compute[74613]: DEBUG nova.network.os_vif_util [None req-e03c8684-1a20-4509-a8f2-5629f4c9fbc6 tempest-TestStampPattern-2144166935 tempest-TestStampPattern-2144166935-project-member] Converting VIF {"id": "02cedfee-7de8-4112-ad75-277367c11133", "address": "fa:16:3e:ba:49:9d", "network": {"id": "fed779df-aeaf-4b57-8336-be4c9d81f0be", "bridge": "br-int", "label": "tempest-TestStampPattern-1699172136-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6004d03e0fbd4684bc8f1d341afad3be", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap02cedfee-7d", "ovs_interfaceid": "02cedfee-7de8-4112-ad75-277367c11133", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74613) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 18:05:12 user nova-compute[74613]: DEBUG nova.network.os_vif_util [None req-e03c8684-1a20-4509-a8f2-5629f4c9fbc6 tempest-TestStampPattern-2144166935 tempest-TestStampPattern-2144166935-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ba:49:9d,bridge_name='br-int',has_traffic_filtering=True,id=02cedfee-7de8-4112-ad75-277367c11133,network=Network(fed779df-aeaf-4b57-8336-be4c9d81f0be),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap02cedfee-7d') {{(pid=74613) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 18:05:12 user nova-compute[74613]: DEBUG os_vif [None req-e03c8684-1a20-4509-a8f2-5629f4c9fbc6 tempest-TestStampPattern-2144166935 tempest-TestStampPattern-2144166935-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ba:49:9d,bridge_name='br-int',has_traffic_filtering=True,id=02cedfee-7de8-4112-ad75-277367c11133,network=Network(fed779df-aeaf-4b57-8336-be4c9d81f0be),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap02cedfee-7d') {{(pid=74613) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 29 18:05:12 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:05:12 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74613) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 18:05:12 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74613) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 29 18:05:12 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:05:12 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '824bb099-c88f-5d8a-8f2d-8fdb1a47e63d', '_type': 'linux-noop'}}, row=False) {{(pid=74613) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 18:05:12 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:05:12 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 18:05:12 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:05:12 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap02cedfee-7d, may_exist=True, interface_attrs={}) {{(pid=74613) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 18:05:12 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap02cedfee-7d, col_values=(('qos', UUID('e93c4231-6533-4027-b408-cf78b9a2cf45')),), if_exists=True) {{(pid=74613) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 18:05:12 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap02cedfee-7d, col_values=(('external_ids', {'iface-id': '02cedfee-7de8-4112-ad75-277367c11133', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ba:49:9d', 'vm-uuid': '9eb14feb-f196-42b1-a6ba-2a049dea2d5e'}),), if_exists=True) {{(pid=74613) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 18:05:12 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:05:12 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 18:05:12 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:05:12 user nova-compute[74613]: INFO os_vif [None req-e03c8684-1a20-4509-a8f2-5629f4c9fbc6 tempest-TestStampPattern-2144166935 tempest-TestStampPattern-2144166935-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ba:49:9d,bridge_name='br-int',has_traffic_filtering=True,id=02cedfee-7de8-4112-ad75-277367c11133,network=Network(fed779df-aeaf-4b57-8336-be4c9d81f0be),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap02cedfee-7d')
Nov 29 18:05:12 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-e03c8684-1a20-4509-a8f2-5629f4c9fbc6 tempest-TestStampPattern-2144166935 tempest-TestStampPattern-2144166935-project-member] No BDM found with device name vda, not building metadata. {{(pid=74613) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 18:05:12 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-e03c8684-1a20-4509-a8f2-5629f4c9fbc6 tempest-TestStampPattern-2144166935 tempest-TestStampPattern-2144166935-project-member] No VIF found with MAC fa:16:3e:ba:49:9d, not building metadata {{(pid=74613) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 29 18:05:12 user nova-compute[74613]: DEBUG nova.network.neutron [req-162b2a1a-c6c4-45a9-96d2-feb473cfc7c7 req-a4063c78-daf9-457f-a218-c011fffc3e17 service nova] [instance: 9eb14feb-f196-42b1-a6ba-2a049dea2d5e] Updated VIF entry in instance network info cache for port 02cedfee-7de8-4112-ad75-277367c11133. {{(pid=74613) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 18:05:12 user nova-compute[74613]: DEBUG nova.network.neutron [req-162b2a1a-c6c4-45a9-96d2-feb473cfc7c7 req-a4063c78-daf9-457f-a218-c011fffc3e17 service nova] [instance: 9eb14feb-f196-42b1-a6ba-2a049dea2d5e] Updating instance_info_cache with network_info: [{"id": "02cedfee-7de8-4112-ad75-277367c11133", "address": "fa:16:3e:ba:49:9d", "network": {"id": "fed779df-aeaf-4b57-8336-be4c9d81f0be", "bridge": "br-int", "label": "tempest-TestStampPattern-1699172136-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6004d03e0fbd4684bc8f1d341afad3be", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap02cedfee-7d", "ovs_interfaceid": "02cedfee-7de8-4112-ad75-277367c11133", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74613) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 18:05:13 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-162b2a1a-c6c4-45a9-96d2-feb473cfc7c7 req-a4063c78-daf9-457f-a218-c011fffc3e17 service nova] Releasing lock "refresh_cache-9eb14feb-f196-42b1-a6ba-2a049dea2d5e" {{(pid=74613) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 18:05:14 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:05:14 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:05:14 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:05:14 user nova-compute[74613]: DEBUG nova.compute.manager [req-e409dee6-1bd2-4551-bfee-431ece5c7d05 req-082eaee0-6368-4453-92ea-acf37606a169 service nova] [instance: 9eb14feb-f196-42b1-a6ba-2a049dea2d5e] Received event network-vif-plugged-02cedfee-7de8-4112-ad75-277367c11133 {{(pid=74613) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 18:05:14 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-e409dee6-1bd2-4551-bfee-431ece5c7d05 req-082eaee0-6368-4453-92ea-acf37606a169 service nova] Acquiring lock "9eb14feb-f196-42b1-a6ba-2a049dea2d5e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 18:05:14 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-e409dee6-1bd2-4551-bfee-431ece5c7d05 req-082eaee0-6368-4453-92ea-acf37606a169 service nova] Lock "9eb14feb-f196-42b1-a6ba-2a049dea2d5e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 18:05:14 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-e409dee6-1bd2-4551-bfee-431ece5c7d05 req-082eaee0-6368-4453-92ea-acf37606a169 service nova] Lock "9eb14feb-f196-42b1-a6ba-2a049dea2d5e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 18:05:14 user nova-compute[74613]: DEBUG nova.compute.manager [req-e409dee6-1bd2-4551-bfee-431ece5c7d05 req-082eaee0-6368-4453-92ea-acf37606a169 service nova] [instance: 9eb14feb-f196-42b1-a6ba-2a049dea2d5e] No waiting events found dispatching network-vif-plugged-02cedfee-7de8-4112-ad75-277367c11133 {{(pid=74613) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 18:05:14 user nova-compute[74613]: WARNING nova.compute.manager [req-e409dee6-1bd2-4551-bfee-431ece5c7d05 req-082eaee0-6368-4453-92ea-acf37606a169 service nova] [instance: 9eb14feb-f196-42b1-a6ba-2a049dea2d5e] Received unexpected event network-vif-plugged-02cedfee-7de8-4112-ad75-277367c11133 for instance with vm_state building and task_state spawning.
Nov 29 18:05:14 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:05:14 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:05:14 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:05:14 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:05:15 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:05:16 user nova-compute[74613]: DEBUG nova.compute.manager [None req-e03c8684-1a20-4509-a8f2-5629f4c9fbc6 tempest-TestStampPattern-2144166935 tempest-TestStampPattern-2144166935-project-member] [instance: 9eb14feb-f196-42b1-a6ba-2a049dea2d5e] Instance event wait completed in 0 seconds for  {{(pid=74613) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 29 18:05:16 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-e03c8684-1a20-4509-a8f2-5629f4c9fbc6 tempest-TestStampPattern-2144166935 tempest-TestStampPattern-2144166935-project-member] [instance: 9eb14feb-f196-42b1-a6ba-2a049dea2d5e] Guest created on hypervisor {{(pid=74613) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 29 18:05:16 user nova-compute[74613]: INFO nova.virt.libvirt.driver [-] [instance: 9eb14feb-f196-42b1-a6ba-2a049dea2d5e] Instance spawned successfully.
Nov 29 18:05:16 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-e03c8684-1a20-4509-a8f2-5629f4c9fbc6 tempest-TestStampPattern-2144166935 tempest-TestStampPattern-2144166935-project-member] [instance: 9eb14feb-f196-42b1-a6ba-2a049dea2d5e] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74613) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 29 18:05:16 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-e03c8684-1a20-4509-a8f2-5629f4c9fbc6 tempest-TestStampPattern-2144166935 tempest-TestStampPattern-2144166935-project-member] [instance: 9eb14feb-f196-42b1-a6ba-2a049dea2d5e] Found default for hw_cdrom_bus of ide {{(pid=74613) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 18:05:16 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-e03c8684-1a20-4509-a8f2-5629f4c9fbc6 tempest-TestStampPattern-2144166935 tempest-TestStampPattern-2144166935-project-member] [instance: 9eb14feb-f196-42b1-a6ba-2a049dea2d5e] Found default for hw_disk_bus of virtio {{(pid=74613) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 18:05:16 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-e03c8684-1a20-4509-a8f2-5629f4c9fbc6 tempest-TestStampPattern-2144166935 tempest-TestStampPattern-2144166935-project-member] [instance: 9eb14feb-f196-42b1-a6ba-2a049dea2d5e] Found default for hw_input_bus of None {{(pid=74613) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 18:05:16 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-e03c8684-1a20-4509-a8f2-5629f4c9fbc6 tempest-TestStampPattern-2144166935 tempest-TestStampPattern-2144166935-project-member] [instance: 9eb14feb-f196-42b1-a6ba-2a049dea2d5e] Found default for hw_pointer_model of None {{(pid=74613) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 18:05:16 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-e03c8684-1a20-4509-a8f2-5629f4c9fbc6 tempest-TestStampPattern-2144166935 tempest-TestStampPattern-2144166935-project-member] [instance: 9eb14feb-f196-42b1-a6ba-2a049dea2d5e] Found default for hw_video_model of virtio {{(pid=74613) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 18:05:16 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-e03c8684-1a20-4509-a8f2-5629f4c9fbc6 tempest-TestStampPattern-2144166935 tempest-TestStampPattern-2144166935-project-member] [instance: 9eb14feb-f196-42b1-a6ba-2a049dea2d5e] Found default for hw_vif_model of virtio {{(pid=74613) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 18:05:16 user nova-compute[74613]: INFO nova.compute.manager [None req-e03c8684-1a20-4509-a8f2-5629f4c9fbc6 tempest-TestStampPattern-2144166935 tempest-TestStampPattern-2144166935-project-member] [instance: 9eb14feb-f196-42b1-a6ba-2a049dea2d5e] Took 5.59 seconds to spawn the instance on the hypervisor.
Nov 29 18:05:16 user nova-compute[74613]: DEBUG nova.compute.manager [None req-e03c8684-1a20-4509-a8f2-5629f4c9fbc6 tempest-TestStampPattern-2144166935 tempest-TestStampPattern-2144166935-project-member] [instance: 9eb14feb-f196-42b1-a6ba-2a049dea2d5e] Checking state {{(pid=74613) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 29 18:05:16 user nova-compute[74613]: DEBUG nova.compute.manager [req-fdec35c1-74e5-450a-b2cd-7872d47681b1 req-78d0079e-c507-401d-9f26-35bf7dfa87b8 service nova] [instance: 9eb14feb-f196-42b1-a6ba-2a049dea2d5e] Received event network-vif-plugged-02cedfee-7de8-4112-ad75-277367c11133 {{(pid=74613) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 18:05:16 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-fdec35c1-74e5-450a-b2cd-7872d47681b1 req-78d0079e-c507-401d-9f26-35bf7dfa87b8 service nova] Acquiring lock "9eb14feb-f196-42b1-a6ba-2a049dea2d5e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 18:05:16 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-fdec35c1-74e5-450a-b2cd-7872d47681b1 req-78d0079e-c507-401d-9f26-35bf7dfa87b8 service nova] Lock "9eb14feb-f196-42b1-a6ba-2a049dea2d5e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 18:05:16 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-fdec35c1-74e5-450a-b2cd-7872d47681b1 req-78d0079e-c507-401d-9f26-35bf7dfa87b8 service nova] Lock "9eb14feb-f196-42b1-a6ba-2a049dea2d5e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 18:05:16 user nova-compute[74613]: DEBUG nova.compute.manager [req-fdec35c1-74e5-450a-b2cd-7872d47681b1 req-78d0079e-c507-401d-9f26-35bf7dfa87b8 service nova] [instance: 9eb14feb-f196-42b1-a6ba-2a049dea2d5e] No waiting events found dispatching network-vif-plugged-02cedfee-7de8-4112-ad75-277367c11133 {{(pid=74613) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 18:05:16 user nova-compute[74613]: WARNING nova.compute.manager [req-fdec35c1-74e5-450a-b2cd-7872d47681b1 req-78d0079e-c507-401d-9f26-35bf7dfa87b8 service nova] [instance: 9eb14feb-f196-42b1-a6ba-2a049dea2d5e] Received unexpected event network-vif-plugged-02cedfee-7de8-4112-ad75-277367c11133 for instance with vm_state building and task_state spawning.
Nov 29 18:05:16 user nova-compute[74613]: INFO nova.compute.manager [None req-e03c8684-1a20-4509-a8f2-5629f4c9fbc6 tempest-TestStampPattern-2144166935 tempest-TestStampPattern-2144166935-project-member] [instance: 9eb14feb-f196-42b1-a6ba-2a049dea2d5e] Took 6.49 seconds to build instance.
Nov 29 18:05:16 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-e03c8684-1a20-4509-a8f2-5629f4c9fbc6 tempest-TestStampPattern-2144166935 tempest-TestStampPattern-2144166935-project-member] Lock "9eb14feb-f196-42b1-a6ba-2a049dea2d5e" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.614s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 18:05:17 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:05:20 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:05:21 user nova-compute[74613]: DEBUG oslo_service.periodic_task [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74613) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 18:05:21 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 18:05:21 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 18:05:21 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 18:05:21 user nova-compute[74613]: DEBUG nova.compute.resource_tracker [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Auditing locally available compute resources for user (node: user) {{(pid=74613) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 29 18:05:21 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=74613) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 29 18:05:21 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9eb14feb-f196-42b1-a6ba-2a049dea2d5e/disk --force-share --output=json {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:05:22 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9eb14feb-f196-42b1-a6ba-2a049dea2d5e/disk --force-share --output=json" returned: 0 in 0.207s {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:05:22 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9eb14feb-f196-42b1-a6ba-2a049dea2d5e/disk --force-share --output=json {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:05:22 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9eb14feb-f196-42b1-a6ba-2a049dea2d5e/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:05:22 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=74613) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 29 18:05:22 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] skipping disk /dev/sdf (vdb) as it is a volume {{(pid=74613) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 29 18:05:22 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] skipping disk /dev/sdg (vdc) as it is a volume {{(pid=74613) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 29 18:05:22 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=74613) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 29 18:05:22 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f4a1329-b3b9-4d1c-8735-abddabc359fd/disk --force-share --output=json {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:05:22 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f4a1329-b3b9-4d1c-8735-abddabc359fd/disk --force-share --output=json" returned: 0 in 0.229s {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:05:22 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f4a1329-b3b9-4d1c-8735-abddabc359fd/disk --force-share --output=json {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:05:22 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f4a1329-b3b9-4d1c-8735-abddabc359fd/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:05:22 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3b828860-5cc5-40b0-b845-8e560211794e/disk --force-share --output=json {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:05:22 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:05:22 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3b828860-5cc5-40b0-b845-8e560211794e/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:05:22 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3b828860-5cc5-40b0-b845-8e560211794e/disk --force-share --output=json {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:05:23 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3b828860-5cc5-40b0-b845-8e560211794e/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:05:23 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/abc9e2b8-f467-4cd0-b40f-de511fde1ec1/disk --force-share --output=json {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:05:23 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/abc9e2b8-f467-4cd0-b40f-de511fde1ec1/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:05:23 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/abc9e2b8-f467-4cd0-b40f-de511fde1ec1/disk --force-share --output=json {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:05:23 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/abc9e2b8-f467-4cd0-b40f-de511fde1ec1/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:05:23 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6993e2e7-7e03-45b4-9d3d-3742589b6078/disk --force-share --output=json {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:05:23 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6993e2e7-7e03-45b4-9d3d-3742589b6078/disk --force-share --output=json" returned: 0 in 0.218s {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:05:23 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6993e2e7-7e03-45b4-9d3d-3742589b6078/disk --force-share --output=json {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:05:23 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6993e2e7-7e03-45b4-9d3d-3742589b6078/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:05:23 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74613) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 29 18:05:23 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8fc8496b-1435-4b5f-8977-6c0d7467ef65/disk --force-share --output=json {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:05:24 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8fc8496b-1435-4b5f-8977-6c0d7467ef65/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:05:24 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8fc8496b-1435-4b5f-8977-6c0d7467ef65/disk --force-share --output=json {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:05:24 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8fc8496b-1435-4b5f-8977-6c0d7467ef65/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:05:24 user nova-compute[74613]: WARNING nova.virt.libvirt.driver [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 18:05:24 user nova-compute[74613]: WARNING nova.virt.libvirt.driver [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 18:05:24 user nova-compute[74613]: DEBUG nova.compute.resource_tracker [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Hypervisor/Node resource view: name=user free_ram=7742MB free_disk=24.934459686279297GB free_vcpus=2 pci_devices=[{"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74613) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 29 18:05:24 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 18:05:24 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 18:05:24 user nova-compute[74613]: DEBUG nova.compute.resource_tracker [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Applying migration context for instance e9acfa30-4ec2-4540-ac34-4c66db3228e1 as it has an incoming, in-progress migration 5c28fdb8-2306-491b-9a4c-9ea25116daee. Migration status is finished {{(pid=74613) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1016}}
Nov 29 18:05:24 user nova-compute[74613]: INFO nova.compute.resource_tracker [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] [instance: e9acfa30-4ec2-4540-ac34-4c66db3228e1] Updating resource usage from migration 5c28fdb8-2306-491b-9a4c-9ea25116daee
Nov 29 18:05:24 user nova-compute[74613]: DEBUG nova.compute.resource_tracker [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Instance 3b828860-5cc5-40b0-b845-8e560211794e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74613) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 18:05:24 user nova-compute[74613]: DEBUG nova.compute.resource_tracker [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Instance abc9e2b8-f467-4cd0-b40f-de511fde1ec1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74613) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 18:05:24 user nova-compute[74613]: DEBUG nova.compute.resource_tracker [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Instance cd22685a-028c-4e0c-834d-e7b20f6d06ab actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74613) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 18:05:24 user nova-compute[74613]: DEBUG nova.compute.resource_tracker [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Instance 8fc8496b-1435-4b5f-8977-6c0d7467ef65 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74613) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 18:05:24 user nova-compute[74613]: DEBUG nova.compute.resource_tracker [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Instance 56de3dd1-6873-4c0a-9d80-58518dfd671e actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74613) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 18:05:24 user nova-compute[74613]: DEBUG nova.compute.resource_tracker [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Instance d3c285cd-9f39-423c-a324-30a48a9c66be actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74613) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 18:05:24 user nova-compute[74613]: DEBUG nova.compute.resource_tracker [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Instance 6993e2e7-7e03-45b4-9d3d-3742589b6078 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74613) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 18:05:24 user nova-compute[74613]: DEBUG nova.compute.resource_tracker [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Instance 6f4a1329-b3b9-4d1c-8735-abddabc359fd actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74613) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 18:05:24 user nova-compute[74613]: DEBUG nova.compute.resource_tracker [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Migration 5c28fdb8-2306-491b-9a4c-9ea25116daee is active on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74613) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1709}}
Nov 29 18:05:24 user nova-compute[74613]: DEBUG nova.compute.resource_tracker [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Instance e9acfa30-4ec2-4540-ac34-4c66db3228e1 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=74613) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 18:05:24 user nova-compute[74613]: DEBUG nova.compute.resource_tracker [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Instance 9eb14feb-f196-42b1-a6ba-2a049dea2d5e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74613) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 18:05:24 user nova-compute[74613]: DEBUG nova.compute.resource_tracker [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Total usable vcpus: 12, total allocated vcpus: 11 {{(pid=74613) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 29 18:05:24 user nova-compute[74613]: DEBUG nova.compute.resource_tracker [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Final resource view: name=user phys_ram=16011MB used_ram=7680MB phys_disk=40GB used_disk=6GB total_vcpus=12 used_vcpus=11 pci_stats=[] {{(pid=74613) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 29 18:05:25 user nova-compute[74613]: DEBUG nova.compute.provider_tree [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Inventory has not changed in ProviderTree for provider: 639d980e-3b12-44b1-b8f4-1812416fa4dd {{(pid=74613) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 18:05:25 user nova-compute[74613]: DEBUG nova.scheduler.client.report [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Inventory has not changed for provider 639d980e-3b12-44b1-b8f4-1812416fa4dd based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74613) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 18:05:25 user nova-compute[74613]: DEBUG nova.compute.resource_tracker [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Compute_service record updated for user:user {{(pid=74613) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 29 18:05:25 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.551s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 18:05:25 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:05:27 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:05:29 user nova-compute[74613]: DEBUG oslo_service.periodic_task [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74613) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 18:05:29 user nova-compute[74613]: DEBUG oslo_service.periodic_task [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74613) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 18:05:29 user nova-compute[74613]: DEBUG oslo_service.periodic_task [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74613) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 18:05:29 user nova-compute[74613]: DEBUG nova.compute.manager [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Starting heal instance info cache {{(pid=74613) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 29 18:05:29 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Acquiring lock "refresh_cache-abc9e2b8-f467-4cd0-b40f-de511fde1ec1" {{(pid=74613) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 18:05:29 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Acquired lock "refresh_cache-abc9e2b8-f467-4cd0-b40f-de511fde1ec1" {{(pid=74613) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 18:05:29 user nova-compute[74613]: DEBUG nova.network.neutron [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] [instance: abc9e2b8-f467-4cd0-b40f-de511fde1ec1] Forcefully refreshing network info cache for instance {{(pid=74613) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 29 18:05:30 user nova-compute[74613]: DEBUG nova.network.neutron [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] [instance: abc9e2b8-f467-4cd0-b40f-de511fde1ec1] Updating instance_info_cache with network_info: [{"id": "59a8bf1b-9fb1-4526-92d5-9ad1897c1ee8", "address": "fa:16:3e:e3:5f:12", "network": {"id": "7c2c368e-4c7d-4d70-9a40-c10fe9541af9", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1287934102-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b1f70c311d4941c986de21ac458d11ab", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap59a8bf1b-9f", "ovs_interfaceid": "59a8bf1b-9fb1-4526-92d5-9ad1897c1ee8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74613) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 18:05:30 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Releasing lock "refresh_cache-abc9e2b8-f467-4cd0-b40f-de511fde1ec1" {{(pid=74613) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 18:05:30 user nova-compute[74613]: DEBUG nova.compute.manager [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] [instance: abc9e2b8-f467-4cd0-b40f-de511fde1ec1] Updated the network info_cache for instance {{(pid=74613) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 29 18:05:30 user nova-compute[74613]: DEBUG oslo_service.periodic_task [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74613) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 18:05:30 user nova-compute[74613]: DEBUG oslo_service.periodic_task [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74613) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 18:05:30 user nova-compute[74613]: DEBUG oslo_service.periodic_task [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74613) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 18:05:30 user nova-compute[74613]: DEBUG oslo_service.periodic_task [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74613) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 18:05:30 user nova-compute[74613]: DEBUG oslo_service.periodic_task [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74613) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 18:05:30 user nova-compute[74613]: DEBUG oslo_service.periodic_task [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74613) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 18:05:30 user nova-compute[74613]: DEBUG nova.compute.manager [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74613) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 29 18:05:30 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:05:30 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:05:32 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:05:32 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:05:35 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:05:35 user nova-compute[74613]: DEBUG nova.compute.manager [req-9fdf8589-f654-451c-bce7-93121c4de731 req-fc73a408-f33c-4098-9cbe-b1b600fd7a29 service nova] [instance: 56de3dd1-6873-4c0a-9d80-58518dfd671e] Received event network-changed-fd1eeb3e-46e9-441a-90e1-048c5ad64d0e {{(pid=74613) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 18:05:35 user nova-compute[74613]: DEBUG nova.compute.manager [req-9fdf8589-f654-451c-bce7-93121c4de731 req-fc73a408-f33c-4098-9cbe-b1b600fd7a29 service nova] [instance: 56de3dd1-6873-4c0a-9d80-58518dfd671e] Refreshing instance network info cache due to event network-changed-fd1eeb3e-46e9-441a-90e1-048c5ad64d0e. {{(pid=74613) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 18:05:35 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-9fdf8589-f654-451c-bce7-93121c4de731 req-fc73a408-f33c-4098-9cbe-b1b600fd7a29 service nova] Acquiring lock "refresh_cache-56de3dd1-6873-4c0a-9d80-58518dfd671e" {{(pid=74613) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 18:05:35 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-9fdf8589-f654-451c-bce7-93121c4de731 req-fc73a408-f33c-4098-9cbe-b1b600fd7a29 service nova] Acquired lock "refresh_cache-56de3dd1-6873-4c0a-9d80-58518dfd671e" {{(pid=74613) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 18:05:35 user nova-compute[74613]: DEBUG nova.network.neutron [req-9fdf8589-f654-451c-bce7-93121c4de731 req-fc73a408-f33c-4098-9cbe-b1b600fd7a29 service nova] [instance: 56de3dd1-6873-4c0a-9d80-58518dfd671e] Refreshing network info cache for port fd1eeb3e-46e9-441a-90e1-048c5ad64d0e {{(pid=74613) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 18:05:36 user nova-compute[74613]: DEBUG nova.network.neutron [req-9fdf8589-f654-451c-bce7-93121c4de731 req-fc73a408-f33c-4098-9cbe-b1b600fd7a29 service nova] [instance: 56de3dd1-6873-4c0a-9d80-58518dfd671e] Updated VIF entry in instance network info cache for port fd1eeb3e-46e9-441a-90e1-048c5ad64d0e. {{(pid=74613) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 18:05:36 user nova-compute[74613]: DEBUG nova.network.neutron [req-9fdf8589-f654-451c-bce7-93121c4de731 req-fc73a408-f33c-4098-9cbe-b1b600fd7a29 service nova] [instance: 56de3dd1-6873-4c0a-9d80-58518dfd671e] Updating instance_info_cache with network_info: [{"id": "fd1eeb3e-46e9-441a-90e1-048c5ad64d0e", "address": "fa:16:3e:23:fc:5e", "network": {"id": "de42d2ca-c48c-4dc3-8b92-61dc7cbafb64", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-203953398-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.80", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a9fa0da4ffc3447795c69b31e4e9a8d0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfd1eeb3e-46", "ovs_interfaceid": "fd1eeb3e-46e9-441a-90e1-048c5ad64d0e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "7d1e40a2-4a06-4e8e-935c-3d66553dac82", "address": "fa:16:3e:a9:89:7f", "network": {"id": "3143fa56-ddfb-4a80-8df7-33d38513cf4b", "bridge": "br-int", "label": "tempest-device-tagging-net1-2047429033", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.201", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "a9fa0da4ffc3447795c69b31e4e9a8d0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7d1e40a2-4a", "ovs_interfaceid": "7d1e40a2-4a06-4e8e-935c-3d66553dac82", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "70ada3a3-186a-425a-8c4c-7af3b2d647ef", "address": "fa:16:3e:7f:89:6c", "network": {"id": "3143fa56-ddfb-4a80-8df7-33d38513cf4b", "bridge": "br-int", "label": "tempest-device-tagging-net1-2047429033", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.230", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "a9fa0da4ffc3447795c69b31e4e9a8d0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap70ada3a3-18", "ovs_interfaceid": "70ada3a3-186a-425a-8c4c-7af3b2d647ef", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "bfeedb02-28d2-4e4c-8a6b-da87e4b8f9cb", "address": "fa:16:3e:c9:00:90", "network": {"id": "3143fa56-ddfb-4a80-8df7-33d38513cf4b", "bridge": "br-int", "label": "tempest-device-tagging-net1-2047429033", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.251", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "a9fa0da4ffc3447795c69b31e4e9a8d0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbfeedb02-28", "ovs_interfaceid": "bfeedb02-28d2-4e4c-8a6b-da87e4b8f9cb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "a41dc4d4-b94a-4659-8709-566b029d2b20", "address": "fa:16:3e:c3:19:36", "network": {"id": "3143fa56-ddfb-4a80-8df7-33d38513cf4b", "bridge": "br-int", "label": "tempest-device-tagging-net1-2047429033", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.253", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "a9fa0da4ffc3447795c69b31e4e9a8d0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa41dc4d4-b9", "ovs_interfaceid": "a41dc4d4-b94a-4659-8709-566b029d2b20", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "4e39483b-3a24-4948-8025-ab381a1a6eee", "address": "fa:16:3e:b3:40:e7", "network": {"id": "e20648c0-8ed3-4009-b577-e6af59d212cd", "bridge": "br-int", "label": "tempest-device-tagging-net2-1059246863", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "a9fa0da4ffc3447795c69b31e4e9a8d0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4e39483b-3a", "ovs_interfaceid": "4e39483b-3a24-4948-8025-ab381a1a6eee", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "30db35d4-e78c-414e-bae8-593d9aaadda8", "address": "fa:16:3e:a3:1f:b8", "network": {"id": "e20648c0-8ed3-4009-b577-e6af59d212cd", "bridge": "br-int", "label": "tempest-device-tagging-net2-1059246863", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "a9fa0da4ffc3447795c69b31e4e9a8d0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap30db35d4-e7", "ovs_interfaceid": "30db35d4-e78c-414e-bae8-593d9aaadda8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74613) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 18:05:36 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-9fdf8589-f654-451c-bce7-93121c4de731 req-fc73a408-f33c-4098-9cbe-b1b600fd7a29 service nova] Releasing lock "refresh_cache-56de3dd1-6873-4c0a-9d80-58518dfd671e" {{(pid=74613) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 18:05:36 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:05:37 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:05:38 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:05:38 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-808081ba-0103-442f-bfae-00dde122d205 tempest-TaggedBootDevicesTest-477858861 tempest-TaggedBootDevicesTest-477858861-project-member] Acquiring lock "56de3dd1-6873-4c0a-9d80-58518dfd671e" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 18:05:38 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-808081ba-0103-442f-bfae-00dde122d205 tempest-TaggedBootDevicesTest-477858861 tempest-TaggedBootDevicesTest-477858861-project-member] Lock "56de3dd1-6873-4c0a-9d80-58518dfd671e" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 18:05:38 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-808081ba-0103-442f-bfae-00dde122d205 tempest-TaggedBootDevicesTest-477858861 tempest-TaggedBootDevicesTest-477858861-project-member] Acquiring lock "56de3dd1-6873-4c0a-9d80-58518dfd671e-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 18:05:38 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-808081ba-0103-442f-bfae-00dde122d205 tempest-TaggedBootDevicesTest-477858861 tempest-TaggedBootDevicesTest-477858861-project-member] Lock "56de3dd1-6873-4c0a-9d80-58518dfd671e-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 18:05:38 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-808081ba-0103-442f-bfae-00dde122d205 tempest-TaggedBootDevicesTest-477858861 tempest-TaggedBootDevicesTest-477858861-project-member] Lock "56de3dd1-6873-4c0a-9d80-58518dfd671e-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 18:05:38 user nova-compute[74613]: INFO nova.compute.manager [None req-808081ba-0103-442f-bfae-00dde122d205 tempest-TaggedBootDevicesTest-477858861 tempest-TaggedBootDevicesTest-477858861-project-member] [instance: 56de3dd1-6873-4c0a-9d80-58518dfd671e] Terminating instance
Nov 29 18:05:38 user nova-compute[74613]: DEBUG nova.compute.manager [None req-808081ba-0103-442f-bfae-00dde122d205 tempest-TaggedBootDevicesTest-477858861 tempest-TaggedBootDevicesTest-477858861-project-member] [instance: 56de3dd1-6873-4c0a-9d80-58518dfd671e] Start destroying the instance on the hypervisor. {{(pid=74613) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 29 18:05:38 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:05:38 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:05:38 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:05:38 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:05:38 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:05:38 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:05:38 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:05:38 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:05:38 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:05:39 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:05:39 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:05:39 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:05:39 user nova-compute[74613]: DEBUG nova.compute.manager [req-4e8acaed-2c25-4fa0-ae10-71204d23836e req-b9b5a1c8-ab1a-455e-81ab-a645254bb2aa service nova] [instance: 56de3dd1-6873-4c0a-9d80-58518dfd671e] Received event network-vif-unplugged-70ada3a3-186a-425a-8c4c-7af3b2d647ef {{(pid=74613) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 18:05:39 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-4e8acaed-2c25-4fa0-ae10-71204d23836e req-b9b5a1c8-ab1a-455e-81ab-a645254bb2aa service nova] Acquiring lock "56de3dd1-6873-4c0a-9d80-58518dfd671e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 18:05:39 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-4e8acaed-2c25-4fa0-ae10-71204d23836e req-b9b5a1c8-ab1a-455e-81ab-a645254bb2aa service nova] Lock "56de3dd1-6873-4c0a-9d80-58518dfd671e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 18:05:39 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-4e8acaed-2c25-4fa0-ae10-71204d23836e req-b9b5a1c8-ab1a-455e-81ab-a645254bb2aa service nova] Lock "56de3dd1-6873-4c0a-9d80-58518dfd671e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 18:05:39 user nova-compute[74613]: DEBUG nova.compute.manager [req-4e8acaed-2c25-4fa0-ae10-71204d23836e req-b9b5a1c8-ab1a-455e-81ab-a645254bb2aa service nova] [instance: 56de3dd1-6873-4c0a-9d80-58518dfd671e] No waiting events found dispatching network-vif-unplugged-70ada3a3-186a-425a-8c4c-7af3b2d647ef {{(pid=74613) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 18:05:39 user nova-compute[74613]: DEBUG nova.compute.manager [req-4e8acaed-2c25-4fa0-ae10-71204d23836e req-b9b5a1c8-ab1a-455e-81ab-a645254bb2aa service nova] [instance: 56de3dd1-6873-4c0a-9d80-58518dfd671e] Received event network-vif-unplugged-70ada3a3-186a-425a-8c4c-7af3b2d647ef for instance with task_state deleting. {{(pid=74613) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 29 18:05:39 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:05:39 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:05:39 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:05:39 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:05:39 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:05:39 user nova-compute[74613]: DEBUG nova.compute.manager [req-9239220f-503c-445e-bbe5-6a0069c7f694 req-3a5f1550-625f-441f-a495-65a4509035da service nova] [instance: 56de3dd1-6873-4c0a-9d80-58518dfd671e] Received event network-vif-unplugged-bfeedb02-28d2-4e4c-8a6b-da87e4b8f9cb {{(pid=74613) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 18:05:39 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-9239220f-503c-445e-bbe5-6a0069c7f694 req-3a5f1550-625f-441f-a495-65a4509035da service nova] Acquiring lock "56de3dd1-6873-4c0a-9d80-58518dfd671e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 18:05:39 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-9239220f-503c-445e-bbe5-6a0069c7f694 req-3a5f1550-625f-441f-a495-65a4509035da service nova] Lock "56de3dd1-6873-4c0a-9d80-58518dfd671e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 18:05:39 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-9239220f-503c-445e-bbe5-6a0069c7f694 req-3a5f1550-625f-441f-a495-65a4509035da service nova] Lock "56de3dd1-6873-4c0a-9d80-58518dfd671e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 18:05:39 user nova-compute[74613]: DEBUG nova.compute.manager [req-9239220f-503c-445e-bbe5-6a0069c7f694 req-3a5f1550-625f-441f-a495-65a4509035da service nova] [instance: 56de3dd1-6873-4c0a-9d80-58518dfd671e] No waiting events found dispatching network-vif-unplugged-bfeedb02-28d2-4e4c-8a6b-da87e4b8f9cb {{(pid=74613) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 18:05:39 user nova-compute[74613]: DEBUG nova.compute.manager [req-9239220f-503c-445e-bbe5-6a0069c7f694 req-3a5f1550-625f-441f-a495-65a4509035da service nova] [instance: 56de3dd1-6873-4c0a-9d80-58518dfd671e] Received event network-vif-unplugged-bfeedb02-28d2-4e4c-8a6b-da87e4b8f9cb for instance with task_state deleting. {{(pid=74613) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 29 18:05:39 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:05:39 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:05:39 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:05:39 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:05:39 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:05:40 user nova-compute[74613]: INFO nova.compute.manager [None req-6ac55ef6-2860-4318-bd34-e22b65aa36c1 tempest-ServerBootFromVolumeStableRescueTest-414665510 tempest-ServerBootFromVolumeStableRescueTest-414665510-project-member] [instance: d3c285cd-9f39-423c-a324-30a48a9c66be] Rescuing
Nov 29 18:05:40 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-6ac55ef6-2860-4318-bd34-e22b65aa36c1 tempest-ServerBootFromVolumeStableRescueTest-414665510 tempest-ServerBootFromVolumeStableRescueTest-414665510-project-member] Acquiring lock "refresh_cache-d3c285cd-9f39-423c-a324-30a48a9c66be" {{(pid=74613) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 18:05:40 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-6ac55ef6-2860-4318-bd34-e22b65aa36c1 tempest-ServerBootFromVolumeStableRescueTest-414665510 tempest-ServerBootFromVolumeStableRescueTest-414665510-project-member] Acquired lock "refresh_cache-d3c285cd-9f39-423c-a324-30a48a9c66be" {{(pid=74613) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 18:05:40 user nova-compute[74613]: DEBUG nova.network.neutron [None req-6ac55ef6-2860-4318-bd34-e22b65aa36c1 tempest-ServerBootFromVolumeStableRescueTest-414665510 tempest-ServerBootFromVolumeStableRescueTest-414665510-project-member] [instance: d3c285cd-9f39-423c-a324-30a48a9c66be] Building network info cache for instance {{(pid=74613) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 29 18:05:40 user nova-compute[74613]: INFO nova.virt.libvirt.driver [-] [instance: 56de3dd1-6873-4c0a-9d80-58518dfd671e] Instance destroyed successfully.
Nov 29 18:05:40 user nova-compute[74613]: DEBUG nova.objects.instance [None req-808081ba-0103-442f-bfae-00dde122d205 tempest-TaggedBootDevicesTest-477858861 tempest-TaggedBootDevicesTest-477858861-project-member] Lazy-loading 'resources' on Instance uuid 56de3dd1-6873-4c0a-9d80-58518dfd671e {{(pid=74613) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 18:05:40 user nova-compute[74613]: DEBUG nova.virt.libvirt.vif [None req-808081ba-0103-442f-bfae-00dde122d205 tempest-TaggedBootDevicesTest-477858861 tempest-TaggedBootDevicesTest-477858861-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-29T18:03:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-673218276',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-673218276',id=26,image_ref='4217f428-8d9d-4ee1-9614-642d26d90c46',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGL96hGsOikLqEHhsj9njCpyfE8e3V+KiaQzlnoRrJRaG1J/31X2lFl/ghui5RIyt0tbBjgF9ySvX5PG4tyErQ1KUFBDp+LZCscA6MDkYFpNo0AlMS+hxWRKFmIZybqZvg==',key_name='tempest-keypair-1703547228',keypairs=<?>,launch_index=0,launched_at=2023-11-29T18:04:22Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='a9fa0da4ffc3447795c69b31e4e9a8d0',ramdisk_id='',reservation_id='r-9nbsmznw',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='4217f428-8d9d-4ee1-9614-642d26d90c46',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-477858861',owner_user_name='tempest-TaggedBootDevicesTest-477858861-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-29T18:04:22Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5e784791fe274eb7bf8e7b31fdff19f9',uuid=56de3dd1-6873-4c0a-9d80-58518dfd671e,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "fd1eeb3e-46e9-441a-90e1-048c5ad64d0e", "address": "fa:16:3e:23:fc:5e", "network": {"id": "de42d2ca-c48c-4dc3-8b92-61dc7cbafb64", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-203953398-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.80", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a9fa0da4ffc3447795c69b31e4e9a8d0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfd1eeb3e-46", "ovs_interfaceid": "fd1eeb3e-46e9-441a-90e1-048c5ad64d0e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74613) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 29 18:05:40 user nova-compute[74613]: DEBUG nova.network.os_vif_util [None req-808081ba-0103-442f-bfae-00dde122d205 tempest-TaggedBootDevicesTest-477858861 tempest-TaggedBootDevicesTest-477858861-project-member] Converting VIF {"id": "fd1eeb3e-46e9-441a-90e1-048c5ad64d0e", "address": "fa:16:3e:23:fc:5e", "network": {"id": "de42d2ca-c48c-4dc3-8b92-61dc7cbafb64", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-203953398-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.80", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a9fa0da4ffc3447795c69b31e4e9a8d0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfd1eeb3e-46", "ovs_interfaceid": "fd1eeb3e-46e9-441a-90e1-048c5ad64d0e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74613) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 18:05:40 user nova-compute[74613]: DEBUG nova.network.os_vif_util [None req-808081ba-0103-442f-bfae-00dde122d205 tempest-TaggedBootDevicesTest-477858861 tempest-TaggedBootDevicesTest-477858861-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:23:fc:5e,bridge_name='br-int',has_traffic_filtering=True,id=fd1eeb3e-46e9-441a-90e1-048c5ad64d0e,network=Network(de42d2ca-c48c-4dc3-8b92-61dc7cbafb64),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfd1eeb3e-46') {{(pid=74613) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 18:05:40 user nova-compute[74613]: DEBUG os_vif [None req-808081ba-0103-442f-bfae-00dde122d205 tempest-TaggedBootDevicesTest-477858861 tempest-TaggedBootDevicesTest-477858861-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:23:fc:5e,bridge_name='br-int',has_traffic_filtering=True,id=fd1eeb3e-46e9-441a-90e1-048c5ad64d0e,network=Network(de42d2ca-c48c-4dc3-8b92-61dc7cbafb64),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfd1eeb3e-46') {{(pid=74613) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 29 18:05:40 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:05:40 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapfd1eeb3e-46, bridge=br-int, if_exists=True) {{(pid=74613) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 18:05:40 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:05:40 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 18:05:40 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:05:40 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:05:40 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=0b578eb5-96bb-47e3-af46-49c6f4f395b8) {{(pid=74613) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 18:05:40 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:05:40 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 18:05:40 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:05:40 user nova-compute[74613]: INFO os_vif [None req-808081ba-0103-442f-bfae-00dde122d205 tempest-TaggedBootDevicesTest-477858861 tempest-TaggedBootDevicesTest-477858861-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:23:fc:5e,bridge_name='br-int',has_traffic_filtering=True,id=fd1eeb3e-46e9-441a-90e1-048c5ad64d0e,network=Network(de42d2ca-c48c-4dc3-8b92-61dc7cbafb64),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfd1eeb3e-46')
Nov 29 18:05:40 user nova-compute[74613]: DEBUG nova.virt.libvirt.vif [None req-808081ba-0103-442f-bfae-00dde122d205 tempest-TaggedBootDevicesTest-477858861 tempest-TaggedBootDevicesTest-477858861-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-29T18:03:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-673218276',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-673218276',id=26,image_ref='4217f428-8d9d-4ee1-9614-642d26d90c46',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGL96hGsOikLqEHhsj9njCpyfE8e3V+KiaQzlnoRrJRaG1J/31X2lFl/ghui5RIyt0tbBjgF9ySvX5PG4tyErQ1KUFBDp+LZCscA6MDkYFpNo0AlMS+hxWRKFmIZybqZvg==',key_name='tempest-keypair-1703547228',keypairs=<?>,launch_index=0,launched_at=2023-11-29T18:04:22Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='a9fa0da4ffc3447795c69b31e4e9a8d0',ramdisk_id='',reservation_id='r-9nbsmznw',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='4217f428-8d9d-4ee1-9614-642d26d90c46',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-477858861',owner_user_name='tempest-TaggedBootDevicesTest-477858861-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-29T18:04:22Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5e784791fe274eb7bf8e7b31fdff19f9',uuid=56de3dd1-6873-4c0a-9d80-58518dfd671e,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "7d1e40a2-4a06-4e8e-935c-3d66553dac82", "address": "fa:16:3e:a9:89:7f", "network": {"id": "3143fa56-ddfb-4a80-8df7-33d38513cf4b", "bridge": "br-int", "label": "tempest-device-tagging-net1-2047429033", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.201", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "a9fa0da4ffc3447795c69b31e4e9a8d0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7d1e40a2-4a", "ovs_interfaceid": "7d1e40a2-4a06-4e8e-935c-3d66553dac82", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74613) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 29 18:05:40 user nova-compute[74613]: DEBUG nova.network.os_vif_util [None req-808081ba-0103-442f-bfae-00dde122d205 tempest-TaggedBootDevicesTest-477858861 tempest-TaggedBootDevicesTest-477858861-project-member] Converting VIF {"id": "7d1e40a2-4a06-4e8e-935c-3d66553dac82", "address": "fa:16:3e:a9:89:7f", "network": {"id": "3143fa56-ddfb-4a80-8df7-33d38513cf4b", "bridge": "br-int", "label": "tempest-device-tagging-net1-2047429033", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.201", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "a9fa0da4ffc3447795c69b31e4e9a8d0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7d1e40a2-4a", "ovs_interfaceid": "7d1e40a2-4a06-4e8e-935c-3d66553dac82", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74613) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 18:05:40 user nova-compute[74613]: DEBUG nova.network.os_vif_util [None req-808081ba-0103-442f-bfae-00dde122d205 tempest-TaggedBootDevicesTest-477858861 tempest-TaggedBootDevicesTest-477858861-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a9:89:7f,bridge_name='br-int',has_traffic_filtering=True,id=7d1e40a2-4a06-4e8e-935c-3d66553dac82,network=Network(3143fa56-ddfb-4a80-8df7-33d38513cf4b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap7d1e40a2-4a') {{(pid=74613) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 18:05:40 user nova-compute[74613]: DEBUG os_vif [None req-808081ba-0103-442f-bfae-00dde122d205 tempest-TaggedBootDevicesTest-477858861 tempest-TaggedBootDevicesTest-477858861-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a9:89:7f,bridge_name='br-int',has_traffic_filtering=True,id=7d1e40a2-4a06-4e8e-935c-3d66553dac82,network=Network(3143fa56-ddfb-4a80-8df7-33d38513cf4b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap7d1e40a2-4a') {{(pid=74613) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 29 18:05:40 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:05:40 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap7d1e40a2-4a, bridge=br-int, if_exists=True) {{(pid=74613) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 18:05:40 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:05:40 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 18:05:40 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:05:40 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:05:40 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=e7343578-e224-4932-b7a7-78cf11f9e4ba) {{(pid=74613) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 18:05:40 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:05:40 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 18:05:40 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:05:40 user nova-compute[74613]: INFO os_vif [None req-808081ba-0103-442f-bfae-00dde122d205 tempest-TaggedBootDevicesTest-477858861 tempest-TaggedBootDevicesTest-477858861-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a9:89:7f,bridge_name='br-int',has_traffic_filtering=True,id=7d1e40a2-4a06-4e8e-935c-3d66553dac82,network=Network(3143fa56-ddfb-4a80-8df7-33d38513cf4b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap7d1e40a2-4a')
Nov 29 18:05:40 user nova-compute[74613]: DEBUG nova.virt.libvirt.vif [None req-808081ba-0103-442f-bfae-00dde122d205 tempest-TaggedBootDevicesTest-477858861 tempest-TaggedBootDevicesTest-477858861-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-29T18:03:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-673218276',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-673218276',id=26,image_ref='4217f428-8d9d-4ee1-9614-642d26d90c46',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGL96hGsOikLqEHhsj9njCpyfE8e3V+KiaQzlnoRrJRaG1J/31X2lFl/ghui5RIyt0tbBjgF9ySvX5PG4tyErQ1KUFBDp+LZCscA6MDkYFpNo0AlMS+hxWRKFmIZybqZvg==',key_name='tempest-keypair-1703547228',keypairs=<?>,launch_index=0,launched_at=2023-11-29T18:04:22Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='a9fa0da4ffc3447795c69b31e4e9a8d0',ramdisk_id='',reservation_id='r-9nbsmznw',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='4217f428-8d9d-4ee1-9614-642d26d90c46',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-477858861',owner_user_name='tempest-TaggedBootDevicesTest-477858861-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-29T18:04:22Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5e784791fe274eb7bf8e7b31fdff19f9',uuid=56de3dd1-6873-4c0a-9d80-58518dfd671e,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "70ada3a3-186a-425a-8c4c-7af3b2d647ef", "address": "fa:16:3e:7f:89:6c", "network": {"id": "3143fa56-ddfb-4a80-8df7-33d38513cf4b", "bridge": "br-int", "label": "tempest-device-tagging-net1-2047429033", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.230", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "a9fa0da4ffc3447795c69b31e4e9a8d0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap70ada3a3-18", "ovs_interfaceid": "70ada3a3-186a-425a-8c4c-7af3b2d647ef", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74613) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 29 18:05:40 user nova-compute[74613]: DEBUG nova.network.os_vif_util [None req-808081ba-0103-442f-bfae-00dde122d205 tempest-TaggedBootDevicesTest-477858861 tempest-TaggedBootDevicesTest-477858861-project-member] Converting VIF {"id": "70ada3a3-186a-425a-8c4c-7af3b2d647ef", "address": "fa:16:3e:7f:89:6c", "network": {"id": "3143fa56-ddfb-4a80-8df7-33d38513cf4b", "bridge": "br-int", "label": "tempest-device-tagging-net1-2047429033", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.230", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "a9fa0da4ffc3447795c69b31e4e9a8d0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap70ada3a3-18", "ovs_interfaceid": "70ada3a3-186a-425a-8c4c-7af3b2d647ef", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74613) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 18:05:40 user nova-compute[74613]: DEBUG nova.network.os_vif_util [None req-808081ba-0103-442f-bfae-00dde122d205 tempest-TaggedBootDevicesTest-477858861 tempest-TaggedBootDevicesTest-477858861-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7f:89:6c,bridge_name='br-int',has_traffic_filtering=True,id=70ada3a3-186a-425a-8c4c-7af3b2d647ef,network=Network(3143fa56-ddfb-4a80-8df7-33d38513cf4b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap70ada3a3-18') {{(pid=74613) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 18:05:40 user nova-compute[74613]: DEBUG os_vif [None req-808081ba-0103-442f-bfae-00dde122d205 tempest-TaggedBootDevicesTest-477858861 tempest-TaggedBootDevicesTest-477858861-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:7f:89:6c,bridge_name='br-int',has_traffic_filtering=True,id=70ada3a3-186a-425a-8c4c-7af3b2d647ef,network=Network(3143fa56-ddfb-4a80-8df7-33d38513cf4b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap70ada3a3-18') {{(pid=74613) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 29 18:05:40 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:05:40 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap70ada3a3-18, bridge=br-int, if_exists=True) {{(pid=74613) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 18:05:40 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:05:40 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 18:05:40 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:05:40 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:05:40 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=5ada9aa8-666e-4b1f-a360-f444450e15ef) {{(pid=74613) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 18:05:40 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:05:40 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 18:05:40 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:05:40 user nova-compute[74613]: INFO os_vif [None req-808081ba-0103-442f-bfae-00dde122d205 tempest-TaggedBootDevicesTest-477858861 tempest-TaggedBootDevicesTest-477858861-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:7f:89:6c,bridge_name='br-int',has_traffic_filtering=True,id=70ada3a3-186a-425a-8c4c-7af3b2d647ef,network=Network(3143fa56-ddfb-4a80-8df7-33d38513cf4b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap70ada3a3-18')
Nov 29 18:05:40 user nova-compute[74613]: DEBUG nova.virt.libvirt.vif [None req-808081ba-0103-442f-bfae-00dde122d205 tempest-TaggedBootDevicesTest-477858861 tempest-TaggedBootDevicesTest-477858861-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-29T18:03:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-673218276',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-673218276',id=26,image_ref='4217f428-8d9d-4ee1-9614-642d26d90c46',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGL96hGsOikLqEHhsj9njCpyfE8e3V+KiaQzlnoRrJRaG1J/31X2lFl/ghui5RIyt0tbBjgF9ySvX5PG4tyErQ1KUFBDp+LZCscA6MDkYFpNo0AlMS+hxWRKFmIZybqZvg==',key_name='tempest-keypair-1703547228',keypairs=<?>,launch_index=0,launched_at=2023-11-29T18:04:22Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='a9fa0da4ffc3447795c69b31e4e9a8d0',ramdisk_id='',reservation_id='r-9nbsmznw',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='4217f428-8d9d-4ee1-9614-642d26d90c46',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-477858861',owner_user_name='tempest-TaggedBootDevicesTest-477858861-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-29T18:04:22Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5e784791fe274eb7bf8e7b31fdff19f9',uuid=56de3dd1-6873-4c0a-9d80-58518dfd671e,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "bfeedb02-28d2-4e4c-8a6b-da87e4b8f9cb", "address": "fa:16:3e:c9:00:90", "network": {"id": "3143fa56-ddfb-4a80-8df7-33d38513cf4b", "bridge": "br-int", "label": "tempest-device-tagging-net1-2047429033", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.251", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "a9fa0da4ffc3447795c69b31e4e9a8d0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbfeedb02-28", "ovs_interfaceid": "bfeedb02-28d2-4e4c-8a6b-da87e4b8f9cb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74613) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 29 18:05:40 user nova-compute[74613]: DEBUG nova.network.os_vif_util [None req-808081ba-0103-442f-bfae-00dde122d205 tempest-TaggedBootDevicesTest-477858861 tempest-TaggedBootDevicesTest-477858861-project-member] Converting VIF {"id": "bfeedb02-28d2-4e4c-8a6b-da87e4b8f9cb", "address": "fa:16:3e:c9:00:90", "network": {"id": "3143fa56-ddfb-4a80-8df7-33d38513cf4b", "bridge": "br-int", "label": "tempest-device-tagging-net1-2047429033", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.251", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "a9fa0da4ffc3447795c69b31e4e9a8d0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbfeedb02-28", "ovs_interfaceid": "bfeedb02-28d2-4e4c-8a6b-da87e4b8f9cb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74613) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 18:05:40 user nova-compute[74613]: DEBUG nova.network.os_vif_util [None req-808081ba-0103-442f-bfae-00dde122d205 tempest-TaggedBootDevicesTest-477858861 tempest-TaggedBootDevicesTest-477858861-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c9:00:90,bridge_name='br-int',has_traffic_filtering=True,id=bfeedb02-28d2-4e4c-8a6b-da87e4b8f9cb,network=Network(3143fa56-ddfb-4a80-8df7-33d38513cf4b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbfeedb02-28') {{(pid=74613) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 18:05:40 user nova-compute[74613]: DEBUG os_vif [None req-808081ba-0103-442f-bfae-00dde122d205 tempest-TaggedBootDevicesTest-477858861 tempest-TaggedBootDevicesTest-477858861-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c9:00:90,bridge_name='br-int',has_traffic_filtering=True,id=bfeedb02-28d2-4e4c-8a6b-da87e4b8f9cb,network=Network(3143fa56-ddfb-4a80-8df7-33d38513cf4b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbfeedb02-28') {{(pid=74613) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 29 18:05:40 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:05:40 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapbfeedb02-28, bridge=br-int, if_exists=True) {{(pid=74613) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 18:05:40 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:05:40 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 18:05:40 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:05:40 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:05:40 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=ac2ecfe0-889d-4619-bd69-2ea1840c3366) {{(pid=74613) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 18:05:40 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:05:40 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 18:05:40 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:05:40 user nova-compute[74613]: INFO os_vif [None req-808081ba-0103-442f-bfae-00dde122d205 tempest-TaggedBootDevicesTest-477858861 tempest-TaggedBootDevicesTest-477858861-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c9:00:90,bridge_name='br-int',has_traffic_filtering=True,id=bfeedb02-28d2-4e4c-8a6b-da87e4b8f9cb,network=Network(3143fa56-ddfb-4a80-8df7-33d38513cf4b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbfeedb02-28')
Nov 29 18:05:40 user nova-compute[74613]: DEBUG nova.virt.libvirt.vif [None req-808081ba-0103-442f-bfae-00dde122d205 tempest-TaggedBootDevicesTest-477858861 tempest-TaggedBootDevicesTest-477858861-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-29T18:03:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-673218276',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-673218276',id=26,image_ref='4217f428-8d9d-4ee1-9614-642d26d90c46',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGL96hGsOikLqEHhsj9njCpyfE8e3V+KiaQzlnoRrJRaG1J/31X2lFl/ghui5RIyt0tbBjgF9ySvX5PG4tyErQ1KUFBDp+LZCscA6MDkYFpNo0AlMS+hxWRKFmIZybqZvg==',key_name='tempest-keypair-1703547228',keypairs=<?>,launch_index=0,launched_at=2023-11-29T18:04:22Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='a9fa0da4ffc3447795c69b31e4e9a8d0',ramdisk_id='',reservation_id='r-9nbsmznw',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='4217f428-8d9d-4ee1-9614-642d26d90c46',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-477858861',owner_user_name='tempest-TaggedBootDevicesTest-477858861-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-29T18:04:22Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5e784791fe274eb7bf8e7b31fdff19f9',uuid=56de3dd1-6873-4c0a-9d80-58518dfd671e,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "a41dc4d4-b94a-4659-8709-566b029d2b20", "address": "fa:16:3e:c3:19:36", "network": {"id": "3143fa56-ddfb-4a80-8df7-33d38513cf4b", "bridge": "br-int", "label": "tempest-device-tagging-net1-2047429033", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.253", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "a9fa0da4ffc3447795c69b31e4e9a8d0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa41dc4d4-b9", "ovs_interfaceid": "a41dc4d4-b94a-4659-8709-566b029d2b20", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74613) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 29 18:05:40 user nova-compute[74613]: DEBUG nova.network.os_vif_util [None req-808081ba-0103-442f-bfae-00dde122d205 tempest-TaggedBootDevicesTest-477858861 tempest-TaggedBootDevicesTest-477858861-project-member] Converting VIF {"id": "a41dc4d4-b94a-4659-8709-566b029d2b20", "address": "fa:16:3e:c3:19:36", "network": {"id": "3143fa56-ddfb-4a80-8df7-33d38513cf4b", "bridge": "br-int", "label": "tempest-device-tagging-net1-2047429033", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.253", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "a9fa0da4ffc3447795c69b31e4e9a8d0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa41dc4d4-b9", "ovs_interfaceid": "a41dc4d4-b94a-4659-8709-566b029d2b20", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74613) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 18:05:40 user nova-compute[74613]: DEBUG nova.network.os_vif_util [None req-808081ba-0103-442f-bfae-00dde122d205 tempest-TaggedBootDevicesTest-477858861 tempest-TaggedBootDevicesTest-477858861-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c3:19:36,bridge_name='br-int',has_traffic_filtering=True,id=a41dc4d4-b94a-4659-8709-566b029d2b20,network=Network(3143fa56-ddfb-4a80-8df7-33d38513cf4b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa41dc4d4-b9') {{(pid=74613) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 18:05:40 user nova-compute[74613]: DEBUG os_vif [None req-808081ba-0103-442f-bfae-00dde122d205 tempest-TaggedBootDevicesTest-477858861 tempest-TaggedBootDevicesTest-477858861-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c3:19:36,bridge_name='br-int',has_traffic_filtering=True,id=a41dc4d4-b94a-4659-8709-566b029d2b20,network=Network(3143fa56-ddfb-4a80-8df7-33d38513cf4b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa41dc4d4-b9') {{(pid=74613) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 29 18:05:40 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:05:40 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapa41dc4d4-b9, bridge=br-int, if_exists=True) {{(pid=74613) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 18:05:40 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:05:40 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 18:05:40 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:05:40 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:05:40 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=a7047048-e359-482d-a0f4-2c8a1a88dae1) {{(pid=74613) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 18:05:40 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 18:05:40 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:05:40 user nova-compute[74613]: DEBUG nova.network.neutron [None req-6ac55ef6-2860-4318-bd34-e22b65aa36c1 tempest-ServerBootFromVolumeStableRescueTest-414665510 tempest-ServerBootFromVolumeStableRescueTest-414665510-project-member] [instance: d3c285cd-9f39-423c-a324-30a48a9c66be] Updating instance_info_cache with network_info: [{"id": "663e4724-b31b-469d-a5ea-c2802db1e0c8", "address": "fa:16:3e:11:80:42", "network": {"id": "0722b02d-a357-4360-87e8-580913723985", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-579793494-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b820dd795dfe46cd804772f0e71f98e9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap663e4724-b3", "ovs_interfaceid": "663e4724-b31b-469d-a5ea-c2802db1e0c8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74613) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 18:05:40 user nova-compute[74613]: INFO os_vif [None req-808081ba-0103-442f-bfae-00dde122d205 tempest-TaggedBootDevicesTest-477858861 tempest-TaggedBootDevicesTest-477858861-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c3:19:36,bridge_name='br-int',has_traffic_filtering=True,id=a41dc4d4-b94a-4659-8709-566b029d2b20,network=Network(3143fa56-ddfb-4a80-8df7-33d38513cf4b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa41dc4d4-b9')
Nov 29 18:05:40 user nova-compute[74613]: DEBUG nova.virt.libvirt.vif [None req-808081ba-0103-442f-bfae-00dde122d205 tempest-TaggedBootDevicesTest-477858861 tempest-TaggedBootDevicesTest-477858861-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-29T18:03:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-673218276',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-673218276',id=26,image_ref='4217f428-8d9d-4ee1-9614-642d26d90c46',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGL96hGsOikLqEHhsj9njCpyfE8e3V+KiaQzlnoRrJRaG1J/31X2lFl/ghui5RIyt0tbBjgF9ySvX5PG4tyErQ1KUFBDp+LZCscA6MDkYFpNo0AlMS+hxWRKFmIZybqZvg==',key_name='tempest-keypair-1703547228',keypairs=<?>,launch_index=0,launched_at=2023-11-29T18:04:22Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='a9fa0da4ffc3447795c69b31e4e9a8d0',ramdisk_id='',reservation_id='r-9nbsmznw',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='4217f428-8d9d-4ee1-9614-642d26d90c46',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-477858861',owner_user_name='tempest-TaggedBootDevicesTest-477858861-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-29T18:04:22Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5e784791fe274eb7bf8e7b31fdff19f9',uuid=56de3dd1-6873-4c0a-9d80-58518dfd671e,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "4e39483b-3a24-4948-8025-ab381a1a6eee", "address": "fa:16:3e:b3:40:e7", "network": {"id": "e20648c0-8ed3-4009-b577-e6af59d212cd", "bridge": "br-int", "label": "tempest-device-tagging-net2-1059246863", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "a9fa0da4ffc3447795c69b31e4e9a8d0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4e39483b-3a", "ovs_interfaceid": "4e39483b-3a24-4948-8025-ab381a1a6eee", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74613) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 29 18:05:40 user nova-compute[74613]: DEBUG nova.network.os_vif_util [None req-808081ba-0103-442f-bfae-00dde122d205 tempest-TaggedBootDevicesTest-477858861 tempest-TaggedBootDevicesTest-477858861-project-member] Converting VIF {"id": "4e39483b-3a24-4948-8025-ab381a1a6eee", "address": "fa:16:3e:b3:40:e7", "network": {"id": "e20648c0-8ed3-4009-b577-e6af59d212cd", "bridge": "br-int", "label": "tempest-device-tagging-net2-1059246863", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "a9fa0da4ffc3447795c69b31e4e9a8d0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4e39483b-3a", "ovs_interfaceid": "4e39483b-3a24-4948-8025-ab381a1a6eee", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74613) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 18:05:40 user nova-compute[74613]: DEBUG nova.network.os_vif_util [None req-808081ba-0103-442f-bfae-00dde122d205 tempest-TaggedBootDevicesTest-477858861 tempest-TaggedBootDevicesTest-477858861-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b3:40:e7,bridge_name='br-int',has_traffic_filtering=True,id=4e39483b-3a24-4948-8025-ab381a1a6eee,network=Network(e20648c0-8ed3-4009-b577-e6af59d212cd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4e39483b-3a') {{(pid=74613) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 18:05:40 user nova-compute[74613]: DEBUG os_vif [None req-808081ba-0103-442f-bfae-00dde122d205 tempest-TaggedBootDevicesTest-477858861 tempest-TaggedBootDevicesTest-477858861-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b3:40:e7,bridge_name='br-int',has_traffic_filtering=True,id=4e39483b-3a24-4948-8025-ab381a1a6eee,network=Network(e20648c0-8ed3-4009-b577-e6af59d212cd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4e39483b-3a') {{(pid=74613) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 29 18:05:40 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:05:41 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap4e39483b-3a, bridge=br-int, if_exists=True) {{(pid=74613) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 18:05:41 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:05:41 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 18:05:41 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-6ac55ef6-2860-4318-bd34-e22b65aa36c1 tempest-ServerBootFromVolumeStableRescueTest-414665510 tempest-ServerBootFromVolumeStableRescueTest-414665510-project-member] Releasing lock "refresh_cache-d3c285cd-9f39-423c-a324-30a48a9c66be" {{(pid=74613) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 18:05:41 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:05:41 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:05:41 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=17f88e1a-98dc-459b-8ffd-d7e7c58a7585) {{(pid=74613) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 18:05:41 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:05:41 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 18:05:41 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:05:41 user nova-compute[74613]: INFO os_vif [None req-808081ba-0103-442f-bfae-00dde122d205 tempest-TaggedBootDevicesTest-477858861 tempest-TaggedBootDevicesTest-477858861-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b3:40:e7,bridge_name='br-int',has_traffic_filtering=True,id=4e39483b-3a24-4948-8025-ab381a1a6eee,network=Network(e20648c0-8ed3-4009-b577-e6af59d212cd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4e39483b-3a')
Nov 29 18:05:41 user nova-compute[74613]: DEBUG nova.virt.libvirt.vif [None req-808081ba-0103-442f-bfae-00dde122d205 tempest-TaggedBootDevicesTest-477858861 tempest-TaggedBootDevicesTest-477858861-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-29T18:03:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-673218276',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-673218276',id=26,image_ref='4217f428-8d9d-4ee1-9614-642d26d90c46',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGL96hGsOikLqEHhsj9njCpyfE8e3V+KiaQzlnoRrJRaG1J/31X2lFl/ghui5RIyt0tbBjgF9ySvX5PG4tyErQ1KUFBDp+LZCscA6MDkYFpNo0AlMS+hxWRKFmIZybqZvg==',key_name='tempest-keypair-1703547228',keypairs=<?>,launch_index=0,launched_at=2023-11-29T18:04:22Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='a9fa0da4ffc3447795c69b31e4e9a8d0',ramdisk_id='',reservation_id='r-9nbsmznw',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='4217f428-8d9d-4ee1-9614-642d26d90c46',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-477858861',owner_user_name='tempest-TaggedBootDevicesTest-477858861-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-29T18:04:22Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5e784791fe274eb7bf8e7b31fdff19f9',uuid=56de3dd1-6873-4c0a-9d80-58518dfd671e,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "30db35d4-e78c-414e-bae8-593d9aaadda8", "address": "fa:16:3e:a3:1f:b8", "network": {"id": "e20648c0-8ed3-4009-b577-e6af59d212cd", "bridge": "br-int", "label": "tempest-device-tagging-net2-1059246863", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "a9fa0da4ffc3447795c69b31e4e9a8d0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap30db35d4-e7", "ovs_interfaceid": "30db35d4-e78c-414e-bae8-593d9aaadda8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74613) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 29 18:05:41 user nova-compute[74613]: DEBUG nova.network.os_vif_util [None req-808081ba-0103-442f-bfae-00dde122d205 tempest-TaggedBootDevicesTest-477858861 tempest-TaggedBootDevicesTest-477858861-project-member] Converting VIF {"id": "30db35d4-e78c-414e-bae8-593d9aaadda8", "address": "fa:16:3e:a3:1f:b8", "network": {"id": "e20648c0-8ed3-4009-b577-e6af59d212cd", "bridge": "br-int", "label": "tempest-device-tagging-net2-1059246863", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "a9fa0da4ffc3447795c69b31e4e9a8d0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap30db35d4-e7", "ovs_interfaceid": "30db35d4-e78c-414e-bae8-593d9aaadda8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74613) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 18:05:41 user nova-compute[74613]: DEBUG nova.network.os_vif_util [None req-808081ba-0103-442f-bfae-00dde122d205 tempest-TaggedBootDevicesTest-477858861 tempest-TaggedBootDevicesTest-477858861-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a3:1f:b8,bridge_name='br-int',has_traffic_filtering=True,id=30db35d4-e78c-414e-bae8-593d9aaadda8,network=Network(e20648c0-8ed3-4009-b577-e6af59d212cd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap30db35d4-e7') {{(pid=74613) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 18:05:41 user nova-compute[74613]: DEBUG os_vif [None req-808081ba-0103-442f-bfae-00dde122d205 tempest-TaggedBootDevicesTest-477858861 tempest-TaggedBootDevicesTest-477858861-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a3:1f:b8,bridge_name='br-int',has_traffic_filtering=True,id=30db35d4-e78c-414e-bae8-593d9aaadda8,network=Network(e20648c0-8ed3-4009-b577-e6af59d212cd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap30db35d4-e7') {{(pid=74613) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 29 18:05:41 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:05:41 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap30db35d4-e7, bridge=br-int, if_exists=True) {{(pid=74613) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 18:05:41 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 18:05:41 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:05:41 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=88b87ad9-0db4-4689-af24-315e6ea1e036) {{(pid=74613) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 18:05:41 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 18:05:41 user nova-compute[74613]: INFO os_vif [None req-808081ba-0103-442f-bfae-00dde122d205 tempest-TaggedBootDevicesTest-477858861 tempest-TaggedBootDevicesTest-477858861-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a3:1f:b8,bridge_name='br-int',has_traffic_filtering=True,id=30db35d4-e78c-414e-bae8-593d9aaadda8,network=Network(e20648c0-8ed3-4009-b577-e6af59d212cd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap30db35d4-e7')
Nov 29 18:05:41 user nova-compute[74613]: DEBUG nova.virt.libvirt.volume.iscsi [None req-808081ba-0103-442f-bfae-00dde122d205 tempest-TaggedBootDevicesTest-477858861 tempest-TaggedBootDevicesTest-477858861-project-member] [instance: 56de3dd1-6873-4c0a-9d80-58518dfd671e] calling os-brick to detach iSCSI Volume {{(pid=74613) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 29 18:05:41 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-808081ba-0103-442f-bfae-00dde122d205 tempest-TaggedBootDevicesTest-477858861 tempest-TaggedBootDevicesTest-477858861-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff828156890>, {'target_iqn': 'iqn.2010-10.org.openstack:32c4a58d-da1b-468d-b32a-6ff5cdc8993d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DEfHXlJY', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': True}}" {{(pid=74613) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 18:05:41 user nova-compute[74613]: WARNING os_brick.initiator.connectors.base [None req-808081ba-0103-442f-bfae-00dde122d205 tempest-TaggedBootDevicesTest-477858861 tempest-TaggedBootDevicesTest-477858861-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 18:05:41 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.base [None req-808081ba-0103-442f-bfae-00dde122d205 tempest-TaggedBootDevicesTest-477858861 tempest-TaggedBootDevicesTest-477858861-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 18:05:41 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.base [None req-808081ba-0103-442f-bfae-00dde122d205 tempest-TaggedBootDevicesTest-477858861 tempest-TaggedBootDevicesTest-477858861-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 18:05:41 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:05:41 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:05:41 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[60e4f2bc-bde3-46e0-82a1-fd415a590b20]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:9511387c-8772-40f2-bf2d-6b6387649e9f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:01de4abf-62b4-4200-97dc-9a38d07324e5\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b4a04a56-f988-4ae8-a3d3-271caf058c33\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b9aad94d-fe0d-415d-9761-9aff25cc6099\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:32c4a58d-da1b-468d-b32a-6ff5cdc8993d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a8c53a27-dcde-402b-a9bb-d8642f7db0da\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 18:05:41 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-808081ba-0103-442f-bfae-00dde122d205 tempest-TaggedBootDevicesTest-477858861 tempest-TaggedBootDevicesTest-477858861-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 29 18:05:41 user nova-compute[74613]: No targets found.
Nov 29 18:05:41 user nova-compute[74613]: iSNS:
Nov 29 18:05:41 user nova-compute[74613]: No targets found.
Nov 29 18:05:41 user nova-compute[74613]: STATIC:
Nov 29 18:05:41 user nova-compute[74613]: Target: iqn.2010-10.org.openstack:9511387c-8772-40f2-bf2d-6b6387649e9f
Nov 29 18:05:41 user nova-compute[74613]:         Portal: 172.16.0.220:3260,-1
Nov 29 18:05:41 user nova-compute[74613]:                 Iface Name: default
Nov 29 18:05:41 user nova-compute[74613]: Target: iqn.2010-10.org.openstack:01de4abf-62b4-4200-97dc-9a38d07324e5
Nov 29 18:05:41 user nova-compute[74613]:         Portal: 172.16.0.220:3260,-1
Nov 29 18:05:41 user nova-compute[74613]:                 Iface Name: default
Nov 29 18:05:41 user nova-compute[74613]: Target: iqn.2010-10.org.openstack:b4a04a56-f988-4ae8-a3d3-271caf058c33
Nov 29 18:05:41 user nova-compute[74613]:         Portal: 172.16.0.220:3260,-1
Nov 29 18:05:41 user nova-compute[74613]:                 Iface Name: default
Nov 29 18:05:41 user nova-compute[74613]: Target: iqn.2010-10.org.openstack:b9aad94d-fe0d-415d-9761-9aff25cc6099
Nov 29 18:05:41 user nova-compute[74613]:         Portal: 172.16.0.220:3260,-1
Nov 29 18:05:41 user nova-compute[74613]:                 Iface Name: default
Nov 29 18:05:41 user nova-compute[74613]: Target: iqn.2010-10.org.openstack:32c4a58d-da1b-468d-b32a-6ff5cdc8993d
Nov 29 18:05:41 user nova-compute[74613]:         Portal: 172.16.0.220:3260,-1
Nov 29 18:05:41 user nova-compute[74613]:                 Iface Name: default
Nov 29 18:05:41 user nova-compute[74613]: Target: iqn.2010-10.org.openstack:a8c53a27-dcde-402b-a9bb-d8642f7db0da
Nov 29 18:05:41 user nova-compute[74613]:         Portal: 172.16.0.220:3260,-1
Nov 29 18:05:41 user nova-compute[74613]:                 Iface Name: default
Nov 29 18:05:41 user nova-compute[74613]: FIRMWARE:
Nov 29 18:05:41 user nova-compute[74613]: No targets found.
Nov 29 18:05:41 user nova-compute[74613]:  stderr= {{(pid=74613) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 18:05:41 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-808081ba-0103-442f-bfae-00dde122d205 tempest-TaggedBootDevicesTest-477858861 tempest-TaggedBootDevicesTest-477858861-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 29 18:05:41 user nova-compute[74613]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 29 18:05:41 user nova-compute[74613]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74613) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 29 18:05:41 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-808081ba-0103-442f-bfae-00dde122d205 tempest-TaggedBootDevicesTest-477858861 tempest-TaggedBootDevicesTest-477858861-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:32c4a58d-da1b-468d-b32a-6ff5cdc8993d', 0)] {{(pid=74613) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 29 18:05:41 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:05:41 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.032s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:05:41 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[0bcd939a-1121-4829-9c65-47130257b1d4]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:01de4abf-62b4-4200-97dc-9a38d07324e5\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:32c4a58d-da1b-468d-b32a-6ff5cdc8993d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9511387c-8772-40f2-bf2d-6b6387649e9f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a8c53a27-dcde-402b-a9bb-d8642f7db0da\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b4a04a56-f988-4ae8-a3d3-271caf058c33\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b9aad94d-fe0d-415d-9761-9aff25cc6099\n', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 18:05:41 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:05:41 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:05:41 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:05:41 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.033s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:05:41 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[3fc2d4d6-066c-4c1f-806a-0b27dfb4ea5e]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9511387c-8772-40f2-bf2d-6b6387649e9f (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9aad94d-fe0d-415d-9761-9aff25cc6099 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:32c4a58d-da1b-468d-b32a-6ff5cdc8993d (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4a04a56-f988-4ae8-a3d3-271caf058c33 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01de4abf-62b4-4200-97dc-9a38d07324e5 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8c53a27-dcde-402b-a9bb-d8642f7db0da (non-flash)\n', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 18:05:41 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-808081ba-0103-442f-bfae-00dde122d205 tempest-TaggedBootDevicesTest-477858861 tempest-TaggedBootDevicesTest-477858861-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9511387c-8772-40f2-bf2d-6b6387649e9f (non-flash)
Nov 29 18:05:41 user nova-compute[74613]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9aad94d-fe0d-415d-9761-9aff25cc6099 (non-flash)
Nov 29 18:05:41 user nova-compute[74613]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:32c4a58d-da1b-468d-b32a-6ff5cdc8993d (non-flash)
Nov 29 18:05:41 user nova-compute[74613]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4a04a56-f988-4ae8-a3d3-271caf058c33 (non-flash)
Nov 29 18:05:41 user nova-compute[74613]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01de4abf-62b4-4200-97dc-9a38d07324e5 (non-flash)
Nov 29 18:05:41 user nova-compute[74613]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8c53a27-dcde-402b-a9bb-d8642f7db0da (non-flash)
Nov 29 18:05:41 user nova-compute[74613]:  stderr= {{(pid=74613) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 18:05:41 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-808081ba-0103-442f-bfae-00dde122d205 tempest-TaggedBootDevicesTest-477858861 tempest-TaggedBootDevicesTest-477858861-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9511387c-8772-40f2-bf2d-6b6387649e9f (non-flash)
Nov 29 18:05:41 user nova-compute[74613]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9aad94d-fe0d-415d-9761-9aff25cc6099 (non-flash)
Nov 29 18:05:41 user nova-compute[74613]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:32c4a58d-da1b-468d-b32a-6ff5cdc8993d (non-flash)
Nov 29 18:05:41 user nova-compute[74613]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4a04a56-f988-4ae8-a3d3-271caf058c33 (non-flash)
Nov 29 18:05:41 user nova-compute[74613]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01de4abf-62b4-4200-97dc-9a38d07324e5 (non-flash)
Nov 29 18:05:41 user nova-compute[74613]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8c53a27-dcde-402b-a9bb-d8642f7db0da (non-flash)
Nov 29 18:05:41 user nova-compute[74613]:  stderr= {{(pid=74613) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 18:05:41 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-808081ba-0103-442f-bfae-00dde122d205 tempest-TaggedBootDevicesTest-477858861 tempest-TaggedBootDevicesTest-477858861-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7ff818138310>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:32c4a58d-da1b-468d-b32a-6ff5cdc8993d'): ({'sdd'}, set())}) {{(pid=74613) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 29 18:05:41 user nova-compute[74613]: DEBUG os_brick.initiator.linuxscsi [None req-808081ba-0103-442f-bfae-00dde122d205 tempest-TaggedBootDevicesTest-477858861 tempest-TaggedBootDevicesTest-477858861-project-member] Removing single pathed devices sdd {{(pid=74613) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 29 18:05:41 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:05:41 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.027s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:05:41 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c8b2fb5-fa26-481c-a6e6-7de6811c36c2]: (4, ('path checker states:\nup                  6\n\npaths: 0\nbusy: False\n', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 18:05:41 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:05:41 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.024s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:05:41 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[afc8b986-9b8e-43af-ab01-58179deec89b]: (4, ('ok\n', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 18:05:41 user nova-compute[74613]: DEBUG os_brick.initiator.linuxscsi [None req-808081ba-0103-442f-bfae-00dde122d205 tempest-TaggedBootDevicesTest-477858861 tempest-TaggedBootDevicesTest-477858861-project-member] Flushing IO for device /dev/sdd {{(pid=74613) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 29 18:05:41 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:05:41 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.016s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:05:41 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[e06dd5e6-9fb4-4542-993e-ee7f014f8455]: (4, ('', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 18:05:41 user nova-compute[74613]: DEBUG os_brick.initiator.linuxscsi [None req-808081ba-0103-442f-bfae-00dde122d205 tempest-TaggedBootDevicesTest-477858861 tempest-TaggedBootDevicesTest-477858861-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=74613) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 29 18:05:41 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:05:41 user nova-compute[74613]: DEBUG nova.compute.manager [req-0183f527-bd4a-451d-bb8c-9a6cd62faa7f req-495ca9dc-1452-46dc-856f-2ce7fa3583d7 service nova] [instance: 56de3dd1-6873-4c0a-9d80-58518dfd671e] Received event network-vif-plugged-70ada3a3-186a-425a-8c4c-7af3b2d647ef {{(pid=74613) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 18:05:41 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-0183f527-bd4a-451d-bb8c-9a6cd62faa7f req-495ca9dc-1452-46dc-856f-2ce7fa3583d7 service nova] Acquiring lock "56de3dd1-6873-4c0a-9d80-58518dfd671e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 18:05:41 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-0183f527-bd4a-451d-bb8c-9a6cd62faa7f req-495ca9dc-1452-46dc-856f-2ce7fa3583d7 service nova] Lock "56de3dd1-6873-4c0a-9d80-58518dfd671e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 18:05:41 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-0183f527-bd4a-451d-bb8c-9a6cd62faa7f req-495ca9dc-1452-46dc-856f-2ce7fa3583d7 service nova] Lock "56de3dd1-6873-4c0a-9d80-58518dfd671e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.002s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 18:05:41 user nova-compute[74613]: DEBUG nova.compute.manager [req-0183f527-bd4a-451d-bb8c-9a6cd62faa7f req-495ca9dc-1452-46dc-856f-2ce7fa3583d7 service nova] [instance: 56de3dd1-6873-4c0a-9d80-58518dfd671e] No waiting events found dispatching network-vif-plugged-70ada3a3-186a-425a-8c4c-7af3b2d647ef {{(pid=74613) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 18:05:41 user nova-compute[74613]: WARNING nova.compute.manager [req-0183f527-bd4a-451d-bb8c-9a6cd62faa7f req-495ca9dc-1452-46dc-856f-2ce7fa3583d7 service nova] [instance: 56de3dd1-6873-4c0a-9d80-58518dfd671e] Received unexpected event network-vif-plugged-70ada3a3-186a-425a-8c4c-7af3b2d647ef for instance with vm_state active and task_state deleting.
Nov 29 18:05:41 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.049s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:05:41 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[73090744-ea25-4352-913f-ff294dd95d38]: (4, ('1', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 18:05:41 user nova-compute[74613]: DEBUG os_brick.initiator.linuxscsi [None req-808081ba-0103-442f-bfae-00dde122d205 tempest-TaggedBootDevicesTest-477858861 tempest-TaggedBootDevicesTest-477858861-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=74613) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 29 18:05:41 user nova-compute[74613]: DEBUG os_brick.initiator.linuxscsi [None req-808081ba-0103-442f-bfae-00dde122d205 tempest-TaggedBootDevicesTest-477858861 tempest-TaggedBootDevicesTest-477858861-project-member] SCSI volumes sdd have been removed. {{(pid=74613) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 29 18:05:41 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-808081ba-0103-442f-bfae-00dde122d205 tempest-TaggedBootDevicesTest-477858861 tempest-TaggedBootDevicesTest-477858861-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:32c4a58d-da1b-468d-b32a-6ff5cdc8993d')] {{(pid=74613) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 29 18:05:41 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:32c4a58d-da1b-468d-b32a-6ff5cdc8993d -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:05:41 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:32c4a58d-da1b-468d-b32a-6ff5cdc8993d -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:05:41 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8a0e75d-6204-4cae-b941-6ce897f8c496]: (4, ('', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 18:05:41 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-808081ba-0103-442f-bfae-00dde122d205 tempest-TaggedBootDevicesTest-477858861 tempest-TaggedBootDevicesTest-477858861-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74613) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 18:05:41 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:32c4a58d-da1b-468d-b32a-6ff5cdc8993d -p 172.16.0.220:3260 --logout {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:05:41 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:05:41 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:05:41 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:32c4a58d-da1b-468d-b32a-6ff5cdc8993d -p 172.16.0.220:3260 --logout" returned: 0 in 0.080s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:05:41 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[165504e4-80bf-40d5-8d2b-adb34a249ac7]: (4, ('Logging out of session [sid: 30, target: iqn.2010-10.org.openstack:32c4a58d-da1b-468d-b32a-6ff5cdc8993d, portal: 172.16.0.220,3260]\nLogout of [sid: 30, target: iqn.2010-10.org.openstack:32c4a58d-da1b-468d-b32a-6ff5cdc8993d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 18:05:41 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-808081ba-0103-442f-bfae-00dde122d205 tempest-TaggedBootDevicesTest-477858861 tempest-TaggedBootDevicesTest-477858861-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 30, target: iqn.2010-10.org.openstack:32c4a58d-da1b-468d-b32a-6ff5cdc8993d, portal: 172.16.0.220,3260]
Nov 29 18:05:41 user nova-compute[74613]: Logout of [sid: 30, target: iqn.2010-10.org.openstack:32c4a58d-da1b-468d-b32a-6ff5cdc8993d, portal: 172.16.0.220,3260] successful.
Nov 29 18:05:41 user nova-compute[74613]:  stderr= {{(pid=74613) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 18:05:41 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:32c4a58d-da1b-468d-b32a-6ff5cdc8993d -p 172.16.0.220:3260 --op delete {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:05:41 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:32c4a58d-da1b-468d-b32a-6ff5cdc8993d -p 172.16.0.220:3260 --op delete" returned: 0 in 0.034s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:05:41 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[47931f49-6cac-46c8-905a-b79dca81df3b]: (4, ('', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 18:05:41 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-808081ba-0103-442f-bfae-00dde122d205 tempest-TaggedBootDevicesTest-477858861 tempest-TaggedBootDevicesTest-477858861-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74613) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 18:05:41 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.base [None req-808081ba-0103-442f-bfae-00dde122d205 tempest-TaggedBootDevicesTest-477858861 tempest-TaggedBootDevicesTest-477858861-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.395s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 18:05:41 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-808081ba-0103-442f-bfae-00dde122d205 tempest-TaggedBootDevicesTest-477858861 tempest-TaggedBootDevicesTest-477858861-project-member] <== disconnect_volume: return (396ms) None {{(pid=74613) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 18:05:41 user nova-compute[74613]: DEBUG nova.virt.libvirt.volume.iscsi [None req-808081ba-0103-442f-bfae-00dde122d205 tempest-TaggedBootDevicesTest-477858861 tempest-TaggedBootDevicesTest-477858861-project-member] [instance: 56de3dd1-6873-4c0a-9d80-58518dfd671e] Disconnected iSCSI Volume {{(pid=74613) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 29 18:05:41 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:05:41 user nova-compute[74613]: DEBUG nova.virt.libvirt.volume.iscsi [None req-808081ba-0103-442f-bfae-00dde122d205 tempest-TaggedBootDevicesTest-477858861 tempest-TaggedBootDevicesTest-477858861-project-member] [instance: 56de3dd1-6873-4c0a-9d80-58518dfd671e] calling os-brick to detach iSCSI Volume {{(pid=74613) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 29 18:05:41 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-808081ba-0103-442f-bfae-00dde122d205 tempest-TaggedBootDevicesTest-477858861 tempest-TaggedBootDevicesTest-477858861-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff828156890>, {'target_iqn': 'iqn.2010-10.org.openstack:b4a04a56-f988-4ae8-a3d3-271caf058c33', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'sMoBSTmE', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, None), 'kwargs': True}}" {{(pid=74613) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 18:05:41 user nova-compute[74613]: WARNING os_brick.initiator.connectors.base [None req-808081ba-0103-442f-bfae-00dde122d205 tempest-TaggedBootDevicesTest-477858861 tempest-TaggedBootDevicesTest-477858861-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 18:05:41 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.base [None req-808081ba-0103-442f-bfae-00dde122d205 tempest-TaggedBootDevicesTest-477858861 tempest-TaggedBootDevicesTest-477858861-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 18:05:41 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.base [None req-808081ba-0103-442f-bfae-00dde122d205 tempest-TaggedBootDevicesTest-477858861 tempest-TaggedBootDevicesTest-477858861-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 18:05:41 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:05:41 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:05:41 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[a03f0e96-04f6-4bef-88cf-75e34578d59f]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:9511387c-8772-40f2-bf2d-6b6387649e9f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:01de4abf-62b4-4200-97dc-9a38d07324e5\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b4a04a56-f988-4ae8-a3d3-271caf058c33\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b9aad94d-fe0d-415d-9761-9aff25cc6099\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a8c53a27-dcde-402b-a9bb-d8642f7db0da\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 18:05:41 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-808081ba-0103-442f-bfae-00dde122d205 tempest-TaggedBootDevicesTest-477858861 tempest-TaggedBootDevicesTest-477858861-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 29 18:05:41 user nova-compute[74613]: No targets found.
Nov 29 18:05:41 user nova-compute[74613]: iSNS:
Nov 29 18:05:41 user nova-compute[74613]: No targets found.
Nov 29 18:05:41 user nova-compute[74613]: STATIC:
Nov 29 18:05:41 user nova-compute[74613]: Target: iqn.2010-10.org.openstack:9511387c-8772-40f2-bf2d-6b6387649e9f
Nov 29 18:05:41 user nova-compute[74613]:         Portal: 172.16.0.220:3260,-1
Nov 29 18:05:41 user nova-compute[74613]:                 Iface Name: default
Nov 29 18:05:41 user nova-compute[74613]: Target: iqn.2010-10.org.openstack:01de4abf-62b4-4200-97dc-9a38d07324e5
Nov 29 18:05:41 user nova-compute[74613]:         Portal: 172.16.0.220:3260,-1
Nov 29 18:05:41 user nova-compute[74613]:                 Iface Name: default
Nov 29 18:05:41 user nova-compute[74613]: Target: iqn.2010-10.org.openstack:b4a04a56-f988-4ae8-a3d3-271caf058c33
Nov 29 18:05:41 user nova-compute[74613]:         Portal: 172.16.0.220:3260,-1
Nov 29 18:05:41 user nova-compute[74613]:                 Iface Name: default
Nov 29 18:05:41 user nova-compute[74613]: Target: iqn.2010-10.org.openstack:b9aad94d-fe0d-415d-9761-9aff25cc6099
Nov 29 18:05:41 user nova-compute[74613]:         Portal: 172.16.0.220:3260,-1
Nov 29 18:05:41 user nova-compute[74613]:                 Iface Name: default
Nov 29 18:05:41 user nova-compute[74613]: Target: iqn.2010-10.org.openstack:a8c53a27-dcde-402b-a9bb-d8642f7db0da
Nov 29 18:05:41 user nova-compute[74613]:         Portal: 172.16.0.220:3260,-1
Nov 29 18:05:41 user nova-compute[74613]:                 Iface Name: default
Nov 29 18:05:41 user nova-compute[74613]: FIRMWARE:
Nov 29 18:05:41 user nova-compute[74613]: No targets found.
Nov 29 18:05:41 user nova-compute[74613]:  stderr= {{(pid=74613) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 18:05:41 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-808081ba-0103-442f-bfae-00dde122d205 tempest-TaggedBootDevicesTest-477858861 tempest-TaggedBootDevicesTest-477858861-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 29 18:05:41 user nova-compute[74613]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 29 18:05:41 user nova-compute[74613]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74613) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 29 18:05:41 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-808081ba-0103-442f-bfae-00dde122d205 tempest-TaggedBootDevicesTest-477858861 tempest-TaggedBootDevicesTest-477858861-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b4a04a56-f988-4ae8-a3d3-271caf058c33', 0)] {{(pid=74613) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 29 18:05:41 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:05:41 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:05:41 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e21bbff-9603-41ed-aef2-77dc77701e98]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:01de4abf-62b4-4200-97dc-9a38d07324e5\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9511387c-8772-40f2-bf2d-6b6387649e9f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a8c53a27-dcde-402b-a9bb-d8642f7db0da\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b4a04a56-f988-4ae8-a3d3-271caf058c33\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b9aad94d-fe0d-415d-9761-9aff25cc6099\n', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 18:05:41 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:05:41 user nova-compute[74613]: DEBUG nova.compute.manager [req-79373805-a450-4668-8c06-9ee198518ab3 req-66e9a581-6069-448d-9474-847f738b1e45 service nova] [instance: 56de3dd1-6873-4c0a-9d80-58518dfd671e] Received event network-vif-plugged-bfeedb02-28d2-4e4c-8a6b-da87e4b8f9cb {{(pid=74613) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 18:05:41 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-79373805-a450-4668-8c06-9ee198518ab3 req-66e9a581-6069-448d-9474-847f738b1e45 service nova] Acquiring lock "56de3dd1-6873-4c0a-9d80-58518dfd671e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 18:05:41 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-79373805-a450-4668-8c06-9ee198518ab3 req-66e9a581-6069-448d-9474-847f738b1e45 service nova] Lock "56de3dd1-6873-4c0a-9d80-58518dfd671e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 18:05:41 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-79373805-a450-4668-8c06-9ee198518ab3 req-66e9a581-6069-448d-9474-847f738b1e45 service nova] Lock "56de3dd1-6873-4c0a-9d80-58518dfd671e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 18:05:41 user nova-compute[74613]: DEBUG nova.compute.manager [req-79373805-a450-4668-8c06-9ee198518ab3 req-66e9a581-6069-448d-9474-847f738b1e45 service nova] [instance: 56de3dd1-6873-4c0a-9d80-58518dfd671e] No waiting events found dispatching network-vif-plugged-bfeedb02-28d2-4e4c-8a6b-da87e4b8f9cb {{(pid=74613) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 18:05:41 user nova-compute[74613]: WARNING nova.compute.manager [req-79373805-a450-4668-8c06-9ee198518ab3 req-66e9a581-6069-448d-9474-847f738b1e45 service nova] [instance: 56de3dd1-6873-4c0a-9d80-58518dfd671e] Received unexpected event network-vif-plugged-bfeedb02-28d2-4e4c-8a6b-da87e4b8f9cb for instance with vm_state active and task_state deleting.
Nov 29 18:05:41 user nova-compute[74613]: DEBUG nova.compute.manager [req-79373805-a450-4668-8c06-9ee198518ab3 req-66e9a581-6069-448d-9474-847f738b1e45 service nova] [instance: 56de3dd1-6873-4c0a-9d80-58518dfd671e] Received event network-vif-unplugged-30db35d4-e78c-414e-bae8-593d9aaadda8 {{(pid=74613) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 18:05:41 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-79373805-a450-4668-8c06-9ee198518ab3 req-66e9a581-6069-448d-9474-847f738b1e45 service nova] Acquiring lock "56de3dd1-6873-4c0a-9d80-58518dfd671e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 18:05:41 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-79373805-a450-4668-8c06-9ee198518ab3 req-66e9a581-6069-448d-9474-847f738b1e45 service nova] Lock "56de3dd1-6873-4c0a-9d80-58518dfd671e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 18:05:41 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-79373805-a450-4668-8c06-9ee198518ab3 req-66e9a581-6069-448d-9474-847f738b1e45 service nova] Lock "56de3dd1-6873-4c0a-9d80-58518dfd671e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 18:05:41 user nova-compute[74613]: DEBUG nova.compute.manager [req-79373805-a450-4668-8c06-9ee198518ab3 req-66e9a581-6069-448d-9474-847f738b1e45 service nova] [instance: 56de3dd1-6873-4c0a-9d80-58518dfd671e] No waiting events found dispatching network-vif-unplugged-30db35d4-e78c-414e-bae8-593d9aaadda8 {{(pid=74613) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 18:05:41 user nova-compute[74613]: DEBUG nova.compute.manager [req-79373805-a450-4668-8c06-9ee198518ab3 req-66e9a581-6069-448d-9474-847f738b1e45 service nova] [instance: 56de3dd1-6873-4c0a-9d80-58518dfd671e] Received event network-vif-unplugged-30db35d4-e78c-414e-bae8-593d9aaadda8 for instance with task_state deleting. {{(pid=74613) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 29 18:05:41 user nova-compute[74613]: DEBUG nova.compute.manager [req-79373805-a450-4668-8c06-9ee198518ab3 req-66e9a581-6069-448d-9474-847f738b1e45 service nova] [instance: 56de3dd1-6873-4c0a-9d80-58518dfd671e] Received event network-vif-plugged-30db35d4-e78c-414e-bae8-593d9aaadda8 {{(pid=74613) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 18:05:41 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-79373805-a450-4668-8c06-9ee198518ab3 req-66e9a581-6069-448d-9474-847f738b1e45 service nova] Acquiring lock "56de3dd1-6873-4c0a-9d80-58518dfd671e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 18:05:41 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-79373805-a450-4668-8c06-9ee198518ab3 req-66e9a581-6069-448d-9474-847f738b1e45 service nova] Lock "56de3dd1-6873-4c0a-9d80-58518dfd671e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 18:05:41 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-79373805-a450-4668-8c06-9ee198518ab3 req-66e9a581-6069-448d-9474-847f738b1e45 service nova] Lock "56de3dd1-6873-4c0a-9d80-58518dfd671e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 18:05:41 user nova-compute[74613]: DEBUG nova.compute.manager [req-79373805-a450-4668-8c06-9ee198518ab3 req-66e9a581-6069-448d-9474-847f738b1e45 service nova] [instance: 56de3dd1-6873-4c0a-9d80-58518dfd671e] No waiting events found dispatching network-vif-plugged-30db35d4-e78c-414e-bae8-593d9aaadda8 {{(pid=74613) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 18:05:41 user nova-compute[74613]: WARNING nova.compute.manager [req-79373805-a450-4668-8c06-9ee198518ab3 req-66e9a581-6069-448d-9474-847f738b1e45 service nova] [instance: 56de3dd1-6873-4c0a-9d80-58518dfd671e] Received unexpected event network-vif-plugged-30db35d4-e78c-414e-bae8-593d9aaadda8 for instance with vm_state active and task_state deleting.
Nov 29 18:05:41 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:05:41 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[94671f03-53af-466c-9bbd-c0503d5541a9]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9511387c-8772-40f2-bf2d-6b6387649e9f (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9aad94d-fe0d-415d-9761-9aff25cc6099 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4a04a56-f988-4ae8-a3d3-271caf058c33 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01de4abf-62b4-4200-97dc-9a38d07324e5 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8c53a27-dcde-402b-a9bb-d8642f7db0da (non-flash)\n', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 18:05:41 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-808081ba-0103-442f-bfae-00dde122d205 tempest-TaggedBootDevicesTest-477858861 tempest-TaggedBootDevicesTest-477858861-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9511387c-8772-40f2-bf2d-6b6387649e9f (non-flash)
Nov 29 18:05:41 user nova-compute[74613]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9aad94d-fe0d-415d-9761-9aff25cc6099 (non-flash)
Nov 29 18:05:41 user nova-compute[74613]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4a04a56-f988-4ae8-a3d3-271caf058c33 (non-flash)
Nov 29 18:05:41 user nova-compute[74613]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01de4abf-62b4-4200-97dc-9a38d07324e5 (non-flash)
Nov 29 18:05:41 user nova-compute[74613]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8c53a27-dcde-402b-a9bb-d8642f7db0da (non-flash)
Nov 29 18:05:41 user nova-compute[74613]:  stderr= {{(pid=74613) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 18:05:41 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-808081ba-0103-442f-bfae-00dde122d205 tempest-TaggedBootDevicesTest-477858861 tempest-TaggedBootDevicesTest-477858861-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9511387c-8772-40f2-bf2d-6b6387649e9f (non-flash)
Nov 29 18:05:41 user nova-compute[74613]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9aad94d-fe0d-415d-9761-9aff25cc6099 (non-flash)
Nov 29 18:05:41 user nova-compute[74613]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4a04a56-f988-4ae8-a3d3-271caf058c33 (non-flash)
Nov 29 18:05:41 user nova-compute[74613]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01de4abf-62b4-4200-97dc-9a38d07324e5 (non-flash)
Nov 29 18:05:41 user nova-compute[74613]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8c53a27-dcde-402b-a9bb-d8642f7db0da (non-flash)
Nov 29 18:05:41 user nova-compute[74613]:  stderr= {{(pid=74613) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 18:05:41 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-808081ba-0103-442f-bfae-00dde122d205 tempest-TaggedBootDevicesTest-477858861 tempest-TaggedBootDevicesTest-477858861-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7ff8182e0280>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b4a04a56-f988-4ae8-a3d3-271caf058c33'): ({'sdf'}, set())}) {{(pid=74613) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 29 18:05:41 user nova-compute[74613]: DEBUG os_brick.initiator.linuxscsi [None req-808081ba-0103-442f-bfae-00dde122d205 tempest-TaggedBootDevicesTest-477858861 tempest-TaggedBootDevicesTest-477858861-project-member] Removing single pathed devices sdf {{(pid=74613) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 29 18:05:41 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:05:41 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:05:41 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c355a88-f1a2-4205-b031-bd34fd38ad5d]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 18:05:41 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:05:41 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.021s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:05:41 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[704dcaf8-da5c-4590-abb2-da11127d9f38]: (4, ('ok\n', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 18:05:41 user nova-compute[74613]: DEBUG os_brick.initiator.linuxscsi [None req-808081ba-0103-442f-bfae-00dde122d205 tempest-TaggedBootDevicesTest-477858861 tempest-TaggedBootDevicesTest-477858861-project-member] Flushing IO for device /dev/sdf {{(pid=74613) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 29 18:05:41 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:05:41 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.012s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:05:41 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e29a6d6-3d54-4358-9b89-09aa7e0b736d]: (4, ('', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 18:05:41 user nova-compute[74613]: DEBUG os_brick.initiator.linuxscsi [None req-808081ba-0103-442f-bfae-00dde122d205 tempest-TaggedBootDevicesTest-477858861 tempest-TaggedBootDevicesTest-477858861-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=74613) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 29 18:05:41 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:05:41 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.042s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:05:41 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[589c94c2-4aec-40d0-859f-e7bcfd906071]: (4, ('1', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 18:05:41 user nova-compute[74613]: DEBUG os_brick.initiator.linuxscsi [None req-808081ba-0103-442f-bfae-00dde122d205 tempest-TaggedBootDevicesTest-477858861 tempest-TaggedBootDevicesTest-477858861-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=74613) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 29 18:05:41 user nova-compute[74613]: DEBUG os_brick.initiator.linuxscsi [None req-808081ba-0103-442f-bfae-00dde122d205 tempest-TaggedBootDevicesTest-477858861 tempest-TaggedBootDevicesTest-477858861-project-member] SCSI volumes sdf have been removed. {{(pid=74613) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 29 18:05:41 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-808081ba-0103-442f-bfae-00dde122d205 tempest-TaggedBootDevicesTest-477858861 tempest-TaggedBootDevicesTest-477858861-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b4a04a56-f988-4ae8-a3d3-271caf058c33')] {{(pid=74613) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 29 18:05:41 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b4a04a56-f988-4ae8-a3d3-271caf058c33 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:05:41 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b4a04a56-f988-4ae8-a3d3-271caf058c33 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:05:41 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[62152745-1078-4653-9c0d-389fcefb10bf]: (4, ('', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 18:05:41 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-808081ba-0103-442f-bfae-00dde122d205 tempest-TaggedBootDevicesTest-477858861 tempest-TaggedBootDevicesTest-477858861-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74613) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 18:05:41 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b4a04a56-f988-4ae8-a3d3-271caf058c33 -p 172.16.0.220:3260 --logout {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:05:41 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b4a04a56-f988-4ae8-a3d3-271caf058c33 -p 172.16.0.220:3260 --logout" returned: 0 in 0.069s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:05:41 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[a207c5e9-9eda-49a0-b9bd-e077d9285826]: (4, ('Logging out of session [sid: 31, target: iqn.2010-10.org.openstack:b4a04a56-f988-4ae8-a3d3-271caf058c33, portal: 172.16.0.220,3260]\nLogout of [sid: 31, target: iqn.2010-10.org.openstack:b4a04a56-f988-4ae8-a3d3-271caf058c33, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 18:05:41 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-808081ba-0103-442f-bfae-00dde122d205 tempest-TaggedBootDevicesTest-477858861 tempest-TaggedBootDevicesTest-477858861-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 31, target: iqn.2010-10.org.openstack:b4a04a56-f988-4ae8-a3d3-271caf058c33, portal: 172.16.0.220,3260]
Nov 29 18:05:41 user nova-compute[74613]: Logout of [sid: 31, target: iqn.2010-10.org.openstack:b4a04a56-f988-4ae8-a3d3-271caf058c33, portal: 172.16.0.220,3260] successful.
Nov 29 18:05:41 user nova-compute[74613]:  stderr= {{(pid=74613) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 18:05:41 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b4a04a56-f988-4ae8-a3d3-271caf058c33 -p 172.16.0.220:3260 --op delete {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:05:41 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b4a04a56-f988-4ae8-a3d3-271caf058c33 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.030s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:05:41 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a24a01e-57a4-40eb-8d54-3685293d8ada]: (4, ('', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 18:05:41 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-808081ba-0103-442f-bfae-00dde122d205 tempest-TaggedBootDevicesTest-477858861 tempest-TaggedBootDevicesTest-477858861-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74613) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 18:05:41 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.base [None req-808081ba-0103-442f-bfae-00dde122d205 tempest-TaggedBootDevicesTest-477858861 tempest-TaggedBootDevicesTest-477858861-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.350s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 18:05:41 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-808081ba-0103-442f-bfae-00dde122d205 tempest-TaggedBootDevicesTest-477858861 tempest-TaggedBootDevicesTest-477858861-project-member] <== disconnect_volume: return (351ms) None {{(pid=74613) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 18:05:41 user nova-compute[74613]: DEBUG nova.virt.libvirt.volume.iscsi [None req-808081ba-0103-442f-bfae-00dde122d205 tempest-TaggedBootDevicesTest-477858861 tempest-TaggedBootDevicesTest-477858861-project-member] [instance: 56de3dd1-6873-4c0a-9d80-58518dfd671e] Disconnected iSCSI Volume {{(pid=74613) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 29 18:05:41 user nova-compute[74613]: DEBUG nova.virt.libvirt.volume.iscsi [None req-808081ba-0103-442f-bfae-00dde122d205 tempest-TaggedBootDevicesTest-477858861 tempest-TaggedBootDevicesTest-477858861-project-member] [instance: 56de3dd1-6873-4c0a-9d80-58518dfd671e] calling os-brick to detach iSCSI Volume {{(pid=74613) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 29 18:05:41 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-808081ba-0103-442f-bfae-00dde122d205 tempest-TaggedBootDevicesTest-477858861 tempest-TaggedBootDevicesTest-477858861-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff828156890>, {'target_iqn': 'iqn.2010-10.org.openstack:01de4abf-62b4-4200-97dc-9a38d07324e5', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'aCZvhqSV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdg'}, None), 'kwargs': True}}" {{(pid=74613) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 18:05:41 user nova-compute[74613]: WARNING os_brick.initiator.connectors.base [None req-808081ba-0103-442f-bfae-00dde122d205 tempest-TaggedBootDevicesTest-477858861 tempest-TaggedBootDevicesTest-477858861-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 18:05:41 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.base [None req-808081ba-0103-442f-bfae-00dde122d205 tempest-TaggedBootDevicesTest-477858861 tempest-TaggedBootDevicesTest-477858861-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 18:05:41 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.base [None req-808081ba-0103-442f-bfae-00dde122d205 tempest-TaggedBootDevicesTest-477858861 tempest-TaggedBootDevicesTest-477858861-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 18:05:41 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:05:41 user nova-compute[74613]: INFO nova.virt.libvirt.driver [-] [instance: d3c285cd-9f39-423c-a324-30a48a9c66be] Instance destroyed successfully.
Nov 29 18:05:41 user nova-compute[74613]: INFO nova.virt.libvirt.driver [None req-6ac55ef6-2860-4318-bd34-e22b65aa36c1 tempest-ServerBootFromVolumeStableRescueTest-414665510 tempest-ServerBootFromVolumeStableRescueTest-414665510-project-member] [instance: d3c285cd-9f39-423c-a324-30a48a9c66be] Attempting a stable device rescue
Nov 29 18:05:41 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:05:41 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[b83b3890-cded-4872-823f-cb920b7bf50b]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:9511387c-8772-40f2-bf2d-6b6387649e9f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:01de4abf-62b4-4200-97dc-9a38d07324e5\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b9aad94d-fe0d-415d-9761-9aff25cc6099\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a8c53a27-dcde-402b-a9bb-d8642f7db0da\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 18:05:41 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-808081ba-0103-442f-bfae-00dde122d205 tempest-TaggedBootDevicesTest-477858861 tempest-TaggedBootDevicesTest-477858861-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 29 18:05:41 user nova-compute[74613]: No targets found.
Nov 29 18:05:41 user nova-compute[74613]: iSNS:
Nov 29 18:05:41 user nova-compute[74613]: No targets found.
Nov 29 18:05:41 user nova-compute[74613]: STATIC:
Nov 29 18:05:41 user nova-compute[74613]: Target: iqn.2010-10.org.openstack:9511387c-8772-40f2-bf2d-6b6387649e9f
Nov 29 18:05:41 user nova-compute[74613]:         Portal: 172.16.0.220:3260,-1
Nov 29 18:05:41 user nova-compute[74613]:                 Iface Name: default
Nov 29 18:05:41 user nova-compute[74613]: Target: iqn.2010-10.org.openstack:01de4abf-62b4-4200-97dc-9a38d07324e5
Nov 29 18:05:41 user nova-compute[74613]:         Portal: 172.16.0.220:3260,-1
Nov 29 18:05:41 user nova-compute[74613]:                 Iface Name: default
Nov 29 18:05:41 user nova-compute[74613]: Target: iqn.2010-10.org.openstack:b9aad94d-fe0d-415d-9761-9aff25cc6099
Nov 29 18:05:41 user nova-compute[74613]:         Portal: 172.16.0.220:3260,-1
Nov 29 18:05:41 user nova-compute[74613]:                 Iface Name: default
Nov 29 18:05:41 user nova-compute[74613]: Target: iqn.2010-10.org.openstack:a8c53a27-dcde-402b-a9bb-d8642f7db0da
Nov 29 18:05:41 user nova-compute[74613]:         Portal: 172.16.0.220:3260,-1
Nov 29 18:05:41 user nova-compute[74613]:                 Iface Name: default
Nov 29 18:05:41 user nova-compute[74613]: FIRMWARE:
Nov 29 18:05:41 user nova-compute[74613]: No targets found.
Nov 29 18:05:41 user nova-compute[74613]:  stderr= {{(pid=74613) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 18:05:41 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-808081ba-0103-442f-bfae-00dde122d205 tempest-TaggedBootDevicesTest-477858861 tempest-TaggedBootDevicesTest-477858861-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 29 18:05:41 user nova-compute[74613]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 29 18:05:41 user nova-compute[74613]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74613) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 29 18:05:41 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-808081ba-0103-442f-bfae-00dde122d205 tempest-TaggedBootDevicesTest-477858861 tempest-TaggedBootDevicesTest-477858861-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:01de4abf-62b4-4200-97dc-9a38d07324e5', 0)] {{(pid=74613) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 29 18:05:41 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:05:41 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.024s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:05:41 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[067e6ada-18dd-42b4-ab51-6081e921192c]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:01de4abf-62b4-4200-97dc-9a38d07324e5\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9511387c-8772-40f2-bf2d-6b6387649e9f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a8c53a27-dcde-402b-a9bb-d8642f7db0da\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b9aad94d-fe0d-415d-9761-9aff25cc6099\n', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 18:05:41 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:05:41 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-6ac55ef6-2860-4318-bd34-e22b65aa36c1 tempest-ServerBootFromVolumeStableRescueTest-414665510 tempest-ServerBootFromVolumeStableRescueTest-414665510-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=74613) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4318}}
Nov 29 18:05:41 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-6ac55ef6-2860-4318-bd34-e22b65aa36c1 tempest-ServerBootFromVolumeStableRescueTest-414665510 tempest-ServerBootFromVolumeStableRescueTest-414665510-project-member] [instance: d3c285cd-9f39-423c-a324-30a48a9c66be] Instance directory exists: not creating {{(pid=74613) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Nov 29 18:05:41 user nova-compute[74613]: INFO nova.virt.libvirt.driver [None req-6ac55ef6-2860-4318-bd34-e22b65aa36c1 tempest-ServerBootFromVolumeStableRescueTest-414665510 tempest-ServerBootFromVolumeStableRescueTest-414665510-project-member] [instance: d3c285cd-9f39-423c-a324-30a48a9c66be] Creating image(s)
Nov 29 18:05:41 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-6ac55ef6-2860-4318-bd34-e22b65aa36c1 tempest-ServerBootFromVolumeStableRescueTest-414665510 tempest-ServerBootFromVolumeStableRescueTest-414665510-project-member] Acquiring lock "/opt/stack/data/nova/instances/d3c285cd-9f39-423c-a324-30a48a9c66be/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 18:05:41 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-6ac55ef6-2860-4318-bd34-e22b65aa36c1 tempest-ServerBootFromVolumeStableRescueTest-414665510 tempest-ServerBootFromVolumeStableRescueTest-414665510-project-member] Lock "/opt/stack/data/nova/instances/d3c285cd-9f39-423c-a324-30a48a9c66be/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 18:05:41 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-6ac55ef6-2860-4318-bd34-e22b65aa36c1 tempest-ServerBootFromVolumeStableRescueTest-414665510 tempest-ServerBootFromVolumeStableRescueTest-414665510-project-member] Lock "/opt/stack/data/nova/instances/d3c285cd-9f39-423c-a324-30a48a9c66be/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 18:05:41 user nova-compute[74613]: DEBUG nova.objects.instance [None req-6ac55ef6-2860-4318-bd34-e22b65aa36c1 tempest-ServerBootFromVolumeStableRescueTest-414665510 tempest-ServerBootFromVolumeStableRescueTest-414665510-project-member] Lazy-loading 'trusted_certs' on Instance uuid d3c285cd-9f39-423c-a324-30a48a9c66be {{(pid=74613) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 18:05:41 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:05:41 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7f3c2b0-db41-4713-ba9d-7902b8ca3d3d]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9511387c-8772-40f2-bf2d-6b6387649e9f (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9aad94d-fe0d-415d-9761-9aff25cc6099 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01de4abf-62b4-4200-97dc-9a38d07324e5 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8c53a27-dcde-402b-a9bb-d8642f7db0da (non-flash)\n', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 18:05:41 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-808081ba-0103-442f-bfae-00dde122d205 tempest-TaggedBootDevicesTest-477858861 tempest-TaggedBootDevicesTest-477858861-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9511387c-8772-40f2-bf2d-6b6387649e9f (non-flash)
Nov 29 18:05:41 user nova-compute[74613]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9aad94d-fe0d-415d-9761-9aff25cc6099 (non-flash)
Nov 29 18:05:41 user nova-compute[74613]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01de4abf-62b4-4200-97dc-9a38d07324e5 (non-flash)
Nov 29 18:05:41 user nova-compute[74613]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8c53a27-dcde-402b-a9bb-d8642f7db0da (non-flash)
Nov 29 18:05:41 user nova-compute[74613]:  stderr= {{(pid=74613) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 18:05:41 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-808081ba-0103-442f-bfae-00dde122d205 tempest-TaggedBootDevicesTest-477858861 tempest-TaggedBootDevicesTest-477858861-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9511387c-8772-40f2-bf2d-6b6387649e9f (non-flash)
Nov 29 18:05:41 user nova-compute[74613]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9aad94d-fe0d-415d-9761-9aff25cc6099 (non-flash)
Nov 29 18:05:41 user nova-compute[74613]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01de4abf-62b4-4200-97dc-9a38d07324e5 (non-flash)
Nov 29 18:05:41 user nova-compute[74613]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8c53a27-dcde-402b-a9bb-d8642f7db0da (non-flash)
Nov 29 18:05:41 user nova-compute[74613]:  stderr= {{(pid=74613) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 18:05:41 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-808081ba-0103-442f-bfae-00dde122d205 tempest-TaggedBootDevicesTest-477858861 tempest-TaggedBootDevicesTest-477858861-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7ff818326d40>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:01de4abf-62b4-4200-97dc-9a38d07324e5'): ({'sdg'}, set())}) {{(pid=74613) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 29 18:05:41 user nova-compute[74613]: DEBUG os_brick.initiator.linuxscsi [None req-808081ba-0103-442f-bfae-00dde122d205 tempest-TaggedBootDevicesTest-477858861 tempest-TaggedBootDevicesTest-477858861-project-member] Removing single pathed devices sdg {{(pid=74613) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 29 18:05:41 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:05:41 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-6ac55ef6-2860-4318-bd34-e22b65aa36c1 tempest-ServerBootFromVolumeStableRescueTest-414665510 tempest-ServerBootFromVolumeStableRescueTest-414665510-project-member] Acquiring lock "2d5634798fda50d354bea5b67a8aef5bccbe0f87" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 18:05:41 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-6ac55ef6-2860-4318-bd34-e22b65aa36c1 tempest-ServerBootFromVolumeStableRescueTest-414665510 tempest-ServerBootFromVolumeStableRescueTest-414665510-project-member] Lock "2d5634798fda50d354bea5b67a8aef5bccbe0f87" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.002s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 18:05:41 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:05:41 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[0fcf191d-f567-47f4-92b2-eb920645bd05]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 18:05:41 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdg {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:05:42 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdg" returned: 0 in 0.028s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:05:42 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a0f5248-22f5-4be3-a33d-a5914d604a27]: (4, ('ok\n', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 18:05:42 user nova-compute[74613]: DEBUG os_brick.initiator.linuxscsi [None req-808081ba-0103-442f-bfae-00dde122d205 tempest-TaggedBootDevicesTest-477858861 tempest-TaggedBootDevicesTest-477858861-project-member] Flushing IO for device /dev/sdg {{(pid=74613) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 29 18:05:42 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdg {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:05:42 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdg" returned: 0 in 0.015s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:05:42 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[90bd5db0-9fd8-4ad7-b9cb-71bfa979f330]: (4, ('', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 18:05:42 user nova-compute[74613]: DEBUG os_brick.initiator.linuxscsi [None req-808081ba-0103-442f-bfae-00dde122d205 tempest-TaggedBootDevicesTest-477858861 tempest-TaggedBootDevicesTest-477858861-project-member] Remove SCSI device /dev/sdg with /sys/block/sdg/device/delete {{(pid=74613) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 29 18:05:42 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdg/device/delete {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:05:42 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-6ac55ef6-2860-4318-bd34-e22b65aa36c1 tempest-ServerBootFromVolumeStableRescueTest-414665510 tempest-ServerBootFromVolumeStableRescueTest-414665510-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2d5634798fda50d354bea5b67a8aef5bccbe0f87.part --force-share --output=json {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:05:42 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdg/device/delete" returned: 0 in 0.064s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:05:42 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[6acafbaa-54ac-4049-bb39-a87693d0135b]: (4, ('1', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 18:05:42 user nova-compute[74613]: DEBUG os_brick.initiator.linuxscsi [None req-808081ba-0103-442f-bfae-00dde122d205 tempest-TaggedBootDevicesTest-477858861 tempest-TaggedBootDevicesTest-477858861-project-member] Checking to see if SCSI volumes sdg have been removed. {{(pid=74613) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 29 18:05:42 user nova-compute[74613]: DEBUG os_brick.initiator.linuxscsi [None req-808081ba-0103-442f-bfae-00dde122d205 tempest-TaggedBootDevicesTest-477858861 tempest-TaggedBootDevicesTest-477858861-project-member] SCSI volumes sdg have been removed. {{(pid=74613) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 29 18:05:42 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-808081ba-0103-442f-bfae-00dde122d205 tempest-TaggedBootDevicesTest-477858861 tempest-TaggedBootDevicesTest-477858861-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:01de4abf-62b4-4200-97dc-9a38d07324e5')] {{(pid=74613) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 29 18:05:42 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:01de4abf-62b4-4200-97dc-9a38d07324e5 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:05:42 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:01de4abf-62b4-4200-97dc-9a38d07324e5 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:05:42 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[11d6ecda-386e-41d1-9762-ffb730384eee]: (4, ('', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 18:05:42 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-808081ba-0103-442f-bfae-00dde122d205 tempest-TaggedBootDevicesTest-477858861 tempest-TaggedBootDevicesTest-477858861-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74613) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 18:05:42 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:01de4abf-62b4-4200-97dc-9a38d07324e5 -p 172.16.0.220:3260 --logout {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:05:43 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:01de4abf-62b4-4200-97dc-9a38d07324e5 -p 172.16.0.220:3260 --logout" returned: 0 in 0.057s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:05:43 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[01fed7f5-eb4c-4439-aa80-6a6602456d7d]: (4, ('Logging out of session [sid: 32, target: iqn.2010-10.org.openstack:01de4abf-62b4-4200-97dc-9a38d07324e5, portal: 172.16.0.220,3260]\nLogout of [sid: 32, target: iqn.2010-10.org.openstack:01de4abf-62b4-4200-97dc-9a38d07324e5, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 18:05:43 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-808081ba-0103-442f-bfae-00dde122d205 tempest-TaggedBootDevicesTest-477858861 tempest-TaggedBootDevicesTest-477858861-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 32, target: iqn.2010-10.org.openstack:01de4abf-62b4-4200-97dc-9a38d07324e5, portal: 172.16.0.220,3260]
Nov 29 18:05:43 user nova-compute[74613]: Logout of [sid: 32, target: iqn.2010-10.org.openstack:01de4abf-62b4-4200-97dc-9a38d07324e5, portal: 172.16.0.220,3260] successful.
Nov 29 18:05:43 user nova-compute[74613]:  stderr= {{(pid=74613) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 18:05:43 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:01de4abf-62b4-4200-97dc-9a38d07324e5 -p 172.16.0.220:3260 --op delete {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:05:43 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:01de4abf-62b4-4200-97dc-9a38d07324e5 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.025s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:05:43 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[039927ed-e9d3-42b5-bde1-b06d63aa11f1]: (4, ('', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 18:05:43 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-808081ba-0103-442f-bfae-00dde122d205 tempest-TaggedBootDevicesTest-477858861 tempest-TaggedBootDevicesTest-477858861-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74613) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 18:05:43 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.base [None req-808081ba-0103-442f-bfae-00dde122d205 tempest-TaggedBootDevicesTest-477858861 tempest-TaggedBootDevicesTest-477858861-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 1.222s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 18:05:43 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-808081ba-0103-442f-bfae-00dde122d205 tempest-TaggedBootDevicesTest-477858861 tempest-TaggedBootDevicesTest-477858861-project-member] <== disconnect_volume: return (1224ms) None {{(pid=74613) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 18:05:43 user nova-compute[74613]: DEBUG nova.virt.libvirt.volume.iscsi [None req-808081ba-0103-442f-bfae-00dde122d205 tempest-TaggedBootDevicesTest-477858861 tempest-TaggedBootDevicesTest-477858861-project-member] [instance: 56de3dd1-6873-4c0a-9d80-58518dfd671e] Disconnected iSCSI Volume {{(pid=74613) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 29 18:05:43 user nova-compute[74613]: INFO nova.virt.libvirt.driver [None req-808081ba-0103-442f-bfae-00dde122d205 tempest-TaggedBootDevicesTest-477858861 tempest-TaggedBootDevicesTest-477858861-project-member] [instance: 56de3dd1-6873-4c0a-9d80-58518dfd671e] Deleting instance files /opt/stack/data/nova/instances/56de3dd1-6873-4c0a-9d80-58518dfd671e_del
Nov 29 18:05:43 user nova-compute[74613]: INFO nova.virt.libvirt.driver [None req-808081ba-0103-442f-bfae-00dde122d205 tempest-TaggedBootDevicesTest-477858861 tempest-TaggedBootDevicesTest-477858861-project-member] [instance: 56de3dd1-6873-4c0a-9d80-58518dfd671e] Deletion of /opt/stack/data/nova/instances/56de3dd1-6873-4c0a-9d80-58518dfd671e_del complete
Nov 29 18:05:43 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-6ac55ef6-2860-4318-bd34-e22b65aa36c1 tempest-ServerBootFromVolumeStableRescueTest-414665510 tempest-ServerBootFromVolumeStableRescueTest-414665510-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2d5634798fda50d354bea5b67a8aef5bccbe0f87.part --force-share --output=json" returned: 0 in 0.191s {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:05:43 user nova-compute[74613]: DEBUG nova.virt.images [None req-6ac55ef6-2860-4318-bd34-e22b65aa36c1 tempest-ServerBootFromVolumeStableRescueTest-414665510 tempest-ServerBootFromVolumeStableRescueTest-414665510-project-member] 54e06562-9358-4b48-bf13-742153ce2ecf was qcow2, converting to raw {{(pid=74613) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 29 18:05:43 user nova-compute[74613]: DEBUG nova.privsep.utils [None req-6ac55ef6-2860-4318-bd34-e22b65aa36c1 tempest-ServerBootFromVolumeStableRescueTest-414665510 tempest-ServerBootFromVolumeStableRescueTest-414665510-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74613) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 29 18:05:43 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-6ac55ef6-2860-4318-bd34-e22b65aa36c1 tempest-ServerBootFromVolumeStableRescueTest-414665510 tempest-ServerBootFromVolumeStableRescueTest-414665510-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/2d5634798fda50d354bea5b67a8aef5bccbe0f87.part /opt/stack/data/nova/instances/_base/2d5634798fda50d354bea5b67a8aef5bccbe0f87.converted {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:05:43 user nova-compute[74613]: INFO nova.compute.manager [None req-808081ba-0103-442f-bfae-00dde122d205 tempest-TaggedBootDevicesTest-477858861 tempest-TaggedBootDevicesTest-477858861-project-member] [instance: 56de3dd1-6873-4c0a-9d80-58518dfd671e] Took 4.49 seconds to destroy the instance on the hypervisor.
Nov 29 18:05:43 user nova-compute[74613]: DEBUG oslo.service.loopingcall [None req-808081ba-0103-442f-bfae-00dde122d205 tempest-TaggedBootDevicesTest-477858861 tempest-TaggedBootDevicesTest-477858861-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74613) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 29 18:05:43 user nova-compute[74613]: DEBUG nova.compute.manager [-] [instance: 56de3dd1-6873-4c0a-9d80-58518dfd671e] Deallocating network for instance {{(pid=74613) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 29 18:05:43 user nova-compute[74613]: DEBUG nova.network.neutron [-] [instance: 56de3dd1-6873-4c0a-9d80-58518dfd671e] deallocate_for_instance() {{(pid=74613) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 29 18:05:43 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-6ac55ef6-2860-4318-bd34-e22b65aa36c1 tempest-ServerBootFromVolumeStableRescueTest-414665510 tempest-ServerBootFromVolumeStableRescueTest-414665510-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/2d5634798fda50d354bea5b67a8aef5bccbe0f87.part /opt/stack/data/nova/instances/_base/2d5634798fda50d354bea5b67a8aef5bccbe0f87.converted" returned: 0 in 0.266s {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:05:43 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-6ac55ef6-2860-4318-bd34-e22b65aa36c1 tempest-ServerBootFromVolumeStableRescueTest-414665510 tempest-ServerBootFromVolumeStableRescueTest-414665510-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2d5634798fda50d354bea5b67a8aef5bccbe0f87.converted --force-share --output=json {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:05:43 user nova-compute[74613]: DEBUG nova.compute.manager [req-bf7a06fa-e2f8-4be0-b68c-7e8efedaa050 req-0ef13e12-fc8d-461b-aff8-8f49d9ad550d service nova] [instance: d3c285cd-9f39-423c-a324-30a48a9c66be] Received event network-vif-unplugged-663e4724-b31b-469d-a5ea-c2802db1e0c8 {{(pid=74613) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 18:05:43 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-bf7a06fa-e2f8-4be0-b68c-7e8efedaa050 req-0ef13e12-fc8d-461b-aff8-8f49d9ad550d service nova] Acquiring lock "d3c285cd-9f39-423c-a324-30a48a9c66be-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 18:05:43 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-bf7a06fa-e2f8-4be0-b68c-7e8efedaa050 req-0ef13e12-fc8d-461b-aff8-8f49d9ad550d service nova] Lock "d3c285cd-9f39-423c-a324-30a48a9c66be-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 18:05:43 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-bf7a06fa-e2f8-4be0-b68c-7e8efedaa050 req-0ef13e12-fc8d-461b-aff8-8f49d9ad550d service nova] Lock "d3c285cd-9f39-423c-a324-30a48a9c66be-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 18:05:43 user nova-compute[74613]: DEBUG nova.compute.manager [req-bf7a06fa-e2f8-4be0-b68c-7e8efedaa050 req-0ef13e12-fc8d-461b-aff8-8f49d9ad550d service nova] [instance: d3c285cd-9f39-423c-a324-30a48a9c66be] No waiting events found dispatching network-vif-unplugged-663e4724-b31b-469d-a5ea-c2802db1e0c8 {{(pid=74613) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 18:05:43 user nova-compute[74613]: WARNING nova.compute.manager [req-bf7a06fa-e2f8-4be0-b68c-7e8efedaa050 req-0ef13e12-fc8d-461b-aff8-8f49d9ad550d service nova] [instance: d3c285cd-9f39-423c-a324-30a48a9c66be] Received unexpected event network-vif-unplugged-663e4724-b31b-469d-a5ea-c2802db1e0c8 for instance with vm_state active and task_state rescuing.
Nov 29 18:05:43 user nova-compute[74613]: DEBUG nova.compute.manager [req-bf7a06fa-e2f8-4be0-b68c-7e8efedaa050 req-0ef13e12-fc8d-461b-aff8-8f49d9ad550d service nova] [instance: d3c285cd-9f39-423c-a324-30a48a9c66be] Received event network-vif-plugged-663e4724-b31b-469d-a5ea-c2802db1e0c8 {{(pid=74613) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 18:05:43 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-bf7a06fa-e2f8-4be0-b68c-7e8efedaa050 req-0ef13e12-fc8d-461b-aff8-8f49d9ad550d service nova] Acquiring lock "d3c285cd-9f39-423c-a324-30a48a9c66be-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 18:05:43 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-bf7a06fa-e2f8-4be0-b68c-7e8efedaa050 req-0ef13e12-fc8d-461b-aff8-8f49d9ad550d service nova] Lock "d3c285cd-9f39-423c-a324-30a48a9c66be-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 18:05:43 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-bf7a06fa-e2f8-4be0-b68c-7e8efedaa050 req-0ef13e12-fc8d-461b-aff8-8f49d9ad550d service nova] Lock "d3c285cd-9f39-423c-a324-30a48a9c66be-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 18:05:43 user nova-compute[74613]: DEBUG nova.compute.manager [req-bf7a06fa-e2f8-4be0-b68c-7e8efedaa050 req-0ef13e12-fc8d-461b-aff8-8f49d9ad550d service nova] [instance: d3c285cd-9f39-423c-a324-30a48a9c66be] No waiting events found dispatching network-vif-plugged-663e4724-b31b-469d-a5ea-c2802db1e0c8 {{(pid=74613) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 18:05:43 user nova-compute[74613]: WARNING nova.compute.manager [req-bf7a06fa-e2f8-4be0-b68c-7e8efedaa050 req-0ef13e12-fc8d-461b-aff8-8f49d9ad550d service nova] [instance: d3c285cd-9f39-423c-a324-30a48a9c66be] Received unexpected event network-vif-plugged-663e4724-b31b-469d-a5ea-c2802db1e0c8 for instance with vm_state active and task_state rescuing.
Nov 29 18:05:43 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-6ac55ef6-2860-4318-bd34-e22b65aa36c1 tempest-ServerBootFromVolumeStableRescueTest-414665510 tempest-ServerBootFromVolumeStableRescueTest-414665510-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2d5634798fda50d354bea5b67a8aef5bccbe0f87.converted --force-share --output=json" returned: 0 in 0.179s {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:05:43 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-6ac55ef6-2860-4318-bd34-e22b65aa36c1 tempest-ServerBootFromVolumeStableRescueTest-414665510 tempest-ServerBootFromVolumeStableRescueTest-414665510-project-member] Lock "2d5634798fda50d354bea5b67a8aef5bccbe0f87" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.617s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 18:05:43 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-6ac55ef6-2860-4318-bd34-e22b65aa36c1 tempest-ServerBootFromVolumeStableRescueTest-414665510 tempest-ServerBootFromVolumeStableRescueTest-414665510-project-member] Acquiring lock "2d5634798fda50d354bea5b67a8aef5bccbe0f87" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 18:05:43 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-6ac55ef6-2860-4318-bd34-e22b65aa36c1 tempest-ServerBootFromVolumeStableRescueTest-414665510 tempest-ServerBootFromVolumeStableRescueTest-414665510-project-member] Lock "2d5634798fda50d354bea5b67a8aef5bccbe0f87" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 18:05:43 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-6ac55ef6-2860-4318-bd34-e22b65aa36c1 tempest-ServerBootFromVolumeStableRescueTest-414665510 tempest-ServerBootFromVolumeStableRescueTest-414665510-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2d5634798fda50d354bea5b67a8aef5bccbe0f87 --force-share --output=json {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:05:43 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-6ac55ef6-2860-4318-bd34-e22b65aa36c1 tempest-ServerBootFromVolumeStableRescueTest-414665510 tempest-ServerBootFromVolumeStableRescueTest-414665510-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2d5634798fda50d354bea5b67a8aef5bccbe0f87 --force-share --output=json" returned: 0 in 0.176s {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:05:43 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-6ac55ef6-2860-4318-bd34-e22b65aa36c1 tempest-ServerBootFromVolumeStableRescueTest-414665510 tempest-ServerBootFromVolumeStableRescueTest-414665510-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/2d5634798fda50d354bea5b67a8aef5bccbe0f87,backing_fmt=raw /opt/stack/data/nova/instances/d3c285cd-9f39-423c-a324-30a48a9c66be/disk.rescue {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:05:43 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-6ac55ef6-2860-4318-bd34-e22b65aa36c1 tempest-ServerBootFromVolumeStableRescueTest-414665510 tempest-ServerBootFromVolumeStableRescueTest-414665510-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/2d5634798fda50d354bea5b67a8aef5bccbe0f87,backing_fmt=raw /opt/stack/data/nova/instances/d3c285cd-9f39-423c-a324-30a48a9c66be/disk.rescue" returned: 0 in 0.068s {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:05:43 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-6ac55ef6-2860-4318-bd34-e22b65aa36c1 tempest-ServerBootFromVolumeStableRescueTest-414665510 tempest-ServerBootFromVolumeStableRescueTest-414665510-project-member] Lock "2d5634798fda50d354bea5b67a8aef5bccbe0f87" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.252s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 18:05:43 user nova-compute[74613]: DEBUG nova.objects.instance [None req-6ac55ef6-2860-4318-bd34-e22b65aa36c1 tempest-ServerBootFromVolumeStableRescueTest-414665510 tempest-ServerBootFromVolumeStableRescueTest-414665510-project-member] Lazy-loading 'migration_context' on Instance uuid d3c285cd-9f39-423c-a324-30a48a9c66be {{(pid=74613) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 18:05:43 user nova-compute[74613]: DEBUG nova.objects.base [None req-6ac55ef6-2860-4318-bd34-e22b65aa36c1 tempest-ServerBootFromVolumeStableRescueTest-414665510 tempest-ServerBootFromVolumeStableRescueTest-414665510-project-member] Object Instance<d3c285cd-9f39-423c-a324-30a48a9c66be> lazy-loaded attributes: trusted_certs,migration_context {{(pid=74613) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 29 18:05:43 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-6ac55ef6-2860-4318-bd34-e22b65aa36c1 tempest-ServerBootFromVolumeStableRescueTest-414665510 tempest-ServerBootFromVolumeStableRescueTest-414665510-project-member] [instance: d3c285cd-9f39-423c-a324-30a48a9c66be] Created local disks {{(pid=74613) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 29 18:05:43 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-6ac55ef6-2860-4318-bd34-e22b65aa36c1 tempest-ServerBootFromVolumeStableRescueTest-414665510 tempest-ServerBootFromVolumeStableRescueTest-414665510-project-member] [instance: d3c285cd-9f39-423c-a324-30a48a9c66be] Start _get_guest_xml network_info=[{"id": "663e4724-b31b-469d-a5ea-c2802db1e0c8", "address": "fa:16:3e:11:80:42", "network": {"id": "0722b02d-a357-4360-87e8-580913723985", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-579793494-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-579793494-network", "vif_mac": "fa:16:3e:11:80:42"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b820dd795dfe46cd804772f0e71f98e9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap663e4724-b3", "ovs_interfaceid": "663e4724-b31b-469d-a5ea-c2802db1e0c8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-29T17:47:38Z,direct_url=<?>,disk_format='qcow2',id=4217f428-8d9d-4ee1-9614-642d26d90c46,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='794b07cbd46a44b5865cfda741036bae',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-29T17:47:40Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': '54e06562-9358-4b48-bf13-742153ce2ecf', 'kernel_id': '', 'ramdisk_id': ''} block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:b9aad94d-fe0d-415d-9761-9aff25cc6099', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UhRblKdm', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, 'status': 'reserved', 'instance': 'd3c285cd-9f39-423c-a324-30a48a9c66be', 'attached_at': '', 'detached_at': '', 'volume_id': 'b9aad94d-fe0d-415d-9761-9aff25cc6099', 'serial': 'b9aad94d-fe0d-415d-9761-9aff25cc6099'}, 'mount_device': '/dev/vda', 'delete_on_termination': False, 'device_type': 'disk', 'boot_index': 0, 'guest_format': None, 'attachment_id': '6480a3ea-ad01-4fc4-a799-a149b073445c', 'disk_bus': 'virtio', 'volume_type': None} {{(pid=74613) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 29 18:05:43 user nova-compute[74613]: DEBUG nova.objects.instance [None req-6ac55ef6-2860-4318-bd34-e22b65aa36c1 tempest-ServerBootFromVolumeStableRescueTest-414665510 tempest-ServerBootFromVolumeStableRescueTest-414665510-project-member] Lazy-loading 'resources' on Instance uuid d3c285cd-9f39-423c-a324-30a48a9c66be {{(pid=74613) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 18:05:43 user nova-compute[74613]: DEBUG nova.objects.base [None req-6ac55ef6-2860-4318-bd34-e22b65aa36c1 tempest-ServerBootFromVolumeStableRescueTest-414665510 tempest-ServerBootFromVolumeStableRescueTest-414665510-project-member] Object Instance<d3c285cd-9f39-423c-a324-30a48a9c66be> lazy-loaded attributes: trusted_certs,migration_context,resources {{(pid=74613) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 29 18:05:43 user nova-compute[74613]: DEBUG nova.objects.instance [None req-6ac55ef6-2860-4318-bd34-e22b65aa36c1 tempest-ServerBootFromVolumeStableRescueTest-414665510 tempest-ServerBootFromVolumeStableRescueTest-414665510-project-member] Lazy-loading 'numa_topology' on Instance uuid d3c285cd-9f39-423c-a324-30a48a9c66be {{(pid=74613) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 18:05:43 user nova-compute[74613]: DEBUG nova.objects.base [None req-6ac55ef6-2860-4318-bd34-e22b65aa36c1 tempest-ServerBootFromVolumeStableRescueTest-414665510 tempest-ServerBootFromVolumeStableRescueTest-414665510-project-member] Object Instance<d3c285cd-9f39-423c-a324-30a48a9c66be> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology {{(pid=74613) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 29 18:05:43 user nova-compute[74613]: WARNING nova.virt.libvirt.driver [None req-6ac55ef6-2860-4318-bd34-e22b65aa36c1 tempest-ServerBootFromVolumeStableRescueTest-414665510 tempest-ServerBootFromVolumeStableRescueTest-414665510-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 18:05:43 user nova-compute[74613]: WARNING nova.virt.libvirt.driver [None req-6ac55ef6-2860-4318-bd34-e22b65aa36c1 tempest-ServerBootFromVolumeStableRescueTest-414665510 tempest-ServerBootFromVolumeStableRescueTest-414665510-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 18:05:43 user nova-compute[74613]: DEBUG nova.virt.libvirt.host [None req-6ac55ef6-2860-4318-bd34-e22b65aa36c1 tempest-ServerBootFromVolumeStableRescueTest-414665510 tempest-ServerBootFromVolumeStableRescueTest-414665510-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74613) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 29 18:05:43 user nova-compute[74613]: DEBUG nova.virt.libvirt.host [None req-6ac55ef6-2860-4318-bd34-e22b65aa36c1 tempest-ServerBootFromVolumeStableRescueTest-414665510 tempest-ServerBootFromVolumeStableRescueTest-414665510-project-member] CPU controller missing on host. {{(pid=74613) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 29 18:05:43 user nova-compute[74613]: DEBUG nova.virt.libvirt.host [None req-6ac55ef6-2860-4318-bd34-e22b65aa36c1 tempest-ServerBootFromVolumeStableRescueTest-414665510 tempest-ServerBootFromVolumeStableRescueTest-414665510-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74613) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 29 18:05:43 user nova-compute[74613]: DEBUG nova.virt.libvirt.host [None req-6ac55ef6-2860-4318-bd34-e22b65aa36c1 tempest-ServerBootFromVolumeStableRescueTest-414665510 tempest-ServerBootFromVolumeStableRescueTest-414665510-project-member] CPU controller found on host. {{(pid=74613) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 29 18:05:43 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-6ac55ef6-2860-4318-bd34-e22b65aa36c1 tempest-ServerBootFromVolumeStableRescueTest-414665510 tempest-ServerBootFromVolumeStableRescueTest-414665510-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74613) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 29 18:05:43 user nova-compute[74613]: DEBUG nova.virt.hardware [None req-6ac55ef6-2860-4318-bd34-e22b65aa36c1 tempest-ServerBootFromVolumeStableRescueTest-414665510 tempest-ServerBootFromVolumeStableRescueTest-414665510-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-29T17:47:27Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-29T17:47:38Z,direct_url=<?>,disk_format='qcow2',id=4217f428-8d9d-4ee1-9614-642d26d90c46,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='794b07cbd46a44b5865cfda741036bae',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-29T17:47:40Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74613) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 29 18:05:43 user nova-compute[74613]: DEBUG nova.virt.hardware [None req-6ac55ef6-2860-4318-bd34-e22b65aa36c1 tempest-ServerBootFromVolumeStableRescueTest-414665510 tempest-ServerBootFromVolumeStableRescueTest-414665510-project-member] Flavor limits 0:0:0 {{(pid=74613) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 29 18:05:43 user nova-compute[74613]: DEBUG nova.virt.hardware [None req-6ac55ef6-2860-4318-bd34-e22b65aa36c1 tempest-ServerBootFromVolumeStableRescueTest-414665510 tempest-ServerBootFromVolumeStableRescueTest-414665510-project-member] Image limits 0:0:0 {{(pid=74613) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 29 18:05:43 user nova-compute[74613]: DEBUG nova.virt.hardware [None req-6ac55ef6-2860-4318-bd34-e22b65aa36c1 tempest-ServerBootFromVolumeStableRescueTest-414665510 tempest-ServerBootFromVolumeStableRescueTest-414665510-project-member] Flavor pref 0:0:0 {{(pid=74613) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 29 18:05:43 user nova-compute[74613]: DEBUG nova.virt.hardware [None req-6ac55ef6-2860-4318-bd34-e22b65aa36c1 tempest-ServerBootFromVolumeStableRescueTest-414665510 tempest-ServerBootFromVolumeStableRescueTest-414665510-project-member] Image pref 0:0:0 {{(pid=74613) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 29 18:05:43 user nova-compute[74613]: DEBUG nova.virt.hardware [None req-6ac55ef6-2860-4318-bd34-e22b65aa36c1 tempest-ServerBootFromVolumeStableRescueTest-414665510 tempest-ServerBootFromVolumeStableRescueTest-414665510-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74613) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 29 18:05:43 user nova-compute[74613]: DEBUG nova.virt.hardware [None req-6ac55ef6-2860-4318-bd34-e22b65aa36c1 tempest-ServerBootFromVolumeStableRescueTest-414665510 tempest-ServerBootFromVolumeStableRescueTest-414665510-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74613) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 29 18:05:43 user nova-compute[74613]: DEBUG nova.virt.hardware [None req-6ac55ef6-2860-4318-bd34-e22b65aa36c1 tempest-ServerBootFromVolumeStableRescueTest-414665510 tempest-ServerBootFromVolumeStableRescueTest-414665510-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74613) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 29 18:05:43 user nova-compute[74613]: DEBUG nova.virt.hardware [None req-6ac55ef6-2860-4318-bd34-e22b65aa36c1 tempest-ServerBootFromVolumeStableRescueTest-414665510 tempest-ServerBootFromVolumeStableRescueTest-414665510-project-member] Got 1 possible topologies {{(pid=74613) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 29 18:05:43 user nova-compute[74613]: DEBUG nova.virt.hardware [None req-6ac55ef6-2860-4318-bd34-e22b65aa36c1 tempest-ServerBootFromVolumeStableRescueTest-414665510 tempest-ServerBootFromVolumeStableRescueTest-414665510-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74613) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 29 18:05:43 user nova-compute[74613]: DEBUG nova.virt.hardware [None req-6ac55ef6-2860-4318-bd34-e22b65aa36c1 tempest-ServerBootFromVolumeStableRescueTest-414665510 tempest-ServerBootFromVolumeStableRescueTest-414665510-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74613) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 29 18:05:43 user nova-compute[74613]: DEBUG nova.objects.instance [None req-6ac55ef6-2860-4318-bd34-e22b65aa36c1 tempest-ServerBootFromVolumeStableRescueTest-414665510 tempest-ServerBootFromVolumeStableRescueTest-414665510-project-member] Lazy-loading 'vcpu_model' on Instance uuid d3c285cd-9f39-423c-a324-30a48a9c66be {{(pid=74613) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 18:05:43 user nova-compute[74613]: DEBUG nova.objects.base [None req-6ac55ef6-2860-4318-bd34-e22b65aa36c1 tempest-ServerBootFromVolumeStableRescueTest-414665510 tempest-ServerBootFromVolumeStableRescueTest-414665510-project-member] Object Instance<d3c285cd-9f39-423c-a324-30a48a9c66be> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model {{(pid=74613) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 29 18:05:43 user nova-compute[74613]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6ac55ef6-2860-4318-bd34-e22b65aa36c1 tempest-ServerBootFromVolumeStableRescueTest-414665510 tempest-ServerBootFromVolumeStableRescueTest-414665510-project-member] [instance: d3c285cd-9f39-423c-a324-30a48a9c66be] Calling os-brick to attach iSCSI Volume {{(pid=74613) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 29 18:05:43 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ac55ef6-2860-4318-bd34-e22b65aa36c1 tempest-ServerBootFromVolumeStableRescueTest-414665510 tempest-ServerBootFromVolumeStableRescueTest-414665510-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff828156890>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:b9aad94d-fe0d-415d-9761-9aff25cc6099', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UhRblKdm', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=74613) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 18:05:43 user nova-compute[74613]: WARNING os_brick.initiator.connectors.base [None req-6ac55ef6-2860-4318-bd34-e22b65aa36c1 tempest-ServerBootFromVolumeStableRescueTest-414665510 tempest-ServerBootFromVolumeStableRescueTest-414665510-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 18:05:43 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.base [None req-6ac55ef6-2860-4318-bd34-e22b65aa36c1 tempest-ServerBootFromVolumeStableRescueTest-414665510 tempest-ServerBootFromVolumeStableRescueTest-414665510-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 18:05:43 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.base [None req-6ac55ef6-2860-4318-bd34-e22b65aa36c1 tempest-ServerBootFromVolumeStableRescueTest-414665510 tempest-ServerBootFromVolumeStableRescueTest-414665510-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 18:05:43 user nova-compute[74613]: WARNING os_brick.initiator.connectors.base [None req-6ac55ef6-2860-4318-bd34-e22b65aa36c1 tempest-ServerBootFromVolumeStableRescueTest-414665510 tempest-ServerBootFromVolumeStableRescueTest-414665510-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 18:05:43 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.base [None req-6ac55ef6-2860-4318-bd34-e22b65aa36c1 tempest-ServerBootFromVolumeStableRescueTest-414665510 tempest-ServerBootFromVolumeStableRescueTest-414665510-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b9aad94d-fe0d-415d-9761-9aff25cc6099" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 18:05:43 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.base [None req-6ac55ef6-2860-4318-bd34-e22b65aa36c1 tempest-ServerBootFromVolumeStableRescueTest-414665510 tempest-ServerBootFromVolumeStableRescueTest-414665510-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b9aad94d-fe0d-415d-9761-9aff25cc6099" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 18:05:43 user nova-compute[74613]: INFO os_brick.initiator.connectors.iscsi [None req-6ac55ef6-2860-4318-bd34-e22b65aa36c1 tempest-ServerBootFromVolumeStableRescueTest-414665510 tempest-ServerBootFromVolumeStableRescueTest-414665510-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 29 18:05:43 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b9aad94d-fe0d-415d-9761-9aff25cc6099 -p 172.16.0.220:3260 {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:05:43 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b9aad94d-fe0d-415d-9761-9aff25cc6099 -p 172.16.0.220:3260" returned: 0 in 0.018s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:05:43 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf316e87-9bbc-4df8-9e84-c15393945dbf]: (4, ('# BEGIN RECORD 2.1.5\nnode.name = iqn.2010-10.org.openstack:b9aad94d-fe0d-415d-9761-9aff25cc6099\nnode.tpgt = -1\nnode.startup = automatic\nnode.leading_login = No\niface.iscsi_ifacename = default\niface.net_ifacename = <empty>\niface.ipaddress = <empty>\niface.prefix_len = 0\niface.hwaddress = <empty>\niface.transport_name = tcp\niface.initiatorname = <empty>\niface.state = <empty>\niface.vlan_id = 0\niface.vlan_priority = 0\niface.vlan_state = <empty>\niface.iface_num = 0\niface.mtu = 0\niface.port = 0\niface.bootproto = <empty>\niface.subnet_mask = <empty>\niface.gateway = <empty>\niface.dhcp_alt_client_id_state = <empty>\niface.dhcp_alt_client_id = <empty>\niface.dhcp_dns = <empty>\niface.dhcp_learn_iqn = <empty>\niface.dhcp_req_vendor_id_state = <empty>\niface.dhcp_vendor_id_state = <empty>\niface.dhcp_vendor_id = <empty>\niface.dhcp_slp_da = <empty>\niface.fragmentation = <empty>\niface.gratuitous_arp = <empty>\niface.incoming_forwarding = <empty>\niface.tos_state = <empty>\niface.tos = 0\niface.ttl = 0\niface.delayed_ack = <empty>\niface.tcp_nagle = <empty>\niface.tcp_wsf_state = <empty>\niface.tcp_wsf = 0\niface.tcp_timer_scale = 0\niface.tcp_timestamp = <empty>\niface.redirect = <empty>\niface.def_task_mgmt_timeout = 0\niface.header_digest = <empty>\niface.data_digest = <empty>\niface.immediate_data = <empty>\niface.initial_r2t = <empty>\niface.data_seq_inorder = <empty>\niface.data_pdu_inorder = <empty>\niface.erl = 0\niface.max_receive_data_len = 0\niface.first_burst_len = 0\niface.max_outstanding_r2t = 0\niface.max_burst_len = 0\niface.chap_auth = <empty>\niface.bidi_chap = <empty>\niface.strict_login_compliance = <empty>\niface.discovery_auth = <empty>\niface.discovery_logout = <empty>\nnode.discovery_address = <empty>\nnode.discovery_port = 0\nnode.discovery_type = static\nnode.session.initial_cmdsn = 0\nnode.session.initial_login_retry_max = 8\nnode.session.xmit_thread_priority = -20\nnode.session.cmds_max = 128\nnode.session.queue_depth = 32\nnode.session.nr_sessions = 1\nnode.session.auth.authmethod = CHAP\nnode.session.auth.username = UhRblKdm\nnode.session.auth.password = ********\nnode.session.auth.username_in = <empty>\nnode.session.auth.password_in = <empty>\nnode.session.auth.chap_algs = MD5\nnode.session.timeo.replacement_timeout = 120\nnode.session.err_timeo.abort_timeout = 15\nnode.session.err_timeo.lu_reset_timeout = 30\nnode.session.err_timeo.tgt_reset_timeout = 30\nnode.session.err_timeo.host_reset_timeout = 60\nnode.session.iscsi.FastAbort = Yes\nnode.session.iscsi.InitialR2T = No\nnode.session.iscsi.ImmediateData = Yes\nnode.session.iscsi.FirstBurstLength = 262144\nnode.session.iscsi.MaxBurstLength = 16776192\nnode.session.iscsi.DefaultTime2Retain = 0\nnode.session.iscsi.DefaultTime2Wait = 2\nnode.session.iscsi.MaxConnections = 1\nnode.session.iscsi.MaxOutstandingR2T = 1\nnode.session.iscsi.ERL = 0\nnode.session.scan = manual\nnode.session.reopen_max = 0\nnode.conn[0].address = 172.16.0.220\nnode.conn[0].port = 3260\nnode.conn[0].startup = manual\nnode.conn[0].tcp.window_size = 524288\nnode.conn[0].tcp.type_of_service = 0\nnode.conn[0].timeo.logout_timeout = 15\nnode.conn[0].timeo.login_timeout = 15\nnode.conn[0].timeo.auth_timeout = 45\nnode.conn[0].timeo.noop_out_interval = 5\nnode.conn[0].timeo.noop_out_timeout = 5\nnode.conn[0].iscsi.MaxXmitDataSegmentLength = 0\nnode.conn[0].iscsi.MaxRecvDataSegmentLength = 262144\nnode.conn[0].iscsi.HeaderDigest = None\nnode.conn[0].iscsi.DataDigest = None\nnode.conn[0].iscsi.IFMarker = No\nnode.conn[0].iscsi.OFMarker = No\n# END RECORD\n', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 18:05:43 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ac55ef6-2860-4318-bd34-e22b65aa36c1 tempest-ServerBootFromVolumeStableRescueTest-414665510 tempest-ServerBootFromVolumeStableRescueTest-414665510-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.5
Nov 29 18:05:43 user nova-compute[74613]: node.name = iqn.2010-10.org.openstack:b9aad94d-fe0d-415d-9761-9aff25cc6099
Nov 29 18:05:43 user nova-compute[74613]: node.tpgt = -1
Nov 29 18:05:43 user nova-compute[74613]: node.startup = automatic
Nov 29 18:05:43 user nova-compute[74613]: node.leading_login = No
Nov 29 18:05:43 user nova-compute[74613]: iface.iscsi_ifacename = default
Nov 29 18:05:43 user nova-compute[74613]: iface.net_ifacename = <empty>
Nov 29 18:05:43 user nova-compute[74613]: iface.ipaddress = <empty>
Nov 29 18:05:43 user nova-compute[74613]: iface.prefix_len = 0
Nov 29 18:05:43 user nova-compute[74613]: iface.hwaddress = <empty>
Nov 29 18:05:43 user nova-compute[74613]: iface.transport_name = tcp
Nov 29 18:05:43 user nova-compute[74613]: iface.initiatorname = <empty>
Nov 29 18:05:43 user nova-compute[74613]: iface.state = <empty>
Nov 29 18:05:43 user nova-compute[74613]: iface.vlan_id = 0
Nov 29 18:05:43 user nova-compute[74613]: iface.vlan_priority = 0
Nov 29 18:05:43 user nova-compute[74613]: iface.vlan_state = <empty>
Nov 29 18:05:43 user nova-compute[74613]: iface.iface_num = 0
Nov 29 18:05:43 user nova-compute[74613]: iface.mtu = 0
Nov 29 18:05:43 user nova-compute[74613]: iface.port = 0
Nov 29 18:05:43 user nova-compute[74613]: iface.bootproto = <empty>
Nov 29 18:05:43 user nova-compute[74613]: iface.subnet_mask = <empty>
Nov 29 18:05:43 user nova-compute[74613]: iface.gateway = <empty>
Nov 29 18:05:43 user nova-compute[74613]: iface.dhcp_alt_client_id_state = <empty>
Nov 29 18:05:43 user nova-compute[74613]: iface.dhcp_alt_client_id = <empty>
Nov 29 18:05:43 user nova-compute[74613]: iface.dhcp_dns = <empty>
Nov 29 18:05:43 user nova-compute[74613]: iface.dhcp_learn_iqn = <empty>
Nov 29 18:05:43 user nova-compute[74613]: iface.dhcp_req_vendor_id_state = <empty>
Nov 29 18:05:43 user nova-compute[74613]: iface.dhcp_vendor_id_state = <empty>
Nov 29 18:05:43 user nova-compute[74613]: iface.dhcp_vendor_id = <empty>
Nov 29 18:05:43 user nova-compute[74613]: iface.dhcp_slp_da = <empty>
Nov 29 18:05:43 user nova-compute[74613]: iface.fragmentation = <empty>
Nov 29 18:05:43 user nova-compute[74613]: iface.gratuitous_arp = <empty>
Nov 29 18:05:43 user nova-compute[74613]: iface.incoming_forwarding = <empty>
Nov 29 18:05:43 user nova-compute[74613]: iface.tos_state = <empty>
Nov 29 18:05:43 user nova-compute[74613]: iface.tos = 0
Nov 29 18:05:43 user nova-compute[74613]: iface.ttl = 0
Nov 29 18:05:43 user nova-compute[74613]: iface.delayed_ack = <empty>
Nov 29 18:05:43 user nova-compute[74613]: iface.tcp_nagle = <empty>
Nov 29 18:05:43 user nova-compute[74613]: iface.tcp_wsf_state = <empty>
Nov 29 18:05:43 user nova-compute[74613]: iface.tcp_wsf = 0
Nov 29 18:05:43 user nova-compute[74613]: iface.tcp_timer_scale = 0
Nov 29 18:05:43 user nova-compute[74613]: iface.tcp_timestamp = <empty>
Nov 29 18:05:43 user nova-compute[74613]: iface.redirect = <empty>
Nov 29 18:05:43 user nova-compute[74613]: iface.def_task_mgmt_timeout = 0
Nov 29 18:05:43 user nova-compute[74613]: iface.header_digest = <empty>
Nov 29 18:05:43 user nova-compute[74613]: iface.data_digest = <empty>
Nov 29 18:05:43 user nova-compute[74613]: iface.immediate_data = <empty>
Nov 29 18:05:43 user nova-compute[74613]: iface.initial_r2t = <empty>
Nov 29 18:05:43 user nova-compute[74613]: iface.data_seq_inorder = <empty>
Nov 29 18:05:43 user nova-compute[74613]: iface.data_pdu_inorder = <empty>
Nov 29 18:05:43 user nova-compute[74613]: iface.erl = 0
Nov 29 18:05:43 user nova-compute[74613]: iface.max_receive_data_len = 0
Nov 29 18:05:43 user nova-compute[74613]: iface.first_burst_len = 0
Nov 29 18:05:43 user nova-compute[74613]: iface.max_outstanding_r2t = 0
Nov 29 18:05:43 user nova-compute[74613]: iface.max_burst_len = 0
Nov 29 18:05:43 user nova-compute[74613]: iface.chap_auth = <empty>
Nov 29 18:05:43 user nova-compute[74613]: iface.bidi_chap = <empty>
Nov 29 18:05:43 user nova-compute[74613]: iface.strict_login_compliance = <empty>
Nov 29 18:05:43 user nova-compute[74613]: iface.discovery_auth = <empty>
Nov 29 18:05:43 user nova-compute[74613]: iface.discovery_logout = <empty>
Nov 29 18:05:43 user nova-compute[74613]: node.discovery_address = <empty>
Nov 29 18:05:43 user nova-compute[74613]: node.discovery_port = 0
Nov 29 18:05:43 user nova-compute[74613]: node.discovery_type = static
Nov 29 18:05:43 user nova-compute[74613]: node.session.initial_cmdsn = 0
Nov 29 18:05:43 user nova-compute[74613]: node.session.initial_login_retry_max = 8
Nov 29 18:05:43 user nova-compute[74613]: node.session.xmit_thread_priority = -20
Nov 29 18:05:43 user nova-compute[74613]: node.session.cmds_max = 128
Nov 29 18:05:43 user nova-compute[74613]: node.session.queue_depth = 32
Nov 29 18:05:43 user nova-compute[74613]: node.session.nr_sessions = 1
Nov 29 18:05:43 user nova-compute[74613]: node.session.auth.authmethod = CHAP
Nov 29 18:05:43 user nova-compute[74613]: node.session.auth.username = UhRblKdm
Nov 29 18:05:43 user nova-compute[74613]: node.session.auth.password = ***
Nov 29 18:05:43 user nova-compute[74613]: node.session.auth.username_in = <empty>
Nov 29 18:05:43 user nova-compute[74613]: node.session.auth.password_in = <empty>
Nov 29 18:05:43 user nova-compute[74613]: node.session.auth.chap_algs = MD5
Nov 29 18:05:43 user nova-compute[74613]: node.session.timeo.replacement_timeout = 120
Nov 29 18:05:43 user nova-compute[74613]: node.session.err_timeo.abort_timeout = 15
Nov 29 18:05:43 user nova-compute[74613]: node.session.err_timeo.lu_reset_timeout = 30
Nov 29 18:05:43 user nova-compute[74613]: node.session.err_timeo.tgt_reset_timeout = 30
Nov 29 18:05:43 user nova-compute[74613]: node.session.err_timeo.host_reset_timeout = 60
Nov 29 18:05:43 user nova-compute[74613]: node.session.iscsi.FastAbort = Yes
Nov 29 18:05:43 user nova-compute[74613]: node.session.iscsi.InitialR2T = No
Nov 29 18:05:43 user nova-compute[74613]: node.session.iscsi.ImmediateData = Yes
Nov 29 18:05:43 user nova-compute[74613]: node.session.iscsi.FirstBurstLength = 262144
Nov 29 18:05:43 user nova-compute[74613]: node.session.iscsi.MaxBurstLength = 16776192
Nov 29 18:05:43 user nova-compute[74613]: node.session.iscsi.DefaultTime2Retain = 0
Nov 29 18:05:43 user nova-compute[74613]: node.session.iscsi.DefaultTime2Wait = 2
Nov 29 18:05:43 user nova-compute[74613]: node.session.iscsi.MaxConnections = 1
Nov 29 18:05:43 user nova-compute[74613]: node.session.iscsi.MaxOutstandingR2T = 1
Nov 29 18:05:43 user nova-compute[74613]: node.session.iscsi.ERL = 0
Nov 29 18:05:43 user nova-compute[74613]: node.session.scan = manual
Nov 29 18:05:43 user nova-compute[74613]: node.session.reopen_max = 0
Nov 29 18:05:43 user nova-compute[74613]: node.conn[0].address = 172.16.0.220
Nov 29 18:05:43 user nova-compute[74613]: node.conn[0].port = 3260
Nov 29 18:05:43 user nova-compute[74613]: node.conn[0].startup = manual
Nov 29 18:05:43 user nova-compute[74613]: node.conn[0].tcp.window_size = 524288
Nov 29 18:05:43 user nova-compute[74613]: node.conn[0].tcp.type_of_service = 0
Nov 29 18:05:43 user nova-compute[74613]: node.conn[0].timeo.logout_timeout = 15
Nov 29 18:05:43 user nova-compute[74613]: node.conn[0].timeo.login_timeout = 15
Nov 29 18:05:43 user nova-compute[74613]: node.conn[0].timeo.auth_timeout = 45
Nov 29 18:05:43 user nova-compute[74613]: node.conn[0].timeo.noop_out_interval = 5
Nov 29 18:05:43 user nova-compute[74613]: node.conn[0].timeo.noop_out_timeout = 5
Nov 29 18:05:43 user nova-compute[74613]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Nov 29 18:05:43 user nova-compute[74613]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Nov 29 18:05:43 user nova-compute[74613]: node.conn[0].iscsi.HeaderDigest = None
Nov 29 18:05:43 user nova-compute[74613]: node.conn[0].iscsi.DataDigest = None
Nov 29 18:05:43 user nova-compute[74613]: node.conn[0].iscsi.IFMarker = No
Nov 29 18:05:43 user nova-compute[74613]: node.conn[0].iscsi.OFMarker = No
Nov 29 18:05:43 user nova-compute[74613]: # END RECORD
Nov 29 18:05:43 user nova-compute[74613]:  stderr= {{(pid=74613) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 18:05:44 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b9aad94d-fe0d-415d-9761-9aff25cc6099 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:05:44 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b9aad94d-fe0d-415d-9761-9aff25cc6099 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:05:44 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ff8fd6b-58a5-4472-9937-f233e6c2ec83]: (4, ('', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 18:05:44 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ac55ef6-2860-4318-bd34-e22b65aa36c1 tempest-ServerBootFromVolumeStableRescueTest-414665510 tempest-ServerBootFromVolumeStableRescueTest-414665510-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74613) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 18:05:44 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b9aad94d-fe0d-415d-9761-9aff25cc6099 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:05:44 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b9aad94d-fe0d-415d-9761-9aff25cc6099 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:05:44 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c5f109c-e56f-47d2-ae9a-9476a396fbcb]: (4, ('', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 18:05:44 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ac55ef6-2860-4318-bd34-e22b65aa36c1 tempest-ServerBootFromVolumeStableRescueTest-414665510 tempest-ServerBootFromVolumeStableRescueTest-414665510-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74613) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 18:05:44 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b9aad94d-fe0d-415d-9761-9aff25cc6099 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v UhRblKdm {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:05:44 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b9aad94d-fe0d-415d-9761-9aff25cc6099 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v UhRblKdm" returned: 0 in 0.027s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:05:44 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c52daa2-43e4-4fc4-8fe1-19441e1dc659]: (4, ('', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 18:05:44 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ac55ef6-2860-4318-bd34-e22b65aa36c1 tempest-ServerBootFromVolumeStableRescueTest-414665510 tempest-ServerBootFromVolumeStableRescueTest-414665510-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'UhRblKdm'): stdout= stderr= {{(pid=74613) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 18:05:44 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b9aad94d-fe0d-415d-9761-9aff25cc6099 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:05:44 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b9aad94d-fe0d-415d-9761-9aff25cc6099 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:05:44 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[dcbe52e2-00d0-456f-8136-2427d0acd97b]: (4, ('', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 18:05:44 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ac55ef6-2860-4318-bd34-e22b65aa36c1 tempest-ServerBootFromVolumeStableRescueTest-414665510 tempest-ServerBootFromVolumeStableRescueTest-414665510-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74613) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 18:05:44 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:05:44 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:05:44 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[f741edfb-ff17-4c5f-8e99-6dd882a84e30]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9511387c-8772-40f2-bf2d-6b6387649e9f (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9aad94d-fe0d-415d-9761-9aff25cc6099 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8c53a27-dcde-402b-a9bb-d8642f7db0da (non-flash)\n', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 18:05:44 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ac55ef6-2860-4318-bd34-e22b65aa36c1 tempest-ServerBootFromVolumeStableRescueTest-414665510 tempest-ServerBootFromVolumeStableRescueTest-414665510-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9511387c-8772-40f2-bf2d-6b6387649e9f (non-flash)
Nov 29 18:05:44 user nova-compute[74613]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9aad94d-fe0d-415d-9761-9aff25cc6099 (non-flash)
Nov 29 18:05:44 user nova-compute[74613]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8c53a27-dcde-402b-a9bb-d8642f7db0da (non-flash)
Nov 29 18:05:44 user nova-compute[74613]:  stderr= {{(pid=74613) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 18:05:44 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ac55ef6-2860-4318-bd34-e22b65aa36c1 tempest-ServerBootFromVolumeStableRescueTest-414665510 tempest-ServerBootFromVolumeStableRescueTest-414665510-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9511387c-8772-40f2-bf2d-6b6387649e9f (non-flash)
Nov 29 18:05:44 user nova-compute[74613]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9aad94d-fe0d-415d-9761-9aff25cc6099 (non-flash)
Nov 29 18:05:44 user nova-compute[74613]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8c53a27-dcde-402b-a9bb-d8642f7db0da (non-flash)
Nov 29 18:05:44 user nova-compute[74613]:  stderr= {{(pid=74613) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 18:05:44 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.base [None req-6ac55ef6-2860-4318-bd34-e22b65aa36c1 tempest-ServerBootFromVolumeStableRescueTest-414665510 tempest-ServerBootFromVolumeStableRescueTest-414665510-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b9aad94d-fe0d-415d-9761-9aff25cc6099" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.158s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 18:05:44 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ac55ef6-2860-4318-bd34-e22b65aa36c1 tempest-ServerBootFromVolumeStableRescueTest-414665510 tempest-ServerBootFromVolumeStableRescueTest-414665510-project-member] Connected to 172.16.0.220:3260 {{(pid=74613) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 29 18:05:44 user nova-compute[74613]: DEBUG os_brick.initiator.linuxscsi [None req-6ac55ef6-2860-4318-bd34-e22b65aa36c1 tempest-ServerBootFromVolumeStableRescueTest-414665510 tempest-ServerBootFromVolumeStableRescueTest-414665510-project-member] HCTL ('34', '0', '0', 0) found on session 29 with lun 0 {{(pid=74613) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 29 18:05:44 user nova-compute[74613]: DEBUG os_brick.initiator.linuxscsi [None req-6ac55ef6-2860-4318-bd34-e22b65aa36c1 tempest-ServerBootFromVolumeStableRescueTest-414665510 tempest-ServerBootFromVolumeStableRescueTest-414665510-project-member] Scanning host 34 c: 0, t: 0, l: 0) {{(pid=74613) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 29 18:05:44 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:05:44 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.014s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:05:44 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[1de798ec-7f60-45a6-8e07-32c97cb79023]: (4, ('0 0 0', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 18:05:44 user nova-compute[74613]: DEBUG os_brick.initiator.linuxscsi [None req-6ac55ef6-2860-4318-bd34-e22b65aa36c1 tempest-ServerBootFromVolumeStableRescueTest-414665510 tempest-ServerBootFromVolumeStableRescueTest-414665510-project-member] Searching for a device in session 29 and hctl ('34', '0', '0', 0) yield: sdc {{(pid=74613) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 29 18:05:44 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ac55ef6-2860-4318-bd34-e22b65aa36c1 tempest-ServerBootFromVolumeStableRescueTest-414665510 tempest-ServerBootFromVolumeStableRescueTest-414665510-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:b9aad94d-fe0d-415d-9761-9aff25cc6099', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UhRblKdm', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'} {{(pid=74613) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 29 18:05:44 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.base [None req-6ac55ef6-2860-4318-bd34-e22b65aa36c1 tempest-ServerBootFromVolumeStableRescueTest-414665510 tempest-ServerBootFromVolumeStableRescueTest-414665510-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 0.186s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 18:05:44 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ac55ef6-2860-4318-bd34-e22b65aa36c1 tempest-ServerBootFromVolumeStableRescueTest-414665510 tempest-ServerBootFromVolumeStableRescueTest-414665510-project-member] <== connect_volume: return (188ms) {'type': 'block', 'scsi_wwn': '23561616463656333', 'path': '/dev/sdc'} {{(pid=74613) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 18:05:44 user nova-compute[74613]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6ac55ef6-2860-4318-bd34-e22b65aa36c1 tempest-ServerBootFromVolumeStableRescueTest-414665510 tempest-ServerBootFromVolumeStableRescueTest-414665510-project-member] [instance: d3c285cd-9f39-423c-a324-30a48a9c66be] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23561616463656333', 'path': '/dev/sdc'} {{(pid=74613) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 29 18:05:44 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-a8ed7b97-89a5-49b7-94ff-b43cb519ed92 tempest-AttachVolumeTestJSON-813984703 tempest-AttachVolumeTestJSON-813984703-project-member] Acquiring lock "69109f06-acbf-4834-b05e-80ab6e3f6ea0" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 18:05:44 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-a8ed7b97-89a5-49b7-94ff-b43cb519ed92 tempest-AttachVolumeTestJSON-813984703 tempest-AttachVolumeTestJSON-813984703-project-member] Lock "69109f06-acbf-4834-b05e-80ab6e3f6ea0" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 18:05:44 user nova-compute[74613]: DEBUG nova.virt.libvirt.vif [None req-6ac55ef6-2860-4318-bd34-e22b65aa36c1 tempest-ServerBootFromVolumeStableRescueTest-414665510 tempest-ServerBootFromVolumeStableRescueTest-414665510-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T18:03:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1343284375',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1343284375',id=27,image_ref='4217f428-8d9d-4ee1-9614-642d26d90c46',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-29T18:04:14Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='b820dd795dfe46cd804772f0e71f98e9',ramdisk_id='',reservation_id='r-aaektgy8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='4217f428-8d9d-4ee1-9614-642d26d90c46',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-414665510',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-414665510-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T18:04:14Z,user_data=None,user_id='c65bc922e04d4d1385e48f70c460c441',uuid=d3c285cd-9f39-423c-a324-30a48a9c66be,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "663e4724-b31b-469d-a5ea-c2802db1e0c8", "address": "fa:16:3e:11:80:42", "network": {"id": "0722b02d-a357-4360-87e8-580913723985", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-579793494-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-579793494-network", "vif_mac": "fa:16:3e:11:80:42"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b820dd795dfe46cd804772f0e71f98e9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap663e4724-b3", "ovs_interfaceid": "663e4724-b31b-469d-a5ea-c2802db1e0c8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74613) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 29 18:05:44 user nova-compute[74613]: DEBUG nova.network.os_vif_util [None req-6ac55ef6-2860-4318-bd34-e22b65aa36c1 tempest-ServerBootFromVolumeStableRescueTest-414665510 tempest-ServerBootFromVolumeStableRescueTest-414665510-project-member] Converting VIF {"id": "663e4724-b31b-469d-a5ea-c2802db1e0c8", "address": "fa:16:3e:11:80:42", "network": {"id": "0722b02d-a357-4360-87e8-580913723985", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-579793494-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-579793494-network", "vif_mac": "fa:16:3e:11:80:42"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b820dd795dfe46cd804772f0e71f98e9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap663e4724-b3", "ovs_interfaceid": "663e4724-b31b-469d-a5ea-c2802db1e0c8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74613) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 18:05:44 user nova-compute[74613]: DEBUG nova.network.os_vif_util [None req-6ac55ef6-2860-4318-bd34-e22b65aa36c1 tempest-ServerBootFromVolumeStableRescueTest-414665510 tempest-ServerBootFromVolumeStableRescueTest-414665510-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:11:80:42,bridge_name='br-int',has_traffic_filtering=True,id=663e4724-b31b-469d-a5ea-c2802db1e0c8,network=Network(0722b02d-a357-4360-87e8-580913723985),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap663e4724-b3') {{(pid=74613) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 18:05:44 user nova-compute[74613]: DEBUG nova.objects.instance [None req-6ac55ef6-2860-4318-bd34-e22b65aa36c1 tempest-ServerBootFromVolumeStableRescueTest-414665510 tempest-ServerBootFromVolumeStableRescueTest-414665510-project-member] Lazy-loading 'pci_devices' on Instance uuid d3c285cd-9f39-423c-a324-30a48a9c66be {{(pid=74613) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 18:05:44 user nova-compute[74613]: DEBUG nova.compute.manager [None req-a8ed7b97-89a5-49b7-94ff-b43cb519ed92 tempest-AttachVolumeTestJSON-813984703 tempest-AttachVolumeTestJSON-813984703-project-member] [instance: 69109f06-acbf-4834-b05e-80ab6e3f6ea0] Starting instance... {{(pid=74613) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 29 18:05:44 user nova-compute[74613]: DEBUG nova.objects.base [None req-6ac55ef6-2860-4318-bd34-e22b65aa36c1 tempest-ServerBootFromVolumeStableRescueTest-414665510 tempest-ServerBootFromVolumeStableRescueTest-414665510-project-member] Object Instance<d3c285cd-9f39-423c-a324-30a48a9c66be> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model,pci_devices {{(pid=74613) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 29 18:05:44 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-6ac55ef6-2860-4318-bd34-e22b65aa36c1 tempest-ServerBootFromVolumeStableRescueTest-414665510 tempest-ServerBootFromVolumeStableRescueTest-414665510-project-member] [instance: d3c285cd-9f39-423c-a324-30a48a9c66be] End _get_guest_xml xml=<domain type="kvm">
Nov 29 18:05:44 user nova-compute[74613]:   <uuid>d3c285cd-9f39-423c-a324-30a48a9c66be</uuid>
Nov 29 18:05:44 user nova-compute[74613]:   <name>instance-0000001b</name>
Nov 29 18:05:44 user nova-compute[74613]:   <memory>524288</memory>
Nov 29 18:05:44 user nova-compute[74613]:   <vcpu>1</vcpu>
Nov 29 18:05:44 user nova-compute[74613]:   <metadata>
Nov 29 18:05:44 user nova-compute[74613]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 29 18:05:44 user nova-compute[74613]:       <nova:package version="0.0.0"/>
Nov 29 18:05:44 user nova-compute[74613]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-1343284375</nova:name>
Nov 29 18:05:44 user nova-compute[74613]:       <nova:creationTime>2023-11-29 18:05:43</nova:creationTime>
Nov 29 18:05:44 user nova-compute[74613]:       <nova:flavor name="m1.tiny">
Nov 29 18:05:44 user nova-compute[74613]:         <nova:memory>512</nova:memory>
Nov 29 18:05:44 user nova-compute[74613]:         <nova:disk>1</nova:disk>
Nov 29 18:05:44 user nova-compute[74613]:         <nova:swap>0</nova:swap>
Nov 29 18:05:44 user nova-compute[74613]:         <nova:ephemeral>0</nova:ephemeral>
Nov 29 18:05:44 user nova-compute[74613]:         <nova:vcpus>1</nova:vcpus>
Nov 29 18:05:44 user nova-compute[74613]:       </nova:flavor>
Nov 29 18:05:44 user nova-compute[74613]:       <nova:owner>
Nov 29 18:05:44 user nova-compute[74613]:         <nova:user uuid="c65bc922e04d4d1385e48f70c460c441">tempest-ServerBootFromVolumeStableRescueTest-414665510-project-member</nova:user>
Nov 29 18:05:44 user nova-compute[74613]:         <nova:project uuid="b820dd795dfe46cd804772f0e71f98e9">tempest-ServerBootFromVolumeStableRescueTest-414665510</nova:project>
Nov 29 18:05:44 user nova-compute[74613]:       </nova:owner>
Nov 29 18:05:44 user nova-compute[74613]:       <nova:root type="image" uuid="4217f428-8d9d-4ee1-9614-642d26d90c46"/>
Nov 29 18:05:44 user nova-compute[74613]:       <nova:ports>
Nov 29 18:05:44 user nova-compute[74613]:         <nova:port uuid="663e4724-b31b-469d-a5ea-c2802db1e0c8">
Nov 29 18:05:44 user nova-compute[74613]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Nov 29 18:05:44 user nova-compute[74613]:         </nova:port>
Nov 29 18:05:44 user nova-compute[74613]:       </nova:ports>
Nov 29 18:05:44 user nova-compute[74613]:     </nova:instance>
Nov 29 18:05:44 user nova-compute[74613]:   </metadata>
Nov 29 18:05:44 user nova-compute[74613]:   <sysinfo type="smbios">
Nov 29 18:05:44 user nova-compute[74613]:     <system>
Nov 29 18:05:44 user nova-compute[74613]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 29 18:05:44 user nova-compute[74613]:       <entry name="product">OpenStack Nova</entry>
Nov 29 18:05:44 user nova-compute[74613]:       <entry name="version">0.0.0</entry>
Nov 29 18:05:44 user nova-compute[74613]:       <entry name="serial">d3c285cd-9f39-423c-a324-30a48a9c66be</entry>
Nov 29 18:05:44 user nova-compute[74613]:       <entry name="uuid">d3c285cd-9f39-423c-a324-30a48a9c66be</entry>
Nov 29 18:05:44 user nova-compute[74613]:       <entry name="family">Virtual Machine</entry>
Nov 29 18:05:44 user nova-compute[74613]:     </system>
Nov 29 18:05:44 user nova-compute[74613]:   </sysinfo>
Nov 29 18:05:44 user nova-compute[74613]:   <os>
Nov 29 18:05:44 user nova-compute[74613]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 29 18:05:44 user nova-compute[74613]:     <smbios mode="sysinfo"/>
Nov 29 18:05:44 user nova-compute[74613]:   </os>
Nov 29 18:05:44 user nova-compute[74613]:   <features>
Nov 29 18:05:44 user nova-compute[74613]:     <acpi/>
Nov 29 18:05:44 user nova-compute[74613]:     <apic/>
Nov 29 18:05:44 user nova-compute[74613]:     <vmcoreinfo/>
Nov 29 18:05:44 user nova-compute[74613]:   </features>
Nov 29 18:05:44 user nova-compute[74613]:   <clock offset="utc">
Nov 29 18:05:44 user nova-compute[74613]:     <timer name="pit" tickpolicy="delay"/>
Nov 29 18:05:44 user nova-compute[74613]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 29 18:05:44 user nova-compute[74613]:     <timer name="hpet" present="no"/>
Nov 29 18:05:44 user nova-compute[74613]:   </clock>
Nov 29 18:05:44 user nova-compute[74613]:   <cpu mode="custom" match="exact">
Nov 29 18:05:44 user nova-compute[74613]:     <model>Nehalem</model>
Nov 29 18:05:44 user nova-compute[74613]:     <topology sockets="1" cores="1" threads="1"/>
Nov 29 18:05:44 user nova-compute[74613]:   </cpu>
Nov 29 18:05:44 user nova-compute[74613]:   <devices>
Nov 29 18:05:44 user nova-compute[74613]:     <disk type="block" device="disk">
Nov 29 18:05:44 user nova-compute[74613]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 18:05:44 user nova-compute[74613]:       <source dev="/dev/sdc"/>
Nov 29 18:05:44 user nova-compute[74613]:       <target dev="vda" bus="virtio"/>
Nov 29 18:05:44 user nova-compute[74613]:       <serial>b9aad94d-fe0d-415d-9761-9aff25cc6099</serial>
Nov 29 18:05:44 user nova-compute[74613]:     </disk>
Nov 29 18:05:44 user nova-compute[74613]:     <disk type="file" device="disk">
Nov 29 18:05:44 user nova-compute[74613]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 29 18:05:44 user nova-compute[74613]:       <source file="/opt/stack/data/nova/instances/d3c285cd-9f39-423c-a324-30a48a9c66be/disk.rescue"/>
Nov 29 18:05:44 user nova-compute[74613]:       <target dev="vdb" bus="virtio"/>
Nov 29 18:05:44 user nova-compute[74613]:       <boot order="1"/>
Nov 29 18:05:44 user nova-compute[74613]:     </disk>
Nov 29 18:05:44 user nova-compute[74613]:     <interface type="ethernet">
Nov 29 18:05:44 user nova-compute[74613]:       <mac address="fa:16:3e:11:80:42"/>
Nov 29 18:05:44 user nova-compute[74613]:       <model type="virtio"/>
Nov 29 18:05:44 user nova-compute[74613]:       <mtu size="1442"/>
Nov 29 18:05:44 user nova-compute[74613]:       <target dev="tap663e4724-b3"/>
Nov 29 18:05:44 user nova-compute[74613]:     </interface>
Nov 29 18:05:44 user nova-compute[74613]:     <serial type="pty">
Nov 29 18:05:44 user nova-compute[74613]:       <log file="/opt/stack/data/nova/instances/d3c285cd-9f39-423c-a324-30a48a9c66be/console.log" append="off"/>
Nov 29 18:05:44 user nova-compute[74613]:     </serial>
Nov 29 18:05:44 user nova-compute[74613]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 29 18:05:44 user nova-compute[74613]:     <video>
Nov 29 18:05:44 user nova-compute[74613]:       <model type="virtio"/>
Nov 29 18:05:44 user nova-compute[74613]:     </video>
Nov 29 18:05:44 user nova-compute[74613]:     <rng model="virtio">
Nov 29 18:05:44 user nova-compute[74613]:       <backend model="random">/dev/urandom</backend>
Nov 29 18:05:44 user nova-compute[74613]:     </rng>
Nov 29 18:05:44 user nova-compute[74613]:     <controller type="usb" index="0" model="none"/>
Nov 29 18:05:44 user nova-compute[74613]:     <memballoon model="virtio">
Nov 29 18:05:44 user nova-compute[74613]:       <stats period="10"/>
Nov 29 18:05:44 user nova-compute[74613]:     </memballoon>
Nov 29 18:05:44 user nova-compute[74613]:   </devices>
Nov 29 18:05:44 user nova-compute[74613]: </domain>
Nov 29 18:05:44 user nova-compute[74613]:  {{(pid=74613) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 29 18:05:44 user nova-compute[74613]: INFO nova.virt.libvirt.driver [-] [instance: d3c285cd-9f39-423c-a324-30a48a9c66be] Instance destroyed successfully.
Nov 29 18:05:44 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-6ac55ef6-2860-4318-bd34-e22b65aa36c1 tempest-ServerBootFromVolumeStableRescueTest-414665510 tempest-ServerBootFromVolumeStableRescueTest-414665510-project-member] No BDM found with device name vda, not building metadata. {{(pid=74613) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 18:05:44 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-6ac55ef6-2860-4318-bd34-e22b65aa36c1 tempest-ServerBootFromVolumeStableRescueTest-414665510 tempest-ServerBootFromVolumeStableRescueTest-414665510-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74613) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 18:05:44 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-6ac55ef6-2860-4318-bd34-e22b65aa36c1 tempest-ServerBootFromVolumeStableRescueTest-414665510 tempest-ServerBootFromVolumeStableRescueTest-414665510-project-member] No VIF found with MAC fa:16:3e:11:80:42, not building metadata {{(pid=74613) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 29 18:05:44 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-a8ed7b97-89a5-49b7-94ff-b43cb519ed92 tempest-AttachVolumeTestJSON-813984703 tempest-AttachVolumeTestJSON-813984703-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 18:05:44 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-a8ed7b97-89a5-49b7-94ff-b43cb519ed92 tempest-AttachVolumeTestJSON-813984703 tempest-AttachVolumeTestJSON-813984703-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 18:05:44 user nova-compute[74613]: DEBUG nova.virt.hardware [None req-a8ed7b97-89a5-49b7-94ff-b43cb519ed92 tempest-AttachVolumeTestJSON-813984703 tempest-AttachVolumeTestJSON-813984703-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74613) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 29 18:05:44 user nova-compute[74613]: INFO nova.compute.claims [None req-a8ed7b97-89a5-49b7-94ff-b43cb519ed92 tempest-AttachVolumeTestJSON-813984703 tempest-AttachVolumeTestJSON-813984703-project-member] [instance: 69109f06-acbf-4834-b05e-80ab6e3f6ea0] Claim successful on node user
Nov 29 18:05:44 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-16f57d8c-725c-4db8-bc77-437fe5a00e4d tempest-AttachVolumeNegativeTest-483083654 tempest-AttachVolumeNegativeTest-483083654-project-member] Acquiring lock "e2439d62-4713-435d-81ce-fafe1d811b47" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 18:05:44 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-16f57d8c-725c-4db8-bc77-437fe5a00e4d tempest-AttachVolumeNegativeTest-483083654 tempest-AttachVolumeNegativeTest-483083654-project-member] Lock "e2439d62-4713-435d-81ce-fafe1d811b47" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 18:05:44 user nova-compute[74613]: DEBUG nova.compute.manager [None req-16f57d8c-725c-4db8-bc77-437fe5a00e4d tempest-AttachVolumeNegativeTest-483083654 tempest-AttachVolumeNegativeTest-483083654-project-member] [instance: e2439d62-4713-435d-81ce-fafe1d811b47] Starting instance... {{(pid=74613) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 29 18:05:44 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-16f57d8c-725c-4db8-bc77-437fe5a00e4d tempest-AttachVolumeNegativeTest-483083654 tempest-AttachVolumeNegativeTest-483083654-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 18:05:44 user nova-compute[74613]: DEBUG nova.compute.provider_tree [None req-a8ed7b97-89a5-49b7-94ff-b43cb519ed92 tempest-AttachVolumeTestJSON-813984703 tempest-AttachVolumeTestJSON-813984703-project-member] Inventory has not changed in ProviderTree for provider: 639d980e-3b12-44b1-b8f4-1812416fa4dd {{(pid=74613) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 18:05:44 user nova-compute[74613]: DEBUG nova.scheduler.client.report [None req-a8ed7b97-89a5-49b7-94ff-b43cb519ed92 tempest-AttachVolumeTestJSON-813984703 tempest-AttachVolumeTestJSON-813984703-project-member] Inventory has not changed for provider 639d980e-3b12-44b1-b8f4-1812416fa4dd based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74613) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 18:05:44 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-a8ed7b97-89a5-49b7-94ff-b43cb519ed92 tempest-AttachVolumeTestJSON-813984703 tempest-AttachVolumeTestJSON-813984703-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.624s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 18:05:44 user nova-compute[74613]: DEBUG nova.compute.manager [None req-a8ed7b97-89a5-49b7-94ff-b43cb519ed92 tempest-AttachVolumeTestJSON-813984703 tempest-AttachVolumeTestJSON-813984703-project-member] [instance: 69109f06-acbf-4834-b05e-80ab6e3f6ea0] Start building networks asynchronously for instance. {{(pid=74613) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 29 18:05:44 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-16f57d8c-725c-4db8-bc77-437fe5a00e4d tempest-AttachVolumeNegativeTest-483083654 tempest-AttachVolumeNegativeTest-483083654-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.160s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 18:05:44 user nova-compute[74613]: DEBUG nova.virt.hardware [None req-16f57d8c-725c-4db8-bc77-437fe5a00e4d tempest-AttachVolumeNegativeTest-483083654 tempest-AttachVolumeNegativeTest-483083654-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74613) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 29 18:05:44 user nova-compute[74613]: INFO nova.compute.claims [None req-16f57d8c-725c-4db8-bc77-437fe5a00e4d tempest-AttachVolumeNegativeTest-483083654 tempest-AttachVolumeNegativeTest-483083654-project-member] [instance: e2439d62-4713-435d-81ce-fafe1d811b47] Claim successful on node user
Nov 29 18:05:45 user nova-compute[74613]: DEBUG nova.compute.manager [None req-a8ed7b97-89a5-49b7-94ff-b43cb519ed92 tempest-AttachVolumeTestJSON-813984703 tempest-AttachVolumeTestJSON-813984703-project-member] [instance: 69109f06-acbf-4834-b05e-80ab6e3f6ea0] Allocating IP information in the background. {{(pid=74613) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 29 18:05:45 user nova-compute[74613]: DEBUG nova.network.neutron [None req-a8ed7b97-89a5-49b7-94ff-b43cb519ed92 tempest-AttachVolumeTestJSON-813984703 tempest-AttachVolumeTestJSON-813984703-project-member] [instance: 69109f06-acbf-4834-b05e-80ab6e3f6ea0] allocate_for_instance() {{(pid=74613) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 29 18:05:45 user nova-compute[74613]: INFO nova.virt.libvirt.driver [None req-a8ed7b97-89a5-49b7-94ff-b43cb519ed92 tempest-AttachVolumeTestJSON-813984703 tempest-AttachVolumeTestJSON-813984703-project-member] [instance: 69109f06-acbf-4834-b05e-80ab6e3f6ea0] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 29 18:05:45 user nova-compute[74613]: DEBUG nova.compute.manager [None req-a8ed7b97-89a5-49b7-94ff-b43cb519ed92 tempest-AttachVolumeTestJSON-813984703 tempest-AttachVolumeTestJSON-813984703-project-member] [instance: 69109f06-acbf-4834-b05e-80ab6e3f6ea0] Start building block device mappings for instance. {{(pid=74613) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 29 18:05:45 user nova-compute[74613]: DEBUG nova.policy [None req-a8ed7b97-89a5-49b7-94ff-b43cb519ed92 tempest-AttachVolumeTestJSON-813984703 tempest-AttachVolumeTestJSON-813984703-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '14808f06536f477b8a2b413e3cf9d18f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5dc39bc30d84269a7ad073867e36436', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74613) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 29 18:05:45 user nova-compute[74613]: DEBUG nova.compute.manager [None req-a8ed7b97-89a5-49b7-94ff-b43cb519ed92 tempest-AttachVolumeTestJSON-813984703 tempest-AttachVolumeTestJSON-813984703-project-member] [instance: 69109f06-acbf-4834-b05e-80ab6e3f6ea0] Start spawning the instance on the hypervisor. {{(pid=74613) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 29 18:05:45 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-a8ed7b97-89a5-49b7-94ff-b43cb519ed92 tempest-AttachVolumeTestJSON-813984703 tempest-AttachVolumeTestJSON-813984703-project-member] [instance: 69109f06-acbf-4834-b05e-80ab6e3f6ea0] Creating instance directory {{(pid=74613) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 29 18:05:45 user nova-compute[74613]: INFO nova.virt.libvirt.driver [None req-a8ed7b97-89a5-49b7-94ff-b43cb519ed92 tempest-AttachVolumeTestJSON-813984703 tempest-AttachVolumeTestJSON-813984703-project-member] [instance: 69109f06-acbf-4834-b05e-80ab6e3f6ea0] Creating image(s)
Nov 29 18:05:45 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-a8ed7b97-89a5-49b7-94ff-b43cb519ed92 tempest-AttachVolumeTestJSON-813984703 tempest-AttachVolumeTestJSON-813984703-project-member] Acquiring lock "/opt/stack/data/nova/instances/69109f06-acbf-4834-b05e-80ab6e3f6ea0/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 18:05:45 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-a8ed7b97-89a5-49b7-94ff-b43cb519ed92 tempest-AttachVolumeTestJSON-813984703 tempest-AttachVolumeTestJSON-813984703-project-member] Lock "/opt/stack/data/nova/instances/69109f06-acbf-4834-b05e-80ab6e3f6ea0/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 18:05:45 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-a8ed7b97-89a5-49b7-94ff-b43cb519ed92 tempest-AttachVolumeTestJSON-813984703 tempest-AttachVolumeTestJSON-813984703-project-member] Lock "/opt/stack/data/nova/instances/69109f06-acbf-4834-b05e-80ab6e3f6ea0/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 18:05:45 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-a8ed7b97-89a5-49b7-94ff-b43cb519ed92 tempest-AttachVolumeTestJSON-813984703 tempest-AttachVolumeTestJSON-813984703-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/21faea9e6951f3bdd0153b76ac89fe1a60a34758 --force-share --output=json {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:05:45 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-a8ed7b97-89a5-49b7-94ff-b43cb519ed92 tempest-AttachVolumeTestJSON-813984703 tempest-AttachVolumeTestJSON-813984703-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/21faea9e6951f3bdd0153b76ac89fe1a60a34758 --force-share --output=json" returned: 0 in 0.190s {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:05:45 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-a8ed7b97-89a5-49b7-94ff-b43cb519ed92 tempest-AttachVolumeTestJSON-813984703 tempest-AttachVolumeTestJSON-813984703-project-member] Acquiring lock "21faea9e6951f3bdd0153b76ac89fe1a60a34758" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 18:05:45 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-a8ed7b97-89a5-49b7-94ff-b43cb519ed92 tempest-AttachVolumeTestJSON-813984703 tempest-AttachVolumeTestJSON-813984703-project-member] Lock "21faea9e6951f3bdd0153b76ac89fe1a60a34758" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.003s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 18:05:45 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-a8ed7b97-89a5-49b7-94ff-b43cb519ed92 tempest-AttachVolumeTestJSON-813984703 tempest-AttachVolumeTestJSON-813984703-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/21faea9e6951f3bdd0153b76ac89fe1a60a34758 --force-share --output=json {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:05:45 user nova-compute[74613]: DEBUG nova.compute.manager [req-bbfbcc44-8622-4689-887d-0d0966756179 req-0f83530e-c2aa-4171-95f3-e36ac186cf3e service nova] [instance: 56de3dd1-6873-4c0a-9d80-58518dfd671e] Received event network-vif-deleted-30db35d4-e78c-414e-bae8-593d9aaadda8 {{(pid=74613) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 18:05:45 user nova-compute[74613]: INFO nova.compute.manager [req-bbfbcc44-8622-4689-887d-0d0966756179 req-0f83530e-c2aa-4171-95f3-e36ac186cf3e service nova] [instance: 56de3dd1-6873-4c0a-9d80-58518dfd671e] Neutron deleted interface 30db35d4-e78c-414e-bae8-593d9aaadda8; detaching it from the instance and deleting it from the info cache
Nov 29 18:05:45 user nova-compute[74613]: DEBUG nova.network.neutron [req-bbfbcc44-8622-4689-887d-0d0966756179 req-0f83530e-c2aa-4171-95f3-e36ac186cf3e service nova] [instance: 56de3dd1-6873-4c0a-9d80-58518dfd671e] Updating instance_info_cache with network_info: [{"id": "fd1eeb3e-46e9-441a-90e1-048c5ad64d0e", "address": "fa:16:3e:23:fc:5e", "network": {"id": "de42d2ca-c48c-4dc3-8b92-61dc7cbafb64", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-203953398-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.80", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a9fa0da4ffc3447795c69b31e4e9a8d0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfd1eeb3e-46", "ovs_interfaceid": "fd1eeb3e-46e9-441a-90e1-048c5ad64d0e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "7d1e40a2-4a06-4e8e-935c-3d66553dac82", "address": "fa:16:3e:a9:89:7f", "network": {"id": "3143fa56-ddfb-4a80-8df7-33d38513cf4b", "bridge": "br-int", "label": "tempest-device-tagging-net1-2047429033", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.201", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "a9fa0da4ffc3447795c69b31e4e9a8d0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7d1e40a2-4a", "ovs_interfaceid": "7d1e40a2-4a06-4e8e-935c-3d66553dac82", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "70ada3a3-186a-425a-8c4c-7af3b2d647ef", "address": "fa:16:3e:7f:89:6c", "network": {"id": "3143fa56-ddfb-4a80-8df7-33d38513cf4b", "bridge": "br-int", "label": "tempest-device-tagging-net1-2047429033", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.230", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "a9fa0da4ffc3447795c69b31e4e9a8d0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap70ada3a3-18", "ovs_interfaceid": "70ada3a3-186a-425a-8c4c-7af3b2d647ef", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "bfeedb02-28d2-4e4c-8a6b-da87e4b8f9cb", "address": "fa:16:3e:c9:00:90", "network": {"id": "3143fa56-ddfb-4a80-8df7-33d38513cf4b", "bridge": "br-int", "label": "tempest-device-tagging-net1-2047429033", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.251", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "a9fa0da4ffc3447795c69b31e4e9a8d0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbfeedb02-28", "ovs_interfaceid": "bfeedb02-28d2-4e4c-8a6b-da87e4b8f9cb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "a41dc4d4-b94a-4659-8709-566b029d2b20", "address": "fa:16:3e:c3:19:36", "network": {"id": "3143fa56-ddfb-4a80-8df7-33d38513cf4b", "bridge": "br-int", "label": "tempest-device-tagging-net1-2047429033", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.253", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "a9fa0da4ffc3447795c69b31e4e9a8d0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa41dc4d4-b9", "ovs_interfaceid": "a41dc4d4-b94a-4659-8709-566b029d2b20", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "4e39483b-3a24-4948-8025-ab381a1a6eee", "address": "fa:16:3e:b3:40:e7", "network": {"id": "e20648c0-8ed3-4009-b577-e6af59d212cd", "bridge": "br-int", "label": "tempest-device-tagging-net2-1059246863", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "a9fa0da4ffc3447795c69b31e4e9a8d0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4e39483b-3a", "ovs_interfaceid": "4e39483b-3a24-4948-8025-ab381a1a6eee", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74613) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 18:05:45 user nova-compute[74613]: DEBUG nova.compute.manager [req-bbfbcc44-8622-4689-887d-0d0966756179 req-0f83530e-c2aa-4171-95f3-e36ac186cf3e service nova] [instance: 56de3dd1-6873-4c0a-9d80-58518dfd671e] Detach interface failed, port_id=30db35d4-e78c-414e-bae8-593d9aaadda8, reason: Instance 56de3dd1-6873-4c0a-9d80-58518dfd671e could not be found. {{(pid=74613) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 29 18:05:45 user nova-compute[74613]: DEBUG nova.compute.provider_tree [None req-16f57d8c-725c-4db8-bc77-437fe5a00e4d tempest-AttachVolumeNegativeTest-483083654 tempest-AttachVolumeNegativeTest-483083654-project-member] Inventory has not changed in ProviderTree for provider: 639d980e-3b12-44b1-b8f4-1812416fa4dd {{(pid=74613) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 18:05:45 user nova-compute[74613]: DEBUG nova.scheduler.client.report [None req-16f57d8c-725c-4db8-bc77-437fe5a00e4d tempest-AttachVolumeNegativeTest-483083654 tempest-AttachVolumeNegativeTest-483083654-project-member] Inventory has not changed for provider 639d980e-3b12-44b1-b8f4-1812416fa4dd based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74613) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 18:05:45 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:05:45 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-a8ed7b97-89a5-49b7-94ff-b43cb519ed92 tempest-AttachVolumeTestJSON-813984703 tempest-AttachVolumeTestJSON-813984703-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/21faea9e6951f3bdd0153b76ac89fe1a60a34758 --force-share --output=json" returned: 0 in 0.218s {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:05:45 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-a8ed7b97-89a5-49b7-94ff-b43cb519ed92 tempest-AttachVolumeTestJSON-813984703 tempest-AttachVolumeTestJSON-813984703-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/21faea9e6951f3bdd0153b76ac89fe1a60a34758,backing_fmt=raw /opt/stack/data/nova/instances/69109f06-acbf-4834-b05e-80ab6e3f6ea0/disk 1073741824 {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:05:45 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:05:45 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-16f57d8c-725c-4db8-bc77-437fe5a00e4d tempest-AttachVolumeNegativeTest-483083654 tempest-AttachVolumeNegativeTest-483083654-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.697s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 18:05:45 user nova-compute[74613]: DEBUG nova.compute.manager [None req-16f57d8c-725c-4db8-bc77-437fe5a00e4d tempest-AttachVolumeNegativeTest-483083654 tempest-AttachVolumeNegativeTest-483083654-project-member] [instance: e2439d62-4713-435d-81ce-fafe1d811b47] Start building networks asynchronously for instance. {{(pid=74613) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 29 18:05:45 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-a8ed7b97-89a5-49b7-94ff-b43cb519ed92 tempest-AttachVolumeTestJSON-813984703 tempest-AttachVolumeTestJSON-813984703-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/21faea9e6951f3bdd0153b76ac89fe1a60a34758,backing_fmt=raw /opt/stack/data/nova/instances/69109f06-acbf-4834-b05e-80ab6e3f6ea0/disk 1073741824" returned: 0 in 0.074s {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:05:45 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-a8ed7b97-89a5-49b7-94ff-b43cb519ed92 tempest-AttachVolumeTestJSON-813984703 tempest-AttachVolumeTestJSON-813984703-project-member] Lock "21faea9e6951f3bdd0153b76ac89fe1a60a34758" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.297s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 18:05:45 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-a8ed7b97-89a5-49b7-94ff-b43cb519ed92 tempest-AttachVolumeTestJSON-813984703 tempest-AttachVolumeTestJSON-813984703-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/21faea9e6951f3bdd0153b76ac89fe1a60a34758 --force-share --output=json {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:05:45 user nova-compute[74613]: DEBUG nova.compute.manager [None req-16f57d8c-725c-4db8-bc77-437fe5a00e4d tempest-AttachVolumeNegativeTest-483083654 tempest-AttachVolumeNegativeTest-483083654-project-member] [instance: e2439d62-4713-435d-81ce-fafe1d811b47] Allocating IP information in the background. {{(pid=74613) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 29 18:05:45 user nova-compute[74613]: DEBUG nova.network.neutron [None req-16f57d8c-725c-4db8-bc77-437fe5a00e4d tempest-AttachVolumeNegativeTest-483083654 tempest-AttachVolumeNegativeTest-483083654-project-member] [instance: e2439d62-4713-435d-81ce-fafe1d811b47] allocate_for_instance() {{(pid=74613) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 29 18:05:45 user nova-compute[74613]: INFO nova.virt.libvirt.driver [None req-16f57d8c-725c-4db8-bc77-437fe5a00e4d tempest-AttachVolumeNegativeTest-483083654 tempest-AttachVolumeNegativeTest-483083654-project-member] [instance: e2439d62-4713-435d-81ce-fafe1d811b47] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 29 18:05:45 user nova-compute[74613]: DEBUG nova.compute.manager [None req-16f57d8c-725c-4db8-bc77-437fe5a00e4d tempest-AttachVolumeNegativeTest-483083654 tempest-AttachVolumeNegativeTest-483083654-project-member] [instance: e2439d62-4713-435d-81ce-fafe1d811b47] Start building block device mappings for instance. {{(pid=74613) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 29 18:05:45 user nova-compute[74613]: DEBUG nova.network.neutron [None req-a8ed7b97-89a5-49b7-94ff-b43cb519ed92 tempest-AttachVolumeTestJSON-813984703 tempest-AttachVolumeTestJSON-813984703-project-member] [instance: 69109f06-acbf-4834-b05e-80ab6e3f6ea0] Successfully created port: e8b2f9b5-0c3a-4f6f-bf96-566c8a779849 {{(pid=74613) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 29 18:05:45 user nova-compute[74613]: DEBUG nova.policy [None req-16f57d8c-725c-4db8-bc77-437fe5a00e4d tempest-AttachVolumeNegativeTest-483083654 tempest-AttachVolumeNegativeTest-483083654-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '57b1f3743f0e4cbdae1dab9e4761511e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37b89c13ba1d4a94805d6af69ad26fb8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74613) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 29 18:05:45 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-a8ed7b97-89a5-49b7-94ff-b43cb519ed92 tempest-AttachVolumeTestJSON-813984703 tempest-AttachVolumeTestJSON-813984703-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/21faea9e6951f3bdd0153b76ac89fe1a60a34758 --force-share --output=json" returned: 0 in 0.209s {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:05:45 user nova-compute[74613]: DEBUG nova.virt.disk.api [None req-a8ed7b97-89a5-49b7-94ff-b43cb519ed92 tempest-AttachVolumeTestJSON-813984703 tempest-AttachVolumeTestJSON-813984703-project-member] Checking if we can resize image /opt/stack/data/nova/instances/69109f06-acbf-4834-b05e-80ab6e3f6ea0/disk. size=1073741824 {{(pid=74613) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 29 18:05:45 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-a8ed7b97-89a5-49b7-94ff-b43cb519ed92 tempest-AttachVolumeTestJSON-813984703 tempest-AttachVolumeTestJSON-813984703-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/69109f06-acbf-4834-b05e-80ab6e3f6ea0/disk --force-share --output=json {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:05:45 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:05:45 user nova-compute[74613]: DEBUG nova.compute.manager [req-3633f104-24e3-468d-8cfa-9a1ea9b7e99d req-d986e4e2-2f9c-4b11-b28d-5c03d8ba5917 service nova] [instance: 56de3dd1-6873-4c0a-9d80-58518dfd671e] Received event network-vif-unplugged-fd1eeb3e-46e9-441a-90e1-048c5ad64d0e {{(pid=74613) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 18:05:45 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-3633f104-24e3-468d-8cfa-9a1ea9b7e99d req-d986e4e2-2f9c-4b11-b28d-5c03d8ba5917 service nova] Acquiring lock "56de3dd1-6873-4c0a-9d80-58518dfd671e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 18:05:45 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-3633f104-24e3-468d-8cfa-9a1ea9b7e99d req-d986e4e2-2f9c-4b11-b28d-5c03d8ba5917 service nova] Lock "56de3dd1-6873-4c0a-9d80-58518dfd671e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 18:05:45 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-3633f104-24e3-468d-8cfa-9a1ea9b7e99d req-d986e4e2-2f9c-4b11-b28d-5c03d8ba5917 service nova] Lock "56de3dd1-6873-4c0a-9d80-58518dfd671e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 18:05:45 user nova-compute[74613]: DEBUG nova.compute.manager [req-3633f104-24e3-468d-8cfa-9a1ea9b7e99d req-d986e4e2-2f9c-4b11-b28d-5c03d8ba5917 service nova] [instance: 56de3dd1-6873-4c0a-9d80-58518dfd671e] No waiting events found dispatching network-vif-unplugged-fd1eeb3e-46e9-441a-90e1-048c5ad64d0e {{(pid=74613) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 18:05:45 user nova-compute[74613]: DEBUG nova.compute.manager [req-3633f104-24e3-468d-8cfa-9a1ea9b7e99d req-d986e4e2-2f9c-4b11-b28d-5c03d8ba5917 service nova] [instance: 56de3dd1-6873-4c0a-9d80-58518dfd671e] Received event network-vif-unplugged-fd1eeb3e-46e9-441a-90e1-048c5ad64d0e for instance with task_state deleting. {{(pid=74613) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 29 18:05:46 user nova-compute[74613]: DEBUG nova.compute.manager [None req-16f57d8c-725c-4db8-bc77-437fe5a00e4d tempest-AttachVolumeNegativeTest-483083654 tempest-AttachVolumeNegativeTest-483083654-project-member] [instance: e2439d62-4713-435d-81ce-fafe1d811b47] Start spawning the instance on the hypervisor. {{(pid=74613) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 29 18:05:46 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-16f57d8c-725c-4db8-bc77-437fe5a00e4d tempest-AttachVolumeNegativeTest-483083654 tempest-AttachVolumeNegativeTest-483083654-project-member] [instance: e2439d62-4713-435d-81ce-fafe1d811b47] Creating instance directory {{(pid=74613) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 29 18:05:46 user nova-compute[74613]: INFO nova.virt.libvirt.driver [None req-16f57d8c-725c-4db8-bc77-437fe5a00e4d tempest-AttachVolumeNegativeTest-483083654 tempest-AttachVolumeNegativeTest-483083654-project-member] [instance: e2439d62-4713-435d-81ce-fafe1d811b47] Creating image(s)
Nov 29 18:05:46 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-16f57d8c-725c-4db8-bc77-437fe5a00e4d tempest-AttachVolumeNegativeTest-483083654 tempest-AttachVolumeNegativeTest-483083654-project-member] Acquiring lock "/opt/stack/data/nova/instances/e2439d62-4713-435d-81ce-fafe1d811b47/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 18:05:46 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-16f57d8c-725c-4db8-bc77-437fe5a00e4d tempest-AttachVolumeNegativeTest-483083654 tempest-AttachVolumeNegativeTest-483083654-project-member] Lock "/opt/stack/data/nova/instances/e2439d62-4713-435d-81ce-fafe1d811b47/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 18:05:46 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-16f57d8c-725c-4db8-bc77-437fe5a00e4d tempest-AttachVolumeNegativeTest-483083654 tempest-AttachVolumeNegativeTest-483083654-project-member] Lock "/opt/stack/data/nova/instances/e2439d62-4713-435d-81ce-fafe1d811b47/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 18:05:46 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-16f57d8c-725c-4db8-bc77-437fe5a00e4d tempest-AttachVolumeNegativeTest-483083654 tempest-AttachVolumeNegativeTest-483083654-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/21faea9e6951f3bdd0153b76ac89fe1a60a34758 --force-share --output=json {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:05:46 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:05:46 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-a8ed7b97-89a5-49b7-94ff-b43cb519ed92 tempest-AttachVolumeTestJSON-813984703 tempest-AttachVolumeTestJSON-813984703-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/69109f06-acbf-4834-b05e-80ab6e3f6ea0/disk --force-share --output=json" returned: 0 in 0.209s {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:05:46 user nova-compute[74613]: DEBUG nova.virt.disk.api [None req-a8ed7b97-89a5-49b7-94ff-b43cb519ed92 tempest-AttachVolumeTestJSON-813984703 tempest-AttachVolumeTestJSON-813984703-project-member] Cannot resize image /opt/stack/data/nova/instances/69109f06-acbf-4834-b05e-80ab6e3f6ea0/disk to a smaller size. {{(pid=74613) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 29 18:05:46 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-a8ed7b97-89a5-49b7-94ff-b43cb519ed92 tempest-AttachVolumeTestJSON-813984703 tempest-AttachVolumeTestJSON-813984703-project-member] [instance: 69109f06-acbf-4834-b05e-80ab6e3f6ea0] Created local disks {{(pid=74613) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 29 18:05:46 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-a8ed7b97-89a5-49b7-94ff-b43cb519ed92 tempest-AttachVolumeTestJSON-813984703 tempest-AttachVolumeTestJSON-813984703-project-member] [instance: 69109f06-acbf-4834-b05e-80ab6e3f6ea0] Ensure instance console log exists: /opt/stack/data/nova/instances/69109f06-acbf-4834-b05e-80ab6e3f6ea0/console.log {{(pid=74613) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 29 18:05:46 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-a8ed7b97-89a5-49b7-94ff-b43cb519ed92 tempest-AttachVolumeTestJSON-813984703 tempest-AttachVolumeTestJSON-813984703-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 18:05:46 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-a8ed7b97-89a5-49b7-94ff-b43cb519ed92 tempest-AttachVolumeTestJSON-813984703 tempest-AttachVolumeTestJSON-813984703-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 18:05:46 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-a8ed7b97-89a5-49b7-94ff-b43cb519ed92 tempest-AttachVolumeTestJSON-813984703 tempest-AttachVolumeTestJSON-813984703-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 18:05:46 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-16f57d8c-725c-4db8-bc77-437fe5a00e4d tempest-AttachVolumeNegativeTest-483083654 tempest-AttachVolumeNegativeTest-483083654-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/21faea9e6951f3bdd0153b76ac89fe1a60a34758 --force-share --output=json" returned: 0 in 0.202s {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:05:46 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-16f57d8c-725c-4db8-bc77-437fe5a00e4d tempest-AttachVolumeNegativeTest-483083654 tempest-AttachVolumeNegativeTest-483083654-project-member] Acquiring lock "21faea9e6951f3bdd0153b76ac89fe1a60a34758" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 18:05:46 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-16f57d8c-725c-4db8-bc77-437fe5a00e4d tempest-AttachVolumeNegativeTest-483083654 tempest-AttachVolumeNegativeTest-483083654-project-member] Lock "21faea9e6951f3bdd0153b76ac89fe1a60a34758" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 18:05:46 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-16f57d8c-725c-4db8-bc77-437fe5a00e4d tempest-AttachVolumeNegativeTest-483083654 tempest-AttachVolumeNegativeTest-483083654-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/21faea9e6951f3bdd0153b76ac89fe1a60a34758 --force-share --output=json {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:05:46 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-16f57d8c-725c-4db8-bc77-437fe5a00e4d tempest-AttachVolumeNegativeTest-483083654 tempest-AttachVolumeNegativeTest-483083654-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/21faea9e6951f3bdd0153b76ac89fe1a60a34758 --force-share --output=json" returned: 0 in 0.211s {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:05:46 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-16f57d8c-725c-4db8-bc77-437fe5a00e4d tempest-AttachVolumeNegativeTest-483083654 tempest-AttachVolumeNegativeTest-483083654-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/21faea9e6951f3bdd0153b76ac89fe1a60a34758,backing_fmt=raw /opt/stack/data/nova/instances/e2439d62-4713-435d-81ce-fafe1d811b47/disk 1073741824 {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:05:46 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-16f57d8c-725c-4db8-bc77-437fe5a00e4d tempest-AttachVolumeNegativeTest-483083654 tempest-AttachVolumeNegativeTest-483083654-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/21faea9e6951f3bdd0153b76ac89fe1a60a34758,backing_fmt=raw /opt/stack/data/nova/instances/e2439d62-4713-435d-81ce-fafe1d811b47/disk 1073741824" returned: 0 in 0.064s {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:05:46 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-16f57d8c-725c-4db8-bc77-437fe5a00e4d tempest-AttachVolumeNegativeTest-483083654 tempest-AttachVolumeNegativeTest-483083654-project-member] Lock "21faea9e6951f3bdd0153b76ac89fe1a60a34758" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.282s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 18:05:46 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-16f57d8c-725c-4db8-bc77-437fe5a00e4d tempest-AttachVolumeNegativeTest-483083654 tempest-AttachVolumeNegativeTest-483083654-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/21faea9e6951f3bdd0153b76ac89fe1a60a34758 --force-share --output=json {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:05:46 user nova-compute[74613]: DEBUG nova.network.neutron [None req-a8ed7b97-89a5-49b7-94ff-b43cb519ed92 tempest-AttachVolumeTestJSON-813984703 tempest-AttachVolumeTestJSON-813984703-project-member] [instance: 69109f06-acbf-4834-b05e-80ab6e3f6ea0] Successfully updated port: e8b2f9b5-0c3a-4f6f-bf96-566c8a779849 {{(pid=74613) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 29 18:05:46 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-a8ed7b97-89a5-49b7-94ff-b43cb519ed92 tempest-AttachVolumeTestJSON-813984703 tempest-AttachVolumeTestJSON-813984703-project-member] Acquiring lock "refresh_cache-69109f06-acbf-4834-b05e-80ab6e3f6ea0" {{(pid=74613) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 18:05:46 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-a8ed7b97-89a5-49b7-94ff-b43cb519ed92 tempest-AttachVolumeTestJSON-813984703 tempest-AttachVolumeTestJSON-813984703-project-member] Acquired lock "refresh_cache-69109f06-acbf-4834-b05e-80ab6e3f6ea0" {{(pid=74613) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 18:05:46 user nova-compute[74613]: DEBUG nova.network.neutron [None req-a8ed7b97-89a5-49b7-94ff-b43cb519ed92 tempest-AttachVolumeTestJSON-813984703 tempest-AttachVolumeTestJSON-813984703-project-member] [instance: 69109f06-acbf-4834-b05e-80ab6e3f6ea0] Building network info cache for instance {{(pid=74613) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 29 18:05:46 user nova-compute[74613]: DEBUG nova.compute.manager [req-9e452059-9aee-444b-b252-e117ad153e6d req-6df1fd7c-9484-48d7-ba8a-2b29f1f04428 service nova] [instance: 69109f06-acbf-4834-b05e-80ab6e3f6ea0] Received event network-changed-e8b2f9b5-0c3a-4f6f-bf96-566c8a779849 {{(pid=74613) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 18:05:46 user nova-compute[74613]: DEBUG nova.compute.manager [req-9e452059-9aee-444b-b252-e117ad153e6d req-6df1fd7c-9484-48d7-ba8a-2b29f1f04428 service nova] [instance: 69109f06-acbf-4834-b05e-80ab6e3f6ea0] Refreshing instance network info cache due to event network-changed-e8b2f9b5-0c3a-4f6f-bf96-566c8a779849. {{(pid=74613) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 18:05:46 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-9e452059-9aee-444b-b252-e117ad153e6d req-6df1fd7c-9484-48d7-ba8a-2b29f1f04428 service nova] Acquiring lock "refresh_cache-69109f06-acbf-4834-b05e-80ab6e3f6ea0" {{(pid=74613) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 18:05:46 user nova-compute[74613]: DEBUG nova.network.neutron [None req-a8ed7b97-89a5-49b7-94ff-b43cb519ed92 tempest-AttachVolumeTestJSON-813984703 tempest-AttachVolumeTestJSON-813984703-project-member] [instance: 69109f06-acbf-4834-b05e-80ab6e3f6ea0] Instance cache missing network info. {{(pid=74613) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 29 18:05:46 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-16f57d8c-725c-4db8-bc77-437fe5a00e4d tempest-AttachVolumeNegativeTest-483083654 tempest-AttachVolumeNegativeTest-483083654-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/21faea9e6951f3bdd0153b76ac89fe1a60a34758 --force-share --output=json" returned: 0 in 0.184s {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:05:46 user nova-compute[74613]: DEBUG nova.virt.disk.api [None req-16f57d8c-725c-4db8-bc77-437fe5a00e4d tempest-AttachVolumeNegativeTest-483083654 tempest-AttachVolumeNegativeTest-483083654-project-member] Checking if we can resize image /opt/stack/data/nova/instances/e2439d62-4713-435d-81ce-fafe1d811b47/disk. size=1073741824 {{(pid=74613) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 29 18:05:46 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-16f57d8c-725c-4db8-bc77-437fe5a00e4d tempest-AttachVolumeNegativeTest-483083654 tempest-AttachVolumeNegativeTest-483083654-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e2439d62-4713-435d-81ce-fafe1d811b47/disk --force-share --output=json {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:05:46 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-16f57d8c-725c-4db8-bc77-437fe5a00e4d tempest-AttachVolumeNegativeTest-483083654 tempest-AttachVolumeNegativeTest-483083654-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e2439d62-4713-435d-81ce-fafe1d811b47/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:05:46 user nova-compute[74613]: DEBUG nova.virt.disk.api [None req-16f57d8c-725c-4db8-bc77-437fe5a00e4d tempest-AttachVolumeNegativeTest-483083654 tempest-AttachVolumeNegativeTest-483083654-project-member] Cannot resize image /opt/stack/data/nova/instances/e2439d62-4713-435d-81ce-fafe1d811b47/disk to a smaller size. {{(pid=74613) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 29 18:05:46 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-16f57d8c-725c-4db8-bc77-437fe5a00e4d tempest-AttachVolumeNegativeTest-483083654 tempest-AttachVolumeNegativeTest-483083654-project-member] [instance: e2439d62-4713-435d-81ce-fafe1d811b47] Created local disks {{(pid=74613) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 29 18:05:46 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-16f57d8c-725c-4db8-bc77-437fe5a00e4d tempest-AttachVolumeNegativeTest-483083654 tempest-AttachVolumeNegativeTest-483083654-project-member] [instance: e2439d62-4713-435d-81ce-fafe1d811b47] Ensure instance console log exists: /opt/stack/data/nova/instances/e2439d62-4713-435d-81ce-fafe1d811b47/console.log {{(pid=74613) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 29 18:05:46 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-16f57d8c-725c-4db8-bc77-437fe5a00e4d tempest-AttachVolumeNegativeTest-483083654 tempest-AttachVolumeNegativeTest-483083654-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 18:05:46 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-16f57d8c-725c-4db8-bc77-437fe5a00e4d tempest-AttachVolumeNegativeTest-483083654 tempest-AttachVolumeNegativeTest-483083654-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 18:05:46 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-16f57d8c-725c-4db8-bc77-437fe5a00e4d tempest-AttachVolumeNegativeTest-483083654 tempest-AttachVolumeNegativeTest-483083654-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 18:05:46 user nova-compute[74613]: DEBUG nova.network.neutron [None req-16f57d8c-725c-4db8-bc77-437fe5a00e4d tempest-AttachVolumeNegativeTest-483083654 tempest-AttachVolumeNegativeTest-483083654-project-member] [instance: e2439d62-4713-435d-81ce-fafe1d811b47] Successfully created port: 50079e9e-673c-4a5a-8f32-56d794575fdf {{(pid=74613) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 29 18:05:46 user nova-compute[74613]: DEBUG nova.network.neutron [None req-a8ed7b97-89a5-49b7-94ff-b43cb519ed92 tempest-AttachVolumeTestJSON-813984703 tempest-AttachVolumeTestJSON-813984703-project-member] [instance: 69109f06-acbf-4834-b05e-80ab6e3f6ea0] Updating instance_info_cache with network_info: [{"id": "e8b2f9b5-0c3a-4f6f-bf96-566c8a779849", "address": "fa:16:3e:da:7a:47", "network": {"id": "21147bc8-b1ac-40d5-8fc0-8dab8ade1ff5", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1502381061-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b5dc39bc30d84269a7ad073867e36436", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape8b2f9b5-0c", "ovs_interfaceid": "e8b2f9b5-0c3a-4f6f-bf96-566c8a779849", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74613) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 18:05:46 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-a8ed7b97-89a5-49b7-94ff-b43cb519ed92 tempest-AttachVolumeTestJSON-813984703 tempest-AttachVolumeTestJSON-813984703-project-member] Releasing lock "refresh_cache-69109f06-acbf-4834-b05e-80ab6e3f6ea0" {{(pid=74613) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 18:05:46 user nova-compute[74613]: DEBUG nova.compute.manager [None req-a8ed7b97-89a5-49b7-94ff-b43cb519ed92 tempest-AttachVolumeTestJSON-813984703 tempest-AttachVolumeTestJSON-813984703-project-member] [instance: 69109f06-acbf-4834-b05e-80ab6e3f6ea0] Instance network_info: |[{"id": "e8b2f9b5-0c3a-4f6f-bf96-566c8a779849", "address": "fa:16:3e:da:7a:47", "network": {"id": "21147bc8-b1ac-40d5-8fc0-8dab8ade1ff5", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1502381061-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b5dc39bc30d84269a7ad073867e36436", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape8b2f9b5-0c", "ovs_interfaceid": "e8b2f9b5-0c3a-4f6f-bf96-566c8a779849", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74613) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 29 18:05:46 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-9e452059-9aee-444b-b252-e117ad153e6d req-6df1fd7c-9484-48d7-ba8a-2b29f1f04428 service nova] Acquired lock "refresh_cache-69109f06-acbf-4834-b05e-80ab6e3f6ea0" {{(pid=74613) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 18:05:46 user nova-compute[74613]: DEBUG nova.network.neutron [req-9e452059-9aee-444b-b252-e117ad153e6d req-6df1fd7c-9484-48d7-ba8a-2b29f1f04428 service nova] [instance: 69109f06-acbf-4834-b05e-80ab6e3f6ea0] Refreshing network info cache for port e8b2f9b5-0c3a-4f6f-bf96-566c8a779849 {{(pid=74613) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 18:05:46 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-a8ed7b97-89a5-49b7-94ff-b43cb519ed92 tempest-AttachVolumeTestJSON-813984703 tempest-AttachVolumeTestJSON-813984703-project-member] [instance: 69109f06-acbf-4834-b05e-80ab6e3f6ea0] Start _get_guest_xml network_info=[{"id": "e8b2f9b5-0c3a-4f6f-bf96-566c8a779849", "address": "fa:16:3e:da:7a:47", "network": {"id": "21147bc8-b1ac-40d5-8fc0-8dab8ade1ff5", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1502381061-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b5dc39bc30d84269a7ad073867e36436", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape8b2f9b5-0c", "ovs_interfaceid": "e8b2f9b5-0c3a-4f6f-bf96-566c8a779849", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-29T17:47:38Z,direct_url=<?>,disk_format='qcow2',id=4217f428-8d9d-4ee1-9614-642d26d90c46,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='794b07cbd46a44b5865cfda741036bae',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-29T17:47:40Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'size': 0, 'device_type': 'disk', 'boot_index': 0, 'guest_format': None, 'encrypted': False, 'encryption_format': None, 'disk_bus': 'virtio', 'image_id': '4217f428-8d9d-4ee1-9614-642d26d90c46'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74613) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 29 18:05:46 user nova-compute[74613]: WARNING nova.virt.libvirt.driver [None req-a8ed7b97-89a5-49b7-94ff-b43cb519ed92 tempest-AttachVolumeTestJSON-813984703 tempest-AttachVolumeTestJSON-813984703-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 18:05:46 user nova-compute[74613]: WARNING nova.virt.libvirt.driver [None req-a8ed7b97-89a5-49b7-94ff-b43cb519ed92 tempest-AttachVolumeTestJSON-813984703 tempest-AttachVolumeTestJSON-813984703-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 18:05:46 user nova-compute[74613]: DEBUG nova.virt.libvirt.host [None req-a8ed7b97-89a5-49b7-94ff-b43cb519ed92 tempest-AttachVolumeTestJSON-813984703 tempest-AttachVolumeTestJSON-813984703-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74613) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 29 18:05:46 user nova-compute[74613]: DEBUG nova.virt.libvirt.host [None req-a8ed7b97-89a5-49b7-94ff-b43cb519ed92 tempest-AttachVolumeTestJSON-813984703 tempest-AttachVolumeTestJSON-813984703-project-member] CPU controller missing on host. {{(pid=74613) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 29 18:05:46 user nova-compute[74613]: DEBUG nova.virt.libvirt.host [None req-a8ed7b97-89a5-49b7-94ff-b43cb519ed92 tempest-AttachVolumeTestJSON-813984703 tempest-AttachVolumeTestJSON-813984703-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74613) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 29 18:05:46 user nova-compute[74613]: DEBUG nova.virt.libvirt.host [None req-a8ed7b97-89a5-49b7-94ff-b43cb519ed92 tempest-AttachVolumeTestJSON-813984703 tempest-AttachVolumeTestJSON-813984703-project-member] CPU controller found on host. {{(pid=74613) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 29 18:05:46 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-a8ed7b97-89a5-49b7-94ff-b43cb519ed92 tempest-AttachVolumeTestJSON-813984703 tempest-AttachVolumeTestJSON-813984703-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74613) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 29 18:05:46 user nova-compute[74613]: DEBUG nova.virt.hardware [None req-a8ed7b97-89a5-49b7-94ff-b43cb519ed92 tempest-AttachVolumeTestJSON-813984703 tempest-AttachVolumeTestJSON-813984703-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-29T17:47:27Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-29T17:47:38Z,direct_url=<?>,disk_format='qcow2',id=4217f428-8d9d-4ee1-9614-642d26d90c46,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='794b07cbd46a44b5865cfda741036bae',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-29T17:47:40Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74613) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 29 18:05:46 user nova-compute[74613]: DEBUG nova.virt.hardware [None req-a8ed7b97-89a5-49b7-94ff-b43cb519ed92 tempest-AttachVolumeTestJSON-813984703 tempest-AttachVolumeTestJSON-813984703-project-member] Flavor limits 0:0:0 {{(pid=74613) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 29 18:05:46 user nova-compute[74613]: DEBUG nova.virt.hardware [None req-a8ed7b97-89a5-49b7-94ff-b43cb519ed92 tempest-AttachVolumeTestJSON-813984703 tempest-AttachVolumeTestJSON-813984703-project-member] Image limits 0:0:0 {{(pid=74613) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 29 18:05:46 user nova-compute[74613]: DEBUG nova.virt.hardware [None req-a8ed7b97-89a5-49b7-94ff-b43cb519ed92 tempest-AttachVolumeTestJSON-813984703 tempest-AttachVolumeTestJSON-813984703-project-member] Flavor pref 0:0:0 {{(pid=74613) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 29 18:05:46 user nova-compute[74613]: DEBUG nova.virt.hardware [None req-a8ed7b97-89a5-49b7-94ff-b43cb519ed92 tempest-AttachVolumeTestJSON-813984703 tempest-AttachVolumeTestJSON-813984703-project-member] Image pref 0:0:0 {{(pid=74613) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 29 18:05:46 user nova-compute[74613]: DEBUG nova.virt.hardware [None req-a8ed7b97-89a5-49b7-94ff-b43cb519ed92 tempest-AttachVolumeTestJSON-813984703 tempest-AttachVolumeTestJSON-813984703-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74613) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 29 18:05:46 user nova-compute[74613]: DEBUG nova.virt.hardware [None req-a8ed7b97-89a5-49b7-94ff-b43cb519ed92 tempest-AttachVolumeTestJSON-813984703 tempest-AttachVolumeTestJSON-813984703-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74613) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 29 18:05:46 user nova-compute[74613]: DEBUG nova.virt.hardware [None req-a8ed7b97-89a5-49b7-94ff-b43cb519ed92 tempest-AttachVolumeTestJSON-813984703 tempest-AttachVolumeTestJSON-813984703-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74613) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 29 18:05:46 user nova-compute[74613]: DEBUG nova.virt.hardware [None req-a8ed7b97-89a5-49b7-94ff-b43cb519ed92 tempest-AttachVolumeTestJSON-813984703 tempest-AttachVolumeTestJSON-813984703-project-member] Got 1 possible topologies {{(pid=74613) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 29 18:05:46 user nova-compute[74613]: DEBUG nova.virt.hardware [None req-a8ed7b97-89a5-49b7-94ff-b43cb519ed92 tempest-AttachVolumeTestJSON-813984703 tempest-AttachVolumeTestJSON-813984703-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74613) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 29 18:05:46 user nova-compute[74613]: DEBUG nova.virt.hardware [None req-a8ed7b97-89a5-49b7-94ff-b43cb519ed92 tempest-AttachVolumeTestJSON-813984703 tempest-AttachVolumeTestJSON-813984703-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74613) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 29 18:05:47 user nova-compute[74613]: DEBUG nova.virt.libvirt.vif [None req-a8ed7b97-89a5-49b7-94ff-b43cb519ed92 tempest-AttachVolumeTestJSON-813984703 tempest-AttachVolumeTestJSON-813984703-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T18:05:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-112129053',display_name='tempest-AttachVolumeTestJSON-server-112129053',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-112129053',id=31,image_ref='4217f428-8d9d-4ee1-9614-642d26d90c46',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBiA6TF+XgKgtvk6TtvUc4C6ae4R2cFJpd7pnrnZXTn17B7mtXw3FeSD7WciMYISZgM0lnyM/Vu+rh9AL6QLxayu8zBkp18LuuA17FBMijpeZLWA1S8luzqDoaFtKzv2Kw==',key_name='tempest-keypair-1770317456',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b5dc39bc30d84269a7ad073867e36436',ramdisk_id='',reservation_id='r-dq3ksvj9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='4217f428-8d9d-4ee1-9614-642d26d90c46',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-813984703',owner_user_name='tempest-AttachVolumeTestJSON-813984703-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T18:05:45Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='14808f06536f477b8a2b413e3cf9d18f',uuid=69109f06-acbf-4834-b05e-80ab6e3f6ea0,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e8b2f9b5-0c3a-4f6f-bf96-566c8a779849", "address": "fa:16:3e:da:7a:47", "network": {"id": "21147bc8-b1ac-40d5-8fc0-8dab8ade1ff5", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1502381061-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b5dc39bc30d84269a7ad073867e36436", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape8b2f9b5-0c", "ovs_interfaceid": "e8b2f9b5-0c3a-4f6f-bf96-566c8a779849", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74613) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 29 18:05:47 user nova-compute[74613]: DEBUG nova.network.os_vif_util [None req-a8ed7b97-89a5-49b7-94ff-b43cb519ed92 tempest-AttachVolumeTestJSON-813984703 tempest-AttachVolumeTestJSON-813984703-project-member] Converting VIF {"id": "e8b2f9b5-0c3a-4f6f-bf96-566c8a779849", "address": "fa:16:3e:da:7a:47", "network": {"id": "21147bc8-b1ac-40d5-8fc0-8dab8ade1ff5", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1502381061-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b5dc39bc30d84269a7ad073867e36436", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape8b2f9b5-0c", "ovs_interfaceid": "e8b2f9b5-0c3a-4f6f-bf96-566c8a779849", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74613) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 18:05:47 user nova-compute[74613]: DEBUG nova.network.os_vif_util [None req-a8ed7b97-89a5-49b7-94ff-b43cb519ed92 tempest-AttachVolumeTestJSON-813984703 tempest-AttachVolumeTestJSON-813984703-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:da:7a:47,bridge_name='br-int',has_traffic_filtering=True,id=e8b2f9b5-0c3a-4f6f-bf96-566c8a779849,network=Network(21147bc8-b1ac-40d5-8fc0-8dab8ade1ff5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape8b2f9b5-0c') {{(pid=74613) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 18:05:47 user nova-compute[74613]: DEBUG nova.objects.instance [None req-a8ed7b97-89a5-49b7-94ff-b43cb519ed92 tempest-AttachVolumeTestJSON-813984703 tempest-AttachVolumeTestJSON-813984703-project-member] Lazy-loading 'pci_devices' on Instance uuid 69109f06-acbf-4834-b05e-80ab6e3f6ea0 {{(pid=74613) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 18:05:47 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-a8ed7b97-89a5-49b7-94ff-b43cb519ed92 tempest-AttachVolumeTestJSON-813984703 tempest-AttachVolumeTestJSON-813984703-project-member] [instance: 69109f06-acbf-4834-b05e-80ab6e3f6ea0] End _get_guest_xml xml=<domain type="kvm">
Nov 29 18:05:47 user nova-compute[74613]:   <uuid>69109f06-acbf-4834-b05e-80ab6e3f6ea0</uuid>
Nov 29 18:05:47 user nova-compute[74613]:   <name>instance-0000001f</name>
Nov 29 18:05:47 user nova-compute[74613]:   <memory>524288</memory>
Nov 29 18:05:47 user nova-compute[74613]:   <vcpu>1</vcpu>
Nov 29 18:05:47 user nova-compute[74613]:   <metadata>
Nov 29 18:05:47 user nova-compute[74613]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 29 18:05:47 user nova-compute[74613]:       <nova:package version="0.0.0"/>
Nov 29 18:05:47 user nova-compute[74613]:       <nova:name>tempest-AttachVolumeTestJSON-server-112129053</nova:name>
Nov 29 18:05:47 user nova-compute[74613]:       <nova:creationTime>2023-11-29 18:05:46</nova:creationTime>
Nov 29 18:05:47 user nova-compute[74613]:       <nova:flavor name="m1.tiny">
Nov 29 18:05:47 user nova-compute[74613]:         <nova:memory>512</nova:memory>
Nov 29 18:05:47 user nova-compute[74613]:         <nova:disk>1</nova:disk>
Nov 29 18:05:47 user nova-compute[74613]:         <nova:swap>0</nova:swap>
Nov 29 18:05:47 user nova-compute[74613]:         <nova:ephemeral>0</nova:ephemeral>
Nov 29 18:05:47 user nova-compute[74613]:         <nova:vcpus>1</nova:vcpus>
Nov 29 18:05:47 user nova-compute[74613]:       </nova:flavor>
Nov 29 18:05:47 user nova-compute[74613]:       <nova:owner>
Nov 29 18:05:47 user nova-compute[74613]:         <nova:user uuid="14808f06536f477b8a2b413e3cf9d18f">tempest-AttachVolumeTestJSON-813984703-project-member</nova:user>
Nov 29 18:05:47 user nova-compute[74613]:         <nova:project uuid="b5dc39bc30d84269a7ad073867e36436">tempest-AttachVolumeTestJSON-813984703</nova:project>
Nov 29 18:05:47 user nova-compute[74613]:       </nova:owner>
Nov 29 18:05:47 user nova-compute[74613]:       <nova:root type="image" uuid="4217f428-8d9d-4ee1-9614-642d26d90c46"/>
Nov 29 18:05:47 user nova-compute[74613]:       <nova:ports>
Nov 29 18:05:47 user nova-compute[74613]:         <nova:port uuid="e8b2f9b5-0c3a-4f6f-bf96-566c8a779849">
Nov 29 18:05:47 user nova-compute[74613]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Nov 29 18:05:47 user nova-compute[74613]:         </nova:port>
Nov 29 18:05:47 user nova-compute[74613]:       </nova:ports>
Nov 29 18:05:47 user nova-compute[74613]:     </nova:instance>
Nov 29 18:05:47 user nova-compute[74613]:   </metadata>
Nov 29 18:05:47 user nova-compute[74613]:   <sysinfo type="smbios">
Nov 29 18:05:47 user nova-compute[74613]:     <system>
Nov 29 18:05:47 user nova-compute[74613]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 29 18:05:47 user nova-compute[74613]:       <entry name="product">OpenStack Nova</entry>
Nov 29 18:05:47 user nova-compute[74613]:       <entry name="version">0.0.0</entry>
Nov 29 18:05:47 user nova-compute[74613]:       <entry name="serial">69109f06-acbf-4834-b05e-80ab6e3f6ea0</entry>
Nov 29 18:05:47 user nova-compute[74613]:       <entry name="uuid">69109f06-acbf-4834-b05e-80ab6e3f6ea0</entry>
Nov 29 18:05:47 user nova-compute[74613]:       <entry name="family">Virtual Machine</entry>
Nov 29 18:05:47 user nova-compute[74613]:     </system>
Nov 29 18:05:47 user nova-compute[74613]:   </sysinfo>
Nov 29 18:05:47 user nova-compute[74613]:   <os>
Nov 29 18:05:47 user nova-compute[74613]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 29 18:05:47 user nova-compute[74613]:     <boot dev="hd"/>
Nov 29 18:05:47 user nova-compute[74613]:     <smbios mode="sysinfo"/>
Nov 29 18:05:47 user nova-compute[74613]:   </os>
Nov 29 18:05:47 user nova-compute[74613]:   <features>
Nov 29 18:05:47 user nova-compute[74613]:     <acpi/>
Nov 29 18:05:47 user nova-compute[74613]:     <apic/>
Nov 29 18:05:47 user nova-compute[74613]:     <vmcoreinfo/>
Nov 29 18:05:47 user nova-compute[74613]:   </features>
Nov 29 18:05:47 user nova-compute[74613]:   <clock offset="utc">
Nov 29 18:05:47 user nova-compute[74613]:     <timer name="pit" tickpolicy="delay"/>
Nov 29 18:05:47 user nova-compute[74613]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 29 18:05:47 user nova-compute[74613]:     <timer name="hpet" present="no"/>
Nov 29 18:05:47 user nova-compute[74613]:   </clock>
Nov 29 18:05:47 user nova-compute[74613]:   <cpu mode="custom" match="exact">
Nov 29 18:05:47 user nova-compute[74613]:     <model>Nehalem</model>
Nov 29 18:05:47 user nova-compute[74613]:     <topology sockets="1" cores="1" threads="1"/>
Nov 29 18:05:47 user nova-compute[74613]:   </cpu>
Nov 29 18:05:47 user nova-compute[74613]:   <devices>
Nov 29 18:05:47 user nova-compute[74613]:     <disk type="file" device="disk">
Nov 29 18:05:47 user nova-compute[74613]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 29 18:05:47 user nova-compute[74613]:       <source file="/opt/stack/data/nova/instances/69109f06-acbf-4834-b05e-80ab6e3f6ea0/disk"/>
Nov 29 18:05:47 user nova-compute[74613]:       <target dev="vda" bus="virtio"/>
Nov 29 18:05:47 user nova-compute[74613]:     </disk>
Nov 29 18:05:47 user nova-compute[74613]:     <interface type="ethernet">
Nov 29 18:05:47 user nova-compute[74613]:       <mac address="fa:16:3e:da:7a:47"/>
Nov 29 18:05:47 user nova-compute[74613]:       <model type="virtio"/>
Nov 29 18:05:47 user nova-compute[74613]:       <mtu size="1442"/>
Nov 29 18:05:47 user nova-compute[74613]:       <target dev="tape8b2f9b5-0c"/>
Nov 29 18:05:47 user nova-compute[74613]:     </interface>
Nov 29 18:05:47 user nova-compute[74613]:     <serial type="pty">
Nov 29 18:05:47 user nova-compute[74613]:       <log file="/opt/stack/data/nova/instances/69109f06-acbf-4834-b05e-80ab6e3f6ea0/console.log" append="off"/>
Nov 29 18:05:47 user nova-compute[74613]:     </serial>
Nov 29 18:05:47 user nova-compute[74613]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 29 18:05:47 user nova-compute[74613]:     <video>
Nov 29 18:05:47 user nova-compute[74613]:       <model type="virtio"/>
Nov 29 18:05:47 user nova-compute[74613]:     </video>
Nov 29 18:05:47 user nova-compute[74613]:     <rng model="virtio">
Nov 29 18:05:47 user nova-compute[74613]:       <backend model="random">/dev/urandom</backend>
Nov 29 18:05:47 user nova-compute[74613]:     </rng>
Nov 29 18:05:47 user nova-compute[74613]:     <controller type="usb" index="0" model="none"/>
Nov 29 18:05:47 user nova-compute[74613]:     <memballoon model="virtio">
Nov 29 18:05:47 user nova-compute[74613]:       <stats period="10"/>
Nov 29 18:05:47 user nova-compute[74613]:     </memballoon>
Nov 29 18:05:47 user nova-compute[74613]:   </devices>
Nov 29 18:05:47 user nova-compute[74613]: </domain>
Nov 29 18:05:47 user nova-compute[74613]:  {{(pid=74613) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 29 18:05:47 user nova-compute[74613]: DEBUG nova.virt.libvirt.vif [None req-a8ed7b97-89a5-49b7-94ff-b43cb519ed92 tempest-AttachVolumeTestJSON-813984703 tempest-AttachVolumeTestJSON-813984703-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T18:05:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-112129053',display_name='tempest-AttachVolumeTestJSON-server-112129053',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-112129053',id=31,image_ref='4217f428-8d9d-4ee1-9614-642d26d90c46',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBiA6TF+XgKgtvk6TtvUc4C6ae4R2cFJpd7pnrnZXTn17B7mtXw3FeSD7WciMYISZgM0lnyM/Vu+rh9AL6QLxayu8zBkp18LuuA17FBMijpeZLWA1S8luzqDoaFtKzv2Kw==',key_name='tempest-keypair-1770317456',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b5dc39bc30d84269a7ad073867e36436',ramdisk_id='',reservation_id='r-dq3ksvj9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='4217f428-8d9d-4ee1-9614-642d26d90c46',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-813984703',owner_user_name='tempest-AttachVolumeTestJSON-813984703-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T18:05:45Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='14808f06536f477b8a2b413e3cf9d18f',uuid=69109f06-acbf-4834-b05e-80ab6e3f6ea0,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e8b2f9b5-0c3a-4f6f-bf96-566c8a779849", "address": "fa:16:3e:da:7a:47", "network": {"id": "21147bc8-b1ac-40d5-8fc0-8dab8ade1ff5", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1502381061-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b5dc39bc30d84269a7ad073867e36436", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape8b2f9b5-0c", "ovs_interfaceid": "e8b2f9b5-0c3a-4f6f-bf96-566c8a779849", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74613) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 29 18:05:47 user nova-compute[74613]: DEBUG nova.network.os_vif_util [None req-a8ed7b97-89a5-49b7-94ff-b43cb519ed92 tempest-AttachVolumeTestJSON-813984703 tempest-AttachVolumeTestJSON-813984703-project-member] Converting VIF {"id": "e8b2f9b5-0c3a-4f6f-bf96-566c8a779849", "address": "fa:16:3e:da:7a:47", "network": {"id": "21147bc8-b1ac-40d5-8fc0-8dab8ade1ff5", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1502381061-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b5dc39bc30d84269a7ad073867e36436", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape8b2f9b5-0c", "ovs_interfaceid": "e8b2f9b5-0c3a-4f6f-bf96-566c8a779849", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74613) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 18:05:47 user nova-compute[74613]: DEBUG nova.network.os_vif_util [None req-a8ed7b97-89a5-49b7-94ff-b43cb519ed92 tempest-AttachVolumeTestJSON-813984703 tempest-AttachVolumeTestJSON-813984703-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:da:7a:47,bridge_name='br-int',has_traffic_filtering=True,id=e8b2f9b5-0c3a-4f6f-bf96-566c8a779849,network=Network(21147bc8-b1ac-40d5-8fc0-8dab8ade1ff5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape8b2f9b5-0c') {{(pid=74613) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 18:05:47 user nova-compute[74613]: DEBUG os_vif [None req-a8ed7b97-89a5-49b7-94ff-b43cb519ed92 tempest-AttachVolumeTestJSON-813984703 tempest-AttachVolumeTestJSON-813984703-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:da:7a:47,bridge_name='br-int',has_traffic_filtering=True,id=e8b2f9b5-0c3a-4f6f-bf96-566c8a779849,network=Network(21147bc8-b1ac-40d5-8fc0-8dab8ade1ff5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape8b2f9b5-0c') {{(pid=74613) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 29 18:05:47 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:05:47 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74613) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 18:05:47 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74613) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 29 18:05:47 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:05:47 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '9dfb5447-3411-50be-bad9-0477e9e5d5d7', '_type': 'linux-noop'}}, row=False) {{(pid=74613) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 18:05:47 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:05:47 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 18:05:47 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:05:47 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tape8b2f9b5-0c, may_exist=True, interface_attrs={}) {{(pid=74613) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 18:05:47 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tape8b2f9b5-0c, col_values=(('qos', UUID('3882f5e8-156a-44b6-86ce-cf8bc975254e')),), if_exists=True) {{(pid=74613) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 18:05:47 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tape8b2f9b5-0c, col_values=(('external_ids', {'iface-id': 'e8b2f9b5-0c3a-4f6f-bf96-566c8a779849', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:da:7a:47', 'vm-uuid': '69109f06-acbf-4834-b05e-80ab6e3f6ea0'}),), if_exists=True) {{(pid=74613) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 18:05:47 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:05:47 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 18:05:47 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:05:47 user nova-compute[74613]: INFO os_vif [None req-a8ed7b97-89a5-49b7-94ff-b43cb519ed92 tempest-AttachVolumeTestJSON-813984703 tempest-AttachVolumeTestJSON-813984703-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:da:7a:47,bridge_name='br-int',has_traffic_filtering=True,id=e8b2f9b5-0c3a-4f6f-bf96-566c8a779849,network=Network(21147bc8-b1ac-40d5-8fc0-8dab8ade1ff5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape8b2f9b5-0c')
Nov 29 18:05:47 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-a8ed7b97-89a5-49b7-94ff-b43cb519ed92 tempest-AttachVolumeTestJSON-813984703 tempest-AttachVolumeTestJSON-813984703-project-member] No BDM found with device name vda, not building metadata. {{(pid=74613) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 18:05:47 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-a8ed7b97-89a5-49b7-94ff-b43cb519ed92 tempest-AttachVolumeTestJSON-813984703 tempest-AttachVolumeTestJSON-813984703-project-member] No VIF found with MAC fa:16:3e:da:7a:47, not building metadata {{(pid=74613) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 29 18:05:47 user nova-compute[74613]: DEBUG nova.network.neutron [req-9e452059-9aee-444b-b252-e117ad153e6d req-6df1fd7c-9484-48d7-ba8a-2b29f1f04428 service nova] [instance: 69109f06-acbf-4834-b05e-80ab6e3f6ea0] Updated VIF entry in instance network info cache for port e8b2f9b5-0c3a-4f6f-bf96-566c8a779849. {{(pid=74613) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 18:05:47 user nova-compute[74613]: DEBUG nova.network.neutron [req-9e452059-9aee-444b-b252-e117ad153e6d req-6df1fd7c-9484-48d7-ba8a-2b29f1f04428 service nova] [instance: 69109f06-acbf-4834-b05e-80ab6e3f6ea0] Updating instance_info_cache with network_info: [{"id": "e8b2f9b5-0c3a-4f6f-bf96-566c8a779849", "address": "fa:16:3e:da:7a:47", "network": {"id": "21147bc8-b1ac-40d5-8fc0-8dab8ade1ff5", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1502381061-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b5dc39bc30d84269a7ad073867e36436", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape8b2f9b5-0c", "ovs_interfaceid": "e8b2f9b5-0c3a-4f6f-bf96-566c8a779849", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74613) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 18:05:47 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-9e452059-9aee-444b-b252-e117ad153e6d req-6df1fd7c-9484-48d7-ba8a-2b29f1f04428 service nova] Releasing lock "refresh_cache-69109f06-acbf-4834-b05e-80ab6e3f6ea0" {{(pid=74613) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 18:05:47 user nova-compute[74613]: DEBUG nova.compute.manager [req-4b99fe47-b561-4092-b998-7defd6c05af2 req-b36e8558-826c-494f-adc6-fe2675fe0e13 service nova] [instance: 56de3dd1-6873-4c0a-9d80-58518dfd671e] Received event network-vif-deleted-bfeedb02-28d2-4e4c-8a6b-da87e4b8f9cb {{(pid=74613) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 18:05:47 user nova-compute[74613]: INFO nova.compute.manager [req-4b99fe47-b561-4092-b998-7defd6c05af2 req-b36e8558-826c-494f-adc6-fe2675fe0e13 service nova] [instance: 56de3dd1-6873-4c0a-9d80-58518dfd671e] Neutron deleted interface bfeedb02-28d2-4e4c-8a6b-da87e4b8f9cb; detaching it from the instance and deleting it from the info cache
Nov 29 18:05:47 user nova-compute[74613]: DEBUG nova.network.neutron [req-4b99fe47-b561-4092-b998-7defd6c05af2 req-b36e8558-826c-494f-adc6-fe2675fe0e13 service nova] [instance: 56de3dd1-6873-4c0a-9d80-58518dfd671e] Updating instance_info_cache with network_info: [{"id": "fd1eeb3e-46e9-441a-90e1-048c5ad64d0e", "address": "fa:16:3e:23:fc:5e", "network": {"id": "de42d2ca-c48c-4dc3-8b92-61dc7cbafb64", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-203953398-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.80", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a9fa0da4ffc3447795c69b31e4e9a8d0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfd1eeb3e-46", "ovs_interfaceid": "fd1eeb3e-46e9-441a-90e1-048c5ad64d0e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "7d1e40a2-4a06-4e8e-935c-3d66553dac82", "address": "fa:16:3e:a9:89:7f", "network": {"id": "3143fa56-ddfb-4a80-8df7-33d38513cf4b", "bridge": "br-int", "label": "tempest-device-tagging-net1-2047429033", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.201", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "a9fa0da4ffc3447795c69b31e4e9a8d0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7d1e40a2-4a", "ovs_interfaceid": "7d1e40a2-4a06-4e8e-935c-3d66553dac82", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "70ada3a3-186a-425a-8c4c-7af3b2d647ef", "address": "fa:16:3e:7f:89:6c", "network": {"id": "3143fa56-ddfb-4a80-8df7-33d38513cf4b", "bridge": "br-int", "label": "tempest-device-tagging-net1-2047429033", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.230", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "a9fa0da4ffc3447795c69b31e4e9a8d0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap70ada3a3-18", "ovs_interfaceid": "70ada3a3-186a-425a-8c4c-7af3b2d647ef", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "a41dc4d4-b94a-4659-8709-566b029d2b20", "address": "fa:16:3e:c3:19:36", "network": {"id": "3143fa56-ddfb-4a80-8df7-33d38513cf4b", "bridge": "br-int", "label": "tempest-device-tagging-net1-2047429033", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.253", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "a9fa0da4ffc3447795c69b31e4e9a8d0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa41dc4d4-b9", "ovs_interfaceid": "a41dc4d4-b94a-4659-8709-566b029d2b20", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "4e39483b-3a24-4948-8025-ab381a1a6eee", "address": "fa:16:3e:b3:40:e7", "network": {"id": "e20648c0-8ed3-4009-b577-e6af59d212cd", "bridge": "br-int", "label": "tempest-device-tagging-net2-1059246863", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "a9fa0da4ffc3447795c69b31e4e9a8d0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4e39483b-3a", "ovs_interfaceid": "4e39483b-3a24-4948-8025-ab381a1a6eee", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74613) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 18:05:47 user nova-compute[74613]: DEBUG nova.compute.manager [req-4b99fe47-b561-4092-b998-7defd6c05af2 req-b36e8558-826c-494f-adc6-fe2675fe0e13 service nova] [instance: 56de3dd1-6873-4c0a-9d80-58518dfd671e] Detach interface failed, port_id=bfeedb02-28d2-4e4c-8a6b-da87e4b8f9cb, reason: Instance 56de3dd1-6873-4c0a-9d80-58518dfd671e could not be found. {{(pid=74613) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 29 18:05:47 user nova-compute[74613]: DEBUG nova.compute.manager [req-4b99fe47-b561-4092-b998-7defd6c05af2 req-b36e8558-826c-494f-adc6-fe2675fe0e13 service nova] [instance: d3c285cd-9f39-423c-a324-30a48a9c66be] Received event network-vif-plugged-663e4724-b31b-469d-a5ea-c2802db1e0c8 {{(pid=74613) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 18:05:47 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-4b99fe47-b561-4092-b998-7defd6c05af2 req-b36e8558-826c-494f-adc6-fe2675fe0e13 service nova] Acquiring lock "d3c285cd-9f39-423c-a324-30a48a9c66be-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 18:05:47 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-4b99fe47-b561-4092-b998-7defd6c05af2 req-b36e8558-826c-494f-adc6-fe2675fe0e13 service nova] Lock "d3c285cd-9f39-423c-a324-30a48a9c66be-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 18:05:47 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-4b99fe47-b561-4092-b998-7defd6c05af2 req-b36e8558-826c-494f-adc6-fe2675fe0e13 service nova] Lock "d3c285cd-9f39-423c-a324-30a48a9c66be-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 18:05:47 user nova-compute[74613]: DEBUG nova.compute.manager [req-4b99fe47-b561-4092-b998-7defd6c05af2 req-b36e8558-826c-494f-adc6-fe2675fe0e13 service nova] [instance: d3c285cd-9f39-423c-a324-30a48a9c66be] No waiting events found dispatching network-vif-plugged-663e4724-b31b-469d-a5ea-c2802db1e0c8 {{(pid=74613) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 18:05:47 user nova-compute[74613]: WARNING nova.compute.manager [req-4b99fe47-b561-4092-b998-7defd6c05af2 req-b36e8558-826c-494f-adc6-fe2675fe0e13 service nova] [instance: d3c285cd-9f39-423c-a324-30a48a9c66be] Received unexpected event network-vif-plugged-663e4724-b31b-469d-a5ea-c2802db1e0c8 for instance with vm_state active and task_state rescuing.
Nov 29 18:05:47 user nova-compute[74613]: DEBUG nova.compute.manager [req-4b99fe47-b561-4092-b998-7defd6c05af2 req-b36e8558-826c-494f-adc6-fe2675fe0e13 service nova] [instance: d3c285cd-9f39-423c-a324-30a48a9c66be] Received event network-vif-plugged-663e4724-b31b-469d-a5ea-c2802db1e0c8 {{(pid=74613) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 18:05:47 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-4b99fe47-b561-4092-b998-7defd6c05af2 req-b36e8558-826c-494f-adc6-fe2675fe0e13 service nova] Acquiring lock "d3c285cd-9f39-423c-a324-30a48a9c66be-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 18:05:47 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-4b99fe47-b561-4092-b998-7defd6c05af2 req-b36e8558-826c-494f-adc6-fe2675fe0e13 service nova] Lock "d3c285cd-9f39-423c-a324-30a48a9c66be-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 18:05:47 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-4b99fe47-b561-4092-b998-7defd6c05af2 req-b36e8558-826c-494f-adc6-fe2675fe0e13 service nova] Lock "d3c285cd-9f39-423c-a324-30a48a9c66be-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 18:05:47 user nova-compute[74613]: DEBUG nova.compute.manager [req-4b99fe47-b561-4092-b998-7defd6c05af2 req-b36e8558-826c-494f-adc6-fe2675fe0e13 service nova] [instance: d3c285cd-9f39-423c-a324-30a48a9c66be] No waiting events found dispatching network-vif-plugged-663e4724-b31b-469d-a5ea-c2802db1e0c8 {{(pid=74613) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 18:05:47 user nova-compute[74613]: WARNING nova.compute.manager [req-4b99fe47-b561-4092-b998-7defd6c05af2 req-b36e8558-826c-494f-adc6-fe2675fe0e13 service nova] [instance: d3c285cd-9f39-423c-a324-30a48a9c66be] Received unexpected event network-vif-plugged-663e4724-b31b-469d-a5ea-c2802db1e0c8 for instance with vm_state active and task_state rescuing.
Nov 29 18:05:47 user nova-compute[74613]: DEBUG nova.compute.manager [req-4b99fe47-b561-4092-b998-7defd6c05af2 req-b36e8558-826c-494f-adc6-fe2675fe0e13 service nova] [instance: 56de3dd1-6873-4c0a-9d80-58518dfd671e] Received event network-vif-deleted-fd1eeb3e-46e9-441a-90e1-048c5ad64d0e {{(pid=74613) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 18:05:47 user nova-compute[74613]: INFO nova.compute.manager [req-4b99fe47-b561-4092-b998-7defd6c05af2 req-b36e8558-826c-494f-adc6-fe2675fe0e13 service nova] [instance: 56de3dd1-6873-4c0a-9d80-58518dfd671e] Neutron deleted interface fd1eeb3e-46e9-441a-90e1-048c5ad64d0e; detaching it from the instance and deleting it from the info cache
Nov 29 18:05:47 user nova-compute[74613]: DEBUG nova.network.neutron [req-4b99fe47-b561-4092-b998-7defd6c05af2 req-b36e8558-826c-494f-adc6-fe2675fe0e13 service nova] [instance: 56de3dd1-6873-4c0a-9d80-58518dfd671e] Updating instance_info_cache with network_info: [{"id": "7d1e40a2-4a06-4e8e-935c-3d66553dac82", "address": "fa:16:3e:a9:89:7f", "network": {"id": "3143fa56-ddfb-4a80-8df7-33d38513cf4b", "bridge": "br-int", "label": "tempest-device-tagging-net1-2047429033", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.201", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "a9fa0da4ffc3447795c69b31e4e9a8d0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7d1e40a2-4a", "ovs_interfaceid": "7d1e40a2-4a06-4e8e-935c-3d66553dac82", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "70ada3a3-186a-425a-8c4c-7af3b2d647ef", "address": "fa:16:3e:7f:89:6c", "network": {"id": "3143fa56-ddfb-4a80-8df7-33d38513cf4b", "bridge": "br-int", "label": "tempest-device-tagging-net1-2047429033", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.230", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "a9fa0da4ffc3447795c69b31e4e9a8d0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap70ada3a3-18", "ovs_interfaceid": "70ada3a3-186a-425a-8c4c-7af3b2d647ef", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "a41dc4d4-b94a-4659-8709-566b029d2b20", "address": "fa:16:3e:c3:19:36", "network": {"id": "3143fa56-ddfb-4a80-8df7-33d38513cf4b", "bridge": "br-int", "label": "tempest-device-tagging-net1-2047429033", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.253", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "a9fa0da4ffc3447795c69b31e4e9a8d0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa41dc4d4-b9", "ovs_interfaceid": "a41dc4d4-b94a-4659-8709-566b029d2b20", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "4e39483b-3a24-4948-8025-ab381a1a6eee", "address": "fa:16:3e:b3:40:e7", "network": {"id": "e20648c0-8ed3-4009-b577-e6af59d212cd", "bridge": "br-int", "label": "tempest-device-tagging-net2-1059246863", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "a9fa0da4ffc3447795c69b31e4e9a8d0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4e39483b-3a", "ovs_interfaceid": "4e39483b-3a24-4948-8025-ab381a1a6eee", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74613) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 18:05:47 user nova-compute[74613]: DEBUG nova.compute.manager [req-4b99fe47-b561-4092-b998-7defd6c05af2 req-b36e8558-826c-494f-adc6-fe2675fe0e13 service nova] [instance: 56de3dd1-6873-4c0a-9d80-58518dfd671e] Detach interface failed, port_id=fd1eeb3e-46e9-441a-90e1-048c5ad64d0e, reason: Instance 56de3dd1-6873-4c0a-9d80-58518dfd671e could not be found. {{(pid=74613) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 29 18:05:47 user nova-compute[74613]: DEBUG nova.compute.manager [req-4b99fe47-b561-4092-b998-7defd6c05af2 req-b36e8558-826c-494f-adc6-fe2675fe0e13 service nova] [instance: 56de3dd1-6873-4c0a-9d80-58518dfd671e] Received event network-vif-deleted-a41dc4d4-b94a-4659-8709-566b029d2b20 {{(pid=74613) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 18:05:47 user nova-compute[74613]: INFO nova.compute.manager [req-4b99fe47-b561-4092-b998-7defd6c05af2 req-b36e8558-826c-494f-adc6-fe2675fe0e13 service nova] [instance: 56de3dd1-6873-4c0a-9d80-58518dfd671e] Neutron deleted interface a41dc4d4-b94a-4659-8709-566b029d2b20; detaching it from the instance and deleting it from the info cache
Nov 29 18:05:47 user nova-compute[74613]: DEBUG nova.network.neutron [req-4b99fe47-b561-4092-b998-7defd6c05af2 req-b36e8558-826c-494f-adc6-fe2675fe0e13 service nova] [instance: 56de3dd1-6873-4c0a-9d80-58518dfd671e] Updating instance_info_cache with network_info: [{"id": "7d1e40a2-4a06-4e8e-935c-3d66553dac82", "address": "fa:16:3e:a9:89:7f", "network": {"id": "3143fa56-ddfb-4a80-8df7-33d38513cf4b", "bridge": "br-int", "label": "tempest-device-tagging-net1-2047429033", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.201", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "a9fa0da4ffc3447795c69b31e4e9a8d0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7d1e40a2-4a", "ovs_interfaceid": "7d1e40a2-4a06-4e8e-935c-3d66553dac82", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "70ada3a3-186a-425a-8c4c-7af3b2d647ef", "address": "fa:16:3e:7f:89:6c", "network": {"id": "3143fa56-ddfb-4a80-8df7-33d38513cf4b", "bridge": "br-int", "label": "tempest-device-tagging-net1-2047429033", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.230", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "a9fa0da4ffc3447795c69b31e4e9a8d0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap70ada3a3-18", "ovs_interfaceid": "70ada3a3-186a-425a-8c4c-7af3b2d647ef", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "4e39483b-3a24-4948-8025-ab381a1a6eee", "address": "fa:16:3e:b3:40:e7", "network": {"id": "e20648c0-8ed3-4009-b577-e6af59d212cd", "bridge": "br-int", "label": "tempest-device-tagging-net2-1059246863", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "a9fa0da4ffc3447795c69b31e4e9a8d0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4e39483b-3a", "ovs_interfaceid": "4e39483b-3a24-4948-8025-ab381a1a6eee", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74613) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 18:05:47 user nova-compute[74613]: DEBUG nova.network.neutron [-] [instance: 56de3dd1-6873-4c0a-9d80-58518dfd671e] Updating instance_info_cache with network_info: [] {{(pid=74613) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 18:05:47 user nova-compute[74613]: DEBUG nova.compute.manager [req-4b99fe47-b561-4092-b998-7defd6c05af2 req-b36e8558-826c-494f-adc6-fe2675fe0e13 service nova] [instance: 56de3dd1-6873-4c0a-9d80-58518dfd671e] Detach interface failed, port_id=a41dc4d4-b94a-4659-8709-566b029d2b20, reason: Instance 56de3dd1-6873-4c0a-9d80-58518dfd671e could not be found. {{(pid=74613) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 29 18:05:47 user nova-compute[74613]: INFO nova.compute.manager [-] [instance: 56de3dd1-6873-4c0a-9d80-58518dfd671e] Took 4.43 seconds to deallocate network for instance.
Nov 29 18:05:47 user nova-compute[74613]: DEBUG nova.network.neutron [None req-16f57d8c-725c-4db8-bc77-437fe5a00e4d tempest-AttachVolumeNegativeTest-483083654 tempest-AttachVolumeNegativeTest-483083654-project-member] [instance: e2439d62-4713-435d-81ce-fafe1d811b47] Successfully updated port: 50079e9e-673c-4a5a-8f32-56d794575fdf {{(pid=74613) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 29 18:05:47 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-16f57d8c-725c-4db8-bc77-437fe5a00e4d tempest-AttachVolumeNegativeTest-483083654 tempest-AttachVolumeNegativeTest-483083654-project-member] Acquiring lock "refresh_cache-e2439d62-4713-435d-81ce-fafe1d811b47" {{(pid=74613) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 18:05:47 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-16f57d8c-725c-4db8-bc77-437fe5a00e4d tempest-AttachVolumeNegativeTest-483083654 tempest-AttachVolumeNegativeTest-483083654-project-member] Acquired lock "refresh_cache-e2439d62-4713-435d-81ce-fafe1d811b47" {{(pid=74613) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 18:05:47 user nova-compute[74613]: DEBUG nova.network.neutron [None req-16f57d8c-725c-4db8-bc77-437fe5a00e4d tempest-AttachVolumeNegativeTest-483083654 tempest-AttachVolumeNegativeTest-483083654-project-member] [instance: e2439d62-4713-435d-81ce-fafe1d811b47] Building network info cache for instance {{(pid=74613) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 29 18:05:47 user nova-compute[74613]: DEBUG nova.network.neutron [None req-16f57d8c-725c-4db8-bc77-437fe5a00e4d tempest-AttachVolumeNegativeTest-483083654 tempest-AttachVolumeNegativeTest-483083654-project-member] [instance: e2439d62-4713-435d-81ce-fafe1d811b47] Instance cache missing network info. {{(pid=74613) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 29 18:05:47 user nova-compute[74613]: DEBUG nova.compute.manager [None req-6ac55ef6-2860-4318-bd34-e22b65aa36c1 tempest-ServerBootFromVolumeStableRescueTest-414665510 tempest-ServerBootFromVolumeStableRescueTest-414665510-project-member] [instance: d3c285cd-9f39-423c-a324-30a48a9c66be] Checking state {{(pid=74613) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 29 18:05:48 user nova-compute[74613]: DEBUG nova.network.neutron [None req-16f57d8c-725c-4db8-bc77-437fe5a00e4d tempest-AttachVolumeNegativeTest-483083654 tempest-AttachVolumeNegativeTest-483083654-project-member] [instance: e2439d62-4713-435d-81ce-fafe1d811b47] Updating instance_info_cache with network_info: [{"id": "50079e9e-673c-4a5a-8f32-56d794575fdf", "address": "fa:16:3e:3f:6e:41", "network": {"id": "c317481b-f8cf-40a0-a326-836a5ea4c495", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-887666255-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "37b89c13ba1d4a94805d6af69ad26fb8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap50079e9e-67", "ovs_interfaceid": "50079e9e-673c-4a5a-8f32-56d794575fdf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74613) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 18:05:48 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-16f57d8c-725c-4db8-bc77-437fe5a00e4d tempest-AttachVolumeNegativeTest-483083654 tempest-AttachVolumeNegativeTest-483083654-project-member] Releasing lock "refresh_cache-e2439d62-4713-435d-81ce-fafe1d811b47" {{(pid=74613) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 18:05:48 user nova-compute[74613]: DEBUG nova.compute.manager [None req-16f57d8c-725c-4db8-bc77-437fe5a00e4d tempest-AttachVolumeNegativeTest-483083654 tempest-AttachVolumeNegativeTest-483083654-project-member] [instance: e2439d62-4713-435d-81ce-fafe1d811b47] Instance network_info: |[{"id": "50079e9e-673c-4a5a-8f32-56d794575fdf", "address": "fa:16:3e:3f:6e:41", "network": {"id": "c317481b-f8cf-40a0-a326-836a5ea4c495", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-887666255-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "37b89c13ba1d4a94805d6af69ad26fb8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap50079e9e-67", "ovs_interfaceid": "50079e9e-673c-4a5a-8f32-56d794575fdf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74613) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 29 18:05:48 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-16f57d8c-725c-4db8-bc77-437fe5a00e4d tempest-AttachVolumeNegativeTest-483083654 tempest-AttachVolumeNegativeTest-483083654-project-member] [instance: e2439d62-4713-435d-81ce-fafe1d811b47] Start _get_guest_xml network_info=[{"id": "50079e9e-673c-4a5a-8f32-56d794575fdf", "address": "fa:16:3e:3f:6e:41", "network": {"id": "c317481b-f8cf-40a0-a326-836a5ea4c495", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-887666255-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "37b89c13ba1d4a94805d6af69ad26fb8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap50079e9e-67", "ovs_interfaceid": "50079e9e-673c-4a5a-8f32-56d794575fdf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-29T17:47:38Z,direct_url=<?>,disk_format='qcow2',id=4217f428-8d9d-4ee1-9614-642d26d90c46,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='794b07cbd46a44b5865cfda741036bae',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-29T17:47:40Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'size': 0, 'device_type': 'disk', 'boot_index': 0, 'guest_format': None, 'encrypted': False, 'encryption_format': None, 'disk_bus': 'virtio', 'image_id': '4217f428-8d9d-4ee1-9614-642d26d90c46'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74613) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 29 18:05:48 user nova-compute[74613]: DEBUG nova.compute.manager [req-8cdf1e96-8e04-45b8-b127-a560501aa6c1 req-4c0a31e2-c086-4f26-bb3f-867a5a5c982d service nova] [instance: 56de3dd1-6873-4c0a-9d80-58518dfd671e] Received event network-vif-plugged-fd1eeb3e-46e9-441a-90e1-048c5ad64d0e {{(pid=74613) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 18:05:48 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-8cdf1e96-8e04-45b8-b127-a560501aa6c1 req-4c0a31e2-c086-4f26-bb3f-867a5a5c982d service nova] Acquiring lock "56de3dd1-6873-4c0a-9d80-58518dfd671e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 18:05:48 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-8cdf1e96-8e04-45b8-b127-a560501aa6c1 req-4c0a31e2-c086-4f26-bb3f-867a5a5c982d service nova] Lock "56de3dd1-6873-4c0a-9d80-58518dfd671e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 18:05:48 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-8cdf1e96-8e04-45b8-b127-a560501aa6c1 req-4c0a31e2-c086-4f26-bb3f-867a5a5c982d service nova] Lock "56de3dd1-6873-4c0a-9d80-58518dfd671e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 18:05:48 user nova-compute[74613]: DEBUG nova.compute.manager [req-8cdf1e96-8e04-45b8-b127-a560501aa6c1 req-4c0a31e2-c086-4f26-bb3f-867a5a5c982d service nova] [instance: 56de3dd1-6873-4c0a-9d80-58518dfd671e] No waiting events found dispatching network-vif-plugged-fd1eeb3e-46e9-441a-90e1-048c5ad64d0e {{(pid=74613) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 18:05:48 user nova-compute[74613]: WARNING nova.compute.manager [req-8cdf1e96-8e04-45b8-b127-a560501aa6c1 req-4c0a31e2-c086-4f26-bb3f-867a5a5c982d service nova] [instance: 56de3dd1-6873-4c0a-9d80-58518dfd671e] Received unexpected event network-vif-plugged-fd1eeb3e-46e9-441a-90e1-048c5ad64d0e for instance with vm_state active and task_state deleting.
Nov 29 18:05:48 user nova-compute[74613]: DEBUG nova.compute.manager [req-8cdf1e96-8e04-45b8-b127-a560501aa6c1 req-4c0a31e2-c086-4f26-bb3f-867a5a5c982d service nova] [instance: 56de3dd1-6873-4c0a-9d80-58518dfd671e] Received event network-vif-unplugged-a41dc4d4-b94a-4659-8709-566b029d2b20 {{(pid=74613) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 18:05:48 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-8cdf1e96-8e04-45b8-b127-a560501aa6c1 req-4c0a31e2-c086-4f26-bb3f-867a5a5c982d service nova] Acquiring lock "56de3dd1-6873-4c0a-9d80-58518dfd671e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 18:05:48 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-8cdf1e96-8e04-45b8-b127-a560501aa6c1 req-4c0a31e2-c086-4f26-bb3f-867a5a5c982d service nova] Lock "56de3dd1-6873-4c0a-9d80-58518dfd671e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 18:05:48 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-8cdf1e96-8e04-45b8-b127-a560501aa6c1 req-4c0a31e2-c086-4f26-bb3f-867a5a5c982d service nova] Lock "56de3dd1-6873-4c0a-9d80-58518dfd671e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 18:05:48 user nova-compute[74613]: DEBUG nova.compute.manager [req-8cdf1e96-8e04-45b8-b127-a560501aa6c1 req-4c0a31e2-c086-4f26-bb3f-867a5a5c982d service nova] [instance: 56de3dd1-6873-4c0a-9d80-58518dfd671e] No waiting events found dispatching network-vif-unplugged-a41dc4d4-b94a-4659-8709-566b029d2b20 {{(pid=74613) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 18:05:48 user nova-compute[74613]: DEBUG nova.compute.manager [req-8cdf1e96-8e04-45b8-b127-a560501aa6c1 req-4c0a31e2-c086-4f26-bb3f-867a5a5c982d service nova] [instance: 56de3dd1-6873-4c0a-9d80-58518dfd671e] Received event network-vif-unplugged-a41dc4d4-b94a-4659-8709-566b029d2b20 for instance with task_state deleting. {{(pid=74613) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 29 18:05:48 user nova-compute[74613]: DEBUG nova.compute.manager [req-8cdf1e96-8e04-45b8-b127-a560501aa6c1 req-4c0a31e2-c086-4f26-bb3f-867a5a5c982d service nova] [instance: 56de3dd1-6873-4c0a-9d80-58518dfd671e] Received event network-vif-plugged-a41dc4d4-b94a-4659-8709-566b029d2b20 {{(pid=74613) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 18:05:48 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-8cdf1e96-8e04-45b8-b127-a560501aa6c1 req-4c0a31e2-c086-4f26-bb3f-867a5a5c982d service nova] Acquiring lock "56de3dd1-6873-4c0a-9d80-58518dfd671e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 18:05:48 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-8cdf1e96-8e04-45b8-b127-a560501aa6c1 req-4c0a31e2-c086-4f26-bb3f-867a5a5c982d service nova] Lock "56de3dd1-6873-4c0a-9d80-58518dfd671e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 18:05:48 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-8cdf1e96-8e04-45b8-b127-a560501aa6c1 req-4c0a31e2-c086-4f26-bb3f-867a5a5c982d service nova] Lock "56de3dd1-6873-4c0a-9d80-58518dfd671e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 18:05:48 user nova-compute[74613]: DEBUG nova.compute.manager [req-8cdf1e96-8e04-45b8-b127-a560501aa6c1 req-4c0a31e2-c086-4f26-bb3f-867a5a5c982d service nova] [instance: 56de3dd1-6873-4c0a-9d80-58518dfd671e] No waiting events found dispatching network-vif-plugged-a41dc4d4-b94a-4659-8709-566b029d2b20 {{(pid=74613) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 18:05:48 user nova-compute[74613]: WARNING nova.compute.manager [req-8cdf1e96-8e04-45b8-b127-a560501aa6c1 req-4c0a31e2-c086-4f26-bb3f-867a5a5c982d service nova] [instance: 56de3dd1-6873-4c0a-9d80-58518dfd671e] Received unexpected event network-vif-plugged-a41dc4d4-b94a-4659-8709-566b029d2b20 for instance with vm_state active and task_state deleting.
Nov 29 18:05:48 user nova-compute[74613]: DEBUG nova.compute.manager [req-8cdf1e96-8e04-45b8-b127-a560501aa6c1 req-4c0a31e2-c086-4f26-bb3f-867a5a5c982d service nova] [instance: 56de3dd1-6873-4c0a-9d80-58518dfd671e] Received event network-vif-unplugged-4e39483b-3a24-4948-8025-ab381a1a6eee {{(pid=74613) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 18:05:48 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-8cdf1e96-8e04-45b8-b127-a560501aa6c1 req-4c0a31e2-c086-4f26-bb3f-867a5a5c982d service nova] Acquiring lock "56de3dd1-6873-4c0a-9d80-58518dfd671e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 18:05:48 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-8cdf1e96-8e04-45b8-b127-a560501aa6c1 req-4c0a31e2-c086-4f26-bb3f-867a5a5c982d service nova] Lock "56de3dd1-6873-4c0a-9d80-58518dfd671e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 18:05:48 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-8cdf1e96-8e04-45b8-b127-a560501aa6c1 req-4c0a31e2-c086-4f26-bb3f-867a5a5c982d service nova] Lock "56de3dd1-6873-4c0a-9d80-58518dfd671e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 18:05:48 user nova-compute[74613]: DEBUG nova.compute.manager [req-8cdf1e96-8e04-45b8-b127-a560501aa6c1 req-4c0a31e2-c086-4f26-bb3f-867a5a5c982d service nova] [instance: 56de3dd1-6873-4c0a-9d80-58518dfd671e] No waiting events found dispatching network-vif-unplugged-4e39483b-3a24-4948-8025-ab381a1a6eee {{(pid=74613) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 18:05:48 user nova-compute[74613]: DEBUG nova.compute.manager [req-8cdf1e96-8e04-45b8-b127-a560501aa6c1 req-4c0a31e2-c086-4f26-bb3f-867a5a5c982d service nova] [instance: 56de3dd1-6873-4c0a-9d80-58518dfd671e] Received event network-vif-unplugged-4e39483b-3a24-4948-8025-ab381a1a6eee for instance with task_state deleting. {{(pid=74613) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 29 18:05:48 user nova-compute[74613]: DEBUG nova.compute.manager [req-8cdf1e96-8e04-45b8-b127-a560501aa6c1 req-4c0a31e2-c086-4f26-bb3f-867a5a5c982d service nova] [instance: e2439d62-4713-435d-81ce-fafe1d811b47] Received event network-changed-50079e9e-673c-4a5a-8f32-56d794575fdf {{(pid=74613) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 18:05:48 user nova-compute[74613]: DEBUG nova.compute.manager [req-8cdf1e96-8e04-45b8-b127-a560501aa6c1 req-4c0a31e2-c086-4f26-bb3f-867a5a5c982d service nova] [instance: e2439d62-4713-435d-81ce-fafe1d811b47] Refreshing instance network info cache due to event network-changed-50079e9e-673c-4a5a-8f32-56d794575fdf. {{(pid=74613) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 18:05:48 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-8cdf1e96-8e04-45b8-b127-a560501aa6c1 req-4c0a31e2-c086-4f26-bb3f-867a5a5c982d service nova] Acquiring lock "refresh_cache-e2439d62-4713-435d-81ce-fafe1d811b47" {{(pid=74613) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 18:05:48 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-8cdf1e96-8e04-45b8-b127-a560501aa6c1 req-4c0a31e2-c086-4f26-bb3f-867a5a5c982d service nova] Acquired lock "refresh_cache-e2439d62-4713-435d-81ce-fafe1d811b47" {{(pid=74613) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 18:05:48 user nova-compute[74613]: DEBUG nova.network.neutron [req-8cdf1e96-8e04-45b8-b127-a560501aa6c1 req-4c0a31e2-c086-4f26-bb3f-867a5a5c982d service nova] [instance: e2439d62-4713-435d-81ce-fafe1d811b47] Refreshing network info cache for port 50079e9e-673c-4a5a-8f32-56d794575fdf {{(pid=74613) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 18:05:48 user nova-compute[74613]: WARNING nova.virt.libvirt.driver [None req-16f57d8c-725c-4db8-bc77-437fe5a00e4d tempest-AttachVolumeNegativeTest-483083654 tempest-AttachVolumeNegativeTest-483083654-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 18:05:48 user nova-compute[74613]: WARNING nova.virt.libvirt.driver [None req-16f57d8c-725c-4db8-bc77-437fe5a00e4d tempest-AttachVolumeNegativeTest-483083654 tempest-AttachVolumeNegativeTest-483083654-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 18:05:48 user nova-compute[74613]: DEBUG nova.virt.libvirt.host [None req-16f57d8c-725c-4db8-bc77-437fe5a00e4d tempest-AttachVolumeNegativeTest-483083654 tempest-AttachVolumeNegativeTest-483083654-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74613) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 29 18:05:48 user nova-compute[74613]: DEBUG nova.virt.libvirt.host [None req-16f57d8c-725c-4db8-bc77-437fe5a00e4d tempest-AttachVolumeNegativeTest-483083654 tempest-AttachVolumeNegativeTest-483083654-project-member] CPU controller missing on host. {{(pid=74613) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 29 18:05:48 user nova-compute[74613]: DEBUG nova.virt.libvirt.host [None req-16f57d8c-725c-4db8-bc77-437fe5a00e4d tempest-AttachVolumeNegativeTest-483083654 tempest-AttachVolumeNegativeTest-483083654-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74613) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 29 18:05:48 user nova-compute[74613]: DEBUG nova.virt.libvirt.host [None req-16f57d8c-725c-4db8-bc77-437fe5a00e4d tempest-AttachVolumeNegativeTest-483083654 tempest-AttachVolumeNegativeTest-483083654-project-member] CPU controller found on host. {{(pid=74613) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 29 18:05:48 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-16f57d8c-725c-4db8-bc77-437fe5a00e4d tempest-AttachVolumeNegativeTest-483083654 tempest-AttachVolumeNegativeTest-483083654-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74613) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 29 18:05:48 user nova-compute[74613]: DEBUG nova.virt.hardware [None req-16f57d8c-725c-4db8-bc77-437fe5a00e4d tempest-AttachVolumeNegativeTest-483083654 tempest-AttachVolumeNegativeTest-483083654-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-29T17:47:27Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-29T17:47:38Z,direct_url=<?>,disk_format='qcow2',id=4217f428-8d9d-4ee1-9614-642d26d90c46,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='794b07cbd46a44b5865cfda741036bae',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-29T17:47:40Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74613) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 29 18:05:48 user nova-compute[74613]: DEBUG nova.virt.hardware [None req-16f57d8c-725c-4db8-bc77-437fe5a00e4d tempest-AttachVolumeNegativeTest-483083654 tempest-AttachVolumeNegativeTest-483083654-project-member] Flavor limits 0:0:0 {{(pid=74613) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 29 18:05:48 user nova-compute[74613]: DEBUG nova.virt.hardware [None req-16f57d8c-725c-4db8-bc77-437fe5a00e4d tempest-AttachVolumeNegativeTest-483083654 tempest-AttachVolumeNegativeTest-483083654-project-member] Image limits 0:0:0 {{(pid=74613) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 29 18:05:48 user nova-compute[74613]: DEBUG nova.virt.hardware [None req-16f57d8c-725c-4db8-bc77-437fe5a00e4d tempest-AttachVolumeNegativeTest-483083654 tempest-AttachVolumeNegativeTest-483083654-project-member] Flavor pref 0:0:0 {{(pid=74613) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 29 18:05:48 user nova-compute[74613]: DEBUG nova.virt.hardware [None req-16f57d8c-725c-4db8-bc77-437fe5a00e4d tempest-AttachVolumeNegativeTest-483083654 tempest-AttachVolumeNegativeTest-483083654-project-member] Image pref 0:0:0 {{(pid=74613) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 29 18:05:48 user nova-compute[74613]: DEBUG nova.virt.hardware [None req-16f57d8c-725c-4db8-bc77-437fe5a00e4d tempest-AttachVolumeNegativeTest-483083654 tempest-AttachVolumeNegativeTest-483083654-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74613) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 29 18:05:48 user nova-compute[74613]: DEBUG nova.virt.hardware [None req-16f57d8c-725c-4db8-bc77-437fe5a00e4d tempest-AttachVolumeNegativeTest-483083654 tempest-AttachVolumeNegativeTest-483083654-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74613) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 29 18:05:48 user nova-compute[74613]: DEBUG nova.virt.hardware [None req-16f57d8c-725c-4db8-bc77-437fe5a00e4d tempest-AttachVolumeNegativeTest-483083654 tempest-AttachVolumeNegativeTest-483083654-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74613) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 29 18:05:48 user nova-compute[74613]: DEBUG nova.virt.hardware [None req-16f57d8c-725c-4db8-bc77-437fe5a00e4d tempest-AttachVolumeNegativeTest-483083654 tempest-AttachVolumeNegativeTest-483083654-project-member] Got 1 possible topologies {{(pid=74613) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 29 18:05:48 user nova-compute[74613]: DEBUG nova.virt.hardware [None req-16f57d8c-725c-4db8-bc77-437fe5a00e4d tempest-AttachVolumeNegativeTest-483083654 tempest-AttachVolumeNegativeTest-483083654-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74613) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 29 18:05:48 user nova-compute[74613]: DEBUG nova.virt.hardware [None req-16f57d8c-725c-4db8-bc77-437fe5a00e4d tempest-AttachVolumeNegativeTest-483083654 tempest-AttachVolumeNegativeTest-483083654-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74613) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 29 18:05:48 user nova-compute[74613]: DEBUG nova.virt.libvirt.vif [None req-16f57d8c-725c-4db8-bc77-437fe5a00e4d tempest-AttachVolumeNegativeTest-483083654 tempest-AttachVolumeNegativeTest-483083654-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T18:05:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1674587994',display_name='tempest-AttachVolumeNegativeTest-server-1674587994',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1674587994',id=32,image_ref='4217f428-8d9d-4ee1-9614-642d26d90c46',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEJCnVTtu90vbCZ4BJfB03c2taMPAMz98qBh9crTNw/3mZqoRZ6KzdyK25aoXZmFo1QEHsaZ1oarwR2VWhszyNqSHeHQUmAsomD9ZROfZT2nXQOa+G3ETkmHvZoV+HeGqQ==',key_name='tempest-keypair-18440938',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='37b89c13ba1d4a94805d6af69ad26fb8',ramdisk_id='',reservation_id='r-0igai5r4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='4217f428-8d9d-4ee1-9614-642d26d90c46',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-483083654',owner_user_name='tempest-AttachVolumeNegativeTest-483083654-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T18:05:46Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='57b1f3743f0e4cbdae1dab9e4761511e',uuid=e2439d62-4713-435d-81ce-fafe1d811b47,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "50079e9e-673c-4a5a-8f32-56d794575fdf", "address": "fa:16:3e:3f:6e:41", "network": {"id": "c317481b-f8cf-40a0-a326-836a5ea4c495", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-887666255-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "37b89c13ba1d4a94805d6af69ad26fb8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap50079e9e-67", "ovs_interfaceid": "50079e9e-673c-4a5a-8f32-56d794575fdf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74613) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 29 18:05:48 user nova-compute[74613]: DEBUG nova.network.os_vif_util [None req-16f57d8c-725c-4db8-bc77-437fe5a00e4d tempest-AttachVolumeNegativeTest-483083654 tempest-AttachVolumeNegativeTest-483083654-project-member] Converting VIF {"id": "50079e9e-673c-4a5a-8f32-56d794575fdf", "address": "fa:16:3e:3f:6e:41", "network": {"id": "c317481b-f8cf-40a0-a326-836a5ea4c495", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-887666255-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "37b89c13ba1d4a94805d6af69ad26fb8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap50079e9e-67", "ovs_interfaceid": "50079e9e-673c-4a5a-8f32-56d794575fdf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74613) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 18:05:48 user nova-compute[74613]: DEBUG nova.network.os_vif_util [None req-16f57d8c-725c-4db8-bc77-437fe5a00e4d tempest-AttachVolumeNegativeTest-483083654 tempest-AttachVolumeNegativeTest-483083654-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3f:6e:41,bridge_name='br-int',has_traffic_filtering=True,id=50079e9e-673c-4a5a-8f32-56d794575fdf,network=Network(c317481b-f8cf-40a0-a326-836a5ea4c495),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap50079e9e-67') {{(pid=74613) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 18:05:48 user nova-compute[74613]: DEBUG nova.objects.instance [None req-16f57d8c-725c-4db8-bc77-437fe5a00e4d tempest-AttachVolumeNegativeTest-483083654 tempest-AttachVolumeNegativeTest-483083654-project-member] Lazy-loading 'pci_devices' on Instance uuid e2439d62-4713-435d-81ce-fafe1d811b47 {{(pid=74613) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 18:05:48 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-16f57d8c-725c-4db8-bc77-437fe5a00e4d tempest-AttachVolumeNegativeTest-483083654 tempest-AttachVolumeNegativeTest-483083654-project-member] [instance: e2439d62-4713-435d-81ce-fafe1d811b47] End _get_guest_xml xml=<domain type="kvm">
Nov 29 18:05:48 user nova-compute[74613]:   <uuid>e2439d62-4713-435d-81ce-fafe1d811b47</uuid>
Nov 29 18:05:48 user nova-compute[74613]:   <name>instance-00000020</name>
Nov 29 18:05:48 user nova-compute[74613]:   <memory>524288</memory>
Nov 29 18:05:48 user nova-compute[74613]:   <vcpu>1</vcpu>
Nov 29 18:05:48 user nova-compute[74613]:   <metadata>
Nov 29 18:05:48 user nova-compute[74613]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 29 18:05:48 user nova-compute[74613]:       <nova:package version="0.0.0"/>
Nov 29 18:05:48 user nova-compute[74613]:       <nova:name>tempest-AttachVolumeNegativeTest-server-1674587994</nova:name>
Nov 29 18:05:48 user nova-compute[74613]:       <nova:creationTime>2023-11-29 18:05:48</nova:creationTime>
Nov 29 18:05:48 user nova-compute[74613]:       <nova:flavor name="m1.tiny">
Nov 29 18:05:48 user nova-compute[74613]:         <nova:memory>512</nova:memory>
Nov 29 18:05:48 user nova-compute[74613]:         <nova:disk>1</nova:disk>
Nov 29 18:05:48 user nova-compute[74613]:         <nova:swap>0</nova:swap>
Nov 29 18:05:48 user nova-compute[74613]:         <nova:ephemeral>0</nova:ephemeral>
Nov 29 18:05:48 user nova-compute[74613]:         <nova:vcpus>1</nova:vcpus>
Nov 29 18:05:48 user nova-compute[74613]:       </nova:flavor>
Nov 29 18:05:48 user nova-compute[74613]:       <nova:owner>
Nov 29 18:05:48 user nova-compute[74613]:         <nova:user uuid="57b1f3743f0e4cbdae1dab9e4761511e">tempest-AttachVolumeNegativeTest-483083654-project-member</nova:user>
Nov 29 18:05:48 user nova-compute[74613]:         <nova:project uuid="37b89c13ba1d4a94805d6af69ad26fb8">tempest-AttachVolumeNegativeTest-483083654</nova:project>
Nov 29 18:05:48 user nova-compute[74613]:       </nova:owner>
Nov 29 18:05:48 user nova-compute[74613]:       <nova:root type="image" uuid="4217f428-8d9d-4ee1-9614-642d26d90c46"/>
Nov 29 18:05:48 user nova-compute[74613]:       <nova:ports>
Nov 29 18:05:48 user nova-compute[74613]:         <nova:port uuid="50079e9e-673c-4a5a-8f32-56d794575fdf">
Nov 29 18:05:48 user nova-compute[74613]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Nov 29 18:05:48 user nova-compute[74613]:         </nova:port>
Nov 29 18:05:48 user nova-compute[74613]:       </nova:ports>
Nov 29 18:05:48 user nova-compute[74613]:     </nova:instance>
Nov 29 18:05:48 user nova-compute[74613]:   </metadata>
Nov 29 18:05:48 user nova-compute[74613]:   <sysinfo type="smbios">
Nov 29 18:05:48 user nova-compute[74613]:     <system>
Nov 29 18:05:48 user nova-compute[74613]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 29 18:05:48 user nova-compute[74613]:       <entry name="product">OpenStack Nova</entry>
Nov 29 18:05:48 user nova-compute[74613]:       <entry name="version">0.0.0</entry>
Nov 29 18:05:48 user nova-compute[74613]:       <entry name="serial">e2439d62-4713-435d-81ce-fafe1d811b47</entry>
Nov 29 18:05:48 user nova-compute[74613]:       <entry name="uuid">e2439d62-4713-435d-81ce-fafe1d811b47</entry>
Nov 29 18:05:48 user nova-compute[74613]:       <entry name="family">Virtual Machine</entry>
Nov 29 18:05:48 user nova-compute[74613]:     </system>
Nov 29 18:05:48 user nova-compute[74613]:   </sysinfo>
Nov 29 18:05:48 user nova-compute[74613]:   <os>
Nov 29 18:05:48 user nova-compute[74613]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 29 18:05:48 user nova-compute[74613]:     <boot dev="hd"/>
Nov 29 18:05:48 user nova-compute[74613]:     <smbios mode="sysinfo"/>
Nov 29 18:05:48 user nova-compute[74613]:   </os>
Nov 29 18:05:48 user nova-compute[74613]:   <features>
Nov 29 18:05:48 user nova-compute[74613]:     <acpi/>
Nov 29 18:05:48 user nova-compute[74613]:     <apic/>
Nov 29 18:05:48 user nova-compute[74613]:     <vmcoreinfo/>
Nov 29 18:05:48 user nova-compute[74613]:   </features>
Nov 29 18:05:48 user nova-compute[74613]:   <clock offset="utc">
Nov 29 18:05:48 user nova-compute[74613]:     <timer name="pit" tickpolicy="delay"/>
Nov 29 18:05:48 user nova-compute[74613]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 29 18:05:48 user nova-compute[74613]:     <timer name="hpet" present="no"/>
Nov 29 18:05:48 user nova-compute[74613]:   </clock>
Nov 29 18:05:48 user nova-compute[74613]:   <cpu mode="custom" match="exact">
Nov 29 18:05:48 user nova-compute[74613]:     <model>Nehalem</model>
Nov 29 18:05:48 user nova-compute[74613]:     <topology sockets="1" cores="1" threads="1"/>
Nov 29 18:05:48 user nova-compute[74613]:   </cpu>
Nov 29 18:05:48 user nova-compute[74613]:   <devices>
Nov 29 18:05:48 user nova-compute[74613]:     <disk type="file" device="disk">
Nov 29 18:05:48 user nova-compute[74613]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 29 18:05:48 user nova-compute[74613]:       <source file="/opt/stack/data/nova/instances/e2439d62-4713-435d-81ce-fafe1d811b47/disk"/>
Nov 29 18:05:48 user nova-compute[74613]:       <target dev="vda" bus="virtio"/>
Nov 29 18:05:48 user nova-compute[74613]:     </disk>
Nov 29 18:05:48 user nova-compute[74613]:     <interface type="ethernet">
Nov 29 18:05:48 user nova-compute[74613]:       <mac address="fa:16:3e:3f:6e:41"/>
Nov 29 18:05:48 user nova-compute[74613]:       <model type="virtio"/>
Nov 29 18:05:48 user nova-compute[74613]:       <mtu size="1442"/>
Nov 29 18:05:48 user nova-compute[74613]:       <target dev="tap50079e9e-67"/>
Nov 29 18:05:48 user nova-compute[74613]:     </interface>
Nov 29 18:05:48 user nova-compute[74613]:     <serial type="pty">
Nov 29 18:05:48 user nova-compute[74613]:       <log file="/opt/stack/data/nova/instances/e2439d62-4713-435d-81ce-fafe1d811b47/console.log" append="off"/>
Nov 29 18:05:48 user nova-compute[74613]:     </serial>
Nov 29 18:05:48 user nova-compute[74613]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 29 18:05:48 user nova-compute[74613]:     <video>
Nov 29 18:05:48 user nova-compute[74613]:       <model type="virtio"/>
Nov 29 18:05:48 user nova-compute[74613]:     </video>
Nov 29 18:05:48 user nova-compute[74613]:     <rng model="virtio">
Nov 29 18:05:48 user nova-compute[74613]:       <backend model="random">/dev/urandom</backend>
Nov 29 18:05:48 user nova-compute[74613]:     </rng>
Nov 29 18:05:48 user nova-compute[74613]:     <controller type="usb" index="0" model="none"/>
Nov 29 18:05:48 user nova-compute[74613]:     <memballoon model="virtio">
Nov 29 18:05:48 user nova-compute[74613]:       <stats period="10"/>
Nov 29 18:05:48 user nova-compute[74613]:     </memballoon>
Nov 29 18:05:48 user nova-compute[74613]:   </devices>
Nov 29 18:05:48 user nova-compute[74613]: </domain>
Nov 29 18:05:48 user nova-compute[74613]:  {{(pid=74613) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 29 18:05:48 user nova-compute[74613]: DEBUG nova.virt.libvirt.vif [None req-16f57d8c-725c-4db8-bc77-437fe5a00e4d tempest-AttachVolumeNegativeTest-483083654 tempest-AttachVolumeNegativeTest-483083654-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T18:05:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1674587994',display_name='tempest-AttachVolumeNegativeTest-server-1674587994',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1674587994',id=32,image_ref='4217f428-8d9d-4ee1-9614-642d26d90c46',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEJCnVTtu90vbCZ4BJfB03c2taMPAMz98qBh9crTNw/3mZqoRZ6KzdyK25aoXZmFo1QEHsaZ1oarwR2VWhszyNqSHeHQUmAsomD9ZROfZT2nXQOa+G3ETkmHvZoV+HeGqQ==',key_name='tempest-keypair-18440938',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='37b89c13ba1d4a94805d6af69ad26fb8',ramdisk_id='',reservation_id='r-0igai5r4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='4217f428-8d9d-4ee1-9614-642d26d90c46',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-483083654',owner_user_name='tempest-AttachVolumeNegativeTest-483083654-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T18:05:46Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='57b1f3743f0e4cbdae1dab9e4761511e',uuid=e2439d62-4713-435d-81ce-fafe1d811b47,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "50079e9e-673c-4a5a-8f32-56d794575fdf", "address": "fa:16:3e:3f:6e:41", "network": {"id": "c317481b-f8cf-40a0-a326-836a5ea4c495", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-887666255-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "37b89c13ba1d4a94805d6af69ad26fb8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap50079e9e-67", "ovs_interfaceid": "50079e9e-673c-4a5a-8f32-56d794575fdf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74613) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 29 18:05:48 user nova-compute[74613]: DEBUG nova.network.os_vif_util [None req-16f57d8c-725c-4db8-bc77-437fe5a00e4d tempest-AttachVolumeNegativeTest-483083654 tempest-AttachVolumeNegativeTest-483083654-project-member] Converting VIF {"id": "50079e9e-673c-4a5a-8f32-56d794575fdf", "address": "fa:16:3e:3f:6e:41", "network": {"id": "c317481b-f8cf-40a0-a326-836a5ea4c495", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-887666255-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "37b89c13ba1d4a94805d6af69ad26fb8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap50079e9e-67", "ovs_interfaceid": "50079e9e-673c-4a5a-8f32-56d794575fdf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74613) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 18:05:48 user nova-compute[74613]: DEBUG nova.network.os_vif_util [None req-16f57d8c-725c-4db8-bc77-437fe5a00e4d tempest-AttachVolumeNegativeTest-483083654 tempest-AttachVolumeNegativeTest-483083654-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3f:6e:41,bridge_name='br-int',has_traffic_filtering=True,id=50079e9e-673c-4a5a-8f32-56d794575fdf,network=Network(c317481b-f8cf-40a0-a326-836a5ea4c495),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap50079e9e-67') {{(pid=74613) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 18:05:48 user nova-compute[74613]: DEBUG os_vif [None req-16f57d8c-725c-4db8-bc77-437fe5a00e4d tempest-AttachVolumeNegativeTest-483083654 tempest-AttachVolumeNegativeTest-483083654-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:3f:6e:41,bridge_name='br-int',has_traffic_filtering=True,id=50079e9e-673c-4a5a-8f32-56d794575fdf,network=Network(c317481b-f8cf-40a0-a326-836a5ea4c495),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap50079e9e-67') {{(pid=74613) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 29 18:05:48 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:05:48 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74613) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 18:05:48 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74613) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 29 18:05:48 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:05:48 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '39263a65-a244-5d81-8301-91ec31766103', '_type': 'linux-noop'}}, row=False) {{(pid=74613) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 18:05:48 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:05:48 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 18:05:48 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:05:48 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:05:48 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap50079e9e-67, may_exist=True, interface_attrs={}) {{(pid=74613) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 18:05:48 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap50079e9e-67, col_values=(('qos', UUID('8089dff2-26c6-4800-991e-6fc9c9de4a24')),), if_exists=True) {{(pid=74613) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 18:05:48 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap50079e9e-67, col_values=(('external_ids', {'iface-id': '50079e9e-673c-4a5a-8f32-56d794575fdf', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:3f:6e:41', 'vm-uuid': 'e2439d62-4713-435d-81ce-fafe1d811b47'}),), if_exists=True) {{(pid=74613) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 18:05:48 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:05:48 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 18:05:48 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:05:48 user nova-compute[74613]: INFO os_vif [None req-16f57d8c-725c-4db8-bc77-437fe5a00e4d tempest-AttachVolumeNegativeTest-483083654 tempest-AttachVolumeNegativeTest-483083654-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:3f:6e:41,bridge_name='br-int',has_traffic_filtering=True,id=50079e9e-673c-4a5a-8f32-56d794575fdf,network=Network(c317481b-f8cf-40a0-a326-836a5ea4c495),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap50079e9e-67')
Nov 29 18:05:48 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-16f57d8c-725c-4db8-bc77-437fe5a00e4d tempest-AttachVolumeNegativeTest-483083654 tempest-AttachVolumeNegativeTest-483083654-project-member] No BDM found with device name vda, not building metadata. {{(pid=74613) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 18:05:48 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-16f57d8c-725c-4db8-bc77-437fe5a00e4d tempest-AttachVolumeNegativeTest-483083654 tempest-AttachVolumeNegativeTest-483083654-project-member] No VIF found with MAC fa:16:3e:3f:6e:41, not building metadata {{(pid=74613) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 29 18:05:48 user nova-compute[74613]: DEBUG nova.network.neutron [req-8cdf1e96-8e04-45b8-b127-a560501aa6c1 req-4c0a31e2-c086-4f26-bb3f-867a5a5c982d service nova] [instance: e2439d62-4713-435d-81ce-fafe1d811b47] Updated VIF entry in instance network info cache for port 50079e9e-673c-4a5a-8f32-56d794575fdf. {{(pid=74613) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 18:05:48 user nova-compute[74613]: DEBUG nova.network.neutron [req-8cdf1e96-8e04-45b8-b127-a560501aa6c1 req-4c0a31e2-c086-4f26-bb3f-867a5a5c982d service nova] [instance: e2439d62-4713-435d-81ce-fafe1d811b47] Updating instance_info_cache with network_info: [{"id": "50079e9e-673c-4a5a-8f32-56d794575fdf", "address": "fa:16:3e:3f:6e:41", "network": {"id": "c317481b-f8cf-40a0-a326-836a5ea4c495", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-887666255-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "37b89c13ba1d4a94805d6af69ad26fb8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap50079e9e-67", "ovs_interfaceid": "50079e9e-673c-4a5a-8f32-56d794575fdf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74613) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 18:05:48 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-8cdf1e96-8e04-45b8-b127-a560501aa6c1 req-4c0a31e2-c086-4f26-bb3f-867a5a5c982d service nova] Releasing lock "refresh_cache-e2439d62-4713-435d-81ce-fafe1d811b47" {{(pid=74613) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 18:05:48 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:05:48 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:05:48 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:05:48 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:05:49 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:05:49 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:05:49 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:05:49 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:05:49 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:05:49 user nova-compute[74613]: DEBUG nova.compute.manager [req-a8ac8955-1d17-4d8d-9e7c-db40b2ae6d76 req-fa202f16-080e-4b74-8f74-26dce5e9a9cd service nova] [instance: 56de3dd1-6873-4c0a-9d80-58518dfd671e] Received event network-vif-deleted-4e39483b-3a24-4948-8025-ab381a1a6eee {{(pid=74613) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 18:05:50 user nova-compute[74613]: DEBUG nova.compute.manager [req-f390089c-912f-4962-a747-f57bee7fadec req-22d4d676-3bfe-4a57-8325-1d1c23be67c1 service nova] [instance: 56de3dd1-6873-4c0a-9d80-58518dfd671e] Received event network-vif-plugged-4e39483b-3a24-4948-8025-ab381a1a6eee {{(pid=74613) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 18:05:50 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-f390089c-912f-4962-a747-f57bee7fadec req-22d4d676-3bfe-4a57-8325-1d1c23be67c1 service nova] Acquiring lock "56de3dd1-6873-4c0a-9d80-58518dfd671e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 18:05:50 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-f390089c-912f-4962-a747-f57bee7fadec req-22d4d676-3bfe-4a57-8325-1d1c23be67c1 service nova] Lock "56de3dd1-6873-4c0a-9d80-58518dfd671e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 18:05:50 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-f390089c-912f-4962-a747-f57bee7fadec req-22d4d676-3bfe-4a57-8325-1d1c23be67c1 service nova] Lock "56de3dd1-6873-4c0a-9d80-58518dfd671e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 18:05:50 user nova-compute[74613]: DEBUG nova.compute.manager [req-f390089c-912f-4962-a747-f57bee7fadec req-22d4d676-3bfe-4a57-8325-1d1c23be67c1 service nova] [instance: 56de3dd1-6873-4c0a-9d80-58518dfd671e] No waiting events found dispatching network-vif-plugged-4e39483b-3a24-4948-8025-ab381a1a6eee {{(pid=74613) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 18:05:50 user nova-compute[74613]: WARNING nova.compute.manager [req-f390089c-912f-4962-a747-f57bee7fadec req-22d4d676-3bfe-4a57-8325-1d1c23be67c1 service nova] [instance: 56de3dd1-6873-4c0a-9d80-58518dfd671e] Received unexpected event network-vif-plugged-4e39483b-3a24-4948-8025-ab381a1a6eee for instance with vm_state active and task_state deleting.
Nov 29 18:05:50 user nova-compute[74613]: DEBUG nova.compute.manager [req-f390089c-912f-4962-a747-f57bee7fadec req-22d4d676-3bfe-4a57-8325-1d1c23be67c1 service nova] [instance: 69109f06-acbf-4834-b05e-80ab6e3f6ea0] Received event network-vif-plugged-e8b2f9b5-0c3a-4f6f-bf96-566c8a779849 {{(pid=74613) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 18:05:50 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-f390089c-912f-4962-a747-f57bee7fadec req-22d4d676-3bfe-4a57-8325-1d1c23be67c1 service nova] Acquiring lock "69109f06-acbf-4834-b05e-80ab6e3f6ea0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 18:05:50 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-f390089c-912f-4962-a747-f57bee7fadec req-22d4d676-3bfe-4a57-8325-1d1c23be67c1 service nova] Lock "69109f06-acbf-4834-b05e-80ab6e3f6ea0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 18:05:50 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-f390089c-912f-4962-a747-f57bee7fadec req-22d4d676-3bfe-4a57-8325-1d1c23be67c1 service nova] Lock "69109f06-acbf-4834-b05e-80ab6e3f6ea0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 18:05:50 user nova-compute[74613]: DEBUG nova.compute.manager [req-f390089c-912f-4962-a747-f57bee7fadec req-22d4d676-3bfe-4a57-8325-1d1c23be67c1 service nova] [instance: 69109f06-acbf-4834-b05e-80ab6e3f6ea0] No waiting events found dispatching network-vif-plugged-e8b2f9b5-0c3a-4f6f-bf96-566c8a779849 {{(pid=74613) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 18:05:50 user nova-compute[74613]: WARNING nova.compute.manager [req-f390089c-912f-4962-a747-f57bee7fadec req-22d4d676-3bfe-4a57-8325-1d1c23be67c1 service nova] [instance: 69109f06-acbf-4834-b05e-80ab6e3f6ea0] Received unexpected event network-vif-plugged-e8b2f9b5-0c3a-4f6f-bf96-566c8a779849 for instance with vm_state building and task_state spawning.
Nov 29 18:05:50 user nova-compute[74613]: DEBUG nova.compute.manager [req-f390089c-912f-4962-a747-f57bee7fadec req-22d4d676-3bfe-4a57-8325-1d1c23be67c1 service nova] [instance: 69109f06-acbf-4834-b05e-80ab6e3f6ea0] Received event network-vif-plugged-e8b2f9b5-0c3a-4f6f-bf96-566c8a779849 {{(pid=74613) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 18:05:50 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-f390089c-912f-4962-a747-f57bee7fadec req-22d4d676-3bfe-4a57-8325-1d1c23be67c1 service nova] Acquiring lock "69109f06-acbf-4834-b05e-80ab6e3f6ea0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 18:05:50 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-f390089c-912f-4962-a747-f57bee7fadec req-22d4d676-3bfe-4a57-8325-1d1c23be67c1 service nova] Lock "69109f06-acbf-4834-b05e-80ab6e3f6ea0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 18:05:50 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-f390089c-912f-4962-a747-f57bee7fadec req-22d4d676-3bfe-4a57-8325-1d1c23be67c1 service nova] Lock "69109f06-acbf-4834-b05e-80ab6e3f6ea0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 18:05:50 user nova-compute[74613]: DEBUG nova.compute.manager [req-f390089c-912f-4962-a747-f57bee7fadec req-22d4d676-3bfe-4a57-8325-1d1c23be67c1 service nova] [instance: 69109f06-acbf-4834-b05e-80ab6e3f6ea0] No waiting events found dispatching network-vif-plugged-e8b2f9b5-0c3a-4f6f-bf96-566c8a779849 {{(pid=74613) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 18:05:50 user nova-compute[74613]: WARNING nova.compute.manager [req-f390089c-912f-4962-a747-f57bee7fadec req-22d4d676-3bfe-4a57-8325-1d1c23be67c1 service nova] [instance: 69109f06-acbf-4834-b05e-80ab6e3f6ea0] Received unexpected event network-vif-plugged-e8b2f9b5-0c3a-4f6f-bf96-566c8a779849 for instance with vm_state building and task_state spawning.
Nov 29 18:05:50 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:05:50 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:05:50 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:05:50 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:05:50 user nova-compute[74613]: INFO nova.compute.manager [None req-808081ba-0103-442f-bfae-00dde122d205 tempest-TaggedBootDevicesTest-477858861 tempest-TaggedBootDevicesTest-477858861-project-member] [instance: 56de3dd1-6873-4c0a-9d80-58518dfd671e] Took 2.91 seconds to detach 3 volumes for instance.
Nov 29 18:05:50 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-808081ba-0103-442f-bfae-00dde122d205 tempest-TaggedBootDevicesTest-477858861 tempest-TaggedBootDevicesTest-477858861-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 18:05:50 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-808081ba-0103-442f-bfae-00dde122d205 tempest-TaggedBootDevicesTest-477858861 tempest-TaggedBootDevicesTest-477858861-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.002s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 18:05:50 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:05:50 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:05:50 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:05:50 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:05:51 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:05:51 user nova-compute[74613]: DEBUG nova.compute.provider_tree [None req-808081ba-0103-442f-bfae-00dde122d205 tempest-TaggedBootDevicesTest-477858861 tempest-TaggedBootDevicesTest-477858861-project-member] Inventory has not changed in ProviderTree for provider: 639d980e-3b12-44b1-b8f4-1812416fa4dd {{(pid=74613) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 18:05:51 user nova-compute[74613]: DEBUG nova.scheduler.client.report [None req-808081ba-0103-442f-bfae-00dde122d205 tempest-TaggedBootDevicesTest-477858861 tempest-TaggedBootDevicesTest-477858861-project-member] Inventory has not changed for provider 639d980e-3b12-44b1-b8f4-1812416fa4dd based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74613) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 18:05:51 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-808081ba-0103-442f-bfae-00dde122d205 tempest-TaggedBootDevicesTest-477858861 tempest-TaggedBootDevicesTest-477858861-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.607s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 18:05:51 user nova-compute[74613]: INFO nova.scheduler.client.report [None req-808081ba-0103-442f-bfae-00dde122d205 tempest-TaggedBootDevicesTest-477858861 tempest-TaggedBootDevicesTest-477858861-project-member] Deleted allocations for instance 56de3dd1-6873-4c0a-9d80-58518dfd671e
Nov 29 18:05:51 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-808081ba-0103-442f-bfae-00dde122d205 tempest-TaggedBootDevicesTest-477858861 tempest-TaggedBootDevicesTest-477858861-project-member] Lock "56de3dd1-6873-4c0a-9d80-58518dfd671e" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 12.716s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 18:05:52 user nova-compute[74613]: DEBUG nova.compute.manager [req-aefff938-65d9-4381-9775-2307a2a1bcbc req-91681a19-df6d-4077-b31d-bed6a9d43a26 service nova] [instance: e2439d62-4713-435d-81ce-fafe1d811b47] Received event network-vif-plugged-50079e9e-673c-4a5a-8f32-56d794575fdf {{(pid=74613) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 18:05:52 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-aefff938-65d9-4381-9775-2307a2a1bcbc req-91681a19-df6d-4077-b31d-bed6a9d43a26 service nova] Acquiring lock "e2439d62-4713-435d-81ce-fafe1d811b47-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 18:05:52 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-aefff938-65d9-4381-9775-2307a2a1bcbc req-91681a19-df6d-4077-b31d-bed6a9d43a26 service nova] Lock "e2439d62-4713-435d-81ce-fafe1d811b47-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 18:05:52 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-aefff938-65d9-4381-9775-2307a2a1bcbc req-91681a19-df6d-4077-b31d-bed6a9d43a26 service nova] Lock "e2439d62-4713-435d-81ce-fafe1d811b47-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 18:05:52 user nova-compute[74613]: DEBUG nova.compute.manager [req-aefff938-65d9-4381-9775-2307a2a1bcbc req-91681a19-df6d-4077-b31d-bed6a9d43a26 service nova] [instance: e2439d62-4713-435d-81ce-fafe1d811b47] No waiting events found dispatching network-vif-plugged-50079e9e-673c-4a5a-8f32-56d794575fdf {{(pid=74613) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 18:05:52 user nova-compute[74613]: WARNING nova.compute.manager [req-aefff938-65d9-4381-9775-2307a2a1bcbc req-91681a19-df6d-4077-b31d-bed6a9d43a26 service nova] [instance: e2439d62-4713-435d-81ce-fafe1d811b47] Received unexpected event network-vif-plugged-50079e9e-673c-4a5a-8f32-56d794575fdf for instance with vm_state building and task_state spawning.
Nov 29 18:05:52 user nova-compute[74613]: DEBUG nova.compute.manager [req-aefff938-65d9-4381-9775-2307a2a1bcbc req-91681a19-df6d-4077-b31d-bed6a9d43a26 service nova] [instance: e2439d62-4713-435d-81ce-fafe1d811b47] Received event network-vif-plugged-50079e9e-673c-4a5a-8f32-56d794575fdf {{(pid=74613) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 18:05:52 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-aefff938-65d9-4381-9775-2307a2a1bcbc req-91681a19-df6d-4077-b31d-bed6a9d43a26 service nova] Acquiring lock "e2439d62-4713-435d-81ce-fafe1d811b47-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 18:05:52 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-aefff938-65d9-4381-9775-2307a2a1bcbc req-91681a19-df6d-4077-b31d-bed6a9d43a26 service nova] Lock "e2439d62-4713-435d-81ce-fafe1d811b47-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 18:05:52 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-aefff938-65d9-4381-9775-2307a2a1bcbc req-91681a19-df6d-4077-b31d-bed6a9d43a26 service nova] Lock "e2439d62-4713-435d-81ce-fafe1d811b47-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 18:05:52 user nova-compute[74613]: DEBUG nova.compute.manager [req-aefff938-65d9-4381-9775-2307a2a1bcbc req-91681a19-df6d-4077-b31d-bed6a9d43a26 service nova] [instance: e2439d62-4713-435d-81ce-fafe1d811b47] No waiting events found dispatching network-vif-plugged-50079e9e-673c-4a5a-8f32-56d794575fdf {{(pid=74613) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 18:05:52 user nova-compute[74613]: WARNING nova.compute.manager [req-aefff938-65d9-4381-9775-2307a2a1bcbc req-91681a19-df6d-4077-b31d-bed6a9d43a26 service nova] [instance: e2439d62-4713-435d-81ce-fafe1d811b47] Received unexpected event network-vif-plugged-50079e9e-673c-4a5a-8f32-56d794575fdf for instance with vm_state building and task_state spawning.
Nov 29 18:05:52 user nova-compute[74613]: DEBUG nova.compute.manager [None req-a8ed7b97-89a5-49b7-94ff-b43cb519ed92 tempest-AttachVolumeTestJSON-813984703 tempest-AttachVolumeTestJSON-813984703-project-member] [instance: 69109f06-acbf-4834-b05e-80ab6e3f6ea0] Instance event wait completed in 0 seconds for  {{(pid=74613) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 29 18:05:52 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-a8ed7b97-89a5-49b7-94ff-b43cb519ed92 tempest-AttachVolumeTestJSON-813984703 tempest-AttachVolumeTestJSON-813984703-project-member] [instance: 69109f06-acbf-4834-b05e-80ab6e3f6ea0] Guest created on hypervisor {{(pid=74613) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 29 18:05:52 user nova-compute[74613]: INFO nova.virt.libvirt.driver [-] [instance: 69109f06-acbf-4834-b05e-80ab6e3f6ea0] Instance spawned successfully.
Nov 29 18:05:52 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-a8ed7b97-89a5-49b7-94ff-b43cb519ed92 tempest-AttachVolumeTestJSON-813984703 tempest-AttachVolumeTestJSON-813984703-project-member] [instance: 69109f06-acbf-4834-b05e-80ab6e3f6ea0] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74613) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 29 18:05:52 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-a8ed7b97-89a5-49b7-94ff-b43cb519ed92 tempest-AttachVolumeTestJSON-813984703 tempest-AttachVolumeTestJSON-813984703-project-member] [instance: 69109f06-acbf-4834-b05e-80ab6e3f6ea0] Found default for hw_cdrom_bus of ide {{(pid=74613) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 18:05:52 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-a8ed7b97-89a5-49b7-94ff-b43cb519ed92 tempest-AttachVolumeTestJSON-813984703 tempest-AttachVolumeTestJSON-813984703-project-member] [instance: 69109f06-acbf-4834-b05e-80ab6e3f6ea0] Found default for hw_disk_bus of virtio {{(pid=74613) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 18:05:52 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-a8ed7b97-89a5-49b7-94ff-b43cb519ed92 tempest-AttachVolumeTestJSON-813984703 tempest-AttachVolumeTestJSON-813984703-project-member] [instance: 69109f06-acbf-4834-b05e-80ab6e3f6ea0] Found default for hw_input_bus of None {{(pid=74613) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 18:05:52 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-a8ed7b97-89a5-49b7-94ff-b43cb519ed92 tempest-AttachVolumeTestJSON-813984703 tempest-AttachVolumeTestJSON-813984703-project-member] [instance: 69109f06-acbf-4834-b05e-80ab6e3f6ea0] Found default for hw_pointer_model of None {{(pid=74613) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 18:05:52 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-a8ed7b97-89a5-49b7-94ff-b43cb519ed92 tempest-AttachVolumeTestJSON-813984703 tempest-AttachVolumeTestJSON-813984703-project-member] [instance: 69109f06-acbf-4834-b05e-80ab6e3f6ea0] Found default for hw_video_model of virtio {{(pid=74613) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 18:05:52 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-a8ed7b97-89a5-49b7-94ff-b43cb519ed92 tempest-AttachVolumeTestJSON-813984703 tempest-AttachVolumeTestJSON-813984703-project-member] [instance: 69109f06-acbf-4834-b05e-80ab6e3f6ea0] Found default for hw_vif_model of virtio {{(pid=74613) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 18:05:52 user nova-compute[74613]: INFO nova.compute.manager [None req-a8ed7b97-89a5-49b7-94ff-b43cb519ed92 tempest-AttachVolumeTestJSON-813984703 tempest-AttachVolumeTestJSON-813984703-project-member] [instance: 69109f06-acbf-4834-b05e-80ab6e3f6ea0] Took 7.13 seconds to spawn the instance on the hypervisor.
Nov 29 18:05:52 user nova-compute[74613]: DEBUG nova.compute.manager [None req-a8ed7b97-89a5-49b7-94ff-b43cb519ed92 tempest-AttachVolumeTestJSON-813984703 tempest-AttachVolumeTestJSON-813984703-project-member] [instance: 69109f06-acbf-4834-b05e-80ab6e3f6ea0] Checking state {{(pid=74613) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 29 18:05:52 user nova-compute[74613]: INFO nova.compute.manager [None req-a8ed7b97-89a5-49b7-94ff-b43cb519ed92 tempest-AttachVolumeTestJSON-813984703 tempest-AttachVolumeTestJSON-813984703-project-member] [instance: 69109f06-acbf-4834-b05e-80ab6e3f6ea0] Took 8.09 seconds to build instance.
Nov 29 18:05:52 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-a8ed7b97-89a5-49b7-94ff-b43cb519ed92 tempest-AttachVolumeTestJSON-813984703 tempest-AttachVolumeTestJSON-813984703-project-member] Lock "69109f06-acbf-4834-b05e-80ab6e3f6ea0" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.209s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 18:05:52 user nova-compute[74613]: DEBUG nova.compute.manager [None req-16f57d8c-725c-4db8-bc77-437fe5a00e4d tempest-AttachVolumeNegativeTest-483083654 tempest-AttachVolumeNegativeTest-483083654-project-member] [instance: e2439d62-4713-435d-81ce-fafe1d811b47] Instance event wait completed in 0 seconds for  {{(pid=74613) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 29 18:05:52 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-16f57d8c-725c-4db8-bc77-437fe5a00e4d tempest-AttachVolumeNegativeTest-483083654 tempest-AttachVolumeNegativeTest-483083654-project-member] [instance: e2439d62-4713-435d-81ce-fafe1d811b47] Guest created on hypervisor {{(pid=74613) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 29 18:05:52 user nova-compute[74613]: INFO nova.virt.libvirt.driver [-] [instance: e2439d62-4713-435d-81ce-fafe1d811b47] Instance spawned successfully.
Nov 29 18:05:52 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-16f57d8c-725c-4db8-bc77-437fe5a00e4d tempest-AttachVolumeNegativeTest-483083654 tempest-AttachVolumeNegativeTest-483083654-project-member] [instance: e2439d62-4713-435d-81ce-fafe1d811b47] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74613) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 29 18:05:52 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-16f57d8c-725c-4db8-bc77-437fe5a00e4d tempest-AttachVolumeNegativeTest-483083654 tempest-AttachVolumeNegativeTest-483083654-project-member] [instance: e2439d62-4713-435d-81ce-fafe1d811b47] Found default for hw_cdrom_bus of ide {{(pid=74613) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 18:05:52 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-16f57d8c-725c-4db8-bc77-437fe5a00e4d tempest-AttachVolumeNegativeTest-483083654 tempest-AttachVolumeNegativeTest-483083654-project-member] [instance: e2439d62-4713-435d-81ce-fafe1d811b47] Found default for hw_disk_bus of virtio {{(pid=74613) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 18:05:52 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-16f57d8c-725c-4db8-bc77-437fe5a00e4d tempest-AttachVolumeNegativeTest-483083654 tempest-AttachVolumeNegativeTest-483083654-project-member] [instance: e2439d62-4713-435d-81ce-fafe1d811b47] Found default for hw_input_bus of None {{(pid=74613) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 18:05:52 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-16f57d8c-725c-4db8-bc77-437fe5a00e4d tempest-AttachVolumeNegativeTest-483083654 tempest-AttachVolumeNegativeTest-483083654-project-member] [instance: e2439d62-4713-435d-81ce-fafe1d811b47] Found default for hw_pointer_model of None {{(pid=74613) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 18:05:52 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-16f57d8c-725c-4db8-bc77-437fe5a00e4d tempest-AttachVolumeNegativeTest-483083654 tempest-AttachVolumeNegativeTest-483083654-project-member] [instance: e2439d62-4713-435d-81ce-fafe1d811b47] Found default for hw_video_model of virtio {{(pid=74613) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 18:05:52 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-16f57d8c-725c-4db8-bc77-437fe5a00e4d tempest-AttachVolumeNegativeTest-483083654 tempest-AttachVolumeNegativeTest-483083654-project-member] [instance: e2439d62-4713-435d-81ce-fafe1d811b47] Found default for hw_vif_model of virtio {{(pid=74613) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 18:05:52 user nova-compute[74613]: INFO nova.compute.manager [None req-16f57d8c-725c-4db8-bc77-437fe5a00e4d tempest-AttachVolumeNegativeTest-483083654 tempest-AttachVolumeNegativeTest-483083654-project-member] [instance: e2439d62-4713-435d-81ce-fafe1d811b47] Took 6.82 seconds to spawn the instance on the hypervisor.
Nov 29 18:05:52 user nova-compute[74613]: DEBUG nova.compute.manager [None req-16f57d8c-725c-4db8-bc77-437fe5a00e4d tempest-AttachVolumeNegativeTest-483083654 tempest-AttachVolumeNegativeTest-483083654-project-member] [instance: e2439d62-4713-435d-81ce-fafe1d811b47] Checking state {{(pid=74613) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 29 18:05:52 user nova-compute[74613]: INFO nova.compute.manager [None req-16f57d8c-725c-4db8-bc77-437fe5a00e4d tempest-AttachVolumeNegativeTest-483083654 tempest-AttachVolumeNegativeTest-483083654-project-member] [instance: e2439d62-4713-435d-81ce-fafe1d811b47] Took 8.18 seconds to build instance.
Nov 29 18:05:52 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-16f57d8c-725c-4db8-bc77-437fe5a00e4d tempest-AttachVolumeNegativeTest-483083654 tempest-AttachVolumeNegativeTest-483083654-project-member] Lock "e2439d62-4713-435d-81ce-fafe1d811b47" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.271s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 18:05:53 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:05:55 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:05:58 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:06:03 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:06:05 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:06:08 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:06:10 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:06:13 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:06:15 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:06:16 user nova-compute[74613]: INFO nova.compute.manager [None req-37365b65-a79e-4177-b2fe-318fe5b47453 tempest-ServerRescueNegativeTestJSON-1891426908 tempest-ServerRescueNegativeTestJSON-1891426908-project-member] [instance: 6f4a1329-b3b9-4d1c-8735-abddabc359fd] Rescuing
Nov 29 18:06:16 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-37365b65-a79e-4177-b2fe-318fe5b47453 tempest-ServerRescueNegativeTestJSON-1891426908 tempest-ServerRescueNegativeTestJSON-1891426908-project-member] Acquiring lock "refresh_cache-6f4a1329-b3b9-4d1c-8735-abddabc359fd" {{(pid=74613) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 18:06:16 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-37365b65-a79e-4177-b2fe-318fe5b47453 tempest-ServerRescueNegativeTestJSON-1891426908 tempest-ServerRescueNegativeTestJSON-1891426908-project-member] Acquired lock "refresh_cache-6f4a1329-b3b9-4d1c-8735-abddabc359fd" {{(pid=74613) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 18:06:16 user nova-compute[74613]: DEBUG nova.network.neutron [None req-37365b65-a79e-4177-b2fe-318fe5b47453 tempest-ServerRescueNegativeTestJSON-1891426908 tempest-ServerRescueNegativeTestJSON-1891426908-project-member] [instance: 6f4a1329-b3b9-4d1c-8735-abddabc359fd] Building network info cache for instance {{(pid=74613) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 29 18:06:17 user nova-compute[74613]: DEBUG nova.network.neutron [None req-37365b65-a79e-4177-b2fe-318fe5b47453 tempest-ServerRescueNegativeTestJSON-1891426908 tempest-ServerRescueNegativeTestJSON-1891426908-project-member] [instance: 6f4a1329-b3b9-4d1c-8735-abddabc359fd] Updating instance_info_cache with network_info: [{"id": "6d82a9a2-81f2-4d4b-846e-178413db6ecf", "address": "fa:16:3e:53:4e:1d", "network": {"id": "db79433c-b21c-4058-b98c-f62822abbf7a", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1715530752-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e6a3eb6ea0294f9da705dca72ec2789a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6d82a9a2-81", "ovs_interfaceid": "6d82a9a2-81f2-4d4b-846e-178413db6ecf", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74613) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 18:06:17 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-37365b65-a79e-4177-b2fe-318fe5b47453 tempest-ServerRescueNegativeTestJSON-1891426908 tempest-ServerRescueNegativeTestJSON-1891426908-project-member] Releasing lock "refresh_cache-6f4a1329-b3b9-4d1c-8735-abddabc359fd" {{(pid=74613) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 18:06:17 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:06:17 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:06:17 user nova-compute[74613]: DEBUG nova.compute.manager [req-a4e8ab39-4de3-4152-a670-924a60657093 req-a99f438a-74a6-41c6-bc20-01ea645c9542 service nova] [instance: 6f4a1329-b3b9-4d1c-8735-abddabc359fd] Received event network-vif-unplugged-6d82a9a2-81f2-4d4b-846e-178413db6ecf {{(pid=74613) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 18:06:17 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-a4e8ab39-4de3-4152-a670-924a60657093 req-a99f438a-74a6-41c6-bc20-01ea645c9542 service nova] Acquiring lock "6f4a1329-b3b9-4d1c-8735-abddabc359fd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 18:06:17 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-a4e8ab39-4de3-4152-a670-924a60657093 req-a99f438a-74a6-41c6-bc20-01ea645c9542 service nova] Lock "6f4a1329-b3b9-4d1c-8735-abddabc359fd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 18:06:17 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-a4e8ab39-4de3-4152-a670-924a60657093 req-a99f438a-74a6-41c6-bc20-01ea645c9542 service nova] Lock "6f4a1329-b3b9-4d1c-8735-abddabc359fd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 18:06:17 user nova-compute[74613]: DEBUG nova.compute.manager [req-a4e8ab39-4de3-4152-a670-924a60657093 req-a99f438a-74a6-41c6-bc20-01ea645c9542 service nova] [instance: 6f4a1329-b3b9-4d1c-8735-abddabc359fd] No waiting events found dispatching network-vif-unplugged-6d82a9a2-81f2-4d4b-846e-178413db6ecf {{(pid=74613) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 18:06:17 user nova-compute[74613]: WARNING nova.compute.manager [req-a4e8ab39-4de3-4152-a670-924a60657093 req-a99f438a-74a6-41c6-bc20-01ea645c9542 service nova] [instance: 6f4a1329-b3b9-4d1c-8735-abddabc359fd] Received unexpected event network-vif-unplugged-6d82a9a2-81f2-4d4b-846e-178413db6ecf for instance with vm_state active and task_state rescuing.
Nov 29 18:06:17 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:06:17 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:06:17 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:06:17 user nova-compute[74613]: INFO nova.virt.libvirt.driver [-] [instance: 6f4a1329-b3b9-4d1c-8735-abddabc359fd] Instance destroyed successfully.
Nov 29 18:06:17 user nova-compute[74613]: INFO nova.virt.libvirt.driver [None req-37365b65-a79e-4177-b2fe-318fe5b47453 tempest-ServerRescueNegativeTestJSON-1891426908 tempest-ServerRescueNegativeTestJSON-1891426908-project-member] [instance: 6f4a1329-b3b9-4d1c-8735-abddabc359fd] Attempting rescue
Nov 29 18:06:17 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-37365b65-a79e-4177-b2fe-318fe5b47453 tempest-ServerRescueNegativeTestJSON-1891426908 tempest-ServerRescueNegativeTestJSON-1891426908-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=74613) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4318}}
Nov 29 18:06:17 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-37365b65-a79e-4177-b2fe-318fe5b47453 tempest-ServerRescueNegativeTestJSON-1891426908 tempest-ServerRescueNegativeTestJSON-1891426908-project-member] [instance: 6f4a1329-b3b9-4d1c-8735-abddabc359fd] Instance directory exists: not creating {{(pid=74613) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Nov 29 18:06:17 user nova-compute[74613]: INFO nova.virt.libvirt.driver [None req-37365b65-a79e-4177-b2fe-318fe5b47453 tempest-ServerRescueNegativeTestJSON-1891426908 tempest-ServerRescueNegativeTestJSON-1891426908-project-member] [instance: 6f4a1329-b3b9-4d1c-8735-abddabc359fd] Creating image(s)
Nov 29 18:06:17 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-37365b65-a79e-4177-b2fe-318fe5b47453 tempest-ServerRescueNegativeTestJSON-1891426908 tempest-ServerRescueNegativeTestJSON-1891426908-project-member] Acquiring lock "/opt/stack/data/nova/instances/6f4a1329-b3b9-4d1c-8735-abddabc359fd/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 18:06:17 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-37365b65-a79e-4177-b2fe-318fe5b47453 tempest-ServerRescueNegativeTestJSON-1891426908 tempest-ServerRescueNegativeTestJSON-1891426908-project-member] Lock "/opt/stack/data/nova/instances/6f4a1329-b3b9-4d1c-8735-abddabc359fd/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 18:06:17 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-37365b65-a79e-4177-b2fe-318fe5b47453 tempest-ServerRescueNegativeTestJSON-1891426908 tempest-ServerRescueNegativeTestJSON-1891426908-project-member] Lock "/opt/stack/data/nova/instances/6f4a1329-b3b9-4d1c-8735-abddabc359fd/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 18:06:17 user nova-compute[74613]: DEBUG nova.objects.instance [None req-37365b65-a79e-4177-b2fe-318fe5b47453 tempest-ServerRescueNegativeTestJSON-1891426908 tempest-ServerRescueNegativeTestJSON-1891426908-project-member] Lazy-loading 'trusted_certs' on Instance uuid 6f4a1329-b3b9-4d1c-8735-abddabc359fd {{(pid=74613) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 18:06:17 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-37365b65-a79e-4177-b2fe-318fe5b47453 tempest-ServerRescueNegativeTestJSON-1891426908 tempest-ServerRescueNegativeTestJSON-1891426908-project-member] Acquiring lock "21faea9e6951f3bdd0153b76ac89fe1a60a34758" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 18:06:17 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-37365b65-a79e-4177-b2fe-318fe5b47453 tempest-ServerRescueNegativeTestJSON-1891426908 tempest-ServerRescueNegativeTestJSON-1891426908-project-member] Lock "21faea9e6951f3bdd0153b76ac89fe1a60a34758" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 18:06:17 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-37365b65-a79e-4177-b2fe-318fe5b47453 tempest-ServerRescueNegativeTestJSON-1891426908 tempest-ServerRescueNegativeTestJSON-1891426908-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/21faea9e6951f3bdd0153b76ac89fe1a60a34758 --force-share --output=json {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:06:18 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-37365b65-a79e-4177-b2fe-318fe5b47453 tempest-ServerRescueNegativeTestJSON-1891426908 tempest-ServerRescueNegativeTestJSON-1891426908-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/21faea9e6951f3bdd0153b76ac89fe1a60a34758 --force-share --output=json" returned: 0 in 0.187s {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:06:18 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-37365b65-a79e-4177-b2fe-318fe5b47453 tempest-ServerRescueNegativeTestJSON-1891426908 tempest-ServerRescueNegativeTestJSON-1891426908-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/21faea9e6951f3bdd0153b76ac89fe1a60a34758,backing_fmt=raw /opt/stack/data/nova/instances/6f4a1329-b3b9-4d1c-8735-abddabc359fd/disk.rescue {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:06:18 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-37365b65-a79e-4177-b2fe-318fe5b47453 tempest-ServerRescueNegativeTestJSON-1891426908 tempest-ServerRescueNegativeTestJSON-1891426908-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/21faea9e6951f3bdd0153b76ac89fe1a60a34758,backing_fmt=raw /opt/stack/data/nova/instances/6f4a1329-b3b9-4d1c-8735-abddabc359fd/disk.rescue" returned: 0 in 0.047s {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:06:18 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-37365b65-a79e-4177-b2fe-318fe5b47453 tempest-ServerRescueNegativeTestJSON-1891426908 tempest-ServerRescueNegativeTestJSON-1891426908-project-member] Lock "21faea9e6951f3bdd0153b76ac89fe1a60a34758" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.240s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 18:06:18 user nova-compute[74613]: DEBUG nova.objects.instance [None req-37365b65-a79e-4177-b2fe-318fe5b47453 tempest-ServerRescueNegativeTestJSON-1891426908 tempest-ServerRescueNegativeTestJSON-1891426908-project-member] Lazy-loading 'migration_context' on Instance uuid 6f4a1329-b3b9-4d1c-8735-abddabc359fd {{(pid=74613) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 18:06:18 user nova-compute[74613]: DEBUG nova.objects.base [None req-37365b65-a79e-4177-b2fe-318fe5b47453 tempest-ServerRescueNegativeTestJSON-1891426908 tempest-ServerRescueNegativeTestJSON-1891426908-project-member] Object Instance<6f4a1329-b3b9-4d1c-8735-abddabc359fd> lazy-loaded attributes: trusted_certs,migration_context {{(pid=74613) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 29 18:06:18 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-37365b65-a79e-4177-b2fe-318fe5b47453 tempest-ServerRescueNegativeTestJSON-1891426908 tempest-ServerRescueNegativeTestJSON-1891426908-project-member] [instance: 6f4a1329-b3b9-4d1c-8735-abddabc359fd] Created local disks {{(pid=74613) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 29 18:06:18 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-37365b65-a79e-4177-b2fe-318fe5b47453 tempest-ServerRescueNegativeTestJSON-1891426908 tempest-ServerRescueNegativeTestJSON-1891426908-project-member] [instance: 6f4a1329-b3b9-4d1c-8735-abddabc359fd] Start _get_guest_xml network_info=[{"id": "6d82a9a2-81f2-4d4b-846e-178413db6ecf", "address": "fa:16:3e:53:4e:1d", "network": {"id": "db79433c-b21c-4058-b98c-f62822abbf7a", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1715530752-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-1715530752-network", "vif_mac": "fa:16:3e:53:4e:1d"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e6a3eb6ea0294f9da705dca72ec2789a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6d82a9a2-81", "ovs_interfaceid": "6d82a9a2-81f2-4d4b-846e-178413db6ecf", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-29T17:47:38Z,direct_url=<?>,disk_format='qcow2',id=4217f428-8d9d-4ee1-9614-642d26d90c46,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='794b07cbd46a44b5865cfda741036bae',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-29T17:47:40Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': '4217f428-8d9d-4ee1-9614-642d26d90c46', 'kernel_id': '', 'ramdisk_id': ''} block_device_info=None {{(pid=74613) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 29 18:06:18 user nova-compute[74613]: DEBUG nova.objects.instance [None req-37365b65-a79e-4177-b2fe-318fe5b47453 tempest-ServerRescueNegativeTestJSON-1891426908 tempest-ServerRescueNegativeTestJSON-1891426908-project-member] Lazy-loading 'resources' on Instance uuid 6f4a1329-b3b9-4d1c-8735-abddabc359fd {{(pid=74613) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 18:06:18 user nova-compute[74613]: DEBUG nova.objects.base [None req-37365b65-a79e-4177-b2fe-318fe5b47453 tempest-ServerRescueNegativeTestJSON-1891426908 tempest-ServerRescueNegativeTestJSON-1891426908-project-member] Object Instance<6f4a1329-b3b9-4d1c-8735-abddabc359fd> lazy-loaded attributes: trusted_certs,migration_context,resources {{(pid=74613) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 29 18:06:18 user nova-compute[74613]: DEBUG nova.objects.instance [None req-37365b65-a79e-4177-b2fe-318fe5b47453 tempest-ServerRescueNegativeTestJSON-1891426908 tempest-ServerRescueNegativeTestJSON-1891426908-project-member] Lazy-loading 'numa_topology' on Instance uuid 6f4a1329-b3b9-4d1c-8735-abddabc359fd {{(pid=74613) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 18:06:18 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:06:18 user nova-compute[74613]: DEBUG nova.objects.base [None req-37365b65-a79e-4177-b2fe-318fe5b47453 tempest-ServerRescueNegativeTestJSON-1891426908 tempest-ServerRescueNegativeTestJSON-1891426908-project-member] Object Instance<6f4a1329-b3b9-4d1c-8735-abddabc359fd> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology {{(pid=74613) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 29 18:06:18 user nova-compute[74613]: WARNING nova.virt.libvirt.driver [None req-37365b65-a79e-4177-b2fe-318fe5b47453 tempest-ServerRescueNegativeTestJSON-1891426908 tempest-ServerRescueNegativeTestJSON-1891426908-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 18:06:18 user nova-compute[74613]: WARNING nova.virt.libvirt.driver [None req-37365b65-a79e-4177-b2fe-318fe5b47453 tempest-ServerRescueNegativeTestJSON-1891426908 tempest-ServerRescueNegativeTestJSON-1891426908-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 18:06:18 user nova-compute[74613]: DEBUG nova.virt.libvirt.host [None req-37365b65-a79e-4177-b2fe-318fe5b47453 tempest-ServerRescueNegativeTestJSON-1891426908 tempest-ServerRescueNegativeTestJSON-1891426908-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74613) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 29 18:06:18 user nova-compute[74613]: DEBUG nova.virt.libvirt.host [None req-37365b65-a79e-4177-b2fe-318fe5b47453 tempest-ServerRescueNegativeTestJSON-1891426908 tempest-ServerRescueNegativeTestJSON-1891426908-project-member] CPU controller missing on host. {{(pid=74613) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 29 18:06:18 user nova-compute[74613]: DEBUG nova.virt.libvirt.host [None req-37365b65-a79e-4177-b2fe-318fe5b47453 tempest-ServerRescueNegativeTestJSON-1891426908 tempest-ServerRescueNegativeTestJSON-1891426908-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74613) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 29 18:06:18 user nova-compute[74613]: DEBUG nova.virt.libvirt.host [None req-37365b65-a79e-4177-b2fe-318fe5b47453 tempest-ServerRescueNegativeTestJSON-1891426908 tempest-ServerRescueNegativeTestJSON-1891426908-project-member] CPU controller found on host. {{(pid=74613) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 29 18:06:18 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-37365b65-a79e-4177-b2fe-318fe5b47453 tempest-ServerRescueNegativeTestJSON-1891426908 tempest-ServerRescueNegativeTestJSON-1891426908-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74613) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 29 18:06:18 user nova-compute[74613]: DEBUG nova.virt.hardware [None req-37365b65-a79e-4177-b2fe-318fe5b47453 tempest-ServerRescueNegativeTestJSON-1891426908 tempest-ServerRescueNegativeTestJSON-1891426908-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-29T17:47:27Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-29T17:47:38Z,direct_url=<?>,disk_format='qcow2',id=4217f428-8d9d-4ee1-9614-642d26d90c46,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='794b07cbd46a44b5865cfda741036bae',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-29T17:47:40Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74613) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 29 18:06:18 user nova-compute[74613]: DEBUG nova.virt.hardware [None req-37365b65-a79e-4177-b2fe-318fe5b47453 tempest-ServerRescueNegativeTestJSON-1891426908 tempest-ServerRescueNegativeTestJSON-1891426908-project-member] Flavor limits 0:0:0 {{(pid=74613) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 29 18:06:18 user nova-compute[74613]: DEBUG nova.virt.hardware [None req-37365b65-a79e-4177-b2fe-318fe5b47453 tempest-ServerRescueNegativeTestJSON-1891426908 tempest-ServerRescueNegativeTestJSON-1891426908-project-member] Image limits 0:0:0 {{(pid=74613) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 29 18:06:18 user nova-compute[74613]: DEBUG nova.virt.hardware [None req-37365b65-a79e-4177-b2fe-318fe5b47453 tempest-ServerRescueNegativeTestJSON-1891426908 tempest-ServerRescueNegativeTestJSON-1891426908-project-member] Flavor pref 0:0:0 {{(pid=74613) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 29 18:06:18 user nova-compute[74613]: DEBUG nova.virt.hardware [None req-37365b65-a79e-4177-b2fe-318fe5b47453 tempest-ServerRescueNegativeTestJSON-1891426908 tempest-ServerRescueNegativeTestJSON-1891426908-project-member] Image pref 0:0:0 {{(pid=74613) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 29 18:06:18 user nova-compute[74613]: DEBUG nova.virt.hardware [None req-37365b65-a79e-4177-b2fe-318fe5b47453 tempest-ServerRescueNegativeTestJSON-1891426908 tempest-ServerRescueNegativeTestJSON-1891426908-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74613) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 29 18:06:18 user nova-compute[74613]: DEBUG nova.virt.hardware [None req-37365b65-a79e-4177-b2fe-318fe5b47453 tempest-ServerRescueNegativeTestJSON-1891426908 tempest-ServerRescueNegativeTestJSON-1891426908-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74613) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 29 18:06:18 user nova-compute[74613]: DEBUG nova.virt.hardware [None req-37365b65-a79e-4177-b2fe-318fe5b47453 tempest-ServerRescueNegativeTestJSON-1891426908 tempest-ServerRescueNegativeTestJSON-1891426908-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74613) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 29 18:06:18 user nova-compute[74613]: DEBUG nova.virt.hardware [None req-37365b65-a79e-4177-b2fe-318fe5b47453 tempest-ServerRescueNegativeTestJSON-1891426908 tempest-ServerRescueNegativeTestJSON-1891426908-project-member] Got 1 possible topologies {{(pid=74613) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 29 18:06:18 user nova-compute[74613]: DEBUG nova.virt.hardware [None req-37365b65-a79e-4177-b2fe-318fe5b47453 tempest-ServerRescueNegativeTestJSON-1891426908 tempest-ServerRescueNegativeTestJSON-1891426908-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74613) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 29 18:06:18 user nova-compute[74613]: DEBUG nova.virt.hardware [None req-37365b65-a79e-4177-b2fe-318fe5b47453 tempest-ServerRescueNegativeTestJSON-1891426908 tempest-ServerRescueNegativeTestJSON-1891426908-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74613) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 29 18:06:18 user nova-compute[74613]: DEBUG nova.objects.instance [None req-37365b65-a79e-4177-b2fe-318fe5b47453 tempest-ServerRescueNegativeTestJSON-1891426908 tempest-ServerRescueNegativeTestJSON-1891426908-project-member] Lazy-loading 'vcpu_model' on Instance uuid 6f4a1329-b3b9-4d1c-8735-abddabc359fd {{(pid=74613) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 18:06:18 user nova-compute[74613]: DEBUG nova.objects.base [None req-37365b65-a79e-4177-b2fe-318fe5b47453 tempest-ServerRescueNegativeTestJSON-1891426908 tempest-ServerRescueNegativeTestJSON-1891426908-project-member] Object Instance<6f4a1329-b3b9-4d1c-8735-abddabc359fd> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model {{(pid=74613) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 29 18:06:18 user nova-compute[74613]: DEBUG nova.virt.libvirt.vif [None req-37365b65-a79e-4177-b2fe-318fe5b47453 tempest-ServerRescueNegativeTestJSON-1891426908 tempest-ServerRescueNegativeTestJSON-1891426908-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T18:04:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1233675414',display_name='tempest-ServerRescueNegativeTestJSON-server-1233675414',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1233675414',id=29,image_ref='4217f428-8d9d-4ee1-9614-642d26d90c46',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-29T18:04:34Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='e6a3eb6ea0294f9da705dca72ec2789a',ramdisk_id='',reservation_id='r-17bsbhc1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='4217f428-8d9d-4ee1-9614-642d26d90c46',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-1891426908',owner_user_name='tempest-ServerRescueNegativeTestJSON-1891426908-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T18:04:35Z,user_data=None,user_id='4e984d45838e441680b9948c213728fb',uuid=6f4a1329-b3b9-4d1c-8735-abddabc359fd,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "6d82a9a2-81f2-4d4b-846e-178413db6ecf", "address": "fa:16:3e:53:4e:1d", "network": {"id": "db79433c-b21c-4058-b98c-f62822abbf7a", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1715530752-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-1715530752-network", "vif_mac": "fa:16:3e:53:4e:1d"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e6a3eb6ea0294f9da705dca72ec2789a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6d82a9a2-81", "ovs_interfaceid": "6d82a9a2-81f2-4d4b-846e-178413db6ecf", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74613) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 29 18:06:18 user nova-compute[74613]: DEBUG nova.network.os_vif_util [None req-37365b65-a79e-4177-b2fe-318fe5b47453 tempest-ServerRescueNegativeTestJSON-1891426908 tempest-ServerRescueNegativeTestJSON-1891426908-project-member] Converting VIF {"id": "6d82a9a2-81f2-4d4b-846e-178413db6ecf", "address": "fa:16:3e:53:4e:1d", "network": {"id": "db79433c-b21c-4058-b98c-f62822abbf7a", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1715530752-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-1715530752-network", "vif_mac": "fa:16:3e:53:4e:1d"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e6a3eb6ea0294f9da705dca72ec2789a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6d82a9a2-81", "ovs_interfaceid": "6d82a9a2-81f2-4d4b-846e-178413db6ecf", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74613) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 18:06:18 user nova-compute[74613]: DEBUG nova.network.os_vif_util [None req-37365b65-a79e-4177-b2fe-318fe5b47453 tempest-ServerRescueNegativeTestJSON-1891426908 tempest-ServerRescueNegativeTestJSON-1891426908-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:53:4e:1d,bridge_name='br-int',has_traffic_filtering=True,id=6d82a9a2-81f2-4d4b-846e-178413db6ecf,network=Network(db79433c-b21c-4058-b98c-f62822abbf7a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6d82a9a2-81') {{(pid=74613) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 18:06:18 user nova-compute[74613]: DEBUG nova.objects.instance [None req-37365b65-a79e-4177-b2fe-318fe5b47453 tempest-ServerRescueNegativeTestJSON-1891426908 tempest-ServerRescueNegativeTestJSON-1891426908-project-member] Lazy-loading 'pci_devices' on Instance uuid 6f4a1329-b3b9-4d1c-8735-abddabc359fd {{(pid=74613) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 18:06:18 user nova-compute[74613]: DEBUG nova.objects.base [None req-37365b65-a79e-4177-b2fe-318fe5b47453 tempest-ServerRescueNegativeTestJSON-1891426908 tempest-ServerRescueNegativeTestJSON-1891426908-project-member] Object Instance<6f4a1329-b3b9-4d1c-8735-abddabc359fd> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model,pci_devices {{(pid=74613) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 29 18:06:18 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-37365b65-a79e-4177-b2fe-318fe5b47453 tempest-ServerRescueNegativeTestJSON-1891426908 tempest-ServerRescueNegativeTestJSON-1891426908-project-member] [instance: 6f4a1329-b3b9-4d1c-8735-abddabc359fd] End _get_guest_xml xml=<domain type="kvm">
Nov 29 18:06:18 user nova-compute[74613]:   <uuid>6f4a1329-b3b9-4d1c-8735-abddabc359fd</uuid>
Nov 29 18:06:18 user nova-compute[74613]:   <name>instance-0000001d</name>
Nov 29 18:06:18 user nova-compute[74613]:   <memory>524288</memory>
Nov 29 18:06:18 user nova-compute[74613]:   <vcpu>1</vcpu>
Nov 29 18:06:18 user nova-compute[74613]:   <metadata>
Nov 29 18:06:18 user nova-compute[74613]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 29 18:06:18 user nova-compute[74613]:       <nova:package version="0.0.0"/>
Nov 29 18:06:18 user nova-compute[74613]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-1233675414</nova:name>
Nov 29 18:06:18 user nova-compute[74613]:       <nova:creationTime>2023-11-29 18:06:18</nova:creationTime>
Nov 29 18:06:18 user nova-compute[74613]:       <nova:flavor name="m1.tiny">
Nov 29 18:06:18 user nova-compute[74613]:         <nova:memory>512</nova:memory>
Nov 29 18:06:18 user nova-compute[74613]:         <nova:disk>1</nova:disk>
Nov 29 18:06:18 user nova-compute[74613]:         <nova:swap>0</nova:swap>
Nov 29 18:06:18 user nova-compute[74613]:         <nova:ephemeral>0</nova:ephemeral>
Nov 29 18:06:18 user nova-compute[74613]:         <nova:vcpus>1</nova:vcpus>
Nov 29 18:06:18 user nova-compute[74613]:       </nova:flavor>
Nov 29 18:06:18 user nova-compute[74613]:       <nova:owner>
Nov 29 18:06:18 user nova-compute[74613]:         <nova:user uuid="4e984d45838e441680b9948c213728fb">tempest-ServerRescueNegativeTestJSON-1891426908-project-member</nova:user>
Nov 29 18:06:18 user nova-compute[74613]:         <nova:project uuid="e6a3eb6ea0294f9da705dca72ec2789a">tempest-ServerRescueNegativeTestJSON-1891426908</nova:project>
Nov 29 18:06:18 user nova-compute[74613]:       </nova:owner>
Nov 29 18:06:18 user nova-compute[74613]:       <nova:root type="image" uuid="4217f428-8d9d-4ee1-9614-642d26d90c46"/>
Nov 29 18:06:18 user nova-compute[74613]:       <nova:ports>
Nov 29 18:06:18 user nova-compute[74613]:         <nova:port uuid="6d82a9a2-81f2-4d4b-846e-178413db6ecf">
Nov 29 18:06:18 user nova-compute[74613]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Nov 29 18:06:18 user nova-compute[74613]:         </nova:port>
Nov 29 18:06:18 user nova-compute[74613]:       </nova:ports>
Nov 29 18:06:18 user nova-compute[74613]:     </nova:instance>
Nov 29 18:06:18 user nova-compute[74613]:   </metadata>
Nov 29 18:06:18 user nova-compute[74613]:   <sysinfo type="smbios">
Nov 29 18:06:18 user nova-compute[74613]:     <system>
Nov 29 18:06:18 user nova-compute[74613]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 29 18:06:18 user nova-compute[74613]:       <entry name="product">OpenStack Nova</entry>
Nov 29 18:06:18 user nova-compute[74613]:       <entry name="version">0.0.0</entry>
Nov 29 18:06:18 user nova-compute[74613]:       <entry name="serial">6f4a1329-b3b9-4d1c-8735-abddabc359fd</entry>
Nov 29 18:06:18 user nova-compute[74613]:       <entry name="uuid">6f4a1329-b3b9-4d1c-8735-abddabc359fd</entry>
Nov 29 18:06:18 user nova-compute[74613]:       <entry name="family">Virtual Machine</entry>
Nov 29 18:06:18 user nova-compute[74613]:     </system>
Nov 29 18:06:18 user nova-compute[74613]:   </sysinfo>
Nov 29 18:06:18 user nova-compute[74613]:   <os>
Nov 29 18:06:18 user nova-compute[74613]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 29 18:06:18 user nova-compute[74613]:     <smbios mode="sysinfo"/>
Nov 29 18:06:18 user nova-compute[74613]:   </os>
Nov 29 18:06:18 user nova-compute[74613]:   <features>
Nov 29 18:06:18 user nova-compute[74613]:     <acpi/>
Nov 29 18:06:18 user nova-compute[74613]:     <apic/>
Nov 29 18:06:18 user nova-compute[74613]:     <vmcoreinfo/>
Nov 29 18:06:18 user nova-compute[74613]:   </features>
Nov 29 18:06:18 user nova-compute[74613]:   <clock offset="utc">
Nov 29 18:06:18 user nova-compute[74613]:     <timer name="pit" tickpolicy="delay"/>
Nov 29 18:06:18 user nova-compute[74613]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 29 18:06:18 user nova-compute[74613]:     <timer name="hpet" present="no"/>
Nov 29 18:06:18 user nova-compute[74613]:   </clock>
Nov 29 18:06:18 user nova-compute[74613]:   <cpu mode="custom" match="exact">
Nov 29 18:06:18 user nova-compute[74613]:     <model>Nehalem</model>
Nov 29 18:06:18 user nova-compute[74613]:     <topology sockets="1" cores="1" threads="1"/>
Nov 29 18:06:18 user nova-compute[74613]:   </cpu>
Nov 29 18:06:18 user nova-compute[74613]:   <devices>
Nov 29 18:06:18 user nova-compute[74613]:     <disk type="file" device="disk">
Nov 29 18:06:18 user nova-compute[74613]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 29 18:06:18 user nova-compute[74613]:       <source file="/opt/stack/data/nova/instances/6f4a1329-b3b9-4d1c-8735-abddabc359fd/disk.rescue"/>
Nov 29 18:06:18 user nova-compute[74613]:       <target dev="vda" bus="virtio"/>
Nov 29 18:06:18 user nova-compute[74613]:     </disk>
Nov 29 18:06:18 user nova-compute[74613]:     <disk type="file" device="disk">
Nov 29 18:06:18 user nova-compute[74613]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 29 18:06:18 user nova-compute[74613]:       <source file="/opt/stack/data/nova/instances/6f4a1329-b3b9-4d1c-8735-abddabc359fd/disk"/>
Nov 29 18:06:18 user nova-compute[74613]:       <target dev="vdb" bus="virtio"/>
Nov 29 18:06:18 user nova-compute[74613]:     </disk>
Nov 29 18:06:18 user nova-compute[74613]:     <interface type="ethernet">
Nov 29 18:06:18 user nova-compute[74613]:       <mac address="fa:16:3e:53:4e:1d"/>
Nov 29 18:06:18 user nova-compute[74613]:       <model type="virtio"/>
Nov 29 18:06:18 user nova-compute[74613]:       <mtu size="1442"/>
Nov 29 18:06:18 user nova-compute[74613]:       <target dev="tap6d82a9a2-81"/>
Nov 29 18:06:18 user nova-compute[74613]:     </interface>
Nov 29 18:06:18 user nova-compute[74613]:     <serial type="pty">
Nov 29 18:06:18 user nova-compute[74613]:       <log file="/opt/stack/data/nova/instances/6f4a1329-b3b9-4d1c-8735-abddabc359fd/console.log" append="off"/>
Nov 29 18:06:18 user nova-compute[74613]:     </serial>
Nov 29 18:06:18 user nova-compute[74613]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 29 18:06:18 user nova-compute[74613]:     <video>
Nov 29 18:06:18 user nova-compute[74613]:       <model type="virtio"/>
Nov 29 18:06:18 user nova-compute[74613]:     </video>
Nov 29 18:06:18 user nova-compute[74613]:     <rng model="virtio">
Nov 29 18:06:18 user nova-compute[74613]:       <backend model="random">/dev/urandom</backend>
Nov 29 18:06:18 user nova-compute[74613]:     </rng>
Nov 29 18:06:18 user nova-compute[74613]:     <controller type="usb" index="0" model="none"/>
Nov 29 18:06:18 user nova-compute[74613]:     <memballoon model="virtio">
Nov 29 18:06:18 user nova-compute[74613]:       <stats period="10"/>
Nov 29 18:06:18 user nova-compute[74613]:     </memballoon>
Nov 29 18:06:18 user nova-compute[74613]:   </devices>
Nov 29 18:06:18 user nova-compute[74613]: </domain>
Nov 29 18:06:18 user nova-compute[74613]:  {{(pid=74613) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 29 18:06:18 user nova-compute[74613]: INFO nova.virt.libvirt.driver [-] [instance: 6f4a1329-b3b9-4d1c-8735-abddabc359fd] Instance destroyed successfully.
Nov 29 18:06:18 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-37365b65-a79e-4177-b2fe-318fe5b47453 tempest-ServerRescueNegativeTestJSON-1891426908 tempest-ServerRescueNegativeTestJSON-1891426908-project-member] No BDM found with device name vda, not building metadata. {{(pid=74613) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 18:06:18 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-37365b65-a79e-4177-b2fe-318fe5b47453 tempest-ServerRescueNegativeTestJSON-1891426908 tempest-ServerRescueNegativeTestJSON-1891426908-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74613) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 18:06:18 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-37365b65-a79e-4177-b2fe-318fe5b47453 tempest-ServerRescueNegativeTestJSON-1891426908 tempest-ServerRescueNegativeTestJSON-1891426908-project-member] No VIF found with MAC fa:16:3e:53:4e:1d, not building metadata {{(pid=74613) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 29 18:06:19 user nova-compute[74613]: DEBUG nova.compute.manager [req-0a3ab7e3-ab2c-415f-b4ce-3542ea251b5f req-7d04f6cd-5df2-40a9-b415-c0a6c20a30a8 service nova] [instance: 6f4a1329-b3b9-4d1c-8735-abddabc359fd] Received event network-vif-plugged-6d82a9a2-81f2-4d4b-846e-178413db6ecf {{(pid=74613) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 18:06:19 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-0a3ab7e3-ab2c-415f-b4ce-3542ea251b5f req-7d04f6cd-5df2-40a9-b415-c0a6c20a30a8 service nova] Acquiring lock "6f4a1329-b3b9-4d1c-8735-abddabc359fd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 18:06:19 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-0a3ab7e3-ab2c-415f-b4ce-3542ea251b5f req-7d04f6cd-5df2-40a9-b415-c0a6c20a30a8 service nova] Lock "6f4a1329-b3b9-4d1c-8735-abddabc359fd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 18:06:19 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-0a3ab7e3-ab2c-415f-b4ce-3542ea251b5f req-7d04f6cd-5df2-40a9-b415-c0a6c20a30a8 service nova] Lock "6f4a1329-b3b9-4d1c-8735-abddabc359fd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 18:06:19 user nova-compute[74613]: DEBUG nova.compute.manager [req-0a3ab7e3-ab2c-415f-b4ce-3542ea251b5f req-7d04f6cd-5df2-40a9-b415-c0a6c20a30a8 service nova] [instance: 6f4a1329-b3b9-4d1c-8735-abddabc359fd] No waiting events found dispatching network-vif-plugged-6d82a9a2-81f2-4d4b-846e-178413db6ecf {{(pid=74613) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 18:06:19 user nova-compute[74613]: WARNING nova.compute.manager [req-0a3ab7e3-ab2c-415f-b4ce-3542ea251b5f req-7d04f6cd-5df2-40a9-b415-c0a6c20a30a8 service nova] [instance: 6f4a1329-b3b9-4d1c-8735-abddabc359fd] Received unexpected event network-vif-plugged-6d82a9a2-81f2-4d4b-846e-178413db6ecf for instance with vm_state active and task_state rescuing.
Nov 29 18:06:19 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:06:19 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:06:19 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:06:19 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:06:19 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:06:19 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:06:20 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:06:21 user nova-compute[74613]: DEBUG nova.compute.manager [req-ee7318a5-7f1e-4cc2-87a9-b74e87a91c3f req-126fab8f-a236-47e9-9c51-1ae412f019bc service nova] [instance: 6f4a1329-b3b9-4d1c-8735-abddabc359fd] Received event network-vif-plugged-6d82a9a2-81f2-4d4b-846e-178413db6ecf {{(pid=74613) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 18:06:21 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-ee7318a5-7f1e-4cc2-87a9-b74e87a91c3f req-126fab8f-a236-47e9-9c51-1ae412f019bc service nova] Acquiring lock "6f4a1329-b3b9-4d1c-8735-abddabc359fd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 18:06:21 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-ee7318a5-7f1e-4cc2-87a9-b74e87a91c3f req-126fab8f-a236-47e9-9c51-1ae412f019bc service nova] Lock "6f4a1329-b3b9-4d1c-8735-abddabc359fd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 18:06:21 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-ee7318a5-7f1e-4cc2-87a9-b74e87a91c3f req-126fab8f-a236-47e9-9c51-1ae412f019bc service nova] Lock "6f4a1329-b3b9-4d1c-8735-abddabc359fd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 18:06:21 user nova-compute[74613]: DEBUG nova.compute.manager [req-ee7318a5-7f1e-4cc2-87a9-b74e87a91c3f req-126fab8f-a236-47e9-9c51-1ae412f019bc service nova] [instance: 6f4a1329-b3b9-4d1c-8735-abddabc359fd] No waiting events found dispatching network-vif-plugged-6d82a9a2-81f2-4d4b-846e-178413db6ecf {{(pid=74613) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 18:06:21 user nova-compute[74613]: WARNING nova.compute.manager [req-ee7318a5-7f1e-4cc2-87a9-b74e87a91c3f req-126fab8f-a236-47e9-9c51-1ae412f019bc service nova] [instance: 6f4a1329-b3b9-4d1c-8735-abddabc359fd] Received unexpected event network-vif-plugged-6d82a9a2-81f2-4d4b-846e-178413db6ecf for instance with vm_state active and task_state rescuing.
Nov 29 18:06:21 user nova-compute[74613]: DEBUG nova.compute.manager [req-ee7318a5-7f1e-4cc2-87a9-b74e87a91c3f req-126fab8f-a236-47e9-9c51-1ae412f019bc service nova] [instance: 6f4a1329-b3b9-4d1c-8735-abddabc359fd] Received event network-vif-plugged-6d82a9a2-81f2-4d4b-846e-178413db6ecf {{(pid=74613) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 18:06:21 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-ee7318a5-7f1e-4cc2-87a9-b74e87a91c3f req-126fab8f-a236-47e9-9c51-1ae412f019bc service nova] Acquiring lock "6f4a1329-b3b9-4d1c-8735-abddabc359fd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 18:06:21 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-ee7318a5-7f1e-4cc2-87a9-b74e87a91c3f req-126fab8f-a236-47e9-9c51-1ae412f019bc service nova] Lock "6f4a1329-b3b9-4d1c-8735-abddabc359fd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 18:06:21 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-ee7318a5-7f1e-4cc2-87a9-b74e87a91c3f req-126fab8f-a236-47e9-9c51-1ae412f019bc service nova] Lock "6f4a1329-b3b9-4d1c-8735-abddabc359fd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 18:06:21 user nova-compute[74613]: DEBUG nova.compute.manager [req-ee7318a5-7f1e-4cc2-87a9-b74e87a91c3f req-126fab8f-a236-47e9-9c51-1ae412f019bc service nova] [instance: 6f4a1329-b3b9-4d1c-8735-abddabc359fd] No waiting events found dispatching network-vif-plugged-6d82a9a2-81f2-4d4b-846e-178413db6ecf {{(pid=74613) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 18:06:21 user nova-compute[74613]: WARNING nova.compute.manager [req-ee7318a5-7f1e-4cc2-87a9-b74e87a91c3f req-126fab8f-a236-47e9-9c51-1ae412f019bc service nova] [instance: 6f4a1329-b3b9-4d1c-8735-abddabc359fd] Received unexpected event network-vif-plugged-6d82a9a2-81f2-4d4b-846e-178413db6ecf for instance with vm_state active and task_state rescuing.
Nov 29 18:06:21 user nova-compute[74613]: DEBUG nova.compute.manager [None req-37365b65-a79e-4177-b2fe-318fe5b47453 tempest-ServerRescueNegativeTestJSON-1891426908 tempest-ServerRescueNegativeTestJSON-1891426908-project-member] [instance: 6f4a1329-b3b9-4d1c-8735-abddabc359fd] Checking state {{(pid=74613) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 29 18:06:23 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:06:23 user nova-compute[74613]: DEBUG oslo_service.periodic_task [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74613) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 18:06:23 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 18:06:23 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 18:06:23 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 18:06:23 user nova-compute[74613]: DEBUG nova.compute.resource_tracker [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Auditing locally available compute resources for user (node: user) {{(pid=74613) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 29 18:06:23 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=74613) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 29 18:06:23 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/69109f06-acbf-4834-b05e-80ab6e3f6ea0/disk --force-share --output=json {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:06:23 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/69109f06-acbf-4834-b05e-80ab6e3f6ea0/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:06:23 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/69109f06-acbf-4834-b05e-80ab6e3f6ea0/disk --force-share --output=json {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:06:24 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/69109f06-acbf-4834-b05e-80ab6e3f6ea0/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:06:24 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9eb14feb-f196-42b1-a6ba-2a049dea2d5e/disk --force-share --output=json {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:06:24 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9eb14feb-f196-42b1-a6ba-2a049dea2d5e/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:06:24 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9eb14feb-f196-42b1-a6ba-2a049dea2d5e/disk --force-share --output=json {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:06:24 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9eb14feb-f196-42b1-a6ba-2a049dea2d5e/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:06:24 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=74613) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 29 18:06:24 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d3c285cd-9f39-423c-a324-30a48a9c66be/disk.rescue --force-share --output=json {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:06:24 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d3c285cd-9f39-423c-a324-30a48a9c66be/disk.rescue --force-share --output=json" returned: 0 in 0.175s {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:06:24 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d3c285cd-9f39-423c-a324-30a48a9c66be/disk.rescue --force-share --output=json {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:06:24 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d3c285cd-9f39-423c-a324-30a48a9c66be/disk.rescue --force-share --output=json" returned: 0 in 0.178s {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:06:24 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f4a1329-b3b9-4d1c-8735-abddabc359fd/disk.rescue --force-share --output=json {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:06:25 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f4a1329-b3b9-4d1c-8735-abddabc359fd/disk.rescue --force-share --output=json" returned: 0 in 0.180s {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:06:25 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f4a1329-b3b9-4d1c-8735-abddabc359fd/disk.rescue --force-share --output=json {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:06:25 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f4a1329-b3b9-4d1c-8735-abddabc359fd/disk.rescue --force-share --output=json" returned: 0 in 0.179s {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:06:25 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f4a1329-b3b9-4d1c-8735-abddabc359fd/disk --force-share --output=json {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:06:25 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f4a1329-b3b9-4d1c-8735-abddabc359fd/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:06:25 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f4a1329-b3b9-4d1c-8735-abddabc359fd/disk --force-share --output=json {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:06:25 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:06:25 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f4a1329-b3b9-4d1c-8735-abddabc359fd/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:06:25 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3b828860-5cc5-40b0-b845-8e560211794e/disk --force-share --output=json {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:06:25 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3b828860-5cc5-40b0-b845-8e560211794e/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:06:25 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3b828860-5cc5-40b0-b845-8e560211794e/disk --force-share --output=json {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:06:26 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3b828860-5cc5-40b0-b845-8e560211794e/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:06:26 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/abc9e2b8-f467-4cd0-b40f-de511fde1ec1/disk --force-share --output=json {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:06:26 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/abc9e2b8-f467-4cd0-b40f-de511fde1ec1/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:06:26 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/abc9e2b8-f467-4cd0-b40f-de511fde1ec1/disk --force-share --output=json {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:06:26 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/abc9e2b8-f467-4cd0-b40f-de511fde1ec1/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:06:26 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6993e2e7-7e03-45b4-9d3d-3742589b6078/disk --force-share --output=json {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:06:26 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6993e2e7-7e03-45b4-9d3d-3742589b6078/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:06:26 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6993e2e7-7e03-45b4-9d3d-3742589b6078/disk --force-share --output=json {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:06:26 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6993e2e7-7e03-45b4-9d3d-3742589b6078/disk --force-share --output=json" returned: 0 in 0.204s {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:06:26 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74613) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 29 18:06:26 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8fc8496b-1435-4b5f-8977-6c0d7467ef65/disk --force-share --output=json {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:06:27 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8fc8496b-1435-4b5f-8977-6c0d7467ef65/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:06:27 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8fc8496b-1435-4b5f-8977-6c0d7467ef65/disk --force-share --output=json {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:06:27 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8fc8496b-1435-4b5f-8977-6c0d7467ef65/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:06:27 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e2439d62-4713-435d-81ce-fafe1d811b47/disk --force-share --output=json {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:06:27 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e2439d62-4713-435d-81ce-fafe1d811b47/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:06:27 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e2439d62-4713-435d-81ce-fafe1d811b47/disk --force-share --output=json {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:06:27 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e2439d62-4713-435d-81ce-fafe1d811b47/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:06:27 user nova-compute[74613]: WARNING nova.virt.libvirt.driver [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 18:06:27 user nova-compute[74613]: WARNING nova.virt.libvirt.driver [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 18:06:27 user nova-compute[74613]: DEBUG nova.compute.resource_tracker [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Hypervisor/Node resource view: name=user free_ram=7574MB free_disk=24.741310119628906GB free_vcpus=1 pci_devices=[{"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74613) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 29 18:06:27 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 18:06:27 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 18:06:28 user nova-compute[74613]: DEBUG nova.compute.resource_tracker [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Applying migration context for instance e9acfa30-4ec2-4540-ac34-4c66db3228e1 as it has an incoming, in-progress migration 5c28fdb8-2306-491b-9a4c-9ea25116daee. Migration status is finished {{(pid=74613) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1016}}
Nov 29 18:06:28 user nova-compute[74613]: INFO nova.compute.resource_tracker [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] [instance: e9acfa30-4ec2-4540-ac34-4c66db3228e1] Updating resource usage from migration 5c28fdb8-2306-491b-9a4c-9ea25116daee
Nov 29 18:06:28 user nova-compute[74613]: DEBUG nova.compute.resource_tracker [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Instance 3b828860-5cc5-40b0-b845-8e560211794e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74613) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 18:06:28 user nova-compute[74613]: DEBUG nova.compute.resource_tracker [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Instance abc9e2b8-f467-4cd0-b40f-de511fde1ec1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74613) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 18:06:28 user nova-compute[74613]: DEBUG nova.compute.resource_tracker [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Instance cd22685a-028c-4e0c-834d-e7b20f6d06ab actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74613) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 18:06:28 user nova-compute[74613]: DEBUG nova.compute.resource_tracker [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Instance 8fc8496b-1435-4b5f-8977-6c0d7467ef65 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74613) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 18:06:28 user nova-compute[74613]: DEBUG nova.compute.resource_tracker [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Instance d3c285cd-9f39-423c-a324-30a48a9c66be actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74613) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 18:06:28 user nova-compute[74613]: DEBUG nova.compute.resource_tracker [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Instance 6993e2e7-7e03-45b4-9d3d-3742589b6078 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74613) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 18:06:28 user nova-compute[74613]: DEBUG nova.compute.resource_tracker [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Instance 6f4a1329-b3b9-4d1c-8735-abddabc359fd actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74613) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 18:06:28 user nova-compute[74613]: DEBUG nova.compute.resource_tracker [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Migration 5c28fdb8-2306-491b-9a4c-9ea25116daee is active on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74613) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1709}}
Nov 29 18:06:28 user nova-compute[74613]: DEBUG nova.compute.resource_tracker [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Instance e9acfa30-4ec2-4540-ac34-4c66db3228e1 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=74613) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 18:06:28 user nova-compute[74613]: DEBUG nova.compute.resource_tracker [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Instance 9eb14feb-f196-42b1-a6ba-2a049dea2d5e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74613) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 18:06:28 user nova-compute[74613]: DEBUG nova.compute.resource_tracker [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Instance 69109f06-acbf-4834-b05e-80ab6e3f6ea0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74613) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 18:06:28 user nova-compute[74613]: DEBUG nova.compute.resource_tracker [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Instance e2439d62-4713-435d-81ce-fafe1d811b47 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74613) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 18:06:28 user nova-compute[74613]: DEBUG nova.compute.resource_tracker [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Total usable vcpus: 12, total allocated vcpus: 12 {{(pid=74613) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 29 18:06:28 user nova-compute[74613]: DEBUG nova.compute.resource_tracker [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Final resource view: name=user phys_ram=16011MB used_ram=8192MB phys_disk=40GB used_disk=8GB total_vcpus=12 used_vcpus=12 pci_stats=[] {{(pid=74613) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 29 18:06:28 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:06:28 user nova-compute[74613]: DEBUG nova.compute.provider_tree [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Inventory has not changed in ProviderTree for provider: 639d980e-3b12-44b1-b8f4-1812416fa4dd {{(pid=74613) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 18:06:28 user nova-compute[74613]: DEBUG nova.scheduler.client.report [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Inventory has not changed for provider 639d980e-3b12-44b1-b8f4-1812416fa4dd based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74613) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 18:06:28 user nova-compute[74613]: DEBUG nova.compute.resource_tracker [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Compute_service record updated for user:user {{(pid=74613) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 29 18:06:28 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.540s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 18:06:31 user nova-compute[74613]: DEBUG oslo_service.periodic_task [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74613) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 18:06:31 user nova-compute[74613]: DEBUG oslo_service.periodic_task [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74613) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 18:06:31 user nova-compute[74613]: DEBUG nova.compute.manager [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Starting heal instance info cache {{(pid=74613) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 29 18:06:31 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Acquiring lock "refresh_cache-cd22685a-028c-4e0c-834d-e7b20f6d06ab" {{(pid=74613) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 18:06:31 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Acquired lock "refresh_cache-cd22685a-028c-4e0c-834d-e7b20f6d06ab" {{(pid=74613) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 18:06:31 user nova-compute[74613]: DEBUG nova.network.neutron [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] [instance: cd22685a-028c-4e0c-834d-e7b20f6d06ab] Forcefully refreshing network info cache for instance {{(pid=74613) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 29 18:06:32 user nova-compute[74613]: DEBUG nova.network.neutron [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] [instance: cd22685a-028c-4e0c-834d-e7b20f6d06ab] Updating instance_info_cache with network_info: [{"id": "5b08bd65-707e-48a5-800b-dd0670c88d61", "address": "fa:16:3e:28:d8:3d", "network": {"id": "0722b02d-a357-4360-87e8-580913723985", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-579793494-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b820dd795dfe46cd804772f0e71f98e9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5b08bd65-70", "ovs_interfaceid": "5b08bd65-707e-48a5-800b-dd0670c88d61", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74613) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 18:06:32 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Releasing lock "refresh_cache-cd22685a-028c-4e0c-834d-e7b20f6d06ab" {{(pid=74613) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 18:06:32 user nova-compute[74613]: DEBUG nova.compute.manager [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] [instance: cd22685a-028c-4e0c-834d-e7b20f6d06ab] Updated the network info_cache for instance {{(pid=74613) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 29 18:06:32 user nova-compute[74613]: DEBUG oslo_service.periodic_task [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74613) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 18:06:32 user nova-compute[74613]: DEBUG oslo_service.periodic_task [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74613) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 18:06:32 user nova-compute[74613]: DEBUG oslo_service.periodic_task [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74613) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 18:06:32 user nova-compute[74613]: DEBUG oslo_service.periodic_task [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74613) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 18:06:32 user nova-compute[74613]: DEBUG oslo_service.periodic_task [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74613) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 18:06:32 user nova-compute[74613]: DEBUG oslo_service.periodic_task [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74613) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 18:06:32 user nova-compute[74613]: DEBUG nova.compute.manager [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74613) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 29 18:06:32 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:06:33 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:06:38 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 18:06:40 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:06:41 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-10e4a10c-7d5b-4889-91aa-5814bd00423a tempest-ServerActionsTestOtherA-1784608629 tempest-ServerActionsTestOtherA-1784608629-project-member] Acquiring lock "e9acfa30-4ec2-4540-ac34-4c66db3228e1" by "nova.compute.manager.ComputeManager.confirm_resize.<locals>.do_confirm_resize" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 18:06:41 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-10e4a10c-7d5b-4889-91aa-5814bd00423a tempest-ServerActionsTestOtherA-1784608629 tempest-ServerActionsTestOtherA-1784608629-project-member] Lock "e9acfa30-4ec2-4540-ac34-4c66db3228e1" acquired by "nova.compute.manager.ComputeManager.confirm_resize.<locals>.do_confirm_resize" :: waited 0.001s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 18:06:41 user nova-compute[74613]: DEBUG nova.compute.manager [None req-10e4a10c-7d5b-4889-91aa-5814bd00423a tempest-ServerActionsTestOtherA-1784608629 tempest-ServerActionsTestOtherA-1784608629-project-member] [instance: e9acfa30-4ec2-4540-ac34-4c66db3228e1] Going to confirm migration 2 {{(pid=74613) do_confirm_resize /opt/stack/nova/nova/compute/manager.py:4774}}
Nov 29 18:06:41 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-10e4a10c-7d5b-4889-91aa-5814bd00423a tempest-ServerActionsTestOtherA-1784608629 tempest-ServerActionsTestOtherA-1784608629-project-member] Acquiring lock "refresh_cache-e9acfa30-4ec2-4540-ac34-4c66db3228e1" {{(pid=74613) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 18:06:41 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-10e4a10c-7d5b-4889-91aa-5814bd00423a tempest-ServerActionsTestOtherA-1784608629 tempest-ServerActionsTestOtherA-1784608629-project-member] Acquired lock "refresh_cache-e9acfa30-4ec2-4540-ac34-4c66db3228e1" {{(pid=74613) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 18:06:41 user nova-compute[74613]: DEBUG nova.network.neutron [None req-10e4a10c-7d5b-4889-91aa-5814bd00423a tempest-ServerActionsTestOtherA-1784608629 tempest-ServerActionsTestOtherA-1784608629-project-member] [instance: e9acfa30-4ec2-4540-ac34-4c66db3228e1] Building network info cache for instance {{(pid=74613) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 29 18:06:41 user nova-compute[74613]: DEBUG nova.objects.instance [None req-10e4a10c-7d5b-4889-91aa-5814bd00423a tempest-ServerActionsTestOtherA-1784608629 tempest-ServerActionsTestOtherA-1784608629-project-member] Lazy-loading 'info_cache' on Instance uuid e9acfa30-4ec2-4540-ac34-4c66db3228e1 {{(pid=74613) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 18:06:41 user nova-compute[74613]: DEBUG nova.network.neutron [None req-10e4a10c-7d5b-4889-91aa-5814bd00423a tempest-ServerActionsTestOtherA-1784608629 tempest-ServerActionsTestOtherA-1784608629-project-member] [instance: e9acfa30-4ec2-4540-ac34-4c66db3228e1] Updating instance_info_cache with network_info: [{"id": "8cd31427-1812-40fb-8018-d8f24a5b1792", "address": "fa:16:3e:97:0e:ed", "network": {"id": "7c2c368e-4c7d-4d70-9a40-c10fe9541af9", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1287934102-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.103", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b1f70c311d4941c986de21ac458d11ab", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8cd31427-18", "ovs_interfaceid": "8cd31427-1812-40fb-8018-d8f24a5b1792", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74613) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 18:06:41 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-10e4a10c-7d5b-4889-91aa-5814bd00423a tempest-ServerActionsTestOtherA-1784608629 tempest-ServerActionsTestOtherA-1784608629-project-member] Releasing lock "refresh_cache-e9acfa30-4ec2-4540-ac34-4c66db3228e1" {{(pid=74613) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 18:06:41 user nova-compute[74613]: DEBUG nova.objects.instance [None req-10e4a10c-7d5b-4889-91aa-5814bd00423a tempest-ServerActionsTestOtherA-1784608629 tempest-ServerActionsTestOtherA-1784608629-project-member] Lazy-loading 'migration_context' on Instance uuid e9acfa30-4ec2-4540-ac34-4c66db3228e1 {{(pid=74613) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 18:06:41 user nova-compute[74613]: DEBUG nova.objects.base [None req-10e4a10c-7d5b-4889-91aa-5814bd00423a tempest-ServerActionsTestOtherA-1784608629 tempest-ServerActionsTestOtherA-1784608629-project-member] Object Instance<e9acfa30-4ec2-4540-ac34-4c66db3228e1> lazy-loaded attributes: info_cache,migration_context {{(pid=74613) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 29 18:06:41 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-10e4a10c-7d5b-4889-91aa-5814bd00423a tempest-ServerActionsTestOtherA-1784608629 tempest-ServerActionsTestOtherA-1784608629-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_source" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 18:06:41 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-10e4a10c-7d5b-4889-91aa-5814bd00423a tempest-ServerActionsTestOtherA-1784608629 tempest-ServerActionsTestOtherA-1784608629-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_source" :: waited 0.000s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 18:06:42 user nova-compute[74613]: DEBUG nova.compute.provider_tree [None req-10e4a10c-7d5b-4889-91aa-5814bd00423a tempest-ServerActionsTestOtherA-1784608629 tempest-ServerActionsTestOtherA-1784608629-project-member] Inventory has not changed in ProviderTree for provider: 639d980e-3b12-44b1-b8f4-1812416fa4dd {{(pid=74613) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 18:06:42 user nova-compute[74613]: DEBUG nova.scheduler.client.report [None req-10e4a10c-7d5b-4889-91aa-5814bd00423a tempest-ServerActionsTestOtherA-1784608629 tempest-ServerActionsTestOtherA-1784608629-project-member] Inventory has not changed for provider 639d980e-3b12-44b1-b8f4-1812416fa4dd based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74613) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 18:06:42 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-10e4a10c-7d5b-4889-91aa-5814bd00423a tempest-ServerActionsTestOtherA-1784608629 tempest-ServerActionsTestOtherA-1784608629-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_source" :: held 0.409s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 18:06:42 user nova-compute[74613]: INFO nova.scheduler.client.report [None req-10e4a10c-7d5b-4889-91aa-5814bd00423a tempest-ServerActionsTestOtherA-1784608629 tempest-ServerActionsTestOtherA-1784608629-project-member] Deleted allocation for migration 5c28fdb8-2306-491b-9a4c-9ea25116daee
Nov 29 18:06:42 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-10e4a10c-7d5b-4889-91aa-5814bd00423a tempest-ServerActionsTestOtherA-1784608629 tempest-ServerActionsTestOtherA-1784608629-project-member] Lock "e9acfa30-4ec2-4540-ac34-4c66db3228e1" "released" by "nova.compute.manager.ComputeManager.confirm_resize.<locals>.do_confirm_resize" :: held 1.437s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 18:06:43 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:06:45 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:06:48 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:06:50 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:06:51 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:06:53 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:06:53 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:06:55 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:06:58 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:07:01 user nova-compute[74613]: DEBUG nova.compute.manager [req-6bf3b824-d8ef-415b-88cb-c153cff13efd req-428f4e0f-7bd6-4345-bbe3-00ff638e8139 service nova] [instance: 9eb14feb-f196-42b1-a6ba-2a049dea2d5e] Received event network-changed-02cedfee-7de8-4112-ad75-277367c11133 {{(pid=74613) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 18:07:01 user nova-compute[74613]: DEBUG nova.compute.manager [req-6bf3b824-d8ef-415b-88cb-c153cff13efd req-428f4e0f-7bd6-4345-bbe3-00ff638e8139 service nova] [instance: 9eb14feb-f196-42b1-a6ba-2a049dea2d5e] Refreshing instance network info cache due to event network-changed-02cedfee-7de8-4112-ad75-277367c11133. {{(pid=74613) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 18:07:01 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-6bf3b824-d8ef-415b-88cb-c153cff13efd req-428f4e0f-7bd6-4345-bbe3-00ff638e8139 service nova] Acquiring lock "refresh_cache-9eb14feb-f196-42b1-a6ba-2a049dea2d5e" {{(pid=74613) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 18:07:01 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-6bf3b824-d8ef-415b-88cb-c153cff13efd req-428f4e0f-7bd6-4345-bbe3-00ff638e8139 service nova] Acquired lock "refresh_cache-9eb14feb-f196-42b1-a6ba-2a049dea2d5e" {{(pid=74613) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 18:07:01 user nova-compute[74613]: DEBUG nova.network.neutron [req-6bf3b824-d8ef-415b-88cb-c153cff13efd req-428f4e0f-7bd6-4345-bbe3-00ff638e8139 service nova] [instance: 9eb14feb-f196-42b1-a6ba-2a049dea2d5e] Refreshing network info cache for port 02cedfee-7de8-4112-ad75-277367c11133 {{(pid=74613) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 18:07:02 user nova-compute[74613]: DEBUG nova.network.neutron [req-6bf3b824-d8ef-415b-88cb-c153cff13efd req-428f4e0f-7bd6-4345-bbe3-00ff638e8139 service nova] [instance: 9eb14feb-f196-42b1-a6ba-2a049dea2d5e] Updated VIF entry in instance network info cache for port 02cedfee-7de8-4112-ad75-277367c11133. {{(pid=74613) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 18:07:02 user nova-compute[74613]: DEBUG nova.network.neutron [req-6bf3b824-d8ef-415b-88cb-c153cff13efd req-428f4e0f-7bd6-4345-bbe3-00ff638e8139 service nova] [instance: 9eb14feb-f196-42b1-a6ba-2a049dea2d5e] Updating instance_info_cache with network_info: [{"id": "02cedfee-7de8-4112-ad75-277367c11133", "address": "fa:16:3e:ba:49:9d", "network": {"id": "fed779df-aeaf-4b57-8336-be4c9d81f0be", "bridge": "br-int", "label": "tempest-TestStampPattern-1699172136-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.110", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6004d03e0fbd4684bc8f1d341afad3be", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap02cedfee-7d", "ovs_interfaceid": "02cedfee-7de8-4112-ad75-277367c11133", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74613) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 18:07:02 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-6bf3b824-d8ef-415b-88cb-c153cff13efd req-428f4e0f-7bd6-4345-bbe3-00ff638e8139 service nova] Releasing lock "refresh_cache-9eb14feb-f196-42b1-a6ba-2a049dea2d5e" {{(pid=74613) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 18:07:03 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 18:07:03 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:07:03 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=74613) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 29 18:07:03 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74613) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 18:07:03 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74613) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 18:07:03 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:07:03 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-09478508-b171-47b9-a6d3-a70140bebb76 tempest-TestStampPattern-2144166935 tempest-TestStampPattern-2144166935-project-member] Acquiring lock "9eb14feb-f196-42b1-a6ba-2a049dea2d5e" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 18:07:03 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-09478508-b171-47b9-a6d3-a70140bebb76 tempest-TestStampPattern-2144166935 tempest-TestStampPattern-2144166935-project-member] Lock "9eb14feb-f196-42b1-a6ba-2a049dea2d5e" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 18:07:03 user nova-compute[74613]: DEBUG nova.objects.instance [None req-09478508-b171-47b9-a6d3-a70140bebb76 tempest-TestStampPattern-2144166935 tempest-TestStampPattern-2144166935-project-member] Lazy-loading 'flavor' on Instance uuid 9eb14feb-f196-42b1-a6ba-2a049dea2d5e {{(pid=74613) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 18:07:03 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-09478508-b171-47b9-a6d3-a70140bebb76 tempest-TestStampPattern-2144166935 tempest-TestStampPattern-2144166935-project-member] Lock "9eb14feb-f196-42b1-a6ba-2a049dea2d5e" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.059s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 18:07:03 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-09478508-b171-47b9-a6d3-a70140bebb76 tempest-TestStampPattern-2144166935 tempest-TestStampPattern-2144166935-project-member] Acquiring lock "9eb14feb-f196-42b1-a6ba-2a049dea2d5e" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 18:07:03 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-09478508-b171-47b9-a6d3-a70140bebb76 tempest-TestStampPattern-2144166935 tempest-TestStampPattern-2144166935-project-member] Lock "9eb14feb-f196-42b1-a6ba-2a049dea2d5e" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 18:07:03 user nova-compute[74613]: INFO nova.compute.manager [None req-09478508-b171-47b9-a6d3-a70140bebb76 tempest-TestStampPattern-2144166935 tempest-TestStampPattern-2144166935-project-member] [instance: 9eb14feb-f196-42b1-a6ba-2a049dea2d5e] Attaching volume b6f3ecd2-9394-4935-a659-96e74bd25348 to /dev/vdb
Nov 29 18:07:03 user nova-compute[74613]: DEBUG os_brick.utils [None req-09478508-b171-47b9-a6d3-a70140bebb76 tempest-TestStampPattern-2144166935 tempest-TestStampPattern-2144166935-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74613) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 18:07:03 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:07:03 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:07:03 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[34fdc398-471a-4964-82c8-8600a2fc7bb0]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:400972819b5\n', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 18:07:03 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:07:03 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:07:03 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b91f81a-cbc2-4294-8e3f-db98e81bd756]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 18:07:03 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:07:03 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:07:03 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6224001-181e-4f69-a713-29c0b3e74482]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 18:07:03 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[f745ea3e-fba4-4193-90d6-58087752216e]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 18:07:03 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-09478508-b171-47b9-a6d3-a70140bebb76 tempest-TestStampPattern-2144166935 tempest-TestStampPattern-2144166935-project-member] Running cmd (subprocess): nvme version {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:07:03 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-09478508-b171-47b9-a6d3-a70140bebb76 tempest-TestStampPattern-2144166935 tempest-TestStampPattern-2144166935-project-member] 'nvme version' failed. Not Retrying. {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 18:07:03 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.nvmeof [None req-09478508-b171-47b9-a6d3-a70140bebb76 tempest-TestStampPattern-2144166935 tempest-TestStampPattern-2144166935-project-member] nvme not present on system {{(pid=74613) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 29 18:07:03 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:07:03 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 18:07:03 user nova-compute[74613]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 29 18:07:03 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b854bf6-d976-41e2-b379-6a92fab7f700]: (4, '') {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 18:07:03 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.lightos [None req-09478508-b171-47b9-a6d3-a70140bebb76 tempest-TestStampPattern-2144166935 tempest-TestStampPattern-2144166935-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74613) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 29 18:07:03 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.lightos [None req-09478508-b171-47b9-a6d3-a70140bebb76 tempest-TestStampPattern-2144166935 tempest-TestStampPattern-2144166935-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74613) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 29 18:07:03 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.lightos [None req-09478508-b171-47b9-a6d3-a70140bebb76 tempest-TestStampPattern-2144166935 tempest-TestStampPattern-2144166935-project-member] LIGHTOS: no hostnqn found. {{(pid=74613) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 29 18:07:03 user nova-compute[74613]: DEBUG os_brick.utils [None req-09478508-b171-47b9-a6d3-a70140bebb76 tempest-TestStampPattern-2144166935 tempest-TestStampPattern-2144166935-project-member] <== get_connector_properties: return (123ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:400972819b5', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74613) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 18:07:03 user nova-compute[74613]: DEBUG nova.virt.block_device [None req-09478508-b171-47b9-a6d3-a70140bebb76 tempest-TestStampPattern-2144166935 tempest-TestStampPattern-2144166935-project-member] [instance: 9eb14feb-f196-42b1-a6ba-2a049dea2d5e] Updating existing volume attachment record: fca318fb-d44d-42a2-b113-fa7f2a4e6230 {{(pid=74613) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 29 18:07:05 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:07:08 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:07:10 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:07:12 user nova-compute[74613]: DEBUG nova.virt.libvirt.volume.iscsi [None req-09478508-b171-47b9-a6d3-a70140bebb76 tempest-TestStampPattern-2144166935 tempest-TestStampPattern-2144166935-project-member] [instance: 9eb14feb-f196-42b1-a6ba-2a049dea2d5e] Calling os-brick to attach iSCSI Volume {{(pid=74613) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 29 18:07:12 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-09478508-b171-47b9-a6d3-a70140bebb76 tempest-TestStampPattern-2144166935 tempest-TestStampPattern-2144166935-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff828156890>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:b6f3ecd2-9394-4935-a659-96e74bd25348', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'tCAhdlKv', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74613) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 18:07:12 user nova-compute[74613]: WARNING os_brick.initiator.connectors.base [None req-09478508-b171-47b9-a6d3-a70140bebb76 tempest-TestStampPattern-2144166935 tempest-TestStampPattern-2144166935-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 18:07:12 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.base [None req-09478508-b171-47b9-a6d3-a70140bebb76 tempest-TestStampPattern-2144166935 tempest-TestStampPattern-2144166935-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 18:07:12 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.base [None req-09478508-b171-47b9-a6d3-a70140bebb76 tempest-TestStampPattern-2144166935 tempest-TestStampPattern-2144166935-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 18:07:12 user nova-compute[74613]: WARNING os_brick.initiator.connectors.base [None req-09478508-b171-47b9-a6d3-a70140bebb76 tempest-TestStampPattern-2144166935 tempest-TestStampPattern-2144166935-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 18:07:12 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.base [None req-09478508-b171-47b9-a6d3-a70140bebb76 tempest-TestStampPattern-2144166935 tempest-TestStampPattern-2144166935-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b6f3ecd2-9394-4935-a659-96e74bd25348" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 18:07:12 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.base [None req-09478508-b171-47b9-a6d3-a70140bebb76 tempest-TestStampPattern-2144166935 tempest-TestStampPattern-2144166935-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b6f3ecd2-9394-4935-a659-96e74bd25348" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 18:07:12 user nova-compute[74613]: INFO os_brick.initiator.connectors.iscsi [None req-09478508-b171-47b9-a6d3-a70140bebb76 tempest-TestStampPattern-2144166935 tempest-TestStampPattern-2144166935-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 29 18:07:12 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b6f3ecd2-9394-4935-a659-96e74bd25348 -p 172.16.0.220:3260 {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:07:12 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b6f3ecd2-9394-4935-a659-96e74bd25348 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:07:12 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[5639f156-c121-4d6d-9ac9-ef7897bdd9f9]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 18:07:12 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-09478508-b171-47b9-a6d3-a70140bebb76 tempest-TestStampPattern-2144166935 tempest-TestStampPattern-2144166935-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 29 18:07:12 user nova-compute[74613]:  {{(pid=74613) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 18:07:12 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b6f3ecd2-9394-4935-a659-96e74bd25348 -p 172.16.0.220:3260 --interface default --op new {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:07:12 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b6f3ecd2-9394-4935-a659-96e74bd25348 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:07:12 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[c660d3f0-4868-4e79-81b2-86a714003791]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b6f3ecd2-9394-4935-a659-96e74bd25348] added\n', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 18:07:12 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-09478508-b171-47b9-a6d3-a70140bebb76 tempest-TestStampPattern-2144166935 tempest-TestStampPattern-2144166935-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b6f3ecd2-9394-4935-a659-96e74bd25348] added
Nov 29 18:07:12 user nova-compute[74613]:  stderr= {{(pid=74613) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 18:07:12 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b6f3ecd2-9394-4935-a659-96e74bd25348 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:07:12 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b6f3ecd2-9394-4935-a659-96e74bd25348 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:07:12 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1bdf3df-dab1-4318-8470-9aa0149d21b2]: (4, ('', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 18:07:12 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-09478508-b171-47b9-a6d3-a70140bebb76 tempest-TestStampPattern-2144166935 tempest-TestStampPattern-2144166935-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74613) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 18:07:12 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b6f3ecd2-9394-4935-a659-96e74bd25348 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:07:12 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b6f3ecd2-9394-4935-a659-96e74bd25348 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:07:12 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[03ecc0c2-54bc-41ee-aeb6-7320e51f0030]: (4, ('', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 18:07:12 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-09478508-b171-47b9-a6d3-a70140bebb76 tempest-TestStampPattern-2144166935 tempest-TestStampPattern-2144166935-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74613) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 18:07:12 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b6f3ecd2-9394-4935-a659-96e74bd25348 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v tCAhdlKv {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:07:12 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b6f3ecd2-9394-4935-a659-96e74bd25348 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v tCAhdlKv" returned: 0 in 0.018s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:07:12 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[89caf097-6607-4b9f-bd9a-5ebcd0054a20]: (4, ('', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 18:07:12 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-09478508-b171-47b9-a6d3-a70140bebb76 tempest-TestStampPattern-2144166935 tempest-TestStampPattern-2144166935-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'tCAhdlKv'): stdout= stderr= {{(pid=74613) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 18:07:12 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b6f3ecd2-9394-4935-a659-96e74bd25348 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:07:12 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b6f3ecd2-9394-4935-a659-96e74bd25348 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:07:12 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[8cf5bb32-469c-4069-9418-ddaa50927a98]: (4, ('', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 18:07:12 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-09478508-b171-47b9-a6d3-a70140bebb76 tempest-TestStampPattern-2144166935 tempest-TestStampPattern-2144166935-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74613) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 18:07:12 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:07:12 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:07:12 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[d464da2b-9cb7-4208-89c0-7db27708f6f9]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9511387c-8772-40f2-bf2d-6b6387649e9f (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9aad94d-fe0d-415d-9761-9aff25cc6099 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8c53a27-dcde-402b-a9bb-d8642f7db0da (non-flash)\n', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 18:07:12 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-09478508-b171-47b9-a6d3-a70140bebb76 tempest-TestStampPattern-2144166935 tempest-TestStampPattern-2144166935-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9511387c-8772-40f2-bf2d-6b6387649e9f (non-flash)
Nov 29 18:07:12 user nova-compute[74613]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9aad94d-fe0d-415d-9761-9aff25cc6099 (non-flash)
Nov 29 18:07:12 user nova-compute[74613]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8c53a27-dcde-402b-a9bb-d8642f7db0da (non-flash)
Nov 29 18:07:12 user nova-compute[74613]:  stderr= {{(pid=74613) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 18:07:12 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-09478508-b171-47b9-a6d3-a70140bebb76 tempest-TestStampPattern-2144166935 tempest-TestStampPattern-2144166935-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9511387c-8772-40f2-bf2d-6b6387649e9f (non-flash)
Nov 29 18:07:12 user nova-compute[74613]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9aad94d-fe0d-415d-9761-9aff25cc6099 (non-flash)
Nov 29 18:07:12 user nova-compute[74613]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8c53a27-dcde-402b-a9bb-d8642f7db0da (non-flash)
Nov 29 18:07:12 user nova-compute[74613]:  stderr= {{(pid=74613) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 18:07:12 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b6f3ecd2-9394-4935-a659-96e74bd25348 -p 172.16.0.220:3260 --login {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:07:12 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b6f3ecd2-9394-4935-a659-96e74bd25348 -p 172.16.0.220:3260 --login" returned: 0 in 0.063s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:07:12 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[913debaf-2c2b-49bb-80bb-30cac149efb0]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:b6f3ecd2-9394-4935-a659-96e74bd25348, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:b6f3ecd2-9394-4935-a659-96e74bd25348, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 18:07:12 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-09478508-b171-47b9-a6d3-a70140bebb76 tempest-TestStampPattern-2144166935 tempest-TestStampPattern-2144166935-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:b6f3ecd2-9394-4935-a659-96e74bd25348, portal: 172.16.0.220,3260]
Nov 29 18:07:12 user nova-compute[74613]: Login to [iface: default, target: iqn.2010-10.org.openstack:b6f3ecd2-9394-4935-a659-96e74bd25348, portal: 172.16.0.220,3260] successful.
Nov 29 18:07:12 user nova-compute[74613]:  stderr= {{(pid=74613) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 18:07:12 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b6f3ecd2-9394-4935-a659-96e74bd25348 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:07:12 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b6f3ecd2-9394-4935-a659-96e74bd25348 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.023s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:07:12 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[760e2cd0-54e2-4044-bad2-1bc27fd01fad]: (4, ('', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 18:07:12 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-09478508-b171-47b9-a6d3-a70140bebb76 tempest-TestStampPattern-2144166935 tempest-TestStampPattern-2144166935-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74613) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 18:07:12 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:07:12 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:07:12 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[320f473c-078e-40de-88f8-d6a52f486df7]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9511387c-8772-40f2-bf2d-6b6387649e9f (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9aad94d-fe0d-415d-9761-9aff25cc6099 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8c53a27-dcde-402b-a9bb-d8642f7db0da (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b6f3ecd2-9394-4935-a659-96e74bd25348 (non-flash)\n', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 18:07:12 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-09478508-b171-47b9-a6d3-a70140bebb76 tempest-TestStampPattern-2144166935 tempest-TestStampPattern-2144166935-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9511387c-8772-40f2-bf2d-6b6387649e9f (non-flash)
Nov 29 18:07:12 user nova-compute[74613]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9aad94d-fe0d-415d-9761-9aff25cc6099 (non-flash)
Nov 29 18:07:12 user nova-compute[74613]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8c53a27-dcde-402b-a9bb-d8642f7db0da (non-flash)
Nov 29 18:07:12 user nova-compute[74613]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b6f3ecd2-9394-4935-a659-96e74bd25348 (non-flash)
Nov 29 18:07:12 user nova-compute[74613]:  stderr= {{(pid=74613) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 18:07:12 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-09478508-b171-47b9-a6d3-a70140bebb76 tempest-TestStampPattern-2144166935 tempest-TestStampPattern-2144166935-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9511387c-8772-40f2-bf2d-6b6387649e9f (non-flash)
Nov 29 18:07:12 user nova-compute[74613]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9aad94d-fe0d-415d-9761-9aff25cc6099 (non-flash)
Nov 29 18:07:12 user nova-compute[74613]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8c53a27-dcde-402b-a9bb-d8642f7db0da (non-flash)
Nov 29 18:07:12 user nova-compute[74613]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b6f3ecd2-9394-4935-a659-96e74bd25348 (non-flash)
Nov 29 18:07:12 user nova-compute[74613]:  stderr= {{(pid=74613) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 18:07:12 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.base [None req-09478508-b171-47b9-a6d3-a70140bebb76 tempest-TestStampPattern-2144166935 tempest-TestStampPattern-2144166935-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b6f3ecd2-9394-4935-a659-96e74bd25348" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.278s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 18:07:12 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-09478508-b171-47b9-a6d3-a70140bebb76 tempest-TestStampPattern-2144166935 tempest-TestStampPattern-2144166935-project-member] Connected to 172.16.0.220:3260 {{(pid=74613) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 29 18:07:12 user nova-compute[74613]: DEBUG os_brick.initiator.linuxscsi [None req-09478508-b171-47b9-a6d3-a70140bebb76 tempest-TestStampPattern-2144166935 tempest-TestStampPattern-2144166935-project-member] HCTL ('35', '-', '-', 0) found on session 34 with lun 0 {{(pid=74613) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 29 18:07:12 user nova-compute[74613]: DEBUG os_brick.initiator.linuxscsi [None req-09478508-b171-47b9-a6d3-a70140bebb76 tempest-TestStampPattern-2144166935 tempest-TestStampPattern-2144166935-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=74613) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 29 18:07:12 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:07:13 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.017s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:07:13 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[f842437a-eebe-4fe5-b3b3-938f9fdeaa7c]: (4, ('- - 0', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 18:07:13 user nova-compute[74613]: DEBUG os_brick.initiator.linuxscsi [None req-09478508-b171-47b9-a6d3-a70140bebb76 tempest-TestStampPattern-2144166935 tempest-TestStampPattern-2144166935-project-member] Searching for a device in session 34 and hctl ['35', '*', '*', 0] yield: None {{(pid=74613) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 29 18:07:13 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:07:14 user nova-compute[74613]: DEBUG os_brick.initiator.linuxscsi [None req-09478508-b171-47b9-a6d3-a70140bebb76 tempest-TestStampPattern-2144166935 tempest-TestStampPattern-2144166935-project-member] Searching for a device in session 34 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=74613) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 29 18:07:14 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-09478508-b171-47b9-a6d3-a70140bebb76 tempest-TestStampPattern-2144166935 tempest-TestStampPattern-2144166935-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:b6f3ecd2-9394-4935-a659-96e74bd25348', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'tCAhdlKv', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74613) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 29 18:07:14 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.base [None req-09478508-b171-47b9-a6d3-a70140bebb76 tempest-TestStampPattern-2144166935 tempest-TestStampPattern-2144166935-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.311s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 18:07:14 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-09478508-b171-47b9-a6d3-a70140bebb76 tempest-TestStampPattern-2144166935 tempest-TestStampPattern-2144166935-project-member] <== connect_volume: return (1313ms) {'type': 'block', 'scsi_wwn': '23730306433323538', 'path': '/dev/sdd'} {{(pid=74613) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 18:07:14 user nova-compute[74613]: DEBUG nova.virt.libvirt.volume.iscsi [None req-09478508-b171-47b9-a6d3-a70140bebb76 tempest-TestStampPattern-2144166935 tempest-TestStampPattern-2144166935-project-member] [instance: 9eb14feb-f196-42b1-a6ba-2a049dea2d5e] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23730306433323538', 'path': '/dev/sdd'} {{(pid=74613) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 29 18:07:14 user nova-compute[74613]: DEBUG nova.objects.instance [None req-09478508-b171-47b9-a6d3-a70140bebb76 tempest-TestStampPattern-2144166935 tempest-TestStampPattern-2144166935-project-member] Lazy-loading 'flavor' on Instance uuid 9eb14feb-f196-42b1-a6ba-2a049dea2d5e {{(pid=74613) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 18:07:14 user nova-compute[74613]: DEBUG nova.virt.libvirt.guest [None req-09478508-b171-47b9-a6d3-a70140bebb76 tempest-TestStampPattern-2144166935 tempest-TestStampPattern-2144166935-project-member] attach device xml: <disk type="block" device="disk">
Nov 29 18:07:14 user nova-compute[74613]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 18:07:14 user nova-compute[74613]:   <source dev="/dev/sdd"/>
Nov 29 18:07:14 user nova-compute[74613]:   <target dev="vdb" bus="virtio"/>
Nov 29 18:07:14 user nova-compute[74613]:   <serial>b6f3ecd2-9394-4935-a659-96e74bd25348</serial>
Nov 29 18:07:14 user nova-compute[74613]: </disk>
Nov 29 18:07:14 user nova-compute[74613]:  {{(pid=74613) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 29 18:07:14 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-09478508-b171-47b9-a6d3-a70140bebb76 tempest-TestStampPattern-2144166935 tempest-TestStampPattern-2144166935-project-member] No BDM found with device name vda, not building metadata. {{(pid=74613) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 18:07:14 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-09478508-b171-47b9-a6d3-a70140bebb76 tempest-TestStampPattern-2144166935 tempest-TestStampPattern-2144166935-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74613) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 18:07:14 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-09478508-b171-47b9-a6d3-a70140bebb76 tempest-TestStampPattern-2144166935 tempest-TestStampPattern-2144166935-project-member] No VIF found with MAC fa:16:3e:ba:49:9d, not building metadata {{(pid=74613) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 29 18:07:14 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-09478508-b171-47b9-a6d3-a70140bebb76 tempest-TestStampPattern-2144166935 tempest-TestStampPattern-2144166935-project-member] Lock "9eb14feb-f196-42b1-a6ba-2a049dea2d5e" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 11.040s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 18:07:15 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:07:17 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-9e29e0a0-b87a-43c9-ba84-9d74b99248cc tempest-TestStampPattern-2144166935 tempest-TestStampPattern-2144166935-project-member] Acquiring lock "9eb14feb-f196-42b1-a6ba-2a049dea2d5e" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 18:07:17 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-9e29e0a0-b87a-43c9-ba84-9d74b99248cc tempest-TestStampPattern-2144166935 tempest-TestStampPattern-2144166935-project-member] Lock "9eb14feb-f196-42b1-a6ba-2a049dea2d5e" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.002s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 18:07:17 user nova-compute[74613]: INFO nova.compute.manager [None req-9e29e0a0-b87a-43c9-ba84-9d74b99248cc tempest-TestStampPattern-2144166935 tempest-TestStampPattern-2144166935-project-member] [instance: 9eb14feb-f196-42b1-a6ba-2a049dea2d5e] Detaching volume b6f3ecd2-9394-4935-a659-96e74bd25348
Nov 29 18:07:17 user nova-compute[74613]: INFO nova.virt.block_device [None req-9e29e0a0-b87a-43c9-ba84-9d74b99248cc tempest-TestStampPattern-2144166935 tempest-TestStampPattern-2144166935-project-member] [instance: 9eb14feb-f196-42b1-a6ba-2a049dea2d5e] Attempting to driver detach volume b6f3ecd2-9394-4935-a659-96e74bd25348 from mountpoint /dev/vdb
Nov 29 18:07:17 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-9e29e0a0-b87a-43c9-ba84-9d74b99248cc tempest-TestStampPattern-2144166935 tempest-TestStampPattern-2144166935-project-member] Attempting to detach device vdb from instance 9eb14feb-f196-42b1-a6ba-2a049dea2d5e from the persistent domain config. {{(pid=74613) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 29 18:07:17 user nova-compute[74613]: DEBUG nova.virt.libvirt.guest [None req-9e29e0a0-b87a-43c9-ba84-9d74b99248cc tempest-TestStampPattern-2144166935 tempest-TestStampPattern-2144166935-project-member] detach device xml: <disk type="block" device="disk">
Nov 29 18:07:17 user nova-compute[74613]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 18:07:17 user nova-compute[74613]:   <source dev="/dev/sdd"/>
Nov 29 18:07:17 user nova-compute[74613]:   <target dev="vdb" bus="virtio"/>
Nov 29 18:07:17 user nova-compute[74613]:   <serial>b6f3ecd2-9394-4935-a659-96e74bd25348</serial>
Nov 29 18:07:17 user nova-compute[74613]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 29 18:07:17 user nova-compute[74613]: </disk>
Nov 29 18:07:17 user nova-compute[74613]:  {{(pid=74613) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 29 18:07:17 user nova-compute[74613]: INFO nova.virt.libvirt.driver [None req-9e29e0a0-b87a-43c9-ba84-9d74b99248cc tempest-TestStampPattern-2144166935 tempest-TestStampPattern-2144166935-project-member] Successfully detached device vdb from instance 9eb14feb-f196-42b1-a6ba-2a049dea2d5e from the persistent domain config.
Nov 29 18:07:17 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-9e29e0a0-b87a-43c9-ba84-9d74b99248cc tempest-TestStampPattern-2144166935 tempest-TestStampPattern-2144166935-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 9eb14feb-f196-42b1-a6ba-2a049dea2d5e from the live domain config. {{(pid=74613) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 29 18:07:17 user nova-compute[74613]: DEBUG nova.virt.libvirt.guest [None req-9e29e0a0-b87a-43c9-ba84-9d74b99248cc tempest-TestStampPattern-2144166935 tempest-TestStampPattern-2144166935-project-member] detach device xml: <disk type="block" device="disk">
Nov 29 18:07:17 user nova-compute[74613]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 18:07:17 user nova-compute[74613]:   <source dev="/dev/sdd"/>
Nov 29 18:07:17 user nova-compute[74613]:   <target dev="vdb" bus="virtio"/>
Nov 29 18:07:17 user nova-compute[74613]:   <serial>b6f3ecd2-9394-4935-a659-96e74bd25348</serial>
Nov 29 18:07:17 user nova-compute[74613]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 29 18:07:17 user nova-compute[74613]: </disk>
Nov 29 18:07:17 user nova-compute[74613]:  {{(pid=74613) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 29 18:07:17 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-9e29e0a0-b87a-43c9-ba84-9d74b99248cc tempest-TestStampPattern-2144166935 tempest-TestStampPattern-2144166935-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 9eb14feb-f196-42b1-a6ba-2a049dea2d5e {{(pid=74613) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 29 18:07:18 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:07:20 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:07:20 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:07:23 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:07:25 user nova-compute[74613]: DEBUG oslo_service.periodic_task [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74613) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 18:07:25 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 18:07:25 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 18:07:25 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 18:07:25 user nova-compute[74613]: DEBUG nova.compute.resource_tracker [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Auditing locally available compute resources for user (node: user) {{(pid=74613) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 29 18:07:25 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=74613) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 29 18:07:25 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/69109f06-acbf-4834-b05e-80ab6e3f6ea0/disk --force-share --output=json {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:07:25 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/69109f06-acbf-4834-b05e-80ab6e3f6ea0/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:07:25 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/69109f06-acbf-4834-b05e-80ab6e3f6ea0/disk --force-share --output=json {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:07:26 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/69109f06-acbf-4834-b05e-80ab6e3f6ea0/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:07:26 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9eb14feb-f196-42b1-a6ba-2a049dea2d5e/disk --force-share --output=json {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:07:26 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9eb14feb-f196-42b1-a6ba-2a049dea2d5e/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:07:26 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9eb14feb-f196-42b1-a6ba-2a049dea2d5e/disk --force-share --output=json {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:07:26 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9eb14feb-f196-42b1-a6ba-2a049dea2d5e/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:07:26 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=74613) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 29 18:07:26 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d3c285cd-9f39-423c-a324-30a48a9c66be/disk.rescue --force-share --output=json {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:07:26 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d3c285cd-9f39-423c-a324-30a48a9c66be/disk.rescue --force-share --output=json" returned: 0 in 0.186s {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:07:26 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d3c285cd-9f39-423c-a324-30a48a9c66be/disk.rescue --force-share --output=json {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:07:26 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d3c285cd-9f39-423c-a324-30a48a9c66be/disk.rescue --force-share --output=json" returned: 0 in 0.171s {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:07:26 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f4a1329-b3b9-4d1c-8735-abddabc359fd/disk.rescue --force-share --output=json {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:07:27 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f4a1329-b3b9-4d1c-8735-abddabc359fd/disk.rescue --force-share --output=json" returned: 0 in 0.175s {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:07:27 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f4a1329-b3b9-4d1c-8735-abddabc359fd/disk.rescue --force-share --output=json {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:07:27 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f4a1329-b3b9-4d1c-8735-abddabc359fd/disk.rescue --force-share --output=json" returned: 0 in 0.185s {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:07:27 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f4a1329-b3b9-4d1c-8735-abddabc359fd/disk --force-share --output=json {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:07:27 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f4a1329-b3b9-4d1c-8735-abddabc359fd/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:07:27 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f4a1329-b3b9-4d1c-8735-abddabc359fd/disk --force-share --output=json {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:07:27 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f4a1329-b3b9-4d1c-8735-abddabc359fd/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:07:27 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3b828860-5cc5-40b0-b845-8e560211794e/disk --force-share --output=json {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:07:27 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3b828860-5cc5-40b0-b845-8e560211794e/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:07:27 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3b828860-5cc5-40b0-b845-8e560211794e/disk --force-share --output=json {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:07:28 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3b828860-5cc5-40b0-b845-8e560211794e/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:07:28 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/abc9e2b8-f467-4cd0-b40f-de511fde1ec1/disk --force-share --output=json {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:07:28 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/abc9e2b8-f467-4cd0-b40f-de511fde1ec1/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:07:28 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/abc9e2b8-f467-4cd0-b40f-de511fde1ec1/disk --force-share --output=json {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:07:28 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 18:07:28 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/abc9e2b8-f467-4cd0-b40f-de511fde1ec1/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:07:28 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6993e2e7-7e03-45b4-9d3d-3742589b6078/disk --force-share --output=json {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:07:28 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6993e2e7-7e03-45b4-9d3d-3742589b6078/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:07:28 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6993e2e7-7e03-45b4-9d3d-3742589b6078/disk --force-share --output=json {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:07:28 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6993e2e7-7e03-45b4-9d3d-3742589b6078/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:07:28 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74613) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 29 18:07:28 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8fc8496b-1435-4b5f-8977-6c0d7467ef65/disk --force-share --output=json {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:07:28 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8fc8496b-1435-4b5f-8977-6c0d7467ef65/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:07:28 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8fc8496b-1435-4b5f-8977-6c0d7467ef65/disk --force-share --output=json {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:07:29 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8fc8496b-1435-4b5f-8977-6c0d7467ef65/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:07:29 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e2439d62-4713-435d-81ce-fafe1d811b47/disk --force-share --output=json {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:07:29 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e2439d62-4713-435d-81ce-fafe1d811b47/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:07:29 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e2439d62-4713-435d-81ce-fafe1d811b47/disk --force-share --output=json {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:07:29 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e2439d62-4713-435d-81ce-fafe1d811b47/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:07:29 user nova-compute[74613]: WARNING nova.virt.libvirt.driver [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 18:07:29 user nova-compute[74613]: WARNING nova.virt.libvirt.driver [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 18:07:29 user nova-compute[74613]: DEBUG nova.compute.resource_tracker [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Hypervisor/Node resource view: name=user free_ram=7565MB free_disk=24.737247467041016GB free_vcpus=1 pci_devices=[{"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74613) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 29 18:07:29 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 18:07:29 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 18:07:30 user nova-compute[74613]: DEBUG nova.compute.resource_tracker [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Instance 3b828860-5cc5-40b0-b845-8e560211794e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74613) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 18:07:30 user nova-compute[74613]: DEBUG nova.compute.resource_tracker [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Instance abc9e2b8-f467-4cd0-b40f-de511fde1ec1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74613) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 18:07:30 user nova-compute[74613]: DEBUG nova.compute.resource_tracker [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Instance cd22685a-028c-4e0c-834d-e7b20f6d06ab actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74613) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 18:07:30 user nova-compute[74613]: DEBUG nova.compute.resource_tracker [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Instance 8fc8496b-1435-4b5f-8977-6c0d7467ef65 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74613) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 18:07:30 user nova-compute[74613]: DEBUG nova.compute.resource_tracker [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Instance d3c285cd-9f39-423c-a324-30a48a9c66be actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74613) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 18:07:30 user nova-compute[74613]: DEBUG nova.compute.resource_tracker [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Instance 6993e2e7-7e03-45b4-9d3d-3742589b6078 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74613) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 18:07:30 user nova-compute[74613]: DEBUG nova.compute.resource_tracker [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Instance 6f4a1329-b3b9-4d1c-8735-abddabc359fd actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74613) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 18:07:30 user nova-compute[74613]: DEBUG nova.compute.resource_tracker [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Instance e9acfa30-4ec2-4540-ac34-4c66db3228e1 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=74613) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 18:07:30 user nova-compute[74613]: DEBUG nova.compute.resource_tracker [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Instance 9eb14feb-f196-42b1-a6ba-2a049dea2d5e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74613) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 18:07:30 user nova-compute[74613]: DEBUG nova.compute.resource_tracker [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Instance 69109f06-acbf-4834-b05e-80ab6e3f6ea0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74613) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 18:07:30 user nova-compute[74613]: DEBUG nova.compute.resource_tracker [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Instance e2439d62-4713-435d-81ce-fafe1d811b47 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74613) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 18:07:30 user nova-compute[74613]: DEBUG nova.compute.resource_tracker [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Total usable vcpus: 12, total allocated vcpus: 11 {{(pid=74613) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 29 18:07:30 user nova-compute[74613]: DEBUG nova.compute.resource_tracker [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Final resource view: name=user phys_ram=16011MB used_ram=7680MB phys_disk=40GB used_disk=8GB total_vcpus=12 used_vcpus=11 pci_stats=[] {{(pid=74613) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 29 18:07:30 user nova-compute[74613]: DEBUG nova.scheduler.client.report [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Refreshing inventories for resource provider 639d980e-3b12-44b1-b8f4-1812416fa4dd {{(pid=74613) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 29 18:07:30 user nova-compute[74613]: DEBUG nova.scheduler.client.report [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Updating ProviderTree inventory for provider 639d980e-3b12-44b1-b8f4-1812416fa4dd from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74613) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 29 18:07:30 user nova-compute[74613]: DEBUG nova.compute.provider_tree [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Updating inventory in ProviderTree for provider 639d980e-3b12-44b1-b8f4-1812416fa4dd with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74613) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 29 18:07:30 user nova-compute[74613]: DEBUG nova.scheduler.client.report [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Refreshing aggregate associations for resource provider 639d980e-3b12-44b1-b8f4-1812416fa4dd, aggregates: None {{(pid=74613) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 29 18:07:30 user nova-compute[74613]: DEBUG nova.scheduler.client.report [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Refreshing trait associations for resource provider 639d980e-3b12-44b1-b8f4-1812416fa4dd, traits: HW_CPU_X86_SSE,COMPUTE_VOLUME_EXTEND,COMPUTE_ACCELERATORS,HW_CPU_X86_SSE41,COMPUTE_STORAGE_BUS_IDE,COMPUTE_NODE,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,HW_CPU_X86_MMX,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,HW_CPU_X86_SSE2,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_STORAGE_BUS_USB,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_STORAGE_BUS_SATA,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_DEVICE_TAGGING,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_RESCUE_BFV,HW_CPU_X86_SSSE3,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_TRUSTED_CERTS,HW_CPU_X86_SSE42,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_STORAGE_BUS_FDC {{(pid=74613) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 29 18:07:30 user nova-compute[74613]: DEBUG nova.compute.provider_tree [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Inventory has not changed in ProviderTree for provider: 639d980e-3b12-44b1-b8f4-1812416fa4dd {{(pid=74613) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 18:07:30 user nova-compute[74613]: DEBUG nova.scheduler.client.report [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Inventory has not changed for provider 639d980e-3b12-44b1-b8f4-1812416fa4dd based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74613) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 18:07:30 user nova-compute[74613]: DEBUG nova.compute.resource_tracker [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Compute_service record updated for user:user {{(pid=74613) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 29 18:07:30 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.756s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 18:07:30 user nova-compute[74613]: DEBUG oslo_service.periodic_task [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=74613) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 18:07:30 user nova-compute[74613]: DEBUG nova.compute.manager [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Cleaning up deleted instances {{(pid=74613) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 29 18:07:30 user nova-compute[74613]: DEBUG nova.compute.manager [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] There are 0 instances to clean {{(pid=74613) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 29 18:07:31 user nova-compute[74613]: DEBUG oslo_service.periodic_task [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74613) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 18:07:31 user nova-compute[74613]: DEBUG oslo_service.periodic_task [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74613) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 18:07:31 user nova-compute[74613]: DEBUG nova.compute.manager [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Starting heal instance info cache {{(pid=74613) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 29 18:07:31 user nova-compute[74613]: INFO nova.compute.manager [None req-a1e338ca-ccee-4cf6-8723-73ae43416c7e tempest-ServerBootFromVolumeStableRescueTest-414665510 tempest-ServerBootFromVolumeStableRescueTest-414665510-project-member] [instance: d3c285cd-9f39-423c-a324-30a48a9c66be] Unrescuing
Nov 29 18:07:31 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-a1e338ca-ccee-4cf6-8723-73ae43416c7e tempest-ServerBootFromVolumeStableRescueTest-414665510 tempest-ServerBootFromVolumeStableRescueTest-414665510-project-member] Acquiring lock "refresh_cache-d3c285cd-9f39-423c-a324-30a48a9c66be" {{(pid=74613) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 18:07:31 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-a1e338ca-ccee-4cf6-8723-73ae43416c7e tempest-ServerBootFromVolumeStableRescueTest-414665510 tempest-ServerBootFromVolumeStableRescueTest-414665510-project-member] Acquired lock "refresh_cache-d3c285cd-9f39-423c-a324-30a48a9c66be" {{(pid=74613) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 18:07:31 user nova-compute[74613]: DEBUG nova.network.neutron [None req-a1e338ca-ccee-4cf6-8723-73ae43416c7e tempest-ServerBootFromVolumeStableRescueTest-414665510 tempest-ServerBootFromVolumeStableRescueTest-414665510-project-member] [instance: d3c285cd-9f39-423c-a324-30a48a9c66be] Building network info cache for instance {{(pid=74613) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 29 18:07:31 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Acquiring lock "refresh_cache-8fc8496b-1435-4b5f-8977-6c0d7467ef65" {{(pid=74613) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 18:07:31 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Acquired lock "refresh_cache-8fc8496b-1435-4b5f-8977-6c0d7467ef65" {{(pid=74613) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 18:07:31 user nova-compute[74613]: DEBUG nova.network.neutron [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] [instance: 8fc8496b-1435-4b5f-8977-6c0d7467ef65] Forcefully refreshing network info cache for instance {{(pid=74613) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 29 18:07:32 user nova-compute[74613]: DEBUG nova.network.neutron [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] [instance: 8fc8496b-1435-4b5f-8977-6c0d7467ef65] Updating instance_info_cache with network_info: [{"id": "ddd4e4e3-180b-42bd-8c21-d3bb61438395", "address": "fa:16:3e:43:4c:c1", "network": {"id": "0722b02d-a357-4360-87e8-580913723985", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-579793494-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b820dd795dfe46cd804772f0e71f98e9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapddd4e4e3-18", "ovs_interfaceid": "ddd4e4e3-180b-42bd-8c21-d3bb61438395", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74613) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 18:07:32 user nova-compute[74613]: DEBUG nova.network.neutron [None req-a1e338ca-ccee-4cf6-8723-73ae43416c7e tempest-ServerBootFromVolumeStableRescueTest-414665510 tempest-ServerBootFromVolumeStableRescueTest-414665510-project-member] [instance: d3c285cd-9f39-423c-a324-30a48a9c66be] Updating instance_info_cache with network_info: [{"id": "663e4724-b31b-469d-a5ea-c2802db1e0c8", "address": "fa:16:3e:11:80:42", "network": {"id": "0722b02d-a357-4360-87e8-580913723985", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-579793494-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b820dd795dfe46cd804772f0e71f98e9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap663e4724-b3", "ovs_interfaceid": "663e4724-b31b-469d-a5ea-c2802db1e0c8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74613) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 18:07:32 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-a1e338ca-ccee-4cf6-8723-73ae43416c7e tempest-ServerBootFromVolumeStableRescueTest-414665510 tempest-ServerBootFromVolumeStableRescueTest-414665510-project-member] Releasing lock "refresh_cache-d3c285cd-9f39-423c-a324-30a48a9c66be" {{(pid=74613) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 18:07:32 user nova-compute[74613]: DEBUG nova.objects.instance [None req-a1e338ca-ccee-4cf6-8723-73ae43416c7e tempest-ServerBootFromVolumeStableRescueTest-414665510 tempest-ServerBootFromVolumeStableRescueTest-414665510-project-member] Lazy-loading 'flavor' on Instance uuid d3c285cd-9f39-423c-a324-30a48a9c66be {{(pid=74613) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 18:07:32 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Releasing lock "refresh_cache-8fc8496b-1435-4b5f-8977-6c0d7467ef65" {{(pid=74613) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 18:07:32 user nova-compute[74613]: DEBUG nova.compute.manager [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] [instance: 8fc8496b-1435-4b5f-8977-6c0d7467ef65] Updated the network info_cache for instance {{(pid=74613) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 29 18:07:32 user nova-compute[74613]: DEBUG oslo_service.periodic_task [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74613) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 18:07:32 user nova-compute[74613]: DEBUG oslo_service.periodic_task [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74613) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 18:07:32 user nova-compute[74613]: DEBUG oslo_service.periodic_task [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74613) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 18:07:32 user nova-compute[74613]: DEBUG oslo_service.periodic_task [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74613) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 18:07:32 user nova-compute[74613]: DEBUG oslo_service.periodic_task [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74613) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 18:07:32 user nova-compute[74613]: DEBUG nova.compute.manager [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74613) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 29 18:07:32 user nova-compute[74613]: DEBUG oslo_service.periodic_task [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=74613) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 18:07:32 user nova-compute[74613]: DEBUG nova.compute.manager [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Cleaning up deleted instances with incomplete migration  {{(pid=74613) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 29 18:07:32 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:07:32 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:07:32 user nova-compute[74613]: DEBUG nova.compute.manager [req-d6d40921-7eb3-4b29-b2b9-33c2880072c7 req-efb3535a-b4f5-45a8-b1f7-cebdd5184560 service nova] [instance: d3c285cd-9f39-423c-a324-30a48a9c66be] Received event network-vif-unplugged-663e4724-b31b-469d-a5ea-c2802db1e0c8 {{(pid=74613) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 18:07:32 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-d6d40921-7eb3-4b29-b2b9-33c2880072c7 req-efb3535a-b4f5-45a8-b1f7-cebdd5184560 service nova] Acquiring lock "d3c285cd-9f39-423c-a324-30a48a9c66be-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 18:07:32 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-d6d40921-7eb3-4b29-b2b9-33c2880072c7 req-efb3535a-b4f5-45a8-b1f7-cebdd5184560 service nova] Lock "d3c285cd-9f39-423c-a324-30a48a9c66be-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 18:07:32 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-d6d40921-7eb3-4b29-b2b9-33c2880072c7 req-efb3535a-b4f5-45a8-b1f7-cebdd5184560 service nova] Lock "d3c285cd-9f39-423c-a324-30a48a9c66be-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 18:07:32 user nova-compute[74613]: DEBUG nova.compute.manager [req-d6d40921-7eb3-4b29-b2b9-33c2880072c7 req-efb3535a-b4f5-45a8-b1f7-cebdd5184560 service nova] [instance: d3c285cd-9f39-423c-a324-30a48a9c66be] No waiting events found dispatching network-vif-unplugged-663e4724-b31b-469d-a5ea-c2802db1e0c8 {{(pid=74613) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 18:07:32 user nova-compute[74613]: WARNING nova.compute.manager [req-d6d40921-7eb3-4b29-b2b9-33c2880072c7 req-efb3535a-b4f5-45a8-b1f7-cebdd5184560 service nova] [instance: d3c285cd-9f39-423c-a324-30a48a9c66be] Received unexpected event network-vif-unplugged-663e4724-b31b-469d-a5ea-c2802db1e0c8 for instance with vm_state rescued and task_state unrescuing.
Nov 29 18:07:32 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:07:32 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:07:33 user nova-compute[74613]: INFO nova.virt.libvirt.driver [-] [instance: d3c285cd-9f39-423c-a324-30a48a9c66be] Instance destroyed successfully.
Nov 29 18:07:33 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:07:33 user nova-compute[74613]: DEBUG oslo_service.periodic_task [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74613) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 18:07:33 user nova-compute[74613]: DEBUG oslo_service.periodic_task [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74613) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 18:07:34 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:07:34 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:07:34 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:07:34 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:07:34 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:07:34 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:07:34 user nova-compute[74613]: DEBUG nova.compute.manager [req-5ba58a57-8374-42d2-acde-e69f4018bbbc req-330d2cc0-44c4-48cc-ad49-a69cd5fb6d82 service nova] [instance: d3c285cd-9f39-423c-a324-30a48a9c66be] Received event network-vif-plugged-663e4724-b31b-469d-a5ea-c2802db1e0c8 {{(pid=74613) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 18:07:34 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-5ba58a57-8374-42d2-acde-e69f4018bbbc req-330d2cc0-44c4-48cc-ad49-a69cd5fb6d82 service nova] Acquiring lock "d3c285cd-9f39-423c-a324-30a48a9c66be-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 18:07:34 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-5ba58a57-8374-42d2-acde-e69f4018bbbc req-330d2cc0-44c4-48cc-ad49-a69cd5fb6d82 service nova] Lock "d3c285cd-9f39-423c-a324-30a48a9c66be-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 18:07:34 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-5ba58a57-8374-42d2-acde-e69f4018bbbc req-330d2cc0-44c4-48cc-ad49-a69cd5fb6d82 service nova] Lock "d3c285cd-9f39-423c-a324-30a48a9c66be-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 18:07:34 user nova-compute[74613]: DEBUG nova.compute.manager [req-5ba58a57-8374-42d2-acde-e69f4018bbbc req-330d2cc0-44c4-48cc-ad49-a69cd5fb6d82 service nova] [instance: d3c285cd-9f39-423c-a324-30a48a9c66be] No waiting events found dispatching network-vif-plugged-663e4724-b31b-469d-a5ea-c2802db1e0c8 {{(pid=74613) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 18:07:34 user nova-compute[74613]: WARNING nova.compute.manager [req-5ba58a57-8374-42d2-acde-e69f4018bbbc req-330d2cc0-44c4-48cc-ad49-a69cd5fb6d82 service nova] [instance: d3c285cd-9f39-423c-a324-30a48a9c66be] Received unexpected event network-vif-plugged-663e4724-b31b-469d-a5ea-c2802db1e0c8 for instance with vm_state rescued and task_state unrescuing.
Nov 29 18:07:34 user nova-compute[74613]: DEBUG nova.compute.manager [req-5ba58a57-8374-42d2-acde-e69f4018bbbc req-330d2cc0-44c4-48cc-ad49-a69cd5fb6d82 service nova] [instance: d3c285cd-9f39-423c-a324-30a48a9c66be] Received event network-vif-plugged-663e4724-b31b-469d-a5ea-c2802db1e0c8 {{(pid=74613) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 18:07:34 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-5ba58a57-8374-42d2-acde-e69f4018bbbc req-330d2cc0-44c4-48cc-ad49-a69cd5fb6d82 service nova] Acquiring lock "d3c285cd-9f39-423c-a324-30a48a9c66be-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 18:07:34 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-5ba58a57-8374-42d2-acde-e69f4018bbbc req-330d2cc0-44c4-48cc-ad49-a69cd5fb6d82 service nova] Lock "d3c285cd-9f39-423c-a324-30a48a9c66be-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 18:07:34 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-5ba58a57-8374-42d2-acde-e69f4018bbbc req-330d2cc0-44c4-48cc-ad49-a69cd5fb6d82 service nova] Lock "d3c285cd-9f39-423c-a324-30a48a9c66be-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 18:07:34 user nova-compute[74613]: DEBUG nova.compute.manager [req-5ba58a57-8374-42d2-acde-e69f4018bbbc req-330d2cc0-44c4-48cc-ad49-a69cd5fb6d82 service nova] [instance: d3c285cd-9f39-423c-a324-30a48a9c66be] No waiting events found dispatching network-vif-plugged-663e4724-b31b-469d-a5ea-c2802db1e0c8 {{(pid=74613) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 18:07:34 user nova-compute[74613]: WARNING nova.compute.manager [req-5ba58a57-8374-42d2-acde-e69f4018bbbc req-330d2cc0-44c4-48cc-ad49-a69cd5fb6d82 service nova] [instance: d3c285cd-9f39-423c-a324-30a48a9c66be] Received unexpected event network-vif-plugged-663e4724-b31b-469d-a5ea-c2802db1e0c8 for instance with vm_state rescued and task_state unrescuing.
Nov 29 18:07:35 user nova-compute[74613]: DEBUG nova.compute.manager [req-9e87604f-1118-4df0-b00a-eaadc5174d85 req-aa4481d5-46ea-46f9-959e-b27d708ce29b service nova] [instance: 69109f06-acbf-4834-b05e-80ab6e3f6ea0] Received event network-changed-e8b2f9b5-0c3a-4f6f-bf96-566c8a779849 {{(pid=74613) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 18:07:35 user nova-compute[74613]: DEBUG nova.compute.manager [req-9e87604f-1118-4df0-b00a-eaadc5174d85 req-aa4481d5-46ea-46f9-959e-b27d708ce29b service nova] [instance: 69109f06-acbf-4834-b05e-80ab6e3f6ea0] Refreshing instance network info cache due to event network-changed-e8b2f9b5-0c3a-4f6f-bf96-566c8a779849. {{(pid=74613) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 18:07:35 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-9e87604f-1118-4df0-b00a-eaadc5174d85 req-aa4481d5-46ea-46f9-959e-b27d708ce29b service nova] Acquiring lock "refresh_cache-69109f06-acbf-4834-b05e-80ab6e3f6ea0" {{(pid=74613) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 18:07:35 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-9e87604f-1118-4df0-b00a-eaadc5174d85 req-aa4481d5-46ea-46f9-959e-b27d708ce29b service nova] Acquired lock "refresh_cache-69109f06-acbf-4834-b05e-80ab6e3f6ea0" {{(pid=74613) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 18:07:35 user nova-compute[74613]: DEBUG nova.network.neutron [req-9e87604f-1118-4df0-b00a-eaadc5174d85 req-aa4481d5-46ea-46f9-959e-b27d708ce29b service nova] [instance: 69109f06-acbf-4834-b05e-80ab6e3f6ea0] Refreshing network info cache for port e8b2f9b5-0c3a-4f6f-bf96-566c8a779849 {{(pid=74613) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 18:07:35 user nova-compute[74613]: DEBUG nova.network.neutron [req-9e87604f-1118-4df0-b00a-eaadc5174d85 req-aa4481d5-46ea-46f9-959e-b27d708ce29b service nova] [instance: 69109f06-acbf-4834-b05e-80ab6e3f6ea0] Updated VIF entry in instance network info cache for port e8b2f9b5-0c3a-4f6f-bf96-566c8a779849. {{(pid=74613) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 18:07:35 user nova-compute[74613]: DEBUG nova.network.neutron [req-9e87604f-1118-4df0-b00a-eaadc5174d85 req-aa4481d5-46ea-46f9-959e-b27d708ce29b service nova] [instance: 69109f06-acbf-4834-b05e-80ab6e3f6ea0] Updating instance_info_cache with network_info: [{"id": "e8b2f9b5-0c3a-4f6f-bf96-566c8a779849", "address": "fa:16:3e:da:7a:47", "network": {"id": "21147bc8-b1ac-40d5-8fc0-8dab8ade1ff5", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1502381061-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.246", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b5dc39bc30d84269a7ad073867e36436", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape8b2f9b5-0c", "ovs_interfaceid": "e8b2f9b5-0c3a-4f6f-bf96-566c8a779849", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74613) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 18:07:35 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-9e87604f-1118-4df0-b00a-eaadc5174d85 req-aa4481d5-46ea-46f9-959e-b27d708ce29b service nova] Releasing lock "refresh_cache-69109f06-acbf-4834-b05e-80ab6e3f6ea0" {{(pid=74613) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 18:07:35 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:07:35 user nova-compute[74613]: DEBUG nova.compute.manager [req-5d0e05be-de54-428c-85f3-5a2a40223d2e req-0f904b1c-f949-4342-8ab9-7f11665742d8 service nova] [instance: e2439d62-4713-435d-81ce-fafe1d811b47] Received event network-changed-50079e9e-673c-4a5a-8f32-56d794575fdf {{(pid=74613) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 18:07:35 user nova-compute[74613]: DEBUG nova.compute.manager [req-5d0e05be-de54-428c-85f3-5a2a40223d2e req-0f904b1c-f949-4342-8ab9-7f11665742d8 service nova] [instance: e2439d62-4713-435d-81ce-fafe1d811b47] Refreshing instance network info cache due to event network-changed-50079e9e-673c-4a5a-8f32-56d794575fdf. {{(pid=74613) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 18:07:35 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-5d0e05be-de54-428c-85f3-5a2a40223d2e req-0f904b1c-f949-4342-8ab9-7f11665742d8 service nova] Acquiring lock "refresh_cache-e2439d62-4713-435d-81ce-fafe1d811b47" {{(pid=74613) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 18:07:35 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-5d0e05be-de54-428c-85f3-5a2a40223d2e req-0f904b1c-f949-4342-8ab9-7f11665742d8 service nova] Acquired lock "refresh_cache-e2439d62-4713-435d-81ce-fafe1d811b47" {{(pid=74613) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 18:07:35 user nova-compute[74613]: DEBUG nova.network.neutron [req-5d0e05be-de54-428c-85f3-5a2a40223d2e req-0f904b1c-f949-4342-8ab9-7f11665742d8 service nova] [instance: e2439d62-4713-435d-81ce-fafe1d811b47] Refreshing network info cache for port 50079e9e-673c-4a5a-8f32-56d794575fdf {{(pid=74613) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 18:07:36 user nova-compute[74613]: DEBUG nova.network.neutron [req-5d0e05be-de54-428c-85f3-5a2a40223d2e req-0f904b1c-f949-4342-8ab9-7f11665742d8 service nova] [instance: e2439d62-4713-435d-81ce-fafe1d811b47] Updated VIF entry in instance network info cache for port 50079e9e-673c-4a5a-8f32-56d794575fdf. {{(pid=74613) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 18:07:36 user nova-compute[74613]: DEBUG nova.network.neutron [req-5d0e05be-de54-428c-85f3-5a2a40223d2e req-0f904b1c-f949-4342-8ab9-7f11665742d8 service nova] [instance: e2439d62-4713-435d-81ce-fafe1d811b47] Updating instance_info_cache with network_info: [{"id": "50079e9e-673c-4a5a-8f32-56d794575fdf", "address": "fa:16:3e:3f:6e:41", "network": {"id": "c317481b-f8cf-40a0-a326-836a5ea4c495", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-887666255-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.69", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "37b89c13ba1d4a94805d6af69ad26fb8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap50079e9e-67", "ovs_interfaceid": "50079e9e-673c-4a5a-8f32-56d794575fdf", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74613) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 18:07:36 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-5d0e05be-de54-428c-85f3-5a2a40223d2e req-0f904b1c-f949-4342-8ab9-7f11665742d8 service nova] Releasing lock "refresh_cache-e2439d62-4713-435d-81ce-fafe1d811b47" {{(pid=74613) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 18:07:36 user nova-compute[74613]: DEBUG nova.compute.manager [None req-a1e338ca-ccee-4cf6-8723-73ae43416c7e tempest-ServerBootFromVolumeStableRescueTest-414665510 tempest-ServerBootFromVolumeStableRescueTest-414665510-project-member] [instance: d3c285cd-9f39-423c-a324-30a48a9c66be] Checking state {{(pid=74613) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 29 18:07:36 user nova-compute[74613]: DEBUG nova.compute.manager [req-3414005a-95c1-44b5-8101-2cbd95a5774c req-63d0e091-9eb7-4505-ad2d-2dec4ec70d3c service nova] [instance: d3c285cd-9f39-423c-a324-30a48a9c66be] Received event network-vif-plugged-663e4724-b31b-469d-a5ea-c2802db1e0c8 {{(pid=74613) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 18:07:36 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-3414005a-95c1-44b5-8101-2cbd95a5774c req-63d0e091-9eb7-4505-ad2d-2dec4ec70d3c service nova] Acquiring lock "d3c285cd-9f39-423c-a324-30a48a9c66be-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 18:07:36 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-3414005a-95c1-44b5-8101-2cbd95a5774c req-63d0e091-9eb7-4505-ad2d-2dec4ec70d3c service nova] Lock "d3c285cd-9f39-423c-a324-30a48a9c66be-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 18:07:36 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-3414005a-95c1-44b5-8101-2cbd95a5774c req-63d0e091-9eb7-4505-ad2d-2dec4ec70d3c service nova] Lock "d3c285cd-9f39-423c-a324-30a48a9c66be-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.002s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 18:07:36 user nova-compute[74613]: DEBUG nova.compute.manager [req-3414005a-95c1-44b5-8101-2cbd95a5774c req-63d0e091-9eb7-4505-ad2d-2dec4ec70d3c service nova] [instance: d3c285cd-9f39-423c-a324-30a48a9c66be] No waiting events found dispatching network-vif-plugged-663e4724-b31b-469d-a5ea-c2802db1e0c8 {{(pid=74613) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 18:07:36 user nova-compute[74613]: WARNING nova.compute.manager [req-3414005a-95c1-44b5-8101-2cbd95a5774c req-63d0e091-9eb7-4505-ad2d-2dec4ec70d3c service nova] [instance: d3c285cd-9f39-423c-a324-30a48a9c66be] Received unexpected event network-vif-plugged-663e4724-b31b-469d-a5ea-c2802db1e0c8 for instance with vm_state active and task_state None.
Nov 29 18:07:37 user nova-compute[74613]: WARNING nova.virt.libvirt.driver [None req-9e29e0a0-b87a-43c9-ba84-9d74b99248cc tempest-TestStampPattern-2144166935 tempest-TestStampPattern-2144166935-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 9eb14feb-f196-42b1-a6ba-2a049dea2d5e is timed out.
Nov 29 18:07:37 user nova-compute[74613]: INFO nova.virt.libvirt.driver [None req-9e29e0a0-b87a-43c9-ba84-9d74b99248cc tempest-TestStampPattern-2144166935 tempest-TestStampPattern-2144166935-project-member] Successfully detached device vdb from instance 9eb14feb-f196-42b1-a6ba-2a049dea2d5e from the live domain config.
Nov 29 18:07:37 user nova-compute[74613]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9e29e0a0-b87a-43c9-ba84-9d74b99248cc tempest-TestStampPattern-2144166935 tempest-TestStampPattern-2144166935-project-member] [instance: 9eb14feb-f196-42b1-a6ba-2a049dea2d5e] calling os-brick to detach iSCSI Volume {{(pid=74613) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 29 18:07:37 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e29e0a0-b87a-43c9-ba84-9d74b99248cc tempest-TestStampPattern-2144166935 tempest-TestStampPattern-2144166935-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff828156890>, {'target_iqn': 'iqn.2010-10.org.openstack:b6f3ecd2-9394-4935-a659-96e74bd25348', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'tCAhdlKv', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=74613) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 18:07:37 user nova-compute[74613]: WARNING os_brick.initiator.connectors.base [None req-9e29e0a0-b87a-43c9-ba84-9d74b99248cc tempest-TestStampPattern-2144166935 tempest-TestStampPattern-2144166935-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 18:07:37 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.base [None req-9e29e0a0-b87a-43c9-ba84-9d74b99248cc tempest-TestStampPattern-2144166935 tempest-TestStampPattern-2144166935-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 18:07:37 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.base [None req-9e29e0a0-b87a-43c9-ba84-9d74b99248cc tempest-TestStampPattern-2144166935 tempest-TestStampPattern-2144166935-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 18:07:37 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:07:37 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.026s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:07:37 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[dbf5a1ff-4aab-4a4a-a81b-4703c983007a]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:9511387c-8772-40f2-bf2d-6b6387649e9f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b6f3ecd2-9394-4935-a659-96e74bd25348\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b9aad94d-fe0d-415d-9761-9aff25cc6099\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a8c53a27-dcde-402b-a9bb-d8642f7db0da\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 18:07:37 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e29e0a0-b87a-43c9-ba84-9d74b99248cc tempest-TestStampPattern-2144166935 tempest-TestStampPattern-2144166935-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 29 18:07:37 user nova-compute[74613]: No targets found.
Nov 29 18:07:37 user nova-compute[74613]: iSNS:
Nov 29 18:07:37 user nova-compute[74613]: No targets found.
Nov 29 18:07:37 user nova-compute[74613]: STATIC:
Nov 29 18:07:37 user nova-compute[74613]: Target: iqn.2010-10.org.openstack:9511387c-8772-40f2-bf2d-6b6387649e9f
Nov 29 18:07:37 user nova-compute[74613]:         Portal: 172.16.0.220:3260,-1
Nov 29 18:07:37 user nova-compute[74613]:                 Iface Name: default
Nov 29 18:07:37 user nova-compute[74613]: Target: iqn.2010-10.org.openstack:b6f3ecd2-9394-4935-a659-96e74bd25348
Nov 29 18:07:37 user nova-compute[74613]:         Portal: 172.16.0.220:3260,-1
Nov 29 18:07:37 user nova-compute[74613]:                 Iface Name: default
Nov 29 18:07:37 user nova-compute[74613]: Target: iqn.2010-10.org.openstack:b9aad94d-fe0d-415d-9761-9aff25cc6099
Nov 29 18:07:37 user nova-compute[74613]:         Portal: 172.16.0.220:3260,-1
Nov 29 18:07:37 user nova-compute[74613]:                 Iface Name: default
Nov 29 18:07:37 user nova-compute[74613]: Target: iqn.2010-10.org.openstack:a8c53a27-dcde-402b-a9bb-d8642f7db0da
Nov 29 18:07:37 user nova-compute[74613]:         Portal: 172.16.0.220:3260,-1
Nov 29 18:07:37 user nova-compute[74613]:                 Iface Name: default
Nov 29 18:07:37 user nova-compute[74613]: FIRMWARE:
Nov 29 18:07:37 user nova-compute[74613]: No targets found.
Nov 29 18:07:37 user nova-compute[74613]:  stderr= {{(pid=74613) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 18:07:37 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e29e0a0-b87a-43c9-ba84-9d74b99248cc tempest-TestStampPattern-2144166935 tempest-TestStampPattern-2144166935-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 29 18:07:37 user nova-compute[74613]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 29 18:07:37 user nova-compute[74613]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74613) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 29 18:07:37 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e29e0a0-b87a-43c9-ba84-9d74b99248cc tempest-TestStampPattern-2144166935 tempest-TestStampPattern-2144166935-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b6f3ecd2-9394-4935-a659-96e74bd25348', 0)] {{(pid=74613) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 29 18:07:37 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:07:37 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.024s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:07:37 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[d05aeb73-0979-4979-88c7-ec63c91f2e54]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9511387c-8772-40f2-bf2d-6b6387649e9f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a8c53a27-dcde-402b-a9bb-d8642f7db0da\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b6f3ecd2-9394-4935-a659-96e74bd25348\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b9aad94d-fe0d-415d-9761-9aff25cc6099\n', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 18:07:37 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:07:37 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:07:37 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f665ab6-6d70-469c-bed4-b1171b61e15f]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9511387c-8772-40f2-bf2d-6b6387649e9f (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9aad94d-fe0d-415d-9761-9aff25cc6099 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8c53a27-dcde-402b-a9bb-d8642f7db0da (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b6f3ecd2-9394-4935-a659-96e74bd25348 (non-flash)\n', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 18:07:37 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e29e0a0-b87a-43c9-ba84-9d74b99248cc tempest-TestStampPattern-2144166935 tempest-TestStampPattern-2144166935-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9511387c-8772-40f2-bf2d-6b6387649e9f (non-flash)
Nov 29 18:07:37 user nova-compute[74613]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9aad94d-fe0d-415d-9761-9aff25cc6099 (non-flash)
Nov 29 18:07:37 user nova-compute[74613]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8c53a27-dcde-402b-a9bb-d8642f7db0da (non-flash)
Nov 29 18:07:37 user nova-compute[74613]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b6f3ecd2-9394-4935-a659-96e74bd25348 (non-flash)
Nov 29 18:07:37 user nova-compute[74613]:  stderr= {{(pid=74613) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 18:07:37 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e29e0a0-b87a-43c9-ba84-9d74b99248cc tempest-TestStampPattern-2144166935 tempest-TestStampPattern-2144166935-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9511387c-8772-40f2-bf2d-6b6387649e9f (non-flash)
Nov 29 18:07:37 user nova-compute[74613]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9aad94d-fe0d-415d-9761-9aff25cc6099 (non-flash)
Nov 29 18:07:37 user nova-compute[74613]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8c53a27-dcde-402b-a9bb-d8642f7db0da (non-flash)
Nov 29 18:07:37 user nova-compute[74613]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b6f3ecd2-9394-4935-a659-96e74bd25348 (non-flash)
Nov 29 18:07:37 user nova-compute[74613]:  stderr= {{(pid=74613) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 18:07:37 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e29e0a0-b87a-43c9-ba84-9d74b99248cc tempest-TestStampPattern-2144166935 tempest-TestStampPattern-2144166935-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7ff8181183a0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b6f3ecd2-9394-4935-a659-96e74bd25348'): ({'sdd'}, set())}) {{(pid=74613) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 29 18:07:37 user nova-compute[74613]: DEBUG os_brick.initiator.linuxscsi [None req-9e29e0a0-b87a-43c9-ba84-9d74b99248cc tempest-TestStampPattern-2144166935 tempest-TestStampPattern-2144166935-project-member] Removing single pathed devices sdd {{(pid=74613) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 29 18:07:37 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:07:37 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.032s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:07:37 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[a43eb43e-1b13-4b64-9897-d8aa9f73cd0c]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 18:07:37 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:07:37 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.023s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:07:37 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[58138e1b-b1b5-479e-9d37-52c7d55d332f]: (4, ('ok\n', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 18:07:37 user nova-compute[74613]: DEBUG os_brick.initiator.linuxscsi [None req-9e29e0a0-b87a-43c9-ba84-9d74b99248cc tempest-TestStampPattern-2144166935 tempest-TestStampPattern-2144166935-project-member] Flushing IO for device /dev/sdd {{(pid=74613) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 29 18:07:37 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:07:37 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.015s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:07:37 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[48427896-0b07-487d-aeed-1358a1fc479c]: (4, ('', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 18:07:37 user nova-compute[74613]: DEBUG os_brick.initiator.linuxscsi [None req-9e29e0a0-b87a-43c9-ba84-9d74b99248cc tempest-TestStampPattern-2144166935 tempest-TestStampPattern-2144166935-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=74613) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 29 18:07:37 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:07:38 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.044s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:07:38 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f1de02c-75c5-4cab-9da4-d8d47b756e69]: (4, ('1', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 18:07:38 user nova-compute[74613]: DEBUG os_brick.initiator.linuxscsi [None req-9e29e0a0-b87a-43c9-ba84-9d74b99248cc tempest-TestStampPattern-2144166935 tempest-TestStampPattern-2144166935-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=74613) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 29 18:07:38 user nova-compute[74613]: DEBUG os_brick.initiator.linuxscsi [None req-9e29e0a0-b87a-43c9-ba84-9d74b99248cc tempest-TestStampPattern-2144166935 tempest-TestStampPattern-2144166935-project-member] SCSI volumes sdd have been removed. {{(pid=74613) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 29 18:07:38 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e29e0a0-b87a-43c9-ba84-9d74b99248cc tempest-TestStampPattern-2144166935 tempest-TestStampPattern-2144166935-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b6f3ecd2-9394-4935-a659-96e74bd25348')] {{(pid=74613) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 29 18:07:38 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b6f3ecd2-9394-4935-a659-96e74bd25348 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:07:38 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b6f3ecd2-9394-4935-a659-96e74bd25348 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.035s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:07:38 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac9bd4a7-d726-475c-899d-4f9be5be61c9]: (4, ('', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 18:07:38 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e29e0a0-b87a-43c9-ba84-9d74b99248cc tempest-TestStampPattern-2144166935 tempest-TestStampPattern-2144166935-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74613) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 18:07:38 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b6f3ecd2-9394-4935-a659-96e74bd25348 -p 172.16.0.220:3260 --logout {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:07:38 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b6f3ecd2-9394-4935-a659-96e74bd25348 -p 172.16.0.220:3260 --logout" returned: 0 in 0.074s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:07:38 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[311a58ad-0787-42f5-a32c-92512bb71802]: (4, ('Logging out of session [sid: 34, target: iqn.2010-10.org.openstack:b6f3ecd2-9394-4935-a659-96e74bd25348, portal: 172.16.0.220,3260]\nLogout of [sid: 34, target: iqn.2010-10.org.openstack:b6f3ecd2-9394-4935-a659-96e74bd25348, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 18:07:38 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e29e0a0-b87a-43c9-ba84-9d74b99248cc tempest-TestStampPattern-2144166935 tempest-TestStampPattern-2144166935-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 34, target: iqn.2010-10.org.openstack:b6f3ecd2-9394-4935-a659-96e74bd25348, portal: 172.16.0.220,3260]
Nov 29 18:07:38 user nova-compute[74613]: Logout of [sid: 34, target: iqn.2010-10.org.openstack:b6f3ecd2-9394-4935-a659-96e74bd25348, portal: 172.16.0.220,3260] successful.
Nov 29 18:07:38 user nova-compute[74613]:  stderr= {{(pid=74613) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 18:07:38 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b6f3ecd2-9394-4935-a659-96e74bd25348 -p 172.16.0.220:3260 --op delete {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:07:38 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b6f3ecd2-9394-4935-a659-96e74bd25348 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.029s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:07:38 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7299203-37bd-46b0-8be0-53dcb39547e3]: (4, ('', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 18:07:38 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e29e0a0-b87a-43c9-ba84-9d74b99248cc tempest-TestStampPattern-2144166935 tempest-TestStampPattern-2144166935-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74613) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 18:07:38 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.base [None req-9e29e0a0-b87a-43c9-ba84-9d74b99248cc tempest-TestStampPattern-2144166935 tempest-TestStampPattern-2144166935-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.395s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 18:07:38 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e29e0a0-b87a-43c9-ba84-9d74b99248cc tempest-TestStampPattern-2144166935 tempest-TestStampPattern-2144166935-project-member] <== disconnect_volume: return (396ms) None {{(pid=74613) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 18:07:38 user nova-compute[74613]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9e29e0a0-b87a-43c9-ba84-9d74b99248cc tempest-TestStampPattern-2144166935 tempest-TestStampPattern-2144166935-project-member] [instance: 9eb14feb-f196-42b1-a6ba-2a049dea2d5e] Disconnected iSCSI Volume {{(pid=74613) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 29 18:07:38 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:07:38 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-c94e6bc0-a29b-48c4-bf6d-25d18f8d1afa tempest-AttachVolumeNegativeTest-483083654 tempest-AttachVolumeNegativeTest-483083654-project-member] Acquiring lock "e2439d62-4713-435d-81ce-fafe1d811b47" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 18:07:38 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-c94e6bc0-a29b-48c4-bf6d-25d18f8d1afa tempest-AttachVolumeNegativeTest-483083654 tempest-AttachVolumeNegativeTest-483083654-project-member] Lock "e2439d62-4713-435d-81ce-fafe1d811b47" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 18:07:38 user nova-compute[74613]: DEBUG nova.objects.instance [None req-c94e6bc0-a29b-48c4-bf6d-25d18f8d1afa tempest-AttachVolumeNegativeTest-483083654 tempest-AttachVolumeNegativeTest-483083654-project-member] Lazy-loading 'flavor' on Instance uuid e2439d62-4713-435d-81ce-fafe1d811b47 {{(pid=74613) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 18:07:38 user nova-compute[74613]: DEBUG oslo_service.periodic_task [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=74613) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 18:07:38 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-c94e6bc0-a29b-48c4-bf6d-25d18f8d1afa tempest-AttachVolumeNegativeTest-483083654 tempest-AttachVolumeNegativeTest-483083654-project-member] Lock "e2439d62-4713-435d-81ce-fafe1d811b47" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.191s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 18:07:38 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-c94e6bc0-a29b-48c4-bf6d-25d18f8d1afa tempest-AttachVolumeNegativeTest-483083654 tempest-AttachVolumeNegativeTest-483083654-project-member] Acquiring lock "e2439d62-4713-435d-81ce-fafe1d811b47" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 18:07:38 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-c94e6bc0-a29b-48c4-bf6d-25d18f8d1afa tempest-AttachVolumeNegativeTest-483083654 tempest-AttachVolumeNegativeTest-483083654-project-member] Lock "e2439d62-4713-435d-81ce-fafe1d811b47" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 18:07:38 user nova-compute[74613]: INFO nova.compute.manager [None req-c94e6bc0-a29b-48c4-bf6d-25d18f8d1afa tempest-AttachVolumeNegativeTest-483083654 tempest-AttachVolumeNegativeTest-483083654-project-member] [instance: e2439d62-4713-435d-81ce-fafe1d811b47] Attaching volume 34908494-9a6c-4c8c-b447-9768745356ca to /dev/vdb
Nov 29 18:07:39 user nova-compute[74613]: DEBUG os_brick.utils [None req-c94e6bc0-a29b-48c4-bf6d-25d18f8d1afa tempest-AttachVolumeNegativeTest-483083654 tempest-AttachVolumeNegativeTest-483083654-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74613) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 18:07:39 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:07:39 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:07:39 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[f35f1dba-73a4-4e72-a9ea-a4683bc42ae7]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:400972819b5\n', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 18:07:39 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:07:39 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:07:39 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd553055-2653-4177-953d-cbca13d7c1fb]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 18:07:39 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:07:39 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.022s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:07:39 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[35ff866b-094a-42a1-9ec6-1261da4e6a82]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 18:07:39 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[84f3c35d-35bd-49ac-b3b4-3d0a5258a814]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 18:07:39 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-c94e6bc0-a29b-48c4-bf6d-25d18f8d1afa tempest-AttachVolumeNegativeTest-483083654 tempest-AttachVolumeNegativeTest-483083654-project-member] Running cmd (subprocess): nvme version {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:07:39 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-c94e6bc0-a29b-48c4-bf6d-25d18f8d1afa tempest-AttachVolumeNegativeTest-483083654 tempest-AttachVolumeNegativeTest-483083654-project-member] 'nvme version' failed. Not Retrying. {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 18:07:39 user nova-compute[74613]: DEBUG nova.objects.instance [None req-9e29e0a0-b87a-43c9-ba84-9d74b99248cc tempest-TestStampPattern-2144166935 tempest-TestStampPattern-2144166935-project-member] Lazy-loading 'flavor' on Instance uuid 9eb14feb-f196-42b1-a6ba-2a049dea2d5e {{(pid=74613) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 18:07:39 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.nvmeof [None req-c94e6bc0-a29b-48c4-bf6d-25d18f8d1afa tempest-AttachVolumeNegativeTest-483083654 tempest-AttachVolumeNegativeTest-483083654-project-member] nvme not present on system {{(pid=74613) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 29 18:07:39 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:07:39 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 18:07:39 user nova-compute[74613]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 29 18:07:39 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c90c757-261d-4b5a-88a1-18c18983359b]: (4, '') {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 18:07:39 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.lightos [None req-c94e6bc0-a29b-48c4-bf6d-25d18f8d1afa tempest-AttachVolumeNegativeTest-483083654 tempest-AttachVolumeNegativeTest-483083654-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74613) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 29 18:07:39 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.lightos [None req-c94e6bc0-a29b-48c4-bf6d-25d18f8d1afa tempest-AttachVolumeNegativeTest-483083654 tempest-AttachVolumeNegativeTest-483083654-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74613) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 29 18:07:39 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.lightos [None req-c94e6bc0-a29b-48c4-bf6d-25d18f8d1afa tempest-AttachVolumeNegativeTest-483083654 tempest-AttachVolumeNegativeTest-483083654-project-member] LIGHTOS: no hostnqn found. {{(pid=74613) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 29 18:07:39 user nova-compute[74613]: DEBUG os_brick.utils [None req-c94e6bc0-a29b-48c4-bf6d-25d18f8d1afa tempest-AttachVolumeNegativeTest-483083654 tempest-AttachVolumeNegativeTest-483083654-project-member] <== get_connector_properties: return (148ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:400972819b5', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74613) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 18:07:39 user nova-compute[74613]: DEBUG nova.virt.block_device [None req-c94e6bc0-a29b-48c4-bf6d-25d18f8d1afa tempest-AttachVolumeNegativeTest-483083654 tempest-AttachVolumeNegativeTest-483083654-project-member] [instance: e2439d62-4713-435d-81ce-fafe1d811b47] Updating existing volume attachment record: 7ec92658-c7a1-4adb-8c75-2f4444e504dd {{(pid=74613) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 29 18:07:39 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-9e29e0a0-b87a-43c9-ba84-9d74b99248cc tempest-TestStampPattern-2144166935 tempest-TestStampPattern-2144166935-project-member] Lock "9eb14feb-f196-42b1-a6ba-2a049dea2d5e" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.992s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 18:07:39 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-96ba1fdc-6afe-4ae7-8013-ffcb5256e023 tempest-AttachVolumeTestJSON-813984703 tempest-AttachVolumeTestJSON-813984703-project-member] Acquiring lock "69109f06-acbf-4834-b05e-80ab6e3f6ea0" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 18:07:39 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-96ba1fdc-6afe-4ae7-8013-ffcb5256e023 tempest-AttachVolumeTestJSON-813984703 tempest-AttachVolumeTestJSON-813984703-project-member] Lock "69109f06-acbf-4834-b05e-80ab6e3f6ea0" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 18:07:39 user nova-compute[74613]: DEBUG nova.objects.instance [None req-96ba1fdc-6afe-4ae7-8013-ffcb5256e023 tempest-AttachVolumeTestJSON-813984703 tempest-AttachVolumeTestJSON-813984703-project-member] Lazy-loading 'flavor' on Instance uuid 69109f06-acbf-4834-b05e-80ab6e3f6ea0 {{(pid=74613) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 18:07:39 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-96ba1fdc-6afe-4ae7-8013-ffcb5256e023 tempest-AttachVolumeTestJSON-813984703 tempest-AttachVolumeTestJSON-813984703-project-member] Lock "69109f06-acbf-4834-b05e-80ab6e3f6ea0" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.056s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 18:07:39 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-96ba1fdc-6afe-4ae7-8013-ffcb5256e023 tempest-AttachVolumeTestJSON-813984703 tempest-AttachVolumeTestJSON-813984703-project-member] Acquiring lock "69109f06-acbf-4834-b05e-80ab6e3f6ea0" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 18:07:39 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-96ba1fdc-6afe-4ae7-8013-ffcb5256e023 tempest-AttachVolumeTestJSON-813984703 tempest-AttachVolumeTestJSON-813984703-project-member] Lock "69109f06-acbf-4834-b05e-80ab6e3f6ea0" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 18:07:39 user nova-compute[74613]: INFO nova.compute.manager [None req-96ba1fdc-6afe-4ae7-8013-ffcb5256e023 tempest-AttachVolumeTestJSON-813984703 tempest-AttachVolumeTestJSON-813984703-project-member] [instance: 69109f06-acbf-4834-b05e-80ab6e3f6ea0] Attaching volume b2879f1d-797c-4701-8803-eb6369ddb534 to /dev/vdb
Nov 29 18:07:39 user nova-compute[74613]: DEBUG os_brick.utils [None req-96ba1fdc-6afe-4ae7-8013-ffcb5256e023 tempest-AttachVolumeTestJSON-813984703 tempest-AttachVolumeTestJSON-813984703-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74613) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 18:07:39 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:07:39 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:07:39 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[37bdde95-d37e-48da-9f4a-2b22e17aff9b]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:400972819b5\n', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 18:07:39 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:07:39 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:07:39 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[508d3e37-af12-4f2c-b22a-f226a9665b8e]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 18:07:39 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:07:39 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:07:39 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[f191f084-bbdb-41b5-93d0-59d9ca5f319d]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 18:07:39 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[76a5bbd8-2e4d-4a3e-8860-7cfc2f32c3d4]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 18:07:39 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-96ba1fdc-6afe-4ae7-8013-ffcb5256e023 tempest-AttachVolumeTestJSON-813984703 tempest-AttachVolumeTestJSON-813984703-project-member] Running cmd (subprocess): nvme version {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:07:39 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-96ba1fdc-6afe-4ae7-8013-ffcb5256e023 tempest-AttachVolumeTestJSON-813984703 tempest-AttachVolumeTestJSON-813984703-project-member] 'nvme version' failed. Not Retrying. {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 18:07:39 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.nvmeof [None req-96ba1fdc-6afe-4ae7-8013-ffcb5256e023 tempest-AttachVolumeTestJSON-813984703 tempest-AttachVolumeTestJSON-813984703-project-member] nvme not present on system {{(pid=74613) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 29 18:07:39 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:07:39 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 18:07:39 user nova-compute[74613]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 29 18:07:39 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[622a9576-7a4c-4280-8390-acccc6c01daa]: (4, '') {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 18:07:39 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.lightos [None req-96ba1fdc-6afe-4ae7-8013-ffcb5256e023 tempest-AttachVolumeTestJSON-813984703 tempest-AttachVolumeTestJSON-813984703-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74613) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 29 18:07:39 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.lightos [None req-96ba1fdc-6afe-4ae7-8013-ffcb5256e023 tempest-AttachVolumeTestJSON-813984703 tempest-AttachVolumeTestJSON-813984703-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74613) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 29 18:07:39 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.lightos [None req-96ba1fdc-6afe-4ae7-8013-ffcb5256e023 tempest-AttachVolumeTestJSON-813984703 tempest-AttachVolumeTestJSON-813984703-project-member] LIGHTOS: no hostnqn found. {{(pid=74613) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 29 18:07:39 user nova-compute[74613]: DEBUG os_brick.utils [None req-96ba1fdc-6afe-4ae7-8013-ffcb5256e023 tempest-AttachVolumeTestJSON-813984703 tempest-AttachVolumeTestJSON-813984703-project-member] <== get_connector_properties: return (134ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:400972819b5', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74613) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 18:07:39 user nova-compute[74613]: DEBUG nova.virt.block_device [None req-96ba1fdc-6afe-4ae7-8013-ffcb5256e023 tempest-AttachVolumeTestJSON-813984703 tempest-AttachVolumeTestJSON-813984703-project-member] [instance: 69109f06-acbf-4834-b05e-80ab6e3f6ea0] Updating existing volume attachment record: 28558fbc-e64e-4ddf-82bd-8a505b0226dc {{(pid=74613) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 29 18:07:40 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:07:43 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:07:45 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:07:47 user nova-compute[74613]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c94e6bc0-a29b-48c4-bf6d-25d18f8d1afa tempest-AttachVolumeNegativeTest-483083654 tempest-AttachVolumeNegativeTest-483083654-project-member] [instance: e2439d62-4713-435d-81ce-fafe1d811b47] Calling os-brick to attach iSCSI Volume {{(pid=74613) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 29 18:07:47 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-c94e6bc0-a29b-48c4-bf6d-25d18f8d1afa tempest-AttachVolumeNegativeTest-483083654 tempest-AttachVolumeNegativeTest-483083654-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff828156890>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:34908494-9a6c-4c8c-b447-9768745356ca', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zyBUQWou', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74613) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 18:07:47 user nova-compute[74613]: WARNING os_brick.initiator.connectors.base [None req-c94e6bc0-a29b-48c4-bf6d-25d18f8d1afa tempest-AttachVolumeNegativeTest-483083654 tempest-AttachVolumeNegativeTest-483083654-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 18:07:47 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.base [None req-c94e6bc0-a29b-48c4-bf6d-25d18f8d1afa tempest-AttachVolumeNegativeTest-483083654 tempest-AttachVolumeNegativeTest-483083654-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 18:07:47 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.base [None req-c94e6bc0-a29b-48c4-bf6d-25d18f8d1afa tempest-AttachVolumeNegativeTest-483083654 tempest-AttachVolumeNegativeTest-483083654-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 18:07:47 user nova-compute[74613]: WARNING os_brick.initiator.connectors.base [None req-c94e6bc0-a29b-48c4-bf6d-25d18f8d1afa tempest-AttachVolumeNegativeTest-483083654 tempest-AttachVolumeNegativeTest-483083654-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 18:07:47 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.base [None req-c94e6bc0-a29b-48c4-bf6d-25d18f8d1afa tempest-AttachVolumeNegativeTest-483083654 tempest-AttachVolumeNegativeTest-483083654-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:34908494-9a6c-4c8c-b447-9768745356ca" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 18:07:47 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.base [None req-c94e6bc0-a29b-48c4-bf6d-25d18f8d1afa tempest-AttachVolumeNegativeTest-483083654 tempest-AttachVolumeNegativeTest-483083654-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:34908494-9a6c-4c8c-b447-9768745356ca" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 18:07:47 user nova-compute[74613]: INFO os_brick.initiator.connectors.iscsi [None req-c94e6bc0-a29b-48c4-bf6d-25d18f8d1afa tempest-AttachVolumeNegativeTest-483083654 tempest-AttachVolumeNegativeTest-483083654-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 29 18:07:47 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:34908494-9a6c-4c8c-b447-9768745356ca -p 172.16.0.220:3260 {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:07:47 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:34908494-9a6c-4c8c-b447-9768745356ca -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:07:47 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[0655acc7-e6af-4ab8-9f87-4baa036a43e1]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 18:07:47 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-c94e6bc0-a29b-48c4-bf6d-25d18f8d1afa tempest-AttachVolumeNegativeTest-483083654 tempest-AttachVolumeNegativeTest-483083654-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 29 18:07:47 user nova-compute[74613]:  {{(pid=74613) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 18:07:47 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:34908494-9a6c-4c8c-b447-9768745356ca -p 172.16.0.220:3260 --interface default --op new {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:07:47 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:34908494-9a6c-4c8c-b447-9768745356ca -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:07:47 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[daa6ab6b-652c-4b2b-af60-ac702dd73422]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:34908494-9a6c-4c8c-b447-9768745356ca] added\n', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 18:07:47 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-c94e6bc0-a29b-48c4-bf6d-25d18f8d1afa tempest-AttachVolumeNegativeTest-483083654 tempest-AttachVolumeNegativeTest-483083654-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:34908494-9a6c-4c8c-b447-9768745356ca] added
Nov 29 18:07:47 user nova-compute[74613]:  stderr= {{(pid=74613) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 18:07:47 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:34908494-9a6c-4c8c-b447-9768745356ca -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:07:47 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:34908494-9a6c-4c8c-b447-9768745356ca -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:07:47 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[aff4fdad-eda9-4c25-96b0-41cbe4127a2a]: (4, ('', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 18:07:47 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-c94e6bc0-a29b-48c4-bf6d-25d18f8d1afa tempest-AttachVolumeNegativeTest-483083654 tempest-AttachVolumeNegativeTest-483083654-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74613) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 18:07:47 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:34908494-9a6c-4c8c-b447-9768745356ca -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:07:47 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:34908494-9a6c-4c8c-b447-9768745356ca -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.024s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:07:47 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1c2971e-3c32-4235-8e6d-1e3b6a91d4aa]: (4, ('', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 18:07:47 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-c94e6bc0-a29b-48c4-bf6d-25d18f8d1afa tempest-AttachVolumeNegativeTest-483083654 tempest-AttachVolumeNegativeTest-483083654-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74613) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 18:07:47 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:34908494-9a6c-4c8c-b447-9768745356ca -p 172.16.0.220:3260 --op update -n node.session.auth.username -v zyBUQWou {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:07:47 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:34908494-9a6c-4c8c-b447-9768745356ca -p 172.16.0.220:3260 --op update -n node.session.auth.username -v zyBUQWou" returned: 0 in 0.018s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:07:47 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[df49d606-44b0-4d20-a12c-9e5862447f1c]: (4, ('', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 18:07:47 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-c94e6bc0-a29b-48c4-bf6d-25d18f8d1afa tempest-AttachVolumeNegativeTest-483083654 tempest-AttachVolumeNegativeTest-483083654-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'zyBUQWou'): stdout= stderr= {{(pid=74613) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 18:07:47 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:34908494-9a6c-4c8c-b447-9768745356ca -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:07:47 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:34908494-9a6c-4c8c-b447-9768745356ca -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:07:47 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[71420fb3-d3fb-4a19-b7c0-372bdcdb4c69]: (4, ('', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 18:07:47 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-c94e6bc0-a29b-48c4-bf6d-25d18f8d1afa tempest-AttachVolumeNegativeTest-483083654 tempest-AttachVolumeNegativeTest-483083654-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74613) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 18:07:47 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:07:47 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:07:47 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0321a4e-ba53-4efd-8cb2-a6d0cca4b201]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9511387c-8772-40f2-bf2d-6b6387649e9f (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9aad94d-fe0d-415d-9761-9aff25cc6099 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8c53a27-dcde-402b-a9bb-d8642f7db0da (non-flash)\n', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 18:07:47 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-c94e6bc0-a29b-48c4-bf6d-25d18f8d1afa tempest-AttachVolumeNegativeTest-483083654 tempest-AttachVolumeNegativeTest-483083654-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9511387c-8772-40f2-bf2d-6b6387649e9f (non-flash)
Nov 29 18:07:47 user nova-compute[74613]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9aad94d-fe0d-415d-9761-9aff25cc6099 (non-flash)
Nov 29 18:07:47 user nova-compute[74613]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8c53a27-dcde-402b-a9bb-d8642f7db0da (non-flash)
Nov 29 18:07:47 user nova-compute[74613]:  stderr= {{(pid=74613) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 18:07:47 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-c94e6bc0-a29b-48c4-bf6d-25d18f8d1afa tempest-AttachVolumeNegativeTest-483083654 tempest-AttachVolumeNegativeTest-483083654-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9511387c-8772-40f2-bf2d-6b6387649e9f (non-flash)
Nov 29 18:07:47 user nova-compute[74613]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9aad94d-fe0d-415d-9761-9aff25cc6099 (non-flash)
Nov 29 18:07:47 user nova-compute[74613]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8c53a27-dcde-402b-a9bb-d8642f7db0da (non-flash)
Nov 29 18:07:47 user nova-compute[74613]:  stderr= {{(pid=74613) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 18:07:47 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:34908494-9a6c-4c8c-b447-9768745356ca -p 172.16.0.220:3260 --login {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:07:47 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:34908494-9a6c-4c8c-b447-9768745356ca -p 172.16.0.220:3260 --login" returned: 0 in 0.061s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:07:47 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d81a45b-d563-4f6e-b4b0-17e7036d2999]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:34908494-9a6c-4c8c-b447-9768745356ca, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:34908494-9a6c-4c8c-b447-9768745356ca, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 18:07:47 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-c94e6bc0-a29b-48c4-bf6d-25d18f8d1afa tempest-AttachVolumeNegativeTest-483083654 tempest-AttachVolumeNegativeTest-483083654-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:34908494-9a6c-4c8c-b447-9768745356ca, portal: 172.16.0.220,3260]
Nov 29 18:07:47 user nova-compute[74613]: Login to [iface: default, target: iqn.2010-10.org.openstack:34908494-9a6c-4c8c-b447-9768745356ca, portal: 172.16.0.220,3260] successful.
Nov 29 18:07:47 user nova-compute[74613]:  stderr= {{(pid=74613) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 18:07:47 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:34908494-9a6c-4c8c-b447-9768745356ca -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:07:47 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:34908494-9a6c-4c8c-b447-9768745356ca -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:07:47 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[67944c5b-9e0d-4e6a-9dc2-052e39a418d7]: (4, ('', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 18:07:47 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-c94e6bc0-a29b-48c4-bf6d-25d18f8d1afa tempest-AttachVolumeNegativeTest-483083654 tempest-AttachVolumeNegativeTest-483083654-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74613) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 18:07:47 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:07:47 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:07:47 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[1292a2b5-ed79-44cc-b81f-dd685e5bcb65]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9511387c-8772-40f2-bf2d-6b6387649e9f (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9aad94d-fe0d-415d-9761-9aff25cc6099 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8c53a27-dcde-402b-a9bb-d8642f7db0da (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:34908494-9a6c-4c8c-b447-9768745356ca (non-flash)\n', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 18:07:47 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-c94e6bc0-a29b-48c4-bf6d-25d18f8d1afa tempest-AttachVolumeNegativeTest-483083654 tempest-AttachVolumeNegativeTest-483083654-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9511387c-8772-40f2-bf2d-6b6387649e9f (non-flash)
Nov 29 18:07:47 user nova-compute[74613]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9aad94d-fe0d-415d-9761-9aff25cc6099 (non-flash)
Nov 29 18:07:47 user nova-compute[74613]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8c53a27-dcde-402b-a9bb-d8642f7db0da (non-flash)
Nov 29 18:07:47 user nova-compute[74613]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:34908494-9a6c-4c8c-b447-9768745356ca (non-flash)
Nov 29 18:07:47 user nova-compute[74613]:  stderr= {{(pid=74613) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 18:07:47 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-c94e6bc0-a29b-48c4-bf6d-25d18f8d1afa tempest-AttachVolumeNegativeTest-483083654 tempest-AttachVolumeNegativeTest-483083654-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9511387c-8772-40f2-bf2d-6b6387649e9f (non-flash)
Nov 29 18:07:47 user nova-compute[74613]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9aad94d-fe0d-415d-9761-9aff25cc6099 (non-flash)
Nov 29 18:07:47 user nova-compute[74613]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8c53a27-dcde-402b-a9bb-d8642f7db0da (non-flash)
Nov 29 18:07:47 user nova-compute[74613]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:34908494-9a6c-4c8c-b447-9768745356ca (non-flash)
Nov 29 18:07:47 user nova-compute[74613]:  stderr= {{(pid=74613) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 18:07:47 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.base [None req-c94e6bc0-a29b-48c4-bf6d-25d18f8d1afa tempest-AttachVolumeNegativeTest-483083654 tempest-AttachVolumeNegativeTest-483083654-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:34908494-9a6c-4c8c-b447-9768745356ca" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.291s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 18:07:47 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-c94e6bc0-a29b-48c4-bf6d-25d18f8d1afa tempest-AttachVolumeNegativeTest-483083654 tempest-AttachVolumeNegativeTest-483083654-project-member] Connected to 172.16.0.220:3260 {{(pid=74613) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 29 18:07:47 user nova-compute[74613]: DEBUG os_brick.initiator.linuxscsi [None req-c94e6bc0-a29b-48c4-bf6d-25d18f8d1afa tempest-AttachVolumeNegativeTest-483083654 tempest-AttachVolumeNegativeTest-483083654-project-member] HCTL ('35', '-', '-', 0) found on session 35 with lun 0 {{(pid=74613) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 29 18:07:47 user nova-compute[74613]: DEBUG os_brick.initiator.linuxscsi [None req-c94e6bc0-a29b-48c4-bf6d-25d18f8d1afa tempest-AttachVolumeNegativeTest-483083654 tempest-AttachVolumeNegativeTest-483083654-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=74613) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 29 18:07:47 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:07:47 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.019s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:07:47 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[835846b1-807b-427a-b72c-2186f8dd899f]: (4, ('- - 0', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 18:07:47 user nova-compute[74613]: DEBUG os_brick.initiator.linuxscsi [None req-c94e6bc0-a29b-48c4-bf6d-25d18f8d1afa tempest-AttachVolumeNegativeTest-483083654 tempest-AttachVolumeNegativeTest-483083654-project-member] Searching for a device in session 35 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=74613) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 29 18:07:47 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-c94e6bc0-a29b-48c4-bf6d-25d18f8d1afa tempest-AttachVolumeNegativeTest-483083654 tempest-AttachVolumeNegativeTest-483083654-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:34908494-9a6c-4c8c-b447-9768745356ca', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zyBUQWou', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74613) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 29 18:07:47 user nova-compute[74613]: DEBUG nova.virt.libvirt.volume.iscsi [None req-96ba1fdc-6afe-4ae7-8013-ffcb5256e023 tempest-AttachVolumeTestJSON-813984703 tempest-AttachVolumeTestJSON-813984703-project-member] [instance: 69109f06-acbf-4834-b05e-80ab6e3f6ea0] Calling os-brick to attach iSCSI Volume {{(pid=74613) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 29 18:07:47 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-96ba1fdc-6afe-4ae7-8013-ffcb5256e023 tempest-AttachVolumeTestJSON-813984703 tempest-AttachVolumeTestJSON-813984703-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff828156890>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:b2879f1d-797c-4701-8803-eb6369ddb534', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'grDSnlbc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74613) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 18:07:47 user nova-compute[74613]: WARNING os_brick.initiator.connectors.base [None req-96ba1fdc-6afe-4ae7-8013-ffcb5256e023 tempest-AttachVolumeTestJSON-813984703 tempest-AttachVolumeTestJSON-813984703-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 18:07:47 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.base [None req-96ba1fdc-6afe-4ae7-8013-ffcb5256e023 tempest-AttachVolumeTestJSON-813984703 tempest-AttachVolumeTestJSON-813984703-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 18:07:48 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:07:48 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.base [None req-c94e6bc0-a29b-48c4-bf6d-25d18f8d1afa tempest-AttachVolumeNegativeTest-483083654 tempest-AttachVolumeNegativeTest-483083654-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.340s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 18:07:48 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-c94e6bc0-a29b-48c4-bf6d-25d18f8d1afa tempest-AttachVolumeNegativeTest-483083654 tempest-AttachVolumeNegativeTest-483083654-project-member] <== connect_volume: return (1341ms) {'type': 'block', 'scsi_wwn': '23663643534626661', 'path': '/dev/sdd'} {{(pid=74613) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 18:07:48 user nova-compute[74613]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c94e6bc0-a29b-48c4-bf6d-25d18f8d1afa tempest-AttachVolumeNegativeTest-483083654 tempest-AttachVolumeNegativeTest-483083654-project-member] [instance: e2439d62-4713-435d-81ce-fafe1d811b47] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23663643534626661', 'path': '/dev/sdd'} {{(pid=74613) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 29 18:07:48 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.base [None req-96ba1fdc-6afe-4ae7-8013-ffcb5256e023 tempest-AttachVolumeTestJSON-813984703 tempest-AttachVolumeTestJSON-813984703-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.668s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 18:07:48 user nova-compute[74613]: WARNING os_brick.initiator.connectors.base [None req-96ba1fdc-6afe-4ae7-8013-ffcb5256e023 tempest-AttachVolumeTestJSON-813984703 tempest-AttachVolumeTestJSON-813984703-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 18:07:48 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.base [None req-96ba1fdc-6afe-4ae7-8013-ffcb5256e023 tempest-AttachVolumeTestJSON-813984703 tempest-AttachVolumeTestJSON-813984703-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b2879f1d-797c-4701-8803-eb6369ddb534" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 18:07:48 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.base [None req-96ba1fdc-6afe-4ae7-8013-ffcb5256e023 tempest-AttachVolumeTestJSON-813984703 tempest-AttachVolumeTestJSON-813984703-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b2879f1d-797c-4701-8803-eb6369ddb534" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 18:07:48 user nova-compute[74613]: INFO os_brick.initiator.connectors.iscsi [None req-96ba1fdc-6afe-4ae7-8013-ffcb5256e023 tempest-AttachVolumeTestJSON-813984703 tempest-AttachVolumeTestJSON-813984703-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 29 18:07:48 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b2879f1d-797c-4701-8803-eb6369ddb534 -p 172.16.0.220:3260 {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:07:48 user nova-compute[74613]: DEBUG nova.objects.instance [None req-c94e6bc0-a29b-48c4-bf6d-25d18f8d1afa tempest-AttachVolumeNegativeTest-483083654 tempest-AttachVolumeNegativeTest-483083654-project-member] Lazy-loading 'flavor' on Instance uuid e2439d62-4713-435d-81ce-fafe1d811b47 {{(pid=74613) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 18:07:48 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b2879f1d-797c-4701-8803-eb6369ddb534 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:07:48 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[295432ab-9afd-4bae-bd5d-c0d9d78c7faf]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 18:07:48 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-96ba1fdc-6afe-4ae7-8013-ffcb5256e023 tempest-AttachVolumeTestJSON-813984703 tempest-AttachVolumeTestJSON-813984703-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 29 18:07:48 user nova-compute[74613]:  {{(pid=74613) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 18:07:48 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b2879f1d-797c-4701-8803-eb6369ddb534 -p 172.16.0.220:3260 --interface default --op new {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:07:48 user nova-compute[74613]: DEBUG nova.virt.libvirt.guest [None req-c94e6bc0-a29b-48c4-bf6d-25d18f8d1afa tempest-AttachVolumeNegativeTest-483083654 tempest-AttachVolumeNegativeTest-483083654-project-member] attach device xml: <disk type="block" device="disk">
Nov 29 18:07:48 user nova-compute[74613]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 18:07:48 user nova-compute[74613]:   <source dev="/dev/sdd"/>
Nov 29 18:07:48 user nova-compute[74613]:   <target dev="vdb" bus="virtio"/>
Nov 29 18:07:48 user nova-compute[74613]:   <serial>34908494-9a6c-4c8c-b447-9768745356ca</serial>
Nov 29 18:07:48 user nova-compute[74613]: </disk>
Nov 29 18:07:48 user nova-compute[74613]:  {{(pid=74613) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 29 18:07:48 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b2879f1d-797c-4701-8803-eb6369ddb534 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:07:48 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7e0b45d-9f50-4e9f-ba11-ecd83bcc4080]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b2879f1d-797c-4701-8803-eb6369ddb534] added\n', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 18:07:48 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-96ba1fdc-6afe-4ae7-8013-ffcb5256e023 tempest-AttachVolumeTestJSON-813984703 tempest-AttachVolumeTestJSON-813984703-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b2879f1d-797c-4701-8803-eb6369ddb534] added
Nov 29 18:07:48 user nova-compute[74613]:  stderr= {{(pid=74613) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 18:07:48 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b2879f1d-797c-4701-8803-eb6369ddb534 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:07:48 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b2879f1d-797c-4701-8803-eb6369ddb534 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:07:48 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf6f7fef-bc7d-4177-af05-0e161c729263]: (4, ('', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 18:07:48 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-96ba1fdc-6afe-4ae7-8013-ffcb5256e023 tempest-AttachVolumeTestJSON-813984703 tempest-AttachVolumeTestJSON-813984703-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74613) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 18:07:48 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b2879f1d-797c-4701-8803-eb6369ddb534 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:07:48 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b2879f1d-797c-4701-8803-eb6369ddb534 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:07:48 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[900e3579-008f-4048-a8ff-050a64d20aa4]: (4, ('', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 18:07:48 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-96ba1fdc-6afe-4ae7-8013-ffcb5256e023 tempest-AttachVolumeTestJSON-813984703 tempest-AttachVolumeTestJSON-813984703-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74613) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 18:07:48 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b2879f1d-797c-4701-8803-eb6369ddb534 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v grDSnlbc {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:07:48 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b2879f1d-797c-4701-8803-eb6369ddb534 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v grDSnlbc" returned: 0 in 0.018s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:07:48 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd8d2fd6-52e4-4a7f-9a90-46e2e50168c5]: (4, ('', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 18:07:48 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-96ba1fdc-6afe-4ae7-8013-ffcb5256e023 tempest-AttachVolumeTestJSON-813984703 tempest-AttachVolumeTestJSON-813984703-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'grDSnlbc'): stdout= stderr= {{(pid=74613) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 18:07:48 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b2879f1d-797c-4701-8803-eb6369ddb534 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:07:48 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b2879f1d-797c-4701-8803-eb6369ddb534 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:07:48 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[47df195d-d55a-4980-98f3-263abda60e8b]: (4, ('', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 18:07:48 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-96ba1fdc-6afe-4ae7-8013-ffcb5256e023 tempest-AttachVolumeTestJSON-813984703 tempest-AttachVolumeTestJSON-813984703-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74613) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 18:07:48 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:07:48 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:07:48 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[5026df93-277b-4099-8fbf-b9218a6c0b10]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9511387c-8772-40f2-bf2d-6b6387649e9f (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9aad94d-fe0d-415d-9761-9aff25cc6099 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8c53a27-dcde-402b-a9bb-d8642f7db0da (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:34908494-9a6c-4c8c-b447-9768745356ca (non-flash)\n', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 18:07:48 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-96ba1fdc-6afe-4ae7-8013-ffcb5256e023 tempest-AttachVolumeTestJSON-813984703 tempest-AttachVolumeTestJSON-813984703-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9511387c-8772-40f2-bf2d-6b6387649e9f (non-flash)
Nov 29 18:07:48 user nova-compute[74613]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9aad94d-fe0d-415d-9761-9aff25cc6099 (non-flash)
Nov 29 18:07:48 user nova-compute[74613]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8c53a27-dcde-402b-a9bb-d8642f7db0da (non-flash)
Nov 29 18:07:48 user nova-compute[74613]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:34908494-9a6c-4c8c-b447-9768745356ca (non-flash)
Nov 29 18:07:48 user nova-compute[74613]:  stderr= {{(pid=74613) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 18:07:48 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-96ba1fdc-6afe-4ae7-8013-ffcb5256e023 tempest-AttachVolumeTestJSON-813984703 tempest-AttachVolumeTestJSON-813984703-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9511387c-8772-40f2-bf2d-6b6387649e9f (non-flash)
Nov 29 18:07:48 user nova-compute[74613]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9aad94d-fe0d-415d-9761-9aff25cc6099 (non-flash)
Nov 29 18:07:48 user nova-compute[74613]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8c53a27-dcde-402b-a9bb-d8642f7db0da (non-flash)
Nov 29 18:07:48 user nova-compute[74613]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:34908494-9a6c-4c8c-b447-9768745356ca (non-flash)
Nov 29 18:07:48 user nova-compute[74613]:  stderr= {{(pid=74613) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 18:07:48 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b2879f1d-797c-4701-8803-eb6369ddb534 -p 172.16.0.220:3260 --login {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:07:48 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b2879f1d-797c-4701-8803-eb6369ddb534 -p 172.16.0.220:3260 --login" returned: 0 in 0.065s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:07:48 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[b11d2bdb-df3e-44dd-8f9f-1e933f8627ce]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:b2879f1d-797c-4701-8803-eb6369ddb534, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:b2879f1d-797c-4701-8803-eb6369ddb534, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 18:07:48 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-96ba1fdc-6afe-4ae7-8013-ffcb5256e023 tempest-AttachVolumeTestJSON-813984703 tempest-AttachVolumeTestJSON-813984703-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:b2879f1d-797c-4701-8803-eb6369ddb534, portal: 172.16.0.220,3260]
Nov 29 18:07:48 user nova-compute[74613]: Login to [iface: default, target: iqn.2010-10.org.openstack:b2879f1d-797c-4701-8803-eb6369ddb534, portal: 172.16.0.220,3260] successful.
Nov 29 18:07:48 user nova-compute[74613]:  stderr= {{(pid=74613) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 18:07:48 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b2879f1d-797c-4701-8803-eb6369ddb534 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:07:48 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b2879f1d-797c-4701-8803-eb6369ddb534 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.023s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:07:48 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[b319b62e-f4ad-4981-9484-24dcc83e6570]: (4, ('', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 18:07:48 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-96ba1fdc-6afe-4ae7-8013-ffcb5256e023 tempest-AttachVolumeTestJSON-813984703 tempest-AttachVolumeTestJSON-813984703-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74613) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 18:07:48 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:07:48 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:07:48 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f2748c9-01a9-4e64-85d5-c301d0a4d46e]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9511387c-8772-40f2-bf2d-6b6387649e9f (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9aad94d-fe0d-415d-9761-9aff25cc6099 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8c53a27-dcde-402b-a9bb-d8642f7db0da (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:34908494-9a6c-4c8c-b447-9768745356ca (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2879f1d-797c-4701-8803-eb6369ddb534 (non-flash)\n', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 18:07:48 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-96ba1fdc-6afe-4ae7-8013-ffcb5256e023 tempest-AttachVolumeTestJSON-813984703 tempest-AttachVolumeTestJSON-813984703-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9511387c-8772-40f2-bf2d-6b6387649e9f (non-flash)
Nov 29 18:07:48 user nova-compute[74613]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9aad94d-fe0d-415d-9761-9aff25cc6099 (non-flash)
Nov 29 18:07:48 user nova-compute[74613]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8c53a27-dcde-402b-a9bb-d8642f7db0da (non-flash)
Nov 29 18:07:48 user nova-compute[74613]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:34908494-9a6c-4c8c-b447-9768745356ca (non-flash)
Nov 29 18:07:48 user nova-compute[74613]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2879f1d-797c-4701-8803-eb6369ddb534 (non-flash)
Nov 29 18:07:48 user nova-compute[74613]:  stderr= {{(pid=74613) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 18:07:48 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-96ba1fdc-6afe-4ae7-8013-ffcb5256e023 tempest-AttachVolumeTestJSON-813984703 tempest-AttachVolumeTestJSON-813984703-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9511387c-8772-40f2-bf2d-6b6387649e9f (non-flash)
Nov 29 18:07:48 user nova-compute[74613]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9aad94d-fe0d-415d-9761-9aff25cc6099 (non-flash)
Nov 29 18:07:48 user nova-compute[74613]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8c53a27-dcde-402b-a9bb-d8642f7db0da (non-flash)
Nov 29 18:07:48 user nova-compute[74613]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:34908494-9a6c-4c8c-b447-9768745356ca (non-flash)
Nov 29 18:07:48 user nova-compute[74613]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2879f1d-797c-4701-8803-eb6369ddb534 (non-flash)
Nov 29 18:07:48 user nova-compute[74613]:  stderr= {{(pid=74613) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 18:07:48 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.base [None req-96ba1fdc-6afe-4ae7-8013-ffcb5256e023 tempest-AttachVolumeTestJSON-813984703 tempest-AttachVolumeTestJSON-813984703-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b2879f1d-797c-4701-8803-eb6369ddb534" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.297s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 18:07:48 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-96ba1fdc-6afe-4ae7-8013-ffcb5256e023 tempest-AttachVolumeTestJSON-813984703 tempest-AttachVolumeTestJSON-813984703-project-member] Connected to 172.16.0.220:3260 {{(pid=74613) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 29 18:07:48 user nova-compute[74613]: DEBUG os_brick.initiator.linuxscsi [None req-96ba1fdc-6afe-4ae7-8013-ffcb5256e023 tempest-AttachVolumeTestJSON-813984703 tempest-AttachVolumeTestJSON-813984703-project-member] HCTL ('37', '-', '-', 0) found on session 36 with lun 0 {{(pid=74613) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 29 18:07:48 user nova-compute[74613]: DEBUG os_brick.initiator.linuxscsi [None req-96ba1fdc-6afe-4ae7-8013-ffcb5256e023 tempest-AttachVolumeTestJSON-813984703 tempest-AttachVolumeTestJSON-813984703-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=74613) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 29 18:07:48 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:07:48 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.016s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:07:48 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[ddf1196b-177e-4e92-92b6-181cedc7fa91]: (4, ('- - 0', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 18:07:48 user nova-compute[74613]: DEBUG os_brick.initiator.linuxscsi [None req-96ba1fdc-6afe-4ae7-8013-ffcb5256e023 tempest-AttachVolumeTestJSON-813984703 tempest-AttachVolumeTestJSON-813984703-project-member] Searching for a device in session 36 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=74613) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 29 18:07:48 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-96ba1fdc-6afe-4ae7-8013-ffcb5256e023 tempest-AttachVolumeTestJSON-813984703 tempest-AttachVolumeTestJSON-813984703-project-member] Connected to sdf using {'target_iqn': 'iqn.2010-10.org.openstack:b2879f1d-797c-4701-8803-eb6369ddb534', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'grDSnlbc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74613) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 29 18:07:49 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-c94e6bc0-a29b-48c4-bf6d-25d18f8d1afa tempest-AttachVolumeNegativeTest-483083654 tempest-AttachVolumeNegativeTest-483083654-project-member] No BDM found with device name vda, not building metadata. {{(pid=74613) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 18:07:49 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-c94e6bc0-a29b-48c4-bf6d-25d18f8d1afa tempest-AttachVolumeNegativeTest-483083654 tempest-AttachVolumeNegativeTest-483083654-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74613) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 18:07:49 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-c94e6bc0-a29b-48c4-bf6d-25d18f8d1afa tempest-AttachVolumeNegativeTest-483083654 tempest-AttachVolumeNegativeTest-483083654-project-member] No VIF found with MAC fa:16:3e:3f:6e:41, not building metadata {{(pid=74613) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 29 18:07:49 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-c94e6bc0-a29b-48c4-bf6d-25d18f8d1afa tempest-AttachVolumeNegativeTest-483083654 tempest-AttachVolumeNegativeTest-483083654-project-member] Lock "e2439d62-4713-435d-81ce-fafe1d811b47" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 10.280s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 18:07:49 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.base [None req-96ba1fdc-6afe-4ae7-8013-ffcb5256e023 tempest-AttachVolumeTestJSON-813984703 tempest-AttachVolumeTestJSON-813984703-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.334s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 18:07:49 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-96ba1fdc-6afe-4ae7-8013-ffcb5256e023 tempest-AttachVolumeTestJSON-813984703 tempest-AttachVolumeTestJSON-813984703-project-member] <== connect_volume: return (2003ms) {'type': 'block', 'scsi_wwn': '23933336166316530', 'path': '/dev/sdf'} {{(pid=74613) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 18:07:49 user nova-compute[74613]: DEBUG nova.virt.libvirt.volume.iscsi [None req-96ba1fdc-6afe-4ae7-8013-ffcb5256e023 tempest-AttachVolumeTestJSON-813984703 tempest-AttachVolumeTestJSON-813984703-project-member] [instance: 69109f06-acbf-4834-b05e-80ab6e3f6ea0] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23933336166316530', 'path': '/dev/sdf'} {{(pid=74613) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 29 18:07:49 user nova-compute[74613]: DEBUG nova.objects.instance [None req-96ba1fdc-6afe-4ae7-8013-ffcb5256e023 tempest-AttachVolumeTestJSON-813984703 tempest-AttachVolumeTestJSON-813984703-project-member] Lazy-loading 'flavor' on Instance uuid 69109f06-acbf-4834-b05e-80ab6e3f6ea0 {{(pid=74613) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 18:07:49 user nova-compute[74613]: DEBUG nova.virt.libvirt.guest [None req-96ba1fdc-6afe-4ae7-8013-ffcb5256e023 tempest-AttachVolumeTestJSON-813984703 tempest-AttachVolumeTestJSON-813984703-project-member] attach device xml: <disk type="block" device="disk">
Nov 29 18:07:49 user nova-compute[74613]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 18:07:49 user nova-compute[74613]:   <source dev="/dev/sdf"/>
Nov 29 18:07:49 user nova-compute[74613]:   <target dev="vdb" bus="virtio"/>
Nov 29 18:07:49 user nova-compute[74613]:   <serial>b2879f1d-797c-4701-8803-eb6369ddb534</serial>
Nov 29 18:07:49 user nova-compute[74613]: </disk>
Nov 29 18:07:49 user nova-compute[74613]:  {{(pid=74613) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 29 18:07:50 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-96ba1fdc-6afe-4ae7-8013-ffcb5256e023 tempest-AttachVolumeTestJSON-813984703 tempest-AttachVolumeTestJSON-813984703-project-member] No BDM found with device name vda, not building metadata. {{(pid=74613) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 18:07:50 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-96ba1fdc-6afe-4ae7-8013-ffcb5256e023 tempest-AttachVolumeTestJSON-813984703 tempest-AttachVolumeTestJSON-813984703-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74613) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 18:07:50 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-96ba1fdc-6afe-4ae7-8013-ffcb5256e023 tempest-AttachVolumeTestJSON-813984703 tempest-AttachVolumeTestJSON-813984703-project-member] No VIF found with MAC fa:16:3e:da:7a:47, not building metadata {{(pid=74613) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 29 18:07:50 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-96ba1fdc-6afe-4ae7-8013-ffcb5256e023 tempest-AttachVolumeTestJSON-813984703 tempest-AttachVolumeTestJSON-813984703-project-member] Lock "69109f06-acbf-4834-b05e-80ab6e3f6ea0" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 10.933s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 18:07:50 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:07:51 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-d451f020-1b04-46c1-9ab7-1e17e5f4d4a6 tempest-AttachVolumeTestJSON-813984703 tempest-AttachVolumeTestJSON-813984703-project-member] Acquiring lock "69109f06-acbf-4834-b05e-80ab6e3f6ea0" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 18:07:51 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-d451f020-1b04-46c1-9ab7-1e17e5f4d4a6 tempest-AttachVolumeTestJSON-813984703 tempest-AttachVolumeTestJSON-813984703-project-member] Lock "69109f06-acbf-4834-b05e-80ab6e3f6ea0" acquired by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: waited 0.002s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 18:07:51 user nova-compute[74613]: DEBUG nova.compute.manager [None req-d451f020-1b04-46c1-9ab7-1e17e5f4d4a6 tempest-AttachVolumeTestJSON-813984703 tempest-AttachVolumeTestJSON-813984703-project-member] [instance: 69109f06-acbf-4834-b05e-80ab6e3f6ea0] Checking state {{(pid=74613) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 29 18:07:51 user nova-compute[74613]: DEBUG nova.compute.manager [None req-d451f020-1b04-46c1-9ab7-1e17e5f4d4a6 tempest-AttachVolumeTestJSON-813984703 tempest-AttachVolumeTestJSON-813984703-project-member] [instance: 69109f06-acbf-4834-b05e-80ab6e3f6ea0] Stopping instance; current vm_state: active, current task_state: powering-off, current DB power_state: 1, current VM power_state: 1 {{(pid=74613) do_stop_instance /opt/stack/nova/nova/compute/manager.py:3358}}
Nov 29 18:07:51 user nova-compute[74613]: DEBUG nova.objects.instance [None req-d451f020-1b04-46c1-9ab7-1e17e5f4d4a6 tempest-AttachVolumeTestJSON-813984703 tempest-AttachVolumeTestJSON-813984703-project-member] Lazy-loading 'flavor' on Instance uuid 69109f06-acbf-4834-b05e-80ab6e3f6ea0 {{(pid=74613) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 18:07:51 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:07:51 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:07:51 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:07:51 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:07:52 user nova-compute[74613]: DEBUG nova.compute.manager [req-be48e1ab-ff6c-4b83-8755-2a50e6babe1f req-79585c32-9a8b-44bf-a9fc-a71024f31184 service nova] [instance: 69109f06-acbf-4834-b05e-80ab6e3f6ea0] Received event network-vif-unplugged-e8b2f9b5-0c3a-4f6f-bf96-566c8a779849 {{(pid=74613) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 18:07:52 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-be48e1ab-ff6c-4b83-8755-2a50e6babe1f req-79585c32-9a8b-44bf-a9fc-a71024f31184 service nova] Acquiring lock "69109f06-acbf-4834-b05e-80ab6e3f6ea0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 18:07:52 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-be48e1ab-ff6c-4b83-8755-2a50e6babe1f req-79585c32-9a8b-44bf-a9fc-a71024f31184 service nova] Lock "69109f06-acbf-4834-b05e-80ab6e3f6ea0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 18:07:52 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-be48e1ab-ff6c-4b83-8755-2a50e6babe1f req-79585c32-9a8b-44bf-a9fc-a71024f31184 service nova] Lock "69109f06-acbf-4834-b05e-80ab6e3f6ea0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 18:07:52 user nova-compute[74613]: DEBUG nova.compute.manager [req-be48e1ab-ff6c-4b83-8755-2a50e6babe1f req-79585c32-9a8b-44bf-a9fc-a71024f31184 service nova] [instance: 69109f06-acbf-4834-b05e-80ab6e3f6ea0] No waiting events found dispatching network-vif-unplugged-e8b2f9b5-0c3a-4f6f-bf96-566c8a779849 {{(pid=74613) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 18:07:52 user nova-compute[74613]: WARNING nova.compute.manager [req-be48e1ab-ff6c-4b83-8755-2a50e6babe1f req-79585c32-9a8b-44bf-a9fc-a71024f31184 service nova] [instance: 69109f06-acbf-4834-b05e-80ab6e3f6ea0] Received unexpected event network-vif-unplugged-e8b2f9b5-0c3a-4f6f-bf96-566c8a779849 for instance with vm_state active and task_state powering-off.
Nov 29 18:07:52 user nova-compute[74613]: INFO nova.virt.libvirt.driver [-] [instance: 69109f06-acbf-4834-b05e-80ab6e3f6ea0] Instance destroyed successfully.
Nov 29 18:07:52 user nova-compute[74613]: DEBUG nova.compute.manager [None req-d451f020-1b04-46c1-9ab7-1e17e5f4d4a6 tempest-AttachVolumeTestJSON-813984703 tempest-AttachVolumeTestJSON-813984703-project-member] [instance: 69109f06-acbf-4834-b05e-80ab6e3f6ea0] Checking state {{(pid=74613) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 29 18:07:52 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-d451f020-1b04-46c1-9ab7-1e17e5f4d4a6 tempest-AttachVolumeTestJSON-813984703 tempest-AttachVolumeTestJSON-813984703-project-member] Lock "69109f06-acbf-4834-b05e-80ab6e3f6ea0" "released" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: held 0.906s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 18:07:52 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-03cc3cca-c7ba-4c52-8428-cb4a643df8e6 tempest-AttachVolumeNegativeTest-483083654 tempest-AttachVolumeNegativeTest-483083654-project-member] Acquiring lock "bdb49266-ed09-4e9a-b3af-eb4b436a71da" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 18:07:52 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-03cc3cca-c7ba-4c52-8428-cb4a643df8e6 tempest-AttachVolumeNegativeTest-483083654 tempest-AttachVolumeNegativeTest-483083654-project-member] Lock "bdb49266-ed09-4e9a-b3af-eb4b436a71da" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 18:07:52 user nova-compute[74613]: DEBUG nova.compute.manager [None req-03cc3cca-c7ba-4c52-8428-cb4a643df8e6 tempest-AttachVolumeNegativeTest-483083654 tempest-AttachVolumeNegativeTest-483083654-project-member] [instance: bdb49266-ed09-4e9a-b3af-eb4b436a71da] Starting instance... {{(pid=74613) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 29 18:07:52 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-03cc3cca-c7ba-4c52-8428-cb4a643df8e6 tempest-AttachVolumeNegativeTest-483083654 tempest-AttachVolumeNegativeTest-483083654-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 18:07:52 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-03cc3cca-c7ba-4c52-8428-cb4a643df8e6 tempest-AttachVolumeNegativeTest-483083654 tempest-AttachVolumeNegativeTest-483083654-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 18:07:53 user nova-compute[74613]: DEBUG nova.virt.hardware [None req-03cc3cca-c7ba-4c52-8428-cb4a643df8e6 tempest-AttachVolumeNegativeTest-483083654 tempest-AttachVolumeNegativeTest-483083654-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74613) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 29 18:07:53 user nova-compute[74613]: INFO nova.compute.claims [None req-03cc3cca-c7ba-4c52-8428-cb4a643df8e6 tempest-AttachVolumeNegativeTest-483083654 tempest-AttachVolumeNegativeTest-483083654-project-member] [instance: bdb49266-ed09-4e9a-b3af-eb4b436a71da] Claim successful on node user
Nov 29 18:07:53 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:07:53 user nova-compute[74613]: DEBUG nova.compute.provider_tree [None req-03cc3cca-c7ba-4c52-8428-cb4a643df8e6 tempest-AttachVolumeNegativeTest-483083654 tempest-AttachVolumeNegativeTest-483083654-project-member] Inventory has not changed in ProviderTree for provider: 639d980e-3b12-44b1-b8f4-1812416fa4dd {{(pid=74613) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 18:07:53 user nova-compute[74613]: DEBUG nova.scheduler.client.report [None req-03cc3cca-c7ba-4c52-8428-cb4a643df8e6 tempest-AttachVolumeNegativeTest-483083654 tempest-AttachVolumeNegativeTest-483083654-project-member] Inventory has not changed for provider 639d980e-3b12-44b1-b8f4-1812416fa4dd based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74613) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 18:07:53 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-03cc3cca-c7ba-4c52-8428-cb4a643df8e6 tempest-AttachVolumeNegativeTest-483083654 tempest-AttachVolumeNegativeTest-483083654-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.428s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 18:07:53 user nova-compute[74613]: DEBUG nova.compute.manager [None req-03cc3cca-c7ba-4c52-8428-cb4a643df8e6 tempest-AttachVolumeNegativeTest-483083654 tempest-AttachVolumeNegativeTest-483083654-project-member] [instance: bdb49266-ed09-4e9a-b3af-eb4b436a71da] Start building networks asynchronously for instance. {{(pid=74613) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 29 18:07:53 user nova-compute[74613]: DEBUG nova.compute.manager [None req-03cc3cca-c7ba-4c52-8428-cb4a643df8e6 tempest-AttachVolumeNegativeTest-483083654 tempest-AttachVolumeNegativeTest-483083654-project-member] [instance: bdb49266-ed09-4e9a-b3af-eb4b436a71da] Allocating IP information in the background. {{(pid=74613) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 29 18:07:53 user nova-compute[74613]: DEBUG nova.network.neutron [None req-03cc3cca-c7ba-4c52-8428-cb4a643df8e6 tempest-AttachVolumeNegativeTest-483083654 tempest-AttachVolumeNegativeTest-483083654-project-member] [instance: bdb49266-ed09-4e9a-b3af-eb4b436a71da] allocate_for_instance() {{(pid=74613) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 29 18:07:53 user nova-compute[74613]: INFO nova.virt.libvirt.driver [None req-03cc3cca-c7ba-4c52-8428-cb4a643df8e6 tempest-AttachVolumeNegativeTest-483083654 tempest-AttachVolumeNegativeTest-483083654-project-member] [instance: bdb49266-ed09-4e9a-b3af-eb4b436a71da] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 29 18:07:53 user nova-compute[74613]: DEBUG nova.compute.manager [None req-03cc3cca-c7ba-4c52-8428-cb4a643df8e6 tempest-AttachVolumeNegativeTest-483083654 tempest-AttachVolumeNegativeTest-483083654-project-member] [instance: bdb49266-ed09-4e9a-b3af-eb4b436a71da] Start building block device mappings for instance. {{(pid=74613) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 29 18:07:53 user nova-compute[74613]: DEBUG nova.policy [None req-03cc3cca-c7ba-4c52-8428-cb4a643df8e6 tempest-AttachVolumeNegativeTest-483083654 tempest-AttachVolumeNegativeTest-483083654-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '57b1f3743f0e4cbdae1dab9e4761511e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37b89c13ba1d4a94805d6af69ad26fb8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74613) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 29 18:07:53 user nova-compute[74613]: DEBUG nova.compute.manager [None req-03cc3cca-c7ba-4c52-8428-cb4a643df8e6 tempest-AttachVolumeNegativeTest-483083654 tempest-AttachVolumeNegativeTest-483083654-project-member] [instance: bdb49266-ed09-4e9a-b3af-eb4b436a71da] Start spawning the instance on the hypervisor. {{(pid=74613) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 29 18:07:53 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-03cc3cca-c7ba-4c52-8428-cb4a643df8e6 tempest-AttachVolumeNegativeTest-483083654 tempest-AttachVolumeNegativeTest-483083654-project-member] [instance: bdb49266-ed09-4e9a-b3af-eb4b436a71da] Creating instance directory {{(pid=74613) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 29 18:07:53 user nova-compute[74613]: INFO nova.virt.libvirt.driver [None req-03cc3cca-c7ba-4c52-8428-cb4a643df8e6 tempest-AttachVolumeNegativeTest-483083654 tempest-AttachVolumeNegativeTest-483083654-project-member] [instance: bdb49266-ed09-4e9a-b3af-eb4b436a71da] Creating image(s)
Nov 29 18:07:53 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-03cc3cca-c7ba-4c52-8428-cb4a643df8e6 tempest-AttachVolumeNegativeTest-483083654 tempest-AttachVolumeNegativeTest-483083654-project-member] Acquiring lock "/opt/stack/data/nova/instances/bdb49266-ed09-4e9a-b3af-eb4b436a71da/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 18:07:53 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-03cc3cca-c7ba-4c52-8428-cb4a643df8e6 tempest-AttachVolumeNegativeTest-483083654 tempest-AttachVolumeNegativeTest-483083654-project-member] Lock "/opt/stack/data/nova/instances/bdb49266-ed09-4e9a-b3af-eb4b436a71da/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 18:07:53 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-03cc3cca-c7ba-4c52-8428-cb4a643df8e6 tempest-AttachVolumeNegativeTest-483083654 tempest-AttachVolumeNegativeTest-483083654-project-member] Lock "/opt/stack/data/nova/instances/bdb49266-ed09-4e9a-b3af-eb4b436a71da/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 18:07:53 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-03cc3cca-c7ba-4c52-8428-cb4a643df8e6 tempest-AttachVolumeNegativeTest-483083654 tempest-AttachVolumeNegativeTest-483083654-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/21faea9e6951f3bdd0153b76ac89fe1a60a34758 --force-share --output=json {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:07:53 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-03cc3cca-c7ba-4c52-8428-cb4a643df8e6 tempest-AttachVolumeNegativeTest-483083654 tempest-AttachVolumeNegativeTest-483083654-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/21faea9e6951f3bdd0153b76ac89fe1a60a34758 --force-share --output=json" returned: 0 in 0.198s {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:07:53 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-03cc3cca-c7ba-4c52-8428-cb4a643df8e6 tempest-AttachVolumeNegativeTest-483083654 tempest-AttachVolumeNegativeTest-483083654-project-member] Acquiring lock "21faea9e6951f3bdd0153b76ac89fe1a60a34758" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 18:07:53 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-03cc3cca-c7ba-4c52-8428-cb4a643df8e6 tempest-AttachVolumeNegativeTest-483083654 tempest-AttachVolumeNegativeTest-483083654-project-member] Lock "21faea9e6951f3bdd0153b76ac89fe1a60a34758" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 18:07:53 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-03cc3cca-c7ba-4c52-8428-cb4a643df8e6 tempest-AttachVolumeNegativeTest-483083654 tempest-AttachVolumeNegativeTest-483083654-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/21faea9e6951f3bdd0153b76ac89fe1a60a34758 --force-share --output=json {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:07:54 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-03cc3cca-c7ba-4c52-8428-cb4a643df8e6 tempest-AttachVolumeNegativeTest-483083654 tempest-AttachVolumeNegativeTest-483083654-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/21faea9e6951f3bdd0153b76ac89fe1a60a34758 --force-share --output=json" returned: 0 in 0.215s {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:07:54 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-03cc3cca-c7ba-4c52-8428-cb4a643df8e6 tempest-AttachVolumeNegativeTest-483083654 tempest-AttachVolumeNegativeTest-483083654-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/21faea9e6951f3bdd0153b76ac89fe1a60a34758,backing_fmt=raw /opt/stack/data/nova/instances/bdb49266-ed09-4e9a-b3af-eb4b436a71da/disk 1073741824 {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:07:54 user nova-compute[74613]: DEBUG nova.compute.manager [req-bcd4e020-6a6d-4ae7-877d-9f7d73c1ed04 req-f9addd40-d0d7-4228-9b29-a31ec162de75 service nova] [instance: 69109f06-acbf-4834-b05e-80ab6e3f6ea0] Received event network-vif-plugged-e8b2f9b5-0c3a-4f6f-bf96-566c8a779849 {{(pid=74613) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 18:07:54 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-bcd4e020-6a6d-4ae7-877d-9f7d73c1ed04 req-f9addd40-d0d7-4228-9b29-a31ec162de75 service nova] Acquiring lock "69109f06-acbf-4834-b05e-80ab6e3f6ea0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 18:07:54 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-bcd4e020-6a6d-4ae7-877d-9f7d73c1ed04 req-f9addd40-d0d7-4228-9b29-a31ec162de75 service nova] Lock "69109f06-acbf-4834-b05e-80ab6e3f6ea0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 18:07:54 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-bcd4e020-6a6d-4ae7-877d-9f7d73c1ed04 req-f9addd40-d0d7-4228-9b29-a31ec162de75 service nova] Lock "69109f06-acbf-4834-b05e-80ab6e3f6ea0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 18:07:54 user nova-compute[74613]: DEBUG nova.compute.manager [req-bcd4e020-6a6d-4ae7-877d-9f7d73c1ed04 req-f9addd40-d0d7-4228-9b29-a31ec162de75 service nova] [instance: 69109f06-acbf-4834-b05e-80ab6e3f6ea0] No waiting events found dispatching network-vif-plugged-e8b2f9b5-0c3a-4f6f-bf96-566c8a779849 {{(pid=74613) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 18:07:54 user nova-compute[74613]: WARNING nova.compute.manager [req-bcd4e020-6a6d-4ae7-877d-9f7d73c1ed04 req-f9addd40-d0d7-4228-9b29-a31ec162de75 service nova] [instance: 69109f06-acbf-4834-b05e-80ab6e3f6ea0] Received unexpected event network-vif-plugged-e8b2f9b5-0c3a-4f6f-bf96-566c8a779849 for instance with vm_state stopped and task_state None.
Nov 29 18:07:54 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-03cc3cca-c7ba-4c52-8428-cb4a643df8e6 tempest-AttachVolumeNegativeTest-483083654 tempest-AttachVolumeNegativeTest-483083654-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/21faea9e6951f3bdd0153b76ac89fe1a60a34758,backing_fmt=raw /opt/stack/data/nova/instances/bdb49266-ed09-4e9a-b3af-eb4b436a71da/disk 1073741824" returned: 0 in 0.194s {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:07:54 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-03cc3cca-c7ba-4c52-8428-cb4a643df8e6 tempest-AttachVolumeNegativeTest-483083654 tempest-AttachVolumeNegativeTest-483083654-project-member] Lock "21faea9e6951f3bdd0153b76ac89fe1a60a34758" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.413s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 18:07:54 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-03cc3cca-c7ba-4c52-8428-cb4a643df8e6 tempest-AttachVolumeNegativeTest-483083654 tempest-AttachVolumeNegativeTest-483083654-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/21faea9e6951f3bdd0153b76ac89fe1a60a34758 --force-share --output=json {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:07:54 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-03cc3cca-c7ba-4c52-8428-cb4a643df8e6 tempest-AttachVolumeNegativeTest-483083654 tempest-AttachVolumeNegativeTest-483083654-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/21faea9e6951f3bdd0153b76ac89fe1a60a34758 --force-share --output=json" returned: 0 in 0.179s {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:07:54 user nova-compute[74613]: DEBUG nova.virt.disk.api [None req-03cc3cca-c7ba-4c52-8428-cb4a643df8e6 tempest-AttachVolumeNegativeTest-483083654 tempest-AttachVolumeNegativeTest-483083654-project-member] Checking if we can resize image /opt/stack/data/nova/instances/bdb49266-ed09-4e9a-b3af-eb4b436a71da/disk. size=1073741824 {{(pid=74613) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 29 18:07:54 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-03cc3cca-c7ba-4c52-8428-cb4a643df8e6 tempest-AttachVolumeNegativeTest-483083654 tempest-AttachVolumeNegativeTest-483083654-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bdb49266-ed09-4e9a-b3af-eb4b436a71da/disk --force-share --output=json {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:07:54 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-03cc3cca-c7ba-4c52-8428-cb4a643df8e6 tempest-AttachVolumeNegativeTest-483083654 tempest-AttachVolumeNegativeTest-483083654-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bdb49266-ed09-4e9a-b3af-eb4b436a71da/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:07:54 user nova-compute[74613]: DEBUG nova.virt.disk.api [None req-03cc3cca-c7ba-4c52-8428-cb4a643df8e6 tempest-AttachVolumeNegativeTest-483083654 tempest-AttachVolumeNegativeTest-483083654-project-member] Cannot resize image /opt/stack/data/nova/instances/bdb49266-ed09-4e9a-b3af-eb4b436a71da/disk to a smaller size. {{(pid=74613) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 29 18:07:54 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-03cc3cca-c7ba-4c52-8428-cb4a643df8e6 tempest-AttachVolumeNegativeTest-483083654 tempest-AttachVolumeNegativeTest-483083654-project-member] [instance: bdb49266-ed09-4e9a-b3af-eb4b436a71da] Created local disks {{(pid=74613) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 29 18:07:54 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-03cc3cca-c7ba-4c52-8428-cb4a643df8e6 tempest-AttachVolumeNegativeTest-483083654 tempest-AttachVolumeNegativeTest-483083654-project-member] [instance: bdb49266-ed09-4e9a-b3af-eb4b436a71da] Ensure instance console log exists: /opt/stack/data/nova/instances/bdb49266-ed09-4e9a-b3af-eb4b436a71da/console.log {{(pid=74613) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 29 18:07:54 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-03cc3cca-c7ba-4c52-8428-cb4a643df8e6 tempest-AttachVolumeNegativeTest-483083654 tempest-AttachVolumeNegativeTest-483083654-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 18:07:54 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-03cc3cca-c7ba-4c52-8428-cb4a643df8e6 tempest-AttachVolumeNegativeTest-483083654 tempest-AttachVolumeNegativeTest-483083654-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 18:07:54 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-03cc3cca-c7ba-4c52-8428-cb4a643df8e6 tempest-AttachVolumeNegativeTest-483083654 tempest-AttachVolumeNegativeTest-483083654-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 18:07:54 user nova-compute[74613]: DEBUG nova.network.neutron [None req-03cc3cca-c7ba-4c52-8428-cb4a643df8e6 tempest-AttachVolumeNegativeTest-483083654 tempest-AttachVolumeNegativeTest-483083654-project-member] [instance: bdb49266-ed09-4e9a-b3af-eb4b436a71da] Successfully created port: 8e24565f-8217-4e78-a37c-53f7fd1c9742 {{(pid=74613) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 29 18:07:55 user nova-compute[74613]: DEBUG nova.network.neutron [None req-03cc3cca-c7ba-4c52-8428-cb4a643df8e6 tempest-AttachVolumeNegativeTest-483083654 tempest-AttachVolumeNegativeTest-483083654-project-member] [instance: bdb49266-ed09-4e9a-b3af-eb4b436a71da] Successfully updated port: 8e24565f-8217-4e78-a37c-53f7fd1c9742 {{(pid=74613) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 29 18:07:55 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-03cc3cca-c7ba-4c52-8428-cb4a643df8e6 tempest-AttachVolumeNegativeTest-483083654 tempest-AttachVolumeNegativeTest-483083654-project-member] Acquiring lock "refresh_cache-bdb49266-ed09-4e9a-b3af-eb4b436a71da" {{(pid=74613) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 18:07:55 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-03cc3cca-c7ba-4c52-8428-cb4a643df8e6 tempest-AttachVolumeNegativeTest-483083654 tempest-AttachVolumeNegativeTest-483083654-project-member] Acquired lock "refresh_cache-bdb49266-ed09-4e9a-b3af-eb4b436a71da" {{(pid=74613) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 18:07:55 user nova-compute[74613]: DEBUG nova.network.neutron [None req-03cc3cca-c7ba-4c52-8428-cb4a643df8e6 tempest-AttachVolumeNegativeTest-483083654 tempest-AttachVolumeNegativeTest-483083654-project-member] [instance: bdb49266-ed09-4e9a-b3af-eb4b436a71da] Building network info cache for instance {{(pid=74613) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 29 18:07:55 user nova-compute[74613]: DEBUG nova.compute.manager [req-ab0cde66-9ab7-4904-a3a6-4c262edb969f req-bca85cb6-5040-4d98-8188-0a1fd8db1cfc service nova] [instance: bdb49266-ed09-4e9a-b3af-eb4b436a71da] Received event network-changed-8e24565f-8217-4e78-a37c-53f7fd1c9742 {{(pid=74613) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 18:07:55 user nova-compute[74613]: DEBUG nova.compute.manager [req-ab0cde66-9ab7-4904-a3a6-4c262edb969f req-bca85cb6-5040-4d98-8188-0a1fd8db1cfc service nova] [instance: bdb49266-ed09-4e9a-b3af-eb4b436a71da] Refreshing instance network info cache due to event network-changed-8e24565f-8217-4e78-a37c-53f7fd1c9742. {{(pid=74613) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 18:07:55 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-ab0cde66-9ab7-4904-a3a6-4c262edb969f req-bca85cb6-5040-4d98-8188-0a1fd8db1cfc service nova] Acquiring lock "refresh_cache-bdb49266-ed09-4e9a-b3af-eb4b436a71da" {{(pid=74613) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 18:07:55 user nova-compute[74613]: DEBUG nova.network.neutron [None req-03cc3cca-c7ba-4c52-8428-cb4a643df8e6 tempest-AttachVolumeNegativeTest-483083654 tempest-AttachVolumeNegativeTest-483083654-project-member] [instance: bdb49266-ed09-4e9a-b3af-eb4b436a71da] Instance cache missing network info. {{(pid=74613) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 29 18:07:55 user nova-compute[74613]: DEBUG nova.network.neutron [None req-03cc3cca-c7ba-4c52-8428-cb4a643df8e6 tempest-AttachVolumeNegativeTest-483083654 tempest-AttachVolumeNegativeTest-483083654-project-member] [instance: bdb49266-ed09-4e9a-b3af-eb4b436a71da] Updating instance_info_cache with network_info: [{"id": "8e24565f-8217-4e78-a37c-53f7fd1c9742", "address": "fa:16:3e:32:23:9b", "network": {"id": "c317481b-f8cf-40a0-a326-836a5ea4c495", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-887666255-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "37b89c13ba1d4a94805d6af69ad26fb8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8e24565f-82", "ovs_interfaceid": "8e24565f-8217-4e78-a37c-53f7fd1c9742", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74613) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 18:07:55 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:07:55 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-03cc3cca-c7ba-4c52-8428-cb4a643df8e6 tempest-AttachVolumeNegativeTest-483083654 tempest-AttachVolumeNegativeTest-483083654-project-member] Releasing lock "refresh_cache-bdb49266-ed09-4e9a-b3af-eb4b436a71da" {{(pid=74613) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 18:07:55 user nova-compute[74613]: DEBUG nova.compute.manager [None req-03cc3cca-c7ba-4c52-8428-cb4a643df8e6 tempest-AttachVolumeNegativeTest-483083654 tempest-AttachVolumeNegativeTest-483083654-project-member] [instance: bdb49266-ed09-4e9a-b3af-eb4b436a71da] Instance network_info: |[{"id": "8e24565f-8217-4e78-a37c-53f7fd1c9742", "address": "fa:16:3e:32:23:9b", "network": {"id": "c317481b-f8cf-40a0-a326-836a5ea4c495", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-887666255-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "37b89c13ba1d4a94805d6af69ad26fb8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8e24565f-82", "ovs_interfaceid": "8e24565f-8217-4e78-a37c-53f7fd1c9742", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74613) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 29 18:07:55 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-ab0cde66-9ab7-4904-a3a6-4c262edb969f req-bca85cb6-5040-4d98-8188-0a1fd8db1cfc service nova] Acquired lock "refresh_cache-bdb49266-ed09-4e9a-b3af-eb4b436a71da" {{(pid=74613) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 18:07:55 user nova-compute[74613]: DEBUG nova.network.neutron [req-ab0cde66-9ab7-4904-a3a6-4c262edb969f req-bca85cb6-5040-4d98-8188-0a1fd8db1cfc service nova] [instance: bdb49266-ed09-4e9a-b3af-eb4b436a71da] Refreshing network info cache for port 8e24565f-8217-4e78-a37c-53f7fd1c9742 {{(pid=74613) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 18:07:55 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-03cc3cca-c7ba-4c52-8428-cb4a643df8e6 tempest-AttachVolumeNegativeTest-483083654 tempest-AttachVolumeNegativeTest-483083654-project-member] [instance: bdb49266-ed09-4e9a-b3af-eb4b436a71da] Start _get_guest_xml network_info=[{"id": "8e24565f-8217-4e78-a37c-53f7fd1c9742", "address": "fa:16:3e:32:23:9b", "network": {"id": "c317481b-f8cf-40a0-a326-836a5ea4c495", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-887666255-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "37b89c13ba1d4a94805d6af69ad26fb8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8e24565f-82", "ovs_interfaceid": "8e24565f-8217-4e78-a37c-53f7fd1c9742", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-29T17:47:38Z,direct_url=<?>,disk_format='qcow2',id=4217f428-8d9d-4ee1-9614-642d26d90c46,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='794b07cbd46a44b5865cfda741036bae',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-29T17:47:40Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'size': 0, 'device_type': 'disk', 'boot_index': 0, 'guest_format': None, 'encrypted': False, 'encryption_format': None, 'disk_bus': 'virtio', 'image_id': '4217f428-8d9d-4ee1-9614-642d26d90c46'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74613) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 29 18:07:55 user nova-compute[74613]: WARNING nova.virt.libvirt.driver [None req-03cc3cca-c7ba-4c52-8428-cb4a643df8e6 tempest-AttachVolumeNegativeTest-483083654 tempest-AttachVolumeNegativeTest-483083654-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 18:07:55 user nova-compute[74613]: WARNING nova.virt.libvirt.driver [None req-03cc3cca-c7ba-4c52-8428-cb4a643df8e6 tempest-AttachVolumeNegativeTest-483083654 tempest-AttachVolumeNegativeTest-483083654-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 18:07:55 user nova-compute[74613]: DEBUG nova.virt.libvirt.host [None req-03cc3cca-c7ba-4c52-8428-cb4a643df8e6 tempest-AttachVolumeNegativeTest-483083654 tempest-AttachVolumeNegativeTest-483083654-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74613) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 29 18:07:55 user nova-compute[74613]: DEBUG nova.virt.libvirt.host [None req-03cc3cca-c7ba-4c52-8428-cb4a643df8e6 tempest-AttachVolumeNegativeTest-483083654 tempest-AttachVolumeNegativeTest-483083654-project-member] CPU controller missing on host. {{(pid=74613) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 29 18:07:55 user nova-compute[74613]: DEBUG nova.virt.libvirt.host [None req-03cc3cca-c7ba-4c52-8428-cb4a643df8e6 tempest-AttachVolumeNegativeTest-483083654 tempest-AttachVolumeNegativeTest-483083654-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74613) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 29 18:07:55 user nova-compute[74613]: DEBUG nova.virt.libvirt.host [None req-03cc3cca-c7ba-4c52-8428-cb4a643df8e6 tempest-AttachVolumeNegativeTest-483083654 tempest-AttachVolumeNegativeTest-483083654-project-member] CPU controller found on host. {{(pid=74613) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 29 18:07:55 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-03cc3cca-c7ba-4c52-8428-cb4a643df8e6 tempest-AttachVolumeNegativeTest-483083654 tempest-AttachVolumeNegativeTest-483083654-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74613) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 29 18:07:55 user nova-compute[74613]: DEBUG nova.virt.hardware [None req-03cc3cca-c7ba-4c52-8428-cb4a643df8e6 tempest-AttachVolumeNegativeTest-483083654 tempest-AttachVolumeNegativeTest-483083654-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-29T17:47:27Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-29T17:47:38Z,direct_url=<?>,disk_format='qcow2',id=4217f428-8d9d-4ee1-9614-642d26d90c46,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='794b07cbd46a44b5865cfda741036bae',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-29T17:47:40Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74613) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 29 18:07:55 user nova-compute[74613]: DEBUG nova.virt.hardware [None req-03cc3cca-c7ba-4c52-8428-cb4a643df8e6 tempest-AttachVolumeNegativeTest-483083654 tempest-AttachVolumeNegativeTest-483083654-project-member] Flavor limits 0:0:0 {{(pid=74613) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 29 18:07:55 user nova-compute[74613]: DEBUG nova.virt.hardware [None req-03cc3cca-c7ba-4c52-8428-cb4a643df8e6 tempest-AttachVolumeNegativeTest-483083654 tempest-AttachVolumeNegativeTest-483083654-project-member] Image limits 0:0:0 {{(pid=74613) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 29 18:07:55 user nova-compute[74613]: DEBUG nova.virt.hardware [None req-03cc3cca-c7ba-4c52-8428-cb4a643df8e6 tempest-AttachVolumeNegativeTest-483083654 tempest-AttachVolumeNegativeTest-483083654-project-member] Flavor pref 0:0:0 {{(pid=74613) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 29 18:07:55 user nova-compute[74613]: DEBUG nova.virt.hardware [None req-03cc3cca-c7ba-4c52-8428-cb4a643df8e6 tempest-AttachVolumeNegativeTest-483083654 tempest-AttachVolumeNegativeTest-483083654-project-member] Image pref 0:0:0 {{(pid=74613) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 29 18:07:55 user nova-compute[74613]: DEBUG nova.virt.hardware [None req-03cc3cca-c7ba-4c52-8428-cb4a643df8e6 tempest-AttachVolumeNegativeTest-483083654 tempest-AttachVolumeNegativeTest-483083654-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74613) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 29 18:07:55 user nova-compute[74613]: DEBUG nova.virt.hardware [None req-03cc3cca-c7ba-4c52-8428-cb4a643df8e6 tempest-AttachVolumeNegativeTest-483083654 tempest-AttachVolumeNegativeTest-483083654-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74613) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 29 18:07:55 user nova-compute[74613]: DEBUG nova.virt.hardware [None req-03cc3cca-c7ba-4c52-8428-cb4a643df8e6 tempest-AttachVolumeNegativeTest-483083654 tempest-AttachVolumeNegativeTest-483083654-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74613) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 29 18:07:55 user nova-compute[74613]: DEBUG nova.virt.hardware [None req-03cc3cca-c7ba-4c52-8428-cb4a643df8e6 tempest-AttachVolumeNegativeTest-483083654 tempest-AttachVolumeNegativeTest-483083654-project-member] Got 1 possible topologies {{(pid=74613) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 29 18:07:55 user nova-compute[74613]: DEBUG nova.virt.hardware [None req-03cc3cca-c7ba-4c52-8428-cb4a643df8e6 tempest-AttachVolumeNegativeTest-483083654 tempest-AttachVolumeNegativeTest-483083654-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74613) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 29 18:07:55 user nova-compute[74613]: DEBUG nova.virt.hardware [None req-03cc3cca-c7ba-4c52-8428-cb4a643df8e6 tempest-AttachVolumeNegativeTest-483083654 tempest-AttachVolumeNegativeTest-483083654-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74613) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 29 18:07:55 user nova-compute[74613]: DEBUG nova.virt.libvirt.vif [None req-03cc3cca-c7ba-4c52-8428-cb4a643df8e6 tempest-AttachVolumeNegativeTest-483083654 tempest-AttachVolumeNegativeTest-483083654-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T18:07:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1298686911',display_name='tempest-AttachVolumeNegativeTest-server-1298686911',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1298686911',id=33,image_ref='4217f428-8d9d-4ee1-9614-642d26d90c46',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFUyRMq62dwJK+HHdpoZ5XJMUq0BsAXYaSsvoXkfzAtWrqqK0lmE77TNB5eAkUPzByeGOhv1ex5b2IR6eoHZKW9iBiQEP2eroByZIatidQr9TjFy7qrxLYLwMWqUmzpGJA==',key_name='tempest-keypair-1140002678',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='37b89c13ba1d4a94805d6af69ad26fb8',ramdisk_id='',reservation_id='r-0ztjzns2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='4217f428-8d9d-4ee1-9614-642d26d90c46',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-483083654',owner_user_name='tempest-AttachVolumeNegativeTest-483083654-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T18:07:54Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='57b1f3743f0e4cbdae1dab9e4761511e',uuid=bdb49266-ed09-4e9a-b3af-eb4b436a71da,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8e24565f-8217-4e78-a37c-53f7fd1c9742", "address": "fa:16:3e:32:23:9b", "network": {"id": "c317481b-f8cf-40a0-a326-836a5ea4c495", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-887666255-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "37b89c13ba1d4a94805d6af69ad26fb8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8e24565f-82", "ovs_interfaceid": "8e24565f-8217-4e78-a37c-53f7fd1c9742", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74613) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 29 18:07:55 user nova-compute[74613]: DEBUG nova.network.os_vif_util [None req-03cc3cca-c7ba-4c52-8428-cb4a643df8e6 tempest-AttachVolumeNegativeTest-483083654 tempest-AttachVolumeNegativeTest-483083654-project-member] Converting VIF {"id": "8e24565f-8217-4e78-a37c-53f7fd1c9742", "address": "fa:16:3e:32:23:9b", "network": {"id": "c317481b-f8cf-40a0-a326-836a5ea4c495", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-887666255-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "37b89c13ba1d4a94805d6af69ad26fb8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8e24565f-82", "ovs_interfaceid": "8e24565f-8217-4e78-a37c-53f7fd1c9742", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74613) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 18:07:55 user nova-compute[74613]: DEBUG nova.network.os_vif_util [None req-03cc3cca-c7ba-4c52-8428-cb4a643df8e6 tempest-AttachVolumeNegativeTest-483083654 tempest-AttachVolumeNegativeTest-483083654-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:32:23:9b,bridge_name='br-int',has_traffic_filtering=True,id=8e24565f-8217-4e78-a37c-53f7fd1c9742,network=Network(c317481b-f8cf-40a0-a326-836a5ea4c495),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8e24565f-82') {{(pid=74613) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 18:07:55 user nova-compute[74613]: DEBUG nova.objects.instance [None req-03cc3cca-c7ba-4c52-8428-cb4a643df8e6 tempest-AttachVolumeNegativeTest-483083654 tempest-AttachVolumeNegativeTest-483083654-project-member] Lazy-loading 'pci_devices' on Instance uuid bdb49266-ed09-4e9a-b3af-eb4b436a71da {{(pid=74613) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 18:07:55 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-03cc3cca-c7ba-4c52-8428-cb4a643df8e6 tempest-AttachVolumeNegativeTest-483083654 tempest-AttachVolumeNegativeTest-483083654-project-member] [instance: bdb49266-ed09-4e9a-b3af-eb4b436a71da] End _get_guest_xml xml=<domain type="kvm">
Nov 29 18:07:55 user nova-compute[74613]:   <uuid>bdb49266-ed09-4e9a-b3af-eb4b436a71da</uuid>
Nov 29 18:07:55 user nova-compute[74613]:   <name>instance-00000021</name>
Nov 29 18:07:55 user nova-compute[74613]:   <memory>524288</memory>
Nov 29 18:07:55 user nova-compute[74613]:   <vcpu>1</vcpu>
Nov 29 18:07:55 user nova-compute[74613]:   <metadata>
Nov 29 18:07:55 user nova-compute[74613]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 29 18:07:55 user nova-compute[74613]:       <nova:package version="0.0.0"/>
Nov 29 18:07:55 user nova-compute[74613]:       <nova:name>tempest-AttachVolumeNegativeTest-server-1298686911</nova:name>
Nov 29 18:07:55 user nova-compute[74613]:       <nova:creationTime>2023-11-29 18:07:55</nova:creationTime>
Nov 29 18:07:55 user nova-compute[74613]:       <nova:flavor name="m1.tiny">
Nov 29 18:07:55 user nova-compute[74613]:         <nova:memory>512</nova:memory>
Nov 29 18:07:55 user nova-compute[74613]:         <nova:disk>1</nova:disk>
Nov 29 18:07:55 user nova-compute[74613]:         <nova:swap>0</nova:swap>
Nov 29 18:07:55 user nova-compute[74613]:         <nova:ephemeral>0</nova:ephemeral>
Nov 29 18:07:55 user nova-compute[74613]:         <nova:vcpus>1</nova:vcpus>
Nov 29 18:07:55 user nova-compute[74613]:       </nova:flavor>
Nov 29 18:07:55 user nova-compute[74613]:       <nova:owner>
Nov 29 18:07:55 user nova-compute[74613]:         <nova:user uuid="57b1f3743f0e4cbdae1dab9e4761511e">tempest-AttachVolumeNegativeTest-483083654-project-member</nova:user>
Nov 29 18:07:55 user nova-compute[74613]:         <nova:project uuid="37b89c13ba1d4a94805d6af69ad26fb8">tempest-AttachVolumeNegativeTest-483083654</nova:project>
Nov 29 18:07:55 user nova-compute[74613]:       </nova:owner>
Nov 29 18:07:55 user nova-compute[74613]:       <nova:root type="image" uuid="4217f428-8d9d-4ee1-9614-642d26d90c46"/>
Nov 29 18:07:55 user nova-compute[74613]:       <nova:ports>
Nov 29 18:07:55 user nova-compute[74613]:         <nova:port uuid="8e24565f-8217-4e78-a37c-53f7fd1c9742">
Nov 29 18:07:55 user nova-compute[74613]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Nov 29 18:07:55 user nova-compute[74613]:         </nova:port>
Nov 29 18:07:55 user nova-compute[74613]:       </nova:ports>
Nov 29 18:07:55 user nova-compute[74613]:     </nova:instance>
Nov 29 18:07:55 user nova-compute[74613]:   </metadata>
Nov 29 18:07:55 user nova-compute[74613]:   <sysinfo type="smbios">
Nov 29 18:07:55 user nova-compute[74613]:     <system>
Nov 29 18:07:55 user nova-compute[74613]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 29 18:07:55 user nova-compute[74613]:       <entry name="product">OpenStack Nova</entry>
Nov 29 18:07:55 user nova-compute[74613]:       <entry name="version">0.0.0</entry>
Nov 29 18:07:55 user nova-compute[74613]:       <entry name="serial">bdb49266-ed09-4e9a-b3af-eb4b436a71da</entry>
Nov 29 18:07:55 user nova-compute[74613]:       <entry name="uuid">bdb49266-ed09-4e9a-b3af-eb4b436a71da</entry>
Nov 29 18:07:55 user nova-compute[74613]:       <entry name="family">Virtual Machine</entry>
Nov 29 18:07:55 user nova-compute[74613]:     </system>
Nov 29 18:07:55 user nova-compute[74613]:   </sysinfo>
Nov 29 18:07:55 user nova-compute[74613]:   <os>
Nov 29 18:07:55 user nova-compute[74613]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 29 18:07:55 user nova-compute[74613]:     <boot dev="hd"/>
Nov 29 18:07:55 user nova-compute[74613]:     <smbios mode="sysinfo"/>
Nov 29 18:07:55 user nova-compute[74613]:   </os>
Nov 29 18:07:55 user nova-compute[74613]:   <features>
Nov 29 18:07:55 user nova-compute[74613]:     <acpi/>
Nov 29 18:07:55 user nova-compute[74613]:     <apic/>
Nov 29 18:07:55 user nova-compute[74613]:     <vmcoreinfo/>
Nov 29 18:07:55 user nova-compute[74613]:   </features>
Nov 29 18:07:55 user nova-compute[74613]:   <clock offset="utc">
Nov 29 18:07:55 user nova-compute[74613]:     <timer name="pit" tickpolicy="delay"/>
Nov 29 18:07:55 user nova-compute[74613]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 29 18:07:55 user nova-compute[74613]:     <timer name="hpet" present="no"/>
Nov 29 18:07:55 user nova-compute[74613]:   </clock>
Nov 29 18:07:55 user nova-compute[74613]:   <cpu mode="custom" match="exact">
Nov 29 18:07:55 user nova-compute[74613]:     <model>Nehalem</model>
Nov 29 18:07:55 user nova-compute[74613]:     <topology sockets="1" cores="1" threads="1"/>
Nov 29 18:07:55 user nova-compute[74613]:   </cpu>
Nov 29 18:07:55 user nova-compute[74613]:   <devices>
Nov 29 18:07:55 user nova-compute[74613]:     <disk type="file" device="disk">
Nov 29 18:07:55 user nova-compute[74613]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 29 18:07:55 user nova-compute[74613]:       <source file="/opt/stack/data/nova/instances/bdb49266-ed09-4e9a-b3af-eb4b436a71da/disk"/>
Nov 29 18:07:55 user nova-compute[74613]:       <target dev="vda" bus="virtio"/>
Nov 29 18:07:55 user nova-compute[74613]:     </disk>
Nov 29 18:07:55 user nova-compute[74613]:     <interface type="ethernet">
Nov 29 18:07:55 user nova-compute[74613]:       <mac address="fa:16:3e:32:23:9b"/>
Nov 29 18:07:55 user nova-compute[74613]:       <model type="virtio"/>
Nov 29 18:07:55 user nova-compute[74613]:       <mtu size="1442"/>
Nov 29 18:07:55 user nova-compute[74613]:       <target dev="tap8e24565f-82"/>
Nov 29 18:07:55 user nova-compute[74613]:     </interface>
Nov 29 18:07:55 user nova-compute[74613]:     <serial type="pty">
Nov 29 18:07:55 user nova-compute[74613]:       <log file="/opt/stack/data/nova/instances/bdb49266-ed09-4e9a-b3af-eb4b436a71da/console.log" append="off"/>
Nov 29 18:07:55 user nova-compute[74613]:     </serial>
Nov 29 18:07:55 user nova-compute[74613]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 29 18:07:55 user nova-compute[74613]:     <video>
Nov 29 18:07:55 user nova-compute[74613]:       <model type="virtio"/>
Nov 29 18:07:55 user nova-compute[74613]:     </video>
Nov 29 18:07:55 user nova-compute[74613]:     <rng model="virtio">
Nov 29 18:07:55 user nova-compute[74613]:       <backend model="random">/dev/urandom</backend>
Nov 29 18:07:55 user nova-compute[74613]:     </rng>
Nov 29 18:07:55 user nova-compute[74613]:     <controller type="usb" index="0" model="none"/>
Nov 29 18:07:55 user nova-compute[74613]:     <memballoon model="virtio">
Nov 29 18:07:55 user nova-compute[74613]:       <stats period="10"/>
Nov 29 18:07:55 user nova-compute[74613]:     </memballoon>
Nov 29 18:07:55 user nova-compute[74613]:   </devices>
Nov 29 18:07:55 user nova-compute[74613]: </domain>
Nov 29 18:07:55 user nova-compute[74613]:  {{(pid=74613) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 29 18:07:55 user nova-compute[74613]: DEBUG nova.virt.libvirt.vif [None req-03cc3cca-c7ba-4c52-8428-cb4a643df8e6 tempest-AttachVolumeNegativeTest-483083654 tempest-AttachVolumeNegativeTest-483083654-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T18:07:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1298686911',display_name='tempest-AttachVolumeNegativeTest-server-1298686911',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1298686911',id=33,image_ref='4217f428-8d9d-4ee1-9614-642d26d90c46',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFUyRMq62dwJK+HHdpoZ5XJMUq0BsAXYaSsvoXkfzAtWrqqK0lmE77TNB5eAkUPzByeGOhv1ex5b2IR6eoHZKW9iBiQEP2eroByZIatidQr9TjFy7qrxLYLwMWqUmzpGJA==',key_name='tempest-keypair-1140002678',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='37b89c13ba1d4a94805d6af69ad26fb8',ramdisk_id='',reservation_id='r-0ztjzns2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='4217f428-8d9d-4ee1-9614-642d26d90c46',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-483083654',owner_user_name='tempest-AttachVolumeNegativeTest-483083654-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T18:07:54Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='57b1f3743f0e4cbdae1dab9e4761511e',uuid=bdb49266-ed09-4e9a-b3af-eb4b436a71da,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8e24565f-8217-4e78-a37c-53f7fd1c9742", "address": "fa:16:3e:32:23:9b", "network": {"id": "c317481b-f8cf-40a0-a326-836a5ea4c495", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-887666255-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "37b89c13ba1d4a94805d6af69ad26fb8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8e24565f-82", "ovs_interfaceid": "8e24565f-8217-4e78-a37c-53f7fd1c9742", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74613) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 29 18:07:55 user nova-compute[74613]: DEBUG nova.network.os_vif_util [None req-03cc3cca-c7ba-4c52-8428-cb4a643df8e6 tempest-AttachVolumeNegativeTest-483083654 tempest-AttachVolumeNegativeTest-483083654-project-member] Converting VIF {"id": "8e24565f-8217-4e78-a37c-53f7fd1c9742", "address": "fa:16:3e:32:23:9b", "network": {"id": "c317481b-f8cf-40a0-a326-836a5ea4c495", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-887666255-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "37b89c13ba1d4a94805d6af69ad26fb8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8e24565f-82", "ovs_interfaceid": "8e24565f-8217-4e78-a37c-53f7fd1c9742", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74613) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 18:07:55 user nova-compute[74613]: DEBUG nova.network.os_vif_util [None req-03cc3cca-c7ba-4c52-8428-cb4a643df8e6 tempest-AttachVolumeNegativeTest-483083654 tempest-AttachVolumeNegativeTest-483083654-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:32:23:9b,bridge_name='br-int',has_traffic_filtering=True,id=8e24565f-8217-4e78-a37c-53f7fd1c9742,network=Network(c317481b-f8cf-40a0-a326-836a5ea4c495),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8e24565f-82') {{(pid=74613) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 18:07:55 user nova-compute[74613]: DEBUG os_vif [None req-03cc3cca-c7ba-4c52-8428-cb4a643df8e6 tempest-AttachVolumeNegativeTest-483083654 tempest-AttachVolumeNegativeTest-483083654-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:32:23:9b,bridge_name='br-int',has_traffic_filtering=True,id=8e24565f-8217-4e78-a37c-53f7fd1c9742,network=Network(c317481b-f8cf-40a0-a326-836a5ea4c495),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8e24565f-82') {{(pid=74613) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 29 18:07:55 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:07:55 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74613) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 18:07:55 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74613) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 29 18:07:55 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:07:55 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'e48ae453-836a-542f-b289-568d5fb246a4', '_type': 'linux-noop'}}, row=False) {{(pid=74613) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 18:07:55 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:07:55 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 18:07:55 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:07:55 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:07:55 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap8e24565f-82, may_exist=True, interface_attrs={}) {{(pid=74613) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 18:07:55 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap8e24565f-82, col_values=(('qos', UUID('ff9f1493-3716-4c8c-aa40-184f4ba90c74')),), if_exists=True) {{(pid=74613) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 18:07:55 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap8e24565f-82, col_values=(('external_ids', {'iface-id': '8e24565f-8217-4e78-a37c-53f7fd1c9742', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:32:23:9b', 'vm-uuid': 'bdb49266-ed09-4e9a-b3af-eb4b436a71da'}),), if_exists=True) {{(pid=74613) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 18:07:55 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:07:55 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 18:07:55 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:07:55 user nova-compute[74613]: INFO os_vif [None req-03cc3cca-c7ba-4c52-8428-cb4a643df8e6 tempest-AttachVolumeNegativeTest-483083654 tempest-AttachVolumeNegativeTest-483083654-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:32:23:9b,bridge_name='br-int',has_traffic_filtering=True,id=8e24565f-8217-4e78-a37c-53f7fd1c9742,network=Network(c317481b-f8cf-40a0-a326-836a5ea4c495),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8e24565f-82')
Nov 29 18:07:55 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-03cc3cca-c7ba-4c52-8428-cb4a643df8e6 tempest-AttachVolumeNegativeTest-483083654 tempest-AttachVolumeNegativeTest-483083654-project-member] No BDM found with device name vda, not building metadata. {{(pid=74613) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 18:07:55 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-03cc3cca-c7ba-4c52-8428-cb4a643df8e6 tempest-AttachVolumeNegativeTest-483083654 tempest-AttachVolumeNegativeTest-483083654-project-member] No VIF found with MAC fa:16:3e:32:23:9b, not building metadata {{(pid=74613) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 29 18:07:56 user nova-compute[74613]: DEBUG nova.network.neutron [req-ab0cde66-9ab7-4904-a3a6-4c262edb969f req-bca85cb6-5040-4d98-8188-0a1fd8db1cfc service nova] [instance: bdb49266-ed09-4e9a-b3af-eb4b436a71da] Updated VIF entry in instance network info cache for port 8e24565f-8217-4e78-a37c-53f7fd1c9742. {{(pid=74613) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 18:07:56 user nova-compute[74613]: DEBUG nova.network.neutron [req-ab0cde66-9ab7-4904-a3a6-4c262edb969f req-bca85cb6-5040-4d98-8188-0a1fd8db1cfc service nova] [instance: bdb49266-ed09-4e9a-b3af-eb4b436a71da] Updating instance_info_cache with network_info: [{"id": "8e24565f-8217-4e78-a37c-53f7fd1c9742", "address": "fa:16:3e:32:23:9b", "network": {"id": "c317481b-f8cf-40a0-a326-836a5ea4c495", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-887666255-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "37b89c13ba1d4a94805d6af69ad26fb8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8e24565f-82", "ovs_interfaceid": "8e24565f-8217-4e78-a37c-53f7fd1c9742", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74613) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 18:07:56 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-ab0cde66-9ab7-4904-a3a6-4c262edb969f req-bca85cb6-5040-4d98-8188-0a1fd8db1cfc service nova] Releasing lock "refresh_cache-bdb49266-ed09-4e9a-b3af-eb4b436a71da" {{(pid=74613) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 18:07:57 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:07:57 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:07:57 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:07:57 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:07:57 user nova-compute[74613]: DEBUG nova.compute.manager [req-ee601c86-6e01-4079-87a8-34921d745e95 req-e082c03d-69e0-4b60-a1e8-9659dc7deb26 service nova] [instance: bdb49266-ed09-4e9a-b3af-eb4b436a71da] Received event network-vif-plugged-8e24565f-8217-4e78-a37c-53f7fd1c9742 {{(pid=74613) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 18:07:57 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-ee601c86-6e01-4079-87a8-34921d745e95 req-e082c03d-69e0-4b60-a1e8-9659dc7deb26 service nova] Acquiring lock "bdb49266-ed09-4e9a-b3af-eb4b436a71da-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 18:07:57 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-ee601c86-6e01-4079-87a8-34921d745e95 req-e082c03d-69e0-4b60-a1e8-9659dc7deb26 service nova] Lock "bdb49266-ed09-4e9a-b3af-eb4b436a71da-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 18:07:57 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-ee601c86-6e01-4079-87a8-34921d745e95 req-e082c03d-69e0-4b60-a1e8-9659dc7deb26 service nova] Lock "bdb49266-ed09-4e9a-b3af-eb4b436a71da-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 18:07:57 user nova-compute[74613]: DEBUG nova.compute.manager [req-ee601c86-6e01-4079-87a8-34921d745e95 req-e082c03d-69e0-4b60-a1e8-9659dc7deb26 service nova] [instance: bdb49266-ed09-4e9a-b3af-eb4b436a71da] No waiting events found dispatching network-vif-plugged-8e24565f-8217-4e78-a37c-53f7fd1c9742 {{(pid=74613) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 18:07:57 user nova-compute[74613]: WARNING nova.compute.manager [req-ee601c86-6e01-4079-87a8-34921d745e95 req-e082c03d-69e0-4b60-a1e8-9659dc7deb26 service nova] [instance: bdb49266-ed09-4e9a-b3af-eb4b436a71da] Received unexpected event network-vif-plugged-8e24565f-8217-4e78-a37c-53f7fd1c9742 for instance with vm_state building and task_state spawning.
Nov 29 18:07:57 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:07:57 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:07:59 user nova-compute[74613]: DEBUG nova.compute.manager [None req-03cc3cca-c7ba-4c52-8428-cb4a643df8e6 tempest-AttachVolumeNegativeTest-483083654 tempest-AttachVolumeNegativeTest-483083654-project-member] [instance: bdb49266-ed09-4e9a-b3af-eb4b436a71da] Instance event wait completed in 0 seconds for  {{(pid=74613) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 29 18:07:59 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-03cc3cca-c7ba-4c52-8428-cb4a643df8e6 tempest-AttachVolumeNegativeTest-483083654 tempest-AttachVolumeNegativeTest-483083654-project-member] [instance: bdb49266-ed09-4e9a-b3af-eb4b436a71da] Guest created on hypervisor {{(pid=74613) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 29 18:07:59 user nova-compute[74613]: INFO nova.virt.libvirt.driver [-] [instance: bdb49266-ed09-4e9a-b3af-eb4b436a71da] Instance spawned successfully.
Nov 29 18:07:59 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-03cc3cca-c7ba-4c52-8428-cb4a643df8e6 tempest-AttachVolumeNegativeTest-483083654 tempest-AttachVolumeNegativeTest-483083654-project-member] [instance: bdb49266-ed09-4e9a-b3af-eb4b436a71da] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74613) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 29 18:07:59 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-03cc3cca-c7ba-4c52-8428-cb4a643df8e6 tempest-AttachVolumeNegativeTest-483083654 tempest-AttachVolumeNegativeTest-483083654-project-member] [instance: bdb49266-ed09-4e9a-b3af-eb4b436a71da] Found default for hw_cdrom_bus of ide {{(pid=74613) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 18:07:59 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-03cc3cca-c7ba-4c52-8428-cb4a643df8e6 tempest-AttachVolumeNegativeTest-483083654 tempest-AttachVolumeNegativeTest-483083654-project-member] [instance: bdb49266-ed09-4e9a-b3af-eb4b436a71da] Found default for hw_disk_bus of virtio {{(pid=74613) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 18:07:59 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-03cc3cca-c7ba-4c52-8428-cb4a643df8e6 tempest-AttachVolumeNegativeTest-483083654 tempest-AttachVolumeNegativeTest-483083654-project-member] [instance: bdb49266-ed09-4e9a-b3af-eb4b436a71da] Found default for hw_input_bus of None {{(pid=74613) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 18:07:59 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-03cc3cca-c7ba-4c52-8428-cb4a643df8e6 tempest-AttachVolumeNegativeTest-483083654 tempest-AttachVolumeNegativeTest-483083654-project-member] [instance: bdb49266-ed09-4e9a-b3af-eb4b436a71da] Found default for hw_pointer_model of None {{(pid=74613) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 18:07:59 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-03cc3cca-c7ba-4c52-8428-cb4a643df8e6 tempest-AttachVolumeNegativeTest-483083654 tempest-AttachVolumeNegativeTest-483083654-project-member] [instance: bdb49266-ed09-4e9a-b3af-eb4b436a71da] Found default for hw_video_model of virtio {{(pid=74613) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 18:07:59 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-03cc3cca-c7ba-4c52-8428-cb4a643df8e6 tempest-AttachVolumeNegativeTest-483083654 tempest-AttachVolumeNegativeTest-483083654-project-member] [instance: bdb49266-ed09-4e9a-b3af-eb4b436a71da] Found default for hw_vif_model of virtio {{(pid=74613) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 18:07:59 user nova-compute[74613]: INFO nova.compute.manager [None req-03cc3cca-c7ba-4c52-8428-cb4a643df8e6 tempest-AttachVolumeNegativeTest-483083654 tempest-AttachVolumeNegativeTest-483083654-project-member] [instance: bdb49266-ed09-4e9a-b3af-eb4b436a71da] Took 5.78 seconds to spawn the instance on the hypervisor.
Nov 29 18:07:59 user nova-compute[74613]: DEBUG nova.compute.manager [None req-03cc3cca-c7ba-4c52-8428-cb4a643df8e6 tempest-AttachVolumeNegativeTest-483083654 tempest-AttachVolumeNegativeTest-483083654-project-member] [instance: bdb49266-ed09-4e9a-b3af-eb4b436a71da] Checking state {{(pid=74613) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 29 18:07:59 user nova-compute[74613]: DEBUG nova.compute.manager [req-ab19a182-124e-471c-8f44-527e52efd50d req-20750a1c-42cb-4b4b-8b9c-fc00e143dc14 service nova] [instance: bdb49266-ed09-4e9a-b3af-eb4b436a71da] Received event network-vif-plugged-8e24565f-8217-4e78-a37c-53f7fd1c9742 {{(pid=74613) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 18:07:59 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-ab19a182-124e-471c-8f44-527e52efd50d req-20750a1c-42cb-4b4b-8b9c-fc00e143dc14 service nova] Acquiring lock "bdb49266-ed09-4e9a-b3af-eb4b436a71da-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 18:07:59 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-ab19a182-124e-471c-8f44-527e52efd50d req-20750a1c-42cb-4b4b-8b9c-fc00e143dc14 service nova] Lock "bdb49266-ed09-4e9a-b3af-eb4b436a71da-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 18:07:59 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-ab19a182-124e-471c-8f44-527e52efd50d req-20750a1c-42cb-4b4b-8b9c-fc00e143dc14 service nova] Lock "bdb49266-ed09-4e9a-b3af-eb4b436a71da-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 18:07:59 user nova-compute[74613]: DEBUG nova.compute.manager [req-ab19a182-124e-471c-8f44-527e52efd50d req-20750a1c-42cb-4b4b-8b9c-fc00e143dc14 service nova] [instance: bdb49266-ed09-4e9a-b3af-eb4b436a71da] No waiting events found dispatching network-vif-plugged-8e24565f-8217-4e78-a37c-53f7fd1c9742 {{(pid=74613) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 18:07:59 user nova-compute[74613]: WARNING nova.compute.manager [req-ab19a182-124e-471c-8f44-527e52efd50d req-20750a1c-42cb-4b4b-8b9c-fc00e143dc14 service nova] [instance: bdb49266-ed09-4e9a-b3af-eb4b436a71da] Received unexpected event network-vif-plugged-8e24565f-8217-4e78-a37c-53f7fd1c9742 for instance with vm_state building and task_state spawning.
Nov 29 18:07:59 user nova-compute[74613]: INFO nova.compute.manager [None req-03cc3cca-c7ba-4c52-8428-cb4a643df8e6 tempest-AttachVolumeNegativeTest-483083654 tempest-AttachVolumeNegativeTest-483083654-project-member] [instance: bdb49266-ed09-4e9a-b3af-eb4b436a71da] Took 6.53 seconds to build instance.
Nov 29 18:07:59 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-03cc3cca-c7ba-4c52-8428-cb4a643df8e6 tempest-AttachVolumeNegativeTest-483083654 tempest-AttachVolumeNegativeTest-483083654-project-member] Lock "bdb49266-ed09-4e9a-b3af-eb4b436a71da" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.634s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 18:08:00 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:08:00 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:08:05 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:08:05 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:08:10 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:08:10 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:08:12 user nova-compute[74613]: DEBUG nova.compute.manager [None req-1b4f084c-7f78-4b26-ad10-3148965fd83d tempest-TestStampPattern-2144166935 tempest-TestStampPattern-2144166935-project-member] [instance: 9eb14feb-f196-42b1-a6ba-2a049dea2d5e] Checking state {{(pid=74613) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 29 18:08:12 user nova-compute[74613]: INFO nova.compute.manager [None req-1b4f084c-7f78-4b26-ad10-3148965fd83d tempest-TestStampPattern-2144166935 tempest-TestStampPattern-2144166935-project-member] [instance: 9eb14feb-f196-42b1-a6ba-2a049dea2d5e] instance snapshotting
Nov 29 18:08:12 user nova-compute[74613]: INFO nova.virt.libvirt.driver [None req-1b4f084c-7f78-4b26-ad10-3148965fd83d tempest-TestStampPattern-2144166935 tempest-TestStampPattern-2144166935-project-member] [instance: 9eb14feb-f196-42b1-a6ba-2a049dea2d5e] Beginning live snapshot process
Nov 29 18:08:12 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-1b4f084c-7f78-4b26-ad10-3148965fd83d tempest-TestStampPattern-2144166935 tempest-TestStampPattern-2144166935-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9eb14feb-f196-42b1-a6ba-2a049dea2d5e/disk --force-share --output=json -f qcow2 {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:08:13 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-1b4f084c-7f78-4b26-ad10-3148965fd83d tempest-TestStampPattern-2144166935 tempest-TestStampPattern-2144166935-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9eb14feb-f196-42b1-a6ba-2a049dea2d5e/disk --force-share --output=json -f qcow2" returned: 0 in 0.184s {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:08:13 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-1b4f084c-7f78-4b26-ad10-3148965fd83d tempest-TestStampPattern-2144166935 tempest-TestStampPattern-2144166935-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9eb14feb-f196-42b1-a6ba-2a049dea2d5e/disk --force-share --output=json -f qcow2 {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:08:13 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-1b4f084c-7f78-4b26-ad10-3148965fd83d tempest-TestStampPattern-2144166935 tempest-TestStampPattern-2144166935-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9eb14feb-f196-42b1-a6ba-2a049dea2d5e/disk --force-share --output=json -f qcow2" returned: 0 in 0.182s {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:08:13 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-1b4f084c-7f78-4b26-ad10-3148965fd83d tempest-TestStampPattern-2144166935 tempest-TestStampPattern-2144166935-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/21faea9e6951f3bdd0153b76ac89fe1a60a34758 --force-share --output=json {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:08:13 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-1b4f084c-7f78-4b26-ad10-3148965fd83d tempest-TestStampPattern-2144166935 tempest-TestStampPattern-2144166935-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/21faea9e6951f3bdd0153b76ac89fe1a60a34758 --force-share --output=json" returned: 0 in 0.176s {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:08:13 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-1b4f084c-7f78-4b26-ad10-3148965fd83d tempest-TestStampPattern-2144166935 tempest-TestStampPattern-2144166935-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/21faea9e6951f3bdd0153b76ac89fe1a60a34758,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpfsr8ldmi/0b549aea406d4f13b5dad22297936085.delta 1073741824 {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:08:13 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-1b4f084c-7f78-4b26-ad10-3148965fd83d tempest-TestStampPattern-2144166935 tempest-TestStampPattern-2144166935-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/21faea9e6951f3bdd0153b76ac89fe1a60a34758,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpfsr8ldmi/0b549aea406d4f13b5dad22297936085.delta 1073741824" returned: 0 in 0.050s {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:08:13 user nova-compute[74613]: INFO nova.virt.libvirt.driver [None req-1b4f084c-7f78-4b26-ad10-3148965fd83d tempest-TestStampPattern-2144166935 tempest-TestStampPattern-2144166935-project-member] [instance: 9eb14feb-f196-42b1-a6ba-2a049dea2d5e] Quiescing instance not available: QEMU guest agent is not enabled.
Nov 29 18:08:14 user nova-compute[74613]: DEBUG nova.virt.libvirt.guest [None req-1b4f084c-7f78-4b26-ad10-3148965fd83d tempest-TestStampPattern-2144166935 tempest-TestStampPattern-2144166935-project-member] COPY block job progress, current cursor: 0 final cursor: 75563008 {{(pid=74613) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 29 18:08:14 user nova-compute[74613]: DEBUG nova.virt.libvirt.guest [None req-1b4f084c-7f78-4b26-ad10-3148965fd83d tempest-TestStampPattern-2144166935 tempest-TestStampPattern-2144166935-project-member] COPY block job progress, current cursor: 75563008 final cursor: 75563008 {{(pid=74613) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 29 18:08:14 user nova-compute[74613]: INFO nova.virt.libvirt.driver [None req-1b4f084c-7f78-4b26-ad10-3148965fd83d tempest-TestStampPattern-2144166935 tempest-TestStampPattern-2144166935-project-member] [instance: 9eb14feb-f196-42b1-a6ba-2a049dea2d5e] Skipping quiescing instance: QEMU guest agent is not enabled.
Nov 29 18:08:14 user nova-compute[74613]: DEBUG nova.privsep.utils [None req-1b4f084c-7f78-4b26-ad10-3148965fd83d tempest-TestStampPattern-2144166935 tempest-TestStampPattern-2144166935-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74613) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 29 18:08:14 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-1b4f084c-7f78-4b26-ad10-3148965fd83d tempest-TestStampPattern-2144166935 tempest-TestStampPattern-2144166935-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpfsr8ldmi/0b549aea406d4f13b5dad22297936085.delta /opt/stack/data/nova/instances/snapshots/tmpfsr8ldmi/0b549aea406d4f13b5dad22297936085 {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:08:15 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-1b4f084c-7f78-4b26-ad10-3148965fd83d tempest-TestStampPattern-2144166935 tempest-TestStampPattern-2144166935-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpfsr8ldmi/0b549aea406d4f13b5dad22297936085.delta /opt/stack/data/nova/instances/snapshots/tmpfsr8ldmi/0b549aea406d4f13b5dad22297936085" returned: 0 in 0.507s {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:08:15 user nova-compute[74613]: INFO nova.virt.libvirt.driver [None req-1b4f084c-7f78-4b26-ad10-3148965fd83d tempest-TestStampPattern-2144166935 tempest-TestStampPattern-2144166935-project-member] [instance: 9eb14feb-f196-42b1-a6ba-2a049dea2d5e] Snapshot extracted, beginning image upload
Nov 29 18:08:15 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:08:15 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:08:17 user nova-compute[74613]: INFO nova.virt.libvirt.driver [None req-1b4f084c-7f78-4b26-ad10-3148965fd83d tempest-TestStampPattern-2144166935 tempest-TestStampPattern-2144166935-project-member] [instance: 9eb14feb-f196-42b1-a6ba-2a049dea2d5e] Snapshot image upload complete
Nov 29 18:08:17 user nova-compute[74613]: INFO nova.compute.manager [None req-1b4f084c-7f78-4b26-ad10-3148965fd83d tempest-TestStampPattern-2144166935 tempest-TestStampPattern-2144166935-project-member] [instance: 9eb14feb-f196-42b1-a6ba-2a049dea2d5e] Took 5.11 seconds to snapshot the instance on the hypervisor.
Nov 29 18:08:19 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-43f3d266-e4e4-45b2-9296-021b6447922b tempest-TestStampPattern-2144166935 tempest-TestStampPattern-2144166935-project-member] Acquiring lock "285d1e76-103b-47fa-9982-4f2d656ee57a" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 18:08:19 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-43f3d266-e4e4-45b2-9296-021b6447922b tempest-TestStampPattern-2144166935 tempest-TestStampPattern-2144166935-project-member] Lock "285d1e76-103b-47fa-9982-4f2d656ee57a" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 18:08:19 user nova-compute[74613]: DEBUG nova.compute.manager [None req-43f3d266-e4e4-45b2-9296-021b6447922b tempest-TestStampPattern-2144166935 tempest-TestStampPattern-2144166935-project-member] [instance: 285d1e76-103b-47fa-9982-4f2d656ee57a] Starting instance... {{(pid=74613) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 29 18:08:19 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-43f3d266-e4e4-45b2-9296-021b6447922b tempest-TestStampPattern-2144166935 tempest-TestStampPattern-2144166935-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 18:08:19 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-43f3d266-e4e4-45b2-9296-021b6447922b tempest-TestStampPattern-2144166935 tempest-TestStampPattern-2144166935-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 18:08:19 user nova-compute[74613]: DEBUG nova.virt.hardware [None req-43f3d266-e4e4-45b2-9296-021b6447922b tempest-TestStampPattern-2144166935 tempest-TestStampPattern-2144166935-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74613) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 29 18:08:19 user nova-compute[74613]: INFO nova.compute.claims [None req-43f3d266-e4e4-45b2-9296-021b6447922b tempest-TestStampPattern-2144166935 tempest-TestStampPattern-2144166935-project-member] [instance: 285d1e76-103b-47fa-9982-4f2d656ee57a] Claim successful on node user
Nov 29 18:08:20 user nova-compute[74613]: DEBUG nova.compute.provider_tree [None req-43f3d266-e4e4-45b2-9296-021b6447922b tempest-TestStampPattern-2144166935 tempest-TestStampPattern-2144166935-project-member] Inventory has not changed in ProviderTree for provider: 639d980e-3b12-44b1-b8f4-1812416fa4dd {{(pid=74613) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 18:08:20 user nova-compute[74613]: DEBUG nova.scheduler.client.report [None req-43f3d266-e4e4-45b2-9296-021b6447922b tempest-TestStampPattern-2144166935 tempest-TestStampPattern-2144166935-project-member] Inventory has not changed for provider 639d980e-3b12-44b1-b8f4-1812416fa4dd based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74613) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 18:08:20 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-43f3d266-e4e4-45b2-9296-021b6447922b tempest-TestStampPattern-2144166935 tempest-TestStampPattern-2144166935-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.709s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 18:08:20 user nova-compute[74613]: DEBUG nova.compute.manager [None req-43f3d266-e4e4-45b2-9296-021b6447922b tempest-TestStampPattern-2144166935 tempest-TestStampPattern-2144166935-project-member] [instance: 285d1e76-103b-47fa-9982-4f2d656ee57a] Start building networks asynchronously for instance. {{(pid=74613) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 29 18:08:20 user nova-compute[74613]: DEBUG nova.compute.manager [None req-43f3d266-e4e4-45b2-9296-021b6447922b tempest-TestStampPattern-2144166935 tempest-TestStampPattern-2144166935-project-member] [instance: 285d1e76-103b-47fa-9982-4f2d656ee57a] Allocating IP information in the background. {{(pid=74613) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 29 18:08:20 user nova-compute[74613]: DEBUG nova.network.neutron [None req-43f3d266-e4e4-45b2-9296-021b6447922b tempest-TestStampPattern-2144166935 tempest-TestStampPattern-2144166935-project-member] [instance: 285d1e76-103b-47fa-9982-4f2d656ee57a] allocate_for_instance() {{(pid=74613) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 29 18:08:20 user nova-compute[74613]: INFO nova.virt.libvirt.driver [None req-43f3d266-e4e4-45b2-9296-021b6447922b tempest-TestStampPattern-2144166935 tempest-TestStampPattern-2144166935-project-member] [instance: 285d1e76-103b-47fa-9982-4f2d656ee57a] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 29 18:08:20 user nova-compute[74613]: DEBUG nova.compute.manager [None req-43f3d266-e4e4-45b2-9296-021b6447922b tempest-TestStampPattern-2144166935 tempest-TestStampPattern-2144166935-project-member] [instance: 285d1e76-103b-47fa-9982-4f2d656ee57a] Start building block device mappings for instance. {{(pid=74613) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 29 18:08:20 user nova-compute[74613]: DEBUG nova.policy [None req-43f3d266-e4e4-45b2-9296-021b6447922b tempest-TestStampPattern-2144166935 tempest-TestStampPattern-2144166935-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '7be3452738104c44bc78152e00fe469d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6004d03e0fbd4684bc8f1d341afad3be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74613) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 29 18:08:20 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:08:20 user nova-compute[74613]: DEBUG nova.compute.manager [None req-43f3d266-e4e4-45b2-9296-021b6447922b tempest-TestStampPattern-2144166935 tempest-TestStampPattern-2144166935-project-member] [instance: 285d1e76-103b-47fa-9982-4f2d656ee57a] Start spawning the instance on the hypervisor. {{(pid=74613) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 29 18:08:20 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-43f3d266-e4e4-45b2-9296-021b6447922b tempest-TestStampPattern-2144166935 tempest-TestStampPattern-2144166935-project-member] [instance: 285d1e76-103b-47fa-9982-4f2d656ee57a] Creating instance directory {{(pid=74613) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 29 18:08:20 user nova-compute[74613]: INFO nova.virt.libvirt.driver [None req-43f3d266-e4e4-45b2-9296-021b6447922b tempest-TestStampPattern-2144166935 tempest-TestStampPattern-2144166935-project-member] [instance: 285d1e76-103b-47fa-9982-4f2d656ee57a] Creating image(s)
Nov 29 18:08:20 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-43f3d266-e4e4-45b2-9296-021b6447922b tempest-TestStampPattern-2144166935 tempest-TestStampPattern-2144166935-project-member] Acquiring lock "/opt/stack/data/nova/instances/285d1e76-103b-47fa-9982-4f2d656ee57a/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 18:08:20 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-43f3d266-e4e4-45b2-9296-021b6447922b tempest-TestStampPattern-2144166935 tempest-TestStampPattern-2144166935-project-member] Lock "/opt/stack/data/nova/instances/285d1e76-103b-47fa-9982-4f2d656ee57a/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 18:08:20 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-43f3d266-e4e4-45b2-9296-021b6447922b tempest-TestStampPattern-2144166935 tempest-TestStampPattern-2144166935-project-member] Lock "/opt/stack/data/nova/instances/285d1e76-103b-47fa-9982-4f2d656ee57a/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 18:08:20 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-43f3d266-e4e4-45b2-9296-021b6447922b tempest-TestStampPattern-2144166935 tempest-TestStampPattern-2144166935-project-member] Acquiring lock "f5309f8810b06e37eebc76add857c30fc6b64f33" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 18:08:20 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-43f3d266-e4e4-45b2-9296-021b6447922b tempest-TestStampPattern-2144166935 tempest-TestStampPattern-2144166935-project-member] Lock "f5309f8810b06e37eebc76add857c30fc6b64f33" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 18:08:20 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:08:21 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-43f3d266-e4e4-45b2-9296-021b6447922b tempest-TestStampPattern-2144166935 tempest-TestStampPattern-2144166935-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f5309f8810b06e37eebc76add857c30fc6b64f33.part --force-share --output=json {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:08:22 user nova-compute[74613]: DEBUG nova.network.neutron [None req-43f3d266-e4e4-45b2-9296-021b6447922b tempest-TestStampPattern-2144166935 tempest-TestStampPattern-2144166935-project-member] [instance: 285d1e76-103b-47fa-9982-4f2d656ee57a] Successfully created port: 914a95dd-9699-41fd-a217-4adc1e9598f9 {{(pid=74613) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 29 18:08:22 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:08:22 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-43f3d266-e4e4-45b2-9296-021b6447922b tempest-TestStampPattern-2144166935 tempest-TestStampPattern-2144166935-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f5309f8810b06e37eebc76add857c30fc6b64f33.part --force-share --output=json" returned: 0 in 0.249s {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:08:22 user nova-compute[74613]: DEBUG nova.virt.images [None req-43f3d266-e4e4-45b2-9296-021b6447922b tempest-TestStampPattern-2144166935 tempest-TestStampPattern-2144166935-project-member] 31f362ed-cacc-4fdf-b825-f6286944498f was qcow2, converting to raw {{(pid=74613) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 29 18:08:22 user nova-compute[74613]: DEBUG nova.privsep.utils [None req-43f3d266-e4e4-45b2-9296-021b6447922b tempest-TestStampPattern-2144166935 tempest-TestStampPattern-2144166935-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74613) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 29 18:08:22 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-43f3d266-e4e4-45b2-9296-021b6447922b tempest-TestStampPattern-2144166935 tempest-TestStampPattern-2144166935-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/f5309f8810b06e37eebc76add857c30fc6b64f33.part /opt/stack/data/nova/instances/_base/f5309f8810b06e37eebc76add857c30fc6b64f33.converted {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:08:22 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-43f3d266-e4e4-45b2-9296-021b6447922b tempest-TestStampPattern-2144166935 tempest-TestStampPattern-2144166935-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/f5309f8810b06e37eebc76add857c30fc6b64f33.part /opt/stack/data/nova/instances/_base/f5309f8810b06e37eebc76add857c30fc6b64f33.converted" returned: 0 in 0.312s {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:08:22 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-43f3d266-e4e4-45b2-9296-021b6447922b tempest-TestStampPattern-2144166935 tempest-TestStampPattern-2144166935-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f5309f8810b06e37eebc76add857c30fc6b64f33.converted --force-share --output=json {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:08:22 user nova-compute[74613]: DEBUG nova.network.neutron [None req-43f3d266-e4e4-45b2-9296-021b6447922b tempest-TestStampPattern-2144166935 tempest-TestStampPattern-2144166935-project-member] [instance: 285d1e76-103b-47fa-9982-4f2d656ee57a] Successfully updated port: 914a95dd-9699-41fd-a217-4adc1e9598f9 {{(pid=74613) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 29 18:08:22 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-43f3d266-e4e4-45b2-9296-021b6447922b tempest-TestStampPattern-2144166935 tempest-TestStampPattern-2144166935-project-member] Acquiring lock "refresh_cache-285d1e76-103b-47fa-9982-4f2d656ee57a" {{(pid=74613) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 18:08:22 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-43f3d266-e4e4-45b2-9296-021b6447922b tempest-TestStampPattern-2144166935 tempest-TestStampPattern-2144166935-project-member] Acquired lock "refresh_cache-285d1e76-103b-47fa-9982-4f2d656ee57a" {{(pid=74613) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 18:08:22 user nova-compute[74613]: DEBUG nova.network.neutron [None req-43f3d266-e4e4-45b2-9296-021b6447922b tempest-TestStampPattern-2144166935 tempest-TestStampPattern-2144166935-project-member] [instance: 285d1e76-103b-47fa-9982-4f2d656ee57a] Building network info cache for instance {{(pid=74613) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 29 18:08:22 user nova-compute[74613]: DEBUG nova.compute.manager [req-ba897ae7-f002-40ee-b66b-9e24b05c0c4c req-1455eab6-a336-4024-9aef-d4bb6669b549 service nova] [instance: 285d1e76-103b-47fa-9982-4f2d656ee57a] Received event network-changed-914a95dd-9699-41fd-a217-4adc1e9598f9 {{(pid=74613) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 18:08:22 user nova-compute[74613]: DEBUG nova.compute.manager [req-ba897ae7-f002-40ee-b66b-9e24b05c0c4c req-1455eab6-a336-4024-9aef-d4bb6669b549 service nova] [instance: 285d1e76-103b-47fa-9982-4f2d656ee57a] Refreshing instance network info cache due to event network-changed-914a95dd-9699-41fd-a217-4adc1e9598f9. {{(pid=74613) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 18:08:22 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-ba897ae7-f002-40ee-b66b-9e24b05c0c4c req-1455eab6-a336-4024-9aef-d4bb6669b549 service nova] Acquiring lock "refresh_cache-285d1e76-103b-47fa-9982-4f2d656ee57a" {{(pid=74613) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 18:08:22 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-43f3d266-e4e4-45b2-9296-021b6447922b tempest-TestStampPattern-2144166935 tempest-TestStampPattern-2144166935-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f5309f8810b06e37eebc76add857c30fc6b64f33.converted --force-share --output=json" returned: 0 in 0.194s {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:08:22 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-43f3d266-e4e4-45b2-9296-021b6447922b tempest-TestStampPattern-2144166935 tempest-TestStampPattern-2144166935-project-member] Lock "f5309f8810b06e37eebc76add857c30fc6b64f33" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 2.022s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 18:08:22 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-43f3d266-e4e4-45b2-9296-021b6447922b tempest-TestStampPattern-2144166935 tempest-TestStampPattern-2144166935-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f5309f8810b06e37eebc76add857c30fc6b64f33 --force-share --output=json {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:08:22 user nova-compute[74613]: DEBUG nova.network.neutron [None req-43f3d266-e4e4-45b2-9296-021b6447922b tempest-TestStampPattern-2144166935 tempest-TestStampPattern-2144166935-project-member] [instance: 285d1e76-103b-47fa-9982-4f2d656ee57a] Instance cache missing network info. {{(pid=74613) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 29 18:08:22 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-43f3d266-e4e4-45b2-9296-021b6447922b tempest-TestStampPattern-2144166935 tempest-TestStampPattern-2144166935-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f5309f8810b06e37eebc76add857c30fc6b64f33 --force-share --output=json" returned: 0 in 0.172s {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:08:22 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-43f3d266-e4e4-45b2-9296-021b6447922b tempest-TestStampPattern-2144166935 tempest-TestStampPattern-2144166935-project-member] Acquiring lock "f5309f8810b06e37eebc76add857c30fc6b64f33" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 18:08:22 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-43f3d266-e4e4-45b2-9296-021b6447922b tempest-TestStampPattern-2144166935 tempest-TestStampPattern-2144166935-project-member] Lock "f5309f8810b06e37eebc76add857c30fc6b64f33" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 18:08:22 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-43f3d266-e4e4-45b2-9296-021b6447922b tempest-TestStampPattern-2144166935 tempest-TestStampPattern-2144166935-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f5309f8810b06e37eebc76add857c30fc6b64f33 --force-share --output=json {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:08:23 user nova-compute[74613]: DEBUG nova.network.neutron [None req-43f3d266-e4e4-45b2-9296-021b6447922b tempest-TestStampPattern-2144166935 tempest-TestStampPattern-2144166935-project-member] [instance: 285d1e76-103b-47fa-9982-4f2d656ee57a] Updating instance_info_cache with network_info: [{"id": "914a95dd-9699-41fd-a217-4adc1e9598f9", "address": "fa:16:3e:b6:a3:cc", "network": {"id": "fed779df-aeaf-4b57-8336-be4c9d81f0be", "bridge": "br-int", "label": "tempest-TestStampPattern-1699172136-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6004d03e0fbd4684bc8f1d341afad3be", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap914a95dd-96", "ovs_interfaceid": "914a95dd-9699-41fd-a217-4adc1e9598f9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74613) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 18:08:23 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-43f3d266-e4e4-45b2-9296-021b6447922b tempest-TestStampPattern-2144166935 tempest-TestStampPattern-2144166935-project-member] Releasing lock "refresh_cache-285d1e76-103b-47fa-9982-4f2d656ee57a" {{(pid=74613) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 18:08:23 user nova-compute[74613]: DEBUG nova.compute.manager [None req-43f3d266-e4e4-45b2-9296-021b6447922b tempest-TestStampPattern-2144166935 tempest-TestStampPattern-2144166935-project-member] [instance: 285d1e76-103b-47fa-9982-4f2d656ee57a] Instance network_info: |[{"id": "914a95dd-9699-41fd-a217-4adc1e9598f9", "address": "fa:16:3e:b6:a3:cc", "network": {"id": "fed779df-aeaf-4b57-8336-be4c9d81f0be", "bridge": "br-int", "label": "tempest-TestStampPattern-1699172136-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6004d03e0fbd4684bc8f1d341afad3be", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap914a95dd-96", "ovs_interfaceid": "914a95dd-9699-41fd-a217-4adc1e9598f9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74613) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 29 18:08:23 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-ba897ae7-f002-40ee-b66b-9e24b05c0c4c req-1455eab6-a336-4024-9aef-d4bb6669b549 service nova] Acquired lock "refresh_cache-285d1e76-103b-47fa-9982-4f2d656ee57a" {{(pid=74613) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 18:08:23 user nova-compute[74613]: DEBUG nova.network.neutron [req-ba897ae7-f002-40ee-b66b-9e24b05c0c4c req-1455eab6-a336-4024-9aef-d4bb6669b549 service nova] [instance: 285d1e76-103b-47fa-9982-4f2d656ee57a] Refreshing network info cache for port 914a95dd-9699-41fd-a217-4adc1e9598f9 {{(pid=74613) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 18:08:23 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-43f3d266-e4e4-45b2-9296-021b6447922b tempest-TestStampPattern-2144166935 tempest-TestStampPattern-2144166935-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f5309f8810b06e37eebc76add857c30fc6b64f33 --force-share --output=json" returned: 0 in 0.182s {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:08:23 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-43f3d266-e4e4-45b2-9296-021b6447922b tempest-TestStampPattern-2144166935 tempest-TestStampPattern-2144166935-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f5309f8810b06e37eebc76add857c30fc6b64f33,backing_fmt=raw /opt/stack/data/nova/instances/285d1e76-103b-47fa-9982-4f2d656ee57a/disk 1073741824 {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:08:23 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-43f3d266-e4e4-45b2-9296-021b6447922b tempest-TestStampPattern-2144166935 tempest-TestStampPattern-2144166935-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f5309f8810b06e37eebc76add857c30fc6b64f33,backing_fmt=raw /opt/stack/data/nova/instances/285d1e76-103b-47fa-9982-4f2d656ee57a/disk 1073741824" returned: 0 in 0.050s {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:08:23 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-43f3d266-e4e4-45b2-9296-021b6447922b tempest-TestStampPattern-2144166935 tempest-TestStampPattern-2144166935-project-member] Lock "f5309f8810b06e37eebc76add857c30fc6b64f33" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.237s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 18:08:23 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-43f3d266-e4e4-45b2-9296-021b6447922b tempest-TestStampPattern-2144166935 tempest-TestStampPattern-2144166935-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f5309f8810b06e37eebc76add857c30fc6b64f33 --force-share --output=json {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:08:23 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-43f3d266-e4e4-45b2-9296-021b6447922b tempest-TestStampPattern-2144166935 tempest-TestStampPattern-2144166935-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f5309f8810b06e37eebc76add857c30fc6b64f33 --force-share --output=json" returned: 0 in 0.202s {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:08:23 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-43f3d266-e4e4-45b2-9296-021b6447922b tempest-TestStampPattern-2144166935 tempest-TestStampPattern-2144166935-project-member] [instance: 285d1e76-103b-47fa-9982-4f2d656ee57a] Created local disks {{(pid=74613) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 29 18:08:23 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-43f3d266-e4e4-45b2-9296-021b6447922b tempest-TestStampPattern-2144166935 tempest-TestStampPattern-2144166935-project-member] [instance: 285d1e76-103b-47fa-9982-4f2d656ee57a] Ensure instance console log exists: /opt/stack/data/nova/instances/285d1e76-103b-47fa-9982-4f2d656ee57a/console.log {{(pid=74613) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 29 18:08:23 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-43f3d266-e4e4-45b2-9296-021b6447922b tempest-TestStampPattern-2144166935 tempest-TestStampPattern-2144166935-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 18:08:23 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-43f3d266-e4e4-45b2-9296-021b6447922b tempest-TestStampPattern-2144166935 tempest-TestStampPattern-2144166935-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 18:08:23 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-43f3d266-e4e4-45b2-9296-021b6447922b tempest-TestStampPattern-2144166935 tempest-TestStampPattern-2144166935-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 18:08:23 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-43f3d266-e4e4-45b2-9296-021b6447922b tempest-TestStampPattern-2144166935 tempest-TestStampPattern-2144166935-project-member] [instance: 285d1e76-103b-47fa-9982-4f2d656ee57a] Start _get_guest_xml network_info=[{"id": "914a95dd-9699-41fd-a217-4adc1e9598f9", "address": "fa:16:3e:b6:a3:cc", "network": {"id": "fed779df-aeaf-4b57-8336-be4c9d81f0be", "bridge": "br-int", "label": "tempest-TestStampPattern-1699172136-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6004d03e0fbd4684bc8f1d341afad3be", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap914a95dd-96", "ovs_interfaceid": "914a95dd-9699-41fd-a217-4adc1e9598f9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='56a024a922abdc279e38a57cab744d1d',container_format='bare',created_at=2023-11-29T18:08:12Z,direct_url=<?>,disk_format='qcow2',id=31f362ed-cacc-4fdf-b825-f6286944498f,min_disk=1,min_ram=0,name='tempest-TestStampPatternsnapshot-499127194',owner='6004d03e0fbd4684bc8f1d341afad3be',properties=ImageMetaProps,protected=<?>,size=52363264,status='active',tags=<?>,updated_at=2023-11-29T18:08:18Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'size': 0, 'device_type': 'disk', 'boot_index': 0, 'guest_format': None, 'encrypted': False, 'encryption_format': None, 'disk_bus': 'virtio', 'image_id': '31f362ed-cacc-4fdf-b825-f6286944498f'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74613) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 29 18:08:23 user nova-compute[74613]: WARNING nova.virt.libvirt.driver [None req-43f3d266-e4e4-45b2-9296-021b6447922b tempest-TestStampPattern-2144166935 tempest-TestStampPattern-2144166935-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 18:08:23 user nova-compute[74613]: WARNING nova.virt.libvirt.driver [None req-43f3d266-e4e4-45b2-9296-021b6447922b tempest-TestStampPattern-2144166935 tempest-TestStampPattern-2144166935-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 18:08:23 user nova-compute[74613]: DEBUG nova.virt.libvirt.host [None req-43f3d266-e4e4-45b2-9296-021b6447922b tempest-TestStampPattern-2144166935 tempest-TestStampPattern-2144166935-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74613) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 29 18:08:23 user nova-compute[74613]: DEBUG nova.virt.libvirt.host [None req-43f3d266-e4e4-45b2-9296-021b6447922b tempest-TestStampPattern-2144166935 tempest-TestStampPattern-2144166935-project-member] CPU controller missing on host. {{(pid=74613) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 29 18:08:23 user nova-compute[74613]: DEBUG nova.virt.libvirt.host [None req-43f3d266-e4e4-45b2-9296-021b6447922b tempest-TestStampPattern-2144166935 tempest-TestStampPattern-2144166935-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74613) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 29 18:08:23 user nova-compute[74613]: DEBUG nova.virt.libvirt.host [None req-43f3d266-e4e4-45b2-9296-021b6447922b tempest-TestStampPattern-2144166935 tempest-TestStampPattern-2144166935-project-member] CPU controller found on host. {{(pid=74613) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 29 18:08:23 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-43f3d266-e4e4-45b2-9296-021b6447922b tempest-TestStampPattern-2144166935 tempest-TestStampPattern-2144166935-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74613) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 29 18:08:23 user nova-compute[74613]: DEBUG nova.virt.hardware [None req-43f3d266-e4e4-45b2-9296-021b6447922b tempest-TestStampPattern-2144166935 tempest-TestStampPattern-2144166935-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-29T17:47:27Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='56a024a922abdc279e38a57cab744d1d',container_format='bare',created_at=2023-11-29T18:08:12Z,direct_url=<?>,disk_format='qcow2',id=31f362ed-cacc-4fdf-b825-f6286944498f,min_disk=1,min_ram=0,name='tempest-TestStampPatternsnapshot-499127194',owner='6004d03e0fbd4684bc8f1d341afad3be',properties=ImageMetaProps,protected=<?>,size=52363264,status='active',tags=<?>,updated_at=2023-11-29T18:08:18Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74613) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 29 18:08:23 user nova-compute[74613]: DEBUG nova.virt.hardware [None req-43f3d266-e4e4-45b2-9296-021b6447922b tempest-TestStampPattern-2144166935 tempest-TestStampPattern-2144166935-project-member] Flavor limits 0:0:0 {{(pid=74613) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 29 18:08:23 user nova-compute[74613]: DEBUG nova.virt.hardware [None req-43f3d266-e4e4-45b2-9296-021b6447922b tempest-TestStampPattern-2144166935 tempest-TestStampPattern-2144166935-project-member] Image limits 0:0:0 {{(pid=74613) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 29 18:08:23 user nova-compute[74613]: DEBUG nova.virt.hardware [None req-43f3d266-e4e4-45b2-9296-021b6447922b tempest-TestStampPattern-2144166935 tempest-TestStampPattern-2144166935-project-member] Flavor pref 0:0:0 {{(pid=74613) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 29 18:08:23 user nova-compute[74613]: DEBUG nova.virt.hardware [None req-43f3d266-e4e4-45b2-9296-021b6447922b tempest-TestStampPattern-2144166935 tempest-TestStampPattern-2144166935-project-member] Image pref 0:0:0 {{(pid=74613) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 29 18:08:23 user nova-compute[74613]: DEBUG nova.virt.hardware [None req-43f3d266-e4e4-45b2-9296-021b6447922b tempest-TestStampPattern-2144166935 tempest-TestStampPattern-2144166935-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74613) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 29 18:08:23 user nova-compute[74613]: DEBUG nova.virt.hardware [None req-43f3d266-e4e4-45b2-9296-021b6447922b tempest-TestStampPattern-2144166935 tempest-TestStampPattern-2144166935-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74613) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 29 18:08:23 user nova-compute[74613]: DEBUG nova.virt.hardware [None req-43f3d266-e4e4-45b2-9296-021b6447922b tempest-TestStampPattern-2144166935 tempest-TestStampPattern-2144166935-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74613) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 29 18:08:23 user nova-compute[74613]: DEBUG nova.virt.hardware [None req-43f3d266-e4e4-45b2-9296-021b6447922b tempest-TestStampPattern-2144166935 tempest-TestStampPattern-2144166935-project-member] Got 1 possible topologies {{(pid=74613) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 29 18:08:23 user nova-compute[74613]: DEBUG nova.virt.hardware [None req-43f3d266-e4e4-45b2-9296-021b6447922b tempest-TestStampPattern-2144166935 tempest-TestStampPattern-2144166935-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74613) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 29 18:08:23 user nova-compute[74613]: DEBUG nova.virt.hardware [None req-43f3d266-e4e4-45b2-9296-021b6447922b tempest-TestStampPattern-2144166935 tempest-TestStampPattern-2144166935-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74613) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 29 18:08:23 user nova-compute[74613]: DEBUG nova.virt.libvirt.vif [None req-43f3d266-e4e4-45b2-9296-021b6447922b tempest-TestStampPattern-2144166935 tempest-TestStampPattern-2144166935-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T18:08:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-1261894322',display_name='tempest-TestStampPattern-server-1261894322',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-1261894322',id=34,image_ref='31f362ed-cacc-4fdf-b825-f6286944498f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBImheB4xIUp31my88WBnuldIYYO3ZplSdSxpARgEiu+bFOOTcjhJQqNcRzf7tbnmHy4961l14bqt6VjuQd2lyczJClyEX4yjcCet+qsyyrKz/utm1mx8LqakuBXZxsC2Hg==',key_name='tempest-TestStampPattern-1424901696',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6004d03e0fbd4684bc8f1d341afad3be',ramdisk_id='',reservation_id='r-qs2gd0wx',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='4217f428-8d9d-4ee1-9614-642d26d90c46',image_boot_roles='member,reader',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_image_location='snapshot',image_image_state='available',image_image_type='snapshot',image_instance_uuid='9eb14feb-f196-42b1-a6ba-2a049dea2d5e',image_min_disk='1',image_min_ram='0',image_owner_id='6004d03e0fbd4684bc8f1d341afad3be',image_owner_project_name='tempest-TestStampPattern-2144166935',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestStampPattern-2144166935-project-member',image_user_id='7be3452738104c44bc78152e00fe469d',network_allocated='True',owner_project_name='tempest-TestStampPattern-2144166935',owner_user_name='tempest-TestStampPattern-2144166935-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T18:08:21Z,user_data=None,user_id='7be3452738104c44bc78152e00fe469d',uuid=285d1e76-103b-47fa-9982-4f2d656ee57a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "914a95dd-9699-41fd-a217-4adc1e9598f9", "address": "fa:16:3e:b6:a3:cc", "network": {"id": "fed779df-aeaf-4b57-8336-be4c9d81f0be", "bridge": "br-int", "label": "tempest-TestStampPattern-1699172136-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6004d03e0fbd4684bc8f1d341afad3be", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap914a95dd-96", "ovs_interfaceid": "914a95dd-9699-41fd-a217-4adc1e9598f9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74613) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 29 18:08:23 user nova-compute[74613]: DEBUG nova.network.os_vif_util [None req-43f3d266-e4e4-45b2-9296-021b6447922b tempest-TestStampPattern-2144166935 tempest-TestStampPattern-2144166935-project-member] Converting VIF {"id": "914a95dd-9699-41fd-a217-4adc1e9598f9", "address": "fa:16:3e:b6:a3:cc", "network": {"id": "fed779df-aeaf-4b57-8336-be4c9d81f0be", "bridge": "br-int", "label": "tempest-TestStampPattern-1699172136-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6004d03e0fbd4684bc8f1d341afad3be", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap914a95dd-96", "ovs_interfaceid": "914a95dd-9699-41fd-a217-4adc1e9598f9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74613) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 18:08:23 user nova-compute[74613]: DEBUG nova.network.os_vif_util [None req-43f3d266-e4e4-45b2-9296-021b6447922b tempest-TestStampPattern-2144166935 tempest-TestStampPattern-2144166935-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b6:a3:cc,bridge_name='br-int',has_traffic_filtering=True,id=914a95dd-9699-41fd-a217-4adc1e9598f9,network=Network(fed779df-aeaf-4b57-8336-be4c9d81f0be),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap914a95dd-96') {{(pid=74613) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 18:08:23 user nova-compute[74613]: DEBUG nova.objects.instance [None req-43f3d266-e4e4-45b2-9296-021b6447922b tempest-TestStampPattern-2144166935 tempest-TestStampPattern-2144166935-project-member] Lazy-loading 'pci_devices' on Instance uuid 285d1e76-103b-47fa-9982-4f2d656ee57a {{(pid=74613) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 18:08:23 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-43f3d266-e4e4-45b2-9296-021b6447922b tempest-TestStampPattern-2144166935 tempest-TestStampPattern-2144166935-project-member] [instance: 285d1e76-103b-47fa-9982-4f2d656ee57a] End _get_guest_xml xml=<domain type="kvm">
Nov 29 18:08:23 user nova-compute[74613]:   <uuid>285d1e76-103b-47fa-9982-4f2d656ee57a</uuid>
Nov 29 18:08:23 user nova-compute[74613]:   <name>instance-00000022</name>
Nov 29 18:08:23 user nova-compute[74613]:   <memory>524288</memory>
Nov 29 18:08:23 user nova-compute[74613]:   <vcpu>1</vcpu>
Nov 29 18:08:23 user nova-compute[74613]:   <metadata>
Nov 29 18:08:23 user nova-compute[74613]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 29 18:08:23 user nova-compute[74613]:       <nova:package version="0.0.0"/>
Nov 29 18:08:23 user nova-compute[74613]:       <nova:name>tempest-TestStampPattern-server-1261894322</nova:name>
Nov 29 18:08:23 user nova-compute[74613]:       <nova:creationTime>2023-11-29 18:08:23</nova:creationTime>
Nov 29 18:08:23 user nova-compute[74613]:       <nova:flavor name="m1.tiny">
Nov 29 18:08:23 user nova-compute[74613]:         <nova:memory>512</nova:memory>
Nov 29 18:08:23 user nova-compute[74613]:         <nova:disk>1</nova:disk>
Nov 29 18:08:23 user nova-compute[74613]:         <nova:swap>0</nova:swap>
Nov 29 18:08:23 user nova-compute[74613]:         <nova:ephemeral>0</nova:ephemeral>
Nov 29 18:08:23 user nova-compute[74613]:         <nova:vcpus>1</nova:vcpus>
Nov 29 18:08:23 user nova-compute[74613]:       </nova:flavor>
Nov 29 18:08:23 user nova-compute[74613]:       <nova:owner>
Nov 29 18:08:23 user nova-compute[74613]:         <nova:user uuid="7be3452738104c44bc78152e00fe469d">tempest-TestStampPattern-2144166935-project-member</nova:user>
Nov 29 18:08:23 user nova-compute[74613]:         <nova:project uuid="6004d03e0fbd4684bc8f1d341afad3be">tempest-TestStampPattern-2144166935</nova:project>
Nov 29 18:08:23 user nova-compute[74613]:       </nova:owner>
Nov 29 18:08:23 user nova-compute[74613]:       <nova:root type="image" uuid="31f362ed-cacc-4fdf-b825-f6286944498f"/>
Nov 29 18:08:23 user nova-compute[74613]:       <nova:ports>
Nov 29 18:08:23 user nova-compute[74613]:         <nova:port uuid="914a95dd-9699-41fd-a217-4adc1e9598f9">
Nov 29 18:08:23 user nova-compute[74613]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Nov 29 18:08:23 user nova-compute[74613]:         </nova:port>
Nov 29 18:08:23 user nova-compute[74613]:       </nova:ports>
Nov 29 18:08:23 user nova-compute[74613]:     </nova:instance>
Nov 29 18:08:23 user nova-compute[74613]:   </metadata>
Nov 29 18:08:23 user nova-compute[74613]:   <sysinfo type="smbios">
Nov 29 18:08:23 user nova-compute[74613]:     <system>
Nov 29 18:08:23 user nova-compute[74613]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 29 18:08:23 user nova-compute[74613]:       <entry name="product">OpenStack Nova</entry>
Nov 29 18:08:23 user nova-compute[74613]:       <entry name="version">0.0.0</entry>
Nov 29 18:08:23 user nova-compute[74613]:       <entry name="serial">285d1e76-103b-47fa-9982-4f2d656ee57a</entry>
Nov 29 18:08:23 user nova-compute[74613]:       <entry name="uuid">285d1e76-103b-47fa-9982-4f2d656ee57a</entry>
Nov 29 18:08:23 user nova-compute[74613]:       <entry name="family">Virtual Machine</entry>
Nov 29 18:08:23 user nova-compute[74613]:     </system>
Nov 29 18:08:23 user nova-compute[74613]:   </sysinfo>
Nov 29 18:08:23 user nova-compute[74613]:   <os>
Nov 29 18:08:23 user nova-compute[74613]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 29 18:08:23 user nova-compute[74613]:     <boot dev="hd"/>
Nov 29 18:08:23 user nova-compute[74613]:     <smbios mode="sysinfo"/>
Nov 29 18:08:23 user nova-compute[74613]:   </os>
Nov 29 18:08:23 user nova-compute[74613]:   <features>
Nov 29 18:08:23 user nova-compute[74613]:     <acpi/>
Nov 29 18:08:23 user nova-compute[74613]:     <apic/>
Nov 29 18:08:23 user nova-compute[74613]:     <vmcoreinfo/>
Nov 29 18:08:23 user nova-compute[74613]:   </features>
Nov 29 18:08:23 user nova-compute[74613]:   <clock offset="utc">
Nov 29 18:08:23 user nova-compute[74613]:     <timer name="pit" tickpolicy="delay"/>
Nov 29 18:08:23 user nova-compute[74613]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 29 18:08:23 user nova-compute[74613]:     <timer name="hpet" present="no"/>
Nov 29 18:08:23 user nova-compute[74613]:   </clock>
Nov 29 18:08:23 user nova-compute[74613]:   <cpu mode="custom" match="exact">
Nov 29 18:08:23 user nova-compute[74613]:     <model>Nehalem</model>
Nov 29 18:08:23 user nova-compute[74613]:     <topology sockets="1" cores="1" threads="1"/>
Nov 29 18:08:23 user nova-compute[74613]:   </cpu>
Nov 29 18:08:23 user nova-compute[74613]:   <devices>
Nov 29 18:08:23 user nova-compute[74613]:     <disk type="file" device="disk">
Nov 29 18:08:23 user nova-compute[74613]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 29 18:08:23 user nova-compute[74613]:       <source file="/opt/stack/data/nova/instances/285d1e76-103b-47fa-9982-4f2d656ee57a/disk"/>
Nov 29 18:08:23 user nova-compute[74613]:       <target dev="vda" bus="virtio"/>
Nov 29 18:08:23 user nova-compute[74613]:     </disk>
Nov 29 18:08:23 user nova-compute[74613]:     <interface type="ethernet">
Nov 29 18:08:23 user nova-compute[74613]:       <mac address="fa:16:3e:b6:a3:cc"/>
Nov 29 18:08:23 user nova-compute[74613]:       <model type="virtio"/>
Nov 29 18:08:23 user nova-compute[74613]:       <mtu size="1442"/>
Nov 29 18:08:23 user nova-compute[74613]:       <target dev="tap914a95dd-96"/>
Nov 29 18:08:23 user nova-compute[74613]:     </interface>
Nov 29 18:08:23 user nova-compute[74613]:     <serial type="pty">
Nov 29 18:08:23 user nova-compute[74613]:       <log file="/opt/stack/data/nova/instances/285d1e76-103b-47fa-9982-4f2d656ee57a/console.log" append="off"/>
Nov 29 18:08:23 user nova-compute[74613]:     </serial>
Nov 29 18:08:23 user nova-compute[74613]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 29 18:08:23 user nova-compute[74613]:     <video>
Nov 29 18:08:23 user nova-compute[74613]:       <model type="virtio"/>
Nov 29 18:08:23 user nova-compute[74613]:     </video>
Nov 29 18:08:23 user nova-compute[74613]:     <rng model="virtio">
Nov 29 18:08:23 user nova-compute[74613]:       <backend model="random">/dev/urandom</backend>
Nov 29 18:08:23 user nova-compute[74613]:     </rng>
Nov 29 18:08:23 user nova-compute[74613]:     <controller type="usb" index="0" model="none"/>
Nov 29 18:08:23 user nova-compute[74613]:     <memballoon model="virtio">
Nov 29 18:08:23 user nova-compute[74613]:       <stats period="10"/>
Nov 29 18:08:23 user nova-compute[74613]:     </memballoon>
Nov 29 18:08:23 user nova-compute[74613]:   </devices>
Nov 29 18:08:23 user nova-compute[74613]: </domain>
Nov 29 18:08:23 user nova-compute[74613]:  {{(pid=74613) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 29 18:08:23 user nova-compute[74613]: DEBUG nova.virt.libvirt.vif [None req-43f3d266-e4e4-45b2-9296-021b6447922b tempest-TestStampPattern-2144166935 tempest-TestStampPattern-2144166935-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T18:08:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-1261894322',display_name='tempest-TestStampPattern-server-1261894322',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-1261894322',id=34,image_ref='31f362ed-cacc-4fdf-b825-f6286944498f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBImheB4xIUp31my88WBnuldIYYO3ZplSdSxpARgEiu+bFOOTcjhJQqNcRzf7tbnmHy4961l14bqt6VjuQd2lyczJClyEX4yjcCet+qsyyrKz/utm1mx8LqakuBXZxsC2Hg==',key_name='tempest-TestStampPattern-1424901696',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6004d03e0fbd4684bc8f1d341afad3be',ramdisk_id='',reservation_id='r-qs2gd0wx',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='4217f428-8d9d-4ee1-9614-642d26d90c46',image_boot_roles='member,reader',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_image_location='snapshot',image_image_state='available',image_image_type='snapshot',image_instance_uuid='9eb14feb-f196-42b1-a6ba-2a049dea2d5e',image_min_disk='1',image_min_ram='0',image_owner_id='6004d03e0fbd4684bc8f1d341afad3be',image_owner_project_name='tempest-TestStampPattern-2144166935',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestStampPattern-2144166935-project-member',image_user_id='7be3452738104c44bc78152e00fe469d',network_allocated='True',owner_project_name='tempest-TestStampPattern-2144166935',owner_user_name='tempest-TestStampPattern-2144166935-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T18:08:21Z,user_data=None,user_id='7be3452738104c44bc78152e00fe469d',uuid=285d1e76-103b-47fa-9982-4f2d656ee57a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "914a95dd-9699-41fd-a217-4adc1e9598f9", "address": "fa:16:3e:b6:a3:cc", "network": {"id": "fed779df-aeaf-4b57-8336-be4c9d81f0be", "bridge": "br-int", "label": "tempest-TestStampPattern-1699172136-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6004d03e0fbd4684bc8f1d341afad3be", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap914a95dd-96", "ovs_interfaceid": "914a95dd-9699-41fd-a217-4adc1e9598f9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74613) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 29 18:08:23 user nova-compute[74613]: DEBUG nova.network.os_vif_util [None req-43f3d266-e4e4-45b2-9296-021b6447922b tempest-TestStampPattern-2144166935 tempest-TestStampPattern-2144166935-project-member] Converting VIF {"id": "914a95dd-9699-41fd-a217-4adc1e9598f9", "address": "fa:16:3e:b6:a3:cc", "network": {"id": "fed779df-aeaf-4b57-8336-be4c9d81f0be", "bridge": "br-int", "label": "tempest-TestStampPattern-1699172136-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6004d03e0fbd4684bc8f1d341afad3be", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap914a95dd-96", "ovs_interfaceid": "914a95dd-9699-41fd-a217-4adc1e9598f9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74613) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 18:08:23 user nova-compute[74613]: DEBUG nova.network.os_vif_util [None req-43f3d266-e4e4-45b2-9296-021b6447922b tempest-TestStampPattern-2144166935 tempest-TestStampPattern-2144166935-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b6:a3:cc,bridge_name='br-int',has_traffic_filtering=True,id=914a95dd-9699-41fd-a217-4adc1e9598f9,network=Network(fed779df-aeaf-4b57-8336-be4c9d81f0be),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap914a95dd-96') {{(pid=74613) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 18:08:23 user nova-compute[74613]: DEBUG os_vif [None req-43f3d266-e4e4-45b2-9296-021b6447922b tempest-TestStampPattern-2144166935 tempest-TestStampPattern-2144166935-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b6:a3:cc,bridge_name='br-int',has_traffic_filtering=True,id=914a95dd-9699-41fd-a217-4adc1e9598f9,network=Network(fed779df-aeaf-4b57-8336-be4c9d81f0be),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap914a95dd-96') {{(pid=74613) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 29 18:08:23 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:08:23 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74613) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 18:08:23 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74613) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 29 18:08:23 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:08:23 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '808a76ff-dc97-5f2b-bc0d-0901c73f7033', '_type': 'linux-noop'}}, row=False) {{(pid=74613) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 18:08:23 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:08:23 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 18:08:23 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:08:23 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:08:23 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap914a95dd-96, may_exist=True, interface_attrs={}) {{(pid=74613) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 18:08:23 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap914a95dd-96, col_values=(('qos', UUID('466531bd-fb97-4e27-ad36-f1c464bfb881')),), if_exists=True) {{(pid=74613) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 18:08:23 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap914a95dd-96, col_values=(('external_ids', {'iface-id': '914a95dd-9699-41fd-a217-4adc1e9598f9', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:b6:a3:cc', 'vm-uuid': '285d1e76-103b-47fa-9982-4f2d656ee57a'}),), if_exists=True) {{(pid=74613) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 18:08:23 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:08:23 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 18:08:23 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:08:23 user nova-compute[74613]: INFO os_vif [None req-43f3d266-e4e4-45b2-9296-021b6447922b tempest-TestStampPattern-2144166935 tempest-TestStampPattern-2144166935-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b6:a3:cc,bridge_name='br-int',has_traffic_filtering=True,id=914a95dd-9699-41fd-a217-4adc1e9598f9,network=Network(fed779df-aeaf-4b57-8336-be4c9d81f0be),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap914a95dd-96')
Nov 29 18:08:23 user nova-compute[74613]: DEBUG nova.network.neutron [req-ba897ae7-f002-40ee-b66b-9e24b05c0c4c req-1455eab6-a336-4024-9aef-d4bb6669b549 service nova] [instance: 285d1e76-103b-47fa-9982-4f2d656ee57a] Updated VIF entry in instance network info cache for port 914a95dd-9699-41fd-a217-4adc1e9598f9. {{(pid=74613) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 18:08:23 user nova-compute[74613]: DEBUG nova.network.neutron [req-ba897ae7-f002-40ee-b66b-9e24b05c0c4c req-1455eab6-a336-4024-9aef-d4bb6669b549 service nova] [instance: 285d1e76-103b-47fa-9982-4f2d656ee57a] Updating instance_info_cache with network_info: [{"id": "914a95dd-9699-41fd-a217-4adc1e9598f9", "address": "fa:16:3e:b6:a3:cc", "network": {"id": "fed779df-aeaf-4b57-8336-be4c9d81f0be", "bridge": "br-int", "label": "tempest-TestStampPattern-1699172136-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6004d03e0fbd4684bc8f1d341afad3be", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap914a95dd-96", "ovs_interfaceid": "914a95dd-9699-41fd-a217-4adc1e9598f9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74613) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 18:08:23 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-ba897ae7-f002-40ee-b66b-9e24b05c0c4c req-1455eab6-a336-4024-9aef-d4bb6669b549 service nova] Releasing lock "refresh_cache-285d1e76-103b-47fa-9982-4f2d656ee57a" {{(pid=74613) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 18:08:23 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-43f3d266-e4e4-45b2-9296-021b6447922b tempest-TestStampPattern-2144166935 tempest-TestStampPattern-2144166935-project-member] No BDM found with device name vda, not building metadata. {{(pid=74613) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 18:08:23 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-43f3d266-e4e4-45b2-9296-021b6447922b tempest-TestStampPattern-2144166935 tempest-TestStampPattern-2144166935-project-member] No VIF found with MAC fa:16:3e:b6:a3:cc, not building metadata {{(pid=74613) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 29 18:08:23 user nova-compute[74613]: DEBUG oslo_service.periodic_task [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Running periodic task ComputeManager._sync_power_states {{(pid=74613) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 18:08:24 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:08:24 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:08:24 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:08:25 user nova-compute[74613]: DEBUG nova.compute.manager [req-f8ab4192-31bc-476f-a0cc-2f4b1502bede req-2a7bf218-a19a-41d9-8a73-9a723150feae service nova] [instance: 285d1e76-103b-47fa-9982-4f2d656ee57a] Received event network-vif-plugged-914a95dd-9699-41fd-a217-4adc1e9598f9 {{(pid=74613) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 18:08:25 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-f8ab4192-31bc-476f-a0cc-2f4b1502bede req-2a7bf218-a19a-41d9-8a73-9a723150feae service nova] Acquiring lock "285d1e76-103b-47fa-9982-4f2d656ee57a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 18:08:25 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-f8ab4192-31bc-476f-a0cc-2f4b1502bede req-2a7bf218-a19a-41d9-8a73-9a723150feae service nova] Lock "285d1e76-103b-47fa-9982-4f2d656ee57a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 18:08:25 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-f8ab4192-31bc-476f-a0cc-2f4b1502bede req-2a7bf218-a19a-41d9-8a73-9a723150feae service nova] Lock "285d1e76-103b-47fa-9982-4f2d656ee57a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 18:08:25 user nova-compute[74613]: DEBUG nova.compute.manager [req-f8ab4192-31bc-476f-a0cc-2f4b1502bede req-2a7bf218-a19a-41d9-8a73-9a723150feae service nova] [instance: 285d1e76-103b-47fa-9982-4f2d656ee57a] No waiting events found dispatching network-vif-plugged-914a95dd-9699-41fd-a217-4adc1e9598f9 {{(pid=74613) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 18:08:25 user nova-compute[74613]: WARNING nova.compute.manager [req-f8ab4192-31bc-476f-a0cc-2f4b1502bede req-2a7bf218-a19a-41d9-8a73-9a723150feae service nova] [instance: 285d1e76-103b-47fa-9982-4f2d656ee57a] Received unexpected event network-vif-plugged-914a95dd-9699-41fd-a217-4adc1e9598f9 for instance with vm_state building and task_state spawning.
Nov 29 18:08:25 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:08:25 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:08:25 user nova-compute[74613]: DEBUG nova.compute.manager [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Triggering sync for uuid 3b828860-5cc5-40b0-b845-8e560211794e {{(pid=74613) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 29 18:08:25 user nova-compute[74613]: DEBUG nova.compute.manager [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Triggering sync for uuid abc9e2b8-f467-4cd0-b40f-de511fde1ec1 {{(pid=74613) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 29 18:08:25 user nova-compute[74613]: DEBUG nova.compute.manager [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Triggering sync for uuid cd22685a-028c-4e0c-834d-e7b20f6d06ab {{(pid=74613) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 29 18:08:25 user nova-compute[74613]: DEBUG nova.compute.manager [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Triggering sync for uuid 8fc8496b-1435-4b5f-8977-6c0d7467ef65 {{(pid=74613) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 29 18:08:25 user nova-compute[74613]: DEBUG nova.compute.manager [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Triggering sync for uuid e9acfa30-4ec2-4540-ac34-4c66db3228e1 {{(pid=74613) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 29 18:08:25 user nova-compute[74613]: DEBUG nova.compute.manager [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Triggering sync for uuid d3c285cd-9f39-423c-a324-30a48a9c66be {{(pid=74613) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 29 18:08:25 user nova-compute[74613]: DEBUG nova.compute.manager [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Triggering sync for uuid 6993e2e7-7e03-45b4-9d3d-3742589b6078 {{(pid=74613) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 29 18:08:25 user nova-compute[74613]: DEBUG nova.compute.manager [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Triggering sync for uuid 6f4a1329-b3b9-4d1c-8735-abddabc359fd {{(pid=74613) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 29 18:08:25 user nova-compute[74613]: DEBUG nova.compute.manager [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Triggering sync for uuid 9eb14feb-f196-42b1-a6ba-2a049dea2d5e {{(pid=74613) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 29 18:08:25 user nova-compute[74613]: DEBUG nova.compute.manager [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Triggering sync for uuid 69109f06-acbf-4834-b05e-80ab6e3f6ea0 {{(pid=74613) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 29 18:08:25 user nova-compute[74613]: DEBUG nova.compute.manager [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Triggering sync for uuid e2439d62-4713-435d-81ce-fafe1d811b47 {{(pid=74613) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 29 18:08:25 user nova-compute[74613]: DEBUG nova.compute.manager [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Triggering sync for uuid bdb49266-ed09-4e9a-b3af-eb4b436a71da {{(pid=74613) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 29 18:08:25 user nova-compute[74613]: DEBUG nova.compute.manager [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Triggering sync for uuid 285d1e76-103b-47fa-9982-4f2d656ee57a {{(pid=74613) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 29 18:08:25 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Acquiring lock "3b828860-5cc5-40b0-b845-8e560211794e" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 18:08:25 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Lock "3b828860-5cc5-40b0-b845-8e560211794e" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 18:08:25 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Acquiring lock "abc9e2b8-f467-4cd0-b40f-de511fde1ec1" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 18:08:25 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Lock "abc9e2b8-f467-4cd0-b40f-de511fde1ec1" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 18:08:25 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Acquiring lock "cd22685a-028c-4e0c-834d-e7b20f6d06ab" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 18:08:25 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Lock "cd22685a-028c-4e0c-834d-e7b20f6d06ab" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 18:08:25 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Acquiring lock "8fc8496b-1435-4b5f-8977-6c0d7467ef65" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 18:08:25 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Lock "8fc8496b-1435-4b5f-8977-6c0d7467ef65" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 18:08:25 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Acquiring lock "e9acfa30-4ec2-4540-ac34-4c66db3228e1" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 18:08:25 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Lock "e9acfa30-4ec2-4540-ac34-4c66db3228e1" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 18:08:25 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Acquiring lock "d3c285cd-9f39-423c-a324-30a48a9c66be" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 18:08:25 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Lock "d3c285cd-9f39-423c-a324-30a48a9c66be" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 18:08:25 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Acquiring lock "6993e2e7-7e03-45b4-9d3d-3742589b6078" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 18:08:25 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Lock "6993e2e7-7e03-45b4-9d3d-3742589b6078" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 18:08:25 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Acquiring lock "6f4a1329-b3b9-4d1c-8735-abddabc359fd" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 18:08:25 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Lock "6f4a1329-b3b9-4d1c-8735-abddabc359fd" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 18:08:25 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Acquiring lock "9eb14feb-f196-42b1-a6ba-2a049dea2d5e" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 18:08:25 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Lock "9eb14feb-f196-42b1-a6ba-2a049dea2d5e" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 18:08:25 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Acquiring lock "69109f06-acbf-4834-b05e-80ab6e3f6ea0" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 18:08:25 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Lock "69109f06-acbf-4834-b05e-80ab6e3f6ea0" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 18:08:25 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Acquiring lock "e2439d62-4713-435d-81ce-fafe1d811b47" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 18:08:25 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Lock "e2439d62-4713-435d-81ce-fafe1d811b47" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 18:08:25 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Acquiring lock "bdb49266-ed09-4e9a-b3af-eb4b436a71da" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 18:08:25 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Lock "bdb49266-ed09-4e9a-b3af-eb4b436a71da" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 18:08:25 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Acquiring lock "285d1e76-103b-47fa-9982-4f2d656ee57a" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 18:08:25 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Lock "3b828860-5cc5-40b0-b845-8e560211794e" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.045s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 18:08:25 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Lock "abc9e2b8-f467-4cd0-b40f-de511fde1ec1" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.044s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 18:08:25 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Lock "cd22685a-028c-4e0c-834d-e7b20f6d06ab" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.054s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 18:08:25 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Lock "8fc8496b-1435-4b5f-8977-6c0d7467ef65" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.054s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 18:08:25 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Lock "e9acfa30-4ec2-4540-ac34-4c66db3228e1" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.066s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 18:08:25 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Lock "6993e2e7-7e03-45b4-9d3d-3742589b6078" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.072s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 18:08:25 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Lock "d3c285cd-9f39-423c-a324-30a48a9c66be" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.074s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 18:08:25 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Lock "6f4a1329-b3b9-4d1c-8735-abddabc359fd" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.080s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 18:08:25 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Lock "69109f06-acbf-4834-b05e-80ab6e3f6ea0" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.085s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 18:08:25 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Lock "e2439d62-4713-435d-81ce-fafe1d811b47" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.091s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 18:08:25 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Lock "9eb14feb-f196-42b1-a6ba-2a049dea2d5e" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.125s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 18:08:25 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Lock "bdb49266-ed09-4e9a-b3af-eb4b436a71da" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.130s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 18:08:25 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:08:26 user nova-compute[74613]: DEBUG oslo_service.periodic_task [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74613) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 18:08:26 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 18:08:26 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 18:08:26 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 18:08:26 user nova-compute[74613]: DEBUG nova.compute.resource_tracker [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Auditing locally available compute resources for user (node: user) {{(pid=74613) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 29 18:08:27 user nova-compute[74613]: DEBUG nova.compute.manager [None req-43f3d266-e4e4-45b2-9296-021b6447922b tempest-TestStampPattern-2144166935 tempest-TestStampPattern-2144166935-project-member] [instance: 285d1e76-103b-47fa-9982-4f2d656ee57a] Instance event wait completed in 0 seconds for  {{(pid=74613) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 29 18:08:27 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-43f3d266-e4e4-45b2-9296-021b6447922b tempest-TestStampPattern-2144166935 tempest-TestStampPattern-2144166935-project-member] [instance: 285d1e76-103b-47fa-9982-4f2d656ee57a] Guest created on hypervisor {{(pid=74613) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 29 18:08:27 user nova-compute[74613]: INFO nova.virt.libvirt.driver [-] [instance: 285d1e76-103b-47fa-9982-4f2d656ee57a] Instance spawned successfully.
Nov 29 18:08:27 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-43f3d266-e4e4-45b2-9296-021b6447922b tempest-TestStampPattern-2144166935 tempest-TestStampPattern-2144166935-project-member] [instance: 285d1e76-103b-47fa-9982-4f2d656ee57a] Attempting to register defaults for the following image properties: ['hw_input_bus', 'hw_pointer_model'] {{(pid=74613) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 29 18:08:27 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-43f3d266-e4e4-45b2-9296-021b6447922b tempest-TestStampPattern-2144166935 tempest-TestStampPattern-2144166935-project-member] [instance: 285d1e76-103b-47fa-9982-4f2d656ee57a] Found default for hw_input_bus of None {{(pid=74613) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 18:08:27 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-43f3d266-e4e4-45b2-9296-021b6447922b tempest-TestStampPattern-2144166935 tempest-TestStampPattern-2144166935-project-member] [instance: 285d1e76-103b-47fa-9982-4f2d656ee57a] Found default for hw_pointer_model of None {{(pid=74613) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 18:08:27 user nova-compute[74613]: INFO nova.compute.manager [None req-43f3d266-e4e4-45b2-9296-021b6447922b tempest-TestStampPattern-2144166935 tempest-TestStampPattern-2144166935-project-member] [instance: 285d1e76-103b-47fa-9982-4f2d656ee57a] Took 6.40 seconds to spawn the instance on the hypervisor.
Nov 29 18:08:27 user nova-compute[74613]: DEBUG nova.compute.manager [None req-43f3d266-e4e4-45b2-9296-021b6447922b tempest-TestStampPattern-2144166935 tempest-TestStampPattern-2144166935-project-member] [instance: 285d1e76-103b-47fa-9982-4f2d656ee57a] Checking state {{(pid=74613) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 29 18:08:27 user nova-compute[74613]: DEBUG nova.compute.manager [req-50b5935a-99da-4810-b904-a42d1f9837f4 req-bcd42af4-dccc-4b9f-a1f4-27820e6d5495 service nova] [instance: 285d1e76-103b-47fa-9982-4f2d656ee57a] Received event network-vif-plugged-914a95dd-9699-41fd-a217-4adc1e9598f9 {{(pid=74613) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 18:08:27 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-50b5935a-99da-4810-b904-a42d1f9837f4 req-bcd42af4-dccc-4b9f-a1f4-27820e6d5495 service nova] Acquiring lock "285d1e76-103b-47fa-9982-4f2d656ee57a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 18:08:27 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-50b5935a-99da-4810-b904-a42d1f9837f4 req-bcd42af4-dccc-4b9f-a1f4-27820e6d5495 service nova] Lock "285d1e76-103b-47fa-9982-4f2d656ee57a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 18:08:27 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-50b5935a-99da-4810-b904-a42d1f9837f4 req-bcd42af4-dccc-4b9f-a1f4-27820e6d5495 service nova] Lock "285d1e76-103b-47fa-9982-4f2d656ee57a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 18:08:27 user nova-compute[74613]: DEBUG nova.compute.manager [req-50b5935a-99da-4810-b904-a42d1f9837f4 req-bcd42af4-dccc-4b9f-a1f4-27820e6d5495 service nova] [instance: 285d1e76-103b-47fa-9982-4f2d656ee57a] No waiting events found dispatching network-vif-plugged-914a95dd-9699-41fd-a217-4adc1e9598f9 {{(pid=74613) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 18:08:27 user nova-compute[74613]: WARNING nova.compute.manager [req-50b5935a-99da-4810-b904-a42d1f9837f4 req-bcd42af4-dccc-4b9f-a1f4-27820e6d5495 service nova] [instance: 285d1e76-103b-47fa-9982-4f2d656ee57a] Received unexpected event network-vif-plugged-914a95dd-9699-41fd-a217-4adc1e9598f9 for instance with vm_state building and task_state spawning.
Nov 29 18:08:27 user nova-compute[74613]: INFO nova.compute.manager [None req-43f3d266-e4e4-45b2-9296-021b6447922b tempest-TestStampPattern-2144166935 tempest-TestStampPattern-2144166935-project-member] [instance: 285d1e76-103b-47fa-9982-4f2d656ee57a] Took 7.51 seconds to build instance.
Nov 29 18:08:27 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=74613) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 29 18:08:27 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/69109f06-acbf-4834-b05e-80ab6e3f6ea0/disk --force-share --output=json {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:08:27 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-43f3d266-e4e4-45b2-9296-021b6447922b tempest-TestStampPattern-2144166935 tempest-TestStampPattern-2144166935-project-member] Lock "285d1e76-103b-47fa-9982-4f2d656ee57a" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.650s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 18:08:27 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Lock "285d1e76-103b-47fa-9982-4f2d656ee57a" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 2.012s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 18:08:27 user nova-compute[74613]: INFO nova.compute.manager [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] [instance: 285d1e76-103b-47fa-9982-4f2d656ee57a] During sync_power_state the instance has a pending task (spawning). Skip.
Nov 29 18:08:27 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Lock "285d1e76-103b-47fa-9982-4f2d656ee57a" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.001s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 18:08:27 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/69109f06-acbf-4834-b05e-80ab6e3f6ea0/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:08:27 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/69109f06-acbf-4834-b05e-80ab6e3f6ea0/disk --force-share --output=json {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:08:27 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/69109f06-acbf-4834-b05e-80ab6e3f6ea0/disk --force-share --output=json" returned: 0 in 0.340s {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:08:27 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] skipping disk /dev/sdf (vdb) as it is a volume {{(pid=74613) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 29 18:08:27 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9eb14feb-f196-42b1-a6ba-2a049dea2d5e/disk --force-share --output=json {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:08:27 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9eb14feb-f196-42b1-a6ba-2a049dea2d5e/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:08:27 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9eb14feb-f196-42b1-a6ba-2a049dea2d5e/disk --force-share --output=json {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:08:28 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9eb14feb-f196-42b1-a6ba-2a049dea2d5e/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:08:28 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bdb49266-ed09-4e9a-b3af-eb4b436a71da/disk --force-share --output=json {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:08:28 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bdb49266-ed09-4e9a-b3af-eb4b436a71da/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:08:28 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bdb49266-ed09-4e9a-b3af-eb4b436a71da/disk --force-share --output=json {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:08:28 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:08:28 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bdb49266-ed09-4e9a-b3af-eb4b436a71da/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:08:28 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=74613) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 29 18:08:28 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f4a1329-b3b9-4d1c-8735-abddabc359fd/disk.rescue --force-share --output=json {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:08:28 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f4a1329-b3b9-4d1c-8735-abddabc359fd/disk.rescue --force-share --output=json" returned: 0 in 0.188s {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:08:28 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f4a1329-b3b9-4d1c-8735-abddabc359fd/disk.rescue --force-share --output=json {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:08:28 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f4a1329-b3b9-4d1c-8735-abddabc359fd/disk.rescue --force-share --output=json" returned: 0 in 0.191s {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:08:28 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f4a1329-b3b9-4d1c-8735-abddabc359fd/disk --force-share --output=json {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:08:29 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f4a1329-b3b9-4d1c-8735-abddabc359fd/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:08:29 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f4a1329-b3b9-4d1c-8735-abddabc359fd/disk --force-share --output=json {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:08:29 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f4a1329-b3b9-4d1c-8735-abddabc359fd/disk --force-share --output=json" returned: 0 in 0.239s {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:08:29 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3b828860-5cc5-40b0-b845-8e560211794e/disk --force-share --output=json {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:08:29 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3b828860-5cc5-40b0-b845-8e560211794e/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:08:29 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3b828860-5cc5-40b0-b845-8e560211794e/disk --force-share --output=json {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:08:29 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3b828860-5cc5-40b0-b845-8e560211794e/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:08:29 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/abc9e2b8-f467-4cd0-b40f-de511fde1ec1/disk --force-share --output=json {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:08:29 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/abc9e2b8-f467-4cd0-b40f-de511fde1ec1/disk --force-share --output=json" returned: 0 in 0.204s {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:08:29 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/abc9e2b8-f467-4cd0-b40f-de511fde1ec1/disk --force-share --output=json {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:08:30 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/abc9e2b8-f467-4cd0-b40f-de511fde1ec1/disk --force-share --output=json" returned: 0 in 0.211s {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:08:30 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6993e2e7-7e03-45b4-9d3d-3742589b6078/disk --force-share --output=json {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:08:30 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6993e2e7-7e03-45b4-9d3d-3742589b6078/disk --force-share --output=json" returned: 0 in 0.250s {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:08:30 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6993e2e7-7e03-45b4-9d3d-3742589b6078/disk --force-share --output=json {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:08:30 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6993e2e7-7e03-45b4-9d3d-3742589b6078/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:08:30 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74613) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 29 18:08:30 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8fc8496b-1435-4b5f-8977-6c0d7467ef65/disk --force-share --output=json {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:08:30 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:08:30 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8fc8496b-1435-4b5f-8977-6c0d7467ef65/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:08:30 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8fc8496b-1435-4b5f-8977-6c0d7467ef65/disk --force-share --output=json {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:08:31 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8fc8496b-1435-4b5f-8977-6c0d7467ef65/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:08:31 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/285d1e76-103b-47fa-9982-4f2d656ee57a/disk --force-share --output=json {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:08:31 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/285d1e76-103b-47fa-9982-4f2d656ee57a/disk --force-share --output=json" returned: 0 in 0.213s {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:08:31 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/285d1e76-103b-47fa-9982-4f2d656ee57a/disk --force-share --output=json {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:08:31 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/285d1e76-103b-47fa-9982-4f2d656ee57a/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:08:31 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e2439d62-4713-435d-81ce-fafe1d811b47/disk --force-share --output=json {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:08:31 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e2439d62-4713-435d-81ce-fafe1d811b47/disk --force-share --output=json" returned: 0 in 0.228s {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:08:31 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e2439d62-4713-435d-81ce-fafe1d811b47/disk --force-share --output=json {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:08:31 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e2439d62-4713-435d-81ce-fafe1d811b47/disk --force-share --output=json" returned: 0 in 0.222s {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:08:31 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=74613) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 29 18:08:32 user nova-compute[74613]: INFO nova.compute.manager [None req-b1e546f4-2f1f-4d18-8f3a-9655cdb9bd42 tempest-ServerActionsTestOtherA-1784608629 tempest-ServerActionsTestOtherA-1784608629-project-member] [instance: e9acfa30-4ec2-4540-ac34-4c66db3228e1] Get console output
Nov 29 18:08:32 user nova-compute[74613]: WARNING nova.virt.libvirt.driver [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 18:08:32 user nova-compute[74613]: WARNING nova.virt.libvirt.driver [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 18:08:32 user nova-compute[74613]: DEBUG nova.compute.resource_tracker [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Hypervisor/Node resource view: name=user free_ram=7671MB free_disk=24.55438232421875GB free_vcpus=0 pci_devices=[{"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74613) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 29 18:08:32 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 18:08:32 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 18:08:32 user nova-compute[74613]: DEBUG nova.compute.resource_tracker [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Instance 3b828860-5cc5-40b0-b845-8e560211794e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74613) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 18:08:32 user nova-compute[74613]: DEBUG nova.compute.resource_tracker [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Instance abc9e2b8-f467-4cd0-b40f-de511fde1ec1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74613) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 18:08:32 user nova-compute[74613]: DEBUG nova.compute.resource_tracker [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Instance cd22685a-028c-4e0c-834d-e7b20f6d06ab actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74613) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 18:08:32 user nova-compute[74613]: DEBUG nova.compute.resource_tracker [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Instance 8fc8496b-1435-4b5f-8977-6c0d7467ef65 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74613) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 18:08:32 user nova-compute[74613]: DEBUG nova.compute.resource_tracker [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Instance d3c285cd-9f39-423c-a324-30a48a9c66be actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74613) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 18:08:32 user nova-compute[74613]: DEBUG nova.compute.resource_tracker [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Instance 6993e2e7-7e03-45b4-9d3d-3742589b6078 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74613) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 18:08:32 user nova-compute[74613]: DEBUG nova.compute.resource_tracker [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Instance 6f4a1329-b3b9-4d1c-8735-abddabc359fd actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74613) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 18:08:32 user nova-compute[74613]: DEBUG nova.compute.resource_tracker [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Instance e9acfa30-4ec2-4540-ac34-4c66db3228e1 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=74613) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 18:08:32 user nova-compute[74613]: DEBUG nova.compute.resource_tracker [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Instance 9eb14feb-f196-42b1-a6ba-2a049dea2d5e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74613) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 18:08:32 user nova-compute[74613]: DEBUG nova.compute.resource_tracker [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Instance 69109f06-acbf-4834-b05e-80ab6e3f6ea0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74613) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 18:08:32 user nova-compute[74613]: DEBUG nova.compute.resource_tracker [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Instance e2439d62-4713-435d-81ce-fafe1d811b47 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74613) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 18:08:32 user nova-compute[74613]: DEBUG nova.compute.resource_tracker [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Instance bdb49266-ed09-4e9a-b3af-eb4b436a71da actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74613) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 18:08:32 user nova-compute[74613]: DEBUG nova.compute.resource_tracker [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Instance 285d1e76-103b-47fa-9982-4f2d656ee57a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74613) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 18:08:32 user nova-compute[74613]: DEBUG nova.compute.resource_tracker [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Total usable vcpus: 12, total allocated vcpus: 13 {{(pid=74613) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 29 18:08:32 user nova-compute[74613]: DEBUG nova.compute.resource_tracker [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Final resource view: name=user phys_ram=16011MB used_ram=8704MB phys_disk=40GB used_disk=10GB total_vcpus=12 used_vcpus=13 pci_stats=[] {{(pid=74613) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 29 18:08:32 user nova-compute[74613]: INFO nova.privsep.libvirt [-] Ignored error while reading from instance console pty: can't concat NoneType to bytes
Nov 29 18:08:33 user nova-compute[74613]: DEBUG nova.compute.provider_tree [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Inventory has not changed in ProviderTree for provider: 639d980e-3b12-44b1-b8f4-1812416fa4dd {{(pid=74613) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 18:08:33 user nova-compute[74613]: DEBUG nova.scheduler.client.report [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Inventory has not changed for provider 639d980e-3b12-44b1-b8f4-1812416fa4dd based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74613) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 18:08:33 user nova-compute[74613]: DEBUG nova.compute.resource_tracker [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Compute_service record updated for user:user {{(pid=74613) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 29 18:08:33 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.578s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 18:08:33 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:08:35 user nova-compute[74613]: DEBUG oslo_service.periodic_task [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74613) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 18:08:35 user nova-compute[74613]: DEBUG oslo_service.periodic_task [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74613) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 18:08:35 user nova-compute[74613]: DEBUG nova.compute.manager [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Starting heal instance info cache {{(pid=74613) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 29 18:08:35 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Acquiring lock "refresh_cache-e9acfa30-4ec2-4540-ac34-4c66db3228e1" {{(pid=74613) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 18:08:35 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Acquired lock "refresh_cache-e9acfa30-4ec2-4540-ac34-4c66db3228e1" {{(pid=74613) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 18:08:35 user nova-compute[74613]: DEBUG nova.network.neutron [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] [instance: e9acfa30-4ec2-4540-ac34-4c66db3228e1] Forcefully refreshing network info cache for instance {{(pid=74613) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 29 18:08:35 user nova-compute[74613]: DEBUG nova.network.neutron [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] [instance: e9acfa30-4ec2-4540-ac34-4c66db3228e1] Updating instance_info_cache with network_info: [{"id": "8cd31427-1812-40fb-8018-d8f24a5b1792", "address": "fa:16:3e:97:0e:ed", "network": {"id": "7c2c368e-4c7d-4d70-9a40-c10fe9541af9", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1287934102-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.103", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b1f70c311d4941c986de21ac458d11ab", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8cd31427-18", "ovs_interfaceid": "8cd31427-1812-40fb-8018-d8f24a5b1792", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74613) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 18:08:35 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Releasing lock "refresh_cache-e9acfa30-4ec2-4540-ac34-4c66db3228e1" {{(pid=74613) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 18:08:35 user nova-compute[74613]: DEBUG nova.compute.manager [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] [instance: e9acfa30-4ec2-4540-ac34-4c66db3228e1] Updated the network info_cache for instance {{(pid=74613) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 29 18:08:35 user nova-compute[74613]: DEBUG oslo_service.periodic_task [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74613) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 18:08:35 user nova-compute[74613]: DEBUG oslo_service.periodic_task [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74613) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 18:08:35 user nova-compute[74613]: DEBUG oslo_service.periodic_task [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74613) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 18:08:35 user nova-compute[74613]: DEBUG oslo_service.periodic_task [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74613) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 18:08:35 user nova-compute[74613]: DEBUG oslo_service.periodic_task [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74613) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 18:08:35 user nova-compute[74613]: DEBUG oslo_service.periodic_task [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74613) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 18:08:35 user nova-compute[74613]: DEBUG nova.compute.manager [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74613) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 29 18:08:35 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:08:38 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:08:43 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:08:45 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:08:48 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:08:50 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:08:53 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:08:55 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:08:58 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:09:01 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:09:03 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:09:08 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 18:09:10 user nova-compute[74613]: INFO nova.compute.manager [None req-00252cee-8dc3-41ed-9b10-1b30902c1b2c tempest-ServerRescueNegativeTestJSON-1891426908 tempest-ServerRescueNegativeTestJSON-1891426908-project-member] [instance: 6993e2e7-7e03-45b4-9d3d-3742589b6078] Rescuing
Nov 29 18:09:10 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-00252cee-8dc3-41ed-9b10-1b30902c1b2c tempest-ServerRescueNegativeTestJSON-1891426908 tempest-ServerRescueNegativeTestJSON-1891426908-project-member] Acquiring lock "refresh_cache-6993e2e7-7e03-45b4-9d3d-3742589b6078" {{(pid=74613) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 18:09:10 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-00252cee-8dc3-41ed-9b10-1b30902c1b2c tempest-ServerRescueNegativeTestJSON-1891426908 tempest-ServerRescueNegativeTestJSON-1891426908-project-member] Acquired lock "refresh_cache-6993e2e7-7e03-45b4-9d3d-3742589b6078" {{(pid=74613) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 18:09:10 user nova-compute[74613]: DEBUG nova.network.neutron [None req-00252cee-8dc3-41ed-9b10-1b30902c1b2c tempest-ServerRescueNegativeTestJSON-1891426908 tempest-ServerRescueNegativeTestJSON-1891426908-project-member] [instance: 6993e2e7-7e03-45b4-9d3d-3742589b6078] Building network info cache for instance {{(pid=74613) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 29 18:09:10 user nova-compute[74613]: DEBUG nova.network.neutron [None req-00252cee-8dc3-41ed-9b10-1b30902c1b2c tempest-ServerRescueNegativeTestJSON-1891426908 tempest-ServerRescueNegativeTestJSON-1891426908-project-member] [instance: 6993e2e7-7e03-45b4-9d3d-3742589b6078] Updating instance_info_cache with network_info: [{"id": "5216b7ab-6e2b-4d7f-8c7f-e52b03d282b9", "address": "fa:16:3e:e8:7b:54", "network": {"id": "db79433c-b21c-4058-b98c-f62822abbf7a", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1715530752-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e6a3eb6ea0294f9da705dca72ec2789a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5216b7ab-6e", "ovs_interfaceid": "5216b7ab-6e2b-4d7f-8c7f-e52b03d282b9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74613) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 18:09:10 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-00252cee-8dc3-41ed-9b10-1b30902c1b2c tempest-ServerRescueNegativeTestJSON-1891426908 tempest-ServerRescueNegativeTestJSON-1891426908-project-member] Releasing lock "refresh_cache-6993e2e7-7e03-45b4-9d3d-3742589b6078" {{(pid=74613) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 18:09:10 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:09:10 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:09:10 user nova-compute[74613]: DEBUG nova.compute.manager [req-77b404bb-b508-4b4b-a58f-e376fc423db0 req-e41ba4c3-9024-4622-973e-edb14d8fb9e2 service nova] [instance: 6993e2e7-7e03-45b4-9d3d-3742589b6078] Received event network-vif-unplugged-5216b7ab-6e2b-4d7f-8c7f-e52b03d282b9 {{(pid=74613) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 18:09:10 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-77b404bb-b508-4b4b-a58f-e376fc423db0 req-e41ba4c3-9024-4622-973e-edb14d8fb9e2 service nova] Acquiring lock "6993e2e7-7e03-45b4-9d3d-3742589b6078-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 18:09:10 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-77b404bb-b508-4b4b-a58f-e376fc423db0 req-e41ba4c3-9024-4622-973e-edb14d8fb9e2 service nova] Lock "6993e2e7-7e03-45b4-9d3d-3742589b6078-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 18:09:10 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-77b404bb-b508-4b4b-a58f-e376fc423db0 req-e41ba4c3-9024-4622-973e-edb14d8fb9e2 service nova] Lock "6993e2e7-7e03-45b4-9d3d-3742589b6078-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 18:09:10 user nova-compute[74613]: DEBUG nova.compute.manager [req-77b404bb-b508-4b4b-a58f-e376fc423db0 req-e41ba4c3-9024-4622-973e-edb14d8fb9e2 service nova] [instance: 6993e2e7-7e03-45b4-9d3d-3742589b6078] No waiting events found dispatching network-vif-unplugged-5216b7ab-6e2b-4d7f-8c7f-e52b03d282b9 {{(pid=74613) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 18:09:10 user nova-compute[74613]: WARNING nova.compute.manager [req-77b404bb-b508-4b4b-a58f-e376fc423db0 req-e41ba4c3-9024-4622-973e-edb14d8fb9e2 service nova] [instance: 6993e2e7-7e03-45b4-9d3d-3742589b6078] Received unexpected event network-vif-unplugged-5216b7ab-6e2b-4d7f-8c7f-e52b03d282b9 for instance with vm_state active and task_state rescuing.
Nov 29 18:09:10 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:09:10 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:09:11 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:09:11 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:09:11 user nova-compute[74613]: INFO nova.virt.libvirt.driver [-] [instance: 6993e2e7-7e03-45b4-9d3d-3742589b6078] Instance destroyed successfully.
Nov 29 18:09:11 user nova-compute[74613]: INFO nova.virt.libvirt.driver [None req-00252cee-8dc3-41ed-9b10-1b30902c1b2c tempest-ServerRescueNegativeTestJSON-1891426908 tempest-ServerRescueNegativeTestJSON-1891426908-project-member] [instance: 6993e2e7-7e03-45b4-9d3d-3742589b6078] Attempting rescue
Nov 29 18:09:11 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-00252cee-8dc3-41ed-9b10-1b30902c1b2c tempest-ServerRescueNegativeTestJSON-1891426908 tempest-ServerRescueNegativeTestJSON-1891426908-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=74613) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4318}}
Nov 29 18:09:11 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-00252cee-8dc3-41ed-9b10-1b30902c1b2c tempest-ServerRescueNegativeTestJSON-1891426908 tempest-ServerRescueNegativeTestJSON-1891426908-project-member] [instance: 6993e2e7-7e03-45b4-9d3d-3742589b6078] Instance directory exists: not creating {{(pid=74613) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Nov 29 18:09:11 user nova-compute[74613]: INFO nova.virt.libvirt.driver [None req-00252cee-8dc3-41ed-9b10-1b30902c1b2c tempest-ServerRescueNegativeTestJSON-1891426908 tempest-ServerRescueNegativeTestJSON-1891426908-project-member] [instance: 6993e2e7-7e03-45b4-9d3d-3742589b6078] Creating image(s)
Nov 29 18:09:11 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-00252cee-8dc3-41ed-9b10-1b30902c1b2c tempest-ServerRescueNegativeTestJSON-1891426908 tempest-ServerRescueNegativeTestJSON-1891426908-project-member] Acquiring lock "/opt/stack/data/nova/instances/6993e2e7-7e03-45b4-9d3d-3742589b6078/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 18:09:11 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-00252cee-8dc3-41ed-9b10-1b30902c1b2c tempest-ServerRescueNegativeTestJSON-1891426908 tempest-ServerRescueNegativeTestJSON-1891426908-project-member] Lock "/opt/stack/data/nova/instances/6993e2e7-7e03-45b4-9d3d-3742589b6078/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 18:09:11 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-00252cee-8dc3-41ed-9b10-1b30902c1b2c tempest-ServerRescueNegativeTestJSON-1891426908 tempest-ServerRescueNegativeTestJSON-1891426908-project-member] Lock "/opt/stack/data/nova/instances/6993e2e7-7e03-45b4-9d3d-3742589b6078/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.007s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 18:09:11 user nova-compute[74613]: DEBUG nova.objects.instance [None req-00252cee-8dc3-41ed-9b10-1b30902c1b2c tempest-ServerRescueNegativeTestJSON-1891426908 tempest-ServerRescueNegativeTestJSON-1891426908-project-member] Lazy-loading 'trusted_certs' on Instance uuid 6993e2e7-7e03-45b4-9d3d-3742589b6078 {{(pid=74613) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 18:09:11 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-00252cee-8dc3-41ed-9b10-1b30902c1b2c tempest-ServerRescueNegativeTestJSON-1891426908 tempest-ServerRescueNegativeTestJSON-1891426908-project-member] Acquiring lock "21faea9e6951f3bdd0153b76ac89fe1a60a34758" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 18:09:11 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-00252cee-8dc3-41ed-9b10-1b30902c1b2c tempest-ServerRescueNegativeTestJSON-1891426908 tempest-ServerRescueNegativeTestJSON-1891426908-project-member] Lock "21faea9e6951f3bdd0153b76ac89fe1a60a34758" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 18:09:11 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-00252cee-8dc3-41ed-9b10-1b30902c1b2c tempest-ServerRescueNegativeTestJSON-1891426908 tempest-ServerRescueNegativeTestJSON-1891426908-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/21faea9e6951f3bdd0153b76ac89fe1a60a34758 --force-share --output=json {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:09:11 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-00252cee-8dc3-41ed-9b10-1b30902c1b2c tempest-ServerRescueNegativeTestJSON-1891426908 tempest-ServerRescueNegativeTestJSON-1891426908-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/21faea9e6951f3bdd0153b76ac89fe1a60a34758 --force-share --output=json" returned: 0 in 0.180s {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:09:11 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-00252cee-8dc3-41ed-9b10-1b30902c1b2c tempest-ServerRescueNegativeTestJSON-1891426908 tempest-ServerRescueNegativeTestJSON-1891426908-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/21faea9e6951f3bdd0153b76ac89fe1a60a34758,backing_fmt=raw /opt/stack/data/nova/instances/6993e2e7-7e03-45b4-9d3d-3742589b6078/disk.rescue {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:09:11 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-00252cee-8dc3-41ed-9b10-1b30902c1b2c tempest-ServerRescueNegativeTestJSON-1891426908 tempest-ServerRescueNegativeTestJSON-1891426908-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/21faea9e6951f3bdd0153b76ac89fe1a60a34758,backing_fmt=raw /opt/stack/data/nova/instances/6993e2e7-7e03-45b4-9d3d-3742589b6078/disk.rescue" returned: 0 in 0.048s {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:09:11 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-00252cee-8dc3-41ed-9b10-1b30902c1b2c tempest-ServerRescueNegativeTestJSON-1891426908 tempest-ServerRescueNegativeTestJSON-1891426908-project-member] Lock "21faea9e6951f3bdd0153b76ac89fe1a60a34758" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.234s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 18:09:11 user nova-compute[74613]: DEBUG nova.objects.instance [None req-00252cee-8dc3-41ed-9b10-1b30902c1b2c tempest-ServerRescueNegativeTestJSON-1891426908 tempest-ServerRescueNegativeTestJSON-1891426908-project-member] Lazy-loading 'migration_context' on Instance uuid 6993e2e7-7e03-45b4-9d3d-3742589b6078 {{(pid=74613) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 18:09:11 user nova-compute[74613]: DEBUG nova.objects.base [None req-00252cee-8dc3-41ed-9b10-1b30902c1b2c tempest-ServerRescueNegativeTestJSON-1891426908 tempest-ServerRescueNegativeTestJSON-1891426908-project-member] Object Instance<6993e2e7-7e03-45b4-9d3d-3742589b6078> lazy-loaded attributes: trusted_certs,migration_context {{(pid=74613) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 29 18:09:11 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-00252cee-8dc3-41ed-9b10-1b30902c1b2c tempest-ServerRescueNegativeTestJSON-1891426908 tempest-ServerRescueNegativeTestJSON-1891426908-project-member] [instance: 6993e2e7-7e03-45b4-9d3d-3742589b6078] Created local disks {{(pid=74613) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 29 18:09:11 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-00252cee-8dc3-41ed-9b10-1b30902c1b2c tempest-ServerRescueNegativeTestJSON-1891426908 tempest-ServerRescueNegativeTestJSON-1891426908-project-member] [instance: 6993e2e7-7e03-45b4-9d3d-3742589b6078] Start _get_guest_xml network_info=[{"id": "5216b7ab-6e2b-4d7f-8c7f-e52b03d282b9", "address": "fa:16:3e:e8:7b:54", "network": {"id": "db79433c-b21c-4058-b98c-f62822abbf7a", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1715530752-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-1715530752-network", "vif_mac": "fa:16:3e:e8:7b:54"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e6a3eb6ea0294f9da705dca72ec2789a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5216b7ab-6e", "ovs_interfaceid": "5216b7ab-6e2b-4d7f-8c7f-e52b03d282b9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-29T17:47:38Z,direct_url=<?>,disk_format='qcow2',id=4217f428-8d9d-4ee1-9614-642d26d90c46,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='794b07cbd46a44b5865cfda741036bae',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-29T17:47:40Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': '4217f428-8d9d-4ee1-9614-642d26d90c46', 'kernel_id': '', 'ramdisk_id': ''} block_device_info=None {{(pid=74613) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 29 18:09:11 user nova-compute[74613]: DEBUG nova.objects.instance [None req-00252cee-8dc3-41ed-9b10-1b30902c1b2c tempest-ServerRescueNegativeTestJSON-1891426908 tempest-ServerRescueNegativeTestJSON-1891426908-project-member] Lazy-loading 'resources' on Instance uuid 6993e2e7-7e03-45b4-9d3d-3742589b6078 {{(pid=74613) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 18:09:11 user nova-compute[74613]: DEBUG nova.objects.base [None req-00252cee-8dc3-41ed-9b10-1b30902c1b2c tempest-ServerRescueNegativeTestJSON-1891426908 tempest-ServerRescueNegativeTestJSON-1891426908-project-member] Object Instance<6993e2e7-7e03-45b4-9d3d-3742589b6078> lazy-loaded attributes: trusted_certs,migration_context,resources {{(pid=74613) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 29 18:09:11 user nova-compute[74613]: DEBUG nova.objects.instance [None req-00252cee-8dc3-41ed-9b10-1b30902c1b2c tempest-ServerRescueNegativeTestJSON-1891426908 tempest-ServerRescueNegativeTestJSON-1891426908-project-member] Lazy-loading 'numa_topology' on Instance uuid 6993e2e7-7e03-45b4-9d3d-3742589b6078 {{(pid=74613) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 18:09:11 user nova-compute[74613]: DEBUG nova.objects.base [None req-00252cee-8dc3-41ed-9b10-1b30902c1b2c tempest-ServerRescueNegativeTestJSON-1891426908 tempest-ServerRescueNegativeTestJSON-1891426908-project-member] Object Instance<6993e2e7-7e03-45b4-9d3d-3742589b6078> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology {{(pid=74613) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 29 18:09:11 user nova-compute[74613]: WARNING nova.virt.libvirt.driver [None req-00252cee-8dc3-41ed-9b10-1b30902c1b2c tempest-ServerRescueNegativeTestJSON-1891426908 tempest-ServerRescueNegativeTestJSON-1891426908-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 18:09:11 user nova-compute[74613]: WARNING nova.virt.libvirt.driver [None req-00252cee-8dc3-41ed-9b10-1b30902c1b2c tempest-ServerRescueNegativeTestJSON-1891426908 tempest-ServerRescueNegativeTestJSON-1891426908-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 18:09:11 user nova-compute[74613]: DEBUG nova.virt.libvirt.host [None req-00252cee-8dc3-41ed-9b10-1b30902c1b2c tempest-ServerRescueNegativeTestJSON-1891426908 tempest-ServerRescueNegativeTestJSON-1891426908-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74613) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 29 18:09:11 user nova-compute[74613]: DEBUG nova.virt.libvirt.host [None req-00252cee-8dc3-41ed-9b10-1b30902c1b2c tempest-ServerRescueNegativeTestJSON-1891426908 tempest-ServerRescueNegativeTestJSON-1891426908-project-member] CPU controller missing on host. {{(pid=74613) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 29 18:09:11 user nova-compute[74613]: DEBUG nova.virt.libvirt.host [None req-00252cee-8dc3-41ed-9b10-1b30902c1b2c tempest-ServerRescueNegativeTestJSON-1891426908 tempest-ServerRescueNegativeTestJSON-1891426908-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74613) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 29 18:09:11 user nova-compute[74613]: DEBUG nova.virt.libvirt.host [None req-00252cee-8dc3-41ed-9b10-1b30902c1b2c tempest-ServerRescueNegativeTestJSON-1891426908 tempest-ServerRescueNegativeTestJSON-1891426908-project-member] CPU controller found on host. {{(pid=74613) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 29 18:09:11 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-00252cee-8dc3-41ed-9b10-1b30902c1b2c tempest-ServerRescueNegativeTestJSON-1891426908 tempest-ServerRescueNegativeTestJSON-1891426908-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74613) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 29 18:09:11 user nova-compute[74613]: DEBUG nova.virt.hardware [None req-00252cee-8dc3-41ed-9b10-1b30902c1b2c tempest-ServerRescueNegativeTestJSON-1891426908 tempest-ServerRescueNegativeTestJSON-1891426908-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-29T17:47:27Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-29T17:47:38Z,direct_url=<?>,disk_format='qcow2',id=4217f428-8d9d-4ee1-9614-642d26d90c46,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='794b07cbd46a44b5865cfda741036bae',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-29T17:47:40Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74613) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 29 18:09:11 user nova-compute[74613]: DEBUG nova.virt.hardware [None req-00252cee-8dc3-41ed-9b10-1b30902c1b2c tempest-ServerRescueNegativeTestJSON-1891426908 tempest-ServerRescueNegativeTestJSON-1891426908-project-member] Flavor limits 0:0:0 {{(pid=74613) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 29 18:09:11 user nova-compute[74613]: DEBUG nova.virt.hardware [None req-00252cee-8dc3-41ed-9b10-1b30902c1b2c tempest-ServerRescueNegativeTestJSON-1891426908 tempest-ServerRescueNegativeTestJSON-1891426908-project-member] Image limits 0:0:0 {{(pid=74613) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 29 18:09:11 user nova-compute[74613]: DEBUG nova.virt.hardware [None req-00252cee-8dc3-41ed-9b10-1b30902c1b2c tempest-ServerRescueNegativeTestJSON-1891426908 tempest-ServerRescueNegativeTestJSON-1891426908-project-member] Flavor pref 0:0:0 {{(pid=74613) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 29 18:09:11 user nova-compute[74613]: DEBUG nova.virt.hardware [None req-00252cee-8dc3-41ed-9b10-1b30902c1b2c tempest-ServerRescueNegativeTestJSON-1891426908 tempest-ServerRescueNegativeTestJSON-1891426908-project-member] Image pref 0:0:0 {{(pid=74613) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 29 18:09:11 user nova-compute[74613]: DEBUG nova.virt.hardware [None req-00252cee-8dc3-41ed-9b10-1b30902c1b2c tempest-ServerRescueNegativeTestJSON-1891426908 tempest-ServerRescueNegativeTestJSON-1891426908-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74613) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 29 18:09:11 user nova-compute[74613]: DEBUG nova.virt.hardware [None req-00252cee-8dc3-41ed-9b10-1b30902c1b2c tempest-ServerRescueNegativeTestJSON-1891426908 tempest-ServerRescueNegativeTestJSON-1891426908-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74613) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 29 18:09:11 user nova-compute[74613]: DEBUG nova.virt.hardware [None req-00252cee-8dc3-41ed-9b10-1b30902c1b2c tempest-ServerRescueNegativeTestJSON-1891426908 tempest-ServerRescueNegativeTestJSON-1891426908-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74613) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 29 18:09:11 user nova-compute[74613]: DEBUG nova.virt.hardware [None req-00252cee-8dc3-41ed-9b10-1b30902c1b2c tempest-ServerRescueNegativeTestJSON-1891426908 tempest-ServerRescueNegativeTestJSON-1891426908-project-member] Got 1 possible topologies {{(pid=74613) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 29 18:09:11 user nova-compute[74613]: DEBUG nova.virt.hardware [None req-00252cee-8dc3-41ed-9b10-1b30902c1b2c tempest-ServerRescueNegativeTestJSON-1891426908 tempest-ServerRescueNegativeTestJSON-1891426908-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74613) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 29 18:09:11 user nova-compute[74613]: DEBUG nova.virt.hardware [None req-00252cee-8dc3-41ed-9b10-1b30902c1b2c tempest-ServerRescueNegativeTestJSON-1891426908 tempest-ServerRescueNegativeTestJSON-1891426908-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74613) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 29 18:09:11 user nova-compute[74613]: DEBUG nova.objects.instance [None req-00252cee-8dc3-41ed-9b10-1b30902c1b2c tempest-ServerRescueNegativeTestJSON-1891426908 tempest-ServerRescueNegativeTestJSON-1891426908-project-member] Lazy-loading 'vcpu_model' on Instance uuid 6993e2e7-7e03-45b4-9d3d-3742589b6078 {{(pid=74613) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 18:09:11 user nova-compute[74613]: DEBUG nova.objects.base [None req-00252cee-8dc3-41ed-9b10-1b30902c1b2c tempest-ServerRescueNegativeTestJSON-1891426908 tempest-ServerRescueNegativeTestJSON-1891426908-project-member] Object Instance<6993e2e7-7e03-45b4-9d3d-3742589b6078> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model {{(pid=74613) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 29 18:09:11 user nova-compute[74613]: DEBUG nova.virt.libvirt.vif [None req-00252cee-8dc3-41ed-9b10-1b30902c1b2c tempest-ServerRescueNegativeTestJSON-1891426908 tempest-ServerRescueNegativeTestJSON-1891426908-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T18:04:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1218880828',display_name='tempest-ServerRescueNegativeTestJSON-server-1218880828',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1218880828',id=28,image_ref='4217f428-8d9d-4ee1-9614-642d26d90c46',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-29T18:04:34Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='e6a3eb6ea0294f9da705dca72ec2789a',ramdisk_id='',reservation_id='r-llk4pbtb',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='4217f428-8d9d-4ee1-9614-642d26d90c46',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-1891426908',owner_user_name='tempest-ServerRescueNegativeTestJSON-1891426908-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T18:04:35Z,user_data=None,user_id='4e984d45838e441680b9948c213728fb',uuid=6993e2e7-7e03-45b4-9d3d-3742589b6078,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "5216b7ab-6e2b-4d7f-8c7f-e52b03d282b9", "address": "fa:16:3e:e8:7b:54", "network": {"id": "db79433c-b21c-4058-b98c-f62822abbf7a", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1715530752-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-1715530752-network", "vif_mac": "fa:16:3e:e8:7b:54"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e6a3eb6ea0294f9da705dca72ec2789a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5216b7ab-6e", "ovs_interfaceid": "5216b7ab-6e2b-4d7f-8c7f-e52b03d282b9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74613) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 29 18:09:11 user nova-compute[74613]: DEBUG nova.network.os_vif_util [None req-00252cee-8dc3-41ed-9b10-1b30902c1b2c tempest-ServerRescueNegativeTestJSON-1891426908 tempest-ServerRescueNegativeTestJSON-1891426908-project-member] Converting VIF {"id": "5216b7ab-6e2b-4d7f-8c7f-e52b03d282b9", "address": "fa:16:3e:e8:7b:54", "network": {"id": "db79433c-b21c-4058-b98c-f62822abbf7a", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1715530752-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-1715530752-network", "vif_mac": "fa:16:3e:e8:7b:54"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e6a3eb6ea0294f9da705dca72ec2789a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5216b7ab-6e", "ovs_interfaceid": "5216b7ab-6e2b-4d7f-8c7f-e52b03d282b9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74613) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 18:09:11 user nova-compute[74613]: DEBUG nova.network.os_vif_util [None req-00252cee-8dc3-41ed-9b10-1b30902c1b2c tempest-ServerRescueNegativeTestJSON-1891426908 tempest-ServerRescueNegativeTestJSON-1891426908-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:e8:7b:54,bridge_name='br-int',has_traffic_filtering=True,id=5216b7ab-6e2b-4d7f-8c7f-e52b03d282b9,network=Network(db79433c-b21c-4058-b98c-f62822abbf7a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5216b7ab-6e') {{(pid=74613) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 18:09:11 user nova-compute[74613]: DEBUG nova.objects.instance [None req-00252cee-8dc3-41ed-9b10-1b30902c1b2c tempest-ServerRescueNegativeTestJSON-1891426908 tempest-ServerRescueNegativeTestJSON-1891426908-project-member] Lazy-loading 'pci_devices' on Instance uuid 6993e2e7-7e03-45b4-9d3d-3742589b6078 {{(pid=74613) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 18:09:11 user nova-compute[74613]: DEBUG nova.objects.base [None req-00252cee-8dc3-41ed-9b10-1b30902c1b2c tempest-ServerRescueNegativeTestJSON-1891426908 tempest-ServerRescueNegativeTestJSON-1891426908-project-member] Object Instance<6993e2e7-7e03-45b4-9d3d-3742589b6078> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model,pci_devices {{(pid=74613) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 29 18:09:11 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-00252cee-8dc3-41ed-9b10-1b30902c1b2c tempest-ServerRescueNegativeTestJSON-1891426908 tempest-ServerRescueNegativeTestJSON-1891426908-project-member] [instance: 6993e2e7-7e03-45b4-9d3d-3742589b6078] End _get_guest_xml xml=<domain type="kvm">
Nov 29 18:09:11 user nova-compute[74613]:   <uuid>6993e2e7-7e03-45b4-9d3d-3742589b6078</uuid>
Nov 29 18:09:11 user nova-compute[74613]:   <name>instance-0000001c</name>
Nov 29 18:09:11 user nova-compute[74613]:   <memory>524288</memory>
Nov 29 18:09:11 user nova-compute[74613]:   <vcpu>1</vcpu>
Nov 29 18:09:11 user nova-compute[74613]:   <metadata>
Nov 29 18:09:11 user nova-compute[74613]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 29 18:09:11 user nova-compute[74613]:       <nova:package version="0.0.0"/>
Nov 29 18:09:11 user nova-compute[74613]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-1218880828</nova:name>
Nov 29 18:09:11 user nova-compute[74613]:       <nova:creationTime>2023-11-29 18:09:11</nova:creationTime>
Nov 29 18:09:11 user nova-compute[74613]:       <nova:flavor name="m1.tiny">
Nov 29 18:09:11 user nova-compute[74613]:         <nova:memory>512</nova:memory>
Nov 29 18:09:11 user nova-compute[74613]:         <nova:disk>1</nova:disk>
Nov 29 18:09:11 user nova-compute[74613]:         <nova:swap>0</nova:swap>
Nov 29 18:09:11 user nova-compute[74613]:         <nova:ephemeral>0</nova:ephemeral>
Nov 29 18:09:11 user nova-compute[74613]:         <nova:vcpus>1</nova:vcpus>
Nov 29 18:09:11 user nova-compute[74613]:       </nova:flavor>
Nov 29 18:09:11 user nova-compute[74613]:       <nova:owner>
Nov 29 18:09:11 user nova-compute[74613]:         <nova:user uuid="4e984d45838e441680b9948c213728fb">tempest-ServerRescueNegativeTestJSON-1891426908-project-member</nova:user>
Nov 29 18:09:11 user nova-compute[74613]:         <nova:project uuid="e6a3eb6ea0294f9da705dca72ec2789a">tempest-ServerRescueNegativeTestJSON-1891426908</nova:project>
Nov 29 18:09:11 user nova-compute[74613]:       </nova:owner>
Nov 29 18:09:11 user nova-compute[74613]:       <nova:root type="image" uuid="4217f428-8d9d-4ee1-9614-642d26d90c46"/>
Nov 29 18:09:11 user nova-compute[74613]:       <nova:ports>
Nov 29 18:09:11 user nova-compute[74613]:         <nova:port uuid="5216b7ab-6e2b-4d7f-8c7f-e52b03d282b9">
Nov 29 18:09:11 user nova-compute[74613]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Nov 29 18:09:11 user nova-compute[74613]:         </nova:port>
Nov 29 18:09:11 user nova-compute[74613]:       </nova:ports>
Nov 29 18:09:11 user nova-compute[74613]:     </nova:instance>
Nov 29 18:09:11 user nova-compute[74613]:   </metadata>
Nov 29 18:09:11 user nova-compute[74613]:   <sysinfo type="smbios">
Nov 29 18:09:11 user nova-compute[74613]:     <system>
Nov 29 18:09:11 user nova-compute[74613]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 29 18:09:11 user nova-compute[74613]:       <entry name="product">OpenStack Nova</entry>
Nov 29 18:09:11 user nova-compute[74613]:       <entry name="version">0.0.0</entry>
Nov 29 18:09:11 user nova-compute[74613]:       <entry name="serial">6993e2e7-7e03-45b4-9d3d-3742589b6078</entry>
Nov 29 18:09:11 user nova-compute[74613]:       <entry name="uuid">6993e2e7-7e03-45b4-9d3d-3742589b6078</entry>
Nov 29 18:09:11 user nova-compute[74613]:       <entry name="family">Virtual Machine</entry>
Nov 29 18:09:11 user nova-compute[74613]:     </system>
Nov 29 18:09:11 user nova-compute[74613]:   </sysinfo>
Nov 29 18:09:11 user nova-compute[74613]:   <os>
Nov 29 18:09:11 user nova-compute[74613]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 29 18:09:11 user nova-compute[74613]:     <smbios mode="sysinfo"/>
Nov 29 18:09:11 user nova-compute[74613]:   </os>
Nov 29 18:09:11 user nova-compute[74613]:   <features>
Nov 29 18:09:11 user nova-compute[74613]:     <acpi/>
Nov 29 18:09:11 user nova-compute[74613]:     <apic/>
Nov 29 18:09:11 user nova-compute[74613]:     <vmcoreinfo/>
Nov 29 18:09:11 user nova-compute[74613]:   </features>
Nov 29 18:09:11 user nova-compute[74613]:   <clock offset="utc">
Nov 29 18:09:11 user nova-compute[74613]:     <timer name="pit" tickpolicy="delay"/>
Nov 29 18:09:11 user nova-compute[74613]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 29 18:09:11 user nova-compute[74613]:     <timer name="hpet" present="no"/>
Nov 29 18:09:11 user nova-compute[74613]:   </clock>
Nov 29 18:09:11 user nova-compute[74613]:   <cpu mode="custom" match="exact">
Nov 29 18:09:11 user nova-compute[74613]:     <model>Nehalem</model>
Nov 29 18:09:11 user nova-compute[74613]:     <topology sockets="1" cores="1" threads="1"/>
Nov 29 18:09:11 user nova-compute[74613]:   </cpu>
Nov 29 18:09:11 user nova-compute[74613]:   <devices>
Nov 29 18:09:11 user nova-compute[74613]:     <disk type="file" device="disk">
Nov 29 18:09:11 user nova-compute[74613]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 29 18:09:11 user nova-compute[74613]:       <source file="/opt/stack/data/nova/instances/6993e2e7-7e03-45b4-9d3d-3742589b6078/disk.rescue"/>
Nov 29 18:09:11 user nova-compute[74613]:       <target dev="vda" bus="virtio"/>
Nov 29 18:09:11 user nova-compute[74613]:     </disk>
Nov 29 18:09:11 user nova-compute[74613]:     <disk type="file" device="disk">
Nov 29 18:09:11 user nova-compute[74613]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 29 18:09:11 user nova-compute[74613]:       <source file="/opt/stack/data/nova/instances/6993e2e7-7e03-45b4-9d3d-3742589b6078/disk"/>
Nov 29 18:09:11 user nova-compute[74613]:       <target dev="vdb" bus="virtio"/>
Nov 29 18:09:11 user nova-compute[74613]:     </disk>
Nov 29 18:09:11 user nova-compute[74613]:     <interface type="ethernet">
Nov 29 18:09:11 user nova-compute[74613]:       <mac address="fa:16:3e:e8:7b:54"/>
Nov 29 18:09:11 user nova-compute[74613]:       <model type="virtio"/>
Nov 29 18:09:11 user nova-compute[74613]:       <mtu size="1442"/>
Nov 29 18:09:11 user nova-compute[74613]:       <target dev="tap5216b7ab-6e"/>
Nov 29 18:09:11 user nova-compute[74613]:     </interface>
Nov 29 18:09:11 user nova-compute[74613]:     <serial type="pty">
Nov 29 18:09:11 user nova-compute[74613]:       <log file="/opt/stack/data/nova/instances/6993e2e7-7e03-45b4-9d3d-3742589b6078/console.log" append="off"/>
Nov 29 18:09:11 user nova-compute[74613]:     </serial>
Nov 29 18:09:11 user nova-compute[74613]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 29 18:09:11 user nova-compute[74613]:     <video>
Nov 29 18:09:11 user nova-compute[74613]:       <model type="virtio"/>
Nov 29 18:09:11 user nova-compute[74613]:     </video>
Nov 29 18:09:11 user nova-compute[74613]:     <rng model="virtio">
Nov 29 18:09:11 user nova-compute[74613]:       <backend model="random">/dev/urandom</backend>
Nov 29 18:09:11 user nova-compute[74613]:     </rng>
Nov 29 18:09:11 user nova-compute[74613]:     <controller type="usb" index="0" model="none"/>
Nov 29 18:09:11 user nova-compute[74613]:     <memballoon model="virtio">
Nov 29 18:09:11 user nova-compute[74613]:       <stats period="10"/>
Nov 29 18:09:11 user nova-compute[74613]:     </memballoon>
Nov 29 18:09:11 user nova-compute[74613]:   </devices>
Nov 29 18:09:11 user nova-compute[74613]: </domain>
Nov 29 18:09:11 user nova-compute[74613]:  {{(pid=74613) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 29 18:09:11 user nova-compute[74613]: INFO nova.virt.libvirt.driver [-] [instance: 6993e2e7-7e03-45b4-9d3d-3742589b6078] Instance destroyed successfully.
Nov 29 18:09:11 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-00252cee-8dc3-41ed-9b10-1b30902c1b2c tempest-ServerRescueNegativeTestJSON-1891426908 tempest-ServerRescueNegativeTestJSON-1891426908-project-member] No BDM found with device name vda, not building metadata. {{(pid=74613) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 18:09:11 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-00252cee-8dc3-41ed-9b10-1b30902c1b2c tempest-ServerRescueNegativeTestJSON-1891426908 tempest-ServerRescueNegativeTestJSON-1891426908-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74613) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 18:09:11 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-00252cee-8dc3-41ed-9b10-1b30902c1b2c tempest-ServerRescueNegativeTestJSON-1891426908 tempest-ServerRescueNegativeTestJSON-1891426908-project-member] No VIF found with MAC fa:16:3e:e8:7b:54, not building metadata {{(pid=74613) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 29 18:09:12 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:09:12 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:09:12 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:09:12 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:09:12 user nova-compute[74613]: DEBUG nova.compute.manager [req-cb45fed9-9178-4ae3-9bfd-a9bc3ccf7322 req-06755127-831a-4d97-9831-8443ea6c9863 service nova] [instance: 6993e2e7-7e03-45b4-9d3d-3742589b6078] Received event network-vif-plugged-5216b7ab-6e2b-4d7f-8c7f-e52b03d282b9 {{(pid=74613) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 18:09:12 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-cb45fed9-9178-4ae3-9bfd-a9bc3ccf7322 req-06755127-831a-4d97-9831-8443ea6c9863 service nova] Acquiring lock "6993e2e7-7e03-45b4-9d3d-3742589b6078-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 18:09:12 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-cb45fed9-9178-4ae3-9bfd-a9bc3ccf7322 req-06755127-831a-4d97-9831-8443ea6c9863 service nova] Lock "6993e2e7-7e03-45b4-9d3d-3742589b6078-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 18:09:12 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-cb45fed9-9178-4ae3-9bfd-a9bc3ccf7322 req-06755127-831a-4d97-9831-8443ea6c9863 service nova] Lock "6993e2e7-7e03-45b4-9d3d-3742589b6078-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 18:09:12 user nova-compute[74613]: DEBUG nova.compute.manager [req-cb45fed9-9178-4ae3-9bfd-a9bc3ccf7322 req-06755127-831a-4d97-9831-8443ea6c9863 service nova] [instance: 6993e2e7-7e03-45b4-9d3d-3742589b6078] No waiting events found dispatching network-vif-plugged-5216b7ab-6e2b-4d7f-8c7f-e52b03d282b9 {{(pid=74613) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 18:09:12 user nova-compute[74613]: WARNING nova.compute.manager [req-cb45fed9-9178-4ae3-9bfd-a9bc3ccf7322 req-06755127-831a-4d97-9831-8443ea6c9863 service nova] [instance: 6993e2e7-7e03-45b4-9d3d-3742589b6078] Received unexpected event network-vif-plugged-5216b7ab-6e2b-4d7f-8c7f-e52b03d282b9 for instance with vm_state active and task_state rescuing.
Nov 29 18:09:13 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:09:13 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:09:13 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:09:15 user nova-compute[74613]: DEBUG nova.compute.manager [None req-00252cee-8dc3-41ed-9b10-1b30902c1b2c tempest-ServerRescueNegativeTestJSON-1891426908 tempest-ServerRescueNegativeTestJSON-1891426908-project-member] [instance: 6993e2e7-7e03-45b4-9d3d-3742589b6078] Checking state {{(pid=74613) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 29 18:09:15 user nova-compute[74613]: DEBUG nova.compute.manager [req-fa692cdc-1fb4-4d00-bef8-55c367aa60f3 req-7772d548-2347-40d1-a054-4896ad162668 service nova] [instance: 6993e2e7-7e03-45b4-9d3d-3742589b6078] Received event network-vif-plugged-5216b7ab-6e2b-4d7f-8c7f-e52b03d282b9 {{(pid=74613) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 18:09:15 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-fa692cdc-1fb4-4d00-bef8-55c367aa60f3 req-7772d548-2347-40d1-a054-4896ad162668 service nova] Acquiring lock "6993e2e7-7e03-45b4-9d3d-3742589b6078-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 18:09:15 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-fa692cdc-1fb4-4d00-bef8-55c367aa60f3 req-7772d548-2347-40d1-a054-4896ad162668 service nova] Lock "6993e2e7-7e03-45b4-9d3d-3742589b6078-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 18:09:15 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-fa692cdc-1fb4-4d00-bef8-55c367aa60f3 req-7772d548-2347-40d1-a054-4896ad162668 service nova] Lock "6993e2e7-7e03-45b4-9d3d-3742589b6078-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 18:09:15 user nova-compute[74613]: DEBUG nova.compute.manager [req-fa692cdc-1fb4-4d00-bef8-55c367aa60f3 req-7772d548-2347-40d1-a054-4896ad162668 service nova] [instance: 6993e2e7-7e03-45b4-9d3d-3742589b6078] No waiting events found dispatching network-vif-plugged-5216b7ab-6e2b-4d7f-8c7f-e52b03d282b9 {{(pid=74613) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 18:09:15 user nova-compute[74613]: WARNING nova.compute.manager [req-fa692cdc-1fb4-4d00-bef8-55c367aa60f3 req-7772d548-2347-40d1-a054-4896ad162668 service nova] [instance: 6993e2e7-7e03-45b4-9d3d-3742589b6078] Received unexpected event network-vif-plugged-5216b7ab-6e2b-4d7f-8c7f-e52b03d282b9 for instance with vm_state active and task_state rescuing.
Nov 29 18:09:15 user nova-compute[74613]: DEBUG nova.compute.manager [req-fa692cdc-1fb4-4d00-bef8-55c367aa60f3 req-7772d548-2347-40d1-a054-4896ad162668 service nova] [instance: 6993e2e7-7e03-45b4-9d3d-3742589b6078] Received event network-vif-plugged-5216b7ab-6e2b-4d7f-8c7f-e52b03d282b9 {{(pid=74613) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 18:09:15 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-fa692cdc-1fb4-4d00-bef8-55c367aa60f3 req-7772d548-2347-40d1-a054-4896ad162668 service nova] Acquiring lock "6993e2e7-7e03-45b4-9d3d-3742589b6078-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 18:09:15 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-fa692cdc-1fb4-4d00-bef8-55c367aa60f3 req-7772d548-2347-40d1-a054-4896ad162668 service nova] Lock "6993e2e7-7e03-45b4-9d3d-3742589b6078-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 18:09:15 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-fa692cdc-1fb4-4d00-bef8-55c367aa60f3 req-7772d548-2347-40d1-a054-4896ad162668 service nova] Lock "6993e2e7-7e03-45b4-9d3d-3742589b6078-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 18:09:15 user nova-compute[74613]: DEBUG nova.compute.manager [req-fa692cdc-1fb4-4d00-bef8-55c367aa60f3 req-7772d548-2347-40d1-a054-4896ad162668 service nova] [instance: 6993e2e7-7e03-45b4-9d3d-3742589b6078] No waiting events found dispatching network-vif-plugged-5216b7ab-6e2b-4d7f-8c7f-e52b03d282b9 {{(pid=74613) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 18:09:15 user nova-compute[74613]: WARNING nova.compute.manager [req-fa692cdc-1fb4-4d00-bef8-55c367aa60f3 req-7772d548-2347-40d1-a054-4896ad162668 service nova] [instance: 6993e2e7-7e03-45b4-9d3d-3742589b6078] Received unexpected event network-vif-plugged-5216b7ab-6e2b-4d7f-8c7f-e52b03d282b9 for instance with vm_state active and task_state rescuing.
Nov 29 18:09:15 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:09:18 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:09:22 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-4e35828a-e709-4fa5-9693-d67e33b1e0f6 tempest-ServerBootFromVolumeStableRescueTest-414665510 tempest-ServerBootFromVolumeStableRescueTest-414665510-project-member] Acquiring lock "d3c285cd-9f39-423c-a324-30a48a9c66be" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 18:09:22 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-4e35828a-e709-4fa5-9693-d67e33b1e0f6 tempest-ServerBootFromVolumeStableRescueTest-414665510 tempest-ServerBootFromVolumeStableRescueTest-414665510-project-member] Lock "d3c285cd-9f39-423c-a324-30a48a9c66be" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 18:09:22 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-4e35828a-e709-4fa5-9693-d67e33b1e0f6 tempest-ServerBootFromVolumeStableRescueTest-414665510 tempest-ServerBootFromVolumeStableRescueTest-414665510-project-member] Acquiring lock "d3c285cd-9f39-423c-a324-30a48a9c66be-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 18:09:22 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-4e35828a-e709-4fa5-9693-d67e33b1e0f6 tempest-ServerBootFromVolumeStableRescueTest-414665510 tempest-ServerBootFromVolumeStableRescueTest-414665510-project-member] Lock "d3c285cd-9f39-423c-a324-30a48a9c66be-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 18:09:22 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-4e35828a-e709-4fa5-9693-d67e33b1e0f6 tempest-ServerBootFromVolumeStableRescueTest-414665510 tempest-ServerBootFromVolumeStableRescueTest-414665510-project-member] Lock "d3c285cd-9f39-423c-a324-30a48a9c66be-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 18:09:22 user nova-compute[74613]: INFO nova.compute.manager [None req-4e35828a-e709-4fa5-9693-d67e33b1e0f6 tempest-ServerBootFromVolumeStableRescueTest-414665510 tempest-ServerBootFromVolumeStableRescueTest-414665510-project-member] [instance: d3c285cd-9f39-423c-a324-30a48a9c66be] Terminating instance
Nov 29 18:09:22 user nova-compute[74613]: DEBUG nova.compute.manager [None req-4e35828a-e709-4fa5-9693-d67e33b1e0f6 tempest-ServerBootFromVolumeStableRescueTest-414665510 tempest-ServerBootFromVolumeStableRescueTest-414665510-project-member] [instance: d3c285cd-9f39-423c-a324-30a48a9c66be] Start destroying the instance on the hypervisor. {{(pid=74613) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 29 18:09:22 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:09:22 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:09:22 user nova-compute[74613]: DEBUG nova.compute.manager [req-ae9134c0-fb7a-4f8e-9cef-85e416be9d55 req-6f512509-08ef-4c37-83c6-297e97d47bd8 service nova] [instance: d3c285cd-9f39-423c-a324-30a48a9c66be] Received event network-vif-unplugged-663e4724-b31b-469d-a5ea-c2802db1e0c8 {{(pid=74613) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 18:09:22 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-ae9134c0-fb7a-4f8e-9cef-85e416be9d55 req-6f512509-08ef-4c37-83c6-297e97d47bd8 service nova] Acquiring lock "d3c285cd-9f39-423c-a324-30a48a9c66be-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 18:09:22 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-ae9134c0-fb7a-4f8e-9cef-85e416be9d55 req-6f512509-08ef-4c37-83c6-297e97d47bd8 service nova] Lock "d3c285cd-9f39-423c-a324-30a48a9c66be-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 18:09:22 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-ae9134c0-fb7a-4f8e-9cef-85e416be9d55 req-6f512509-08ef-4c37-83c6-297e97d47bd8 service nova] Lock "d3c285cd-9f39-423c-a324-30a48a9c66be-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.002s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 18:09:22 user nova-compute[74613]: DEBUG nova.compute.manager [req-ae9134c0-fb7a-4f8e-9cef-85e416be9d55 req-6f512509-08ef-4c37-83c6-297e97d47bd8 service nova] [instance: d3c285cd-9f39-423c-a324-30a48a9c66be] No waiting events found dispatching network-vif-unplugged-663e4724-b31b-469d-a5ea-c2802db1e0c8 {{(pid=74613) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 18:09:22 user nova-compute[74613]: DEBUG nova.compute.manager [req-ae9134c0-fb7a-4f8e-9cef-85e416be9d55 req-6f512509-08ef-4c37-83c6-297e97d47bd8 service nova] [instance: d3c285cd-9f39-423c-a324-30a48a9c66be] Received event network-vif-unplugged-663e4724-b31b-469d-a5ea-c2802db1e0c8 for instance with task_state deleting. {{(pid=74613) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 29 18:09:22 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:09:22 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:09:23 user nova-compute[74613]: INFO nova.virt.libvirt.driver [-] [instance: d3c285cd-9f39-423c-a324-30a48a9c66be] Instance destroyed successfully.
Nov 29 18:09:23 user nova-compute[74613]: DEBUG nova.objects.instance [None req-4e35828a-e709-4fa5-9693-d67e33b1e0f6 tempest-ServerBootFromVolumeStableRescueTest-414665510 tempest-ServerBootFromVolumeStableRescueTest-414665510-project-member] Lazy-loading 'resources' on Instance uuid d3c285cd-9f39-423c-a324-30a48a9c66be {{(pid=74613) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 18:09:23 user nova-compute[74613]: DEBUG nova.virt.libvirt.vif [None req-4e35828a-e709-4fa5-9693-d67e33b1e0f6 tempest-ServerBootFromVolumeStableRescueTest-414665510 tempest-ServerBootFromVolumeStableRescueTest-414665510-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T18:03:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1343284375',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1343284375',id=27,image_ref='4217f428-8d9d-4ee1-9614-642d26d90c46',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-29T18:05:47Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='b820dd795dfe46cd804772f0e71f98e9',ramdisk_id='',reservation_id='r-aaektgy8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='4217f428-8d9d-4ee1-9614-642d26d90c46',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-414665510',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-414665510-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-29T18:07:37Z,user_data=None,user_id='c65bc922e04d4d1385e48f70c460c441',uuid=d3c285cd-9f39-423c-a324-30a48a9c66be,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "663e4724-b31b-469d-a5ea-c2802db1e0c8", "address": "fa:16:3e:11:80:42", "network": {"id": "0722b02d-a357-4360-87e8-580913723985", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-579793494-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b820dd795dfe46cd804772f0e71f98e9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap663e4724-b3", "ovs_interfaceid": "663e4724-b31b-469d-a5ea-c2802db1e0c8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74613) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 29 18:09:23 user nova-compute[74613]: DEBUG nova.network.os_vif_util [None req-4e35828a-e709-4fa5-9693-d67e33b1e0f6 tempest-ServerBootFromVolumeStableRescueTest-414665510 tempest-ServerBootFromVolumeStableRescueTest-414665510-project-member] Converting VIF {"id": "663e4724-b31b-469d-a5ea-c2802db1e0c8", "address": "fa:16:3e:11:80:42", "network": {"id": "0722b02d-a357-4360-87e8-580913723985", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-579793494-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b820dd795dfe46cd804772f0e71f98e9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap663e4724-b3", "ovs_interfaceid": "663e4724-b31b-469d-a5ea-c2802db1e0c8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74613) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 18:09:23 user nova-compute[74613]: DEBUG nova.network.os_vif_util [None req-4e35828a-e709-4fa5-9693-d67e33b1e0f6 tempest-ServerBootFromVolumeStableRescueTest-414665510 tempest-ServerBootFromVolumeStableRescueTest-414665510-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:11:80:42,bridge_name='br-int',has_traffic_filtering=True,id=663e4724-b31b-469d-a5ea-c2802db1e0c8,network=Network(0722b02d-a357-4360-87e8-580913723985),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap663e4724-b3') {{(pid=74613) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 18:09:23 user nova-compute[74613]: DEBUG os_vif [None req-4e35828a-e709-4fa5-9693-d67e33b1e0f6 tempest-ServerBootFromVolumeStableRescueTest-414665510 tempest-ServerBootFromVolumeStableRescueTest-414665510-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:11:80:42,bridge_name='br-int',has_traffic_filtering=True,id=663e4724-b31b-469d-a5ea-c2802db1e0c8,network=Network(0722b02d-a357-4360-87e8-580913723985),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap663e4724-b3') {{(pid=74613) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 29 18:09:23 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:09:23 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap663e4724-b3, bridge=br-int, if_exists=True) {{(pid=74613) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 18:09:23 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:09:23 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 18:09:23 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:09:23 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:09:23 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=8f809c86-18f0-45f4-bd4f-dc6a43754cef) {{(pid=74613) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 18:09:23 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:09:23 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 18:09:23 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:09:23 user nova-compute[74613]: INFO os_vif [None req-4e35828a-e709-4fa5-9693-d67e33b1e0f6 tempest-ServerBootFromVolumeStableRescueTest-414665510 tempest-ServerBootFromVolumeStableRescueTest-414665510-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:11:80:42,bridge_name='br-int',has_traffic_filtering=True,id=663e4724-b31b-469d-a5ea-c2802db1e0c8,network=Network(0722b02d-a357-4360-87e8-580913723985),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap663e4724-b3')
Nov 29 18:09:23 user nova-compute[74613]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4e35828a-e709-4fa5-9693-d67e33b1e0f6 tempest-ServerBootFromVolumeStableRescueTest-414665510 tempest-ServerBootFromVolumeStableRescueTest-414665510-project-member] [instance: d3c285cd-9f39-423c-a324-30a48a9c66be] calling os-brick to detach iSCSI Volume {{(pid=74613) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 29 18:09:23 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e35828a-e709-4fa5-9693-d67e33b1e0f6 tempest-ServerBootFromVolumeStableRescueTest-414665510 tempest-ServerBootFromVolumeStableRescueTest-414665510-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff828156890>, {'target_iqn': 'iqn.2010-10.org.openstack:b9aad94d-fe0d-415d-9761-9aff25cc6099', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UhRblKdm', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=74613) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 18:09:23 user nova-compute[74613]: WARNING os_brick.initiator.connectors.base [None req-4e35828a-e709-4fa5-9693-d67e33b1e0f6 tempest-ServerBootFromVolumeStableRescueTest-414665510 tempest-ServerBootFromVolumeStableRescueTest-414665510-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 18:09:23 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.base [None req-4e35828a-e709-4fa5-9693-d67e33b1e0f6 tempest-ServerBootFromVolumeStableRescueTest-414665510 tempest-ServerBootFromVolumeStableRescueTest-414665510-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 18:09:23 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.base [None req-4e35828a-e709-4fa5-9693-d67e33b1e0f6 tempest-ServerBootFromVolumeStableRescueTest-414665510 tempest-ServerBootFromVolumeStableRescueTest-414665510-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 18:09:23 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:09:23 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.059s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:09:23 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e1ce828-6d8a-48c9-b67c-83d6eea9ad04]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:9511387c-8772-40f2-bf2d-6b6387649e9f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b9aad94d-fe0d-415d-9761-9aff25cc6099\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:34908494-9a6c-4c8c-b447-9768745356ca\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b2879f1d-797c-4701-8803-eb6369ddb534\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a8c53a27-dcde-402b-a9bb-d8642f7db0da\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 18:09:23 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e35828a-e709-4fa5-9693-d67e33b1e0f6 tempest-ServerBootFromVolumeStableRescueTest-414665510 tempest-ServerBootFromVolumeStableRescueTest-414665510-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 29 18:09:23 user nova-compute[74613]: No targets found.
Nov 29 18:09:23 user nova-compute[74613]: iSNS:
Nov 29 18:09:23 user nova-compute[74613]: No targets found.
Nov 29 18:09:23 user nova-compute[74613]: STATIC:
Nov 29 18:09:23 user nova-compute[74613]: Target: iqn.2010-10.org.openstack:9511387c-8772-40f2-bf2d-6b6387649e9f
Nov 29 18:09:23 user nova-compute[74613]:         Portal: 172.16.0.220:3260,-1
Nov 29 18:09:23 user nova-compute[74613]:                 Iface Name: default
Nov 29 18:09:23 user nova-compute[74613]: Target: iqn.2010-10.org.openstack:b9aad94d-fe0d-415d-9761-9aff25cc6099
Nov 29 18:09:23 user nova-compute[74613]:         Portal: 172.16.0.220:3260,-1
Nov 29 18:09:23 user nova-compute[74613]:                 Iface Name: default
Nov 29 18:09:23 user nova-compute[74613]: Target: iqn.2010-10.org.openstack:34908494-9a6c-4c8c-b447-9768745356ca
Nov 29 18:09:23 user nova-compute[74613]:         Portal: 172.16.0.220:3260,-1
Nov 29 18:09:23 user nova-compute[74613]:                 Iface Name: default
Nov 29 18:09:23 user nova-compute[74613]: Target: iqn.2010-10.org.openstack:b2879f1d-797c-4701-8803-eb6369ddb534
Nov 29 18:09:23 user nova-compute[74613]:         Portal: 172.16.0.220:3260,-1
Nov 29 18:09:23 user nova-compute[74613]:                 Iface Name: default
Nov 29 18:09:23 user nova-compute[74613]: Target: iqn.2010-10.org.openstack:a8c53a27-dcde-402b-a9bb-d8642f7db0da
Nov 29 18:09:23 user nova-compute[74613]:         Portal: 172.16.0.220:3260,-1
Nov 29 18:09:23 user nova-compute[74613]:                 Iface Name: default
Nov 29 18:09:23 user nova-compute[74613]: FIRMWARE:
Nov 29 18:09:23 user nova-compute[74613]: No targets found.
Nov 29 18:09:23 user nova-compute[74613]:  stderr= {{(pid=74613) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 18:09:23 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e35828a-e709-4fa5-9693-d67e33b1e0f6 tempest-ServerBootFromVolumeStableRescueTest-414665510 tempest-ServerBootFromVolumeStableRescueTest-414665510-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 29 18:09:23 user nova-compute[74613]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 29 18:09:23 user nova-compute[74613]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74613) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 29 18:09:23 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e35828a-e709-4fa5-9693-d67e33b1e0f6 tempest-ServerBootFromVolumeStableRescueTest-414665510 tempest-ServerBootFromVolumeStableRescueTest-414665510-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b9aad94d-fe0d-415d-9761-9aff25cc6099', 0)] {{(pid=74613) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 29 18:09:23 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:09:23 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.022s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:09:23 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[81f58a13-8d55-49c5-8ae3-8e8d811cad63]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:34908494-9a6c-4c8c-b447-9768745356ca\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9511387c-8772-40f2-bf2d-6b6387649e9f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a8c53a27-dcde-402b-a9bb-d8642f7db0da\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b2879f1d-797c-4701-8803-eb6369ddb534\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b9aad94d-fe0d-415d-9761-9aff25cc6099\n', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 18:09:23 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:09:23 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:09:23 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[e982cbae-d506-4089-bd8b-7a670e6e6b94]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9511387c-8772-40f2-bf2d-6b6387649e9f (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9aad94d-fe0d-415d-9761-9aff25cc6099 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8c53a27-dcde-402b-a9bb-d8642f7db0da (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:34908494-9a6c-4c8c-b447-9768745356ca (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2879f1d-797c-4701-8803-eb6369ddb534 (non-flash)\n', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 18:09:23 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e35828a-e709-4fa5-9693-d67e33b1e0f6 tempest-ServerBootFromVolumeStableRescueTest-414665510 tempest-ServerBootFromVolumeStableRescueTest-414665510-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9511387c-8772-40f2-bf2d-6b6387649e9f (non-flash)
Nov 29 18:09:23 user nova-compute[74613]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9aad94d-fe0d-415d-9761-9aff25cc6099 (non-flash)
Nov 29 18:09:23 user nova-compute[74613]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8c53a27-dcde-402b-a9bb-d8642f7db0da (non-flash)
Nov 29 18:09:23 user nova-compute[74613]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:34908494-9a6c-4c8c-b447-9768745356ca (non-flash)
Nov 29 18:09:23 user nova-compute[74613]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2879f1d-797c-4701-8803-eb6369ddb534 (non-flash)
Nov 29 18:09:23 user nova-compute[74613]:  stderr= {{(pid=74613) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 18:09:23 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e35828a-e709-4fa5-9693-d67e33b1e0f6 tempest-ServerBootFromVolumeStableRescueTest-414665510 tempest-ServerBootFromVolumeStableRescueTest-414665510-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9511387c-8772-40f2-bf2d-6b6387649e9f (non-flash)
Nov 29 18:09:23 user nova-compute[74613]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9aad94d-fe0d-415d-9761-9aff25cc6099 (non-flash)
Nov 29 18:09:23 user nova-compute[74613]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8c53a27-dcde-402b-a9bb-d8642f7db0da (non-flash)
Nov 29 18:09:23 user nova-compute[74613]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:34908494-9a6c-4c8c-b447-9768745356ca (non-flash)
Nov 29 18:09:23 user nova-compute[74613]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2879f1d-797c-4701-8803-eb6369ddb534 (non-flash)
Nov 29 18:09:23 user nova-compute[74613]:  stderr= {{(pid=74613) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 18:09:23 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e35828a-e709-4fa5-9693-d67e33b1e0f6 tempest-ServerBootFromVolumeStableRescueTest-414665510 tempest-ServerBootFromVolumeStableRescueTest-414665510-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7ff8285332e0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b9aad94d-fe0d-415d-9761-9aff25cc6099'): ({'sdc'}, set())}) {{(pid=74613) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 29 18:09:23 user nova-compute[74613]: DEBUG os_brick.initiator.linuxscsi [None req-4e35828a-e709-4fa5-9693-d67e33b1e0f6 tempest-ServerBootFromVolumeStableRescueTest-414665510 tempest-ServerBootFromVolumeStableRescueTest-414665510-project-member] Removing single pathed devices sdc {{(pid=74613) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 29 18:09:23 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:09:23 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.029s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:09:23 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[d17d8529-9128-4b3d-a2c5-b26702aea8cb]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 18:09:23 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:09:23 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.023s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:09:23 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc80fc16-3839-48be-a093-40d752ddb95b]: (4, ('ok\n', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 18:09:23 user nova-compute[74613]: DEBUG os_brick.initiator.linuxscsi [None req-4e35828a-e709-4fa5-9693-d67e33b1e0f6 tempest-ServerBootFromVolumeStableRescueTest-414665510 tempest-ServerBootFromVolumeStableRescueTest-414665510-project-member] Flushing IO for device /dev/sdc {{(pid=74613) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 29 18:09:23 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:09:23 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.018s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:09:23 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c05894e-5d23-48e0-8d8e-acd2d435ec4e]: (4, ('', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 18:09:23 user nova-compute[74613]: DEBUG os_brick.initiator.linuxscsi [None req-4e35828a-e709-4fa5-9693-d67e33b1e0f6 tempest-ServerBootFromVolumeStableRescueTest-414665510 tempest-ServerBootFromVolumeStableRescueTest-414665510-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=74613) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 29 18:09:23 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:09:23 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.055s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:09:23 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec9a0fd0-e3a8-491a-9dc6-f2b8a438f02b]: (4, ('1', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 18:09:23 user nova-compute[74613]: DEBUG os_brick.initiator.linuxscsi [None req-4e35828a-e709-4fa5-9693-d67e33b1e0f6 tempest-ServerBootFromVolumeStableRescueTest-414665510 tempest-ServerBootFromVolumeStableRescueTest-414665510-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=74613) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 29 18:09:23 user nova-compute[74613]: DEBUG os_brick.initiator.linuxscsi [None req-4e35828a-e709-4fa5-9693-d67e33b1e0f6 tempest-ServerBootFromVolumeStableRescueTest-414665510 tempest-ServerBootFromVolumeStableRescueTest-414665510-project-member] SCSI volumes sdc have been removed. {{(pid=74613) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 29 18:09:23 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e35828a-e709-4fa5-9693-d67e33b1e0f6 tempest-ServerBootFromVolumeStableRescueTest-414665510 tempest-ServerBootFromVolumeStableRescueTest-414665510-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b9aad94d-fe0d-415d-9761-9aff25cc6099')] {{(pid=74613) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 29 18:09:23 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b9aad94d-fe0d-415d-9761-9aff25cc6099 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:09:23 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b9aad94d-fe0d-415d-9761-9aff25cc6099 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.028s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:09:23 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef1ccbda-ebce-498c-88fd-460858f46a2d]: (4, ('', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 18:09:23 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e35828a-e709-4fa5-9693-d67e33b1e0f6 tempest-ServerBootFromVolumeStableRescueTest-414665510 tempest-ServerBootFromVolumeStableRescueTest-414665510-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74613) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 18:09:23 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b9aad94d-fe0d-415d-9761-9aff25cc6099 -p 172.16.0.220:3260 --logout {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:09:23 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b9aad94d-fe0d-415d-9761-9aff25cc6099 -p 172.16.0.220:3260 --logout" returned: 0 in 0.058s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:09:23 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[0be47e60-c305-46a2-a3ce-e3502902cf0a]: (4, ('Logging out of session [sid: 29, target: iqn.2010-10.org.openstack:b9aad94d-fe0d-415d-9761-9aff25cc6099, portal: 172.16.0.220,3260]\nLogout of [sid: 29, target: iqn.2010-10.org.openstack:b9aad94d-fe0d-415d-9761-9aff25cc6099, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 18:09:23 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e35828a-e709-4fa5-9693-d67e33b1e0f6 tempest-ServerBootFromVolumeStableRescueTest-414665510 tempest-ServerBootFromVolumeStableRescueTest-414665510-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 29, target: iqn.2010-10.org.openstack:b9aad94d-fe0d-415d-9761-9aff25cc6099, portal: 172.16.0.220,3260]
Nov 29 18:09:23 user nova-compute[74613]: Logout of [sid: 29, target: iqn.2010-10.org.openstack:b9aad94d-fe0d-415d-9761-9aff25cc6099, portal: 172.16.0.220,3260] successful.
Nov 29 18:09:23 user nova-compute[74613]:  stderr= {{(pid=74613) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 18:09:23 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b9aad94d-fe0d-415d-9761-9aff25cc6099 -p 172.16.0.220:3260 --op delete {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:09:23 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b9aad94d-fe0d-415d-9761-9aff25cc6099 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.039s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:09:23 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[75c2c279-32a0-456c-8ff2-c34a18b64177]: (4, ('', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 18:09:23 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e35828a-e709-4fa5-9693-d67e33b1e0f6 tempest-ServerBootFromVolumeStableRescueTest-414665510 tempest-ServerBootFromVolumeStableRescueTest-414665510-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74613) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 18:09:23 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.base [None req-4e35828a-e709-4fa5-9693-d67e33b1e0f6 tempest-ServerBootFromVolumeStableRescueTest-414665510 tempest-ServerBootFromVolumeStableRescueTest-414665510-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.421s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 18:09:23 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e35828a-e709-4fa5-9693-d67e33b1e0f6 tempest-ServerBootFromVolumeStableRescueTest-414665510 tempest-ServerBootFromVolumeStableRescueTest-414665510-project-member] <== disconnect_volume: return (422ms) None {{(pid=74613) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 18:09:23 user nova-compute[74613]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4e35828a-e709-4fa5-9693-d67e33b1e0f6 tempest-ServerBootFromVolumeStableRescueTest-414665510 tempest-ServerBootFromVolumeStableRescueTest-414665510-project-member] [instance: d3c285cd-9f39-423c-a324-30a48a9c66be] Disconnected iSCSI Volume {{(pid=74613) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 29 18:09:23 user nova-compute[74613]: INFO nova.virt.libvirt.driver [None req-4e35828a-e709-4fa5-9693-d67e33b1e0f6 tempest-ServerBootFromVolumeStableRescueTest-414665510 tempest-ServerBootFromVolumeStableRescueTest-414665510-project-member] [instance: d3c285cd-9f39-423c-a324-30a48a9c66be] Deleting instance files /opt/stack/data/nova/instances/d3c285cd-9f39-423c-a324-30a48a9c66be_del
Nov 29 18:09:23 user nova-compute[74613]: INFO nova.virt.libvirt.driver [None req-4e35828a-e709-4fa5-9693-d67e33b1e0f6 tempest-ServerBootFromVolumeStableRescueTest-414665510 tempest-ServerBootFromVolumeStableRescueTest-414665510-project-member] [instance: d3c285cd-9f39-423c-a324-30a48a9c66be] Deletion of /opt/stack/data/nova/instances/d3c285cd-9f39-423c-a324-30a48a9c66be_del complete
Nov 29 18:09:23 user nova-compute[74613]: INFO nova.compute.manager [None req-4e35828a-e709-4fa5-9693-d67e33b1e0f6 tempest-ServerBootFromVolumeStableRescueTest-414665510 tempest-ServerBootFromVolumeStableRescueTest-414665510-project-member] [instance: d3c285cd-9f39-423c-a324-30a48a9c66be] Took 1.41 seconds to destroy the instance on the hypervisor.
Nov 29 18:09:23 user nova-compute[74613]: DEBUG oslo.service.loopingcall [None req-4e35828a-e709-4fa5-9693-d67e33b1e0f6 tempest-ServerBootFromVolumeStableRescueTest-414665510 tempest-ServerBootFromVolumeStableRescueTest-414665510-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74613) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 29 18:09:23 user nova-compute[74613]: DEBUG nova.compute.manager [-] [instance: d3c285cd-9f39-423c-a324-30a48a9c66be] Deallocating network for instance {{(pid=74613) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 29 18:09:23 user nova-compute[74613]: DEBUG nova.network.neutron [-] [instance: d3c285cd-9f39-423c-a324-30a48a9c66be] deallocate_for_instance() {{(pid=74613) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 29 18:09:24 user nova-compute[74613]: DEBUG nova.network.neutron [-] [instance: d3c285cd-9f39-423c-a324-30a48a9c66be] Updating instance_info_cache with network_info: [] {{(pid=74613) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 18:09:24 user nova-compute[74613]: INFO nova.compute.manager [-] [instance: d3c285cd-9f39-423c-a324-30a48a9c66be] Took 0.57 seconds to deallocate network for instance.
Nov 29 18:09:24 user nova-compute[74613]: DEBUG nova.compute.manager [req-4fa1c093-5093-41a0-b30c-9c29faac64d2 req-e2e107ee-6416-484e-b1ec-3a2579fc1442 service nova] [instance: d3c285cd-9f39-423c-a324-30a48a9c66be] Received event network-vif-plugged-663e4724-b31b-469d-a5ea-c2802db1e0c8 {{(pid=74613) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 18:09:24 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-4fa1c093-5093-41a0-b30c-9c29faac64d2 req-e2e107ee-6416-484e-b1ec-3a2579fc1442 service nova] Acquiring lock "d3c285cd-9f39-423c-a324-30a48a9c66be-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 18:09:24 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-4fa1c093-5093-41a0-b30c-9c29faac64d2 req-e2e107ee-6416-484e-b1ec-3a2579fc1442 service nova] Lock "d3c285cd-9f39-423c-a324-30a48a9c66be-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 18:09:24 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-4fa1c093-5093-41a0-b30c-9c29faac64d2 req-e2e107ee-6416-484e-b1ec-3a2579fc1442 service nova] Lock "d3c285cd-9f39-423c-a324-30a48a9c66be-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 18:09:24 user nova-compute[74613]: DEBUG nova.compute.manager [req-4fa1c093-5093-41a0-b30c-9c29faac64d2 req-e2e107ee-6416-484e-b1ec-3a2579fc1442 service nova] [instance: d3c285cd-9f39-423c-a324-30a48a9c66be] No waiting events found dispatching network-vif-plugged-663e4724-b31b-469d-a5ea-c2802db1e0c8 {{(pid=74613) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 18:09:24 user nova-compute[74613]: WARNING nova.compute.manager [req-4fa1c093-5093-41a0-b30c-9c29faac64d2 req-e2e107ee-6416-484e-b1ec-3a2579fc1442 service nova] [instance: d3c285cd-9f39-423c-a324-30a48a9c66be] Received unexpected event network-vif-plugged-663e4724-b31b-469d-a5ea-c2802db1e0c8 for instance with vm_state active and task_state deleting.
Nov 29 18:09:24 user nova-compute[74613]: DEBUG nova.compute.manager [req-4fa1c093-5093-41a0-b30c-9c29faac64d2 req-e2e107ee-6416-484e-b1ec-3a2579fc1442 service nova] [instance: d3c285cd-9f39-423c-a324-30a48a9c66be] Received event network-vif-deleted-663e4724-b31b-469d-a5ea-c2802db1e0c8 {{(pid=74613) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 18:09:25 user nova-compute[74613]: INFO nova.compute.manager [None req-4e35828a-e709-4fa5-9693-d67e33b1e0f6 tempest-ServerBootFromVolumeStableRescueTest-414665510 tempest-ServerBootFromVolumeStableRescueTest-414665510-project-member] [instance: d3c285cd-9f39-423c-a324-30a48a9c66be] Took 0.90 seconds to detach 1 volumes for instance.
Nov 29 18:09:25 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-4e35828a-e709-4fa5-9693-d67e33b1e0f6 tempest-ServerBootFromVolumeStableRescueTest-414665510 tempest-ServerBootFromVolumeStableRescueTest-414665510-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 18:09:25 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-4e35828a-e709-4fa5-9693-d67e33b1e0f6 tempest-ServerBootFromVolumeStableRescueTest-414665510 tempest-ServerBootFromVolumeStableRescueTest-414665510-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 18:09:25 user nova-compute[74613]: DEBUG nova.compute.provider_tree [None req-4e35828a-e709-4fa5-9693-d67e33b1e0f6 tempest-ServerBootFromVolumeStableRescueTest-414665510 tempest-ServerBootFromVolumeStableRescueTest-414665510-project-member] Inventory has not changed in ProviderTree for provider: 639d980e-3b12-44b1-b8f4-1812416fa4dd {{(pid=74613) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 18:09:25 user nova-compute[74613]: DEBUG nova.scheduler.client.report [None req-4e35828a-e709-4fa5-9693-d67e33b1e0f6 tempest-ServerBootFromVolumeStableRescueTest-414665510 tempest-ServerBootFromVolumeStableRescueTest-414665510-project-member] Inventory has not changed for provider 639d980e-3b12-44b1-b8f4-1812416fa4dd based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74613) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 18:09:25 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-4e35828a-e709-4fa5-9693-d67e33b1e0f6 tempest-ServerBootFromVolumeStableRescueTest-414665510 tempest-ServerBootFromVolumeStableRescueTest-414665510-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.473s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 18:09:25 user nova-compute[74613]: INFO nova.scheduler.client.report [None req-4e35828a-e709-4fa5-9693-d67e33b1e0f6 tempest-ServerBootFromVolumeStableRescueTest-414665510 tempest-ServerBootFromVolumeStableRescueTest-414665510-project-member] Deleted allocations for instance d3c285cd-9f39-423c-a324-30a48a9c66be
Nov 29 18:09:26 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-4e35828a-e709-4fa5-9693-d67e33b1e0f6 tempest-ServerBootFromVolumeStableRescueTest-414665510 tempest-ServerBootFromVolumeStableRescueTest-414665510-project-member] Lock "d3c285cd-9f39-423c-a324-30a48a9c66be" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.573s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 18:09:27 user nova-compute[74613]: DEBUG oslo_service.periodic_task [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74613) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 18:09:27 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 18:09:27 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 18:09:27 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 18:09:27 user nova-compute[74613]: DEBUG nova.compute.resource_tracker [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Auditing locally available compute resources for user (node: user) {{(pid=74613) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 29 18:09:27 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=74613) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 29 18:09:27 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/69109f06-acbf-4834-b05e-80ab6e3f6ea0/disk --force-share --output=json {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:09:27 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/69109f06-acbf-4834-b05e-80ab6e3f6ea0/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:09:27 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/69109f06-acbf-4834-b05e-80ab6e3f6ea0/disk --force-share --output=json {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:09:28 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/69109f06-acbf-4834-b05e-80ab6e3f6ea0/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:09:28 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] skipping disk /dev/sdf (vdb) as it is a volume {{(pid=74613) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 29 18:09:28 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9eb14feb-f196-42b1-a6ba-2a049dea2d5e/disk --force-share --output=json {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:09:28 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9eb14feb-f196-42b1-a6ba-2a049dea2d5e/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:09:28 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9eb14feb-f196-42b1-a6ba-2a049dea2d5e/disk --force-share --output=json {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:09:28 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:09:28 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9eb14feb-f196-42b1-a6ba-2a049dea2d5e/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:09:28 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bdb49266-ed09-4e9a-b3af-eb4b436a71da/disk --force-share --output=json {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:09:28 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bdb49266-ed09-4e9a-b3af-eb4b436a71da/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:09:28 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bdb49266-ed09-4e9a-b3af-eb4b436a71da/disk --force-share --output=json {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:09:28 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bdb49266-ed09-4e9a-b3af-eb4b436a71da/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:09:28 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f4a1329-b3b9-4d1c-8735-abddabc359fd/disk.rescue --force-share --output=json {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:09:29 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f4a1329-b3b9-4d1c-8735-abddabc359fd/disk.rescue --force-share --output=json" returned: 0 in 0.168s {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:09:29 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f4a1329-b3b9-4d1c-8735-abddabc359fd/disk.rescue --force-share --output=json {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:09:29 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f4a1329-b3b9-4d1c-8735-abddabc359fd/disk.rescue --force-share --output=json" returned: 0 in 0.173s {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:09:29 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f4a1329-b3b9-4d1c-8735-abddabc359fd/disk --force-share --output=json {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:09:29 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f4a1329-b3b9-4d1c-8735-abddabc359fd/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:09:29 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f4a1329-b3b9-4d1c-8735-abddabc359fd/disk --force-share --output=json {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:09:29 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f4a1329-b3b9-4d1c-8735-abddabc359fd/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:09:29 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3b828860-5cc5-40b0-b845-8e560211794e/disk --force-share --output=json {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:09:29 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3b828860-5cc5-40b0-b845-8e560211794e/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:09:29 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3b828860-5cc5-40b0-b845-8e560211794e/disk --force-share --output=json {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:09:30 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3b828860-5cc5-40b0-b845-8e560211794e/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:09:30 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/abc9e2b8-f467-4cd0-b40f-de511fde1ec1/disk --force-share --output=json {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:09:30 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/abc9e2b8-f467-4cd0-b40f-de511fde1ec1/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:09:30 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/abc9e2b8-f467-4cd0-b40f-de511fde1ec1/disk --force-share --output=json {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:09:30 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/abc9e2b8-f467-4cd0-b40f-de511fde1ec1/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:09:30 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6993e2e7-7e03-45b4-9d3d-3742589b6078/disk.rescue --force-share --output=json {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:09:30 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6993e2e7-7e03-45b4-9d3d-3742589b6078/disk.rescue --force-share --output=json" returned: 0 in 0.177s {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:09:30 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6993e2e7-7e03-45b4-9d3d-3742589b6078/disk.rescue --force-share --output=json {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:09:30 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:09:30 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6993e2e7-7e03-45b4-9d3d-3742589b6078/disk.rescue --force-share --output=json" returned: 0 in 0.175s {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:09:30 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6993e2e7-7e03-45b4-9d3d-3742589b6078/disk --force-share --output=json {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:09:30 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6993e2e7-7e03-45b4-9d3d-3742589b6078/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:09:30 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6993e2e7-7e03-45b4-9d3d-3742589b6078/disk --force-share --output=json {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:09:31 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6993e2e7-7e03-45b4-9d3d-3742589b6078/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:09:31 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74613) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 29 18:09:31 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8fc8496b-1435-4b5f-8977-6c0d7467ef65/disk --force-share --output=json {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:09:31 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8fc8496b-1435-4b5f-8977-6c0d7467ef65/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:09:31 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8fc8496b-1435-4b5f-8977-6c0d7467ef65/disk --force-share --output=json {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:09:31 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8fc8496b-1435-4b5f-8977-6c0d7467ef65/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:09:31 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/285d1e76-103b-47fa-9982-4f2d656ee57a/disk --force-share --output=json {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:09:31 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-8f7ed80a-7db0-4f25-8450-817c7a93d4b8 tempest-VolumesNegativeTest-1958586316 tempest-VolumesNegativeTest-1958586316-project-member] Acquiring lock "461df216-9911-4af0-98dc-5fa1a6b5c14b" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 18:09:31 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-8f7ed80a-7db0-4f25-8450-817c7a93d4b8 tempest-VolumesNegativeTest-1958586316 tempest-VolumesNegativeTest-1958586316-project-member] Lock "461df216-9911-4af0-98dc-5fa1a6b5c14b" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 18:09:31 user nova-compute[74613]: DEBUG nova.compute.manager [None req-8f7ed80a-7db0-4f25-8450-817c7a93d4b8 tempest-VolumesNegativeTest-1958586316 tempest-VolumesNegativeTest-1958586316-project-member] [instance: 461df216-9911-4af0-98dc-5fa1a6b5c14b] Starting instance... {{(pid=74613) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 29 18:09:31 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-8f7ed80a-7db0-4f25-8450-817c7a93d4b8 tempest-VolumesNegativeTest-1958586316 tempest-VolumesNegativeTest-1958586316-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 18:09:31 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-8f7ed80a-7db0-4f25-8450-817c7a93d4b8 tempest-VolumesNegativeTest-1958586316 tempest-VolumesNegativeTest-1958586316-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 18:09:31 user nova-compute[74613]: DEBUG nova.virt.hardware [None req-8f7ed80a-7db0-4f25-8450-817c7a93d4b8 tempest-VolumesNegativeTest-1958586316 tempest-VolumesNegativeTest-1958586316-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74613) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 29 18:09:31 user nova-compute[74613]: INFO nova.compute.claims [None req-8f7ed80a-7db0-4f25-8450-817c7a93d4b8 tempest-VolumesNegativeTest-1958586316 tempest-VolumesNegativeTest-1958586316-project-member] [instance: 461df216-9911-4af0-98dc-5fa1a6b5c14b] Claim successful on node user
Nov 29 18:09:31 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/285d1e76-103b-47fa-9982-4f2d656ee57a/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:09:31 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/285d1e76-103b-47fa-9982-4f2d656ee57a/disk --force-share --output=json {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:09:31 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/285d1e76-103b-47fa-9982-4f2d656ee57a/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:09:31 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e2439d62-4713-435d-81ce-fafe1d811b47/disk --force-share --output=json {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:09:32 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e2439d62-4713-435d-81ce-fafe1d811b47/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:09:32 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e2439d62-4713-435d-81ce-fafe1d811b47/disk --force-share --output=json {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:09:32 user nova-compute[74613]: DEBUG nova.compute.provider_tree [None req-8f7ed80a-7db0-4f25-8450-817c7a93d4b8 tempest-VolumesNegativeTest-1958586316 tempest-VolumesNegativeTest-1958586316-project-member] Inventory has not changed in ProviderTree for provider: 639d980e-3b12-44b1-b8f4-1812416fa4dd {{(pid=74613) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 18:09:32 user nova-compute[74613]: DEBUG nova.scheduler.client.report [None req-8f7ed80a-7db0-4f25-8450-817c7a93d4b8 tempest-VolumesNegativeTest-1958586316 tempest-VolumesNegativeTest-1958586316-project-member] Inventory has not changed for provider 639d980e-3b12-44b1-b8f4-1812416fa4dd based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74613) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 18:09:32 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-8f7ed80a-7db0-4f25-8450-817c7a93d4b8 tempest-VolumesNegativeTest-1958586316 tempest-VolumesNegativeTest-1958586316-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.559s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 18:09:32 user nova-compute[74613]: DEBUG nova.compute.manager [None req-8f7ed80a-7db0-4f25-8450-817c7a93d4b8 tempest-VolumesNegativeTest-1958586316 tempest-VolumesNegativeTest-1958586316-project-member] [instance: 461df216-9911-4af0-98dc-5fa1a6b5c14b] Start building networks asynchronously for instance. {{(pid=74613) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 29 18:09:32 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e2439d62-4713-435d-81ce-fafe1d811b47/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:09:32 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=74613) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 29 18:09:32 user nova-compute[74613]: DEBUG nova.compute.manager [None req-8f7ed80a-7db0-4f25-8450-817c7a93d4b8 tempest-VolumesNegativeTest-1958586316 tempest-VolumesNegativeTest-1958586316-project-member] [instance: 461df216-9911-4af0-98dc-5fa1a6b5c14b] Allocating IP information in the background. {{(pid=74613) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 29 18:09:32 user nova-compute[74613]: DEBUG nova.network.neutron [None req-8f7ed80a-7db0-4f25-8450-817c7a93d4b8 tempest-VolumesNegativeTest-1958586316 tempest-VolumesNegativeTest-1958586316-project-member] [instance: 461df216-9911-4af0-98dc-5fa1a6b5c14b] allocate_for_instance() {{(pid=74613) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 29 18:09:32 user nova-compute[74613]: WARNING nova.virt.libvirt.driver [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 18:09:32 user nova-compute[74613]: WARNING nova.virt.libvirt.driver [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 18:09:32 user nova-compute[74613]: DEBUG nova.compute.resource_tracker [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Hypervisor/Node resource view: name=user free_ram=7645MB free_disk=24.549434661865234GB free_vcpus=1 pci_devices=[{"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74613) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 29 18:09:32 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 18:09:32 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 18:09:32 user nova-compute[74613]: INFO nova.virt.libvirt.driver [None req-8f7ed80a-7db0-4f25-8450-817c7a93d4b8 tempest-VolumesNegativeTest-1958586316 tempest-VolumesNegativeTest-1958586316-project-member] [instance: 461df216-9911-4af0-98dc-5fa1a6b5c14b] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 29 18:09:32 user nova-compute[74613]: DEBUG nova.compute.manager [None req-8f7ed80a-7db0-4f25-8450-817c7a93d4b8 tempest-VolumesNegativeTest-1958586316 tempest-VolumesNegativeTest-1958586316-project-member] [instance: 461df216-9911-4af0-98dc-5fa1a6b5c14b] Start building block device mappings for instance. {{(pid=74613) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 29 18:09:32 user nova-compute[74613]: DEBUG nova.compute.manager [None req-8f7ed80a-7db0-4f25-8450-817c7a93d4b8 tempest-VolumesNegativeTest-1958586316 tempest-VolumesNegativeTest-1958586316-project-member] [instance: 461df216-9911-4af0-98dc-5fa1a6b5c14b] Start spawning the instance on the hypervisor. {{(pid=74613) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 29 18:09:32 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-8f7ed80a-7db0-4f25-8450-817c7a93d4b8 tempest-VolumesNegativeTest-1958586316 tempest-VolumesNegativeTest-1958586316-project-member] [instance: 461df216-9911-4af0-98dc-5fa1a6b5c14b] Creating instance directory {{(pid=74613) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 29 18:09:32 user nova-compute[74613]: INFO nova.virt.libvirt.driver [None req-8f7ed80a-7db0-4f25-8450-817c7a93d4b8 tempest-VolumesNegativeTest-1958586316 tempest-VolumesNegativeTest-1958586316-project-member] [instance: 461df216-9911-4af0-98dc-5fa1a6b5c14b] Creating image(s)
Nov 29 18:09:32 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-8f7ed80a-7db0-4f25-8450-817c7a93d4b8 tempest-VolumesNegativeTest-1958586316 tempest-VolumesNegativeTest-1958586316-project-member] Acquiring lock "/opt/stack/data/nova/instances/461df216-9911-4af0-98dc-5fa1a6b5c14b/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 18:09:32 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-8f7ed80a-7db0-4f25-8450-817c7a93d4b8 tempest-VolumesNegativeTest-1958586316 tempest-VolumesNegativeTest-1958586316-project-member] Lock "/opt/stack/data/nova/instances/461df216-9911-4af0-98dc-5fa1a6b5c14b/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 18:09:32 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-8f7ed80a-7db0-4f25-8450-817c7a93d4b8 tempest-VolumesNegativeTest-1958586316 tempest-VolumesNegativeTest-1958586316-project-member] Lock "/opt/stack/data/nova/instances/461df216-9911-4af0-98dc-5fa1a6b5c14b/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.006s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 18:09:32 user nova-compute[74613]: DEBUG nova.compute.resource_tracker [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Instance 3b828860-5cc5-40b0-b845-8e560211794e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74613) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 18:09:32 user nova-compute[74613]: DEBUG nova.compute.resource_tracker [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Instance abc9e2b8-f467-4cd0-b40f-de511fde1ec1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74613) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 18:09:32 user nova-compute[74613]: DEBUG nova.compute.resource_tracker [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Instance cd22685a-028c-4e0c-834d-e7b20f6d06ab actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74613) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 18:09:32 user nova-compute[74613]: DEBUG nova.compute.resource_tracker [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Instance 8fc8496b-1435-4b5f-8977-6c0d7467ef65 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74613) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 18:09:32 user nova-compute[74613]: DEBUG nova.compute.resource_tracker [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Instance 6993e2e7-7e03-45b4-9d3d-3742589b6078 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74613) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 18:09:32 user nova-compute[74613]: DEBUG nova.compute.resource_tracker [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Instance 6f4a1329-b3b9-4d1c-8735-abddabc359fd actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74613) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 18:09:32 user nova-compute[74613]: DEBUG nova.compute.resource_tracker [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Instance e9acfa30-4ec2-4540-ac34-4c66db3228e1 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=74613) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 18:09:32 user nova-compute[74613]: DEBUG nova.compute.resource_tracker [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Instance 9eb14feb-f196-42b1-a6ba-2a049dea2d5e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74613) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 18:09:32 user nova-compute[74613]: DEBUG nova.compute.resource_tracker [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Instance 69109f06-acbf-4834-b05e-80ab6e3f6ea0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74613) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 18:09:32 user nova-compute[74613]: DEBUG nova.compute.resource_tracker [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Instance e2439d62-4713-435d-81ce-fafe1d811b47 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74613) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 18:09:32 user nova-compute[74613]: DEBUG nova.compute.resource_tracker [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Instance bdb49266-ed09-4e9a-b3af-eb4b436a71da actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74613) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 18:09:32 user nova-compute[74613]: DEBUG nova.compute.resource_tracker [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Instance 285d1e76-103b-47fa-9982-4f2d656ee57a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74613) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 18:09:32 user nova-compute[74613]: DEBUG nova.compute.resource_tracker [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Instance 461df216-9911-4af0-98dc-5fa1a6b5c14b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74613) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 18:09:32 user nova-compute[74613]: DEBUG nova.compute.resource_tracker [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Total usable vcpus: 12, total allocated vcpus: 13 {{(pid=74613) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 29 18:09:32 user nova-compute[74613]: DEBUG nova.compute.resource_tracker [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Final resource view: name=user phys_ram=16011MB used_ram=8704MB phys_disk=40GB used_disk=11GB total_vcpus=12 used_vcpus=13 pci_stats=[] {{(pid=74613) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 29 18:09:32 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-8f7ed80a-7db0-4f25-8450-817c7a93d4b8 tempest-VolumesNegativeTest-1958586316 tempest-VolumesNegativeTest-1958586316-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/21faea9e6951f3bdd0153b76ac89fe1a60a34758 --force-share --output=json {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:09:33 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-8f7ed80a-7db0-4f25-8450-817c7a93d4b8 tempest-VolumesNegativeTest-1958586316 tempest-VolumesNegativeTest-1958586316-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/21faea9e6951f3bdd0153b76ac89fe1a60a34758 --force-share --output=json" returned: 0 in 0.179s {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:09:33 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-8f7ed80a-7db0-4f25-8450-817c7a93d4b8 tempest-VolumesNegativeTest-1958586316 tempest-VolumesNegativeTest-1958586316-project-member] Acquiring lock "21faea9e6951f3bdd0153b76ac89fe1a60a34758" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 18:09:33 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-8f7ed80a-7db0-4f25-8450-817c7a93d4b8 tempest-VolumesNegativeTest-1958586316 tempest-VolumesNegativeTest-1958586316-project-member] Lock "21faea9e6951f3bdd0153b76ac89fe1a60a34758" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 18:09:33 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-8f7ed80a-7db0-4f25-8450-817c7a93d4b8 tempest-VolumesNegativeTest-1958586316 tempest-VolumesNegativeTest-1958586316-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/21faea9e6951f3bdd0153b76ac89fe1a60a34758 --force-share --output=json {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:09:33 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-8f7ed80a-7db0-4f25-8450-817c7a93d4b8 tempest-VolumesNegativeTest-1958586316 tempest-VolumesNegativeTest-1958586316-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/21faea9e6951f3bdd0153b76ac89fe1a60a34758 --force-share --output=json" returned: 0 in 0.181s {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:09:33 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-8f7ed80a-7db0-4f25-8450-817c7a93d4b8 tempest-VolumesNegativeTest-1958586316 tempest-VolumesNegativeTest-1958586316-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/21faea9e6951f3bdd0153b76ac89fe1a60a34758,backing_fmt=raw /opt/stack/data/nova/instances/461df216-9911-4af0-98dc-5fa1a6b5c14b/disk 1073741824 {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:09:33 user nova-compute[74613]: DEBUG nova.policy [None req-8f7ed80a-7db0-4f25-8450-817c7a93d4b8 tempest-VolumesNegativeTest-1958586316 tempest-VolumesNegativeTest-1958586316-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'fa9231cab6ff4bbcb4c06e4cc4da907a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92f9bb68afc04038bb230fc036546e4a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74613) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 29 18:09:33 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-8f7ed80a-7db0-4f25-8450-817c7a93d4b8 tempest-VolumesNegativeTest-1958586316 tempest-VolumesNegativeTest-1958586316-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/21faea9e6951f3bdd0153b76ac89fe1a60a34758,backing_fmt=raw /opt/stack/data/nova/instances/461df216-9911-4af0-98dc-5fa1a6b5c14b/disk 1073741824" returned: 0 in 0.065s {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:09:33 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-8f7ed80a-7db0-4f25-8450-817c7a93d4b8 tempest-VolumesNegativeTest-1958586316 tempest-VolumesNegativeTest-1958586316-project-member] Lock "21faea9e6951f3bdd0153b76ac89fe1a60a34758" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.252s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 18:09:33 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-8f7ed80a-7db0-4f25-8450-817c7a93d4b8 tempest-VolumesNegativeTest-1958586316 tempest-VolumesNegativeTest-1958586316-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/21faea9e6951f3bdd0153b76ac89fe1a60a34758 --force-share --output=json {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:09:33 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-fd56056a-5932-4a3e-86b3-cd6b9050553e tempest-ServerActionsTestOtherA-1784608629 tempest-ServerActionsTestOtherA-1784608629-project-member] Acquiring lock "e9acfa30-4ec2-4540-ac34-4c66db3228e1" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 18:09:33 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-fd56056a-5932-4a3e-86b3-cd6b9050553e tempest-ServerActionsTestOtherA-1784608629 tempest-ServerActionsTestOtherA-1784608629-project-member] Lock "e9acfa30-4ec2-4540-ac34-4c66db3228e1" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.002s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 18:09:33 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-fd56056a-5932-4a3e-86b3-cd6b9050553e tempest-ServerActionsTestOtherA-1784608629 tempest-ServerActionsTestOtherA-1784608629-project-member] Acquiring lock "e9acfa30-4ec2-4540-ac34-4c66db3228e1-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 18:09:33 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-fd56056a-5932-4a3e-86b3-cd6b9050553e tempest-ServerActionsTestOtherA-1784608629 tempest-ServerActionsTestOtherA-1784608629-project-member] Lock "e9acfa30-4ec2-4540-ac34-4c66db3228e1-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 18:09:33 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-fd56056a-5932-4a3e-86b3-cd6b9050553e tempest-ServerActionsTestOtherA-1784608629 tempest-ServerActionsTestOtherA-1784608629-project-member] Lock "e9acfa30-4ec2-4540-ac34-4c66db3228e1-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 18:09:33 user nova-compute[74613]: INFO nova.compute.manager [None req-fd56056a-5932-4a3e-86b3-cd6b9050553e tempest-ServerActionsTestOtherA-1784608629 tempest-ServerActionsTestOtherA-1784608629-project-member] [instance: e9acfa30-4ec2-4540-ac34-4c66db3228e1] Terminating instance
Nov 29 18:09:33 user nova-compute[74613]: DEBUG nova.compute.manager [None req-fd56056a-5932-4a3e-86b3-cd6b9050553e tempest-ServerActionsTestOtherA-1784608629 tempest-ServerActionsTestOtherA-1784608629-project-member] [instance: e9acfa30-4ec2-4540-ac34-4c66db3228e1] Start destroying the instance on the hypervisor. {{(pid=74613) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 29 18:09:33 user nova-compute[74613]: DEBUG nova.compute.provider_tree [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Inventory has not changed in ProviderTree for provider: 639d980e-3b12-44b1-b8f4-1812416fa4dd {{(pid=74613) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 18:09:33 user nova-compute[74613]: DEBUG nova.scheduler.client.report [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Inventory has not changed for provider 639d980e-3b12-44b1-b8f4-1812416fa4dd based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74613) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 18:09:33 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:09:33 user nova-compute[74613]: DEBUG nova.compute.resource_tracker [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Compute_service record updated for user:user {{(pid=74613) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 29 18:09:33 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.734s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 18:09:33 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:09:33 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:09:33 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-8f7ed80a-7db0-4f25-8450-817c7a93d4b8 tempest-VolumesNegativeTest-1958586316 tempest-VolumesNegativeTest-1958586316-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/21faea9e6951f3bdd0153b76ac89fe1a60a34758 --force-share --output=json" returned: 0 in 0.199s {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:09:33 user nova-compute[74613]: DEBUG nova.virt.disk.api [None req-8f7ed80a-7db0-4f25-8450-817c7a93d4b8 tempest-VolumesNegativeTest-1958586316 tempest-VolumesNegativeTest-1958586316-project-member] Checking if we can resize image /opt/stack/data/nova/instances/461df216-9911-4af0-98dc-5fa1a6b5c14b/disk. size=1073741824 {{(pid=74613) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 29 18:09:33 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-8f7ed80a-7db0-4f25-8450-817c7a93d4b8 tempest-VolumesNegativeTest-1958586316 tempest-VolumesNegativeTest-1958586316-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/461df216-9911-4af0-98dc-5fa1a6b5c14b/disk --force-share --output=json {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:09:33 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-8f7ed80a-7db0-4f25-8450-817c7a93d4b8 tempest-VolumesNegativeTest-1958586316 tempest-VolumesNegativeTest-1958586316-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/461df216-9911-4af0-98dc-5fa1a6b5c14b/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:09:33 user nova-compute[74613]: DEBUG nova.virt.disk.api [None req-8f7ed80a-7db0-4f25-8450-817c7a93d4b8 tempest-VolumesNegativeTest-1958586316 tempest-VolumesNegativeTest-1958586316-project-member] Cannot resize image /opt/stack/data/nova/instances/461df216-9911-4af0-98dc-5fa1a6b5c14b/disk to a smaller size. {{(pid=74613) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 29 18:09:33 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-8f7ed80a-7db0-4f25-8450-817c7a93d4b8 tempest-VolumesNegativeTest-1958586316 tempest-VolumesNegativeTest-1958586316-project-member] [instance: 461df216-9911-4af0-98dc-5fa1a6b5c14b] Created local disks {{(pid=74613) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 29 18:09:33 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-8f7ed80a-7db0-4f25-8450-817c7a93d4b8 tempest-VolumesNegativeTest-1958586316 tempest-VolumesNegativeTest-1958586316-project-member] [instance: 461df216-9911-4af0-98dc-5fa1a6b5c14b] Ensure instance console log exists: /opt/stack/data/nova/instances/461df216-9911-4af0-98dc-5fa1a6b5c14b/console.log {{(pid=74613) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 29 18:09:33 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-8f7ed80a-7db0-4f25-8450-817c7a93d4b8 tempest-VolumesNegativeTest-1958586316 tempest-VolumesNegativeTest-1958586316-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 18:09:33 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-8f7ed80a-7db0-4f25-8450-817c7a93d4b8 tempest-VolumesNegativeTest-1958586316 tempest-VolumesNegativeTest-1958586316-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 18:09:33 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-8f7ed80a-7db0-4f25-8450-817c7a93d4b8 tempest-VolumesNegativeTest-1958586316 tempest-VolumesNegativeTest-1958586316-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 18:09:33 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:09:33 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:09:33 user nova-compute[74613]: DEBUG nova.compute.manager [req-9648adc1-910e-448a-b553-bb8245e9e8f6 req-9dd186b5-1046-45b2-bb37-f800cc2bb7b7 service nova] [instance: e9acfa30-4ec2-4540-ac34-4c66db3228e1] Received event network-vif-unplugged-8cd31427-1812-40fb-8018-d8f24a5b1792 {{(pid=74613) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 18:09:33 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-9648adc1-910e-448a-b553-bb8245e9e8f6 req-9dd186b5-1046-45b2-bb37-f800cc2bb7b7 service nova] Acquiring lock "e9acfa30-4ec2-4540-ac34-4c66db3228e1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 18:09:33 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-9648adc1-910e-448a-b553-bb8245e9e8f6 req-9dd186b5-1046-45b2-bb37-f800cc2bb7b7 service nova] Lock "e9acfa30-4ec2-4540-ac34-4c66db3228e1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 18:09:33 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-9648adc1-910e-448a-b553-bb8245e9e8f6 req-9dd186b5-1046-45b2-bb37-f800cc2bb7b7 service nova] Lock "e9acfa30-4ec2-4540-ac34-4c66db3228e1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 18:09:33 user nova-compute[74613]: DEBUG nova.compute.manager [req-9648adc1-910e-448a-b553-bb8245e9e8f6 req-9dd186b5-1046-45b2-bb37-f800cc2bb7b7 service nova] [instance: e9acfa30-4ec2-4540-ac34-4c66db3228e1] No waiting events found dispatching network-vif-unplugged-8cd31427-1812-40fb-8018-d8f24a5b1792 {{(pid=74613) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 18:09:33 user nova-compute[74613]: DEBUG nova.compute.manager [req-9648adc1-910e-448a-b553-bb8245e9e8f6 req-9dd186b5-1046-45b2-bb37-f800cc2bb7b7 service nova] [instance: e9acfa30-4ec2-4540-ac34-4c66db3228e1] Received event network-vif-unplugged-8cd31427-1812-40fb-8018-d8f24a5b1792 for instance with task_state deleting. {{(pid=74613) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 29 18:09:34 user nova-compute[74613]: INFO nova.virt.libvirt.driver [-] [instance: e9acfa30-4ec2-4540-ac34-4c66db3228e1] Instance destroyed successfully.
Nov 29 18:09:34 user nova-compute[74613]: DEBUG nova.objects.instance [None req-fd56056a-5932-4a3e-86b3-cd6b9050553e tempest-ServerActionsTestOtherA-1784608629 tempest-ServerActionsTestOtherA-1784608629-project-member] Lazy-loading 'resources' on Instance uuid e9acfa30-4ec2-4540-ac34-4c66db3228e1 {{(pid=74613) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 18:09:34 user nova-compute[74613]: DEBUG nova.virt.libvirt.vif [None req-fd56056a-5932-4a3e-86b3-cd6b9050553e tempest-ServerActionsTestOtherA-1784608629 tempest-ServerActionsTestOtherA-1784608629-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T18:02:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1745064093',display_name='tempest-ServerActionsTestOtherA-server-1745064093',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-1745064093',id=25,image_ref='',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIpucl9TdiuMtgo2HD8A0S0XK6/wskQQSBMcoxjyazAtLZUlGJCbAbNEhyc7Esm1yWePtzGTrNFIbg4z5HCtj+7HLtHc8+57P9i9m4iI8l/z1ZnWm+BWBA3bkBkjzP6q3Q==',key_name='tempest-keypair-1839431126',keypairs=<?>,launch_index=0,launched_at=2023-11-29T18:05:09Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='b1f70c311d4941c986de21ac458d11ab',ramdisk_id='',reservation_id='r-cod9xl0z',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-1784608629',owner_user_name='tempest-ServerActionsTestOtherA-1784608629-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-29T18:06:43Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='368555c72103480b82c5c0bf64b07360',uuid=e9acfa30-4ec2-4540-ac34-4c66db3228e1,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "8cd31427-1812-40fb-8018-d8f24a5b1792", "address": "fa:16:3e:97:0e:ed", "network": {"id": "7c2c368e-4c7d-4d70-9a40-c10fe9541af9", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1287934102-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.103", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b1f70c311d4941c986de21ac458d11ab", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8cd31427-18", "ovs_interfaceid": "8cd31427-1812-40fb-8018-d8f24a5b1792", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74613) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 29 18:09:34 user nova-compute[74613]: DEBUG nova.network.os_vif_util [None req-fd56056a-5932-4a3e-86b3-cd6b9050553e tempest-ServerActionsTestOtherA-1784608629 tempest-ServerActionsTestOtherA-1784608629-project-member] Converting VIF {"id": "8cd31427-1812-40fb-8018-d8f24a5b1792", "address": "fa:16:3e:97:0e:ed", "network": {"id": "7c2c368e-4c7d-4d70-9a40-c10fe9541af9", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1287934102-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.103", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b1f70c311d4941c986de21ac458d11ab", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8cd31427-18", "ovs_interfaceid": "8cd31427-1812-40fb-8018-d8f24a5b1792", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74613) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 18:09:34 user nova-compute[74613]: DEBUG nova.network.os_vif_util [None req-fd56056a-5932-4a3e-86b3-cd6b9050553e tempest-ServerActionsTestOtherA-1784608629 tempest-ServerActionsTestOtherA-1784608629-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:97:0e:ed,bridge_name='br-int',has_traffic_filtering=True,id=8cd31427-1812-40fb-8018-d8f24a5b1792,network=Network(7c2c368e-4c7d-4d70-9a40-c10fe9541af9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8cd31427-18') {{(pid=74613) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 18:09:34 user nova-compute[74613]: DEBUG os_vif [None req-fd56056a-5932-4a3e-86b3-cd6b9050553e tempest-ServerActionsTestOtherA-1784608629 tempest-ServerActionsTestOtherA-1784608629-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:97:0e:ed,bridge_name='br-int',has_traffic_filtering=True,id=8cd31427-1812-40fb-8018-d8f24a5b1792,network=Network(7c2c368e-4c7d-4d70-9a40-c10fe9541af9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8cd31427-18') {{(pid=74613) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 29 18:09:34 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:09:34 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap8cd31427-18, bridge=br-int, if_exists=True) {{(pid=74613) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 18:09:34 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:09:34 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 18:09:34 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:09:34 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:09:34 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=e510c42b-1704-4b53-8b07-1b81982c57d9) {{(pid=74613) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 18:09:34 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:09:34 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 18:09:34 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:09:34 user nova-compute[74613]: INFO os_vif [None req-fd56056a-5932-4a3e-86b3-cd6b9050553e tempest-ServerActionsTestOtherA-1784608629 tempest-ServerActionsTestOtherA-1784608629-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:97:0e:ed,bridge_name='br-int',has_traffic_filtering=True,id=8cd31427-1812-40fb-8018-d8f24a5b1792,network=Network(7c2c368e-4c7d-4d70-9a40-c10fe9541af9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8cd31427-18')
Nov 29 18:09:34 user nova-compute[74613]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fd56056a-5932-4a3e-86b3-cd6b9050553e tempest-ServerActionsTestOtherA-1784608629 tempest-ServerActionsTestOtherA-1784608629-project-member] [instance: e9acfa30-4ec2-4540-ac34-4c66db3228e1] calling os-brick to detach iSCSI Volume {{(pid=74613) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 29 18:09:34 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd56056a-5932-4a3e-86b3-cd6b9050553e tempest-ServerActionsTestOtherA-1784608629 tempest-ServerActionsTestOtherA-1784608629-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff828156890>, {'target_iqn': 'iqn.2010-10.org.openstack:a8c53a27-dcde-402b-a9bb-d8642f7db0da', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'SLOlKdrc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': True}}" {{(pid=74613) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 18:09:34 user nova-compute[74613]: WARNING os_brick.initiator.connectors.base [None req-fd56056a-5932-4a3e-86b3-cd6b9050553e tempest-ServerActionsTestOtherA-1784608629 tempest-ServerActionsTestOtherA-1784608629-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 18:09:34 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.base [None req-fd56056a-5932-4a3e-86b3-cd6b9050553e tempest-ServerActionsTestOtherA-1784608629 tempest-ServerActionsTestOtherA-1784608629-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 18:09:34 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.base [None req-fd56056a-5932-4a3e-86b3-cd6b9050553e tempest-ServerActionsTestOtherA-1784608629 tempest-ServerActionsTestOtherA-1784608629-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 18:09:34 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:09:34 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:09:34 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd999f55-acde-4d5a-b961-21574a6aa2d4]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:9511387c-8772-40f2-bf2d-6b6387649e9f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:34908494-9a6c-4c8c-b447-9768745356ca\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b2879f1d-797c-4701-8803-eb6369ddb534\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a8c53a27-dcde-402b-a9bb-d8642f7db0da\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 18:09:34 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd56056a-5932-4a3e-86b3-cd6b9050553e tempest-ServerActionsTestOtherA-1784608629 tempest-ServerActionsTestOtherA-1784608629-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 29 18:09:34 user nova-compute[74613]: No targets found.
Nov 29 18:09:34 user nova-compute[74613]: iSNS:
Nov 29 18:09:34 user nova-compute[74613]: No targets found.
Nov 29 18:09:34 user nova-compute[74613]: STATIC:
Nov 29 18:09:34 user nova-compute[74613]: Target: iqn.2010-10.org.openstack:9511387c-8772-40f2-bf2d-6b6387649e9f
Nov 29 18:09:34 user nova-compute[74613]:         Portal: 172.16.0.220:3260,-1
Nov 29 18:09:34 user nova-compute[74613]:                 Iface Name: default
Nov 29 18:09:34 user nova-compute[74613]: Target: iqn.2010-10.org.openstack:34908494-9a6c-4c8c-b447-9768745356ca
Nov 29 18:09:34 user nova-compute[74613]:         Portal: 172.16.0.220:3260,-1
Nov 29 18:09:34 user nova-compute[74613]:                 Iface Name: default
Nov 29 18:09:34 user nova-compute[74613]: Target: iqn.2010-10.org.openstack:b2879f1d-797c-4701-8803-eb6369ddb534
Nov 29 18:09:34 user nova-compute[74613]:         Portal: 172.16.0.220:3260,-1
Nov 29 18:09:34 user nova-compute[74613]:                 Iface Name: default
Nov 29 18:09:34 user nova-compute[74613]: Target: iqn.2010-10.org.openstack:a8c53a27-dcde-402b-a9bb-d8642f7db0da
Nov 29 18:09:34 user nova-compute[74613]:         Portal: 172.16.0.220:3260,-1
Nov 29 18:09:34 user nova-compute[74613]:                 Iface Name: default
Nov 29 18:09:34 user nova-compute[74613]: FIRMWARE:
Nov 29 18:09:34 user nova-compute[74613]: No targets found.
Nov 29 18:09:34 user nova-compute[74613]:  stderr= {{(pid=74613) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 18:09:34 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd56056a-5932-4a3e-86b3-cd6b9050553e tempest-ServerActionsTestOtherA-1784608629 tempest-ServerActionsTestOtherA-1784608629-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 29 18:09:34 user nova-compute[74613]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 29 18:09:34 user nova-compute[74613]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74613) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 29 18:09:34 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd56056a-5932-4a3e-86b3-cd6b9050553e tempest-ServerActionsTestOtherA-1784608629 tempest-ServerActionsTestOtherA-1784608629-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a8c53a27-dcde-402b-a9bb-d8642f7db0da', 0)] {{(pid=74613) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 29 18:09:34 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:09:34 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:09:34 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[e891c48d-4d0d-4d31-9105-c4b3b52f7809]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:34908494-9a6c-4c8c-b447-9768745356ca\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9511387c-8772-40f2-bf2d-6b6387649e9f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a8c53a27-dcde-402b-a9bb-d8642f7db0da\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b2879f1d-797c-4701-8803-eb6369ddb534\n', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 18:09:34 user nova-compute[74613]: DEBUG nova.network.neutron [None req-8f7ed80a-7db0-4f25-8450-817c7a93d4b8 tempest-VolumesNegativeTest-1958586316 tempest-VolumesNegativeTest-1958586316-project-member] [instance: 461df216-9911-4af0-98dc-5fa1a6b5c14b] Successfully created port: aadb2d92-266c-47cb-9ef1-74edb0e4522c {{(pid=74613) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 29 18:09:34 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:09:34 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:09:34 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ff83ccf-58c8-40e9-b280-f298f9673d48]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9511387c-8772-40f2-bf2d-6b6387649e9f (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8c53a27-dcde-402b-a9bb-d8642f7db0da (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:34908494-9a6c-4c8c-b447-9768745356ca (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2879f1d-797c-4701-8803-eb6369ddb534 (non-flash)\n', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 18:09:34 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd56056a-5932-4a3e-86b3-cd6b9050553e tempest-ServerActionsTestOtherA-1784608629 tempest-ServerActionsTestOtherA-1784608629-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9511387c-8772-40f2-bf2d-6b6387649e9f (non-flash)
Nov 29 18:09:34 user nova-compute[74613]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8c53a27-dcde-402b-a9bb-d8642f7db0da (non-flash)
Nov 29 18:09:34 user nova-compute[74613]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:34908494-9a6c-4c8c-b447-9768745356ca (non-flash)
Nov 29 18:09:34 user nova-compute[74613]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2879f1d-797c-4701-8803-eb6369ddb534 (non-flash)
Nov 29 18:09:34 user nova-compute[74613]:  stderr= {{(pid=74613) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 18:09:34 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd56056a-5932-4a3e-86b3-cd6b9050553e tempest-ServerActionsTestOtherA-1784608629 tempest-ServerActionsTestOtherA-1784608629-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9511387c-8772-40f2-bf2d-6b6387649e9f (non-flash)
Nov 29 18:09:34 user nova-compute[74613]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8c53a27-dcde-402b-a9bb-d8642f7db0da (non-flash)
Nov 29 18:09:34 user nova-compute[74613]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:34908494-9a6c-4c8c-b447-9768745356ca (non-flash)
Nov 29 18:09:34 user nova-compute[74613]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2879f1d-797c-4701-8803-eb6369ddb534 (non-flash)
Nov 29 18:09:34 user nova-compute[74613]:  stderr= {{(pid=74613) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 18:09:34 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd56056a-5932-4a3e-86b3-cd6b9050553e tempest-ServerActionsTestOtherA-1784608629 tempest-ServerActionsTestOtherA-1784608629-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7ff828531d80>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a8c53a27-dcde-402b-a9bb-d8642f7db0da'): ({'sde'}, set())}) {{(pid=74613) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 29 18:09:34 user nova-compute[74613]: DEBUG os_brick.initiator.linuxscsi [None req-fd56056a-5932-4a3e-86b3-cd6b9050553e tempest-ServerActionsTestOtherA-1784608629 tempest-ServerActionsTestOtherA-1784608629-project-member] Removing single pathed devices sde {{(pid=74613) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 29 18:09:34 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:09:34 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:09:34 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[42c454ec-d266-4379-8fc3-69ad6c32840e]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 18:09:34 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:09:34 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.018s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:09:34 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[907b2f0f-d609-4cb5-8f91-07b57061e437]: (4, ('ok\n', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 18:09:34 user nova-compute[74613]: DEBUG os_brick.initiator.linuxscsi [None req-fd56056a-5932-4a3e-86b3-cd6b9050553e tempest-ServerActionsTestOtherA-1784608629 tempest-ServerActionsTestOtherA-1784608629-project-member] Flushing IO for device /dev/sde {{(pid=74613) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 29 18:09:34 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:09:34 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.014s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:09:34 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[69d6c183-6f57-4a97-985d-92e2e26e3828]: (4, ('', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 18:09:34 user nova-compute[74613]: DEBUG os_brick.initiator.linuxscsi [None req-fd56056a-5932-4a3e-86b3-cd6b9050553e tempest-ServerActionsTestOtherA-1784608629 tempest-ServerActionsTestOtherA-1784608629-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=74613) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 29 18:09:34 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:09:34 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.050s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:09:34 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[749665e6-740d-4dc7-b83f-9ff15306b833]: (4, ('1', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 18:09:34 user nova-compute[74613]: DEBUG os_brick.initiator.linuxscsi [None req-fd56056a-5932-4a3e-86b3-cd6b9050553e tempest-ServerActionsTestOtherA-1784608629 tempest-ServerActionsTestOtherA-1784608629-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=74613) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 29 18:09:34 user nova-compute[74613]: DEBUG os_brick.initiator.linuxscsi [None req-fd56056a-5932-4a3e-86b3-cd6b9050553e tempest-ServerActionsTestOtherA-1784608629 tempest-ServerActionsTestOtherA-1784608629-project-member] SCSI volumes sde have been removed. {{(pid=74613) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 29 18:09:34 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd56056a-5932-4a3e-86b3-cd6b9050553e tempest-ServerActionsTestOtherA-1784608629 tempest-ServerActionsTestOtherA-1784608629-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a8c53a27-dcde-402b-a9bb-d8642f7db0da')] {{(pid=74613) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 29 18:09:34 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a8c53a27-dcde-402b-a9bb-d8642f7db0da -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:09:34 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a8c53a27-dcde-402b-a9bb-d8642f7db0da -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:09:34 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[09cb32de-e3de-4d50-9e16-5da0e8e77d3a]: (4, ('', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 18:09:34 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd56056a-5932-4a3e-86b3-cd6b9050553e tempest-ServerActionsTestOtherA-1784608629 tempest-ServerActionsTestOtherA-1784608629-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74613) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 18:09:34 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a8c53a27-dcde-402b-a9bb-d8642f7db0da -p 172.16.0.220:3260 --logout {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:09:34 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a8c53a27-dcde-402b-a9bb-d8642f7db0da -p 172.16.0.220:3260 --logout" returned: 0 in 0.057s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:09:34 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb323dc2-7ca1-4ebf-a27d-ca1243356c1a]: (4, ('Logging out of session [sid: 33, target: iqn.2010-10.org.openstack:a8c53a27-dcde-402b-a9bb-d8642f7db0da, portal: 172.16.0.220,3260]\nLogout of [sid: 33, target: iqn.2010-10.org.openstack:a8c53a27-dcde-402b-a9bb-d8642f7db0da, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 18:09:34 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd56056a-5932-4a3e-86b3-cd6b9050553e tempest-ServerActionsTestOtherA-1784608629 tempest-ServerActionsTestOtherA-1784608629-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 33, target: iqn.2010-10.org.openstack:a8c53a27-dcde-402b-a9bb-d8642f7db0da, portal: 172.16.0.220,3260]
Nov 29 18:09:34 user nova-compute[74613]: Logout of [sid: 33, target: iqn.2010-10.org.openstack:a8c53a27-dcde-402b-a9bb-d8642f7db0da, portal: 172.16.0.220,3260] successful.
Nov 29 18:09:34 user nova-compute[74613]:  stderr= {{(pid=74613) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 18:09:34 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a8c53a27-dcde-402b-a9bb-d8642f7db0da -p 172.16.0.220:3260 --op delete {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:09:34 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a8c53a27-dcde-402b-a9bb-d8642f7db0da -p 172.16.0.220:3260 --op delete" returned: 0 in 0.025s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:09:34 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[c84e66dd-99cf-446d-afbf-859407bcf672]: (4, ('', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 18:09:34 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd56056a-5932-4a3e-86b3-cd6b9050553e tempest-ServerActionsTestOtherA-1784608629 tempest-ServerActionsTestOtherA-1784608629-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74613) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 18:09:34 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.base [None req-fd56056a-5932-4a3e-86b3-cd6b9050553e tempest-ServerActionsTestOtherA-1784608629 tempest-ServerActionsTestOtherA-1784608629-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.322s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 18:09:34 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd56056a-5932-4a3e-86b3-cd6b9050553e tempest-ServerActionsTestOtherA-1784608629 tempest-ServerActionsTestOtherA-1784608629-project-member] <== disconnect_volume: return (324ms) None {{(pid=74613) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 18:09:34 user nova-compute[74613]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fd56056a-5932-4a3e-86b3-cd6b9050553e tempest-ServerActionsTestOtherA-1784608629 tempest-ServerActionsTestOtherA-1784608629-project-member] [instance: e9acfa30-4ec2-4540-ac34-4c66db3228e1] Disconnected iSCSI Volume {{(pid=74613) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 29 18:09:34 user nova-compute[74613]: INFO nova.virt.libvirt.driver [None req-fd56056a-5932-4a3e-86b3-cd6b9050553e tempest-ServerActionsTestOtherA-1784608629 tempest-ServerActionsTestOtherA-1784608629-project-member] [instance: e9acfa30-4ec2-4540-ac34-4c66db3228e1] Deleting instance files /opt/stack/data/nova/instances/e9acfa30-4ec2-4540-ac34-4c66db3228e1_del
Nov 29 18:09:34 user nova-compute[74613]: INFO nova.virt.libvirt.driver [None req-fd56056a-5932-4a3e-86b3-cd6b9050553e tempest-ServerActionsTestOtherA-1784608629 tempest-ServerActionsTestOtherA-1784608629-project-member] [instance: e9acfa30-4ec2-4540-ac34-4c66db3228e1] Deletion of /opt/stack/data/nova/instances/e9acfa30-4ec2-4540-ac34-4c66db3228e1_del complete
Nov 29 18:09:34 user nova-compute[74613]: INFO nova.compute.manager [None req-fd56056a-5932-4a3e-86b3-cd6b9050553e tempest-ServerActionsTestOtherA-1784608629 tempest-ServerActionsTestOtherA-1784608629-project-member] [instance: e9acfa30-4ec2-4540-ac34-4c66db3228e1] Took 1.22 seconds to destroy the instance on the hypervisor.
Nov 29 18:09:34 user nova-compute[74613]: DEBUG oslo.service.loopingcall [None req-fd56056a-5932-4a3e-86b3-cd6b9050553e tempest-ServerActionsTestOtherA-1784608629 tempest-ServerActionsTestOtherA-1784608629-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74613) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 29 18:09:34 user nova-compute[74613]: DEBUG nova.compute.manager [-] [instance: e9acfa30-4ec2-4540-ac34-4c66db3228e1] Deallocating network for instance {{(pid=74613) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 29 18:09:34 user nova-compute[74613]: DEBUG nova.network.neutron [-] [instance: e9acfa30-4ec2-4540-ac34-4c66db3228e1] deallocate_for_instance() {{(pid=74613) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 29 18:09:34 user nova-compute[74613]: DEBUG nova.network.neutron [None req-8f7ed80a-7db0-4f25-8450-817c7a93d4b8 tempest-VolumesNegativeTest-1958586316 tempest-VolumesNegativeTest-1958586316-project-member] [instance: 461df216-9911-4af0-98dc-5fa1a6b5c14b] Successfully updated port: aadb2d92-266c-47cb-9ef1-74edb0e4522c {{(pid=74613) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 29 18:09:34 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-8f7ed80a-7db0-4f25-8450-817c7a93d4b8 tempest-VolumesNegativeTest-1958586316 tempest-VolumesNegativeTest-1958586316-project-member] Acquiring lock "refresh_cache-461df216-9911-4af0-98dc-5fa1a6b5c14b" {{(pid=74613) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 18:09:34 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-8f7ed80a-7db0-4f25-8450-817c7a93d4b8 tempest-VolumesNegativeTest-1958586316 tempest-VolumesNegativeTest-1958586316-project-member] Acquired lock "refresh_cache-461df216-9911-4af0-98dc-5fa1a6b5c14b" {{(pid=74613) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 18:09:34 user nova-compute[74613]: DEBUG nova.network.neutron [None req-8f7ed80a-7db0-4f25-8450-817c7a93d4b8 tempest-VolumesNegativeTest-1958586316 tempest-VolumesNegativeTest-1958586316-project-member] [instance: 461df216-9911-4af0-98dc-5fa1a6b5c14b] Building network info cache for instance {{(pid=74613) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 29 18:09:34 user nova-compute[74613]: DEBUG nova.network.neutron [None req-8f7ed80a-7db0-4f25-8450-817c7a93d4b8 tempest-VolumesNegativeTest-1958586316 tempest-VolumesNegativeTest-1958586316-project-member] [instance: 461df216-9911-4af0-98dc-5fa1a6b5c14b] Instance cache missing network info. {{(pid=74613) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 29 18:09:35 user nova-compute[74613]: DEBUG nova.network.neutron [None req-8f7ed80a-7db0-4f25-8450-817c7a93d4b8 tempest-VolumesNegativeTest-1958586316 tempest-VolumesNegativeTest-1958586316-project-member] [instance: 461df216-9911-4af0-98dc-5fa1a6b5c14b] Updating instance_info_cache with network_info: [{"id": "aadb2d92-266c-47cb-9ef1-74edb0e4522c", "address": "fa:16:3e:8d:a6:af", "network": {"id": "49d6eb18-c708-4eb8-a685-1ab6acc72f0b", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.110", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "794b07cbd46a44b5865cfda741036bae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaadb2d92-26", "ovs_interfaceid": "aadb2d92-266c-47cb-9ef1-74edb0e4522c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74613) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 18:09:35 user nova-compute[74613]: DEBUG nova.network.neutron [-] [instance: e9acfa30-4ec2-4540-ac34-4c66db3228e1] Updating instance_info_cache with network_info: [] {{(pid=74613) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 18:09:35 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-8f7ed80a-7db0-4f25-8450-817c7a93d4b8 tempest-VolumesNegativeTest-1958586316 tempest-VolumesNegativeTest-1958586316-project-member] Releasing lock "refresh_cache-461df216-9911-4af0-98dc-5fa1a6b5c14b" {{(pid=74613) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 18:09:35 user nova-compute[74613]: DEBUG nova.compute.manager [None req-8f7ed80a-7db0-4f25-8450-817c7a93d4b8 tempest-VolumesNegativeTest-1958586316 tempest-VolumesNegativeTest-1958586316-project-member] [instance: 461df216-9911-4af0-98dc-5fa1a6b5c14b] Instance network_info: |[{"id": "aadb2d92-266c-47cb-9ef1-74edb0e4522c", "address": "fa:16:3e:8d:a6:af", "network": {"id": "49d6eb18-c708-4eb8-a685-1ab6acc72f0b", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.110", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "794b07cbd46a44b5865cfda741036bae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaadb2d92-26", "ovs_interfaceid": "aadb2d92-266c-47cb-9ef1-74edb0e4522c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74613) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 29 18:09:35 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-8f7ed80a-7db0-4f25-8450-817c7a93d4b8 tempest-VolumesNegativeTest-1958586316 tempest-VolumesNegativeTest-1958586316-project-member] [instance: 461df216-9911-4af0-98dc-5fa1a6b5c14b] Start _get_guest_xml network_info=[{"id": "aadb2d92-266c-47cb-9ef1-74edb0e4522c", "address": "fa:16:3e:8d:a6:af", "network": {"id": "49d6eb18-c708-4eb8-a685-1ab6acc72f0b", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.110", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "794b07cbd46a44b5865cfda741036bae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaadb2d92-26", "ovs_interfaceid": "aadb2d92-266c-47cb-9ef1-74edb0e4522c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-29T17:47:38Z,direct_url=<?>,disk_format='qcow2',id=4217f428-8d9d-4ee1-9614-642d26d90c46,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='794b07cbd46a44b5865cfda741036bae',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-29T17:47:40Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'size': 0, 'device_type': 'disk', 'boot_index': 0, 'guest_format': None, 'encrypted': False, 'encryption_format': None, 'disk_bus': 'virtio', 'image_id': '4217f428-8d9d-4ee1-9614-642d26d90c46'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74613) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 29 18:09:35 user nova-compute[74613]: WARNING nova.virt.libvirt.driver [None req-8f7ed80a-7db0-4f25-8450-817c7a93d4b8 tempest-VolumesNegativeTest-1958586316 tempest-VolumesNegativeTest-1958586316-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 18:09:35 user nova-compute[74613]: WARNING nova.virt.libvirt.driver [None req-8f7ed80a-7db0-4f25-8450-817c7a93d4b8 tempest-VolumesNegativeTest-1958586316 tempest-VolumesNegativeTest-1958586316-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 18:09:35 user nova-compute[74613]: INFO nova.compute.manager [-] [instance: e9acfa30-4ec2-4540-ac34-4c66db3228e1] Took 0.78 seconds to deallocate network for instance.
Nov 29 18:09:35 user nova-compute[74613]: DEBUG nova.virt.libvirt.host [None req-8f7ed80a-7db0-4f25-8450-817c7a93d4b8 tempest-VolumesNegativeTest-1958586316 tempest-VolumesNegativeTest-1958586316-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74613) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 29 18:09:35 user nova-compute[74613]: DEBUG nova.virt.libvirt.host [None req-8f7ed80a-7db0-4f25-8450-817c7a93d4b8 tempest-VolumesNegativeTest-1958586316 tempest-VolumesNegativeTest-1958586316-project-member] CPU controller missing on host. {{(pid=74613) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 29 18:09:35 user nova-compute[74613]: DEBUG nova.compute.manager [req-ad8fc588-aaec-469e-a8e7-b67df48d534e req-d16eba95-bfd2-47cf-9ade-f4a207b18c44 service nova] [instance: e9acfa30-4ec2-4540-ac34-4c66db3228e1] Received event network-vif-deleted-8cd31427-1812-40fb-8018-d8f24a5b1792 {{(pid=74613) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 18:09:35 user nova-compute[74613]: DEBUG nova.virt.libvirt.host [None req-8f7ed80a-7db0-4f25-8450-817c7a93d4b8 tempest-VolumesNegativeTest-1958586316 tempest-VolumesNegativeTest-1958586316-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74613) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 29 18:09:35 user nova-compute[74613]: DEBUG nova.virt.libvirt.host [None req-8f7ed80a-7db0-4f25-8450-817c7a93d4b8 tempest-VolumesNegativeTest-1958586316 tempest-VolumesNegativeTest-1958586316-project-member] CPU controller found on host. {{(pid=74613) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 29 18:09:35 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-8f7ed80a-7db0-4f25-8450-817c7a93d4b8 tempest-VolumesNegativeTest-1958586316 tempest-VolumesNegativeTest-1958586316-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74613) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 29 18:09:35 user nova-compute[74613]: DEBUG nova.virt.hardware [None req-8f7ed80a-7db0-4f25-8450-817c7a93d4b8 tempest-VolumesNegativeTest-1958586316 tempest-VolumesNegativeTest-1958586316-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-29T17:47:27Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-29T17:47:38Z,direct_url=<?>,disk_format='qcow2',id=4217f428-8d9d-4ee1-9614-642d26d90c46,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='794b07cbd46a44b5865cfda741036bae',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-29T17:47:40Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74613) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 29 18:09:35 user nova-compute[74613]: DEBUG nova.virt.hardware [None req-8f7ed80a-7db0-4f25-8450-817c7a93d4b8 tempest-VolumesNegativeTest-1958586316 tempest-VolumesNegativeTest-1958586316-project-member] Flavor limits 0:0:0 {{(pid=74613) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 29 18:09:35 user nova-compute[74613]: DEBUG nova.virt.hardware [None req-8f7ed80a-7db0-4f25-8450-817c7a93d4b8 tempest-VolumesNegativeTest-1958586316 tempest-VolumesNegativeTest-1958586316-project-member] Image limits 0:0:0 {{(pid=74613) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 29 18:09:35 user nova-compute[74613]: DEBUG nova.virt.hardware [None req-8f7ed80a-7db0-4f25-8450-817c7a93d4b8 tempest-VolumesNegativeTest-1958586316 tempest-VolumesNegativeTest-1958586316-project-member] Flavor pref 0:0:0 {{(pid=74613) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 29 18:09:35 user nova-compute[74613]: DEBUG nova.virt.hardware [None req-8f7ed80a-7db0-4f25-8450-817c7a93d4b8 tempest-VolumesNegativeTest-1958586316 tempest-VolumesNegativeTest-1958586316-project-member] Image pref 0:0:0 {{(pid=74613) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 29 18:09:35 user nova-compute[74613]: DEBUG nova.virt.hardware [None req-8f7ed80a-7db0-4f25-8450-817c7a93d4b8 tempest-VolumesNegativeTest-1958586316 tempest-VolumesNegativeTest-1958586316-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74613) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 29 18:09:35 user nova-compute[74613]: DEBUG nova.virt.hardware [None req-8f7ed80a-7db0-4f25-8450-817c7a93d4b8 tempest-VolumesNegativeTest-1958586316 tempest-VolumesNegativeTest-1958586316-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74613) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 29 18:09:35 user nova-compute[74613]: DEBUG nova.virt.hardware [None req-8f7ed80a-7db0-4f25-8450-817c7a93d4b8 tempest-VolumesNegativeTest-1958586316 tempest-VolumesNegativeTest-1958586316-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74613) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 29 18:09:35 user nova-compute[74613]: DEBUG nova.virt.hardware [None req-8f7ed80a-7db0-4f25-8450-817c7a93d4b8 tempest-VolumesNegativeTest-1958586316 tempest-VolumesNegativeTest-1958586316-project-member] Got 1 possible topologies {{(pid=74613) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 29 18:09:35 user nova-compute[74613]: DEBUG nova.virt.hardware [None req-8f7ed80a-7db0-4f25-8450-817c7a93d4b8 tempest-VolumesNegativeTest-1958586316 tempest-VolumesNegativeTest-1958586316-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74613) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 29 18:09:35 user nova-compute[74613]: DEBUG nova.virt.hardware [None req-8f7ed80a-7db0-4f25-8450-817c7a93d4b8 tempest-VolumesNegativeTest-1958586316 tempest-VolumesNegativeTest-1958586316-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74613) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 29 18:09:35 user nova-compute[74613]: DEBUG nova.virt.libvirt.vif [None req-8f7ed80a-7db0-4f25-8450-817c7a93d4b8 tempest-VolumesNegativeTest-1958586316 tempest-VolumesNegativeTest-1958586316-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T18:09:31Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesNegativeTest-instance-1160816456',display_name='tempest-VolumesNegativeTest-instance-1160816456',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesnegativetest-instance-1160816456',id=35,image_ref='4217f428-8d9d-4ee1-9614-642d26d90c46',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='92f9bb68afc04038bb230fc036546e4a',ramdisk_id='',reservation_id='r-ppzdqsjk',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='4217f428-8d9d-4ee1-9614-642d26d90c46',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesNegativeTest-1958586316',owner_user_name='tempest-VolumesNegativeTest-1958586316-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T18:09:33Z,user_data=None,user_id='fa9231cab6ff4bbcb4c06e4cc4da907a',uuid=461df216-9911-4af0-98dc-5fa1a6b5c14b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "aadb2d92-266c-47cb-9ef1-74edb0e4522c", "address": "fa:16:3e:8d:a6:af", "network": {"id": "49d6eb18-c708-4eb8-a685-1ab6acc72f0b", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.110", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "794b07cbd46a44b5865cfda741036bae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaadb2d92-26", "ovs_interfaceid": "aadb2d92-266c-47cb-9ef1-74edb0e4522c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74613) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 29 18:09:35 user nova-compute[74613]: DEBUG nova.network.os_vif_util [None req-8f7ed80a-7db0-4f25-8450-817c7a93d4b8 tempest-VolumesNegativeTest-1958586316 tempest-VolumesNegativeTest-1958586316-project-member] Converting VIF {"id": "aadb2d92-266c-47cb-9ef1-74edb0e4522c", "address": "fa:16:3e:8d:a6:af", "network": {"id": "49d6eb18-c708-4eb8-a685-1ab6acc72f0b", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.110", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "794b07cbd46a44b5865cfda741036bae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaadb2d92-26", "ovs_interfaceid": "aadb2d92-266c-47cb-9ef1-74edb0e4522c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74613) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 18:09:35 user nova-compute[74613]: DEBUG nova.network.os_vif_util [None req-8f7ed80a-7db0-4f25-8450-817c7a93d4b8 tempest-VolumesNegativeTest-1958586316 tempest-VolumesNegativeTest-1958586316-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8d:a6:af,bridge_name='br-int',has_traffic_filtering=True,id=aadb2d92-266c-47cb-9ef1-74edb0e4522c,network=Network(49d6eb18-c708-4eb8-a685-1ab6acc72f0b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaadb2d92-26') {{(pid=74613) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 18:09:35 user nova-compute[74613]: DEBUG nova.objects.instance [None req-8f7ed80a-7db0-4f25-8450-817c7a93d4b8 tempest-VolumesNegativeTest-1958586316 tempest-VolumesNegativeTest-1958586316-project-member] Lazy-loading 'pci_devices' on Instance uuid 461df216-9911-4af0-98dc-5fa1a6b5c14b {{(pid=74613) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 18:09:35 user nova-compute[74613]: DEBUG oslo_service.periodic_task [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74613) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 18:09:35 user nova-compute[74613]: DEBUG oslo_service.periodic_task [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74613) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 18:09:35 user nova-compute[74613]: DEBUG nova.compute.manager [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Starting heal instance info cache {{(pid=74613) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 29 18:09:35 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-8f7ed80a-7db0-4f25-8450-817c7a93d4b8 tempest-VolumesNegativeTest-1958586316 tempest-VolumesNegativeTest-1958586316-project-member] [instance: 461df216-9911-4af0-98dc-5fa1a6b5c14b] End _get_guest_xml xml=<domain type="kvm">
Nov 29 18:09:35 user nova-compute[74613]:   <uuid>461df216-9911-4af0-98dc-5fa1a6b5c14b</uuid>
Nov 29 18:09:35 user nova-compute[74613]:   <name>instance-00000023</name>
Nov 29 18:09:35 user nova-compute[74613]:   <memory>524288</memory>
Nov 29 18:09:35 user nova-compute[74613]:   <vcpu>1</vcpu>
Nov 29 18:09:35 user nova-compute[74613]:   <metadata>
Nov 29 18:09:35 user nova-compute[74613]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 29 18:09:35 user nova-compute[74613]:       <nova:package version="0.0.0"/>
Nov 29 18:09:35 user nova-compute[74613]:       <nova:name>tempest-VolumesNegativeTest-instance-1160816456</nova:name>
Nov 29 18:09:35 user nova-compute[74613]:       <nova:creationTime>2023-11-29 18:09:35</nova:creationTime>
Nov 29 18:09:35 user nova-compute[74613]:       <nova:flavor name="m1.tiny">
Nov 29 18:09:35 user nova-compute[74613]:         <nova:memory>512</nova:memory>
Nov 29 18:09:35 user nova-compute[74613]:         <nova:disk>1</nova:disk>
Nov 29 18:09:35 user nova-compute[74613]:         <nova:swap>0</nova:swap>
Nov 29 18:09:35 user nova-compute[74613]:         <nova:ephemeral>0</nova:ephemeral>
Nov 29 18:09:35 user nova-compute[74613]:         <nova:vcpus>1</nova:vcpus>
Nov 29 18:09:35 user nova-compute[74613]:       </nova:flavor>
Nov 29 18:09:35 user nova-compute[74613]:       <nova:owner>
Nov 29 18:09:35 user nova-compute[74613]:         <nova:user uuid="fa9231cab6ff4bbcb4c06e4cc4da907a">tempest-VolumesNegativeTest-1958586316-project-member</nova:user>
Nov 29 18:09:35 user nova-compute[74613]:         <nova:project uuid="92f9bb68afc04038bb230fc036546e4a">tempest-VolumesNegativeTest-1958586316</nova:project>
Nov 29 18:09:35 user nova-compute[74613]:       </nova:owner>
Nov 29 18:09:35 user nova-compute[74613]:       <nova:root type="image" uuid="4217f428-8d9d-4ee1-9614-642d26d90c46"/>
Nov 29 18:09:35 user nova-compute[74613]:       <nova:ports>
Nov 29 18:09:35 user nova-compute[74613]:         <nova:port uuid="aadb2d92-266c-47cb-9ef1-74edb0e4522c">
Nov 29 18:09:35 user nova-compute[74613]:           <nova:ip type="fixed" address="192.168.233.110" ipVersion="4"/>
Nov 29 18:09:35 user nova-compute[74613]:         </nova:port>
Nov 29 18:09:35 user nova-compute[74613]:       </nova:ports>
Nov 29 18:09:35 user nova-compute[74613]:     </nova:instance>
Nov 29 18:09:35 user nova-compute[74613]:   </metadata>
Nov 29 18:09:35 user nova-compute[74613]:   <sysinfo type="smbios">
Nov 29 18:09:35 user nova-compute[74613]:     <system>
Nov 29 18:09:35 user nova-compute[74613]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 29 18:09:35 user nova-compute[74613]:       <entry name="product">OpenStack Nova</entry>
Nov 29 18:09:35 user nova-compute[74613]:       <entry name="version">0.0.0</entry>
Nov 29 18:09:35 user nova-compute[74613]:       <entry name="serial">461df216-9911-4af0-98dc-5fa1a6b5c14b</entry>
Nov 29 18:09:35 user nova-compute[74613]:       <entry name="uuid">461df216-9911-4af0-98dc-5fa1a6b5c14b</entry>
Nov 29 18:09:35 user nova-compute[74613]:       <entry name="family">Virtual Machine</entry>
Nov 29 18:09:35 user nova-compute[74613]:     </system>
Nov 29 18:09:35 user nova-compute[74613]:   </sysinfo>
Nov 29 18:09:35 user nova-compute[74613]:   <os>
Nov 29 18:09:35 user nova-compute[74613]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 29 18:09:35 user nova-compute[74613]:     <boot dev="hd"/>
Nov 29 18:09:35 user nova-compute[74613]:     <smbios mode="sysinfo"/>
Nov 29 18:09:35 user nova-compute[74613]:   </os>
Nov 29 18:09:35 user nova-compute[74613]:   <features>
Nov 29 18:09:35 user nova-compute[74613]:     <acpi/>
Nov 29 18:09:35 user nova-compute[74613]:     <apic/>
Nov 29 18:09:35 user nova-compute[74613]:     <vmcoreinfo/>
Nov 29 18:09:35 user nova-compute[74613]:   </features>
Nov 29 18:09:35 user nova-compute[74613]:   <clock offset="utc">
Nov 29 18:09:35 user nova-compute[74613]:     <timer name="pit" tickpolicy="delay"/>
Nov 29 18:09:35 user nova-compute[74613]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 29 18:09:35 user nova-compute[74613]:     <timer name="hpet" present="no"/>
Nov 29 18:09:35 user nova-compute[74613]:   </clock>
Nov 29 18:09:35 user nova-compute[74613]:   <cpu mode="custom" match="exact">
Nov 29 18:09:35 user nova-compute[74613]:     <model>Nehalem</model>
Nov 29 18:09:35 user nova-compute[74613]:     <topology sockets="1" cores="1" threads="1"/>
Nov 29 18:09:35 user nova-compute[74613]:   </cpu>
Nov 29 18:09:35 user nova-compute[74613]:   <devices>
Nov 29 18:09:35 user nova-compute[74613]:     <disk type="file" device="disk">
Nov 29 18:09:35 user nova-compute[74613]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 29 18:09:35 user nova-compute[74613]:       <source file="/opt/stack/data/nova/instances/461df216-9911-4af0-98dc-5fa1a6b5c14b/disk"/>
Nov 29 18:09:35 user nova-compute[74613]:       <target dev="vda" bus="virtio"/>
Nov 29 18:09:35 user nova-compute[74613]:     </disk>
Nov 29 18:09:35 user nova-compute[74613]:     <interface type="ethernet">
Nov 29 18:09:35 user nova-compute[74613]:       <mac address="fa:16:3e:8d:a6:af"/>
Nov 29 18:09:35 user nova-compute[74613]:       <model type="virtio"/>
Nov 29 18:09:35 user nova-compute[74613]:       <mtu size="1442"/>
Nov 29 18:09:35 user nova-compute[74613]:       <target dev="tapaadb2d92-26"/>
Nov 29 18:09:35 user nova-compute[74613]:     </interface>
Nov 29 18:09:35 user nova-compute[74613]:     <serial type="pty">
Nov 29 18:09:35 user nova-compute[74613]:       <log file="/opt/stack/data/nova/instances/461df216-9911-4af0-98dc-5fa1a6b5c14b/console.log" append="off"/>
Nov 29 18:09:35 user nova-compute[74613]:     </serial>
Nov 29 18:09:35 user nova-compute[74613]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 29 18:09:35 user nova-compute[74613]:     <video>
Nov 29 18:09:35 user nova-compute[74613]:       <model type="virtio"/>
Nov 29 18:09:35 user nova-compute[74613]:     </video>
Nov 29 18:09:35 user nova-compute[74613]:     <rng model="virtio">
Nov 29 18:09:35 user nova-compute[74613]:       <backend model="random">/dev/urandom</backend>
Nov 29 18:09:35 user nova-compute[74613]:     </rng>
Nov 29 18:09:35 user nova-compute[74613]:     <controller type="usb" index="0" model="none"/>
Nov 29 18:09:35 user nova-compute[74613]:     <memballoon model="virtio">
Nov 29 18:09:35 user nova-compute[74613]:       <stats period="10"/>
Nov 29 18:09:35 user nova-compute[74613]:     </memballoon>
Nov 29 18:09:35 user nova-compute[74613]:   </devices>
Nov 29 18:09:35 user nova-compute[74613]: </domain>
Nov 29 18:09:35 user nova-compute[74613]:  {{(pid=74613) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 29 18:09:35 user nova-compute[74613]: DEBUG nova.virt.libvirt.vif [None req-8f7ed80a-7db0-4f25-8450-817c7a93d4b8 tempest-VolumesNegativeTest-1958586316 tempest-VolumesNegativeTest-1958586316-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T18:09:31Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesNegativeTest-instance-1160816456',display_name='tempest-VolumesNegativeTest-instance-1160816456',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesnegativetest-instance-1160816456',id=35,image_ref='4217f428-8d9d-4ee1-9614-642d26d90c46',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='92f9bb68afc04038bb230fc036546e4a',ramdisk_id='',reservation_id='r-ppzdqsjk',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='4217f428-8d9d-4ee1-9614-642d26d90c46',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesNegativeTest-1958586316',owner_user_name='tempest-VolumesNegativeTest-1958586316-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T18:09:33Z,user_data=None,user_id='fa9231cab6ff4bbcb4c06e4cc4da907a',uuid=461df216-9911-4af0-98dc-5fa1a6b5c14b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "aadb2d92-266c-47cb-9ef1-74edb0e4522c", "address": "fa:16:3e:8d:a6:af", "network": {"id": "49d6eb18-c708-4eb8-a685-1ab6acc72f0b", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.110", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "794b07cbd46a44b5865cfda741036bae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaadb2d92-26", "ovs_interfaceid": "aadb2d92-266c-47cb-9ef1-74edb0e4522c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74613) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 29 18:09:35 user nova-compute[74613]: DEBUG nova.network.os_vif_util [None req-8f7ed80a-7db0-4f25-8450-817c7a93d4b8 tempest-VolumesNegativeTest-1958586316 tempest-VolumesNegativeTest-1958586316-project-member] Converting VIF {"id": "aadb2d92-266c-47cb-9ef1-74edb0e4522c", "address": "fa:16:3e:8d:a6:af", "network": {"id": "49d6eb18-c708-4eb8-a685-1ab6acc72f0b", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.110", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "794b07cbd46a44b5865cfda741036bae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaadb2d92-26", "ovs_interfaceid": "aadb2d92-266c-47cb-9ef1-74edb0e4522c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74613) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 18:09:35 user nova-compute[74613]: DEBUG nova.network.os_vif_util [None req-8f7ed80a-7db0-4f25-8450-817c7a93d4b8 tempest-VolumesNegativeTest-1958586316 tempest-VolumesNegativeTest-1958586316-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8d:a6:af,bridge_name='br-int',has_traffic_filtering=True,id=aadb2d92-266c-47cb-9ef1-74edb0e4522c,network=Network(49d6eb18-c708-4eb8-a685-1ab6acc72f0b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaadb2d92-26') {{(pid=74613) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 18:09:35 user nova-compute[74613]: DEBUG os_vif [None req-8f7ed80a-7db0-4f25-8450-817c7a93d4b8 tempest-VolumesNegativeTest-1958586316 tempest-VolumesNegativeTest-1958586316-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:8d:a6:af,bridge_name='br-int',has_traffic_filtering=True,id=aadb2d92-266c-47cb-9ef1-74edb0e4522c,network=Network(49d6eb18-c708-4eb8-a685-1ab6acc72f0b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaadb2d92-26') {{(pid=74613) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 29 18:09:35 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:09:35 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74613) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 18:09:35 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74613) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 29 18:09:35 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:09:35 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '63959868-02a7-58a2-9025-aa74019fbfa4', '_type': 'linux-noop'}}, row=False) {{(pid=74613) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 18:09:35 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:09:35 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 18:09:35 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:09:35 user nova-compute[74613]: DEBUG nova.compute.manager [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Didn't find any instances for network info cache update. {{(pid=74613) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 29 18:09:35 user nova-compute[74613]: DEBUG oslo_service.periodic_task [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74613) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 18:09:35 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:09:35 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapaadb2d92-26, may_exist=True, interface_attrs={}) {{(pid=74613) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 18:09:35 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapaadb2d92-26, col_values=(('qos', UUID('9a8a4e25-dbdb-466c-89da-bf519a20df79')),), if_exists=True) {{(pid=74613) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 18:09:35 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapaadb2d92-26, col_values=(('external_ids', {'iface-id': 'aadb2d92-266c-47cb-9ef1-74edb0e4522c', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:8d:a6:af', 'vm-uuid': '461df216-9911-4af0-98dc-5fa1a6b5c14b'}),), if_exists=True) {{(pid=74613) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 18:09:35 user nova-compute[74613]: DEBUG oslo_service.periodic_task [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74613) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 18:09:35 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:09:35 user nova-compute[74613]: DEBUG oslo_service.periodic_task [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74613) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 18:09:35 user nova-compute[74613]: DEBUG oslo_service.periodic_task [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74613) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 18:09:35 user nova-compute[74613]: DEBUG nova.compute.manager [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74613) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 29 18:09:35 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 18:09:35 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:09:35 user nova-compute[74613]: INFO os_vif [None req-8f7ed80a-7db0-4f25-8450-817c7a93d4b8 tempest-VolumesNegativeTest-1958586316 tempest-VolumesNegativeTest-1958586316-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:8d:a6:af,bridge_name='br-int',has_traffic_filtering=True,id=aadb2d92-266c-47cb-9ef1-74edb0e4522c,network=Network(49d6eb18-c708-4eb8-a685-1ab6acc72f0b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaadb2d92-26')
Nov 29 18:09:35 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-8f7ed80a-7db0-4f25-8450-817c7a93d4b8 tempest-VolumesNegativeTest-1958586316 tempest-VolumesNegativeTest-1958586316-project-member] No BDM found with device name vda, not building metadata. {{(pid=74613) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 18:09:35 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-8f7ed80a-7db0-4f25-8450-817c7a93d4b8 tempest-VolumesNegativeTest-1958586316 tempest-VolumesNegativeTest-1958586316-project-member] No VIF found with MAC fa:16:3e:8d:a6:af, not building metadata {{(pid=74613) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 29 18:09:35 user nova-compute[74613]: DEBUG oslo_service.periodic_task [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74613) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 18:09:35 user nova-compute[74613]: DEBUG oslo_service.periodic_task [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74613) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 18:09:35 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:09:35 user nova-compute[74613]: DEBUG nova.compute.manager [req-57f4db34-76b1-4aa8-8e88-e4e2349f9897 req-0e61b9bd-8aac-4e36-a3a7-818553c0d80f service nova] [instance: e9acfa30-4ec2-4540-ac34-4c66db3228e1] Received event network-vif-plugged-8cd31427-1812-40fb-8018-d8f24a5b1792 {{(pid=74613) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 18:09:35 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-57f4db34-76b1-4aa8-8e88-e4e2349f9897 req-0e61b9bd-8aac-4e36-a3a7-818553c0d80f service nova] Acquiring lock "e9acfa30-4ec2-4540-ac34-4c66db3228e1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 18:09:35 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-57f4db34-76b1-4aa8-8e88-e4e2349f9897 req-0e61b9bd-8aac-4e36-a3a7-818553c0d80f service nova] Lock "e9acfa30-4ec2-4540-ac34-4c66db3228e1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 18:09:35 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-57f4db34-76b1-4aa8-8e88-e4e2349f9897 req-0e61b9bd-8aac-4e36-a3a7-818553c0d80f service nova] Lock "e9acfa30-4ec2-4540-ac34-4c66db3228e1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 18:09:35 user nova-compute[74613]: DEBUG nova.compute.manager [req-57f4db34-76b1-4aa8-8e88-e4e2349f9897 req-0e61b9bd-8aac-4e36-a3a7-818553c0d80f service nova] [instance: e9acfa30-4ec2-4540-ac34-4c66db3228e1] No waiting events found dispatching network-vif-plugged-8cd31427-1812-40fb-8018-d8f24a5b1792 {{(pid=74613) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 18:09:35 user nova-compute[74613]: WARNING nova.compute.manager [req-57f4db34-76b1-4aa8-8e88-e4e2349f9897 req-0e61b9bd-8aac-4e36-a3a7-818553c0d80f service nova] [instance: e9acfa30-4ec2-4540-ac34-4c66db3228e1] Received unexpected event network-vif-plugged-8cd31427-1812-40fb-8018-d8f24a5b1792 for instance with vm_state active and task_state deleting.
Nov 29 18:09:35 user nova-compute[74613]: DEBUG nova.compute.manager [req-57f4db34-76b1-4aa8-8e88-e4e2349f9897 req-0e61b9bd-8aac-4e36-a3a7-818553c0d80f service nova] [instance: 461df216-9911-4af0-98dc-5fa1a6b5c14b] Received event network-changed-aadb2d92-266c-47cb-9ef1-74edb0e4522c {{(pid=74613) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 18:09:35 user nova-compute[74613]: DEBUG nova.compute.manager [req-57f4db34-76b1-4aa8-8e88-e4e2349f9897 req-0e61b9bd-8aac-4e36-a3a7-818553c0d80f service nova] [instance: 461df216-9911-4af0-98dc-5fa1a6b5c14b] Refreshing instance network info cache due to event network-changed-aadb2d92-266c-47cb-9ef1-74edb0e4522c. {{(pid=74613) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 18:09:35 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-57f4db34-76b1-4aa8-8e88-e4e2349f9897 req-0e61b9bd-8aac-4e36-a3a7-818553c0d80f service nova] Acquiring lock "refresh_cache-461df216-9911-4af0-98dc-5fa1a6b5c14b" {{(pid=74613) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 18:09:35 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-57f4db34-76b1-4aa8-8e88-e4e2349f9897 req-0e61b9bd-8aac-4e36-a3a7-818553c0d80f service nova] Acquired lock "refresh_cache-461df216-9911-4af0-98dc-5fa1a6b5c14b" {{(pid=74613) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 18:09:35 user nova-compute[74613]: DEBUG nova.network.neutron [req-57f4db34-76b1-4aa8-8e88-e4e2349f9897 req-0e61b9bd-8aac-4e36-a3a7-818553c0d80f service nova] [instance: 461df216-9911-4af0-98dc-5fa1a6b5c14b] Refreshing network info cache for port aadb2d92-266c-47cb-9ef1-74edb0e4522c {{(pid=74613) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 18:09:36 user nova-compute[74613]: INFO nova.compute.manager [None req-fd56056a-5932-4a3e-86b3-cd6b9050553e tempest-ServerActionsTestOtherA-1784608629 tempest-ServerActionsTestOtherA-1784608629-project-member] [instance: e9acfa30-4ec2-4540-ac34-4c66db3228e1] Took 0.94 seconds to detach 1 volumes for instance.
Nov 29 18:09:36 user nova-compute[74613]: DEBUG nova.compute.manager [None req-fd56056a-5932-4a3e-86b3-cd6b9050553e tempest-ServerActionsTestOtherA-1784608629 tempest-ServerActionsTestOtherA-1784608629-project-member] [instance: e9acfa30-4ec2-4540-ac34-4c66db3228e1] Deleting volume: a8c53a27-dcde-402b-a9bb-d8642f7db0da {{(pid=74613) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3237}}
Nov 29 18:09:36 user nova-compute[74613]: DEBUG nova.network.neutron [req-57f4db34-76b1-4aa8-8e88-e4e2349f9897 req-0e61b9bd-8aac-4e36-a3a7-818553c0d80f service nova] [instance: 461df216-9911-4af0-98dc-5fa1a6b5c14b] Updated VIF entry in instance network info cache for port aadb2d92-266c-47cb-9ef1-74edb0e4522c. {{(pid=74613) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 18:09:36 user nova-compute[74613]: DEBUG nova.network.neutron [req-57f4db34-76b1-4aa8-8e88-e4e2349f9897 req-0e61b9bd-8aac-4e36-a3a7-818553c0d80f service nova] [instance: 461df216-9911-4af0-98dc-5fa1a6b5c14b] Updating instance_info_cache with network_info: [{"id": "aadb2d92-266c-47cb-9ef1-74edb0e4522c", "address": "fa:16:3e:8d:a6:af", "network": {"id": "49d6eb18-c708-4eb8-a685-1ab6acc72f0b", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.110", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "794b07cbd46a44b5865cfda741036bae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaadb2d92-26", "ovs_interfaceid": "aadb2d92-266c-47cb-9ef1-74edb0e4522c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74613) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 18:09:36 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-57f4db34-76b1-4aa8-8e88-e4e2349f9897 req-0e61b9bd-8aac-4e36-a3a7-818553c0d80f service nova] Releasing lock "refresh_cache-461df216-9911-4af0-98dc-5fa1a6b5c14b" {{(pid=74613) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 18:09:36 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-fd56056a-5932-4a3e-86b3-cd6b9050553e tempest-ServerActionsTestOtherA-1784608629 tempest-ServerActionsTestOtherA-1784608629-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 18:09:36 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-fd56056a-5932-4a3e-86b3-cd6b9050553e tempest-ServerActionsTestOtherA-1784608629 tempest-ServerActionsTestOtherA-1784608629-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 18:09:36 user nova-compute[74613]: DEBUG nova.compute.provider_tree [None req-fd56056a-5932-4a3e-86b3-cd6b9050553e tempest-ServerActionsTestOtherA-1784608629 tempest-ServerActionsTestOtherA-1784608629-project-member] Inventory has not changed in ProviderTree for provider: 639d980e-3b12-44b1-b8f4-1812416fa4dd {{(pid=74613) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 18:09:36 user nova-compute[74613]: DEBUG nova.scheduler.client.report [None req-fd56056a-5932-4a3e-86b3-cd6b9050553e tempest-ServerActionsTestOtherA-1784608629 tempest-ServerActionsTestOtherA-1784608629-project-member] Inventory has not changed for provider 639d980e-3b12-44b1-b8f4-1812416fa4dd based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74613) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 18:09:37 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-fd56056a-5932-4a3e-86b3-cd6b9050553e tempest-ServerActionsTestOtherA-1784608629 tempest-ServerActionsTestOtherA-1784608629-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.541s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 18:09:37 user nova-compute[74613]: INFO nova.scheduler.client.report [None req-fd56056a-5932-4a3e-86b3-cd6b9050553e tempest-ServerActionsTestOtherA-1784608629 tempest-ServerActionsTestOtherA-1784608629-project-member] Deleted allocations for instance e9acfa30-4ec2-4540-ac34-4c66db3228e1
Nov 29 18:09:37 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-fd56056a-5932-4a3e-86b3-cd6b9050553e tempest-ServerActionsTestOtherA-1784608629 tempest-ServerActionsTestOtherA-1784608629-project-member] Lock "e9acfa30-4ec2-4540-ac34-4c66db3228e1" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.849s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 18:09:37 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:09:37 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:09:37 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:09:37 user nova-compute[74613]: DEBUG oslo_service.periodic_task [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74613) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 18:09:37 user nova-compute[74613]: DEBUG nova.compute.manager [req-07dfddf7-0dbe-4269-b89f-56a08cd80ed4 req-5af77e34-1708-480e-af10-6e9dda5f23af service nova] [instance: 461df216-9911-4af0-98dc-5fa1a6b5c14b] Received event network-vif-plugged-aadb2d92-266c-47cb-9ef1-74edb0e4522c {{(pid=74613) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 18:09:37 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-07dfddf7-0dbe-4269-b89f-56a08cd80ed4 req-5af77e34-1708-480e-af10-6e9dda5f23af service nova] Acquiring lock "461df216-9911-4af0-98dc-5fa1a6b5c14b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 18:09:37 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-07dfddf7-0dbe-4269-b89f-56a08cd80ed4 req-5af77e34-1708-480e-af10-6e9dda5f23af service nova] Lock "461df216-9911-4af0-98dc-5fa1a6b5c14b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 18:09:37 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-07dfddf7-0dbe-4269-b89f-56a08cd80ed4 req-5af77e34-1708-480e-af10-6e9dda5f23af service nova] Lock "461df216-9911-4af0-98dc-5fa1a6b5c14b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 18:09:37 user nova-compute[74613]: DEBUG nova.compute.manager [req-07dfddf7-0dbe-4269-b89f-56a08cd80ed4 req-5af77e34-1708-480e-af10-6e9dda5f23af service nova] [instance: 461df216-9911-4af0-98dc-5fa1a6b5c14b] No waiting events found dispatching network-vif-plugged-aadb2d92-266c-47cb-9ef1-74edb0e4522c {{(pid=74613) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 18:09:37 user nova-compute[74613]: WARNING nova.compute.manager [req-07dfddf7-0dbe-4269-b89f-56a08cd80ed4 req-5af77e34-1708-480e-af10-6e9dda5f23af service nova] [instance: 461df216-9911-4af0-98dc-5fa1a6b5c14b] Received unexpected event network-vif-plugged-aadb2d92-266c-47cb-9ef1-74edb0e4522c for instance with vm_state building and task_state spawning.
Nov 29 18:09:37 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:09:37 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:09:37 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:09:37 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:09:39 user nova-compute[74613]: DEBUG nova.compute.manager [None req-8f7ed80a-7db0-4f25-8450-817c7a93d4b8 tempest-VolumesNegativeTest-1958586316 tempest-VolumesNegativeTest-1958586316-project-member] [instance: 461df216-9911-4af0-98dc-5fa1a6b5c14b] Instance event wait completed in 0 seconds for  {{(pid=74613) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 29 18:09:39 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-8f7ed80a-7db0-4f25-8450-817c7a93d4b8 tempest-VolumesNegativeTest-1958586316 tempest-VolumesNegativeTest-1958586316-project-member] [instance: 461df216-9911-4af0-98dc-5fa1a6b5c14b] Guest created on hypervisor {{(pid=74613) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 29 18:09:39 user nova-compute[74613]: INFO nova.virt.libvirt.driver [-] [instance: 461df216-9911-4af0-98dc-5fa1a6b5c14b] Instance spawned successfully.
Nov 29 18:09:39 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-8f7ed80a-7db0-4f25-8450-817c7a93d4b8 tempest-VolumesNegativeTest-1958586316 tempest-VolumesNegativeTest-1958586316-project-member] [instance: 461df216-9911-4af0-98dc-5fa1a6b5c14b] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74613) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 29 18:09:39 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-8f7ed80a-7db0-4f25-8450-817c7a93d4b8 tempest-VolumesNegativeTest-1958586316 tempest-VolumesNegativeTest-1958586316-project-member] [instance: 461df216-9911-4af0-98dc-5fa1a6b5c14b] Found default for hw_cdrom_bus of ide {{(pid=74613) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 18:09:39 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-8f7ed80a-7db0-4f25-8450-817c7a93d4b8 tempest-VolumesNegativeTest-1958586316 tempest-VolumesNegativeTest-1958586316-project-member] [instance: 461df216-9911-4af0-98dc-5fa1a6b5c14b] Found default for hw_disk_bus of virtio {{(pid=74613) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 18:09:39 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-8f7ed80a-7db0-4f25-8450-817c7a93d4b8 tempest-VolumesNegativeTest-1958586316 tempest-VolumesNegativeTest-1958586316-project-member] [instance: 461df216-9911-4af0-98dc-5fa1a6b5c14b] Found default for hw_input_bus of None {{(pid=74613) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 18:09:39 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-8f7ed80a-7db0-4f25-8450-817c7a93d4b8 tempest-VolumesNegativeTest-1958586316 tempest-VolumesNegativeTest-1958586316-project-member] [instance: 461df216-9911-4af0-98dc-5fa1a6b5c14b] Found default for hw_pointer_model of None {{(pid=74613) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 18:09:39 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-8f7ed80a-7db0-4f25-8450-817c7a93d4b8 tempest-VolumesNegativeTest-1958586316 tempest-VolumesNegativeTest-1958586316-project-member] [instance: 461df216-9911-4af0-98dc-5fa1a6b5c14b] Found default for hw_video_model of virtio {{(pid=74613) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 18:09:39 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-8f7ed80a-7db0-4f25-8450-817c7a93d4b8 tempest-VolumesNegativeTest-1958586316 tempest-VolumesNegativeTest-1958586316-project-member] [instance: 461df216-9911-4af0-98dc-5fa1a6b5c14b] Found default for hw_vif_model of virtio {{(pid=74613) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 18:09:39 user nova-compute[74613]: INFO nova.compute.manager [None req-8f7ed80a-7db0-4f25-8450-817c7a93d4b8 tempest-VolumesNegativeTest-1958586316 tempest-VolumesNegativeTest-1958586316-project-member] [instance: 461df216-9911-4af0-98dc-5fa1a6b5c14b] Took 6.74 seconds to spawn the instance on the hypervisor.
Nov 29 18:09:39 user nova-compute[74613]: DEBUG nova.compute.manager [None req-8f7ed80a-7db0-4f25-8450-817c7a93d4b8 tempest-VolumesNegativeTest-1958586316 tempest-VolumesNegativeTest-1958586316-project-member] [instance: 461df216-9911-4af0-98dc-5fa1a6b5c14b] Checking state {{(pid=74613) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 29 18:09:39 user nova-compute[74613]: INFO nova.compute.manager [None req-8f7ed80a-7db0-4f25-8450-817c7a93d4b8 tempest-VolumesNegativeTest-1958586316 tempest-VolumesNegativeTest-1958586316-project-member] [instance: 461df216-9911-4af0-98dc-5fa1a6b5c14b] Took 7.97 seconds to build instance.
Nov 29 18:09:39 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-8f7ed80a-7db0-4f25-8450-817c7a93d4b8 tempest-VolumesNegativeTest-1958586316 tempest-VolumesNegativeTest-1958586316-project-member] Lock "461df216-9911-4af0-98dc-5fa1a6b5c14b" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.071s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 18:09:39 user nova-compute[74613]: DEBUG nova.compute.manager [req-f6f5f087-98c4-4e7c-a26f-1f0f109b4f82 req-e6c41302-b8c6-4a8f-9f44-8ad085ce8008 service nova] [instance: 461df216-9911-4af0-98dc-5fa1a6b5c14b] Received event network-vif-plugged-aadb2d92-266c-47cb-9ef1-74edb0e4522c {{(pid=74613) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 18:09:39 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-f6f5f087-98c4-4e7c-a26f-1f0f109b4f82 req-e6c41302-b8c6-4a8f-9f44-8ad085ce8008 service nova] Acquiring lock "461df216-9911-4af0-98dc-5fa1a6b5c14b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 18:09:39 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-f6f5f087-98c4-4e7c-a26f-1f0f109b4f82 req-e6c41302-b8c6-4a8f-9f44-8ad085ce8008 service nova] Lock "461df216-9911-4af0-98dc-5fa1a6b5c14b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 18:09:39 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-f6f5f087-98c4-4e7c-a26f-1f0f109b4f82 req-e6c41302-b8c6-4a8f-9f44-8ad085ce8008 service nova] Lock "461df216-9911-4af0-98dc-5fa1a6b5c14b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 18:09:39 user nova-compute[74613]: DEBUG nova.compute.manager [req-f6f5f087-98c4-4e7c-a26f-1f0f109b4f82 req-e6c41302-b8c6-4a8f-9f44-8ad085ce8008 service nova] [instance: 461df216-9911-4af0-98dc-5fa1a6b5c14b] No waiting events found dispatching network-vif-plugged-aadb2d92-266c-47cb-9ef1-74edb0e4522c {{(pid=74613) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 18:09:39 user nova-compute[74613]: WARNING nova.compute.manager [req-f6f5f087-98c4-4e7c-a26f-1f0f109b4f82 req-e6c41302-b8c6-4a8f-9f44-8ad085ce8008 service nova] [instance: 461df216-9911-4af0-98dc-5fa1a6b5c14b] Received unexpected event network-vif-plugged-aadb2d92-266c-47cb-9ef1-74edb0e4522c for instance with vm_state active and task_state None.
Nov 29 18:09:40 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:09:40 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:09:42 user nova-compute[74613]: DEBUG nova.objects.instance [None req-641fab2e-701d-4b13-b383-5b92aa060de7 tempest-AttachVolumeTestJSON-813984703 tempest-AttachVolumeTestJSON-813984703-project-member] Lazy-loading 'flavor' on Instance uuid 69109f06-acbf-4834-b05e-80ab6e3f6ea0 {{(pid=74613) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 18:09:42 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-641fab2e-701d-4b13-b383-5b92aa060de7 tempest-AttachVolumeTestJSON-813984703 tempest-AttachVolumeTestJSON-813984703-project-member] Acquiring lock "refresh_cache-69109f06-acbf-4834-b05e-80ab6e3f6ea0" {{(pid=74613) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 18:09:42 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-641fab2e-701d-4b13-b383-5b92aa060de7 tempest-AttachVolumeTestJSON-813984703 tempest-AttachVolumeTestJSON-813984703-project-member] Acquired lock "refresh_cache-69109f06-acbf-4834-b05e-80ab6e3f6ea0" {{(pid=74613) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 18:09:42 user nova-compute[74613]: DEBUG nova.network.neutron [None req-641fab2e-701d-4b13-b383-5b92aa060de7 tempest-AttachVolumeTestJSON-813984703 tempest-AttachVolumeTestJSON-813984703-project-member] [instance: 69109f06-acbf-4834-b05e-80ab6e3f6ea0] Building network info cache for instance {{(pid=74613) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 29 18:09:42 user nova-compute[74613]: DEBUG nova.objects.instance [None req-641fab2e-701d-4b13-b383-5b92aa060de7 tempest-AttachVolumeTestJSON-813984703 tempest-AttachVolumeTestJSON-813984703-project-member] Lazy-loading 'info_cache' on Instance uuid 69109f06-acbf-4834-b05e-80ab6e3f6ea0 {{(pid=74613) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 18:09:42 user nova-compute[74613]: DEBUG nova.objects.base [None req-641fab2e-701d-4b13-b383-5b92aa060de7 tempest-AttachVolumeTestJSON-813984703 tempest-AttachVolumeTestJSON-813984703-project-member] Object Instance<69109f06-acbf-4834-b05e-80ab6e3f6ea0> lazy-loaded attributes: flavor,info_cache {{(pid=74613) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 29 18:09:43 user nova-compute[74613]: DEBUG nova.network.neutron [None req-641fab2e-701d-4b13-b383-5b92aa060de7 tempest-AttachVolumeTestJSON-813984703 tempest-AttachVolumeTestJSON-813984703-project-member] [instance: 69109f06-acbf-4834-b05e-80ab6e3f6ea0] Updating instance_info_cache with network_info: [{"id": "e8b2f9b5-0c3a-4f6f-bf96-566c8a779849", "address": "fa:16:3e:da:7a:47", "network": {"id": "21147bc8-b1ac-40d5-8fc0-8dab8ade1ff5", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1502381061-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.246", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b5dc39bc30d84269a7ad073867e36436", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape8b2f9b5-0c", "ovs_interfaceid": "e8b2f9b5-0c3a-4f6f-bf96-566c8a779849", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74613) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 18:09:43 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-641fab2e-701d-4b13-b383-5b92aa060de7 tempest-AttachVolumeTestJSON-813984703 tempest-AttachVolumeTestJSON-813984703-project-member] Releasing lock "refresh_cache-69109f06-acbf-4834-b05e-80ab6e3f6ea0" {{(pid=74613) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 18:09:43 user nova-compute[74613]: INFO nova.virt.libvirt.driver [-] [instance: 69109f06-acbf-4834-b05e-80ab6e3f6ea0] Instance destroyed successfully.
Nov 29 18:09:43 user nova-compute[74613]: DEBUG nova.objects.instance [None req-641fab2e-701d-4b13-b383-5b92aa060de7 tempest-AttachVolumeTestJSON-813984703 tempest-AttachVolumeTestJSON-813984703-project-member] Lazy-loading 'resources' on Instance uuid 69109f06-acbf-4834-b05e-80ab6e3f6ea0 {{(pid=74613) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 18:09:43 user nova-compute[74613]: DEBUG nova.objects.base [None req-641fab2e-701d-4b13-b383-5b92aa060de7 tempest-AttachVolumeTestJSON-813984703 tempest-AttachVolumeTestJSON-813984703-project-member] Object Instance<69109f06-acbf-4834-b05e-80ab6e3f6ea0> lazy-loaded attributes: flavor,info_cache,resources {{(pid=74613) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 29 18:09:43 user nova-compute[74613]: DEBUG nova.virt.libvirt.vif [None req-641fab2e-701d-4b13-b383-5b92aa060de7 tempest-AttachVolumeTestJSON-813984703 tempest-AttachVolumeTestJSON-813984703-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T18:05:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-112129053',display_name='tempest-AttachVolumeTestJSON-server-112129053',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-112129053',id=31,image_ref='4217f428-8d9d-4ee1-9614-642d26d90c46',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBiA6TF+XgKgtvk6TtvUc4C6ae4R2cFJpd7pnrnZXTn17B7mtXw3FeSD7WciMYISZgM0lnyM/Vu+rh9AL6QLxayu8zBkp18LuuA17FBMijpeZLWA1S8luzqDoaFtKzv2Kw==',key_name='tempest-keypair-1770317456',keypairs=<?>,launch_index=0,launched_at=2023-11-29T18:05:52Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='b5dc39bc30d84269a7ad073867e36436',ramdisk_id='',reservation_id='r-dq3ksvj9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='4217f428-8d9d-4ee1-9614-642d26d90c46',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-813984703',owner_user_name='tempest-AttachVolumeTestJSON-813984703-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-29T18:07:53Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='14808f06536f477b8a2b413e3cf9d18f',uuid=69109f06-acbf-4834-b05e-80ab6e3f6ea0,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "e8b2f9b5-0c3a-4f6f-bf96-566c8a779849", "address": "fa:16:3e:da:7a:47", "network": {"id": "21147bc8-b1ac-40d5-8fc0-8dab8ade1ff5", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1502381061-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.246", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b5dc39bc30d84269a7ad073867e36436", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape8b2f9b5-0c", "ovs_interfaceid": "e8b2f9b5-0c3a-4f6f-bf96-566c8a779849", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74613) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 29 18:09:43 user nova-compute[74613]: DEBUG nova.network.os_vif_util [None req-641fab2e-701d-4b13-b383-5b92aa060de7 tempest-AttachVolumeTestJSON-813984703 tempest-AttachVolumeTestJSON-813984703-project-member] Converting VIF {"id": "e8b2f9b5-0c3a-4f6f-bf96-566c8a779849", "address": "fa:16:3e:da:7a:47", "network": {"id": "21147bc8-b1ac-40d5-8fc0-8dab8ade1ff5", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1502381061-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.246", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b5dc39bc30d84269a7ad073867e36436", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape8b2f9b5-0c", "ovs_interfaceid": "e8b2f9b5-0c3a-4f6f-bf96-566c8a779849", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74613) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 18:09:43 user nova-compute[74613]: DEBUG nova.network.os_vif_util [None req-641fab2e-701d-4b13-b383-5b92aa060de7 tempest-AttachVolumeTestJSON-813984703 tempest-AttachVolumeTestJSON-813984703-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:da:7a:47,bridge_name='br-int',has_traffic_filtering=True,id=e8b2f9b5-0c3a-4f6f-bf96-566c8a779849,network=Network(21147bc8-b1ac-40d5-8fc0-8dab8ade1ff5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape8b2f9b5-0c') {{(pid=74613) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 18:09:43 user nova-compute[74613]: DEBUG os_vif [None req-641fab2e-701d-4b13-b383-5b92aa060de7 tempest-AttachVolumeTestJSON-813984703 tempest-AttachVolumeTestJSON-813984703-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:da:7a:47,bridge_name='br-int',has_traffic_filtering=True,id=e8b2f9b5-0c3a-4f6f-bf96-566c8a779849,network=Network(21147bc8-b1ac-40d5-8fc0-8dab8ade1ff5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape8b2f9b5-0c') {{(pid=74613) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 29 18:09:43 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:09:43 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tape8b2f9b5-0c, bridge=br-int, if_exists=True) {{(pid=74613) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 18:09:43 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:09:43 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:09:43 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:09:43 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=3882f5e8-156a-44b6-86ce-cf8bc975254e) {{(pid=74613) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 18:09:43 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:09:43 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 18:09:43 user nova-compute[74613]: INFO os_vif [None req-641fab2e-701d-4b13-b383-5b92aa060de7 tempest-AttachVolumeTestJSON-813984703 tempest-AttachVolumeTestJSON-813984703-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:da:7a:47,bridge_name='br-int',has_traffic_filtering=True,id=e8b2f9b5-0c3a-4f6f-bf96-566c8a779849,network=Network(21147bc8-b1ac-40d5-8fc0-8dab8ade1ff5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape8b2f9b5-0c')
Nov 29 18:09:43 user nova-compute[74613]: DEBUG nova.virt.libvirt.volume.iscsi [None req-641fab2e-701d-4b13-b383-5b92aa060de7 tempest-AttachVolumeTestJSON-813984703 tempest-AttachVolumeTestJSON-813984703-project-member] [instance: 69109f06-acbf-4834-b05e-80ab6e3f6ea0] calling os-brick to detach iSCSI Volume {{(pid=74613) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 29 18:09:43 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-641fab2e-701d-4b13-b383-5b92aa060de7 tempest-AttachVolumeTestJSON-813984703 tempest-AttachVolumeTestJSON-813984703-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff828156890>, {'target_iqn': 'iqn.2010-10.org.openstack:b2879f1d-797c-4701-8803-eb6369ddb534', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'grDSnlbc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, None), 'kwargs': True}}" {{(pid=74613) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 18:09:43 user nova-compute[74613]: WARNING os_brick.initiator.connectors.base [None req-641fab2e-701d-4b13-b383-5b92aa060de7 tempest-AttachVolumeTestJSON-813984703 tempest-AttachVolumeTestJSON-813984703-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 18:09:43 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.base [None req-641fab2e-701d-4b13-b383-5b92aa060de7 tempest-AttachVolumeTestJSON-813984703 tempest-AttachVolumeTestJSON-813984703-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 18:09:43 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.base [None req-641fab2e-701d-4b13-b383-5b92aa060de7 tempest-AttachVolumeTestJSON-813984703 tempest-AttachVolumeTestJSON-813984703-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 18:09:43 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:09:43 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:09:43 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[03d625b4-8b3a-4dab-9835-2c9146a8e48c]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:9511387c-8772-40f2-bf2d-6b6387649e9f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:34908494-9a6c-4c8c-b447-9768745356ca\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b2879f1d-797c-4701-8803-eb6369ddb534\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 18:09:43 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-641fab2e-701d-4b13-b383-5b92aa060de7 tempest-AttachVolumeTestJSON-813984703 tempest-AttachVolumeTestJSON-813984703-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 29 18:09:43 user nova-compute[74613]: No targets found.
Nov 29 18:09:43 user nova-compute[74613]: iSNS:
Nov 29 18:09:43 user nova-compute[74613]: No targets found.
Nov 29 18:09:43 user nova-compute[74613]: STATIC:
Nov 29 18:09:43 user nova-compute[74613]: Target: iqn.2010-10.org.openstack:9511387c-8772-40f2-bf2d-6b6387649e9f
Nov 29 18:09:43 user nova-compute[74613]:         Portal: 172.16.0.220:3260,-1
Nov 29 18:09:43 user nova-compute[74613]:                 Iface Name: default
Nov 29 18:09:43 user nova-compute[74613]: Target: iqn.2010-10.org.openstack:34908494-9a6c-4c8c-b447-9768745356ca
Nov 29 18:09:43 user nova-compute[74613]:         Portal: 172.16.0.220:3260,-1
Nov 29 18:09:43 user nova-compute[74613]:                 Iface Name: default
Nov 29 18:09:43 user nova-compute[74613]: Target: iqn.2010-10.org.openstack:b2879f1d-797c-4701-8803-eb6369ddb534
Nov 29 18:09:43 user nova-compute[74613]:         Portal: 172.16.0.220:3260,-1
Nov 29 18:09:43 user nova-compute[74613]:                 Iface Name: default
Nov 29 18:09:43 user nova-compute[74613]: FIRMWARE:
Nov 29 18:09:43 user nova-compute[74613]: No targets found.
Nov 29 18:09:43 user nova-compute[74613]:  stderr= {{(pid=74613) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 18:09:43 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-641fab2e-701d-4b13-b383-5b92aa060de7 tempest-AttachVolumeTestJSON-813984703 tempest-AttachVolumeTestJSON-813984703-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 29 18:09:43 user nova-compute[74613]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 29 18:09:43 user nova-compute[74613]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74613) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 29 18:09:43 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-641fab2e-701d-4b13-b383-5b92aa060de7 tempest-AttachVolumeTestJSON-813984703 tempest-AttachVolumeTestJSON-813984703-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b2879f1d-797c-4701-8803-eb6369ddb534', 0)] {{(pid=74613) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 29 18:09:43 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:09:43 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:09:43 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[381a623a-a6bc-4847-bd2e-78d207721365]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:34908494-9a6c-4c8c-b447-9768745356ca\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9511387c-8772-40f2-bf2d-6b6387649e9f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b2879f1d-797c-4701-8803-eb6369ddb534\n', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 18:09:43 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:09:43 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:09:43 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4e8def9-a15d-479b-88b3-2c20b8de35b1]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9511387c-8772-40f2-bf2d-6b6387649e9f (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:34908494-9a6c-4c8c-b447-9768745356ca (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2879f1d-797c-4701-8803-eb6369ddb534 (non-flash)\n', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 18:09:43 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-641fab2e-701d-4b13-b383-5b92aa060de7 tempest-AttachVolumeTestJSON-813984703 tempest-AttachVolumeTestJSON-813984703-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9511387c-8772-40f2-bf2d-6b6387649e9f (non-flash)
Nov 29 18:09:43 user nova-compute[74613]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:34908494-9a6c-4c8c-b447-9768745356ca (non-flash)
Nov 29 18:09:43 user nova-compute[74613]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2879f1d-797c-4701-8803-eb6369ddb534 (non-flash)
Nov 29 18:09:43 user nova-compute[74613]:  stderr= {{(pid=74613) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 18:09:43 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-641fab2e-701d-4b13-b383-5b92aa060de7 tempest-AttachVolumeTestJSON-813984703 tempest-AttachVolumeTestJSON-813984703-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9511387c-8772-40f2-bf2d-6b6387649e9f (non-flash)
Nov 29 18:09:43 user nova-compute[74613]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:34908494-9a6c-4c8c-b447-9768745356ca (non-flash)
Nov 29 18:09:43 user nova-compute[74613]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2879f1d-797c-4701-8803-eb6369ddb534 (non-flash)
Nov 29 18:09:43 user nova-compute[74613]:  stderr= {{(pid=74613) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 18:09:43 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-641fab2e-701d-4b13-b383-5b92aa060de7 tempest-AttachVolumeTestJSON-813984703 tempest-AttachVolumeTestJSON-813984703-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7ff7f87b0b80>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b2879f1d-797c-4701-8803-eb6369ddb534'): ({'sdf'}, set())}) {{(pid=74613) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 29 18:09:43 user nova-compute[74613]: DEBUG os_brick.initiator.linuxscsi [None req-641fab2e-701d-4b13-b383-5b92aa060de7 tempest-AttachVolumeTestJSON-813984703 tempest-AttachVolumeTestJSON-813984703-project-member] Removing single pathed devices sdf {{(pid=74613) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 29 18:09:43 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:09:43 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:09:43 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1b7ae44-8246-4163-81e7-0a734164e338]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 18:09:43 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:09:43 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.023s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:09:43 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[109fcb14-8825-4620-b525-334e562a1503]: (4, ('ok\n', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 18:09:43 user nova-compute[74613]: DEBUG os_brick.initiator.linuxscsi [None req-641fab2e-701d-4b13-b383-5b92aa060de7 tempest-AttachVolumeTestJSON-813984703 tempest-AttachVolumeTestJSON-813984703-project-member] Flushing IO for device /dev/sdf {{(pid=74613) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 29 18:09:43 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:09:43 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.025s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:09:43 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc0e11c9-a7bc-4fa9-a8f9-b20104ba37d4]: (4, ('', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 18:09:43 user nova-compute[74613]: DEBUG os_brick.initiator.linuxscsi [None req-641fab2e-701d-4b13-b383-5b92aa060de7 tempest-AttachVolumeTestJSON-813984703 tempest-AttachVolumeTestJSON-813984703-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=74613) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 29 18:09:43 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:09:43 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.049s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:09:43 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[38b840cd-84b3-4f8b-abf2-6bd63c971555]: (4, ('1', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 18:09:43 user nova-compute[74613]: DEBUG os_brick.initiator.linuxscsi [None req-641fab2e-701d-4b13-b383-5b92aa060de7 tempest-AttachVolumeTestJSON-813984703 tempest-AttachVolumeTestJSON-813984703-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=74613) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 29 18:09:43 user nova-compute[74613]: DEBUG os_brick.initiator.linuxscsi [None req-641fab2e-701d-4b13-b383-5b92aa060de7 tempest-AttachVolumeTestJSON-813984703 tempest-AttachVolumeTestJSON-813984703-project-member] SCSI volumes sdf have been removed. {{(pid=74613) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 29 18:09:43 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-641fab2e-701d-4b13-b383-5b92aa060de7 tempest-AttachVolumeTestJSON-813984703 tempest-AttachVolumeTestJSON-813984703-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b2879f1d-797c-4701-8803-eb6369ddb534')] {{(pid=74613) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 29 18:09:43 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b2879f1d-797c-4701-8803-eb6369ddb534 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:09:43 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b2879f1d-797c-4701-8803-eb6369ddb534 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.024s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:09:43 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[807664be-f783-455d-a03e-c6dfabd9f7eb]: (4, ('', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 18:09:43 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-641fab2e-701d-4b13-b383-5b92aa060de7 tempest-AttachVolumeTestJSON-813984703 tempest-AttachVolumeTestJSON-813984703-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74613) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 18:09:43 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b2879f1d-797c-4701-8803-eb6369ddb534 -p 172.16.0.220:3260 --logout {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:09:43 user nova-compute[74613]: DEBUG nova.compute.manager [req-939e7c63-b222-444e-bac5-7550d8cef67a req-48beb37c-e59a-47c6-8538-e5737d27cff8 service nova] [instance: bdb49266-ed09-4e9a-b3af-eb4b436a71da] Received event network-changed-8e24565f-8217-4e78-a37c-53f7fd1c9742 {{(pid=74613) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 18:09:43 user nova-compute[74613]: DEBUG nova.compute.manager [req-939e7c63-b222-444e-bac5-7550d8cef67a req-48beb37c-e59a-47c6-8538-e5737d27cff8 service nova] [instance: bdb49266-ed09-4e9a-b3af-eb4b436a71da] Refreshing instance network info cache due to event network-changed-8e24565f-8217-4e78-a37c-53f7fd1c9742. {{(pid=74613) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 18:09:43 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-939e7c63-b222-444e-bac5-7550d8cef67a req-48beb37c-e59a-47c6-8538-e5737d27cff8 service nova] Acquiring lock "refresh_cache-bdb49266-ed09-4e9a-b3af-eb4b436a71da" {{(pid=74613) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 18:09:43 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-939e7c63-b222-444e-bac5-7550d8cef67a req-48beb37c-e59a-47c6-8538-e5737d27cff8 service nova] Acquired lock "refresh_cache-bdb49266-ed09-4e9a-b3af-eb4b436a71da" {{(pid=74613) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 18:09:43 user nova-compute[74613]: DEBUG nova.network.neutron [req-939e7c63-b222-444e-bac5-7550d8cef67a req-48beb37c-e59a-47c6-8538-e5737d27cff8 service nova] [instance: bdb49266-ed09-4e9a-b3af-eb4b436a71da] Refreshing network info cache for port 8e24565f-8217-4e78-a37c-53f7fd1c9742 {{(pid=74613) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 18:09:43 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b2879f1d-797c-4701-8803-eb6369ddb534 -p 172.16.0.220:3260 --logout" returned: 0 in 0.058s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:09:43 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c93208a-076f-4b8a-8195-e187458b66db]: (4, ('Logging out of session [sid: 36, target: iqn.2010-10.org.openstack:b2879f1d-797c-4701-8803-eb6369ddb534, portal: 172.16.0.220,3260]\nLogout of [sid: 36, target: iqn.2010-10.org.openstack:b2879f1d-797c-4701-8803-eb6369ddb534, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 18:09:43 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-641fab2e-701d-4b13-b383-5b92aa060de7 tempest-AttachVolumeTestJSON-813984703 tempest-AttachVolumeTestJSON-813984703-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 36, target: iqn.2010-10.org.openstack:b2879f1d-797c-4701-8803-eb6369ddb534, portal: 172.16.0.220,3260]
Nov 29 18:09:43 user nova-compute[74613]: Logout of [sid: 36, target: iqn.2010-10.org.openstack:b2879f1d-797c-4701-8803-eb6369ddb534, portal: 172.16.0.220,3260] successful.
Nov 29 18:09:43 user nova-compute[74613]:  stderr= {{(pid=74613) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 18:09:43 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b2879f1d-797c-4701-8803-eb6369ddb534 -p 172.16.0.220:3260 --op delete {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:09:43 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b2879f1d-797c-4701-8803-eb6369ddb534 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.025s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:09:43 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[d25dcb02-49e7-4cf4-806d-5a49d861816c]: (4, ('', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 18:09:43 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-641fab2e-701d-4b13-b383-5b92aa060de7 tempest-AttachVolumeTestJSON-813984703 tempest-AttachVolumeTestJSON-813984703-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74613) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 18:09:43 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.base [None req-641fab2e-701d-4b13-b383-5b92aa060de7 tempest-AttachVolumeTestJSON-813984703 tempest-AttachVolumeTestJSON-813984703-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.342s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 18:09:43 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-641fab2e-701d-4b13-b383-5b92aa060de7 tempest-AttachVolumeTestJSON-813984703 tempest-AttachVolumeTestJSON-813984703-project-member] <== disconnect_volume: return (343ms) None {{(pid=74613) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 18:09:43 user nova-compute[74613]: DEBUG nova.virt.libvirt.volume.iscsi [None req-641fab2e-701d-4b13-b383-5b92aa060de7 tempest-AttachVolumeTestJSON-813984703 tempest-AttachVolumeTestJSON-813984703-project-member] [instance: 69109f06-acbf-4834-b05e-80ab6e3f6ea0] Disconnected iSCSI Volume {{(pid=74613) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 29 18:09:43 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-641fab2e-701d-4b13-b383-5b92aa060de7 tempest-AttachVolumeTestJSON-813984703 tempest-AttachVolumeTestJSON-813984703-project-member] [instance: 69109f06-acbf-4834-b05e-80ab6e3f6ea0] Start _get_guest_xml network_info=[{"id": "e8b2f9b5-0c3a-4f6f-bf96-566c8a779849", "address": "fa:16:3e:da:7a:47", "network": {"id": "21147bc8-b1ac-40d5-8fc0-8dab8ade1ff5", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1502381061-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.246", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b5dc39bc30d84269a7ad073867e36436", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape8b2f9b5-0c", "ovs_interfaceid": "e8b2f9b5-0c3a-4f6f-bf96-566c8a779849", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=4217f428-8d9d-4ee1-9614-642d26d90c46,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'size': 0, 'device_type': 'disk', 'boot_index': 0, 'guest_format': None, 'encrypted': False, 'encryption_format': None, 'disk_bus': 'virtio', 'image_id': '4217f428-8d9d-4ee1-9614-642d26d90c46'}], 'ephemerals': [], 'block_device_mapping': [{'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:b2879f1d-797c-4701-8803-eb6369ddb534', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'grDSnlbc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, 'status': 'reserved', 'instance': '69109f06-acbf-4834-b05e-80ab6e3f6ea0', 'attached_at': '', 'detached_at': '', 'volume_id': 'b2879f1d-797c-4701-8803-eb6369ddb534', 'serial': 'b2879f1d-797c-4701-8803-eb6369ddb534'}, 'mount_device': '/dev/vdb', 'delete_on_termination': False, 'device_type': 'disk', 'boot_index': None, 'guest_format': None, 'attachment_id': '28558fbc-e64e-4ddf-82bd-8a505b0226dc', 'disk_bus': 'virtio', 'volume_type': None} {{(pid=74613) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 29 18:09:43 user nova-compute[74613]: DEBUG nova.objects.instance [None req-641fab2e-701d-4b13-b383-5b92aa060de7 tempest-AttachVolumeTestJSON-813984703 tempest-AttachVolumeTestJSON-813984703-project-member] Lazy-loading 'numa_topology' on Instance uuid 69109f06-acbf-4834-b05e-80ab6e3f6ea0 {{(pid=74613) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 18:09:43 user nova-compute[74613]: DEBUG nova.objects.base [None req-641fab2e-701d-4b13-b383-5b92aa060de7 tempest-AttachVolumeTestJSON-813984703 tempest-AttachVolumeTestJSON-813984703-project-member] Object Instance<69109f06-acbf-4834-b05e-80ab6e3f6ea0> lazy-loaded attributes: flavor,info_cache,resources,numa_topology {{(pid=74613) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 29 18:09:43 user nova-compute[74613]: WARNING nova.virt.libvirt.driver [None req-641fab2e-701d-4b13-b383-5b92aa060de7 tempest-AttachVolumeTestJSON-813984703 tempest-AttachVolumeTestJSON-813984703-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 18:09:43 user nova-compute[74613]: WARNING nova.virt.libvirt.driver [None req-641fab2e-701d-4b13-b383-5b92aa060de7 tempest-AttachVolumeTestJSON-813984703 tempest-AttachVolumeTestJSON-813984703-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 18:09:43 user nova-compute[74613]: DEBUG nova.virt.libvirt.host [None req-641fab2e-701d-4b13-b383-5b92aa060de7 tempest-AttachVolumeTestJSON-813984703 tempest-AttachVolumeTestJSON-813984703-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74613) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 29 18:09:43 user nova-compute[74613]: DEBUG nova.virt.libvirt.host [None req-641fab2e-701d-4b13-b383-5b92aa060de7 tempest-AttachVolumeTestJSON-813984703 tempest-AttachVolumeTestJSON-813984703-project-member] CPU controller missing on host. {{(pid=74613) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 29 18:09:43 user nova-compute[74613]: DEBUG nova.virt.libvirt.host [None req-641fab2e-701d-4b13-b383-5b92aa060de7 tempest-AttachVolumeTestJSON-813984703 tempest-AttachVolumeTestJSON-813984703-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74613) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 29 18:09:43 user nova-compute[74613]: DEBUG nova.virt.libvirt.host [None req-641fab2e-701d-4b13-b383-5b92aa060de7 tempest-AttachVolumeTestJSON-813984703 tempest-AttachVolumeTestJSON-813984703-project-member] CPU controller found on host. {{(pid=74613) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 29 18:09:43 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-641fab2e-701d-4b13-b383-5b92aa060de7 tempest-AttachVolumeTestJSON-813984703 tempest-AttachVolumeTestJSON-813984703-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74613) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 29 18:09:43 user nova-compute[74613]: DEBUG nova.virt.hardware [None req-641fab2e-701d-4b13-b383-5b92aa060de7 tempest-AttachVolumeTestJSON-813984703 tempest-AttachVolumeTestJSON-813984703-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-29T17:47:27Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=4217f428-8d9d-4ee1-9614-642d26d90c46,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74613) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 29 18:09:43 user nova-compute[74613]: DEBUG nova.virt.hardware [None req-641fab2e-701d-4b13-b383-5b92aa060de7 tempest-AttachVolumeTestJSON-813984703 tempest-AttachVolumeTestJSON-813984703-project-member] Flavor limits 0:0:0 {{(pid=74613) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 29 18:09:43 user nova-compute[74613]: DEBUG nova.virt.hardware [None req-641fab2e-701d-4b13-b383-5b92aa060de7 tempest-AttachVolumeTestJSON-813984703 tempest-AttachVolumeTestJSON-813984703-project-member] Image limits 0:0:0 {{(pid=74613) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 29 18:09:43 user nova-compute[74613]: DEBUG nova.virt.hardware [None req-641fab2e-701d-4b13-b383-5b92aa060de7 tempest-AttachVolumeTestJSON-813984703 tempest-AttachVolumeTestJSON-813984703-project-member] Flavor pref 0:0:0 {{(pid=74613) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 29 18:09:43 user nova-compute[74613]: DEBUG nova.virt.hardware [None req-641fab2e-701d-4b13-b383-5b92aa060de7 tempest-AttachVolumeTestJSON-813984703 tempest-AttachVolumeTestJSON-813984703-project-member] Image pref 0:0:0 {{(pid=74613) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 29 18:09:43 user nova-compute[74613]: DEBUG nova.virt.hardware [None req-641fab2e-701d-4b13-b383-5b92aa060de7 tempest-AttachVolumeTestJSON-813984703 tempest-AttachVolumeTestJSON-813984703-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74613) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 29 18:09:43 user nova-compute[74613]: DEBUG nova.virt.hardware [None req-641fab2e-701d-4b13-b383-5b92aa060de7 tempest-AttachVolumeTestJSON-813984703 tempest-AttachVolumeTestJSON-813984703-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74613) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 29 18:09:43 user nova-compute[74613]: DEBUG nova.virt.hardware [None req-641fab2e-701d-4b13-b383-5b92aa060de7 tempest-AttachVolumeTestJSON-813984703 tempest-AttachVolumeTestJSON-813984703-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74613) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 29 18:09:43 user nova-compute[74613]: DEBUG nova.virt.hardware [None req-641fab2e-701d-4b13-b383-5b92aa060de7 tempest-AttachVolumeTestJSON-813984703 tempest-AttachVolumeTestJSON-813984703-project-member] Got 1 possible topologies {{(pid=74613) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 29 18:09:43 user nova-compute[74613]: DEBUG nova.virt.hardware [None req-641fab2e-701d-4b13-b383-5b92aa060de7 tempest-AttachVolumeTestJSON-813984703 tempest-AttachVolumeTestJSON-813984703-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74613) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 29 18:09:43 user nova-compute[74613]: DEBUG nova.virt.hardware [None req-641fab2e-701d-4b13-b383-5b92aa060de7 tempest-AttachVolumeTestJSON-813984703 tempest-AttachVolumeTestJSON-813984703-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74613) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 29 18:09:43 user nova-compute[74613]: DEBUG nova.objects.instance [None req-641fab2e-701d-4b13-b383-5b92aa060de7 tempest-AttachVolumeTestJSON-813984703 tempest-AttachVolumeTestJSON-813984703-project-member] Lazy-loading 'vcpu_model' on Instance uuid 69109f06-acbf-4834-b05e-80ab6e3f6ea0 {{(pid=74613) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 18:09:43 user nova-compute[74613]: DEBUG nova.objects.base [None req-641fab2e-701d-4b13-b383-5b92aa060de7 tempest-AttachVolumeTestJSON-813984703 tempest-AttachVolumeTestJSON-813984703-project-member] Object Instance<69109f06-acbf-4834-b05e-80ab6e3f6ea0> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model {{(pid=74613) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 29 18:09:43 user nova-compute[74613]: DEBUG nova.virt.libvirt.volume.iscsi [None req-641fab2e-701d-4b13-b383-5b92aa060de7 tempest-AttachVolumeTestJSON-813984703 tempest-AttachVolumeTestJSON-813984703-project-member] [instance: 69109f06-acbf-4834-b05e-80ab6e3f6ea0] Calling os-brick to attach iSCSI Volume {{(pid=74613) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 29 18:09:43 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-641fab2e-701d-4b13-b383-5b92aa060de7 tempest-AttachVolumeTestJSON-813984703 tempest-AttachVolumeTestJSON-813984703-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff828156890>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:b2879f1d-797c-4701-8803-eb6369ddb534', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'grDSnlbc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=74613) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 18:09:43 user nova-compute[74613]: WARNING os_brick.initiator.connectors.base [None req-641fab2e-701d-4b13-b383-5b92aa060de7 tempest-AttachVolumeTestJSON-813984703 tempest-AttachVolumeTestJSON-813984703-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 18:09:43 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.base [None req-641fab2e-701d-4b13-b383-5b92aa060de7 tempest-AttachVolumeTestJSON-813984703 tempest-AttachVolumeTestJSON-813984703-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 18:09:43 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.base [None req-641fab2e-701d-4b13-b383-5b92aa060de7 tempest-AttachVolumeTestJSON-813984703 tempest-AttachVolumeTestJSON-813984703-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 18:09:43 user nova-compute[74613]: WARNING os_brick.initiator.connectors.base [None req-641fab2e-701d-4b13-b383-5b92aa060de7 tempest-AttachVolumeTestJSON-813984703 tempest-AttachVolumeTestJSON-813984703-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 18:09:43 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.base [None req-641fab2e-701d-4b13-b383-5b92aa060de7 tempest-AttachVolumeTestJSON-813984703 tempest-AttachVolumeTestJSON-813984703-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b2879f1d-797c-4701-8803-eb6369ddb534" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 18:09:43 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.base [None req-641fab2e-701d-4b13-b383-5b92aa060de7 tempest-AttachVolumeTestJSON-813984703 tempest-AttachVolumeTestJSON-813984703-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b2879f1d-797c-4701-8803-eb6369ddb534" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 18:09:43 user nova-compute[74613]: INFO os_brick.initiator.connectors.iscsi [None req-641fab2e-701d-4b13-b383-5b92aa060de7 tempest-AttachVolumeTestJSON-813984703 tempest-AttachVolumeTestJSON-813984703-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 29 18:09:43 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b2879f1d-797c-4701-8803-eb6369ddb534 -p 172.16.0.220:3260 {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:09:43 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b2879f1d-797c-4701-8803-eb6369ddb534 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:09:43 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[eeca186d-28d3-46f3-ace0-7781861e2114]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 18:09:43 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-641fab2e-701d-4b13-b383-5b92aa060de7 tempest-AttachVolumeTestJSON-813984703 tempest-AttachVolumeTestJSON-813984703-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 29 18:09:43 user nova-compute[74613]:  {{(pid=74613) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 18:09:43 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b2879f1d-797c-4701-8803-eb6369ddb534 -p 172.16.0.220:3260 --interface default --op new {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:09:43 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b2879f1d-797c-4701-8803-eb6369ddb534 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:09:43 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d7cc499-0691-403d-a732-79dc2ebe94e4]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b2879f1d-797c-4701-8803-eb6369ddb534] added\n', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 18:09:43 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-641fab2e-701d-4b13-b383-5b92aa060de7 tempest-AttachVolumeTestJSON-813984703 tempest-AttachVolumeTestJSON-813984703-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b2879f1d-797c-4701-8803-eb6369ddb534] added
Nov 29 18:09:43 user nova-compute[74613]:  stderr= {{(pid=74613) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 18:09:43 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b2879f1d-797c-4701-8803-eb6369ddb534 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:09:43 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b2879f1d-797c-4701-8803-eb6369ddb534 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.036s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:09:43 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d12de85-d071-4726-a5bc-dd79c0b50928]: (4, ('', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 18:09:43 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-641fab2e-701d-4b13-b383-5b92aa060de7 tempest-AttachVolumeTestJSON-813984703 tempest-AttachVolumeTestJSON-813984703-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74613) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 18:09:43 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b2879f1d-797c-4701-8803-eb6369ddb534 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:09:43 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b2879f1d-797c-4701-8803-eb6369ddb534 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:09:43 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[7278d33a-0783-4b44-b731-081e27a6671b]: (4, ('', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 18:09:43 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-641fab2e-701d-4b13-b383-5b92aa060de7 tempest-AttachVolumeTestJSON-813984703 tempest-AttachVolumeTestJSON-813984703-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74613) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 18:09:43 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b2879f1d-797c-4701-8803-eb6369ddb534 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v grDSnlbc {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:09:43 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b2879f1d-797c-4701-8803-eb6369ddb534 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v grDSnlbc" returned: 0 in 0.021s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:09:43 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[572b2296-a330-4754-b143-e4ca7ac00cf5]: (4, ('', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 18:09:43 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-641fab2e-701d-4b13-b383-5b92aa060de7 tempest-AttachVolumeTestJSON-813984703 tempest-AttachVolumeTestJSON-813984703-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'grDSnlbc'): stdout= stderr= {{(pid=74613) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 18:09:43 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b2879f1d-797c-4701-8803-eb6369ddb534 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:09:44 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b2879f1d-797c-4701-8803-eb6369ddb534 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.143s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:09:44 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8f561df-4ad5-4d6a-895a-c80d3ad9d67b]: (4, ('', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 18:09:44 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-641fab2e-701d-4b13-b383-5b92aa060de7 tempest-AttachVolumeTestJSON-813984703 tempest-AttachVolumeTestJSON-813984703-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74613) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 18:09:44 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:09:44 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:09:44 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e0d2da2-81df-498e-b404-9c0d23228968]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9511387c-8772-40f2-bf2d-6b6387649e9f (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:34908494-9a6c-4c8c-b447-9768745356ca (non-flash)\n', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 18:09:44 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-641fab2e-701d-4b13-b383-5b92aa060de7 tempest-AttachVolumeTestJSON-813984703 tempest-AttachVolumeTestJSON-813984703-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9511387c-8772-40f2-bf2d-6b6387649e9f (non-flash)
Nov 29 18:09:44 user nova-compute[74613]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:34908494-9a6c-4c8c-b447-9768745356ca (non-flash)
Nov 29 18:09:44 user nova-compute[74613]:  stderr= {{(pid=74613) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 18:09:44 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-641fab2e-701d-4b13-b383-5b92aa060de7 tempest-AttachVolumeTestJSON-813984703 tempest-AttachVolumeTestJSON-813984703-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9511387c-8772-40f2-bf2d-6b6387649e9f (non-flash)
Nov 29 18:09:44 user nova-compute[74613]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:34908494-9a6c-4c8c-b447-9768745356ca (non-flash)
Nov 29 18:09:44 user nova-compute[74613]:  stderr= {{(pid=74613) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 18:09:44 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b2879f1d-797c-4701-8803-eb6369ddb534 -p 172.16.0.220:3260 --login {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:09:44 user nova-compute[74613]: DEBUG nova.network.neutron [req-939e7c63-b222-444e-bac5-7550d8cef67a req-48beb37c-e59a-47c6-8538-e5737d27cff8 service nova] [instance: bdb49266-ed09-4e9a-b3af-eb4b436a71da] Updated VIF entry in instance network info cache for port 8e24565f-8217-4e78-a37c-53f7fd1c9742. {{(pid=74613) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 18:09:44 user nova-compute[74613]: DEBUG nova.network.neutron [req-939e7c63-b222-444e-bac5-7550d8cef67a req-48beb37c-e59a-47c6-8538-e5737d27cff8 service nova] [instance: bdb49266-ed09-4e9a-b3af-eb4b436a71da] Updating instance_info_cache with network_info: [{"id": "8e24565f-8217-4e78-a37c-53f7fd1c9742", "address": "fa:16:3e:32:23:9b", "network": {"id": "c317481b-f8cf-40a0-a326-836a5ea4c495", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-887666255-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.65", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "37b89c13ba1d4a94805d6af69ad26fb8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8e24565f-82", "ovs_interfaceid": "8e24565f-8217-4e78-a37c-53f7fd1c9742", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74613) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 18:09:44 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b2879f1d-797c-4701-8803-eb6369ddb534 -p 172.16.0.220:3260 --login" returned: 0 in 0.060s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:09:44 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[d36898b6-2ef6-44db-a6a1-049f31d481ac]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:b2879f1d-797c-4701-8803-eb6369ddb534, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:b2879f1d-797c-4701-8803-eb6369ddb534, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 18:09:44 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-641fab2e-701d-4b13-b383-5b92aa060de7 tempest-AttachVolumeTestJSON-813984703 tempest-AttachVolumeTestJSON-813984703-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:b2879f1d-797c-4701-8803-eb6369ddb534, portal: 172.16.0.220,3260]
Nov 29 18:09:44 user nova-compute[74613]: Login to [iface: default, target: iqn.2010-10.org.openstack:b2879f1d-797c-4701-8803-eb6369ddb534, portal: 172.16.0.220,3260] successful.
Nov 29 18:09:44 user nova-compute[74613]:  stderr= {{(pid=74613) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 18:09:44 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b2879f1d-797c-4701-8803-eb6369ddb534 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:09:44 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-939e7c63-b222-444e-bac5-7550d8cef67a req-48beb37c-e59a-47c6-8538-e5737d27cff8 service nova] Releasing lock "refresh_cache-bdb49266-ed09-4e9a-b3af-eb4b436a71da" {{(pid=74613) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 18:09:44 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b2879f1d-797c-4701-8803-eb6369ddb534 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:09:44 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2b97191-f9b2-47a1-be09-6b16015ab2c8]: (4, ('', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 18:09:44 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-641fab2e-701d-4b13-b383-5b92aa060de7 tempest-AttachVolumeTestJSON-813984703 tempest-AttachVolumeTestJSON-813984703-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74613) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 18:09:44 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:09:44 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-a33156fe-010c-489f-a2bf-223dd7a2a6de tempest-AttachVolumeNegativeTest-483083654 tempest-AttachVolumeNegativeTest-483083654-project-member] Acquiring lock "bdb49266-ed09-4e9a-b3af-eb4b436a71da" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 18:09:44 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-a33156fe-010c-489f-a2bf-223dd7a2a6de tempest-AttachVolumeNegativeTest-483083654 tempest-AttachVolumeNegativeTest-483083654-project-member] Lock "bdb49266-ed09-4e9a-b3af-eb4b436a71da" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 18:09:44 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-a33156fe-010c-489f-a2bf-223dd7a2a6de tempest-AttachVolumeNegativeTest-483083654 tempest-AttachVolumeNegativeTest-483083654-project-member] Acquiring lock "bdb49266-ed09-4e9a-b3af-eb4b436a71da-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 18:09:44 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-a33156fe-010c-489f-a2bf-223dd7a2a6de tempest-AttachVolumeNegativeTest-483083654 tempest-AttachVolumeNegativeTest-483083654-project-member] Lock "bdb49266-ed09-4e9a-b3af-eb4b436a71da-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 18:09:44 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-a33156fe-010c-489f-a2bf-223dd7a2a6de tempest-AttachVolumeNegativeTest-483083654 tempest-AttachVolumeNegativeTest-483083654-project-member] Lock "bdb49266-ed09-4e9a-b3af-eb4b436a71da-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 18:09:44 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:09:44 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[a51c1f87-cfb5-4240-b4cd-e7ee203c4424]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9511387c-8772-40f2-bf2d-6b6387649e9f (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:34908494-9a6c-4c8c-b447-9768745356ca (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2879f1d-797c-4701-8803-eb6369ddb534 (non-flash)\n', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 18:09:44 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-641fab2e-701d-4b13-b383-5b92aa060de7 tempest-AttachVolumeTestJSON-813984703 tempest-AttachVolumeTestJSON-813984703-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9511387c-8772-40f2-bf2d-6b6387649e9f (non-flash)
Nov 29 18:09:44 user nova-compute[74613]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:34908494-9a6c-4c8c-b447-9768745356ca (non-flash)
Nov 29 18:09:44 user nova-compute[74613]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2879f1d-797c-4701-8803-eb6369ddb534 (non-flash)
Nov 29 18:09:44 user nova-compute[74613]:  stderr= {{(pid=74613) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 18:09:44 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-641fab2e-701d-4b13-b383-5b92aa060de7 tempest-AttachVolumeTestJSON-813984703 tempest-AttachVolumeTestJSON-813984703-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9511387c-8772-40f2-bf2d-6b6387649e9f (non-flash)
Nov 29 18:09:44 user nova-compute[74613]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:34908494-9a6c-4c8c-b447-9768745356ca (non-flash)
Nov 29 18:09:44 user nova-compute[74613]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2879f1d-797c-4701-8803-eb6369ddb534 (non-flash)
Nov 29 18:09:44 user nova-compute[74613]:  stderr= {{(pid=74613) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 18:09:44 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.base [None req-641fab2e-701d-4b13-b383-5b92aa060de7 tempest-AttachVolumeTestJSON-813984703 tempest-AttachVolumeTestJSON-813984703-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b2879f1d-797c-4701-8803-eb6369ddb534" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.509s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 18:09:44 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-641fab2e-701d-4b13-b383-5b92aa060de7 tempest-AttachVolumeTestJSON-813984703 tempest-AttachVolumeTestJSON-813984703-project-member] Connected to 172.16.0.220:3260 {{(pid=74613) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 29 18:09:44 user nova-compute[74613]: DEBUG os_brick.initiator.linuxscsi [None req-641fab2e-701d-4b13-b383-5b92aa060de7 tempest-AttachVolumeTestJSON-813984703 tempest-AttachVolumeTestJSON-813984703-project-member] HCTL ('34', '-', '-', 0) found on session 37 with lun 0 {{(pid=74613) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 29 18:09:44 user nova-compute[74613]: DEBUG os_brick.initiator.linuxscsi [None req-641fab2e-701d-4b13-b383-5b92aa060de7 tempest-AttachVolumeTestJSON-813984703 tempest-AttachVolumeTestJSON-813984703-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=74613) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 29 18:09:44 user nova-compute[74613]: INFO nova.compute.manager [None req-a33156fe-010c-489f-a2bf-223dd7a2a6de tempest-AttachVolumeNegativeTest-483083654 tempest-AttachVolumeNegativeTest-483083654-project-member] [instance: bdb49266-ed09-4e9a-b3af-eb4b436a71da] Terminating instance
Nov 29 18:09:44 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:09:44 user nova-compute[74613]: DEBUG nova.compute.manager [None req-a33156fe-010c-489f-a2bf-223dd7a2a6de tempest-AttachVolumeNegativeTest-483083654 tempest-AttachVolumeNegativeTest-483083654-project-member] [instance: bdb49266-ed09-4e9a-b3af-eb4b436a71da] Start destroying the instance on the hypervisor. {{(pid=74613) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 29 18:09:44 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.017s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:09:44 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[02ad2711-6c1c-4336-879a-b5a66b4fa154]: (4, ('- - 0', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 18:09:44 user nova-compute[74613]: DEBUG os_brick.initiator.linuxscsi [None req-641fab2e-701d-4b13-b383-5b92aa060de7 tempest-AttachVolumeTestJSON-813984703 tempest-AttachVolumeTestJSON-813984703-project-member] Searching for a device in session 37 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=74613) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 29 18:09:44 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-641fab2e-701d-4b13-b383-5b92aa060de7 tempest-AttachVolumeTestJSON-813984703 tempest-AttachVolumeTestJSON-813984703-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:b2879f1d-797c-4701-8803-eb6369ddb534', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'grDSnlbc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'} {{(pid=74613) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 29 18:09:44 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:09:44 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:09:44 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:09:44 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:09:44 user nova-compute[74613]: INFO nova.virt.libvirt.driver [-] [instance: bdb49266-ed09-4e9a-b3af-eb4b436a71da] Instance destroyed successfully.
Nov 29 18:09:44 user nova-compute[74613]: DEBUG nova.objects.instance [None req-a33156fe-010c-489f-a2bf-223dd7a2a6de tempest-AttachVolumeNegativeTest-483083654 tempest-AttachVolumeNegativeTest-483083654-project-member] Lazy-loading 'resources' on Instance uuid bdb49266-ed09-4e9a-b3af-eb4b436a71da {{(pid=74613) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 18:09:44 user nova-compute[74613]: DEBUG nova.virt.libvirt.vif [None req-a33156fe-010c-489f-a2bf-223dd7a2a6de tempest-AttachVolumeNegativeTest-483083654 tempest-AttachVolumeNegativeTest-483083654-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T18:07:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1298686911',display_name='tempest-AttachVolumeNegativeTest-server-1298686911',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1298686911',id=33,image_ref='4217f428-8d9d-4ee1-9614-642d26d90c46',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFUyRMq62dwJK+HHdpoZ5XJMUq0BsAXYaSsvoXkfzAtWrqqK0lmE77TNB5eAkUPzByeGOhv1ex5b2IR6eoHZKW9iBiQEP2eroByZIatidQr9TjFy7qrxLYLwMWqUmzpGJA==',key_name='tempest-keypair-1140002678',keypairs=<?>,launch_index=0,launched_at=2023-11-29T18:07:59Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='37b89c13ba1d4a94805d6af69ad26fb8',ramdisk_id='',reservation_id='r-0ztjzns2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='4217f428-8d9d-4ee1-9614-642d26d90c46',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-483083654',owner_user_name='tempest-AttachVolumeNegativeTest-483083654-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-29T18:07:59Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='57b1f3743f0e4cbdae1dab9e4761511e',uuid=bdb49266-ed09-4e9a-b3af-eb4b436a71da,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "8e24565f-8217-4e78-a37c-53f7fd1c9742", "address": "fa:16:3e:32:23:9b", "network": {"id": "c317481b-f8cf-40a0-a326-836a5ea4c495", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-887666255-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "37b89c13ba1d4a94805d6af69ad26fb8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8e24565f-82", "ovs_interfaceid": "8e24565f-8217-4e78-a37c-53f7fd1c9742", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74613) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 29 18:09:44 user nova-compute[74613]: DEBUG nova.network.os_vif_util [None req-a33156fe-010c-489f-a2bf-223dd7a2a6de tempest-AttachVolumeNegativeTest-483083654 tempest-AttachVolumeNegativeTest-483083654-project-member] Converting VIF {"id": "8e24565f-8217-4e78-a37c-53f7fd1c9742", "address": "fa:16:3e:32:23:9b", "network": {"id": "c317481b-f8cf-40a0-a326-836a5ea4c495", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-887666255-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "37b89c13ba1d4a94805d6af69ad26fb8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8e24565f-82", "ovs_interfaceid": "8e24565f-8217-4e78-a37c-53f7fd1c9742", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74613) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 18:09:44 user nova-compute[74613]: DEBUG nova.network.os_vif_util [None req-a33156fe-010c-489f-a2bf-223dd7a2a6de tempest-AttachVolumeNegativeTest-483083654 tempest-AttachVolumeNegativeTest-483083654-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:32:23:9b,bridge_name='br-int',has_traffic_filtering=True,id=8e24565f-8217-4e78-a37c-53f7fd1c9742,network=Network(c317481b-f8cf-40a0-a326-836a5ea4c495),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8e24565f-82') {{(pid=74613) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 18:09:44 user nova-compute[74613]: DEBUG os_vif [None req-a33156fe-010c-489f-a2bf-223dd7a2a6de tempest-AttachVolumeNegativeTest-483083654 tempest-AttachVolumeNegativeTest-483083654-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:32:23:9b,bridge_name='br-int',has_traffic_filtering=True,id=8e24565f-8217-4e78-a37c-53f7fd1c9742,network=Network(c317481b-f8cf-40a0-a326-836a5ea4c495),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8e24565f-82') {{(pid=74613) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 29 18:09:44 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:09:44 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap8e24565f-82, bridge=br-int, if_exists=True) {{(pid=74613) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 18:09:44 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:09:44 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:09:44 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:09:44 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=ff9f1493-3716-4c8c-aa40-184f4ba90c74) {{(pid=74613) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 18:09:44 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:09:44 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 18:09:44 user nova-compute[74613]: INFO os_vif [None req-a33156fe-010c-489f-a2bf-223dd7a2a6de tempest-AttachVolumeNegativeTest-483083654 tempest-AttachVolumeNegativeTest-483083654-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:32:23:9b,bridge_name='br-int',has_traffic_filtering=True,id=8e24565f-8217-4e78-a37c-53f7fd1c9742,network=Network(c317481b-f8cf-40a0-a326-836a5ea4c495),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8e24565f-82')
Nov 29 18:09:44 user nova-compute[74613]: INFO nova.virt.libvirt.driver [None req-a33156fe-010c-489f-a2bf-223dd7a2a6de tempest-AttachVolumeNegativeTest-483083654 tempest-AttachVolumeNegativeTest-483083654-project-member] [instance: bdb49266-ed09-4e9a-b3af-eb4b436a71da] Deleting instance files /opt/stack/data/nova/instances/bdb49266-ed09-4e9a-b3af-eb4b436a71da_del
Nov 29 18:09:44 user nova-compute[74613]: INFO nova.virt.libvirt.driver [None req-a33156fe-010c-489f-a2bf-223dd7a2a6de tempest-AttachVolumeNegativeTest-483083654 tempest-AttachVolumeNegativeTest-483083654-project-member] [instance: bdb49266-ed09-4e9a-b3af-eb4b436a71da] Deletion of /opt/stack/data/nova/instances/bdb49266-ed09-4e9a-b3af-eb4b436a71da_del complete
Nov 29 18:09:44 user nova-compute[74613]: INFO nova.compute.manager [None req-a33156fe-010c-489f-a2bf-223dd7a2a6de tempest-AttachVolumeNegativeTest-483083654 tempest-AttachVolumeNegativeTest-483083654-project-member] [instance: bdb49266-ed09-4e9a-b3af-eb4b436a71da] Took 0.68 seconds to destroy the instance on the hypervisor.
Nov 29 18:09:44 user nova-compute[74613]: DEBUG oslo.service.loopingcall [None req-a33156fe-010c-489f-a2bf-223dd7a2a6de tempest-AttachVolumeNegativeTest-483083654 tempest-AttachVolumeNegativeTest-483083654-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74613) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 29 18:09:44 user nova-compute[74613]: DEBUG nova.compute.manager [-] [instance: bdb49266-ed09-4e9a-b3af-eb4b436a71da] Deallocating network for instance {{(pid=74613) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 29 18:09:44 user nova-compute[74613]: DEBUG nova.network.neutron [-] [instance: bdb49266-ed09-4e9a-b3af-eb4b436a71da] deallocate_for_instance() {{(pid=74613) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 29 18:09:45 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.base [None req-641fab2e-701d-4b13-b383-5b92aa060de7 tempest-AttachVolumeTestJSON-813984703 tempest-AttachVolumeTestJSON-813984703-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.543s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 18:09:45 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-641fab2e-701d-4b13-b383-5b92aa060de7 tempest-AttachVolumeTestJSON-813984703 tempest-AttachVolumeTestJSON-813984703-project-member] <== connect_volume: return (1545ms) {'type': 'block', 'scsi_wwn': '23933336166316530', 'path': '/dev/sdc'} {{(pid=74613) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 18:09:45 user nova-compute[74613]: DEBUG nova.virt.libvirt.volume.iscsi [None req-641fab2e-701d-4b13-b383-5b92aa060de7 tempest-AttachVolumeTestJSON-813984703 tempest-AttachVolumeTestJSON-813984703-project-member] [instance: 69109f06-acbf-4834-b05e-80ab6e3f6ea0] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23933336166316530', 'path': '/dev/sdc'} {{(pid=74613) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 29 18:09:45 user nova-compute[74613]: DEBUG nova.virt.libvirt.vif [None req-641fab2e-701d-4b13-b383-5b92aa060de7 tempest-AttachVolumeTestJSON-813984703 tempest-AttachVolumeTestJSON-813984703-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T18:05:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-112129053',display_name='tempest-AttachVolumeTestJSON-server-112129053',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-112129053',id=31,image_ref='4217f428-8d9d-4ee1-9614-642d26d90c46',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBiA6TF+XgKgtvk6TtvUc4C6ae4R2cFJpd7pnrnZXTn17B7mtXw3FeSD7WciMYISZgM0lnyM/Vu+rh9AL6QLxayu8zBkp18LuuA17FBMijpeZLWA1S8luzqDoaFtKzv2Kw==',key_name='tempest-keypair-1770317456',keypairs=<?>,launch_index=0,launched_at=2023-11-29T18:05:52Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='b5dc39bc30d84269a7ad073867e36436',ramdisk_id='',reservation_id='r-dq3ksvj9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='4217f428-8d9d-4ee1-9614-642d26d90c46',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-813984703',owner_user_name='tempest-AttachVolumeTestJSON-813984703-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-29T18:07:53Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='14808f06536f477b8a2b413e3cf9d18f',uuid=69109f06-acbf-4834-b05e-80ab6e3f6ea0,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "e8b2f9b5-0c3a-4f6f-bf96-566c8a779849", "address": "fa:16:3e:da:7a:47", "network": {"id": "21147bc8-b1ac-40d5-8fc0-8dab8ade1ff5", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1502381061-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.246", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b5dc39bc30d84269a7ad073867e36436", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape8b2f9b5-0c", "ovs_interfaceid": "e8b2f9b5-0c3a-4f6f-bf96-566c8a779849", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74613) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 29 18:09:45 user nova-compute[74613]: DEBUG nova.network.os_vif_util [None req-641fab2e-701d-4b13-b383-5b92aa060de7 tempest-AttachVolumeTestJSON-813984703 tempest-AttachVolumeTestJSON-813984703-project-member] Converting VIF {"id": "e8b2f9b5-0c3a-4f6f-bf96-566c8a779849", "address": "fa:16:3e:da:7a:47", "network": {"id": "21147bc8-b1ac-40d5-8fc0-8dab8ade1ff5", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1502381061-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.246", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b5dc39bc30d84269a7ad073867e36436", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape8b2f9b5-0c", "ovs_interfaceid": "e8b2f9b5-0c3a-4f6f-bf96-566c8a779849", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74613) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 18:09:45 user nova-compute[74613]: DEBUG nova.network.os_vif_util [None req-641fab2e-701d-4b13-b383-5b92aa060de7 tempest-AttachVolumeTestJSON-813984703 tempest-AttachVolumeTestJSON-813984703-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:da:7a:47,bridge_name='br-int',has_traffic_filtering=True,id=e8b2f9b5-0c3a-4f6f-bf96-566c8a779849,network=Network(21147bc8-b1ac-40d5-8fc0-8dab8ade1ff5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape8b2f9b5-0c') {{(pid=74613) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 18:09:45 user nova-compute[74613]: DEBUG nova.objects.instance [None req-641fab2e-701d-4b13-b383-5b92aa060de7 tempest-AttachVolumeTestJSON-813984703 tempest-AttachVolumeTestJSON-813984703-project-member] Lazy-loading 'pci_devices' on Instance uuid 69109f06-acbf-4834-b05e-80ab6e3f6ea0 {{(pid=74613) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 18:09:45 user nova-compute[74613]: DEBUG nova.objects.base [None req-641fab2e-701d-4b13-b383-5b92aa060de7 tempest-AttachVolumeTestJSON-813984703 tempest-AttachVolumeTestJSON-813984703-project-member] Object Instance<69109f06-acbf-4834-b05e-80ab6e3f6ea0> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model,pci_devices {{(pid=74613) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 29 18:09:45 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-641fab2e-701d-4b13-b383-5b92aa060de7 tempest-AttachVolumeTestJSON-813984703 tempest-AttachVolumeTestJSON-813984703-project-member] [instance: 69109f06-acbf-4834-b05e-80ab6e3f6ea0] End _get_guest_xml xml=<domain type="kvm">
Nov 29 18:09:45 user nova-compute[74613]:   <uuid>69109f06-acbf-4834-b05e-80ab6e3f6ea0</uuid>
Nov 29 18:09:45 user nova-compute[74613]:   <name>instance-0000001f</name>
Nov 29 18:09:45 user nova-compute[74613]:   <memory>524288</memory>
Nov 29 18:09:45 user nova-compute[74613]:   <vcpu>1</vcpu>
Nov 29 18:09:45 user nova-compute[74613]:   <metadata>
Nov 29 18:09:45 user nova-compute[74613]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 29 18:09:45 user nova-compute[74613]:       <nova:package version="0.0.0"/>
Nov 29 18:09:45 user nova-compute[74613]:       <nova:name>tempest-AttachVolumeTestJSON-server-112129053</nova:name>
Nov 29 18:09:45 user nova-compute[74613]:       <nova:creationTime>2023-11-29 18:09:43</nova:creationTime>
Nov 29 18:09:45 user nova-compute[74613]:       <nova:flavor name="m1.tiny">
Nov 29 18:09:45 user nova-compute[74613]:         <nova:memory>512</nova:memory>
Nov 29 18:09:45 user nova-compute[74613]:         <nova:disk>1</nova:disk>
Nov 29 18:09:45 user nova-compute[74613]:         <nova:swap>0</nova:swap>
Nov 29 18:09:45 user nova-compute[74613]:         <nova:ephemeral>0</nova:ephemeral>
Nov 29 18:09:45 user nova-compute[74613]:         <nova:vcpus>1</nova:vcpus>
Nov 29 18:09:45 user nova-compute[74613]:       </nova:flavor>
Nov 29 18:09:45 user nova-compute[74613]:       <nova:owner>
Nov 29 18:09:45 user nova-compute[74613]:         <nova:user uuid="14808f06536f477b8a2b413e3cf9d18f">tempest-AttachVolumeTestJSON-813984703-project-member</nova:user>
Nov 29 18:09:45 user nova-compute[74613]:         <nova:project uuid="b5dc39bc30d84269a7ad073867e36436">tempest-AttachVolumeTestJSON-813984703</nova:project>
Nov 29 18:09:45 user nova-compute[74613]:       </nova:owner>
Nov 29 18:09:45 user nova-compute[74613]:       <nova:root type="image" uuid="4217f428-8d9d-4ee1-9614-642d26d90c46"/>
Nov 29 18:09:45 user nova-compute[74613]:       <nova:ports>
Nov 29 18:09:45 user nova-compute[74613]:         <nova:port uuid="e8b2f9b5-0c3a-4f6f-bf96-566c8a779849">
Nov 29 18:09:45 user nova-compute[74613]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Nov 29 18:09:45 user nova-compute[74613]:         </nova:port>
Nov 29 18:09:45 user nova-compute[74613]:       </nova:ports>
Nov 29 18:09:45 user nova-compute[74613]:     </nova:instance>
Nov 29 18:09:45 user nova-compute[74613]:   </metadata>
Nov 29 18:09:45 user nova-compute[74613]:   <sysinfo type="smbios">
Nov 29 18:09:45 user nova-compute[74613]:     <system>
Nov 29 18:09:45 user nova-compute[74613]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 29 18:09:45 user nova-compute[74613]:       <entry name="product">OpenStack Nova</entry>
Nov 29 18:09:45 user nova-compute[74613]:       <entry name="version">0.0.0</entry>
Nov 29 18:09:45 user nova-compute[74613]:       <entry name="serial">69109f06-acbf-4834-b05e-80ab6e3f6ea0</entry>
Nov 29 18:09:45 user nova-compute[74613]:       <entry name="uuid">69109f06-acbf-4834-b05e-80ab6e3f6ea0</entry>
Nov 29 18:09:45 user nova-compute[74613]:       <entry name="family">Virtual Machine</entry>
Nov 29 18:09:45 user nova-compute[74613]:     </system>
Nov 29 18:09:45 user nova-compute[74613]:   </sysinfo>
Nov 29 18:09:45 user nova-compute[74613]:   <os>
Nov 29 18:09:45 user nova-compute[74613]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 29 18:09:45 user nova-compute[74613]:     <boot dev="hd"/>
Nov 29 18:09:45 user nova-compute[74613]:     <smbios mode="sysinfo"/>
Nov 29 18:09:45 user nova-compute[74613]:   </os>
Nov 29 18:09:45 user nova-compute[74613]:   <features>
Nov 29 18:09:45 user nova-compute[74613]:     <acpi/>
Nov 29 18:09:45 user nova-compute[74613]:     <apic/>
Nov 29 18:09:45 user nova-compute[74613]:     <vmcoreinfo/>
Nov 29 18:09:45 user nova-compute[74613]:   </features>
Nov 29 18:09:45 user nova-compute[74613]:   <clock offset="utc">
Nov 29 18:09:45 user nova-compute[74613]:     <timer name="pit" tickpolicy="delay"/>
Nov 29 18:09:45 user nova-compute[74613]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 29 18:09:45 user nova-compute[74613]:     <timer name="hpet" present="no"/>
Nov 29 18:09:45 user nova-compute[74613]:   </clock>
Nov 29 18:09:45 user nova-compute[74613]:   <cpu mode="custom" match="exact">
Nov 29 18:09:45 user nova-compute[74613]:     <model>Nehalem</model>
Nov 29 18:09:45 user nova-compute[74613]:     <topology sockets="1" cores="1" threads="1"/>
Nov 29 18:09:45 user nova-compute[74613]:   </cpu>
Nov 29 18:09:45 user nova-compute[74613]:   <devices>
Nov 29 18:09:45 user nova-compute[74613]:     <disk type="file" device="disk">
Nov 29 18:09:45 user nova-compute[74613]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 29 18:09:45 user nova-compute[74613]:       <source file="/opt/stack/data/nova/instances/69109f06-acbf-4834-b05e-80ab6e3f6ea0/disk"/>
Nov 29 18:09:45 user nova-compute[74613]:       <target dev="vda" bus="virtio"/>
Nov 29 18:09:45 user nova-compute[74613]:     </disk>
Nov 29 18:09:45 user nova-compute[74613]:     <disk type="block" device="disk">
Nov 29 18:09:45 user nova-compute[74613]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 18:09:45 user nova-compute[74613]:       <source dev="/dev/sdc"/>
Nov 29 18:09:45 user nova-compute[74613]:       <target dev="vdb" bus="virtio"/>
Nov 29 18:09:45 user nova-compute[74613]:       <serial>b2879f1d-797c-4701-8803-eb6369ddb534</serial>
Nov 29 18:09:45 user nova-compute[74613]:     </disk>
Nov 29 18:09:45 user nova-compute[74613]:     <interface type="ethernet">
Nov 29 18:09:45 user nova-compute[74613]:       <mac address="fa:16:3e:da:7a:47"/>
Nov 29 18:09:45 user nova-compute[74613]:       <model type="virtio"/>
Nov 29 18:09:45 user nova-compute[74613]:       <mtu size="1442"/>
Nov 29 18:09:45 user nova-compute[74613]:       <target dev="tape8b2f9b5-0c"/>
Nov 29 18:09:45 user nova-compute[74613]:     </interface>
Nov 29 18:09:45 user nova-compute[74613]:     <serial type="pty">
Nov 29 18:09:45 user nova-compute[74613]:       <log file="/opt/stack/data/nova/instances/69109f06-acbf-4834-b05e-80ab6e3f6ea0/console.log" append="off"/>
Nov 29 18:09:45 user nova-compute[74613]:     </serial>
Nov 29 18:09:45 user nova-compute[74613]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 29 18:09:45 user nova-compute[74613]:     <video>
Nov 29 18:09:45 user nova-compute[74613]:       <model type="virtio"/>
Nov 29 18:09:45 user nova-compute[74613]:     </video>
Nov 29 18:09:45 user nova-compute[74613]:     <rng model="virtio">
Nov 29 18:09:45 user nova-compute[74613]:       <backend model="random">/dev/urandom</backend>
Nov 29 18:09:45 user nova-compute[74613]:     </rng>
Nov 29 18:09:45 user nova-compute[74613]:     <controller type="usb" index="0" model="none"/>
Nov 29 18:09:45 user nova-compute[74613]:     <memballoon model="virtio">
Nov 29 18:09:45 user nova-compute[74613]:       <stats period="10"/>
Nov 29 18:09:45 user nova-compute[74613]:     </memballoon>
Nov 29 18:09:45 user nova-compute[74613]:   </devices>
Nov 29 18:09:45 user nova-compute[74613]: </domain>
Nov 29 18:09:45 user nova-compute[74613]:  {{(pid=74613) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 29 18:09:45 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-641fab2e-701d-4b13-b383-5b92aa060de7 tempest-AttachVolumeTestJSON-813984703 tempest-AttachVolumeTestJSON-813984703-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/69109f06-acbf-4834-b05e-80ab6e3f6ea0/disk --force-share --output=json {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:09:45 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-641fab2e-701d-4b13-b383-5b92aa060de7 tempest-AttachVolumeTestJSON-813984703 tempest-AttachVolumeTestJSON-813984703-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/69109f06-acbf-4834-b05e-80ab6e3f6ea0/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:09:45 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-641fab2e-701d-4b13-b383-5b92aa060de7 tempest-AttachVolumeTestJSON-813984703 tempest-AttachVolumeTestJSON-813984703-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/69109f06-acbf-4834-b05e-80ab6e3f6ea0/disk --force-share --output=json {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:09:45 user nova-compute[74613]: DEBUG nova.compute.manager [req-a6b6bcf5-3ed9-46f7-8f42-19bfc4c92def req-c8d76a39-3c56-4f36-a855-c9f257ffcc50 service nova] [instance: bdb49266-ed09-4e9a-b3af-eb4b436a71da] Received event network-vif-unplugged-8e24565f-8217-4e78-a37c-53f7fd1c9742 {{(pid=74613) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 18:09:45 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-a6b6bcf5-3ed9-46f7-8f42-19bfc4c92def req-c8d76a39-3c56-4f36-a855-c9f257ffcc50 service nova] Acquiring lock "bdb49266-ed09-4e9a-b3af-eb4b436a71da-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 18:09:45 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-a6b6bcf5-3ed9-46f7-8f42-19bfc4c92def req-c8d76a39-3c56-4f36-a855-c9f257ffcc50 service nova] Lock "bdb49266-ed09-4e9a-b3af-eb4b436a71da-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 18:09:45 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-a6b6bcf5-3ed9-46f7-8f42-19bfc4c92def req-c8d76a39-3c56-4f36-a855-c9f257ffcc50 service nova] Lock "bdb49266-ed09-4e9a-b3af-eb4b436a71da-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 18:09:45 user nova-compute[74613]: DEBUG nova.compute.manager [req-a6b6bcf5-3ed9-46f7-8f42-19bfc4c92def req-c8d76a39-3c56-4f36-a855-c9f257ffcc50 service nova] [instance: bdb49266-ed09-4e9a-b3af-eb4b436a71da] No waiting events found dispatching network-vif-unplugged-8e24565f-8217-4e78-a37c-53f7fd1c9742 {{(pid=74613) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 18:09:45 user nova-compute[74613]: DEBUG nova.compute.manager [req-a6b6bcf5-3ed9-46f7-8f42-19bfc4c92def req-c8d76a39-3c56-4f36-a855-c9f257ffcc50 service nova] [instance: bdb49266-ed09-4e9a-b3af-eb4b436a71da] Received event network-vif-unplugged-8e24565f-8217-4e78-a37c-53f7fd1c9742 for instance with task_state deleting. {{(pid=74613) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 29 18:09:45 user nova-compute[74613]: DEBUG nova.compute.manager [req-a6b6bcf5-3ed9-46f7-8f42-19bfc4c92def req-c8d76a39-3c56-4f36-a855-c9f257ffcc50 service nova] [instance: bdb49266-ed09-4e9a-b3af-eb4b436a71da] Received event network-vif-plugged-8e24565f-8217-4e78-a37c-53f7fd1c9742 {{(pid=74613) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 18:09:45 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-a6b6bcf5-3ed9-46f7-8f42-19bfc4c92def req-c8d76a39-3c56-4f36-a855-c9f257ffcc50 service nova] Acquiring lock "bdb49266-ed09-4e9a-b3af-eb4b436a71da-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 18:09:45 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-a6b6bcf5-3ed9-46f7-8f42-19bfc4c92def req-c8d76a39-3c56-4f36-a855-c9f257ffcc50 service nova] Lock "bdb49266-ed09-4e9a-b3af-eb4b436a71da-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 18:09:45 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-a6b6bcf5-3ed9-46f7-8f42-19bfc4c92def req-c8d76a39-3c56-4f36-a855-c9f257ffcc50 service nova] Lock "bdb49266-ed09-4e9a-b3af-eb4b436a71da-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 18:09:45 user nova-compute[74613]: DEBUG nova.compute.manager [req-a6b6bcf5-3ed9-46f7-8f42-19bfc4c92def req-c8d76a39-3c56-4f36-a855-c9f257ffcc50 service nova] [instance: bdb49266-ed09-4e9a-b3af-eb4b436a71da] No waiting events found dispatching network-vif-plugged-8e24565f-8217-4e78-a37c-53f7fd1c9742 {{(pid=74613) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 18:09:45 user nova-compute[74613]: WARNING nova.compute.manager [req-a6b6bcf5-3ed9-46f7-8f42-19bfc4c92def req-c8d76a39-3c56-4f36-a855-c9f257ffcc50 service nova] [instance: bdb49266-ed09-4e9a-b3af-eb4b436a71da] Received unexpected event network-vif-plugged-8e24565f-8217-4e78-a37c-53f7fd1c9742 for instance with vm_state active and task_state deleting.
Nov 29 18:09:45 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:09:45 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-641fab2e-701d-4b13-b383-5b92aa060de7 tempest-AttachVolumeTestJSON-813984703 tempest-AttachVolumeTestJSON-813984703-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/69109f06-acbf-4834-b05e-80ab6e3f6ea0/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:09:45 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-641fab2e-701d-4b13-b383-5b92aa060de7 tempest-AttachVolumeTestJSON-813984703 tempest-AttachVolumeTestJSON-813984703-project-member] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=74613) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 29 18:09:45 user nova-compute[74613]: DEBUG nova.objects.instance [None req-641fab2e-701d-4b13-b383-5b92aa060de7 tempest-AttachVolumeTestJSON-813984703 tempest-AttachVolumeTestJSON-813984703-project-member] Lazy-loading 'trusted_certs' on Instance uuid 69109f06-acbf-4834-b05e-80ab6e3f6ea0 {{(pid=74613) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 18:09:45 user nova-compute[74613]: DEBUG nova.objects.base [None req-641fab2e-701d-4b13-b383-5b92aa060de7 tempest-AttachVolumeTestJSON-813984703 tempest-AttachVolumeTestJSON-813984703-project-member] Object Instance<69109f06-acbf-4834-b05e-80ab6e3f6ea0> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model,pci_devices,trusted_certs {{(pid=74613) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 29 18:09:45 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-641fab2e-701d-4b13-b383-5b92aa060de7 tempest-AttachVolumeTestJSON-813984703 tempest-AttachVolumeTestJSON-813984703-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/21faea9e6951f3bdd0153b76ac89fe1a60a34758 --force-share --output=json {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:09:45 user nova-compute[74613]: DEBUG nova.network.neutron [-] [instance: bdb49266-ed09-4e9a-b3af-eb4b436a71da] Updating instance_info_cache with network_info: [] {{(pid=74613) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 18:09:45 user nova-compute[74613]: DEBUG nova.compute.manager [req-f8d8e680-e9c9-4f4c-bb1b-604151dbdc85 req-f072e9e3-f97b-46b1-8861-7e27a4cfa6ab service nova] [instance: bdb49266-ed09-4e9a-b3af-eb4b436a71da] Received event network-vif-deleted-8e24565f-8217-4e78-a37c-53f7fd1c9742 {{(pid=74613) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 18:09:45 user nova-compute[74613]: INFO nova.compute.manager [req-f8d8e680-e9c9-4f4c-bb1b-604151dbdc85 req-f072e9e3-f97b-46b1-8861-7e27a4cfa6ab service nova] [instance: bdb49266-ed09-4e9a-b3af-eb4b436a71da] Neutron deleted interface 8e24565f-8217-4e78-a37c-53f7fd1c9742; detaching it from the instance and deleting it from the info cache
Nov 29 18:09:45 user nova-compute[74613]: DEBUG nova.network.neutron [req-f8d8e680-e9c9-4f4c-bb1b-604151dbdc85 req-f072e9e3-f97b-46b1-8861-7e27a4cfa6ab service nova] [instance: bdb49266-ed09-4e9a-b3af-eb4b436a71da] Updating instance_info_cache with network_info: [] {{(pid=74613) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 18:09:45 user nova-compute[74613]: INFO nova.compute.manager [-] [instance: bdb49266-ed09-4e9a-b3af-eb4b436a71da] Took 0.93 seconds to deallocate network for instance.
Nov 29 18:09:46 user nova-compute[74613]: DEBUG nova.compute.manager [req-f8d8e680-e9c9-4f4c-bb1b-604151dbdc85 req-f072e9e3-f97b-46b1-8861-7e27a4cfa6ab service nova] [instance: bdb49266-ed09-4e9a-b3af-eb4b436a71da] Detach interface failed, port_id=8e24565f-8217-4e78-a37c-53f7fd1c9742, reason: Instance bdb49266-ed09-4e9a-b3af-eb4b436a71da could not be found. {{(pid=74613) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 29 18:09:46 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-a33156fe-010c-489f-a2bf-223dd7a2a6de tempest-AttachVolumeNegativeTest-483083654 tempest-AttachVolumeNegativeTest-483083654-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 18:09:46 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-a33156fe-010c-489f-a2bf-223dd7a2a6de tempest-AttachVolumeNegativeTest-483083654 tempest-AttachVolumeNegativeTest-483083654-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 18:09:46 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-641fab2e-701d-4b13-b383-5b92aa060de7 tempest-AttachVolumeTestJSON-813984703 tempest-AttachVolumeTestJSON-813984703-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/21faea9e6951f3bdd0153b76ac89fe1a60a34758 --force-share --output=json" returned: 0 in 0.467s {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:09:46 user nova-compute[74613]: DEBUG nova.virt.disk.api [None req-641fab2e-701d-4b13-b383-5b92aa060de7 tempest-AttachVolumeTestJSON-813984703 tempest-AttachVolumeTestJSON-813984703-project-member] Checking if we can resize image /opt/stack/data/nova/instances/69109f06-acbf-4834-b05e-80ab6e3f6ea0/disk. size=1073741824 {{(pid=74613) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 29 18:09:46 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-641fab2e-701d-4b13-b383-5b92aa060de7 tempest-AttachVolumeTestJSON-813984703 tempest-AttachVolumeTestJSON-813984703-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/69109f06-acbf-4834-b05e-80ab6e3f6ea0/disk --force-share --output=json {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:09:46 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-641fab2e-701d-4b13-b383-5b92aa060de7 tempest-AttachVolumeTestJSON-813984703 tempest-AttachVolumeTestJSON-813984703-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/69109f06-acbf-4834-b05e-80ab6e3f6ea0/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:09:46 user nova-compute[74613]: DEBUG nova.virt.disk.api [None req-641fab2e-701d-4b13-b383-5b92aa060de7 tempest-AttachVolumeTestJSON-813984703 tempest-AttachVolumeTestJSON-813984703-project-member] Cannot resize image /opt/stack/data/nova/instances/69109f06-acbf-4834-b05e-80ab6e3f6ea0/disk to a smaller size. {{(pid=74613) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 29 18:09:46 user nova-compute[74613]: DEBUG nova.objects.instance [None req-641fab2e-701d-4b13-b383-5b92aa060de7 tempest-AttachVolumeTestJSON-813984703 tempest-AttachVolumeTestJSON-813984703-project-member] Lazy-loading 'migration_context' on Instance uuid 69109f06-acbf-4834-b05e-80ab6e3f6ea0 {{(pid=74613) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 18:09:46 user nova-compute[74613]: DEBUG nova.objects.base [None req-641fab2e-701d-4b13-b383-5b92aa060de7 tempest-AttachVolumeTestJSON-813984703 tempest-AttachVolumeTestJSON-813984703-project-member] Object Instance<69109f06-acbf-4834-b05e-80ab6e3f6ea0> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model,pci_devices,trusted_certs,migration_context {{(pid=74613) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 29 18:09:46 user nova-compute[74613]: DEBUG nova.virt.libvirt.vif [None req-641fab2e-701d-4b13-b383-5b92aa060de7 tempest-AttachVolumeTestJSON-813984703 tempest-AttachVolumeTestJSON-813984703-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T18:05:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-112129053',display_name='tempest-AttachVolumeTestJSON-server-112129053',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-112129053',id=31,image_ref='4217f428-8d9d-4ee1-9614-642d26d90c46',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBiA6TF+XgKgtvk6TtvUc4C6ae4R2cFJpd7pnrnZXTn17B7mtXw3FeSD7WciMYISZgM0lnyM/Vu+rh9AL6QLxayu8zBkp18LuuA17FBMijpeZLWA1S8luzqDoaFtKzv2Kw==',key_name='tempest-keypair-1770317456',keypairs=<?>,launch_index=0,launched_at=2023-11-29T18:05:52Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=<?>,power_state=4,progress=0,project_id='b5dc39bc30d84269a7ad073867e36436',ramdisk_id='',reservation_id='r-dq3ksvj9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='4217f428-8d9d-4ee1-9614-642d26d90c46',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-813984703',owner_user_name='tempest-AttachVolumeTestJSON-813984703-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T18:07:53Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='14808f06536f477b8a2b413e3cf9d18f',uuid=69109f06-acbf-4834-b05e-80ab6e3f6ea0,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "e8b2f9b5-0c3a-4f6f-bf96-566c8a779849", "address": "fa:16:3e:da:7a:47", "network": {"id": "21147bc8-b1ac-40d5-8fc0-8dab8ade1ff5", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1502381061-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.246", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b5dc39bc30d84269a7ad073867e36436", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape8b2f9b5-0c", "ovs_interfaceid": "e8b2f9b5-0c3a-4f6f-bf96-566c8a779849", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74613) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 29 18:09:46 user nova-compute[74613]: DEBUG nova.network.os_vif_util [None req-641fab2e-701d-4b13-b383-5b92aa060de7 tempest-AttachVolumeTestJSON-813984703 tempest-AttachVolumeTestJSON-813984703-project-member] Converting VIF {"id": "e8b2f9b5-0c3a-4f6f-bf96-566c8a779849", "address": "fa:16:3e:da:7a:47", "network": {"id": "21147bc8-b1ac-40d5-8fc0-8dab8ade1ff5", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1502381061-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.246", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b5dc39bc30d84269a7ad073867e36436", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape8b2f9b5-0c", "ovs_interfaceid": "e8b2f9b5-0c3a-4f6f-bf96-566c8a779849", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74613) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 18:09:46 user nova-compute[74613]: DEBUG nova.network.os_vif_util [None req-641fab2e-701d-4b13-b383-5b92aa060de7 tempest-AttachVolumeTestJSON-813984703 tempest-AttachVolumeTestJSON-813984703-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:da:7a:47,bridge_name='br-int',has_traffic_filtering=True,id=e8b2f9b5-0c3a-4f6f-bf96-566c8a779849,network=Network(21147bc8-b1ac-40d5-8fc0-8dab8ade1ff5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape8b2f9b5-0c') {{(pid=74613) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 18:09:46 user nova-compute[74613]: DEBUG os_vif [None req-641fab2e-701d-4b13-b383-5b92aa060de7 tempest-AttachVolumeTestJSON-813984703 tempest-AttachVolumeTestJSON-813984703-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:da:7a:47,bridge_name='br-int',has_traffic_filtering=True,id=e8b2f9b5-0c3a-4f6f-bf96-566c8a779849,network=Network(21147bc8-b1ac-40d5-8fc0-8dab8ade1ff5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape8b2f9b5-0c') {{(pid=74613) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 29 18:09:46 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:09:46 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74613) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 18:09:46 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74613) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 29 18:09:46 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:09:46 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '9dfb5447-3411-50be-bad9-0477e9e5d5d7', '_type': 'linux-noop'}}, row=False) {{(pid=74613) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 18:09:46 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:09:46 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 18:09:46 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:09:46 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tape8b2f9b5-0c, may_exist=True, interface_attrs={}) {{(pid=74613) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 18:09:46 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tape8b2f9b5-0c, col_values=(('qos', UUID('e3ecc97a-211d-4477-96d1-59a6f1178ad8')),), if_exists=True) {{(pid=74613) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 18:09:46 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tape8b2f9b5-0c, col_values=(('external_ids', {'iface-id': 'e8b2f9b5-0c3a-4f6f-bf96-566c8a779849', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:da:7a:47', 'vm-uuid': '69109f06-acbf-4834-b05e-80ab6e3f6ea0'}),), if_exists=True) {{(pid=74613) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 18:09:46 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:09:46 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 18:09:46 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:09:46 user nova-compute[74613]: INFO os_vif [None req-641fab2e-701d-4b13-b383-5b92aa060de7 tempest-AttachVolumeTestJSON-813984703 tempest-AttachVolumeTestJSON-813984703-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:da:7a:47,bridge_name='br-int',has_traffic_filtering=True,id=e8b2f9b5-0c3a-4f6f-bf96-566c8a779849,network=Network(21147bc8-b1ac-40d5-8fc0-8dab8ade1ff5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape8b2f9b5-0c')
Nov 29 18:09:46 user nova-compute[74613]: DEBUG nova.compute.provider_tree [None req-a33156fe-010c-489f-a2bf-223dd7a2a6de tempest-AttachVolumeNegativeTest-483083654 tempest-AttachVolumeNegativeTest-483083654-project-member] Inventory has not changed in ProviderTree for provider: 639d980e-3b12-44b1-b8f4-1812416fa4dd {{(pid=74613) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 18:09:46 user nova-compute[74613]: DEBUG nova.scheduler.client.report [None req-a33156fe-010c-489f-a2bf-223dd7a2a6de tempest-AttachVolumeNegativeTest-483083654 tempest-AttachVolumeNegativeTest-483083654-project-member] Inventory has not changed for provider 639d980e-3b12-44b1-b8f4-1812416fa4dd based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74613) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 18:09:46 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-a33156fe-010c-489f-a2bf-223dd7a2a6de tempest-AttachVolumeNegativeTest-483083654 tempest-AttachVolumeNegativeTest-483083654-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.455s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 18:09:46 user nova-compute[74613]: INFO nova.scheduler.client.report [None req-a33156fe-010c-489f-a2bf-223dd7a2a6de tempest-AttachVolumeNegativeTest-483083654 tempest-AttachVolumeNegativeTest-483083654-project-member] Deleted allocations for instance bdb49266-ed09-4e9a-b3af-eb4b436a71da
Nov 29 18:09:46 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-a33156fe-010c-489f-a2bf-223dd7a2a6de tempest-AttachVolumeNegativeTest-483083654 tempest-AttachVolumeNegativeTest-483083654-project-member] Lock "bdb49266-ed09-4e9a-b3af-eb4b436a71da" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.556s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 18:09:47 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:09:47 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:09:47 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:09:48 user nova-compute[74613]: DEBUG nova.compute.manager [req-372f6d29-2120-47df-b26c-fbc3c6df84a1 req-838c8e97-4c37-47e7-baf4-f9170aec1957 service nova] [instance: 69109f06-acbf-4834-b05e-80ab6e3f6ea0] Received event network-vif-plugged-e8b2f9b5-0c3a-4f6f-bf96-566c8a779849 {{(pid=74613) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 18:09:48 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-372f6d29-2120-47df-b26c-fbc3c6df84a1 req-838c8e97-4c37-47e7-baf4-f9170aec1957 service nova] Acquiring lock "69109f06-acbf-4834-b05e-80ab6e3f6ea0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 18:09:48 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-372f6d29-2120-47df-b26c-fbc3c6df84a1 req-838c8e97-4c37-47e7-baf4-f9170aec1957 service nova] Lock "69109f06-acbf-4834-b05e-80ab6e3f6ea0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 18:09:48 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-372f6d29-2120-47df-b26c-fbc3c6df84a1 req-838c8e97-4c37-47e7-baf4-f9170aec1957 service nova] Lock "69109f06-acbf-4834-b05e-80ab6e3f6ea0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 18:09:48 user nova-compute[74613]: DEBUG nova.compute.manager [req-372f6d29-2120-47df-b26c-fbc3c6df84a1 req-838c8e97-4c37-47e7-baf4-f9170aec1957 service nova] [instance: 69109f06-acbf-4834-b05e-80ab6e3f6ea0] No waiting events found dispatching network-vif-plugged-e8b2f9b5-0c3a-4f6f-bf96-566c8a779849 {{(pid=74613) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 18:09:48 user nova-compute[74613]: WARNING nova.compute.manager [req-372f6d29-2120-47df-b26c-fbc3c6df84a1 req-838c8e97-4c37-47e7-baf4-f9170aec1957 service nova] [instance: 69109f06-acbf-4834-b05e-80ab6e3f6ea0] Received unexpected event network-vif-plugged-e8b2f9b5-0c3a-4f6f-bf96-566c8a779849 for instance with vm_state stopped and task_state powering-on.
Nov 29 18:09:48 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:09:48 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:09:48 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:09:48 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:09:49 user nova-compute[74613]: DEBUG nova.compute.manager [None req-641fab2e-701d-4b13-b383-5b92aa060de7 tempest-AttachVolumeTestJSON-813984703 tempest-AttachVolumeTestJSON-813984703-project-member] [instance: 69109f06-acbf-4834-b05e-80ab6e3f6ea0] Instance event wait completed in 0 seconds for  {{(pid=74613) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 29 18:09:49 user nova-compute[74613]: INFO nova.virt.libvirt.driver [-] [instance: 69109f06-acbf-4834-b05e-80ab6e3f6ea0] Instance rebooted successfully.
Nov 29 18:09:49 user nova-compute[74613]: DEBUG nova.compute.manager [None req-641fab2e-701d-4b13-b383-5b92aa060de7 tempest-AttachVolumeTestJSON-813984703 tempest-AttachVolumeTestJSON-813984703-project-member] [instance: 69109f06-acbf-4834-b05e-80ab6e3f6ea0] Checking state {{(pid=74613) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 29 18:09:50 user nova-compute[74613]: DEBUG nova.compute.manager [req-0bfe9cef-9ab7-489c-9771-c62d26e84f92 req-6c891209-470c-4c2f-8156-82a8dad7d187 service nova] [instance: 69109f06-acbf-4834-b05e-80ab6e3f6ea0] Received event network-vif-plugged-e8b2f9b5-0c3a-4f6f-bf96-566c8a779849 {{(pid=74613) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 18:09:50 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-0bfe9cef-9ab7-489c-9771-c62d26e84f92 req-6c891209-470c-4c2f-8156-82a8dad7d187 service nova] Acquiring lock "69109f06-acbf-4834-b05e-80ab6e3f6ea0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 18:09:50 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-0bfe9cef-9ab7-489c-9771-c62d26e84f92 req-6c891209-470c-4c2f-8156-82a8dad7d187 service nova] Lock "69109f06-acbf-4834-b05e-80ab6e3f6ea0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 18:09:50 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-0bfe9cef-9ab7-489c-9771-c62d26e84f92 req-6c891209-470c-4c2f-8156-82a8dad7d187 service nova] Lock "69109f06-acbf-4834-b05e-80ab6e3f6ea0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 18:09:50 user nova-compute[74613]: DEBUG nova.compute.manager [req-0bfe9cef-9ab7-489c-9771-c62d26e84f92 req-6c891209-470c-4c2f-8156-82a8dad7d187 service nova] [instance: 69109f06-acbf-4834-b05e-80ab6e3f6ea0] No waiting events found dispatching network-vif-plugged-e8b2f9b5-0c3a-4f6f-bf96-566c8a779849 {{(pid=74613) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 18:09:50 user nova-compute[74613]: WARNING nova.compute.manager [req-0bfe9cef-9ab7-489c-9771-c62d26e84f92 req-6c891209-470c-4c2f-8156-82a8dad7d187 service nova] [instance: 69109f06-acbf-4834-b05e-80ab6e3f6ea0] Received unexpected event network-vif-plugged-e8b2f9b5-0c3a-4f6f-bf96-566c8a779849 for instance with vm_state active and task_state None.
Nov 29 18:09:50 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:09:51 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:09:55 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:09:56 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:10:00 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:10:01 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:10:05 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:10:06 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:10:10 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:10:11 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:10:12 user nova-compute[74613]: DEBUG nova.compute.manager [req-c7a608d0-bb29-460a-85b2-bf06a6aa6813 req-9bd0ddb5-ca98-4234-905d-f8acf25dd490 service nova] [instance: 285d1e76-103b-47fa-9982-4f2d656ee57a] Received event network-changed-914a95dd-9699-41fd-a217-4adc1e9598f9 {{(pid=74613) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 18:10:12 user nova-compute[74613]: DEBUG nova.compute.manager [req-c7a608d0-bb29-460a-85b2-bf06a6aa6813 req-9bd0ddb5-ca98-4234-905d-f8acf25dd490 service nova] [instance: 285d1e76-103b-47fa-9982-4f2d656ee57a] Refreshing instance network info cache due to event network-changed-914a95dd-9699-41fd-a217-4adc1e9598f9. {{(pid=74613) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 18:10:12 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-c7a608d0-bb29-460a-85b2-bf06a6aa6813 req-9bd0ddb5-ca98-4234-905d-f8acf25dd490 service nova] Acquiring lock "refresh_cache-285d1e76-103b-47fa-9982-4f2d656ee57a" {{(pid=74613) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 18:10:12 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-c7a608d0-bb29-460a-85b2-bf06a6aa6813 req-9bd0ddb5-ca98-4234-905d-f8acf25dd490 service nova] Acquired lock "refresh_cache-285d1e76-103b-47fa-9982-4f2d656ee57a" {{(pid=74613) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 18:10:12 user nova-compute[74613]: DEBUG nova.network.neutron [req-c7a608d0-bb29-460a-85b2-bf06a6aa6813 req-9bd0ddb5-ca98-4234-905d-f8acf25dd490 service nova] [instance: 285d1e76-103b-47fa-9982-4f2d656ee57a] Refreshing network info cache for port 914a95dd-9699-41fd-a217-4adc1e9598f9 {{(pid=74613) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 18:10:12 user nova-compute[74613]: DEBUG nova.network.neutron [req-c7a608d0-bb29-460a-85b2-bf06a6aa6813 req-9bd0ddb5-ca98-4234-905d-f8acf25dd490 service nova] [instance: 285d1e76-103b-47fa-9982-4f2d656ee57a] Updated VIF entry in instance network info cache for port 914a95dd-9699-41fd-a217-4adc1e9598f9. {{(pid=74613) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 18:10:12 user nova-compute[74613]: DEBUG nova.network.neutron [req-c7a608d0-bb29-460a-85b2-bf06a6aa6813 req-9bd0ddb5-ca98-4234-905d-f8acf25dd490 service nova] [instance: 285d1e76-103b-47fa-9982-4f2d656ee57a] Updating instance_info_cache with network_info: [{"id": "914a95dd-9699-41fd-a217-4adc1e9598f9", "address": "fa:16:3e:b6:a3:cc", "network": {"id": "fed779df-aeaf-4b57-8336-be4c9d81f0be", "bridge": "br-int", "label": "tempest-TestStampPattern-1699172136-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.104", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6004d03e0fbd4684bc8f1d341afad3be", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap914a95dd-96", "ovs_interfaceid": "914a95dd-9699-41fd-a217-4adc1e9598f9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74613) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 18:10:12 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-c7a608d0-bb29-460a-85b2-bf06a6aa6813 req-9bd0ddb5-ca98-4234-905d-f8acf25dd490 service nova] Releasing lock "refresh_cache-285d1e76-103b-47fa-9982-4f2d656ee57a" {{(pid=74613) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 18:10:12 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-a1de81bb-1b3d-4b1d-8375-dd0d557a4e42 tempest-TestStampPattern-2144166935 tempest-TestStampPattern-2144166935-project-member] Acquiring lock "285d1e76-103b-47fa-9982-4f2d656ee57a" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 18:10:12 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-a1de81bb-1b3d-4b1d-8375-dd0d557a4e42 tempest-TestStampPattern-2144166935 tempest-TestStampPattern-2144166935-project-member] Lock "285d1e76-103b-47fa-9982-4f2d656ee57a" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 18:10:12 user nova-compute[74613]: DEBUG nova.objects.instance [None req-a1de81bb-1b3d-4b1d-8375-dd0d557a4e42 tempest-TestStampPattern-2144166935 tempest-TestStampPattern-2144166935-project-member] Lazy-loading 'flavor' on Instance uuid 285d1e76-103b-47fa-9982-4f2d656ee57a {{(pid=74613) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 18:10:12 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-a1de81bb-1b3d-4b1d-8375-dd0d557a4e42 tempest-TestStampPattern-2144166935 tempest-TestStampPattern-2144166935-project-member] Lock "285d1e76-103b-47fa-9982-4f2d656ee57a" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.051s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 18:10:12 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-a1de81bb-1b3d-4b1d-8375-dd0d557a4e42 tempest-TestStampPattern-2144166935 tempest-TestStampPattern-2144166935-project-member] Acquiring lock "285d1e76-103b-47fa-9982-4f2d656ee57a" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 18:10:12 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-a1de81bb-1b3d-4b1d-8375-dd0d557a4e42 tempest-TestStampPattern-2144166935 tempest-TestStampPattern-2144166935-project-member] Lock "285d1e76-103b-47fa-9982-4f2d656ee57a" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 18:10:12 user nova-compute[74613]: INFO nova.compute.manager [None req-a1de81bb-1b3d-4b1d-8375-dd0d557a4e42 tempest-TestStampPattern-2144166935 tempest-TestStampPattern-2144166935-project-member] [instance: 285d1e76-103b-47fa-9982-4f2d656ee57a] Attaching volume feacf752-4278-4706-96de-8baca33a964d to /dev/vdb
Nov 29 18:10:12 user nova-compute[74613]: DEBUG os_brick.utils [None req-a1de81bb-1b3d-4b1d-8375-dd0d557a4e42 tempest-TestStampPattern-2144166935 tempest-TestStampPattern-2144166935-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74613) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 18:10:12 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:10:12 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:10:12 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd3d7ee5-2c22-4e64-8bcc-afd1776005ea]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:400972819b5\n', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 18:10:12 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:10:12 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:10:12 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a0317b6-87ee-4de6-ae7f-3f529bdce590]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 18:10:12 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:10:12 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:10:12 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[45185433-88ce-445f-856d-1ecedfb6faa3]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 18:10:12 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[86c87843-bc2f-4099-a577-e8a4dcd4e39b]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 18:10:12 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-a1de81bb-1b3d-4b1d-8375-dd0d557a4e42 tempest-TestStampPattern-2144166935 tempest-TestStampPattern-2144166935-project-member] Running cmd (subprocess): nvme version {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:10:12 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-a1de81bb-1b3d-4b1d-8375-dd0d557a4e42 tempest-TestStampPattern-2144166935 tempest-TestStampPattern-2144166935-project-member] 'nvme version' failed. Not Retrying. {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 18:10:12 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.nvmeof [None req-a1de81bb-1b3d-4b1d-8375-dd0d557a4e42 tempest-TestStampPattern-2144166935 tempest-TestStampPattern-2144166935-project-member] nvme not present on system {{(pid=74613) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 29 18:10:12 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:10:12 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 18:10:12 user nova-compute[74613]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 29 18:10:12 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[376f8694-e9bc-47f3-941e-567b8069192f]: (4, '') {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 18:10:12 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.lightos [None req-a1de81bb-1b3d-4b1d-8375-dd0d557a4e42 tempest-TestStampPattern-2144166935 tempest-TestStampPattern-2144166935-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74613) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 29 18:10:12 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.lightos [None req-a1de81bb-1b3d-4b1d-8375-dd0d557a4e42 tempest-TestStampPattern-2144166935 tempest-TestStampPattern-2144166935-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74613) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 29 18:10:12 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.lightos [None req-a1de81bb-1b3d-4b1d-8375-dd0d557a4e42 tempest-TestStampPattern-2144166935 tempest-TestStampPattern-2144166935-project-member] LIGHTOS: no hostnqn found. {{(pid=74613) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 29 18:10:12 user nova-compute[74613]: DEBUG os_brick.utils [None req-a1de81bb-1b3d-4b1d-8375-dd0d557a4e42 tempest-TestStampPattern-2144166935 tempest-TestStampPattern-2144166935-project-member] <== get_connector_properties: return (123ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:400972819b5', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74613) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 18:10:12 user nova-compute[74613]: DEBUG nova.virt.block_device [None req-a1de81bb-1b3d-4b1d-8375-dd0d557a4e42 tempest-TestStampPattern-2144166935 tempest-TestStampPattern-2144166935-project-member] [instance: 285d1e76-103b-47fa-9982-4f2d656ee57a] Updating existing volume attachment record: 71c80ec6-82fb-423d-80d6-c6a55eb8138e {{(pid=74613) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 29 18:10:13 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-fb84d8d8-fe19-48e1-ba3f-8b4cdd7e639d tempest-ServerBootFromVolumeStableRescueTest-414665510 tempest-ServerBootFromVolumeStableRescueTest-414665510-project-member] Acquiring lock "8fc8496b-1435-4b5f-8977-6c0d7467ef65" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 18:10:13 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-fb84d8d8-fe19-48e1-ba3f-8b4cdd7e639d tempest-ServerBootFromVolumeStableRescueTest-414665510 tempest-ServerBootFromVolumeStableRescueTest-414665510-project-member] Lock "8fc8496b-1435-4b5f-8977-6c0d7467ef65" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 18:10:13 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-fb84d8d8-fe19-48e1-ba3f-8b4cdd7e639d tempest-ServerBootFromVolumeStableRescueTest-414665510 tempest-ServerBootFromVolumeStableRescueTest-414665510-project-member] Acquiring lock "8fc8496b-1435-4b5f-8977-6c0d7467ef65-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 18:10:13 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-fb84d8d8-fe19-48e1-ba3f-8b4cdd7e639d tempest-ServerBootFromVolumeStableRescueTest-414665510 tempest-ServerBootFromVolumeStableRescueTest-414665510-project-member] Lock "8fc8496b-1435-4b5f-8977-6c0d7467ef65-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 18:10:13 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-fb84d8d8-fe19-48e1-ba3f-8b4cdd7e639d tempest-ServerBootFromVolumeStableRescueTest-414665510 tempest-ServerBootFromVolumeStableRescueTest-414665510-project-member] Lock "8fc8496b-1435-4b5f-8977-6c0d7467ef65-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 18:10:13 user nova-compute[74613]: INFO nova.compute.manager [None req-fb84d8d8-fe19-48e1-ba3f-8b4cdd7e639d tempest-ServerBootFromVolumeStableRescueTest-414665510 tempest-ServerBootFromVolumeStableRescueTest-414665510-project-member] [instance: 8fc8496b-1435-4b5f-8977-6c0d7467ef65] Terminating instance
Nov 29 18:10:13 user nova-compute[74613]: DEBUG nova.compute.manager [None req-fb84d8d8-fe19-48e1-ba3f-8b4cdd7e639d tempest-ServerBootFromVolumeStableRescueTest-414665510 tempest-ServerBootFromVolumeStableRescueTest-414665510-project-member] [instance: 8fc8496b-1435-4b5f-8977-6c0d7467ef65] Start destroying the instance on the hypervisor. {{(pid=74613) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 29 18:10:13 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:10:13 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:10:13 user nova-compute[74613]: DEBUG nova.compute.manager [req-1ebd4aa5-534e-4399-8c0e-36d3b64f3384 req-eb232cb3-1f65-4b63-b6db-0687eef1108a service nova] [instance: 8fc8496b-1435-4b5f-8977-6c0d7467ef65] Received event network-vif-unplugged-ddd4e4e3-180b-42bd-8c21-d3bb61438395 {{(pid=74613) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 18:10:13 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-1ebd4aa5-534e-4399-8c0e-36d3b64f3384 req-eb232cb3-1f65-4b63-b6db-0687eef1108a service nova] Acquiring lock "8fc8496b-1435-4b5f-8977-6c0d7467ef65-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 18:10:13 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-1ebd4aa5-534e-4399-8c0e-36d3b64f3384 req-eb232cb3-1f65-4b63-b6db-0687eef1108a service nova] Lock "8fc8496b-1435-4b5f-8977-6c0d7467ef65-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 18:10:13 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-1ebd4aa5-534e-4399-8c0e-36d3b64f3384 req-eb232cb3-1f65-4b63-b6db-0687eef1108a service nova] Lock "8fc8496b-1435-4b5f-8977-6c0d7467ef65-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 18:10:13 user nova-compute[74613]: DEBUG nova.compute.manager [req-1ebd4aa5-534e-4399-8c0e-36d3b64f3384 req-eb232cb3-1f65-4b63-b6db-0687eef1108a service nova] [instance: 8fc8496b-1435-4b5f-8977-6c0d7467ef65] No waiting events found dispatching network-vif-unplugged-ddd4e4e3-180b-42bd-8c21-d3bb61438395 {{(pid=74613) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 18:10:13 user nova-compute[74613]: DEBUG nova.compute.manager [req-1ebd4aa5-534e-4399-8c0e-36d3b64f3384 req-eb232cb3-1f65-4b63-b6db-0687eef1108a service nova] [instance: 8fc8496b-1435-4b5f-8977-6c0d7467ef65] Received event network-vif-unplugged-ddd4e4e3-180b-42bd-8c21-d3bb61438395 for instance with task_state deleting. {{(pid=74613) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 29 18:10:13 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:10:13 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:10:14 user nova-compute[74613]: INFO nova.virt.libvirt.driver [-] [instance: 8fc8496b-1435-4b5f-8977-6c0d7467ef65] Instance destroyed successfully.
Nov 29 18:10:14 user nova-compute[74613]: DEBUG nova.objects.instance [None req-fb84d8d8-fe19-48e1-ba3f-8b4cdd7e639d tempest-ServerBootFromVolumeStableRescueTest-414665510 tempest-ServerBootFromVolumeStableRescueTest-414665510-project-member] Lazy-loading 'resources' on Instance uuid 8fc8496b-1435-4b5f-8977-6c0d7467ef65 {{(pid=74613) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 18:10:14 user nova-compute[74613]: DEBUG nova.virt.libvirt.vif [None req-fb84d8d8-fe19-48e1-ba3f-8b4cdd7e639d tempest-ServerBootFromVolumeStableRescueTest-414665510 tempest-ServerBootFromVolumeStableRescueTest-414665510-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T18:00:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-469660568',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-469660568',id=23,image_ref='4217f428-8d9d-4ee1-9614-642d26d90c46',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-29T18:00:06Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='b820dd795dfe46cd804772f0e71f98e9',ramdisk_id='',reservation_id='r-ej2u8uj7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='4217f428-8d9d-4ee1-9614-642d26d90c46',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-414665510',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-414665510-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-29T18:01:57Z,user_data=None,user_id='c65bc922e04d4d1385e48f70c460c441',uuid=8fc8496b-1435-4b5f-8977-6c0d7467ef65,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "ddd4e4e3-180b-42bd-8c21-d3bb61438395", "address": "fa:16:3e:43:4c:c1", "network": {"id": "0722b02d-a357-4360-87e8-580913723985", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-579793494-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b820dd795dfe46cd804772f0e71f98e9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapddd4e4e3-18", "ovs_interfaceid": "ddd4e4e3-180b-42bd-8c21-d3bb61438395", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74613) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 29 18:10:14 user nova-compute[74613]: DEBUG nova.network.os_vif_util [None req-fb84d8d8-fe19-48e1-ba3f-8b4cdd7e639d tempest-ServerBootFromVolumeStableRescueTest-414665510 tempest-ServerBootFromVolumeStableRescueTest-414665510-project-member] Converting VIF {"id": "ddd4e4e3-180b-42bd-8c21-d3bb61438395", "address": "fa:16:3e:43:4c:c1", "network": {"id": "0722b02d-a357-4360-87e8-580913723985", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-579793494-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b820dd795dfe46cd804772f0e71f98e9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapddd4e4e3-18", "ovs_interfaceid": "ddd4e4e3-180b-42bd-8c21-d3bb61438395", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74613) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 18:10:14 user nova-compute[74613]: DEBUG nova.network.os_vif_util [None req-fb84d8d8-fe19-48e1-ba3f-8b4cdd7e639d tempest-ServerBootFromVolumeStableRescueTest-414665510 tempest-ServerBootFromVolumeStableRescueTest-414665510-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:43:4c:c1,bridge_name='br-int',has_traffic_filtering=True,id=ddd4e4e3-180b-42bd-8c21-d3bb61438395,network=Network(0722b02d-a357-4360-87e8-580913723985),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapddd4e4e3-18') {{(pid=74613) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 18:10:14 user nova-compute[74613]: DEBUG os_vif [None req-fb84d8d8-fe19-48e1-ba3f-8b4cdd7e639d tempest-ServerBootFromVolumeStableRescueTest-414665510 tempest-ServerBootFromVolumeStableRescueTest-414665510-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:43:4c:c1,bridge_name='br-int',has_traffic_filtering=True,id=ddd4e4e3-180b-42bd-8c21-d3bb61438395,network=Network(0722b02d-a357-4360-87e8-580913723985),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapddd4e4e3-18') {{(pid=74613) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 29 18:10:14 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:10:14 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapddd4e4e3-18, bridge=br-int, if_exists=True) {{(pid=74613) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 18:10:14 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:10:14 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 18:10:14 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:10:14 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=4a7a9541-4f6e-45ed-9cbf-ddd6df02c1bb) {{(pid=74613) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 18:10:14 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:10:14 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:10:14 user nova-compute[74613]: INFO os_vif [None req-fb84d8d8-fe19-48e1-ba3f-8b4cdd7e639d tempest-ServerBootFromVolumeStableRescueTest-414665510 tempest-ServerBootFromVolumeStableRescueTest-414665510-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:43:4c:c1,bridge_name='br-int',has_traffic_filtering=True,id=ddd4e4e3-180b-42bd-8c21-d3bb61438395,network=Network(0722b02d-a357-4360-87e8-580913723985),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapddd4e4e3-18')
Nov 29 18:10:14 user nova-compute[74613]: INFO nova.virt.libvirt.driver [None req-fb84d8d8-fe19-48e1-ba3f-8b4cdd7e639d tempest-ServerBootFromVolumeStableRescueTest-414665510 tempest-ServerBootFromVolumeStableRescueTest-414665510-project-member] [instance: 8fc8496b-1435-4b5f-8977-6c0d7467ef65] Deleting instance files /opt/stack/data/nova/instances/8fc8496b-1435-4b5f-8977-6c0d7467ef65_del
Nov 29 18:10:14 user nova-compute[74613]: INFO nova.virt.libvirt.driver [None req-fb84d8d8-fe19-48e1-ba3f-8b4cdd7e639d tempest-ServerBootFromVolumeStableRescueTest-414665510 tempest-ServerBootFromVolumeStableRescueTest-414665510-project-member] [instance: 8fc8496b-1435-4b5f-8977-6c0d7467ef65] Deletion of /opt/stack/data/nova/instances/8fc8496b-1435-4b5f-8977-6c0d7467ef65_del complete
Nov 29 18:10:14 user nova-compute[74613]: INFO nova.compute.manager [None req-fb84d8d8-fe19-48e1-ba3f-8b4cdd7e639d tempest-ServerBootFromVolumeStableRescueTest-414665510 tempest-ServerBootFromVolumeStableRescueTest-414665510-project-member] [instance: 8fc8496b-1435-4b5f-8977-6c0d7467ef65] Took 0.91 seconds to destroy the instance on the hypervisor.
Nov 29 18:10:14 user nova-compute[74613]: DEBUG oslo.service.loopingcall [None req-fb84d8d8-fe19-48e1-ba3f-8b4cdd7e639d tempest-ServerBootFromVolumeStableRescueTest-414665510 tempest-ServerBootFromVolumeStableRescueTest-414665510-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74613) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 29 18:10:14 user nova-compute[74613]: DEBUG nova.compute.manager [-] [instance: 8fc8496b-1435-4b5f-8977-6c0d7467ef65] Deallocating network for instance {{(pid=74613) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 29 18:10:14 user nova-compute[74613]: DEBUG nova.network.neutron [-] [instance: 8fc8496b-1435-4b5f-8977-6c0d7467ef65] deallocate_for_instance() {{(pid=74613) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 29 18:10:14 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:10:14 user nova-compute[74613]: DEBUG nova.network.neutron [-] [instance: 8fc8496b-1435-4b5f-8977-6c0d7467ef65] Updating instance_info_cache with network_info: [] {{(pid=74613) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 18:10:14 user nova-compute[74613]: DEBUG nova.compute.manager [req-cad6db9c-05ad-41c7-955d-21bc6efade64 req-a6254c11-4e75-46b1-9828-7441cce862b0 service nova] [instance: 8fc8496b-1435-4b5f-8977-6c0d7467ef65] Received event network-vif-deleted-ddd4e4e3-180b-42bd-8c21-d3bb61438395 {{(pid=74613) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 18:10:14 user nova-compute[74613]: INFO nova.compute.manager [req-cad6db9c-05ad-41c7-955d-21bc6efade64 req-a6254c11-4e75-46b1-9828-7441cce862b0 service nova] [instance: 8fc8496b-1435-4b5f-8977-6c0d7467ef65] Neutron deleted interface ddd4e4e3-180b-42bd-8c21-d3bb61438395; detaching it from the instance and deleting it from the info cache
Nov 29 18:10:14 user nova-compute[74613]: DEBUG nova.network.neutron [req-cad6db9c-05ad-41c7-955d-21bc6efade64 req-a6254c11-4e75-46b1-9828-7441cce862b0 service nova] [instance: 8fc8496b-1435-4b5f-8977-6c0d7467ef65] Updating instance_info_cache with network_info: [] {{(pid=74613) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 18:10:14 user nova-compute[74613]: INFO nova.compute.manager [-] [instance: 8fc8496b-1435-4b5f-8977-6c0d7467ef65] Took 0.54 seconds to deallocate network for instance.
Nov 29 18:10:14 user nova-compute[74613]: DEBUG nova.compute.manager [req-cad6db9c-05ad-41c7-955d-21bc6efade64 req-a6254c11-4e75-46b1-9828-7441cce862b0 service nova] [instance: 8fc8496b-1435-4b5f-8977-6c0d7467ef65] Detach interface failed, port_id=ddd4e4e3-180b-42bd-8c21-d3bb61438395, reason: Instance 8fc8496b-1435-4b5f-8977-6c0d7467ef65 could not be found. {{(pid=74613) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 29 18:10:14 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-fb84d8d8-fe19-48e1-ba3f-8b4cdd7e639d tempest-ServerBootFromVolumeStableRescueTest-414665510 tempest-ServerBootFromVolumeStableRescueTest-414665510-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 18:10:14 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-fb84d8d8-fe19-48e1-ba3f-8b4cdd7e639d tempest-ServerBootFromVolumeStableRescueTest-414665510 tempest-ServerBootFromVolumeStableRescueTest-414665510-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 18:10:15 user nova-compute[74613]: DEBUG nova.compute.provider_tree [None req-fb84d8d8-fe19-48e1-ba3f-8b4cdd7e639d tempest-ServerBootFromVolumeStableRescueTest-414665510 tempest-ServerBootFromVolumeStableRescueTest-414665510-project-member] Inventory has not changed in ProviderTree for provider: 639d980e-3b12-44b1-b8f4-1812416fa4dd {{(pid=74613) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 18:10:15 user nova-compute[74613]: DEBUG nova.scheduler.client.report [None req-fb84d8d8-fe19-48e1-ba3f-8b4cdd7e639d tempest-ServerBootFromVolumeStableRescueTest-414665510 tempest-ServerBootFromVolumeStableRescueTest-414665510-project-member] Inventory has not changed for provider 639d980e-3b12-44b1-b8f4-1812416fa4dd based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74613) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 18:10:15 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-fb84d8d8-fe19-48e1-ba3f-8b4cdd7e639d tempest-ServerBootFromVolumeStableRescueTest-414665510 tempest-ServerBootFromVolumeStableRescueTest-414665510-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.374s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 18:10:15 user nova-compute[74613]: INFO nova.scheduler.client.report [None req-fb84d8d8-fe19-48e1-ba3f-8b4cdd7e639d tempest-ServerBootFromVolumeStableRescueTest-414665510 tempest-ServerBootFromVolumeStableRescueTest-414665510-project-member] Deleted allocations for instance 8fc8496b-1435-4b5f-8977-6c0d7467ef65
Nov 29 18:10:15 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-fb84d8d8-fe19-48e1-ba3f-8b4cdd7e639d tempest-ServerBootFromVolumeStableRescueTest-414665510 tempest-ServerBootFromVolumeStableRescueTest-414665510-project-member] Lock "8fc8496b-1435-4b5f-8977-6c0d7467ef65" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.016s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 18:10:15 user nova-compute[74613]: DEBUG nova.compute.manager [req-ef72cb85-682c-463c-8fe6-dc4e09c79e3c req-a65a4fce-f4c1-48ee-8406-ffaa7be534a5 service nova] [instance: 8fc8496b-1435-4b5f-8977-6c0d7467ef65] Received event network-vif-plugged-ddd4e4e3-180b-42bd-8c21-d3bb61438395 {{(pid=74613) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 18:10:15 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-ef72cb85-682c-463c-8fe6-dc4e09c79e3c req-a65a4fce-f4c1-48ee-8406-ffaa7be534a5 service nova] Acquiring lock "8fc8496b-1435-4b5f-8977-6c0d7467ef65-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 18:10:15 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-ef72cb85-682c-463c-8fe6-dc4e09c79e3c req-a65a4fce-f4c1-48ee-8406-ffaa7be534a5 service nova] Lock "8fc8496b-1435-4b5f-8977-6c0d7467ef65-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 18:10:15 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-ef72cb85-682c-463c-8fe6-dc4e09c79e3c req-a65a4fce-f4c1-48ee-8406-ffaa7be534a5 service nova] Lock "8fc8496b-1435-4b5f-8977-6c0d7467ef65-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 18:10:15 user nova-compute[74613]: DEBUG nova.compute.manager [req-ef72cb85-682c-463c-8fe6-dc4e09c79e3c req-a65a4fce-f4c1-48ee-8406-ffaa7be534a5 service nova] [instance: 8fc8496b-1435-4b5f-8977-6c0d7467ef65] No waiting events found dispatching network-vif-plugged-ddd4e4e3-180b-42bd-8c21-d3bb61438395 {{(pid=74613) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 18:10:15 user nova-compute[74613]: WARNING nova.compute.manager [req-ef72cb85-682c-463c-8fe6-dc4e09c79e3c req-a65a4fce-f4c1-48ee-8406-ffaa7be534a5 service nova] [instance: 8fc8496b-1435-4b5f-8977-6c0d7467ef65] Received unexpected event network-vif-plugged-ddd4e4e3-180b-42bd-8c21-d3bb61438395 for instance with vm_state deleted and task_state None.
Nov 29 18:10:15 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:10:19 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:10:20 user nova-compute[74613]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a1de81bb-1b3d-4b1d-8375-dd0d557a4e42 tempest-TestStampPattern-2144166935 tempest-TestStampPattern-2144166935-project-member] [instance: 285d1e76-103b-47fa-9982-4f2d656ee57a] Calling os-brick to attach iSCSI Volume {{(pid=74613) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 29 18:10:20 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1de81bb-1b3d-4b1d-8375-dd0d557a4e42 tempest-TestStampPattern-2144166935 tempest-TestStampPattern-2144166935-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff828156890>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:feacf752-4278-4706-96de-8baca33a964d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YICjdcps', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74613) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 18:10:20 user nova-compute[74613]: WARNING os_brick.initiator.connectors.base [None req-a1de81bb-1b3d-4b1d-8375-dd0d557a4e42 tempest-TestStampPattern-2144166935 tempest-TestStampPattern-2144166935-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 18:10:20 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.base [None req-a1de81bb-1b3d-4b1d-8375-dd0d557a4e42 tempest-TestStampPattern-2144166935 tempest-TestStampPattern-2144166935-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 18:10:20 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.base [None req-a1de81bb-1b3d-4b1d-8375-dd0d557a4e42 tempest-TestStampPattern-2144166935 tempest-TestStampPattern-2144166935-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 18:10:20 user nova-compute[74613]: WARNING os_brick.initiator.connectors.base [None req-a1de81bb-1b3d-4b1d-8375-dd0d557a4e42 tempest-TestStampPattern-2144166935 tempest-TestStampPattern-2144166935-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 18:10:20 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.base [None req-a1de81bb-1b3d-4b1d-8375-dd0d557a4e42 tempest-TestStampPattern-2144166935 tempest-TestStampPattern-2144166935-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:feacf752-4278-4706-96de-8baca33a964d" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 18:10:20 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.base [None req-a1de81bb-1b3d-4b1d-8375-dd0d557a4e42 tempest-TestStampPattern-2144166935 tempest-TestStampPattern-2144166935-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:feacf752-4278-4706-96de-8baca33a964d" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 18:10:20 user nova-compute[74613]: INFO os_brick.initiator.connectors.iscsi [None req-a1de81bb-1b3d-4b1d-8375-dd0d557a4e42 tempest-TestStampPattern-2144166935 tempest-TestStampPattern-2144166935-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 29 18:10:20 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:feacf752-4278-4706-96de-8baca33a964d -p 172.16.0.220:3260 {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:10:20 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:10:20 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:feacf752-4278-4706-96de-8baca33a964d -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:10:20 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[64499df1-636b-4011-9deb-caab25fc32e9]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 18:10:20 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1de81bb-1b3d-4b1d-8375-dd0d557a4e42 tempest-TestStampPattern-2144166935 tempest-TestStampPattern-2144166935-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 29 18:10:20 user nova-compute[74613]:  {{(pid=74613) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 18:10:20 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:feacf752-4278-4706-96de-8baca33a964d -p 172.16.0.220:3260 --interface default --op new {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:10:20 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:feacf752-4278-4706-96de-8baca33a964d -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:10:20 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc87b710-1cbc-4f15-80c5-a85863df7d1f]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:feacf752-4278-4706-96de-8baca33a964d] added\n', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 18:10:20 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1de81bb-1b3d-4b1d-8375-dd0d557a4e42 tempest-TestStampPattern-2144166935 tempest-TestStampPattern-2144166935-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:feacf752-4278-4706-96de-8baca33a964d] added
Nov 29 18:10:20 user nova-compute[74613]:  stderr= {{(pid=74613) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 18:10:20 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:feacf752-4278-4706-96de-8baca33a964d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:10:20 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:feacf752-4278-4706-96de-8baca33a964d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:10:20 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6157459-6aa4-41f8-82ce-44422f98e34c]: (4, ('', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 18:10:20 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1de81bb-1b3d-4b1d-8375-dd0d557a4e42 tempest-TestStampPattern-2144166935 tempest-TestStampPattern-2144166935-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74613) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 18:10:20 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:feacf752-4278-4706-96de-8baca33a964d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:10:20 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:feacf752-4278-4706-96de-8baca33a964d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:10:20 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[3380c2ea-156b-4c98-8d30-7f4b0e7838af]: (4, ('', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 18:10:20 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1de81bb-1b3d-4b1d-8375-dd0d557a4e42 tempest-TestStampPattern-2144166935 tempest-TestStampPattern-2144166935-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74613) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 18:10:20 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:feacf752-4278-4706-96de-8baca33a964d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v YICjdcps {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:10:20 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:feacf752-4278-4706-96de-8baca33a964d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v YICjdcps" returned: 0 in 0.020s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:10:20 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d284249-81fd-47fb-84fe-03f658ffd086]: (4, ('', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 18:10:20 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1de81bb-1b3d-4b1d-8375-dd0d557a4e42 tempest-TestStampPattern-2144166935 tempest-TestStampPattern-2144166935-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'YICjdcps'): stdout= stderr= {{(pid=74613) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 18:10:20 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:feacf752-4278-4706-96de-8baca33a964d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:10:20 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:feacf752-4278-4706-96de-8baca33a964d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:10:20 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1f52f10-074d-471b-ad84-7f33c7c192dc]: (4, ('', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 18:10:20 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1de81bb-1b3d-4b1d-8375-dd0d557a4e42 tempest-TestStampPattern-2144166935 tempest-TestStampPattern-2144166935-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74613) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 18:10:20 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:10:20 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:10:20 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[38699a40-c7de-4fd6-af36-c663f399e640]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9511387c-8772-40f2-bf2d-6b6387649e9f (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:34908494-9a6c-4c8c-b447-9768745356ca (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2879f1d-797c-4701-8803-eb6369ddb534 (non-flash)\n', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 18:10:20 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1de81bb-1b3d-4b1d-8375-dd0d557a4e42 tempest-TestStampPattern-2144166935 tempest-TestStampPattern-2144166935-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9511387c-8772-40f2-bf2d-6b6387649e9f (non-flash)
Nov 29 18:10:20 user nova-compute[74613]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:34908494-9a6c-4c8c-b447-9768745356ca (non-flash)
Nov 29 18:10:20 user nova-compute[74613]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2879f1d-797c-4701-8803-eb6369ddb534 (non-flash)
Nov 29 18:10:20 user nova-compute[74613]:  stderr= {{(pid=74613) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 18:10:20 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1de81bb-1b3d-4b1d-8375-dd0d557a4e42 tempest-TestStampPattern-2144166935 tempest-TestStampPattern-2144166935-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9511387c-8772-40f2-bf2d-6b6387649e9f (non-flash)
Nov 29 18:10:20 user nova-compute[74613]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:34908494-9a6c-4c8c-b447-9768745356ca (non-flash)
Nov 29 18:10:20 user nova-compute[74613]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2879f1d-797c-4701-8803-eb6369ddb534 (non-flash)
Nov 29 18:10:20 user nova-compute[74613]:  stderr= {{(pid=74613) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 18:10:20 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:feacf752-4278-4706-96de-8baca33a964d -p 172.16.0.220:3260 --login {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:10:21 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:feacf752-4278-4706-96de-8baca33a964d -p 172.16.0.220:3260 --login" returned: 0 in 0.064s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:10:21 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[767228e5-c7ff-4062-8eef-2a2b34ab87cd]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:feacf752-4278-4706-96de-8baca33a964d, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:feacf752-4278-4706-96de-8baca33a964d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 18:10:21 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1de81bb-1b3d-4b1d-8375-dd0d557a4e42 tempest-TestStampPattern-2144166935 tempest-TestStampPattern-2144166935-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:feacf752-4278-4706-96de-8baca33a964d, portal: 172.16.0.220,3260]
Nov 29 18:10:21 user nova-compute[74613]: Login to [iface: default, target: iqn.2010-10.org.openstack:feacf752-4278-4706-96de-8baca33a964d, portal: 172.16.0.220,3260] successful.
Nov 29 18:10:21 user nova-compute[74613]:  stderr= {{(pid=74613) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 18:10:21 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:feacf752-4278-4706-96de-8baca33a964d -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:10:21 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:feacf752-4278-4706-96de-8baca33a964d -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:10:21 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[af6e645e-99f0-4dd3-bb51-a1c32dcce5da]: (4, ('', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 18:10:21 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1de81bb-1b3d-4b1d-8375-dd0d557a4e42 tempest-TestStampPattern-2144166935 tempest-TestStampPattern-2144166935-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74613) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 18:10:21 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:10:21 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:10:21 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[446bf991-ade0-419f-a7f5-0241dd0cbea5]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9511387c-8772-40f2-bf2d-6b6387649e9f (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:34908494-9a6c-4c8c-b447-9768745356ca (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2879f1d-797c-4701-8803-eb6369ddb534 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:feacf752-4278-4706-96de-8baca33a964d (non-flash)\n', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 18:10:21 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1de81bb-1b3d-4b1d-8375-dd0d557a4e42 tempest-TestStampPattern-2144166935 tempest-TestStampPattern-2144166935-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9511387c-8772-40f2-bf2d-6b6387649e9f (non-flash)
Nov 29 18:10:21 user nova-compute[74613]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:34908494-9a6c-4c8c-b447-9768745356ca (non-flash)
Nov 29 18:10:21 user nova-compute[74613]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2879f1d-797c-4701-8803-eb6369ddb534 (non-flash)
Nov 29 18:10:21 user nova-compute[74613]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:feacf752-4278-4706-96de-8baca33a964d (non-flash)
Nov 29 18:10:21 user nova-compute[74613]:  stderr= {{(pid=74613) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 18:10:21 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1de81bb-1b3d-4b1d-8375-dd0d557a4e42 tempest-TestStampPattern-2144166935 tempest-TestStampPattern-2144166935-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9511387c-8772-40f2-bf2d-6b6387649e9f (non-flash)
Nov 29 18:10:21 user nova-compute[74613]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:34908494-9a6c-4c8c-b447-9768745356ca (non-flash)
Nov 29 18:10:21 user nova-compute[74613]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2879f1d-797c-4701-8803-eb6369ddb534 (non-flash)
Nov 29 18:10:21 user nova-compute[74613]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:feacf752-4278-4706-96de-8baca33a964d (non-flash)
Nov 29 18:10:21 user nova-compute[74613]:  stderr= {{(pid=74613) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 18:10:21 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.base [None req-a1de81bb-1b3d-4b1d-8375-dd0d557a4e42 tempest-TestStampPattern-2144166935 tempest-TestStampPattern-2144166935-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:feacf752-4278-4706-96de-8baca33a964d" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.281s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 18:10:21 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1de81bb-1b3d-4b1d-8375-dd0d557a4e42 tempest-TestStampPattern-2144166935 tempest-TestStampPattern-2144166935-project-member] Connected to 172.16.0.220:3260 {{(pid=74613) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 29 18:10:21 user nova-compute[74613]: DEBUG os_brick.initiator.linuxscsi [None req-a1de81bb-1b3d-4b1d-8375-dd0d557a4e42 tempest-TestStampPattern-2144166935 tempest-TestStampPattern-2144166935-project-member] HCTL ('36', '-', '-', 0) found on session 38 with lun 0 {{(pid=74613) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 29 18:10:21 user nova-compute[74613]: DEBUG os_brick.initiator.linuxscsi [None req-a1de81bb-1b3d-4b1d-8375-dd0d557a4e42 tempest-TestStampPattern-2144166935 tempest-TestStampPattern-2144166935-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=74613) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 29 18:10:21 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:10:21 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.018s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:10:21 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[274ddae9-a136-4195-ac6c-81fa204f3b93]: (4, ('- - 0', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 18:10:21 user nova-compute[74613]: DEBUG os_brick.initiator.linuxscsi [None req-a1de81bb-1b3d-4b1d-8375-dd0d557a4e42 tempest-TestStampPattern-2144166935 tempest-TestStampPattern-2144166935-project-member] Searching for a device in session 38 and hctl ['36', '*', '*', 0] yield: sde {{(pid=74613) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 29 18:10:21 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1de81bb-1b3d-4b1d-8375-dd0d557a4e42 tempest-TestStampPattern-2144166935 tempest-TestStampPattern-2144166935-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:feacf752-4278-4706-96de-8baca33a964d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YICjdcps', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74613) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 29 18:10:22 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.base [None req-a1de81bb-1b3d-4b1d-8375-dd0d557a4e42 tempest-TestStampPattern-2144166935 tempest-TestStampPattern-2144166935-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.313s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 18:10:22 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1de81bb-1b3d-4b1d-8375-dd0d557a4e42 tempest-TestStampPattern-2144166935 tempest-TestStampPattern-2144166935-project-member] <== connect_volume: return (1315ms) {'type': 'block', 'scsi_wwn': '23131656532633735', 'path': '/dev/sde'} {{(pid=74613) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 18:10:22 user nova-compute[74613]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a1de81bb-1b3d-4b1d-8375-dd0d557a4e42 tempest-TestStampPattern-2144166935 tempest-TestStampPattern-2144166935-project-member] [instance: 285d1e76-103b-47fa-9982-4f2d656ee57a] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23131656532633735', 'path': '/dev/sde'} {{(pid=74613) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 29 18:10:22 user nova-compute[74613]: DEBUG nova.objects.instance [None req-a1de81bb-1b3d-4b1d-8375-dd0d557a4e42 tempest-TestStampPattern-2144166935 tempest-TestStampPattern-2144166935-project-member] Lazy-loading 'flavor' on Instance uuid 285d1e76-103b-47fa-9982-4f2d656ee57a {{(pid=74613) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 18:10:22 user nova-compute[74613]: DEBUG nova.virt.libvirt.guest [None req-a1de81bb-1b3d-4b1d-8375-dd0d557a4e42 tempest-TestStampPattern-2144166935 tempest-TestStampPattern-2144166935-project-member] attach device xml: <disk type="block" device="disk">
Nov 29 18:10:22 user nova-compute[74613]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 18:10:22 user nova-compute[74613]:   <source dev="/dev/sde"/>
Nov 29 18:10:22 user nova-compute[74613]:   <target dev="vdb" bus="virtio"/>
Nov 29 18:10:22 user nova-compute[74613]:   <serial>feacf752-4278-4706-96de-8baca33a964d</serial>
Nov 29 18:10:22 user nova-compute[74613]: </disk>
Nov 29 18:10:22 user nova-compute[74613]:  {{(pid=74613) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 29 18:10:22 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-a1de81bb-1b3d-4b1d-8375-dd0d557a4e42 tempest-TestStampPattern-2144166935 tempest-TestStampPattern-2144166935-project-member] No BDM found with device name vda, not building metadata. {{(pid=74613) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 18:10:22 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-a1de81bb-1b3d-4b1d-8375-dd0d557a4e42 tempest-TestStampPattern-2144166935 tempest-TestStampPattern-2144166935-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74613) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 18:10:22 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-a1de81bb-1b3d-4b1d-8375-dd0d557a4e42 tempest-TestStampPattern-2144166935 tempest-TestStampPattern-2144166935-project-member] No VIF found with MAC fa:16:3e:b6:a3:cc, not building metadata {{(pid=74613) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 29 18:10:22 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-a1de81bb-1b3d-4b1d-8375-dd0d557a4e42 tempest-TestStampPattern-2144166935 tempest-TestStampPattern-2144166935-project-member] Lock "285d1e76-103b-47fa-9982-4f2d656ee57a" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 9.864s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 18:10:24 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:10:24 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-664f4dc4-06f7-42e1-9e97-3d2d37f6e46e tempest-TestStampPattern-2144166935 tempest-TestStampPattern-2144166935-project-member] Acquiring lock "285d1e76-103b-47fa-9982-4f2d656ee57a" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 18:10:24 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-664f4dc4-06f7-42e1-9e97-3d2d37f6e46e tempest-TestStampPattern-2144166935 tempest-TestStampPattern-2144166935-project-member] Lock "285d1e76-103b-47fa-9982-4f2d656ee57a" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 18:10:24 user nova-compute[74613]: INFO nova.compute.manager [None req-664f4dc4-06f7-42e1-9e97-3d2d37f6e46e tempest-TestStampPattern-2144166935 tempest-TestStampPattern-2144166935-project-member] [instance: 285d1e76-103b-47fa-9982-4f2d656ee57a] Detaching volume feacf752-4278-4706-96de-8baca33a964d
Nov 29 18:10:24 user nova-compute[74613]: INFO nova.virt.block_device [None req-664f4dc4-06f7-42e1-9e97-3d2d37f6e46e tempest-TestStampPattern-2144166935 tempest-TestStampPattern-2144166935-project-member] [instance: 285d1e76-103b-47fa-9982-4f2d656ee57a] Attempting to driver detach volume feacf752-4278-4706-96de-8baca33a964d from mountpoint /dev/vdb
Nov 29 18:10:24 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-664f4dc4-06f7-42e1-9e97-3d2d37f6e46e tempest-TestStampPattern-2144166935 tempest-TestStampPattern-2144166935-project-member] Attempting to detach device vdb from instance 285d1e76-103b-47fa-9982-4f2d656ee57a from the persistent domain config. {{(pid=74613) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 29 18:10:24 user nova-compute[74613]: DEBUG nova.virt.libvirt.guest [None req-664f4dc4-06f7-42e1-9e97-3d2d37f6e46e tempest-TestStampPattern-2144166935 tempest-TestStampPattern-2144166935-project-member] detach device xml: <disk type="block" device="disk">
Nov 29 18:10:24 user nova-compute[74613]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 18:10:24 user nova-compute[74613]:   <source dev="/dev/sde"/>
Nov 29 18:10:24 user nova-compute[74613]:   <target dev="vdb" bus="virtio"/>
Nov 29 18:10:24 user nova-compute[74613]:   <serial>feacf752-4278-4706-96de-8baca33a964d</serial>
Nov 29 18:10:24 user nova-compute[74613]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 29 18:10:24 user nova-compute[74613]: </disk>
Nov 29 18:10:24 user nova-compute[74613]:  {{(pid=74613) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 29 18:10:24 user nova-compute[74613]: INFO nova.virt.libvirt.driver [None req-664f4dc4-06f7-42e1-9e97-3d2d37f6e46e tempest-TestStampPattern-2144166935 tempest-TestStampPattern-2144166935-project-member] Successfully detached device vdb from instance 285d1e76-103b-47fa-9982-4f2d656ee57a from the persistent domain config.
Nov 29 18:10:24 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-664f4dc4-06f7-42e1-9e97-3d2d37f6e46e tempest-TestStampPattern-2144166935 tempest-TestStampPattern-2144166935-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 285d1e76-103b-47fa-9982-4f2d656ee57a from the live domain config. {{(pid=74613) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 29 18:10:24 user nova-compute[74613]: DEBUG nova.virt.libvirt.guest [None req-664f4dc4-06f7-42e1-9e97-3d2d37f6e46e tempest-TestStampPattern-2144166935 tempest-TestStampPattern-2144166935-project-member] detach device xml: <disk type="block" device="disk">
Nov 29 18:10:24 user nova-compute[74613]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 18:10:24 user nova-compute[74613]:   <source dev="/dev/sde"/>
Nov 29 18:10:24 user nova-compute[74613]:   <target dev="vdb" bus="virtio"/>
Nov 29 18:10:24 user nova-compute[74613]:   <serial>feacf752-4278-4706-96de-8baca33a964d</serial>
Nov 29 18:10:24 user nova-compute[74613]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 29 18:10:24 user nova-compute[74613]: </disk>
Nov 29 18:10:24 user nova-compute[74613]:  {{(pid=74613) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 29 18:10:25 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-664f4dc4-06f7-42e1-9e97-3d2d37f6e46e tempest-TestStampPattern-2144166935 tempest-TestStampPattern-2144166935-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 285d1e76-103b-47fa-9982-4f2d656ee57a {{(pid=74613) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 29 18:10:25 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:10:27 user nova-compute[74613]: DEBUG oslo_service.periodic_task [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74613) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 18:10:27 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 18:10:27 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 18:10:27 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 18:10:27 user nova-compute[74613]: DEBUG nova.compute.resource_tracker [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Auditing locally available compute resources for user (node: user) {{(pid=74613) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 29 18:10:27 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/461df216-9911-4af0-98dc-5fa1a6b5c14b/disk --force-share --output=json {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:10:27 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/461df216-9911-4af0-98dc-5fa1a6b5c14b/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:10:27 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/461df216-9911-4af0-98dc-5fa1a6b5c14b/disk --force-share --output=json {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:10:28 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/461df216-9911-4af0-98dc-5fa1a6b5c14b/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:10:28 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/69109f06-acbf-4834-b05e-80ab6e3f6ea0/disk --force-share --output=json {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:10:28 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-4c79cbc0-7725-4d98-ab67-b919b2864548 tempest-ServerActionsTestOtherA-1784608629 tempest-ServerActionsTestOtherA-1784608629-project-member] Acquiring lock "abc9e2b8-f467-4cd0-b40f-de511fde1ec1" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 18:10:28 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-4c79cbc0-7725-4d98-ab67-b919b2864548 tempest-ServerActionsTestOtherA-1784608629 tempest-ServerActionsTestOtherA-1784608629-project-member] Lock "abc9e2b8-f467-4cd0-b40f-de511fde1ec1" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.003s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 18:10:28 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-4c79cbc0-7725-4d98-ab67-b919b2864548 tempest-ServerActionsTestOtherA-1784608629 tempest-ServerActionsTestOtherA-1784608629-project-member] Acquiring lock "abc9e2b8-f467-4cd0-b40f-de511fde1ec1-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 18:10:28 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-4c79cbc0-7725-4d98-ab67-b919b2864548 tempest-ServerActionsTestOtherA-1784608629 tempest-ServerActionsTestOtherA-1784608629-project-member] Lock "abc9e2b8-f467-4cd0-b40f-de511fde1ec1-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 18:10:28 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-4c79cbc0-7725-4d98-ab67-b919b2864548 tempest-ServerActionsTestOtherA-1784608629 tempest-ServerActionsTestOtherA-1784608629-project-member] Lock "abc9e2b8-f467-4cd0-b40f-de511fde1ec1-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 18:10:28 user nova-compute[74613]: INFO nova.compute.manager [None req-4c79cbc0-7725-4d98-ab67-b919b2864548 tempest-ServerActionsTestOtherA-1784608629 tempest-ServerActionsTestOtherA-1784608629-project-member] [instance: abc9e2b8-f467-4cd0-b40f-de511fde1ec1] Terminating instance
Nov 29 18:10:28 user nova-compute[74613]: DEBUG nova.compute.manager [None req-4c79cbc0-7725-4d98-ab67-b919b2864548 tempest-ServerActionsTestOtherA-1784608629 tempest-ServerActionsTestOtherA-1784608629-project-member] [instance: abc9e2b8-f467-4cd0-b40f-de511fde1ec1] Start destroying the instance on the hypervisor. {{(pid=74613) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 29 18:10:28 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/69109f06-acbf-4834-b05e-80ab6e3f6ea0/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:10:28 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/69109f06-acbf-4834-b05e-80ab6e3f6ea0/disk --force-share --output=json {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:10:28 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:10:28 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:10:28 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:10:28 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:10:28 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/69109f06-acbf-4834-b05e-80ab6e3f6ea0/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:10:28 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=74613) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 29 18:10:28 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9eb14feb-f196-42b1-a6ba-2a049dea2d5e/disk --force-share --output=json {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:10:28 user nova-compute[74613]: DEBUG nova.compute.manager [req-6a884804-2194-4aba-9a8e-1570ef5f82e7 req-dff76d38-4fb2-4b2e-869d-880ee0bcfd85 service nova] [instance: abc9e2b8-f467-4cd0-b40f-de511fde1ec1] Received event network-vif-unplugged-59a8bf1b-9fb1-4526-92d5-9ad1897c1ee8 {{(pid=74613) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 18:10:28 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-6a884804-2194-4aba-9a8e-1570ef5f82e7 req-dff76d38-4fb2-4b2e-869d-880ee0bcfd85 service nova] Acquiring lock "abc9e2b8-f467-4cd0-b40f-de511fde1ec1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 18:10:28 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-6a884804-2194-4aba-9a8e-1570ef5f82e7 req-dff76d38-4fb2-4b2e-869d-880ee0bcfd85 service nova] Lock "abc9e2b8-f467-4cd0-b40f-de511fde1ec1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 18:10:28 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-6a884804-2194-4aba-9a8e-1570ef5f82e7 req-dff76d38-4fb2-4b2e-869d-880ee0bcfd85 service nova] Lock "abc9e2b8-f467-4cd0-b40f-de511fde1ec1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 18:10:28 user nova-compute[74613]: DEBUG nova.compute.manager [req-6a884804-2194-4aba-9a8e-1570ef5f82e7 req-dff76d38-4fb2-4b2e-869d-880ee0bcfd85 service nova] [instance: abc9e2b8-f467-4cd0-b40f-de511fde1ec1] No waiting events found dispatching network-vif-unplugged-59a8bf1b-9fb1-4526-92d5-9ad1897c1ee8 {{(pid=74613) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 18:10:28 user nova-compute[74613]: DEBUG nova.compute.manager [req-6a884804-2194-4aba-9a8e-1570ef5f82e7 req-dff76d38-4fb2-4b2e-869d-880ee0bcfd85 service nova] [instance: abc9e2b8-f467-4cd0-b40f-de511fde1ec1] Received event network-vif-unplugged-59a8bf1b-9fb1-4526-92d5-9ad1897c1ee8 for instance with task_state deleting. {{(pid=74613) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 29 18:10:28 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9eb14feb-f196-42b1-a6ba-2a049dea2d5e/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:10:28 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9eb14feb-f196-42b1-a6ba-2a049dea2d5e/disk --force-share --output=json {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:10:28 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9eb14feb-f196-42b1-a6ba-2a049dea2d5e/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:10:28 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f4a1329-b3b9-4d1c-8735-abddabc359fd/disk.rescue --force-share --output=json {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:10:29 user nova-compute[74613]: INFO nova.virt.libvirt.driver [-] [instance: abc9e2b8-f467-4cd0-b40f-de511fde1ec1] Instance destroyed successfully.
Nov 29 18:10:29 user nova-compute[74613]: DEBUG nova.objects.instance [None req-4c79cbc0-7725-4d98-ab67-b919b2864548 tempest-ServerActionsTestOtherA-1784608629 tempest-ServerActionsTestOtherA-1784608629-project-member] Lazy-loading 'resources' on Instance uuid abc9e2b8-f467-4cd0-b40f-de511fde1ec1 {{(pid=74613) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 18:10:29 user nova-compute[74613]: DEBUG nova.virt.libvirt.vif [None req-4c79cbc0-7725-4d98-ab67-b919b2864548 tempest-ServerActionsTestOtherA-1784608629 tempest-ServerActionsTestOtherA-1784608629-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T17:51:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1839142631',display_name='tempest-ServerActionsTestOtherA-server-1839142631',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-1839142631',id=5,image_ref='4217f428-8d9d-4ee1-9614-642d26d90c46',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIpucl9TdiuMtgo2HD8A0S0XK6/wskQQSBMcoxjyazAtLZUlGJCbAbNEhyc7Esm1yWePtzGTrNFIbg4z5HCtj+7HLtHc8+57P9i9m4iI8l/z1ZnWm+BWBA3bkBkjzP6q3Q==',key_name='tempest-keypair-1839431126',keypairs=<?>,launch_index=0,launched_at=2023-11-29T17:51:44Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='b1f70c311d4941c986de21ac458d11ab',ramdisk_id='',reservation_id='r-abzkfybc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='4217f428-8d9d-4ee1-9614-642d26d90c46',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-1784608629',owner_user_name='tempest-ServerActionsTestOtherA-1784608629-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-29T17:51:44Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='368555c72103480b82c5c0bf64b07360',uuid=abc9e2b8-f467-4cd0-b40f-de511fde1ec1,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "59a8bf1b-9fb1-4526-92d5-9ad1897c1ee8", "address": "fa:16:3e:e3:5f:12", "network": {"id": "7c2c368e-4c7d-4d70-9a40-c10fe9541af9", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1287934102-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b1f70c311d4941c986de21ac458d11ab", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap59a8bf1b-9f", "ovs_interfaceid": "59a8bf1b-9fb1-4526-92d5-9ad1897c1ee8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74613) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 29 18:10:29 user nova-compute[74613]: DEBUG nova.network.os_vif_util [None req-4c79cbc0-7725-4d98-ab67-b919b2864548 tempest-ServerActionsTestOtherA-1784608629 tempest-ServerActionsTestOtherA-1784608629-project-member] Converting VIF {"id": "59a8bf1b-9fb1-4526-92d5-9ad1897c1ee8", "address": "fa:16:3e:e3:5f:12", "network": {"id": "7c2c368e-4c7d-4d70-9a40-c10fe9541af9", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1287934102-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b1f70c311d4941c986de21ac458d11ab", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap59a8bf1b-9f", "ovs_interfaceid": "59a8bf1b-9fb1-4526-92d5-9ad1897c1ee8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74613) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 18:10:29 user nova-compute[74613]: DEBUG nova.network.os_vif_util [None req-4c79cbc0-7725-4d98-ab67-b919b2864548 tempest-ServerActionsTestOtherA-1784608629 tempest-ServerActionsTestOtherA-1784608629-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:e3:5f:12,bridge_name='br-int',has_traffic_filtering=True,id=59a8bf1b-9fb1-4526-92d5-9ad1897c1ee8,network=Network(7c2c368e-4c7d-4d70-9a40-c10fe9541af9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap59a8bf1b-9f') {{(pid=74613) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 18:10:29 user nova-compute[74613]: DEBUG os_vif [None req-4c79cbc0-7725-4d98-ab67-b919b2864548 tempest-ServerActionsTestOtherA-1784608629 tempest-ServerActionsTestOtherA-1784608629-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:e3:5f:12,bridge_name='br-int',has_traffic_filtering=True,id=59a8bf1b-9fb1-4526-92d5-9ad1897c1ee8,network=Network(7c2c368e-4c7d-4d70-9a40-c10fe9541af9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap59a8bf1b-9f') {{(pid=74613) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 29 18:10:29 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:10:29 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap59a8bf1b-9f, bridge=br-int, if_exists=True) {{(pid=74613) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 18:10:29 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:10:29 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f4a1329-b3b9-4d1c-8735-abddabc359fd/disk.rescue --force-share --output=json" returned: 0 in 0.198s {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:10:29 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f4a1329-b3b9-4d1c-8735-abddabc359fd/disk.rescue --force-share --output=json {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:10:29 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 18:10:29 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:10:29 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=b19dea82-3c3d-486c-a54c-fab6102e6e98) {{(pid=74613) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 18:10:29 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 18:10:29 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:10:29 user nova-compute[74613]: INFO os_vif [None req-4c79cbc0-7725-4d98-ab67-b919b2864548 tempest-ServerActionsTestOtherA-1784608629 tempest-ServerActionsTestOtherA-1784608629-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:e3:5f:12,bridge_name='br-int',has_traffic_filtering=True,id=59a8bf1b-9fb1-4526-92d5-9ad1897c1ee8,network=Network(7c2c368e-4c7d-4d70-9a40-c10fe9541af9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap59a8bf1b-9f')
Nov 29 18:10:29 user nova-compute[74613]: INFO nova.virt.libvirt.driver [None req-4c79cbc0-7725-4d98-ab67-b919b2864548 tempest-ServerActionsTestOtherA-1784608629 tempest-ServerActionsTestOtherA-1784608629-project-member] [instance: abc9e2b8-f467-4cd0-b40f-de511fde1ec1] Deleting instance files /opt/stack/data/nova/instances/abc9e2b8-f467-4cd0-b40f-de511fde1ec1_del
Nov 29 18:10:29 user nova-compute[74613]: INFO nova.virt.libvirt.driver [None req-4c79cbc0-7725-4d98-ab67-b919b2864548 tempest-ServerActionsTestOtherA-1784608629 tempest-ServerActionsTestOtherA-1784608629-project-member] [instance: abc9e2b8-f467-4cd0-b40f-de511fde1ec1] Deletion of /opt/stack/data/nova/instances/abc9e2b8-f467-4cd0-b40f-de511fde1ec1_del complete
Nov 29 18:10:29 user nova-compute[74613]: INFO nova.compute.manager [None req-4c79cbc0-7725-4d98-ab67-b919b2864548 tempest-ServerActionsTestOtherA-1784608629 tempest-ServerActionsTestOtherA-1784608629-project-member] [instance: abc9e2b8-f467-4cd0-b40f-de511fde1ec1] Took 0.94 seconds to destroy the instance on the hypervisor.
Nov 29 18:10:29 user nova-compute[74613]: DEBUG oslo.service.loopingcall [None req-4c79cbc0-7725-4d98-ab67-b919b2864548 tempest-ServerActionsTestOtherA-1784608629 tempest-ServerActionsTestOtherA-1784608629-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74613) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 29 18:10:29 user nova-compute[74613]: DEBUG nova.compute.manager [-] [instance: abc9e2b8-f467-4cd0-b40f-de511fde1ec1] Deallocating network for instance {{(pid=74613) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 29 18:10:29 user nova-compute[74613]: DEBUG nova.network.neutron [-] [instance: abc9e2b8-f467-4cd0-b40f-de511fde1ec1] deallocate_for_instance() {{(pid=74613) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 29 18:10:29 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f4a1329-b3b9-4d1c-8735-abddabc359fd/disk.rescue --force-share --output=json" returned: 0 in 0.187s {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:10:29 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f4a1329-b3b9-4d1c-8735-abddabc359fd/disk --force-share --output=json {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:10:29 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f4a1329-b3b9-4d1c-8735-abddabc359fd/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:10:29 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f4a1329-b3b9-4d1c-8735-abddabc359fd/disk --force-share --output=json {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:10:29 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f4a1329-b3b9-4d1c-8735-abddabc359fd/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:10:29 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3b828860-5cc5-40b0-b845-8e560211794e/disk --force-share --output=json {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:10:29 user nova-compute[74613]: DEBUG nova.network.neutron [-] [instance: abc9e2b8-f467-4cd0-b40f-de511fde1ec1] Updating instance_info_cache with network_info: [] {{(pid=74613) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 18:10:29 user nova-compute[74613]: INFO nova.compute.manager [-] [instance: abc9e2b8-f467-4cd0-b40f-de511fde1ec1] Took 0.53 seconds to deallocate network for instance.
Nov 29 18:10:29 user nova-compute[74613]: DEBUG nova.compute.manager [req-ff7fae61-2c89-46c3-89d8-0b9741cc5b4e req-a927026e-d21b-46ef-8757-718913ea3400 service nova] [instance: abc9e2b8-f467-4cd0-b40f-de511fde1ec1] Received event network-vif-deleted-59a8bf1b-9fb1-4526-92d5-9ad1897c1ee8 {{(pid=74613) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 18:10:29 user nova-compute[74613]: INFO nova.compute.manager [req-ff7fae61-2c89-46c3-89d8-0b9741cc5b4e req-a927026e-d21b-46ef-8757-718913ea3400 service nova] [instance: abc9e2b8-f467-4cd0-b40f-de511fde1ec1] Neutron deleted interface 59a8bf1b-9fb1-4526-92d5-9ad1897c1ee8; detaching it from the instance and deleting it from the info cache
Nov 29 18:10:29 user nova-compute[74613]: DEBUG nova.network.neutron [req-ff7fae61-2c89-46c3-89d8-0b9741cc5b4e req-a927026e-d21b-46ef-8757-718913ea3400 service nova] [instance: abc9e2b8-f467-4cd0-b40f-de511fde1ec1] Updating instance_info_cache with network_info: [] {{(pid=74613) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 18:10:29 user nova-compute[74613]: DEBUG nova.compute.manager [req-ff7fae61-2c89-46c3-89d8-0b9741cc5b4e req-a927026e-d21b-46ef-8757-718913ea3400 service nova] [instance: abc9e2b8-f467-4cd0-b40f-de511fde1ec1] Detach interface failed, port_id=59a8bf1b-9fb1-4526-92d5-9ad1897c1ee8, reason: Instance abc9e2b8-f467-4cd0-b40f-de511fde1ec1 could not be found. {{(pid=74613) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 29 18:10:29 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3b828860-5cc5-40b0-b845-8e560211794e/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:10:29 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3b828860-5cc5-40b0-b845-8e560211794e/disk --force-share --output=json {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:10:29 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-4c79cbc0-7725-4d98-ab67-b919b2864548 tempest-ServerActionsTestOtherA-1784608629 tempest-ServerActionsTestOtherA-1784608629-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 18:10:29 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-4c79cbc0-7725-4d98-ab67-b919b2864548 tempest-ServerActionsTestOtherA-1784608629 tempest-ServerActionsTestOtherA-1784608629-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.002s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 18:10:30 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3b828860-5cc5-40b0-b845-8e560211794e/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:10:30 user nova-compute[74613]: WARNING nova.virt.libvirt.driver [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Error from libvirt while getting description of instance-00000005: [Error Code 42] Domain not found: no domain with matching uuid 'abc9e2b8-f467-4cd0-b40f-de511fde1ec1' (instance-00000005): libvirt.libvirtError: Domain not found: no domain with matching uuid 'abc9e2b8-f467-4cd0-b40f-de511fde1ec1' (instance-00000005)
Nov 29 18:10:30 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6993e2e7-7e03-45b4-9d3d-3742589b6078/disk.rescue --force-share --output=json {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:10:30 user nova-compute[74613]: DEBUG nova.compute.provider_tree [None req-4c79cbc0-7725-4d98-ab67-b919b2864548 tempest-ServerActionsTestOtherA-1784608629 tempest-ServerActionsTestOtherA-1784608629-project-member] Inventory has not changed in ProviderTree for provider: 639d980e-3b12-44b1-b8f4-1812416fa4dd {{(pid=74613) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 18:10:30 user nova-compute[74613]: DEBUG nova.scheduler.client.report [None req-4c79cbc0-7725-4d98-ab67-b919b2864548 tempest-ServerActionsTestOtherA-1784608629 tempest-ServerActionsTestOtherA-1784608629-project-member] Inventory has not changed for provider 639d980e-3b12-44b1-b8f4-1812416fa4dd based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74613) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 18:10:30 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6993e2e7-7e03-45b4-9d3d-3742589b6078/disk.rescue --force-share --output=json" returned: 0 in 0.191s {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:10:30 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6993e2e7-7e03-45b4-9d3d-3742589b6078/disk.rescue --force-share --output=json {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:10:30 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-4c79cbc0-7725-4d98-ab67-b919b2864548 tempest-ServerActionsTestOtherA-1784608629 tempest-ServerActionsTestOtherA-1784608629-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.393s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 18:10:30 user nova-compute[74613]: INFO nova.scheduler.client.report [None req-4c79cbc0-7725-4d98-ab67-b919b2864548 tempest-ServerActionsTestOtherA-1784608629 tempest-ServerActionsTestOtherA-1784608629-project-member] Deleted allocations for instance abc9e2b8-f467-4cd0-b40f-de511fde1ec1
Nov 29 18:10:30 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-4c79cbc0-7725-4d98-ab67-b919b2864548 tempest-ServerActionsTestOtherA-1784608629 tempest-ServerActionsTestOtherA-1784608629-project-member] Lock "abc9e2b8-f467-4cd0-b40f-de511fde1ec1" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.133s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 18:10:30 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6993e2e7-7e03-45b4-9d3d-3742589b6078/disk.rescue --force-share --output=json" returned: 0 in 0.176s {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:10:30 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6993e2e7-7e03-45b4-9d3d-3742589b6078/disk --force-share --output=json {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:10:30 user nova-compute[74613]: DEBUG nova.compute.manager [req-35ace2e5-9637-41b9-8ba3-251aa4454b15 req-e3d4f795-566d-48c6-b33b-6f74d69a4703 service nova] [instance: abc9e2b8-f467-4cd0-b40f-de511fde1ec1] Received event network-vif-plugged-59a8bf1b-9fb1-4526-92d5-9ad1897c1ee8 {{(pid=74613) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 18:10:30 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-35ace2e5-9637-41b9-8ba3-251aa4454b15 req-e3d4f795-566d-48c6-b33b-6f74d69a4703 service nova] Acquiring lock "abc9e2b8-f467-4cd0-b40f-de511fde1ec1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 18:10:30 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-35ace2e5-9637-41b9-8ba3-251aa4454b15 req-e3d4f795-566d-48c6-b33b-6f74d69a4703 service nova] Lock "abc9e2b8-f467-4cd0-b40f-de511fde1ec1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 18:10:30 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-35ace2e5-9637-41b9-8ba3-251aa4454b15 req-e3d4f795-566d-48c6-b33b-6f74d69a4703 service nova] Lock "abc9e2b8-f467-4cd0-b40f-de511fde1ec1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 18:10:30 user nova-compute[74613]: DEBUG nova.compute.manager [req-35ace2e5-9637-41b9-8ba3-251aa4454b15 req-e3d4f795-566d-48c6-b33b-6f74d69a4703 service nova] [instance: abc9e2b8-f467-4cd0-b40f-de511fde1ec1] No waiting events found dispatching network-vif-plugged-59a8bf1b-9fb1-4526-92d5-9ad1897c1ee8 {{(pid=74613) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 18:10:30 user nova-compute[74613]: WARNING nova.compute.manager [req-35ace2e5-9637-41b9-8ba3-251aa4454b15 req-e3d4f795-566d-48c6-b33b-6f74d69a4703 service nova] [instance: abc9e2b8-f467-4cd0-b40f-de511fde1ec1] Received unexpected event network-vif-plugged-59a8bf1b-9fb1-4526-92d5-9ad1897c1ee8 for instance with vm_state deleted and task_state None.
Nov 29 18:10:30 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6993e2e7-7e03-45b4-9d3d-3742589b6078/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:10:30 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6993e2e7-7e03-45b4-9d3d-3742589b6078/disk --force-share --output=json {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:10:30 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:10:30 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6993e2e7-7e03-45b4-9d3d-3742589b6078/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:10:30 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74613) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 29 18:10:30 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/285d1e76-103b-47fa-9982-4f2d656ee57a/disk --force-share --output=json {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:10:31 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/285d1e76-103b-47fa-9982-4f2d656ee57a/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:10:31 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/285d1e76-103b-47fa-9982-4f2d656ee57a/disk --force-share --output=json {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:10:31 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/285d1e76-103b-47fa-9982-4f2d656ee57a/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:10:31 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e2439d62-4713-435d-81ce-fafe1d811b47/disk --force-share --output=json {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:10:31 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e2439d62-4713-435d-81ce-fafe1d811b47/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:10:31 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e2439d62-4713-435d-81ce-fafe1d811b47/disk --force-share --output=json {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:10:31 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e2439d62-4713-435d-81ce-fafe1d811b47/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:10:31 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=74613) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 29 18:10:31 user nova-compute[74613]: WARNING nova.virt.libvirt.driver [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 18:10:31 user nova-compute[74613]: WARNING nova.virt.libvirt.driver [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 18:10:31 user nova-compute[74613]: DEBUG nova.compute.resource_tracker [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Hypervisor/Node resource view: name=user free_ram=7704MB free_disk=24.662826538085938GB free_vcpus=2 pci_devices=[{"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74613) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 29 18:10:31 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 18:10:31 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 18:10:32 user nova-compute[74613]: DEBUG nova.compute.resource_tracker [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Instance 3b828860-5cc5-40b0-b845-8e560211794e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74613) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 18:10:32 user nova-compute[74613]: DEBUG nova.compute.resource_tracker [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Instance cd22685a-028c-4e0c-834d-e7b20f6d06ab actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74613) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 18:10:32 user nova-compute[74613]: DEBUG nova.compute.resource_tracker [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Instance 6993e2e7-7e03-45b4-9d3d-3742589b6078 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74613) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 18:10:32 user nova-compute[74613]: DEBUG nova.compute.resource_tracker [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Instance 6f4a1329-b3b9-4d1c-8735-abddabc359fd actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74613) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 18:10:32 user nova-compute[74613]: DEBUG nova.compute.resource_tracker [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Instance 9eb14feb-f196-42b1-a6ba-2a049dea2d5e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74613) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 18:10:32 user nova-compute[74613]: DEBUG nova.compute.resource_tracker [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Instance 69109f06-acbf-4834-b05e-80ab6e3f6ea0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74613) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 18:10:32 user nova-compute[74613]: DEBUG nova.compute.resource_tracker [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Instance e2439d62-4713-435d-81ce-fafe1d811b47 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74613) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 18:10:32 user nova-compute[74613]: DEBUG nova.compute.resource_tracker [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Instance 285d1e76-103b-47fa-9982-4f2d656ee57a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74613) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 18:10:32 user nova-compute[74613]: DEBUG nova.compute.resource_tracker [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Instance 461df216-9911-4af0-98dc-5fa1a6b5c14b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74613) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 18:10:32 user nova-compute[74613]: DEBUG nova.compute.resource_tracker [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Total usable vcpus: 12, total allocated vcpus: 9 {{(pid=74613) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 29 18:10:32 user nova-compute[74613]: DEBUG nova.compute.resource_tracker [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Final resource view: name=user phys_ram=16011MB used_ram=5120MB phys_disk=40GB used_disk=8GB total_vcpus=12 used_vcpus=9 pci_stats=[] {{(pid=74613) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 29 18:10:32 user nova-compute[74613]: DEBUG nova.compute.provider_tree [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Inventory has not changed in ProviderTree for provider: 639d980e-3b12-44b1-b8f4-1812416fa4dd {{(pid=74613) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 18:10:32 user nova-compute[74613]: DEBUG nova.scheduler.client.report [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Inventory has not changed for provider 639d980e-3b12-44b1-b8f4-1812416fa4dd based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74613) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 18:10:32 user nova-compute[74613]: DEBUG nova.compute.resource_tracker [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Compute_service record updated for user:user {{(pid=74613) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 29 18:10:32 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.425s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 18:10:34 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:10:34 user nova-compute[74613]: DEBUG oslo_service.periodic_task [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74613) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 18:10:34 user nova-compute[74613]: DEBUG oslo_service.periodic_task [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74613) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 18:10:34 user nova-compute[74613]: DEBUG nova.compute.manager [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Starting heal instance info cache {{(pid=74613) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 29 18:10:34 user nova-compute[74613]: DEBUG nova.compute.manager [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Rebuilding the list of instances to heal {{(pid=74613) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 29 18:10:34 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Acquiring lock "refresh_cache-3b828860-5cc5-40b0-b845-8e560211794e" {{(pid=74613) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 18:10:34 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Acquired lock "refresh_cache-3b828860-5cc5-40b0-b845-8e560211794e" {{(pid=74613) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 18:10:34 user nova-compute[74613]: DEBUG nova.network.neutron [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] [instance: 3b828860-5cc5-40b0-b845-8e560211794e] Forcefully refreshing network info cache for instance {{(pid=74613) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 29 18:10:34 user nova-compute[74613]: DEBUG nova.objects.instance [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Lazy-loading 'info_cache' on Instance uuid 3b828860-5cc5-40b0-b845-8e560211794e {{(pid=74613) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 18:10:35 user nova-compute[74613]: DEBUG nova.network.neutron [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] [instance: 3b828860-5cc5-40b0-b845-8e560211794e] Updating instance_info_cache with network_info: [{"id": "dfe097e1-192f-47e2-96b7-0e9fe8320758", "address": "fa:16:3e:c2:a8:2f", "network": {"id": "0722b02d-a357-4360-87e8-580913723985", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-579793494-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b820dd795dfe46cd804772f0e71f98e9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdfe097e1-19", "ovs_interfaceid": "dfe097e1-192f-47e2-96b7-0e9fe8320758", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74613) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 18:10:35 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Releasing lock "refresh_cache-3b828860-5cc5-40b0-b845-8e560211794e" {{(pid=74613) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 18:10:35 user nova-compute[74613]: DEBUG nova.compute.manager [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] [instance: 3b828860-5cc5-40b0-b845-8e560211794e] Updated the network info_cache for instance {{(pid=74613) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 29 18:10:35 user nova-compute[74613]: DEBUG oslo_service.periodic_task [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74613) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 18:10:35 user nova-compute[74613]: DEBUG oslo_service.periodic_task [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74613) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 18:10:35 user nova-compute[74613]: DEBUG oslo_service.periodic_task [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74613) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 18:10:35 user nova-compute[74613]: DEBUG oslo_service.periodic_task [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74613) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 18:10:35 user nova-compute[74613]: DEBUG oslo_service.periodic_task [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74613) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 18:10:35 user nova-compute[74613]: DEBUG nova.compute.manager [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74613) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 29 18:10:35 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-d6d47e39-ca7c-47e0-827d-decdc6f47579 tempest-AttachVolumeNegativeTest-483083654 tempest-AttachVolumeNegativeTest-483083654-project-member] Acquiring lock "e2439d62-4713-435d-81ce-fafe1d811b47" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 18:10:35 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-d6d47e39-ca7c-47e0-827d-decdc6f47579 tempest-AttachVolumeNegativeTest-483083654 tempest-AttachVolumeNegativeTest-483083654-project-member] Lock "e2439d62-4713-435d-81ce-fafe1d811b47" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 18:10:35 user nova-compute[74613]: INFO nova.compute.manager [None req-d6d47e39-ca7c-47e0-827d-decdc6f47579 tempest-AttachVolumeNegativeTest-483083654 tempest-AttachVolumeNegativeTest-483083654-project-member] [instance: e2439d62-4713-435d-81ce-fafe1d811b47] Detaching volume 34908494-9a6c-4c8c-b447-9768745356ca
Nov 29 18:10:35 user nova-compute[74613]: INFO nova.virt.block_device [None req-d6d47e39-ca7c-47e0-827d-decdc6f47579 tempest-AttachVolumeNegativeTest-483083654 tempest-AttachVolumeNegativeTest-483083654-project-member] [instance: e2439d62-4713-435d-81ce-fafe1d811b47] Attempting to driver detach volume 34908494-9a6c-4c8c-b447-9768745356ca from mountpoint /dev/vdb
Nov 29 18:10:35 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-d6d47e39-ca7c-47e0-827d-decdc6f47579 tempest-AttachVolumeNegativeTest-483083654 tempest-AttachVolumeNegativeTest-483083654-project-member] Attempting to detach device vdb from instance e2439d62-4713-435d-81ce-fafe1d811b47 from the persistent domain config. {{(pid=74613) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 29 18:10:35 user nova-compute[74613]: DEBUG nova.virt.libvirt.guest [None req-d6d47e39-ca7c-47e0-827d-decdc6f47579 tempest-AttachVolumeNegativeTest-483083654 tempest-AttachVolumeNegativeTest-483083654-project-member] detach device xml: <disk type="block" device="disk">
Nov 29 18:10:35 user nova-compute[74613]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 18:10:35 user nova-compute[74613]:   <source dev="/dev/sdd"/>
Nov 29 18:10:35 user nova-compute[74613]:   <target dev="vdb" bus="virtio"/>
Nov 29 18:10:35 user nova-compute[74613]:   <serial>34908494-9a6c-4c8c-b447-9768745356ca</serial>
Nov 29 18:10:35 user nova-compute[74613]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 29 18:10:35 user nova-compute[74613]: </disk>
Nov 29 18:10:35 user nova-compute[74613]:  {{(pid=74613) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 29 18:10:35 user nova-compute[74613]: INFO nova.virt.libvirt.driver [None req-d6d47e39-ca7c-47e0-827d-decdc6f47579 tempest-AttachVolumeNegativeTest-483083654 tempest-AttachVolumeNegativeTest-483083654-project-member] Successfully detached device vdb from instance e2439d62-4713-435d-81ce-fafe1d811b47 from the persistent domain config.
Nov 29 18:10:35 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-d6d47e39-ca7c-47e0-827d-decdc6f47579 tempest-AttachVolumeNegativeTest-483083654 tempest-AttachVolumeNegativeTest-483083654-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance e2439d62-4713-435d-81ce-fafe1d811b47 from the live domain config. {{(pid=74613) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 29 18:10:35 user nova-compute[74613]: DEBUG nova.virt.libvirt.guest [None req-d6d47e39-ca7c-47e0-827d-decdc6f47579 tempest-AttachVolumeNegativeTest-483083654 tempest-AttachVolumeNegativeTest-483083654-project-member] detach device xml: <disk type="block" device="disk">
Nov 29 18:10:35 user nova-compute[74613]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 18:10:35 user nova-compute[74613]:   <source dev="/dev/sdd"/>
Nov 29 18:10:35 user nova-compute[74613]:   <target dev="vdb" bus="virtio"/>
Nov 29 18:10:35 user nova-compute[74613]:   <serial>34908494-9a6c-4c8c-b447-9768745356ca</serial>
Nov 29 18:10:35 user nova-compute[74613]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 29 18:10:35 user nova-compute[74613]: </disk>
Nov 29 18:10:35 user nova-compute[74613]:  {{(pid=74613) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 29 18:10:36 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-d6d47e39-ca7c-47e0-827d-decdc6f47579 tempest-AttachVolumeNegativeTest-483083654 tempest-AttachVolumeNegativeTest-483083654-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance e2439d62-4713-435d-81ce-fafe1d811b47 {{(pid=74613) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 29 18:10:36 user nova-compute[74613]: DEBUG oslo_service.periodic_task [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74613) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 18:10:39 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 18:10:39 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:10:39 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74613) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 29 18:10:39 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74613) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 18:10:39 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74613) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 18:10:39 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:10:44 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:10:45 user nova-compute[74613]: WARNING nova.virt.libvirt.driver [None req-664f4dc4-06f7-42e1-9e97-3d2d37f6e46e tempest-TestStampPattern-2144166935 tempest-TestStampPattern-2144166935-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 285d1e76-103b-47fa-9982-4f2d656ee57a is timed out.
Nov 29 18:10:45 user nova-compute[74613]: INFO nova.virt.libvirt.driver [None req-664f4dc4-06f7-42e1-9e97-3d2d37f6e46e tempest-TestStampPattern-2144166935 tempest-TestStampPattern-2144166935-project-member] Successfully detached device vdb from instance 285d1e76-103b-47fa-9982-4f2d656ee57a from the live domain config.
Nov 29 18:10:45 user nova-compute[74613]: DEBUG nova.virt.libvirt.volume.iscsi [None req-664f4dc4-06f7-42e1-9e97-3d2d37f6e46e tempest-TestStampPattern-2144166935 tempest-TestStampPattern-2144166935-project-member] [instance: 285d1e76-103b-47fa-9982-4f2d656ee57a] calling os-brick to detach iSCSI Volume {{(pid=74613) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 29 18:10:45 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-664f4dc4-06f7-42e1-9e97-3d2d37f6e46e tempest-TestStampPattern-2144166935 tempest-TestStampPattern-2144166935-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff828156890>, {'target_iqn': 'iqn.2010-10.org.openstack:feacf752-4278-4706-96de-8baca33a964d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YICjdcps', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': False}}" {{(pid=74613) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 18:10:45 user nova-compute[74613]: WARNING os_brick.initiator.connectors.base [None req-664f4dc4-06f7-42e1-9e97-3d2d37f6e46e tempest-TestStampPattern-2144166935 tempest-TestStampPattern-2144166935-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 18:10:45 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.base [None req-664f4dc4-06f7-42e1-9e97-3d2d37f6e46e tempest-TestStampPattern-2144166935 tempest-TestStampPattern-2144166935-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 18:10:45 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.base [None req-664f4dc4-06f7-42e1-9e97-3d2d37f6e46e tempest-TestStampPattern-2144166935 tempest-TestStampPattern-2144166935-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 18:10:45 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:10:45 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:10:45 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[199f1441-547f-46bf-833a-7349cd69ca21]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:9511387c-8772-40f2-bf2d-6b6387649e9f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:feacf752-4278-4706-96de-8baca33a964d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:34908494-9a6c-4c8c-b447-9768745356ca\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b2879f1d-797c-4701-8803-eb6369ddb534\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 18:10:45 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-664f4dc4-06f7-42e1-9e97-3d2d37f6e46e tempest-TestStampPattern-2144166935 tempest-TestStampPattern-2144166935-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 29 18:10:45 user nova-compute[74613]: No targets found.
Nov 29 18:10:45 user nova-compute[74613]: iSNS:
Nov 29 18:10:45 user nova-compute[74613]: No targets found.
Nov 29 18:10:45 user nova-compute[74613]: STATIC:
Nov 29 18:10:45 user nova-compute[74613]: Target: iqn.2010-10.org.openstack:9511387c-8772-40f2-bf2d-6b6387649e9f
Nov 29 18:10:45 user nova-compute[74613]:         Portal: 172.16.0.220:3260,-1
Nov 29 18:10:45 user nova-compute[74613]:                 Iface Name: default
Nov 29 18:10:45 user nova-compute[74613]: Target: iqn.2010-10.org.openstack:feacf752-4278-4706-96de-8baca33a964d
Nov 29 18:10:45 user nova-compute[74613]:         Portal: 172.16.0.220:3260,-1
Nov 29 18:10:45 user nova-compute[74613]:                 Iface Name: default
Nov 29 18:10:45 user nova-compute[74613]: Target: iqn.2010-10.org.openstack:34908494-9a6c-4c8c-b447-9768745356ca
Nov 29 18:10:45 user nova-compute[74613]:         Portal: 172.16.0.220:3260,-1
Nov 29 18:10:45 user nova-compute[74613]:                 Iface Name: default
Nov 29 18:10:45 user nova-compute[74613]: Target: iqn.2010-10.org.openstack:b2879f1d-797c-4701-8803-eb6369ddb534
Nov 29 18:10:45 user nova-compute[74613]:         Portal: 172.16.0.220:3260,-1
Nov 29 18:10:45 user nova-compute[74613]:                 Iface Name: default
Nov 29 18:10:45 user nova-compute[74613]: FIRMWARE:
Nov 29 18:10:45 user nova-compute[74613]: No targets found.
Nov 29 18:10:45 user nova-compute[74613]:  stderr= {{(pid=74613) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 18:10:45 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-664f4dc4-06f7-42e1-9e97-3d2d37f6e46e tempest-TestStampPattern-2144166935 tempest-TestStampPattern-2144166935-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 29 18:10:45 user nova-compute[74613]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 29 18:10:45 user nova-compute[74613]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74613) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 29 18:10:45 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-664f4dc4-06f7-42e1-9e97-3d2d37f6e46e tempest-TestStampPattern-2144166935 tempest-TestStampPattern-2144166935-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:feacf752-4278-4706-96de-8baca33a964d', 0)] {{(pid=74613) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 29 18:10:45 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:10:45 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:10:45 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2d2bc6e-8621-4003-a8e6-ed2d7316e80f]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:34908494-9a6c-4c8c-b447-9768745356ca\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9511387c-8772-40f2-bf2d-6b6387649e9f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b2879f1d-797c-4701-8803-eb6369ddb534\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:feacf752-4278-4706-96de-8baca33a964d\n', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 18:10:45 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:10:45 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:10:45 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[916a52fe-21d3-4b38-8133-0d9ff09a2610]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9511387c-8772-40f2-bf2d-6b6387649e9f (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:34908494-9a6c-4c8c-b447-9768745356ca (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2879f1d-797c-4701-8803-eb6369ddb534 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:feacf752-4278-4706-96de-8baca33a964d (non-flash)\n', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 18:10:45 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-664f4dc4-06f7-42e1-9e97-3d2d37f6e46e tempest-TestStampPattern-2144166935 tempest-TestStampPattern-2144166935-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9511387c-8772-40f2-bf2d-6b6387649e9f (non-flash)
Nov 29 18:10:45 user nova-compute[74613]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:34908494-9a6c-4c8c-b447-9768745356ca (non-flash)
Nov 29 18:10:45 user nova-compute[74613]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2879f1d-797c-4701-8803-eb6369ddb534 (non-flash)
Nov 29 18:10:45 user nova-compute[74613]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:feacf752-4278-4706-96de-8baca33a964d (non-flash)
Nov 29 18:10:45 user nova-compute[74613]:  stderr= {{(pid=74613) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 18:10:45 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-664f4dc4-06f7-42e1-9e97-3d2d37f6e46e tempest-TestStampPattern-2144166935 tempest-TestStampPattern-2144166935-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9511387c-8772-40f2-bf2d-6b6387649e9f (non-flash)
Nov 29 18:10:45 user nova-compute[74613]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:34908494-9a6c-4c8c-b447-9768745356ca (non-flash)
Nov 29 18:10:45 user nova-compute[74613]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2879f1d-797c-4701-8803-eb6369ddb534 (non-flash)
Nov 29 18:10:45 user nova-compute[74613]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:feacf752-4278-4706-96de-8baca33a964d (non-flash)
Nov 29 18:10:45 user nova-compute[74613]:  stderr= {{(pid=74613) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 18:10:45 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-664f4dc4-06f7-42e1-9e97-3d2d37f6e46e tempest-TestStampPattern-2144166935 tempest-TestStampPattern-2144166935-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7ff828532e60>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:feacf752-4278-4706-96de-8baca33a964d'): ({'sde'}, set())}) {{(pid=74613) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 29 18:10:45 user nova-compute[74613]: DEBUG os_brick.initiator.linuxscsi [None req-664f4dc4-06f7-42e1-9e97-3d2d37f6e46e tempest-TestStampPattern-2144166935 tempest-TestStampPattern-2144166935-project-member] Removing single pathed devices sde {{(pid=74613) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 29 18:10:45 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:10:45 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:10:45 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8cb6652-66f4-408f-84f4-0c2b2290df3e]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 18:10:45 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:10:45 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.019s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:10:45 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[96aa58d8-a280-4962-aafa-e4c0bd42dc02]: (4, ('ok\n', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 18:10:45 user nova-compute[74613]: DEBUG os_brick.initiator.linuxscsi [None req-664f4dc4-06f7-42e1-9e97-3d2d37f6e46e tempest-TestStampPattern-2144166935 tempest-TestStampPattern-2144166935-project-member] Flushing IO for device /dev/sde {{(pid=74613) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 29 18:10:45 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:10:45 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.014s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:10:45 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[98f529e0-ac27-4b2f-8516-b66cef1b2caa]: (4, ('', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 18:10:45 user nova-compute[74613]: DEBUG os_brick.initiator.linuxscsi [None req-664f4dc4-06f7-42e1-9e97-3d2d37f6e46e tempest-TestStampPattern-2144166935 tempest-TestStampPattern-2144166935-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=74613) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 29 18:10:45 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:10:45 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.062s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:10:45 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[61c55eb6-7598-476e-be36-6aa1ede41335]: (4, ('1', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 18:10:45 user nova-compute[74613]: DEBUG os_brick.initiator.linuxscsi [None req-664f4dc4-06f7-42e1-9e97-3d2d37f6e46e tempest-TestStampPattern-2144166935 tempest-TestStampPattern-2144166935-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=74613) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 29 18:10:45 user nova-compute[74613]: DEBUG os_brick.initiator.linuxscsi [None req-664f4dc4-06f7-42e1-9e97-3d2d37f6e46e tempest-TestStampPattern-2144166935 tempest-TestStampPattern-2144166935-project-member] SCSI volumes sde have been removed. {{(pid=74613) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 29 18:10:45 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-664f4dc4-06f7-42e1-9e97-3d2d37f6e46e tempest-TestStampPattern-2144166935 tempest-TestStampPattern-2144166935-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:feacf752-4278-4706-96de-8baca33a964d')] {{(pid=74613) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 29 18:10:45 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:feacf752-4278-4706-96de-8baca33a964d -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:10:45 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:feacf752-4278-4706-96de-8baca33a964d -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:10:45 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[88994476-d640-4fa1-b8c3-3ae7ad720f2f]: (4, ('', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 18:10:45 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-664f4dc4-06f7-42e1-9e97-3d2d37f6e46e tempest-TestStampPattern-2144166935 tempest-TestStampPattern-2144166935-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74613) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 18:10:45 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:feacf752-4278-4706-96de-8baca33a964d -p 172.16.0.220:3260 --logout {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:10:45 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:feacf752-4278-4706-96de-8baca33a964d -p 172.16.0.220:3260 --logout" returned: 0 in 0.055s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:10:45 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[0342650d-4974-43d6-8012-8987e3b153bb]: (4, ('Logging out of session [sid: 38, target: iqn.2010-10.org.openstack:feacf752-4278-4706-96de-8baca33a964d, portal: 172.16.0.220,3260]\nLogout of [sid: 38, target: iqn.2010-10.org.openstack:feacf752-4278-4706-96de-8baca33a964d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 18:10:45 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-664f4dc4-06f7-42e1-9e97-3d2d37f6e46e tempest-TestStampPattern-2144166935 tempest-TestStampPattern-2144166935-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 38, target: iqn.2010-10.org.openstack:feacf752-4278-4706-96de-8baca33a964d, portal: 172.16.0.220,3260]
Nov 29 18:10:45 user nova-compute[74613]: Logout of [sid: 38, target: iqn.2010-10.org.openstack:feacf752-4278-4706-96de-8baca33a964d, portal: 172.16.0.220,3260] successful.
Nov 29 18:10:45 user nova-compute[74613]:  stderr= {{(pid=74613) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 18:10:45 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:feacf752-4278-4706-96de-8baca33a964d -p 172.16.0.220:3260 --op delete {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:10:45 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:feacf752-4278-4706-96de-8baca33a964d -p 172.16.0.220:3260 --op delete" returned: 0 in 0.026s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:10:45 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[dfd43984-d95f-438d-ab2a-02121f964c81]: (4, ('', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 18:10:45 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-664f4dc4-06f7-42e1-9e97-3d2d37f6e46e tempest-TestStampPattern-2144166935 tempest-TestStampPattern-2144166935-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74613) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 18:10:45 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.base [None req-664f4dc4-06f7-42e1-9e97-3d2d37f6e46e tempest-TestStampPattern-2144166935 tempest-TestStampPattern-2144166935-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.324s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 18:10:45 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-664f4dc4-06f7-42e1-9e97-3d2d37f6e46e tempest-TestStampPattern-2144166935 tempest-TestStampPattern-2144166935-project-member] <== disconnect_volume: return (326ms) None {{(pid=74613) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 18:10:45 user nova-compute[74613]: DEBUG nova.virt.libvirt.volume.iscsi [None req-664f4dc4-06f7-42e1-9e97-3d2d37f6e46e tempest-TestStampPattern-2144166935 tempest-TestStampPattern-2144166935-project-member] [instance: 285d1e76-103b-47fa-9982-4f2d656ee57a] Disconnected iSCSI Volume {{(pid=74613) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 29 18:10:45 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:10:46 user nova-compute[74613]: DEBUG nova.objects.instance [None req-664f4dc4-06f7-42e1-9e97-3d2d37f6e46e tempest-TestStampPattern-2144166935 tempest-TestStampPattern-2144166935-project-member] Lazy-loading 'flavor' on Instance uuid 285d1e76-103b-47fa-9982-4f2d656ee57a {{(pid=74613) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 18:10:46 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-664f4dc4-06f7-42e1-9e97-3d2d37f6e46e tempest-TestStampPattern-2144166935 tempest-TestStampPattern-2144166935-project-member] Lock "285d1e76-103b-47fa-9982-4f2d656ee57a" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.702s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 18:10:49 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:10:54 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 18:10:54 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:10:54 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74613) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 29 18:10:54 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74613) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 18:10:54 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74613) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 18:10:54 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:10:56 user nova-compute[74613]: WARNING nova.virt.libvirt.driver [None req-d6d47e39-ca7c-47e0-827d-decdc6f47579 tempest-AttachVolumeNegativeTest-483083654 tempest-AttachVolumeNegativeTest-483083654-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance e2439d62-4713-435d-81ce-fafe1d811b47 is timed out.
Nov 29 18:10:56 user nova-compute[74613]: INFO nova.virt.libvirt.driver [None req-d6d47e39-ca7c-47e0-827d-decdc6f47579 tempest-AttachVolumeNegativeTest-483083654 tempest-AttachVolumeNegativeTest-483083654-project-member] Successfully detached device vdb from instance e2439d62-4713-435d-81ce-fafe1d811b47 from the live domain config.
Nov 29 18:10:56 user nova-compute[74613]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d6d47e39-ca7c-47e0-827d-decdc6f47579 tempest-AttachVolumeNegativeTest-483083654 tempest-AttachVolumeNegativeTest-483083654-project-member] [instance: e2439d62-4713-435d-81ce-fafe1d811b47] calling os-brick to detach iSCSI Volume {{(pid=74613) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 29 18:10:56 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6d47e39-ca7c-47e0-827d-decdc6f47579 tempest-AttachVolumeNegativeTest-483083654 tempest-AttachVolumeNegativeTest-483083654-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff828156890>, {'target_iqn': 'iqn.2010-10.org.openstack:34908494-9a6c-4c8c-b447-9768745356ca', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zyBUQWou', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=74613) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 18:10:56 user nova-compute[74613]: WARNING os_brick.initiator.connectors.base [None req-d6d47e39-ca7c-47e0-827d-decdc6f47579 tempest-AttachVolumeNegativeTest-483083654 tempest-AttachVolumeNegativeTest-483083654-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 18:10:56 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.base [None req-d6d47e39-ca7c-47e0-827d-decdc6f47579 tempest-AttachVolumeNegativeTest-483083654 tempest-AttachVolumeNegativeTest-483083654-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 18:10:56 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.base [None req-d6d47e39-ca7c-47e0-827d-decdc6f47579 tempest-AttachVolumeNegativeTest-483083654 tempest-AttachVolumeNegativeTest-483083654-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 18:10:56 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:10:56 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:10:56 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[c22d4f20-394d-48a8-8c88-612a6c57fbbb]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:9511387c-8772-40f2-bf2d-6b6387649e9f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:34908494-9a6c-4c8c-b447-9768745356ca\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b2879f1d-797c-4701-8803-eb6369ddb534\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 18:10:56 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6d47e39-ca7c-47e0-827d-decdc6f47579 tempest-AttachVolumeNegativeTest-483083654 tempest-AttachVolumeNegativeTest-483083654-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 29 18:10:56 user nova-compute[74613]: No targets found.
Nov 29 18:10:56 user nova-compute[74613]: iSNS:
Nov 29 18:10:56 user nova-compute[74613]: No targets found.
Nov 29 18:10:56 user nova-compute[74613]: STATIC:
Nov 29 18:10:56 user nova-compute[74613]: Target: iqn.2010-10.org.openstack:9511387c-8772-40f2-bf2d-6b6387649e9f
Nov 29 18:10:56 user nova-compute[74613]:         Portal: 172.16.0.220:3260,-1
Nov 29 18:10:56 user nova-compute[74613]:                 Iface Name: default
Nov 29 18:10:56 user nova-compute[74613]: Target: iqn.2010-10.org.openstack:34908494-9a6c-4c8c-b447-9768745356ca
Nov 29 18:10:56 user nova-compute[74613]:         Portal: 172.16.0.220:3260,-1
Nov 29 18:10:56 user nova-compute[74613]:                 Iface Name: default
Nov 29 18:10:56 user nova-compute[74613]: Target: iqn.2010-10.org.openstack:b2879f1d-797c-4701-8803-eb6369ddb534
Nov 29 18:10:56 user nova-compute[74613]:         Portal: 172.16.0.220:3260,-1
Nov 29 18:10:56 user nova-compute[74613]:                 Iface Name: default
Nov 29 18:10:56 user nova-compute[74613]: FIRMWARE:
Nov 29 18:10:56 user nova-compute[74613]: No targets found.
Nov 29 18:10:56 user nova-compute[74613]:  stderr= {{(pid=74613) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 18:10:56 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6d47e39-ca7c-47e0-827d-decdc6f47579 tempest-AttachVolumeNegativeTest-483083654 tempest-AttachVolumeNegativeTest-483083654-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 29 18:10:56 user nova-compute[74613]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 29 18:10:56 user nova-compute[74613]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74613) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 29 18:10:56 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6d47e39-ca7c-47e0-827d-decdc6f47579 tempest-AttachVolumeNegativeTest-483083654 tempest-AttachVolumeNegativeTest-483083654-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:34908494-9a6c-4c8c-b447-9768745356ca', 0)] {{(pid=74613) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 29 18:10:56 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:10:56 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:10:56 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea002513-f48a-4229-ade8-0027c1995f91]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:34908494-9a6c-4c8c-b447-9768745356ca\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9511387c-8772-40f2-bf2d-6b6387649e9f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b2879f1d-797c-4701-8803-eb6369ddb534\n', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 18:10:56 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:10:56 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:10:56 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[c68a6ac6-d309-49b5-a986-57edcf5298ff]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9511387c-8772-40f2-bf2d-6b6387649e9f (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:34908494-9a6c-4c8c-b447-9768745356ca (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2879f1d-797c-4701-8803-eb6369ddb534 (non-flash)\n', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 18:10:56 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6d47e39-ca7c-47e0-827d-decdc6f47579 tempest-AttachVolumeNegativeTest-483083654 tempest-AttachVolumeNegativeTest-483083654-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9511387c-8772-40f2-bf2d-6b6387649e9f (non-flash)
Nov 29 18:10:56 user nova-compute[74613]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:34908494-9a6c-4c8c-b447-9768745356ca (non-flash)
Nov 29 18:10:56 user nova-compute[74613]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2879f1d-797c-4701-8803-eb6369ddb534 (non-flash)
Nov 29 18:10:56 user nova-compute[74613]:  stderr= {{(pid=74613) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 18:10:56 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6d47e39-ca7c-47e0-827d-decdc6f47579 tempest-AttachVolumeNegativeTest-483083654 tempest-AttachVolumeNegativeTest-483083654-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9511387c-8772-40f2-bf2d-6b6387649e9f (non-flash)
Nov 29 18:10:56 user nova-compute[74613]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:34908494-9a6c-4c8c-b447-9768745356ca (non-flash)
Nov 29 18:10:56 user nova-compute[74613]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2879f1d-797c-4701-8803-eb6369ddb534 (non-flash)
Nov 29 18:10:56 user nova-compute[74613]:  stderr= {{(pid=74613) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 18:10:56 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6d47e39-ca7c-47e0-827d-decdc6f47579 tempest-AttachVolumeNegativeTest-483083654 tempest-AttachVolumeNegativeTest-483083654-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7ff832b87eb0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:34908494-9a6c-4c8c-b447-9768745356ca'): ({'sdd'}, set())}) {{(pid=74613) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 29 18:10:56 user nova-compute[74613]: DEBUG os_brick.initiator.linuxscsi [None req-d6d47e39-ca7c-47e0-827d-decdc6f47579 tempest-AttachVolumeNegativeTest-483083654 tempest-AttachVolumeNegativeTest-483083654-project-member] Removing single pathed devices sdd {{(pid=74613) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 29 18:10:56 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:10:56 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:10:56 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[b26ee6f7-c000-410f-a5b9-7be793ea15cf]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 18:10:56 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:10:56 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.021s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:10:56 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[43b09c73-fbc6-40aa-b854-60420d959c35]: (4, ('ok\n', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 18:10:56 user nova-compute[74613]: DEBUG os_brick.initiator.linuxscsi [None req-d6d47e39-ca7c-47e0-827d-decdc6f47579 tempest-AttachVolumeNegativeTest-483083654 tempest-AttachVolumeNegativeTest-483083654-project-member] Flushing IO for device /dev/sdd {{(pid=74613) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 29 18:10:56 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:10:56 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.012s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:10:56 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7214ea7-e406-44fd-b615-3dc60cf9eaeb]: (4, ('', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 18:10:56 user nova-compute[74613]: DEBUG os_brick.initiator.linuxscsi [None req-d6d47e39-ca7c-47e0-827d-decdc6f47579 tempest-AttachVolumeNegativeTest-483083654 tempest-AttachVolumeNegativeTest-483083654-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=74613) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 29 18:10:56 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:10:56 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.048s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:10:56 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0af06d9-235f-4963-acfb-4dfe0ce2b653]: (4, ('1', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 18:10:56 user nova-compute[74613]: DEBUG os_brick.initiator.linuxscsi [None req-d6d47e39-ca7c-47e0-827d-decdc6f47579 tempest-AttachVolumeNegativeTest-483083654 tempest-AttachVolumeNegativeTest-483083654-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=74613) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 29 18:10:56 user nova-compute[74613]: DEBUG os_brick.initiator.linuxscsi [None req-d6d47e39-ca7c-47e0-827d-decdc6f47579 tempest-AttachVolumeNegativeTest-483083654 tempest-AttachVolumeNegativeTest-483083654-project-member] SCSI volumes sdd have been removed. {{(pid=74613) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 29 18:10:56 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6d47e39-ca7c-47e0-827d-decdc6f47579 tempest-AttachVolumeNegativeTest-483083654 tempest-AttachVolumeNegativeTest-483083654-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:34908494-9a6c-4c8c-b447-9768745356ca')] {{(pid=74613) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 29 18:10:56 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:34908494-9a6c-4c8c-b447-9768745356ca -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:10:56 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:34908494-9a6c-4c8c-b447-9768745356ca -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:10:56 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[1258bbd1-a8d6-4b2e-8d99-2642b9cc0d01]: (4, ('', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 18:10:56 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6d47e39-ca7c-47e0-827d-decdc6f47579 tempest-AttachVolumeNegativeTest-483083654 tempest-AttachVolumeNegativeTest-483083654-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74613) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 18:10:56 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:34908494-9a6c-4c8c-b447-9768745356ca -p 172.16.0.220:3260 --logout {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:10:56 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:34908494-9a6c-4c8c-b447-9768745356ca -p 172.16.0.220:3260 --logout" returned: 0 in 0.058s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:10:56 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[82a1aeec-34ac-4d96-96c8-69f751d60a53]: (4, ('Logging out of session [sid: 35, target: iqn.2010-10.org.openstack:34908494-9a6c-4c8c-b447-9768745356ca, portal: 172.16.0.220,3260]\nLogout of [sid: 35, target: iqn.2010-10.org.openstack:34908494-9a6c-4c8c-b447-9768745356ca, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 18:10:56 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6d47e39-ca7c-47e0-827d-decdc6f47579 tempest-AttachVolumeNegativeTest-483083654 tempest-AttachVolumeNegativeTest-483083654-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 35, target: iqn.2010-10.org.openstack:34908494-9a6c-4c8c-b447-9768745356ca, portal: 172.16.0.220,3260]
Nov 29 18:10:56 user nova-compute[74613]: Logout of [sid: 35, target: iqn.2010-10.org.openstack:34908494-9a6c-4c8c-b447-9768745356ca, portal: 172.16.0.220,3260] successful.
Nov 29 18:10:56 user nova-compute[74613]:  stderr= {{(pid=74613) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 18:10:56 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:34908494-9a6c-4c8c-b447-9768745356ca -p 172.16.0.220:3260 --op delete {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:10:56 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:34908494-9a6c-4c8c-b447-9768745356ca -p 172.16.0.220:3260 --op delete" returned: 0 in 0.022s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:10:56 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[ece5694e-5168-4f2b-a515-d6ae5774dfe2]: (4, ('', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 18:10:56 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6d47e39-ca7c-47e0-827d-decdc6f47579 tempest-AttachVolumeNegativeTest-483083654 tempest-AttachVolumeNegativeTest-483083654-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74613) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 18:10:56 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.base [None req-d6d47e39-ca7c-47e0-827d-decdc6f47579 tempest-AttachVolumeNegativeTest-483083654 tempest-AttachVolumeNegativeTest-483083654-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.310s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 18:10:56 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6d47e39-ca7c-47e0-827d-decdc6f47579 tempest-AttachVolumeNegativeTest-483083654 tempest-AttachVolumeNegativeTest-483083654-project-member] <== disconnect_volume: return (312ms) None {{(pid=74613) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 18:10:56 user nova-compute[74613]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d6d47e39-ca7c-47e0-827d-decdc6f47579 tempest-AttachVolumeNegativeTest-483083654 tempest-AttachVolumeNegativeTest-483083654-project-member] [instance: e2439d62-4713-435d-81ce-fafe1d811b47] Disconnected iSCSI Volume {{(pid=74613) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 29 18:10:57 user nova-compute[74613]: DEBUG nova.objects.instance [None req-d6d47e39-ca7c-47e0-827d-decdc6f47579 tempest-AttachVolumeNegativeTest-483083654 tempest-AttachVolumeNegativeTest-483083654-project-member] Lazy-loading 'flavor' on Instance uuid e2439d62-4713-435d-81ce-fafe1d811b47 {{(pid=74613) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 18:10:57 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-d6d47e39-ca7c-47e0-827d-decdc6f47579 tempest-AttachVolumeNegativeTest-483083654 tempest-AttachVolumeNegativeTest-483083654-project-member] Lock "e2439d62-4713-435d-81ce-fafe1d811b47" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.931s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 18:10:59 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 18:11:01 user nova-compute[74613]: INFO nova.compute.manager [None req-a3bde1ac-35b1-4e77-b04b-b57d60835ff4 tempest-ServerRescueNegativeTestJSON-1891426908 tempest-ServerRescueNegativeTestJSON-1891426908-project-member] [instance: 6993e2e7-7e03-45b4-9d3d-3742589b6078] Unrescuing
Nov 29 18:11:01 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-a3bde1ac-35b1-4e77-b04b-b57d60835ff4 tempest-ServerRescueNegativeTestJSON-1891426908 tempest-ServerRescueNegativeTestJSON-1891426908-project-member] Acquiring lock "refresh_cache-6993e2e7-7e03-45b4-9d3d-3742589b6078" {{(pid=74613) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 18:11:01 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-a3bde1ac-35b1-4e77-b04b-b57d60835ff4 tempest-ServerRescueNegativeTestJSON-1891426908 tempest-ServerRescueNegativeTestJSON-1891426908-project-member] Acquired lock "refresh_cache-6993e2e7-7e03-45b4-9d3d-3742589b6078" {{(pid=74613) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 18:11:01 user nova-compute[74613]: DEBUG nova.network.neutron [None req-a3bde1ac-35b1-4e77-b04b-b57d60835ff4 tempest-ServerRescueNegativeTestJSON-1891426908 tempest-ServerRescueNegativeTestJSON-1891426908-project-member] [instance: 6993e2e7-7e03-45b4-9d3d-3742589b6078] Building network info cache for instance {{(pid=74613) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 29 18:11:01 user nova-compute[74613]: DEBUG nova.network.neutron [None req-a3bde1ac-35b1-4e77-b04b-b57d60835ff4 tempest-ServerRescueNegativeTestJSON-1891426908 tempest-ServerRescueNegativeTestJSON-1891426908-project-member] [instance: 6993e2e7-7e03-45b4-9d3d-3742589b6078] Updating instance_info_cache with network_info: [{"id": "5216b7ab-6e2b-4d7f-8c7f-e52b03d282b9", "address": "fa:16:3e:e8:7b:54", "network": {"id": "db79433c-b21c-4058-b98c-f62822abbf7a", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1715530752-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e6a3eb6ea0294f9da705dca72ec2789a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5216b7ab-6e", "ovs_interfaceid": "5216b7ab-6e2b-4d7f-8c7f-e52b03d282b9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74613) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 18:11:01 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-a3bde1ac-35b1-4e77-b04b-b57d60835ff4 tempest-ServerRescueNegativeTestJSON-1891426908 tempest-ServerRescueNegativeTestJSON-1891426908-project-member] Releasing lock "refresh_cache-6993e2e7-7e03-45b4-9d3d-3742589b6078" {{(pid=74613) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 18:11:01 user nova-compute[74613]: DEBUG nova.objects.instance [None req-a3bde1ac-35b1-4e77-b04b-b57d60835ff4 tempest-ServerRescueNegativeTestJSON-1891426908 tempest-ServerRescueNegativeTestJSON-1891426908-project-member] Lazy-loading 'flavor' on Instance uuid 6993e2e7-7e03-45b4-9d3d-3742589b6078 {{(pid=74613) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 18:11:01 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:11:01 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:11:01 user nova-compute[74613]: DEBUG nova.compute.manager [req-80d5a502-9f55-4331-a030-0b7ed4610681 req-b5ff259e-e78e-4a78-b110-5aee2a862169 service nova] [instance: 6993e2e7-7e03-45b4-9d3d-3742589b6078] Received event network-vif-unplugged-5216b7ab-6e2b-4d7f-8c7f-e52b03d282b9 {{(pid=74613) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 18:11:01 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-80d5a502-9f55-4331-a030-0b7ed4610681 req-b5ff259e-e78e-4a78-b110-5aee2a862169 service nova] Acquiring lock "6993e2e7-7e03-45b4-9d3d-3742589b6078-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 18:11:01 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-80d5a502-9f55-4331-a030-0b7ed4610681 req-b5ff259e-e78e-4a78-b110-5aee2a862169 service nova] Lock "6993e2e7-7e03-45b4-9d3d-3742589b6078-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 18:11:01 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-80d5a502-9f55-4331-a030-0b7ed4610681 req-b5ff259e-e78e-4a78-b110-5aee2a862169 service nova] Lock "6993e2e7-7e03-45b4-9d3d-3742589b6078-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 18:11:01 user nova-compute[74613]: DEBUG nova.compute.manager [req-80d5a502-9f55-4331-a030-0b7ed4610681 req-b5ff259e-e78e-4a78-b110-5aee2a862169 service nova] [instance: 6993e2e7-7e03-45b4-9d3d-3742589b6078] No waiting events found dispatching network-vif-unplugged-5216b7ab-6e2b-4d7f-8c7f-e52b03d282b9 {{(pid=74613) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 18:11:01 user nova-compute[74613]: WARNING nova.compute.manager [req-80d5a502-9f55-4331-a030-0b7ed4610681 req-b5ff259e-e78e-4a78-b110-5aee2a862169 service nova] [instance: 6993e2e7-7e03-45b4-9d3d-3742589b6078] Received unexpected event network-vif-unplugged-5216b7ab-6e2b-4d7f-8c7f-e52b03d282b9 for instance with vm_state rescued and task_state unrescuing.
Nov 29 18:11:01 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:11:01 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:11:02 user nova-compute[74613]: INFO nova.virt.libvirt.driver [-] [instance: 6993e2e7-7e03-45b4-9d3d-3742589b6078] Instance destroyed successfully.
Nov 29 18:11:03 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:11:03 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:11:03 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:11:03 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:11:03 user nova-compute[74613]: DEBUG nova.compute.manager [req-73b12994-6fe1-453d-abe4-4c0c83d2a12f req-a37cdce9-d281-4383-b905-6b0889f6dfb2 service nova] [instance: 6993e2e7-7e03-45b4-9d3d-3742589b6078] Received event network-vif-plugged-5216b7ab-6e2b-4d7f-8c7f-e52b03d282b9 {{(pid=74613) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 18:11:03 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-73b12994-6fe1-453d-abe4-4c0c83d2a12f req-a37cdce9-d281-4383-b905-6b0889f6dfb2 service nova] Acquiring lock "6993e2e7-7e03-45b4-9d3d-3742589b6078-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 18:11:03 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-73b12994-6fe1-453d-abe4-4c0c83d2a12f req-a37cdce9-d281-4383-b905-6b0889f6dfb2 service nova] Lock "6993e2e7-7e03-45b4-9d3d-3742589b6078-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 18:11:03 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-73b12994-6fe1-453d-abe4-4c0c83d2a12f req-a37cdce9-d281-4383-b905-6b0889f6dfb2 service nova] Lock "6993e2e7-7e03-45b4-9d3d-3742589b6078-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 18:11:03 user nova-compute[74613]: DEBUG nova.compute.manager [req-73b12994-6fe1-453d-abe4-4c0c83d2a12f req-a37cdce9-d281-4383-b905-6b0889f6dfb2 service nova] [instance: 6993e2e7-7e03-45b4-9d3d-3742589b6078] No waiting events found dispatching network-vif-plugged-5216b7ab-6e2b-4d7f-8c7f-e52b03d282b9 {{(pid=74613) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 18:11:03 user nova-compute[74613]: WARNING nova.compute.manager [req-73b12994-6fe1-453d-abe4-4c0c83d2a12f req-a37cdce9-d281-4383-b905-6b0889f6dfb2 service nova] [instance: 6993e2e7-7e03-45b4-9d3d-3742589b6078] Received unexpected event network-vif-plugged-5216b7ab-6e2b-4d7f-8c7f-e52b03d282b9 for instance with vm_state rescued and task_state unrescuing.
Nov 29 18:11:03 user nova-compute[74613]: DEBUG nova.compute.manager [req-73b12994-6fe1-453d-abe4-4c0c83d2a12f req-a37cdce9-d281-4383-b905-6b0889f6dfb2 service nova] [instance: 6993e2e7-7e03-45b4-9d3d-3742589b6078] Received event network-vif-plugged-5216b7ab-6e2b-4d7f-8c7f-e52b03d282b9 {{(pid=74613) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 18:11:03 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-73b12994-6fe1-453d-abe4-4c0c83d2a12f req-a37cdce9-d281-4383-b905-6b0889f6dfb2 service nova] Acquiring lock "6993e2e7-7e03-45b4-9d3d-3742589b6078-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 18:11:03 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-73b12994-6fe1-453d-abe4-4c0c83d2a12f req-a37cdce9-d281-4383-b905-6b0889f6dfb2 service nova] Lock "6993e2e7-7e03-45b4-9d3d-3742589b6078-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 18:11:03 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-73b12994-6fe1-453d-abe4-4c0c83d2a12f req-a37cdce9-d281-4383-b905-6b0889f6dfb2 service nova] Lock "6993e2e7-7e03-45b4-9d3d-3742589b6078-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 18:11:03 user nova-compute[74613]: DEBUG nova.compute.manager [req-73b12994-6fe1-453d-abe4-4c0c83d2a12f req-a37cdce9-d281-4383-b905-6b0889f6dfb2 service nova] [instance: 6993e2e7-7e03-45b4-9d3d-3742589b6078] No waiting events found dispatching network-vif-plugged-5216b7ab-6e2b-4d7f-8c7f-e52b03d282b9 {{(pid=74613) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 18:11:03 user nova-compute[74613]: WARNING nova.compute.manager [req-73b12994-6fe1-453d-abe4-4c0c83d2a12f req-a37cdce9-d281-4383-b905-6b0889f6dfb2 service nova] [instance: 6993e2e7-7e03-45b4-9d3d-3742589b6078] Received unexpected event network-vif-plugged-5216b7ab-6e2b-4d7f-8c7f-e52b03d282b9 for instance with vm_state rescued and task_state unrescuing.
Nov 29 18:11:03 user nova-compute[74613]: DEBUG nova.compute.manager [req-73b12994-6fe1-453d-abe4-4c0c83d2a12f req-a37cdce9-d281-4383-b905-6b0889f6dfb2 service nova] [instance: 6993e2e7-7e03-45b4-9d3d-3742589b6078] Received event network-vif-plugged-5216b7ab-6e2b-4d7f-8c7f-e52b03d282b9 {{(pid=74613) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 18:11:03 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-73b12994-6fe1-453d-abe4-4c0c83d2a12f req-a37cdce9-d281-4383-b905-6b0889f6dfb2 service nova] Acquiring lock "6993e2e7-7e03-45b4-9d3d-3742589b6078-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 18:11:03 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-73b12994-6fe1-453d-abe4-4c0c83d2a12f req-a37cdce9-d281-4383-b905-6b0889f6dfb2 service nova] Lock "6993e2e7-7e03-45b4-9d3d-3742589b6078-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 18:11:03 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-73b12994-6fe1-453d-abe4-4c0c83d2a12f req-a37cdce9-d281-4383-b905-6b0889f6dfb2 service nova] Lock "6993e2e7-7e03-45b4-9d3d-3742589b6078-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 18:11:03 user nova-compute[74613]: DEBUG nova.compute.manager [req-73b12994-6fe1-453d-abe4-4c0c83d2a12f req-a37cdce9-d281-4383-b905-6b0889f6dfb2 service nova] [instance: 6993e2e7-7e03-45b4-9d3d-3742589b6078] No waiting events found dispatching network-vif-plugged-5216b7ab-6e2b-4d7f-8c7f-e52b03d282b9 {{(pid=74613) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 18:11:03 user nova-compute[74613]: WARNING nova.compute.manager [req-73b12994-6fe1-453d-abe4-4c0c83d2a12f req-a37cdce9-d281-4383-b905-6b0889f6dfb2 service nova] [instance: 6993e2e7-7e03-45b4-9d3d-3742589b6078] Received unexpected event network-vif-plugged-5216b7ab-6e2b-4d7f-8c7f-e52b03d282b9 for instance with vm_state rescued and task_state unrescuing.
Nov 29 18:11:03 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-b3c01fe9-3a95-47e9-aae0-b3c30332d5f5 tempest-ServerBootFromVolumeStableRescueTest-414665510 tempest-ServerBootFromVolumeStableRescueTest-414665510-project-member] Acquiring lock "cd22685a-028c-4e0c-834d-e7b20f6d06ab" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 18:11:03 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-b3c01fe9-3a95-47e9-aae0-b3c30332d5f5 tempest-ServerBootFromVolumeStableRescueTest-414665510 tempest-ServerBootFromVolumeStableRescueTest-414665510-project-member] Lock "cd22685a-028c-4e0c-834d-e7b20f6d06ab" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 18:11:03 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-b3c01fe9-3a95-47e9-aae0-b3c30332d5f5 tempest-ServerBootFromVolumeStableRescueTest-414665510 tempest-ServerBootFromVolumeStableRescueTest-414665510-project-member] Acquiring lock "cd22685a-028c-4e0c-834d-e7b20f6d06ab-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 18:11:03 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-b3c01fe9-3a95-47e9-aae0-b3c30332d5f5 tempest-ServerBootFromVolumeStableRescueTest-414665510 tempest-ServerBootFromVolumeStableRescueTest-414665510-project-member] Lock "cd22685a-028c-4e0c-834d-e7b20f6d06ab-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 18:11:03 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-b3c01fe9-3a95-47e9-aae0-b3c30332d5f5 tempest-ServerBootFromVolumeStableRescueTest-414665510 tempest-ServerBootFromVolumeStableRescueTest-414665510-project-member] Lock "cd22685a-028c-4e0c-834d-e7b20f6d06ab-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 18:11:03 user nova-compute[74613]: INFO nova.compute.manager [None req-b3c01fe9-3a95-47e9-aae0-b3c30332d5f5 tempest-ServerBootFromVolumeStableRescueTest-414665510 tempest-ServerBootFromVolumeStableRescueTest-414665510-project-member] [instance: cd22685a-028c-4e0c-834d-e7b20f6d06ab] Terminating instance
Nov 29 18:11:03 user nova-compute[74613]: DEBUG nova.compute.manager [None req-b3c01fe9-3a95-47e9-aae0-b3c30332d5f5 tempest-ServerBootFromVolumeStableRescueTest-414665510 tempest-ServerBootFromVolumeStableRescueTest-414665510-project-member] [instance: cd22685a-028c-4e0c-834d-e7b20f6d06ab] Start destroying the instance on the hypervisor. {{(pid=74613) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 29 18:11:03 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:11:03 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:11:04 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:11:04 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:11:04 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:11:04 user nova-compute[74613]: INFO nova.virt.libvirt.driver [-] [instance: cd22685a-028c-4e0c-834d-e7b20f6d06ab] Instance destroyed successfully.
Nov 29 18:11:04 user nova-compute[74613]: DEBUG nova.objects.instance [None req-b3c01fe9-3a95-47e9-aae0-b3c30332d5f5 tempest-ServerBootFromVolumeStableRescueTest-414665510 tempest-ServerBootFromVolumeStableRescueTest-414665510-project-member] Lazy-loading 'resources' on Instance uuid cd22685a-028c-4e0c-834d-e7b20f6d06ab {{(pid=74613) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 18:11:04 user nova-compute[74613]: DEBUG nova.virt.libvirt.vif [None req-b3c01fe9-3a95-47e9-aae0-b3c30332d5f5 tempest-ServerBootFromVolumeStableRescueTest-414665510 tempest-ServerBootFromVolumeStableRescueTest-414665510-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T17:54:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1015515172',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1015515172',id=12,image_ref='4217f428-8d9d-4ee1-9614-642d26d90c46',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-29T17:56:27Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='b820dd795dfe46cd804772f0e71f98e9',ramdisk_id='',reservation_id='r-j65rtiu7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='4217f428-8d9d-4ee1-9614-642d26d90c46',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-414665510',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-414665510-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-29T17:58:13Z,user_data=None,user_id='c65bc922e04d4d1385e48f70c460c441',uuid=cd22685a-028c-4e0c-834d-e7b20f6d06ab,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "5b08bd65-707e-48a5-800b-dd0670c88d61", "address": "fa:16:3e:28:d8:3d", "network": {"id": "0722b02d-a357-4360-87e8-580913723985", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-579793494-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b820dd795dfe46cd804772f0e71f98e9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5b08bd65-70", "ovs_interfaceid": "5b08bd65-707e-48a5-800b-dd0670c88d61", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74613) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 29 18:11:04 user nova-compute[74613]: DEBUG nova.network.os_vif_util [None req-b3c01fe9-3a95-47e9-aae0-b3c30332d5f5 tempest-ServerBootFromVolumeStableRescueTest-414665510 tempest-ServerBootFromVolumeStableRescueTest-414665510-project-member] Converting VIF {"id": "5b08bd65-707e-48a5-800b-dd0670c88d61", "address": "fa:16:3e:28:d8:3d", "network": {"id": "0722b02d-a357-4360-87e8-580913723985", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-579793494-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b820dd795dfe46cd804772f0e71f98e9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5b08bd65-70", "ovs_interfaceid": "5b08bd65-707e-48a5-800b-dd0670c88d61", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74613) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 18:11:04 user nova-compute[74613]: DEBUG nova.network.os_vif_util [None req-b3c01fe9-3a95-47e9-aae0-b3c30332d5f5 tempest-ServerBootFromVolumeStableRescueTest-414665510 tempest-ServerBootFromVolumeStableRescueTest-414665510-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:28:d8:3d,bridge_name='br-int',has_traffic_filtering=True,id=5b08bd65-707e-48a5-800b-dd0670c88d61,network=Network(0722b02d-a357-4360-87e8-580913723985),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5b08bd65-70') {{(pid=74613) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 18:11:04 user nova-compute[74613]: DEBUG os_vif [None req-b3c01fe9-3a95-47e9-aae0-b3c30332d5f5 tempest-ServerBootFromVolumeStableRescueTest-414665510 tempest-ServerBootFromVolumeStableRescueTest-414665510-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:28:d8:3d,bridge_name='br-int',has_traffic_filtering=True,id=5b08bd65-707e-48a5-800b-dd0670c88d61,network=Network(0722b02d-a357-4360-87e8-580913723985),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5b08bd65-70') {{(pid=74613) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 29 18:11:04 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:11:04 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap5b08bd65-70, bridge=br-int, if_exists=True) {{(pid=74613) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 18:11:04 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:11:04 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 18:11:04 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:11:04 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=df8fe42e-819c-4278-aaa6-4cf117017cf7) {{(pid=74613) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 18:11:04 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 18:11:04 user nova-compute[74613]: INFO os_vif [None req-b3c01fe9-3a95-47e9-aae0-b3c30332d5f5 tempest-ServerBootFromVolumeStableRescueTest-414665510 tempest-ServerBootFromVolumeStableRescueTest-414665510-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:28:d8:3d,bridge_name='br-int',has_traffic_filtering=True,id=5b08bd65-707e-48a5-800b-dd0670c88d61,network=Network(0722b02d-a357-4360-87e8-580913723985),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5b08bd65-70')
Nov 29 18:11:04 user nova-compute[74613]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b3c01fe9-3a95-47e9-aae0-b3c30332d5f5 tempest-ServerBootFromVolumeStableRescueTest-414665510 tempest-ServerBootFromVolumeStableRescueTest-414665510-project-member] [instance: cd22685a-028c-4e0c-834d-e7b20f6d06ab] calling os-brick to detach iSCSI Volume {{(pid=74613) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 29 18:11:04 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3c01fe9-3a95-47e9-aae0-b3c30332d5f5 tempest-ServerBootFromVolumeStableRescueTest-414665510 tempest-ServerBootFromVolumeStableRescueTest-414665510-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff828156890>, {'target_iqn': 'iqn.2010-10.org.openstack:9511387c-8772-40f2-bf2d-6b6387649e9f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XOfkuEgp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=74613) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 18:11:04 user nova-compute[74613]: WARNING os_brick.initiator.connectors.base [None req-b3c01fe9-3a95-47e9-aae0-b3c30332d5f5 tempest-ServerBootFromVolumeStableRescueTest-414665510 tempest-ServerBootFromVolumeStableRescueTest-414665510-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 18:11:04 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.base [None req-b3c01fe9-3a95-47e9-aae0-b3c30332d5f5 tempest-ServerBootFromVolumeStableRescueTest-414665510 tempest-ServerBootFromVolumeStableRescueTest-414665510-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 18:11:04 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.base [None req-b3c01fe9-3a95-47e9-aae0-b3c30332d5f5 tempest-ServerBootFromVolumeStableRescueTest-414665510 tempest-ServerBootFromVolumeStableRescueTest-414665510-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 18:11:04 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:11:04 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:11:04 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f7d8b85-a79b-4b13-9010-a0ca6637acda]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:9511387c-8772-40f2-bf2d-6b6387649e9f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b2879f1d-797c-4701-8803-eb6369ddb534\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 18:11:04 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3c01fe9-3a95-47e9-aae0-b3c30332d5f5 tempest-ServerBootFromVolumeStableRescueTest-414665510 tempest-ServerBootFromVolumeStableRescueTest-414665510-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 29 18:11:04 user nova-compute[74613]: No targets found.
Nov 29 18:11:04 user nova-compute[74613]: iSNS:
Nov 29 18:11:04 user nova-compute[74613]: No targets found.
Nov 29 18:11:04 user nova-compute[74613]: STATIC:
Nov 29 18:11:04 user nova-compute[74613]: Target: iqn.2010-10.org.openstack:9511387c-8772-40f2-bf2d-6b6387649e9f
Nov 29 18:11:04 user nova-compute[74613]:         Portal: 172.16.0.220:3260,-1
Nov 29 18:11:04 user nova-compute[74613]:                 Iface Name: default
Nov 29 18:11:04 user nova-compute[74613]: Target: iqn.2010-10.org.openstack:b2879f1d-797c-4701-8803-eb6369ddb534
Nov 29 18:11:04 user nova-compute[74613]:         Portal: 172.16.0.220:3260,-1
Nov 29 18:11:04 user nova-compute[74613]:                 Iface Name: default
Nov 29 18:11:04 user nova-compute[74613]: FIRMWARE:
Nov 29 18:11:04 user nova-compute[74613]: No targets found.
Nov 29 18:11:04 user nova-compute[74613]:  stderr= {{(pid=74613) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 18:11:04 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3c01fe9-3a95-47e9-aae0-b3c30332d5f5 tempest-ServerBootFromVolumeStableRescueTest-414665510 tempest-ServerBootFromVolumeStableRescueTest-414665510-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 29 18:11:04 user nova-compute[74613]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 29 18:11:04 user nova-compute[74613]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74613) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 29 18:11:04 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3c01fe9-3a95-47e9-aae0-b3c30332d5f5 tempest-ServerBootFromVolumeStableRescueTest-414665510 tempest-ServerBootFromVolumeStableRescueTest-414665510-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9511387c-8772-40f2-bf2d-6b6387649e9f', 0)] {{(pid=74613) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 29 18:11:04 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:11:04 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.016s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:11:04 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[c576b8e4-c786-4bf7-9916-0ec598e816ac]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9511387c-8772-40f2-bf2d-6b6387649e9f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b2879f1d-797c-4701-8803-eb6369ddb534\n', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 18:11:04 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:11:04 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:11:04 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[16b991d3-a90d-4faa-a88d-da0d8243f655]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9511387c-8772-40f2-bf2d-6b6387649e9f (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2879f1d-797c-4701-8803-eb6369ddb534 (non-flash)\n', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 18:11:04 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3c01fe9-3a95-47e9-aae0-b3c30332d5f5 tempest-ServerBootFromVolumeStableRescueTest-414665510 tempest-ServerBootFromVolumeStableRescueTest-414665510-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9511387c-8772-40f2-bf2d-6b6387649e9f (non-flash)
Nov 29 18:11:04 user nova-compute[74613]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2879f1d-797c-4701-8803-eb6369ddb534 (non-flash)
Nov 29 18:11:04 user nova-compute[74613]:  stderr= {{(pid=74613) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 18:11:04 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3c01fe9-3a95-47e9-aae0-b3c30332d5f5 tempest-ServerBootFromVolumeStableRescueTest-414665510 tempest-ServerBootFromVolumeStableRescueTest-414665510-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9511387c-8772-40f2-bf2d-6b6387649e9f (non-flash)
Nov 29 18:11:04 user nova-compute[74613]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2879f1d-797c-4701-8803-eb6369ddb534 (non-flash)
Nov 29 18:11:04 user nova-compute[74613]:  stderr= {{(pid=74613) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 18:11:04 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3c01fe9-3a95-47e9-aae0-b3c30332d5f5 tempest-ServerBootFromVolumeStableRescueTest-414665510 tempest-ServerBootFromVolumeStableRescueTest-414665510-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7ff7f863c9d0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9511387c-8772-40f2-bf2d-6b6387649e9f'): ({'sdb'}, set())}) {{(pid=74613) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 29 18:11:04 user nova-compute[74613]: DEBUG os_brick.initiator.linuxscsi [None req-b3c01fe9-3a95-47e9-aae0-b3c30332d5f5 tempest-ServerBootFromVolumeStableRescueTest-414665510 tempest-ServerBootFromVolumeStableRescueTest-414665510-project-member] Removing single pathed devices sdb {{(pid=74613) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 29 18:11:04 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:11:04 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.017s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:11:04 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[1979ed03-823f-47be-883f-4fc658cb5128]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 18:11:04 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:11:04 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.018s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:11:04 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[7aefed1f-8269-465b-8e73-150af69a2f82]: (4, ('ok\n', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 18:11:04 user nova-compute[74613]: DEBUG os_brick.initiator.linuxscsi [None req-b3c01fe9-3a95-47e9-aae0-b3c30332d5f5 tempest-ServerBootFromVolumeStableRescueTest-414665510 tempest-ServerBootFromVolumeStableRescueTest-414665510-project-member] Flushing IO for device /dev/sdb {{(pid=74613) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 29 18:11:04 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:11:04 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.011s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:11:04 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[8262475f-8db8-4470-a2a7-b17d2d07096b]: (4, ('', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 18:11:04 user nova-compute[74613]: DEBUG os_brick.initiator.linuxscsi [None req-b3c01fe9-3a95-47e9-aae0-b3c30332d5f5 tempest-ServerBootFromVolumeStableRescueTest-414665510 tempest-ServerBootFromVolumeStableRescueTest-414665510-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74613) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 29 18:11:04 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:11:04 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.033s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:11:04 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[40624327-e954-4807-b09a-65f1c00429aa]: (4, ('1', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 18:11:04 user nova-compute[74613]: DEBUG os_brick.initiator.linuxscsi [None req-b3c01fe9-3a95-47e9-aae0-b3c30332d5f5 tempest-ServerBootFromVolumeStableRescueTest-414665510 tempest-ServerBootFromVolumeStableRescueTest-414665510-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74613) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 29 18:11:04 user nova-compute[74613]: DEBUG os_brick.initiator.linuxscsi [None req-b3c01fe9-3a95-47e9-aae0-b3c30332d5f5 tempest-ServerBootFromVolumeStableRescueTest-414665510 tempest-ServerBootFromVolumeStableRescueTest-414665510-project-member] SCSI volumes sdb have been removed. {{(pid=74613) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 29 18:11:04 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3c01fe9-3a95-47e9-aae0-b3c30332d5f5 tempest-ServerBootFromVolumeStableRescueTest-414665510 tempest-ServerBootFromVolumeStableRescueTest-414665510-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9511387c-8772-40f2-bf2d-6b6387649e9f')] {{(pid=74613) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 29 18:11:04 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9511387c-8772-40f2-bf2d-6b6387649e9f -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:11:04 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9511387c-8772-40f2-bf2d-6b6387649e9f -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.017s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:11:04 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[a669c332-53ef-429b-8d60-ad585ce07c37]: (4, ('', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 18:11:04 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3c01fe9-3a95-47e9-aae0-b3c30332d5f5 tempest-ServerBootFromVolumeStableRescueTest-414665510 tempest-ServerBootFromVolumeStableRescueTest-414665510-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74613) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 18:11:04 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9511387c-8772-40f2-bf2d-6b6387649e9f -p 172.16.0.220:3260 --logout {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:11:04 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9511387c-8772-40f2-bf2d-6b6387649e9f -p 172.16.0.220:3260 --logout" returned: 0 in 0.055s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:11:04 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[074ba005-bb86-405d-b12a-e45238fc1fac]: (4, ('Logging out of session [sid: 14, target: iqn.2010-10.org.openstack:9511387c-8772-40f2-bf2d-6b6387649e9f, portal: 172.16.0.220,3260]\nLogout of [sid: 14, target: iqn.2010-10.org.openstack:9511387c-8772-40f2-bf2d-6b6387649e9f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 18:11:04 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3c01fe9-3a95-47e9-aae0-b3c30332d5f5 tempest-ServerBootFromVolumeStableRescueTest-414665510 tempest-ServerBootFromVolumeStableRescueTest-414665510-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 14, target: iqn.2010-10.org.openstack:9511387c-8772-40f2-bf2d-6b6387649e9f, portal: 172.16.0.220,3260]
Nov 29 18:11:04 user nova-compute[74613]: Logout of [sid: 14, target: iqn.2010-10.org.openstack:9511387c-8772-40f2-bf2d-6b6387649e9f, portal: 172.16.0.220,3260] successful.
Nov 29 18:11:04 user nova-compute[74613]:  stderr= {{(pid=74613) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 18:11:04 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9511387c-8772-40f2-bf2d-6b6387649e9f -p 172.16.0.220:3260 --op delete {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:11:04 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9511387c-8772-40f2-bf2d-6b6387649e9f -p 172.16.0.220:3260 --op delete" returned: 0 in 0.019s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:11:04 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[025dd6f9-1782-4875-b024-edbbbca57eca]: (4, ('', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 18:11:04 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3c01fe9-3a95-47e9-aae0-b3c30332d5f5 tempest-ServerBootFromVolumeStableRescueTest-414665510 tempest-ServerBootFromVolumeStableRescueTest-414665510-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74613) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 18:11:04 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.base [None req-b3c01fe9-3a95-47e9-aae0-b3c30332d5f5 tempest-ServerBootFromVolumeStableRescueTest-414665510 tempest-ServerBootFromVolumeStableRescueTest-414665510-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.274s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 18:11:04 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3c01fe9-3a95-47e9-aae0-b3c30332d5f5 tempest-ServerBootFromVolumeStableRescueTest-414665510 tempest-ServerBootFromVolumeStableRescueTest-414665510-project-member] <== disconnect_volume: return (276ms) None {{(pid=74613) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 18:11:04 user nova-compute[74613]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b3c01fe9-3a95-47e9-aae0-b3c30332d5f5 tempest-ServerBootFromVolumeStableRescueTest-414665510 tempest-ServerBootFromVolumeStableRescueTest-414665510-project-member] [instance: cd22685a-028c-4e0c-834d-e7b20f6d06ab] Disconnected iSCSI Volume {{(pid=74613) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 29 18:11:04 user nova-compute[74613]: INFO nova.virt.libvirt.driver [None req-b3c01fe9-3a95-47e9-aae0-b3c30332d5f5 tempest-ServerBootFromVolumeStableRescueTest-414665510 tempest-ServerBootFromVolumeStableRescueTest-414665510-project-member] [instance: cd22685a-028c-4e0c-834d-e7b20f6d06ab] Deleting instance files /opt/stack/data/nova/instances/cd22685a-028c-4e0c-834d-e7b20f6d06ab_del
Nov 29 18:11:04 user nova-compute[74613]: INFO nova.virt.libvirt.driver [None req-b3c01fe9-3a95-47e9-aae0-b3c30332d5f5 tempest-ServerBootFromVolumeStableRescueTest-414665510 tempest-ServerBootFromVolumeStableRescueTest-414665510-project-member] [instance: cd22685a-028c-4e0c-834d-e7b20f6d06ab] Deletion of /opt/stack/data/nova/instances/cd22685a-028c-4e0c-834d-e7b20f6d06ab_del complete
Nov 29 18:11:04 user nova-compute[74613]: INFO nova.compute.manager [None req-b3c01fe9-3a95-47e9-aae0-b3c30332d5f5 tempest-ServerBootFromVolumeStableRescueTest-414665510 tempest-ServerBootFromVolumeStableRescueTest-414665510-project-member] [instance: cd22685a-028c-4e0c-834d-e7b20f6d06ab] Took 1.15 seconds to destroy the instance on the hypervisor.
Nov 29 18:11:04 user nova-compute[74613]: DEBUG oslo.service.loopingcall [None req-b3c01fe9-3a95-47e9-aae0-b3c30332d5f5 tempest-ServerBootFromVolumeStableRescueTest-414665510 tempest-ServerBootFromVolumeStableRescueTest-414665510-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74613) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 29 18:11:04 user nova-compute[74613]: DEBUG nova.compute.manager [-] [instance: cd22685a-028c-4e0c-834d-e7b20f6d06ab] Deallocating network for instance {{(pid=74613) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 29 18:11:04 user nova-compute[74613]: DEBUG nova.network.neutron [-] [instance: cd22685a-028c-4e0c-834d-e7b20f6d06ab] deallocate_for_instance() {{(pid=74613) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 29 18:11:05 user nova-compute[74613]: DEBUG nova.network.neutron [-] [instance: cd22685a-028c-4e0c-834d-e7b20f6d06ab] Updating instance_info_cache with network_info: [] {{(pid=74613) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 18:11:05 user nova-compute[74613]: INFO nova.compute.manager [-] [instance: cd22685a-028c-4e0c-834d-e7b20f6d06ab] Took 0.45 seconds to deallocate network for instance.
Nov 29 18:11:05 user nova-compute[74613]: DEBUG nova.compute.manager [None req-a3bde1ac-35b1-4e77-b04b-b57d60835ff4 tempest-ServerRescueNegativeTestJSON-1891426908 tempest-ServerRescueNegativeTestJSON-1891426908-project-member] [instance: 6993e2e7-7e03-45b4-9d3d-3742589b6078] Checking state {{(pid=74613) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 29 18:11:05 user nova-compute[74613]: DEBUG nova.compute.manager [req-155733dc-657e-4347-8a05-97d7dd0433e7 req-5edf8095-fbc0-460a-b826-67110a0d21a8 service nova] [instance: cd22685a-028c-4e0c-834d-e7b20f6d06ab] Received event network-vif-unplugged-5b08bd65-707e-48a5-800b-dd0670c88d61 {{(pid=74613) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 18:11:05 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-155733dc-657e-4347-8a05-97d7dd0433e7 req-5edf8095-fbc0-460a-b826-67110a0d21a8 service nova] Acquiring lock "cd22685a-028c-4e0c-834d-e7b20f6d06ab-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 18:11:05 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-155733dc-657e-4347-8a05-97d7dd0433e7 req-5edf8095-fbc0-460a-b826-67110a0d21a8 service nova] Lock "cd22685a-028c-4e0c-834d-e7b20f6d06ab-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 18:11:05 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-155733dc-657e-4347-8a05-97d7dd0433e7 req-5edf8095-fbc0-460a-b826-67110a0d21a8 service nova] Lock "cd22685a-028c-4e0c-834d-e7b20f6d06ab-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 18:11:05 user nova-compute[74613]: DEBUG nova.compute.manager [req-155733dc-657e-4347-8a05-97d7dd0433e7 req-5edf8095-fbc0-460a-b826-67110a0d21a8 service nova] [instance: cd22685a-028c-4e0c-834d-e7b20f6d06ab] No waiting events found dispatching network-vif-unplugged-5b08bd65-707e-48a5-800b-dd0670c88d61 {{(pid=74613) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 18:11:05 user nova-compute[74613]: DEBUG nova.compute.manager [req-155733dc-657e-4347-8a05-97d7dd0433e7 req-5edf8095-fbc0-460a-b826-67110a0d21a8 service nova] [instance: cd22685a-028c-4e0c-834d-e7b20f6d06ab] Received event network-vif-unplugged-5b08bd65-707e-48a5-800b-dd0670c88d61 for instance with task_state deleting. {{(pid=74613) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 29 18:11:05 user nova-compute[74613]: DEBUG nova.compute.manager [req-155733dc-657e-4347-8a05-97d7dd0433e7 req-5edf8095-fbc0-460a-b826-67110a0d21a8 service nova] [instance: cd22685a-028c-4e0c-834d-e7b20f6d06ab] Received event network-vif-plugged-5b08bd65-707e-48a5-800b-dd0670c88d61 {{(pid=74613) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 18:11:05 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-155733dc-657e-4347-8a05-97d7dd0433e7 req-5edf8095-fbc0-460a-b826-67110a0d21a8 service nova] Acquiring lock "cd22685a-028c-4e0c-834d-e7b20f6d06ab-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 18:11:05 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-155733dc-657e-4347-8a05-97d7dd0433e7 req-5edf8095-fbc0-460a-b826-67110a0d21a8 service nova] Lock "cd22685a-028c-4e0c-834d-e7b20f6d06ab-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 18:11:05 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-155733dc-657e-4347-8a05-97d7dd0433e7 req-5edf8095-fbc0-460a-b826-67110a0d21a8 service nova] Lock "cd22685a-028c-4e0c-834d-e7b20f6d06ab-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 18:11:05 user nova-compute[74613]: DEBUG nova.compute.manager [req-155733dc-657e-4347-8a05-97d7dd0433e7 req-5edf8095-fbc0-460a-b826-67110a0d21a8 service nova] [instance: cd22685a-028c-4e0c-834d-e7b20f6d06ab] No waiting events found dispatching network-vif-plugged-5b08bd65-707e-48a5-800b-dd0670c88d61 {{(pid=74613) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 18:11:05 user nova-compute[74613]: WARNING nova.compute.manager [req-155733dc-657e-4347-8a05-97d7dd0433e7 req-5edf8095-fbc0-460a-b826-67110a0d21a8 service nova] [instance: cd22685a-028c-4e0c-834d-e7b20f6d06ab] Received unexpected event network-vif-plugged-5b08bd65-707e-48a5-800b-dd0670c88d61 for instance with vm_state active and task_state deleting.
Nov 29 18:11:05 user nova-compute[74613]: DEBUG nova.compute.manager [req-155733dc-657e-4347-8a05-97d7dd0433e7 req-5edf8095-fbc0-460a-b826-67110a0d21a8 service nova] [instance: cd22685a-028c-4e0c-834d-e7b20f6d06ab] Received event network-vif-deleted-5b08bd65-707e-48a5-800b-dd0670c88d61 {{(pid=74613) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 18:11:05 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:11:06 user nova-compute[74613]: INFO nova.compute.manager [None req-b3c01fe9-3a95-47e9-aae0-b3c30332d5f5 tempest-ServerBootFromVolumeStableRescueTest-414665510 tempest-ServerBootFromVolumeStableRescueTest-414665510-project-member] [instance: cd22685a-028c-4e0c-834d-e7b20f6d06ab] Took 0.89 seconds to detach 1 volumes for instance.
Nov 29 18:11:06 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-b3c01fe9-3a95-47e9-aae0-b3c30332d5f5 tempest-ServerBootFromVolumeStableRescueTest-414665510 tempest-ServerBootFromVolumeStableRescueTest-414665510-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 18:11:06 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-b3c01fe9-3a95-47e9-aae0-b3c30332d5f5 tempest-ServerBootFromVolumeStableRescueTest-414665510 tempest-ServerBootFromVolumeStableRescueTest-414665510-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 18:11:06 user nova-compute[74613]: DEBUG nova.compute.provider_tree [None req-b3c01fe9-3a95-47e9-aae0-b3c30332d5f5 tempest-ServerBootFromVolumeStableRescueTest-414665510 tempest-ServerBootFromVolumeStableRescueTest-414665510-project-member] Inventory has not changed in ProviderTree for provider: 639d980e-3b12-44b1-b8f4-1812416fa4dd {{(pid=74613) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 18:11:06 user nova-compute[74613]: DEBUG nova.scheduler.client.report [None req-b3c01fe9-3a95-47e9-aae0-b3c30332d5f5 tempest-ServerBootFromVolumeStableRescueTest-414665510 tempest-ServerBootFromVolumeStableRescueTest-414665510-project-member] Inventory has not changed for provider 639d980e-3b12-44b1-b8f4-1812416fa4dd based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74613) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 18:11:06 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-b3c01fe9-3a95-47e9-aae0-b3c30332d5f5 tempest-ServerBootFromVolumeStableRescueTest-414665510 tempest-ServerBootFromVolumeStableRescueTest-414665510-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.309s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 18:11:06 user nova-compute[74613]: INFO nova.scheduler.client.report [None req-b3c01fe9-3a95-47e9-aae0-b3c30332d5f5 tempest-ServerBootFromVolumeStableRescueTest-414665510 tempest-ServerBootFromVolumeStableRescueTest-414665510-project-member] Deleted allocations for instance cd22685a-028c-4e0c-834d-e7b20f6d06ab
Nov 29 18:11:06 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-b3c01fe9-3a95-47e9-aae0-b3c30332d5f5 tempest-ServerBootFromVolumeStableRescueTest-414665510 tempest-ServerBootFromVolumeStableRescueTest-414665510-project-member] Lock "cd22685a-028c-4e0c-834d-e7b20f6d06ab" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.993s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 18:11:09 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:11:14 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:11:15 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:11:15 user nova-compute[74613]: DEBUG nova.compute.manager [req-5242e6f0-2200-4a26-8ba5-03111fdf4e5d req-6b163b26-7292-4fb4-95bc-189bde72b894 service nova] [instance: 285d1e76-103b-47fa-9982-4f2d656ee57a] Received event network-changed-914a95dd-9699-41fd-a217-4adc1e9598f9 {{(pid=74613) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 18:11:15 user nova-compute[74613]: DEBUG nova.compute.manager [req-5242e6f0-2200-4a26-8ba5-03111fdf4e5d req-6b163b26-7292-4fb4-95bc-189bde72b894 service nova] [instance: 285d1e76-103b-47fa-9982-4f2d656ee57a] Refreshing instance network info cache due to event network-changed-914a95dd-9699-41fd-a217-4adc1e9598f9. {{(pid=74613) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 18:11:15 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-5242e6f0-2200-4a26-8ba5-03111fdf4e5d req-6b163b26-7292-4fb4-95bc-189bde72b894 service nova] Acquiring lock "refresh_cache-285d1e76-103b-47fa-9982-4f2d656ee57a" {{(pid=74613) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 18:11:15 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-5242e6f0-2200-4a26-8ba5-03111fdf4e5d req-6b163b26-7292-4fb4-95bc-189bde72b894 service nova] Acquired lock "refresh_cache-285d1e76-103b-47fa-9982-4f2d656ee57a" {{(pid=74613) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 18:11:15 user nova-compute[74613]: DEBUG nova.network.neutron [req-5242e6f0-2200-4a26-8ba5-03111fdf4e5d req-6b163b26-7292-4fb4-95bc-189bde72b894 service nova] [instance: 285d1e76-103b-47fa-9982-4f2d656ee57a] Refreshing network info cache for port 914a95dd-9699-41fd-a217-4adc1e9598f9 {{(pid=74613) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 18:11:15 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-71f54968-cb0f-4ab7-83c1-8e60c08b3e80 tempest-TestStampPattern-2144166935 tempest-TestStampPattern-2144166935-project-member] Acquiring lock "285d1e76-103b-47fa-9982-4f2d656ee57a" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 18:11:15 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-71f54968-cb0f-4ab7-83c1-8e60c08b3e80 tempest-TestStampPattern-2144166935 tempest-TestStampPattern-2144166935-project-member] Lock "285d1e76-103b-47fa-9982-4f2d656ee57a" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 18:11:15 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-71f54968-cb0f-4ab7-83c1-8e60c08b3e80 tempest-TestStampPattern-2144166935 tempest-TestStampPattern-2144166935-project-member] Acquiring lock "285d1e76-103b-47fa-9982-4f2d656ee57a-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 18:11:15 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-71f54968-cb0f-4ab7-83c1-8e60c08b3e80 tempest-TestStampPattern-2144166935 tempest-TestStampPattern-2144166935-project-member] Lock "285d1e76-103b-47fa-9982-4f2d656ee57a-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 18:11:15 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-71f54968-cb0f-4ab7-83c1-8e60c08b3e80 tempest-TestStampPattern-2144166935 tempest-TestStampPattern-2144166935-project-member] Lock "285d1e76-103b-47fa-9982-4f2d656ee57a-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 18:11:15 user nova-compute[74613]: INFO nova.compute.manager [None req-71f54968-cb0f-4ab7-83c1-8e60c08b3e80 tempest-TestStampPattern-2144166935 tempest-TestStampPattern-2144166935-project-member] [instance: 285d1e76-103b-47fa-9982-4f2d656ee57a] Terminating instance
Nov 29 18:11:15 user nova-compute[74613]: DEBUG nova.compute.manager [None req-71f54968-cb0f-4ab7-83c1-8e60c08b3e80 tempest-TestStampPattern-2144166935 tempest-TestStampPattern-2144166935-project-member] [instance: 285d1e76-103b-47fa-9982-4f2d656ee57a] Start destroying the instance on the hypervisor. {{(pid=74613) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 29 18:11:15 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:11:15 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:11:15 user nova-compute[74613]: DEBUG nova.network.neutron [req-5242e6f0-2200-4a26-8ba5-03111fdf4e5d req-6b163b26-7292-4fb4-95bc-189bde72b894 service nova] [instance: 285d1e76-103b-47fa-9982-4f2d656ee57a] Updated VIF entry in instance network info cache for port 914a95dd-9699-41fd-a217-4adc1e9598f9. {{(pid=74613) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 18:11:15 user nova-compute[74613]: DEBUG nova.network.neutron [req-5242e6f0-2200-4a26-8ba5-03111fdf4e5d req-6b163b26-7292-4fb4-95bc-189bde72b894 service nova] [instance: 285d1e76-103b-47fa-9982-4f2d656ee57a] Updating instance_info_cache with network_info: [{"id": "914a95dd-9699-41fd-a217-4adc1e9598f9", "address": "fa:16:3e:b6:a3:cc", "network": {"id": "fed779df-aeaf-4b57-8336-be4c9d81f0be", "bridge": "br-int", "label": "tempest-TestStampPattern-1699172136-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6004d03e0fbd4684bc8f1d341afad3be", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap914a95dd-96", "ovs_interfaceid": "914a95dd-9699-41fd-a217-4adc1e9598f9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74613) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 18:11:15 user nova-compute[74613]: DEBUG nova.compute.manager [req-c91fa265-17af-4e4d-9ed5-6bf3228b23f1 req-6daab8db-57eb-4d77-89e6-dc9aea7914ae service nova] [instance: 285d1e76-103b-47fa-9982-4f2d656ee57a] Received event network-vif-unplugged-914a95dd-9699-41fd-a217-4adc1e9598f9 {{(pid=74613) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 18:11:15 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-c91fa265-17af-4e4d-9ed5-6bf3228b23f1 req-6daab8db-57eb-4d77-89e6-dc9aea7914ae service nova] Acquiring lock "285d1e76-103b-47fa-9982-4f2d656ee57a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 18:11:15 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-c91fa265-17af-4e4d-9ed5-6bf3228b23f1 req-6daab8db-57eb-4d77-89e6-dc9aea7914ae service nova] Lock "285d1e76-103b-47fa-9982-4f2d656ee57a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 18:11:15 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-c91fa265-17af-4e4d-9ed5-6bf3228b23f1 req-6daab8db-57eb-4d77-89e6-dc9aea7914ae service nova] Lock "285d1e76-103b-47fa-9982-4f2d656ee57a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 18:11:15 user nova-compute[74613]: DEBUG nova.compute.manager [req-c91fa265-17af-4e4d-9ed5-6bf3228b23f1 req-6daab8db-57eb-4d77-89e6-dc9aea7914ae service nova] [instance: 285d1e76-103b-47fa-9982-4f2d656ee57a] No waiting events found dispatching network-vif-unplugged-914a95dd-9699-41fd-a217-4adc1e9598f9 {{(pid=74613) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 18:11:15 user nova-compute[74613]: DEBUG nova.compute.manager [req-c91fa265-17af-4e4d-9ed5-6bf3228b23f1 req-6daab8db-57eb-4d77-89e6-dc9aea7914ae service nova] [instance: 285d1e76-103b-47fa-9982-4f2d656ee57a] Received event network-vif-unplugged-914a95dd-9699-41fd-a217-4adc1e9598f9 for instance with task_state deleting. {{(pid=74613) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 29 18:11:15 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-5242e6f0-2200-4a26-8ba5-03111fdf4e5d req-6b163b26-7292-4fb4-95bc-189bde72b894 service nova] Releasing lock "refresh_cache-285d1e76-103b-47fa-9982-4f2d656ee57a" {{(pid=74613) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 18:11:15 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:11:15 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:11:16 user nova-compute[74613]: INFO nova.virt.libvirt.driver [-] [instance: 285d1e76-103b-47fa-9982-4f2d656ee57a] Instance destroyed successfully.
Nov 29 18:11:16 user nova-compute[74613]: DEBUG nova.objects.instance [None req-71f54968-cb0f-4ab7-83c1-8e60c08b3e80 tempest-TestStampPattern-2144166935 tempest-TestStampPattern-2144166935-project-member] Lazy-loading 'resources' on Instance uuid 285d1e76-103b-47fa-9982-4f2d656ee57a {{(pid=74613) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 18:11:16 user nova-compute[74613]: DEBUG nova.virt.libvirt.vif [None req-71f54968-cb0f-4ab7-83c1-8e60c08b3e80 tempest-TestStampPattern-2144166935 tempest-TestStampPattern-2144166935-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T18:08:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestStampPattern-server-1261894322',display_name='tempest-TestStampPattern-server-1261894322',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-1261894322',id=34,image_ref='31f362ed-cacc-4fdf-b825-f6286944498f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBImheB4xIUp31my88WBnuldIYYO3ZplSdSxpARgEiu+bFOOTcjhJQqNcRzf7tbnmHy4961l14bqt6VjuQd2lyczJClyEX4yjcCet+qsyyrKz/utm1mx8LqakuBXZxsC2Hg==',key_name='tempest-TestStampPattern-1424901696',keypairs=<?>,launch_index=0,launched_at=2023-11-29T18:08:27Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='6004d03e0fbd4684bc8f1d341afad3be',ramdisk_id='',reservation_id='r-qs2gd0wx',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='4217f428-8d9d-4ee1-9614-642d26d90c46',image_boot_roles='member,reader',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_image_location='snapshot',image_image_state='available',image_image_type='snapshot',image_instance_uuid='9eb14feb-f196-42b1-a6ba-2a049dea2d5e',image_min_disk='1',image_min_ram='0',image_owner_id='6004d03e0fbd4684bc8f1d341afad3be',image_owner_project_name='tempest-TestStampPattern-2144166935',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestStampPattern-2144166935-project-member',image_user_id='7be3452738104c44bc78152e00fe469d',owner_project_name='tempest-TestStampPattern-2144166935',owner_user_name='tempest-TestStampPattern-2144166935-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-29T18:08:27Z,user_data=None,user_id='7be3452738104c44bc78152e00fe469d',uuid=285d1e76-103b-47fa-9982-4f2d656ee57a,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "914a95dd-9699-41fd-a217-4adc1e9598f9", "address": "fa:16:3e:b6:a3:cc", "network": {"id": "fed779df-aeaf-4b57-8336-be4c9d81f0be", "bridge": "br-int", "label": "tempest-TestStampPattern-1699172136-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.104", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6004d03e0fbd4684bc8f1d341afad3be", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap914a95dd-96", "ovs_interfaceid": "914a95dd-9699-41fd-a217-4adc1e9598f9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74613) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 29 18:11:16 user nova-compute[74613]: DEBUG nova.network.os_vif_util [None req-71f54968-cb0f-4ab7-83c1-8e60c08b3e80 tempest-TestStampPattern-2144166935 tempest-TestStampPattern-2144166935-project-member] Converting VIF {"id": "914a95dd-9699-41fd-a217-4adc1e9598f9", "address": "fa:16:3e:b6:a3:cc", "network": {"id": "fed779df-aeaf-4b57-8336-be4c9d81f0be", "bridge": "br-int", "label": "tempest-TestStampPattern-1699172136-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.104", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6004d03e0fbd4684bc8f1d341afad3be", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap914a95dd-96", "ovs_interfaceid": "914a95dd-9699-41fd-a217-4adc1e9598f9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74613) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 18:11:16 user nova-compute[74613]: DEBUG nova.network.os_vif_util [None req-71f54968-cb0f-4ab7-83c1-8e60c08b3e80 tempest-TestStampPattern-2144166935 tempest-TestStampPattern-2144166935-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:b6:a3:cc,bridge_name='br-int',has_traffic_filtering=True,id=914a95dd-9699-41fd-a217-4adc1e9598f9,network=Network(fed779df-aeaf-4b57-8336-be4c9d81f0be),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap914a95dd-96') {{(pid=74613) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 18:11:16 user nova-compute[74613]: DEBUG os_vif [None req-71f54968-cb0f-4ab7-83c1-8e60c08b3e80 tempest-TestStampPattern-2144166935 tempest-TestStampPattern-2144166935-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:b6:a3:cc,bridge_name='br-int',has_traffic_filtering=True,id=914a95dd-9699-41fd-a217-4adc1e9598f9,network=Network(fed779df-aeaf-4b57-8336-be4c9d81f0be),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap914a95dd-96') {{(pid=74613) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 29 18:11:16 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:11:16 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap914a95dd-96, bridge=br-int, if_exists=True) {{(pid=74613) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 18:11:16 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:11:16 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 18:11:16 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:11:16 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=466531bd-fb97-4e27-ad36-f1c464bfb881) {{(pid=74613) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 18:11:16 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:11:16 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 18:11:16 user nova-compute[74613]: INFO os_vif [None req-71f54968-cb0f-4ab7-83c1-8e60c08b3e80 tempest-TestStampPattern-2144166935 tempest-TestStampPattern-2144166935-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:b6:a3:cc,bridge_name='br-int',has_traffic_filtering=True,id=914a95dd-9699-41fd-a217-4adc1e9598f9,network=Network(fed779df-aeaf-4b57-8336-be4c9d81f0be),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap914a95dd-96')
Nov 29 18:11:16 user nova-compute[74613]: INFO nova.virt.libvirt.driver [None req-71f54968-cb0f-4ab7-83c1-8e60c08b3e80 tempest-TestStampPattern-2144166935 tempest-TestStampPattern-2144166935-project-member] [instance: 285d1e76-103b-47fa-9982-4f2d656ee57a] Deleting instance files /opt/stack/data/nova/instances/285d1e76-103b-47fa-9982-4f2d656ee57a_del
Nov 29 18:11:16 user nova-compute[74613]: INFO nova.virt.libvirt.driver [None req-71f54968-cb0f-4ab7-83c1-8e60c08b3e80 tempest-TestStampPattern-2144166935 tempest-TestStampPattern-2144166935-project-member] [instance: 285d1e76-103b-47fa-9982-4f2d656ee57a] Deletion of /opt/stack/data/nova/instances/285d1e76-103b-47fa-9982-4f2d656ee57a_del complete
Nov 29 18:11:16 user nova-compute[74613]: INFO nova.compute.manager [None req-71f54968-cb0f-4ab7-83c1-8e60c08b3e80 tempest-TestStampPattern-2144166935 tempest-TestStampPattern-2144166935-project-member] [instance: 285d1e76-103b-47fa-9982-4f2d656ee57a] Took 0.86 seconds to destroy the instance on the hypervisor.
Nov 29 18:11:16 user nova-compute[74613]: DEBUG oslo.service.loopingcall [None req-71f54968-cb0f-4ab7-83c1-8e60c08b3e80 tempest-TestStampPattern-2144166935 tempest-TestStampPattern-2144166935-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74613) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 29 18:11:16 user nova-compute[74613]: DEBUG nova.compute.manager [-] [instance: 285d1e76-103b-47fa-9982-4f2d656ee57a] Deallocating network for instance {{(pid=74613) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 29 18:11:16 user nova-compute[74613]: DEBUG nova.network.neutron [-] [instance: 285d1e76-103b-47fa-9982-4f2d656ee57a] deallocate_for_instance() {{(pid=74613) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 29 18:11:16 user nova-compute[74613]: DEBUG nova.network.neutron [-] [instance: 285d1e76-103b-47fa-9982-4f2d656ee57a] Updating instance_info_cache with network_info: [] {{(pid=74613) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 18:11:16 user nova-compute[74613]: INFO nova.compute.manager [-] [instance: 285d1e76-103b-47fa-9982-4f2d656ee57a] Took 0.48 seconds to deallocate network for instance.
Nov 29 18:11:16 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-71f54968-cb0f-4ab7-83c1-8e60c08b3e80 tempest-TestStampPattern-2144166935 tempest-TestStampPattern-2144166935-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 18:11:16 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-71f54968-cb0f-4ab7-83c1-8e60c08b3e80 tempest-TestStampPattern-2144166935 tempest-TestStampPattern-2144166935-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 18:11:17 user nova-compute[74613]: DEBUG nova.compute.provider_tree [None req-71f54968-cb0f-4ab7-83c1-8e60c08b3e80 tempest-TestStampPattern-2144166935 tempest-TestStampPattern-2144166935-project-member] Inventory has not changed in ProviderTree for provider: 639d980e-3b12-44b1-b8f4-1812416fa4dd {{(pid=74613) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 18:11:17 user nova-compute[74613]: DEBUG nova.scheduler.client.report [None req-71f54968-cb0f-4ab7-83c1-8e60c08b3e80 tempest-TestStampPattern-2144166935 tempest-TestStampPattern-2144166935-project-member] Inventory has not changed for provider 639d980e-3b12-44b1-b8f4-1812416fa4dd based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74613) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 18:11:17 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-71f54968-cb0f-4ab7-83c1-8e60c08b3e80 tempest-TestStampPattern-2144166935 tempest-TestStampPattern-2144166935-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.251s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 18:11:17 user nova-compute[74613]: INFO nova.scheduler.client.report [None req-71f54968-cb0f-4ab7-83c1-8e60c08b3e80 tempest-TestStampPattern-2144166935 tempest-TestStampPattern-2144166935-project-member] Deleted allocations for instance 285d1e76-103b-47fa-9982-4f2d656ee57a
Nov 29 18:11:17 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-71f54968-cb0f-4ab7-83c1-8e60c08b3e80 tempest-TestStampPattern-2144166935 tempest-TestStampPattern-2144166935-project-member] Lock "285d1e76-103b-47fa-9982-4f2d656ee57a" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.769s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 18:11:17 user nova-compute[74613]: DEBUG nova.compute.manager [req-9eaaaa69-dfa1-488c-b963-98254faa0997 req-4e49ccb3-a2fa-4e61-891b-ceeafdc870ef service nova] [instance: 285d1e76-103b-47fa-9982-4f2d656ee57a] Received event network-vif-deleted-914a95dd-9699-41fd-a217-4adc1e9598f9 {{(pid=74613) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 18:11:17 user nova-compute[74613]: DEBUG nova.compute.manager [req-f9e1ca56-631a-4456-82d7-31e7480342e5 req-91a91a62-f416-4f1f-ae3c-75132521cf66 service nova] [instance: 285d1e76-103b-47fa-9982-4f2d656ee57a] Received event network-vif-plugged-914a95dd-9699-41fd-a217-4adc1e9598f9 {{(pid=74613) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 18:11:17 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-f9e1ca56-631a-4456-82d7-31e7480342e5 req-91a91a62-f416-4f1f-ae3c-75132521cf66 service nova] Acquiring lock "285d1e76-103b-47fa-9982-4f2d656ee57a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 18:11:17 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-f9e1ca56-631a-4456-82d7-31e7480342e5 req-91a91a62-f416-4f1f-ae3c-75132521cf66 service nova] Lock "285d1e76-103b-47fa-9982-4f2d656ee57a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 18:11:17 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-f9e1ca56-631a-4456-82d7-31e7480342e5 req-91a91a62-f416-4f1f-ae3c-75132521cf66 service nova] Lock "285d1e76-103b-47fa-9982-4f2d656ee57a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 18:11:17 user nova-compute[74613]: DEBUG nova.compute.manager [req-f9e1ca56-631a-4456-82d7-31e7480342e5 req-91a91a62-f416-4f1f-ae3c-75132521cf66 service nova] [instance: 285d1e76-103b-47fa-9982-4f2d656ee57a] No waiting events found dispatching network-vif-plugged-914a95dd-9699-41fd-a217-4adc1e9598f9 {{(pid=74613) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 18:11:17 user nova-compute[74613]: WARNING nova.compute.manager [req-f9e1ca56-631a-4456-82d7-31e7480342e5 req-91a91a62-f416-4f1f-ae3c-75132521cf66 service nova] [instance: 285d1e76-103b-47fa-9982-4f2d656ee57a] Received unexpected event network-vif-plugged-914a95dd-9699-41fd-a217-4adc1e9598f9 for instance with vm_state deleted and task_state None.
Nov 29 18:11:20 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:11:21 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:11:21 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-76cca3c9-6b0e-4ea9-a4a6-9bb5b9f0d849 tempest-VolumesNegativeTest-1958586316 tempest-VolumesNegativeTest-1958586316-project-member] Acquiring lock "461df216-9911-4af0-98dc-5fa1a6b5c14b" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 18:11:21 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-76cca3c9-6b0e-4ea9-a4a6-9bb5b9f0d849 tempest-VolumesNegativeTest-1958586316 tempest-VolumesNegativeTest-1958586316-project-member] Lock "461df216-9911-4af0-98dc-5fa1a6b5c14b" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 18:11:21 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-76cca3c9-6b0e-4ea9-a4a6-9bb5b9f0d849 tempest-VolumesNegativeTest-1958586316 tempest-VolumesNegativeTest-1958586316-project-member] Acquiring lock "461df216-9911-4af0-98dc-5fa1a6b5c14b-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 18:11:21 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-76cca3c9-6b0e-4ea9-a4a6-9bb5b9f0d849 tempest-VolumesNegativeTest-1958586316 tempest-VolumesNegativeTest-1958586316-project-member] Lock "461df216-9911-4af0-98dc-5fa1a6b5c14b-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 18:11:21 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-76cca3c9-6b0e-4ea9-a4a6-9bb5b9f0d849 tempest-VolumesNegativeTest-1958586316 tempest-VolumesNegativeTest-1958586316-project-member] Lock "461df216-9911-4af0-98dc-5fa1a6b5c14b-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 18:11:21 user nova-compute[74613]: INFO nova.compute.manager [None req-76cca3c9-6b0e-4ea9-a4a6-9bb5b9f0d849 tempest-VolumesNegativeTest-1958586316 tempest-VolumesNegativeTest-1958586316-project-member] [instance: 461df216-9911-4af0-98dc-5fa1a6b5c14b] Terminating instance
Nov 29 18:11:21 user nova-compute[74613]: DEBUG nova.compute.manager [None req-76cca3c9-6b0e-4ea9-a4a6-9bb5b9f0d849 tempest-VolumesNegativeTest-1958586316 tempest-VolumesNegativeTest-1958586316-project-member] [instance: 461df216-9911-4af0-98dc-5fa1a6b5c14b] Start destroying the instance on the hypervisor. {{(pid=74613) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 29 18:11:21 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:11:22 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:11:22 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:11:22 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:11:22 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:11:22 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:11:22 user nova-compute[74613]: DEBUG nova.compute.manager [req-164c9d33-8d04-4d34-86c6-682524372883 req-aa7ffb12-e3de-40c4-b092-af2f82dd4309 service nova] [instance: 461df216-9911-4af0-98dc-5fa1a6b5c14b] Received event network-vif-unplugged-aadb2d92-266c-47cb-9ef1-74edb0e4522c {{(pid=74613) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 18:11:22 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-164c9d33-8d04-4d34-86c6-682524372883 req-aa7ffb12-e3de-40c4-b092-af2f82dd4309 service nova] Acquiring lock "461df216-9911-4af0-98dc-5fa1a6b5c14b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 18:11:22 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-164c9d33-8d04-4d34-86c6-682524372883 req-aa7ffb12-e3de-40c4-b092-af2f82dd4309 service nova] Lock "461df216-9911-4af0-98dc-5fa1a6b5c14b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 18:11:22 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-164c9d33-8d04-4d34-86c6-682524372883 req-aa7ffb12-e3de-40c4-b092-af2f82dd4309 service nova] Lock "461df216-9911-4af0-98dc-5fa1a6b5c14b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 18:11:22 user nova-compute[74613]: DEBUG nova.compute.manager [req-164c9d33-8d04-4d34-86c6-682524372883 req-aa7ffb12-e3de-40c4-b092-af2f82dd4309 service nova] [instance: 461df216-9911-4af0-98dc-5fa1a6b5c14b] No waiting events found dispatching network-vif-unplugged-aadb2d92-266c-47cb-9ef1-74edb0e4522c {{(pid=74613) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 18:11:22 user nova-compute[74613]: DEBUG nova.compute.manager [req-164c9d33-8d04-4d34-86c6-682524372883 req-aa7ffb12-e3de-40c4-b092-af2f82dd4309 service nova] [instance: 461df216-9911-4af0-98dc-5fa1a6b5c14b] Received event network-vif-unplugged-aadb2d92-266c-47cb-9ef1-74edb0e4522c for instance with task_state deleting. {{(pid=74613) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 29 18:11:22 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:11:22 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:11:22 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:11:22 user nova-compute[74613]: INFO nova.virt.libvirt.driver [-] [instance: 461df216-9911-4af0-98dc-5fa1a6b5c14b] Instance destroyed successfully.
Nov 29 18:11:22 user nova-compute[74613]: DEBUG nova.objects.instance [None req-76cca3c9-6b0e-4ea9-a4a6-9bb5b9f0d849 tempest-VolumesNegativeTest-1958586316 tempest-VolumesNegativeTest-1958586316-project-member] Lazy-loading 'resources' on Instance uuid 461df216-9911-4af0-98dc-5fa1a6b5c14b {{(pid=74613) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 18:11:22 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:11:22 user nova-compute[74613]: DEBUG nova.virt.libvirt.vif [None req-76cca3c9-6b0e-4ea9-a4a6-9bb5b9f0d849 tempest-VolumesNegativeTest-1958586316 tempest-VolumesNegativeTest-1958586316-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T18:09:31Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesNegativeTest-instance-1160816456',display_name='tempest-VolumesNegativeTest-instance-1160816456',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesnegativetest-instance-1160816456',id=35,image_ref='4217f428-8d9d-4ee1-9614-642d26d90c46',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-29T18:09:39Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='92f9bb68afc04038bb230fc036546e4a',ramdisk_id='',reservation_id='r-ppzdqsjk',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='4217f428-8d9d-4ee1-9614-642d26d90c46',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesNegativeTest-1958586316',owner_user_name='tempest-VolumesNegativeTest-1958586316-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-29T18:09:40Z,user_data=None,user_id='fa9231cab6ff4bbcb4c06e4cc4da907a',uuid=461df216-9911-4af0-98dc-5fa1a6b5c14b,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "aadb2d92-266c-47cb-9ef1-74edb0e4522c", "address": "fa:16:3e:8d:a6:af", "network": {"id": "49d6eb18-c708-4eb8-a685-1ab6acc72f0b", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.110", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "794b07cbd46a44b5865cfda741036bae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaadb2d92-26", "ovs_interfaceid": "aadb2d92-266c-47cb-9ef1-74edb0e4522c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74613) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 29 18:11:22 user nova-compute[74613]: DEBUG nova.network.os_vif_util [None req-76cca3c9-6b0e-4ea9-a4a6-9bb5b9f0d849 tempest-VolumesNegativeTest-1958586316 tempest-VolumesNegativeTest-1958586316-project-member] Converting VIF {"id": "aadb2d92-266c-47cb-9ef1-74edb0e4522c", "address": "fa:16:3e:8d:a6:af", "network": {"id": "49d6eb18-c708-4eb8-a685-1ab6acc72f0b", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.110", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "794b07cbd46a44b5865cfda741036bae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaadb2d92-26", "ovs_interfaceid": "aadb2d92-266c-47cb-9ef1-74edb0e4522c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74613) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 18:11:22 user nova-compute[74613]: DEBUG nova.network.os_vif_util [None req-76cca3c9-6b0e-4ea9-a4a6-9bb5b9f0d849 tempest-VolumesNegativeTest-1958586316 tempest-VolumesNegativeTest-1958586316-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8d:a6:af,bridge_name='br-int',has_traffic_filtering=True,id=aadb2d92-266c-47cb-9ef1-74edb0e4522c,network=Network(49d6eb18-c708-4eb8-a685-1ab6acc72f0b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaadb2d92-26') {{(pid=74613) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 18:11:22 user nova-compute[74613]: DEBUG os_vif [None req-76cca3c9-6b0e-4ea9-a4a6-9bb5b9f0d849 tempest-VolumesNegativeTest-1958586316 tempest-VolumesNegativeTest-1958586316-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:8d:a6:af,bridge_name='br-int',has_traffic_filtering=True,id=aadb2d92-266c-47cb-9ef1-74edb0e4522c,network=Network(49d6eb18-c708-4eb8-a685-1ab6acc72f0b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaadb2d92-26') {{(pid=74613) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 29 18:11:22 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:11:22 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapaadb2d92-26, bridge=br-int, if_exists=True) {{(pid=74613) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 18:11:22 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:11:22 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 18:11:22 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:11:22 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=9a8a4e25-dbdb-466c-89da-bf519a20df79) {{(pid=74613) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 18:11:22 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:11:22 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:11:22 user nova-compute[74613]: INFO os_vif [None req-76cca3c9-6b0e-4ea9-a4a6-9bb5b9f0d849 tempest-VolumesNegativeTest-1958586316 tempest-VolumesNegativeTest-1958586316-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:8d:a6:af,bridge_name='br-int',has_traffic_filtering=True,id=aadb2d92-266c-47cb-9ef1-74edb0e4522c,network=Network(49d6eb18-c708-4eb8-a685-1ab6acc72f0b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaadb2d92-26')
Nov 29 18:11:22 user nova-compute[74613]: INFO nova.virt.libvirt.driver [None req-76cca3c9-6b0e-4ea9-a4a6-9bb5b9f0d849 tempest-VolumesNegativeTest-1958586316 tempest-VolumesNegativeTest-1958586316-project-member] [instance: 461df216-9911-4af0-98dc-5fa1a6b5c14b] Deleting instance files /opt/stack/data/nova/instances/461df216-9911-4af0-98dc-5fa1a6b5c14b_del
Nov 29 18:11:22 user nova-compute[74613]: INFO nova.virt.libvirt.driver [None req-76cca3c9-6b0e-4ea9-a4a6-9bb5b9f0d849 tempest-VolumesNegativeTest-1958586316 tempest-VolumesNegativeTest-1958586316-project-member] [instance: 461df216-9911-4af0-98dc-5fa1a6b5c14b] Deletion of /opt/stack/data/nova/instances/461df216-9911-4af0-98dc-5fa1a6b5c14b_del complete
Nov 29 18:11:22 user nova-compute[74613]: INFO nova.compute.manager [None req-76cca3c9-6b0e-4ea9-a4a6-9bb5b9f0d849 tempest-VolumesNegativeTest-1958586316 tempest-VolumesNegativeTest-1958586316-project-member] [instance: 461df216-9911-4af0-98dc-5fa1a6b5c14b] Took 0.87 seconds to destroy the instance on the hypervisor.
Nov 29 18:11:22 user nova-compute[74613]: DEBUG oslo.service.loopingcall [None req-76cca3c9-6b0e-4ea9-a4a6-9bb5b9f0d849 tempest-VolumesNegativeTest-1958586316 tempest-VolumesNegativeTest-1958586316-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74613) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 29 18:11:22 user nova-compute[74613]: DEBUG nova.compute.manager [-] [instance: 461df216-9911-4af0-98dc-5fa1a6b5c14b] Deallocating network for instance {{(pid=74613) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 29 18:11:22 user nova-compute[74613]: DEBUG nova.network.neutron [-] [instance: 461df216-9911-4af0-98dc-5fa1a6b5c14b] deallocate_for_instance() {{(pid=74613) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 29 18:11:23 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:11:23 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:11:23 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:11:23 user nova-compute[74613]: DEBUG nova.network.neutron [-] [instance: 461df216-9911-4af0-98dc-5fa1a6b5c14b] Updating instance_info_cache with network_info: [] {{(pid=74613) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 18:11:23 user nova-compute[74613]: INFO nova.compute.manager [-] [instance: 461df216-9911-4af0-98dc-5fa1a6b5c14b] Took 0.63 seconds to deallocate network for instance.
Nov 29 18:11:23 user nova-compute[74613]: DEBUG nova.compute.manager [req-13bec29d-a4a0-40e9-a3ab-e2abf1928fe7 req-ef3d7e5e-6f7f-4ed7-ab65-419b844b35c7 service nova] [instance: 461df216-9911-4af0-98dc-5fa1a6b5c14b] Received event network-vif-deleted-aadb2d92-266c-47cb-9ef1-74edb0e4522c {{(pid=74613) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 18:11:23 user nova-compute[74613]: INFO nova.compute.manager [req-13bec29d-a4a0-40e9-a3ab-e2abf1928fe7 req-ef3d7e5e-6f7f-4ed7-ab65-419b844b35c7 service nova] [instance: 461df216-9911-4af0-98dc-5fa1a6b5c14b] Neutron deleted interface aadb2d92-266c-47cb-9ef1-74edb0e4522c; detaching it from the instance and deleting it from the info cache
Nov 29 18:11:23 user nova-compute[74613]: DEBUG nova.network.neutron [req-13bec29d-a4a0-40e9-a3ab-e2abf1928fe7 req-ef3d7e5e-6f7f-4ed7-ab65-419b844b35c7 service nova] [instance: 461df216-9911-4af0-98dc-5fa1a6b5c14b] Updating instance_info_cache with network_info: [] {{(pid=74613) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 18:11:23 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:11:23 user nova-compute[74613]: DEBUG nova.compute.manager [req-13bec29d-a4a0-40e9-a3ab-e2abf1928fe7 req-ef3d7e5e-6f7f-4ed7-ab65-419b844b35c7 service nova] [instance: 461df216-9911-4af0-98dc-5fa1a6b5c14b] Detach interface failed, port_id=aadb2d92-266c-47cb-9ef1-74edb0e4522c, reason: Instance 461df216-9911-4af0-98dc-5fa1a6b5c14b could not be found. {{(pid=74613) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 29 18:11:23 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:11:23 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-76cca3c9-6b0e-4ea9-a4a6-9bb5b9f0d849 tempest-VolumesNegativeTest-1958586316 tempest-VolumesNegativeTest-1958586316-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 18:11:23 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-76cca3c9-6b0e-4ea9-a4a6-9bb5b9f0d849 tempest-VolumesNegativeTest-1958586316 tempest-VolumesNegativeTest-1958586316-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 18:11:23 user nova-compute[74613]: DEBUG nova.compute.provider_tree [None req-76cca3c9-6b0e-4ea9-a4a6-9bb5b9f0d849 tempest-VolumesNegativeTest-1958586316 tempest-VolumesNegativeTest-1958586316-project-member] Inventory has not changed in ProviderTree for provider: 639d980e-3b12-44b1-b8f4-1812416fa4dd {{(pid=74613) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 18:11:23 user nova-compute[74613]: DEBUG nova.scheduler.client.report [None req-76cca3c9-6b0e-4ea9-a4a6-9bb5b9f0d849 tempest-VolumesNegativeTest-1958586316 tempest-VolumesNegativeTest-1958586316-project-member] Inventory has not changed for provider 639d980e-3b12-44b1-b8f4-1812416fa4dd based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74613) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 18:11:23 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-76cca3c9-6b0e-4ea9-a4a6-9bb5b9f0d849 tempest-VolumesNegativeTest-1958586316 tempest-VolumesNegativeTest-1958586316-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.243s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 18:11:23 user nova-compute[74613]: INFO nova.scheduler.client.report [None req-76cca3c9-6b0e-4ea9-a4a6-9bb5b9f0d849 tempest-VolumesNegativeTest-1958586316 tempest-VolumesNegativeTest-1958586316-project-member] Deleted allocations for instance 461df216-9911-4af0-98dc-5fa1a6b5c14b
Nov 29 18:11:23 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-76cca3c9-6b0e-4ea9-a4a6-9bb5b9f0d849 tempest-VolumesNegativeTest-1958586316 tempest-VolumesNegativeTest-1958586316-project-member] Lock "461df216-9911-4af0-98dc-5fa1a6b5c14b" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.941s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 18:11:24 user nova-compute[74613]: DEBUG nova.compute.manager [req-793bf7e6-4c6f-49b6-bc8f-5aa3ff981652 req-2ec14270-60e1-498e-9412-77a17a769ee0 service nova] [instance: 461df216-9911-4af0-98dc-5fa1a6b5c14b] Received event network-vif-plugged-aadb2d92-266c-47cb-9ef1-74edb0e4522c {{(pid=74613) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 18:11:24 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-793bf7e6-4c6f-49b6-bc8f-5aa3ff981652 req-2ec14270-60e1-498e-9412-77a17a769ee0 service nova] Acquiring lock "461df216-9911-4af0-98dc-5fa1a6b5c14b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 18:11:24 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-793bf7e6-4c6f-49b6-bc8f-5aa3ff981652 req-2ec14270-60e1-498e-9412-77a17a769ee0 service nova] Lock "461df216-9911-4af0-98dc-5fa1a6b5c14b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 18:11:24 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-793bf7e6-4c6f-49b6-bc8f-5aa3ff981652 req-2ec14270-60e1-498e-9412-77a17a769ee0 service nova] Lock "461df216-9911-4af0-98dc-5fa1a6b5c14b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 18:11:24 user nova-compute[74613]: DEBUG nova.compute.manager [req-793bf7e6-4c6f-49b6-bc8f-5aa3ff981652 req-2ec14270-60e1-498e-9412-77a17a769ee0 service nova] [instance: 461df216-9911-4af0-98dc-5fa1a6b5c14b] No waiting events found dispatching network-vif-plugged-aadb2d92-266c-47cb-9ef1-74edb0e4522c {{(pid=74613) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 18:11:24 user nova-compute[74613]: WARNING nova.compute.manager [req-793bf7e6-4c6f-49b6-bc8f-5aa3ff981652 req-2ec14270-60e1-498e-9412-77a17a769ee0 service nova] [instance: 461df216-9911-4af0-98dc-5fa1a6b5c14b] Received unexpected event network-vif-plugged-aadb2d92-266c-47cb-9ef1-74edb0e4522c for instance with vm_state deleted and task_state None.
Nov 29 18:11:25 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:11:26 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-71d4c64d-8741-49ae-ae7f-456e6a73e5bb tempest-AttachVolumeNegativeTest-483083654 tempest-AttachVolumeNegativeTest-483083654-project-member] Acquiring lock "e2439d62-4713-435d-81ce-fafe1d811b47" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 18:11:26 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-71d4c64d-8741-49ae-ae7f-456e6a73e5bb tempest-AttachVolumeNegativeTest-483083654 tempest-AttachVolumeNegativeTest-483083654-project-member] Lock "e2439d62-4713-435d-81ce-fafe1d811b47" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 18:11:26 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-71d4c64d-8741-49ae-ae7f-456e6a73e5bb tempest-AttachVolumeNegativeTest-483083654 tempest-AttachVolumeNegativeTest-483083654-project-member] Acquiring lock "e2439d62-4713-435d-81ce-fafe1d811b47-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 18:11:26 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-71d4c64d-8741-49ae-ae7f-456e6a73e5bb tempest-AttachVolumeNegativeTest-483083654 tempest-AttachVolumeNegativeTest-483083654-project-member] Lock "e2439d62-4713-435d-81ce-fafe1d811b47-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 18:11:26 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-71d4c64d-8741-49ae-ae7f-456e6a73e5bb tempest-AttachVolumeNegativeTest-483083654 tempest-AttachVolumeNegativeTest-483083654-project-member] Lock "e2439d62-4713-435d-81ce-fafe1d811b47-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 18:11:26 user nova-compute[74613]: INFO nova.compute.manager [None req-71d4c64d-8741-49ae-ae7f-456e6a73e5bb tempest-AttachVolumeNegativeTest-483083654 tempest-AttachVolumeNegativeTest-483083654-project-member] [instance: e2439d62-4713-435d-81ce-fafe1d811b47] Terminating instance
Nov 29 18:11:26 user nova-compute[74613]: DEBUG nova.compute.manager [None req-71d4c64d-8741-49ae-ae7f-456e6a73e5bb tempest-AttachVolumeNegativeTest-483083654 tempest-AttachVolumeNegativeTest-483083654-project-member] [instance: e2439d62-4713-435d-81ce-fafe1d811b47] Start destroying the instance on the hypervisor. {{(pid=74613) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 29 18:11:26 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:11:26 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:11:26 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:11:26 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:11:26 user nova-compute[74613]: DEBUG nova.compute.manager [req-b5b1916e-1c2b-442c-9b0c-dcccd7d8fa78 req-46062bce-3c14-4509-b62b-5fd7cab27340 service nova] [instance: e2439d62-4713-435d-81ce-fafe1d811b47] Received event network-vif-unplugged-50079e9e-673c-4a5a-8f32-56d794575fdf {{(pid=74613) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 18:11:26 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-b5b1916e-1c2b-442c-9b0c-dcccd7d8fa78 req-46062bce-3c14-4509-b62b-5fd7cab27340 service nova] Acquiring lock "e2439d62-4713-435d-81ce-fafe1d811b47-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 18:11:26 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-b5b1916e-1c2b-442c-9b0c-dcccd7d8fa78 req-46062bce-3c14-4509-b62b-5fd7cab27340 service nova] Lock "e2439d62-4713-435d-81ce-fafe1d811b47-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 18:11:26 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-b5b1916e-1c2b-442c-9b0c-dcccd7d8fa78 req-46062bce-3c14-4509-b62b-5fd7cab27340 service nova] Lock "e2439d62-4713-435d-81ce-fafe1d811b47-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 18:11:26 user nova-compute[74613]: DEBUG nova.compute.manager [req-b5b1916e-1c2b-442c-9b0c-dcccd7d8fa78 req-46062bce-3c14-4509-b62b-5fd7cab27340 service nova] [instance: e2439d62-4713-435d-81ce-fafe1d811b47] No waiting events found dispatching network-vif-unplugged-50079e9e-673c-4a5a-8f32-56d794575fdf {{(pid=74613) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 18:11:26 user nova-compute[74613]: DEBUG nova.compute.manager [req-b5b1916e-1c2b-442c-9b0c-dcccd7d8fa78 req-46062bce-3c14-4509-b62b-5fd7cab27340 service nova] [instance: e2439d62-4713-435d-81ce-fafe1d811b47] Received event network-vif-unplugged-50079e9e-673c-4a5a-8f32-56d794575fdf for instance with task_state deleting. {{(pid=74613) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 29 18:11:26 user nova-compute[74613]: INFO nova.virt.libvirt.driver [-] [instance: e2439d62-4713-435d-81ce-fafe1d811b47] Instance destroyed successfully.
Nov 29 18:11:26 user nova-compute[74613]: DEBUG nova.objects.instance [None req-71d4c64d-8741-49ae-ae7f-456e6a73e5bb tempest-AttachVolumeNegativeTest-483083654 tempest-AttachVolumeNegativeTest-483083654-project-member] Lazy-loading 'resources' on Instance uuid e2439d62-4713-435d-81ce-fafe1d811b47 {{(pid=74613) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 18:11:26 user nova-compute[74613]: DEBUG nova.virt.libvirt.vif [None req-71d4c64d-8741-49ae-ae7f-456e6a73e5bb tempest-AttachVolumeNegativeTest-483083654 tempest-AttachVolumeNegativeTest-483083654-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T18:05:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1674587994',display_name='tempest-AttachVolumeNegativeTest-server-1674587994',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1674587994',id=32,image_ref='4217f428-8d9d-4ee1-9614-642d26d90c46',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEJCnVTtu90vbCZ4BJfB03c2taMPAMz98qBh9crTNw/3mZqoRZ6KzdyK25aoXZmFo1QEHsaZ1oarwR2VWhszyNqSHeHQUmAsomD9ZROfZT2nXQOa+G3ETkmHvZoV+HeGqQ==',key_name='tempest-keypair-18440938',keypairs=<?>,launch_index=0,launched_at=2023-11-29T18:05:52Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='37b89c13ba1d4a94805d6af69ad26fb8',ramdisk_id='',reservation_id='r-0igai5r4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='4217f428-8d9d-4ee1-9614-642d26d90c46',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-483083654',owner_user_name='tempest-AttachVolumeNegativeTest-483083654-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-29T18:05:53Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='57b1f3743f0e4cbdae1dab9e4761511e',uuid=e2439d62-4713-435d-81ce-fafe1d811b47,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "50079e9e-673c-4a5a-8f32-56d794575fdf", "address": "fa:16:3e:3f:6e:41", "network": {"id": "c317481b-f8cf-40a0-a326-836a5ea4c495", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-887666255-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.69", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "37b89c13ba1d4a94805d6af69ad26fb8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap50079e9e-67", "ovs_interfaceid": "50079e9e-673c-4a5a-8f32-56d794575fdf", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74613) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 29 18:11:26 user nova-compute[74613]: DEBUG nova.network.os_vif_util [None req-71d4c64d-8741-49ae-ae7f-456e6a73e5bb tempest-AttachVolumeNegativeTest-483083654 tempest-AttachVolumeNegativeTest-483083654-project-member] Converting VIF {"id": "50079e9e-673c-4a5a-8f32-56d794575fdf", "address": "fa:16:3e:3f:6e:41", "network": {"id": "c317481b-f8cf-40a0-a326-836a5ea4c495", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-887666255-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.69", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "37b89c13ba1d4a94805d6af69ad26fb8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap50079e9e-67", "ovs_interfaceid": "50079e9e-673c-4a5a-8f32-56d794575fdf", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74613) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 18:11:26 user nova-compute[74613]: DEBUG nova.network.os_vif_util [None req-71d4c64d-8741-49ae-ae7f-456e6a73e5bb tempest-AttachVolumeNegativeTest-483083654 tempest-AttachVolumeNegativeTest-483083654-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:3f:6e:41,bridge_name='br-int',has_traffic_filtering=True,id=50079e9e-673c-4a5a-8f32-56d794575fdf,network=Network(c317481b-f8cf-40a0-a326-836a5ea4c495),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap50079e9e-67') {{(pid=74613) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 18:11:26 user nova-compute[74613]: DEBUG os_vif [None req-71d4c64d-8741-49ae-ae7f-456e6a73e5bb tempest-AttachVolumeNegativeTest-483083654 tempest-AttachVolumeNegativeTest-483083654-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:3f:6e:41,bridge_name='br-int',has_traffic_filtering=True,id=50079e9e-673c-4a5a-8f32-56d794575fdf,network=Network(c317481b-f8cf-40a0-a326-836a5ea4c495),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap50079e9e-67') {{(pid=74613) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 29 18:11:26 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:11:26 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap50079e9e-67, bridge=br-int, if_exists=True) {{(pid=74613) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 18:11:26 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:11:26 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:11:26 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:11:26 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=8089dff2-26c6-4800-991e-6fc9c9de4a24) {{(pid=74613) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 18:11:26 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:11:26 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:11:26 user nova-compute[74613]: INFO os_vif [None req-71d4c64d-8741-49ae-ae7f-456e6a73e5bb tempest-AttachVolumeNegativeTest-483083654 tempest-AttachVolumeNegativeTest-483083654-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:3f:6e:41,bridge_name='br-int',has_traffic_filtering=True,id=50079e9e-673c-4a5a-8f32-56d794575fdf,network=Network(c317481b-f8cf-40a0-a326-836a5ea4c495),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap50079e9e-67')
Nov 29 18:11:26 user nova-compute[74613]: INFO nova.virt.libvirt.driver [None req-71d4c64d-8741-49ae-ae7f-456e6a73e5bb tempest-AttachVolumeNegativeTest-483083654 tempest-AttachVolumeNegativeTest-483083654-project-member] [instance: e2439d62-4713-435d-81ce-fafe1d811b47] Deleting instance files /opt/stack/data/nova/instances/e2439d62-4713-435d-81ce-fafe1d811b47_del
Nov 29 18:11:26 user nova-compute[74613]: INFO nova.virt.libvirt.driver [None req-71d4c64d-8741-49ae-ae7f-456e6a73e5bb tempest-AttachVolumeNegativeTest-483083654 tempest-AttachVolumeNegativeTest-483083654-project-member] [instance: e2439d62-4713-435d-81ce-fafe1d811b47] Deletion of /opt/stack/data/nova/instances/e2439d62-4713-435d-81ce-fafe1d811b47_del complete
Nov 29 18:11:26 user nova-compute[74613]: INFO nova.compute.manager [None req-71d4c64d-8741-49ae-ae7f-456e6a73e5bb tempest-AttachVolumeNegativeTest-483083654 tempest-AttachVolumeNegativeTest-483083654-project-member] [instance: e2439d62-4713-435d-81ce-fafe1d811b47] Took 0.85 seconds to destroy the instance on the hypervisor.
Nov 29 18:11:26 user nova-compute[74613]: DEBUG oslo.service.loopingcall [None req-71d4c64d-8741-49ae-ae7f-456e6a73e5bb tempest-AttachVolumeNegativeTest-483083654 tempest-AttachVolumeNegativeTest-483083654-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74613) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 29 18:11:26 user nova-compute[74613]: DEBUG nova.compute.manager [-] [instance: e2439d62-4713-435d-81ce-fafe1d811b47] Deallocating network for instance {{(pid=74613) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 29 18:11:26 user nova-compute[74613]: DEBUG nova.network.neutron [-] [instance: e2439d62-4713-435d-81ce-fafe1d811b47] deallocate_for_instance() {{(pid=74613) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 29 18:11:27 user nova-compute[74613]: DEBUG nova.network.neutron [-] [instance: e2439d62-4713-435d-81ce-fafe1d811b47] Updating instance_info_cache with network_info: [] {{(pid=74613) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 18:11:27 user nova-compute[74613]: INFO nova.compute.manager [-] [instance: e2439d62-4713-435d-81ce-fafe1d811b47] Took 0.74 seconds to deallocate network for instance.
Nov 29 18:11:27 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-71d4c64d-8741-49ae-ae7f-456e6a73e5bb tempest-AttachVolumeNegativeTest-483083654 tempest-AttachVolumeNegativeTest-483083654-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 18:11:27 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-71d4c64d-8741-49ae-ae7f-456e6a73e5bb tempest-AttachVolumeNegativeTest-483083654 tempest-AttachVolumeNegativeTest-483083654-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 18:11:27 user nova-compute[74613]: DEBUG nova.compute.provider_tree [None req-71d4c64d-8741-49ae-ae7f-456e6a73e5bb tempest-AttachVolumeNegativeTest-483083654 tempest-AttachVolumeNegativeTest-483083654-project-member] Inventory has not changed in ProviderTree for provider: 639d980e-3b12-44b1-b8f4-1812416fa4dd {{(pid=74613) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 18:11:27 user nova-compute[74613]: DEBUG nova.scheduler.client.report [None req-71d4c64d-8741-49ae-ae7f-456e6a73e5bb tempest-AttachVolumeNegativeTest-483083654 tempest-AttachVolumeNegativeTest-483083654-project-member] Inventory has not changed for provider 639d980e-3b12-44b1-b8f4-1812416fa4dd based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74613) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 18:11:28 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-71d4c64d-8741-49ae-ae7f-456e6a73e5bb tempest-AttachVolumeNegativeTest-483083654 tempest-AttachVolumeNegativeTest-483083654-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.224s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 18:11:28 user nova-compute[74613]: INFO nova.scheduler.client.report [None req-71d4c64d-8741-49ae-ae7f-456e6a73e5bb tempest-AttachVolumeNegativeTest-483083654 tempest-AttachVolumeNegativeTest-483083654-project-member] Deleted allocations for instance e2439d62-4713-435d-81ce-fafe1d811b47
Nov 29 18:11:28 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-71d4c64d-8741-49ae-ae7f-456e6a73e5bb tempest-AttachVolumeNegativeTest-483083654 tempest-AttachVolumeNegativeTest-483083654-project-member] Lock "e2439d62-4713-435d-81ce-fafe1d811b47" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.993s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 18:11:28 user nova-compute[74613]: DEBUG nova.compute.manager [req-c5d0adf7-5fd9-42b5-836a-b9ac718f4ad7 req-ec0b3351-1a43-4065-84e2-350303c8ef7f service nova] [instance: e2439d62-4713-435d-81ce-fafe1d811b47] Received event network-vif-plugged-50079e9e-673c-4a5a-8f32-56d794575fdf {{(pid=74613) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 18:11:28 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-c5d0adf7-5fd9-42b5-836a-b9ac718f4ad7 req-ec0b3351-1a43-4065-84e2-350303c8ef7f service nova] Acquiring lock "e2439d62-4713-435d-81ce-fafe1d811b47-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 18:11:28 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-c5d0adf7-5fd9-42b5-836a-b9ac718f4ad7 req-ec0b3351-1a43-4065-84e2-350303c8ef7f service nova] Lock "e2439d62-4713-435d-81ce-fafe1d811b47-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 18:11:28 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-c5d0adf7-5fd9-42b5-836a-b9ac718f4ad7 req-ec0b3351-1a43-4065-84e2-350303c8ef7f service nova] Lock "e2439d62-4713-435d-81ce-fafe1d811b47-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 18:11:28 user nova-compute[74613]: DEBUG nova.compute.manager [req-c5d0adf7-5fd9-42b5-836a-b9ac718f4ad7 req-ec0b3351-1a43-4065-84e2-350303c8ef7f service nova] [instance: e2439d62-4713-435d-81ce-fafe1d811b47] No waiting events found dispatching network-vif-plugged-50079e9e-673c-4a5a-8f32-56d794575fdf {{(pid=74613) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 18:11:28 user nova-compute[74613]: WARNING nova.compute.manager [req-c5d0adf7-5fd9-42b5-836a-b9ac718f4ad7 req-ec0b3351-1a43-4065-84e2-350303c8ef7f service nova] [instance: e2439d62-4713-435d-81ce-fafe1d811b47] Received unexpected event network-vif-plugged-50079e9e-673c-4a5a-8f32-56d794575fdf for instance with vm_state deleted and task_state None.
Nov 29 18:11:28 user nova-compute[74613]: DEBUG nova.compute.manager [req-c5d0adf7-5fd9-42b5-836a-b9ac718f4ad7 req-ec0b3351-1a43-4065-84e2-350303c8ef7f service nova] [instance: e2439d62-4713-435d-81ce-fafe1d811b47] Received event network-vif-deleted-50079e9e-673c-4a5a-8f32-56d794575fdf {{(pid=74613) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 18:11:29 user nova-compute[74613]: DEBUG oslo_service.periodic_task [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74613) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 18:11:29 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 18:11:29 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.005s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 18:11:29 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.003s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 18:11:29 user nova-compute[74613]: DEBUG nova.compute.resource_tracker [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Auditing locally available compute resources for user (node: user) {{(pid=74613) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 29 18:11:29 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/69109f06-acbf-4834-b05e-80ab6e3f6ea0/disk --force-share --output=json {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:11:29 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/69109f06-acbf-4834-b05e-80ab6e3f6ea0/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:11:29 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/69109f06-acbf-4834-b05e-80ab6e3f6ea0/disk --force-share --output=json {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:11:30 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/69109f06-acbf-4834-b05e-80ab6e3f6ea0/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:11:30 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=74613) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 29 18:11:30 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9eb14feb-f196-42b1-a6ba-2a049dea2d5e/disk --force-share --output=json {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:11:30 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9eb14feb-f196-42b1-a6ba-2a049dea2d5e/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:11:30 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9eb14feb-f196-42b1-a6ba-2a049dea2d5e/disk --force-share --output=json {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:11:30 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9eb14feb-f196-42b1-a6ba-2a049dea2d5e/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:11:30 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f4a1329-b3b9-4d1c-8735-abddabc359fd/disk.rescue --force-share --output=json {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:11:30 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f4a1329-b3b9-4d1c-8735-abddabc359fd/disk.rescue --force-share --output=json" returned: 0 in 0.179s {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:11:30 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f4a1329-b3b9-4d1c-8735-abddabc359fd/disk.rescue --force-share --output=json {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:11:30 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:11:30 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f4a1329-b3b9-4d1c-8735-abddabc359fd/disk.rescue --force-share --output=json" returned: 0 in 0.187s {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:11:30 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f4a1329-b3b9-4d1c-8735-abddabc359fd/disk --force-share --output=json {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:11:31 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f4a1329-b3b9-4d1c-8735-abddabc359fd/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:11:31 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f4a1329-b3b9-4d1c-8735-abddabc359fd/disk --force-share --output=json {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:11:31 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f4a1329-b3b9-4d1c-8735-abddabc359fd/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:11:31 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3b828860-5cc5-40b0-b845-8e560211794e/disk --force-share --output=json {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:11:31 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3b828860-5cc5-40b0-b845-8e560211794e/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:11:31 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3b828860-5cc5-40b0-b845-8e560211794e/disk --force-share --output=json {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:11:31 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3b828860-5cc5-40b0-b845-8e560211794e/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:11:31 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6993e2e7-7e03-45b4-9d3d-3742589b6078/disk --force-share --output=json {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:11:31 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6993e2e7-7e03-45b4-9d3d-3742589b6078/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:11:31 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6993e2e7-7e03-45b4-9d3d-3742589b6078/disk --force-share --output=json {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:11:31 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:11:31 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6993e2e7-7e03-45b4-9d3d-3742589b6078/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:11:32 user nova-compute[74613]: WARNING nova.virt.libvirt.driver [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 18:11:32 user nova-compute[74613]: WARNING nova.virt.libvirt.driver [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 18:11:32 user nova-compute[74613]: DEBUG nova.compute.resource_tracker [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Hypervisor/Node resource view: name=user free_ram=8226MB free_disk=24.745182037353516GB free_vcpus=7 pci_devices=[{"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74613) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 29 18:11:32 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 18:11:32 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 18:11:32 user nova-compute[74613]: DEBUG nova.compute.resource_tracker [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Instance 3b828860-5cc5-40b0-b845-8e560211794e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74613) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 18:11:32 user nova-compute[74613]: DEBUG nova.compute.resource_tracker [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Instance 6993e2e7-7e03-45b4-9d3d-3742589b6078 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74613) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 18:11:32 user nova-compute[74613]: DEBUG nova.compute.resource_tracker [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Instance 6f4a1329-b3b9-4d1c-8735-abddabc359fd actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74613) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 18:11:32 user nova-compute[74613]: DEBUG nova.compute.resource_tracker [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Instance 9eb14feb-f196-42b1-a6ba-2a049dea2d5e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74613) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 18:11:32 user nova-compute[74613]: DEBUG nova.compute.resource_tracker [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Instance 69109f06-acbf-4834-b05e-80ab6e3f6ea0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74613) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 18:11:32 user nova-compute[74613]: DEBUG nova.compute.resource_tracker [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Total usable vcpus: 12, total allocated vcpus: 5 {{(pid=74613) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 29 18:11:32 user nova-compute[74613]: DEBUG nova.compute.resource_tracker [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Final resource view: name=user phys_ram=16011MB used_ram=3072MB phys_disk=40GB used_disk=5GB total_vcpus=12 used_vcpus=5 pci_stats=[] {{(pid=74613) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 29 18:11:32 user nova-compute[74613]: DEBUG nova.compute.provider_tree [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Inventory has not changed in ProviderTree for provider: 639d980e-3b12-44b1-b8f4-1812416fa4dd {{(pid=74613) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 18:11:32 user nova-compute[74613]: DEBUG nova.scheduler.client.report [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Inventory has not changed for provider 639d980e-3b12-44b1-b8f4-1812416fa4dd based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74613) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 18:11:32 user nova-compute[74613]: DEBUG nova.compute.resource_tracker [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Compute_service record updated for user:user {{(pid=74613) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 29 18:11:32 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.340s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 18:11:33 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-e6fd9535-5ef0-49c3-b8df-bd6002fe9b05 tempest-AttachVolumeTestJSON-813984703 tempest-AttachVolumeTestJSON-813984703-project-member] Acquiring lock "69109f06-acbf-4834-b05e-80ab6e3f6ea0" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 18:11:33 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-e6fd9535-5ef0-49c3-b8df-bd6002fe9b05 tempest-AttachVolumeTestJSON-813984703 tempest-AttachVolumeTestJSON-813984703-project-member] Lock "69109f06-acbf-4834-b05e-80ab6e3f6ea0" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 18:11:33 user nova-compute[74613]: INFO nova.compute.manager [None req-e6fd9535-5ef0-49c3-b8df-bd6002fe9b05 tempest-AttachVolumeTestJSON-813984703 tempest-AttachVolumeTestJSON-813984703-project-member] [instance: 69109f06-acbf-4834-b05e-80ab6e3f6ea0] Detaching volume b2879f1d-797c-4701-8803-eb6369ddb534
Nov 29 18:11:33 user nova-compute[74613]: DEBUG oslo_service.periodic_task [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74613) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 18:11:33 user nova-compute[74613]: DEBUG oslo_service.periodic_task [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74613) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 18:11:33 user nova-compute[74613]: DEBUG nova.compute.manager [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Starting heal instance info cache {{(pid=74613) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 29 18:11:33 user nova-compute[74613]: INFO nova.virt.block_device [None req-e6fd9535-5ef0-49c3-b8df-bd6002fe9b05 tempest-AttachVolumeTestJSON-813984703 tempest-AttachVolumeTestJSON-813984703-project-member] [instance: 69109f06-acbf-4834-b05e-80ab6e3f6ea0] Attempting to driver detach volume b2879f1d-797c-4701-8803-eb6369ddb534 from mountpoint /dev/vdb
Nov 29 18:11:33 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-e6fd9535-5ef0-49c3-b8df-bd6002fe9b05 tempest-AttachVolumeTestJSON-813984703 tempest-AttachVolumeTestJSON-813984703-project-member] Attempting to detach device vdb from instance 69109f06-acbf-4834-b05e-80ab6e3f6ea0 from the persistent domain config. {{(pid=74613) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 29 18:11:33 user nova-compute[74613]: DEBUG nova.virt.libvirt.guest [None req-e6fd9535-5ef0-49c3-b8df-bd6002fe9b05 tempest-AttachVolumeTestJSON-813984703 tempest-AttachVolumeTestJSON-813984703-project-member] detach device xml: <disk type="block" device="disk">
Nov 29 18:11:33 user nova-compute[74613]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 18:11:33 user nova-compute[74613]:   <source dev="/dev/sdc"/>
Nov 29 18:11:33 user nova-compute[74613]:   <target dev="vdb" bus="virtio"/>
Nov 29 18:11:33 user nova-compute[74613]:   <serial>b2879f1d-797c-4701-8803-eb6369ddb534</serial>
Nov 29 18:11:33 user nova-compute[74613]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Nov 29 18:11:33 user nova-compute[74613]: </disk>
Nov 29 18:11:33 user nova-compute[74613]:  {{(pid=74613) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 29 18:11:33 user nova-compute[74613]: INFO nova.virt.libvirt.driver [None req-e6fd9535-5ef0-49c3-b8df-bd6002fe9b05 tempest-AttachVolumeTestJSON-813984703 tempest-AttachVolumeTestJSON-813984703-project-member] Successfully detached device vdb from instance 69109f06-acbf-4834-b05e-80ab6e3f6ea0 from the persistent domain config.
Nov 29 18:11:33 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-e6fd9535-5ef0-49c3-b8df-bd6002fe9b05 tempest-AttachVolumeTestJSON-813984703 tempest-AttachVolumeTestJSON-813984703-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 69109f06-acbf-4834-b05e-80ab6e3f6ea0 from the live domain config. {{(pid=74613) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 29 18:11:33 user nova-compute[74613]: DEBUG nova.virt.libvirt.guest [None req-e6fd9535-5ef0-49c3-b8df-bd6002fe9b05 tempest-AttachVolumeTestJSON-813984703 tempest-AttachVolumeTestJSON-813984703-project-member] detach device xml: <disk type="block" device="disk">
Nov 29 18:11:33 user nova-compute[74613]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 18:11:33 user nova-compute[74613]:   <source dev="/dev/sdc"/>
Nov 29 18:11:33 user nova-compute[74613]:   <target dev="vdb" bus="virtio"/>
Nov 29 18:11:33 user nova-compute[74613]:   <serial>b2879f1d-797c-4701-8803-eb6369ddb534</serial>
Nov 29 18:11:33 user nova-compute[74613]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Nov 29 18:11:33 user nova-compute[74613]: </disk>
Nov 29 18:11:33 user nova-compute[74613]:  {{(pid=74613) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 29 18:11:34 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Acquiring lock "refresh_cache-6993e2e7-7e03-45b4-9d3d-3742589b6078" {{(pid=74613) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 18:11:34 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Acquired lock "refresh_cache-6993e2e7-7e03-45b4-9d3d-3742589b6078" {{(pid=74613) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 18:11:34 user nova-compute[74613]: DEBUG nova.network.neutron [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] [instance: 6993e2e7-7e03-45b4-9d3d-3742589b6078] Forcefully refreshing network info cache for instance {{(pid=74613) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 29 18:11:34 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-e6fd9535-5ef0-49c3-b8df-bd6002fe9b05 tempest-AttachVolumeTestJSON-813984703 tempest-AttachVolumeTestJSON-813984703-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 69109f06-acbf-4834-b05e-80ab6e3f6ea0 {{(pid=74613) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 29 18:11:34 user nova-compute[74613]: DEBUG nova.network.neutron [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] [instance: 6993e2e7-7e03-45b4-9d3d-3742589b6078] Updating instance_info_cache with network_info: [{"id": "5216b7ab-6e2b-4d7f-8c7f-e52b03d282b9", "address": "fa:16:3e:e8:7b:54", "network": {"id": "db79433c-b21c-4058-b98c-f62822abbf7a", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1715530752-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e6a3eb6ea0294f9da705dca72ec2789a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5216b7ab-6e", "ovs_interfaceid": "5216b7ab-6e2b-4d7f-8c7f-e52b03d282b9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74613) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 18:11:34 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Releasing lock "refresh_cache-6993e2e7-7e03-45b4-9d3d-3742589b6078" {{(pid=74613) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 18:11:34 user nova-compute[74613]: DEBUG nova.compute.manager [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] [instance: 6993e2e7-7e03-45b4-9d3d-3742589b6078] Updated the network info_cache for instance {{(pid=74613) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 29 18:11:34 user nova-compute[74613]: DEBUG oslo_service.periodic_task [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74613) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 18:11:34 user nova-compute[74613]: DEBUG oslo_service.periodic_task [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74613) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 18:11:34 user nova-compute[74613]: DEBUG oslo_service.periodic_task [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74613) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 18:11:35 user nova-compute[74613]: DEBUG oslo_service.periodic_task [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74613) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 18:11:35 user nova-compute[74613]: DEBUG nova.compute.manager [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74613) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 29 18:11:35 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:11:36 user nova-compute[74613]: DEBUG oslo_service.periodic_task [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74613) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 18:11:36 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:11:37 user nova-compute[74613]: DEBUG oslo_service.periodic_task [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74613) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 18:11:40 user nova-compute[74613]: DEBUG oslo_service.periodic_task [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74613) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 18:11:40 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:11:41 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:11:46 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 18:11:51 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 18:11:54 user nova-compute[74613]: WARNING nova.virt.libvirt.driver [None req-e6fd9535-5ef0-49c3-b8df-bd6002fe9b05 tempest-AttachVolumeTestJSON-813984703 tempest-AttachVolumeTestJSON-813984703-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 69109f06-acbf-4834-b05e-80ab6e3f6ea0 is timed out.
Nov 29 18:11:54 user nova-compute[74613]: INFO nova.virt.libvirt.driver [None req-e6fd9535-5ef0-49c3-b8df-bd6002fe9b05 tempest-AttachVolumeTestJSON-813984703 tempest-AttachVolumeTestJSON-813984703-project-member] Successfully detached device vdb from instance 69109f06-acbf-4834-b05e-80ab6e3f6ea0 from the live domain config.
Nov 29 18:11:54 user nova-compute[74613]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e6fd9535-5ef0-49c3-b8df-bd6002fe9b05 tempest-AttachVolumeTestJSON-813984703 tempest-AttachVolumeTestJSON-813984703-project-member] [instance: 69109f06-acbf-4834-b05e-80ab6e3f6ea0] calling os-brick to detach iSCSI Volume {{(pid=74613) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 29 18:11:54 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-e6fd9535-5ef0-49c3-b8df-bd6002fe9b05 tempest-AttachVolumeTestJSON-813984703 tempest-AttachVolumeTestJSON-813984703-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff828156890>, {'target_iqn': 'iqn.2010-10.org.openstack:b2879f1d-797c-4701-8803-eb6369ddb534', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'grDSnlbc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=74613) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 18:11:54 user nova-compute[74613]: WARNING os_brick.initiator.connectors.base [None req-e6fd9535-5ef0-49c3-b8df-bd6002fe9b05 tempest-AttachVolumeTestJSON-813984703 tempest-AttachVolumeTestJSON-813984703-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 18:11:54 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.base [None req-e6fd9535-5ef0-49c3-b8df-bd6002fe9b05 tempest-AttachVolumeTestJSON-813984703 tempest-AttachVolumeTestJSON-813984703-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 18:11:54 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.base [None req-e6fd9535-5ef0-49c3-b8df-bd6002fe9b05 tempest-AttachVolumeTestJSON-813984703 tempest-AttachVolumeTestJSON-813984703-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 18:11:54 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:11:54 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.017s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:11:54 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[7831ddde-d5cd-45d6-89fe-b4a52792cda4]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:b2879f1d-797c-4701-8803-eb6369ddb534\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 18:11:54 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-e6fd9535-5ef0-49c3-b8df-bd6002fe9b05 tempest-AttachVolumeTestJSON-813984703 tempest-AttachVolumeTestJSON-813984703-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 29 18:11:54 user nova-compute[74613]: No targets found.
Nov 29 18:11:54 user nova-compute[74613]: iSNS:
Nov 29 18:11:54 user nova-compute[74613]: No targets found.
Nov 29 18:11:54 user nova-compute[74613]: STATIC:
Nov 29 18:11:54 user nova-compute[74613]: Target: iqn.2010-10.org.openstack:b2879f1d-797c-4701-8803-eb6369ddb534
Nov 29 18:11:54 user nova-compute[74613]:         Portal: 172.16.0.220:3260,-1
Nov 29 18:11:54 user nova-compute[74613]:                 Iface Name: default
Nov 29 18:11:54 user nova-compute[74613]: FIRMWARE:
Nov 29 18:11:54 user nova-compute[74613]: No targets found.
Nov 29 18:11:54 user nova-compute[74613]:  stderr= {{(pid=74613) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 18:11:54 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-e6fd9535-5ef0-49c3-b8df-bd6002fe9b05 tempest-AttachVolumeTestJSON-813984703 tempest-AttachVolumeTestJSON-813984703-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 29 18:11:54 user nova-compute[74613]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 29 18:11:54 user nova-compute[74613]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74613) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 29 18:11:54 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-e6fd9535-5ef0-49c3-b8df-bd6002fe9b05 tempest-AttachVolumeTestJSON-813984703 tempest-AttachVolumeTestJSON-813984703-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b2879f1d-797c-4701-8803-eb6369ddb534', 0)] {{(pid=74613) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 29 18:11:54 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:11:54 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:11:54 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[17fd6bcb-a546-4245-8f79-9898367da087]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b2879f1d-797c-4701-8803-eb6369ddb534\n', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 18:11:54 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:11:54 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:11:54 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f75f338-10af-4a03-a956-38dc07481444]: (4, ('tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2879f1d-797c-4701-8803-eb6369ddb534 (non-flash)\n', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 18:11:54 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-e6fd9535-5ef0-49c3-b8df-bd6002fe9b05 tempest-AttachVolumeTestJSON-813984703 tempest-AttachVolumeTestJSON-813984703-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2879f1d-797c-4701-8803-eb6369ddb534 (non-flash)
Nov 29 18:11:54 user nova-compute[74613]:  stderr= {{(pid=74613) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 18:11:54 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-e6fd9535-5ef0-49c3-b8df-bd6002fe9b05 tempest-AttachVolumeTestJSON-813984703 tempest-AttachVolumeTestJSON-813984703-project-member] iscsi session list stdout=tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2879f1d-797c-4701-8803-eb6369ddb534 (non-flash)
Nov 29 18:11:54 user nova-compute[74613]:  stderr= {{(pid=74613) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 18:11:54 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-e6fd9535-5ef0-49c3-b8df-bd6002fe9b05 tempest-AttachVolumeTestJSON-813984703 tempest-AttachVolumeTestJSON-813984703-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7ff818325c60>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b2879f1d-797c-4701-8803-eb6369ddb534'): ({'sdc'}, set())}) {{(pid=74613) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 29 18:11:54 user nova-compute[74613]: DEBUG os_brick.initiator.linuxscsi [None req-e6fd9535-5ef0-49c3-b8df-bd6002fe9b05 tempest-AttachVolumeTestJSON-813984703 tempest-AttachVolumeTestJSON-813984703-project-member] Removing single pathed devices sdc {{(pid=74613) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 29 18:11:54 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:11:54 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:11:54 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[21d0fc25-1e9d-430e-8842-a2a1b6c5fa1c]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 18:11:54 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:11:54 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.022s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:11:54 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ea9b0fe-6678-4b09-a5ef-afea09eddef6]: (4, ('ok\n', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 18:11:54 user nova-compute[74613]: DEBUG os_brick.initiator.linuxscsi [None req-e6fd9535-5ef0-49c3-b8df-bd6002fe9b05 tempest-AttachVolumeTestJSON-813984703 tempest-AttachVolumeTestJSON-813984703-project-member] Flushing IO for device /dev/sdc {{(pid=74613) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 29 18:11:54 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:11:54 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.014s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:11:54 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0fd251f-4b41-4002-8d4d-959820be6176]: (4, ('', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 18:11:54 user nova-compute[74613]: DEBUG os_brick.initiator.linuxscsi [None req-e6fd9535-5ef0-49c3-b8df-bd6002fe9b05 tempest-AttachVolumeTestJSON-813984703 tempest-AttachVolumeTestJSON-813984703-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=74613) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 29 18:11:54 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:11:54 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.034s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:11:54 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa1c1cfb-f3a2-44b1-ba62-fbcd60965b98]: (4, ('1', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 18:11:54 user nova-compute[74613]: DEBUG os_brick.initiator.linuxscsi [None req-e6fd9535-5ef0-49c3-b8df-bd6002fe9b05 tempest-AttachVolumeTestJSON-813984703 tempest-AttachVolumeTestJSON-813984703-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=74613) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 29 18:11:54 user nova-compute[74613]: DEBUG os_brick.initiator.linuxscsi [None req-e6fd9535-5ef0-49c3-b8df-bd6002fe9b05 tempest-AttachVolumeTestJSON-813984703 tempest-AttachVolumeTestJSON-813984703-project-member] SCSI volumes sdc have been removed. {{(pid=74613) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 29 18:11:54 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-e6fd9535-5ef0-49c3-b8df-bd6002fe9b05 tempest-AttachVolumeTestJSON-813984703 tempest-AttachVolumeTestJSON-813984703-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b2879f1d-797c-4701-8803-eb6369ddb534')] {{(pid=74613) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 29 18:11:54 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b2879f1d-797c-4701-8803-eb6369ddb534 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:11:54 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b2879f1d-797c-4701-8803-eb6369ddb534 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:11:54 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd058cb5-d6e0-405c-8b55-e56e69675132]: (4, ('', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 18:11:54 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-e6fd9535-5ef0-49c3-b8df-bd6002fe9b05 tempest-AttachVolumeTestJSON-813984703 tempest-AttachVolumeTestJSON-813984703-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74613) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 18:11:54 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b2879f1d-797c-4701-8803-eb6369ddb534 -p 172.16.0.220:3260 --logout {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:11:54 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-9b3e929e-1b4b-4f19-8c0b-0b0063aa7d5c tempest-ServerBootFromVolumeStableRescueTest-414665510 tempest-ServerBootFromVolumeStableRescueTest-414665510-project-member] Acquiring lock "3b828860-5cc5-40b0-b845-8e560211794e" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 18:11:54 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-9b3e929e-1b4b-4f19-8c0b-0b0063aa7d5c tempest-ServerBootFromVolumeStableRescueTest-414665510 tempest-ServerBootFromVolumeStableRescueTest-414665510-project-member] Lock "3b828860-5cc5-40b0-b845-8e560211794e" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 18:11:54 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-9b3e929e-1b4b-4f19-8c0b-0b0063aa7d5c tempest-ServerBootFromVolumeStableRescueTest-414665510 tempest-ServerBootFromVolumeStableRescueTest-414665510-project-member] Acquiring lock "3b828860-5cc5-40b0-b845-8e560211794e-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 18:11:54 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-9b3e929e-1b4b-4f19-8c0b-0b0063aa7d5c tempest-ServerBootFromVolumeStableRescueTest-414665510 tempest-ServerBootFromVolumeStableRescueTest-414665510-project-member] Lock "3b828860-5cc5-40b0-b845-8e560211794e-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 18:11:54 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-9b3e929e-1b4b-4f19-8c0b-0b0063aa7d5c tempest-ServerBootFromVolumeStableRescueTest-414665510 tempest-ServerBootFromVolumeStableRescueTest-414665510-project-member] Lock "3b828860-5cc5-40b0-b845-8e560211794e-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 18:11:54 user nova-compute[74613]: INFO nova.compute.manager [None req-9b3e929e-1b4b-4f19-8c0b-0b0063aa7d5c tempest-ServerBootFromVolumeStableRescueTest-414665510 tempest-ServerBootFromVolumeStableRescueTest-414665510-project-member] [instance: 3b828860-5cc5-40b0-b845-8e560211794e] Terminating instance
Nov 29 18:11:54 user nova-compute[74613]: DEBUG nova.compute.manager [None req-9b3e929e-1b4b-4f19-8c0b-0b0063aa7d5c tempest-ServerBootFromVolumeStableRescueTest-414665510 tempest-ServerBootFromVolumeStableRescueTest-414665510-project-member] [instance: 3b828860-5cc5-40b0-b845-8e560211794e] Start destroying the instance on the hypervisor. {{(pid=74613) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 29 18:11:54 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b2879f1d-797c-4701-8803-eb6369ddb534 -p 172.16.0.220:3260 --logout" returned: 0 in 0.055s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:11:54 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a43387a-3980-4398-9fcf-aa518f6b2536]: (4, ('Logging out of session [sid: 37, target: iqn.2010-10.org.openstack:b2879f1d-797c-4701-8803-eb6369ddb534, portal: 172.16.0.220,3260]\nLogout of [sid: 37, target: iqn.2010-10.org.openstack:b2879f1d-797c-4701-8803-eb6369ddb534, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 18:11:54 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-e6fd9535-5ef0-49c3-b8df-bd6002fe9b05 tempest-AttachVolumeTestJSON-813984703 tempest-AttachVolumeTestJSON-813984703-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 37, target: iqn.2010-10.org.openstack:b2879f1d-797c-4701-8803-eb6369ddb534, portal: 172.16.0.220,3260]
Nov 29 18:11:54 user nova-compute[74613]: Logout of [sid: 37, target: iqn.2010-10.org.openstack:b2879f1d-797c-4701-8803-eb6369ddb534, portal: 172.16.0.220,3260] successful.
Nov 29 18:11:54 user nova-compute[74613]:  stderr= {{(pid=74613) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 18:11:54 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b2879f1d-797c-4701-8803-eb6369ddb534 -p 172.16.0.220:3260 --op delete {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:11:54 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b2879f1d-797c-4701-8803-eb6369ddb534 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.019s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:11:54 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c1e127a-5da6-4776-a9e1-e611e316a814]: (4, ('', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 18:11:54 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-e6fd9535-5ef0-49c3-b8df-bd6002fe9b05 tempest-AttachVolumeTestJSON-813984703 tempest-AttachVolumeTestJSON-813984703-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74613) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 18:11:54 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.base [None req-e6fd9535-5ef0-49c3-b8df-bd6002fe9b05 tempest-AttachVolumeTestJSON-813984703 tempest-AttachVolumeTestJSON-813984703-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.293s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 18:11:54 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-e6fd9535-5ef0-49c3-b8df-bd6002fe9b05 tempest-AttachVolumeTestJSON-813984703 tempest-AttachVolumeTestJSON-813984703-project-member] <== disconnect_volume: return (295ms) None {{(pid=74613) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 18:11:54 user nova-compute[74613]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e6fd9535-5ef0-49c3-b8df-bd6002fe9b05 tempest-AttachVolumeTestJSON-813984703 tempest-AttachVolumeTestJSON-813984703-project-member] [instance: 69109f06-acbf-4834-b05e-80ab6e3f6ea0] Disconnected iSCSI Volume {{(pid=74613) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 29 18:11:54 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:11:54 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:11:54 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:11:54 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:11:54 user nova-compute[74613]: DEBUG nova.compute.manager [req-cb69a72d-a92a-4793-92fb-2d213cb4f948 req-9820e882-a510-4b7f-a8b4-17a038f8b812 service nova] [instance: 3b828860-5cc5-40b0-b845-8e560211794e] Received event network-vif-unplugged-dfe097e1-192f-47e2-96b7-0e9fe8320758 {{(pid=74613) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 18:11:54 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-cb69a72d-a92a-4793-92fb-2d213cb4f948 req-9820e882-a510-4b7f-a8b4-17a038f8b812 service nova] Acquiring lock "3b828860-5cc5-40b0-b845-8e560211794e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 18:11:54 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-cb69a72d-a92a-4793-92fb-2d213cb4f948 req-9820e882-a510-4b7f-a8b4-17a038f8b812 service nova] Lock "3b828860-5cc5-40b0-b845-8e560211794e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 18:11:54 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-cb69a72d-a92a-4793-92fb-2d213cb4f948 req-9820e882-a510-4b7f-a8b4-17a038f8b812 service nova] Lock "3b828860-5cc5-40b0-b845-8e560211794e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 18:11:54 user nova-compute[74613]: DEBUG nova.compute.manager [req-cb69a72d-a92a-4793-92fb-2d213cb4f948 req-9820e882-a510-4b7f-a8b4-17a038f8b812 service nova] [instance: 3b828860-5cc5-40b0-b845-8e560211794e] No waiting events found dispatching network-vif-unplugged-dfe097e1-192f-47e2-96b7-0e9fe8320758 {{(pid=74613) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 18:11:54 user nova-compute[74613]: DEBUG nova.compute.manager [req-cb69a72d-a92a-4793-92fb-2d213cb4f948 req-9820e882-a510-4b7f-a8b4-17a038f8b812 service nova] [instance: 3b828860-5cc5-40b0-b845-8e560211794e] Received event network-vif-unplugged-dfe097e1-192f-47e2-96b7-0e9fe8320758 for instance with task_state deleting. {{(pid=74613) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 29 18:11:55 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:11:55 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:11:55 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:11:55 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:11:55 user nova-compute[74613]: INFO nova.virt.libvirt.driver [-] [instance: 3b828860-5cc5-40b0-b845-8e560211794e] Instance destroyed successfully.
Nov 29 18:11:55 user nova-compute[74613]: DEBUG nova.objects.instance [None req-9b3e929e-1b4b-4f19-8c0b-0b0063aa7d5c tempest-ServerBootFromVolumeStableRescueTest-414665510 tempest-ServerBootFromVolumeStableRescueTest-414665510-project-member] Lazy-loading 'resources' on Instance uuid 3b828860-5cc5-40b0-b845-8e560211794e {{(pid=74613) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 18:11:55 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:11:55 user nova-compute[74613]: DEBUG nova.virt.libvirt.vif [None req-9b3e929e-1b4b-4f19-8c0b-0b0063aa7d5c tempest-ServerBootFromVolumeStableRescueTest-414665510 tempest-ServerBootFromVolumeStableRescueTest-414665510-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T17:51:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-209698272',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-209698272',id=2,image_ref='4217f428-8d9d-4ee1-9614-642d26d90c46',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-29T17:51:44Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='b820dd795dfe46cd804772f0e71f98e9',ramdisk_id='',reservation_id='r-duhpdsex',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='4217f428-8d9d-4ee1-9614-642d26d90c46',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-414665510',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-414665510-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-29T17:53:23Z,user_data=None,user_id='c65bc922e04d4d1385e48f70c460c441',uuid=3b828860-5cc5-40b0-b845-8e560211794e,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "dfe097e1-192f-47e2-96b7-0e9fe8320758", "address": "fa:16:3e:c2:a8:2f", "network": {"id": "0722b02d-a357-4360-87e8-580913723985", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-579793494-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b820dd795dfe46cd804772f0e71f98e9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdfe097e1-19", "ovs_interfaceid": "dfe097e1-192f-47e2-96b7-0e9fe8320758", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74613) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 29 18:11:55 user nova-compute[74613]: DEBUG nova.network.os_vif_util [None req-9b3e929e-1b4b-4f19-8c0b-0b0063aa7d5c tempest-ServerBootFromVolumeStableRescueTest-414665510 tempest-ServerBootFromVolumeStableRescueTest-414665510-project-member] Converting VIF {"id": "dfe097e1-192f-47e2-96b7-0e9fe8320758", "address": "fa:16:3e:c2:a8:2f", "network": {"id": "0722b02d-a357-4360-87e8-580913723985", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-579793494-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b820dd795dfe46cd804772f0e71f98e9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdfe097e1-19", "ovs_interfaceid": "dfe097e1-192f-47e2-96b7-0e9fe8320758", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74613) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 18:11:55 user nova-compute[74613]: DEBUG nova.network.os_vif_util [None req-9b3e929e-1b4b-4f19-8c0b-0b0063aa7d5c tempest-ServerBootFromVolumeStableRescueTest-414665510 tempest-ServerBootFromVolumeStableRescueTest-414665510-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:c2:a8:2f,bridge_name='br-int',has_traffic_filtering=True,id=dfe097e1-192f-47e2-96b7-0e9fe8320758,network=Network(0722b02d-a357-4360-87e8-580913723985),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdfe097e1-19') {{(pid=74613) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 18:11:55 user nova-compute[74613]: DEBUG os_vif [None req-9b3e929e-1b4b-4f19-8c0b-0b0063aa7d5c tempest-ServerBootFromVolumeStableRescueTest-414665510 tempest-ServerBootFromVolumeStableRescueTest-414665510-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:c2:a8:2f,bridge_name='br-int',has_traffic_filtering=True,id=dfe097e1-192f-47e2-96b7-0e9fe8320758,network=Network(0722b02d-a357-4360-87e8-580913723985),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdfe097e1-19') {{(pid=74613) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 29 18:11:55 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:11:55 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapdfe097e1-19, bridge=br-int, if_exists=True) {{(pid=74613) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 18:11:55 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:11:55 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 18:11:55 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:11:55 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=043ff774-c2d8-42a1-a4d5-20bcf13d919c) {{(pid=74613) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 18:11:55 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:11:55 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:11:55 user nova-compute[74613]: INFO os_vif [None req-9b3e929e-1b4b-4f19-8c0b-0b0063aa7d5c tempest-ServerBootFromVolumeStableRescueTest-414665510 tempest-ServerBootFromVolumeStableRescueTest-414665510-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:c2:a8:2f,bridge_name='br-int',has_traffic_filtering=True,id=dfe097e1-192f-47e2-96b7-0e9fe8320758,network=Network(0722b02d-a357-4360-87e8-580913723985),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdfe097e1-19')
Nov 29 18:11:55 user nova-compute[74613]: INFO nova.virt.libvirt.driver [None req-9b3e929e-1b4b-4f19-8c0b-0b0063aa7d5c tempest-ServerBootFromVolumeStableRescueTest-414665510 tempest-ServerBootFromVolumeStableRescueTest-414665510-project-member] [instance: 3b828860-5cc5-40b0-b845-8e560211794e] Deleting instance files /opt/stack/data/nova/instances/3b828860-5cc5-40b0-b845-8e560211794e_del
Nov 29 18:11:55 user nova-compute[74613]: INFO nova.virt.libvirt.driver [None req-9b3e929e-1b4b-4f19-8c0b-0b0063aa7d5c tempest-ServerBootFromVolumeStableRescueTest-414665510 tempest-ServerBootFromVolumeStableRescueTest-414665510-project-member] [instance: 3b828860-5cc5-40b0-b845-8e560211794e] Deletion of /opt/stack/data/nova/instances/3b828860-5cc5-40b0-b845-8e560211794e_del complete
Nov 29 18:11:55 user nova-compute[74613]: INFO nova.compute.manager [None req-9b3e929e-1b4b-4f19-8c0b-0b0063aa7d5c tempest-ServerBootFromVolumeStableRescueTest-414665510 tempest-ServerBootFromVolumeStableRescueTest-414665510-project-member] [instance: 3b828860-5cc5-40b0-b845-8e560211794e] Took 0.89 seconds to destroy the instance on the hypervisor.
Nov 29 18:11:55 user nova-compute[74613]: DEBUG oslo.service.loopingcall [None req-9b3e929e-1b4b-4f19-8c0b-0b0063aa7d5c tempest-ServerBootFromVolumeStableRescueTest-414665510 tempest-ServerBootFromVolumeStableRescueTest-414665510-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74613) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 29 18:11:55 user nova-compute[74613]: DEBUG nova.compute.manager [-] [instance: 3b828860-5cc5-40b0-b845-8e560211794e] Deallocating network for instance {{(pid=74613) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 29 18:11:55 user nova-compute[74613]: DEBUG nova.network.neutron [-] [instance: 3b828860-5cc5-40b0-b845-8e560211794e] deallocate_for_instance() {{(pid=74613) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 29 18:11:55 user nova-compute[74613]: DEBUG nova.objects.instance [None req-e6fd9535-5ef0-49c3-b8df-bd6002fe9b05 tempest-AttachVolumeTestJSON-813984703 tempest-AttachVolumeTestJSON-813984703-project-member] Lazy-loading 'flavor' on Instance uuid 69109f06-acbf-4834-b05e-80ab6e3f6ea0 {{(pid=74613) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 18:11:55 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-e6fd9535-5ef0-49c3-b8df-bd6002fe9b05 tempest-AttachVolumeTestJSON-813984703 tempest-AttachVolumeTestJSON-813984703-project-member] Lock "69109f06-acbf-4834-b05e-80ab6e3f6ea0" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.870s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 18:11:55 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:11:55 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:11:55 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:11:56 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:11:56 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:11:56 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:11:56 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-e20548b5-522f-4fcb-be14-2fa239a7edf9 tempest-AttachVolumeTestJSON-813984703 tempest-AttachVolumeTestJSON-813984703-project-member] Acquiring lock "69109f06-acbf-4834-b05e-80ab6e3f6ea0" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 18:11:56 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-e20548b5-522f-4fcb-be14-2fa239a7edf9 tempest-AttachVolumeTestJSON-813984703 tempest-AttachVolumeTestJSON-813984703-project-member] Lock "69109f06-acbf-4834-b05e-80ab6e3f6ea0" acquired by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: waited 0.001s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 18:11:56 user nova-compute[74613]: DEBUG nova.compute.manager [None req-e20548b5-522f-4fcb-be14-2fa239a7edf9 tempest-AttachVolumeTestJSON-813984703 tempest-AttachVolumeTestJSON-813984703-project-member] [instance: 69109f06-acbf-4834-b05e-80ab6e3f6ea0] Checking state {{(pid=74613) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 29 18:11:56 user nova-compute[74613]: DEBUG nova.compute.manager [None req-e20548b5-522f-4fcb-be14-2fa239a7edf9 tempest-AttachVolumeTestJSON-813984703 tempest-AttachVolumeTestJSON-813984703-project-member] [instance: 69109f06-acbf-4834-b05e-80ab6e3f6ea0] Stopping instance; current vm_state: active, current task_state: powering-off, current DB power_state: 1, current VM power_state: 1 {{(pid=74613) do_stop_instance /opt/stack/nova/nova/compute/manager.py:3358}}
Nov 29 18:11:56 user nova-compute[74613]: DEBUG nova.objects.instance [None req-e20548b5-522f-4fcb-be14-2fa239a7edf9 tempest-AttachVolumeTestJSON-813984703 tempest-AttachVolumeTestJSON-813984703-project-member] Lazy-loading 'flavor' on Instance uuid 69109f06-acbf-4834-b05e-80ab6e3f6ea0 {{(pid=74613) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 18:11:56 user nova-compute[74613]: DEBUG nova.network.neutron [-] [instance: 3b828860-5cc5-40b0-b845-8e560211794e] Updating instance_info_cache with network_info: [] {{(pid=74613) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 18:11:56 user nova-compute[74613]: INFO nova.compute.manager [-] [instance: 3b828860-5cc5-40b0-b845-8e560211794e] Took 0.85 seconds to deallocate network for instance.
Nov 29 18:11:56 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-9b3e929e-1b4b-4f19-8c0b-0b0063aa7d5c tempest-ServerBootFromVolumeStableRescueTest-414665510 tempest-ServerBootFromVolumeStableRescueTest-414665510-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 18:11:56 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-9b3e929e-1b4b-4f19-8c0b-0b0063aa7d5c tempest-ServerBootFromVolumeStableRescueTest-414665510 tempest-ServerBootFromVolumeStableRescueTest-414665510-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 18:11:56 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:11:56 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:11:56 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:11:56 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:11:56 user nova-compute[74613]: DEBUG nova.compute.provider_tree [None req-9b3e929e-1b4b-4f19-8c0b-0b0063aa7d5c tempest-ServerBootFromVolumeStableRescueTest-414665510 tempest-ServerBootFromVolumeStableRescueTest-414665510-project-member] Inventory has not changed in ProviderTree for provider: 639d980e-3b12-44b1-b8f4-1812416fa4dd {{(pid=74613) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 18:11:56 user nova-compute[74613]: DEBUG nova.scheduler.client.report [None req-9b3e929e-1b4b-4f19-8c0b-0b0063aa7d5c tempest-ServerBootFromVolumeStableRescueTest-414665510 tempest-ServerBootFromVolumeStableRescueTest-414665510-project-member] Inventory has not changed for provider 639d980e-3b12-44b1-b8f4-1812416fa4dd based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74613) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 18:11:56 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-9b3e929e-1b4b-4f19-8c0b-0b0063aa7d5c tempest-ServerBootFromVolumeStableRescueTest-414665510 tempest-ServerBootFromVolumeStableRescueTest-414665510-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.258s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 18:11:56 user nova-compute[74613]: INFO nova.scheduler.client.report [None req-9b3e929e-1b4b-4f19-8c0b-0b0063aa7d5c tempest-ServerBootFromVolumeStableRescueTest-414665510 tempest-ServerBootFromVolumeStableRescueTest-414665510-project-member] Deleted allocations for instance 3b828860-5cc5-40b0-b845-8e560211794e
Nov 29 18:11:56 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-9b3e929e-1b4b-4f19-8c0b-0b0063aa7d5c tempest-ServerBootFromVolumeStableRescueTest-414665510 tempest-ServerBootFromVolumeStableRescueTest-414665510-project-member] Lock "3b828860-5cc5-40b0-b845-8e560211794e" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.218s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 18:11:56 user nova-compute[74613]: DEBUG nova.compute.manager [req-4565973f-e984-47a4-a886-9825315ecf83 req-e289f578-119f-45e3-ab0d-ef5c51b95e72 service nova] [instance: 3b828860-5cc5-40b0-b845-8e560211794e] Received event network-vif-plugged-dfe097e1-192f-47e2-96b7-0e9fe8320758 {{(pid=74613) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 18:11:56 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-4565973f-e984-47a4-a886-9825315ecf83 req-e289f578-119f-45e3-ab0d-ef5c51b95e72 service nova] Acquiring lock "3b828860-5cc5-40b0-b845-8e560211794e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 18:11:56 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-4565973f-e984-47a4-a886-9825315ecf83 req-e289f578-119f-45e3-ab0d-ef5c51b95e72 service nova] Lock "3b828860-5cc5-40b0-b845-8e560211794e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 18:11:56 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-4565973f-e984-47a4-a886-9825315ecf83 req-e289f578-119f-45e3-ab0d-ef5c51b95e72 service nova] Lock "3b828860-5cc5-40b0-b845-8e560211794e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 18:11:56 user nova-compute[74613]: DEBUG nova.compute.manager [req-4565973f-e984-47a4-a886-9825315ecf83 req-e289f578-119f-45e3-ab0d-ef5c51b95e72 service nova] [instance: 3b828860-5cc5-40b0-b845-8e560211794e] No waiting events found dispatching network-vif-plugged-dfe097e1-192f-47e2-96b7-0e9fe8320758 {{(pid=74613) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 18:11:56 user nova-compute[74613]: WARNING nova.compute.manager [req-4565973f-e984-47a4-a886-9825315ecf83 req-e289f578-119f-45e3-ab0d-ef5c51b95e72 service nova] [instance: 3b828860-5cc5-40b0-b845-8e560211794e] Received unexpected event network-vif-plugged-dfe097e1-192f-47e2-96b7-0e9fe8320758 for instance with vm_state deleted and task_state None.
Nov 29 18:11:56 user nova-compute[74613]: DEBUG nova.compute.manager [req-4565973f-e984-47a4-a886-9825315ecf83 req-e289f578-119f-45e3-ab0d-ef5c51b95e72 service nova] [instance: 3b828860-5cc5-40b0-b845-8e560211794e] Received event network-vif-plugged-dfe097e1-192f-47e2-96b7-0e9fe8320758 {{(pid=74613) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 18:11:56 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-4565973f-e984-47a4-a886-9825315ecf83 req-e289f578-119f-45e3-ab0d-ef5c51b95e72 service nova] Acquiring lock "3b828860-5cc5-40b0-b845-8e560211794e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 18:11:56 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-4565973f-e984-47a4-a886-9825315ecf83 req-e289f578-119f-45e3-ab0d-ef5c51b95e72 service nova] Lock "3b828860-5cc5-40b0-b845-8e560211794e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 18:11:56 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-4565973f-e984-47a4-a886-9825315ecf83 req-e289f578-119f-45e3-ab0d-ef5c51b95e72 service nova] Lock "3b828860-5cc5-40b0-b845-8e560211794e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 18:11:56 user nova-compute[74613]: DEBUG nova.compute.manager [req-4565973f-e984-47a4-a886-9825315ecf83 req-e289f578-119f-45e3-ab0d-ef5c51b95e72 service nova] [instance: 3b828860-5cc5-40b0-b845-8e560211794e] No waiting events found dispatching network-vif-plugged-dfe097e1-192f-47e2-96b7-0e9fe8320758 {{(pid=74613) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 18:11:56 user nova-compute[74613]: WARNING nova.compute.manager [req-4565973f-e984-47a4-a886-9825315ecf83 req-e289f578-119f-45e3-ab0d-ef5c51b95e72 service nova] [instance: 3b828860-5cc5-40b0-b845-8e560211794e] Received unexpected event network-vif-plugged-dfe097e1-192f-47e2-96b7-0e9fe8320758 for instance with vm_state deleted and task_state None.
Nov 29 18:11:56 user nova-compute[74613]: DEBUG nova.compute.manager [req-4565973f-e984-47a4-a886-9825315ecf83 req-e289f578-119f-45e3-ab0d-ef5c51b95e72 service nova] [instance: 3b828860-5cc5-40b0-b845-8e560211794e] Received event network-vif-plugged-dfe097e1-192f-47e2-96b7-0e9fe8320758 {{(pid=74613) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 18:11:56 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-4565973f-e984-47a4-a886-9825315ecf83 req-e289f578-119f-45e3-ab0d-ef5c51b95e72 service nova] Acquiring lock "3b828860-5cc5-40b0-b845-8e560211794e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 18:11:56 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-4565973f-e984-47a4-a886-9825315ecf83 req-e289f578-119f-45e3-ab0d-ef5c51b95e72 service nova] Lock "3b828860-5cc5-40b0-b845-8e560211794e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 18:11:56 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-4565973f-e984-47a4-a886-9825315ecf83 req-e289f578-119f-45e3-ab0d-ef5c51b95e72 service nova] Lock "3b828860-5cc5-40b0-b845-8e560211794e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 18:11:56 user nova-compute[74613]: DEBUG nova.compute.manager [req-4565973f-e984-47a4-a886-9825315ecf83 req-e289f578-119f-45e3-ab0d-ef5c51b95e72 service nova] [instance: 3b828860-5cc5-40b0-b845-8e560211794e] No waiting events found dispatching network-vif-plugged-dfe097e1-192f-47e2-96b7-0e9fe8320758 {{(pid=74613) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 18:11:56 user nova-compute[74613]: WARNING nova.compute.manager [req-4565973f-e984-47a4-a886-9825315ecf83 req-e289f578-119f-45e3-ab0d-ef5c51b95e72 service nova] [instance: 3b828860-5cc5-40b0-b845-8e560211794e] Received unexpected event network-vif-plugged-dfe097e1-192f-47e2-96b7-0e9fe8320758 for instance with vm_state deleted and task_state None.
Nov 29 18:11:56 user nova-compute[74613]: DEBUG nova.compute.manager [req-4565973f-e984-47a4-a886-9825315ecf83 req-e289f578-119f-45e3-ab0d-ef5c51b95e72 service nova] [instance: 3b828860-5cc5-40b0-b845-8e560211794e] Received event network-vif-plugged-dfe097e1-192f-47e2-96b7-0e9fe8320758 {{(pid=74613) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 18:11:56 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-4565973f-e984-47a4-a886-9825315ecf83 req-e289f578-119f-45e3-ab0d-ef5c51b95e72 service nova] Acquiring lock "3b828860-5cc5-40b0-b845-8e560211794e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 18:11:56 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-4565973f-e984-47a4-a886-9825315ecf83 req-e289f578-119f-45e3-ab0d-ef5c51b95e72 service nova] Lock "3b828860-5cc5-40b0-b845-8e560211794e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 18:11:56 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-4565973f-e984-47a4-a886-9825315ecf83 req-e289f578-119f-45e3-ab0d-ef5c51b95e72 service nova] Lock "3b828860-5cc5-40b0-b845-8e560211794e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 18:11:56 user nova-compute[74613]: DEBUG nova.compute.manager [req-4565973f-e984-47a4-a886-9825315ecf83 req-e289f578-119f-45e3-ab0d-ef5c51b95e72 service nova] [instance: 3b828860-5cc5-40b0-b845-8e560211794e] No waiting events found dispatching network-vif-plugged-dfe097e1-192f-47e2-96b7-0e9fe8320758 {{(pid=74613) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 18:11:56 user nova-compute[74613]: WARNING nova.compute.manager [req-4565973f-e984-47a4-a886-9825315ecf83 req-e289f578-119f-45e3-ab0d-ef5c51b95e72 service nova] [instance: 3b828860-5cc5-40b0-b845-8e560211794e] Received unexpected event network-vif-plugged-dfe097e1-192f-47e2-96b7-0e9fe8320758 for instance with vm_state deleted and task_state None.
Nov 29 18:11:56 user nova-compute[74613]: DEBUG nova.compute.manager [req-4565973f-e984-47a4-a886-9825315ecf83 req-e289f578-119f-45e3-ab0d-ef5c51b95e72 service nova] [instance: 3b828860-5cc5-40b0-b845-8e560211794e] Received event network-vif-deleted-dfe097e1-192f-47e2-96b7-0e9fe8320758 {{(pid=74613) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 18:11:56 user nova-compute[74613]: DEBUG nova.compute.manager [req-4565973f-e984-47a4-a886-9825315ecf83 req-e289f578-119f-45e3-ab0d-ef5c51b95e72 service nova] [instance: 69109f06-acbf-4834-b05e-80ab6e3f6ea0] Received event network-vif-unplugged-e8b2f9b5-0c3a-4f6f-bf96-566c8a779849 {{(pid=74613) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 18:11:56 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-4565973f-e984-47a4-a886-9825315ecf83 req-e289f578-119f-45e3-ab0d-ef5c51b95e72 service nova] Acquiring lock "69109f06-acbf-4834-b05e-80ab6e3f6ea0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 18:11:56 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-4565973f-e984-47a4-a886-9825315ecf83 req-e289f578-119f-45e3-ab0d-ef5c51b95e72 service nova] Lock "69109f06-acbf-4834-b05e-80ab6e3f6ea0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 18:11:56 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-4565973f-e984-47a4-a886-9825315ecf83 req-e289f578-119f-45e3-ab0d-ef5c51b95e72 service nova] Lock "69109f06-acbf-4834-b05e-80ab6e3f6ea0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 18:11:56 user nova-compute[74613]: DEBUG nova.compute.manager [req-4565973f-e984-47a4-a886-9825315ecf83 req-e289f578-119f-45e3-ab0d-ef5c51b95e72 service nova] [instance: 69109f06-acbf-4834-b05e-80ab6e3f6ea0] No waiting events found dispatching network-vif-unplugged-e8b2f9b5-0c3a-4f6f-bf96-566c8a779849 {{(pid=74613) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 18:11:56 user nova-compute[74613]: WARNING nova.compute.manager [req-4565973f-e984-47a4-a886-9825315ecf83 req-e289f578-119f-45e3-ab0d-ef5c51b95e72 service nova] [instance: 69109f06-acbf-4834-b05e-80ab6e3f6ea0] Received unexpected event network-vif-unplugged-e8b2f9b5-0c3a-4f6f-bf96-566c8a779849 for instance with vm_state active and task_state powering-off.
Nov 29 18:11:56 user nova-compute[74613]: DEBUG nova.compute.manager [req-4565973f-e984-47a4-a886-9825315ecf83 req-e289f578-119f-45e3-ab0d-ef5c51b95e72 service nova] [instance: 69109f06-acbf-4834-b05e-80ab6e3f6ea0] Received event network-vif-plugged-e8b2f9b5-0c3a-4f6f-bf96-566c8a779849 {{(pid=74613) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 18:11:56 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-4565973f-e984-47a4-a886-9825315ecf83 req-e289f578-119f-45e3-ab0d-ef5c51b95e72 service nova] Acquiring lock "69109f06-acbf-4834-b05e-80ab6e3f6ea0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 18:11:56 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-4565973f-e984-47a4-a886-9825315ecf83 req-e289f578-119f-45e3-ab0d-ef5c51b95e72 service nova] Lock "69109f06-acbf-4834-b05e-80ab6e3f6ea0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 18:11:56 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-4565973f-e984-47a4-a886-9825315ecf83 req-e289f578-119f-45e3-ab0d-ef5c51b95e72 service nova] Lock "69109f06-acbf-4834-b05e-80ab6e3f6ea0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 18:11:56 user nova-compute[74613]: DEBUG nova.compute.manager [req-4565973f-e984-47a4-a886-9825315ecf83 req-e289f578-119f-45e3-ab0d-ef5c51b95e72 service nova] [instance: 69109f06-acbf-4834-b05e-80ab6e3f6ea0] No waiting events found dispatching network-vif-plugged-e8b2f9b5-0c3a-4f6f-bf96-566c8a779849 {{(pid=74613) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 18:11:56 user nova-compute[74613]: WARNING nova.compute.manager [req-4565973f-e984-47a4-a886-9825315ecf83 req-e289f578-119f-45e3-ab0d-ef5c51b95e72 service nova] [instance: 69109f06-acbf-4834-b05e-80ab6e3f6ea0] Received unexpected event network-vif-plugged-e8b2f9b5-0c3a-4f6f-bf96-566c8a779849 for instance with vm_state active and task_state powering-off.
Nov 29 18:11:57 user nova-compute[74613]: INFO nova.virt.libvirt.driver [-] [instance: 69109f06-acbf-4834-b05e-80ab6e3f6ea0] Instance destroyed successfully.
Nov 29 18:11:57 user nova-compute[74613]: DEBUG nova.compute.manager [None req-e20548b5-522f-4fcb-be14-2fa239a7edf9 tempest-AttachVolumeTestJSON-813984703 tempest-AttachVolumeTestJSON-813984703-project-member] [instance: 69109f06-acbf-4834-b05e-80ab6e3f6ea0] Checking state {{(pid=74613) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 29 18:11:57 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-e20548b5-522f-4fcb-be14-2fa239a7edf9 tempest-AttachVolumeTestJSON-813984703 tempest-AttachVolumeTestJSON-813984703-project-member] Lock "69109f06-acbf-4834-b05e-80ab6e3f6ea0" "released" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: held 0.850s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 18:12:00 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:12:05 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 18:12:10 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 18:12:10 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:12:10 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74613) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 29 18:12:10 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74613) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 18:12:10 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74613) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 18:12:10 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:12:15 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:12:15 user nova-compute[74613]: DEBUG nova.compute.manager [req-db197d88-5531-4c75-8ee9-77359ca10a05 req-cf415c2e-9fc3-4c0b-b9a8-ca8a013c474a service nova] [instance: 9eb14feb-f196-42b1-a6ba-2a049dea2d5e] Received event network-changed-02cedfee-7de8-4112-ad75-277367c11133 {{(pid=74613) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 18:12:15 user nova-compute[74613]: DEBUG nova.compute.manager [req-db197d88-5531-4c75-8ee9-77359ca10a05 req-cf415c2e-9fc3-4c0b-b9a8-ca8a013c474a service nova] [instance: 9eb14feb-f196-42b1-a6ba-2a049dea2d5e] Refreshing instance network info cache due to event network-changed-02cedfee-7de8-4112-ad75-277367c11133. {{(pid=74613) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 18:12:15 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-db197d88-5531-4c75-8ee9-77359ca10a05 req-cf415c2e-9fc3-4c0b-b9a8-ca8a013c474a service nova] Acquiring lock "refresh_cache-9eb14feb-f196-42b1-a6ba-2a049dea2d5e" {{(pid=74613) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 18:12:15 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-db197d88-5531-4c75-8ee9-77359ca10a05 req-cf415c2e-9fc3-4c0b-b9a8-ca8a013c474a service nova] Acquired lock "refresh_cache-9eb14feb-f196-42b1-a6ba-2a049dea2d5e" {{(pid=74613) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 18:12:15 user nova-compute[74613]: DEBUG nova.network.neutron [req-db197d88-5531-4c75-8ee9-77359ca10a05 req-cf415c2e-9fc3-4c0b-b9a8-ca8a013c474a service nova] [instance: 9eb14feb-f196-42b1-a6ba-2a049dea2d5e] Refreshing network info cache for port 02cedfee-7de8-4112-ad75-277367c11133 {{(pid=74613) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 18:12:15 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-e2072278-f7fd-449f-959b-6b894ee08a8c tempest-TestStampPattern-2144166935 tempest-TestStampPattern-2144166935-project-member] Acquiring lock "9eb14feb-f196-42b1-a6ba-2a049dea2d5e" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 18:12:15 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-e2072278-f7fd-449f-959b-6b894ee08a8c tempest-TestStampPattern-2144166935 tempest-TestStampPattern-2144166935-project-member] Lock "9eb14feb-f196-42b1-a6ba-2a049dea2d5e" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 18:12:15 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-e2072278-f7fd-449f-959b-6b894ee08a8c tempest-TestStampPattern-2144166935 tempest-TestStampPattern-2144166935-project-member] Acquiring lock "9eb14feb-f196-42b1-a6ba-2a049dea2d5e-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 18:12:15 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-e2072278-f7fd-449f-959b-6b894ee08a8c tempest-TestStampPattern-2144166935 tempest-TestStampPattern-2144166935-project-member] Lock "9eb14feb-f196-42b1-a6ba-2a049dea2d5e-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 18:12:15 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-e2072278-f7fd-449f-959b-6b894ee08a8c tempest-TestStampPattern-2144166935 tempest-TestStampPattern-2144166935-project-member] Lock "9eb14feb-f196-42b1-a6ba-2a049dea2d5e-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 18:12:15 user nova-compute[74613]: INFO nova.compute.manager [None req-e2072278-f7fd-449f-959b-6b894ee08a8c tempest-TestStampPattern-2144166935 tempest-TestStampPattern-2144166935-project-member] [instance: 9eb14feb-f196-42b1-a6ba-2a049dea2d5e] Terminating instance
Nov 29 18:12:15 user nova-compute[74613]: DEBUG nova.compute.manager [None req-e2072278-f7fd-449f-959b-6b894ee08a8c tempest-TestStampPattern-2144166935 tempest-TestStampPattern-2144166935-project-member] [instance: 9eb14feb-f196-42b1-a6ba-2a049dea2d5e] Start destroying the instance on the hypervisor. {{(pid=74613) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 29 18:12:15 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:12:15 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:12:15 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:12:15 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:12:15 user nova-compute[74613]: DEBUG nova.compute.manager [req-73060626-ced4-4ae8-9e74-9f2d23965085 req-42e75561-037a-4038-8190-1c995c9a9a30 service nova] [instance: 9eb14feb-f196-42b1-a6ba-2a049dea2d5e] Received event network-vif-unplugged-02cedfee-7de8-4112-ad75-277367c11133 {{(pid=74613) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 18:12:15 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-73060626-ced4-4ae8-9e74-9f2d23965085 req-42e75561-037a-4038-8190-1c995c9a9a30 service nova] Acquiring lock "9eb14feb-f196-42b1-a6ba-2a049dea2d5e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 18:12:15 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-73060626-ced4-4ae8-9e74-9f2d23965085 req-42e75561-037a-4038-8190-1c995c9a9a30 service nova] Lock "9eb14feb-f196-42b1-a6ba-2a049dea2d5e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 18:12:15 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-73060626-ced4-4ae8-9e74-9f2d23965085 req-42e75561-037a-4038-8190-1c995c9a9a30 service nova] Lock "9eb14feb-f196-42b1-a6ba-2a049dea2d5e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 18:12:15 user nova-compute[74613]: DEBUG nova.compute.manager [req-73060626-ced4-4ae8-9e74-9f2d23965085 req-42e75561-037a-4038-8190-1c995c9a9a30 service nova] [instance: 9eb14feb-f196-42b1-a6ba-2a049dea2d5e] No waiting events found dispatching network-vif-unplugged-02cedfee-7de8-4112-ad75-277367c11133 {{(pid=74613) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 18:12:15 user nova-compute[74613]: DEBUG nova.compute.manager [req-73060626-ced4-4ae8-9e74-9f2d23965085 req-42e75561-037a-4038-8190-1c995c9a9a30 service nova] [instance: 9eb14feb-f196-42b1-a6ba-2a049dea2d5e] Received event network-vif-unplugged-02cedfee-7de8-4112-ad75-277367c11133 for instance with task_state deleting. {{(pid=74613) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 29 18:12:16 user nova-compute[74613]: DEBUG nova.network.neutron [req-db197d88-5531-4c75-8ee9-77359ca10a05 req-cf415c2e-9fc3-4c0b-b9a8-ca8a013c474a service nova] [instance: 9eb14feb-f196-42b1-a6ba-2a049dea2d5e] Updated VIF entry in instance network info cache for port 02cedfee-7de8-4112-ad75-277367c11133. {{(pid=74613) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 18:12:16 user nova-compute[74613]: DEBUG nova.network.neutron [req-db197d88-5531-4c75-8ee9-77359ca10a05 req-cf415c2e-9fc3-4c0b-b9a8-ca8a013c474a service nova] [instance: 9eb14feb-f196-42b1-a6ba-2a049dea2d5e] Updating instance_info_cache with network_info: [{"id": "02cedfee-7de8-4112-ad75-277367c11133", "address": "fa:16:3e:ba:49:9d", "network": {"id": "fed779df-aeaf-4b57-8336-be4c9d81f0be", "bridge": "br-int", "label": "tempest-TestStampPattern-1699172136-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6004d03e0fbd4684bc8f1d341afad3be", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap02cedfee-7d", "ovs_interfaceid": "02cedfee-7de8-4112-ad75-277367c11133", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74613) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 18:12:16 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-db197d88-5531-4c75-8ee9-77359ca10a05 req-cf415c2e-9fc3-4c0b-b9a8-ca8a013c474a service nova] Releasing lock "refresh_cache-9eb14feb-f196-42b1-a6ba-2a049dea2d5e" {{(pid=74613) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 18:12:16 user nova-compute[74613]: INFO nova.virt.libvirt.driver [-] [instance: 9eb14feb-f196-42b1-a6ba-2a049dea2d5e] Instance destroyed successfully.
Nov 29 18:12:16 user nova-compute[74613]: DEBUG nova.objects.instance [None req-e2072278-f7fd-449f-959b-6b894ee08a8c tempest-TestStampPattern-2144166935 tempest-TestStampPattern-2144166935-project-member] Lazy-loading 'resources' on Instance uuid 9eb14feb-f196-42b1-a6ba-2a049dea2d5e {{(pid=74613) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 18:12:16 user nova-compute[74613]: DEBUG nova.virt.libvirt.vif [None req-e2072278-f7fd-449f-959b-6b894ee08a8c tempest-TestStampPattern-2144166935 tempest-TestStampPattern-2144166935-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T18:05:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestStampPattern-server-1271023988',display_name='tempest-TestStampPattern-server-1271023988',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-1271023988',id=30,image_ref='4217f428-8d9d-4ee1-9614-642d26d90c46',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBImheB4xIUp31my88WBnuldIYYO3ZplSdSxpARgEiu+bFOOTcjhJQqNcRzf7tbnmHy4961l14bqt6VjuQd2lyczJClyEX4yjcCet+qsyyrKz/utm1mx8LqakuBXZxsC2Hg==',key_name='tempest-TestStampPattern-1424901696',keypairs=<?>,launch_index=0,launched_at=2023-11-29T18:05:16Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='6004d03e0fbd4684bc8f1d341afad3be',ramdisk_id='',reservation_id='r-uqpl4ynx',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='4217f428-8d9d-4ee1-9614-642d26d90c46',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestStampPattern-2144166935',owner_user_name='tempest-TestStampPattern-2144166935-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-29T18:08:18Z,user_data=None,user_id='7be3452738104c44bc78152e00fe469d',uuid=9eb14feb-f196-42b1-a6ba-2a049dea2d5e,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "02cedfee-7de8-4112-ad75-277367c11133", "address": "fa:16:3e:ba:49:9d", "network": {"id": "fed779df-aeaf-4b57-8336-be4c9d81f0be", "bridge": "br-int", "label": "tempest-TestStampPattern-1699172136-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.110", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6004d03e0fbd4684bc8f1d341afad3be", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap02cedfee-7d", "ovs_interfaceid": "02cedfee-7de8-4112-ad75-277367c11133", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74613) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 29 18:12:16 user nova-compute[74613]: DEBUG nova.network.os_vif_util [None req-e2072278-f7fd-449f-959b-6b894ee08a8c tempest-TestStampPattern-2144166935 tempest-TestStampPattern-2144166935-project-member] Converting VIF {"id": "02cedfee-7de8-4112-ad75-277367c11133", "address": "fa:16:3e:ba:49:9d", "network": {"id": "fed779df-aeaf-4b57-8336-be4c9d81f0be", "bridge": "br-int", "label": "tempest-TestStampPattern-1699172136-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.110", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6004d03e0fbd4684bc8f1d341afad3be", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap02cedfee-7d", "ovs_interfaceid": "02cedfee-7de8-4112-ad75-277367c11133", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74613) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 18:12:16 user nova-compute[74613]: DEBUG nova.network.os_vif_util [None req-e2072278-f7fd-449f-959b-6b894ee08a8c tempest-TestStampPattern-2144166935 tempest-TestStampPattern-2144166935-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:ba:49:9d,bridge_name='br-int',has_traffic_filtering=True,id=02cedfee-7de8-4112-ad75-277367c11133,network=Network(fed779df-aeaf-4b57-8336-be4c9d81f0be),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap02cedfee-7d') {{(pid=74613) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 18:12:16 user nova-compute[74613]: DEBUG os_vif [None req-e2072278-f7fd-449f-959b-6b894ee08a8c tempest-TestStampPattern-2144166935 tempest-TestStampPattern-2144166935-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:ba:49:9d,bridge_name='br-int',has_traffic_filtering=True,id=02cedfee-7de8-4112-ad75-277367c11133,network=Network(fed779df-aeaf-4b57-8336-be4c9d81f0be),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap02cedfee-7d') {{(pid=74613) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 29 18:12:16 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:12:16 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap02cedfee-7d, bridge=br-int, if_exists=True) {{(pid=74613) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 18:12:16 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:12:16 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 18:12:16 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:12:16 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:12:16 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=e93c4231-6533-4027-b408-cf78b9a2cf45) {{(pid=74613) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 18:12:16 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:12:16 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 18:12:16 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:12:16 user nova-compute[74613]: INFO os_vif [None req-e2072278-f7fd-449f-959b-6b894ee08a8c tempest-TestStampPattern-2144166935 tempest-TestStampPattern-2144166935-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:ba:49:9d,bridge_name='br-int',has_traffic_filtering=True,id=02cedfee-7de8-4112-ad75-277367c11133,network=Network(fed779df-aeaf-4b57-8336-be4c9d81f0be),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap02cedfee-7d')
Nov 29 18:12:16 user nova-compute[74613]: INFO nova.virt.libvirt.driver [None req-e2072278-f7fd-449f-959b-6b894ee08a8c tempest-TestStampPattern-2144166935 tempest-TestStampPattern-2144166935-project-member] [instance: 9eb14feb-f196-42b1-a6ba-2a049dea2d5e] Deleting instance files /opt/stack/data/nova/instances/9eb14feb-f196-42b1-a6ba-2a049dea2d5e_del
Nov 29 18:12:16 user nova-compute[74613]: INFO nova.virt.libvirt.driver [None req-e2072278-f7fd-449f-959b-6b894ee08a8c tempest-TestStampPattern-2144166935 tempest-TestStampPattern-2144166935-project-member] [instance: 9eb14feb-f196-42b1-a6ba-2a049dea2d5e] Deletion of /opt/stack/data/nova/instances/9eb14feb-f196-42b1-a6ba-2a049dea2d5e_del complete
Nov 29 18:12:16 user nova-compute[74613]: INFO nova.compute.manager [None req-e2072278-f7fd-449f-959b-6b894ee08a8c tempest-TestStampPattern-2144166935 tempest-TestStampPattern-2144166935-project-member] [instance: 9eb14feb-f196-42b1-a6ba-2a049dea2d5e] Took 0.88 seconds to destroy the instance on the hypervisor.
Nov 29 18:12:16 user nova-compute[74613]: DEBUG oslo.service.loopingcall [None req-e2072278-f7fd-449f-959b-6b894ee08a8c tempest-TestStampPattern-2144166935 tempest-TestStampPattern-2144166935-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74613) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 29 18:12:16 user nova-compute[74613]: DEBUG nova.compute.manager [-] [instance: 9eb14feb-f196-42b1-a6ba-2a049dea2d5e] Deallocating network for instance {{(pid=74613) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 29 18:12:16 user nova-compute[74613]: DEBUG nova.network.neutron [-] [instance: 9eb14feb-f196-42b1-a6ba-2a049dea2d5e] deallocate_for_instance() {{(pid=74613) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 29 18:12:16 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:12:16 user nova-compute[74613]: DEBUG nova.network.neutron [-] [instance: 9eb14feb-f196-42b1-a6ba-2a049dea2d5e] Updating instance_info_cache with network_info: [] {{(pid=74613) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 18:12:16 user nova-compute[74613]: INFO nova.compute.manager [-] [instance: 9eb14feb-f196-42b1-a6ba-2a049dea2d5e] Took 0.51 seconds to deallocate network for instance.
Nov 29 18:12:16 user nova-compute[74613]: DEBUG nova.compute.manager [req-722b7d98-0c28-4c8a-b2be-29ed0c707b48 req-12e8766d-44da-4e88-b735-dba1bbc5fb39 service nova] [instance: 9eb14feb-f196-42b1-a6ba-2a049dea2d5e] Received event network-vif-deleted-02cedfee-7de8-4112-ad75-277367c11133 {{(pid=74613) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 18:12:17 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-e2072278-f7fd-449f-959b-6b894ee08a8c tempest-TestStampPattern-2144166935 tempest-TestStampPattern-2144166935-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 18:12:17 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-e2072278-f7fd-449f-959b-6b894ee08a8c tempest-TestStampPattern-2144166935 tempest-TestStampPattern-2144166935-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 18:12:17 user nova-compute[74613]: DEBUG nova.compute.provider_tree [None req-e2072278-f7fd-449f-959b-6b894ee08a8c tempest-TestStampPattern-2144166935 tempest-TestStampPattern-2144166935-project-member] Inventory has not changed in ProviderTree for provider: 639d980e-3b12-44b1-b8f4-1812416fa4dd {{(pid=74613) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 18:12:17 user nova-compute[74613]: DEBUG nova.scheduler.client.report [None req-e2072278-f7fd-449f-959b-6b894ee08a8c tempest-TestStampPattern-2144166935 tempest-TestStampPattern-2144166935-project-member] Inventory has not changed for provider 639d980e-3b12-44b1-b8f4-1812416fa4dd based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74613) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 18:12:17 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-e2072278-f7fd-449f-959b-6b894ee08a8c tempest-TestStampPattern-2144166935 tempest-TestStampPattern-2144166935-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.207s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 18:12:17 user nova-compute[74613]: INFO nova.scheduler.client.report [None req-e2072278-f7fd-449f-959b-6b894ee08a8c tempest-TestStampPattern-2144166935 tempest-TestStampPattern-2144166935-project-member] Deleted allocations for instance 9eb14feb-f196-42b1-a6ba-2a049dea2d5e
Nov 29 18:12:17 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-e2072278-f7fd-449f-959b-6b894ee08a8c tempest-TestStampPattern-2144166935 tempest-TestStampPattern-2144166935-project-member] Lock "9eb14feb-f196-42b1-a6ba-2a049dea2d5e" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.856s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 18:12:17 user nova-compute[74613]: DEBUG nova.compute.manager [req-7553d22a-f0df-4c29-b8d8-579214e0d671 req-91a56d8e-ebc6-4069-b417-f644bb050c37 service nova] [instance: 9eb14feb-f196-42b1-a6ba-2a049dea2d5e] Received event network-vif-plugged-02cedfee-7de8-4112-ad75-277367c11133 {{(pid=74613) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 18:12:17 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-7553d22a-f0df-4c29-b8d8-579214e0d671 req-91a56d8e-ebc6-4069-b417-f644bb050c37 service nova] Acquiring lock "9eb14feb-f196-42b1-a6ba-2a049dea2d5e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 18:12:17 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-7553d22a-f0df-4c29-b8d8-579214e0d671 req-91a56d8e-ebc6-4069-b417-f644bb050c37 service nova] Lock "9eb14feb-f196-42b1-a6ba-2a049dea2d5e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 18:12:17 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-7553d22a-f0df-4c29-b8d8-579214e0d671 req-91a56d8e-ebc6-4069-b417-f644bb050c37 service nova] Lock "9eb14feb-f196-42b1-a6ba-2a049dea2d5e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 18:12:17 user nova-compute[74613]: DEBUG nova.compute.manager [req-7553d22a-f0df-4c29-b8d8-579214e0d671 req-91a56d8e-ebc6-4069-b417-f644bb050c37 service nova] [instance: 9eb14feb-f196-42b1-a6ba-2a049dea2d5e] No waiting events found dispatching network-vif-plugged-02cedfee-7de8-4112-ad75-277367c11133 {{(pid=74613) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 18:12:17 user nova-compute[74613]: WARNING nova.compute.manager [req-7553d22a-f0df-4c29-b8d8-579214e0d671 req-91a56d8e-ebc6-4069-b417-f644bb050c37 service nova] [instance: 9eb14feb-f196-42b1-a6ba-2a049dea2d5e] Received unexpected event network-vif-plugged-02cedfee-7de8-4112-ad75-277367c11133 for instance with vm_state deleted and task_state None.
Nov 29 18:12:20 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-e9886a5c-6123-4c41-be01-997014f477d5 tempest-AttachVolumeNegativeTest-483083654 tempest-AttachVolumeNegativeTest-483083654-project-member] Acquiring lock "fa144332-bad7-4373-94d9-018f41f50ee4" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 18:12:20 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-e9886a5c-6123-4c41-be01-997014f477d5 tempest-AttachVolumeNegativeTest-483083654 tempest-AttachVolumeNegativeTest-483083654-project-member] Lock "fa144332-bad7-4373-94d9-018f41f50ee4" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 18:12:20 user nova-compute[74613]: DEBUG nova.compute.manager [None req-e9886a5c-6123-4c41-be01-997014f477d5 tempest-AttachVolumeNegativeTest-483083654 tempest-AttachVolumeNegativeTest-483083654-project-member] [instance: fa144332-bad7-4373-94d9-018f41f50ee4] Starting instance... {{(pid=74613) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 29 18:12:20 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-e9886a5c-6123-4c41-be01-997014f477d5 tempest-AttachVolumeNegativeTest-483083654 tempest-AttachVolumeNegativeTest-483083654-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 18:12:20 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-e9886a5c-6123-4c41-be01-997014f477d5 tempest-AttachVolumeNegativeTest-483083654 tempest-AttachVolumeNegativeTest-483083654-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 18:12:20 user nova-compute[74613]: DEBUG nova.virt.hardware [None req-e9886a5c-6123-4c41-be01-997014f477d5 tempest-AttachVolumeNegativeTest-483083654 tempest-AttachVolumeNegativeTest-483083654-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74613) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 29 18:12:20 user nova-compute[74613]: INFO nova.compute.claims [None req-e9886a5c-6123-4c41-be01-997014f477d5 tempest-AttachVolumeNegativeTest-483083654 tempest-AttachVolumeNegativeTest-483083654-project-member] [instance: fa144332-bad7-4373-94d9-018f41f50ee4] Claim successful on node user
Nov 29 18:12:20 user nova-compute[74613]: DEBUG nova.compute.provider_tree [None req-e9886a5c-6123-4c41-be01-997014f477d5 tempest-AttachVolumeNegativeTest-483083654 tempest-AttachVolumeNegativeTest-483083654-project-member] Inventory has not changed in ProviderTree for provider: 639d980e-3b12-44b1-b8f4-1812416fa4dd {{(pid=74613) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 18:12:20 user nova-compute[74613]: DEBUG nova.scheduler.client.report [None req-e9886a5c-6123-4c41-be01-997014f477d5 tempest-AttachVolumeNegativeTest-483083654 tempest-AttachVolumeNegativeTest-483083654-project-member] Inventory has not changed for provider 639d980e-3b12-44b1-b8f4-1812416fa4dd based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74613) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 18:12:20 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-e9886a5c-6123-4c41-be01-997014f477d5 tempest-AttachVolumeNegativeTest-483083654 tempest-AttachVolumeNegativeTest-483083654-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.275s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 18:12:20 user nova-compute[74613]: DEBUG nova.compute.manager [None req-e9886a5c-6123-4c41-be01-997014f477d5 tempest-AttachVolumeNegativeTest-483083654 tempest-AttachVolumeNegativeTest-483083654-project-member] [instance: fa144332-bad7-4373-94d9-018f41f50ee4] Start building networks asynchronously for instance. {{(pid=74613) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 29 18:12:20 user nova-compute[74613]: DEBUG nova.compute.manager [None req-e9886a5c-6123-4c41-be01-997014f477d5 tempest-AttachVolumeNegativeTest-483083654 tempest-AttachVolumeNegativeTest-483083654-project-member] [instance: fa144332-bad7-4373-94d9-018f41f50ee4] Allocating IP information in the background. {{(pid=74613) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 29 18:12:20 user nova-compute[74613]: DEBUG nova.network.neutron [None req-e9886a5c-6123-4c41-be01-997014f477d5 tempest-AttachVolumeNegativeTest-483083654 tempest-AttachVolumeNegativeTest-483083654-project-member] [instance: fa144332-bad7-4373-94d9-018f41f50ee4] allocate_for_instance() {{(pid=74613) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 29 18:12:20 user nova-compute[74613]: INFO nova.virt.libvirt.driver [None req-e9886a5c-6123-4c41-be01-997014f477d5 tempest-AttachVolumeNegativeTest-483083654 tempest-AttachVolumeNegativeTest-483083654-project-member] [instance: fa144332-bad7-4373-94d9-018f41f50ee4] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 29 18:12:20 user nova-compute[74613]: DEBUG nova.compute.manager [None req-e9886a5c-6123-4c41-be01-997014f477d5 tempest-AttachVolumeNegativeTest-483083654 tempest-AttachVolumeNegativeTest-483083654-project-member] [instance: fa144332-bad7-4373-94d9-018f41f50ee4] Start building block device mappings for instance. {{(pid=74613) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 29 18:12:20 user nova-compute[74613]: DEBUG nova.policy [None req-e9886a5c-6123-4c41-be01-997014f477d5 tempest-AttachVolumeNegativeTest-483083654 tempest-AttachVolumeNegativeTest-483083654-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '57b1f3743f0e4cbdae1dab9e4761511e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37b89c13ba1d4a94805d6af69ad26fb8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74613) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 29 18:12:20 user nova-compute[74613]: DEBUG nova.compute.manager [None req-e9886a5c-6123-4c41-be01-997014f477d5 tempest-AttachVolumeNegativeTest-483083654 tempest-AttachVolumeNegativeTest-483083654-project-member] [instance: fa144332-bad7-4373-94d9-018f41f50ee4] Start spawning the instance on the hypervisor. {{(pid=74613) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 29 18:12:20 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-e9886a5c-6123-4c41-be01-997014f477d5 tempest-AttachVolumeNegativeTest-483083654 tempest-AttachVolumeNegativeTest-483083654-project-member] [instance: fa144332-bad7-4373-94d9-018f41f50ee4] Creating instance directory {{(pid=74613) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 29 18:12:20 user nova-compute[74613]: INFO nova.virt.libvirt.driver [None req-e9886a5c-6123-4c41-be01-997014f477d5 tempest-AttachVolumeNegativeTest-483083654 tempest-AttachVolumeNegativeTest-483083654-project-member] [instance: fa144332-bad7-4373-94d9-018f41f50ee4] Creating image(s)
Nov 29 18:12:20 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-e9886a5c-6123-4c41-be01-997014f477d5 tempest-AttachVolumeNegativeTest-483083654 tempest-AttachVolumeNegativeTest-483083654-project-member] Acquiring lock "/opt/stack/data/nova/instances/fa144332-bad7-4373-94d9-018f41f50ee4/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 18:12:20 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-e9886a5c-6123-4c41-be01-997014f477d5 tempest-AttachVolumeNegativeTest-483083654 tempest-AttachVolumeNegativeTest-483083654-project-member] Lock "/opt/stack/data/nova/instances/fa144332-bad7-4373-94d9-018f41f50ee4/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 18:12:20 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-e9886a5c-6123-4c41-be01-997014f477d5 tempest-AttachVolumeNegativeTest-483083654 tempest-AttachVolumeNegativeTest-483083654-project-member] Lock "/opt/stack/data/nova/instances/fa144332-bad7-4373-94d9-018f41f50ee4/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 18:12:20 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-e9886a5c-6123-4c41-be01-997014f477d5 tempest-AttachVolumeNegativeTest-483083654 tempest-AttachVolumeNegativeTest-483083654-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/21faea9e6951f3bdd0153b76ac89fe1a60a34758 --force-share --output=json {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:12:20 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-e9886a5c-6123-4c41-be01-997014f477d5 tempest-AttachVolumeNegativeTest-483083654 tempest-AttachVolumeNegativeTest-483083654-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/21faea9e6951f3bdd0153b76ac89fe1a60a34758 --force-share --output=json" returned: 0 in 0.182s {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:12:20 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-e9886a5c-6123-4c41-be01-997014f477d5 tempest-AttachVolumeNegativeTest-483083654 tempest-AttachVolumeNegativeTest-483083654-project-member] Acquiring lock "21faea9e6951f3bdd0153b76ac89fe1a60a34758" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 18:12:20 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-e9886a5c-6123-4c41-be01-997014f477d5 tempest-AttachVolumeNegativeTest-483083654 tempest-AttachVolumeNegativeTest-483083654-project-member] Lock "21faea9e6951f3bdd0153b76ac89fe1a60a34758" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 18:12:20 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-e9886a5c-6123-4c41-be01-997014f477d5 tempest-AttachVolumeNegativeTest-483083654 tempest-AttachVolumeNegativeTest-483083654-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/21faea9e6951f3bdd0153b76ac89fe1a60a34758 --force-share --output=json {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:12:21 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-e9886a5c-6123-4c41-be01-997014f477d5 tempest-AttachVolumeNegativeTest-483083654 tempest-AttachVolumeNegativeTest-483083654-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/21faea9e6951f3bdd0153b76ac89fe1a60a34758 --force-share --output=json" returned: 0 in 0.176s {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:12:21 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-e9886a5c-6123-4c41-be01-997014f477d5 tempest-AttachVolumeNegativeTest-483083654 tempest-AttachVolumeNegativeTest-483083654-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/21faea9e6951f3bdd0153b76ac89fe1a60a34758,backing_fmt=raw /opt/stack/data/nova/instances/fa144332-bad7-4373-94d9-018f41f50ee4/disk 1073741824 {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:12:21 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-e9886a5c-6123-4c41-be01-997014f477d5 tempest-AttachVolumeNegativeTest-483083654 tempest-AttachVolumeNegativeTest-483083654-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/21faea9e6951f3bdd0153b76ac89fe1a60a34758,backing_fmt=raw /opt/stack/data/nova/instances/fa144332-bad7-4373-94d9-018f41f50ee4/disk 1073741824" returned: 0 in 0.054s {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:12:21 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-e9886a5c-6123-4c41-be01-997014f477d5 tempest-AttachVolumeNegativeTest-483083654 tempest-AttachVolumeNegativeTest-483083654-project-member] Lock "21faea9e6951f3bdd0153b76ac89fe1a60a34758" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.237s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 18:12:21 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-e9886a5c-6123-4c41-be01-997014f477d5 tempest-AttachVolumeNegativeTest-483083654 tempest-AttachVolumeNegativeTest-483083654-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/21faea9e6951f3bdd0153b76ac89fe1a60a34758 --force-share --output=json {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:12:21 user nova-compute[74613]: DEBUG nova.network.neutron [None req-e9886a5c-6123-4c41-be01-997014f477d5 tempest-AttachVolumeNegativeTest-483083654 tempest-AttachVolumeNegativeTest-483083654-project-member] [instance: fa144332-bad7-4373-94d9-018f41f50ee4] Successfully created port: d2cb059e-f41b-41a5-b4a5-aef2d663eeb2 {{(pid=74613) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 29 18:12:21 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-e9886a5c-6123-4c41-be01-997014f477d5 tempest-AttachVolumeNegativeTest-483083654 tempest-AttachVolumeNegativeTest-483083654-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/21faea9e6951f3bdd0153b76ac89fe1a60a34758 --force-share --output=json" returned: 0 in 0.191s {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:12:21 user nova-compute[74613]: DEBUG nova.virt.disk.api [None req-e9886a5c-6123-4c41-be01-997014f477d5 tempest-AttachVolumeNegativeTest-483083654 tempest-AttachVolumeNegativeTest-483083654-project-member] Checking if we can resize image /opt/stack/data/nova/instances/fa144332-bad7-4373-94d9-018f41f50ee4/disk. size=1073741824 {{(pid=74613) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 29 18:12:21 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-e9886a5c-6123-4c41-be01-997014f477d5 tempest-AttachVolumeNegativeTest-483083654 tempest-AttachVolumeNegativeTest-483083654-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fa144332-bad7-4373-94d9-018f41f50ee4/disk --force-share --output=json {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:12:21 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:12:21 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-e9886a5c-6123-4c41-be01-997014f477d5 tempest-AttachVolumeNegativeTest-483083654 tempest-AttachVolumeNegativeTest-483083654-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fa144332-bad7-4373-94d9-018f41f50ee4/disk --force-share --output=json" returned: 0 in 0.223s {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:12:21 user nova-compute[74613]: DEBUG nova.virt.disk.api [None req-e9886a5c-6123-4c41-be01-997014f477d5 tempest-AttachVolumeNegativeTest-483083654 tempest-AttachVolumeNegativeTest-483083654-project-member] Cannot resize image /opt/stack/data/nova/instances/fa144332-bad7-4373-94d9-018f41f50ee4/disk to a smaller size. {{(pid=74613) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 29 18:12:21 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-e9886a5c-6123-4c41-be01-997014f477d5 tempest-AttachVolumeNegativeTest-483083654 tempest-AttachVolumeNegativeTest-483083654-project-member] [instance: fa144332-bad7-4373-94d9-018f41f50ee4] Created local disks {{(pid=74613) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 29 18:12:21 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-e9886a5c-6123-4c41-be01-997014f477d5 tempest-AttachVolumeNegativeTest-483083654 tempest-AttachVolumeNegativeTest-483083654-project-member] [instance: fa144332-bad7-4373-94d9-018f41f50ee4] Ensure instance console log exists: /opt/stack/data/nova/instances/fa144332-bad7-4373-94d9-018f41f50ee4/console.log {{(pid=74613) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 29 18:12:21 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-e9886a5c-6123-4c41-be01-997014f477d5 tempest-AttachVolumeNegativeTest-483083654 tempest-AttachVolumeNegativeTest-483083654-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 18:12:21 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-e9886a5c-6123-4c41-be01-997014f477d5 tempest-AttachVolumeNegativeTest-483083654 tempest-AttachVolumeNegativeTest-483083654-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 18:12:21 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-e9886a5c-6123-4c41-be01-997014f477d5 tempest-AttachVolumeNegativeTest-483083654 tempest-AttachVolumeNegativeTest-483083654-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 18:12:21 user nova-compute[74613]: DEBUG nova.network.neutron [None req-e9886a5c-6123-4c41-be01-997014f477d5 tempest-AttachVolumeNegativeTest-483083654 tempest-AttachVolumeNegativeTest-483083654-project-member] [instance: fa144332-bad7-4373-94d9-018f41f50ee4] Successfully updated port: d2cb059e-f41b-41a5-b4a5-aef2d663eeb2 {{(pid=74613) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 29 18:12:21 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-e9886a5c-6123-4c41-be01-997014f477d5 tempest-AttachVolumeNegativeTest-483083654 tempest-AttachVolumeNegativeTest-483083654-project-member] Acquiring lock "refresh_cache-fa144332-bad7-4373-94d9-018f41f50ee4" {{(pid=74613) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 18:12:21 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-e9886a5c-6123-4c41-be01-997014f477d5 tempest-AttachVolumeNegativeTest-483083654 tempest-AttachVolumeNegativeTest-483083654-project-member] Acquired lock "refresh_cache-fa144332-bad7-4373-94d9-018f41f50ee4" {{(pid=74613) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 18:12:21 user nova-compute[74613]: DEBUG nova.network.neutron [None req-e9886a5c-6123-4c41-be01-997014f477d5 tempest-AttachVolumeNegativeTest-483083654 tempest-AttachVolumeNegativeTest-483083654-project-member] [instance: fa144332-bad7-4373-94d9-018f41f50ee4] Building network info cache for instance {{(pid=74613) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 29 18:12:21 user nova-compute[74613]: DEBUG nova.compute.manager [req-56c1d756-edfa-4eac-988b-47bac3ba2025 req-3bd3c2b6-4f7f-481a-b2cb-be85b7a8ce7e service nova] [instance: fa144332-bad7-4373-94d9-018f41f50ee4] Received event network-changed-d2cb059e-f41b-41a5-b4a5-aef2d663eeb2 {{(pid=74613) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 18:12:21 user nova-compute[74613]: DEBUG nova.compute.manager [req-56c1d756-edfa-4eac-988b-47bac3ba2025 req-3bd3c2b6-4f7f-481a-b2cb-be85b7a8ce7e service nova] [instance: fa144332-bad7-4373-94d9-018f41f50ee4] Refreshing instance network info cache due to event network-changed-d2cb059e-f41b-41a5-b4a5-aef2d663eeb2. {{(pid=74613) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 18:12:21 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-56c1d756-edfa-4eac-988b-47bac3ba2025 req-3bd3c2b6-4f7f-481a-b2cb-be85b7a8ce7e service nova] Acquiring lock "refresh_cache-fa144332-bad7-4373-94d9-018f41f50ee4" {{(pid=74613) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 18:12:22 user nova-compute[74613]: DEBUG nova.network.neutron [None req-e9886a5c-6123-4c41-be01-997014f477d5 tempest-AttachVolumeNegativeTest-483083654 tempest-AttachVolumeNegativeTest-483083654-project-member] [instance: fa144332-bad7-4373-94d9-018f41f50ee4] Instance cache missing network info. {{(pid=74613) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 29 18:12:22 user nova-compute[74613]: DEBUG nova.network.neutron [None req-e9886a5c-6123-4c41-be01-997014f477d5 tempest-AttachVolumeNegativeTest-483083654 tempest-AttachVolumeNegativeTest-483083654-project-member] [instance: fa144332-bad7-4373-94d9-018f41f50ee4] Updating instance_info_cache with network_info: [{"id": "d2cb059e-f41b-41a5-b4a5-aef2d663eeb2", "address": "fa:16:3e:bc:1d:c9", "network": {"id": "c317481b-f8cf-40a0-a326-836a5ea4c495", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-887666255-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "37b89c13ba1d4a94805d6af69ad26fb8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd2cb059e-f4", "ovs_interfaceid": "d2cb059e-f41b-41a5-b4a5-aef2d663eeb2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74613) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 18:12:22 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-e9886a5c-6123-4c41-be01-997014f477d5 tempest-AttachVolumeNegativeTest-483083654 tempest-AttachVolumeNegativeTest-483083654-project-member] Releasing lock "refresh_cache-fa144332-bad7-4373-94d9-018f41f50ee4" {{(pid=74613) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 18:12:22 user nova-compute[74613]: DEBUG nova.compute.manager [None req-e9886a5c-6123-4c41-be01-997014f477d5 tempest-AttachVolumeNegativeTest-483083654 tempest-AttachVolumeNegativeTest-483083654-project-member] [instance: fa144332-bad7-4373-94d9-018f41f50ee4] Instance network_info: |[{"id": "d2cb059e-f41b-41a5-b4a5-aef2d663eeb2", "address": "fa:16:3e:bc:1d:c9", "network": {"id": "c317481b-f8cf-40a0-a326-836a5ea4c495", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-887666255-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "37b89c13ba1d4a94805d6af69ad26fb8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd2cb059e-f4", "ovs_interfaceid": "d2cb059e-f41b-41a5-b4a5-aef2d663eeb2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74613) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 29 18:12:22 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-56c1d756-edfa-4eac-988b-47bac3ba2025 req-3bd3c2b6-4f7f-481a-b2cb-be85b7a8ce7e service nova] Acquired lock "refresh_cache-fa144332-bad7-4373-94d9-018f41f50ee4" {{(pid=74613) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 18:12:22 user nova-compute[74613]: DEBUG nova.network.neutron [req-56c1d756-edfa-4eac-988b-47bac3ba2025 req-3bd3c2b6-4f7f-481a-b2cb-be85b7a8ce7e service nova] [instance: fa144332-bad7-4373-94d9-018f41f50ee4] Refreshing network info cache for port d2cb059e-f41b-41a5-b4a5-aef2d663eeb2 {{(pid=74613) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 18:12:22 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-e9886a5c-6123-4c41-be01-997014f477d5 tempest-AttachVolumeNegativeTest-483083654 tempest-AttachVolumeNegativeTest-483083654-project-member] [instance: fa144332-bad7-4373-94d9-018f41f50ee4] Start _get_guest_xml network_info=[{"id": "d2cb059e-f41b-41a5-b4a5-aef2d663eeb2", "address": "fa:16:3e:bc:1d:c9", "network": {"id": "c317481b-f8cf-40a0-a326-836a5ea4c495", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-887666255-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "37b89c13ba1d4a94805d6af69ad26fb8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd2cb059e-f4", "ovs_interfaceid": "d2cb059e-f41b-41a5-b4a5-aef2d663eeb2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-29T17:47:38Z,direct_url=<?>,disk_format='qcow2',id=4217f428-8d9d-4ee1-9614-642d26d90c46,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='794b07cbd46a44b5865cfda741036bae',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-29T17:47:40Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'size': 0, 'device_type': 'disk', 'boot_index': 0, 'guest_format': None, 'encrypted': False, 'encryption_format': None, 'disk_bus': 'virtio', 'image_id': '4217f428-8d9d-4ee1-9614-642d26d90c46'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74613) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 29 18:12:22 user nova-compute[74613]: WARNING nova.virt.libvirt.driver [None req-e9886a5c-6123-4c41-be01-997014f477d5 tempest-AttachVolumeNegativeTest-483083654 tempest-AttachVolumeNegativeTest-483083654-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 18:12:22 user nova-compute[74613]: WARNING nova.virt.libvirt.driver [None req-e9886a5c-6123-4c41-be01-997014f477d5 tempest-AttachVolumeNegativeTest-483083654 tempest-AttachVolumeNegativeTest-483083654-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 18:12:22 user nova-compute[74613]: DEBUG nova.virt.libvirt.host [None req-e9886a5c-6123-4c41-be01-997014f477d5 tempest-AttachVolumeNegativeTest-483083654 tempest-AttachVolumeNegativeTest-483083654-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74613) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 29 18:12:22 user nova-compute[74613]: DEBUG nova.virt.libvirt.host [None req-e9886a5c-6123-4c41-be01-997014f477d5 tempest-AttachVolumeNegativeTest-483083654 tempest-AttachVolumeNegativeTest-483083654-project-member] CPU controller missing on host. {{(pid=74613) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 29 18:12:22 user nova-compute[74613]: DEBUG nova.virt.libvirt.host [None req-e9886a5c-6123-4c41-be01-997014f477d5 tempest-AttachVolumeNegativeTest-483083654 tempest-AttachVolumeNegativeTest-483083654-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74613) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 29 18:12:22 user nova-compute[74613]: DEBUG nova.virt.libvirt.host [None req-e9886a5c-6123-4c41-be01-997014f477d5 tempest-AttachVolumeNegativeTest-483083654 tempest-AttachVolumeNegativeTest-483083654-project-member] CPU controller found on host. {{(pid=74613) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 29 18:12:22 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-e9886a5c-6123-4c41-be01-997014f477d5 tempest-AttachVolumeNegativeTest-483083654 tempest-AttachVolumeNegativeTest-483083654-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74613) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 29 18:12:22 user nova-compute[74613]: DEBUG nova.virt.hardware [None req-e9886a5c-6123-4c41-be01-997014f477d5 tempest-AttachVolumeNegativeTest-483083654 tempest-AttachVolumeNegativeTest-483083654-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-29T17:47:27Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-29T17:47:38Z,direct_url=<?>,disk_format='qcow2',id=4217f428-8d9d-4ee1-9614-642d26d90c46,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='794b07cbd46a44b5865cfda741036bae',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-29T17:47:40Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74613) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 29 18:12:22 user nova-compute[74613]: DEBUG nova.virt.hardware [None req-e9886a5c-6123-4c41-be01-997014f477d5 tempest-AttachVolumeNegativeTest-483083654 tempest-AttachVolumeNegativeTest-483083654-project-member] Flavor limits 0:0:0 {{(pid=74613) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 29 18:12:22 user nova-compute[74613]: DEBUG nova.virt.hardware [None req-e9886a5c-6123-4c41-be01-997014f477d5 tempest-AttachVolumeNegativeTest-483083654 tempest-AttachVolumeNegativeTest-483083654-project-member] Image limits 0:0:0 {{(pid=74613) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 29 18:12:22 user nova-compute[74613]: DEBUG nova.virt.hardware [None req-e9886a5c-6123-4c41-be01-997014f477d5 tempest-AttachVolumeNegativeTest-483083654 tempest-AttachVolumeNegativeTest-483083654-project-member] Flavor pref 0:0:0 {{(pid=74613) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 29 18:12:22 user nova-compute[74613]: DEBUG nova.virt.hardware [None req-e9886a5c-6123-4c41-be01-997014f477d5 tempest-AttachVolumeNegativeTest-483083654 tempest-AttachVolumeNegativeTest-483083654-project-member] Image pref 0:0:0 {{(pid=74613) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 29 18:12:22 user nova-compute[74613]: DEBUG nova.virt.hardware [None req-e9886a5c-6123-4c41-be01-997014f477d5 tempest-AttachVolumeNegativeTest-483083654 tempest-AttachVolumeNegativeTest-483083654-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74613) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 29 18:12:22 user nova-compute[74613]: DEBUG nova.virt.hardware [None req-e9886a5c-6123-4c41-be01-997014f477d5 tempest-AttachVolumeNegativeTest-483083654 tempest-AttachVolumeNegativeTest-483083654-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74613) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 29 18:12:22 user nova-compute[74613]: DEBUG nova.virt.hardware [None req-e9886a5c-6123-4c41-be01-997014f477d5 tempest-AttachVolumeNegativeTest-483083654 tempest-AttachVolumeNegativeTest-483083654-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74613) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 29 18:12:22 user nova-compute[74613]: DEBUG nova.virt.hardware [None req-e9886a5c-6123-4c41-be01-997014f477d5 tempest-AttachVolumeNegativeTest-483083654 tempest-AttachVolumeNegativeTest-483083654-project-member] Got 1 possible topologies {{(pid=74613) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 29 18:12:22 user nova-compute[74613]: DEBUG nova.virt.hardware [None req-e9886a5c-6123-4c41-be01-997014f477d5 tempest-AttachVolumeNegativeTest-483083654 tempest-AttachVolumeNegativeTest-483083654-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74613) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 29 18:12:22 user nova-compute[74613]: DEBUG nova.virt.hardware [None req-e9886a5c-6123-4c41-be01-997014f477d5 tempest-AttachVolumeNegativeTest-483083654 tempest-AttachVolumeNegativeTest-483083654-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74613) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 29 18:12:22 user nova-compute[74613]: DEBUG nova.virt.libvirt.vif [None req-e9886a5c-6123-4c41-be01-997014f477d5 tempest-AttachVolumeNegativeTest-483083654 tempest-AttachVolumeNegativeTest-483083654-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T18:12:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-410376697',display_name='tempest-AttachVolumeNegativeTest-server-410376697',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-410376697',id=36,image_ref='4217f428-8d9d-4ee1-9614-642d26d90c46',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBH2f5iCFa3W9SeqcZ+bT2Iw3FxywKrKvZxDegdHcmyUY1YMiAAKE8PJ+M7qDvpk5KlzOJjvchmP5p27/jrd9Zah6ar7CkTxzMJXdnzg6pTs0XOzB0OIi4fjJk5Uy+JU3FQ==',key_name='tempest-keypair-1923808935',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='37b89c13ba1d4a94805d6af69ad26fb8',ramdisk_id='',reservation_id='r-hg1b7qhh',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='4217f428-8d9d-4ee1-9614-642d26d90c46',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-483083654',owner_user_name='tempest-AttachVolumeNegativeTest-483083654-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T18:12:21Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='57b1f3743f0e4cbdae1dab9e4761511e',uuid=fa144332-bad7-4373-94d9-018f41f50ee4,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d2cb059e-f41b-41a5-b4a5-aef2d663eeb2", "address": "fa:16:3e:bc:1d:c9", "network": {"id": "c317481b-f8cf-40a0-a326-836a5ea4c495", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-887666255-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "37b89c13ba1d4a94805d6af69ad26fb8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd2cb059e-f4", "ovs_interfaceid": "d2cb059e-f41b-41a5-b4a5-aef2d663eeb2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74613) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 29 18:12:22 user nova-compute[74613]: DEBUG nova.network.os_vif_util [None req-e9886a5c-6123-4c41-be01-997014f477d5 tempest-AttachVolumeNegativeTest-483083654 tempest-AttachVolumeNegativeTest-483083654-project-member] Converting VIF {"id": "d2cb059e-f41b-41a5-b4a5-aef2d663eeb2", "address": "fa:16:3e:bc:1d:c9", "network": {"id": "c317481b-f8cf-40a0-a326-836a5ea4c495", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-887666255-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "37b89c13ba1d4a94805d6af69ad26fb8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd2cb059e-f4", "ovs_interfaceid": "d2cb059e-f41b-41a5-b4a5-aef2d663eeb2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74613) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 18:12:22 user nova-compute[74613]: DEBUG nova.network.os_vif_util [None req-e9886a5c-6123-4c41-be01-997014f477d5 tempest-AttachVolumeNegativeTest-483083654 tempest-AttachVolumeNegativeTest-483083654-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:bc:1d:c9,bridge_name='br-int',has_traffic_filtering=True,id=d2cb059e-f41b-41a5-b4a5-aef2d663eeb2,network=Network(c317481b-f8cf-40a0-a326-836a5ea4c495),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd2cb059e-f4') {{(pid=74613) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 18:12:22 user nova-compute[74613]: DEBUG nova.objects.instance [None req-e9886a5c-6123-4c41-be01-997014f477d5 tempest-AttachVolumeNegativeTest-483083654 tempest-AttachVolumeNegativeTest-483083654-project-member] Lazy-loading 'pci_devices' on Instance uuid fa144332-bad7-4373-94d9-018f41f50ee4 {{(pid=74613) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 18:12:22 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-e9886a5c-6123-4c41-be01-997014f477d5 tempest-AttachVolumeNegativeTest-483083654 tempest-AttachVolumeNegativeTest-483083654-project-member] [instance: fa144332-bad7-4373-94d9-018f41f50ee4] End _get_guest_xml xml=<domain type="kvm">
Nov 29 18:12:22 user nova-compute[74613]:   <uuid>fa144332-bad7-4373-94d9-018f41f50ee4</uuid>
Nov 29 18:12:22 user nova-compute[74613]:   <name>instance-00000024</name>
Nov 29 18:12:22 user nova-compute[74613]:   <memory>524288</memory>
Nov 29 18:12:22 user nova-compute[74613]:   <vcpu>1</vcpu>
Nov 29 18:12:22 user nova-compute[74613]:   <metadata>
Nov 29 18:12:22 user nova-compute[74613]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 29 18:12:22 user nova-compute[74613]:       <nova:package version="0.0.0"/>
Nov 29 18:12:22 user nova-compute[74613]:       <nova:name>tempest-AttachVolumeNegativeTest-server-410376697</nova:name>
Nov 29 18:12:22 user nova-compute[74613]:       <nova:creationTime>2023-11-29 18:12:22</nova:creationTime>
Nov 29 18:12:22 user nova-compute[74613]:       <nova:flavor name="m1.tiny">
Nov 29 18:12:22 user nova-compute[74613]:         <nova:memory>512</nova:memory>
Nov 29 18:12:22 user nova-compute[74613]:         <nova:disk>1</nova:disk>
Nov 29 18:12:22 user nova-compute[74613]:         <nova:swap>0</nova:swap>
Nov 29 18:12:22 user nova-compute[74613]:         <nova:ephemeral>0</nova:ephemeral>
Nov 29 18:12:22 user nova-compute[74613]:         <nova:vcpus>1</nova:vcpus>
Nov 29 18:12:22 user nova-compute[74613]:       </nova:flavor>
Nov 29 18:12:22 user nova-compute[74613]:       <nova:owner>
Nov 29 18:12:22 user nova-compute[74613]:         <nova:user uuid="57b1f3743f0e4cbdae1dab9e4761511e">tempest-AttachVolumeNegativeTest-483083654-project-member</nova:user>
Nov 29 18:12:22 user nova-compute[74613]:         <nova:project uuid="37b89c13ba1d4a94805d6af69ad26fb8">tempest-AttachVolumeNegativeTest-483083654</nova:project>
Nov 29 18:12:22 user nova-compute[74613]:       </nova:owner>
Nov 29 18:12:22 user nova-compute[74613]:       <nova:root type="image" uuid="4217f428-8d9d-4ee1-9614-642d26d90c46"/>
Nov 29 18:12:22 user nova-compute[74613]:       <nova:ports>
Nov 29 18:12:22 user nova-compute[74613]:         <nova:port uuid="d2cb059e-f41b-41a5-b4a5-aef2d663eeb2">
Nov 29 18:12:22 user nova-compute[74613]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Nov 29 18:12:22 user nova-compute[74613]:         </nova:port>
Nov 29 18:12:22 user nova-compute[74613]:       </nova:ports>
Nov 29 18:12:22 user nova-compute[74613]:     </nova:instance>
Nov 29 18:12:22 user nova-compute[74613]:   </metadata>
Nov 29 18:12:22 user nova-compute[74613]:   <sysinfo type="smbios">
Nov 29 18:12:22 user nova-compute[74613]:     <system>
Nov 29 18:12:22 user nova-compute[74613]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 29 18:12:22 user nova-compute[74613]:       <entry name="product">OpenStack Nova</entry>
Nov 29 18:12:22 user nova-compute[74613]:       <entry name="version">0.0.0</entry>
Nov 29 18:12:22 user nova-compute[74613]:       <entry name="serial">fa144332-bad7-4373-94d9-018f41f50ee4</entry>
Nov 29 18:12:22 user nova-compute[74613]:       <entry name="uuid">fa144332-bad7-4373-94d9-018f41f50ee4</entry>
Nov 29 18:12:22 user nova-compute[74613]:       <entry name="family">Virtual Machine</entry>
Nov 29 18:12:22 user nova-compute[74613]:     </system>
Nov 29 18:12:22 user nova-compute[74613]:   </sysinfo>
Nov 29 18:12:22 user nova-compute[74613]:   <os>
Nov 29 18:12:22 user nova-compute[74613]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 29 18:12:22 user nova-compute[74613]:     <boot dev="hd"/>
Nov 29 18:12:22 user nova-compute[74613]:     <smbios mode="sysinfo"/>
Nov 29 18:12:22 user nova-compute[74613]:   </os>
Nov 29 18:12:22 user nova-compute[74613]:   <features>
Nov 29 18:12:22 user nova-compute[74613]:     <acpi/>
Nov 29 18:12:22 user nova-compute[74613]:     <apic/>
Nov 29 18:12:22 user nova-compute[74613]:     <vmcoreinfo/>
Nov 29 18:12:22 user nova-compute[74613]:   </features>
Nov 29 18:12:22 user nova-compute[74613]:   <clock offset="utc">
Nov 29 18:12:22 user nova-compute[74613]:     <timer name="pit" tickpolicy="delay"/>
Nov 29 18:12:22 user nova-compute[74613]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 29 18:12:22 user nova-compute[74613]:     <timer name="hpet" present="no"/>
Nov 29 18:12:22 user nova-compute[74613]:   </clock>
Nov 29 18:12:22 user nova-compute[74613]:   <cpu mode="custom" match="exact">
Nov 29 18:12:22 user nova-compute[74613]:     <model>Nehalem</model>
Nov 29 18:12:22 user nova-compute[74613]:     <topology sockets="1" cores="1" threads="1"/>
Nov 29 18:12:22 user nova-compute[74613]:   </cpu>
Nov 29 18:12:22 user nova-compute[74613]:   <devices>
Nov 29 18:12:22 user nova-compute[74613]:     <disk type="file" device="disk">
Nov 29 18:12:22 user nova-compute[74613]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 29 18:12:22 user nova-compute[74613]:       <source file="/opt/stack/data/nova/instances/fa144332-bad7-4373-94d9-018f41f50ee4/disk"/>
Nov 29 18:12:22 user nova-compute[74613]:       <target dev="vda" bus="virtio"/>
Nov 29 18:12:22 user nova-compute[74613]:     </disk>
Nov 29 18:12:22 user nova-compute[74613]:     <interface type="ethernet">
Nov 29 18:12:22 user nova-compute[74613]:       <mac address="fa:16:3e:bc:1d:c9"/>
Nov 29 18:12:22 user nova-compute[74613]:       <model type="virtio"/>
Nov 29 18:12:22 user nova-compute[74613]:       <mtu size="1442"/>
Nov 29 18:12:22 user nova-compute[74613]:       <target dev="tapd2cb059e-f4"/>
Nov 29 18:12:22 user nova-compute[74613]:     </interface>
Nov 29 18:12:22 user nova-compute[74613]:     <serial type="pty">
Nov 29 18:12:22 user nova-compute[74613]:       <log file="/opt/stack/data/nova/instances/fa144332-bad7-4373-94d9-018f41f50ee4/console.log" append="off"/>
Nov 29 18:12:22 user nova-compute[74613]:     </serial>
Nov 29 18:12:22 user nova-compute[74613]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 29 18:12:22 user nova-compute[74613]:     <video>
Nov 29 18:12:22 user nova-compute[74613]:       <model type="virtio"/>
Nov 29 18:12:22 user nova-compute[74613]:     </video>
Nov 29 18:12:22 user nova-compute[74613]:     <rng model="virtio">
Nov 29 18:12:22 user nova-compute[74613]:       <backend model="random">/dev/urandom</backend>
Nov 29 18:12:22 user nova-compute[74613]:     </rng>
Nov 29 18:12:22 user nova-compute[74613]:     <controller type="usb" index="0" model="none"/>
Nov 29 18:12:22 user nova-compute[74613]:     <memballoon model="virtio">
Nov 29 18:12:22 user nova-compute[74613]:       <stats period="10"/>
Nov 29 18:12:22 user nova-compute[74613]:     </memballoon>
Nov 29 18:12:22 user nova-compute[74613]:   </devices>
Nov 29 18:12:22 user nova-compute[74613]: </domain>
Nov 29 18:12:22 user nova-compute[74613]:  {{(pid=74613) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 29 18:12:22 user nova-compute[74613]: DEBUG nova.virt.libvirt.vif [None req-e9886a5c-6123-4c41-be01-997014f477d5 tempest-AttachVolumeNegativeTest-483083654 tempest-AttachVolumeNegativeTest-483083654-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T18:12:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-410376697',display_name='tempest-AttachVolumeNegativeTest-server-410376697',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-410376697',id=36,image_ref='4217f428-8d9d-4ee1-9614-642d26d90c46',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBH2f5iCFa3W9SeqcZ+bT2Iw3FxywKrKvZxDegdHcmyUY1YMiAAKE8PJ+M7qDvpk5KlzOJjvchmP5p27/jrd9Zah6ar7CkTxzMJXdnzg6pTs0XOzB0OIi4fjJk5Uy+JU3FQ==',key_name='tempest-keypair-1923808935',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='37b89c13ba1d4a94805d6af69ad26fb8',ramdisk_id='',reservation_id='r-hg1b7qhh',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='4217f428-8d9d-4ee1-9614-642d26d90c46',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-483083654',owner_user_name='tempest-AttachVolumeNegativeTest-483083654-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T18:12:21Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='57b1f3743f0e4cbdae1dab9e4761511e',uuid=fa144332-bad7-4373-94d9-018f41f50ee4,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d2cb059e-f41b-41a5-b4a5-aef2d663eeb2", "address": "fa:16:3e:bc:1d:c9", "network": {"id": "c317481b-f8cf-40a0-a326-836a5ea4c495", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-887666255-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "37b89c13ba1d4a94805d6af69ad26fb8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd2cb059e-f4", "ovs_interfaceid": "d2cb059e-f41b-41a5-b4a5-aef2d663eeb2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74613) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 29 18:12:22 user nova-compute[74613]: DEBUG nova.network.os_vif_util [None req-e9886a5c-6123-4c41-be01-997014f477d5 tempest-AttachVolumeNegativeTest-483083654 tempest-AttachVolumeNegativeTest-483083654-project-member] Converting VIF {"id": "d2cb059e-f41b-41a5-b4a5-aef2d663eeb2", "address": "fa:16:3e:bc:1d:c9", "network": {"id": "c317481b-f8cf-40a0-a326-836a5ea4c495", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-887666255-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "37b89c13ba1d4a94805d6af69ad26fb8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd2cb059e-f4", "ovs_interfaceid": "d2cb059e-f41b-41a5-b4a5-aef2d663eeb2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74613) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 18:12:22 user nova-compute[74613]: DEBUG nova.network.os_vif_util [None req-e9886a5c-6123-4c41-be01-997014f477d5 tempest-AttachVolumeNegativeTest-483083654 tempest-AttachVolumeNegativeTest-483083654-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:bc:1d:c9,bridge_name='br-int',has_traffic_filtering=True,id=d2cb059e-f41b-41a5-b4a5-aef2d663eeb2,network=Network(c317481b-f8cf-40a0-a326-836a5ea4c495),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd2cb059e-f4') {{(pid=74613) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 18:12:22 user nova-compute[74613]: DEBUG os_vif [None req-e9886a5c-6123-4c41-be01-997014f477d5 tempest-AttachVolumeNegativeTest-483083654 tempest-AttachVolumeNegativeTest-483083654-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:bc:1d:c9,bridge_name='br-int',has_traffic_filtering=True,id=d2cb059e-f41b-41a5-b4a5-aef2d663eeb2,network=Network(c317481b-f8cf-40a0-a326-836a5ea4c495),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd2cb059e-f4') {{(pid=74613) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 29 18:12:22 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:12:22 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74613) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 18:12:22 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74613) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 29 18:12:22 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:12:22 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '70d64941-b3b2-5a08-bc43-6a400df28803', '_type': 'linux-noop'}}, row=False) {{(pid=74613) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 18:12:22 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:12:22 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 18:12:22 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:12:22 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:12:22 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapd2cb059e-f4, may_exist=True, interface_attrs={}) {{(pid=74613) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 18:12:22 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapd2cb059e-f4, col_values=(('qos', UUID('9397c604-3241-4bff-be58-5b3bd2a853b1')),), if_exists=True) {{(pid=74613) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 18:12:22 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapd2cb059e-f4, col_values=(('external_ids', {'iface-id': 'd2cb059e-f41b-41a5-b4a5-aef2d663eeb2', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:bc:1d:c9', 'vm-uuid': 'fa144332-bad7-4373-94d9-018f41f50ee4'}),), if_exists=True) {{(pid=74613) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 18:12:22 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:12:22 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 18:12:22 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:12:22 user nova-compute[74613]: INFO os_vif [None req-e9886a5c-6123-4c41-be01-997014f477d5 tempest-AttachVolumeNegativeTest-483083654 tempest-AttachVolumeNegativeTest-483083654-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:bc:1d:c9,bridge_name='br-int',has_traffic_filtering=True,id=d2cb059e-f41b-41a5-b4a5-aef2d663eeb2,network=Network(c317481b-f8cf-40a0-a326-836a5ea4c495),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd2cb059e-f4')
Nov 29 18:12:22 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-e9886a5c-6123-4c41-be01-997014f477d5 tempest-AttachVolumeNegativeTest-483083654 tempest-AttachVolumeNegativeTest-483083654-project-member] No BDM found with device name vda, not building metadata. {{(pid=74613) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 18:12:22 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-e9886a5c-6123-4c41-be01-997014f477d5 tempest-AttachVolumeNegativeTest-483083654 tempest-AttachVolumeNegativeTest-483083654-project-member] No VIF found with MAC fa:16:3e:bc:1d:c9, not building metadata {{(pid=74613) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 29 18:12:22 user nova-compute[74613]: DEBUG nova.network.neutron [req-56c1d756-edfa-4eac-988b-47bac3ba2025 req-3bd3c2b6-4f7f-481a-b2cb-be85b7a8ce7e service nova] [instance: fa144332-bad7-4373-94d9-018f41f50ee4] Updated VIF entry in instance network info cache for port d2cb059e-f41b-41a5-b4a5-aef2d663eeb2. {{(pid=74613) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 18:12:22 user nova-compute[74613]: DEBUG nova.network.neutron [req-56c1d756-edfa-4eac-988b-47bac3ba2025 req-3bd3c2b6-4f7f-481a-b2cb-be85b7a8ce7e service nova] [instance: fa144332-bad7-4373-94d9-018f41f50ee4] Updating instance_info_cache with network_info: [{"id": "d2cb059e-f41b-41a5-b4a5-aef2d663eeb2", "address": "fa:16:3e:bc:1d:c9", "network": {"id": "c317481b-f8cf-40a0-a326-836a5ea4c495", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-887666255-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "37b89c13ba1d4a94805d6af69ad26fb8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd2cb059e-f4", "ovs_interfaceid": "d2cb059e-f41b-41a5-b4a5-aef2d663eeb2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74613) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 18:12:22 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-56c1d756-edfa-4eac-988b-47bac3ba2025 req-3bd3c2b6-4f7f-481a-b2cb-be85b7a8ce7e service nova] Releasing lock "refresh_cache-fa144332-bad7-4373-94d9-018f41f50ee4" {{(pid=74613) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 18:12:23 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:12:23 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:12:23 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:12:23 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:12:24 user nova-compute[74613]: DEBUG nova.compute.manager [req-94faa195-520f-4b29-9a4f-7ed9708e5265 req-b711e20b-93fb-4cf2-bb9b-3736535d7cd4 service nova] [instance: fa144332-bad7-4373-94d9-018f41f50ee4] Received event network-vif-plugged-d2cb059e-f41b-41a5-b4a5-aef2d663eeb2 {{(pid=74613) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 18:12:24 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-94faa195-520f-4b29-9a4f-7ed9708e5265 req-b711e20b-93fb-4cf2-bb9b-3736535d7cd4 service nova] Acquiring lock "fa144332-bad7-4373-94d9-018f41f50ee4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 18:12:24 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-94faa195-520f-4b29-9a4f-7ed9708e5265 req-b711e20b-93fb-4cf2-bb9b-3736535d7cd4 service nova] Lock "fa144332-bad7-4373-94d9-018f41f50ee4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 18:12:24 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-94faa195-520f-4b29-9a4f-7ed9708e5265 req-b711e20b-93fb-4cf2-bb9b-3736535d7cd4 service nova] Lock "fa144332-bad7-4373-94d9-018f41f50ee4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 18:12:24 user nova-compute[74613]: DEBUG nova.compute.manager [req-94faa195-520f-4b29-9a4f-7ed9708e5265 req-b711e20b-93fb-4cf2-bb9b-3736535d7cd4 service nova] [instance: fa144332-bad7-4373-94d9-018f41f50ee4] No waiting events found dispatching network-vif-plugged-d2cb059e-f41b-41a5-b4a5-aef2d663eeb2 {{(pid=74613) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 18:12:24 user nova-compute[74613]: WARNING nova.compute.manager [req-94faa195-520f-4b29-9a4f-7ed9708e5265 req-b711e20b-93fb-4cf2-bb9b-3736535d7cd4 service nova] [instance: fa144332-bad7-4373-94d9-018f41f50ee4] Received unexpected event network-vif-plugged-d2cb059e-f41b-41a5-b4a5-aef2d663eeb2 for instance with vm_state building and task_state spawning.
Nov 29 18:12:24 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:12:24 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:12:24 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:12:24 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:12:25 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:12:26 user nova-compute[74613]: DEBUG nova.compute.manager [None req-e9886a5c-6123-4c41-be01-997014f477d5 tempest-AttachVolumeNegativeTest-483083654 tempest-AttachVolumeNegativeTest-483083654-project-member] [instance: fa144332-bad7-4373-94d9-018f41f50ee4] Instance event wait completed in 0 seconds for  {{(pid=74613) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 29 18:12:26 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-e9886a5c-6123-4c41-be01-997014f477d5 tempest-AttachVolumeNegativeTest-483083654 tempest-AttachVolumeNegativeTest-483083654-project-member] [instance: fa144332-bad7-4373-94d9-018f41f50ee4] Guest created on hypervisor {{(pid=74613) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 29 18:12:26 user nova-compute[74613]: INFO nova.virt.libvirt.driver [-] [instance: fa144332-bad7-4373-94d9-018f41f50ee4] Instance spawned successfully.
Nov 29 18:12:26 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-e9886a5c-6123-4c41-be01-997014f477d5 tempest-AttachVolumeNegativeTest-483083654 tempest-AttachVolumeNegativeTest-483083654-project-member] [instance: fa144332-bad7-4373-94d9-018f41f50ee4] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74613) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 29 18:12:26 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-e9886a5c-6123-4c41-be01-997014f477d5 tempest-AttachVolumeNegativeTest-483083654 tempest-AttachVolumeNegativeTest-483083654-project-member] [instance: fa144332-bad7-4373-94d9-018f41f50ee4] Found default for hw_cdrom_bus of ide {{(pid=74613) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 18:12:26 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-e9886a5c-6123-4c41-be01-997014f477d5 tempest-AttachVolumeNegativeTest-483083654 tempest-AttachVolumeNegativeTest-483083654-project-member] [instance: fa144332-bad7-4373-94d9-018f41f50ee4] Found default for hw_disk_bus of virtio {{(pid=74613) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 18:12:26 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-e9886a5c-6123-4c41-be01-997014f477d5 tempest-AttachVolumeNegativeTest-483083654 tempest-AttachVolumeNegativeTest-483083654-project-member] [instance: fa144332-bad7-4373-94d9-018f41f50ee4] Found default for hw_input_bus of None {{(pid=74613) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 18:12:26 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-e9886a5c-6123-4c41-be01-997014f477d5 tempest-AttachVolumeNegativeTest-483083654 tempest-AttachVolumeNegativeTest-483083654-project-member] [instance: fa144332-bad7-4373-94d9-018f41f50ee4] Found default for hw_pointer_model of None {{(pid=74613) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 18:12:26 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-e9886a5c-6123-4c41-be01-997014f477d5 tempest-AttachVolumeNegativeTest-483083654 tempest-AttachVolumeNegativeTest-483083654-project-member] [instance: fa144332-bad7-4373-94d9-018f41f50ee4] Found default for hw_video_model of virtio {{(pid=74613) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 18:12:26 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-e9886a5c-6123-4c41-be01-997014f477d5 tempest-AttachVolumeNegativeTest-483083654 tempest-AttachVolumeNegativeTest-483083654-project-member] [instance: fa144332-bad7-4373-94d9-018f41f50ee4] Found default for hw_vif_model of virtio {{(pid=74613) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 18:12:26 user nova-compute[74613]: INFO nova.compute.manager [None req-e9886a5c-6123-4c41-be01-997014f477d5 tempest-AttachVolumeNegativeTest-483083654 tempest-AttachVolumeNegativeTest-483083654-project-member] [instance: fa144332-bad7-4373-94d9-018f41f50ee4] Took 5.52 seconds to spawn the instance on the hypervisor.
Nov 29 18:12:26 user nova-compute[74613]: DEBUG nova.compute.manager [None req-e9886a5c-6123-4c41-be01-997014f477d5 tempest-AttachVolumeNegativeTest-483083654 tempest-AttachVolumeNegativeTest-483083654-project-member] [instance: fa144332-bad7-4373-94d9-018f41f50ee4] Checking state {{(pid=74613) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 29 18:12:26 user nova-compute[74613]: INFO nova.compute.manager [None req-e9886a5c-6123-4c41-be01-997014f477d5 tempest-AttachVolumeNegativeTest-483083654 tempest-AttachVolumeNegativeTest-483083654-project-member] [instance: fa144332-bad7-4373-94d9-018f41f50ee4] Took 6.18 seconds to build instance.
Nov 29 18:12:26 user nova-compute[74613]: DEBUG nova.compute.manager [req-01936691-1837-4797-aa1f-5bc32fbda8bf req-620a217e-fa21-428b-a437-3e8722787a7c service nova] [instance: fa144332-bad7-4373-94d9-018f41f50ee4] Received event network-vif-plugged-d2cb059e-f41b-41a5-b4a5-aef2d663eeb2 {{(pid=74613) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 18:12:26 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-01936691-1837-4797-aa1f-5bc32fbda8bf req-620a217e-fa21-428b-a437-3e8722787a7c service nova] Acquiring lock "fa144332-bad7-4373-94d9-018f41f50ee4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 18:12:26 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-01936691-1837-4797-aa1f-5bc32fbda8bf req-620a217e-fa21-428b-a437-3e8722787a7c service nova] Lock "fa144332-bad7-4373-94d9-018f41f50ee4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 18:12:26 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-01936691-1837-4797-aa1f-5bc32fbda8bf req-620a217e-fa21-428b-a437-3e8722787a7c service nova] Lock "fa144332-bad7-4373-94d9-018f41f50ee4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 18:12:26 user nova-compute[74613]: DEBUG nova.compute.manager [req-01936691-1837-4797-aa1f-5bc32fbda8bf req-620a217e-fa21-428b-a437-3e8722787a7c service nova] [instance: fa144332-bad7-4373-94d9-018f41f50ee4] No waiting events found dispatching network-vif-plugged-d2cb059e-f41b-41a5-b4a5-aef2d663eeb2 {{(pid=74613) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 18:12:26 user nova-compute[74613]: WARNING nova.compute.manager [req-01936691-1837-4797-aa1f-5bc32fbda8bf req-620a217e-fa21-428b-a437-3e8722787a7c service nova] [instance: fa144332-bad7-4373-94d9-018f41f50ee4] Received unexpected event network-vif-plugged-d2cb059e-f41b-41a5-b4a5-aef2d663eeb2 for instance with vm_state active and task_state None.
Nov 29 18:12:26 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-e9886a5c-6123-4c41-be01-997014f477d5 tempest-AttachVolumeNegativeTest-483083654 tempest-AttachVolumeNegativeTest-483083654-project-member] Lock "fa144332-bad7-4373-94d9-018f41f50ee4" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.295s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 18:12:27 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:12:30 user nova-compute[74613]: DEBUG oslo_service.periodic_task [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74613) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 18:12:30 user nova-compute[74613]: DEBUG oslo_service.periodic_task [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74613) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 18:12:30 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 18:12:30 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 18:12:30 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 18:12:30 user nova-compute[74613]: DEBUG nova.compute.resource_tracker [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Auditing locally available compute resources for user (node: user) {{(pid=74613) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 29 18:12:30 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/69109f06-acbf-4834-b05e-80ab6e3f6ea0/disk --force-share --output=json {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:12:30 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:12:30 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/69109f06-acbf-4834-b05e-80ab6e3f6ea0/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:12:30 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/69109f06-acbf-4834-b05e-80ab6e3f6ea0/disk --force-share --output=json {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:12:31 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/69109f06-acbf-4834-b05e-80ab6e3f6ea0/disk --force-share --output=json" returned: 0 in 0.216s {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:12:31 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f4a1329-b3b9-4d1c-8735-abddabc359fd/disk.rescue --force-share --output=json {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:12:31 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f4a1329-b3b9-4d1c-8735-abddabc359fd/disk.rescue --force-share --output=json" returned: 0 in 0.183s {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:12:31 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f4a1329-b3b9-4d1c-8735-abddabc359fd/disk.rescue --force-share --output=json {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:12:31 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f4a1329-b3b9-4d1c-8735-abddabc359fd/disk.rescue --force-share --output=json" returned: 0 in 0.184s {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:12:31 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f4a1329-b3b9-4d1c-8735-abddabc359fd/disk --force-share --output=json {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:12:31 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f4a1329-b3b9-4d1c-8735-abddabc359fd/disk --force-share --output=json" returned: 0 in 0.204s {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:12:31 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f4a1329-b3b9-4d1c-8735-abddabc359fd/disk --force-share --output=json {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:12:31 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f4a1329-b3b9-4d1c-8735-abddabc359fd/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:12:31 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fa144332-bad7-4373-94d9-018f41f50ee4/disk --force-share --output=json {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:12:32 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fa144332-bad7-4373-94d9-018f41f50ee4/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:12:32 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fa144332-bad7-4373-94d9-018f41f50ee4/disk --force-share --output=json {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:12:32 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fa144332-bad7-4373-94d9-018f41f50ee4/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:12:32 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6993e2e7-7e03-45b4-9d3d-3742589b6078/disk --force-share --output=json {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:12:32 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:12:32 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6993e2e7-7e03-45b4-9d3d-3742589b6078/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:12:32 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6993e2e7-7e03-45b4-9d3d-3742589b6078/disk --force-share --output=json {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:12:32 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6993e2e7-7e03-45b4-9d3d-3742589b6078/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:12:33 user nova-compute[74613]: WARNING nova.virt.libvirt.driver [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 18:12:33 user nova-compute[74613]: WARNING nova.virt.libvirt.driver [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 18:12:33 user nova-compute[74613]: DEBUG nova.compute.resource_tracker [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Hypervisor/Node resource view: name=user free_ram=8629MB free_disk=24.967361450195312GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74613) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 29 18:12:33 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 18:12:33 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 18:12:33 user nova-compute[74613]: DEBUG nova.compute.resource_tracker [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Instance 6993e2e7-7e03-45b4-9d3d-3742589b6078 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74613) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 18:12:33 user nova-compute[74613]: DEBUG nova.compute.resource_tracker [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Instance 6f4a1329-b3b9-4d1c-8735-abddabc359fd actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74613) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 18:12:33 user nova-compute[74613]: DEBUG nova.compute.resource_tracker [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Instance 69109f06-acbf-4834-b05e-80ab6e3f6ea0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74613) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 18:12:33 user nova-compute[74613]: DEBUG nova.compute.resource_tracker [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Instance fa144332-bad7-4373-94d9-018f41f50ee4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74613) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 18:12:33 user nova-compute[74613]: DEBUG nova.compute.resource_tracker [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Total usable vcpus: 12, total allocated vcpus: 4 {{(pid=74613) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 29 18:12:33 user nova-compute[74613]: DEBUG nova.compute.resource_tracker [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Final resource view: name=user phys_ram=16011MB used_ram=2560MB phys_disk=40GB used_disk=4GB total_vcpus=12 used_vcpus=4 pci_stats=[] {{(pid=74613) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 29 18:12:33 user nova-compute[74613]: DEBUG nova.scheduler.client.report [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Refreshing inventories for resource provider 639d980e-3b12-44b1-b8f4-1812416fa4dd {{(pid=74613) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 29 18:12:33 user nova-compute[74613]: DEBUG nova.scheduler.client.report [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Updating ProviderTree inventory for provider 639d980e-3b12-44b1-b8f4-1812416fa4dd from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74613) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 29 18:12:33 user nova-compute[74613]: DEBUG nova.compute.provider_tree [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Updating inventory in ProviderTree for provider 639d980e-3b12-44b1-b8f4-1812416fa4dd with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74613) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 29 18:12:33 user nova-compute[74613]: DEBUG nova.scheduler.client.report [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Refreshing aggregate associations for resource provider 639d980e-3b12-44b1-b8f4-1812416fa4dd, aggregates: None {{(pid=74613) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 29 18:12:33 user nova-compute[74613]: DEBUG nova.scheduler.client.report [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Refreshing trait associations for resource provider 639d980e-3b12-44b1-b8f4-1812416fa4dd, traits: HW_CPU_X86_SSE,COMPUTE_VOLUME_EXTEND,COMPUTE_ACCELERATORS,HW_CPU_X86_SSE41,COMPUTE_STORAGE_BUS_IDE,COMPUTE_NODE,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,HW_CPU_X86_MMX,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,HW_CPU_X86_SSE2,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_STORAGE_BUS_USB,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_STORAGE_BUS_SATA,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_DEVICE_TAGGING,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_RESCUE_BFV,HW_CPU_X86_SSSE3,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_TRUSTED_CERTS,HW_CPU_X86_SSE42,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_STORAGE_BUS_FDC {{(pid=74613) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 29 18:12:33 user nova-compute[74613]: DEBUG nova.compute.provider_tree [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Inventory has not changed in ProviderTree for provider: 639d980e-3b12-44b1-b8f4-1812416fa4dd {{(pid=74613) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 18:12:33 user nova-compute[74613]: DEBUG nova.scheduler.client.report [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Inventory has not changed for provider 639d980e-3b12-44b1-b8f4-1812416fa4dd based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74613) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 18:12:33 user nova-compute[74613]: DEBUG nova.compute.resource_tracker [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Compute_service record updated for user:user {{(pid=74613) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 29 18:12:33 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.632s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 18:12:36 user nova-compute[74613]: DEBUG oslo_service.periodic_task [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74613) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 18:12:36 user nova-compute[74613]: DEBUG nova.compute.manager [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Starting heal instance info cache {{(pid=74613) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 29 18:12:36 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Acquiring lock "refresh_cache-6f4a1329-b3b9-4d1c-8735-abddabc359fd" {{(pid=74613) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 18:12:36 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Acquired lock "refresh_cache-6f4a1329-b3b9-4d1c-8735-abddabc359fd" {{(pid=74613) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 18:12:36 user nova-compute[74613]: DEBUG nova.network.neutron [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] [instance: 6f4a1329-b3b9-4d1c-8735-abddabc359fd] Forcefully refreshing network info cache for instance {{(pid=74613) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 29 18:12:37 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 18:12:37 user nova-compute[74613]: DEBUG nova.network.neutron [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] [instance: 6f4a1329-b3b9-4d1c-8735-abddabc359fd] Updating instance_info_cache with network_info: [{"id": "6d82a9a2-81f2-4d4b-846e-178413db6ecf", "address": "fa:16:3e:53:4e:1d", "network": {"id": "db79433c-b21c-4058-b98c-f62822abbf7a", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1715530752-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e6a3eb6ea0294f9da705dca72ec2789a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6d82a9a2-81", "ovs_interfaceid": "6d82a9a2-81f2-4d4b-846e-178413db6ecf", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74613) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 18:12:37 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Releasing lock "refresh_cache-6f4a1329-b3b9-4d1c-8735-abddabc359fd" {{(pid=74613) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 18:12:37 user nova-compute[74613]: DEBUG nova.compute.manager [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] [instance: 6f4a1329-b3b9-4d1c-8735-abddabc359fd] Updated the network info_cache for instance {{(pid=74613) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 29 18:12:37 user nova-compute[74613]: DEBUG oslo_service.periodic_task [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74613) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 18:12:37 user nova-compute[74613]: DEBUG oslo_service.periodic_task [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74613) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 18:12:37 user nova-compute[74613]: DEBUG oslo_service.periodic_task [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74613) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 18:12:37 user nova-compute[74613]: DEBUG oslo_service.periodic_task [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74613) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 18:12:37 user nova-compute[74613]: DEBUG oslo_service.periodic_task [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74613) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 18:12:37 user nova-compute[74613]: DEBUG nova.compute.manager [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74613) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 29 18:12:37 user nova-compute[74613]: DEBUG oslo_service.periodic_task [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=74613) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 18:12:37 user nova-compute[74613]: DEBUG nova.compute.manager [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Cleaning up deleted instances with incomplete migration  {{(pid=74613) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 29 18:12:38 user nova-compute[74613]: DEBUG oslo_service.periodic_task [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74613) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 18:12:39 user nova-compute[74613]: DEBUG oslo_service.periodic_task [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=74613) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 18:12:39 user nova-compute[74613]: DEBUG nova.compute.manager [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Cleaning up deleted instances {{(pid=74613) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 29 18:12:39 user nova-compute[74613]: DEBUG nova.compute.manager [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] There are 0 instances to clean {{(pid=74613) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 29 18:12:39 user nova-compute[74613]: DEBUG oslo_service.periodic_task [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=74613) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 18:12:40 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:12:42 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:12:45 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:12:47 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:12:48 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:12:50 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:12:52 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:12:55 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:12:57 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-bfd5f1ae-676f-465c-ab4b-6add21a385ea tempest-ServerRescueNegativeTestJSON-1891426908 tempest-ServerRescueNegativeTestJSON-1891426908-project-member] Acquiring lock "1f2b4426-815f-4ef4-b98e-e5124fec93b7" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 18:12:57 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-bfd5f1ae-676f-465c-ab4b-6add21a385ea tempest-ServerRescueNegativeTestJSON-1891426908 tempest-ServerRescueNegativeTestJSON-1891426908-project-member] Lock "1f2b4426-815f-4ef4-b98e-e5124fec93b7" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 18:12:57 user nova-compute[74613]: DEBUG nova.compute.manager [None req-bfd5f1ae-676f-465c-ab4b-6add21a385ea tempest-ServerRescueNegativeTestJSON-1891426908 tempest-ServerRescueNegativeTestJSON-1891426908-project-member] [instance: 1f2b4426-815f-4ef4-b98e-e5124fec93b7] Starting instance... {{(pid=74613) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 29 18:12:57 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-bfd5f1ae-676f-465c-ab4b-6add21a385ea tempest-ServerRescueNegativeTestJSON-1891426908 tempest-ServerRescueNegativeTestJSON-1891426908-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 18:12:57 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-bfd5f1ae-676f-465c-ab4b-6add21a385ea tempest-ServerRescueNegativeTestJSON-1891426908 tempest-ServerRescueNegativeTestJSON-1891426908-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 18:12:57 user nova-compute[74613]: DEBUG nova.virt.hardware [None req-bfd5f1ae-676f-465c-ab4b-6add21a385ea tempest-ServerRescueNegativeTestJSON-1891426908 tempest-ServerRescueNegativeTestJSON-1891426908-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74613) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 29 18:12:57 user nova-compute[74613]: INFO nova.compute.claims [None req-bfd5f1ae-676f-465c-ab4b-6add21a385ea tempest-ServerRescueNegativeTestJSON-1891426908 tempest-ServerRescueNegativeTestJSON-1891426908-project-member] [instance: 1f2b4426-815f-4ef4-b98e-e5124fec93b7] Claim successful on node user
Nov 29 18:12:57 user nova-compute[74613]: DEBUG nova.compute.provider_tree [None req-bfd5f1ae-676f-465c-ab4b-6add21a385ea tempest-ServerRescueNegativeTestJSON-1891426908 tempest-ServerRescueNegativeTestJSON-1891426908-project-member] Inventory has not changed in ProviderTree for provider: 639d980e-3b12-44b1-b8f4-1812416fa4dd {{(pid=74613) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 18:12:57 user nova-compute[74613]: DEBUG nova.scheduler.client.report [None req-bfd5f1ae-676f-465c-ab4b-6add21a385ea tempest-ServerRescueNegativeTestJSON-1891426908 tempest-ServerRescueNegativeTestJSON-1891426908-project-member] Inventory has not changed for provider 639d980e-3b12-44b1-b8f4-1812416fa4dd based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74613) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 18:12:57 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-bfd5f1ae-676f-465c-ab4b-6add21a385ea tempest-ServerRescueNegativeTestJSON-1891426908 tempest-ServerRescueNegativeTestJSON-1891426908-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.336s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 18:12:57 user nova-compute[74613]: DEBUG nova.compute.manager [None req-bfd5f1ae-676f-465c-ab4b-6add21a385ea tempest-ServerRescueNegativeTestJSON-1891426908 tempest-ServerRescueNegativeTestJSON-1891426908-project-member] [instance: 1f2b4426-815f-4ef4-b98e-e5124fec93b7] Start building networks asynchronously for instance. {{(pid=74613) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 29 18:12:57 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:12:57 user nova-compute[74613]: DEBUG nova.compute.manager [None req-bfd5f1ae-676f-465c-ab4b-6add21a385ea tempest-ServerRescueNegativeTestJSON-1891426908 tempest-ServerRescueNegativeTestJSON-1891426908-project-member] [instance: 1f2b4426-815f-4ef4-b98e-e5124fec93b7] Allocating IP information in the background. {{(pid=74613) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 29 18:12:57 user nova-compute[74613]: DEBUG nova.network.neutron [None req-bfd5f1ae-676f-465c-ab4b-6add21a385ea tempest-ServerRescueNegativeTestJSON-1891426908 tempest-ServerRescueNegativeTestJSON-1891426908-project-member] [instance: 1f2b4426-815f-4ef4-b98e-e5124fec93b7] allocate_for_instance() {{(pid=74613) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 29 18:12:57 user nova-compute[74613]: INFO nova.virt.libvirt.driver [None req-bfd5f1ae-676f-465c-ab4b-6add21a385ea tempest-ServerRescueNegativeTestJSON-1891426908 tempest-ServerRescueNegativeTestJSON-1891426908-project-member] [instance: 1f2b4426-815f-4ef4-b98e-e5124fec93b7] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 29 18:12:57 user nova-compute[74613]: DEBUG nova.compute.manager [None req-bfd5f1ae-676f-465c-ab4b-6add21a385ea tempest-ServerRescueNegativeTestJSON-1891426908 tempest-ServerRescueNegativeTestJSON-1891426908-project-member] [instance: 1f2b4426-815f-4ef4-b98e-e5124fec93b7] Start building block device mappings for instance. {{(pid=74613) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 29 18:12:57 user nova-compute[74613]: DEBUG nova.policy [None req-bfd5f1ae-676f-465c-ab4b-6add21a385ea tempest-ServerRescueNegativeTestJSON-1891426908 tempest-ServerRescueNegativeTestJSON-1891426908-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '4e984d45838e441680b9948c213728fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6a3eb6ea0294f9da705dca72ec2789a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74613) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 29 18:12:57 user nova-compute[74613]: DEBUG nova.compute.manager [None req-bfd5f1ae-676f-465c-ab4b-6add21a385ea tempest-ServerRescueNegativeTestJSON-1891426908 tempest-ServerRescueNegativeTestJSON-1891426908-project-member] [instance: 1f2b4426-815f-4ef4-b98e-e5124fec93b7] Start spawning the instance on the hypervisor. {{(pid=74613) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 29 18:12:57 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-bfd5f1ae-676f-465c-ab4b-6add21a385ea tempest-ServerRescueNegativeTestJSON-1891426908 tempest-ServerRescueNegativeTestJSON-1891426908-project-member] [instance: 1f2b4426-815f-4ef4-b98e-e5124fec93b7] Creating instance directory {{(pid=74613) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 29 18:12:57 user nova-compute[74613]: INFO nova.virt.libvirt.driver [None req-bfd5f1ae-676f-465c-ab4b-6add21a385ea tempest-ServerRescueNegativeTestJSON-1891426908 tempest-ServerRescueNegativeTestJSON-1891426908-project-member] [instance: 1f2b4426-815f-4ef4-b98e-e5124fec93b7] Creating image(s)
Nov 29 18:12:57 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-bfd5f1ae-676f-465c-ab4b-6add21a385ea tempest-ServerRescueNegativeTestJSON-1891426908 tempest-ServerRescueNegativeTestJSON-1891426908-project-member] Acquiring lock "/opt/stack/data/nova/instances/1f2b4426-815f-4ef4-b98e-e5124fec93b7/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 18:12:57 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-bfd5f1ae-676f-465c-ab4b-6add21a385ea tempest-ServerRescueNegativeTestJSON-1891426908 tempest-ServerRescueNegativeTestJSON-1891426908-project-member] Lock "/opt/stack/data/nova/instances/1f2b4426-815f-4ef4-b98e-e5124fec93b7/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 18:12:57 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-bfd5f1ae-676f-465c-ab4b-6add21a385ea tempest-ServerRescueNegativeTestJSON-1891426908 tempest-ServerRescueNegativeTestJSON-1891426908-project-member] Lock "/opt/stack/data/nova/instances/1f2b4426-815f-4ef4-b98e-e5124fec93b7/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 18:12:57 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-bfd5f1ae-676f-465c-ab4b-6add21a385ea tempest-ServerRescueNegativeTestJSON-1891426908 tempest-ServerRescueNegativeTestJSON-1891426908-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/21faea9e6951f3bdd0153b76ac89fe1a60a34758 --force-share --output=json {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:12:57 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-bfd5f1ae-676f-465c-ab4b-6add21a385ea tempest-ServerRescueNegativeTestJSON-1891426908 tempest-ServerRescueNegativeTestJSON-1891426908-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/21faea9e6951f3bdd0153b76ac89fe1a60a34758 --force-share --output=json" returned: 0 in 0.183s {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:12:57 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-bfd5f1ae-676f-465c-ab4b-6add21a385ea tempest-ServerRescueNegativeTestJSON-1891426908 tempest-ServerRescueNegativeTestJSON-1891426908-project-member] Acquiring lock "21faea9e6951f3bdd0153b76ac89fe1a60a34758" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 18:12:57 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-bfd5f1ae-676f-465c-ab4b-6add21a385ea tempest-ServerRescueNegativeTestJSON-1891426908 tempest-ServerRescueNegativeTestJSON-1891426908-project-member] Lock "21faea9e6951f3bdd0153b76ac89fe1a60a34758" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 18:12:57 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-bfd5f1ae-676f-465c-ab4b-6add21a385ea tempest-ServerRescueNegativeTestJSON-1891426908 tempest-ServerRescueNegativeTestJSON-1891426908-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/21faea9e6951f3bdd0153b76ac89fe1a60a34758 --force-share --output=json {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:12:58 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-bfd5f1ae-676f-465c-ab4b-6add21a385ea tempest-ServerRescueNegativeTestJSON-1891426908 tempest-ServerRescueNegativeTestJSON-1891426908-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/21faea9e6951f3bdd0153b76ac89fe1a60a34758 --force-share --output=json" returned: 0 in 0.170s {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:12:58 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-bfd5f1ae-676f-465c-ab4b-6add21a385ea tempest-ServerRescueNegativeTestJSON-1891426908 tempest-ServerRescueNegativeTestJSON-1891426908-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/21faea9e6951f3bdd0153b76ac89fe1a60a34758,backing_fmt=raw /opt/stack/data/nova/instances/1f2b4426-815f-4ef4-b98e-e5124fec93b7/disk 1073741824 {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:12:58 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-bfd5f1ae-676f-465c-ab4b-6add21a385ea tempest-ServerRescueNegativeTestJSON-1891426908 tempest-ServerRescueNegativeTestJSON-1891426908-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/21faea9e6951f3bdd0153b76ac89fe1a60a34758,backing_fmt=raw /opt/stack/data/nova/instances/1f2b4426-815f-4ef4-b98e-e5124fec93b7/disk 1073741824" returned: 0 in 0.048s {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:12:58 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-bfd5f1ae-676f-465c-ab4b-6add21a385ea tempest-ServerRescueNegativeTestJSON-1891426908 tempest-ServerRescueNegativeTestJSON-1891426908-project-member] Lock "21faea9e6951f3bdd0153b76ac89fe1a60a34758" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.224s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 18:12:58 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-bfd5f1ae-676f-465c-ab4b-6add21a385ea tempest-ServerRescueNegativeTestJSON-1891426908 tempest-ServerRescueNegativeTestJSON-1891426908-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/21faea9e6951f3bdd0153b76ac89fe1a60a34758 --force-share --output=json {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:12:58 user nova-compute[74613]: DEBUG nova.network.neutron [None req-bfd5f1ae-676f-465c-ab4b-6add21a385ea tempest-ServerRescueNegativeTestJSON-1891426908 tempest-ServerRescueNegativeTestJSON-1891426908-project-member] [instance: 1f2b4426-815f-4ef4-b98e-e5124fec93b7] Successfully created port: e89209f3-5532-4ff8-95c7-fb7a3334846a {{(pid=74613) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 29 18:12:58 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-bfd5f1ae-676f-465c-ab4b-6add21a385ea tempest-ServerRescueNegativeTestJSON-1891426908 tempest-ServerRescueNegativeTestJSON-1891426908-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/21faea9e6951f3bdd0153b76ac89fe1a60a34758 --force-share --output=json" returned: 0 in 0.186s {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:12:58 user nova-compute[74613]: DEBUG nova.virt.disk.api [None req-bfd5f1ae-676f-465c-ab4b-6add21a385ea tempest-ServerRescueNegativeTestJSON-1891426908 tempest-ServerRescueNegativeTestJSON-1891426908-project-member] Checking if we can resize image /opt/stack/data/nova/instances/1f2b4426-815f-4ef4-b98e-e5124fec93b7/disk. size=1073741824 {{(pid=74613) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 29 18:12:58 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-bfd5f1ae-676f-465c-ab4b-6add21a385ea tempest-ServerRescueNegativeTestJSON-1891426908 tempest-ServerRescueNegativeTestJSON-1891426908-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1f2b4426-815f-4ef4-b98e-e5124fec93b7/disk --force-share --output=json {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:12:58 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-bfd5f1ae-676f-465c-ab4b-6add21a385ea tempest-ServerRescueNegativeTestJSON-1891426908 tempest-ServerRescueNegativeTestJSON-1891426908-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1f2b4426-815f-4ef4-b98e-e5124fec93b7/disk --force-share --output=json" returned: 0 in 0.211s {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:12:58 user nova-compute[74613]: DEBUG nova.virt.disk.api [None req-bfd5f1ae-676f-465c-ab4b-6add21a385ea tempest-ServerRescueNegativeTestJSON-1891426908 tempest-ServerRescueNegativeTestJSON-1891426908-project-member] Cannot resize image /opt/stack/data/nova/instances/1f2b4426-815f-4ef4-b98e-e5124fec93b7/disk to a smaller size. {{(pid=74613) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 29 18:12:58 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-bfd5f1ae-676f-465c-ab4b-6add21a385ea tempest-ServerRescueNegativeTestJSON-1891426908 tempest-ServerRescueNegativeTestJSON-1891426908-project-member] [instance: 1f2b4426-815f-4ef4-b98e-e5124fec93b7] Created local disks {{(pid=74613) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 29 18:12:58 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-bfd5f1ae-676f-465c-ab4b-6add21a385ea tempest-ServerRescueNegativeTestJSON-1891426908 tempest-ServerRescueNegativeTestJSON-1891426908-project-member] [instance: 1f2b4426-815f-4ef4-b98e-e5124fec93b7] Ensure instance console log exists: /opt/stack/data/nova/instances/1f2b4426-815f-4ef4-b98e-e5124fec93b7/console.log {{(pid=74613) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 29 18:12:58 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-bfd5f1ae-676f-465c-ab4b-6add21a385ea tempest-ServerRescueNegativeTestJSON-1891426908 tempest-ServerRescueNegativeTestJSON-1891426908-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 18:12:58 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-bfd5f1ae-676f-465c-ab4b-6add21a385ea tempest-ServerRescueNegativeTestJSON-1891426908 tempest-ServerRescueNegativeTestJSON-1891426908-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 18:12:58 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-bfd5f1ae-676f-465c-ab4b-6add21a385ea tempest-ServerRescueNegativeTestJSON-1891426908 tempest-ServerRescueNegativeTestJSON-1891426908-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 18:12:58 user nova-compute[74613]: DEBUG nova.network.neutron [None req-bfd5f1ae-676f-465c-ab4b-6add21a385ea tempest-ServerRescueNegativeTestJSON-1891426908 tempest-ServerRescueNegativeTestJSON-1891426908-project-member] [instance: 1f2b4426-815f-4ef4-b98e-e5124fec93b7] Successfully updated port: e89209f3-5532-4ff8-95c7-fb7a3334846a {{(pid=74613) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 29 18:12:58 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-bfd5f1ae-676f-465c-ab4b-6add21a385ea tempest-ServerRescueNegativeTestJSON-1891426908 tempest-ServerRescueNegativeTestJSON-1891426908-project-member] Acquiring lock "refresh_cache-1f2b4426-815f-4ef4-b98e-e5124fec93b7" {{(pid=74613) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 18:12:58 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-bfd5f1ae-676f-465c-ab4b-6add21a385ea tempest-ServerRescueNegativeTestJSON-1891426908 tempest-ServerRescueNegativeTestJSON-1891426908-project-member] Acquired lock "refresh_cache-1f2b4426-815f-4ef4-b98e-e5124fec93b7" {{(pid=74613) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 18:12:58 user nova-compute[74613]: DEBUG nova.network.neutron [None req-bfd5f1ae-676f-465c-ab4b-6add21a385ea tempest-ServerRescueNegativeTestJSON-1891426908 tempest-ServerRescueNegativeTestJSON-1891426908-project-member] [instance: 1f2b4426-815f-4ef4-b98e-e5124fec93b7] Building network info cache for instance {{(pid=74613) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 29 18:12:59 user nova-compute[74613]: DEBUG nova.network.neutron [None req-bfd5f1ae-676f-465c-ab4b-6add21a385ea tempest-ServerRescueNegativeTestJSON-1891426908 tempest-ServerRescueNegativeTestJSON-1891426908-project-member] [instance: 1f2b4426-815f-4ef4-b98e-e5124fec93b7] Instance cache missing network info. {{(pid=74613) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 29 18:12:59 user nova-compute[74613]: DEBUG nova.compute.manager [req-410b1a48-a3c8-4477-b558-85599d30d439 req-e4c4a823-bea8-4991-9462-5b8a81272e99 service nova] [instance: 1f2b4426-815f-4ef4-b98e-e5124fec93b7] Received event network-changed-e89209f3-5532-4ff8-95c7-fb7a3334846a {{(pid=74613) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 18:12:59 user nova-compute[74613]: DEBUG nova.compute.manager [req-410b1a48-a3c8-4477-b558-85599d30d439 req-e4c4a823-bea8-4991-9462-5b8a81272e99 service nova] [instance: 1f2b4426-815f-4ef4-b98e-e5124fec93b7] Refreshing instance network info cache due to event network-changed-e89209f3-5532-4ff8-95c7-fb7a3334846a. {{(pid=74613) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 18:12:59 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-410b1a48-a3c8-4477-b558-85599d30d439 req-e4c4a823-bea8-4991-9462-5b8a81272e99 service nova] Acquiring lock "refresh_cache-1f2b4426-815f-4ef4-b98e-e5124fec93b7" {{(pid=74613) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 18:12:59 user nova-compute[74613]: DEBUG nova.network.neutron [None req-bfd5f1ae-676f-465c-ab4b-6add21a385ea tempest-ServerRescueNegativeTestJSON-1891426908 tempest-ServerRescueNegativeTestJSON-1891426908-project-member] [instance: 1f2b4426-815f-4ef4-b98e-e5124fec93b7] Updating instance_info_cache with network_info: [{"id": "e89209f3-5532-4ff8-95c7-fb7a3334846a", "address": "fa:16:3e:98:a3:61", "network": {"id": "db79433c-b21c-4058-b98c-f62822abbf7a", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1715530752-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e6a3eb6ea0294f9da705dca72ec2789a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape89209f3-55", "ovs_interfaceid": "e89209f3-5532-4ff8-95c7-fb7a3334846a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74613) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 18:12:59 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-bfd5f1ae-676f-465c-ab4b-6add21a385ea tempest-ServerRescueNegativeTestJSON-1891426908 tempest-ServerRescueNegativeTestJSON-1891426908-project-member] Releasing lock "refresh_cache-1f2b4426-815f-4ef4-b98e-e5124fec93b7" {{(pid=74613) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 18:12:59 user nova-compute[74613]: DEBUG nova.compute.manager [None req-bfd5f1ae-676f-465c-ab4b-6add21a385ea tempest-ServerRescueNegativeTestJSON-1891426908 tempest-ServerRescueNegativeTestJSON-1891426908-project-member] [instance: 1f2b4426-815f-4ef4-b98e-e5124fec93b7] Instance network_info: |[{"id": "e89209f3-5532-4ff8-95c7-fb7a3334846a", "address": "fa:16:3e:98:a3:61", "network": {"id": "db79433c-b21c-4058-b98c-f62822abbf7a", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1715530752-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e6a3eb6ea0294f9da705dca72ec2789a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape89209f3-55", "ovs_interfaceid": "e89209f3-5532-4ff8-95c7-fb7a3334846a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74613) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 29 18:12:59 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-410b1a48-a3c8-4477-b558-85599d30d439 req-e4c4a823-bea8-4991-9462-5b8a81272e99 service nova] Acquired lock "refresh_cache-1f2b4426-815f-4ef4-b98e-e5124fec93b7" {{(pid=74613) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 18:12:59 user nova-compute[74613]: DEBUG nova.network.neutron [req-410b1a48-a3c8-4477-b558-85599d30d439 req-e4c4a823-bea8-4991-9462-5b8a81272e99 service nova] [instance: 1f2b4426-815f-4ef4-b98e-e5124fec93b7] Refreshing network info cache for port e89209f3-5532-4ff8-95c7-fb7a3334846a {{(pid=74613) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 18:12:59 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-bfd5f1ae-676f-465c-ab4b-6add21a385ea tempest-ServerRescueNegativeTestJSON-1891426908 tempest-ServerRescueNegativeTestJSON-1891426908-project-member] [instance: 1f2b4426-815f-4ef4-b98e-e5124fec93b7] Start _get_guest_xml network_info=[{"id": "e89209f3-5532-4ff8-95c7-fb7a3334846a", "address": "fa:16:3e:98:a3:61", "network": {"id": "db79433c-b21c-4058-b98c-f62822abbf7a", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1715530752-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e6a3eb6ea0294f9da705dca72ec2789a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape89209f3-55", "ovs_interfaceid": "e89209f3-5532-4ff8-95c7-fb7a3334846a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-29T17:47:38Z,direct_url=<?>,disk_format='qcow2',id=4217f428-8d9d-4ee1-9614-642d26d90c46,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='794b07cbd46a44b5865cfda741036bae',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-29T17:47:40Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'size': 0, 'device_type': 'disk', 'boot_index': 0, 'guest_format': None, 'encrypted': False, 'encryption_format': None, 'disk_bus': 'virtio', 'image_id': '4217f428-8d9d-4ee1-9614-642d26d90c46'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74613) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 29 18:12:59 user nova-compute[74613]: WARNING nova.virt.libvirt.driver [None req-bfd5f1ae-676f-465c-ab4b-6add21a385ea tempest-ServerRescueNegativeTestJSON-1891426908 tempest-ServerRescueNegativeTestJSON-1891426908-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 18:12:59 user nova-compute[74613]: WARNING nova.virt.libvirt.driver [None req-bfd5f1ae-676f-465c-ab4b-6add21a385ea tempest-ServerRescueNegativeTestJSON-1891426908 tempest-ServerRescueNegativeTestJSON-1891426908-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 18:12:59 user nova-compute[74613]: DEBUG nova.virt.libvirt.host [None req-bfd5f1ae-676f-465c-ab4b-6add21a385ea tempest-ServerRescueNegativeTestJSON-1891426908 tempest-ServerRescueNegativeTestJSON-1891426908-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74613) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 29 18:12:59 user nova-compute[74613]: DEBUG nova.virt.libvirt.host [None req-bfd5f1ae-676f-465c-ab4b-6add21a385ea tempest-ServerRescueNegativeTestJSON-1891426908 tempest-ServerRescueNegativeTestJSON-1891426908-project-member] CPU controller missing on host. {{(pid=74613) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 29 18:12:59 user nova-compute[74613]: DEBUG nova.virt.libvirt.host [None req-bfd5f1ae-676f-465c-ab4b-6add21a385ea tempest-ServerRescueNegativeTestJSON-1891426908 tempest-ServerRescueNegativeTestJSON-1891426908-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74613) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 29 18:12:59 user nova-compute[74613]: DEBUG nova.virt.libvirt.host [None req-bfd5f1ae-676f-465c-ab4b-6add21a385ea tempest-ServerRescueNegativeTestJSON-1891426908 tempest-ServerRescueNegativeTestJSON-1891426908-project-member] CPU controller found on host. {{(pid=74613) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 29 18:12:59 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-bfd5f1ae-676f-465c-ab4b-6add21a385ea tempest-ServerRescueNegativeTestJSON-1891426908 tempest-ServerRescueNegativeTestJSON-1891426908-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74613) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 29 18:12:59 user nova-compute[74613]: DEBUG nova.virt.hardware [None req-bfd5f1ae-676f-465c-ab4b-6add21a385ea tempest-ServerRescueNegativeTestJSON-1891426908 tempest-ServerRescueNegativeTestJSON-1891426908-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-29T17:47:27Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-29T17:47:38Z,direct_url=<?>,disk_format='qcow2',id=4217f428-8d9d-4ee1-9614-642d26d90c46,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='794b07cbd46a44b5865cfda741036bae',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-29T17:47:40Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74613) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 29 18:12:59 user nova-compute[74613]: DEBUG nova.virt.hardware [None req-bfd5f1ae-676f-465c-ab4b-6add21a385ea tempest-ServerRescueNegativeTestJSON-1891426908 tempest-ServerRescueNegativeTestJSON-1891426908-project-member] Flavor limits 0:0:0 {{(pid=74613) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 29 18:12:59 user nova-compute[74613]: DEBUG nova.virt.hardware [None req-bfd5f1ae-676f-465c-ab4b-6add21a385ea tempest-ServerRescueNegativeTestJSON-1891426908 tempest-ServerRescueNegativeTestJSON-1891426908-project-member] Image limits 0:0:0 {{(pid=74613) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 29 18:12:59 user nova-compute[74613]: DEBUG nova.virt.hardware [None req-bfd5f1ae-676f-465c-ab4b-6add21a385ea tempest-ServerRescueNegativeTestJSON-1891426908 tempest-ServerRescueNegativeTestJSON-1891426908-project-member] Flavor pref 0:0:0 {{(pid=74613) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 29 18:12:59 user nova-compute[74613]: DEBUG nova.virt.hardware [None req-bfd5f1ae-676f-465c-ab4b-6add21a385ea tempest-ServerRescueNegativeTestJSON-1891426908 tempest-ServerRescueNegativeTestJSON-1891426908-project-member] Image pref 0:0:0 {{(pid=74613) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 29 18:12:59 user nova-compute[74613]: DEBUG nova.virt.hardware [None req-bfd5f1ae-676f-465c-ab4b-6add21a385ea tempest-ServerRescueNegativeTestJSON-1891426908 tempest-ServerRescueNegativeTestJSON-1891426908-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74613) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 29 18:12:59 user nova-compute[74613]: DEBUG nova.virt.hardware [None req-bfd5f1ae-676f-465c-ab4b-6add21a385ea tempest-ServerRescueNegativeTestJSON-1891426908 tempest-ServerRescueNegativeTestJSON-1891426908-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74613) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 29 18:12:59 user nova-compute[74613]: DEBUG nova.virt.hardware [None req-bfd5f1ae-676f-465c-ab4b-6add21a385ea tempest-ServerRescueNegativeTestJSON-1891426908 tempest-ServerRescueNegativeTestJSON-1891426908-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74613) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 29 18:12:59 user nova-compute[74613]: DEBUG nova.virt.hardware [None req-bfd5f1ae-676f-465c-ab4b-6add21a385ea tempest-ServerRescueNegativeTestJSON-1891426908 tempest-ServerRescueNegativeTestJSON-1891426908-project-member] Got 1 possible topologies {{(pid=74613) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 29 18:12:59 user nova-compute[74613]: DEBUG nova.virt.hardware [None req-bfd5f1ae-676f-465c-ab4b-6add21a385ea tempest-ServerRescueNegativeTestJSON-1891426908 tempest-ServerRescueNegativeTestJSON-1891426908-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74613) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 29 18:12:59 user nova-compute[74613]: DEBUG nova.virt.hardware [None req-bfd5f1ae-676f-465c-ab4b-6add21a385ea tempest-ServerRescueNegativeTestJSON-1891426908 tempest-ServerRescueNegativeTestJSON-1891426908-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74613) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 29 18:12:59 user nova-compute[74613]: DEBUG nova.virt.libvirt.vif [None req-bfd5f1ae-676f-465c-ab4b-6add21a385ea tempest-ServerRescueNegativeTestJSON-1891426908 tempest-ServerRescueNegativeTestJSON-1891426908-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T18:12:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1726006672',display_name='tempest-ServerRescueNegativeTestJSON-server-1726006672',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1726006672',id=37,image_ref='4217f428-8d9d-4ee1-9614-642d26d90c46',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMgPoXgDUW7nk75D69xzLfcbvWDEVu3o5D9tsIFqy77Ta+ar2r8agObqLmmaHBpRVe2srT806cnX5IaVx4iIVSCtnRfzPCKkokoW4ZMSXWu1sEMn3RQK+XuNeGnG5ClNRw==',key_name='tempest-keypair-716087799',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e6a3eb6ea0294f9da705dca72ec2789a',ramdisk_id='',reservation_id='r-sx0019fy',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='4217f428-8d9d-4ee1-9614-642d26d90c46',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-1891426908',owner_user_name='tempest-ServerRescueNegativeTestJSON-1891426908-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T18:12:58Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4e984d45838e441680b9948c213728fb',uuid=1f2b4426-815f-4ef4-b98e-e5124fec93b7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e89209f3-5532-4ff8-95c7-fb7a3334846a", "address": "fa:16:3e:98:a3:61", "network": {"id": "db79433c-b21c-4058-b98c-f62822abbf7a", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1715530752-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e6a3eb6ea0294f9da705dca72ec2789a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape89209f3-55", "ovs_interfaceid": "e89209f3-5532-4ff8-95c7-fb7a3334846a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74613) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 29 18:12:59 user nova-compute[74613]: DEBUG nova.network.os_vif_util [None req-bfd5f1ae-676f-465c-ab4b-6add21a385ea tempest-ServerRescueNegativeTestJSON-1891426908 tempest-ServerRescueNegativeTestJSON-1891426908-project-member] Converting VIF {"id": "e89209f3-5532-4ff8-95c7-fb7a3334846a", "address": "fa:16:3e:98:a3:61", "network": {"id": "db79433c-b21c-4058-b98c-f62822abbf7a", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1715530752-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e6a3eb6ea0294f9da705dca72ec2789a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape89209f3-55", "ovs_interfaceid": "e89209f3-5532-4ff8-95c7-fb7a3334846a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74613) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 18:12:59 user nova-compute[74613]: DEBUG nova.network.os_vif_util [None req-bfd5f1ae-676f-465c-ab4b-6add21a385ea tempest-ServerRescueNegativeTestJSON-1891426908 tempest-ServerRescueNegativeTestJSON-1891426908-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:98:a3:61,bridge_name='br-int',has_traffic_filtering=True,id=e89209f3-5532-4ff8-95c7-fb7a3334846a,network=Network(db79433c-b21c-4058-b98c-f62822abbf7a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape89209f3-55') {{(pid=74613) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 18:12:59 user nova-compute[74613]: DEBUG nova.objects.instance [None req-bfd5f1ae-676f-465c-ab4b-6add21a385ea tempest-ServerRescueNegativeTestJSON-1891426908 tempest-ServerRescueNegativeTestJSON-1891426908-project-member] Lazy-loading 'pci_devices' on Instance uuid 1f2b4426-815f-4ef4-b98e-e5124fec93b7 {{(pid=74613) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 18:12:59 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-bfd5f1ae-676f-465c-ab4b-6add21a385ea tempest-ServerRescueNegativeTestJSON-1891426908 tempest-ServerRescueNegativeTestJSON-1891426908-project-member] [instance: 1f2b4426-815f-4ef4-b98e-e5124fec93b7] End _get_guest_xml xml=<domain type="kvm">
Nov 29 18:12:59 user nova-compute[74613]:   <uuid>1f2b4426-815f-4ef4-b98e-e5124fec93b7</uuid>
Nov 29 18:12:59 user nova-compute[74613]:   <name>instance-00000025</name>
Nov 29 18:12:59 user nova-compute[74613]:   <memory>524288</memory>
Nov 29 18:12:59 user nova-compute[74613]:   <vcpu>1</vcpu>
Nov 29 18:12:59 user nova-compute[74613]:   <metadata>
Nov 29 18:12:59 user nova-compute[74613]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 29 18:12:59 user nova-compute[74613]:       <nova:package version="0.0.0"/>
Nov 29 18:12:59 user nova-compute[74613]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-1726006672</nova:name>
Nov 29 18:12:59 user nova-compute[74613]:       <nova:creationTime>2023-11-29 18:12:59</nova:creationTime>
Nov 29 18:12:59 user nova-compute[74613]:       <nova:flavor name="m1.tiny">
Nov 29 18:12:59 user nova-compute[74613]:         <nova:memory>512</nova:memory>
Nov 29 18:12:59 user nova-compute[74613]:         <nova:disk>1</nova:disk>
Nov 29 18:12:59 user nova-compute[74613]:         <nova:swap>0</nova:swap>
Nov 29 18:12:59 user nova-compute[74613]:         <nova:ephemeral>0</nova:ephemeral>
Nov 29 18:12:59 user nova-compute[74613]:         <nova:vcpus>1</nova:vcpus>
Nov 29 18:12:59 user nova-compute[74613]:       </nova:flavor>
Nov 29 18:12:59 user nova-compute[74613]:       <nova:owner>
Nov 29 18:12:59 user nova-compute[74613]:         <nova:user uuid="4e984d45838e441680b9948c213728fb">tempest-ServerRescueNegativeTestJSON-1891426908-project-member</nova:user>
Nov 29 18:12:59 user nova-compute[74613]:         <nova:project uuid="e6a3eb6ea0294f9da705dca72ec2789a">tempest-ServerRescueNegativeTestJSON-1891426908</nova:project>
Nov 29 18:12:59 user nova-compute[74613]:       </nova:owner>
Nov 29 18:12:59 user nova-compute[74613]:       <nova:root type="image" uuid="4217f428-8d9d-4ee1-9614-642d26d90c46"/>
Nov 29 18:12:59 user nova-compute[74613]:       <nova:ports>
Nov 29 18:12:59 user nova-compute[74613]:         <nova:port uuid="e89209f3-5532-4ff8-95c7-fb7a3334846a">
Nov 29 18:12:59 user nova-compute[74613]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Nov 29 18:12:59 user nova-compute[74613]:         </nova:port>
Nov 29 18:12:59 user nova-compute[74613]:       </nova:ports>
Nov 29 18:12:59 user nova-compute[74613]:     </nova:instance>
Nov 29 18:12:59 user nova-compute[74613]:   </metadata>
Nov 29 18:12:59 user nova-compute[74613]:   <sysinfo type="smbios">
Nov 29 18:12:59 user nova-compute[74613]:     <system>
Nov 29 18:12:59 user nova-compute[74613]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 29 18:12:59 user nova-compute[74613]:       <entry name="product">OpenStack Nova</entry>
Nov 29 18:12:59 user nova-compute[74613]:       <entry name="version">0.0.0</entry>
Nov 29 18:12:59 user nova-compute[74613]:       <entry name="serial">1f2b4426-815f-4ef4-b98e-e5124fec93b7</entry>
Nov 29 18:12:59 user nova-compute[74613]:       <entry name="uuid">1f2b4426-815f-4ef4-b98e-e5124fec93b7</entry>
Nov 29 18:12:59 user nova-compute[74613]:       <entry name="family">Virtual Machine</entry>
Nov 29 18:12:59 user nova-compute[74613]:     </system>
Nov 29 18:12:59 user nova-compute[74613]:   </sysinfo>
Nov 29 18:12:59 user nova-compute[74613]:   <os>
Nov 29 18:12:59 user nova-compute[74613]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 29 18:12:59 user nova-compute[74613]:     <boot dev="hd"/>
Nov 29 18:12:59 user nova-compute[74613]:     <smbios mode="sysinfo"/>
Nov 29 18:12:59 user nova-compute[74613]:   </os>
Nov 29 18:12:59 user nova-compute[74613]:   <features>
Nov 29 18:12:59 user nova-compute[74613]:     <acpi/>
Nov 29 18:12:59 user nova-compute[74613]:     <apic/>
Nov 29 18:12:59 user nova-compute[74613]:     <vmcoreinfo/>
Nov 29 18:12:59 user nova-compute[74613]:   </features>
Nov 29 18:12:59 user nova-compute[74613]:   <clock offset="utc">
Nov 29 18:12:59 user nova-compute[74613]:     <timer name="pit" tickpolicy="delay"/>
Nov 29 18:12:59 user nova-compute[74613]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 29 18:12:59 user nova-compute[74613]:     <timer name="hpet" present="no"/>
Nov 29 18:12:59 user nova-compute[74613]:   </clock>
Nov 29 18:12:59 user nova-compute[74613]:   <cpu mode="custom" match="exact">
Nov 29 18:12:59 user nova-compute[74613]:     <model>Nehalem</model>
Nov 29 18:12:59 user nova-compute[74613]:     <topology sockets="1" cores="1" threads="1"/>
Nov 29 18:12:59 user nova-compute[74613]:   </cpu>
Nov 29 18:12:59 user nova-compute[74613]:   <devices>
Nov 29 18:12:59 user nova-compute[74613]:     <disk type="file" device="disk">
Nov 29 18:12:59 user nova-compute[74613]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 29 18:12:59 user nova-compute[74613]:       <source file="/opt/stack/data/nova/instances/1f2b4426-815f-4ef4-b98e-e5124fec93b7/disk"/>
Nov 29 18:12:59 user nova-compute[74613]:       <target dev="vda" bus="virtio"/>
Nov 29 18:12:59 user nova-compute[74613]:     </disk>
Nov 29 18:12:59 user nova-compute[74613]:     <interface type="ethernet">
Nov 29 18:12:59 user nova-compute[74613]:       <mac address="fa:16:3e:98:a3:61"/>
Nov 29 18:12:59 user nova-compute[74613]:       <model type="virtio"/>
Nov 29 18:12:59 user nova-compute[74613]:       <mtu size="1442"/>
Nov 29 18:12:59 user nova-compute[74613]:       <target dev="tape89209f3-55"/>
Nov 29 18:12:59 user nova-compute[74613]:     </interface>
Nov 29 18:12:59 user nova-compute[74613]:     <serial type="pty">
Nov 29 18:12:59 user nova-compute[74613]:       <log file="/opt/stack/data/nova/instances/1f2b4426-815f-4ef4-b98e-e5124fec93b7/console.log" append="off"/>
Nov 29 18:12:59 user nova-compute[74613]:     </serial>
Nov 29 18:12:59 user nova-compute[74613]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 29 18:12:59 user nova-compute[74613]:     <video>
Nov 29 18:12:59 user nova-compute[74613]:       <model type="virtio"/>
Nov 29 18:12:59 user nova-compute[74613]:     </video>
Nov 29 18:12:59 user nova-compute[74613]:     <rng model="virtio">
Nov 29 18:12:59 user nova-compute[74613]:       <backend model="random">/dev/urandom</backend>
Nov 29 18:12:59 user nova-compute[74613]:     </rng>
Nov 29 18:12:59 user nova-compute[74613]:     <controller type="usb" index="0" model="none"/>
Nov 29 18:12:59 user nova-compute[74613]:     <memballoon model="virtio">
Nov 29 18:12:59 user nova-compute[74613]:       <stats period="10"/>
Nov 29 18:12:59 user nova-compute[74613]:     </memballoon>
Nov 29 18:12:59 user nova-compute[74613]:   </devices>
Nov 29 18:12:59 user nova-compute[74613]: </domain>
Nov 29 18:12:59 user nova-compute[74613]:  {{(pid=74613) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 29 18:12:59 user nova-compute[74613]: DEBUG nova.virt.libvirt.vif [None req-bfd5f1ae-676f-465c-ab4b-6add21a385ea tempest-ServerRescueNegativeTestJSON-1891426908 tempest-ServerRescueNegativeTestJSON-1891426908-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T18:12:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1726006672',display_name='tempest-ServerRescueNegativeTestJSON-server-1726006672',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1726006672',id=37,image_ref='4217f428-8d9d-4ee1-9614-642d26d90c46',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMgPoXgDUW7nk75D69xzLfcbvWDEVu3o5D9tsIFqy77Ta+ar2r8agObqLmmaHBpRVe2srT806cnX5IaVx4iIVSCtnRfzPCKkokoW4ZMSXWu1sEMn3RQK+XuNeGnG5ClNRw==',key_name='tempest-keypair-716087799',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e6a3eb6ea0294f9da705dca72ec2789a',ramdisk_id='',reservation_id='r-sx0019fy',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='4217f428-8d9d-4ee1-9614-642d26d90c46',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-1891426908',owner_user_name='tempest-ServerRescueNegativeTestJSON-1891426908-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T18:12:58Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4e984d45838e441680b9948c213728fb',uuid=1f2b4426-815f-4ef4-b98e-e5124fec93b7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e89209f3-5532-4ff8-95c7-fb7a3334846a", "address": "fa:16:3e:98:a3:61", "network": {"id": "db79433c-b21c-4058-b98c-f62822abbf7a", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1715530752-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e6a3eb6ea0294f9da705dca72ec2789a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape89209f3-55", "ovs_interfaceid": "e89209f3-5532-4ff8-95c7-fb7a3334846a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74613) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 29 18:12:59 user nova-compute[74613]: DEBUG nova.network.os_vif_util [None req-bfd5f1ae-676f-465c-ab4b-6add21a385ea tempest-ServerRescueNegativeTestJSON-1891426908 tempest-ServerRescueNegativeTestJSON-1891426908-project-member] Converting VIF {"id": "e89209f3-5532-4ff8-95c7-fb7a3334846a", "address": "fa:16:3e:98:a3:61", "network": {"id": "db79433c-b21c-4058-b98c-f62822abbf7a", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1715530752-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e6a3eb6ea0294f9da705dca72ec2789a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape89209f3-55", "ovs_interfaceid": "e89209f3-5532-4ff8-95c7-fb7a3334846a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74613) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 18:12:59 user nova-compute[74613]: DEBUG nova.network.os_vif_util [None req-bfd5f1ae-676f-465c-ab4b-6add21a385ea tempest-ServerRescueNegativeTestJSON-1891426908 tempest-ServerRescueNegativeTestJSON-1891426908-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:98:a3:61,bridge_name='br-int',has_traffic_filtering=True,id=e89209f3-5532-4ff8-95c7-fb7a3334846a,network=Network(db79433c-b21c-4058-b98c-f62822abbf7a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape89209f3-55') {{(pid=74613) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 18:12:59 user nova-compute[74613]: DEBUG os_vif [None req-bfd5f1ae-676f-465c-ab4b-6add21a385ea tempest-ServerRescueNegativeTestJSON-1891426908 tempest-ServerRescueNegativeTestJSON-1891426908-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:98:a3:61,bridge_name='br-int',has_traffic_filtering=True,id=e89209f3-5532-4ff8-95c7-fb7a3334846a,network=Network(db79433c-b21c-4058-b98c-f62822abbf7a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape89209f3-55') {{(pid=74613) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 29 18:12:59 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:12:59 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74613) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 18:12:59 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74613) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 29 18:12:59 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:12:59 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'a41fd501-5138-5577-929d-b75de4ed14a5', '_type': 'linux-noop'}}, row=False) {{(pid=74613) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 18:12:59 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:12:59 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 18:12:59 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:12:59 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:12:59 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tape89209f3-55, may_exist=True, interface_attrs={}) {{(pid=74613) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 18:12:59 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tape89209f3-55, col_values=(('qos', UUID('d84a34d9-6c41-45c4-a04b-536823f0b033')),), if_exists=True) {{(pid=74613) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 18:12:59 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tape89209f3-55, col_values=(('external_ids', {'iface-id': 'e89209f3-5532-4ff8-95c7-fb7a3334846a', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:98:a3:61', 'vm-uuid': '1f2b4426-815f-4ef4-b98e-e5124fec93b7'}),), if_exists=True) {{(pid=74613) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 18:12:59 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:12:59 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 18:12:59 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:12:59 user nova-compute[74613]: INFO os_vif [None req-bfd5f1ae-676f-465c-ab4b-6add21a385ea tempest-ServerRescueNegativeTestJSON-1891426908 tempest-ServerRescueNegativeTestJSON-1891426908-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:98:a3:61,bridge_name='br-int',has_traffic_filtering=True,id=e89209f3-5532-4ff8-95c7-fb7a3334846a,network=Network(db79433c-b21c-4058-b98c-f62822abbf7a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape89209f3-55')
Nov 29 18:12:59 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-bfd5f1ae-676f-465c-ab4b-6add21a385ea tempest-ServerRescueNegativeTestJSON-1891426908 tempest-ServerRescueNegativeTestJSON-1891426908-project-member] No BDM found with device name vda, not building metadata. {{(pid=74613) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 18:12:59 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-bfd5f1ae-676f-465c-ab4b-6add21a385ea tempest-ServerRescueNegativeTestJSON-1891426908 tempest-ServerRescueNegativeTestJSON-1891426908-project-member] No VIF found with MAC fa:16:3e:98:a3:61, not building metadata {{(pid=74613) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 29 18:12:59 user nova-compute[74613]: DEBUG nova.network.neutron [req-410b1a48-a3c8-4477-b558-85599d30d439 req-e4c4a823-bea8-4991-9462-5b8a81272e99 service nova] [instance: 1f2b4426-815f-4ef4-b98e-e5124fec93b7] Updated VIF entry in instance network info cache for port e89209f3-5532-4ff8-95c7-fb7a3334846a. {{(pid=74613) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 18:12:59 user nova-compute[74613]: DEBUG nova.network.neutron [req-410b1a48-a3c8-4477-b558-85599d30d439 req-e4c4a823-bea8-4991-9462-5b8a81272e99 service nova] [instance: 1f2b4426-815f-4ef4-b98e-e5124fec93b7] Updating instance_info_cache with network_info: [{"id": "e89209f3-5532-4ff8-95c7-fb7a3334846a", "address": "fa:16:3e:98:a3:61", "network": {"id": "db79433c-b21c-4058-b98c-f62822abbf7a", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1715530752-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e6a3eb6ea0294f9da705dca72ec2789a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape89209f3-55", "ovs_interfaceid": "e89209f3-5532-4ff8-95c7-fb7a3334846a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74613) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 18:12:59 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-410b1a48-a3c8-4477-b558-85599d30d439 req-e4c4a823-bea8-4991-9462-5b8a81272e99 service nova] Releasing lock "refresh_cache-1f2b4426-815f-4ef4-b98e-e5124fec93b7" {{(pid=74613) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 18:13:00 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:13:00 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:13:00 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:13:00 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:13:01 user nova-compute[74613]: DEBUG nova.compute.manager [req-2b71932c-8b79-486b-940f-33601297db66 req-9566fe1a-8d05-410d-921d-3b342934edf4 service nova] [instance: 1f2b4426-815f-4ef4-b98e-e5124fec93b7] Received event network-vif-plugged-e89209f3-5532-4ff8-95c7-fb7a3334846a {{(pid=74613) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 18:13:01 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-2b71932c-8b79-486b-940f-33601297db66 req-9566fe1a-8d05-410d-921d-3b342934edf4 service nova] Acquiring lock "1f2b4426-815f-4ef4-b98e-e5124fec93b7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 18:13:01 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-2b71932c-8b79-486b-940f-33601297db66 req-9566fe1a-8d05-410d-921d-3b342934edf4 service nova] Lock "1f2b4426-815f-4ef4-b98e-e5124fec93b7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 18:13:01 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-2b71932c-8b79-486b-940f-33601297db66 req-9566fe1a-8d05-410d-921d-3b342934edf4 service nova] Lock "1f2b4426-815f-4ef4-b98e-e5124fec93b7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 18:13:01 user nova-compute[74613]: DEBUG nova.compute.manager [req-2b71932c-8b79-486b-940f-33601297db66 req-9566fe1a-8d05-410d-921d-3b342934edf4 service nova] [instance: 1f2b4426-815f-4ef4-b98e-e5124fec93b7] No waiting events found dispatching network-vif-plugged-e89209f3-5532-4ff8-95c7-fb7a3334846a {{(pid=74613) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 18:13:01 user nova-compute[74613]: WARNING nova.compute.manager [req-2b71932c-8b79-486b-940f-33601297db66 req-9566fe1a-8d05-410d-921d-3b342934edf4 service nova] [instance: 1f2b4426-815f-4ef4-b98e-e5124fec93b7] Received unexpected event network-vif-plugged-e89209f3-5532-4ff8-95c7-fb7a3334846a for instance with vm_state building and task_state spawning.
Nov 29 18:13:01 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:13:01 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:13:02 user nova-compute[74613]: DEBUG nova.compute.manager [None req-bfd5f1ae-676f-465c-ab4b-6add21a385ea tempest-ServerRescueNegativeTestJSON-1891426908 tempest-ServerRescueNegativeTestJSON-1891426908-project-member] [instance: 1f2b4426-815f-4ef4-b98e-e5124fec93b7] Instance event wait completed in 0 seconds for  {{(pid=74613) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 29 18:13:02 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-bfd5f1ae-676f-465c-ab4b-6add21a385ea tempest-ServerRescueNegativeTestJSON-1891426908 tempest-ServerRescueNegativeTestJSON-1891426908-project-member] [instance: 1f2b4426-815f-4ef4-b98e-e5124fec93b7] Guest created on hypervisor {{(pid=74613) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 29 18:13:02 user nova-compute[74613]: INFO nova.virt.libvirt.driver [-] [instance: 1f2b4426-815f-4ef4-b98e-e5124fec93b7] Instance spawned successfully.
Nov 29 18:13:02 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-bfd5f1ae-676f-465c-ab4b-6add21a385ea tempest-ServerRescueNegativeTestJSON-1891426908 tempest-ServerRescueNegativeTestJSON-1891426908-project-member] [instance: 1f2b4426-815f-4ef4-b98e-e5124fec93b7] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74613) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 29 18:13:02 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-bfd5f1ae-676f-465c-ab4b-6add21a385ea tempest-ServerRescueNegativeTestJSON-1891426908 tempest-ServerRescueNegativeTestJSON-1891426908-project-member] [instance: 1f2b4426-815f-4ef4-b98e-e5124fec93b7] Found default for hw_cdrom_bus of ide {{(pid=74613) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 18:13:02 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-bfd5f1ae-676f-465c-ab4b-6add21a385ea tempest-ServerRescueNegativeTestJSON-1891426908 tempest-ServerRescueNegativeTestJSON-1891426908-project-member] [instance: 1f2b4426-815f-4ef4-b98e-e5124fec93b7] Found default for hw_disk_bus of virtio {{(pid=74613) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 18:13:02 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-bfd5f1ae-676f-465c-ab4b-6add21a385ea tempest-ServerRescueNegativeTestJSON-1891426908 tempest-ServerRescueNegativeTestJSON-1891426908-project-member] [instance: 1f2b4426-815f-4ef4-b98e-e5124fec93b7] Found default for hw_input_bus of None {{(pid=74613) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 18:13:02 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-bfd5f1ae-676f-465c-ab4b-6add21a385ea tempest-ServerRescueNegativeTestJSON-1891426908 tempest-ServerRescueNegativeTestJSON-1891426908-project-member] [instance: 1f2b4426-815f-4ef4-b98e-e5124fec93b7] Found default for hw_pointer_model of None {{(pid=74613) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 18:13:02 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-bfd5f1ae-676f-465c-ab4b-6add21a385ea tempest-ServerRescueNegativeTestJSON-1891426908 tempest-ServerRescueNegativeTestJSON-1891426908-project-member] [instance: 1f2b4426-815f-4ef4-b98e-e5124fec93b7] Found default for hw_video_model of virtio {{(pid=74613) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 18:13:02 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-bfd5f1ae-676f-465c-ab4b-6add21a385ea tempest-ServerRescueNegativeTestJSON-1891426908 tempest-ServerRescueNegativeTestJSON-1891426908-project-member] [instance: 1f2b4426-815f-4ef4-b98e-e5124fec93b7] Found default for hw_vif_model of virtio {{(pid=74613) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 18:13:03 user nova-compute[74613]: INFO nova.compute.manager [None req-bfd5f1ae-676f-465c-ab4b-6add21a385ea tempest-ServerRescueNegativeTestJSON-1891426908 tempest-ServerRescueNegativeTestJSON-1891426908-project-member] [instance: 1f2b4426-815f-4ef4-b98e-e5124fec93b7] Took 5.39 seconds to spawn the instance on the hypervisor.
Nov 29 18:13:03 user nova-compute[74613]: DEBUG nova.compute.manager [None req-bfd5f1ae-676f-465c-ab4b-6add21a385ea tempest-ServerRescueNegativeTestJSON-1891426908 tempest-ServerRescueNegativeTestJSON-1891426908-project-member] [instance: 1f2b4426-815f-4ef4-b98e-e5124fec93b7] Checking state {{(pid=74613) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 29 18:13:03 user nova-compute[74613]: INFO nova.compute.manager [None req-bfd5f1ae-676f-465c-ab4b-6add21a385ea tempest-ServerRescueNegativeTestJSON-1891426908 tempest-ServerRescueNegativeTestJSON-1891426908-project-member] [instance: 1f2b4426-815f-4ef4-b98e-e5124fec93b7] Took 6.04 seconds to build instance.
Nov 29 18:13:03 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-bfd5f1ae-676f-465c-ab4b-6add21a385ea tempest-ServerRescueNegativeTestJSON-1891426908 tempest-ServerRescueNegativeTestJSON-1891426908-project-member] Lock "1f2b4426-815f-4ef4-b98e-e5124fec93b7" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.140s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 18:13:03 user nova-compute[74613]: DEBUG nova.compute.manager [req-35af576d-d24c-460a-94d2-9658032b5675 req-5353bf60-0b63-4685-8327-de5de6e3a560 service nova] [instance: 1f2b4426-815f-4ef4-b98e-e5124fec93b7] Received event network-vif-plugged-e89209f3-5532-4ff8-95c7-fb7a3334846a {{(pid=74613) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 18:13:03 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-35af576d-d24c-460a-94d2-9658032b5675 req-5353bf60-0b63-4685-8327-de5de6e3a560 service nova] Acquiring lock "1f2b4426-815f-4ef4-b98e-e5124fec93b7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 18:13:03 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-35af576d-d24c-460a-94d2-9658032b5675 req-5353bf60-0b63-4685-8327-de5de6e3a560 service nova] Lock "1f2b4426-815f-4ef4-b98e-e5124fec93b7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 18:13:03 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-35af576d-d24c-460a-94d2-9658032b5675 req-5353bf60-0b63-4685-8327-de5de6e3a560 service nova] Lock "1f2b4426-815f-4ef4-b98e-e5124fec93b7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 18:13:03 user nova-compute[74613]: DEBUG nova.compute.manager [req-35af576d-d24c-460a-94d2-9658032b5675 req-5353bf60-0b63-4685-8327-de5de6e3a560 service nova] [instance: 1f2b4426-815f-4ef4-b98e-e5124fec93b7] No waiting events found dispatching network-vif-plugged-e89209f3-5532-4ff8-95c7-fb7a3334846a {{(pid=74613) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 18:13:03 user nova-compute[74613]: WARNING nova.compute.manager [req-35af576d-d24c-460a-94d2-9658032b5675 req-5353bf60-0b63-4685-8327-de5de6e3a560 service nova] [instance: 1f2b4426-815f-4ef4-b98e-e5124fec93b7] Received unexpected event network-vif-plugged-e89209f3-5532-4ff8-95c7-fb7a3334846a for instance with vm_state active and task_state None.
Nov 29 18:13:04 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:13:05 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:13:09 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:13:13 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:13:14 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:13:17 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:13:17 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:13:19 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:13:20 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:13:24 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:13:24 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:13:25 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:13:27 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:13:29 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:13:30 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:13:31 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:13:31 user nova-compute[74613]: DEBUG oslo_service.periodic_task [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74613) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 18:13:32 user nova-compute[74613]: DEBUG oslo_service.periodic_task [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74613) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 18:13:32 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 18:13:32 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 18:13:32 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 18:13:32 user nova-compute[74613]: DEBUG nova.compute.resource_tracker [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Auditing locally available compute resources for user (node: user) {{(pid=74613) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 29 18:13:32 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1f2b4426-815f-4ef4-b98e-e5124fec93b7/disk --force-share --output=json {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:13:33 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1f2b4426-815f-4ef4-b98e-e5124fec93b7/disk --force-share --output=json" returned: 0 in 0.253s {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:13:33 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1f2b4426-815f-4ef4-b98e-e5124fec93b7/disk --force-share --output=json {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:13:33 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1f2b4426-815f-4ef4-b98e-e5124fec93b7/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:13:33 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/69109f06-acbf-4834-b05e-80ab6e3f6ea0/disk --force-share --output=json {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:13:33 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/69109f06-acbf-4834-b05e-80ab6e3f6ea0/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:13:33 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/69109f06-acbf-4834-b05e-80ab6e3f6ea0/disk --force-share --output=json {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:13:33 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/69109f06-acbf-4834-b05e-80ab6e3f6ea0/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:13:33 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f4a1329-b3b9-4d1c-8735-abddabc359fd/disk.rescue --force-share --output=json {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:13:33 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f4a1329-b3b9-4d1c-8735-abddabc359fd/disk.rescue --force-share --output=json" returned: 0 in 0.192s {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:13:33 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f4a1329-b3b9-4d1c-8735-abddabc359fd/disk.rescue --force-share --output=json {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:13:34 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f4a1329-b3b9-4d1c-8735-abddabc359fd/disk.rescue --force-share --output=json" returned: 0 in 0.203s {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:13:34 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f4a1329-b3b9-4d1c-8735-abddabc359fd/disk --force-share --output=json {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:13:34 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f4a1329-b3b9-4d1c-8735-abddabc359fd/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:13:34 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f4a1329-b3b9-4d1c-8735-abddabc359fd/disk --force-share --output=json {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:13:34 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:13:34 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:13:34 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f4a1329-b3b9-4d1c-8735-abddabc359fd/disk --force-share --output=json" returned: 0 in 0.222s {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:13:34 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fa144332-bad7-4373-94d9-018f41f50ee4/disk --force-share --output=json {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:13:34 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fa144332-bad7-4373-94d9-018f41f50ee4/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:13:34 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fa144332-bad7-4373-94d9-018f41f50ee4/disk --force-share --output=json {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:13:34 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fa144332-bad7-4373-94d9-018f41f50ee4/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:13:34 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6993e2e7-7e03-45b4-9d3d-3742589b6078/disk --force-share --output=json {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:13:35 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6993e2e7-7e03-45b4-9d3d-3742589b6078/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:13:35 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6993e2e7-7e03-45b4-9d3d-3742589b6078/disk --force-share --output=json {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:13:35 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6993e2e7-7e03-45b4-9d3d-3742589b6078/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:13:35 user nova-compute[74613]: WARNING nova.virt.libvirt.driver [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 18:13:35 user nova-compute[74613]: WARNING nova.virt.libvirt.driver [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 18:13:35 user nova-compute[74613]: DEBUG nova.compute.resource_tracker [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Hypervisor/Node resource view: name=user free_ram=8435MB free_disk=24.898578643798828GB free_vcpus=8 pci_devices=[{"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74613) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 29 18:13:35 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 18:13:35 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 18:13:35 user nova-compute[74613]: DEBUG nova.compute.resource_tracker [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Instance 6993e2e7-7e03-45b4-9d3d-3742589b6078 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74613) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 18:13:35 user nova-compute[74613]: DEBUG nova.compute.resource_tracker [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Instance 6f4a1329-b3b9-4d1c-8735-abddabc359fd actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74613) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 18:13:35 user nova-compute[74613]: DEBUG nova.compute.resource_tracker [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Instance 69109f06-acbf-4834-b05e-80ab6e3f6ea0 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74613) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 18:13:35 user nova-compute[74613]: DEBUG nova.compute.resource_tracker [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Instance fa144332-bad7-4373-94d9-018f41f50ee4 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74613) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 18:13:35 user nova-compute[74613]: DEBUG nova.compute.resource_tracker [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Instance 1f2b4426-815f-4ef4-b98e-e5124fec93b7 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74613) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 18:13:35 user nova-compute[74613]: DEBUG nova.compute.resource_tracker [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Total usable vcpus: 12, total allocated vcpus: 5 {{(pid=74613) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 29 18:13:35 user nova-compute[74613]: DEBUG nova.compute.resource_tracker [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Final resource view: name=user phys_ram=16011MB used_ram=3072MB phys_disk=40GB used_disk=5GB total_vcpus=12 used_vcpus=5 pci_stats=[] {{(pid=74613) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 29 18:13:35 user nova-compute[74613]: DEBUG nova.compute.provider_tree [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Inventory has not changed in ProviderTree for provider: 639d980e-3b12-44b1-b8f4-1812416fa4dd {{(pid=74613) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 18:13:35 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:13:35 user nova-compute[74613]: DEBUG nova.scheduler.client.report [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Inventory has not changed for provider 639d980e-3b12-44b1-b8f4-1812416fa4dd based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74613) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 18:13:35 user nova-compute[74613]: DEBUG nova.compute.resource_tracker [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Compute_service record updated for user:user {{(pid=74613) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 29 18:13:35 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.359s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 18:13:36 user nova-compute[74613]: DEBUG oslo_service.periodic_task [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74613) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 18:13:36 user nova-compute[74613]: DEBUG oslo_service.periodic_task [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74613) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 18:13:36 user nova-compute[74613]: DEBUG oslo_service.periodic_task [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74613) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 18:13:37 user nova-compute[74613]: DEBUG oslo_service.periodic_task [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74613) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 18:13:37 user nova-compute[74613]: DEBUG nova.compute.manager [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Starting heal instance info cache {{(pid=74613) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 29 18:13:37 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Acquiring lock "refresh_cache-69109f06-acbf-4834-b05e-80ab6e3f6ea0" {{(pid=74613) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 18:13:37 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Acquired lock "refresh_cache-69109f06-acbf-4834-b05e-80ab6e3f6ea0" {{(pid=74613) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 18:13:37 user nova-compute[74613]: DEBUG nova.network.neutron [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] [instance: 69109f06-acbf-4834-b05e-80ab6e3f6ea0] Forcefully refreshing network info cache for instance {{(pid=74613) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 29 18:13:38 user nova-compute[74613]: DEBUG nova.network.neutron [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] [instance: 69109f06-acbf-4834-b05e-80ab6e3f6ea0] Updating instance_info_cache with network_info: [{"id": "e8b2f9b5-0c3a-4f6f-bf96-566c8a779849", "address": "fa:16:3e:da:7a:47", "network": {"id": "21147bc8-b1ac-40d5-8fc0-8dab8ade1ff5", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1502381061-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.246", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b5dc39bc30d84269a7ad073867e36436", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape8b2f9b5-0c", "ovs_interfaceid": "e8b2f9b5-0c3a-4f6f-bf96-566c8a779849", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74613) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 18:13:38 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Releasing lock "refresh_cache-69109f06-acbf-4834-b05e-80ab6e3f6ea0" {{(pid=74613) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 18:13:38 user nova-compute[74613]: DEBUG nova.compute.manager [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] [instance: 69109f06-acbf-4834-b05e-80ab6e3f6ea0] Updated the network info_cache for instance {{(pid=74613) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 29 18:13:38 user nova-compute[74613]: DEBUG oslo_service.periodic_task [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74613) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 18:13:38 user nova-compute[74613]: DEBUG oslo_service.periodic_task [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74613) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 18:13:38 user nova-compute[74613]: DEBUG nova.compute.manager [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74613) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 29 18:13:39 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:13:39 user nova-compute[74613]: DEBUG oslo_service.periodic_task [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74613) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 18:13:40 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:13:44 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:13:45 user nova-compute[74613]: DEBUG oslo_service.periodic_task [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74613) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 18:13:46 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-ab7fd62b-7ddc-447a-bd88-b69791003b80 tempest-TestVolumeBootPattern-1318569205 tempest-TestVolumeBootPattern-1318569205-project-member] Acquiring lock "ca290abd-2eb9-43ec-b212-b1cfe1fdf35c" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 18:13:46 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-ab7fd62b-7ddc-447a-bd88-b69791003b80 tempest-TestVolumeBootPattern-1318569205 tempest-TestVolumeBootPattern-1318569205-project-member] Lock "ca290abd-2eb9-43ec-b212-b1cfe1fdf35c" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 18:13:46 user nova-compute[74613]: DEBUG nova.compute.manager [None req-ab7fd62b-7ddc-447a-bd88-b69791003b80 tempest-TestVolumeBootPattern-1318569205 tempest-TestVolumeBootPattern-1318569205-project-member] [instance: ca290abd-2eb9-43ec-b212-b1cfe1fdf35c] Starting instance... {{(pid=74613) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 29 18:13:46 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-ab7fd62b-7ddc-447a-bd88-b69791003b80 tempest-TestVolumeBootPattern-1318569205 tempest-TestVolumeBootPattern-1318569205-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 18:13:46 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-ab7fd62b-7ddc-447a-bd88-b69791003b80 tempest-TestVolumeBootPattern-1318569205 tempest-TestVolumeBootPattern-1318569205-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 18:13:46 user nova-compute[74613]: DEBUG nova.virt.hardware [None req-ab7fd62b-7ddc-447a-bd88-b69791003b80 tempest-TestVolumeBootPattern-1318569205 tempest-TestVolumeBootPattern-1318569205-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74613) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 29 18:13:46 user nova-compute[74613]: INFO nova.compute.claims [None req-ab7fd62b-7ddc-447a-bd88-b69791003b80 tempest-TestVolumeBootPattern-1318569205 tempest-TestVolumeBootPattern-1318569205-project-member] [instance: ca290abd-2eb9-43ec-b212-b1cfe1fdf35c] Claim successful on node user
Nov 29 18:13:46 user nova-compute[74613]: DEBUG nova.compute.provider_tree [None req-ab7fd62b-7ddc-447a-bd88-b69791003b80 tempest-TestVolumeBootPattern-1318569205 tempest-TestVolumeBootPattern-1318569205-project-member] Inventory has not changed in ProviderTree for provider: 639d980e-3b12-44b1-b8f4-1812416fa4dd {{(pid=74613) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 18:13:46 user nova-compute[74613]: DEBUG nova.scheduler.client.report [None req-ab7fd62b-7ddc-447a-bd88-b69791003b80 tempest-TestVolumeBootPattern-1318569205 tempest-TestVolumeBootPattern-1318569205-project-member] Inventory has not changed for provider 639d980e-3b12-44b1-b8f4-1812416fa4dd based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74613) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 18:13:46 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-ab7fd62b-7ddc-447a-bd88-b69791003b80 tempest-TestVolumeBootPattern-1318569205 tempest-TestVolumeBootPattern-1318569205-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.291s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 18:13:46 user nova-compute[74613]: DEBUG nova.compute.manager [None req-ab7fd62b-7ddc-447a-bd88-b69791003b80 tempest-TestVolumeBootPattern-1318569205 tempest-TestVolumeBootPattern-1318569205-project-member] [instance: ca290abd-2eb9-43ec-b212-b1cfe1fdf35c] Start building networks asynchronously for instance. {{(pid=74613) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 29 18:13:46 user nova-compute[74613]: DEBUG nova.compute.manager [None req-ab7fd62b-7ddc-447a-bd88-b69791003b80 tempest-TestVolumeBootPattern-1318569205 tempest-TestVolumeBootPattern-1318569205-project-member] [instance: ca290abd-2eb9-43ec-b212-b1cfe1fdf35c] Allocating IP information in the background. {{(pid=74613) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 29 18:13:46 user nova-compute[74613]: DEBUG nova.network.neutron [None req-ab7fd62b-7ddc-447a-bd88-b69791003b80 tempest-TestVolumeBootPattern-1318569205 tempest-TestVolumeBootPattern-1318569205-project-member] [instance: ca290abd-2eb9-43ec-b212-b1cfe1fdf35c] allocate_for_instance() {{(pid=74613) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 29 18:13:46 user nova-compute[74613]: INFO nova.virt.libvirt.driver [None req-ab7fd62b-7ddc-447a-bd88-b69791003b80 tempest-TestVolumeBootPattern-1318569205 tempest-TestVolumeBootPattern-1318569205-project-member] [instance: ca290abd-2eb9-43ec-b212-b1cfe1fdf35c] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 29 18:13:46 user nova-compute[74613]: DEBUG nova.compute.manager [None req-ab7fd62b-7ddc-447a-bd88-b69791003b80 tempest-TestVolumeBootPattern-1318569205 tempest-TestVolumeBootPattern-1318569205-project-member] [instance: ca290abd-2eb9-43ec-b212-b1cfe1fdf35c] Start building block device mappings for instance. {{(pid=74613) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 29 18:13:46 user nova-compute[74613]: INFO nova.virt.block_device [None req-ab7fd62b-7ddc-447a-bd88-b69791003b80 tempest-TestVolumeBootPattern-1318569205 tempest-TestVolumeBootPattern-1318569205-project-member] [instance: ca290abd-2eb9-43ec-b212-b1cfe1fdf35c] Booting with volume snapshot ca104702-9417-4196-8baf-f92b49c761d6 at /dev/vda
Nov 29 18:13:46 user nova-compute[74613]: DEBUG nova.policy [None req-ab7fd62b-7ddc-447a-bd88-b69791003b80 tempest-TestVolumeBootPattern-1318569205 tempest-TestVolumeBootPattern-1318569205-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'bedbc6ed47394e2b9125543a8b88a71f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67390f1402214191904cfbd68c3142a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74613) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 29 18:13:47 user nova-compute[74613]: DEBUG nova.objects.instance [None req-e42e3e19-12fb-4442-89f4-584d7eb17bec tempest-AttachVolumeTestJSON-813984703 tempest-AttachVolumeTestJSON-813984703-project-member] Lazy-loading 'flavor' on Instance uuid 69109f06-acbf-4834-b05e-80ab6e3f6ea0 {{(pid=74613) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 18:13:47 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-e42e3e19-12fb-4442-89f4-584d7eb17bec tempest-AttachVolumeTestJSON-813984703 tempest-AttachVolumeTestJSON-813984703-project-member] Acquiring lock "refresh_cache-69109f06-acbf-4834-b05e-80ab6e3f6ea0" {{(pid=74613) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 18:13:47 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-e42e3e19-12fb-4442-89f4-584d7eb17bec tempest-AttachVolumeTestJSON-813984703 tempest-AttachVolumeTestJSON-813984703-project-member] Acquired lock "refresh_cache-69109f06-acbf-4834-b05e-80ab6e3f6ea0" {{(pid=74613) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 18:13:47 user nova-compute[74613]: DEBUG nova.network.neutron [None req-e42e3e19-12fb-4442-89f4-584d7eb17bec tempest-AttachVolumeTestJSON-813984703 tempest-AttachVolumeTestJSON-813984703-project-member] [instance: 69109f06-acbf-4834-b05e-80ab6e3f6ea0] Building network info cache for instance {{(pid=74613) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 29 18:13:47 user nova-compute[74613]: DEBUG nova.objects.instance [None req-e42e3e19-12fb-4442-89f4-584d7eb17bec tempest-AttachVolumeTestJSON-813984703 tempest-AttachVolumeTestJSON-813984703-project-member] Lazy-loading 'info_cache' on Instance uuid 69109f06-acbf-4834-b05e-80ab6e3f6ea0 {{(pid=74613) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 18:13:47 user nova-compute[74613]: DEBUG nova.objects.base [None req-e42e3e19-12fb-4442-89f4-584d7eb17bec tempest-AttachVolumeTestJSON-813984703 tempest-AttachVolumeTestJSON-813984703-project-member] Object Instance<69109f06-acbf-4834-b05e-80ab6e3f6ea0> lazy-loaded attributes: flavor,info_cache {{(pid=74613) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 29 18:13:47 user nova-compute[74613]: DEBUG nova.network.neutron [None req-ab7fd62b-7ddc-447a-bd88-b69791003b80 tempest-TestVolumeBootPattern-1318569205 tempest-TestVolumeBootPattern-1318569205-project-member] [instance: ca290abd-2eb9-43ec-b212-b1cfe1fdf35c] Successfully created port: a0a4c680-262b-4bff-b523-0bc7a27baa88 {{(pid=74613) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 29 18:13:47 user nova-compute[74613]: DEBUG nova.network.neutron [None req-e42e3e19-12fb-4442-89f4-584d7eb17bec tempest-AttachVolumeTestJSON-813984703 tempest-AttachVolumeTestJSON-813984703-project-member] [instance: 69109f06-acbf-4834-b05e-80ab6e3f6ea0] Updating instance_info_cache with network_info: [{"id": "e8b2f9b5-0c3a-4f6f-bf96-566c8a779849", "address": "fa:16:3e:da:7a:47", "network": {"id": "21147bc8-b1ac-40d5-8fc0-8dab8ade1ff5", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1502381061-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.246", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b5dc39bc30d84269a7ad073867e36436", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape8b2f9b5-0c", "ovs_interfaceid": "e8b2f9b5-0c3a-4f6f-bf96-566c8a779849", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74613) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 18:13:47 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-e42e3e19-12fb-4442-89f4-584d7eb17bec tempest-AttachVolumeTestJSON-813984703 tempest-AttachVolumeTestJSON-813984703-project-member] Releasing lock "refresh_cache-69109f06-acbf-4834-b05e-80ab6e3f6ea0" {{(pid=74613) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 18:13:47 user nova-compute[74613]: INFO nova.virt.libvirt.driver [-] [instance: 69109f06-acbf-4834-b05e-80ab6e3f6ea0] Instance destroyed successfully.
Nov 29 18:13:47 user nova-compute[74613]: DEBUG nova.objects.instance [None req-e42e3e19-12fb-4442-89f4-584d7eb17bec tempest-AttachVolumeTestJSON-813984703 tempest-AttachVolumeTestJSON-813984703-project-member] Lazy-loading 'resources' on Instance uuid 69109f06-acbf-4834-b05e-80ab6e3f6ea0 {{(pid=74613) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 18:13:47 user nova-compute[74613]: DEBUG nova.objects.base [None req-e42e3e19-12fb-4442-89f4-584d7eb17bec tempest-AttachVolumeTestJSON-813984703 tempest-AttachVolumeTestJSON-813984703-project-member] Object Instance<69109f06-acbf-4834-b05e-80ab6e3f6ea0> lazy-loaded attributes: flavor,info_cache,resources {{(pid=74613) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 29 18:13:47 user nova-compute[74613]: DEBUG nova.virt.libvirt.vif [None req-e42e3e19-12fb-4442-89f4-584d7eb17bec tempest-AttachVolumeTestJSON-813984703 tempest-AttachVolumeTestJSON-813984703-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T18:05:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-112129053',display_name='tempest-AttachVolumeTestJSON-server-112129053',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-112129053',id=31,image_ref='4217f428-8d9d-4ee1-9614-642d26d90c46',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBiA6TF+XgKgtvk6TtvUc4C6ae4R2cFJpd7pnrnZXTn17B7mtXw3FeSD7WciMYISZgM0lnyM/Vu+rh9AL6QLxayu8zBkp18LuuA17FBMijpeZLWA1S8luzqDoaFtKzv2Kw==',key_name='tempest-keypair-1770317456',keypairs=<?>,launch_index=0,launched_at=2023-11-29T18:05:52Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='b5dc39bc30d84269a7ad073867e36436',ramdisk_id='',reservation_id='r-dq3ksvj9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='4217f428-8d9d-4ee1-9614-642d26d90c46',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-813984703',owner_user_name='tempest-AttachVolumeTestJSON-813984703-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-29T18:11:57Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='14808f06536f477b8a2b413e3cf9d18f',uuid=69109f06-acbf-4834-b05e-80ab6e3f6ea0,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "e8b2f9b5-0c3a-4f6f-bf96-566c8a779849", "address": "fa:16:3e:da:7a:47", "network": {"id": "21147bc8-b1ac-40d5-8fc0-8dab8ade1ff5", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1502381061-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.246", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b5dc39bc30d84269a7ad073867e36436", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape8b2f9b5-0c", "ovs_interfaceid": "e8b2f9b5-0c3a-4f6f-bf96-566c8a779849", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74613) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 29 18:13:47 user nova-compute[74613]: DEBUG nova.network.os_vif_util [None req-e42e3e19-12fb-4442-89f4-584d7eb17bec tempest-AttachVolumeTestJSON-813984703 tempest-AttachVolumeTestJSON-813984703-project-member] Converting VIF {"id": "e8b2f9b5-0c3a-4f6f-bf96-566c8a779849", "address": "fa:16:3e:da:7a:47", "network": {"id": "21147bc8-b1ac-40d5-8fc0-8dab8ade1ff5", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1502381061-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.246", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b5dc39bc30d84269a7ad073867e36436", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape8b2f9b5-0c", "ovs_interfaceid": "e8b2f9b5-0c3a-4f6f-bf96-566c8a779849", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74613) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 18:13:47 user nova-compute[74613]: DEBUG nova.network.os_vif_util [None req-e42e3e19-12fb-4442-89f4-584d7eb17bec tempest-AttachVolumeTestJSON-813984703 tempest-AttachVolumeTestJSON-813984703-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:da:7a:47,bridge_name='br-int',has_traffic_filtering=True,id=e8b2f9b5-0c3a-4f6f-bf96-566c8a779849,network=Network(21147bc8-b1ac-40d5-8fc0-8dab8ade1ff5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape8b2f9b5-0c') {{(pid=74613) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 18:13:47 user nova-compute[74613]: DEBUG os_vif [None req-e42e3e19-12fb-4442-89f4-584d7eb17bec tempest-AttachVolumeTestJSON-813984703 tempest-AttachVolumeTestJSON-813984703-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:da:7a:47,bridge_name='br-int',has_traffic_filtering=True,id=e8b2f9b5-0c3a-4f6f-bf96-566c8a779849,network=Network(21147bc8-b1ac-40d5-8fc0-8dab8ade1ff5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape8b2f9b5-0c') {{(pid=74613) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 29 18:13:47 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:13:47 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tape8b2f9b5-0c, bridge=br-int, if_exists=True) {{(pid=74613) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 18:13:47 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:13:47 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 18:13:47 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:13:47 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=e3ecc97a-211d-4477-96d1-59a6f1178ad8) {{(pid=74613) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 18:13:47 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:13:47 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 18:13:47 user nova-compute[74613]: INFO os_vif [None req-e42e3e19-12fb-4442-89f4-584d7eb17bec tempest-AttachVolumeTestJSON-813984703 tempest-AttachVolumeTestJSON-813984703-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:da:7a:47,bridge_name='br-int',has_traffic_filtering=True,id=e8b2f9b5-0c3a-4f6f-bf96-566c8a779849,network=Network(21147bc8-b1ac-40d5-8fc0-8dab8ade1ff5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape8b2f9b5-0c')
Nov 29 18:13:47 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-e42e3e19-12fb-4442-89f4-584d7eb17bec tempest-AttachVolumeTestJSON-813984703 tempest-AttachVolumeTestJSON-813984703-project-member] [instance: 69109f06-acbf-4834-b05e-80ab6e3f6ea0] Start _get_guest_xml network_info=[{"id": "e8b2f9b5-0c3a-4f6f-bf96-566c8a779849", "address": "fa:16:3e:da:7a:47", "network": {"id": "21147bc8-b1ac-40d5-8fc0-8dab8ade1ff5", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1502381061-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.246", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b5dc39bc30d84269a7ad073867e36436", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape8b2f9b5-0c", "ovs_interfaceid": "e8b2f9b5-0c3a-4f6f-bf96-566c8a779849", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=4217f428-8d9d-4ee1-9614-642d26d90c46,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'size': 0, 'device_type': 'disk', 'boot_index': 0, 'guest_format': None, 'encrypted': False, 'encryption_format': None, 'disk_bus': 'virtio', 'image_id': '4217f428-8d9d-4ee1-9614-642d26d90c46'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74613) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 29 18:13:47 user nova-compute[74613]: DEBUG nova.objects.instance [None req-e42e3e19-12fb-4442-89f4-584d7eb17bec tempest-AttachVolumeTestJSON-813984703 tempest-AttachVolumeTestJSON-813984703-project-member] Lazy-loading 'numa_topology' on Instance uuid 69109f06-acbf-4834-b05e-80ab6e3f6ea0 {{(pid=74613) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 18:13:47 user nova-compute[74613]: DEBUG nova.objects.base [None req-e42e3e19-12fb-4442-89f4-584d7eb17bec tempest-AttachVolumeTestJSON-813984703 tempest-AttachVolumeTestJSON-813984703-project-member] Object Instance<69109f06-acbf-4834-b05e-80ab6e3f6ea0> lazy-loaded attributes: flavor,info_cache,resources,numa_topology {{(pid=74613) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 29 18:13:47 user nova-compute[74613]: WARNING nova.virt.libvirt.driver [None req-e42e3e19-12fb-4442-89f4-584d7eb17bec tempest-AttachVolumeTestJSON-813984703 tempest-AttachVolumeTestJSON-813984703-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 18:13:47 user nova-compute[74613]: WARNING nova.virt.libvirt.driver [None req-e42e3e19-12fb-4442-89f4-584d7eb17bec tempest-AttachVolumeTestJSON-813984703 tempest-AttachVolumeTestJSON-813984703-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 18:13:47 user nova-compute[74613]: DEBUG nova.virt.libvirt.host [None req-e42e3e19-12fb-4442-89f4-584d7eb17bec tempest-AttachVolumeTestJSON-813984703 tempest-AttachVolumeTestJSON-813984703-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74613) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 29 18:13:47 user nova-compute[74613]: DEBUG nova.virt.libvirt.host [None req-e42e3e19-12fb-4442-89f4-584d7eb17bec tempest-AttachVolumeTestJSON-813984703 tempest-AttachVolumeTestJSON-813984703-project-member] CPU controller missing on host. {{(pid=74613) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 29 18:13:47 user nova-compute[74613]: DEBUG nova.virt.libvirt.host [None req-e42e3e19-12fb-4442-89f4-584d7eb17bec tempest-AttachVolumeTestJSON-813984703 tempest-AttachVolumeTestJSON-813984703-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74613) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 29 18:13:47 user nova-compute[74613]: DEBUG nova.virt.libvirt.host [None req-e42e3e19-12fb-4442-89f4-584d7eb17bec tempest-AttachVolumeTestJSON-813984703 tempest-AttachVolumeTestJSON-813984703-project-member] CPU controller found on host. {{(pid=74613) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 29 18:13:47 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-e42e3e19-12fb-4442-89f4-584d7eb17bec tempest-AttachVolumeTestJSON-813984703 tempest-AttachVolumeTestJSON-813984703-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74613) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 29 18:13:47 user nova-compute[74613]: DEBUG nova.virt.hardware [None req-e42e3e19-12fb-4442-89f4-584d7eb17bec tempest-AttachVolumeTestJSON-813984703 tempest-AttachVolumeTestJSON-813984703-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-29T17:47:27Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=4217f428-8d9d-4ee1-9614-642d26d90c46,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74613) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 29 18:13:47 user nova-compute[74613]: DEBUG nova.virt.hardware [None req-e42e3e19-12fb-4442-89f4-584d7eb17bec tempest-AttachVolumeTestJSON-813984703 tempest-AttachVolumeTestJSON-813984703-project-member] Flavor limits 0:0:0 {{(pid=74613) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 29 18:13:47 user nova-compute[74613]: DEBUG nova.virt.hardware [None req-e42e3e19-12fb-4442-89f4-584d7eb17bec tempest-AttachVolumeTestJSON-813984703 tempest-AttachVolumeTestJSON-813984703-project-member] Image limits 0:0:0 {{(pid=74613) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 29 18:13:47 user nova-compute[74613]: DEBUG nova.virt.hardware [None req-e42e3e19-12fb-4442-89f4-584d7eb17bec tempest-AttachVolumeTestJSON-813984703 tempest-AttachVolumeTestJSON-813984703-project-member] Flavor pref 0:0:0 {{(pid=74613) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 29 18:13:47 user nova-compute[74613]: DEBUG nova.virt.hardware [None req-e42e3e19-12fb-4442-89f4-584d7eb17bec tempest-AttachVolumeTestJSON-813984703 tempest-AttachVolumeTestJSON-813984703-project-member] Image pref 0:0:0 {{(pid=74613) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 29 18:13:47 user nova-compute[74613]: DEBUG nova.virt.hardware [None req-e42e3e19-12fb-4442-89f4-584d7eb17bec tempest-AttachVolumeTestJSON-813984703 tempest-AttachVolumeTestJSON-813984703-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74613) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 29 18:13:47 user nova-compute[74613]: DEBUG nova.virt.hardware [None req-e42e3e19-12fb-4442-89f4-584d7eb17bec tempest-AttachVolumeTestJSON-813984703 tempest-AttachVolumeTestJSON-813984703-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74613) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 29 18:13:47 user nova-compute[74613]: DEBUG nova.virt.hardware [None req-e42e3e19-12fb-4442-89f4-584d7eb17bec tempest-AttachVolumeTestJSON-813984703 tempest-AttachVolumeTestJSON-813984703-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74613) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 29 18:13:47 user nova-compute[74613]: DEBUG nova.virt.hardware [None req-e42e3e19-12fb-4442-89f4-584d7eb17bec tempest-AttachVolumeTestJSON-813984703 tempest-AttachVolumeTestJSON-813984703-project-member] Got 1 possible topologies {{(pid=74613) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 29 18:13:47 user nova-compute[74613]: DEBUG nova.virt.hardware [None req-e42e3e19-12fb-4442-89f4-584d7eb17bec tempest-AttachVolumeTestJSON-813984703 tempest-AttachVolumeTestJSON-813984703-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74613) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 29 18:13:47 user nova-compute[74613]: DEBUG nova.virt.hardware [None req-e42e3e19-12fb-4442-89f4-584d7eb17bec tempest-AttachVolumeTestJSON-813984703 tempest-AttachVolumeTestJSON-813984703-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74613) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 29 18:13:47 user nova-compute[74613]: DEBUG nova.objects.instance [None req-e42e3e19-12fb-4442-89f4-584d7eb17bec tempest-AttachVolumeTestJSON-813984703 tempest-AttachVolumeTestJSON-813984703-project-member] Lazy-loading 'vcpu_model' on Instance uuid 69109f06-acbf-4834-b05e-80ab6e3f6ea0 {{(pid=74613) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 18:13:47 user nova-compute[74613]: DEBUG nova.objects.base [None req-e42e3e19-12fb-4442-89f4-584d7eb17bec tempest-AttachVolumeTestJSON-813984703 tempest-AttachVolumeTestJSON-813984703-project-member] Object Instance<69109f06-acbf-4834-b05e-80ab6e3f6ea0> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model {{(pid=74613) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 29 18:13:47 user nova-compute[74613]: DEBUG nova.virt.libvirt.vif [None req-e42e3e19-12fb-4442-89f4-584d7eb17bec tempest-AttachVolumeTestJSON-813984703 tempest-AttachVolumeTestJSON-813984703-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T18:05:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-112129053',display_name='tempest-AttachVolumeTestJSON-server-112129053',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-112129053',id=31,image_ref='4217f428-8d9d-4ee1-9614-642d26d90c46',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBiA6TF+XgKgtvk6TtvUc4C6ae4R2cFJpd7pnrnZXTn17B7mtXw3FeSD7WciMYISZgM0lnyM/Vu+rh9AL6QLxayu8zBkp18LuuA17FBMijpeZLWA1S8luzqDoaFtKzv2Kw==',key_name='tempest-keypair-1770317456',keypairs=<?>,launch_index=0,launched_at=2023-11-29T18:05:52Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='b5dc39bc30d84269a7ad073867e36436',ramdisk_id='',reservation_id='r-dq3ksvj9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='4217f428-8d9d-4ee1-9614-642d26d90c46',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-813984703',owner_user_name='tempest-AttachVolumeTestJSON-813984703-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-29T18:11:57Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='14808f06536f477b8a2b413e3cf9d18f',uuid=69109f06-acbf-4834-b05e-80ab6e3f6ea0,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "e8b2f9b5-0c3a-4f6f-bf96-566c8a779849", "address": "fa:16:3e:da:7a:47", "network": {"id": "21147bc8-b1ac-40d5-8fc0-8dab8ade1ff5", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1502381061-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.246", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b5dc39bc30d84269a7ad073867e36436", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape8b2f9b5-0c", "ovs_interfaceid": "e8b2f9b5-0c3a-4f6f-bf96-566c8a779849", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74613) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 29 18:13:47 user nova-compute[74613]: DEBUG nova.network.os_vif_util [None req-e42e3e19-12fb-4442-89f4-584d7eb17bec tempest-AttachVolumeTestJSON-813984703 tempest-AttachVolumeTestJSON-813984703-project-member] Converting VIF {"id": "e8b2f9b5-0c3a-4f6f-bf96-566c8a779849", "address": "fa:16:3e:da:7a:47", "network": {"id": "21147bc8-b1ac-40d5-8fc0-8dab8ade1ff5", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1502381061-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.246", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b5dc39bc30d84269a7ad073867e36436", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape8b2f9b5-0c", "ovs_interfaceid": "e8b2f9b5-0c3a-4f6f-bf96-566c8a779849", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74613) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 18:13:47 user nova-compute[74613]: DEBUG nova.network.os_vif_util [None req-e42e3e19-12fb-4442-89f4-584d7eb17bec tempest-AttachVolumeTestJSON-813984703 tempest-AttachVolumeTestJSON-813984703-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:da:7a:47,bridge_name='br-int',has_traffic_filtering=True,id=e8b2f9b5-0c3a-4f6f-bf96-566c8a779849,network=Network(21147bc8-b1ac-40d5-8fc0-8dab8ade1ff5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape8b2f9b5-0c') {{(pid=74613) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 18:13:47 user nova-compute[74613]: DEBUG nova.objects.instance [None req-e42e3e19-12fb-4442-89f4-584d7eb17bec tempest-AttachVolumeTestJSON-813984703 tempest-AttachVolumeTestJSON-813984703-project-member] Lazy-loading 'pci_devices' on Instance uuid 69109f06-acbf-4834-b05e-80ab6e3f6ea0 {{(pid=74613) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 18:13:47 user nova-compute[74613]: DEBUG nova.objects.base [None req-e42e3e19-12fb-4442-89f4-584d7eb17bec tempest-AttachVolumeTestJSON-813984703 tempest-AttachVolumeTestJSON-813984703-project-member] Object Instance<69109f06-acbf-4834-b05e-80ab6e3f6ea0> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model,pci_devices {{(pid=74613) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 29 18:13:47 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-e42e3e19-12fb-4442-89f4-584d7eb17bec tempest-AttachVolumeTestJSON-813984703 tempest-AttachVolumeTestJSON-813984703-project-member] [instance: 69109f06-acbf-4834-b05e-80ab6e3f6ea0] End _get_guest_xml xml=<domain type="kvm">
Nov 29 18:13:47 user nova-compute[74613]:   <uuid>69109f06-acbf-4834-b05e-80ab6e3f6ea0</uuid>
Nov 29 18:13:47 user nova-compute[74613]:   <name>instance-0000001f</name>
Nov 29 18:13:47 user nova-compute[74613]:   <memory>524288</memory>
Nov 29 18:13:47 user nova-compute[74613]:   <vcpu>1</vcpu>
Nov 29 18:13:47 user nova-compute[74613]:   <metadata>
Nov 29 18:13:47 user nova-compute[74613]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 29 18:13:47 user nova-compute[74613]:       <nova:package version="0.0.0"/>
Nov 29 18:13:47 user nova-compute[74613]:       <nova:name>tempest-AttachVolumeTestJSON-server-112129053</nova:name>
Nov 29 18:13:47 user nova-compute[74613]:       <nova:creationTime>2023-11-29 18:13:47</nova:creationTime>
Nov 29 18:13:47 user nova-compute[74613]:       <nova:flavor name="m1.tiny">
Nov 29 18:13:47 user nova-compute[74613]:         <nova:memory>512</nova:memory>
Nov 29 18:13:47 user nova-compute[74613]:         <nova:disk>1</nova:disk>
Nov 29 18:13:47 user nova-compute[74613]:         <nova:swap>0</nova:swap>
Nov 29 18:13:47 user nova-compute[74613]:         <nova:ephemeral>0</nova:ephemeral>
Nov 29 18:13:47 user nova-compute[74613]:         <nova:vcpus>1</nova:vcpus>
Nov 29 18:13:47 user nova-compute[74613]:       </nova:flavor>
Nov 29 18:13:47 user nova-compute[74613]:       <nova:owner>
Nov 29 18:13:47 user nova-compute[74613]:         <nova:user uuid="14808f06536f477b8a2b413e3cf9d18f">tempest-AttachVolumeTestJSON-813984703-project-member</nova:user>
Nov 29 18:13:47 user nova-compute[74613]:         <nova:project uuid="b5dc39bc30d84269a7ad073867e36436">tempest-AttachVolumeTestJSON-813984703</nova:project>
Nov 29 18:13:47 user nova-compute[74613]:       </nova:owner>
Nov 29 18:13:47 user nova-compute[74613]:       <nova:root type="image" uuid="4217f428-8d9d-4ee1-9614-642d26d90c46"/>
Nov 29 18:13:47 user nova-compute[74613]:       <nova:ports>
Nov 29 18:13:47 user nova-compute[74613]:         <nova:port uuid="e8b2f9b5-0c3a-4f6f-bf96-566c8a779849">
Nov 29 18:13:47 user nova-compute[74613]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Nov 29 18:13:47 user nova-compute[74613]:         </nova:port>
Nov 29 18:13:47 user nova-compute[74613]:       </nova:ports>
Nov 29 18:13:47 user nova-compute[74613]:     </nova:instance>
Nov 29 18:13:47 user nova-compute[74613]:   </metadata>
Nov 29 18:13:47 user nova-compute[74613]:   <sysinfo type="smbios">
Nov 29 18:13:47 user nova-compute[74613]:     <system>
Nov 29 18:13:47 user nova-compute[74613]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 29 18:13:47 user nova-compute[74613]:       <entry name="product">OpenStack Nova</entry>
Nov 29 18:13:47 user nova-compute[74613]:       <entry name="version">0.0.0</entry>
Nov 29 18:13:47 user nova-compute[74613]:       <entry name="serial">69109f06-acbf-4834-b05e-80ab6e3f6ea0</entry>
Nov 29 18:13:47 user nova-compute[74613]:       <entry name="uuid">69109f06-acbf-4834-b05e-80ab6e3f6ea0</entry>
Nov 29 18:13:47 user nova-compute[74613]:       <entry name="family">Virtual Machine</entry>
Nov 29 18:13:47 user nova-compute[74613]:     </system>
Nov 29 18:13:47 user nova-compute[74613]:   </sysinfo>
Nov 29 18:13:47 user nova-compute[74613]:   <os>
Nov 29 18:13:47 user nova-compute[74613]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 29 18:13:47 user nova-compute[74613]:     <boot dev="hd"/>
Nov 29 18:13:47 user nova-compute[74613]:     <smbios mode="sysinfo"/>
Nov 29 18:13:47 user nova-compute[74613]:   </os>
Nov 29 18:13:47 user nova-compute[74613]:   <features>
Nov 29 18:13:47 user nova-compute[74613]:     <acpi/>
Nov 29 18:13:47 user nova-compute[74613]:     <apic/>
Nov 29 18:13:47 user nova-compute[74613]:     <vmcoreinfo/>
Nov 29 18:13:47 user nova-compute[74613]:   </features>
Nov 29 18:13:47 user nova-compute[74613]:   <clock offset="utc">
Nov 29 18:13:47 user nova-compute[74613]:     <timer name="pit" tickpolicy="delay"/>
Nov 29 18:13:47 user nova-compute[74613]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 29 18:13:47 user nova-compute[74613]:     <timer name="hpet" present="no"/>
Nov 29 18:13:47 user nova-compute[74613]:   </clock>
Nov 29 18:13:47 user nova-compute[74613]:   <cpu mode="custom" match="exact">
Nov 29 18:13:47 user nova-compute[74613]:     <model>Nehalem</model>
Nov 29 18:13:47 user nova-compute[74613]:     <topology sockets="1" cores="1" threads="1"/>
Nov 29 18:13:47 user nova-compute[74613]:   </cpu>
Nov 29 18:13:47 user nova-compute[74613]:   <devices>
Nov 29 18:13:47 user nova-compute[74613]:     <disk type="file" device="disk">
Nov 29 18:13:47 user nova-compute[74613]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 29 18:13:47 user nova-compute[74613]:       <source file="/opt/stack/data/nova/instances/69109f06-acbf-4834-b05e-80ab6e3f6ea0/disk"/>
Nov 29 18:13:47 user nova-compute[74613]:       <target dev="vda" bus="virtio"/>
Nov 29 18:13:47 user nova-compute[74613]:     </disk>
Nov 29 18:13:47 user nova-compute[74613]:     <interface type="ethernet">
Nov 29 18:13:47 user nova-compute[74613]:       <mac address="fa:16:3e:da:7a:47"/>
Nov 29 18:13:47 user nova-compute[74613]:       <model type="virtio"/>
Nov 29 18:13:47 user nova-compute[74613]:       <mtu size="1442"/>
Nov 29 18:13:47 user nova-compute[74613]:       <target dev="tape8b2f9b5-0c"/>
Nov 29 18:13:47 user nova-compute[74613]:     </interface>
Nov 29 18:13:47 user nova-compute[74613]:     <serial type="pty">
Nov 29 18:13:47 user nova-compute[74613]:       <log file="/opt/stack/data/nova/instances/69109f06-acbf-4834-b05e-80ab6e3f6ea0/console.log" append="off"/>
Nov 29 18:13:47 user nova-compute[74613]:     </serial>
Nov 29 18:13:47 user nova-compute[74613]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 29 18:13:47 user nova-compute[74613]:     <video>
Nov 29 18:13:47 user nova-compute[74613]:       <model type="virtio"/>
Nov 29 18:13:47 user nova-compute[74613]:     </video>
Nov 29 18:13:47 user nova-compute[74613]:     <rng model="virtio">
Nov 29 18:13:47 user nova-compute[74613]:       <backend model="random">/dev/urandom</backend>
Nov 29 18:13:47 user nova-compute[74613]:     </rng>
Nov 29 18:13:47 user nova-compute[74613]:     <controller type="usb" index="0" model="none"/>
Nov 29 18:13:47 user nova-compute[74613]:     <memballoon model="virtio">
Nov 29 18:13:47 user nova-compute[74613]:       <stats period="10"/>
Nov 29 18:13:47 user nova-compute[74613]:     </memballoon>
Nov 29 18:13:47 user nova-compute[74613]:   </devices>
Nov 29 18:13:47 user nova-compute[74613]: </domain>
Nov 29 18:13:47 user nova-compute[74613]:  {{(pid=74613) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 29 18:13:47 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-e42e3e19-12fb-4442-89f4-584d7eb17bec tempest-AttachVolumeTestJSON-813984703 tempest-AttachVolumeTestJSON-813984703-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/69109f06-acbf-4834-b05e-80ab6e3f6ea0/disk --force-share --output=json {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:13:48 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-e42e3e19-12fb-4442-89f4-584d7eb17bec tempest-AttachVolumeTestJSON-813984703 tempest-AttachVolumeTestJSON-813984703-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/69109f06-acbf-4834-b05e-80ab6e3f6ea0/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:13:48 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-e42e3e19-12fb-4442-89f4-584d7eb17bec tempest-AttachVolumeTestJSON-813984703 tempest-AttachVolumeTestJSON-813984703-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/69109f06-acbf-4834-b05e-80ab6e3f6ea0/disk --force-share --output=json {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:13:48 user nova-compute[74613]: DEBUG nova.network.neutron [None req-ab7fd62b-7ddc-447a-bd88-b69791003b80 tempest-TestVolumeBootPattern-1318569205 tempest-TestVolumeBootPattern-1318569205-project-member] [instance: ca290abd-2eb9-43ec-b212-b1cfe1fdf35c] Successfully updated port: a0a4c680-262b-4bff-b523-0bc7a27baa88 {{(pid=74613) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 29 18:13:48 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-ab7fd62b-7ddc-447a-bd88-b69791003b80 tempest-TestVolumeBootPattern-1318569205 tempest-TestVolumeBootPattern-1318569205-project-member] Acquiring lock "refresh_cache-ca290abd-2eb9-43ec-b212-b1cfe1fdf35c" {{(pid=74613) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 18:13:48 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-ab7fd62b-7ddc-447a-bd88-b69791003b80 tempest-TestVolumeBootPattern-1318569205 tempest-TestVolumeBootPattern-1318569205-project-member] Acquired lock "refresh_cache-ca290abd-2eb9-43ec-b212-b1cfe1fdf35c" {{(pid=74613) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 18:13:48 user nova-compute[74613]: DEBUG nova.network.neutron [None req-ab7fd62b-7ddc-447a-bd88-b69791003b80 tempest-TestVolumeBootPattern-1318569205 tempest-TestVolumeBootPattern-1318569205-project-member] [instance: ca290abd-2eb9-43ec-b212-b1cfe1fdf35c] Building network info cache for instance {{(pid=74613) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 29 18:13:48 user nova-compute[74613]: DEBUG nova.compute.manager [req-0f24a127-a5d4-41a2-ad8a-407f0fe2c481 req-01104848-a8e3-4e19-b211-c8373323ce1c service nova] [instance: ca290abd-2eb9-43ec-b212-b1cfe1fdf35c] Received event network-changed-a0a4c680-262b-4bff-b523-0bc7a27baa88 {{(pid=74613) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 18:13:48 user nova-compute[74613]: DEBUG nova.compute.manager [req-0f24a127-a5d4-41a2-ad8a-407f0fe2c481 req-01104848-a8e3-4e19-b211-c8373323ce1c service nova] [instance: ca290abd-2eb9-43ec-b212-b1cfe1fdf35c] Refreshing instance network info cache due to event network-changed-a0a4c680-262b-4bff-b523-0bc7a27baa88. {{(pid=74613) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 18:13:48 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-0f24a127-a5d4-41a2-ad8a-407f0fe2c481 req-01104848-a8e3-4e19-b211-c8373323ce1c service nova] Acquiring lock "refresh_cache-ca290abd-2eb9-43ec-b212-b1cfe1fdf35c" {{(pid=74613) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 18:13:48 user nova-compute[74613]: DEBUG nova.network.neutron [None req-ab7fd62b-7ddc-447a-bd88-b69791003b80 tempest-TestVolumeBootPattern-1318569205 tempest-TestVolumeBootPattern-1318569205-project-member] [instance: ca290abd-2eb9-43ec-b212-b1cfe1fdf35c] Instance cache missing network info. {{(pid=74613) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 29 18:13:48 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-e42e3e19-12fb-4442-89f4-584d7eb17bec tempest-AttachVolumeTestJSON-813984703 tempest-AttachVolumeTestJSON-813984703-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/69109f06-acbf-4834-b05e-80ab6e3f6ea0/disk --force-share --output=json" returned: 0 in 0.223s {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:13:48 user nova-compute[74613]: DEBUG nova.objects.instance [None req-e42e3e19-12fb-4442-89f4-584d7eb17bec tempest-AttachVolumeTestJSON-813984703 tempest-AttachVolumeTestJSON-813984703-project-member] Lazy-loading 'trusted_certs' on Instance uuid 69109f06-acbf-4834-b05e-80ab6e3f6ea0 {{(pid=74613) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 18:13:48 user nova-compute[74613]: DEBUG nova.objects.base [None req-e42e3e19-12fb-4442-89f4-584d7eb17bec tempest-AttachVolumeTestJSON-813984703 tempest-AttachVolumeTestJSON-813984703-project-member] Object Instance<69109f06-acbf-4834-b05e-80ab6e3f6ea0> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model,pci_devices,trusted_certs {{(pid=74613) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 29 18:13:48 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-e42e3e19-12fb-4442-89f4-584d7eb17bec tempest-AttachVolumeTestJSON-813984703 tempest-AttachVolumeTestJSON-813984703-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/21faea9e6951f3bdd0153b76ac89fe1a60a34758 --force-share --output=json {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:13:48 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-e42e3e19-12fb-4442-89f4-584d7eb17bec tempest-AttachVolumeTestJSON-813984703 tempest-AttachVolumeTestJSON-813984703-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/21faea9e6951f3bdd0153b76ac89fe1a60a34758 --force-share --output=json" returned: 0 in 0.172s {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:13:48 user nova-compute[74613]: DEBUG nova.virt.disk.api [None req-e42e3e19-12fb-4442-89f4-584d7eb17bec tempest-AttachVolumeTestJSON-813984703 tempest-AttachVolumeTestJSON-813984703-project-member] Checking if we can resize image /opt/stack/data/nova/instances/69109f06-acbf-4834-b05e-80ab6e3f6ea0/disk. size=1073741824 {{(pid=74613) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 29 18:13:48 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-e42e3e19-12fb-4442-89f4-584d7eb17bec tempest-AttachVolumeTestJSON-813984703 tempest-AttachVolumeTestJSON-813984703-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/69109f06-acbf-4834-b05e-80ab6e3f6ea0/disk --force-share --output=json {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:13:48 user nova-compute[74613]: DEBUG nova.network.neutron [None req-ab7fd62b-7ddc-447a-bd88-b69791003b80 tempest-TestVolumeBootPattern-1318569205 tempest-TestVolumeBootPattern-1318569205-project-member] [instance: ca290abd-2eb9-43ec-b212-b1cfe1fdf35c] Updating instance_info_cache with network_info: [{"id": "a0a4c680-262b-4bff-b523-0bc7a27baa88", "address": "fa:16:3e:15:0b:97", "network": {"id": "4a5179dd-d0b1-44c3-80c1-08dd7b0152f1", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1296336996-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "67390f1402214191904cfbd68c3142a7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa0a4c680-26", "ovs_interfaceid": "a0a4c680-262b-4bff-b523-0bc7a27baa88", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74613) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 18:13:48 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-ab7fd62b-7ddc-447a-bd88-b69791003b80 tempest-TestVolumeBootPattern-1318569205 tempest-TestVolumeBootPattern-1318569205-project-member] Releasing lock "refresh_cache-ca290abd-2eb9-43ec-b212-b1cfe1fdf35c" {{(pid=74613) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 18:13:48 user nova-compute[74613]: DEBUG nova.compute.manager [None req-ab7fd62b-7ddc-447a-bd88-b69791003b80 tempest-TestVolumeBootPattern-1318569205 tempest-TestVolumeBootPattern-1318569205-project-member] [instance: ca290abd-2eb9-43ec-b212-b1cfe1fdf35c] Instance network_info: |[{"id": "a0a4c680-262b-4bff-b523-0bc7a27baa88", "address": "fa:16:3e:15:0b:97", "network": {"id": "4a5179dd-d0b1-44c3-80c1-08dd7b0152f1", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1296336996-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "67390f1402214191904cfbd68c3142a7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa0a4c680-26", "ovs_interfaceid": "a0a4c680-262b-4bff-b523-0bc7a27baa88", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74613) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 29 18:13:48 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-0f24a127-a5d4-41a2-ad8a-407f0fe2c481 req-01104848-a8e3-4e19-b211-c8373323ce1c service nova] Acquired lock "refresh_cache-ca290abd-2eb9-43ec-b212-b1cfe1fdf35c" {{(pid=74613) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 18:13:48 user nova-compute[74613]: DEBUG nova.network.neutron [req-0f24a127-a5d4-41a2-ad8a-407f0fe2c481 req-01104848-a8e3-4e19-b211-c8373323ce1c service nova] [instance: ca290abd-2eb9-43ec-b212-b1cfe1fdf35c] Refreshing network info cache for port a0a4c680-262b-4bff-b523-0bc7a27baa88 {{(pid=74613) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 18:13:48 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-e42e3e19-12fb-4442-89f4-584d7eb17bec tempest-AttachVolumeTestJSON-813984703 tempest-AttachVolumeTestJSON-813984703-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/69109f06-acbf-4834-b05e-80ab6e3f6ea0/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:13:48 user nova-compute[74613]: DEBUG nova.virt.disk.api [None req-e42e3e19-12fb-4442-89f4-584d7eb17bec tempest-AttachVolumeTestJSON-813984703 tempest-AttachVolumeTestJSON-813984703-project-member] Cannot resize image /opt/stack/data/nova/instances/69109f06-acbf-4834-b05e-80ab6e3f6ea0/disk to a smaller size. {{(pid=74613) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 29 18:13:48 user nova-compute[74613]: DEBUG nova.objects.instance [None req-e42e3e19-12fb-4442-89f4-584d7eb17bec tempest-AttachVolumeTestJSON-813984703 tempest-AttachVolumeTestJSON-813984703-project-member] Lazy-loading 'migration_context' on Instance uuid 69109f06-acbf-4834-b05e-80ab6e3f6ea0 {{(pid=74613) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 18:13:48 user nova-compute[74613]: DEBUG nova.objects.base [None req-e42e3e19-12fb-4442-89f4-584d7eb17bec tempest-AttachVolumeTestJSON-813984703 tempest-AttachVolumeTestJSON-813984703-project-member] Object Instance<69109f06-acbf-4834-b05e-80ab6e3f6ea0> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model,pci_devices,trusted_certs,migration_context {{(pid=74613) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 29 18:13:48 user nova-compute[74613]: DEBUG nova.virt.libvirt.vif [None req-e42e3e19-12fb-4442-89f4-584d7eb17bec tempest-AttachVolumeTestJSON-813984703 tempest-AttachVolumeTestJSON-813984703-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T18:05:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-112129053',display_name='tempest-AttachVolumeTestJSON-server-112129053',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-112129053',id=31,image_ref='4217f428-8d9d-4ee1-9614-642d26d90c46',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBiA6TF+XgKgtvk6TtvUc4C6ae4R2cFJpd7pnrnZXTn17B7mtXw3FeSD7WciMYISZgM0lnyM/Vu+rh9AL6QLxayu8zBkp18LuuA17FBMijpeZLWA1S8luzqDoaFtKzv2Kw==',key_name='tempest-keypair-1770317456',keypairs=<?>,launch_index=0,launched_at=2023-11-29T18:05:52Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=<?>,power_state=4,progress=0,project_id='b5dc39bc30d84269a7ad073867e36436',ramdisk_id='',reservation_id='r-dq3ksvj9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='4217f428-8d9d-4ee1-9614-642d26d90c46',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-813984703',owner_user_name='tempest-AttachVolumeTestJSON-813984703-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T18:11:57Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='14808f06536f477b8a2b413e3cf9d18f',uuid=69109f06-acbf-4834-b05e-80ab6e3f6ea0,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "e8b2f9b5-0c3a-4f6f-bf96-566c8a779849", "address": "fa:16:3e:da:7a:47", "network": {"id": "21147bc8-b1ac-40d5-8fc0-8dab8ade1ff5", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1502381061-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.246", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b5dc39bc30d84269a7ad073867e36436", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape8b2f9b5-0c", "ovs_interfaceid": "e8b2f9b5-0c3a-4f6f-bf96-566c8a779849", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74613) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 29 18:13:48 user nova-compute[74613]: DEBUG nova.network.os_vif_util [None req-e42e3e19-12fb-4442-89f4-584d7eb17bec tempest-AttachVolumeTestJSON-813984703 tempest-AttachVolumeTestJSON-813984703-project-member] Converting VIF {"id": "e8b2f9b5-0c3a-4f6f-bf96-566c8a779849", "address": "fa:16:3e:da:7a:47", "network": {"id": "21147bc8-b1ac-40d5-8fc0-8dab8ade1ff5", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1502381061-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.246", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b5dc39bc30d84269a7ad073867e36436", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape8b2f9b5-0c", "ovs_interfaceid": "e8b2f9b5-0c3a-4f6f-bf96-566c8a779849", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74613) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 18:13:48 user nova-compute[74613]: DEBUG nova.network.os_vif_util [None req-e42e3e19-12fb-4442-89f4-584d7eb17bec tempest-AttachVolumeTestJSON-813984703 tempest-AttachVolumeTestJSON-813984703-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:da:7a:47,bridge_name='br-int',has_traffic_filtering=True,id=e8b2f9b5-0c3a-4f6f-bf96-566c8a779849,network=Network(21147bc8-b1ac-40d5-8fc0-8dab8ade1ff5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape8b2f9b5-0c') {{(pid=74613) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 18:13:48 user nova-compute[74613]: DEBUG os_vif [None req-e42e3e19-12fb-4442-89f4-584d7eb17bec tempest-AttachVolumeTestJSON-813984703 tempest-AttachVolumeTestJSON-813984703-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:da:7a:47,bridge_name='br-int',has_traffic_filtering=True,id=e8b2f9b5-0c3a-4f6f-bf96-566c8a779849,network=Network(21147bc8-b1ac-40d5-8fc0-8dab8ade1ff5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape8b2f9b5-0c') {{(pid=74613) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 29 18:13:48 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:13:48 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74613) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 18:13:48 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74613) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 29 18:13:48 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:13:48 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '9dfb5447-3411-50be-bad9-0477e9e5d5d7', '_type': 'linux-noop'}}, row=False) {{(pid=74613) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 18:13:48 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:13:48 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 18:13:48 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:13:48 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tape8b2f9b5-0c, may_exist=True, interface_attrs={}) {{(pid=74613) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 18:13:48 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tape8b2f9b5-0c, col_values=(('qos', UUID('3bd5f531-d7f3-4cad-ba81-4168c05e01ff')),), if_exists=True) {{(pid=74613) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 18:13:48 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tape8b2f9b5-0c, col_values=(('external_ids', {'iface-id': 'e8b2f9b5-0c3a-4f6f-bf96-566c8a779849', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:da:7a:47', 'vm-uuid': '69109f06-acbf-4834-b05e-80ab6e3f6ea0'}),), if_exists=True) {{(pid=74613) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 18:13:48 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:13:48 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 18:13:48 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:13:48 user nova-compute[74613]: INFO os_vif [None req-e42e3e19-12fb-4442-89f4-584d7eb17bec tempest-AttachVolumeTestJSON-813984703 tempest-AttachVolumeTestJSON-813984703-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:da:7a:47,bridge_name='br-int',has_traffic_filtering=True,id=e8b2f9b5-0c3a-4f6f-bf96-566c8a779849,network=Network(21147bc8-b1ac-40d5-8fc0-8dab8ade1ff5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape8b2f9b5-0c')
Nov 29 18:13:49 user nova-compute[74613]: DEBUG nova.network.neutron [req-0f24a127-a5d4-41a2-ad8a-407f0fe2c481 req-01104848-a8e3-4e19-b211-c8373323ce1c service nova] [instance: ca290abd-2eb9-43ec-b212-b1cfe1fdf35c] Updated VIF entry in instance network info cache for port a0a4c680-262b-4bff-b523-0bc7a27baa88. {{(pid=74613) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 18:13:49 user nova-compute[74613]: DEBUG nova.network.neutron [req-0f24a127-a5d4-41a2-ad8a-407f0fe2c481 req-01104848-a8e3-4e19-b211-c8373323ce1c service nova] [instance: ca290abd-2eb9-43ec-b212-b1cfe1fdf35c] Updating instance_info_cache with network_info: [{"id": "a0a4c680-262b-4bff-b523-0bc7a27baa88", "address": "fa:16:3e:15:0b:97", "network": {"id": "4a5179dd-d0b1-44c3-80c1-08dd7b0152f1", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1296336996-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "67390f1402214191904cfbd68c3142a7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa0a4c680-26", "ovs_interfaceid": "a0a4c680-262b-4bff-b523-0bc7a27baa88", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74613) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 18:13:49 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-0f24a127-a5d4-41a2-ad8a-407f0fe2c481 req-01104848-a8e3-4e19-b211-c8373323ce1c service nova] Releasing lock "refresh_cache-ca290abd-2eb9-43ec-b212-b1cfe1fdf35c" {{(pid=74613) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 18:13:50 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:13:50 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:13:50 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:13:50 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:13:50 user nova-compute[74613]: DEBUG nova.compute.manager [req-40656765-8137-435e-b55e-816b213fd6b4 req-50754b33-2aa5-480d-aac3-bc2c32e4ad4c service nova] [instance: 69109f06-acbf-4834-b05e-80ab6e3f6ea0] Received event network-vif-plugged-e8b2f9b5-0c3a-4f6f-bf96-566c8a779849 {{(pid=74613) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 18:13:50 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-40656765-8137-435e-b55e-816b213fd6b4 req-50754b33-2aa5-480d-aac3-bc2c32e4ad4c service nova] Acquiring lock "69109f06-acbf-4834-b05e-80ab6e3f6ea0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 18:13:50 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-40656765-8137-435e-b55e-816b213fd6b4 req-50754b33-2aa5-480d-aac3-bc2c32e4ad4c service nova] Lock "69109f06-acbf-4834-b05e-80ab6e3f6ea0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 18:13:50 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-40656765-8137-435e-b55e-816b213fd6b4 req-50754b33-2aa5-480d-aac3-bc2c32e4ad4c service nova] Lock "69109f06-acbf-4834-b05e-80ab6e3f6ea0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 18:13:50 user nova-compute[74613]: DEBUG nova.compute.manager [req-40656765-8137-435e-b55e-816b213fd6b4 req-50754b33-2aa5-480d-aac3-bc2c32e4ad4c service nova] [instance: 69109f06-acbf-4834-b05e-80ab6e3f6ea0] No waiting events found dispatching network-vif-plugged-e8b2f9b5-0c3a-4f6f-bf96-566c8a779849 {{(pid=74613) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 18:13:50 user nova-compute[74613]: WARNING nova.compute.manager [req-40656765-8137-435e-b55e-816b213fd6b4 req-50754b33-2aa5-480d-aac3-bc2c32e4ad4c service nova] [instance: 69109f06-acbf-4834-b05e-80ab6e3f6ea0] Received unexpected event network-vif-plugged-e8b2f9b5-0c3a-4f6f-bf96-566c8a779849 for instance with vm_state stopped and task_state powering-on.
Nov 29 18:13:50 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:13:50 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:13:50 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:13:50 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:13:52 user nova-compute[74613]: DEBUG os_brick.utils [None req-ab7fd62b-7ddc-447a-bd88-b69791003b80 tempest-TestVolumeBootPattern-1318569205 tempest-TestVolumeBootPattern-1318569205-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74613) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 18:13:52 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:13:52 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:13:52 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[d01f256f-0529-484b-814e-650c0a4f22b7]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:400972819b5\n', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 18:13:52 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:13:52 user nova-compute[74613]: DEBUG nova.compute.manager [None req-e42e3e19-12fb-4442-89f4-584d7eb17bec tempest-AttachVolumeTestJSON-813984703 tempest-AttachVolumeTestJSON-813984703-project-member] [instance: 69109f06-acbf-4834-b05e-80ab6e3f6ea0] Instance event wait completed in 0 seconds for  {{(pid=74613) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 29 18:13:52 user nova-compute[74613]: INFO nova.virt.libvirt.driver [-] [instance: 69109f06-acbf-4834-b05e-80ab6e3f6ea0] Instance rebooted successfully.
Nov 29 18:13:52 user nova-compute[74613]: DEBUG nova.compute.manager [None req-e42e3e19-12fb-4442-89f4-584d7eb17bec tempest-AttachVolumeTestJSON-813984703 tempest-AttachVolumeTestJSON-813984703-project-member] [instance: 69109f06-acbf-4834-b05e-80ab6e3f6ea0] Checking state {{(pid=74613) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 29 18:13:52 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:13:52 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6162647-8bd8-4f4b-ba22-7ef690faea43]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 18:13:52 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:13:52 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:13:52 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[e62fc81d-d4d7-463b-a734-329f434a0321]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 18:13:52 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[bac70c07-1c6c-4441-b017-1e7d816e7579]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 18:13:52 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-ab7fd62b-7ddc-447a-bd88-b69791003b80 tempest-TestVolumeBootPattern-1318569205 tempest-TestVolumeBootPattern-1318569205-project-member] Running cmd (subprocess): nvme version {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:13:52 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-ab7fd62b-7ddc-447a-bd88-b69791003b80 tempest-TestVolumeBootPattern-1318569205 tempest-TestVolumeBootPattern-1318569205-project-member] 'nvme version' failed. Not Retrying. {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 18:13:52 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.nvmeof [None req-ab7fd62b-7ddc-447a-bd88-b69791003b80 tempest-TestVolumeBootPattern-1318569205 tempest-TestVolumeBootPattern-1318569205-project-member] nvme not present on system {{(pid=74613) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 29 18:13:52 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:13:52 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 18:13:52 user nova-compute[74613]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 29 18:13:52 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[55009d7b-cf59-4b4b-ad2e-0fb82c256273]: (4, '') {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 18:13:52 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.lightos [None req-ab7fd62b-7ddc-447a-bd88-b69791003b80 tempest-TestVolumeBootPattern-1318569205 tempest-TestVolumeBootPattern-1318569205-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74613) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 29 18:13:52 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.lightos [None req-ab7fd62b-7ddc-447a-bd88-b69791003b80 tempest-TestVolumeBootPattern-1318569205 tempest-TestVolumeBootPattern-1318569205-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74613) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 29 18:13:52 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.lightos [None req-ab7fd62b-7ddc-447a-bd88-b69791003b80 tempest-TestVolumeBootPattern-1318569205 tempest-TestVolumeBootPattern-1318569205-project-member] LIGHTOS: no hostnqn found. {{(pid=74613) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 29 18:13:52 user nova-compute[74613]: DEBUG os_brick.utils [None req-ab7fd62b-7ddc-447a-bd88-b69791003b80 tempest-TestVolumeBootPattern-1318569205 tempest-TestVolumeBootPattern-1318569205-project-member] <== get_connector_properties: return (133ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:400972819b5', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74613) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 18:13:52 user nova-compute[74613]: DEBUG nova.virt.block_device [None req-ab7fd62b-7ddc-447a-bd88-b69791003b80 tempest-TestVolumeBootPattern-1318569205 tempest-TestVolumeBootPattern-1318569205-project-member] [instance: ca290abd-2eb9-43ec-b212-b1cfe1fdf35c] Updating existing volume attachment record: a078ec82-5e38-498e-ace8-3818a48b775d {{(pid=74613) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 29 18:13:52 user nova-compute[74613]: DEBUG nova.compute.manager [req-af44128b-4bbc-44bb-a2f6-e6e8d4543e11 req-64e0b835-fe9d-46d8-a4b3-ff0514f9efc5 service nova] [instance: 69109f06-acbf-4834-b05e-80ab6e3f6ea0] Received event network-vif-plugged-e8b2f9b5-0c3a-4f6f-bf96-566c8a779849 {{(pid=74613) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 18:13:52 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-af44128b-4bbc-44bb-a2f6-e6e8d4543e11 req-64e0b835-fe9d-46d8-a4b3-ff0514f9efc5 service nova] Acquiring lock "69109f06-acbf-4834-b05e-80ab6e3f6ea0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 18:13:52 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-af44128b-4bbc-44bb-a2f6-e6e8d4543e11 req-64e0b835-fe9d-46d8-a4b3-ff0514f9efc5 service nova] Lock "69109f06-acbf-4834-b05e-80ab6e3f6ea0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 18:13:52 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-af44128b-4bbc-44bb-a2f6-e6e8d4543e11 req-64e0b835-fe9d-46d8-a4b3-ff0514f9efc5 service nova] Lock "69109f06-acbf-4834-b05e-80ab6e3f6ea0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 18:13:52 user nova-compute[74613]: DEBUG nova.compute.manager [req-af44128b-4bbc-44bb-a2f6-e6e8d4543e11 req-64e0b835-fe9d-46d8-a4b3-ff0514f9efc5 service nova] [instance: 69109f06-acbf-4834-b05e-80ab6e3f6ea0] No waiting events found dispatching network-vif-plugged-e8b2f9b5-0c3a-4f6f-bf96-566c8a779849 {{(pid=74613) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 18:13:52 user nova-compute[74613]: WARNING nova.compute.manager [req-af44128b-4bbc-44bb-a2f6-e6e8d4543e11 req-64e0b835-fe9d-46d8-a4b3-ff0514f9efc5 service nova] [instance: 69109f06-acbf-4834-b05e-80ab6e3f6ea0] Received unexpected event network-vif-plugged-e8b2f9b5-0c3a-4f6f-bf96-566c8a779849 for instance with vm_state active and task_state None.
Nov 29 18:13:53 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:13:55 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:13:58 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:14:00 user nova-compute[74613]: DEBUG nova.compute.manager [None req-ab7fd62b-7ddc-447a-bd88-b69791003b80 tempest-TestVolumeBootPattern-1318569205 tempest-TestVolumeBootPattern-1318569205-project-member] [instance: ca290abd-2eb9-43ec-b212-b1cfe1fdf35c] Start spawning the instance on the hypervisor. {{(pid=74613) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 29 18:14:00 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-ab7fd62b-7ddc-447a-bd88-b69791003b80 tempest-TestVolumeBootPattern-1318569205 tempest-TestVolumeBootPattern-1318569205-project-member] [instance: ca290abd-2eb9-43ec-b212-b1cfe1fdf35c] Creating instance directory {{(pid=74613) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 29 18:14:00 user nova-compute[74613]: INFO nova.virt.libvirt.driver [None req-ab7fd62b-7ddc-447a-bd88-b69791003b80 tempest-TestVolumeBootPattern-1318569205 tempest-TestVolumeBootPattern-1318569205-project-member] [instance: ca290abd-2eb9-43ec-b212-b1cfe1fdf35c] Creating image(s)
Nov 29 18:14:00 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-ab7fd62b-7ddc-447a-bd88-b69791003b80 tempest-TestVolumeBootPattern-1318569205 tempest-TestVolumeBootPattern-1318569205-project-member] [instance: ca290abd-2eb9-43ec-b212-b1cfe1fdf35c] Did not create local disks {{(pid=74613) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 29 18:14:00 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-ab7fd62b-7ddc-447a-bd88-b69791003b80 tempest-TestVolumeBootPattern-1318569205 tempest-TestVolumeBootPattern-1318569205-project-member] [instance: ca290abd-2eb9-43ec-b212-b1cfe1fdf35c] Ensure instance console log exists: /opt/stack/data/nova/instances/ca290abd-2eb9-43ec-b212-b1cfe1fdf35c/console.log {{(pid=74613) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 29 18:14:00 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-ab7fd62b-7ddc-447a-bd88-b69791003b80 tempest-TestVolumeBootPattern-1318569205 tempest-TestVolumeBootPattern-1318569205-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 18:14:00 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-ab7fd62b-7ddc-447a-bd88-b69791003b80 tempest-TestVolumeBootPattern-1318569205 tempest-TestVolumeBootPattern-1318569205-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 18:14:00 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-ab7fd62b-7ddc-447a-bd88-b69791003b80 tempest-TestVolumeBootPattern-1318569205 tempest-TestVolumeBootPattern-1318569205-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 18:14:00 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-ab7fd62b-7ddc-447a-bd88-b69791003b80 tempest-TestVolumeBootPattern-1318569205 tempest-TestVolumeBootPattern-1318569205-project-member] [instance: ca290abd-2eb9-43ec-b212-b1cfe1fdf35c] Start _get_guest_xml network_info=[{"id": "a0a4c680-262b-4bff-b523-0bc7a27baa88", "address": "fa:16:3e:15:0b:97", "network": {"id": "4a5179dd-d0b1-44c3-80c1-08dd7b0152f1", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1296336996-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "67390f1402214191904cfbd68c3142a7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa0a4c680-26", "ovs_interfaceid": "a0a4c680-262b-4bff-b523-0bc7a27baa88", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:1cd1b4f3-6008-4bef-bb8d-e92e973d5a96', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WQUqJxNg', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'ca290abd-2eb9-43ec-b212-b1cfe1fdf35c', 'attached_at': '', 'detached_at': '', 'volume_id': '1cd1b4f3-6008-4bef-bb8d-e92e973d5a96', 'serial': '1cd1b4f3-6008-4bef-bb8d-e92e973d5a96'}, 'mount_device': '/dev/vda', 'delete_on_termination': True, 'device_type': 'disk', 'boot_index': 0, 'guest_format': None, 'attachment_id': 'a078ec82-5e38-498e-ace8-3818a48b775d', 'disk_bus': 'virtio', 'volume_type': None} {{(pid=74613) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 29 18:14:00 user nova-compute[74613]: WARNING nova.virt.libvirt.driver [None req-ab7fd62b-7ddc-447a-bd88-b69791003b80 tempest-TestVolumeBootPattern-1318569205 tempest-TestVolumeBootPattern-1318569205-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 18:14:00 user nova-compute[74613]: WARNING nova.virt.libvirt.driver [None req-ab7fd62b-7ddc-447a-bd88-b69791003b80 tempest-TestVolumeBootPattern-1318569205 tempest-TestVolumeBootPattern-1318569205-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 18:14:00 user nova-compute[74613]: DEBUG nova.virt.libvirt.host [None req-ab7fd62b-7ddc-447a-bd88-b69791003b80 tempest-TestVolumeBootPattern-1318569205 tempest-TestVolumeBootPattern-1318569205-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74613) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 29 18:14:00 user nova-compute[74613]: DEBUG nova.virt.libvirt.host [None req-ab7fd62b-7ddc-447a-bd88-b69791003b80 tempest-TestVolumeBootPattern-1318569205 tempest-TestVolumeBootPattern-1318569205-project-member] CPU controller missing on host. {{(pid=74613) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 29 18:14:00 user nova-compute[74613]: DEBUG nova.virt.libvirt.host [None req-ab7fd62b-7ddc-447a-bd88-b69791003b80 tempest-TestVolumeBootPattern-1318569205 tempest-TestVolumeBootPattern-1318569205-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74613) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 29 18:14:00 user nova-compute[74613]: DEBUG nova.virt.libvirt.host [None req-ab7fd62b-7ddc-447a-bd88-b69791003b80 tempest-TestVolumeBootPattern-1318569205 tempest-TestVolumeBootPattern-1318569205-project-member] CPU controller found on host. {{(pid=74613) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 29 18:14:00 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-ab7fd62b-7ddc-447a-bd88-b69791003b80 tempest-TestVolumeBootPattern-1318569205 tempest-TestVolumeBootPattern-1318569205-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74613) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 29 18:14:00 user nova-compute[74613]: DEBUG nova.virt.hardware [None req-ab7fd62b-7ddc-447a-bd88-b69791003b80 tempest-TestVolumeBootPattern-1318569205 tempest-TestVolumeBootPattern-1318569205-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-29T17:47:27Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74613) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 29 18:14:00 user nova-compute[74613]: DEBUG nova.virt.hardware [None req-ab7fd62b-7ddc-447a-bd88-b69791003b80 tempest-TestVolumeBootPattern-1318569205 tempest-TestVolumeBootPattern-1318569205-project-member] Flavor limits 0:0:0 {{(pid=74613) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 29 18:14:00 user nova-compute[74613]: DEBUG nova.virt.hardware [None req-ab7fd62b-7ddc-447a-bd88-b69791003b80 tempest-TestVolumeBootPattern-1318569205 tempest-TestVolumeBootPattern-1318569205-project-member] Image limits 0:0:0 {{(pid=74613) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 29 18:14:00 user nova-compute[74613]: DEBUG nova.virt.hardware [None req-ab7fd62b-7ddc-447a-bd88-b69791003b80 tempest-TestVolumeBootPattern-1318569205 tempest-TestVolumeBootPattern-1318569205-project-member] Flavor pref 0:0:0 {{(pid=74613) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 29 18:14:00 user nova-compute[74613]: DEBUG nova.virt.hardware [None req-ab7fd62b-7ddc-447a-bd88-b69791003b80 tempest-TestVolumeBootPattern-1318569205 tempest-TestVolumeBootPattern-1318569205-project-member] Image pref 0:0:0 {{(pid=74613) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 29 18:14:00 user nova-compute[74613]: DEBUG nova.virt.hardware [None req-ab7fd62b-7ddc-447a-bd88-b69791003b80 tempest-TestVolumeBootPattern-1318569205 tempest-TestVolumeBootPattern-1318569205-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74613) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 29 18:14:00 user nova-compute[74613]: DEBUG nova.virt.hardware [None req-ab7fd62b-7ddc-447a-bd88-b69791003b80 tempest-TestVolumeBootPattern-1318569205 tempest-TestVolumeBootPattern-1318569205-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74613) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 29 18:14:00 user nova-compute[74613]: DEBUG nova.virt.hardware [None req-ab7fd62b-7ddc-447a-bd88-b69791003b80 tempest-TestVolumeBootPattern-1318569205 tempest-TestVolumeBootPattern-1318569205-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74613) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 29 18:14:00 user nova-compute[74613]: DEBUG nova.virt.hardware [None req-ab7fd62b-7ddc-447a-bd88-b69791003b80 tempest-TestVolumeBootPattern-1318569205 tempest-TestVolumeBootPattern-1318569205-project-member] Got 1 possible topologies {{(pid=74613) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 29 18:14:00 user nova-compute[74613]: DEBUG nova.virt.hardware [None req-ab7fd62b-7ddc-447a-bd88-b69791003b80 tempest-TestVolumeBootPattern-1318569205 tempest-TestVolumeBootPattern-1318569205-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74613) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 29 18:14:00 user nova-compute[74613]: DEBUG nova.virt.hardware [None req-ab7fd62b-7ddc-447a-bd88-b69791003b80 tempest-TestVolumeBootPattern-1318569205 tempest-TestVolumeBootPattern-1318569205-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74613) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 29 18:14:00 user nova-compute[74613]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ab7fd62b-7ddc-447a-bd88-b69791003b80 tempest-TestVolumeBootPattern-1318569205 tempest-TestVolumeBootPattern-1318569205-project-member] [instance: ca290abd-2eb9-43ec-b212-b1cfe1fdf35c] Calling os-brick to attach iSCSI Volume {{(pid=74613) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 29 18:14:00 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab7fd62b-7ddc-447a-bd88-b69791003b80 tempest-TestVolumeBootPattern-1318569205 tempest-TestVolumeBootPattern-1318569205-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff828156890>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:1cd1b4f3-6008-4bef-bb8d-e92e973d5a96', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WQUqJxNg', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74613) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 18:14:00 user nova-compute[74613]: WARNING os_brick.initiator.connectors.base [None req-ab7fd62b-7ddc-447a-bd88-b69791003b80 tempest-TestVolumeBootPattern-1318569205 tempest-TestVolumeBootPattern-1318569205-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 18:14:00 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.base [None req-ab7fd62b-7ddc-447a-bd88-b69791003b80 tempest-TestVolumeBootPattern-1318569205 tempest-TestVolumeBootPattern-1318569205-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 18:14:00 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.base [None req-ab7fd62b-7ddc-447a-bd88-b69791003b80 tempest-TestVolumeBootPattern-1318569205 tempest-TestVolumeBootPattern-1318569205-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 18:14:00 user nova-compute[74613]: WARNING os_brick.initiator.connectors.base [None req-ab7fd62b-7ddc-447a-bd88-b69791003b80 tempest-TestVolumeBootPattern-1318569205 tempest-TestVolumeBootPattern-1318569205-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 18:14:00 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.base [None req-ab7fd62b-7ddc-447a-bd88-b69791003b80 tempest-TestVolumeBootPattern-1318569205 tempest-TestVolumeBootPattern-1318569205-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1cd1b4f3-6008-4bef-bb8d-e92e973d5a96" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 18:14:00 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.base [None req-ab7fd62b-7ddc-447a-bd88-b69791003b80 tempest-TestVolumeBootPattern-1318569205 tempest-TestVolumeBootPattern-1318569205-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1cd1b4f3-6008-4bef-bb8d-e92e973d5a96" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 18:14:00 user nova-compute[74613]: INFO os_brick.initiator.connectors.iscsi [None req-ab7fd62b-7ddc-447a-bd88-b69791003b80 tempest-TestVolumeBootPattern-1318569205 tempest-TestVolumeBootPattern-1318569205-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 29 18:14:00 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1cd1b4f3-6008-4bef-bb8d-e92e973d5a96 -p 172.16.0.220:3260 {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:14:00 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1cd1b4f3-6008-4bef-bb8d-e92e973d5a96 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:14:00 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac6bb8e0-7e1e-49c1-9e13-0bd2ab0af9b1]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 18:14:00 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab7fd62b-7ddc-447a-bd88-b69791003b80 tempest-TestVolumeBootPattern-1318569205 tempest-TestVolumeBootPattern-1318569205-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 29 18:14:00 user nova-compute[74613]:  {{(pid=74613) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 18:14:00 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1cd1b4f3-6008-4bef-bb8d-e92e973d5a96 -p 172.16.0.220:3260 --interface default --op new {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:14:00 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1cd1b4f3-6008-4bef-bb8d-e92e973d5a96 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:14:00 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[8119f6d2-6066-40db-b466-f10a0f19e1ee]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:1cd1b4f3-6008-4bef-bb8d-e92e973d5a96] added\n', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 18:14:00 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab7fd62b-7ddc-447a-bd88-b69791003b80 tempest-TestVolumeBootPattern-1318569205 tempest-TestVolumeBootPattern-1318569205-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:1cd1b4f3-6008-4bef-bb8d-e92e973d5a96] added
Nov 29 18:14:00 user nova-compute[74613]:  stderr= {{(pid=74613) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 18:14:00 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1cd1b4f3-6008-4bef-bb8d-e92e973d5a96 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:14:00 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1cd1b4f3-6008-4bef-bb8d-e92e973d5a96 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:14:00 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[4900b4d9-7a41-4b2c-8d69-6ea652b1eebb]: (4, ('', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 18:14:00 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab7fd62b-7ddc-447a-bd88-b69791003b80 tempest-TestVolumeBootPattern-1318569205 tempest-TestVolumeBootPattern-1318569205-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74613) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 18:14:00 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1cd1b4f3-6008-4bef-bb8d-e92e973d5a96 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:14:00 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1cd1b4f3-6008-4bef-bb8d-e92e973d5a96 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:14:00 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[91abe721-1559-42d2-b920-5f1f2f421414]: (4, ('', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 18:14:00 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab7fd62b-7ddc-447a-bd88-b69791003b80 tempest-TestVolumeBootPattern-1318569205 tempest-TestVolumeBootPattern-1318569205-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74613) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 18:14:00 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1cd1b4f3-6008-4bef-bb8d-e92e973d5a96 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v WQUqJxNg {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:14:00 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1cd1b4f3-6008-4bef-bb8d-e92e973d5a96 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v WQUqJxNg" returned: 0 in 0.017s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:14:00 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0a05bff-aef9-4a78-953e-85305b1a9393]: (4, ('', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 18:14:00 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab7fd62b-7ddc-447a-bd88-b69791003b80 tempest-TestVolumeBootPattern-1318569205 tempest-TestVolumeBootPattern-1318569205-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'WQUqJxNg'): stdout= stderr= {{(pid=74613) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 18:14:00 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1cd1b4f3-6008-4bef-bb8d-e92e973d5a96 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:14:00 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1cd1b4f3-6008-4bef-bb8d-e92e973d5a96 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:14:00 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4b4433c-4a8d-4121-ae07-072e1e703947]: (4, ('', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 18:14:00 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab7fd62b-7ddc-447a-bd88-b69791003b80 tempest-TestVolumeBootPattern-1318569205 tempest-TestVolumeBootPattern-1318569205-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74613) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 18:14:00 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:14:00 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.016s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:14:00 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[20f6444b-38df-4aa8-9e06-5d42d89e998f]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 18:14:00 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab7fd62b-7ddc-447a-bd88-b69791003b80 tempest-TestVolumeBootPattern-1318569205 tempest-TestVolumeBootPattern-1318569205-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Nov 29 18:14:00 user nova-compute[74613]:  {{(pid=74613) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 18:14:00 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab7fd62b-7ddc-447a-bd88-b69791003b80 tempest-TestVolumeBootPattern-1318569205 tempest-TestVolumeBootPattern-1318569205-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Nov 29 18:14:00 user nova-compute[74613]:  {{(pid=74613) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 18:14:00 user nova-compute[74613]: WARNING os_brick.initiator.connectors.iscsi [None req-ab7fd62b-7ddc-447a-bd88-b69791003b80 tempest-TestVolumeBootPattern-1318569205 tempest-TestVolumeBootPattern-1318569205-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Nov 29 18:14:00 user nova-compute[74613]: 
Nov 29 18:14:00 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1cd1b4f3-6008-4bef-bb8d-e92e973d5a96 -p 172.16.0.220:3260 --login {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:14:00 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1cd1b4f3-6008-4bef-bb8d-e92e973d5a96 -p 172.16.0.220:3260 --login" returned: 0 in 0.047s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:14:00 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[1746e29d-bfbb-4e2b-a931-f4f4a9bd7c62]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:1cd1b4f3-6008-4bef-bb8d-e92e973d5a96, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:1cd1b4f3-6008-4bef-bb8d-e92e973d5a96, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 18:14:00 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab7fd62b-7ddc-447a-bd88-b69791003b80 tempest-TestVolumeBootPattern-1318569205 tempest-TestVolumeBootPattern-1318569205-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:1cd1b4f3-6008-4bef-bb8d-e92e973d5a96, portal: 172.16.0.220,3260]
Nov 29 18:14:00 user nova-compute[74613]: Login to [iface: default, target: iqn.2010-10.org.openstack:1cd1b4f3-6008-4bef-bb8d-e92e973d5a96, portal: 172.16.0.220,3260] successful.
Nov 29 18:14:00 user nova-compute[74613]:  stderr= {{(pid=74613) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 18:14:00 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1cd1b4f3-6008-4bef-bb8d-e92e973d5a96 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:14:00 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1cd1b4f3-6008-4bef-bb8d-e92e973d5a96 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:14:00 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[ebc5abd1-2b75-4d91-97d5-fb45bddc9f16]: (4, ('', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 18:14:00 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab7fd62b-7ddc-447a-bd88-b69791003b80 tempest-TestVolumeBootPattern-1318569205 tempest-TestVolumeBootPattern-1318569205-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74613) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 18:14:00 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:14:00 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:14:00 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1e6c4ec-f78e-40a1-9b26-197445be0e74]: (4, ('tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1cd1b4f3-6008-4bef-bb8d-e92e973d5a96 (non-flash)\n', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 18:14:00 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab7fd62b-7ddc-447a-bd88-b69791003b80 tempest-TestVolumeBootPattern-1318569205 tempest-TestVolumeBootPattern-1318569205-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1cd1b4f3-6008-4bef-bb8d-e92e973d5a96 (non-flash)
Nov 29 18:14:00 user nova-compute[74613]:  stderr= {{(pid=74613) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 18:14:00 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab7fd62b-7ddc-447a-bd88-b69791003b80 tempest-TestVolumeBootPattern-1318569205 tempest-TestVolumeBootPattern-1318569205-project-member] iscsi session list stdout=tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1cd1b4f3-6008-4bef-bb8d-e92e973d5a96 (non-flash)
Nov 29 18:14:00 user nova-compute[74613]:  stderr= {{(pid=74613) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 18:14:00 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.base [None req-ab7fd62b-7ddc-447a-bd88-b69791003b80 tempest-TestVolumeBootPattern-1318569205 tempest-TestVolumeBootPattern-1318569205-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1cd1b4f3-6008-4bef-bb8d-e92e973d5a96" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.253s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 18:14:00 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab7fd62b-7ddc-447a-bd88-b69791003b80 tempest-TestVolumeBootPattern-1318569205 tempest-TestVolumeBootPattern-1318569205-project-member] Connected to 172.16.0.220:3260 {{(pid=74613) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 29 18:14:00 user nova-compute[74613]: DEBUG os_brick.initiator.linuxscsi [None req-ab7fd62b-7ddc-447a-bd88-b69791003b80 tempest-TestVolumeBootPattern-1318569205 tempest-TestVolumeBootPattern-1318569205-project-member] HCTL ('33', '-', '-', 0) found on session 42 with lun 0 {{(pid=74613) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 29 18:14:00 user nova-compute[74613]: DEBUG os_brick.initiator.linuxscsi [None req-ab7fd62b-7ddc-447a-bd88-b69791003b80 tempest-TestVolumeBootPattern-1318569205 tempest-TestVolumeBootPattern-1318569205-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74613) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 29 18:14:00 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:14:00 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.018s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:14:00 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c882beb-a8f5-49a0-9224-7f1511c8bb44]: (4, ('- - 0', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 18:14:00 user nova-compute[74613]: DEBUG os_brick.initiator.linuxscsi [None req-ab7fd62b-7ddc-447a-bd88-b69791003b80 tempest-TestVolumeBootPattern-1318569205 tempest-TestVolumeBootPattern-1318569205-project-member] Searching for a device in session 42 and hctl ['33', '*', '*', 0] yield: None {{(pid=74613) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 29 18:14:01 user nova-compute[74613]: DEBUG os_brick.initiator.linuxscsi [None req-ab7fd62b-7ddc-447a-bd88-b69791003b80 tempest-TestVolumeBootPattern-1318569205 tempest-TestVolumeBootPattern-1318569205-project-member] Searching for a device in session 42 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74613) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 29 18:14:01 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab7fd62b-7ddc-447a-bd88-b69791003b80 tempest-TestVolumeBootPattern-1318569205 tempest-TestVolumeBootPattern-1318569205-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:1cd1b4f3-6008-4bef-bb8d-e92e973d5a96', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WQUqJxNg', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74613) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 29 18:14:01 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.base [None req-ab7fd62b-7ddc-447a-bd88-b69791003b80 tempest-TestVolumeBootPattern-1318569205 tempest-TestVolumeBootPattern-1318569205-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.283s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 18:14:01 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab7fd62b-7ddc-447a-bd88-b69791003b80 tempest-TestVolumeBootPattern-1318569205 tempest-TestVolumeBootPattern-1318569205-project-member] <== connect_volume: return (1285ms) {'type': 'block', 'scsi_wwn': '26139363232323062', 'path': '/dev/sdb'} {{(pid=74613) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 18:14:01 user nova-compute[74613]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ab7fd62b-7ddc-447a-bd88-b69791003b80 tempest-TestVolumeBootPattern-1318569205 tempest-TestVolumeBootPattern-1318569205-project-member] [instance: ca290abd-2eb9-43ec-b212-b1cfe1fdf35c] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26139363232323062', 'path': '/dev/sdb'} {{(pid=74613) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 29 18:14:01 user nova-compute[74613]: DEBUG nova.virt.libvirt.vif [None req-ab7fd62b-7ddc-447a-bd88-b69791003b80 tempest-TestVolumeBootPattern-1318569205 tempest-TestVolumeBootPattern-1318569205-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T18:13:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-683782260',display_name='tempest-TestVolumeBootPattern-server-683782260',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-683782260',id=38,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='67390f1402214191904cfbd68c3142a7',ramdisk_id='',reservation_id='r-062ykjyd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1318569205',owner_user_name='tempest-TestVolumeBootPattern-1318569205-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T18:13:47Z,user_data=None,user_id='bedbc6ed47394e2b9125543a8b88a71f',uuid=ca290abd-2eb9-43ec-b212-b1cfe1fdf35c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a0a4c680-262b-4bff-b523-0bc7a27baa88", "address": "fa:16:3e:15:0b:97", "network": {"id": "4a5179dd-d0b1-44c3-80c1-08dd7b0152f1", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1296336996-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "67390f1402214191904cfbd68c3142a7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa0a4c680-26", "ovs_interfaceid": "a0a4c680-262b-4bff-b523-0bc7a27baa88", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74613) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 29 18:14:01 user nova-compute[74613]: DEBUG nova.network.os_vif_util [None req-ab7fd62b-7ddc-447a-bd88-b69791003b80 tempest-TestVolumeBootPattern-1318569205 tempest-TestVolumeBootPattern-1318569205-project-member] Converting VIF {"id": "a0a4c680-262b-4bff-b523-0bc7a27baa88", "address": "fa:16:3e:15:0b:97", "network": {"id": "4a5179dd-d0b1-44c3-80c1-08dd7b0152f1", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1296336996-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "67390f1402214191904cfbd68c3142a7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa0a4c680-26", "ovs_interfaceid": "a0a4c680-262b-4bff-b523-0bc7a27baa88", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74613) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 18:14:01 user nova-compute[74613]: DEBUG nova.network.os_vif_util [None req-ab7fd62b-7ddc-447a-bd88-b69791003b80 tempest-TestVolumeBootPattern-1318569205 tempest-TestVolumeBootPattern-1318569205-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:15:0b:97,bridge_name='br-int',has_traffic_filtering=True,id=a0a4c680-262b-4bff-b523-0bc7a27baa88,network=Network(4a5179dd-d0b1-44c3-80c1-08dd7b0152f1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa0a4c680-26') {{(pid=74613) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 18:14:01 user nova-compute[74613]: DEBUG nova.objects.instance [None req-ab7fd62b-7ddc-447a-bd88-b69791003b80 tempest-TestVolumeBootPattern-1318569205 tempest-TestVolumeBootPattern-1318569205-project-member] Lazy-loading 'pci_devices' on Instance uuid ca290abd-2eb9-43ec-b212-b1cfe1fdf35c {{(pid=74613) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 18:14:01 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-ab7fd62b-7ddc-447a-bd88-b69791003b80 tempest-TestVolumeBootPattern-1318569205 tempest-TestVolumeBootPattern-1318569205-project-member] [instance: ca290abd-2eb9-43ec-b212-b1cfe1fdf35c] End _get_guest_xml xml=<domain type="kvm">
Nov 29 18:14:01 user nova-compute[74613]:   <uuid>ca290abd-2eb9-43ec-b212-b1cfe1fdf35c</uuid>
Nov 29 18:14:01 user nova-compute[74613]:   <name>instance-00000026</name>
Nov 29 18:14:01 user nova-compute[74613]:   <memory>524288</memory>
Nov 29 18:14:01 user nova-compute[74613]:   <vcpu>1</vcpu>
Nov 29 18:14:01 user nova-compute[74613]:   <metadata>
Nov 29 18:14:01 user nova-compute[74613]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 29 18:14:01 user nova-compute[74613]:       <nova:package version="0.0.0"/>
Nov 29 18:14:01 user nova-compute[74613]:       <nova:name>tempest-TestVolumeBootPattern-server-683782260</nova:name>
Nov 29 18:14:01 user nova-compute[74613]:       <nova:creationTime>2023-11-29 18:14:00</nova:creationTime>
Nov 29 18:14:01 user nova-compute[74613]:       <nova:flavor name="m1.tiny">
Nov 29 18:14:01 user nova-compute[74613]:         <nova:memory>512</nova:memory>
Nov 29 18:14:01 user nova-compute[74613]:         <nova:disk>1</nova:disk>
Nov 29 18:14:01 user nova-compute[74613]:         <nova:swap>0</nova:swap>
Nov 29 18:14:01 user nova-compute[74613]:         <nova:ephemeral>0</nova:ephemeral>
Nov 29 18:14:01 user nova-compute[74613]:         <nova:vcpus>1</nova:vcpus>
Nov 29 18:14:01 user nova-compute[74613]:       </nova:flavor>
Nov 29 18:14:01 user nova-compute[74613]:       <nova:owner>
Nov 29 18:14:01 user nova-compute[74613]:         <nova:user uuid="bedbc6ed47394e2b9125543a8b88a71f">tempest-TestVolumeBootPattern-1318569205-project-member</nova:user>
Nov 29 18:14:01 user nova-compute[74613]:         <nova:project uuid="67390f1402214191904cfbd68c3142a7">tempest-TestVolumeBootPattern-1318569205</nova:project>
Nov 29 18:14:01 user nova-compute[74613]:       </nova:owner>
Nov 29 18:14:01 user nova-compute[74613]:       <nova:ports>
Nov 29 18:14:01 user nova-compute[74613]:         <nova:port uuid="a0a4c680-262b-4bff-b523-0bc7a27baa88">
Nov 29 18:14:01 user nova-compute[74613]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Nov 29 18:14:01 user nova-compute[74613]:         </nova:port>
Nov 29 18:14:01 user nova-compute[74613]:       </nova:ports>
Nov 29 18:14:01 user nova-compute[74613]:     </nova:instance>
Nov 29 18:14:01 user nova-compute[74613]:   </metadata>
Nov 29 18:14:01 user nova-compute[74613]:   <sysinfo type="smbios">
Nov 29 18:14:01 user nova-compute[74613]:     <system>
Nov 29 18:14:01 user nova-compute[74613]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 29 18:14:01 user nova-compute[74613]:       <entry name="product">OpenStack Nova</entry>
Nov 29 18:14:01 user nova-compute[74613]:       <entry name="version">0.0.0</entry>
Nov 29 18:14:01 user nova-compute[74613]:       <entry name="serial">ca290abd-2eb9-43ec-b212-b1cfe1fdf35c</entry>
Nov 29 18:14:01 user nova-compute[74613]:       <entry name="uuid">ca290abd-2eb9-43ec-b212-b1cfe1fdf35c</entry>
Nov 29 18:14:01 user nova-compute[74613]:       <entry name="family">Virtual Machine</entry>
Nov 29 18:14:01 user nova-compute[74613]:     </system>
Nov 29 18:14:01 user nova-compute[74613]:   </sysinfo>
Nov 29 18:14:01 user nova-compute[74613]:   <os>
Nov 29 18:14:01 user nova-compute[74613]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 29 18:14:01 user nova-compute[74613]:     <boot dev="hd"/>
Nov 29 18:14:01 user nova-compute[74613]:     <smbios mode="sysinfo"/>
Nov 29 18:14:01 user nova-compute[74613]:   </os>
Nov 29 18:14:01 user nova-compute[74613]:   <features>
Nov 29 18:14:01 user nova-compute[74613]:     <acpi/>
Nov 29 18:14:01 user nova-compute[74613]:     <apic/>
Nov 29 18:14:01 user nova-compute[74613]:     <vmcoreinfo/>
Nov 29 18:14:01 user nova-compute[74613]:   </features>
Nov 29 18:14:01 user nova-compute[74613]:   <clock offset="utc">
Nov 29 18:14:01 user nova-compute[74613]:     <timer name="pit" tickpolicy="delay"/>
Nov 29 18:14:01 user nova-compute[74613]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 29 18:14:01 user nova-compute[74613]:     <timer name="hpet" present="no"/>
Nov 29 18:14:01 user nova-compute[74613]:   </clock>
Nov 29 18:14:01 user nova-compute[74613]:   <cpu mode="custom" match="exact">
Nov 29 18:14:01 user nova-compute[74613]:     <model>Nehalem</model>
Nov 29 18:14:01 user nova-compute[74613]:     <topology sockets="1" cores="1" threads="1"/>
Nov 29 18:14:01 user nova-compute[74613]:   </cpu>
Nov 29 18:14:01 user nova-compute[74613]:   <devices>
Nov 29 18:14:01 user nova-compute[74613]:     <disk type="block" device="disk">
Nov 29 18:14:01 user nova-compute[74613]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 18:14:01 user nova-compute[74613]:       <source dev="/dev/sdb"/>
Nov 29 18:14:01 user nova-compute[74613]:       <target dev="vda" bus="virtio"/>
Nov 29 18:14:01 user nova-compute[74613]:       <serial>1cd1b4f3-6008-4bef-bb8d-e92e973d5a96</serial>
Nov 29 18:14:01 user nova-compute[74613]:     </disk>
Nov 29 18:14:01 user nova-compute[74613]:     <interface type="ethernet">
Nov 29 18:14:01 user nova-compute[74613]:       <mac address="fa:16:3e:15:0b:97"/>
Nov 29 18:14:01 user nova-compute[74613]:       <model type="virtio"/>
Nov 29 18:14:01 user nova-compute[74613]:       <mtu size="1442"/>
Nov 29 18:14:01 user nova-compute[74613]:       <target dev="tapa0a4c680-26"/>
Nov 29 18:14:01 user nova-compute[74613]:     </interface>
Nov 29 18:14:01 user nova-compute[74613]:     <serial type="pty">
Nov 29 18:14:01 user nova-compute[74613]:       <log file="/opt/stack/data/nova/instances/ca290abd-2eb9-43ec-b212-b1cfe1fdf35c/console.log" append="off"/>
Nov 29 18:14:01 user nova-compute[74613]:     </serial>
Nov 29 18:14:01 user nova-compute[74613]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 29 18:14:01 user nova-compute[74613]:     <video>
Nov 29 18:14:01 user nova-compute[74613]:       <model type="virtio"/>
Nov 29 18:14:01 user nova-compute[74613]:     </video>
Nov 29 18:14:01 user nova-compute[74613]:     <rng model="virtio">
Nov 29 18:14:01 user nova-compute[74613]:       <backend model="random">/dev/urandom</backend>
Nov 29 18:14:01 user nova-compute[74613]:     </rng>
Nov 29 18:14:01 user nova-compute[74613]:     <controller type="usb" index="0" model="none"/>
Nov 29 18:14:01 user nova-compute[74613]:     <memballoon model="virtio">
Nov 29 18:14:01 user nova-compute[74613]:       <stats period="10"/>
Nov 29 18:14:01 user nova-compute[74613]:     </memballoon>
Nov 29 18:14:01 user nova-compute[74613]:   </devices>
Nov 29 18:14:01 user nova-compute[74613]: </domain>
Nov 29 18:14:01 user nova-compute[74613]:  {{(pid=74613) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 29 18:14:01 user nova-compute[74613]: DEBUG nova.virt.libvirt.vif [None req-ab7fd62b-7ddc-447a-bd88-b69791003b80 tempest-TestVolumeBootPattern-1318569205 tempest-TestVolumeBootPattern-1318569205-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T18:13:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-683782260',display_name='tempest-TestVolumeBootPattern-server-683782260',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-683782260',id=38,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='67390f1402214191904cfbd68c3142a7',ramdisk_id='',reservation_id='r-062ykjyd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1318569205',owner_user_name='tempest-TestVolumeBootPattern-1318569205-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T18:13:47Z,user_data=None,user_id='bedbc6ed47394e2b9125543a8b88a71f',uuid=ca290abd-2eb9-43ec-b212-b1cfe1fdf35c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a0a4c680-262b-4bff-b523-0bc7a27baa88", "address": "fa:16:3e:15:0b:97", "network": {"id": "4a5179dd-d0b1-44c3-80c1-08dd7b0152f1", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1296336996-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "67390f1402214191904cfbd68c3142a7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa0a4c680-26", "ovs_interfaceid": "a0a4c680-262b-4bff-b523-0bc7a27baa88", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74613) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 29 18:14:01 user nova-compute[74613]: DEBUG nova.network.os_vif_util [None req-ab7fd62b-7ddc-447a-bd88-b69791003b80 tempest-TestVolumeBootPattern-1318569205 tempest-TestVolumeBootPattern-1318569205-project-member] Converting VIF {"id": "a0a4c680-262b-4bff-b523-0bc7a27baa88", "address": "fa:16:3e:15:0b:97", "network": {"id": "4a5179dd-d0b1-44c3-80c1-08dd7b0152f1", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1296336996-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "67390f1402214191904cfbd68c3142a7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa0a4c680-26", "ovs_interfaceid": "a0a4c680-262b-4bff-b523-0bc7a27baa88", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74613) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 18:14:01 user nova-compute[74613]: DEBUG nova.network.os_vif_util [None req-ab7fd62b-7ddc-447a-bd88-b69791003b80 tempest-TestVolumeBootPattern-1318569205 tempest-TestVolumeBootPattern-1318569205-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:15:0b:97,bridge_name='br-int',has_traffic_filtering=True,id=a0a4c680-262b-4bff-b523-0bc7a27baa88,network=Network(4a5179dd-d0b1-44c3-80c1-08dd7b0152f1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa0a4c680-26') {{(pid=74613) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 18:14:01 user nova-compute[74613]: DEBUG os_vif [None req-ab7fd62b-7ddc-447a-bd88-b69791003b80 tempest-TestVolumeBootPattern-1318569205 tempest-TestVolumeBootPattern-1318569205-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:15:0b:97,bridge_name='br-int',has_traffic_filtering=True,id=a0a4c680-262b-4bff-b523-0bc7a27baa88,network=Network(4a5179dd-d0b1-44c3-80c1-08dd7b0152f1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa0a4c680-26') {{(pid=74613) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 29 18:14:01 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:14:01 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74613) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 18:14:01 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74613) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 29 18:14:01 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:14:01 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '14c37595-6553-5430-bb6d-744bcbd767d1', '_type': 'linux-noop'}}, row=False) {{(pid=74613) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 18:14:01 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 18:14:01 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:14:01 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapa0a4c680-26, may_exist=True, interface_attrs={}) {{(pid=74613) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 18:14:01 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapa0a4c680-26, col_values=(('qos', UUID('0fa41ae3-52cd-4c50-b174-5dd6dade71ce')),), if_exists=True) {{(pid=74613) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 18:14:01 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapa0a4c680-26, col_values=(('external_ids', {'iface-id': 'a0a4c680-262b-4bff-b523-0bc7a27baa88', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:15:0b:97', 'vm-uuid': 'ca290abd-2eb9-43ec-b212-b1cfe1fdf35c'}),), if_exists=True) {{(pid=74613) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 18:14:01 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 18:14:01 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:14:01 user nova-compute[74613]: INFO os_vif [None req-ab7fd62b-7ddc-447a-bd88-b69791003b80 tempest-TestVolumeBootPattern-1318569205 tempest-TestVolumeBootPattern-1318569205-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:15:0b:97,bridge_name='br-int',has_traffic_filtering=True,id=a0a4c680-262b-4bff-b523-0bc7a27baa88,network=Network(4a5179dd-d0b1-44c3-80c1-08dd7b0152f1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa0a4c680-26')
Nov 29 18:14:01 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-ab7fd62b-7ddc-447a-bd88-b69791003b80 tempest-TestVolumeBootPattern-1318569205 tempest-TestVolumeBootPattern-1318569205-project-member] No BDM found with device name vda, not building metadata. {{(pid=74613) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 18:14:01 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-ab7fd62b-7ddc-447a-bd88-b69791003b80 tempest-TestVolumeBootPattern-1318569205 tempest-TestVolumeBootPattern-1318569205-project-member] No VIF found with MAC fa:16:3e:15:0b:97, not building metadata {{(pid=74613) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 29 18:14:03 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:14:03 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:14:03 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:14:03 user nova-compute[74613]: DEBUG nova.compute.manager [req-923d5abe-14b9-4ecc-bb6c-c15ff962e364 req-e9fa6c8d-0f77-4103-ac98-9e8e5af9cb13 service nova] [instance: ca290abd-2eb9-43ec-b212-b1cfe1fdf35c] Received event network-vif-plugged-a0a4c680-262b-4bff-b523-0bc7a27baa88 {{(pid=74613) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 18:14:03 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-923d5abe-14b9-4ecc-bb6c-c15ff962e364 req-e9fa6c8d-0f77-4103-ac98-9e8e5af9cb13 service nova] Acquiring lock "ca290abd-2eb9-43ec-b212-b1cfe1fdf35c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 18:14:03 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-923d5abe-14b9-4ecc-bb6c-c15ff962e364 req-e9fa6c8d-0f77-4103-ac98-9e8e5af9cb13 service nova] Lock "ca290abd-2eb9-43ec-b212-b1cfe1fdf35c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 18:14:03 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-923d5abe-14b9-4ecc-bb6c-c15ff962e364 req-e9fa6c8d-0f77-4103-ac98-9e8e5af9cb13 service nova] Lock "ca290abd-2eb9-43ec-b212-b1cfe1fdf35c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 18:14:03 user nova-compute[74613]: DEBUG nova.compute.manager [req-923d5abe-14b9-4ecc-bb6c-c15ff962e364 req-e9fa6c8d-0f77-4103-ac98-9e8e5af9cb13 service nova] [instance: ca290abd-2eb9-43ec-b212-b1cfe1fdf35c] No waiting events found dispatching network-vif-plugged-a0a4c680-262b-4bff-b523-0bc7a27baa88 {{(pid=74613) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 18:14:03 user nova-compute[74613]: WARNING nova.compute.manager [req-923d5abe-14b9-4ecc-bb6c-c15ff962e364 req-e9fa6c8d-0f77-4103-ac98-9e8e5af9cb13 service nova] [instance: ca290abd-2eb9-43ec-b212-b1cfe1fdf35c] Received unexpected event network-vif-plugged-a0a4c680-262b-4bff-b523-0bc7a27baa88 for instance with vm_state building and task_state spawning.
Nov 29 18:14:03 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:14:03 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:14:03 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:14:03 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:14:05 user nova-compute[74613]: DEBUG nova.compute.manager [None req-ab7fd62b-7ddc-447a-bd88-b69791003b80 tempest-TestVolumeBootPattern-1318569205 tempest-TestVolumeBootPattern-1318569205-project-member] [instance: ca290abd-2eb9-43ec-b212-b1cfe1fdf35c] Instance event wait completed in 0 seconds for  {{(pid=74613) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 29 18:14:05 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-ab7fd62b-7ddc-447a-bd88-b69791003b80 tempest-TestVolumeBootPattern-1318569205 tempest-TestVolumeBootPattern-1318569205-project-member] [instance: ca290abd-2eb9-43ec-b212-b1cfe1fdf35c] Guest created on hypervisor {{(pid=74613) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 29 18:14:05 user nova-compute[74613]: INFO nova.virt.libvirt.driver [-] [instance: ca290abd-2eb9-43ec-b212-b1cfe1fdf35c] Instance spawned successfully.
Nov 29 18:14:05 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-ab7fd62b-7ddc-447a-bd88-b69791003b80 tempest-TestVolumeBootPattern-1318569205 tempest-TestVolumeBootPattern-1318569205-project-member] [instance: ca290abd-2eb9-43ec-b212-b1cfe1fdf35c] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74613) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 29 18:14:05 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-ab7fd62b-7ddc-447a-bd88-b69791003b80 tempest-TestVolumeBootPattern-1318569205 tempest-TestVolumeBootPattern-1318569205-project-member] [instance: ca290abd-2eb9-43ec-b212-b1cfe1fdf35c] Found default for hw_cdrom_bus of ide {{(pid=74613) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 18:14:05 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-ab7fd62b-7ddc-447a-bd88-b69791003b80 tempest-TestVolumeBootPattern-1318569205 tempest-TestVolumeBootPattern-1318569205-project-member] [instance: ca290abd-2eb9-43ec-b212-b1cfe1fdf35c] Found default for hw_disk_bus of virtio {{(pid=74613) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 18:14:05 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-ab7fd62b-7ddc-447a-bd88-b69791003b80 tempest-TestVolumeBootPattern-1318569205 tempest-TestVolumeBootPattern-1318569205-project-member] [instance: ca290abd-2eb9-43ec-b212-b1cfe1fdf35c] Found default for hw_input_bus of None {{(pid=74613) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 18:14:05 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-ab7fd62b-7ddc-447a-bd88-b69791003b80 tempest-TestVolumeBootPattern-1318569205 tempest-TestVolumeBootPattern-1318569205-project-member] [instance: ca290abd-2eb9-43ec-b212-b1cfe1fdf35c] Found default for hw_pointer_model of None {{(pid=74613) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 18:14:05 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-ab7fd62b-7ddc-447a-bd88-b69791003b80 tempest-TestVolumeBootPattern-1318569205 tempest-TestVolumeBootPattern-1318569205-project-member] [instance: ca290abd-2eb9-43ec-b212-b1cfe1fdf35c] Found default for hw_video_model of virtio {{(pid=74613) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 18:14:05 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-ab7fd62b-7ddc-447a-bd88-b69791003b80 tempest-TestVolumeBootPattern-1318569205 tempest-TestVolumeBootPattern-1318569205-project-member] [instance: ca290abd-2eb9-43ec-b212-b1cfe1fdf35c] Found default for hw_vif_model of virtio {{(pid=74613) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 18:14:05 user nova-compute[74613]: INFO nova.compute.manager [None req-ab7fd62b-7ddc-447a-bd88-b69791003b80 tempest-TestVolumeBootPattern-1318569205 tempest-TestVolumeBootPattern-1318569205-project-member] [instance: ca290abd-2eb9-43ec-b212-b1cfe1fdf35c] Took 4.96 seconds to spawn the instance on the hypervisor.
Nov 29 18:14:05 user nova-compute[74613]: DEBUG nova.compute.manager [None req-ab7fd62b-7ddc-447a-bd88-b69791003b80 tempest-TestVolumeBootPattern-1318569205 tempest-TestVolumeBootPattern-1318569205-project-member] [instance: ca290abd-2eb9-43ec-b212-b1cfe1fdf35c] Checking state {{(pid=74613) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 29 18:14:05 user nova-compute[74613]: INFO nova.compute.manager [None req-ab7fd62b-7ddc-447a-bd88-b69791003b80 tempest-TestVolumeBootPattern-1318569205 tempest-TestVolumeBootPattern-1318569205-project-member] [instance: ca290abd-2eb9-43ec-b212-b1cfe1fdf35c] Took 19.21 seconds to build instance.
Nov 29 18:14:05 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-ab7fd62b-7ddc-447a-bd88-b69791003b80 tempest-TestVolumeBootPattern-1318569205 tempest-TestVolumeBootPattern-1318569205-project-member] Lock "ca290abd-2eb9-43ec-b212-b1cfe1fdf35c" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 19.314s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 18:14:05 user nova-compute[74613]: DEBUG nova.compute.manager [req-6365f29b-c677-469d-be6c-3363fd513ac2 req-ff405a92-d2ec-475e-abd9-7b427f0f6767 service nova] [instance: ca290abd-2eb9-43ec-b212-b1cfe1fdf35c] Received event network-vif-plugged-a0a4c680-262b-4bff-b523-0bc7a27baa88 {{(pid=74613) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 18:14:05 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-6365f29b-c677-469d-be6c-3363fd513ac2 req-ff405a92-d2ec-475e-abd9-7b427f0f6767 service nova] Acquiring lock "ca290abd-2eb9-43ec-b212-b1cfe1fdf35c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 18:14:05 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-6365f29b-c677-469d-be6c-3363fd513ac2 req-ff405a92-d2ec-475e-abd9-7b427f0f6767 service nova] Lock "ca290abd-2eb9-43ec-b212-b1cfe1fdf35c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 18:14:05 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-6365f29b-c677-469d-be6c-3363fd513ac2 req-ff405a92-d2ec-475e-abd9-7b427f0f6767 service nova] Lock "ca290abd-2eb9-43ec-b212-b1cfe1fdf35c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 18:14:05 user nova-compute[74613]: DEBUG nova.compute.manager [req-6365f29b-c677-469d-be6c-3363fd513ac2 req-ff405a92-d2ec-475e-abd9-7b427f0f6767 service nova] [instance: ca290abd-2eb9-43ec-b212-b1cfe1fdf35c] No waiting events found dispatching network-vif-plugged-a0a4c680-262b-4bff-b523-0bc7a27baa88 {{(pid=74613) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 18:14:05 user nova-compute[74613]: WARNING nova.compute.manager [req-6365f29b-c677-469d-be6c-3363fd513ac2 req-ff405a92-d2ec-475e-abd9-7b427f0f6767 service nova] [instance: ca290abd-2eb9-43ec-b212-b1cfe1fdf35c] Received unexpected event network-vif-plugged-a0a4c680-262b-4bff-b523-0bc7a27baa88 for instance with vm_state active and task_state None.
Nov 29 18:14:05 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:14:06 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:14:10 user nova-compute[74613]: DEBUG nova.compute.manager [req-02d14e95-d4cf-4544-a7ca-7a1f03712a7c req-afe35405-6e81-470a-89c6-eb7dedacc17c service nova] [instance: fa144332-bad7-4373-94d9-018f41f50ee4] Received event network-changed-d2cb059e-f41b-41a5-b4a5-aef2d663eeb2 {{(pid=74613) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 18:14:10 user nova-compute[74613]: DEBUG nova.compute.manager [req-02d14e95-d4cf-4544-a7ca-7a1f03712a7c req-afe35405-6e81-470a-89c6-eb7dedacc17c service nova] [instance: fa144332-bad7-4373-94d9-018f41f50ee4] Refreshing instance network info cache due to event network-changed-d2cb059e-f41b-41a5-b4a5-aef2d663eeb2. {{(pid=74613) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 18:14:10 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-02d14e95-d4cf-4544-a7ca-7a1f03712a7c req-afe35405-6e81-470a-89c6-eb7dedacc17c service nova] Acquiring lock "refresh_cache-fa144332-bad7-4373-94d9-018f41f50ee4" {{(pid=74613) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 18:14:10 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-02d14e95-d4cf-4544-a7ca-7a1f03712a7c req-afe35405-6e81-470a-89c6-eb7dedacc17c service nova] Acquired lock "refresh_cache-fa144332-bad7-4373-94d9-018f41f50ee4" {{(pid=74613) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 18:14:10 user nova-compute[74613]: DEBUG nova.network.neutron [req-02d14e95-d4cf-4544-a7ca-7a1f03712a7c req-afe35405-6e81-470a-89c6-eb7dedacc17c service nova] [instance: fa144332-bad7-4373-94d9-018f41f50ee4] Refreshing network info cache for port d2cb059e-f41b-41a5-b4a5-aef2d663eeb2 {{(pid=74613) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 18:14:10 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:14:11 user nova-compute[74613]: DEBUG nova.network.neutron [req-02d14e95-d4cf-4544-a7ca-7a1f03712a7c req-afe35405-6e81-470a-89c6-eb7dedacc17c service nova] [instance: fa144332-bad7-4373-94d9-018f41f50ee4] Updated VIF entry in instance network info cache for port d2cb059e-f41b-41a5-b4a5-aef2d663eeb2. {{(pid=74613) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 18:14:11 user nova-compute[74613]: DEBUG nova.network.neutron [req-02d14e95-d4cf-4544-a7ca-7a1f03712a7c req-afe35405-6e81-470a-89c6-eb7dedacc17c service nova] [instance: fa144332-bad7-4373-94d9-018f41f50ee4] Updating instance_info_cache with network_info: [{"id": "d2cb059e-f41b-41a5-b4a5-aef2d663eeb2", "address": "fa:16:3e:bc:1d:c9", "network": {"id": "c317481b-f8cf-40a0-a326-836a5ea4c495", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-887666255-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.179", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "37b89c13ba1d4a94805d6af69ad26fb8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd2cb059e-f4", "ovs_interfaceid": "d2cb059e-f41b-41a5-b4a5-aef2d663eeb2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74613) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 18:14:11 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-02d14e95-d4cf-4544-a7ca-7a1f03712a7c req-afe35405-6e81-470a-89c6-eb7dedacc17c service nova] Releasing lock "refresh_cache-fa144332-bad7-4373-94d9-018f41f50ee4" {{(pid=74613) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 18:14:11 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:14:13 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-a17d917a-94b2-4031-a10c-cc6053b5878f tempest-AttachVolumeNegativeTest-483083654 tempest-AttachVolumeNegativeTest-483083654-project-member] Acquiring lock "fa144332-bad7-4373-94d9-018f41f50ee4" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 18:14:13 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-a17d917a-94b2-4031-a10c-cc6053b5878f tempest-AttachVolumeNegativeTest-483083654 tempest-AttachVolumeNegativeTest-483083654-project-member] Lock "fa144332-bad7-4373-94d9-018f41f50ee4" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 18:14:13 user nova-compute[74613]: DEBUG nova.objects.instance [None req-a17d917a-94b2-4031-a10c-cc6053b5878f tempest-AttachVolumeNegativeTest-483083654 tempest-AttachVolumeNegativeTest-483083654-project-member] Lazy-loading 'flavor' on Instance uuid fa144332-bad7-4373-94d9-018f41f50ee4 {{(pid=74613) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 18:14:13 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-a17d917a-94b2-4031-a10c-cc6053b5878f tempest-AttachVolumeNegativeTest-483083654 tempest-AttachVolumeNegativeTest-483083654-project-member] Lock "fa144332-bad7-4373-94d9-018f41f50ee4" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.079s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 18:14:13 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-a17d917a-94b2-4031-a10c-cc6053b5878f tempest-AttachVolumeNegativeTest-483083654 tempest-AttachVolumeNegativeTest-483083654-project-member] Acquiring lock "fa144332-bad7-4373-94d9-018f41f50ee4" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 18:14:13 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-a17d917a-94b2-4031-a10c-cc6053b5878f tempest-AttachVolumeNegativeTest-483083654 tempest-AttachVolumeNegativeTest-483083654-project-member] Lock "fa144332-bad7-4373-94d9-018f41f50ee4" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 18:14:13 user nova-compute[74613]: INFO nova.compute.manager [None req-a17d917a-94b2-4031-a10c-cc6053b5878f tempest-AttachVolumeNegativeTest-483083654 tempest-AttachVolumeNegativeTest-483083654-project-member] [instance: fa144332-bad7-4373-94d9-018f41f50ee4] Attaching volume 126f927d-c446-4653-b7c9-b0254f7119bd to /dev/vdb
Nov 29 18:14:14 user nova-compute[74613]: DEBUG os_brick.utils [None req-a17d917a-94b2-4031-a10c-cc6053b5878f tempest-AttachVolumeNegativeTest-483083654 tempest-AttachVolumeNegativeTest-483083654-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74613) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 18:14:14 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:14:14 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:14:14 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[2fb027be-4bbf-479f-82bf-467afa5d3cd1]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:400972819b5\n', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 18:14:14 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:14:14 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:14:14 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3233b5d-5066-4f90-8da9-a305855a0b7b]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 18:14:14 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:14:14 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:14:14 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[bbd36d25-9704-4262-91b7-ebec9cad60b8]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 18:14:14 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[12e8ff79-391a-4a3d-b8f7-833fc92c1acc]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 18:14:14 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-a17d917a-94b2-4031-a10c-cc6053b5878f tempest-AttachVolumeNegativeTest-483083654 tempest-AttachVolumeNegativeTest-483083654-project-member] Running cmd (subprocess): nvme version {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:14:14 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-a17d917a-94b2-4031-a10c-cc6053b5878f tempest-AttachVolumeNegativeTest-483083654 tempest-AttachVolumeNegativeTest-483083654-project-member] 'nvme version' failed. Not Retrying. {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 18:14:14 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.nvmeof [None req-a17d917a-94b2-4031-a10c-cc6053b5878f tempest-AttachVolumeNegativeTest-483083654 tempest-AttachVolumeNegativeTest-483083654-project-member] nvme not present on system {{(pid=74613) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 29 18:14:14 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:14:14 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 18:14:14 user nova-compute[74613]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 29 18:14:14 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[95b605de-05fb-41e9-b91b-c0e2893534a4]: (4, '') {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 18:14:14 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.lightos [None req-a17d917a-94b2-4031-a10c-cc6053b5878f tempest-AttachVolumeNegativeTest-483083654 tempest-AttachVolumeNegativeTest-483083654-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74613) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 29 18:14:14 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.lightos [None req-a17d917a-94b2-4031-a10c-cc6053b5878f tempest-AttachVolumeNegativeTest-483083654 tempest-AttachVolumeNegativeTest-483083654-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74613) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 29 18:14:14 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.lightos [None req-a17d917a-94b2-4031-a10c-cc6053b5878f tempest-AttachVolumeNegativeTest-483083654 tempest-AttachVolumeNegativeTest-483083654-project-member] LIGHTOS: no hostnqn found. {{(pid=74613) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 29 18:14:14 user nova-compute[74613]: DEBUG os_brick.utils [None req-a17d917a-94b2-4031-a10c-cc6053b5878f tempest-AttachVolumeNegativeTest-483083654 tempest-AttachVolumeNegativeTest-483083654-project-member] <== get_connector_properties: return (121ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:400972819b5', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74613) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 18:14:14 user nova-compute[74613]: DEBUG nova.virt.block_device [None req-a17d917a-94b2-4031-a10c-cc6053b5878f tempest-AttachVolumeNegativeTest-483083654 tempest-AttachVolumeNegativeTest-483083654-project-member] [instance: fa144332-bad7-4373-94d9-018f41f50ee4] Updating existing volume attachment record: 6394147c-9252-4395-81eb-75f75e2c369c {{(pid=74613) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 29 18:14:15 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:14:16 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:14:16 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:14:21 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:14:21 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:14:22 user nova-compute[74613]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a17d917a-94b2-4031-a10c-cc6053b5878f tempest-AttachVolumeNegativeTest-483083654 tempest-AttachVolumeNegativeTest-483083654-project-member] [instance: fa144332-bad7-4373-94d9-018f41f50ee4] Calling os-brick to attach iSCSI Volume {{(pid=74613) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 29 18:14:22 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-a17d917a-94b2-4031-a10c-cc6053b5878f tempest-AttachVolumeNegativeTest-483083654 tempest-AttachVolumeNegativeTest-483083654-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff828156890>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:126f927d-c446-4653-b7c9-b0254f7119bd', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'pSFdyHoU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74613) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 18:14:22 user nova-compute[74613]: WARNING os_brick.initiator.connectors.base [None req-a17d917a-94b2-4031-a10c-cc6053b5878f tempest-AttachVolumeNegativeTest-483083654 tempest-AttachVolumeNegativeTest-483083654-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 18:14:22 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.base [None req-a17d917a-94b2-4031-a10c-cc6053b5878f tempest-AttachVolumeNegativeTest-483083654 tempest-AttachVolumeNegativeTest-483083654-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 18:14:22 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.base [None req-a17d917a-94b2-4031-a10c-cc6053b5878f tempest-AttachVolumeNegativeTest-483083654 tempest-AttachVolumeNegativeTest-483083654-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 18:14:22 user nova-compute[74613]: WARNING os_brick.initiator.connectors.base [None req-a17d917a-94b2-4031-a10c-cc6053b5878f tempest-AttachVolumeNegativeTest-483083654 tempest-AttachVolumeNegativeTest-483083654-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 18:14:22 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.base [None req-a17d917a-94b2-4031-a10c-cc6053b5878f tempest-AttachVolumeNegativeTest-483083654 tempest-AttachVolumeNegativeTest-483083654-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:126f927d-c446-4653-b7c9-b0254f7119bd" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 18:14:22 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.base [None req-a17d917a-94b2-4031-a10c-cc6053b5878f tempest-AttachVolumeNegativeTest-483083654 tempest-AttachVolumeNegativeTest-483083654-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:126f927d-c446-4653-b7c9-b0254f7119bd" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 18:14:22 user nova-compute[74613]: INFO os_brick.initiator.connectors.iscsi [None req-a17d917a-94b2-4031-a10c-cc6053b5878f tempest-AttachVolumeNegativeTest-483083654 tempest-AttachVolumeNegativeTest-483083654-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 29 18:14:22 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:126f927d-c446-4653-b7c9-b0254f7119bd -p 172.16.0.220:3260 {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:14:22 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:126f927d-c446-4653-b7c9-b0254f7119bd -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:14:22 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d421688-2bfe-420d-b991-f434cc7233e0]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 18:14:22 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-a17d917a-94b2-4031-a10c-cc6053b5878f tempest-AttachVolumeNegativeTest-483083654 tempest-AttachVolumeNegativeTest-483083654-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 29 18:14:22 user nova-compute[74613]:  {{(pid=74613) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 18:14:22 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:126f927d-c446-4653-b7c9-b0254f7119bd -p 172.16.0.220:3260 --interface default --op new {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:14:22 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:126f927d-c446-4653-b7c9-b0254f7119bd -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:14:22 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[883f886b-a00d-4c1a-bf26-aa3aab785206]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:126f927d-c446-4653-b7c9-b0254f7119bd] added\n', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 18:14:22 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-a17d917a-94b2-4031-a10c-cc6053b5878f tempest-AttachVolumeNegativeTest-483083654 tempest-AttachVolumeNegativeTest-483083654-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:126f927d-c446-4653-b7c9-b0254f7119bd] added
Nov 29 18:14:22 user nova-compute[74613]:  stderr= {{(pid=74613) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 18:14:22 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:126f927d-c446-4653-b7c9-b0254f7119bd -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:14:22 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:126f927d-c446-4653-b7c9-b0254f7119bd -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:14:22 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7f7051c-2f44-4c59-8a20-a84980c17c03]: (4, ('', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 18:14:22 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-a17d917a-94b2-4031-a10c-cc6053b5878f tempest-AttachVolumeNegativeTest-483083654 tempest-AttachVolumeNegativeTest-483083654-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74613) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 18:14:22 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:126f927d-c446-4653-b7c9-b0254f7119bd -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:14:22 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:126f927d-c446-4653-b7c9-b0254f7119bd -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:14:22 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[79189f85-3795-46be-a604-164eefbc2413]: (4, ('', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 18:14:22 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-a17d917a-94b2-4031-a10c-cc6053b5878f tempest-AttachVolumeNegativeTest-483083654 tempest-AttachVolumeNegativeTest-483083654-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74613) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 18:14:22 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:126f927d-c446-4653-b7c9-b0254f7119bd -p 172.16.0.220:3260 --op update -n node.session.auth.username -v pSFdyHoU {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:14:22 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:126f927d-c446-4653-b7c9-b0254f7119bd -p 172.16.0.220:3260 --op update -n node.session.auth.username -v pSFdyHoU" returned: 0 in 0.017s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:14:22 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[95248d94-cc71-4cbf-b491-85d5ec3ef9ca]: (4, ('', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 18:14:22 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-a17d917a-94b2-4031-a10c-cc6053b5878f tempest-AttachVolumeNegativeTest-483083654 tempest-AttachVolumeNegativeTest-483083654-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'pSFdyHoU'): stdout= stderr= {{(pid=74613) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 18:14:22 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:126f927d-c446-4653-b7c9-b0254f7119bd -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:14:22 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:126f927d-c446-4653-b7c9-b0254f7119bd -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:14:22 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0aa418a-c3dc-4b54-b877-53548cb52bb5]: (4, ('', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 18:14:22 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-a17d917a-94b2-4031-a10c-cc6053b5878f tempest-AttachVolumeNegativeTest-483083654 tempest-AttachVolumeNegativeTest-483083654-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74613) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 18:14:22 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:14:22 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:14:22 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[06c1d35e-a5fb-409a-9a1d-1c67f882f299]: (4, ('tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1cd1b4f3-6008-4bef-bb8d-e92e973d5a96 (non-flash)\n', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 18:14:22 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-a17d917a-94b2-4031-a10c-cc6053b5878f tempest-AttachVolumeNegativeTest-483083654 tempest-AttachVolumeNegativeTest-483083654-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1cd1b4f3-6008-4bef-bb8d-e92e973d5a96 (non-flash)
Nov 29 18:14:22 user nova-compute[74613]:  stderr= {{(pid=74613) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 18:14:22 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-a17d917a-94b2-4031-a10c-cc6053b5878f tempest-AttachVolumeNegativeTest-483083654 tempest-AttachVolumeNegativeTest-483083654-project-member] iscsi session list stdout=tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1cd1b4f3-6008-4bef-bb8d-e92e973d5a96 (non-flash)
Nov 29 18:14:22 user nova-compute[74613]:  stderr= {{(pid=74613) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 18:14:22 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:126f927d-c446-4653-b7c9-b0254f7119bd -p 172.16.0.220:3260 --login {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:14:22 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:126f927d-c446-4653-b7c9-b0254f7119bd -p 172.16.0.220:3260 --login" returned: 0 in 0.050s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:14:22 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f1f38c2-e441-49f0-997d-5e0031129471]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:126f927d-c446-4653-b7c9-b0254f7119bd, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:126f927d-c446-4653-b7c9-b0254f7119bd, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 18:14:22 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-a17d917a-94b2-4031-a10c-cc6053b5878f tempest-AttachVolumeNegativeTest-483083654 tempest-AttachVolumeNegativeTest-483083654-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:126f927d-c446-4653-b7c9-b0254f7119bd, portal: 172.16.0.220,3260]
Nov 29 18:14:22 user nova-compute[74613]: Login to [iface: default, target: iqn.2010-10.org.openstack:126f927d-c446-4653-b7c9-b0254f7119bd, portal: 172.16.0.220,3260] successful.
Nov 29 18:14:22 user nova-compute[74613]:  stderr= {{(pid=74613) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 18:14:22 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:126f927d-c446-4653-b7c9-b0254f7119bd -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:14:22 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:126f927d-c446-4653-b7c9-b0254f7119bd -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:14:22 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[375ca83d-a800-43b8-984b-85c4490bf223]: (4, ('', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 18:14:22 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-a17d917a-94b2-4031-a10c-cc6053b5878f tempest-AttachVolumeNegativeTest-483083654 tempest-AttachVolumeNegativeTest-483083654-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74613) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 18:14:22 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:14:22 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:14:22 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[68218858-b9a7-4e9c-945d-301c0cc3a720]: (4, ('tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1cd1b4f3-6008-4bef-bb8d-e92e973d5a96 (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:126f927d-c446-4653-b7c9-b0254f7119bd (non-flash)\n', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 18:14:22 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-a17d917a-94b2-4031-a10c-cc6053b5878f tempest-AttachVolumeNegativeTest-483083654 tempest-AttachVolumeNegativeTest-483083654-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1cd1b4f3-6008-4bef-bb8d-e92e973d5a96 (non-flash)
Nov 29 18:14:22 user nova-compute[74613]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:126f927d-c446-4653-b7c9-b0254f7119bd (non-flash)
Nov 29 18:14:22 user nova-compute[74613]:  stderr= {{(pid=74613) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 18:14:22 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-a17d917a-94b2-4031-a10c-cc6053b5878f tempest-AttachVolumeNegativeTest-483083654 tempest-AttachVolumeNegativeTest-483083654-project-member] iscsi session list stdout=tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1cd1b4f3-6008-4bef-bb8d-e92e973d5a96 (non-flash)
Nov 29 18:14:22 user nova-compute[74613]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:126f927d-c446-4653-b7c9-b0254f7119bd (non-flash)
Nov 29 18:14:22 user nova-compute[74613]:  stderr= {{(pid=74613) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 18:14:22 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.base [None req-a17d917a-94b2-4031-a10c-cc6053b5878f tempest-AttachVolumeNegativeTest-483083654 tempest-AttachVolumeNegativeTest-483083654-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:126f927d-c446-4653-b7c9-b0254f7119bd" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.254s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 18:14:22 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-a17d917a-94b2-4031-a10c-cc6053b5878f tempest-AttachVolumeNegativeTest-483083654 tempest-AttachVolumeNegativeTest-483083654-project-member] Connected to 172.16.0.220:3260 {{(pid=74613) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 29 18:14:22 user nova-compute[74613]: DEBUG os_brick.initiator.linuxscsi [None req-a17d917a-94b2-4031-a10c-cc6053b5878f tempest-AttachVolumeNegativeTest-483083654 tempest-AttachVolumeNegativeTest-483083654-project-member] HCTL ('34', '-', '-', 0) found on session 43 with lun 0 {{(pid=74613) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 29 18:14:22 user nova-compute[74613]: DEBUG os_brick.initiator.linuxscsi [None req-a17d917a-94b2-4031-a10c-cc6053b5878f tempest-AttachVolumeNegativeTest-483083654 tempest-AttachVolumeNegativeTest-483083654-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=74613) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 29 18:14:22 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:14:22 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.016s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:14:22 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a57e726-7131-4e5e-93e3-8127b9e405a1]: (4, ('- - 0', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 18:14:22 user nova-compute[74613]: DEBUG os_brick.initiator.linuxscsi [None req-a17d917a-94b2-4031-a10c-cc6053b5878f tempest-AttachVolumeNegativeTest-483083654 tempest-AttachVolumeNegativeTest-483083654-project-member] Searching for a device in session 43 and hctl ['34', '*', '*', 0] yield: None {{(pid=74613) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 29 18:14:23 user nova-compute[74613]: DEBUG os_brick.initiator.linuxscsi [None req-a17d917a-94b2-4031-a10c-cc6053b5878f tempest-AttachVolumeNegativeTest-483083654 tempest-AttachVolumeNegativeTest-483083654-project-member] Searching for a device in session 43 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=74613) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 29 18:14:23 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-a17d917a-94b2-4031-a10c-cc6053b5878f tempest-AttachVolumeNegativeTest-483083654 tempest-AttachVolumeNegativeTest-483083654-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:126f927d-c446-4653-b7c9-b0254f7119bd', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'pSFdyHoU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74613) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 29 18:14:23 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.base [None req-a17d917a-94b2-4031-a10c-cc6053b5878f tempest-AttachVolumeNegativeTest-483083654 tempest-AttachVolumeNegativeTest-483083654-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.281s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 18:14:23 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-a17d917a-94b2-4031-a10c-cc6053b5878f tempest-AttachVolumeNegativeTest-483083654 tempest-AttachVolumeNegativeTest-483083654-project-member] <== connect_volume: return (1283ms) {'type': 'block', 'scsi_wwn': '26539653239393363', 'path': '/dev/sdc'} {{(pid=74613) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 18:14:23 user nova-compute[74613]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a17d917a-94b2-4031-a10c-cc6053b5878f tempest-AttachVolumeNegativeTest-483083654 tempest-AttachVolumeNegativeTest-483083654-project-member] [instance: fa144332-bad7-4373-94d9-018f41f50ee4] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26539653239393363', 'path': '/dev/sdc'} {{(pid=74613) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 29 18:14:23 user nova-compute[74613]: DEBUG nova.objects.instance [None req-a17d917a-94b2-4031-a10c-cc6053b5878f tempest-AttachVolumeNegativeTest-483083654 tempest-AttachVolumeNegativeTest-483083654-project-member] Lazy-loading 'flavor' on Instance uuid fa144332-bad7-4373-94d9-018f41f50ee4 {{(pid=74613) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 18:14:23 user nova-compute[74613]: DEBUG nova.virt.libvirt.guest [None req-a17d917a-94b2-4031-a10c-cc6053b5878f tempest-AttachVolumeNegativeTest-483083654 tempest-AttachVolumeNegativeTest-483083654-project-member] attach device xml: <disk type="block" device="disk">
Nov 29 18:14:23 user nova-compute[74613]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 18:14:23 user nova-compute[74613]:   <source dev="/dev/sdc"/>
Nov 29 18:14:23 user nova-compute[74613]:   <target dev="vdb" bus="virtio"/>
Nov 29 18:14:23 user nova-compute[74613]:   <serial>126f927d-c446-4653-b7c9-b0254f7119bd</serial>
Nov 29 18:14:23 user nova-compute[74613]: </disk>
Nov 29 18:14:23 user nova-compute[74613]:  {{(pid=74613) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 29 18:14:24 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-a17d917a-94b2-4031-a10c-cc6053b5878f tempest-AttachVolumeNegativeTest-483083654 tempest-AttachVolumeNegativeTest-483083654-project-member] No BDM found with device name vda, not building metadata. {{(pid=74613) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 18:14:24 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-a17d917a-94b2-4031-a10c-cc6053b5878f tempest-AttachVolumeNegativeTest-483083654 tempest-AttachVolumeNegativeTest-483083654-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74613) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 18:14:24 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-a17d917a-94b2-4031-a10c-cc6053b5878f tempest-AttachVolumeNegativeTest-483083654 tempest-AttachVolumeNegativeTest-483083654-project-member] No VIF found with MAC fa:16:3e:bc:1d:c9, not building metadata {{(pid=74613) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 29 18:14:24 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-a17d917a-94b2-4031-a10c-cc6053b5878f tempest-AttachVolumeNegativeTest-483083654 tempest-AttachVolumeNegativeTest-483083654-project-member] Lock "fa144332-bad7-4373-94d9-018f41f50ee4" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 10.563s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 18:14:25 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-4eecf745-9df5-450e-bcd6-877c71c85f12 tempest-AttachVolumeNegativeTest-483083654 tempest-AttachVolumeNegativeTest-483083654-project-member] Acquiring lock "fa144332-bad7-4373-94d9-018f41f50ee4" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 18:14:25 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-4eecf745-9df5-450e-bcd6-877c71c85f12 tempest-AttachVolumeNegativeTest-483083654 tempest-AttachVolumeNegativeTest-483083654-project-member] Lock "fa144332-bad7-4373-94d9-018f41f50ee4" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 18:14:25 user nova-compute[74613]: INFO nova.compute.manager [None req-4eecf745-9df5-450e-bcd6-877c71c85f12 tempest-AttachVolumeNegativeTest-483083654 tempest-AttachVolumeNegativeTest-483083654-project-member] [instance: fa144332-bad7-4373-94d9-018f41f50ee4] Detaching volume 126f927d-c446-4653-b7c9-b0254f7119bd
Nov 29 18:14:25 user nova-compute[74613]: INFO nova.virt.block_device [None req-4eecf745-9df5-450e-bcd6-877c71c85f12 tempest-AttachVolumeNegativeTest-483083654 tempest-AttachVolumeNegativeTest-483083654-project-member] [instance: fa144332-bad7-4373-94d9-018f41f50ee4] Attempting to driver detach volume 126f927d-c446-4653-b7c9-b0254f7119bd from mountpoint /dev/vdb
Nov 29 18:14:25 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-4eecf745-9df5-450e-bcd6-877c71c85f12 tempest-AttachVolumeNegativeTest-483083654 tempest-AttachVolumeNegativeTest-483083654-project-member] Attempting to detach device vdb from instance fa144332-bad7-4373-94d9-018f41f50ee4 from the persistent domain config. {{(pid=74613) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 29 18:14:25 user nova-compute[74613]: DEBUG nova.virt.libvirt.guest [None req-4eecf745-9df5-450e-bcd6-877c71c85f12 tempest-AttachVolumeNegativeTest-483083654 tempest-AttachVolumeNegativeTest-483083654-project-member] detach device xml: <disk type="block" device="disk">
Nov 29 18:14:25 user nova-compute[74613]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 18:14:25 user nova-compute[74613]:   <source dev="/dev/sdc"/>
Nov 29 18:14:25 user nova-compute[74613]:   <target dev="vdb" bus="virtio"/>
Nov 29 18:14:25 user nova-compute[74613]:   <serial>126f927d-c446-4653-b7c9-b0254f7119bd</serial>
Nov 29 18:14:25 user nova-compute[74613]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 29 18:14:25 user nova-compute[74613]: </disk>
Nov 29 18:14:25 user nova-compute[74613]:  {{(pid=74613) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 29 18:14:25 user nova-compute[74613]: INFO nova.virt.libvirt.driver [None req-4eecf745-9df5-450e-bcd6-877c71c85f12 tempest-AttachVolumeNegativeTest-483083654 tempest-AttachVolumeNegativeTest-483083654-project-member] Successfully detached device vdb from instance fa144332-bad7-4373-94d9-018f41f50ee4 from the persistent domain config.
Nov 29 18:14:25 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-4eecf745-9df5-450e-bcd6-877c71c85f12 tempest-AttachVolumeNegativeTest-483083654 tempest-AttachVolumeNegativeTest-483083654-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance fa144332-bad7-4373-94d9-018f41f50ee4 from the live domain config. {{(pid=74613) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 29 18:14:25 user nova-compute[74613]: DEBUG nova.virt.libvirt.guest [None req-4eecf745-9df5-450e-bcd6-877c71c85f12 tempest-AttachVolumeNegativeTest-483083654 tempest-AttachVolumeNegativeTest-483083654-project-member] detach device xml: <disk type="block" device="disk">
Nov 29 18:14:25 user nova-compute[74613]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 18:14:25 user nova-compute[74613]:   <source dev="/dev/sdc"/>
Nov 29 18:14:25 user nova-compute[74613]:   <target dev="vdb" bus="virtio"/>
Nov 29 18:14:25 user nova-compute[74613]:   <serial>126f927d-c446-4653-b7c9-b0254f7119bd</serial>
Nov 29 18:14:25 user nova-compute[74613]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 29 18:14:25 user nova-compute[74613]: </disk>
Nov 29 18:14:25 user nova-compute[74613]:  {{(pid=74613) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 29 18:14:25 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-4eecf745-9df5-450e-bcd6-877c71c85f12 tempest-AttachVolumeNegativeTest-483083654 tempest-AttachVolumeNegativeTest-483083654-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance fa144332-bad7-4373-94d9-018f41f50ee4 {{(pid=74613) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 29 18:14:26 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:14:26 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:14:31 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:14:31 user nova-compute[74613]: DEBUG oslo_service.periodic_task [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74613) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 18:14:31 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:14:33 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:14:33 user nova-compute[74613]: DEBUG oslo_service.periodic_task [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74613) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 18:14:33 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 18:14:33 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 18:14:33 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 18:14:33 user nova-compute[74613]: DEBUG nova.compute.resource_tracker [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Auditing locally available compute resources for user (node: user) {{(pid=74613) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 29 18:14:33 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1f2b4426-815f-4ef4-b98e-e5124fec93b7/disk --force-share --output=json {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:14:33 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1f2b4426-815f-4ef4-b98e-e5124fec93b7/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:14:33 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1f2b4426-815f-4ef4-b98e-e5124fec93b7/disk --force-share --output=json {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:14:34 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1f2b4426-815f-4ef4-b98e-e5124fec93b7/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:14:34 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74613) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 29 18:14:34 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/69109f06-acbf-4834-b05e-80ab6e3f6ea0/disk --force-share --output=json {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:14:34 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/69109f06-acbf-4834-b05e-80ab6e3f6ea0/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:14:34 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/69109f06-acbf-4834-b05e-80ab6e3f6ea0/disk --force-share --output=json {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:14:34 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/69109f06-acbf-4834-b05e-80ab6e3f6ea0/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:14:34 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f4a1329-b3b9-4d1c-8735-abddabc359fd/disk.rescue --force-share --output=json {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:14:34 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f4a1329-b3b9-4d1c-8735-abddabc359fd/disk.rescue --force-share --output=json" returned: 0 in 0.187s {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:14:34 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f4a1329-b3b9-4d1c-8735-abddabc359fd/disk.rescue --force-share --output=json {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:14:34 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f4a1329-b3b9-4d1c-8735-abddabc359fd/disk.rescue --force-share --output=json" returned: 0 in 0.202s {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:14:34 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f4a1329-b3b9-4d1c-8735-abddabc359fd/disk --force-share --output=json {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:14:35 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f4a1329-b3b9-4d1c-8735-abddabc359fd/disk --force-share --output=json" returned: 0 in 0.222s {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:14:35 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f4a1329-b3b9-4d1c-8735-abddabc359fd/disk --force-share --output=json {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:14:35 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f4a1329-b3b9-4d1c-8735-abddabc359fd/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:14:35 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fa144332-bad7-4373-94d9-018f41f50ee4/disk --force-share --output=json {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:14:35 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:14:35 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fa144332-bad7-4373-94d9-018f41f50ee4/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:14:35 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fa144332-bad7-4373-94d9-018f41f50ee4/disk --force-share --output=json {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:14:35 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fa144332-bad7-4373-94d9-018f41f50ee4/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:14:35 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6993e2e7-7e03-45b4-9d3d-3742589b6078/disk --force-share --output=json {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:14:35 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6993e2e7-7e03-45b4-9d3d-3742589b6078/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:14:35 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6993e2e7-7e03-45b4-9d3d-3742589b6078/disk --force-share --output=json {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:14:36 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:14:36 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6993e2e7-7e03-45b4-9d3d-3742589b6078/disk --force-share --output=json" returned: 0 in 0.268s {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:14:36 user nova-compute[74613]: WARNING nova.virt.libvirt.driver [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 18:14:36 user nova-compute[74613]: WARNING nova.virt.libvirt.driver [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 18:14:36 user nova-compute[74613]: DEBUG nova.compute.resource_tracker [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Hypervisor/Node resource view: name=user free_ram=8214MB free_disk=24.893104553222656GB free_vcpus=6 pci_devices=[{"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74613) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 29 18:14:36 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 18:14:36 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 18:14:36 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:14:36 user nova-compute[74613]: DEBUG nova.compute.resource_tracker [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Instance 6993e2e7-7e03-45b4-9d3d-3742589b6078 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74613) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 18:14:36 user nova-compute[74613]: DEBUG nova.compute.resource_tracker [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Instance 6f4a1329-b3b9-4d1c-8735-abddabc359fd actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74613) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 18:14:36 user nova-compute[74613]: DEBUG nova.compute.resource_tracker [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Instance 69109f06-acbf-4834-b05e-80ab6e3f6ea0 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74613) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 18:14:36 user nova-compute[74613]: DEBUG nova.compute.resource_tracker [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Instance fa144332-bad7-4373-94d9-018f41f50ee4 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74613) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 18:14:36 user nova-compute[74613]: DEBUG nova.compute.resource_tracker [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Instance 1f2b4426-815f-4ef4-b98e-e5124fec93b7 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74613) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 18:14:36 user nova-compute[74613]: DEBUG nova.compute.resource_tracker [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Instance ca290abd-2eb9-43ec-b212-b1cfe1fdf35c actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74613) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 18:14:36 user nova-compute[74613]: DEBUG nova.compute.resource_tracker [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Total usable vcpus: 12, total allocated vcpus: 6 {{(pid=74613) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 29 18:14:36 user nova-compute[74613]: DEBUG nova.compute.resource_tracker [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Final resource view: name=user phys_ram=16011MB used_ram=3584MB phys_disk=40GB used_disk=5GB total_vcpus=12 used_vcpus=6 pci_stats=[] {{(pid=74613) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 29 18:14:37 user nova-compute[74613]: DEBUG nova.compute.provider_tree [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Inventory has not changed in ProviderTree for provider: 639d980e-3b12-44b1-b8f4-1812416fa4dd {{(pid=74613) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 18:14:37 user nova-compute[74613]: DEBUG nova.scheduler.client.report [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Inventory has not changed for provider 639d980e-3b12-44b1-b8f4-1812416fa4dd based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74613) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 18:14:37 user nova-compute[74613]: DEBUG nova.compute.resource_tracker [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Compute_service record updated for user:user {{(pid=74613) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 29 18:14:37 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.469s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 18:14:38 user nova-compute[74613]: DEBUG oslo_service.periodic_task [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74613) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 18:14:38 user nova-compute[74613]: DEBUG oslo_service.periodic_task [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74613) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 18:14:38 user nova-compute[74613]: DEBUG oslo_service.periodic_task [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74613) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 18:14:38 user nova-compute[74613]: DEBUG oslo_service.periodic_task [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74613) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 18:14:38 user nova-compute[74613]: DEBUG nova.compute.manager [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Starting heal instance info cache {{(pid=74613) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 29 18:14:38 user nova-compute[74613]: DEBUG nova.compute.manager [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Didn't find any instances for network info cache update. {{(pid=74613) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 29 18:14:39 user nova-compute[74613]: DEBUG oslo_service.periodic_task [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74613) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 18:14:39 user nova-compute[74613]: DEBUG oslo_service.periodic_task [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74613) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 18:14:39 user nova-compute[74613]: DEBUG nova.compute.manager [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74613) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 29 18:14:40 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:14:40 user nova-compute[74613]: DEBUG oslo_service.periodic_task [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74613) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 18:14:41 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:14:41 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:14:42 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:14:43 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-206e8b21-88a3-488c-8ab4-7d1df0990547 tempest-VolumesActionsTest-1891851968 tempest-VolumesActionsTest-1891851968-project-member] Acquiring lock "8ef9c2f4-23d0-44eb-9ba9-8c7c3f6b0874" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 18:14:43 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-206e8b21-88a3-488c-8ab4-7d1df0990547 tempest-VolumesActionsTest-1891851968 tempest-VolumesActionsTest-1891851968-project-member] Lock "8ef9c2f4-23d0-44eb-9ba9-8c7c3f6b0874" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.002s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 18:14:43 user nova-compute[74613]: DEBUG nova.compute.manager [None req-206e8b21-88a3-488c-8ab4-7d1df0990547 tempest-VolumesActionsTest-1891851968 tempest-VolumesActionsTest-1891851968-project-member] [instance: 8ef9c2f4-23d0-44eb-9ba9-8c7c3f6b0874] Starting instance... {{(pid=74613) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 29 18:14:43 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-206e8b21-88a3-488c-8ab4-7d1df0990547 tempest-VolumesActionsTest-1891851968 tempest-VolumesActionsTest-1891851968-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 18:14:43 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-206e8b21-88a3-488c-8ab4-7d1df0990547 tempest-VolumesActionsTest-1891851968 tempest-VolumesActionsTest-1891851968-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 18:14:43 user nova-compute[74613]: DEBUG nova.virt.hardware [None req-206e8b21-88a3-488c-8ab4-7d1df0990547 tempest-VolumesActionsTest-1891851968 tempest-VolumesActionsTest-1891851968-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74613) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 29 18:14:43 user nova-compute[74613]: INFO nova.compute.claims [None req-206e8b21-88a3-488c-8ab4-7d1df0990547 tempest-VolumesActionsTest-1891851968 tempest-VolumesActionsTest-1891851968-project-member] [instance: 8ef9c2f4-23d0-44eb-9ba9-8c7c3f6b0874] Claim successful on node user
Nov 29 18:14:44 user nova-compute[74613]: DEBUG nova.compute.provider_tree [None req-206e8b21-88a3-488c-8ab4-7d1df0990547 tempest-VolumesActionsTest-1891851968 tempest-VolumesActionsTest-1891851968-project-member] Inventory has not changed in ProviderTree for provider: 639d980e-3b12-44b1-b8f4-1812416fa4dd {{(pid=74613) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 18:14:44 user nova-compute[74613]: DEBUG nova.scheduler.client.report [None req-206e8b21-88a3-488c-8ab4-7d1df0990547 tempest-VolumesActionsTest-1891851968 tempest-VolumesActionsTest-1891851968-project-member] Inventory has not changed for provider 639d980e-3b12-44b1-b8f4-1812416fa4dd based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74613) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 18:14:44 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-206e8b21-88a3-488c-8ab4-7d1df0990547 tempest-VolumesActionsTest-1891851968 tempest-VolumesActionsTest-1891851968-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.455s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 18:14:44 user nova-compute[74613]: DEBUG nova.compute.manager [None req-206e8b21-88a3-488c-8ab4-7d1df0990547 tempest-VolumesActionsTest-1891851968 tempest-VolumesActionsTest-1891851968-project-member] [instance: 8ef9c2f4-23d0-44eb-9ba9-8c7c3f6b0874] Start building networks asynchronously for instance. {{(pid=74613) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 29 18:14:44 user nova-compute[74613]: DEBUG nova.compute.manager [None req-206e8b21-88a3-488c-8ab4-7d1df0990547 tempest-VolumesActionsTest-1891851968 tempest-VolumesActionsTest-1891851968-project-member] [instance: 8ef9c2f4-23d0-44eb-9ba9-8c7c3f6b0874] Allocating IP information in the background. {{(pid=74613) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 29 18:14:44 user nova-compute[74613]: DEBUG nova.network.neutron [None req-206e8b21-88a3-488c-8ab4-7d1df0990547 tempest-VolumesActionsTest-1891851968 tempest-VolumesActionsTest-1891851968-project-member] [instance: 8ef9c2f4-23d0-44eb-9ba9-8c7c3f6b0874] allocate_for_instance() {{(pid=74613) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 29 18:14:44 user nova-compute[74613]: INFO nova.virt.libvirt.driver [None req-206e8b21-88a3-488c-8ab4-7d1df0990547 tempest-VolumesActionsTest-1891851968 tempest-VolumesActionsTest-1891851968-project-member] [instance: 8ef9c2f4-23d0-44eb-9ba9-8c7c3f6b0874] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 29 18:14:44 user nova-compute[74613]: DEBUG nova.compute.manager [None req-206e8b21-88a3-488c-8ab4-7d1df0990547 tempest-VolumesActionsTest-1891851968 tempest-VolumesActionsTest-1891851968-project-member] [instance: 8ef9c2f4-23d0-44eb-9ba9-8c7c3f6b0874] Start building block device mappings for instance. {{(pid=74613) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 29 18:14:44 user nova-compute[74613]: DEBUG nova.policy [None req-206e8b21-88a3-488c-8ab4-7d1df0990547 tempest-VolumesActionsTest-1891851968 tempest-VolumesActionsTest-1891851968-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'ead62365fd2c4e17a70639f15b9ebf25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b45cf6afa1d8432aa734c6d7ba388d01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74613) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 29 18:14:44 user nova-compute[74613]: DEBUG nova.compute.manager [None req-206e8b21-88a3-488c-8ab4-7d1df0990547 tempest-VolumesActionsTest-1891851968 tempest-VolumesActionsTest-1891851968-project-member] [instance: 8ef9c2f4-23d0-44eb-9ba9-8c7c3f6b0874] Start spawning the instance on the hypervisor. {{(pid=74613) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 29 18:14:44 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-206e8b21-88a3-488c-8ab4-7d1df0990547 tempest-VolumesActionsTest-1891851968 tempest-VolumesActionsTest-1891851968-project-member] [instance: 8ef9c2f4-23d0-44eb-9ba9-8c7c3f6b0874] Creating instance directory {{(pid=74613) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 29 18:14:44 user nova-compute[74613]: INFO nova.virt.libvirt.driver [None req-206e8b21-88a3-488c-8ab4-7d1df0990547 tempest-VolumesActionsTest-1891851968 tempest-VolumesActionsTest-1891851968-project-member] [instance: 8ef9c2f4-23d0-44eb-9ba9-8c7c3f6b0874] Creating image(s)
Nov 29 18:14:44 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-206e8b21-88a3-488c-8ab4-7d1df0990547 tempest-VolumesActionsTest-1891851968 tempest-VolumesActionsTest-1891851968-project-member] Acquiring lock "/opt/stack/data/nova/instances/8ef9c2f4-23d0-44eb-9ba9-8c7c3f6b0874/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 18:14:44 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-206e8b21-88a3-488c-8ab4-7d1df0990547 tempest-VolumesActionsTest-1891851968 tempest-VolumesActionsTest-1891851968-project-member] Lock "/opt/stack/data/nova/instances/8ef9c2f4-23d0-44eb-9ba9-8c7c3f6b0874/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 18:14:44 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-206e8b21-88a3-488c-8ab4-7d1df0990547 tempest-VolumesActionsTest-1891851968 tempest-VolumesActionsTest-1891851968-project-member] Lock "/opt/stack/data/nova/instances/8ef9c2f4-23d0-44eb-9ba9-8c7c3f6b0874/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 18:14:44 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-206e8b21-88a3-488c-8ab4-7d1df0990547 tempest-VolumesActionsTest-1891851968 tempest-VolumesActionsTest-1891851968-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/21faea9e6951f3bdd0153b76ac89fe1a60a34758 --force-share --output=json {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:14:44 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-206e8b21-88a3-488c-8ab4-7d1df0990547 tempest-VolumesActionsTest-1891851968 tempest-VolumesActionsTest-1891851968-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/21faea9e6951f3bdd0153b76ac89fe1a60a34758 --force-share --output=json" returned: 0 in 0.178s {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:14:44 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-206e8b21-88a3-488c-8ab4-7d1df0990547 tempest-VolumesActionsTest-1891851968 tempest-VolumesActionsTest-1891851968-project-member] Acquiring lock "21faea9e6951f3bdd0153b76ac89fe1a60a34758" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 18:14:44 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-206e8b21-88a3-488c-8ab4-7d1df0990547 tempest-VolumesActionsTest-1891851968 tempest-VolumesActionsTest-1891851968-project-member] Lock "21faea9e6951f3bdd0153b76ac89fe1a60a34758" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 18:14:44 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-206e8b21-88a3-488c-8ab4-7d1df0990547 tempest-VolumesActionsTest-1891851968 tempest-VolumesActionsTest-1891851968-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/21faea9e6951f3bdd0153b76ac89fe1a60a34758 --force-share --output=json {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:14:44 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-206e8b21-88a3-488c-8ab4-7d1df0990547 tempest-VolumesActionsTest-1891851968 tempest-VolumesActionsTest-1891851968-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/21faea9e6951f3bdd0153b76ac89fe1a60a34758 --force-share --output=json" returned: 0 in 0.181s {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:14:44 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-206e8b21-88a3-488c-8ab4-7d1df0990547 tempest-VolumesActionsTest-1891851968 tempest-VolumesActionsTest-1891851968-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/21faea9e6951f3bdd0153b76ac89fe1a60a34758,backing_fmt=raw /opt/stack/data/nova/instances/8ef9c2f4-23d0-44eb-9ba9-8c7c3f6b0874/disk 1073741824 {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:14:44 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-206e8b21-88a3-488c-8ab4-7d1df0990547 tempest-VolumesActionsTest-1891851968 tempest-VolumesActionsTest-1891851968-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/21faea9e6951f3bdd0153b76ac89fe1a60a34758,backing_fmt=raw /opt/stack/data/nova/instances/8ef9c2f4-23d0-44eb-9ba9-8c7c3f6b0874/disk 1073741824" returned: 0 in 0.057s {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:14:44 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-206e8b21-88a3-488c-8ab4-7d1df0990547 tempest-VolumesActionsTest-1891851968 tempest-VolumesActionsTest-1891851968-project-member] Lock "21faea9e6951f3bdd0153b76ac89fe1a60a34758" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.247s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 18:14:44 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-206e8b21-88a3-488c-8ab4-7d1df0990547 tempest-VolumesActionsTest-1891851968 tempest-VolumesActionsTest-1891851968-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/21faea9e6951f3bdd0153b76ac89fe1a60a34758 --force-share --output=json {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:14:45 user nova-compute[74613]: DEBUG nova.network.neutron [None req-206e8b21-88a3-488c-8ab4-7d1df0990547 tempest-VolumesActionsTest-1891851968 tempest-VolumesActionsTest-1891851968-project-member] [instance: 8ef9c2f4-23d0-44eb-9ba9-8c7c3f6b0874] Successfully created port: 1bf62fcc-5bb2-4457-880a-4fffbdd56514 {{(pid=74613) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 29 18:14:45 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-206e8b21-88a3-488c-8ab4-7d1df0990547 tempest-VolumesActionsTest-1891851968 tempest-VolumesActionsTest-1891851968-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/21faea9e6951f3bdd0153b76ac89fe1a60a34758 --force-share --output=json" returned: 0 in 0.179s {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:14:45 user nova-compute[74613]: DEBUG nova.virt.disk.api [None req-206e8b21-88a3-488c-8ab4-7d1df0990547 tempest-VolumesActionsTest-1891851968 tempest-VolumesActionsTest-1891851968-project-member] Checking if we can resize image /opt/stack/data/nova/instances/8ef9c2f4-23d0-44eb-9ba9-8c7c3f6b0874/disk. size=1073741824 {{(pid=74613) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 29 18:14:45 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-206e8b21-88a3-488c-8ab4-7d1df0990547 tempest-VolumesActionsTest-1891851968 tempest-VolumesActionsTest-1891851968-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ef9c2f4-23d0-44eb-9ba9-8c7c3f6b0874/disk --force-share --output=json {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:14:45 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-206e8b21-88a3-488c-8ab4-7d1df0990547 tempest-VolumesActionsTest-1891851968 tempest-VolumesActionsTest-1891851968-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ef9c2f4-23d0-44eb-9ba9-8c7c3f6b0874/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:14:45 user nova-compute[74613]: DEBUG nova.virt.disk.api [None req-206e8b21-88a3-488c-8ab4-7d1df0990547 tempest-VolumesActionsTest-1891851968 tempest-VolumesActionsTest-1891851968-project-member] Cannot resize image /opt/stack/data/nova/instances/8ef9c2f4-23d0-44eb-9ba9-8c7c3f6b0874/disk to a smaller size. {{(pid=74613) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 29 18:14:45 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-206e8b21-88a3-488c-8ab4-7d1df0990547 tempest-VolumesActionsTest-1891851968 tempest-VolumesActionsTest-1891851968-project-member] [instance: 8ef9c2f4-23d0-44eb-9ba9-8c7c3f6b0874] Created local disks {{(pid=74613) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 29 18:14:45 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-206e8b21-88a3-488c-8ab4-7d1df0990547 tempest-VolumesActionsTest-1891851968 tempest-VolumesActionsTest-1891851968-project-member] [instance: 8ef9c2f4-23d0-44eb-9ba9-8c7c3f6b0874] Ensure instance console log exists: /opt/stack/data/nova/instances/8ef9c2f4-23d0-44eb-9ba9-8c7c3f6b0874/console.log {{(pid=74613) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 29 18:14:45 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-206e8b21-88a3-488c-8ab4-7d1df0990547 tempest-VolumesActionsTest-1891851968 tempest-VolumesActionsTest-1891851968-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 18:14:45 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-206e8b21-88a3-488c-8ab4-7d1df0990547 tempest-VolumesActionsTest-1891851968 tempest-VolumesActionsTest-1891851968-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 18:14:45 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-206e8b21-88a3-488c-8ab4-7d1df0990547 tempest-VolumesActionsTest-1891851968 tempest-VolumesActionsTest-1891851968-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 18:14:45 user nova-compute[74613]: DEBUG nova.network.neutron [None req-206e8b21-88a3-488c-8ab4-7d1df0990547 tempest-VolumesActionsTest-1891851968 tempest-VolumesActionsTest-1891851968-project-member] [instance: 8ef9c2f4-23d0-44eb-9ba9-8c7c3f6b0874] Successfully updated port: 1bf62fcc-5bb2-4457-880a-4fffbdd56514 {{(pid=74613) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 29 18:14:45 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-206e8b21-88a3-488c-8ab4-7d1df0990547 tempest-VolumesActionsTest-1891851968 tempest-VolumesActionsTest-1891851968-project-member] Acquiring lock "refresh_cache-8ef9c2f4-23d0-44eb-9ba9-8c7c3f6b0874" {{(pid=74613) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 18:14:45 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-206e8b21-88a3-488c-8ab4-7d1df0990547 tempest-VolumesActionsTest-1891851968 tempest-VolumesActionsTest-1891851968-project-member] Acquired lock "refresh_cache-8ef9c2f4-23d0-44eb-9ba9-8c7c3f6b0874" {{(pid=74613) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 18:14:45 user nova-compute[74613]: DEBUG nova.network.neutron [None req-206e8b21-88a3-488c-8ab4-7d1df0990547 tempest-VolumesActionsTest-1891851968 tempest-VolumesActionsTest-1891851968-project-member] [instance: 8ef9c2f4-23d0-44eb-9ba9-8c7c3f6b0874] Building network info cache for instance {{(pid=74613) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 29 18:14:45 user nova-compute[74613]: DEBUG nova.compute.manager [req-a107f93f-ea32-433f-b7cc-8cc16cc32458 req-ae84d0d0-b3c2-4ab5-aecc-dab4179cfb52 service nova] [instance: 8ef9c2f4-23d0-44eb-9ba9-8c7c3f6b0874] Received event network-changed-1bf62fcc-5bb2-4457-880a-4fffbdd56514 {{(pid=74613) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 18:14:45 user nova-compute[74613]: DEBUG nova.compute.manager [req-a107f93f-ea32-433f-b7cc-8cc16cc32458 req-ae84d0d0-b3c2-4ab5-aecc-dab4179cfb52 service nova] [instance: 8ef9c2f4-23d0-44eb-9ba9-8c7c3f6b0874] Refreshing instance network info cache due to event network-changed-1bf62fcc-5bb2-4457-880a-4fffbdd56514. {{(pid=74613) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 18:14:45 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-a107f93f-ea32-433f-b7cc-8cc16cc32458 req-ae84d0d0-b3c2-4ab5-aecc-dab4179cfb52 service nova] Acquiring lock "refresh_cache-8ef9c2f4-23d0-44eb-9ba9-8c7c3f6b0874" {{(pid=74613) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 18:14:45 user nova-compute[74613]: WARNING nova.virt.libvirt.driver [None req-4eecf745-9df5-450e-bcd6-877c71c85f12 tempest-AttachVolumeNegativeTest-483083654 tempest-AttachVolumeNegativeTest-483083654-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance fa144332-bad7-4373-94d9-018f41f50ee4 is timed out.
Nov 29 18:14:45 user nova-compute[74613]: INFO nova.virt.libvirt.driver [None req-4eecf745-9df5-450e-bcd6-877c71c85f12 tempest-AttachVolumeNegativeTest-483083654 tempest-AttachVolumeNegativeTest-483083654-project-member] Successfully detached device vdb from instance fa144332-bad7-4373-94d9-018f41f50ee4 from the live domain config.
Nov 29 18:14:45 user nova-compute[74613]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4eecf745-9df5-450e-bcd6-877c71c85f12 tempest-AttachVolumeNegativeTest-483083654 tempest-AttachVolumeNegativeTest-483083654-project-member] [instance: fa144332-bad7-4373-94d9-018f41f50ee4] calling os-brick to detach iSCSI Volume {{(pid=74613) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 29 18:14:45 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-4eecf745-9df5-450e-bcd6-877c71c85f12 tempest-AttachVolumeNegativeTest-483083654 tempest-AttachVolumeNegativeTest-483083654-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff828156890>, {'target_iqn': 'iqn.2010-10.org.openstack:126f927d-c446-4653-b7c9-b0254f7119bd', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'pSFdyHoU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=74613) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 18:14:45 user nova-compute[74613]: WARNING os_brick.initiator.connectors.base [None req-4eecf745-9df5-450e-bcd6-877c71c85f12 tempest-AttachVolumeNegativeTest-483083654 tempest-AttachVolumeNegativeTest-483083654-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 18:14:45 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.base [None req-4eecf745-9df5-450e-bcd6-877c71c85f12 tempest-AttachVolumeNegativeTest-483083654 tempest-AttachVolumeNegativeTest-483083654-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 18:14:45 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.base [None req-4eecf745-9df5-450e-bcd6-877c71c85f12 tempest-AttachVolumeNegativeTest-483083654 tempest-AttachVolumeNegativeTest-483083654-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 18:14:45 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:14:45 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:14:45 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[a89d033a-81c1-4998-84cc-c6ed79262b65]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:1cd1b4f3-6008-4bef-bb8d-e92e973d5a96\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:126f927d-c446-4653-b7c9-b0254f7119bd\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 18:14:45 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-4eecf745-9df5-450e-bcd6-877c71c85f12 tempest-AttachVolumeNegativeTest-483083654 tempest-AttachVolumeNegativeTest-483083654-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 29 18:14:45 user nova-compute[74613]: No targets found.
Nov 29 18:14:45 user nova-compute[74613]: iSNS:
Nov 29 18:14:45 user nova-compute[74613]: No targets found.
Nov 29 18:14:45 user nova-compute[74613]: STATIC:
Nov 29 18:14:45 user nova-compute[74613]: Target: iqn.2010-10.org.openstack:1cd1b4f3-6008-4bef-bb8d-e92e973d5a96
Nov 29 18:14:45 user nova-compute[74613]:         Portal: 172.16.0.220:3260,-1
Nov 29 18:14:45 user nova-compute[74613]:                 Iface Name: default
Nov 29 18:14:45 user nova-compute[74613]: Target: iqn.2010-10.org.openstack:126f927d-c446-4653-b7c9-b0254f7119bd
Nov 29 18:14:45 user nova-compute[74613]:         Portal: 172.16.0.220:3260,-1
Nov 29 18:14:45 user nova-compute[74613]:                 Iface Name: default
Nov 29 18:14:45 user nova-compute[74613]: FIRMWARE:
Nov 29 18:14:45 user nova-compute[74613]: No targets found.
Nov 29 18:14:45 user nova-compute[74613]:  stderr= {{(pid=74613) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 18:14:45 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-4eecf745-9df5-450e-bcd6-877c71c85f12 tempest-AttachVolumeNegativeTest-483083654 tempest-AttachVolumeNegativeTest-483083654-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 29 18:14:45 user nova-compute[74613]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 29 18:14:45 user nova-compute[74613]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74613) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 29 18:14:45 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-4eecf745-9df5-450e-bcd6-877c71c85f12 tempest-AttachVolumeNegativeTest-483083654 tempest-AttachVolumeNegativeTest-483083654-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:126f927d-c446-4653-b7c9-b0254f7119bd', 0)] {{(pid=74613) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 29 18:14:45 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:14:45 user nova-compute[74613]: DEBUG nova.network.neutron [None req-206e8b21-88a3-488c-8ab4-7d1df0990547 tempest-VolumesActionsTest-1891851968 tempest-VolumesActionsTest-1891851968-project-member] [instance: 8ef9c2f4-23d0-44eb-9ba9-8c7c3f6b0874] Instance cache missing network info. {{(pid=74613) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 29 18:14:45 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:14:45 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[d68156da-8aa9-4053-a549-08909deb28ef]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:126f927d-c446-4653-b7c9-b0254f7119bd\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1cd1b4f3-6008-4bef-bb8d-e92e973d5a96\n', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 18:14:45 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:14:45 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:14:45 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[792c4fc1-6ded-40dc-956f-4722e615c492]: (4, ('tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1cd1b4f3-6008-4bef-bb8d-e92e973d5a96 (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:126f927d-c446-4653-b7c9-b0254f7119bd (non-flash)\n', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 18:14:45 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-4eecf745-9df5-450e-bcd6-877c71c85f12 tempest-AttachVolumeNegativeTest-483083654 tempest-AttachVolumeNegativeTest-483083654-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1cd1b4f3-6008-4bef-bb8d-e92e973d5a96 (non-flash)
Nov 29 18:14:45 user nova-compute[74613]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:126f927d-c446-4653-b7c9-b0254f7119bd (non-flash)
Nov 29 18:14:45 user nova-compute[74613]:  stderr= {{(pid=74613) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 18:14:45 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-4eecf745-9df5-450e-bcd6-877c71c85f12 tempest-AttachVolumeNegativeTest-483083654 tempest-AttachVolumeNegativeTest-483083654-project-member] iscsi session list stdout=tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1cd1b4f3-6008-4bef-bb8d-e92e973d5a96 (non-flash)
Nov 29 18:14:45 user nova-compute[74613]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:126f927d-c446-4653-b7c9-b0254f7119bd (non-flash)
Nov 29 18:14:45 user nova-compute[74613]:  stderr= {{(pid=74613) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 18:14:45 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-4eecf745-9df5-450e-bcd6-877c71c85f12 tempest-AttachVolumeNegativeTest-483083654 tempest-AttachVolumeNegativeTest-483083654-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7ff8182e08b0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:126f927d-c446-4653-b7c9-b0254f7119bd'): ({'sdc'}, set())}) {{(pid=74613) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 29 18:14:45 user nova-compute[74613]: DEBUG os_brick.initiator.linuxscsi [None req-4eecf745-9df5-450e-bcd6-877c71c85f12 tempest-AttachVolumeNegativeTest-483083654 tempest-AttachVolumeNegativeTest-483083654-project-member] Removing single pathed devices sdc {{(pid=74613) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 29 18:14:45 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:14:45 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:14:45 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[7bd1b174-5938-470e-93ca-5878ca310e34]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 18:14:45 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:14:45 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.017s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:14:45 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[33765f8b-919e-48f2-b1ee-3b673f4db975]: (4, ('ok\n', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 18:14:45 user nova-compute[74613]: DEBUG os_brick.initiator.linuxscsi [None req-4eecf745-9df5-450e-bcd6-877c71c85f12 tempest-AttachVolumeNegativeTest-483083654 tempest-AttachVolumeNegativeTest-483083654-project-member] Flushing IO for device /dev/sdc {{(pid=74613) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 29 18:14:45 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:14:45 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.012s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:14:45 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[d514365b-3fea-4404-8491-977fd1fd0535]: (4, ('', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 18:14:45 user nova-compute[74613]: DEBUG os_brick.initiator.linuxscsi [None req-4eecf745-9df5-450e-bcd6-877c71c85f12 tempest-AttachVolumeNegativeTest-483083654 tempest-AttachVolumeNegativeTest-483083654-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=74613) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 29 18:14:45 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:14:45 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.036s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:14:45 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad1f4565-5270-46a5-89ba-f34fafeac1f9]: (4, ('1', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 18:14:45 user nova-compute[74613]: DEBUG os_brick.initiator.linuxscsi [None req-4eecf745-9df5-450e-bcd6-877c71c85f12 tempest-AttachVolumeNegativeTest-483083654 tempest-AttachVolumeNegativeTest-483083654-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=74613) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 29 18:14:45 user nova-compute[74613]: DEBUG os_brick.initiator.linuxscsi [None req-4eecf745-9df5-450e-bcd6-877c71c85f12 tempest-AttachVolumeNegativeTest-483083654 tempest-AttachVolumeNegativeTest-483083654-project-member] SCSI volumes sdc have been removed. {{(pid=74613) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 29 18:14:45 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-4eecf745-9df5-450e-bcd6-877c71c85f12 tempest-AttachVolumeNegativeTest-483083654 tempest-AttachVolumeNegativeTest-483083654-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:126f927d-c446-4653-b7c9-b0254f7119bd')] {{(pid=74613) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 29 18:14:45 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:126f927d-c446-4653-b7c9-b0254f7119bd -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:14:46 user nova-compute[74613]: DEBUG nova.network.neutron [None req-206e8b21-88a3-488c-8ab4-7d1df0990547 tempest-VolumesActionsTest-1891851968 tempest-VolumesActionsTest-1891851968-project-member] [instance: 8ef9c2f4-23d0-44eb-9ba9-8c7c3f6b0874] Updating instance_info_cache with network_info: [{"id": "1bf62fcc-5bb2-4457-880a-4fffbdd56514", "address": "fa:16:3e:00:cd:c7", "network": {"id": "da3e9619-3fb3-4a93-b70a-02ab4c0a47e6", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1370048768-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b45cf6afa1d8432aa734c6d7ba388d01", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1bf62fcc-5b", "ovs_interfaceid": "1bf62fcc-5bb2-4457-880a-4fffbdd56514", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74613) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 18:14:46 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:14:46 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:126f927d-c446-4653-b7c9-b0254f7119bd -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.146s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:14:46 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[d51af6e1-c638-4e8d-a075-0444b2421e18]: (4, ('', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 18:14:46 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-4eecf745-9df5-450e-bcd6-877c71c85f12 tempest-AttachVolumeNegativeTest-483083654 tempest-AttachVolumeNegativeTest-483083654-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74613) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 18:14:46 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:126f927d-c446-4653-b7c9-b0254f7119bd -p 172.16.0.220:3260 --logout {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:14:46 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-206e8b21-88a3-488c-8ab4-7d1df0990547 tempest-VolumesActionsTest-1891851968 tempest-VolumesActionsTest-1891851968-project-member] Releasing lock "refresh_cache-8ef9c2f4-23d0-44eb-9ba9-8c7c3f6b0874" {{(pid=74613) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 18:14:46 user nova-compute[74613]: DEBUG nova.compute.manager [None req-206e8b21-88a3-488c-8ab4-7d1df0990547 tempest-VolumesActionsTest-1891851968 tempest-VolumesActionsTest-1891851968-project-member] [instance: 8ef9c2f4-23d0-44eb-9ba9-8c7c3f6b0874] Instance network_info: |[{"id": "1bf62fcc-5bb2-4457-880a-4fffbdd56514", "address": "fa:16:3e:00:cd:c7", "network": {"id": "da3e9619-3fb3-4a93-b70a-02ab4c0a47e6", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1370048768-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b45cf6afa1d8432aa734c6d7ba388d01", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1bf62fcc-5b", "ovs_interfaceid": "1bf62fcc-5bb2-4457-880a-4fffbdd56514", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74613) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 29 18:14:46 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-a107f93f-ea32-433f-b7cc-8cc16cc32458 req-ae84d0d0-b3c2-4ab5-aecc-dab4179cfb52 service nova] Acquired lock "refresh_cache-8ef9c2f4-23d0-44eb-9ba9-8c7c3f6b0874" {{(pid=74613) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 18:14:46 user nova-compute[74613]: DEBUG nova.network.neutron [req-a107f93f-ea32-433f-b7cc-8cc16cc32458 req-ae84d0d0-b3c2-4ab5-aecc-dab4179cfb52 service nova] [instance: 8ef9c2f4-23d0-44eb-9ba9-8c7c3f6b0874] Refreshing network info cache for port 1bf62fcc-5bb2-4457-880a-4fffbdd56514 {{(pid=74613) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 18:14:46 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-206e8b21-88a3-488c-8ab4-7d1df0990547 tempest-VolumesActionsTest-1891851968 tempest-VolumesActionsTest-1891851968-project-member] [instance: 8ef9c2f4-23d0-44eb-9ba9-8c7c3f6b0874] Start _get_guest_xml network_info=[{"id": "1bf62fcc-5bb2-4457-880a-4fffbdd56514", "address": "fa:16:3e:00:cd:c7", "network": {"id": "da3e9619-3fb3-4a93-b70a-02ab4c0a47e6", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1370048768-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b45cf6afa1d8432aa734c6d7ba388d01", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1bf62fcc-5b", "ovs_interfaceid": "1bf62fcc-5bb2-4457-880a-4fffbdd56514", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-29T17:47:38Z,direct_url=<?>,disk_format='qcow2',id=4217f428-8d9d-4ee1-9614-642d26d90c46,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='794b07cbd46a44b5865cfda741036bae',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-29T17:47:40Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'size': 0, 'device_type': 'disk', 'boot_index': 0, 'guest_format': None, 'encrypted': False, 'encryption_format': None, 'disk_bus': 'virtio', 'image_id': '4217f428-8d9d-4ee1-9614-642d26d90c46'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74613) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 29 18:14:46 user nova-compute[74613]: WARNING nova.virt.libvirt.driver [None req-206e8b21-88a3-488c-8ab4-7d1df0990547 tempest-VolumesActionsTest-1891851968 tempest-VolumesActionsTest-1891851968-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 18:14:46 user nova-compute[74613]: WARNING nova.virt.libvirt.driver [None req-206e8b21-88a3-488c-8ab4-7d1df0990547 tempest-VolumesActionsTest-1891851968 tempest-VolumesActionsTest-1891851968-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 18:14:46 user nova-compute[74613]: DEBUG nova.virt.libvirt.host [None req-206e8b21-88a3-488c-8ab4-7d1df0990547 tempest-VolumesActionsTest-1891851968 tempest-VolumesActionsTest-1891851968-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74613) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 29 18:14:46 user nova-compute[74613]: DEBUG nova.virt.libvirt.host [None req-206e8b21-88a3-488c-8ab4-7d1df0990547 tempest-VolumesActionsTest-1891851968 tempest-VolumesActionsTest-1891851968-project-member] CPU controller missing on host. {{(pid=74613) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 29 18:14:46 user nova-compute[74613]: DEBUG nova.virt.libvirt.host [None req-206e8b21-88a3-488c-8ab4-7d1df0990547 tempest-VolumesActionsTest-1891851968 tempest-VolumesActionsTest-1891851968-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74613) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 29 18:14:46 user nova-compute[74613]: DEBUG nova.virt.libvirt.host [None req-206e8b21-88a3-488c-8ab4-7d1df0990547 tempest-VolumesActionsTest-1891851968 tempest-VolumesActionsTest-1891851968-project-member] CPU controller found on host. {{(pid=74613) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 29 18:14:46 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-206e8b21-88a3-488c-8ab4-7d1df0990547 tempest-VolumesActionsTest-1891851968 tempest-VolumesActionsTest-1891851968-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74613) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 29 18:14:46 user nova-compute[74613]: DEBUG nova.virt.hardware [None req-206e8b21-88a3-488c-8ab4-7d1df0990547 tempest-VolumesActionsTest-1891851968 tempest-VolumesActionsTest-1891851968-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-29T17:47:27Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-29T17:47:38Z,direct_url=<?>,disk_format='qcow2',id=4217f428-8d9d-4ee1-9614-642d26d90c46,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='794b07cbd46a44b5865cfda741036bae',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-29T17:47:40Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74613) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 29 18:14:46 user nova-compute[74613]: DEBUG nova.virt.hardware [None req-206e8b21-88a3-488c-8ab4-7d1df0990547 tempest-VolumesActionsTest-1891851968 tempest-VolumesActionsTest-1891851968-project-member] Flavor limits 0:0:0 {{(pid=74613) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 29 18:14:46 user nova-compute[74613]: DEBUG nova.virt.hardware [None req-206e8b21-88a3-488c-8ab4-7d1df0990547 tempest-VolumesActionsTest-1891851968 tempest-VolumesActionsTest-1891851968-project-member] Image limits 0:0:0 {{(pid=74613) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 29 18:14:46 user nova-compute[74613]: DEBUG nova.virt.hardware [None req-206e8b21-88a3-488c-8ab4-7d1df0990547 tempest-VolumesActionsTest-1891851968 tempest-VolumesActionsTest-1891851968-project-member] Flavor pref 0:0:0 {{(pid=74613) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 29 18:14:46 user nova-compute[74613]: DEBUG nova.virt.hardware [None req-206e8b21-88a3-488c-8ab4-7d1df0990547 tempest-VolumesActionsTest-1891851968 tempest-VolumesActionsTest-1891851968-project-member] Image pref 0:0:0 {{(pid=74613) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 29 18:14:46 user nova-compute[74613]: DEBUG nova.virt.hardware [None req-206e8b21-88a3-488c-8ab4-7d1df0990547 tempest-VolumesActionsTest-1891851968 tempest-VolumesActionsTest-1891851968-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74613) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 29 18:14:46 user nova-compute[74613]: DEBUG nova.virt.hardware [None req-206e8b21-88a3-488c-8ab4-7d1df0990547 tempest-VolumesActionsTest-1891851968 tempest-VolumesActionsTest-1891851968-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74613) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 29 18:14:46 user nova-compute[74613]: DEBUG nova.virt.hardware [None req-206e8b21-88a3-488c-8ab4-7d1df0990547 tempest-VolumesActionsTest-1891851968 tempest-VolumesActionsTest-1891851968-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74613) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 29 18:14:46 user nova-compute[74613]: DEBUG nova.virt.hardware [None req-206e8b21-88a3-488c-8ab4-7d1df0990547 tempest-VolumesActionsTest-1891851968 tempest-VolumesActionsTest-1891851968-project-member] Got 1 possible topologies {{(pid=74613) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 29 18:14:46 user nova-compute[74613]: DEBUG nova.virt.hardware [None req-206e8b21-88a3-488c-8ab4-7d1df0990547 tempest-VolumesActionsTest-1891851968 tempest-VolumesActionsTest-1891851968-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74613) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 29 18:14:46 user nova-compute[74613]: DEBUG nova.virt.hardware [None req-206e8b21-88a3-488c-8ab4-7d1df0990547 tempest-VolumesActionsTest-1891851968 tempest-VolumesActionsTest-1891851968-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74613) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 29 18:14:46 user nova-compute[74613]: DEBUG nova.virt.libvirt.vif [None req-206e8b21-88a3-488c-8ab4-7d1df0990547 tempest-VolumesActionsTest-1891851968 tempest-VolumesActionsTest-1891851968-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T18:14:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1151516964',display_name='tempest-VolumesActionsTest-instance-1151516964',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1151516964',id=39,image_ref='4217f428-8d9d-4ee1-9614-642d26d90c46',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b45cf6afa1d8432aa734c6d7ba388d01',ramdisk_id='',reservation_id='r-edglceyz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='4217f428-8d9d-4ee1-9614-642d26d90c46',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-1891851968',owner_user_name='tempest-VolumesActionsTest-1891851968-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T18:14:44Z,user_data=None,user_id='ead62365fd2c4e17a70639f15b9ebf25',uuid=8ef9c2f4-23d0-44eb-9ba9-8c7c3f6b0874,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1bf62fcc-5bb2-4457-880a-4fffbdd56514", "address": "fa:16:3e:00:cd:c7", "network": {"id": "da3e9619-3fb3-4a93-b70a-02ab4c0a47e6", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1370048768-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b45cf6afa1d8432aa734c6d7ba388d01", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1bf62fcc-5b", "ovs_interfaceid": "1bf62fcc-5bb2-4457-880a-4fffbdd56514", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74613) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 29 18:14:46 user nova-compute[74613]: DEBUG nova.network.os_vif_util [None req-206e8b21-88a3-488c-8ab4-7d1df0990547 tempest-VolumesActionsTest-1891851968 tempest-VolumesActionsTest-1891851968-project-member] Converting VIF {"id": "1bf62fcc-5bb2-4457-880a-4fffbdd56514", "address": "fa:16:3e:00:cd:c7", "network": {"id": "da3e9619-3fb3-4a93-b70a-02ab4c0a47e6", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1370048768-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b45cf6afa1d8432aa734c6d7ba388d01", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1bf62fcc-5b", "ovs_interfaceid": "1bf62fcc-5bb2-4457-880a-4fffbdd56514", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74613) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 18:14:46 user nova-compute[74613]: DEBUG nova.network.os_vif_util [None req-206e8b21-88a3-488c-8ab4-7d1df0990547 tempest-VolumesActionsTest-1891851968 tempest-VolumesActionsTest-1891851968-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:00:cd:c7,bridge_name='br-int',has_traffic_filtering=True,id=1bf62fcc-5bb2-4457-880a-4fffbdd56514,network=Network(da3e9619-3fb3-4a93-b70a-02ab4c0a47e6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1bf62fcc-5b') {{(pid=74613) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 18:14:46 user nova-compute[74613]: DEBUG nova.objects.instance [None req-206e8b21-88a3-488c-8ab4-7d1df0990547 tempest-VolumesActionsTest-1891851968 tempest-VolumesActionsTest-1891851968-project-member] Lazy-loading 'pci_devices' on Instance uuid 8ef9c2f4-23d0-44eb-9ba9-8c7c3f6b0874 {{(pid=74613) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 18:14:46 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:126f927d-c446-4653-b7c9-b0254f7119bd -p 172.16.0.220:3260 --logout" returned: 0 in 0.049s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:14:46 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[d42cf190-a09a-40ac-911f-73e20f17c332]: (4, ('Logging out of session [sid: 43, target: iqn.2010-10.org.openstack:126f927d-c446-4653-b7c9-b0254f7119bd, portal: 172.16.0.220,3260]\nLogout of [sid: 43, target: iqn.2010-10.org.openstack:126f927d-c446-4653-b7c9-b0254f7119bd, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 18:14:46 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-4eecf745-9df5-450e-bcd6-877c71c85f12 tempest-AttachVolumeNegativeTest-483083654 tempest-AttachVolumeNegativeTest-483083654-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 43, target: iqn.2010-10.org.openstack:126f927d-c446-4653-b7c9-b0254f7119bd, portal: 172.16.0.220,3260]
Nov 29 18:14:46 user nova-compute[74613]: Logout of [sid: 43, target: iqn.2010-10.org.openstack:126f927d-c446-4653-b7c9-b0254f7119bd, portal: 172.16.0.220,3260] successful.
Nov 29 18:14:46 user nova-compute[74613]:  stderr= {{(pid=74613) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 18:14:46 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:126f927d-c446-4653-b7c9-b0254f7119bd -p 172.16.0.220:3260 --op delete {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:14:46 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-206e8b21-88a3-488c-8ab4-7d1df0990547 tempest-VolumesActionsTest-1891851968 tempest-VolumesActionsTest-1891851968-project-member] [instance: 8ef9c2f4-23d0-44eb-9ba9-8c7c3f6b0874] End _get_guest_xml xml=<domain type="kvm">
Nov 29 18:14:46 user nova-compute[74613]:   <uuid>8ef9c2f4-23d0-44eb-9ba9-8c7c3f6b0874</uuid>
Nov 29 18:14:46 user nova-compute[74613]:   <name>instance-00000027</name>
Nov 29 18:14:46 user nova-compute[74613]:   <memory>524288</memory>
Nov 29 18:14:46 user nova-compute[74613]:   <vcpu>1</vcpu>
Nov 29 18:14:46 user nova-compute[74613]:   <metadata>
Nov 29 18:14:46 user nova-compute[74613]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 29 18:14:46 user nova-compute[74613]:       <nova:package version="0.0.0"/>
Nov 29 18:14:46 user nova-compute[74613]:       <nova:name>tempest-VolumesActionsTest-instance-1151516964</nova:name>
Nov 29 18:14:46 user nova-compute[74613]:       <nova:creationTime>2023-11-29 18:14:46</nova:creationTime>
Nov 29 18:14:46 user nova-compute[74613]:       <nova:flavor name="m1.tiny">
Nov 29 18:14:46 user nova-compute[74613]:         <nova:memory>512</nova:memory>
Nov 29 18:14:46 user nova-compute[74613]:         <nova:disk>1</nova:disk>
Nov 29 18:14:46 user nova-compute[74613]:         <nova:swap>0</nova:swap>
Nov 29 18:14:46 user nova-compute[74613]:         <nova:ephemeral>0</nova:ephemeral>
Nov 29 18:14:46 user nova-compute[74613]:         <nova:vcpus>1</nova:vcpus>
Nov 29 18:14:46 user nova-compute[74613]:       </nova:flavor>
Nov 29 18:14:46 user nova-compute[74613]:       <nova:owner>
Nov 29 18:14:46 user nova-compute[74613]:         <nova:user uuid="ead62365fd2c4e17a70639f15b9ebf25">tempest-VolumesActionsTest-1891851968-project-member</nova:user>
Nov 29 18:14:46 user nova-compute[74613]:         <nova:project uuid="b45cf6afa1d8432aa734c6d7ba388d01">tempest-VolumesActionsTest-1891851968</nova:project>
Nov 29 18:14:46 user nova-compute[74613]:       </nova:owner>
Nov 29 18:14:46 user nova-compute[74613]:       <nova:root type="image" uuid="4217f428-8d9d-4ee1-9614-642d26d90c46"/>
Nov 29 18:14:46 user nova-compute[74613]:       <nova:ports>
Nov 29 18:14:46 user nova-compute[74613]:         <nova:port uuid="1bf62fcc-5bb2-4457-880a-4fffbdd56514">
Nov 29 18:14:46 user nova-compute[74613]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Nov 29 18:14:46 user nova-compute[74613]:         </nova:port>
Nov 29 18:14:46 user nova-compute[74613]:       </nova:ports>
Nov 29 18:14:46 user nova-compute[74613]:     </nova:instance>
Nov 29 18:14:46 user nova-compute[74613]:   </metadata>
Nov 29 18:14:46 user nova-compute[74613]:   <sysinfo type="smbios">
Nov 29 18:14:46 user nova-compute[74613]:     <system>
Nov 29 18:14:46 user nova-compute[74613]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 29 18:14:46 user nova-compute[74613]:       <entry name="product">OpenStack Nova</entry>
Nov 29 18:14:46 user nova-compute[74613]:       <entry name="version">0.0.0</entry>
Nov 29 18:14:46 user nova-compute[74613]:       <entry name="serial">8ef9c2f4-23d0-44eb-9ba9-8c7c3f6b0874</entry>
Nov 29 18:14:46 user nova-compute[74613]:       <entry name="uuid">8ef9c2f4-23d0-44eb-9ba9-8c7c3f6b0874</entry>
Nov 29 18:14:46 user nova-compute[74613]:       <entry name="family">Virtual Machine</entry>
Nov 29 18:14:46 user nova-compute[74613]:     </system>
Nov 29 18:14:46 user nova-compute[74613]:   </sysinfo>
Nov 29 18:14:46 user nova-compute[74613]:   <os>
Nov 29 18:14:46 user nova-compute[74613]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 29 18:14:46 user nova-compute[74613]:     <boot dev="hd"/>
Nov 29 18:14:46 user nova-compute[74613]:     <smbios mode="sysinfo"/>
Nov 29 18:14:46 user nova-compute[74613]:   </os>
Nov 29 18:14:46 user nova-compute[74613]:   <features>
Nov 29 18:14:46 user nova-compute[74613]:     <acpi/>
Nov 29 18:14:46 user nova-compute[74613]:     <apic/>
Nov 29 18:14:46 user nova-compute[74613]:     <vmcoreinfo/>
Nov 29 18:14:46 user nova-compute[74613]:   </features>
Nov 29 18:14:46 user nova-compute[74613]:   <clock offset="utc">
Nov 29 18:14:46 user nova-compute[74613]:     <timer name="pit" tickpolicy="delay"/>
Nov 29 18:14:46 user nova-compute[74613]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 29 18:14:46 user nova-compute[74613]:     <timer name="hpet" present="no"/>
Nov 29 18:14:46 user nova-compute[74613]:   </clock>
Nov 29 18:14:46 user nova-compute[74613]:   <cpu mode="custom" match="exact">
Nov 29 18:14:46 user nova-compute[74613]:     <model>Nehalem</model>
Nov 29 18:14:46 user nova-compute[74613]:     <topology sockets="1" cores="1" threads="1"/>
Nov 29 18:14:46 user nova-compute[74613]:   </cpu>
Nov 29 18:14:46 user nova-compute[74613]:   <devices>
Nov 29 18:14:46 user nova-compute[74613]:     <disk type="file" device="disk">
Nov 29 18:14:46 user nova-compute[74613]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 29 18:14:46 user nova-compute[74613]:       <source file="/opt/stack/data/nova/instances/8ef9c2f4-23d0-44eb-9ba9-8c7c3f6b0874/disk"/>
Nov 29 18:14:46 user nova-compute[74613]:       <target dev="vda" bus="virtio"/>
Nov 29 18:14:46 user nova-compute[74613]:     </disk>
Nov 29 18:14:46 user nova-compute[74613]:     <interface type="ethernet">
Nov 29 18:14:46 user nova-compute[74613]:       <mac address="fa:16:3e:00:cd:c7"/>
Nov 29 18:14:46 user nova-compute[74613]:       <model type="virtio"/>
Nov 29 18:14:46 user nova-compute[74613]:       <mtu size="1442"/>
Nov 29 18:14:46 user nova-compute[74613]:       <target dev="tap1bf62fcc-5b"/>
Nov 29 18:14:46 user nova-compute[74613]:     </interface>
Nov 29 18:14:46 user nova-compute[74613]:     <serial type="pty">
Nov 29 18:14:46 user nova-compute[74613]:       <log file="/opt/stack/data/nova/instances/8ef9c2f4-23d0-44eb-9ba9-8c7c3f6b0874/console.log" append="off"/>
Nov 29 18:14:46 user nova-compute[74613]:     </serial>
Nov 29 18:14:46 user nova-compute[74613]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 29 18:14:46 user nova-compute[74613]:     <video>
Nov 29 18:14:46 user nova-compute[74613]:       <model type="virtio"/>
Nov 29 18:14:46 user nova-compute[74613]:     </video>
Nov 29 18:14:46 user nova-compute[74613]:     <rng model="virtio">
Nov 29 18:14:46 user nova-compute[74613]:       <backend model="random">/dev/urandom</backend>
Nov 29 18:14:46 user nova-compute[74613]:     </rng>
Nov 29 18:14:46 user nova-compute[74613]:     <controller type="usb" index="0" model="none"/>
Nov 29 18:14:46 user nova-compute[74613]:     <memballoon model="virtio">
Nov 29 18:14:46 user nova-compute[74613]:       <stats period="10"/>
Nov 29 18:14:46 user nova-compute[74613]:     </memballoon>
Nov 29 18:14:46 user nova-compute[74613]:   </devices>
Nov 29 18:14:46 user nova-compute[74613]: </domain>
Nov 29 18:14:46 user nova-compute[74613]:  {{(pid=74613) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 29 18:14:46 user nova-compute[74613]: DEBUG nova.virt.libvirt.vif [None req-206e8b21-88a3-488c-8ab4-7d1df0990547 tempest-VolumesActionsTest-1891851968 tempest-VolumesActionsTest-1891851968-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T18:14:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1151516964',display_name='tempest-VolumesActionsTest-instance-1151516964',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1151516964',id=39,image_ref='4217f428-8d9d-4ee1-9614-642d26d90c46',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b45cf6afa1d8432aa734c6d7ba388d01',ramdisk_id='',reservation_id='r-edglceyz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='4217f428-8d9d-4ee1-9614-642d26d90c46',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-1891851968',owner_user_name='tempest-VolumesActionsTest-1891851968-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T18:14:44Z,user_data=None,user_id='ead62365fd2c4e17a70639f15b9ebf25',uuid=8ef9c2f4-23d0-44eb-9ba9-8c7c3f6b0874,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1bf62fcc-5bb2-4457-880a-4fffbdd56514", "address": "fa:16:3e:00:cd:c7", "network": {"id": "da3e9619-3fb3-4a93-b70a-02ab4c0a47e6", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1370048768-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b45cf6afa1d8432aa734c6d7ba388d01", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1bf62fcc-5b", "ovs_interfaceid": "1bf62fcc-5bb2-4457-880a-4fffbdd56514", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74613) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 29 18:14:46 user nova-compute[74613]: DEBUG nova.network.os_vif_util [None req-206e8b21-88a3-488c-8ab4-7d1df0990547 tempest-VolumesActionsTest-1891851968 tempest-VolumesActionsTest-1891851968-project-member] Converting VIF {"id": "1bf62fcc-5bb2-4457-880a-4fffbdd56514", "address": "fa:16:3e:00:cd:c7", "network": {"id": "da3e9619-3fb3-4a93-b70a-02ab4c0a47e6", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1370048768-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b45cf6afa1d8432aa734c6d7ba388d01", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1bf62fcc-5b", "ovs_interfaceid": "1bf62fcc-5bb2-4457-880a-4fffbdd56514", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74613) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 18:14:46 user nova-compute[74613]: DEBUG nova.network.os_vif_util [None req-206e8b21-88a3-488c-8ab4-7d1df0990547 tempest-VolumesActionsTest-1891851968 tempest-VolumesActionsTest-1891851968-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:00:cd:c7,bridge_name='br-int',has_traffic_filtering=True,id=1bf62fcc-5bb2-4457-880a-4fffbdd56514,network=Network(da3e9619-3fb3-4a93-b70a-02ab4c0a47e6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1bf62fcc-5b') {{(pid=74613) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 18:14:46 user nova-compute[74613]: DEBUG os_vif [None req-206e8b21-88a3-488c-8ab4-7d1df0990547 tempest-VolumesActionsTest-1891851968 tempest-VolumesActionsTest-1891851968-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:00:cd:c7,bridge_name='br-int',has_traffic_filtering=True,id=1bf62fcc-5bb2-4457-880a-4fffbdd56514,network=Network(da3e9619-3fb3-4a93-b70a-02ab4c0a47e6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1bf62fcc-5b') {{(pid=74613) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 29 18:14:46 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:14:46 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74613) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 18:14:46 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74613) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 29 18:14:46 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:14:46 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '58b2c561-e04f-5f6f-b850-3bc3760eafbd', '_type': 'linux-noop'}}, row=False) {{(pid=74613) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 18:14:46 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:14:46 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:14:46 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:14:46 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap1bf62fcc-5b, may_exist=True, interface_attrs={}) {{(pid=74613) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 18:14:46 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap1bf62fcc-5b, col_values=(('qos', UUID('9427f92d-f72c-4dbf-824c-cdf9efc95fa4')),), if_exists=True) {{(pid=74613) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 18:14:46 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap1bf62fcc-5b, col_values=(('external_ids', {'iface-id': '1bf62fcc-5bb2-4457-880a-4fffbdd56514', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:00:cd:c7', 'vm-uuid': '8ef9c2f4-23d0-44eb-9ba9-8c7c3f6b0874'}),), if_exists=True) {{(pid=74613) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 18:14:46 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:126f927d-c446-4653-b7c9-b0254f7119bd -p 172.16.0.220:3260 --op delete" returned: 0 in 0.023s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:14:46 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2c84fa0-b56f-48c3-bf7f-4b6ce339a01a]: (4, ('', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 18:14:46 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-4eecf745-9df5-450e-bcd6-877c71c85f12 tempest-AttachVolumeNegativeTest-483083654 tempest-AttachVolumeNegativeTest-483083654-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74613) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 18:14:46 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.base [None req-4eecf745-9df5-450e-bcd6-877c71c85f12 tempest-AttachVolumeNegativeTest-483083654 tempest-AttachVolumeNegativeTest-483083654-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.450s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 18:14:46 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-4eecf745-9df5-450e-bcd6-877c71c85f12 tempest-AttachVolumeNegativeTest-483083654 tempest-AttachVolumeNegativeTest-483083654-project-member] <== disconnect_volume: return (451ms) None {{(pid=74613) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 18:14:46 user nova-compute[74613]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4eecf745-9df5-450e-bcd6-877c71c85f12 tempest-AttachVolumeNegativeTest-483083654 tempest-AttachVolumeNegativeTest-483083654-project-member] [instance: fa144332-bad7-4373-94d9-018f41f50ee4] Disconnected iSCSI Volume {{(pid=74613) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 29 18:14:46 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:14:46 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 18:14:46 user nova-compute[74613]: INFO os_vif [None req-206e8b21-88a3-488c-8ab4-7d1df0990547 tempest-VolumesActionsTest-1891851968 tempest-VolumesActionsTest-1891851968-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:00:cd:c7,bridge_name='br-int',has_traffic_filtering=True,id=1bf62fcc-5bb2-4457-880a-4fffbdd56514,network=Network(da3e9619-3fb3-4a93-b70a-02ab4c0a47e6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1bf62fcc-5b')
Nov 29 18:14:46 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-206e8b21-88a3-488c-8ab4-7d1df0990547 tempest-VolumesActionsTest-1891851968 tempest-VolumesActionsTest-1891851968-project-member] No BDM found with device name vda, not building metadata. {{(pid=74613) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 18:14:46 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-206e8b21-88a3-488c-8ab4-7d1df0990547 tempest-VolumesActionsTest-1891851968 tempest-VolumesActionsTest-1891851968-project-member] No VIF found with MAC fa:16:3e:00:cd:c7, not building metadata {{(pid=74613) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 29 18:14:46 user nova-compute[74613]: DEBUG nova.network.neutron [req-a107f93f-ea32-433f-b7cc-8cc16cc32458 req-ae84d0d0-b3c2-4ab5-aecc-dab4179cfb52 service nova] [instance: 8ef9c2f4-23d0-44eb-9ba9-8c7c3f6b0874] Updated VIF entry in instance network info cache for port 1bf62fcc-5bb2-4457-880a-4fffbdd56514. {{(pid=74613) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 18:14:46 user nova-compute[74613]: DEBUG nova.network.neutron [req-a107f93f-ea32-433f-b7cc-8cc16cc32458 req-ae84d0d0-b3c2-4ab5-aecc-dab4179cfb52 service nova] [instance: 8ef9c2f4-23d0-44eb-9ba9-8c7c3f6b0874] Updating instance_info_cache with network_info: [{"id": "1bf62fcc-5bb2-4457-880a-4fffbdd56514", "address": "fa:16:3e:00:cd:c7", "network": {"id": "da3e9619-3fb3-4a93-b70a-02ab4c0a47e6", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1370048768-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b45cf6afa1d8432aa734c6d7ba388d01", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1bf62fcc-5b", "ovs_interfaceid": "1bf62fcc-5bb2-4457-880a-4fffbdd56514", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74613) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 18:14:46 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-a107f93f-ea32-433f-b7cc-8cc16cc32458 req-ae84d0d0-b3c2-4ab5-aecc-dab4179cfb52 service nova] Releasing lock "refresh_cache-8ef9c2f4-23d0-44eb-9ba9-8c7c3f6b0874" {{(pid=74613) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 18:14:46 user nova-compute[74613]: DEBUG nova.objects.instance [None req-4eecf745-9df5-450e-bcd6-877c71c85f12 tempest-AttachVolumeNegativeTest-483083654 tempest-AttachVolumeNegativeTest-483083654-project-member] Lazy-loading 'flavor' on Instance uuid fa144332-bad7-4373-94d9-018f41f50ee4 {{(pid=74613) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 18:14:46 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-4eecf745-9df5-450e-bcd6-877c71c85f12 tempest-AttachVolumeNegativeTest-483083654 tempest-AttachVolumeNegativeTest-483083654-project-member] Lock "fa144332-bad7-4373-94d9-018f41f50ee4" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.780s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 18:14:47 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:14:47 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:14:47 user nova-compute[74613]: DEBUG nova.compute.manager [req-88909786-0e9d-49d0-a555-ecd5fc8972bc req-1dc49598-33f0-4aaf-9ffd-0648834ee94b service nova] [instance: 8ef9c2f4-23d0-44eb-9ba9-8c7c3f6b0874] Received event network-vif-plugged-1bf62fcc-5bb2-4457-880a-4fffbdd56514 {{(pid=74613) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 18:14:47 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-88909786-0e9d-49d0-a555-ecd5fc8972bc req-1dc49598-33f0-4aaf-9ffd-0648834ee94b service nova] Acquiring lock "8ef9c2f4-23d0-44eb-9ba9-8c7c3f6b0874-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 18:14:47 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-88909786-0e9d-49d0-a555-ecd5fc8972bc req-1dc49598-33f0-4aaf-9ffd-0648834ee94b service nova] Lock "8ef9c2f4-23d0-44eb-9ba9-8c7c3f6b0874-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 18:14:47 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-88909786-0e9d-49d0-a555-ecd5fc8972bc req-1dc49598-33f0-4aaf-9ffd-0648834ee94b service nova] Lock "8ef9c2f4-23d0-44eb-9ba9-8c7c3f6b0874-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 18:14:47 user nova-compute[74613]: DEBUG nova.compute.manager [req-88909786-0e9d-49d0-a555-ecd5fc8972bc req-1dc49598-33f0-4aaf-9ffd-0648834ee94b service nova] [instance: 8ef9c2f4-23d0-44eb-9ba9-8c7c3f6b0874] No waiting events found dispatching network-vif-plugged-1bf62fcc-5bb2-4457-880a-4fffbdd56514 {{(pid=74613) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 18:14:47 user nova-compute[74613]: WARNING nova.compute.manager [req-88909786-0e9d-49d0-a555-ecd5fc8972bc req-1dc49598-33f0-4aaf-9ffd-0648834ee94b service nova] [instance: 8ef9c2f4-23d0-44eb-9ba9-8c7c3f6b0874] Received unexpected event network-vif-plugged-1bf62fcc-5bb2-4457-880a-4fffbdd56514 for instance with vm_state building and task_state spawning.
Nov 29 18:14:48 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:14:48 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:14:48 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:14:48 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-89e76344-7832-4808-8711-6fe5d5e2b363 tempest-ServerRescueNegativeTestJSON-1891426908 tempest-ServerRescueNegativeTestJSON-1891426908-project-member] Acquiring lock "1f2b4426-815f-4ef4-b98e-e5124fec93b7" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 18:14:48 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-89e76344-7832-4808-8711-6fe5d5e2b363 tempest-ServerRescueNegativeTestJSON-1891426908 tempest-ServerRescueNegativeTestJSON-1891426908-project-member] Lock "1f2b4426-815f-4ef4-b98e-e5124fec93b7" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 18:14:48 user nova-compute[74613]: DEBUG nova.objects.instance [None req-89e76344-7832-4808-8711-6fe5d5e2b363 tempest-ServerRescueNegativeTestJSON-1891426908 tempest-ServerRescueNegativeTestJSON-1891426908-project-member] Lazy-loading 'flavor' on Instance uuid 1f2b4426-815f-4ef4-b98e-e5124fec93b7 {{(pid=74613) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 18:14:48 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-89e76344-7832-4808-8711-6fe5d5e2b363 tempest-ServerRescueNegativeTestJSON-1891426908 tempest-ServerRescueNegativeTestJSON-1891426908-project-member] Lock "1f2b4426-815f-4ef4-b98e-e5124fec93b7" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.053s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 18:14:48 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-89e76344-7832-4808-8711-6fe5d5e2b363 tempest-ServerRescueNegativeTestJSON-1891426908 tempest-ServerRescueNegativeTestJSON-1891426908-project-member] Acquiring lock "1f2b4426-815f-4ef4-b98e-e5124fec93b7" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 18:14:48 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-89e76344-7832-4808-8711-6fe5d5e2b363 tempest-ServerRescueNegativeTestJSON-1891426908 tempest-ServerRescueNegativeTestJSON-1891426908-project-member] Lock "1f2b4426-815f-4ef4-b98e-e5124fec93b7" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 18:14:48 user nova-compute[74613]: INFO nova.compute.manager [None req-89e76344-7832-4808-8711-6fe5d5e2b363 tempest-ServerRescueNegativeTestJSON-1891426908 tempest-ServerRescueNegativeTestJSON-1891426908-project-member] [instance: 1f2b4426-815f-4ef4-b98e-e5124fec93b7] Attaching volume 113c5dd9-52e5-46ba-8f15-faf70db70464 to /dev/vdb
Nov 29 18:14:48 user nova-compute[74613]: DEBUG os_brick.utils [None req-89e76344-7832-4808-8711-6fe5d5e2b363 tempest-ServerRescueNegativeTestJSON-1891426908 tempest-ServerRescueNegativeTestJSON-1891426908-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74613) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 18:14:48 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:14:48 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:14:48 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8dff723-4bd3-4523-baa3-8bc5334222c2]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:400972819b5\n', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 18:14:48 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:14:48 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:14:48 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b7e5eb4-a886-47c4-839b-6622059ed19d]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 18:14:48 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:14:48 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:14:48 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8f90f43-ee3a-4fa1-bfc9-602d470b4447]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 18:14:48 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[6625cbcf-e69d-46e0-8974-a79c7159fe6e]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 18:14:48 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-89e76344-7832-4808-8711-6fe5d5e2b363 tempest-ServerRescueNegativeTestJSON-1891426908 tempest-ServerRescueNegativeTestJSON-1891426908-project-member] Running cmd (subprocess): nvme version {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:14:48 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-89e76344-7832-4808-8711-6fe5d5e2b363 tempest-ServerRescueNegativeTestJSON-1891426908 tempest-ServerRescueNegativeTestJSON-1891426908-project-member] 'nvme version' failed. Not Retrying. {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 18:14:48 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.nvmeof [None req-89e76344-7832-4808-8711-6fe5d5e2b363 tempest-ServerRescueNegativeTestJSON-1891426908 tempest-ServerRescueNegativeTestJSON-1891426908-project-member] nvme not present on system {{(pid=74613) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 29 18:14:48 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:14:48 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 18:14:48 user nova-compute[74613]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 29 18:14:48 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[921c5d8d-f9aa-46fe-aa98-b3fc5133abc6]: (4, '') {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 18:14:48 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.lightos [None req-89e76344-7832-4808-8711-6fe5d5e2b363 tempest-ServerRescueNegativeTestJSON-1891426908 tempest-ServerRescueNegativeTestJSON-1891426908-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74613) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 29 18:14:48 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.lightos [None req-89e76344-7832-4808-8711-6fe5d5e2b363 tempest-ServerRescueNegativeTestJSON-1891426908 tempest-ServerRescueNegativeTestJSON-1891426908-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74613) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 29 18:14:48 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.lightos [None req-89e76344-7832-4808-8711-6fe5d5e2b363 tempest-ServerRescueNegativeTestJSON-1891426908 tempest-ServerRescueNegativeTestJSON-1891426908-project-member] LIGHTOS: no hostnqn found. {{(pid=74613) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 29 18:14:48 user nova-compute[74613]: DEBUG os_brick.utils [None req-89e76344-7832-4808-8711-6fe5d5e2b363 tempest-ServerRescueNegativeTestJSON-1891426908 tempest-ServerRescueNegativeTestJSON-1891426908-project-member] <== get_connector_properties: return (118ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:400972819b5', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74613) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 18:14:48 user nova-compute[74613]: DEBUG nova.virt.block_device [None req-89e76344-7832-4808-8711-6fe5d5e2b363 tempest-ServerRescueNegativeTestJSON-1891426908 tempest-ServerRescueNegativeTestJSON-1891426908-project-member] [instance: 1f2b4426-815f-4ef4-b98e-e5124fec93b7] Updating existing volume attachment record: 33682ee6-1aa7-42bf-9895-c1f953667acd {{(pid=74613) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 29 18:14:49 user nova-compute[74613]: DEBUG nova.compute.manager [None req-206e8b21-88a3-488c-8ab4-7d1df0990547 tempest-VolumesActionsTest-1891851968 tempest-VolumesActionsTest-1891851968-project-member] [instance: 8ef9c2f4-23d0-44eb-9ba9-8c7c3f6b0874] Instance event wait completed in 0 seconds for  {{(pid=74613) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 29 18:14:49 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-206e8b21-88a3-488c-8ab4-7d1df0990547 tempest-VolumesActionsTest-1891851968 tempest-VolumesActionsTest-1891851968-project-member] [instance: 8ef9c2f4-23d0-44eb-9ba9-8c7c3f6b0874] Guest created on hypervisor {{(pid=74613) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 29 18:14:49 user nova-compute[74613]: INFO nova.virt.libvirt.driver [-] [instance: 8ef9c2f4-23d0-44eb-9ba9-8c7c3f6b0874] Instance spawned successfully.
Nov 29 18:14:49 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-206e8b21-88a3-488c-8ab4-7d1df0990547 tempest-VolumesActionsTest-1891851968 tempest-VolumesActionsTest-1891851968-project-member] [instance: 8ef9c2f4-23d0-44eb-9ba9-8c7c3f6b0874] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74613) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 29 18:14:49 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-206e8b21-88a3-488c-8ab4-7d1df0990547 tempest-VolumesActionsTest-1891851968 tempest-VolumesActionsTest-1891851968-project-member] [instance: 8ef9c2f4-23d0-44eb-9ba9-8c7c3f6b0874] Found default for hw_cdrom_bus of ide {{(pid=74613) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 18:14:49 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-206e8b21-88a3-488c-8ab4-7d1df0990547 tempest-VolumesActionsTest-1891851968 tempest-VolumesActionsTest-1891851968-project-member] [instance: 8ef9c2f4-23d0-44eb-9ba9-8c7c3f6b0874] Found default for hw_disk_bus of virtio {{(pid=74613) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 18:14:49 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-206e8b21-88a3-488c-8ab4-7d1df0990547 tempest-VolumesActionsTest-1891851968 tempest-VolumesActionsTest-1891851968-project-member] [instance: 8ef9c2f4-23d0-44eb-9ba9-8c7c3f6b0874] Found default for hw_input_bus of None {{(pid=74613) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 18:14:49 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-206e8b21-88a3-488c-8ab4-7d1df0990547 tempest-VolumesActionsTest-1891851968 tempest-VolumesActionsTest-1891851968-project-member] [instance: 8ef9c2f4-23d0-44eb-9ba9-8c7c3f6b0874] Found default for hw_pointer_model of None {{(pid=74613) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 18:14:49 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-206e8b21-88a3-488c-8ab4-7d1df0990547 tempest-VolumesActionsTest-1891851968 tempest-VolumesActionsTest-1891851968-project-member] [instance: 8ef9c2f4-23d0-44eb-9ba9-8c7c3f6b0874] Found default for hw_video_model of virtio {{(pid=74613) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 18:14:49 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-206e8b21-88a3-488c-8ab4-7d1df0990547 tempest-VolumesActionsTest-1891851968 tempest-VolumesActionsTest-1891851968-project-member] [instance: 8ef9c2f4-23d0-44eb-9ba9-8c7c3f6b0874] Found default for hw_vif_model of virtio {{(pid=74613) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 18:14:49 user nova-compute[74613]: INFO nova.compute.manager [None req-206e8b21-88a3-488c-8ab4-7d1df0990547 tempest-VolumesActionsTest-1891851968 tempest-VolumesActionsTest-1891851968-project-member] [instance: 8ef9c2f4-23d0-44eb-9ba9-8c7c3f6b0874] Took 5.27 seconds to spawn the instance on the hypervisor.
Nov 29 18:14:49 user nova-compute[74613]: DEBUG nova.compute.manager [None req-206e8b21-88a3-488c-8ab4-7d1df0990547 tempest-VolumesActionsTest-1891851968 tempest-VolumesActionsTest-1891851968-project-member] [instance: 8ef9c2f4-23d0-44eb-9ba9-8c7c3f6b0874] Checking state {{(pid=74613) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 29 18:14:49 user nova-compute[74613]: INFO nova.compute.manager [None req-206e8b21-88a3-488c-8ab4-7d1df0990547 tempest-VolumesActionsTest-1891851968 tempest-VolumesActionsTest-1891851968-project-member] [instance: 8ef9c2f4-23d0-44eb-9ba9-8c7c3f6b0874] Took 6.06 seconds to build instance.
Nov 29 18:14:49 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-206e8b21-88a3-488c-8ab4-7d1df0990547 tempest-VolumesActionsTest-1891851968 tempest-VolumesActionsTest-1891851968-project-member] Lock "8ef9c2f4-23d0-44eb-9ba9-8c7c3f6b0874" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.152s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 18:14:50 user nova-compute[74613]: DEBUG nova.compute.manager [req-dd0435ae-6f66-4804-bb56-340036ea7f2a req-17c6c335-ceea-4d6b-9b43-294aed01e386 service nova] [instance: 1f2b4426-815f-4ef4-b98e-e5124fec93b7] Received event network-changed-e89209f3-5532-4ff8-95c7-fb7a3334846a {{(pid=74613) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 18:14:50 user nova-compute[74613]: DEBUG nova.compute.manager [req-dd0435ae-6f66-4804-bb56-340036ea7f2a req-17c6c335-ceea-4d6b-9b43-294aed01e386 service nova] [instance: 1f2b4426-815f-4ef4-b98e-e5124fec93b7] Refreshing instance network info cache due to event network-changed-e89209f3-5532-4ff8-95c7-fb7a3334846a. {{(pid=74613) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 18:14:50 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-dd0435ae-6f66-4804-bb56-340036ea7f2a req-17c6c335-ceea-4d6b-9b43-294aed01e386 service nova] Acquiring lock "refresh_cache-1f2b4426-815f-4ef4-b98e-e5124fec93b7" {{(pid=74613) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 18:14:50 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-dd0435ae-6f66-4804-bb56-340036ea7f2a req-17c6c335-ceea-4d6b-9b43-294aed01e386 service nova] Acquired lock "refresh_cache-1f2b4426-815f-4ef4-b98e-e5124fec93b7" {{(pid=74613) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 18:14:50 user nova-compute[74613]: DEBUG nova.network.neutron [req-dd0435ae-6f66-4804-bb56-340036ea7f2a req-17c6c335-ceea-4d6b-9b43-294aed01e386 service nova] [instance: 1f2b4426-815f-4ef4-b98e-e5124fec93b7] Refreshing network info cache for port e89209f3-5532-4ff8-95c7-fb7a3334846a {{(pid=74613) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 18:14:50 user nova-compute[74613]: DEBUG nova.network.neutron [req-dd0435ae-6f66-4804-bb56-340036ea7f2a req-17c6c335-ceea-4d6b-9b43-294aed01e386 service nova] [instance: 1f2b4426-815f-4ef4-b98e-e5124fec93b7] Updated VIF entry in instance network info cache for port e89209f3-5532-4ff8-95c7-fb7a3334846a. {{(pid=74613) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 18:14:50 user nova-compute[74613]: DEBUG nova.network.neutron [req-dd0435ae-6f66-4804-bb56-340036ea7f2a req-17c6c335-ceea-4d6b-9b43-294aed01e386 service nova] [instance: 1f2b4426-815f-4ef4-b98e-e5124fec93b7] Updating instance_info_cache with network_info: [{"id": "e89209f3-5532-4ff8-95c7-fb7a3334846a", "address": "fa:16:3e:98:a3:61", "network": {"id": "db79433c-b21c-4058-b98c-f62822abbf7a", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1715530752-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.251", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e6a3eb6ea0294f9da705dca72ec2789a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape89209f3-55", "ovs_interfaceid": "e89209f3-5532-4ff8-95c7-fb7a3334846a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74613) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 18:14:50 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-dd0435ae-6f66-4804-bb56-340036ea7f2a req-17c6c335-ceea-4d6b-9b43-294aed01e386 service nova] Releasing lock "refresh_cache-1f2b4426-815f-4ef4-b98e-e5124fec93b7" {{(pid=74613) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 18:14:50 user nova-compute[74613]: DEBUG nova.compute.manager [req-dd0435ae-6f66-4804-bb56-340036ea7f2a req-17c6c335-ceea-4d6b-9b43-294aed01e386 service nova] [instance: 8ef9c2f4-23d0-44eb-9ba9-8c7c3f6b0874] Received event network-vif-plugged-1bf62fcc-5bb2-4457-880a-4fffbdd56514 {{(pid=74613) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 18:14:50 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-dd0435ae-6f66-4804-bb56-340036ea7f2a req-17c6c335-ceea-4d6b-9b43-294aed01e386 service nova] Acquiring lock "8ef9c2f4-23d0-44eb-9ba9-8c7c3f6b0874-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 18:14:50 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-dd0435ae-6f66-4804-bb56-340036ea7f2a req-17c6c335-ceea-4d6b-9b43-294aed01e386 service nova] Lock "8ef9c2f4-23d0-44eb-9ba9-8c7c3f6b0874-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 18:14:50 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-dd0435ae-6f66-4804-bb56-340036ea7f2a req-17c6c335-ceea-4d6b-9b43-294aed01e386 service nova] Lock "8ef9c2f4-23d0-44eb-9ba9-8c7c3f6b0874-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 18:14:50 user nova-compute[74613]: DEBUG nova.compute.manager [req-dd0435ae-6f66-4804-bb56-340036ea7f2a req-17c6c335-ceea-4d6b-9b43-294aed01e386 service nova] [instance: 8ef9c2f4-23d0-44eb-9ba9-8c7c3f6b0874] No waiting events found dispatching network-vif-plugged-1bf62fcc-5bb2-4457-880a-4fffbdd56514 {{(pid=74613) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 18:14:50 user nova-compute[74613]: WARNING nova.compute.manager [req-dd0435ae-6f66-4804-bb56-340036ea7f2a req-17c6c335-ceea-4d6b-9b43-294aed01e386 service nova] [instance: 8ef9c2f4-23d0-44eb-9ba9-8c7c3f6b0874] Received unexpected event network-vif-plugged-1bf62fcc-5bb2-4457-880a-4fffbdd56514 for instance with vm_state active and task_state None.
Nov 29 18:14:51 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:14:51 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:14:56 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:14:56 user nova-compute[74613]: DEBUG nova.virt.libvirt.volume.iscsi [None req-89e76344-7832-4808-8711-6fe5d5e2b363 tempest-ServerRescueNegativeTestJSON-1891426908 tempest-ServerRescueNegativeTestJSON-1891426908-project-member] [instance: 1f2b4426-815f-4ef4-b98e-e5124fec93b7] Calling os-brick to attach iSCSI Volume {{(pid=74613) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 29 18:14:56 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-89e76344-7832-4808-8711-6fe5d5e2b363 tempest-ServerRescueNegativeTestJSON-1891426908 tempest-ServerRescueNegativeTestJSON-1891426908-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff828156890>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:113c5dd9-52e5-46ba-8f15-faf70db70464', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'hUtHORWv', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74613) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 18:14:56 user nova-compute[74613]: WARNING os_brick.initiator.connectors.base [None req-89e76344-7832-4808-8711-6fe5d5e2b363 tempest-ServerRescueNegativeTestJSON-1891426908 tempest-ServerRescueNegativeTestJSON-1891426908-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 18:14:56 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.base [None req-89e76344-7832-4808-8711-6fe5d5e2b363 tempest-ServerRescueNegativeTestJSON-1891426908 tempest-ServerRescueNegativeTestJSON-1891426908-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 18:14:56 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.base [None req-89e76344-7832-4808-8711-6fe5d5e2b363 tempest-ServerRescueNegativeTestJSON-1891426908 tempest-ServerRescueNegativeTestJSON-1891426908-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 18:14:56 user nova-compute[74613]: WARNING os_brick.initiator.connectors.base [None req-89e76344-7832-4808-8711-6fe5d5e2b363 tempest-ServerRescueNegativeTestJSON-1891426908 tempest-ServerRescueNegativeTestJSON-1891426908-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 18:14:56 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.base [None req-89e76344-7832-4808-8711-6fe5d5e2b363 tempest-ServerRescueNegativeTestJSON-1891426908 tempest-ServerRescueNegativeTestJSON-1891426908-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:113c5dd9-52e5-46ba-8f15-faf70db70464" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 18:14:56 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.base [None req-89e76344-7832-4808-8711-6fe5d5e2b363 tempest-ServerRescueNegativeTestJSON-1891426908 tempest-ServerRescueNegativeTestJSON-1891426908-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:113c5dd9-52e5-46ba-8f15-faf70db70464" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 18:14:56 user nova-compute[74613]: INFO os_brick.initiator.connectors.iscsi [None req-89e76344-7832-4808-8711-6fe5d5e2b363 tempest-ServerRescueNegativeTestJSON-1891426908 tempest-ServerRescueNegativeTestJSON-1891426908-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 29 18:14:56 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:113c5dd9-52e5-46ba-8f15-faf70db70464 -p 172.16.0.220:3260 {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:14:56 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:14:56 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:113c5dd9-52e5-46ba-8f15-faf70db70464 -p 172.16.0.220:3260" returned: 21 in 0.016s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:14:56 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[29cfe835-01bf-4412-9994-e0fa5117e194]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 18:14:56 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-89e76344-7832-4808-8711-6fe5d5e2b363 tempest-ServerRescueNegativeTestJSON-1891426908 tempest-ServerRescueNegativeTestJSON-1891426908-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 29 18:14:56 user nova-compute[74613]:  {{(pid=74613) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 18:14:56 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:113c5dd9-52e5-46ba-8f15-faf70db70464 -p 172.16.0.220:3260 --interface default --op new {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:14:56 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:113c5dd9-52e5-46ba-8f15-faf70db70464 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:14:56 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[3cf37b8a-7dd9-4d89-9afb-36473bded890]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:113c5dd9-52e5-46ba-8f15-faf70db70464] added\n', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 18:14:56 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-89e76344-7832-4808-8711-6fe5d5e2b363 tempest-ServerRescueNegativeTestJSON-1891426908 tempest-ServerRescueNegativeTestJSON-1891426908-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:113c5dd9-52e5-46ba-8f15-faf70db70464] added
Nov 29 18:14:56 user nova-compute[74613]:  stderr= {{(pid=74613) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 18:14:56 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:113c5dd9-52e5-46ba-8f15-faf70db70464 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:14:56 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:113c5dd9-52e5-46ba-8f15-faf70db70464 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:14:56 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[49abd2fd-b61f-44da-a28c-ad7f9d366ac9]: (4, ('', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 18:14:56 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-89e76344-7832-4808-8711-6fe5d5e2b363 tempest-ServerRescueNegativeTestJSON-1891426908 tempest-ServerRescueNegativeTestJSON-1891426908-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74613) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 18:14:56 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:113c5dd9-52e5-46ba-8f15-faf70db70464 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:14:56 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:113c5dd9-52e5-46ba-8f15-faf70db70464 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:14:56 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba0b9922-8155-4bb2-a582-5ca6989cb00c]: (4, ('', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 18:14:56 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-89e76344-7832-4808-8711-6fe5d5e2b363 tempest-ServerRescueNegativeTestJSON-1891426908 tempest-ServerRescueNegativeTestJSON-1891426908-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74613) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 18:14:56 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:113c5dd9-52e5-46ba-8f15-faf70db70464 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v hUtHORWv {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:14:56 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:113c5dd9-52e5-46ba-8f15-faf70db70464 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v hUtHORWv" returned: 0 in 0.017s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:14:56 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0dd9aec-1a18-42b7-ae3e-269e55f7d80a]: (4, ('', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 18:14:56 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-89e76344-7832-4808-8711-6fe5d5e2b363 tempest-ServerRescueNegativeTestJSON-1891426908 tempest-ServerRescueNegativeTestJSON-1891426908-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'hUtHORWv'): stdout= stderr= {{(pid=74613) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 18:14:56 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:113c5dd9-52e5-46ba-8f15-faf70db70464 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:14:56 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:113c5dd9-52e5-46ba-8f15-faf70db70464 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:14:56 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[26039932-9297-4f40-aefe-ecca9dfab182]: (4, ('', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 18:14:56 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-89e76344-7832-4808-8711-6fe5d5e2b363 tempest-ServerRescueNegativeTestJSON-1891426908 tempest-ServerRescueNegativeTestJSON-1891426908-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74613) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 18:14:56 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:14:56 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:14:56 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[40d61462-7755-4aa0-8191-8a2f4e3559ae]: (4, ('tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1cd1b4f3-6008-4bef-bb8d-e92e973d5a96 (non-flash)\n', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 18:14:56 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-89e76344-7832-4808-8711-6fe5d5e2b363 tempest-ServerRescueNegativeTestJSON-1891426908 tempest-ServerRescueNegativeTestJSON-1891426908-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1cd1b4f3-6008-4bef-bb8d-e92e973d5a96 (non-flash)
Nov 29 18:14:56 user nova-compute[74613]:  stderr= {{(pid=74613) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 18:14:56 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-89e76344-7832-4808-8711-6fe5d5e2b363 tempest-ServerRescueNegativeTestJSON-1891426908 tempest-ServerRescueNegativeTestJSON-1891426908-project-member] iscsi session list stdout=tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1cd1b4f3-6008-4bef-bb8d-e92e973d5a96 (non-flash)
Nov 29 18:14:56 user nova-compute[74613]:  stderr= {{(pid=74613) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 18:14:56 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:113c5dd9-52e5-46ba-8f15-faf70db70464 -p 172.16.0.220:3260 --login {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:14:56 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:113c5dd9-52e5-46ba-8f15-faf70db70464 -p 172.16.0.220:3260 --login" returned: 0 in 0.055s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:14:56 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[da1b4ffc-d896-4202-a3d1-4d91a17cc9bc]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:113c5dd9-52e5-46ba-8f15-faf70db70464, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:113c5dd9-52e5-46ba-8f15-faf70db70464, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 18:14:56 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-89e76344-7832-4808-8711-6fe5d5e2b363 tempest-ServerRescueNegativeTestJSON-1891426908 tempest-ServerRescueNegativeTestJSON-1891426908-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:113c5dd9-52e5-46ba-8f15-faf70db70464, portal: 172.16.0.220,3260]
Nov 29 18:14:56 user nova-compute[74613]: Login to [iface: default, target: iqn.2010-10.org.openstack:113c5dd9-52e5-46ba-8f15-faf70db70464, portal: 172.16.0.220,3260] successful.
Nov 29 18:14:56 user nova-compute[74613]:  stderr= {{(pid=74613) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 18:14:56 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:113c5dd9-52e5-46ba-8f15-faf70db70464 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:14:56 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:113c5dd9-52e5-46ba-8f15-faf70db70464 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.017s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:14:56 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[6bd95d0d-f2ed-4b4a-a20b-dc4fd4b17f0e]: (4, ('', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 18:14:56 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-89e76344-7832-4808-8711-6fe5d5e2b363 tempest-ServerRescueNegativeTestJSON-1891426908 tempest-ServerRescueNegativeTestJSON-1891426908-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74613) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 18:14:56 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:14:56 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:14:56 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[85f0ff31-1c40-4b8b-b842-6a74f5d4db98]: (4, ('tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1cd1b4f3-6008-4bef-bb8d-e92e973d5a96 (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:113c5dd9-52e5-46ba-8f15-faf70db70464 (non-flash)\n', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 18:14:56 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-89e76344-7832-4808-8711-6fe5d5e2b363 tempest-ServerRescueNegativeTestJSON-1891426908 tempest-ServerRescueNegativeTestJSON-1891426908-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1cd1b4f3-6008-4bef-bb8d-e92e973d5a96 (non-flash)
Nov 29 18:14:56 user nova-compute[74613]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:113c5dd9-52e5-46ba-8f15-faf70db70464 (non-flash)
Nov 29 18:14:56 user nova-compute[74613]:  stderr= {{(pid=74613) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 18:14:56 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-89e76344-7832-4808-8711-6fe5d5e2b363 tempest-ServerRescueNegativeTestJSON-1891426908 tempest-ServerRescueNegativeTestJSON-1891426908-project-member] iscsi session list stdout=tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1cd1b4f3-6008-4bef-bb8d-e92e973d5a96 (non-flash)
Nov 29 18:14:56 user nova-compute[74613]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:113c5dd9-52e5-46ba-8f15-faf70db70464 (non-flash)
Nov 29 18:14:56 user nova-compute[74613]:  stderr= {{(pid=74613) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 18:14:56 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.base [None req-89e76344-7832-4808-8711-6fe5d5e2b363 tempest-ServerRescueNegativeTestJSON-1891426908 tempest-ServerRescueNegativeTestJSON-1891426908-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:113c5dd9-52e5-46ba-8f15-faf70db70464" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.251s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 18:14:56 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-89e76344-7832-4808-8711-6fe5d5e2b363 tempest-ServerRescueNegativeTestJSON-1891426908 tempest-ServerRescueNegativeTestJSON-1891426908-project-member] Connected to 172.16.0.220:3260 {{(pid=74613) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 29 18:14:56 user nova-compute[74613]: DEBUG os_brick.initiator.linuxscsi [None req-89e76344-7832-4808-8711-6fe5d5e2b363 tempest-ServerRescueNegativeTestJSON-1891426908 tempest-ServerRescueNegativeTestJSON-1891426908-project-member] HCTL ('34', '-', '-', 0) found on session 44 with lun 0 {{(pid=74613) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 29 18:14:56 user nova-compute[74613]: DEBUG os_brick.initiator.linuxscsi [None req-89e76344-7832-4808-8711-6fe5d5e2b363 tempest-ServerRescueNegativeTestJSON-1891426908 tempest-ServerRescueNegativeTestJSON-1891426908-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=74613) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 29 18:14:56 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:14:56 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.016s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:14:56 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8c64324-a3e9-4977-b988-947e07429b79]: (4, ('- - 0', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 18:14:56 user nova-compute[74613]: DEBUG os_brick.initiator.linuxscsi [None req-89e76344-7832-4808-8711-6fe5d5e2b363 tempest-ServerRescueNegativeTestJSON-1891426908 tempest-ServerRescueNegativeTestJSON-1891426908-project-member] Searching for a device in session 44 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=74613) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 29 18:14:56 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-89e76344-7832-4808-8711-6fe5d5e2b363 tempest-ServerRescueNegativeTestJSON-1891426908 tempest-ServerRescueNegativeTestJSON-1891426908-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:113c5dd9-52e5-46ba-8f15-faf70db70464', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'hUtHORWv', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74613) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 29 18:14:57 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.base [None req-89e76344-7832-4808-8711-6fe5d5e2b363 tempest-ServerRescueNegativeTestJSON-1891426908 tempest-ServerRescueNegativeTestJSON-1891426908-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.283s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 18:14:57 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-89e76344-7832-4808-8711-6fe5d5e2b363 tempest-ServerRescueNegativeTestJSON-1891426908 tempest-ServerRescueNegativeTestJSON-1891426908-project-member] <== connect_volume: return (1285ms) {'type': 'block', 'scsi_wwn': '23930613839313637', 'path': '/dev/sdc'} {{(pid=74613) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 18:14:57 user nova-compute[74613]: DEBUG nova.virt.libvirt.volume.iscsi [None req-89e76344-7832-4808-8711-6fe5d5e2b363 tempest-ServerRescueNegativeTestJSON-1891426908 tempest-ServerRescueNegativeTestJSON-1891426908-project-member] [instance: 1f2b4426-815f-4ef4-b98e-e5124fec93b7] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23930613839313637', 'path': '/dev/sdc'} {{(pid=74613) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 29 18:14:57 user nova-compute[74613]: DEBUG nova.objects.instance [None req-89e76344-7832-4808-8711-6fe5d5e2b363 tempest-ServerRescueNegativeTestJSON-1891426908 tempest-ServerRescueNegativeTestJSON-1891426908-project-member] Lazy-loading 'flavor' on Instance uuid 1f2b4426-815f-4ef4-b98e-e5124fec93b7 {{(pid=74613) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 18:14:57 user nova-compute[74613]: DEBUG nova.virt.libvirt.guest [None req-89e76344-7832-4808-8711-6fe5d5e2b363 tempest-ServerRescueNegativeTestJSON-1891426908 tempest-ServerRescueNegativeTestJSON-1891426908-project-member] attach device xml: <disk type="block" device="disk">
Nov 29 18:14:57 user nova-compute[74613]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 18:14:57 user nova-compute[74613]:   <source dev="/dev/sdc"/>
Nov 29 18:14:57 user nova-compute[74613]:   <target dev="vdb" bus="virtio"/>
Nov 29 18:14:57 user nova-compute[74613]:   <serial>113c5dd9-52e5-46ba-8f15-faf70db70464</serial>
Nov 29 18:14:57 user nova-compute[74613]: </disk>
Nov 29 18:14:57 user nova-compute[74613]:  {{(pid=74613) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 29 18:14:57 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-89e76344-7832-4808-8711-6fe5d5e2b363 tempest-ServerRescueNegativeTestJSON-1891426908 tempest-ServerRescueNegativeTestJSON-1891426908-project-member] No BDM found with device name vda, not building metadata. {{(pid=74613) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 18:14:57 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-89e76344-7832-4808-8711-6fe5d5e2b363 tempest-ServerRescueNegativeTestJSON-1891426908 tempest-ServerRescueNegativeTestJSON-1891426908-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74613) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 18:14:57 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-89e76344-7832-4808-8711-6fe5d5e2b363 tempest-ServerRescueNegativeTestJSON-1891426908 tempest-ServerRescueNegativeTestJSON-1891426908-project-member] No VIF found with MAC fa:16:3e:98:a3:61, not building metadata {{(pid=74613) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 29 18:14:58 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-89e76344-7832-4808-8711-6fe5d5e2b363 tempest-ServerRescueNegativeTestJSON-1891426908 tempest-ServerRescueNegativeTestJSON-1891426908-project-member] Lock "1f2b4426-815f-4ef4-b98e-e5124fec93b7" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 9.627s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 18:14:59 user nova-compute[74613]: INFO nova.compute.manager [None req-118d2bf7-f410-45d0-90d1-0db109692905 tempest-ServerRescueNegativeTestJSON-1891426908 tempest-ServerRescueNegativeTestJSON-1891426908-project-member] [instance: 1f2b4426-815f-4ef4-b98e-e5124fec93b7] Rescuing
Nov 29 18:14:59 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-118d2bf7-f410-45d0-90d1-0db109692905 tempest-ServerRescueNegativeTestJSON-1891426908 tempest-ServerRescueNegativeTestJSON-1891426908-project-member] Acquiring lock "refresh_cache-1f2b4426-815f-4ef4-b98e-e5124fec93b7" {{(pid=74613) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 18:14:59 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-118d2bf7-f410-45d0-90d1-0db109692905 tempest-ServerRescueNegativeTestJSON-1891426908 tempest-ServerRescueNegativeTestJSON-1891426908-project-member] Acquired lock "refresh_cache-1f2b4426-815f-4ef4-b98e-e5124fec93b7" {{(pid=74613) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 18:14:59 user nova-compute[74613]: DEBUG nova.network.neutron [None req-118d2bf7-f410-45d0-90d1-0db109692905 tempest-ServerRescueNegativeTestJSON-1891426908 tempest-ServerRescueNegativeTestJSON-1891426908-project-member] [instance: 1f2b4426-815f-4ef4-b98e-e5124fec93b7] Building network info cache for instance {{(pid=74613) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 29 18:15:00 user nova-compute[74613]: DEBUG nova.network.neutron [None req-118d2bf7-f410-45d0-90d1-0db109692905 tempest-ServerRescueNegativeTestJSON-1891426908 tempest-ServerRescueNegativeTestJSON-1891426908-project-member] [instance: 1f2b4426-815f-4ef4-b98e-e5124fec93b7] Updating instance_info_cache with network_info: [{"id": "e89209f3-5532-4ff8-95c7-fb7a3334846a", "address": "fa:16:3e:98:a3:61", "network": {"id": "db79433c-b21c-4058-b98c-f62822abbf7a", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1715530752-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.251", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e6a3eb6ea0294f9da705dca72ec2789a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape89209f3-55", "ovs_interfaceid": "e89209f3-5532-4ff8-95c7-fb7a3334846a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74613) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 18:15:00 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-118d2bf7-f410-45d0-90d1-0db109692905 tempest-ServerRescueNegativeTestJSON-1891426908 tempest-ServerRescueNegativeTestJSON-1891426908-project-member] Releasing lock "refresh_cache-1f2b4426-815f-4ef4-b98e-e5124fec93b7" {{(pid=74613) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 18:15:00 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:15:00 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:15:00 user nova-compute[74613]: DEBUG nova.compute.manager [req-d7d05fba-7557-4a82-9be5-b931197efe84 req-15f9a5bd-ba67-436b-a1f2-6f874626e5c7 service nova] [instance: 1f2b4426-815f-4ef4-b98e-e5124fec93b7] Received event network-vif-unplugged-e89209f3-5532-4ff8-95c7-fb7a3334846a {{(pid=74613) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 18:15:00 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-d7d05fba-7557-4a82-9be5-b931197efe84 req-15f9a5bd-ba67-436b-a1f2-6f874626e5c7 service nova] Acquiring lock "1f2b4426-815f-4ef4-b98e-e5124fec93b7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 18:15:00 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-d7d05fba-7557-4a82-9be5-b931197efe84 req-15f9a5bd-ba67-436b-a1f2-6f874626e5c7 service nova] Lock "1f2b4426-815f-4ef4-b98e-e5124fec93b7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 18:15:00 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-d7d05fba-7557-4a82-9be5-b931197efe84 req-15f9a5bd-ba67-436b-a1f2-6f874626e5c7 service nova] Lock "1f2b4426-815f-4ef4-b98e-e5124fec93b7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 18:15:00 user nova-compute[74613]: DEBUG nova.compute.manager [req-d7d05fba-7557-4a82-9be5-b931197efe84 req-15f9a5bd-ba67-436b-a1f2-6f874626e5c7 service nova] [instance: 1f2b4426-815f-4ef4-b98e-e5124fec93b7] No waiting events found dispatching network-vif-unplugged-e89209f3-5532-4ff8-95c7-fb7a3334846a {{(pid=74613) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 18:15:00 user nova-compute[74613]: WARNING nova.compute.manager [req-d7d05fba-7557-4a82-9be5-b931197efe84 req-15f9a5bd-ba67-436b-a1f2-6f874626e5c7 service nova] [instance: 1f2b4426-815f-4ef4-b98e-e5124fec93b7] Received unexpected event network-vif-unplugged-e89209f3-5532-4ff8-95c7-fb7a3334846a for instance with vm_state active and task_state rescuing.
Nov 29 18:15:00 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:15:00 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:15:01 user nova-compute[74613]: INFO nova.virt.libvirt.driver [-] [instance: 1f2b4426-815f-4ef4-b98e-e5124fec93b7] Instance destroyed successfully.
Nov 29 18:15:01 user nova-compute[74613]: INFO nova.virt.libvirt.driver [None req-118d2bf7-f410-45d0-90d1-0db109692905 tempest-ServerRescueNegativeTestJSON-1891426908 tempest-ServerRescueNegativeTestJSON-1891426908-project-member] [instance: 1f2b4426-815f-4ef4-b98e-e5124fec93b7] Attempting rescue
Nov 29 18:15:01 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-118d2bf7-f410-45d0-90d1-0db109692905 tempest-ServerRescueNegativeTestJSON-1891426908 tempest-ServerRescueNegativeTestJSON-1891426908-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=74613) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4318}}
Nov 29 18:15:01 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-118d2bf7-f410-45d0-90d1-0db109692905 tempest-ServerRescueNegativeTestJSON-1891426908 tempest-ServerRescueNegativeTestJSON-1891426908-project-member] [instance: 1f2b4426-815f-4ef4-b98e-e5124fec93b7] Instance directory exists: not creating {{(pid=74613) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Nov 29 18:15:01 user nova-compute[74613]: INFO nova.virt.libvirt.driver [None req-118d2bf7-f410-45d0-90d1-0db109692905 tempest-ServerRescueNegativeTestJSON-1891426908 tempest-ServerRescueNegativeTestJSON-1891426908-project-member] [instance: 1f2b4426-815f-4ef4-b98e-e5124fec93b7] Creating image(s)
Nov 29 18:15:01 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-118d2bf7-f410-45d0-90d1-0db109692905 tempest-ServerRescueNegativeTestJSON-1891426908 tempest-ServerRescueNegativeTestJSON-1891426908-project-member] Acquiring lock "/opt/stack/data/nova/instances/1f2b4426-815f-4ef4-b98e-e5124fec93b7/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 18:15:01 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-118d2bf7-f410-45d0-90d1-0db109692905 tempest-ServerRescueNegativeTestJSON-1891426908 tempest-ServerRescueNegativeTestJSON-1891426908-project-member] Lock "/opt/stack/data/nova/instances/1f2b4426-815f-4ef4-b98e-e5124fec93b7/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 18:15:01 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-118d2bf7-f410-45d0-90d1-0db109692905 tempest-ServerRescueNegativeTestJSON-1891426908 tempest-ServerRescueNegativeTestJSON-1891426908-project-member] Lock "/opt/stack/data/nova/instances/1f2b4426-815f-4ef4-b98e-e5124fec93b7/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 18:15:01 user nova-compute[74613]: DEBUG nova.objects.instance [None req-118d2bf7-f410-45d0-90d1-0db109692905 tempest-ServerRescueNegativeTestJSON-1891426908 tempest-ServerRescueNegativeTestJSON-1891426908-project-member] Lazy-loading 'trusted_certs' on Instance uuid 1f2b4426-815f-4ef4-b98e-e5124fec93b7 {{(pid=74613) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 18:15:01 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-118d2bf7-f410-45d0-90d1-0db109692905 tempest-ServerRescueNegativeTestJSON-1891426908 tempest-ServerRescueNegativeTestJSON-1891426908-project-member] Acquiring lock "21faea9e6951f3bdd0153b76ac89fe1a60a34758" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 18:15:01 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-118d2bf7-f410-45d0-90d1-0db109692905 tempest-ServerRescueNegativeTestJSON-1891426908 tempest-ServerRescueNegativeTestJSON-1891426908-project-member] Lock "21faea9e6951f3bdd0153b76ac89fe1a60a34758" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 18:15:01 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-118d2bf7-f410-45d0-90d1-0db109692905 tempest-ServerRescueNegativeTestJSON-1891426908 tempest-ServerRescueNegativeTestJSON-1891426908-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/21faea9e6951f3bdd0153b76ac89fe1a60a34758 --force-share --output=json {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:15:01 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:15:01 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-118d2bf7-f410-45d0-90d1-0db109692905 tempest-ServerRescueNegativeTestJSON-1891426908 tempest-ServerRescueNegativeTestJSON-1891426908-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/21faea9e6951f3bdd0153b76ac89fe1a60a34758 --force-share --output=json" returned: 0 in 0.174s {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:15:01 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-118d2bf7-f410-45d0-90d1-0db109692905 tempest-ServerRescueNegativeTestJSON-1891426908 tempest-ServerRescueNegativeTestJSON-1891426908-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/21faea9e6951f3bdd0153b76ac89fe1a60a34758,backing_fmt=raw /opt/stack/data/nova/instances/1f2b4426-815f-4ef4-b98e-e5124fec93b7/disk.rescue {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:15:01 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-118d2bf7-f410-45d0-90d1-0db109692905 tempest-ServerRescueNegativeTestJSON-1891426908 tempest-ServerRescueNegativeTestJSON-1891426908-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/21faea9e6951f3bdd0153b76ac89fe1a60a34758,backing_fmt=raw /opt/stack/data/nova/instances/1f2b4426-815f-4ef4-b98e-e5124fec93b7/disk.rescue" returned: 0 in 0.047s {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:15:01 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-118d2bf7-f410-45d0-90d1-0db109692905 tempest-ServerRescueNegativeTestJSON-1891426908 tempest-ServerRescueNegativeTestJSON-1891426908-project-member] Lock "21faea9e6951f3bdd0153b76ac89fe1a60a34758" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.227s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 18:15:01 user nova-compute[74613]: DEBUG nova.objects.instance [None req-118d2bf7-f410-45d0-90d1-0db109692905 tempest-ServerRescueNegativeTestJSON-1891426908 tempest-ServerRescueNegativeTestJSON-1891426908-project-member] Lazy-loading 'migration_context' on Instance uuid 1f2b4426-815f-4ef4-b98e-e5124fec93b7 {{(pid=74613) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 18:15:01 user nova-compute[74613]: DEBUG nova.objects.base [None req-118d2bf7-f410-45d0-90d1-0db109692905 tempest-ServerRescueNegativeTestJSON-1891426908 tempest-ServerRescueNegativeTestJSON-1891426908-project-member] Object Instance<1f2b4426-815f-4ef4-b98e-e5124fec93b7> lazy-loaded attributes: trusted_certs,migration_context {{(pid=74613) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 29 18:15:01 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-118d2bf7-f410-45d0-90d1-0db109692905 tempest-ServerRescueNegativeTestJSON-1891426908 tempest-ServerRescueNegativeTestJSON-1891426908-project-member] [instance: 1f2b4426-815f-4ef4-b98e-e5124fec93b7] Created local disks {{(pid=74613) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 29 18:15:01 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-118d2bf7-f410-45d0-90d1-0db109692905 tempest-ServerRescueNegativeTestJSON-1891426908 tempest-ServerRescueNegativeTestJSON-1891426908-project-member] [instance: 1f2b4426-815f-4ef4-b98e-e5124fec93b7] Start _get_guest_xml network_info=[{"id": "e89209f3-5532-4ff8-95c7-fb7a3334846a", "address": "fa:16:3e:98:a3:61", "network": {"id": "db79433c-b21c-4058-b98c-f62822abbf7a", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1715530752-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.251", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerRescueNegativeTestJSON-1715530752-network", "vif_mac": "fa:16:3e:98:a3:61"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e6a3eb6ea0294f9da705dca72ec2789a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape89209f3-55", "ovs_interfaceid": "e89209f3-5532-4ff8-95c7-fb7a3334846a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-29T17:47:38Z,direct_url=<?>,disk_format='qcow2',id=4217f428-8d9d-4ee1-9614-642d26d90c46,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='794b07cbd46a44b5865cfda741036bae',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-29T17:47:40Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': '4217f428-8d9d-4ee1-9614-642d26d90c46', 'kernel_id': '', 'ramdisk_id': ''} block_device_info=None {{(pid=74613) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 29 18:15:01 user nova-compute[74613]: DEBUG nova.objects.instance [None req-118d2bf7-f410-45d0-90d1-0db109692905 tempest-ServerRescueNegativeTestJSON-1891426908 tempest-ServerRescueNegativeTestJSON-1891426908-project-member] Lazy-loading 'resources' on Instance uuid 1f2b4426-815f-4ef4-b98e-e5124fec93b7 {{(pid=74613) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 18:15:01 user nova-compute[74613]: DEBUG nova.objects.base [None req-118d2bf7-f410-45d0-90d1-0db109692905 tempest-ServerRescueNegativeTestJSON-1891426908 tempest-ServerRescueNegativeTestJSON-1891426908-project-member] Object Instance<1f2b4426-815f-4ef4-b98e-e5124fec93b7> lazy-loaded attributes: trusted_certs,migration_context,resources {{(pid=74613) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 29 18:15:01 user nova-compute[74613]: DEBUG nova.objects.instance [None req-118d2bf7-f410-45d0-90d1-0db109692905 tempest-ServerRescueNegativeTestJSON-1891426908 tempest-ServerRescueNegativeTestJSON-1891426908-project-member] Lazy-loading 'numa_topology' on Instance uuid 1f2b4426-815f-4ef4-b98e-e5124fec93b7 {{(pid=74613) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 18:15:01 user nova-compute[74613]: DEBUG nova.objects.base [None req-118d2bf7-f410-45d0-90d1-0db109692905 tempest-ServerRescueNegativeTestJSON-1891426908 tempest-ServerRescueNegativeTestJSON-1891426908-project-member] Object Instance<1f2b4426-815f-4ef4-b98e-e5124fec93b7> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology {{(pid=74613) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 29 18:15:01 user nova-compute[74613]: WARNING nova.virt.libvirt.driver [None req-118d2bf7-f410-45d0-90d1-0db109692905 tempest-ServerRescueNegativeTestJSON-1891426908 tempest-ServerRescueNegativeTestJSON-1891426908-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 18:15:01 user nova-compute[74613]: WARNING nova.virt.libvirt.driver [None req-118d2bf7-f410-45d0-90d1-0db109692905 tempest-ServerRescueNegativeTestJSON-1891426908 tempest-ServerRescueNegativeTestJSON-1891426908-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 18:15:01 user nova-compute[74613]: DEBUG nova.virt.libvirt.host [None req-118d2bf7-f410-45d0-90d1-0db109692905 tempest-ServerRescueNegativeTestJSON-1891426908 tempest-ServerRescueNegativeTestJSON-1891426908-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74613) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 29 18:15:01 user nova-compute[74613]: DEBUG nova.virt.libvirt.host [None req-118d2bf7-f410-45d0-90d1-0db109692905 tempest-ServerRescueNegativeTestJSON-1891426908 tempest-ServerRescueNegativeTestJSON-1891426908-project-member] CPU controller missing on host. {{(pid=74613) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 29 18:15:01 user nova-compute[74613]: DEBUG nova.virt.libvirt.host [None req-118d2bf7-f410-45d0-90d1-0db109692905 tempest-ServerRescueNegativeTestJSON-1891426908 tempest-ServerRescueNegativeTestJSON-1891426908-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74613) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 29 18:15:01 user nova-compute[74613]: DEBUG nova.virt.libvirt.host [None req-118d2bf7-f410-45d0-90d1-0db109692905 tempest-ServerRescueNegativeTestJSON-1891426908 tempest-ServerRescueNegativeTestJSON-1891426908-project-member] CPU controller found on host. {{(pid=74613) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 29 18:15:01 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-118d2bf7-f410-45d0-90d1-0db109692905 tempest-ServerRescueNegativeTestJSON-1891426908 tempest-ServerRescueNegativeTestJSON-1891426908-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74613) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 29 18:15:01 user nova-compute[74613]: DEBUG nova.virt.hardware [None req-118d2bf7-f410-45d0-90d1-0db109692905 tempest-ServerRescueNegativeTestJSON-1891426908 tempest-ServerRescueNegativeTestJSON-1891426908-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-29T17:47:27Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-29T17:47:38Z,direct_url=<?>,disk_format='qcow2',id=4217f428-8d9d-4ee1-9614-642d26d90c46,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='794b07cbd46a44b5865cfda741036bae',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-29T17:47:40Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74613) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 29 18:15:01 user nova-compute[74613]: DEBUG nova.virt.hardware [None req-118d2bf7-f410-45d0-90d1-0db109692905 tempest-ServerRescueNegativeTestJSON-1891426908 tempest-ServerRescueNegativeTestJSON-1891426908-project-member] Flavor limits 0:0:0 {{(pid=74613) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 29 18:15:01 user nova-compute[74613]: DEBUG nova.virt.hardware [None req-118d2bf7-f410-45d0-90d1-0db109692905 tempest-ServerRescueNegativeTestJSON-1891426908 tempest-ServerRescueNegativeTestJSON-1891426908-project-member] Image limits 0:0:0 {{(pid=74613) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 29 18:15:01 user nova-compute[74613]: DEBUG nova.virt.hardware [None req-118d2bf7-f410-45d0-90d1-0db109692905 tempest-ServerRescueNegativeTestJSON-1891426908 tempest-ServerRescueNegativeTestJSON-1891426908-project-member] Flavor pref 0:0:0 {{(pid=74613) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 29 18:15:01 user nova-compute[74613]: DEBUG nova.virt.hardware [None req-118d2bf7-f410-45d0-90d1-0db109692905 tempest-ServerRescueNegativeTestJSON-1891426908 tempest-ServerRescueNegativeTestJSON-1891426908-project-member] Image pref 0:0:0 {{(pid=74613) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 29 18:15:01 user nova-compute[74613]: DEBUG nova.virt.hardware [None req-118d2bf7-f410-45d0-90d1-0db109692905 tempest-ServerRescueNegativeTestJSON-1891426908 tempest-ServerRescueNegativeTestJSON-1891426908-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74613) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 29 18:15:01 user nova-compute[74613]: DEBUG nova.virt.hardware [None req-118d2bf7-f410-45d0-90d1-0db109692905 tempest-ServerRescueNegativeTestJSON-1891426908 tempest-ServerRescueNegativeTestJSON-1891426908-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74613) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 29 18:15:01 user nova-compute[74613]: DEBUG nova.virt.hardware [None req-118d2bf7-f410-45d0-90d1-0db109692905 tempest-ServerRescueNegativeTestJSON-1891426908 tempest-ServerRescueNegativeTestJSON-1891426908-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74613) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 29 18:15:01 user nova-compute[74613]: DEBUG nova.virt.hardware [None req-118d2bf7-f410-45d0-90d1-0db109692905 tempest-ServerRescueNegativeTestJSON-1891426908 tempest-ServerRescueNegativeTestJSON-1891426908-project-member] Got 1 possible topologies {{(pid=74613) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 29 18:15:01 user nova-compute[74613]: DEBUG nova.virt.hardware [None req-118d2bf7-f410-45d0-90d1-0db109692905 tempest-ServerRescueNegativeTestJSON-1891426908 tempest-ServerRescueNegativeTestJSON-1891426908-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74613) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 29 18:15:01 user nova-compute[74613]: DEBUG nova.virt.hardware [None req-118d2bf7-f410-45d0-90d1-0db109692905 tempest-ServerRescueNegativeTestJSON-1891426908 tempest-ServerRescueNegativeTestJSON-1891426908-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74613) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 29 18:15:01 user nova-compute[74613]: DEBUG nova.objects.instance [None req-118d2bf7-f410-45d0-90d1-0db109692905 tempest-ServerRescueNegativeTestJSON-1891426908 tempest-ServerRescueNegativeTestJSON-1891426908-project-member] Lazy-loading 'vcpu_model' on Instance uuid 1f2b4426-815f-4ef4-b98e-e5124fec93b7 {{(pid=74613) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 18:15:01 user nova-compute[74613]: DEBUG nova.objects.base [None req-118d2bf7-f410-45d0-90d1-0db109692905 tempest-ServerRescueNegativeTestJSON-1891426908 tempest-ServerRescueNegativeTestJSON-1891426908-project-member] Object Instance<1f2b4426-815f-4ef4-b98e-e5124fec93b7> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model {{(pid=74613) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 29 18:15:01 user nova-compute[74613]: DEBUG nova.virt.libvirt.vif [None req-118d2bf7-f410-45d0-90d1-0db109692905 tempest-ServerRescueNegativeTestJSON-1891426908 tempest-ServerRescueNegativeTestJSON-1891426908-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T18:12:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1726006672',display_name='tempest-ServerRescueNegativeTestJSON-server-1726006672',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1726006672',id=37,image_ref='4217f428-8d9d-4ee1-9614-642d26d90c46',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMgPoXgDUW7nk75D69xzLfcbvWDEVu3o5D9tsIFqy77Ta+ar2r8agObqLmmaHBpRVe2srT806cnX5IaVx4iIVSCtnRfzPCKkokoW4ZMSXWu1sEMn3RQK+XuNeGnG5ClNRw==',key_name='tempest-keypair-716087799',keypairs=<?>,launch_index=0,launched_at=2023-11-29T18:13:03Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='e6a3eb6ea0294f9da705dca72ec2789a',ramdisk_id='',reservation_id='r-sx0019fy',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='4217f428-8d9d-4ee1-9614-642d26d90c46',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-1891426908',owner_user_name='tempest-ServerRescueNegativeTestJSON-1891426908-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T18:13:03Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4e984d45838e441680b9948c213728fb',uuid=1f2b4426-815f-4ef4-b98e-e5124fec93b7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "e89209f3-5532-4ff8-95c7-fb7a3334846a", "address": "fa:16:3e:98:a3:61", "network": {"id": "db79433c-b21c-4058-b98c-f62822abbf7a", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1715530752-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.251", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerRescueNegativeTestJSON-1715530752-network", "vif_mac": "fa:16:3e:98:a3:61"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e6a3eb6ea0294f9da705dca72ec2789a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape89209f3-55", "ovs_interfaceid": "e89209f3-5532-4ff8-95c7-fb7a3334846a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74613) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 29 18:15:01 user nova-compute[74613]: DEBUG nova.network.os_vif_util [None req-118d2bf7-f410-45d0-90d1-0db109692905 tempest-ServerRescueNegativeTestJSON-1891426908 tempest-ServerRescueNegativeTestJSON-1891426908-project-member] Converting VIF {"id": "e89209f3-5532-4ff8-95c7-fb7a3334846a", "address": "fa:16:3e:98:a3:61", "network": {"id": "db79433c-b21c-4058-b98c-f62822abbf7a", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1715530752-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.251", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerRescueNegativeTestJSON-1715530752-network", "vif_mac": "fa:16:3e:98:a3:61"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e6a3eb6ea0294f9da705dca72ec2789a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape89209f3-55", "ovs_interfaceid": "e89209f3-5532-4ff8-95c7-fb7a3334846a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74613) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 18:15:01 user nova-compute[74613]: DEBUG nova.network.os_vif_util [None req-118d2bf7-f410-45d0-90d1-0db109692905 tempest-ServerRescueNegativeTestJSON-1891426908 tempest-ServerRescueNegativeTestJSON-1891426908-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:98:a3:61,bridge_name='br-int',has_traffic_filtering=True,id=e89209f3-5532-4ff8-95c7-fb7a3334846a,network=Network(db79433c-b21c-4058-b98c-f62822abbf7a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape89209f3-55') {{(pid=74613) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 18:15:01 user nova-compute[74613]: DEBUG nova.objects.instance [None req-118d2bf7-f410-45d0-90d1-0db109692905 tempest-ServerRescueNegativeTestJSON-1891426908 tempest-ServerRescueNegativeTestJSON-1891426908-project-member] Lazy-loading 'pci_devices' on Instance uuid 1f2b4426-815f-4ef4-b98e-e5124fec93b7 {{(pid=74613) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 18:15:01 user nova-compute[74613]: DEBUG nova.objects.base [None req-118d2bf7-f410-45d0-90d1-0db109692905 tempest-ServerRescueNegativeTestJSON-1891426908 tempest-ServerRescueNegativeTestJSON-1891426908-project-member] Object Instance<1f2b4426-815f-4ef4-b98e-e5124fec93b7> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model,pci_devices {{(pid=74613) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 29 18:15:01 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-118d2bf7-f410-45d0-90d1-0db109692905 tempest-ServerRescueNegativeTestJSON-1891426908 tempest-ServerRescueNegativeTestJSON-1891426908-project-member] [instance: 1f2b4426-815f-4ef4-b98e-e5124fec93b7] End _get_guest_xml xml=<domain type="kvm">
Nov 29 18:15:01 user nova-compute[74613]:   <uuid>1f2b4426-815f-4ef4-b98e-e5124fec93b7</uuid>
Nov 29 18:15:01 user nova-compute[74613]:   <name>instance-00000025</name>
Nov 29 18:15:01 user nova-compute[74613]:   <memory>524288</memory>
Nov 29 18:15:01 user nova-compute[74613]:   <vcpu>1</vcpu>
Nov 29 18:15:01 user nova-compute[74613]:   <metadata>
Nov 29 18:15:01 user nova-compute[74613]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 29 18:15:01 user nova-compute[74613]:       <nova:package version="0.0.0"/>
Nov 29 18:15:01 user nova-compute[74613]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-1726006672</nova:name>
Nov 29 18:15:01 user nova-compute[74613]:       <nova:creationTime>2023-11-29 18:15:01</nova:creationTime>
Nov 29 18:15:01 user nova-compute[74613]:       <nova:flavor name="m1.tiny">
Nov 29 18:15:01 user nova-compute[74613]:         <nova:memory>512</nova:memory>
Nov 29 18:15:01 user nova-compute[74613]:         <nova:disk>1</nova:disk>
Nov 29 18:15:01 user nova-compute[74613]:         <nova:swap>0</nova:swap>
Nov 29 18:15:01 user nova-compute[74613]:         <nova:ephemeral>0</nova:ephemeral>
Nov 29 18:15:01 user nova-compute[74613]:         <nova:vcpus>1</nova:vcpus>
Nov 29 18:15:01 user nova-compute[74613]:       </nova:flavor>
Nov 29 18:15:01 user nova-compute[74613]:       <nova:owner>
Nov 29 18:15:01 user nova-compute[74613]:         <nova:user uuid="4e984d45838e441680b9948c213728fb">tempest-ServerRescueNegativeTestJSON-1891426908-project-member</nova:user>
Nov 29 18:15:01 user nova-compute[74613]:         <nova:project uuid="e6a3eb6ea0294f9da705dca72ec2789a">tempest-ServerRescueNegativeTestJSON-1891426908</nova:project>
Nov 29 18:15:01 user nova-compute[74613]:       </nova:owner>
Nov 29 18:15:01 user nova-compute[74613]:       <nova:root type="image" uuid="4217f428-8d9d-4ee1-9614-642d26d90c46"/>
Nov 29 18:15:01 user nova-compute[74613]:       <nova:ports>
Nov 29 18:15:01 user nova-compute[74613]:         <nova:port uuid="e89209f3-5532-4ff8-95c7-fb7a3334846a">
Nov 29 18:15:01 user nova-compute[74613]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Nov 29 18:15:01 user nova-compute[74613]:         </nova:port>
Nov 29 18:15:01 user nova-compute[74613]:       </nova:ports>
Nov 29 18:15:01 user nova-compute[74613]:     </nova:instance>
Nov 29 18:15:01 user nova-compute[74613]:   </metadata>
Nov 29 18:15:01 user nova-compute[74613]:   <sysinfo type="smbios">
Nov 29 18:15:01 user nova-compute[74613]:     <system>
Nov 29 18:15:01 user nova-compute[74613]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 29 18:15:01 user nova-compute[74613]:       <entry name="product">OpenStack Nova</entry>
Nov 29 18:15:01 user nova-compute[74613]:       <entry name="version">0.0.0</entry>
Nov 29 18:15:01 user nova-compute[74613]:       <entry name="serial">1f2b4426-815f-4ef4-b98e-e5124fec93b7</entry>
Nov 29 18:15:01 user nova-compute[74613]:       <entry name="uuid">1f2b4426-815f-4ef4-b98e-e5124fec93b7</entry>
Nov 29 18:15:01 user nova-compute[74613]:       <entry name="family">Virtual Machine</entry>
Nov 29 18:15:01 user nova-compute[74613]:     </system>
Nov 29 18:15:01 user nova-compute[74613]:   </sysinfo>
Nov 29 18:15:01 user nova-compute[74613]:   <os>
Nov 29 18:15:01 user nova-compute[74613]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 29 18:15:01 user nova-compute[74613]:     <smbios mode="sysinfo"/>
Nov 29 18:15:01 user nova-compute[74613]:   </os>
Nov 29 18:15:01 user nova-compute[74613]:   <features>
Nov 29 18:15:01 user nova-compute[74613]:     <acpi/>
Nov 29 18:15:01 user nova-compute[74613]:     <apic/>
Nov 29 18:15:01 user nova-compute[74613]:     <vmcoreinfo/>
Nov 29 18:15:01 user nova-compute[74613]:   </features>
Nov 29 18:15:01 user nova-compute[74613]:   <clock offset="utc">
Nov 29 18:15:01 user nova-compute[74613]:     <timer name="pit" tickpolicy="delay"/>
Nov 29 18:15:01 user nova-compute[74613]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 29 18:15:01 user nova-compute[74613]:     <timer name="hpet" present="no"/>
Nov 29 18:15:01 user nova-compute[74613]:   </clock>
Nov 29 18:15:01 user nova-compute[74613]:   <cpu mode="custom" match="exact">
Nov 29 18:15:01 user nova-compute[74613]:     <model>Nehalem</model>
Nov 29 18:15:01 user nova-compute[74613]:     <topology sockets="1" cores="1" threads="1"/>
Nov 29 18:15:01 user nova-compute[74613]:   </cpu>
Nov 29 18:15:01 user nova-compute[74613]:   <devices>
Nov 29 18:15:01 user nova-compute[74613]:     <disk type="file" device="disk">
Nov 29 18:15:01 user nova-compute[74613]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 29 18:15:01 user nova-compute[74613]:       <source file="/opt/stack/data/nova/instances/1f2b4426-815f-4ef4-b98e-e5124fec93b7/disk.rescue"/>
Nov 29 18:15:01 user nova-compute[74613]:       <target dev="vda" bus="virtio"/>
Nov 29 18:15:01 user nova-compute[74613]:     </disk>
Nov 29 18:15:01 user nova-compute[74613]:     <disk type="file" device="disk">
Nov 29 18:15:01 user nova-compute[74613]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 29 18:15:01 user nova-compute[74613]:       <source file="/opt/stack/data/nova/instances/1f2b4426-815f-4ef4-b98e-e5124fec93b7/disk"/>
Nov 29 18:15:01 user nova-compute[74613]:       <target dev="vdb" bus="virtio"/>
Nov 29 18:15:01 user nova-compute[74613]:     </disk>
Nov 29 18:15:01 user nova-compute[74613]:     <interface type="ethernet">
Nov 29 18:15:01 user nova-compute[74613]:       <mac address="fa:16:3e:98:a3:61"/>
Nov 29 18:15:01 user nova-compute[74613]:       <model type="virtio"/>
Nov 29 18:15:01 user nova-compute[74613]:       <mtu size="1442"/>
Nov 29 18:15:01 user nova-compute[74613]:       <target dev="tape89209f3-55"/>
Nov 29 18:15:01 user nova-compute[74613]:     </interface>
Nov 29 18:15:01 user nova-compute[74613]:     <serial type="pty">
Nov 29 18:15:01 user nova-compute[74613]:       <log file="/opt/stack/data/nova/instances/1f2b4426-815f-4ef4-b98e-e5124fec93b7/console.log" append="off"/>
Nov 29 18:15:01 user nova-compute[74613]:     </serial>
Nov 29 18:15:01 user nova-compute[74613]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 29 18:15:01 user nova-compute[74613]:     <video>
Nov 29 18:15:01 user nova-compute[74613]:       <model type="virtio"/>
Nov 29 18:15:01 user nova-compute[74613]:     </video>
Nov 29 18:15:01 user nova-compute[74613]:     <rng model="virtio">
Nov 29 18:15:01 user nova-compute[74613]:       <backend model="random">/dev/urandom</backend>
Nov 29 18:15:01 user nova-compute[74613]:     </rng>
Nov 29 18:15:01 user nova-compute[74613]:     <controller type="usb" index="0" model="none"/>
Nov 29 18:15:01 user nova-compute[74613]:     <memballoon model="virtio">
Nov 29 18:15:01 user nova-compute[74613]:       <stats period="10"/>
Nov 29 18:15:01 user nova-compute[74613]:     </memballoon>
Nov 29 18:15:01 user nova-compute[74613]:   </devices>
Nov 29 18:15:01 user nova-compute[74613]: </domain>
Nov 29 18:15:01 user nova-compute[74613]:  {{(pid=74613) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 29 18:15:01 user nova-compute[74613]: INFO nova.virt.libvirt.driver [-] [instance: 1f2b4426-815f-4ef4-b98e-e5124fec93b7] Instance destroyed successfully.
Nov 29 18:15:01 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-118d2bf7-f410-45d0-90d1-0db109692905 tempest-ServerRescueNegativeTestJSON-1891426908 tempest-ServerRescueNegativeTestJSON-1891426908-project-member] No BDM found with device name vda, not building metadata. {{(pid=74613) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 18:15:01 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-118d2bf7-f410-45d0-90d1-0db109692905 tempest-ServerRescueNegativeTestJSON-1891426908 tempest-ServerRescueNegativeTestJSON-1891426908-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74613) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 18:15:01 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-118d2bf7-f410-45d0-90d1-0db109692905 tempest-ServerRescueNegativeTestJSON-1891426908 tempest-ServerRescueNegativeTestJSON-1891426908-project-member] No VIF found with MAC fa:16:3e:98:a3:61, not building metadata {{(pid=74613) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 29 18:15:02 user nova-compute[74613]: DEBUG nova.compute.manager [req-3d232a32-1a07-423b-93ce-c3dd8cfd42bf req-d07a6266-8603-4520-9d84-3538a825ab1e service nova] [instance: 1f2b4426-815f-4ef4-b98e-e5124fec93b7] Received event network-vif-plugged-e89209f3-5532-4ff8-95c7-fb7a3334846a {{(pid=74613) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 18:15:02 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-3d232a32-1a07-423b-93ce-c3dd8cfd42bf req-d07a6266-8603-4520-9d84-3538a825ab1e service nova] Acquiring lock "1f2b4426-815f-4ef4-b98e-e5124fec93b7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 18:15:02 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-3d232a32-1a07-423b-93ce-c3dd8cfd42bf req-d07a6266-8603-4520-9d84-3538a825ab1e service nova] Lock "1f2b4426-815f-4ef4-b98e-e5124fec93b7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 18:15:02 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-3d232a32-1a07-423b-93ce-c3dd8cfd42bf req-d07a6266-8603-4520-9d84-3538a825ab1e service nova] Lock "1f2b4426-815f-4ef4-b98e-e5124fec93b7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 18:15:02 user nova-compute[74613]: DEBUG nova.compute.manager [req-3d232a32-1a07-423b-93ce-c3dd8cfd42bf req-d07a6266-8603-4520-9d84-3538a825ab1e service nova] [instance: 1f2b4426-815f-4ef4-b98e-e5124fec93b7] No waiting events found dispatching network-vif-plugged-e89209f3-5532-4ff8-95c7-fb7a3334846a {{(pid=74613) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 18:15:02 user nova-compute[74613]: WARNING nova.compute.manager [req-3d232a32-1a07-423b-93ce-c3dd8cfd42bf req-d07a6266-8603-4520-9d84-3538a825ab1e service nova] [instance: 1f2b4426-815f-4ef4-b98e-e5124fec93b7] Received unexpected event network-vif-plugged-e89209f3-5532-4ff8-95c7-fb7a3334846a for instance with vm_state active and task_state rescuing.
Nov 29 18:15:03 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:15:03 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:15:03 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:15:03 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:15:03 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:15:03 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:15:04 user nova-compute[74613]: DEBUG nova.compute.manager [req-e5340531-8d94-4391-82fc-2073183a5749 req-d8ca5eb1-d168-43e5-bef0-59e5f119bc94 service nova] [instance: 1f2b4426-815f-4ef4-b98e-e5124fec93b7] Received event network-vif-plugged-e89209f3-5532-4ff8-95c7-fb7a3334846a {{(pid=74613) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 18:15:04 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-e5340531-8d94-4391-82fc-2073183a5749 req-d8ca5eb1-d168-43e5-bef0-59e5f119bc94 service nova] Acquiring lock "1f2b4426-815f-4ef4-b98e-e5124fec93b7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 18:15:04 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-e5340531-8d94-4391-82fc-2073183a5749 req-d8ca5eb1-d168-43e5-bef0-59e5f119bc94 service nova] Lock "1f2b4426-815f-4ef4-b98e-e5124fec93b7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 18:15:04 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-e5340531-8d94-4391-82fc-2073183a5749 req-d8ca5eb1-d168-43e5-bef0-59e5f119bc94 service nova] Lock "1f2b4426-815f-4ef4-b98e-e5124fec93b7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 18:15:04 user nova-compute[74613]: DEBUG nova.compute.manager [req-e5340531-8d94-4391-82fc-2073183a5749 req-d8ca5eb1-d168-43e5-bef0-59e5f119bc94 service nova] [instance: 1f2b4426-815f-4ef4-b98e-e5124fec93b7] No waiting events found dispatching network-vif-plugged-e89209f3-5532-4ff8-95c7-fb7a3334846a {{(pid=74613) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 18:15:04 user nova-compute[74613]: WARNING nova.compute.manager [req-e5340531-8d94-4391-82fc-2073183a5749 req-d8ca5eb1-d168-43e5-bef0-59e5f119bc94 service nova] [instance: 1f2b4426-815f-4ef4-b98e-e5124fec93b7] Received unexpected event network-vif-plugged-e89209f3-5532-4ff8-95c7-fb7a3334846a for instance with vm_state active and task_state rescuing.
Nov 29 18:15:04 user nova-compute[74613]: DEBUG nova.compute.manager [req-e5340531-8d94-4391-82fc-2073183a5749 req-d8ca5eb1-d168-43e5-bef0-59e5f119bc94 service nova] [instance: 1f2b4426-815f-4ef4-b98e-e5124fec93b7] Received event network-vif-plugged-e89209f3-5532-4ff8-95c7-fb7a3334846a {{(pid=74613) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 18:15:04 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-e5340531-8d94-4391-82fc-2073183a5749 req-d8ca5eb1-d168-43e5-bef0-59e5f119bc94 service nova] Acquiring lock "1f2b4426-815f-4ef4-b98e-e5124fec93b7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 18:15:04 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-e5340531-8d94-4391-82fc-2073183a5749 req-d8ca5eb1-d168-43e5-bef0-59e5f119bc94 service nova] Lock "1f2b4426-815f-4ef4-b98e-e5124fec93b7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 18:15:04 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-e5340531-8d94-4391-82fc-2073183a5749 req-d8ca5eb1-d168-43e5-bef0-59e5f119bc94 service nova] Lock "1f2b4426-815f-4ef4-b98e-e5124fec93b7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 18:15:04 user nova-compute[74613]: DEBUG nova.compute.manager [req-e5340531-8d94-4391-82fc-2073183a5749 req-d8ca5eb1-d168-43e5-bef0-59e5f119bc94 service nova] [instance: 1f2b4426-815f-4ef4-b98e-e5124fec93b7] No waiting events found dispatching network-vif-plugged-e89209f3-5532-4ff8-95c7-fb7a3334846a {{(pid=74613) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 18:15:04 user nova-compute[74613]: WARNING nova.compute.manager [req-e5340531-8d94-4391-82fc-2073183a5749 req-d8ca5eb1-d168-43e5-bef0-59e5f119bc94 service nova] [instance: 1f2b4426-815f-4ef4-b98e-e5124fec93b7] Received unexpected event network-vif-plugged-e89209f3-5532-4ff8-95c7-fb7a3334846a for instance with vm_state active and task_state rescuing.
Nov 29 18:15:05 user nova-compute[74613]: DEBUG nova.compute.manager [None req-118d2bf7-f410-45d0-90d1-0db109692905 tempest-ServerRescueNegativeTestJSON-1891426908 tempest-ServerRescueNegativeTestJSON-1891426908-project-member] [instance: 1f2b4426-815f-4ef4-b98e-e5124fec93b7] Checking state {{(pid=74613) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 29 18:15:06 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:15:06 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:15:11 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:15:11 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:15:15 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-1c157b9a-29c2-4db0-95a8-f892966ad1a9 tempest-AttachVolumeNegativeTest-483083654 tempest-AttachVolumeNegativeTest-483083654-project-member] Acquiring lock "fa144332-bad7-4373-94d9-018f41f50ee4" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 18:15:15 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-1c157b9a-29c2-4db0-95a8-f892966ad1a9 tempest-AttachVolumeNegativeTest-483083654 tempest-AttachVolumeNegativeTest-483083654-project-member] Lock "fa144332-bad7-4373-94d9-018f41f50ee4" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 18:15:15 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-1c157b9a-29c2-4db0-95a8-f892966ad1a9 tempest-AttachVolumeNegativeTest-483083654 tempest-AttachVolumeNegativeTest-483083654-project-member] Acquiring lock "fa144332-bad7-4373-94d9-018f41f50ee4-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 18:15:15 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-1c157b9a-29c2-4db0-95a8-f892966ad1a9 tempest-AttachVolumeNegativeTest-483083654 tempest-AttachVolumeNegativeTest-483083654-project-member] Lock "fa144332-bad7-4373-94d9-018f41f50ee4-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 18:15:15 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-1c157b9a-29c2-4db0-95a8-f892966ad1a9 tempest-AttachVolumeNegativeTest-483083654 tempest-AttachVolumeNegativeTest-483083654-project-member] Lock "fa144332-bad7-4373-94d9-018f41f50ee4-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 18:15:15 user nova-compute[74613]: INFO nova.compute.manager [None req-1c157b9a-29c2-4db0-95a8-f892966ad1a9 tempest-AttachVolumeNegativeTest-483083654 tempest-AttachVolumeNegativeTest-483083654-project-member] [instance: fa144332-bad7-4373-94d9-018f41f50ee4] Terminating instance
Nov 29 18:15:15 user nova-compute[74613]: DEBUG nova.compute.manager [None req-1c157b9a-29c2-4db0-95a8-f892966ad1a9 tempest-AttachVolumeNegativeTest-483083654 tempest-AttachVolumeNegativeTest-483083654-project-member] [instance: fa144332-bad7-4373-94d9-018f41f50ee4] Start destroying the instance on the hypervisor. {{(pid=74613) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 29 18:15:15 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:15:15 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:15:15 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:15:15 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:15:15 user nova-compute[74613]: DEBUG nova.compute.manager [req-7f6f7451-08dd-4ef5-84d6-b69d83004732 req-525d3e81-ffac-4564-848a-bf90c4c58d1a service nova] [instance: fa144332-bad7-4373-94d9-018f41f50ee4] Received event network-vif-unplugged-d2cb059e-f41b-41a5-b4a5-aef2d663eeb2 {{(pid=74613) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 18:15:15 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-7f6f7451-08dd-4ef5-84d6-b69d83004732 req-525d3e81-ffac-4564-848a-bf90c4c58d1a service nova] Acquiring lock "fa144332-bad7-4373-94d9-018f41f50ee4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 18:15:15 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-7f6f7451-08dd-4ef5-84d6-b69d83004732 req-525d3e81-ffac-4564-848a-bf90c4c58d1a service nova] Lock "fa144332-bad7-4373-94d9-018f41f50ee4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 18:15:15 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-7f6f7451-08dd-4ef5-84d6-b69d83004732 req-525d3e81-ffac-4564-848a-bf90c4c58d1a service nova] Lock "fa144332-bad7-4373-94d9-018f41f50ee4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 18:15:15 user nova-compute[74613]: DEBUG nova.compute.manager [req-7f6f7451-08dd-4ef5-84d6-b69d83004732 req-525d3e81-ffac-4564-848a-bf90c4c58d1a service nova] [instance: fa144332-bad7-4373-94d9-018f41f50ee4] No waiting events found dispatching network-vif-unplugged-d2cb059e-f41b-41a5-b4a5-aef2d663eeb2 {{(pid=74613) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 18:15:15 user nova-compute[74613]: DEBUG nova.compute.manager [req-7f6f7451-08dd-4ef5-84d6-b69d83004732 req-525d3e81-ffac-4564-848a-bf90c4c58d1a service nova] [instance: fa144332-bad7-4373-94d9-018f41f50ee4] Received event network-vif-unplugged-d2cb059e-f41b-41a5-b4a5-aef2d663eeb2 for instance with task_state deleting. {{(pid=74613) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 29 18:15:16 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:15:16 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:15:16 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:15:16 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:15:16 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:15:16 user nova-compute[74613]: INFO nova.virt.libvirt.driver [-] [instance: fa144332-bad7-4373-94d9-018f41f50ee4] Instance destroyed successfully.
Nov 29 18:15:16 user nova-compute[74613]: DEBUG nova.objects.instance [None req-1c157b9a-29c2-4db0-95a8-f892966ad1a9 tempest-AttachVolumeNegativeTest-483083654 tempest-AttachVolumeNegativeTest-483083654-project-member] Lazy-loading 'resources' on Instance uuid fa144332-bad7-4373-94d9-018f41f50ee4 {{(pid=74613) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 18:15:16 user nova-compute[74613]: DEBUG nova.virt.libvirt.vif [None req-1c157b9a-29c2-4db0-95a8-f892966ad1a9 tempest-AttachVolumeNegativeTest-483083654 tempest-AttachVolumeNegativeTest-483083654-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T18:12:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-410376697',display_name='tempest-AttachVolumeNegativeTest-server-410376697',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-410376697',id=36,image_ref='4217f428-8d9d-4ee1-9614-642d26d90c46',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBH2f5iCFa3W9SeqcZ+bT2Iw3FxywKrKvZxDegdHcmyUY1YMiAAKE8PJ+M7qDvpk5KlzOJjvchmP5p27/jrd9Zah6ar7CkTxzMJXdnzg6pTs0XOzB0OIi4fjJk5Uy+JU3FQ==',key_name='tempest-keypair-1923808935',keypairs=<?>,launch_index=0,launched_at=2023-11-29T18:12:26Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='37b89c13ba1d4a94805d6af69ad26fb8',ramdisk_id='',reservation_id='r-hg1b7qhh',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='4217f428-8d9d-4ee1-9614-642d26d90c46',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-483083654',owner_user_name='tempest-AttachVolumeNegativeTest-483083654-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-29T18:12:26Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='57b1f3743f0e4cbdae1dab9e4761511e',uuid=fa144332-bad7-4373-94d9-018f41f50ee4,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "d2cb059e-f41b-41a5-b4a5-aef2d663eeb2", "address": "fa:16:3e:bc:1d:c9", "network": {"id": "c317481b-f8cf-40a0-a326-836a5ea4c495", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-887666255-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.179", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "37b89c13ba1d4a94805d6af69ad26fb8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd2cb059e-f4", "ovs_interfaceid": "d2cb059e-f41b-41a5-b4a5-aef2d663eeb2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74613) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 29 18:15:16 user nova-compute[74613]: DEBUG nova.network.os_vif_util [None req-1c157b9a-29c2-4db0-95a8-f892966ad1a9 tempest-AttachVolumeNegativeTest-483083654 tempest-AttachVolumeNegativeTest-483083654-project-member] Converting VIF {"id": "d2cb059e-f41b-41a5-b4a5-aef2d663eeb2", "address": "fa:16:3e:bc:1d:c9", "network": {"id": "c317481b-f8cf-40a0-a326-836a5ea4c495", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-887666255-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.179", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "37b89c13ba1d4a94805d6af69ad26fb8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd2cb059e-f4", "ovs_interfaceid": "d2cb059e-f41b-41a5-b4a5-aef2d663eeb2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74613) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 18:15:16 user nova-compute[74613]: DEBUG nova.network.os_vif_util [None req-1c157b9a-29c2-4db0-95a8-f892966ad1a9 tempest-AttachVolumeNegativeTest-483083654 tempest-AttachVolumeNegativeTest-483083654-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:bc:1d:c9,bridge_name='br-int',has_traffic_filtering=True,id=d2cb059e-f41b-41a5-b4a5-aef2d663eeb2,network=Network(c317481b-f8cf-40a0-a326-836a5ea4c495),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd2cb059e-f4') {{(pid=74613) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 18:15:16 user nova-compute[74613]: DEBUG os_vif [None req-1c157b9a-29c2-4db0-95a8-f892966ad1a9 tempest-AttachVolumeNegativeTest-483083654 tempest-AttachVolumeNegativeTest-483083654-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:bc:1d:c9,bridge_name='br-int',has_traffic_filtering=True,id=d2cb059e-f41b-41a5-b4a5-aef2d663eeb2,network=Network(c317481b-f8cf-40a0-a326-836a5ea4c495),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd2cb059e-f4') {{(pid=74613) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 29 18:15:16 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:15:16 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapd2cb059e-f4, bridge=br-int, if_exists=True) {{(pid=74613) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 18:15:16 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:15:16 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 18:15:16 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:15:16 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:15:16 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=9397c604-3241-4bff-be58-5b3bd2a853b1) {{(pid=74613) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 18:15:16 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:15:16 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:15:16 user nova-compute[74613]: INFO os_vif [None req-1c157b9a-29c2-4db0-95a8-f892966ad1a9 tempest-AttachVolumeNegativeTest-483083654 tempest-AttachVolumeNegativeTest-483083654-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:bc:1d:c9,bridge_name='br-int',has_traffic_filtering=True,id=d2cb059e-f41b-41a5-b4a5-aef2d663eeb2,network=Network(c317481b-f8cf-40a0-a326-836a5ea4c495),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd2cb059e-f4')
Nov 29 18:15:16 user nova-compute[74613]: INFO nova.virt.libvirt.driver [None req-1c157b9a-29c2-4db0-95a8-f892966ad1a9 tempest-AttachVolumeNegativeTest-483083654 tempest-AttachVolumeNegativeTest-483083654-project-member] [instance: fa144332-bad7-4373-94d9-018f41f50ee4] Deleting instance files /opt/stack/data/nova/instances/fa144332-bad7-4373-94d9-018f41f50ee4_del
Nov 29 18:15:16 user nova-compute[74613]: INFO nova.virt.libvirt.driver [None req-1c157b9a-29c2-4db0-95a8-f892966ad1a9 tempest-AttachVolumeNegativeTest-483083654 tempest-AttachVolumeNegativeTest-483083654-project-member] [instance: fa144332-bad7-4373-94d9-018f41f50ee4] Deletion of /opt/stack/data/nova/instances/fa144332-bad7-4373-94d9-018f41f50ee4_del complete
Nov 29 18:15:16 user nova-compute[74613]: INFO nova.compute.manager [None req-1c157b9a-29c2-4db0-95a8-f892966ad1a9 tempest-AttachVolumeNegativeTest-483083654 tempest-AttachVolumeNegativeTest-483083654-project-member] [instance: fa144332-bad7-4373-94d9-018f41f50ee4] Took 0.88 seconds to destroy the instance on the hypervisor.
Nov 29 18:15:16 user nova-compute[74613]: DEBUG oslo.service.loopingcall [None req-1c157b9a-29c2-4db0-95a8-f892966ad1a9 tempest-AttachVolumeNegativeTest-483083654 tempest-AttachVolumeNegativeTest-483083654-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74613) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 29 18:15:16 user nova-compute[74613]: DEBUG nova.compute.manager [-] [instance: fa144332-bad7-4373-94d9-018f41f50ee4] Deallocating network for instance {{(pid=74613) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 29 18:15:16 user nova-compute[74613]: DEBUG nova.network.neutron [-] [instance: fa144332-bad7-4373-94d9-018f41f50ee4] deallocate_for_instance() {{(pid=74613) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 29 18:15:16 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:15:16 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:15:16 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:15:16 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:15:17 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:15:17 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:15:17 user nova-compute[74613]: DEBUG nova.network.neutron [-] [instance: fa144332-bad7-4373-94d9-018f41f50ee4] Updating instance_info_cache with network_info: [] {{(pid=74613) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 18:15:17 user nova-compute[74613]: INFO nova.compute.manager [-] [instance: fa144332-bad7-4373-94d9-018f41f50ee4] Took 0.82 seconds to deallocate network for instance.
Nov 29 18:15:17 user nova-compute[74613]: DEBUG nova.compute.manager [req-6ef9a8de-389d-4173-813f-ee0befdf6d67 req-623068e6-4cd9-4919-9242-817d7bda99d4 service nova] [instance: fa144332-bad7-4373-94d9-018f41f50ee4] Received event network-vif-deleted-d2cb059e-f41b-41a5-b4a5-aef2d663eeb2 {{(pid=74613) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 18:15:17 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-1c157b9a-29c2-4db0-95a8-f892966ad1a9 tempest-AttachVolumeNegativeTest-483083654 tempest-AttachVolumeNegativeTest-483083654-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 18:15:17 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-1c157b9a-29c2-4db0-95a8-f892966ad1a9 tempest-AttachVolumeNegativeTest-483083654 tempest-AttachVolumeNegativeTest-483083654-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 18:15:17 user nova-compute[74613]: DEBUG nova.compute.provider_tree [None req-1c157b9a-29c2-4db0-95a8-f892966ad1a9 tempest-AttachVolumeNegativeTest-483083654 tempest-AttachVolumeNegativeTest-483083654-project-member] Inventory has not changed in ProviderTree for provider: 639d980e-3b12-44b1-b8f4-1812416fa4dd {{(pid=74613) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 18:15:17 user nova-compute[74613]: DEBUG nova.scheduler.client.report [None req-1c157b9a-29c2-4db0-95a8-f892966ad1a9 tempest-AttachVolumeNegativeTest-483083654 tempest-AttachVolumeNegativeTest-483083654-project-member] Inventory has not changed for provider 639d980e-3b12-44b1-b8f4-1812416fa4dd based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74613) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 18:15:17 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-1c157b9a-29c2-4db0-95a8-f892966ad1a9 tempest-AttachVolumeNegativeTest-483083654 tempest-AttachVolumeNegativeTest-483083654-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.310s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 18:15:17 user nova-compute[74613]: INFO nova.scheduler.client.report [None req-1c157b9a-29c2-4db0-95a8-f892966ad1a9 tempest-AttachVolumeNegativeTest-483083654 tempest-AttachVolumeNegativeTest-483083654-project-member] Deleted allocations for instance fa144332-bad7-4373-94d9-018f41f50ee4
Nov 29 18:15:17 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-1c157b9a-29c2-4db0-95a8-f892966ad1a9 tempest-AttachVolumeNegativeTest-483083654 tempest-AttachVolumeNegativeTest-483083654-project-member] Lock "fa144332-bad7-4373-94d9-018f41f50ee4" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.221s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 18:15:17 user nova-compute[74613]: DEBUG nova.compute.manager [req-724a5af3-8961-47ee-ac0a-7d1014047509 req-4ce760de-ea0f-4a29-b53f-660051305aee service nova] [instance: fa144332-bad7-4373-94d9-018f41f50ee4] Received event network-vif-plugged-d2cb059e-f41b-41a5-b4a5-aef2d663eeb2 {{(pid=74613) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 18:15:17 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-724a5af3-8961-47ee-ac0a-7d1014047509 req-4ce760de-ea0f-4a29-b53f-660051305aee service nova] Acquiring lock "fa144332-bad7-4373-94d9-018f41f50ee4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 18:15:17 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-724a5af3-8961-47ee-ac0a-7d1014047509 req-4ce760de-ea0f-4a29-b53f-660051305aee service nova] Lock "fa144332-bad7-4373-94d9-018f41f50ee4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 18:15:17 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-724a5af3-8961-47ee-ac0a-7d1014047509 req-4ce760de-ea0f-4a29-b53f-660051305aee service nova] Lock "fa144332-bad7-4373-94d9-018f41f50ee4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 18:15:17 user nova-compute[74613]: DEBUG nova.compute.manager [req-724a5af3-8961-47ee-ac0a-7d1014047509 req-4ce760de-ea0f-4a29-b53f-660051305aee service nova] [instance: fa144332-bad7-4373-94d9-018f41f50ee4] No waiting events found dispatching network-vif-plugged-d2cb059e-f41b-41a5-b4a5-aef2d663eeb2 {{(pid=74613) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 18:15:17 user nova-compute[74613]: WARNING nova.compute.manager [req-724a5af3-8961-47ee-ac0a-7d1014047509 req-4ce760de-ea0f-4a29-b53f-660051305aee service nova] [instance: fa144332-bad7-4373-94d9-018f41f50ee4] Received unexpected event network-vif-plugged-d2cb059e-f41b-41a5-b4a5-aef2d663eeb2 for instance with vm_state deleted and task_state None.
Nov 29 18:15:17 user nova-compute[74613]: DEBUG nova.compute.manager [req-724a5af3-8961-47ee-ac0a-7d1014047509 req-4ce760de-ea0f-4a29-b53f-660051305aee service nova] [instance: fa144332-bad7-4373-94d9-018f41f50ee4] Received event network-vif-plugged-d2cb059e-f41b-41a5-b4a5-aef2d663eeb2 {{(pid=74613) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 18:15:17 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-724a5af3-8961-47ee-ac0a-7d1014047509 req-4ce760de-ea0f-4a29-b53f-660051305aee service nova] Acquiring lock "fa144332-bad7-4373-94d9-018f41f50ee4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 18:15:17 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-724a5af3-8961-47ee-ac0a-7d1014047509 req-4ce760de-ea0f-4a29-b53f-660051305aee service nova] Lock "fa144332-bad7-4373-94d9-018f41f50ee4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 18:15:17 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-724a5af3-8961-47ee-ac0a-7d1014047509 req-4ce760de-ea0f-4a29-b53f-660051305aee service nova] Lock "fa144332-bad7-4373-94d9-018f41f50ee4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 18:15:17 user nova-compute[74613]: DEBUG nova.compute.manager [req-724a5af3-8961-47ee-ac0a-7d1014047509 req-4ce760de-ea0f-4a29-b53f-660051305aee service nova] [instance: fa144332-bad7-4373-94d9-018f41f50ee4] No waiting events found dispatching network-vif-plugged-d2cb059e-f41b-41a5-b4a5-aef2d663eeb2 {{(pid=74613) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 18:15:17 user nova-compute[74613]: WARNING nova.compute.manager [req-724a5af3-8961-47ee-ac0a-7d1014047509 req-4ce760de-ea0f-4a29-b53f-660051305aee service nova] [instance: fa144332-bad7-4373-94d9-018f41f50ee4] Received unexpected event network-vif-plugged-d2cb059e-f41b-41a5-b4a5-aef2d663eeb2 for instance with vm_state deleted and task_state None.
Nov 29 18:15:17 user nova-compute[74613]: DEBUG nova.compute.manager [req-724a5af3-8961-47ee-ac0a-7d1014047509 req-4ce760de-ea0f-4a29-b53f-660051305aee service nova] [instance: fa144332-bad7-4373-94d9-018f41f50ee4] Received event network-vif-plugged-d2cb059e-f41b-41a5-b4a5-aef2d663eeb2 {{(pid=74613) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 18:15:17 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-724a5af3-8961-47ee-ac0a-7d1014047509 req-4ce760de-ea0f-4a29-b53f-660051305aee service nova] Acquiring lock "fa144332-bad7-4373-94d9-018f41f50ee4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 18:15:17 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-724a5af3-8961-47ee-ac0a-7d1014047509 req-4ce760de-ea0f-4a29-b53f-660051305aee service nova] Lock "fa144332-bad7-4373-94d9-018f41f50ee4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 18:15:17 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-724a5af3-8961-47ee-ac0a-7d1014047509 req-4ce760de-ea0f-4a29-b53f-660051305aee service nova] Lock "fa144332-bad7-4373-94d9-018f41f50ee4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 18:15:17 user nova-compute[74613]: DEBUG nova.compute.manager [req-724a5af3-8961-47ee-ac0a-7d1014047509 req-4ce760de-ea0f-4a29-b53f-660051305aee service nova] [instance: fa144332-bad7-4373-94d9-018f41f50ee4] No waiting events found dispatching network-vif-plugged-d2cb059e-f41b-41a5-b4a5-aef2d663eeb2 {{(pid=74613) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 18:15:17 user nova-compute[74613]: WARNING nova.compute.manager [req-724a5af3-8961-47ee-ac0a-7d1014047509 req-4ce760de-ea0f-4a29-b53f-660051305aee service nova] [instance: fa144332-bad7-4373-94d9-018f41f50ee4] Received unexpected event network-vif-plugged-d2cb059e-f41b-41a5-b4a5-aef2d663eeb2 for instance with vm_state deleted and task_state None.
Nov 29 18:15:17 user nova-compute[74613]: DEBUG nova.compute.manager [req-724a5af3-8961-47ee-ac0a-7d1014047509 req-4ce760de-ea0f-4a29-b53f-660051305aee service nova] [instance: fa144332-bad7-4373-94d9-018f41f50ee4] Received event network-vif-unplugged-d2cb059e-f41b-41a5-b4a5-aef2d663eeb2 {{(pid=74613) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 18:15:17 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-724a5af3-8961-47ee-ac0a-7d1014047509 req-4ce760de-ea0f-4a29-b53f-660051305aee service nova] Acquiring lock "fa144332-bad7-4373-94d9-018f41f50ee4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 18:15:17 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-724a5af3-8961-47ee-ac0a-7d1014047509 req-4ce760de-ea0f-4a29-b53f-660051305aee service nova] Lock "fa144332-bad7-4373-94d9-018f41f50ee4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 18:15:17 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-724a5af3-8961-47ee-ac0a-7d1014047509 req-4ce760de-ea0f-4a29-b53f-660051305aee service nova] Lock "fa144332-bad7-4373-94d9-018f41f50ee4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 18:15:17 user nova-compute[74613]: DEBUG nova.compute.manager [req-724a5af3-8961-47ee-ac0a-7d1014047509 req-4ce760de-ea0f-4a29-b53f-660051305aee service nova] [instance: fa144332-bad7-4373-94d9-018f41f50ee4] No waiting events found dispatching network-vif-unplugged-d2cb059e-f41b-41a5-b4a5-aef2d663eeb2 {{(pid=74613) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 18:15:17 user nova-compute[74613]: WARNING nova.compute.manager [req-724a5af3-8961-47ee-ac0a-7d1014047509 req-4ce760de-ea0f-4a29-b53f-660051305aee service nova] [instance: fa144332-bad7-4373-94d9-018f41f50ee4] Received unexpected event network-vif-unplugged-d2cb059e-f41b-41a5-b4a5-aef2d663eeb2 for instance with vm_state deleted and task_state None.
Nov 29 18:15:17 user nova-compute[74613]: DEBUG nova.compute.manager [req-724a5af3-8961-47ee-ac0a-7d1014047509 req-4ce760de-ea0f-4a29-b53f-660051305aee service nova] [instance: fa144332-bad7-4373-94d9-018f41f50ee4] Received event network-vif-plugged-d2cb059e-f41b-41a5-b4a5-aef2d663eeb2 {{(pid=74613) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 18:15:17 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-724a5af3-8961-47ee-ac0a-7d1014047509 req-4ce760de-ea0f-4a29-b53f-660051305aee service nova] Acquiring lock "fa144332-bad7-4373-94d9-018f41f50ee4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 18:15:17 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-724a5af3-8961-47ee-ac0a-7d1014047509 req-4ce760de-ea0f-4a29-b53f-660051305aee service nova] Lock "fa144332-bad7-4373-94d9-018f41f50ee4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 18:15:17 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-724a5af3-8961-47ee-ac0a-7d1014047509 req-4ce760de-ea0f-4a29-b53f-660051305aee service nova] Lock "fa144332-bad7-4373-94d9-018f41f50ee4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 18:15:17 user nova-compute[74613]: DEBUG nova.compute.manager [req-724a5af3-8961-47ee-ac0a-7d1014047509 req-4ce760de-ea0f-4a29-b53f-660051305aee service nova] [instance: fa144332-bad7-4373-94d9-018f41f50ee4] No waiting events found dispatching network-vif-plugged-d2cb059e-f41b-41a5-b4a5-aef2d663eeb2 {{(pid=74613) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 18:15:17 user nova-compute[74613]: WARNING nova.compute.manager [req-724a5af3-8961-47ee-ac0a-7d1014047509 req-4ce760de-ea0f-4a29-b53f-660051305aee service nova] [instance: fa144332-bad7-4373-94d9-018f41f50ee4] Received unexpected event network-vif-plugged-d2cb059e-f41b-41a5-b4a5-aef2d663eeb2 for instance with vm_state deleted and task_state None.
Nov 29 18:15:21 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:15:21 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:15:26 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:15:26 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:15:31 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:15:31 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:15:32 user nova-compute[74613]: DEBUG oslo_service.periodic_task [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74613) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 18:15:35 user nova-compute[74613]: DEBUG oslo_service.periodic_task [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74613) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 18:15:35 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 18:15:35 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 18:15:35 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 18:15:35 user nova-compute[74613]: DEBUG nova.compute.resource_tracker [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Auditing locally available compute resources for user (node: user) {{(pid=74613) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 29 18:15:35 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1f2b4426-815f-4ef4-b98e-e5124fec93b7/disk.rescue --force-share --output=json {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:15:35 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1f2b4426-815f-4ef4-b98e-e5124fec93b7/disk.rescue --force-share --output=json" returned: 0 in 0.209s {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:15:35 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1f2b4426-815f-4ef4-b98e-e5124fec93b7/disk.rescue --force-share --output=json {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:15:36 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:15:36 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1f2b4426-815f-4ef4-b98e-e5124fec93b7/disk.rescue --force-share --output=json" returned: 0 in 0.245s {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:15:36 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] skipping disk /opt/stack/data/nova/instances/1f2b4426-815f-4ef4-b98e-e5124fec93b7/disk (vdb) as it is a volume {{(pid=74613) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 29 18:15:36 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74613) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 29 18:15:36 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ef9c2f4-23d0-44eb-9ba9-8c7c3f6b0874/disk --force-share --output=json {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:15:36 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:15:36 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ef9c2f4-23d0-44eb-9ba9-8c7c3f6b0874/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:15:36 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ef9c2f4-23d0-44eb-9ba9-8c7c3f6b0874/disk --force-share --output=json {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:15:36 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ef9c2f4-23d0-44eb-9ba9-8c7c3f6b0874/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:15:36 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/69109f06-acbf-4834-b05e-80ab6e3f6ea0/disk --force-share --output=json {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:15:36 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-1e93c5e5-d36b-42c7-b3c1-1ce4d6ae9e40 tempest-TestVolumeBootPattern-1318569205 tempest-TestVolumeBootPattern-1318569205-project-member] Acquiring lock "ca290abd-2eb9-43ec-b212-b1cfe1fdf35c" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 18:15:36 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-1e93c5e5-d36b-42c7-b3c1-1ce4d6ae9e40 tempest-TestVolumeBootPattern-1318569205 tempest-TestVolumeBootPattern-1318569205-project-member] Lock "ca290abd-2eb9-43ec-b212-b1cfe1fdf35c" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 18:15:36 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-1e93c5e5-d36b-42c7-b3c1-1ce4d6ae9e40 tempest-TestVolumeBootPattern-1318569205 tempest-TestVolumeBootPattern-1318569205-project-member] Acquiring lock "ca290abd-2eb9-43ec-b212-b1cfe1fdf35c-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 18:15:36 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-1e93c5e5-d36b-42c7-b3c1-1ce4d6ae9e40 tempest-TestVolumeBootPattern-1318569205 tempest-TestVolumeBootPattern-1318569205-project-member] Lock "ca290abd-2eb9-43ec-b212-b1cfe1fdf35c-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 18:15:36 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-1e93c5e5-d36b-42c7-b3c1-1ce4d6ae9e40 tempest-TestVolumeBootPattern-1318569205 tempest-TestVolumeBootPattern-1318569205-project-member] Lock "ca290abd-2eb9-43ec-b212-b1cfe1fdf35c-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 18:15:36 user nova-compute[74613]: INFO nova.compute.manager [None req-1e93c5e5-d36b-42c7-b3c1-1ce4d6ae9e40 tempest-TestVolumeBootPattern-1318569205 tempest-TestVolumeBootPattern-1318569205-project-member] [instance: ca290abd-2eb9-43ec-b212-b1cfe1fdf35c] Terminating instance
Nov 29 18:15:36 user nova-compute[74613]: DEBUG nova.compute.manager [None req-1e93c5e5-d36b-42c7-b3c1-1ce4d6ae9e40 tempest-TestVolumeBootPattern-1318569205 tempest-TestVolumeBootPattern-1318569205-project-member] [instance: ca290abd-2eb9-43ec-b212-b1cfe1fdf35c] Start destroying the instance on the hypervisor. {{(pid=74613) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 29 18:15:36 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:15:36 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:15:36 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:15:36 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/69109f06-acbf-4834-b05e-80ab6e3f6ea0/disk --force-share --output=json" returned: 0 in 0.239s {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:15:36 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/69109f06-acbf-4834-b05e-80ab6e3f6ea0/disk --force-share --output=json {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:15:36 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:15:37 user nova-compute[74613]: DEBUG nova.compute.manager [req-23f2f22a-d24b-4d67-900b-151379ac0403 req-b38890c9-11d0-42c3-ada3-7096e367024d service nova] [instance: ca290abd-2eb9-43ec-b212-b1cfe1fdf35c] Received event network-vif-unplugged-a0a4c680-262b-4bff-b523-0bc7a27baa88 {{(pid=74613) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 18:15:37 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-23f2f22a-d24b-4d67-900b-151379ac0403 req-b38890c9-11d0-42c3-ada3-7096e367024d service nova] Acquiring lock "ca290abd-2eb9-43ec-b212-b1cfe1fdf35c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 18:15:37 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-23f2f22a-d24b-4d67-900b-151379ac0403 req-b38890c9-11d0-42c3-ada3-7096e367024d service nova] Lock "ca290abd-2eb9-43ec-b212-b1cfe1fdf35c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 18:15:37 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-23f2f22a-d24b-4d67-900b-151379ac0403 req-b38890c9-11d0-42c3-ada3-7096e367024d service nova] Lock "ca290abd-2eb9-43ec-b212-b1cfe1fdf35c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 18:15:37 user nova-compute[74613]: DEBUG nova.compute.manager [req-23f2f22a-d24b-4d67-900b-151379ac0403 req-b38890c9-11d0-42c3-ada3-7096e367024d service nova] [instance: ca290abd-2eb9-43ec-b212-b1cfe1fdf35c] No waiting events found dispatching network-vif-unplugged-a0a4c680-262b-4bff-b523-0bc7a27baa88 {{(pid=74613) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 18:15:37 user nova-compute[74613]: DEBUG nova.compute.manager [req-23f2f22a-d24b-4d67-900b-151379ac0403 req-b38890c9-11d0-42c3-ada3-7096e367024d service nova] [instance: ca290abd-2eb9-43ec-b212-b1cfe1fdf35c] Received event network-vif-unplugged-a0a4c680-262b-4bff-b523-0bc7a27baa88 for instance with task_state deleting. {{(pid=74613) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 29 18:15:37 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/69109f06-acbf-4834-b05e-80ab6e3f6ea0/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:15:37 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f4a1329-b3b9-4d1c-8735-abddabc359fd/disk.rescue --force-share --output=json {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:15:37 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:15:37 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f4a1329-b3b9-4d1c-8735-abddabc359fd/disk.rescue --force-share --output=json" returned: 0 in 0.204s {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:15:37 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f4a1329-b3b9-4d1c-8735-abddabc359fd/disk.rescue --force-share --output=json {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:15:37 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f4a1329-b3b9-4d1c-8735-abddabc359fd/disk.rescue --force-share --output=json" returned: 0 in 0.183s {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:15:37 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f4a1329-b3b9-4d1c-8735-abddabc359fd/disk --force-share --output=json {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:15:37 user nova-compute[74613]: INFO nova.virt.libvirt.driver [-] [instance: ca290abd-2eb9-43ec-b212-b1cfe1fdf35c] Instance destroyed successfully.
Nov 29 18:15:37 user nova-compute[74613]: DEBUG nova.objects.instance [None req-1e93c5e5-d36b-42c7-b3c1-1ce4d6ae9e40 tempest-TestVolumeBootPattern-1318569205 tempest-TestVolumeBootPattern-1318569205-project-member] Lazy-loading 'resources' on Instance uuid ca290abd-2eb9-43ec-b212-b1cfe1fdf35c {{(pid=74613) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 18:15:37 user nova-compute[74613]: DEBUG nova.virt.libvirt.vif [None req-1e93c5e5-d36b-42c7-b3c1-1ce4d6ae9e40 tempest-TestVolumeBootPattern-1318569205 tempest-TestVolumeBootPattern-1318569205-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T18:13:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-683782260',display_name='tempest-TestVolumeBootPattern-server-683782260',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-683782260',id=38,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-29T18:14:05Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='67390f1402214191904cfbd68c3142a7',ramdisk_id='',reservation_id='r-062ykjyd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-1318569205',owner_user_name='tempest-TestVolumeBootPattern-1318569205-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-29T18:14:05Z,user_data=None,user_id='bedbc6ed47394e2b9125543a8b88a71f',uuid=ca290abd-2eb9-43ec-b212-b1cfe1fdf35c,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "a0a4c680-262b-4bff-b523-0bc7a27baa88", "address": "fa:16:3e:15:0b:97", "network": {"id": "4a5179dd-d0b1-44c3-80c1-08dd7b0152f1", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1296336996-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "67390f1402214191904cfbd68c3142a7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa0a4c680-26", "ovs_interfaceid": "a0a4c680-262b-4bff-b523-0bc7a27baa88", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74613) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 29 18:15:37 user nova-compute[74613]: DEBUG nova.network.os_vif_util [None req-1e93c5e5-d36b-42c7-b3c1-1ce4d6ae9e40 tempest-TestVolumeBootPattern-1318569205 tempest-TestVolumeBootPattern-1318569205-project-member] Converting VIF {"id": "a0a4c680-262b-4bff-b523-0bc7a27baa88", "address": "fa:16:3e:15:0b:97", "network": {"id": "4a5179dd-d0b1-44c3-80c1-08dd7b0152f1", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1296336996-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "67390f1402214191904cfbd68c3142a7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa0a4c680-26", "ovs_interfaceid": "a0a4c680-262b-4bff-b523-0bc7a27baa88", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74613) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 18:15:37 user nova-compute[74613]: DEBUG nova.network.os_vif_util [None req-1e93c5e5-d36b-42c7-b3c1-1ce4d6ae9e40 tempest-TestVolumeBootPattern-1318569205 tempest-TestVolumeBootPattern-1318569205-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:15:0b:97,bridge_name='br-int',has_traffic_filtering=True,id=a0a4c680-262b-4bff-b523-0bc7a27baa88,network=Network(4a5179dd-d0b1-44c3-80c1-08dd7b0152f1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa0a4c680-26') {{(pid=74613) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 18:15:37 user nova-compute[74613]: DEBUG os_vif [None req-1e93c5e5-d36b-42c7-b3c1-1ce4d6ae9e40 tempest-TestVolumeBootPattern-1318569205 tempest-TestVolumeBootPattern-1318569205-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:15:0b:97,bridge_name='br-int',has_traffic_filtering=True,id=a0a4c680-262b-4bff-b523-0bc7a27baa88,network=Network(4a5179dd-d0b1-44c3-80c1-08dd7b0152f1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa0a4c680-26') {{(pid=74613) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 29 18:15:37 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:15:37 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapa0a4c680-26, bridge=br-int, if_exists=True) {{(pid=74613) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 18:15:37 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:15:37 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 18:15:37 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:15:37 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=0fa41ae3-52cd-4c50-b174-5dd6dade71ce) {{(pid=74613) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 18:15:37 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:15:37 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 18:15:37 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:15:37 user nova-compute[74613]: INFO os_vif [None req-1e93c5e5-d36b-42c7-b3c1-1ce4d6ae9e40 tempest-TestVolumeBootPattern-1318569205 tempest-TestVolumeBootPattern-1318569205-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:15:0b:97,bridge_name='br-int',has_traffic_filtering=True,id=a0a4c680-262b-4bff-b523-0bc7a27baa88,network=Network(4a5179dd-d0b1-44c3-80c1-08dd7b0152f1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa0a4c680-26')
Nov 29 18:15:37 user nova-compute[74613]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1e93c5e5-d36b-42c7-b3c1-1ce4d6ae9e40 tempest-TestVolumeBootPattern-1318569205 tempest-TestVolumeBootPattern-1318569205-project-member] [instance: ca290abd-2eb9-43ec-b212-b1cfe1fdf35c] calling os-brick to detach iSCSI Volume {{(pid=74613) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 29 18:15:37 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-1e93c5e5-d36b-42c7-b3c1-1ce4d6ae9e40 tempest-TestVolumeBootPattern-1318569205 tempest-TestVolumeBootPattern-1318569205-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff828156890>, {'target_iqn': 'iqn.2010-10.org.openstack:1cd1b4f3-6008-4bef-bb8d-e92e973d5a96', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WQUqJxNg', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=74613) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 18:15:37 user nova-compute[74613]: WARNING os_brick.initiator.connectors.base [None req-1e93c5e5-d36b-42c7-b3c1-1ce4d6ae9e40 tempest-TestVolumeBootPattern-1318569205 tempest-TestVolumeBootPattern-1318569205-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 18:15:37 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.base [None req-1e93c5e5-d36b-42c7-b3c1-1ce4d6ae9e40 tempest-TestVolumeBootPattern-1318569205 tempest-TestVolumeBootPattern-1318569205-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 18:15:37 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.base [None req-1e93c5e5-d36b-42c7-b3c1-1ce4d6ae9e40 tempest-TestVolumeBootPattern-1318569205 tempest-TestVolumeBootPattern-1318569205-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 18:15:37 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:15:37 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:15:37 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8955981-c373-428b-b397-3ed5f56bf9ad]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:1cd1b4f3-6008-4bef-bb8d-e92e973d5a96\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:113c5dd9-52e5-46ba-8f15-faf70db70464\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 18:15:37 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-1e93c5e5-d36b-42c7-b3c1-1ce4d6ae9e40 tempest-TestVolumeBootPattern-1318569205 tempest-TestVolumeBootPattern-1318569205-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 29 18:15:37 user nova-compute[74613]: No targets found.
Nov 29 18:15:37 user nova-compute[74613]: iSNS:
Nov 29 18:15:37 user nova-compute[74613]: No targets found.
Nov 29 18:15:37 user nova-compute[74613]: STATIC:
Nov 29 18:15:37 user nova-compute[74613]: Target: iqn.2010-10.org.openstack:1cd1b4f3-6008-4bef-bb8d-e92e973d5a96
Nov 29 18:15:37 user nova-compute[74613]:         Portal: 172.16.0.220:3260,-1
Nov 29 18:15:37 user nova-compute[74613]:                 Iface Name: default
Nov 29 18:15:37 user nova-compute[74613]: Target: iqn.2010-10.org.openstack:113c5dd9-52e5-46ba-8f15-faf70db70464
Nov 29 18:15:37 user nova-compute[74613]:         Portal: 172.16.0.220:3260,-1
Nov 29 18:15:37 user nova-compute[74613]:                 Iface Name: default
Nov 29 18:15:37 user nova-compute[74613]: FIRMWARE:
Nov 29 18:15:37 user nova-compute[74613]: No targets found.
Nov 29 18:15:37 user nova-compute[74613]:  stderr= {{(pid=74613) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 18:15:37 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-1e93c5e5-d36b-42c7-b3c1-1ce4d6ae9e40 tempest-TestVolumeBootPattern-1318569205 tempest-TestVolumeBootPattern-1318569205-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 29 18:15:37 user nova-compute[74613]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 29 18:15:37 user nova-compute[74613]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74613) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 29 18:15:37 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-1e93c5e5-d36b-42c7-b3c1-1ce4d6ae9e40 tempest-TestVolumeBootPattern-1318569205 tempest-TestVolumeBootPattern-1318569205-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1cd1b4f3-6008-4bef-bb8d-e92e973d5a96', 0)] {{(pid=74613) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 29 18:15:37 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:15:37 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:15:37 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9f53991-667a-4754-b99c-487757bcfbe4]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:113c5dd9-52e5-46ba-8f15-faf70db70464\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1cd1b4f3-6008-4bef-bb8d-e92e973d5a96\n', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 18:15:37 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:15:37 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:15:37 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4a8804e-eacd-4089-afa2-9446a38570eb]: (4, ('tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1cd1b4f3-6008-4bef-bb8d-e92e973d5a96 (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:113c5dd9-52e5-46ba-8f15-faf70db70464 (non-flash)\n', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 18:15:37 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-1e93c5e5-d36b-42c7-b3c1-1ce4d6ae9e40 tempest-TestVolumeBootPattern-1318569205 tempest-TestVolumeBootPattern-1318569205-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1cd1b4f3-6008-4bef-bb8d-e92e973d5a96 (non-flash)
Nov 29 18:15:37 user nova-compute[74613]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:113c5dd9-52e5-46ba-8f15-faf70db70464 (non-flash)
Nov 29 18:15:37 user nova-compute[74613]:  stderr= {{(pid=74613) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 18:15:37 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-1e93c5e5-d36b-42c7-b3c1-1ce4d6ae9e40 tempest-TestVolumeBootPattern-1318569205 tempest-TestVolumeBootPattern-1318569205-project-member] iscsi session list stdout=tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1cd1b4f3-6008-4bef-bb8d-e92e973d5a96 (non-flash)
Nov 29 18:15:37 user nova-compute[74613]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:113c5dd9-52e5-46ba-8f15-faf70db70464 (non-flash)
Nov 29 18:15:37 user nova-compute[74613]:  stderr= {{(pid=74613) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 18:15:37 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-1e93c5e5-d36b-42c7-b3c1-1ce4d6ae9e40 tempest-TestVolumeBootPattern-1318569205 tempest-TestVolumeBootPattern-1318569205-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7ff81813ae60>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1cd1b4f3-6008-4bef-bb8d-e92e973d5a96'): ({'sdb'}, set())}) {{(pid=74613) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 29 18:15:37 user nova-compute[74613]: DEBUG os_brick.initiator.linuxscsi [None req-1e93c5e5-d36b-42c7-b3c1-1ce4d6ae9e40 tempest-TestVolumeBootPattern-1318569205 tempest-TestVolumeBootPattern-1318569205-project-member] Removing single pathed devices sdb {{(pid=74613) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 29 18:15:37 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:15:37 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:15:37 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[eef9410a-04a3-4796-902b-cc5b03a3678a]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 18:15:37 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:15:37 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.019s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:15:37 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[653e5082-2602-4aa1-8c42-936494048917]: (4, ('ok\n', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 18:15:37 user nova-compute[74613]: DEBUG os_brick.initiator.linuxscsi [None req-1e93c5e5-d36b-42c7-b3c1-1ce4d6ae9e40 tempest-TestVolumeBootPattern-1318569205 tempest-TestVolumeBootPattern-1318569205-project-member] Flushing IO for device /dev/sdb {{(pid=74613) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 29 18:15:37 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:15:37 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f4a1329-b3b9-4d1c-8735-abddabc359fd/disk --force-share --output=json" returned: 0 in 0.244s {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:15:37 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f4a1329-b3b9-4d1c-8735-abddabc359fd/disk --force-share --output=json {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:15:37 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.014s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:15:37 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[8140f7c0-b8ac-4a8c-bdad-454a2cfcdb00]: (4, ('', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 18:15:37 user nova-compute[74613]: DEBUG os_brick.initiator.linuxscsi [None req-1e93c5e5-d36b-42c7-b3c1-1ce4d6ae9e40 tempest-TestVolumeBootPattern-1318569205 tempest-TestVolumeBootPattern-1318569205-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74613) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 29 18:15:37 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:15:37 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.043s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:15:37 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4b6d4bc-71ba-4369-a44d-1e4c3f48f32c]: (4, ('1', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 18:15:37 user nova-compute[74613]: DEBUG os_brick.initiator.linuxscsi [None req-1e93c5e5-d36b-42c7-b3c1-1ce4d6ae9e40 tempest-TestVolumeBootPattern-1318569205 tempest-TestVolumeBootPattern-1318569205-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74613) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 29 18:15:37 user nova-compute[74613]: DEBUG os_brick.initiator.linuxscsi [None req-1e93c5e5-d36b-42c7-b3c1-1ce4d6ae9e40 tempest-TestVolumeBootPattern-1318569205 tempest-TestVolumeBootPattern-1318569205-project-member] SCSI volumes sdb have been removed. {{(pid=74613) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 29 18:15:37 user nova-compute[74613]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-1SCST_BIOad197b37-a962220ba9f1202e', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_ad197b37', '/dev/disk/by-id/scsi-26139363232323062') {{(pid=85376) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Nov 29 18:15:37 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ddb4fe3-0caa-43b3-82ba-fe649a03ceb8]: (4, None) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 18:15:37 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-1e93c5e5-d36b-42c7-b3c1-1ce4d6ae9e40 tempest-TestVolumeBootPattern-1318569205 tempest-TestVolumeBootPattern-1318569205-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1cd1b4f3-6008-4bef-bb8d-e92e973d5a96')] {{(pid=74613) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 29 18:15:37 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1cd1b4f3-6008-4bef-bb8d-e92e973d5a96 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:15:37 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1cd1b4f3-6008-4bef-bb8d-e92e973d5a96 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:15:37 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[024da99e-0b46-4e62-ac3d-e93c41125ff8]: (4, ('', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 18:15:37 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-1e93c5e5-d36b-42c7-b3c1-1ce4d6ae9e40 tempest-TestVolumeBootPattern-1318569205 tempest-TestVolumeBootPattern-1318569205-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74613) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 18:15:37 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1cd1b4f3-6008-4bef-bb8d-e92e973d5a96 -p 172.16.0.220:3260 --logout {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:15:37 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1cd1b4f3-6008-4bef-bb8d-e92e973d5a96 -p 172.16.0.220:3260 --logout" returned: 0 in 0.054s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:15:37 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[19bfceab-d54d-44a0-8da4-c8c4549c4ca4]: (4, ('Logging out of session [sid: 42, target: iqn.2010-10.org.openstack:1cd1b4f3-6008-4bef-bb8d-e92e973d5a96, portal: 172.16.0.220,3260]\nLogout of [sid: 42, target: iqn.2010-10.org.openstack:1cd1b4f3-6008-4bef-bb8d-e92e973d5a96, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 18:15:37 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-1e93c5e5-d36b-42c7-b3c1-1ce4d6ae9e40 tempest-TestVolumeBootPattern-1318569205 tempest-TestVolumeBootPattern-1318569205-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 42, target: iqn.2010-10.org.openstack:1cd1b4f3-6008-4bef-bb8d-e92e973d5a96, portal: 172.16.0.220,3260]
Nov 29 18:15:37 user nova-compute[74613]: Logout of [sid: 42, target: iqn.2010-10.org.openstack:1cd1b4f3-6008-4bef-bb8d-e92e973d5a96, portal: 172.16.0.220,3260] successful.
Nov 29 18:15:37 user nova-compute[74613]:  stderr= {{(pid=74613) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 18:15:37 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1cd1b4f3-6008-4bef-bb8d-e92e973d5a96 -p 172.16.0.220:3260 --op delete {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:15:37 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1cd1b4f3-6008-4bef-bb8d-e92e973d5a96 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.020s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:15:37 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb1e065c-a7a7-4fbf-998e-66f74a79e6c9]: (4, ('', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 18:15:37 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-1e93c5e5-d36b-42c7-b3c1-1ce4d6ae9e40 tempest-TestVolumeBootPattern-1318569205 tempest-TestVolumeBootPattern-1318569205-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74613) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 18:15:37 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.base [None req-1e93c5e5-d36b-42c7-b3c1-1ce4d6ae9e40 tempest-TestVolumeBootPattern-1318569205 tempest-TestVolumeBootPattern-1318569205-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.343s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 18:15:37 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-1e93c5e5-d36b-42c7-b3c1-1ce4d6ae9e40 tempest-TestVolumeBootPattern-1318569205 tempest-TestVolumeBootPattern-1318569205-project-member] <== disconnect_volume: return (345ms) None {{(pid=74613) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 18:15:37 user nova-compute[74613]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1e93c5e5-d36b-42c7-b3c1-1ce4d6ae9e40 tempest-TestVolumeBootPattern-1318569205 tempest-TestVolumeBootPattern-1318569205-project-member] [instance: ca290abd-2eb9-43ec-b212-b1cfe1fdf35c] Disconnected iSCSI Volume {{(pid=74613) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 29 18:15:37 user nova-compute[74613]: INFO nova.virt.libvirt.driver [None req-1e93c5e5-d36b-42c7-b3c1-1ce4d6ae9e40 tempest-TestVolumeBootPattern-1318569205 tempest-TestVolumeBootPattern-1318569205-project-member] [instance: ca290abd-2eb9-43ec-b212-b1cfe1fdf35c] Deleting instance files /opt/stack/data/nova/instances/ca290abd-2eb9-43ec-b212-b1cfe1fdf35c_del
Nov 29 18:15:37 user nova-compute[74613]: INFO nova.virt.libvirt.driver [None req-1e93c5e5-d36b-42c7-b3c1-1ce4d6ae9e40 tempest-TestVolumeBootPattern-1318569205 tempest-TestVolumeBootPattern-1318569205-project-member] [instance: ca290abd-2eb9-43ec-b212-b1cfe1fdf35c] Deletion of /opt/stack/data/nova/instances/ca290abd-2eb9-43ec-b212-b1cfe1fdf35c_del complete
Nov 29 18:15:37 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f4a1329-b3b9-4d1c-8735-abddabc359fd/disk --force-share --output=json" returned: 0 in 0.224s {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:15:37 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6993e2e7-7e03-45b4-9d3d-3742589b6078/disk --force-share --output=json {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:15:38 user nova-compute[74613]: INFO nova.compute.manager [None req-1e93c5e5-d36b-42c7-b3c1-1ce4d6ae9e40 tempest-TestVolumeBootPattern-1318569205 tempest-TestVolumeBootPattern-1318569205-project-member] [instance: ca290abd-2eb9-43ec-b212-b1cfe1fdf35c] Took 1.28 seconds to destroy the instance on the hypervisor.
Nov 29 18:15:38 user nova-compute[74613]: DEBUG oslo.service.loopingcall [None req-1e93c5e5-d36b-42c7-b3c1-1ce4d6ae9e40 tempest-TestVolumeBootPattern-1318569205 tempest-TestVolumeBootPattern-1318569205-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74613) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 29 18:15:38 user nova-compute[74613]: DEBUG nova.compute.manager [-] [instance: ca290abd-2eb9-43ec-b212-b1cfe1fdf35c] Deallocating network for instance {{(pid=74613) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 29 18:15:38 user nova-compute[74613]: DEBUG nova.network.neutron [-] [instance: ca290abd-2eb9-43ec-b212-b1cfe1fdf35c] deallocate_for_instance() {{(pid=74613) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 29 18:15:38 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6993e2e7-7e03-45b4-9d3d-3742589b6078/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:15:38 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6993e2e7-7e03-45b4-9d3d-3742589b6078/disk --force-share --output=json {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:15:38 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-8552bec8-74c7-4ae8-93ac-c620873ba76e tempest-AttachVolumeTestJSON-813984703 tempest-AttachVolumeTestJSON-813984703-project-member] Acquiring lock "69109f06-acbf-4834-b05e-80ab6e3f6ea0" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 18:15:38 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-8552bec8-74c7-4ae8-93ac-c620873ba76e tempest-AttachVolumeTestJSON-813984703 tempest-AttachVolumeTestJSON-813984703-project-member] Lock "69109f06-acbf-4834-b05e-80ab6e3f6ea0" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 18:15:38 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-8552bec8-74c7-4ae8-93ac-c620873ba76e tempest-AttachVolumeTestJSON-813984703 tempest-AttachVolumeTestJSON-813984703-project-member] Acquiring lock "69109f06-acbf-4834-b05e-80ab6e3f6ea0-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 18:15:38 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-8552bec8-74c7-4ae8-93ac-c620873ba76e tempest-AttachVolumeTestJSON-813984703 tempest-AttachVolumeTestJSON-813984703-project-member] Lock "69109f06-acbf-4834-b05e-80ab6e3f6ea0-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 18:15:38 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-8552bec8-74c7-4ae8-93ac-c620873ba76e tempest-AttachVolumeTestJSON-813984703 tempest-AttachVolumeTestJSON-813984703-project-member] Lock "69109f06-acbf-4834-b05e-80ab6e3f6ea0-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 18:15:38 user nova-compute[74613]: INFO nova.compute.manager [None req-8552bec8-74c7-4ae8-93ac-c620873ba76e tempest-AttachVolumeTestJSON-813984703 tempest-AttachVolumeTestJSON-813984703-project-member] [instance: 69109f06-acbf-4834-b05e-80ab6e3f6ea0] Terminating instance
Nov 29 18:15:38 user nova-compute[74613]: DEBUG nova.compute.manager [None req-8552bec8-74c7-4ae8-93ac-c620873ba76e tempest-AttachVolumeTestJSON-813984703 tempest-AttachVolumeTestJSON-813984703-project-member] [instance: 69109f06-acbf-4834-b05e-80ab6e3f6ea0] Start destroying the instance on the hypervisor. {{(pid=74613) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 29 18:15:38 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:15:38 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6993e2e7-7e03-45b4-9d3d-3742589b6078/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:15:38 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:15:38 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:15:38 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:15:38 user nova-compute[74613]: DEBUG nova.compute.manager [req-56fe9d15-465f-43d1-8955-3d8a1fbc1647 req-315c0500-c9b0-4aa8-b7fa-f60fcae01f92 service nova] [instance: 69109f06-acbf-4834-b05e-80ab6e3f6ea0] Received event network-vif-unplugged-e8b2f9b5-0c3a-4f6f-bf96-566c8a779849 {{(pid=74613) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 18:15:38 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-56fe9d15-465f-43d1-8955-3d8a1fbc1647 req-315c0500-c9b0-4aa8-b7fa-f60fcae01f92 service nova] Acquiring lock "69109f06-acbf-4834-b05e-80ab6e3f6ea0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 18:15:38 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-56fe9d15-465f-43d1-8955-3d8a1fbc1647 req-315c0500-c9b0-4aa8-b7fa-f60fcae01f92 service nova] Lock "69109f06-acbf-4834-b05e-80ab6e3f6ea0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 18:15:38 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-56fe9d15-465f-43d1-8955-3d8a1fbc1647 req-315c0500-c9b0-4aa8-b7fa-f60fcae01f92 service nova] Lock "69109f06-acbf-4834-b05e-80ab6e3f6ea0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 18:15:38 user nova-compute[74613]: DEBUG nova.compute.manager [req-56fe9d15-465f-43d1-8955-3d8a1fbc1647 req-315c0500-c9b0-4aa8-b7fa-f60fcae01f92 service nova] [instance: 69109f06-acbf-4834-b05e-80ab6e3f6ea0] No waiting events found dispatching network-vif-unplugged-e8b2f9b5-0c3a-4f6f-bf96-566c8a779849 {{(pid=74613) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 18:15:38 user nova-compute[74613]: DEBUG nova.compute.manager [req-56fe9d15-465f-43d1-8955-3d8a1fbc1647 req-315c0500-c9b0-4aa8-b7fa-f60fcae01f92 service nova] [instance: 69109f06-acbf-4834-b05e-80ab6e3f6ea0] Received event network-vif-unplugged-e8b2f9b5-0c3a-4f6f-bf96-566c8a779849 for instance with task_state deleting. {{(pid=74613) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 29 18:15:38 user nova-compute[74613]: WARNING nova.virt.libvirt.driver [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 18:15:38 user nova-compute[74613]: WARNING nova.virt.libvirt.driver [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 18:15:38 user nova-compute[74613]: DEBUG nova.compute.resource_tracker [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Hypervisor/Node resource view: name=user free_ram=8154MB free_disk=24.88144302368164GB free_vcpus=6 pci_devices=[{"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74613) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 29 18:15:38 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 18:15:38 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 18:15:38 user nova-compute[74613]: DEBUG nova.network.neutron [-] [instance: ca290abd-2eb9-43ec-b212-b1cfe1fdf35c] Updating instance_info_cache with network_info: [] {{(pid=74613) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 18:15:38 user nova-compute[74613]: INFO nova.compute.manager [-] [instance: ca290abd-2eb9-43ec-b212-b1cfe1fdf35c] Took 0.83 seconds to deallocate network for instance.
Nov 29 18:15:38 user nova-compute[74613]: DEBUG nova.compute.resource_tracker [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Instance 6993e2e7-7e03-45b4-9d3d-3742589b6078 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74613) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 18:15:38 user nova-compute[74613]: DEBUG nova.compute.resource_tracker [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Instance 6f4a1329-b3b9-4d1c-8735-abddabc359fd actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74613) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 18:15:38 user nova-compute[74613]: DEBUG nova.compute.resource_tracker [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Instance 69109f06-acbf-4834-b05e-80ab6e3f6ea0 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74613) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 18:15:38 user nova-compute[74613]: DEBUG nova.compute.resource_tracker [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Instance 1f2b4426-815f-4ef4-b98e-e5124fec93b7 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74613) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 18:15:38 user nova-compute[74613]: DEBUG nova.compute.resource_tracker [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Instance ca290abd-2eb9-43ec-b212-b1cfe1fdf35c actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74613) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 18:15:38 user nova-compute[74613]: DEBUG nova.compute.resource_tracker [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Instance 8ef9c2f4-23d0-44eb-9ba9-8c7c3f6b0874 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74613) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 18:15:38 user nova-compute[74613]: DEBUG nova.compute.resource_tracker [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Total usable vcpus: 12, total allocated vcpus: 6 {{(pid=74613) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 29 18:15:38 user nova-compute[74613]: DEBUG nova.compute.resource_tracker [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Final resource view: name=user phys_ram=16011MB used_ram=3584MB phys_disk=40GB used_disk=5GB total_vcpus=12 used_vcpus=6 pci_stats=[] {{(pid=74613) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 29 18:15:38 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:15:38 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:15:39 user nova-compute[74613]: INFO nova.virt.libvirt.driver [-] [instance: 69109f06-acbf-4834-b05e-80ab6e3f6ea0] Instance destroyed successfully.
Nov 29 18:15:39 user nova-compute[74613]: DEBUG nova.objects.instance [None req-8552bec8-74c7-4ae8-93ac-c620873ba76e tempest-AttachVolumeTestJSON-813984703 tempest-AttachVolumeTestJSON-813984703-project-member] Lazy-loading 'resources' on Instance uuid 69109f06-acbf-4834-b05e-80ab6e3f6ea0 {{(pid=74613) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 18:15:39 user nova-compute[74613]: DEBUG nova.virt.libvirt.vif [None req-8552bec8-74c7-4ae8-93ac-c620873ba76e tempest-AttachVolumeTestJSON-813984703 tempest-AttachVolumeTestJSON-813984703-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T18:05:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-112129053',display_name='tempest-AttachVolumeTestJSON-server-112129053',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-112129053',id=31,image_ref='4217f428-8d9d-4ee1-9614-642d26d90c46',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBiA6TF+XgKgtvk6TtvUc4C6ae4R2cFJpd7pnrnZXTn17B7mtXw3FeSD7WciMYISZgM0lnyM/Vu+rh9AL6QLxayu8zBkp18LuuA17FBMijpeZLWA1S8luzqDoaFtKzv2Kw==',key_name='tempest-keypair-1770317456',keypairs=<?>,launch_index=0,launched_at=2023-11-29T18:05:52Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='b5dc39bc30d84269a7ad073867e36436',ramdisk_id='',reservation_id='r-dq3ksvj9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='4217f428-8d9d-4ee1-9614-642d26d90c46',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-813984703',owner_user_name='tempest-AttachVolumeTestJSON-813984703-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-29T18:13:52Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='14808f06536f477b8a2b413e3cf9d18f',uuid=69109f06-acbf-4834-b05e-80ab6e3f6ea0,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "e8b2f9b5-0c3a-4f6f-bf96-566c8a779849", "address": "fa:16:3e:da:7a:47", "network": {"id": "21147bc8-b1ac-40d5-8fc0-8dab8ade1ff5", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1502381061-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.246", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b5dc39bc30d84269a7ad073867e36436", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape8b2f9b5-0c", "ovs_interfaceid": "e8b2f9b5-0c3a-4f6f-bf96-566c8a779849", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74613) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 29 18:15:39 user nova-compute[74613]: DEBUG nova.network.os_vif_util [None req-8552bec8-74c7-4ae8-93ac-c620873ba76e tempest-AttachVolumeTestJSON-813984703 tempest-AttachVolumeTestJSON-813984703-project-member] Converting VIF {"id": "e8b2f9b5-0c3a-4f6f-bf96-566c8a779849", "address": "fa:16:3e:da:7a:47", "network": {"id": "21147bc8-b1ac-40d5-8fc0-8dab8ade1ff5", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1502381061-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.246", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b5dc39bc30d84269a7ad073867e36436", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape8b2f9b5-0c", "ovs_interfaceid": "e8b2f9b5-0c3a-4f6f-bf96-566c8a779849", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74613) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 18:15:39 user nova-compute[74613]: DEBUG nova.network.os_vif_util [None req-8552bec8-74c7-4ae8-93ac-c620873ba76e tempest-AttachVolumeTestJSON-813984703 tempest-AttachVolumeTestJSON-813984703-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:da:7a:47,bridge_name='br-int',has_traffic_filtering=True,id=e8b2f9b5-0c3a-4f6f-bf96-566c8a779849,network=Network(21147bc8-b1ac-40d5-8fc0-8dab8ade1ff5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape8b2f9b5-0c') {{(pid=74613) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 18:15:39 user nova-compute[74613]: DEBUG os_vif [None req-8552bec8-74c7-4ae8-93ac-c620873ba76e tempest-AttachVolumeTestJSON-813984703 tempest-AttachVolumeTestJSON-813984703-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:da:7a:47,bridge_name='br-int',has_traffic_filtering=True,id=e8b2f9b5-0c3a-4f6f-bf96-566c8a779849,network=Network(21147bc8-b1ac-40d5-8fc0-8dab8ade1ff5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape8b2f9b5-0c') {{(pid=74613) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 29 18:15:39 user nova-compute[74613]: DEBUG nova.compute.manager [req-13de1014-45dc-4554-a394-9a0edf785b05 req-c67a005c-9f31-4689-aa19-8325e452b95f service nova] [instance: ca290abd-2eb9-43ec-b212-b1cfe1fdf35c] Received event network-vif-plugged-a0a4c680-262b-4bff-b523-0bc7a27baa88 {{(pid=74613) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 18:15:39 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-13de1014-45dc-4554-a394-9a0edf785b05 req-c67a005c-9f31-4689-aa19-8325e452b95f service nova] Acquiring lock "ca290abd-2eb9-43ec-b212-b1cfe1fdf35c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 18:15:39 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-13de1014-45dc-4554-a394-9a0edf785b05 req-c67a005c-9f31-4689-aa19-8325e452b95f service nova] Lock "ca290abd-2eb9-43ec-b212-b1cfe1fdf35c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 18:15:39 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-13de1014-45dc-4554-a394-9a0edf785b05 req-c67a005c-9f31-4689-aa19-8325e452b95f service nova] Lock "ca290abd-2eb9-43ec-b212-b1cfe1fdf35c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 18:15:39 user nova-compute[74613]: DEBUG nova.compute.manager [req-13de1014-45dc-4554-a394-9a0edf785b05 req-c67a005c-9f31-4689-aa19-8325e452b95f service nova] [instance: ca290abd-2eb9-43ec-b212-b1cfe1fdf35c] No waiting events found dispatching network-vif-plugged-a0a4c680-262b-4bff-b523-0bc7a27baa88 {{(pid=74613) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 18:15:39 user nova-compute[74613]: WARNING nova.compute.manager [req-13de1014-45dc-4554-a394-9a0edf785b05 req-c67a005c-9f31-4689-aa19-8325e452b95f service nova] [instance: ca290abd-2eb9-43ec-b212-b1cfe1fdf35c] Received unexpected event network-vif-plugged-a0a4c680-262b-4bff-b523-0bc7a27baa88 for instance with vm_state active and task_state deleting.
Nov 29 18:15:39 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:15:39 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tape8b2f9b5-0c, bridge=br-int, if_exists=True) {{(pid=74613) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 18:15:39 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 18:15:39 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:15:39 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=3bd5f531-d7f3-4cad-ba81-4168c05e01ff) {{(pid=74613) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 18:15:39 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:15:39 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 18:15:39 user nova-compute[74613]: INFO os_vif [None req-8552bec8-74c7-4ae8-93ac-c620873ba76e tempest-AttachVolumeTestJSON-813984703 tempest-AttachVolumeTestJSON-813984703-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:da:7a:47,bridge_name='br-int',has_traffic_filtering=True,id=e8b2f9b5-0c3a-4f6f-bf96-566c8a779849,network=Network(21147bc8-b1ac-40d5-8fc0-8dab8ade1ff5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape8b2f9b5-0c')
Nov 29 18:15:39 user nova-compute[74613]: INFO nova.virt.libvirt.driver [None req-8552bec8-74c7-4ae8-93ac-c620873ba76e tempest-AttachVolumeTestJSON-813984703 tempest-AttachVolumeTestJSON-813984703-project-member] [instance: 69109f06-acbf-4834-b05e-80ab6e3f6ea0] Deleting instance files /opt/stack/data/nova/instances/69109f06-acbf-4834-b05e-80ab6e3f6ea0_del
Nov 29 18:15:39 user nova-compute[74613]: INFO nova.virt.libvirt.driver [None req-8552bec8-74c7-4ae8-93ac-c620873ba76e tempest-AttachVolumeTestJSON-813984703 tempest-AttachVolumeTestJSON-813984703-project-member] [instance: 69109f06-acbf-4834-b05e-80ab6e3f6ea0] Deletion of /opt/stack/data/nova/instances/69109f06-acbf-4834-b05e-80ab6e3f6ea0_del complete
Nov 29 18:15:39 user nova-compute[74613]: DEBUG nova.compute.provider_tree [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Inventory has not changed in ProviderTree for provider: 639d980e-3b12-44b1-b8f4-1812416fa4dd {{(pid=74613) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 18:15:39 user nova-compute[74613]: DEBUG nova.scheduler.client.report [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Inventory has not changed for provider 639d980e-3b12-44b1-b8f4-1812416fa4dd based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74613) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 18:15:39 user nova-compute[74613]: INFO nova.compute.manager [None req-8552bec8-74c7-4ae8-93ac-c620873ba76e tempest-AttachVolumeTestJSON-813984703 tempest-AttachVolumeTestJSON-813984703-project-member] [instance: 69109f06-acbf-4834-b05e-80ab6e3f6ea0] Took 0.91 seconds to destroy the instance on the hypervisor.
Nov 29 18:15:39 user nova-compute[74613]: DEBUG oslo.service.loopingcall [None req-8552bec8-74c7-4ae8-93ac-c620873ba76e tempest-AttachVolumeTestJSON-813984703 tempest-AttachVolumeTestJSON-813984703-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74613) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 29 18:15:39 user nova-compute[74613]: DEBUG nova.compute.manager [-] [instance: 69109f06-acbf-4834-b05e-80ab6e3f6ea0] Deallocating network for instance {{(pid=74613) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 29 18:15:39 user nova-compute[74613]: DEBUG nova.network.neutron [-] [instance: 69109f06-acbf-4834-b05e-80ab6e3f6ea0] deallocate_for_instance() {{(pid=74613) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 29 18:15:39 user nova-compute[74613]: DEBUG nova.compute.resource_tracker [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Compute_service record updated for user:user {{(pid=74613) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 29 18:15:39 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.332s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 18:15:39 user nova-compute[74613]: INFO nova.compute.manager [None req-1e93c5e5-d36b-42c7-b3c1-1ce4d6ae9e40 tempest-TestVolumeBootPattern-1318569205 tempest-TestVolumeBootPattern-1318569205-project-member] [instance: ca290abd-2eb9-43ec-b212-b1cfe1fdf35c] Took 0.82 seconds to detach 1 volumes for instance.
Nov 29 18:15:39 user nova-compute[74613]: DEBUG nova.compute.manager [None req-1e93c5e5-d36b-42c7-b3c1-1ce4d6ae9e40 tempest-TestVolumeBootPattern-1318569205 tempest-TestVolumeBootPattern-1318569205-project-member] [instance: ca290abd-2eb9-43ec-b212-b1cfe1fdf35c] Deleting volume: 1cd1b4f3-6008-4bef-bb8d-e92e973d5a96 {{(pid=74613) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3237}}
Nov 29 18:15:39 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-1e93c5e5-d36b-42c7-b3c1-1ce4d6ae9e40 tempest-TestVolumeBootPattern-1318569205 tempest-TestVolumeBootPattern-1318569205-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 18:15:39 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-1e93c5e5-d36b-42c7-b3c1-1ce4d6ae9e40 tempest-TestVolumeBootPattern-1318569205 tempest-TestVolumeBootPattern-1318569205-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 18:15:39 user nova-compute[74613]: DEBUG nova.network.neutron [-] [instance: 69109f06-acbf-4834-b05e-80ab6e3f6ea0] Updating instance_info_cache with network_info: [] {{(pid=74613) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 18:15:39 user nova-compute[74613]: INFO nova.compute.manager [-] [instance: 69109f06-acbf-4834-b05e-80ab6e3f6ea0] Took 0.78 seconds to deallocate network for instance.
Nov 29 18:15:39 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-8552bec8-74c7-4ae8-93ac-c620873ba76e tempest-AttachVolumeTestJSON-813984703 tempest-AttachVolumeTestJSON-813984703-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 18:15:40 user nova-compute[74613]: DEBUG nova.compute.provider_tree [None req-1e93c5e5-d36b-42c7-b3c1-1ce4d6ae9e40 tempest-TestVolumeBootPattern-1318569205 tempest-TestVolumeBootPattern-1318569205-project-member] Inventory has not changed in ProviderTree for provider: 639d980e-3b12-44b1-b8f4-1812416fa4dd {{(pid=74613) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 18:15:40 user nova-compute[74613]: DEBUG nova.scheduler.client.report [None req-1e93c5e5-d36b-42c7-b3c1-1ce4d6ae9e40 tempest-TestVolumeBootPattern-1318569205 tempest-TestVolumeBootPattern-1318569205-project-member] Inventory has not changed for provider 639d980e-3b12-44b1-b8f4-1812416fa4dd based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74613) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 18:15:40 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-1e93c5e5-d36b-42c7-b3c1-1ce4d6ae9e40 tempest-TestVolumeBootPattern-1318569205 tempest-TestVolumeBootPattern-1318569205-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.265s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 18:15:40 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-8552bec8-74c7-4ae8-93ac-c620873ba76e tempest-AttachVolumeTestJSON-813984703 tempest-AttachVolumeTestJSON-813984703-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.092s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 18:15:40 user nova-compute[74613]: INFO nova.scheduler.client.report [None req-1e93c5e5-d36b-42c7-b3c1-1ce4d6ae9e40 tempest-TestVolumeBootPattern-1318569205 tempest-TestVolumeBootPattern-1318569205-project-member] Deleted allocations for instance ca290abd-2eb9-43ec-b212-b1cfe1fdf35c
Nov 29 18:15:40 user nova-compute[74613]: DEBUG oslo_service.periodic_task [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74613) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 18:15:40 user nova-compute[74613]: DEBUG nova.compute.manager [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Starting heal instance info cache {{(pid=74613) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 29 18:15:40 user nova-compute[74613]: DEBUG nova.compute.manager [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Rebuilding the list of instances to heal {{(pid=74613) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 29 18:15:40 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-1e93c5e5-d36b-42c7-b3c1-1ce4d6ae9e40 tempest-TestVolumeBootPattern-1318569205 tempest-TestVolumeBootPattern-1318569205-project-member] Lock "ca290abd-2eb9-43ec-b212-b1cfe1fdf35c" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.472s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 18:15:40 user nova-compute[74613]: DEBUG nova.compute.provider_tree [None req-8552bec8-74c7-4ae8-93ac-c620873ba76e tempest-AttachVolumeTestJSON-813984703 tempest-AttachVolumeTestJSON-813984703-project-member] Inventory has not changed in ProviderTree for provider: 639d980e-3b12-44b1-b8f4-1812416fa4dd {{(pid=74613) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 18:15:40 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Acquiring lock "refresh_cache-6993e2e7-7e03-45b4-9d3d-3742589b6078" {{(pid=74613) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 18:15:40 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Acquired lock "refresh_cache-6993e2e7-7e03-45b4-9d3d-3742589b6078" {{(pid=74613) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 18:15:40 user nova-compute[74613]: DEBUG nova.network.neutron [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] [instance: 6993e2e7-7e03-45b4-9d3d-3742589b6078] Forcefully refreshing network info cache for instance {{(pid=74613) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 29 18:15:40 user nova-compute[74613]: DEBUG nova.objects.instance [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Lazy-loading 'info_cache' on Instance uuid 6993e2e7-7e03-45b4-9d3d-3742589b6078 {{(pid=74613) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 18:15:40 user nova-compute[74613]: DEBUG nova.scheduler.client.report [None req-8552bec8-74c7-4ae8-93ac-c620873ba76e tempest-AttachVolumeTestJSON-813984703 tempest-AttachVolumeTestJSON-813984703-project-member] Inventory has not changed for provider 639d980e-3b12-44b1-b8f4-1812416fa4dd based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74613) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 18:15:40 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-8552bec8-74c7-4ae8-93ac-c620873ba76e tempest-AttachVolumeTestJSON-813984703 tempest-AttachVolumeTestJSON-813984703-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.217s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 18:15:40 user nova-compute[74613]: INFO nova.scheduler.client.report [None req-8552bec8-74c7-4ae8-93ac-c620873ba76e tempest-AttachVolumeTestJSON-813984703 tempest-AttachVolumeTestJSON-813984703-project-member] Deleted allocations for instance 69109f06-acbf-4834-b05e-80ab6e3f6ea0
Nov 29 18:15:40 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-8552bec8-74c7-4ae8-93ac-c620873ba76e tempest-AttachVolumeTestJSON-813984703 tempest-AttachVolumeTestJSON-813984703-project-member] Lock "69109f06-acbf-4834-b05e-80ab6e3f6ea0" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.180s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 18:15:40 user nova-compute[74613]: DEBUG nova.compute.manager [req-ffbe1eb2-69c3-4b05-8766-56c034653f45 req-e2f4fb59-c1b5-4b77-8db3-aec5ddbd2aad service nova] [instance: ca290abd-2eb9-43ec-b212-b1cfe1fdf35c] Received event network-vif-deleted-a0a4c680-262b-4bff-b523-0bc7a27baa88 {{(pid=74613) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 18:15:40 user nova-compute[74613]: DEBUG nova.compute.manager [req-ffbe1eb2-69c3-4b05-8766-56c034653f45 req-e2f4fb59-c1b5-4b77-8db3-aec5ddbd2aad service nova] [instance: 69109f06-acbf-4834-b05e-80ab6e3f6ea0] Received event network-vif-plugged-e8b2f9b5-0c3a-4f6f-bf96-566c8a779849 {{(pid=74613) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 18:15:40 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-ffbe1eb2-69c3-4b05-8766-56c034653f45 req-e2f4fb59-c1b5-4b77-8db3-aec5ddbd2aad service nova] Acquiring lock "69109f06-acbf-4834-b05e-80ab6e3f6ea0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 18:15:40 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-ffbe1eb2-69c3-4b05-8766-56c034653f45 req-e2f4fb59-c1b5-4b77-8db3-aec5ddbd2aad service nova] Lock "69109f06-acbf-4834-b05e-80ab6e3f6ea0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 18:15:40 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-ffbe1eb2-69c3-4b05-8766-56c034653f45 req-e2f4fb59-c1b5-4b77-8db3-aec5ddbd2aad service nova] Lock "69109f06-acbf-4834-b05e-80ab6e3f6ea0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 18:15:40 user nova-compute[74613]: DEBUG nova.compute.manager [req-ffbe1eb2-69c3-4b05-8766-56c034653f45 req-e2f4fb59-c1b5-4b77-8db3-aec5ddbd2aad service nova] [instance: 69109f06-acbf-4834-b05e-80ab6e3f6ea0] No waiting events found dispatching network-vif-plugged-e8b2f9b5-0c3a-4f6f-bf96-566c8a779849 {{(pid=74613) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 18:15:40 user nova-compute[74613]: WARNING nova.compute.manager [req-ffbe1eb2-69c3-4b05-8766-56c034653f45 req-e2f4fb59-c1b5-4b77-8db3-aec5ddbd2aad service nova] [instance: 69109f06-acbf-4834-b05e-80ab6e3f6ea0] Received unexpected event network-vif-plugged-e8b2f9b5-0c3a-4f6f-bf96-566c8a779849 for instance with vm_state deleted and task_state None.
Nov 29 18:15:40 user nova-compute[74613]: DEBUG nova.compute.manager [req-ffbe1eb2-69c3-4b05-8766-56c034653f45 req-e2f4fb59-c1b5-4b77-8db3-aec5ddbd2aad service nova] [instance: 69109f06-acbf-4834-b05e-80ab6e3f6ea0] Received event network-vif-deleted-e8b2f9b5-0c3a-4f6f-bf96-566c8a779849 {{(pid=74613) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 18:15:40 user nova-compute[74613]: DEBUG nova.network.neutron [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] [instance: 6993e2e7-7e03-45b4-9d3d-3742589b6078] Updating instance_info_cache with network_info: [{"id": "5216b7ab-6e2b-4d7f-8c7f-e52b03d282b9", "address": "fa:16:3e:e8:7b:54", "network": {"id": "db79433c-b21c-4058-b98c-f62822abbf7a", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1715530752-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e6a3eb6ea0294f9da705dca72ec2789a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5216b7ab-6e", "ovs_interfaceid": "5216b7ab-6e2b-4d7f-8c7f-e52b03d282b9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74613) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 18:15:40 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Releasing lock "refresh_cache-6993e2e7-7e03-45b4-9d3d-3742589b6078" {{(pid=74613) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 18:15:40 user nova-compute[74613]: DEBUG nova.compute.manager [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] [instance: 6993e2e7-7e03-45b4-9d3d-3742589b6078] Updated the network info_cache for instance {{(pid=74613) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 29 18:15:40 user nova-compute[74613]: DEBUG oslo_service.periodic_task [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74613) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 18:15:40 user nova-compute[74613]: DEBUG oslo_service.periodic_task [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74613) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 18:15:40 user nova-compute[74613]: DEBUG oslo_service.periodic_task [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74613) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 18:15:40 user nova-compute[74613]: DEBUG oslo_service.periodic_task [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74613) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 18:15:40 user nova-compute[74613]: DEBUG oslo_service.periodic_task [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74613) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 18:15:41 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:15:41 user nova-compute[74613]: DEBUG oslo_service.periodic_task [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74613) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 18:15:41 user nova-compute[74613]: DEBUG nova.compute.manager [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74613) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 29 18:15:44 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:15:46 user nova-compute[74613]: DEBUG oslo_service.periodic_task [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74613) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 18:15:49 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 18:15:54 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 18:15:59 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:16:04 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 18:16:09 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 18:16:09 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-63ec1b08-6367-41c4-82a2-6dd5f417879e tempest-AttachVolumeNegativeTest-483083654 tempest-AttachVolumeNegativeTest-483083654-project-member] Acquiring lock "d9f10bfb-5202-4b4a-a42d-f167501f597b" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 18:16:09 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-63ec1b08-6367-41c4-82a2-6dd5f417879e tempest-AttachVolumeNegativeTest-483083654 tempest-AttachVolumeNegativeTest-483083654-project-member] Lock "d9f10bfb-5202-4b4a-a42d-f167501f597b" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 18:16:09 user nova-compute[74613]: DEBUG nova.compute.manager [None req-63ec1b08-6367-41c4-82a2-6dd5f417879e tempest-AttachVolumeNegativeTest-483083654 tempest-AttachVolumeNegativeTest-483083654-project-member] [instance: d9f10bfb-5202-4b4a-a42d-f167501f597b] Starting instance... {{(pid=74613) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 29 18:16:09 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-63ec1b08-6367-41c4-82a2-6dd5f417879e tempest-AttachVolumeNegativeTest-483083654 tempest-AttachVolumeNegativeTest-483083654-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 18:16:09 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-63ec1b08-6367-41c4-82a2-6dd5f417879e tempest-AttachVolumeNegativeTest-483083654 tempest-AttachVolumeNegativeTest-483083654-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 18:16:09 user nova-compute[74613]: DEBUG nova.virt.hardware [None req-63ec1b08-6367-41c4-82a2-6dd5f417879e tempest-AttachVolumeNegativeTest-483083654 tempest-AttachVolumeNegativeTest-483083654-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74613) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 29 18:16:09 user nova-compute[74613]: INFO nova.compute.claims [None req-63ec1b08-6367-41c4-82a2-6dd5f417879e tempest-AttachVolumeNegativeTest-483083654 tempest-AttachVolumeNegativeTest-483083654-project-member] [instance: d9f10bfb-5202-4b4a-a42d-f167501f597b] Claim successful on node user
Nov 29 18:16:09 user nova-compute[74613]: DEBUG nova.compute.provider_tree [None req-63ec1b08-6367-41c4-82a2-6dd5f417879e tempest-AttachVolumeNegativeTest-483083654 tempest-AttachVolumeNegativeTest-483083654-project-member] Inventory has not changed in ProviderTree for provider: 639d980e-3b12-44b1-b8f4-1812416fa4dd {{(pid=74613) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 18:16:09 user nova-compute[74613]: DEBUG nova.scheduler.client.report [None req-63ec1b08-6367-41c4-82a2-6dd5f417879e tempest-AttachVolumeNegativeTest-483083654 tempest-AttachVolumeNegativeTest-483083654-project-member] Inventory has not changed for provider 639d980e-3b12-44b1-b8f4-1812416fa4dd based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74613) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 18:16:09 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-63ec1b08-6367-41c4-82a2-6dd5f417879e tempest-AttachVolumeNegativeTest-483083654 tempest-AttachVolumeNegativeTest-483083654-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.260s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 18:16:09 user nova-compute[74613]: DEBUG nova.compute.manager [None req-63ec1b08-6367-41c4-82a2-6dd5f417879e tempest-AttachVolumeNegativeTest-483083654 tempest-AttachVolumeNegativeTest-483083654-project-member] [instance: d9f10bfb-5202-4b4a-a42d-f167501f597b] Start building networks asynchronously for instance. {{(pid=74613) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 29 18:16:09 user nova-compute[74613]: DEBUG nova.compute.manager [None req-63ec1b08-6367-41c4-82a2-6dd5f417879e tempest-AttachVolumeNegativeTest-483083654 tempest-AttachVolumeNegativeTest-483083654-project-member] [instance: d9f10bfb-5202-4b4a-a42d-f167501f597b] Allocating IP information in the background. {{(pid=74613) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 29 18:16:09 user nova-compute[74613]: DEBUG nova.network.neutron [None req-63ec1b08-6367-41c4-82a2-6dd5f417879e tempest-AttachVolumeNegativeTest-483083654 tempest-AttachVolumeNegativeTest-483083654-project-member] [instance: d9f10bfb-5202-4b4a-a42d-f167501f597b] allocate_for_instance() {{(pid=74613) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 29 18:16:09 user nova-compute[74613]: INFO nova.virt.libvirt.driver [None req-63ec1b08-6367-41c4-82a2-6dd5f417879e tempest-AttachVolumeNegativeTest-483083654 tempest-AttachVolumeNegativeTest-483083654-project-member] [instance: d9f10bfb-5202-4b4a-a42d-f167501f597b] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 29 18:16:09 user nova-compute[74613]: DEBUG nova.compute.manager [None req-63ec1b08-6367-41c4-82a2-6dd5f417879e tempest-AttachVolumeNegativeTest-483083654 tempest-AttachVolumeNegativeTest-483083654-project-member] [instance: d9f10bfb-5202-4b4a-a42d-f167501f597b] Start building block device mappings for instance. {{(pid=74613) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 29 18:16:09 user nova-compute[74613]: DEBUG nova.policy [None req-63ec1b08-6367-41c4-82a2-6dd5f417879e tempest-AttachVolumeNegativeTest-483083654 tempest-AttachVolumeNegativeTest-483083654-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '57b1f3743f0e4cbdae1dab9e4761511e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37b89c13ba1d4a94805d6af69ad26fb8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74613) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 29 18:16:09 user nova-compute[74613]: DEBUG nova.compute.manager [None req-63ec1b08-6367-41c4-82a2-6dd5f417879e tempest-AttachVolumeNegativeTest-483083654 tempest-AttachVolumeNegativeTest-483083654-project-member] [instance: d9f10bfb-5202-4b4a-a42d-f167501f597b] Start spawning the instance on the hypervisor. {{(pid=74613) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 29 18:16:09 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-63ec1b08-6367-41c4-82a2-6dd5f417879e tempest-AttachVolumeNegativeTest-483083654 tempest-AttachVolumeNegativeTest-483083654-project-member] [instance: d9f10bfb-5202-4b4a-a42d-f167501f597b] Creating instance directory {{(pid=74613) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 29 18:16:09 user nova-compute[74613]: INFO nova.virt.libvirt.driver [None req-63ec1b08-6367-41c4-82a2-6dd5f417879e tempest-AttachVolumeNegativeTest-483083654 tempest-AttachVolumeNegativeTest-483083654-project-member] [instance: d9f10bfb-5202-4b4a-a42d-f167501f597b] Creating image(s)
Nov 29 18:16:09 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-63ec1b08-6367-41c4-82a2-6dd5f417879e tempest-AttachVolumeNegativeTest-483083654 tempest-AttachVolumeNegativeTest-483083654-project-member] Acquiring lock "/opt/stack/data/nova/instances/d9f10bfb-5202-4b4a-a42d-f167501f597b/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 18:16:09 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-63ec1b08-6367-41c4-82a2-6dd5f417879e tempest-AttachVolumeNegativeTest-483083654 tempest-AttachVolumeNegativeTest-483083654-project-member] Lock "/opt/stack/data/nova/instances/d9f10bfb-5202-4b4a-a42d-f167501f597b/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 18:16:09 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-63ec1b08-6367-41c4-82a2-6dd5f417879e tempest-AttachVolumeNegativeTest-483083654 tempest-AttachVolumeNegativeTest-483083654-project-member] Lock "/opt/stack/data/nova/instances/d9f10bfb-5202-4b4a-a42d-f167501f597b/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 18:16:09 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-63ec1b08-6367-41c4-82a2-6dd5f417879e tempest-AttachVolumeNegativeTest-483083654 tempest-AttachVolumeNegativeTest-483083654-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/21faea9e6951f3bdd0153b76ac89fe1a60a34758 --force-share --output=json {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:16:10 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-63ec1b08-6367-41c4-82a2-6dd5f417879e tempest-AttachVolumeNegativeTest-483083654 tempest-AttachVolumeNegativeTest-483083654-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/21faea9e6951f3bdd0153b76ac89fe1a60a34758 --force-share --output=json" returned: 0 in 0.213s {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:16:10 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-63ec1b08-6367-41c4-82a2-6dd5f417879e tempest-AttachVolumeNegativeTest-483083654 tempest-AttachVolumeNegativeTest-483083654-project-member] Acquiring lock "21faea9e6951f3bdd0153b76ac89fe1a60a34758" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 18:16:10 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-63ec1b08-6367-41c4-82a2-6dd5f417879e tempest-AttachVolumeNegativeTest-483083654 tempest-AttachVolumeNegativeTest-483083654-project-member] Lock "21faea9e6951f3bdd0153b76ac89fe1a60a34758" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 18:16:10 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-63ec1b08-6367-41c4-82a2-6dd5f417879e tempest-AttachVolumeNegativeTest-483083654 tempest-AttachVolumeNegativeTest-483083654-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/21faea9e6951f3bdd0153b76ac89fe1a60a34758 --force-share --output=json {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:16:10 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-63ec1b08-6367-41c4-82a2-6dd5f417879e tempest-AttachVolumeNegativeTest-483083654 tempest-AttachVolumeNegativeTest-483083654-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/21faea9e6951f3bdd0153b76ac89fe1a60a34758 --force-share --output=json" returned: 0 in 0.174s {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:16:10 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-63ec1b08-6367-41c4-82a2-6dd5f417879e tempest-AttachVolumeNegativeTest-483083654 tempest-AttachVolumeNegativeTest-483083654-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/21faea9e6951f3bdd0153b76ac89fe1a60a34758,backing_fmt=raw /opt/stack/data/nova/instances/d9f10bfb-5202-4b4a-a42d-f167501f597b/disk 1073741824 {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:16:10 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-63ec1b08-6367-41c4-82a2-6dd5f417879e tempest-AttachVolumeNegativeTest-483083654 tempest-AttachVolumeNegativeTest-483083654-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/21faea9e6951f3bdd0153b76ac89fe1a60a34758,backing_fmt=raw /opt/stack/data/nova/instances/d9f10bfb-5202-4b4a-a42d-f167501f597b/disk 1073741824" returned: 0 in 0.056s {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:16:10 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-63ec1b08-6367-41c4-82a2-6dd5f417879e tempest-AttachVolumeNegativeTest-483083654 tempest-AttachVolumeNegativeTest-483083654-project-member] Lock "21faea9e6951f3bdd0153b76ac89fe1a60a34758" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.239s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 18:16:10 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-63ec1b08-6367-41c4-82a2-6dd5f417879e tempest-AttachVolumeNegativeTest-483083654 tempest-AttachVolumeNegativeTest-483083654-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/21faea9e6951f3bdd0153b76ac89fe1a60a34758 --force-share --output=json {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:16:10 user nova-compute[74613]: DEBUG nova.network.neutron [None req-63ec1b08-6367-41c4-82a2-6dd5f417879e tempest-AttachVolumeNegativeTest-483083654 tempest-AttachVolumeNegativeTest-483083654-project-member] [instance: d9f10bfb-5202-4b4a-a42d-f167501f597b] Successfully created port: 796b80c8-8509-4685-ac3b-6832f110bc9d {{(pid=74613) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 29 18:16:10 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-63ec1b08-6367-41c4-82a2-6dd5f417879e tempest-AttachVolumeNegativeTest-483083654 tempest-AttachVolumeNegativeTest-483083654-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/21faea9e6951f3bdd0153b76ac89fe1a60a34758 --force-share --output=json" returned: 0 in 0.182s {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:16:10 user nova-compute[74613]: DEBUG nova.virt.disk.api [None req-63ec1b08-6367-41c4-82a2-6dd5f417879e tempest-AttachVolumeNegativeTest-483083654 tempest-AttachVolumeNegativeTest-483083654-project-member] Checking if we can resize image /opt/stack/data/nova/instances/d9f10bfb-5202-4b4a-a42d-f167501f597b/disk. size=1073741824 {{(pid=74613) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 29 18:16:10 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-63ec1b08-6367-41c4-82a2-6dd5f417879e tempest-AttachVolumeNegativeTest-483083654 tempest-AttachVolumeNegativeTest-483083654-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d9f10bfb-5202-4b4a-a42d-f167501f597b/disk --force-share --output=json {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:16:10 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-63ec1b08-6367-41c4-82a2-6dd5f417879e tempest-AttachVolumeNegativeTest-483083654 tempest-AttachVolumeNegativeTest-483083654-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d9f10bfb-5202-4b4a-a42d-f167501f597b/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:16:10 user nova-compute[74613]: DEBUG nova.virt.disk.api [None req-63ec1b08-6367-41c4-82a2-6dd5f417879e tempest-AttachVolumeNegativeTest-483083654 tempest-AttachVolumeNegativeTest-483083654-project-member] Cannot resize image /opt/stack/data/nova/instances/d9f10bfb-5202-4b4a-a42d-f167501f597b/disk to a smaller size. {{(pid=74613) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 29 18:16:10 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-63ec1b08-6367-41c4-82a2-6dd5f417879e tempest-AttachVolumeNegativeTest-483083654 tempest-AttachVolumeNegativeTest-483083654-project-member] [instance: d9f10bfb-5202-4b4a-a42d-f167501f597b] Created local disks {{(pid=74613) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 29 18:16:10 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-63ec1b08-6367-41c4-82a2-6dd5f417879e tempest-AttachVolumeNegativeTest-483083654 tempest-AttachVolumeNegativeTest-483083654-project-member] [instance: d9f10bfb-5202-4b4a-a42d-f167501f597b] Ensure instance console log exists: /opt/stack/data/nova/instances/d9f10bfb-5202-4b4a-a42d-f167501f597b/console.log {{(pid=74613) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 29 18:16:10 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-63ec1b08-6367-41c4-82a2-6dd5f417879e tempest-AttachVolumeNegativeTest-483083654 tempest-AttachVolumeNegativeTest-483083654-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 18:16:10 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-63ec1b08-6367-41c4-82a2-6dd5f417879e tempest-AttachVolumeNegativeTest-483083654 tempest-AttachVolumeNegativeTest-483083654-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 18:16:10 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-63ec1b08-6367-41c4-82a2-6dd5f417879e tempest-AttachVolumeNegativeTest-483083654 tempest-AttachVolumeNegativeTest-483083654-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 18:16:10 user nova-compute[74613]: DEBUG nova.network.neutron [None req-63ec1b08-6367-41c4-82a2-6dd5f417879e tempest-AttachVolumeNegativeTest-483083654 tempest-AttachVolumeNegativeTest-483083654-project-member] [instance: d9f10bfb-5202-4b4a-a42d-f167501f597b] Successfully updated port: 796b80c8-8509-4685-ac3b-6832f110bc9d {{(pid=74613) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 29 18:16:10 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-63ec1b08-6367-41c4-82a2-6dd5f417879e tempest-AttachVolumeNegativeTest-483083654 tempest-AttachVolumeNegativeTest-483083654-project-member] Acquiring lock "refresh_cache-d9f10bfb-5202-4b4a-a42d-f167501f597b" {{(pid=74613) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 18:16:10 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-63ec1b08-6367-41c4-82a2-6dd5f417879e tempest-AttachVolumeNegativeTest-483083654 tempest-AttachVolumeNegativeTest-483083654-project-member] Acquired lock "refresh_cache-d9f10bfb-5202-4b4a-a42d-f167501f597b" {{(pid=74613) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 18:16:10 user nova-compute[74613]: DEBUG nova.network.neutron [None req-63ec1b08-6367-41c4-82a2-6dd5f417879e tempest-AttachVolumeNegativeTest-483083654 tempest-AttachVolumeNegativeTest-483083654-project-member] [instance: d9f10bfb-5202-4b4a-a42d-f167501f597b] Building network info cache for instance {{(pid=74613) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 29 18:16:10 user nova-compute[74613]: DEBUG nova.compute.manager [req-156efa85-96cf-4bae-aca0-8cbbd6a2df8c req-faf723bc-8e0e-4c68-9a90-b5e38a7cb866 service nova] [instance: d9f10bfb-5202-4b4a-a42d-f167501f597b] Received event network-changed-796b80c8-8509-4685-ac3b-6832f110bc9d {{(pid=74613) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 18:16:10 user nova-compute[74613]: DEBUG nova.compute.manager [req-156efa85-96cf-4bae-aca0-8cbbd6a2df8c req-faf723bc-8e0e-4c68-9a90-b5e38a7cb866 service nova] [instance: d9f10bfb-5202-4b4a-a42d-f167501f597b] Refreshing instance network info cache due to event network-changed-796b80c8-8509-4685-ac3b-6832f110bc9d. {{(pid=74613) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 18:16:10 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-156efa85-96cf-4bae-aca0-8cbbd6a2df8c req-faf723bc-8e0e-4c68-9a90-b5e38a7cb866 service nova] Acquiring lock "refresh_cache-d9f10bfb-5202-4b4a-a42d-f167501f597b" {{(pid=74613) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 18:16:11 user nova-compute[74613]: DEBUG nova.network.neutron [None req-63ec1b08-6367-41c4-82a2-6dd5f417879e tempest-AttachVolumeNegativeTest-483083654 tempest-AttachVolumeNegativeTest-483083654-project-member] [instance: d9f10bfb-5202-4b4a-a42d-f167501f597b] Instance cache missing network info. {{(pid=74613) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 29 18:16:11 user nova-compute[74613]: DEBUG nova.network.neutron [None req-63ec1b08-6367-41c4-82a2-6dd5f417879e tempest-AttachVolumeNegativeTest-483083654 tempest-AttachVolumeNegativeTest-483083654-project-member] [instance: d9f10bfb-5202-4b4a-a42d-f167501f597b] Updating instance_info_cache with network_info: [{"id": "796b80c8-8509-4685-ac3b-6832f110bc9d", "address": "fa:16:3e:29:a3:f5", "network": {"id": "c317481b-f8cf-40a0-a326-836a5ea4c495", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-887666255-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "37b89c13ba1d4a94805d6af69ad26fb8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap796b80c8-85", "ovs_interfaceid": "796b80c8-8509-4685-ac3b-6832f110bc9d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74613) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 18:16:11 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-63ec1b08-6367-41c4-82a2-6dd5f417879e tempest-AttachVolumeNegativeTest-483083654 tempest-AttachVolumeNegativeTest-483083654-project-member] Releasing lock "refresh_cache-d9f10bfb-5202-4b4a-a42d-f167501f597b" {{(pid=74613) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 18:16:11 user nova-compute[74613]: DEBUG nova.compute.manager [None req-63ec1b08-6367-41c4-82a2-6dd5f417879e tempest-AttachVolumeNegativeTest-483083654 tempest-AttachVolumeNegativeTest-483083654-project-member] [instance: d9f10bfb-5202-4b4a-a42d-f167501f597b] Instance network_info: |[{"id": "796b80c8-8509-4685-ac3b-6832f110bc9d", "address": "fa:16:3e:29:a3:f5", "network": {"id": "c317481b-f8cf-40a0-a326-836a5ea4c495", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-887666255-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "37b89c13ba1d4a94805d6af69ad26fb8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap796b80c8-85", "ovs_interfaceid": "796b80c8-8509-4685-ac3b-6832f110bc9d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74613) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 29 18:16:11 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-156efa85-96cf-4bae-aca0-8cbbd6a2df8c req-faf723bc-8e0e-4c68-9a90-b5e38a7cb866 service nova] Acquired lock "refresh_cache-d9f10bfb-5202-4b4a-a42d-f167501f597b" {{(pid=74613) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 18:16:11 user nova-compute[74613]: DEBUG nova.network.neutron [req-156efa85-96cf-4bae-aca0-8cbbd6a2df8c req-faf723bc-8e0e-4c68-9a90-b5e38a7cb866 service nova] [instance: d9f10bfb-5202-4b4a-a42d-f167501f597b] Refreshing network info cache for port 796b80c8-8509-4685-ac3b-6832f110bc9d {{(pid=74613) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 18:16:11 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-63ec1b08-6367-41c4-82a2-6dd5f417879e tempest-AttachVolumeNegativeTest-483083654 tempest-AttachVolumeNegativeTest-483083654-project-member] [instance: d9f10bfb-5202-4b4a-a42d-f167501f597b] Start _get_guest_xml network_info=[{"id": "796b80c8-8509-4685-ac3b-6832f110bc9d", "address": "fa:16:3e:29:a3:f5", "network": {"id": "c317481b-f8cf-40a0-a326-836a5ea4c495", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-887666255-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "37b89c13ba1d4a94805d6af69ad26fb8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap796b80c8-85", "ovs_interfaceid": "796b80c8-8509-4685-ac3b-6832f110bc9d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-29T17:47:38Z,direct_url=<?>,disk_format='qcow2',id=4217f428-8d9d-4ee1-9614-642d26d90c46,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='794b07cbd46a44b5865cfda741036bae',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-29T17:47:40Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'size': 0, 'device_type': 'disk', 'boot_index': 0, 'guest_format': None, 'encrypted': False, 'encryption_format': None, 'disk_bus': 'virtio', 'image_id': '4217f428-8d9d-4ee1-9614-642d26d90c46'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74613) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 29 18:16:11 user nova-compute[74613]: WARNING nova.virt.libvirt.driver [None req-63ec1b08-6367-41c4-82a2-6dd5f417879e tempest-AttachVolumeNegativeTest-483083654 tempest-AttachVolumeNegativeTest-483083654-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 18:16:11 user nova-compute[74613]: WARNING nova.virt.libvirt.driver [None req-63ec1b08-6367-41c4-82a2-6dd5f417879e tempest-AttachVolumeNegativeTest-483083654 tempest-AttachVolumeNegativeTest-483083654-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 18:16:11 user nova-compute[74613]: DEBUG nova.virt.libvirt.host [None req-63ec1b08-6367-41c4-82a2-6dd5f417879e tempest-AttachVolumeNegativeTest-483083654 tempest-AttachVolumeNegativeTest-483083654-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74613) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 29 18:16:11 user nova-compute[74613]: DEBUG nova.virt.libvirt.host [None req-63ec1b08-6367-41c4-82a2-6dd5f417879e tempest-AttachVolumeNegativeTest-483083654 tempest-AttachVolumeNegativeTest-483083654-project-member] CPU controller missing on host. {{(pid=74613) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 29 18:16:11 user nova-compute[74613]: DEBUG nova.virt.libvirt.host [None req-63ec1b08-6367-41c4-82a2-6dd5f417879e tempest-AttachVolumeNegativeTest-483083654 tempest-AttachVolumeNegativeTest-483083654-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74613) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 29 18:16:11 user nova-compute[74613]: DEBUG nova.virt.libvirt.host [None req-63ec1b08-6367-41c4-82a2-6dd5f417879e tempest-AttachVolumeNegativeTest-483083654 tempest-AttachVolumeNegativeTest-483083654-project-member] CPU controller found on host. {{(pid=74613) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 29 18:16:11 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-63ec1b08-6367-41c4-82a2-6dd5f417879e tempest-AttachVolumeNegativeTest-483083654 tempest-AttachVolumeNegativeTest-483083654-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74613) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 29 18:16:11 user nova-compute[74613]: DEBUG nova.virt.hardware [None req-63ec1b08-6367-41c4-82a2-6dd5f417879e tempest-AttachVolumeNegativeTest-483083654 tempest-AttachVolumeNegativeTest-483083654-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-29T17:47:27Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-29T17:47:38Z,direct_url=<?>,disk_format='qcow2',id=4217f428-8d9d-4ee1-9614-642d26d90c46,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='794b07cbd46a44b5865cfda741036bae',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-29T17:47:40Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74613) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 29 18:16:11 user nova-compute[74613]: DEBUG nova.virt.hardware [None req-63ec1b08-6367-41c4-82a2-6dd5f417879e tempest-AttachVolumeNegativeTest-483083654 tempest-AttachVolumeNegativeTest-483083654-project-member] Flavor limits 0:0:0 {{(pid=74613) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 29 18:16:11 user nova-compute[74613]: DEBUG nova.virt.hardware [None req-63ec1b08-6367-41c4-82a2-6dd5f417879e tempest-AttachVolumeNegativeTest-483083654 tempest-AttachVolumeNegativeTest-483083654-project-member] Image limits 0:0:0 {{(pid=74613) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 29 18:16:11 user nova-compute[74613]: DEBUG nova.virt.hardware [None req-63ec1b08-6367-41c4-82a2-6dd5f417879e tempest-AttachVolumeNegativeTest-483083654 tempest-AttachVolumeNegativeTest-483083654-project-member] Flavor pref 0:0:0 {{(pid=74613) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 29 18:16:11 user nova-compute[74613]: DEBUG nova.virt.hardware [None req-63ec1b08-6367-41c4-82a2-6dd5f417879e tempest-AttachVolumeNegativeTest-483083654 tempest-AttachVolumeNegativeTest-483083654-project-member] Image pref 0:0:0 {{(pid=74613) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 29 18:16:11 user nova-compute[74613]: DEBUG nova.virt.hardware [None req-63ec1b08-6367-41c4-82a2-6dd5f417879e tempest-AttachVolumeNegativeTest-483083654 tempest-AttachVolumeNegativeTest-483083654-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74613) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 29 18:16:11 user nova-compute[74613]: DEBUG nova.virt.hardware [None req-63ec1b08-6367-41c4-82a2-6dd5f417879e tempest-AttachVolumeNegativeTest-483083654 tempest-AttachVolumeNegativeTest-483083654-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74613) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 29 18:16:11 user nova-compute[74613]: DEBUG nova.virt.hardware [None req-63ec1b08-6367-41c4-82a2-6dd5f417879e tempest-AttachVolumeNegativeTest-483083654 tempest-AttachVolumeNegativeTest-483083654-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74613) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 29 18:16:11 user nova-compute[74613]: DEBUG nova.virt.hardware [None req-63ec1b08-6367-41c4-82a2-6dd5f417879e tempest-AttachVolumeNegativeTest-483083654 tempest-AttachVolumeNegativeTest-483083654-project-member] Got 1 possible topologies {{(pid=74613) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 29 18:16:11 user nova-compute[74613]: DEBUG nova.virt.hardware [None req-63ec1b08-6367-41c4-82a2-6dd5f417879e tempest-AttachVolumeNegativeTest-483083654 tempest-AttachVolumeNegativeTest-483083654-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74613) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 29 18:16:11 user nova-compute[74613]: DEBUG nova.virt.hardware [None req-63ec1b08-6367-41c4-82a2-6dd5f417879e tempest-AttachVolumeNegativeTest-483083654 tempest-AttachVolumeNegativeTest-483083654-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74613) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 29 18:16:11 user nova-compute[74613]: DEBUG nova.virt.libvirt.vif [None req-63ec1b08-6367-41c4-82a2-6dd5f417879e tempest-AttachVolumeNegativeTest-483083654 tempest-AttachVolumeNegativeTest-483083654-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T18:16:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-806279909',display_name='tempest-AttachVolumeNegativeTest-server-806279909',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-806279909',id=40,image_ref='4217f428-8d9d-4ee1-9614-642d26d90c46',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMlYJOBz64Wm2/6I5Fa8UIaS4tEJ8gD1GzFZQM3TUBZrixsEKCT/+6PiVLIgj9vYxVXbNvlDvzfxWTszI1rHYqBksKkh7r9w0AAl7FtwHxVzRvvr+RtPF51mwJrZomz2xQ==',key_name='tempest-keypair-2080746392',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='37b89c13ba1d4a94805d6af69ad26fb8',ramdisk_id='',reservation_id='r-84zr9e26',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='4217f428-8d9d-4ee1-9614-642d26d90c46',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-483083654',owner_user_name='tempest-AttachVolumeNegativeTest-483083654-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T18:16:10Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='57b1f3743f0e4cbdae1dab9e4761511e',uuid=d9f10bfb-5202-4b4a-a42d-f167501f597b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "796b80c8-8509-4685-ac3b-6832f110bc9d", "address": "fa:16:3e:29:a3:f5", "network": {"id": "c317481b-f8cf-40a0-a326-836a5ea4c495", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-887666255-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "37b89c13ba1d4a94805d6af69ad26fb8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap796b80c8-85", "ovs_interfaceid": "796b80c8-8509-4685-ac3b-6832f110bc9d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74613) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 29 18:16:11 user nova-compute[74613]: DEBUG nova.network.os_vif_util [None req-63ec1b08-6367-41c4-82a2-6dd5f417879e tempest-AttachVolumeNegativeTest-483083654 tempest-AttachVolumeNegativeTest-483083654-project-member] Converting VIF {"id": "796b80c8-8509-4685-ac3b-6832f110bc9d", "address": "fa:16:3e:29:a3:f5", "network": {"id": "c317481b-f8cf-40a0-a326-836a5ea4c495", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-887666255-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "37b89c13ba1d4a94805d6af69ad26fb8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap796b80c8-85", "ovs_interfaceid": "796b80c8-8509-4685-ac3b-6832f110bc9d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74613) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 18:16:11 user nova-compute[74613]: DEBUG nova.network.os_vif_util [None req-63ec1b08-6367-41c4-82a2-6dd5f417879e tempest-AttachVolumeNegativeTest-483083654 tempest-AttachVolumeNegativeTest-483083654-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:29:a3:f5,bridge_name='br-int',has_traffic_filtering=True,id=796b80c8-8509-4685-ac3b-6832f110bc9d,network=Network(c317481b-f8cf-40a0-a326-836a5ea4c495),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap796b80c8-85') {{(pid=74613) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 18:16:11 user nova-compute[74613]: DEBUG nova.objects.instance [None req-63ec1b08-6367-41c4-82a2-6dd5f417879e tempest-AttachVolumeNegativeTest-483083654 tempest-AttachVolumeNegativeTest-483083654-project-member] Lazy-loading 'pci_devices' on Instance uuid d9f10bfb-5202-4b4a-a42d-f167501f597b {{(pid=74613) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 18:16:11 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-63ec1b08-6367-41c4-82a2-6dd5f417879e tempest-AttachVolumeNegativeTest-483083654 tempest-AttachVolumeNegativeTest-483083654-project-member] [instance: d9f10bfb-5202-4b4a-a42d-f167501f597b] End _get_guest_xml xml=<domain type="kvm">
Nov 29 18:16:11 user nova-compute[74613]:   <uuid>d9f10bfb-5202-4b4a-a42d-f167501f597b</uuid>
Nov 29 18:16:11 user nova-compute[74613]:   <name>instance-00000028</name>
Nov 29 18:16:11 user nova-compute[74613]:   <memory>524288</memory>
Nov 29 18:16:11 user nova-compute[74613]:   <vcpu>1</vcpu>
Nov 29 18:16:11 user nova-compute[74613]:   <metadata>
Nov 29 18:16:11 user nova-compute[74613]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 29 18:16:11 user nova-compute[74613]:       <nova:package version="0.0.0"/>
Nov 29 18:16:11 user nova-compute[74613]:       <nova:name>tempest-AttachVolumeNegativeTest-server-806279909</nova:name>
Nov 29 18:16:11 user nova-compute[74613]:       <nova:creationTime>2023-11-29 18:16:11</nova:creationTime>
Nov 29 18:16:11 user nova-compute[74613]:       <nova:flavor name="m1.tiny">
Nov 29 18:16:11 user nova-compute[74613]:         <nova:memory>512</nova:memory>
Nov 29 18:16:11 user nova-compute[74613]:         <nova:disk>1</nova:disk>
Nov 29 18:16:11 user nova-compute[74613]:         <nova:swap>0</nova:swap>
Nov 29 18:16:11 user nova-compute[74613]:         <nova:ephemeral>0</nova:ephemeral>
Nov 29 18:16:11 user nova-compute[74613]:         <nova:vcpus>1</nova:vcpus>
Nov 29 18:16:11 user nova-compute[74613]:       </nova:flavor>
Nov 29 18:16:11 user nova-compute[74613]:       <nova:owner>
Nov 29 18:16:11 user nova-compute[74613]:         <nova:user uuid="57b1f3743f0e4cbdae1dab9e4761511e">tempest-AttachVolumeNegativeTest-483083654-project-member</nova:user>
Nov 29 18:16:11 user nova-compute[74613]:         <nova:project uuid="37b89c13ba1d4a94805d6af69ad26fb8">tempest-AttachVolumeNegativeTest-483083654</nova:project>
Nov 29 18:16:11 user nova-compute[74613]:       </nova:owner>
Nov 29 18:16:11 user nova-compute[74613]:       <nova:root type="image" uuid="4217f428-8d9d-4ee1-9614-642d26d90c46"/>
Nov 29 18:16:11 user nova-compute[74613]:       <nova:ports>
Nov 29 18:16:11 user nova-compute[74613]:         <nova:port uuid="796b80c8-8509-4685-ac3b-6832f110bc9d">
Nov 29 18:16:11 user nova-compute[74613]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Nov 29 18:16:11 user nova-compute[74613]:         </nova:port>
Nov 29 18:16:11 user nova-compute[74613]:       </nova:ports>
Nov 29 18:16:11 user nova-compute[74613]:     </nova:instance>
Nov 29 18:16:11 user nova-compute[74613]:   </metadata>
Nov 29 18:16:11 user nova-compute[74613]:   <sysinfo type="smbios">
Nov 29 18:16:11 user nova-compute[74613]:     <system>
Nov 29 18:16:11 user nova-compute[74613]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 29 18:16:11 user nova-compute[74613]:       <entry name="product">OpenStack Nova</entry>
Nov 29 18:16:11 user nova-compute[74613]:       <entry name="version">0.0.0</entry>
Nov 29 18:16:11 user nova-compute[74613]:       <entry name="serial">d9f10bfb-5202-4b4a-a42d-f167501f597b</entry>
Nov 29 18:16:11 user nova-compute[74613]:       <entry name="uuid">d9f10bfb-5202-4b4a-a42d-f167501f597b</entry>
Nov 29 18:16:11 user nova-compute[74613]:       <entry name="family">Virtual Machine</entry>
Nov 29 18:16:11 user nova-compute[74613]:     </system>
Nov 29 18:16:11 user nova-compute[74613]:   </sysinfo>
Nov 29 18:16:11 user nova-compute[74613]:   <os>
Nov 29 18:16:11 user nova-compute[74613]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 29 18:16:11 user nova-compute[74613]:     <boot dev="hd"/>
Nov 29 18:16:11 user nova-compute[74613]:     <smbios mode="sysinfo"/>
Nov 29 18:16:11 user nova-compute[74613]:   </os>
Nov 29 18:16:11 user nova-compute[74613]:   <features>
Nov 29 18:16:11 user nova-compute[74613]:     <acpi/>
Nov 29 18:16:11 user nova-compute[74613]:     <apic/>
Nov 29 18:16:11 user nova-compute[74613]:     <vmcoreinfo/>
Nov 29 18:16:11 user nova-compute[74613]:   </features>
Nov 29 18:16:11 user nova-compute[74613]:   <clock offset="utc">
Nov 29 18:16:11 user nova-compute[74613]:     <timer name="pit" tickpolicy="delay"/>
Nov 29 18:16:11 user nova-compute[74613]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 29 18:16:11 user nova-compute[74613]:     <timer name="hpet" present="no"/>
Nov 29 18:16:11 user nova-compute[74613]:   </clock>
Nov 29 18:16:11 user nova-compute[74613]:   <cpu mode="custom" match="exact">
Nov 29 18:16:11 user nova-compute[74613]:     <model>Nehalem</model>
Nov 29 18:16:11 user nova-compute[74613]:     <topology sockets="1" cores="1" threads="1"/>
Nov 29 18:16:11 user nova-compute[74613]:   </cpu>
Nov 29 18:16:11 user nova-compute[74613]:   <devices>
Nov 29 18:16:11 user nova-compute[74613]:     <disk type="file" device="disk">
Nov 29 18:16:11 user nova-compute[74613]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 29 18:16:11 user nova-compute[74613]:       <source file="/opt/stack/data/nova/instances/d9f10bfb-5202-4b4a-a42d-f167501f597b/disk"/>
Nov 29 18:16:11 user nova-compute[74613]:       <target dev="vda" bus="virtio"/>
Nov 29 18:16:11 user nova-compute[74613]:     </disk>
Nov 29 18:16:11 user nova-compute[74613]:     <interface type="ethernet">
Nov 29 18:16:11 user nova-compute[74613]:       <mac address="fa:16:3e:29:a3:f5"/>
Nov 29 18:16:11 user nova-compute[74613]:       <model type="virtio"/>
Nov 29 18:16:11 user nova-compute[74613]:       <mtu size="1442"/>
Nov 29 18:16:11 user nova-compute[74613]:       <target dev="tap796b80c8-85"/>
Nov 29 18:16:11 user nova-compute[74613]:     </interface>
Nov 29 18:16:11 user nova-compute[74613]:     <serial type="pty">
Nov 29 18:16:11 user nova-compute[74613]:       <log file="/opt/stack/data/nova/instances/d9f10bfb-5202-4b4a-a42d-f167501f597b/console.log" append="off"/>
Nov 29 18:16:11 user nova-compute[74613]:     </serial>
Nov 29 18:16:11 user nova-compute[74613]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 29 18:16:11 user nova-compute[74613]:     <video>
Nov 29 18:16:11 user nova-compute[74613]:       <model type="virtio"/>
Nov 29 18:16:11 user nova-compute[74613]:     </video>
Nov 29 18:16:11 user nova-compute[74613]:     <rng model="virtio">
Nov 29 18:16:11 user nova-compute[74613]:       <backend model="random">/dev/urandom</backend>
Nov 29 18:16:11 user nova-compute[74613]:     </rng>
Nov 29 18:16:11 user nova-compute[74613]:     <controller type="usb" index="0" model="none"/>
Nov 29 18:16:11 user nova-compute[74613]:     <memballoon model="virtio">
Nov 29 18:16:11 user nova-compute[74613]:       <stats period="10"/>
Nov 29 18:16:11 user nova-compute[74613]:     </memballoon>
Nov 29 18:16:11 user nova-compute[74613]:   </devices>
Nov 29 18:16:11 user nova-compute[74613]: </domain>
Nov 29 18:16:11 user nova-compute[74613]:  {{(pid=74613) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 29 18:16:11 user nova-compute[74613]: DEBUG nova.virt.libvirt.vif [None req-63ec1b08-6367-41c4-82a2-6dd5f417879e tempest-AttachVolumeNegativeTest-483083654 tempest-AttachVolumeNegativeTest-483083654-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T18:16:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-806279909',display_name='tempest-AttachVolumeNegativeTest-server-806279909',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-806279909',id=40,image_ref='4217f428-8d9d-4ee1-9614-642d26d90c46',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMlYJOBz64Wm2/6I5Fa8UIaS4tEJ8gD1GzFZQM3TUBZrixsEKCT/+6PiVLIgj9vYxVXbNvlDvzfxWTszI1rHYqBksKkh7r9w0AAl7FtwHxVzRvvr+RtPF51mwJrZomz2xQ==',key_name='tempest-keypair-2080746392',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='37b89c13ba1d4a94805d6af69ad26fb8',ramdisk_id='',reservation_id='r-84zr9e26',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='4217f428-8d9d-4ee1-9614-642d26d90c46',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-483083654',owner_user_name='tempest-AttachVolumeNegativeTest-483083654-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T18:16:10Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='57b1f3743f0e4cbdae1dab9e4761511e',uuid=d9f10bfb-5202-4b4a-a42d-f167501f597b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "796b80c8-8509-4685-ac3b-6832f110bc9d", "address": "fa:16:3e:29:a3:f5", "network": {"id": "c317481b-f8cf-40a0-a326-836a5ea4c495", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-887666255-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "37b89c13ba1d4a94805d6af69ad26fb8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap796b80c8-85", "ovs_interfaceid": "796b80c8-8509-4685-ac3b-6832f110bc9d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74613) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 29 18:16:11 user nova-compute[74613]: DEBUG nova.network.os_vif_util [None req-63ec1b08-6367-41c4-82a2-6dd5f417879e tempest-AttachVolumeNegativeTest-483083654 tempest-AttachVolumeNegativeTest-483083654-project-member] Converting VIF {"id": "796b80c8-8509-4685-ac3b-6832f110bc9d", "address": "fa:16:3e:29:a3:f5", "network": {"id": "c317481b-f8cf-40a0-a326-836a5ea4c495", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-887666255-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "37b89c13ba1d4a94805d6af69ad26fb8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap796b80c8-85", "ovs_interfaceid": "796b80c8-8509-4685-ac3b-6832f110bc9d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74613) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 18:16:11 user nova-compute[74613]: DEBUG nova.network.os_vif_util [None req-63ec1b08-6367-41c4-82a2-6dd5f417879e tempest-AttachVolumeNegativeTest-483083654 tempest-AttachVolumeNegativeTest-483083654-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:29:a3:f5,bridge_name='br-int',has_traffic_filtering=True,id=796b80c8-8509-4685-ac3b-6832f110bc9d,network=Network(c317481b-f8cf-40a0-a326-836a5ea4c495),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap796b80c8-85') {{(pid=74613) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 18:16:11 user nova-compute[74613]: DEBUG os_vif [None req-63ec1b08-6367-41c4-82a2-6dd5f417879e tempest-AttachVolumeNegativeTest-483083654 tempest-AttachVolumeNegativeTest-483083654-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:29:a3:f5,bridge_name='br-int',has_traffic_filtering=True,id=796b80c8-8509-4685-ac3b-6832f110bc9d,network=Network(c317481b-f8cf-40a0-a326-836a5ea4c495),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap796b80c8-85') {{(pid=74613) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 29 18:16:11 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:16:11 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74613) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 18:16:11 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74613) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 29 18:16:11 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:16:11 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'ebeaa551-4a00-5f19-a8e8-7d37ab0b9d36', '_type': 'linux-noop'}}, row=False) {{(pid=74613) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 18:16:11 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:16:11 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 18:16:11 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:16:11 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap796b80c8-85, may_exist=True, interface_attrs={}) {{(pid=74613) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 18:16:11 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap796b80c8-85, col_values=(('qos', UUID('2bb1cf5f-b3d6-4094-8cd8-da0f097f2c36')),), if_exists=True) {{(pid=74613) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 18:16:11 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap796b80c8-85, col_values=(('external_ids', {'iface-id': '796b80c8-8509-4685-ac3b-6832f110bc9d', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:29:a3:f5', 'vm-uuid': 'd9f10bfb-5202-4b4a-a42d-f167501f597b'}),), if_exists=True) {{(pid=74613) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 18:16:11 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:16:11 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 18:16:11 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:16:11 user nova-compute[74613]: INFO os_vif [None req-63ec1b08-6367-41c4-82a2-6dd5f417879e tempest-AttachVolumeNegativeTest-483083654 tempest-AttachVolumeNegativeTest-483083654-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:29:a3:f5,bridge_name='br-int',has_traffic_filtering=True,id=796b80c8-8509-4685-ac3b-6832f110bc9d,network=Network(c317481b-f8cf-40a0-a326-836a5ea4c495),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap796b80c8-85')
Nov 29 18:16:11 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-63ec1b08-6367-41c4-82a2-6dd5f417879e tempest-AttachVolumeNegativeTest-483083654 tempest-AttachVolumeNegativeTest-483083654-project-member] No BDM found with device name vda, not building metadata. {{(pid=74613) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 18:16:11 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-63ec1b08-6367-41c4-82a2-6dd5f417879e tempest-AttachVolumeNegativeTest-483083654 tempest-AttachVolumeNegativeTest-483083654-project-member] No VIF found with MAC fa:16:3e:29:a3:f5, not building metadata {{(pid=74613) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 29 18:16:11 user nova-compute[74613]: DEBUG nova.network.neutron [req-156efa85-96cf-4bae-aca0-8cbbd6a2df8c req-faf723bc-8e0e-4c68-9a90-b5e38a7cb866 service nova] [instance: d9f10bfb-5202-4b4a-a42d-f167501f597b] Updated VIF entry in instance network info cache for port 796b80c8-8509-4685-ac3b-6832f110bc9d. {{(pid=74613) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 18:16:11 user nova-compute[74613]: DEBUG nova.network.neutron [req-156efa85-96cf-4bae-aca0-8cbbd6a2df8c req-faf723bc-8e0e-4c68-9a90-b5e38a7cb866 service nova] [instance: d9f10bfb-5202-4b4a-a42d-f167501f597b] Updating instance_info_cache with network_info: [{"id": "796b80c8-8509-4685-ac3b-6832f110bc9d", "address": "fa:16:3e:29:a3:f5", "network": {"id": "c317481b-f8cf-40a0-a326-836a5ea4c495", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-887666255-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "37b89c13ba1d4a94805d6af69ad26fb8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap796b80c8-85", "ovs_interfaceid": "796b80c8-8509-4685-ac3b-6832f110bc9d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74613) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 18:16:11 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-156efa85-96cf-4bae-aca0-8cbbd6a2df8c req-faf723bc-8e0e-4c68-9a90-b5e38a7cb866 service nova] Releasing lock "refresh_cache-d9f10bfb-5202-4b4a-a42d-f167501f597b" {{(pid=74613) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 18:16:12 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:16:12 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:16:12 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:16:13 user nova-compute[74613]: DEBUG nova.compute.manager [req-347667d7-646c-43b8-a117-e995a4da774b req-bebbd7ee-2927-48d6-b17c-2c775c529d57 service nova] [instance: d9f10bfb-5202-4b4a-a42d-f167501f597b] Received event network-vif-plugged-796b80c8-8509-4685-ac3b-6832f110bc9d {{(pid=74613) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 18:16:13 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-347667d7-646c-43b8-a117-e995a4da774b req-bebbd7ee-2927-48d6-b17c-2c775c529d57 service nova] Acquiring lock "d9f10bfb-5202-4b4a-a42d-f167501f597b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 18:16:13 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-347667d7-646c-43b8-a117-e995a4da774b req-bebbd7ee-2927-48d6-b17c-2c775c529d57 service nova] Lock "d9f10bfb-5202-4b4a-a42d-f167501f597b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 18:16:13 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-347667d7-646c-43b8-a117-e995a4da774b req-bebbd7ee-2927-48d6-b17c-2c775c529d57 service nova] Lock "d9f10bfb-5202-4b4a-a42d-f167501f597b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 18:16:13 user nova-compute[74613]: DEBUG nova.compute.manager [req-347667d7-646c-43b8-a117-e995a4da774b req-bebbd7ee-2927-48d6-b17c-2c775c529d57 service nova] [instance: d9f10bfb-5202-4b4a-a42d-f167501f597b] No waiting events found dispatching network-vif-plugged-796b80c8-8509-4685-ac3b-6832f110bc9d {{(pid=74613) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 18:16:13 user nova-compute[74613]: WARNING nova.compute.manager [req-347667d7-646c-43b8-a117-e995a4da774b req-bebbd7ee-2927-48d6-b17c-2c775c529d57 service nova] [instance: d9f10bfb-5202-4b4a-a42d-f167501f597b] Received unexpected event network-vif-plugged-796b80c8-8509-4685-ac3b-6832f110bc9d for instance with vm_state building and task_state spawning.
Nov 29 18:16:13 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:16:13 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:16:13 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:16:14 user nova-compute[74613]: DEBUG nova.compute.manager [None req-63ec1b08-6367-41c4-82a2-6dd5f417879e tempest-AttachVolumeNegativeTest-483083654 tempest-AttachVolumeNegativeTest-483083654-project-member] [instance: d9f10bfb-5202-4b4a-a42d-f167501f597b] Instance event wait completed in 0 seconds for  {{(pid=74613) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 29 18:16:14 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-63ec1b08-6367-41c4-82a2-6dd5f417879e tempest-AttachVolumeNegativeTest-483083654 tempest-AttachVolumeNegativeTest-483083654-project-member] [instance: d9f10bfb-5202-4b4a-a42d-f167501f597b] Guest created on hypervisor {{(pid=74613) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 29 18:16:14 user nova-compute[74613]: INFO nova.virt.libvirt.driver [-] [instance: d9f10bfb-5202-4b4a-a42d-f167501f597b] Instance spawned successfully.
Nov 29 18:16:14 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-63ec1b08-6367-41c4-82a2-6dd5f417879e tempest-AttachVolumeNegativeTest-483083654 tempest-AttachVolumeNegativeTest-483083654-project-member] [instance: d9f10bfb-5202-4b4a-a42d-f167501f597b] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74613) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 29 18:16:14 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-63ec1b08-6367-41c4-82a2-6dd5f417879e tempest-AttachVolumeNegativeTest-483083654 tempest-AttachVolumeNegativeTest-483083654-project-member] [instance: d9f10bfb-5202-4b4a-a42d-f167501f597b] Found default for hw_cdrom_bus of ide {{(pid=74613) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 18:16:14 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-63ec1b08-6367-41c4-82a2-6dd5f417879e tempest-AttachVolumeNegativeTest-483083654 tempest-AttachVolumeNegativeTest-483083654-project-member] [instance: d9f10bfb-5202-4b4a-a42d-f167501f597b] Found default for hw_disk_bus of virtio {{(pid=74613) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 18:16:14 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-63ec1b08-6367-41c4-82a2-6dd5f417879e tempest-AttachVolumeNegativeTest-483083654 tempest-AttachVolumeNegativeTest-483083654-project-member] [instance: d9f10bfb-5202-4b4a-a42d-f167501f597b] Found default for hw_input_bus of None {{(pid=74613) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 18:16:14 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-63ec1b08-6367-41c4-82a2-6dd5f417879e tempest-AttachVolumeNegativeTest-483083654 tempest-AttachVolumeNegativeTest-483083654-project-member] [instance: d9f10bfb-5202-4b4a-a42d-f167501f597b] Found default for hw_pointer_model of None {{(pid=74613) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 18:16:14 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-63ec1b08-6367-41c4-82a2-6dd5f417879e tempest-AttachVolumeNegativeTest-483083654 tempest-AttachVolumeNegativeTest-483083654-project-member] [instance: d9f10bfb-5202-4b4a-a42d-f167501f597b] Found default for hw_video_model of virtio {{(pid=74613) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 18:16:14 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-63ec1b08-6367-41c4-82a2-6dd5f417879e tempest-AttachVolumeNegativeTest-483083654 tempest-AttachVolumeNegativeTest-483083654-project-member] [instance: d9f10bfb-5202-4b4a-a42d-f167501f597b] Found default for hw_vif_model of virtio {{(pid=74613) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 18:16:15 user nova-compute[74613]: DEBUG nova.compute.manager [req-3f0ee81f-3e65-4a0a-b515-b45c8b4cd50b req-4b68b22b-98e1-403c-8fd1-ac33bd91e01a service nova] [instance: d9f10bfb-5202-4b4a-a42d-f167501f597b] Received event network-vif-plugged-796b80c8-8509-4685-ac3b-6832f110bc9d {{(pid=74613) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 18:16:15 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-3f0ee81f-3e65-4a0a-b515-b45c8b4cd50b req-4b68b22b-98e1-403c-8fd1-ac33bd91e01a service nova] Acquiring lock "d9f10bfb-5202-4b4a-a42d-f167501f597b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 18:16:15 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-3f0ee81f-3e65-4a0a-b515-b45c8b4cd50b req-4b68b22b-98e1-403c-8fd1-ac33bd91e01a service nova] Lock "d9f10bfb-5202-4b4a-a42d-f167501f597b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 18:16:15 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-3f0ee81f-3e65-4a0a-b515-b45c8b4cd50b req-4b68b22b-98e1-403c-8fd1-ac33bd91e01a service nova] Lock "d9f10bfb-5202-4b4a-a42d-f167501f597b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 18:16:15 user nova-compute[74613]: DEBUG nova.compute.manager [req-3f0ee81f-3e65-4a0a-b515-b45c8b4cd50b req-4b68b22b-98e1-403c-8fd1-ac33bd91e01a service nova] [instance: d9f10bfb-5202-4b4a-a42d-f167501f597b] No waiting events found dispatching network-vif-plugged-796b80c8-8509-4685-ac3b-6832f110bc9d {{(pid=74613) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 18:16:15 user nova-compute[74613]: WARNING nova.compute.manager [req-3f0ee81f-3e65-4a0a-b515-b45c8b4cd50b req-4b68b22b-98e1-403c-8fd1-ac33bd91e01a service nova] [instance: d9f10bfb-5202-4b4a-a42d-f167501f597b] Received unexpected event network-vif-plugged-796b80c8-8509-4685-ac3b-6832f110bc9d for instance with vm_state building and task_state spawning.
Nov 29 18:16:15 user nova-compute[74613]: INFO nova.compute.manager [None req-63ec1b08-6367-41c4-82a2-6dd5f417879e tempest-AttachVolumeNegativeTest-483083654 tempest-AttachVolumeNegativeTest-483083654-project-member] [instance: d9f10bfb-5202-4b4a-a42d-f167501f597b] Took 5.25 seconds to spawn the instance on the hypervisor.
Nov 29 18:16:15 user nova-compute[74613]: DEBUG nova.compute.manager [None req-63ec1b08-6367-41c4-82a2-6dd5f417879e tempest-AttachVolumeNegativeTest-483083654 tempest-AttachVolumeNegativeTest-483083654-project-member] [instance: d9f10bfb-5202-4b4a-a42d-f167501f597b] Checking state {{(pid=74613) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 29 18:16:15 user nova-compute[74613]: INFO nova.compute.manager [None req-63ec1b08-6367-41c4-82a2-6dd5f417879e tempest-AttachVolumeNegativeTest-483083654 tempest-AttachVolumeNegativeTest-483083654-project-member] [instance: d9f10bfb-5202-4b4a-a42d-f167501f597b] Took 5.83 seconds to build instance.
Nov 29 18:16:15 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-63ec1b08-6367-41c4-82a2-6dd5f417879e tempest-AttachVolumeNegativeTest-483083654 tempest-AttachVolumeNegativeTest-483083654-project-member] Lock "d9f10bfb-5202-4b4a-a42d-f167501f597b" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 5.921s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 18:16:16 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:16:16 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:16:21 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 18:16:21 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:16:21 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74613) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 29 18:16:21 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74613) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 18:16:21 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74613) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 18:16:21 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:16:26 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:16:31 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:16:31 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:16:31 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-8b22462a-e554-44fb-96bd-96788f646710 tempest-AttachVolumeTestJSON-813984703 tempest-AttachVolumeTestJSON-813984703-project-member] Acquiring lock "b2c3eb4f-df1f-46d0-acb5-3ac9f16f9a82" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 18:16:31 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-8b22462a-e554-44fb-96bd-96788f646710 tempest-AttachVolumeTestJSON-813984703 tempest-AttachVolumeTestJSON-813984703-project-member] Lock "b2c3eb4f-df1f-46d0-acb5-3ac9f16f9a82" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 18:16:31 user nova-compute[74613]: DEBUG nova.compute.manager [None req-8b22462a-e554-44fb-96bd-96788f646710 tempest-AttachVolumeTestJSON-813984703 tempest-AttachVolumeTestJSON-813984703-project-member] [instance: b2c3eb4f-df1f-46d0-acb5-3ac9f16f9a82] Starting instance... {{(pid=74613) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 29 18:16:31 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-8b22462a-e554-44fb-96bd-96788f646710 tempest-AttachVolumeTestJSON-813984703 tempest-AttachVolumeTestJSON-813984703-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 18:16:31 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-8b22462a-e554-44fb-96bd-96788f646710 tempest-AttachVolumeTestJSON-813984703 tempest-AttachVolumeTestJSON-813984703-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 18:16:31 user nova-compute[74613]: DEBUG nova.virt.hardware [None req-8b22462a-e554-44fb-96bd-96788f646710 tempest-AttachVolumeTestJSON-813984703 tempest-AttachVolumeTestJSON-813984703-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74613) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 29 18:16:31 user nova-compute[74613]: INFO nova.compute.claims [None req-8b22462a-e554-44fb-96bd-96788f646710 tempest-AttachVolumeTestJSON-813984703 tempest-AttachVolumeTestJSON-813984703-project-member] [instance: b2c3eb4f-df1f-46d0-acb5-3ac9f16f9a82] Claim successful on node user
Nov 29 18:16:32 user nova-compute[74613]: DEBUG nova.compute.provider_tree [None req-8b22462a-e554-44fb-96bd-96788f646710 tempest-AttachVolumeTestJSON-813984703 tempest-AttachVolumeTestJSON-813984703-project-member] Inventory has not changed in ProviderTree for provider: 639d980e-3b12-44b1-b8f4-1812416fa4dd {{(pid=74613) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 18:16:32 user nova-compute[74613]: DEBUG nova.scheduler.client.report [None req-8b22462a-e554-44fb-96bd-96788f646710 tempest-AttachVolumeTestJSON-813984703 tempest-AttachVolumeTestJSON-813984703-project-member] Inventory has not changed for provider 639d980e-3b12-44b1-b8f4-1812416fa4dd based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74613) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 18:16:32 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-8b22462a-e554-44fb-96bd-96788f646710 tempest-AttachVolumeTestJSON-813984703 tempest-AttachVolumeTestJSON-813984703-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.359s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 18:16:32 user nova-compute[74613]: DEBUG nova.compute.manager [None req-8b22462a-e554-44fb-96bd-96788f646710 tempest-AttachVolumeTestJSON-813984703 tempest-AttachVolumeTestJSON-813984703-project-member] [instance: b2c3eb4f-df1f-46d0-acb5-3ac9f16f9a82] Start building networks asynchronously for instance. {{(pid=74613) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 29 18:16:32 user nova-compute[74613]: DEBUG nova.compute.manager [None req-8b22462a-e554-44fb-96bd-96788f646710 tempest-AttachVolumeTestJSON-813984703 tempest-AttachVolumeTestJSON-813984703-project-member] [instance: b2c3eb4f-df1f-46d0-acb5-3ac9f16f9a82] Allocating IP information in the background. {{(pid=74613) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 29 18:16:32 user nova-compute[74613]: DEBUG nova.network.neutron [None req-8b22462a-e554-44fb-96bd-96788f646710 tempest-AttachVolumeTestJSON-813984703 tempest-AttachVolumeTestJSON-813984703-project-member] [instance: b2c3eb4f-df1f-46d0-acb5-3ac9f16f9a82] allocate_for_instance() {{(pid=74613) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 29 18:16:32 user nova-compute[74613]: INFO nova.virt.libvirt.driver [None req-8b22462a-e554-44fb-96bd-96788f646710 tempest-AttachVolumeTestJSON-813984703 tempest-AttachVolumeTestJSON-813984703-project-member] [instance: b2c3eb4f-df1f-46d0-acb5-3ac9f16f9a82] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 29 18:16:32 user nova-compute[74613]: DEBUG nova.compute.manager [None req-8b22462a-e554-44fb-96bd-96788f646710 tempest-AttachVolumeTestJSON-813984703 tempest-AttachVolumeTestJSON-813984703-project-member] [instance: b2c3eb4f-df1f-46d0-acb5-3ac9f16f9a82] Start building block device mappings for instance. {{(pid=74613) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 29 18:16:32 user nova-compute[74613]: DEBUG nova.policy [None req-8b22462a-e554-44fb-96bd-96788f646710 tempest-AttachVolumeTestJSON-813984703 tempest-AttachVolumeTestJSON-813984703-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '14808f06536f477b8a2b413e3cf9d18f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5dc39bc30d84269a7ad073867e36436', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74613) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 29 18:16:32 user nova-compute[74613]: DEBUG nova.compute.manager [None req-8b22462a-e554-44fb-96bd-96788f646710 tempest-AttachVolumeTestJSON-813984703 tempest-AttachVolumeTestJSON-813984703-project-member] [instance: b2c3eb4f-df1f-46d0-acb5-3ac9f16f9a82] Start spawning the instance on the hypervisor. {{(pid=74613) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 29 18:16:32 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-8b22462a-e554-44fb-96bd-96788f646710 tempest-AttachVolumeTestJSON-813984703 tempest-AttachVolumeTestJSON-813984703-project-member] [instance: b2c3eb4f-df1f-46d0-acb5-3ac9f16f9a82] Creating instance directory {{(pid=74613) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 29 18:16:32 user nova-compute[74613]: INFO nova.virt.libvirt.driver [None req-8b22462a-e554-44fb-96bd-96788f646710 tempest-AttachVolumeTestJSON-813984703 tempest-AttachVolumeTestJSON-813984703-project-member] [instance: b2c3eb4f-df1f-46d0-acb5-3ac9f16f9a82] Creating image(s)
Nov 29 18:16:32 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-8b22462a-e554-44fb-96bd-96788f646710 tempest-AttachVolumeTestJSON-813984703 tempest-AttachVolumeTestJSON-813984703-project-member] Acquiring lock "/opt/stack/data/nova/instances/b2c3eb4f-df1f-46d0-acb5-3ac9f16f9a82/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 18:16:32 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-8b22462a-e554-44fb-96bd-96788f646710 tempest-AttachVolumeTestJSON-813984703 tempest-AttachVolumeTestJSON-813984703-project-member] Lock "/opt/stack/data/nova/instances/b2c3eb4f-df1f-46d0-acb5-3ac9f16f9a82/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 18:16:32 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-8b22462a-e554-44fb-96bd-96788f646710 tempest-AttachVolumeTestJSON-813984703 tempest-AttachVolumeTestJSON-813984703-project-member] Lock "/opt/stack/data/nova/instances/b2c3eb4f-df1f-46d0-acb5-3ac9f16f9a82/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 18:16:32 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-8b22462a-e554-44fb-96bd-96788f646710 tempest-AttachVolumeTestJSON-813984703 tempest-AttachVolumeTestJSON-813984703-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/21faea9e6951f3bdd0153b76ac89fe1a60a34758 --force-share --output=json {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:16:32 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-8b22462a-e554-44fb-96bd-96788f646710 tempest-AttachVolumeTestJSON-813984703 tempest-AttachVolumeTestJSON-813984703-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/21faea9e6951f3bdd0153b76ac89fe1a60a34758 --force-share --output=json" returned: 0 in 0.183s {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:16:32 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-8b22462a-e554-44fb-96bd-96788f646710 tempest-AttachVolumeTestJSON-813984703 tempest-AttachVolumeTestJSON-813984703-project-member] Acquiring lock "21faea9e6951f3bdd0153b76ac89fe1a60a34758" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 18:16:32 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-8b22462a-e554-44fb-96bd-96788f646710 tempest-AttachVolumeTestJSON-813984703 tempest-AttachVolumeTestJSON-813984703-project-member] Lock "21faea9e6951f3bdd0153b76ac89fe1a60a34758" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 18:16:32 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-8b22462a-e554-44fb-96bd-96788f646710 tempest-AttachVolumeTestJSON-813984703 tempest-AttachVolumeTestJSON-813984703-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/21faea9e6951f3bdd0153b76ac89fe1a60a34758 --force-share --output=json {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:16:32 user nova-compute[74613]: DEBUG oslo_service.periodic_task [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74613) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 18:16:32 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-8b22462a-e554-44fb-96bd-96788f646710 tempest-AttachVolumeTestJSON-813984703 tempest-AttachVolumeTestJSON-813984703-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/21faea9e6951f3bdd0153b76ac89fe1a60a34758 --force-share --output=json" returned: 0 in 0.198s {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:16:32 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-8b22462a-e554-44fb-96bd-96788f646710 tempest-AttachVolumeTestJSON-813984703 tempest-AttachVolumeTestJSON-813984703-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/21faea9e6951f3bdd0153b76ac89fe1a60a34758,backing_fmt=raw /opt/stack/data/nova/instances/b2c3eb4f-df1f-46d0-acb5-3ac9f16f9a82/disk 1073741824 {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:16:32 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-8b22462a-e554-44fb-96bd-96788f646710 tempest-AttachVolumeTestJSON-813984703 tempest-AttachVolumeTestJSON-813984703-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/21faea9e6951f3bdd0153b76ac89fe1a60a34758,backing_fmt=raw /opt/stack/data/nova/instances/b2c3eb4f-df1f-46d0-acb5-3ac9f16f9a82/disk 1073741824" returned: 0 in 0.052s {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:16:32 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-8b22462a-e554-44fb-96bd-96788f646710 tempest-AttachVolumeTestJSON-813984703 tempest-AttachVolumeTestJSON-813984703-project-member] Lock "21faea9e6951f3bdd0153b76ac89fe1a60a34758" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.256s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 18:16:32 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-8b22462a-e554-44fb-96bd-96788f646710 tempest-AttachVolumeTestJSON-813984703 tempest-AttachVolumeTestJSON-813984703-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/21faea9e6951f3bdd0153b76ac89fe1a60a34758 --force-share --output=json {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:16:32 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-8b22462a-e554-44fb-96bd-96788f646710 tempest-AttachVolumeTestJSON-813984703 tempest-AttachVolumeTestJSON-813984703-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/21faea9e6951f3bdd0153b76ac89fe1a60a34758 --force-share --output=json" returned: 0 in 0.168s {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:16:32 user nova-compute[74613]: DEBUG nova.virt.disk.api [None req-8b22462a-e554-44fb-96bd-96788f646710 tempest-AttachVolumeTestJSON-813984703 tempest-AttachVolumeTestJSON-813984703-project-member] Checking if we can resize image /opt/stack/data/nova/instances/b2c3eb4f-df1f-46d0-acb5-3ac9f16f9a82/disk. size=1073741824 {{(pid=74613) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 29 18:16:32 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-8b22462a-e554-44fb-96bd-96788f646710 tempest-AttachVolumeTestJSON-813984703 tempest-AttachVolumeTestJSON-813984703-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b2c3eb4f-df1f-46d0-acb5-3ac9f16f9a82/disk --force-share --output=json {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:16:33 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-8b22462a-e554-44fb-96bd-96788f646710 tempest-AttachVolumeTestJSON-813984703 tempest-AttachVolumeTestJSON-813984703-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b2c3eb4f-df1f-46d0-acb5-3ac9f16f9a82/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:16:33 user nova-compute[74613]: DEBUG nova.virt.disk.api [None req-8b22462a-e554-44fb-96bd-96788f646710 tempest-AttachVolumeTestJSON-813984703 tempest-AttachVolumeTestJSON-813984703-project-member] Cannot resize image /opt/stack/data/nova/instances/b2c3eb4f-df1f-46d0-acb5-3ac9f16f9a82/disk to a smaller size. {{(pid=74613) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 29 18:16:33 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-8b22462a-e554-44fb-96bd-96788f646710 tempest-AttachVolumeTestJSON-813984703 tempest-AttachVolumeTestJSON-813984703-project-member] [instance: b2c3eb4f-df1f-46d0-acb5-3ac9f16f9a82] Created local disks {{(pid=74613) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 29 18:16:33 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-8b22462a-e554-44fb-96bd-96788f646710 tempest-AttachVolumeTestJSON-813984703 tempest-AttachVolumeTestJSON-813984703-project-member] [instance: b2c3eb4f-df1f-46d0-acb5-3ac9f16f9a82] Ensure instance console log exists: /opt/stack/data/nova/instances/b2c3eb4f-df1f-46d0-acb5-3ac9f16f9a82/console.log {{(pid=74613) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 29 18:16:33 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-8b22462a-e554-44fb-96bd-96788f646710 tempest-AttachVolumeTestJSON-813984703 tempest-AttachVolumeTestJSON-813984703-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 18:16:33 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-8b22462a-e554-44fb-96bd-96788f646710 tempest-AttachVolumeTestJSON-813984703 tempest-AttachVolumeTestJSON-813984703-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 18:16:33 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-8b22462a-e554-44fb-96bd-96788f646710 tempest-AttachVolumeTestJSON-813984703 tempest-AttachVolumeTestJSON-813984703-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 18:16:33 user nova-compute[74613]: DEBUG nova.network.neutron [None req-8b22462a-e554-44fb-96bd-96788f646710 tempest-AttachVolumeTestJSON-813984703 tempest-AttachVolumeTestJSON-813984703-project-member] [instance: b2c3eb4f-df1f-46d0-acb5-3ac9f16f9a82] Successfully created port: d2959064-4006-4ab9-b71f-f6a391cbffcf {{(pid=74613) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 29 18:16:33 user nova-compute[74613]: DEBUG nova.network.neutron [None req-8b22462a-e554-44fb-96bd-96788f646710 tempest-AttachVolumeTestJSON-813984703 tempest-AttachVolumeTestJSON-813984703-project-member] [instance: b2c3eb4f-df1f-46d0-acb5-3ac9f16f9a82] Successfully updated port: d2959064-4006-4ab9-b71f-f6a391cbffcf {{(pid=74613) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 29 18:16:33 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-8b22462a-e554-44fb-96bd-96788f646710 tempest-AttachVolumeTestJSON-813984703 tempest-AttachVolumeTestJSON-813984703-project-member] Acquiring lock "refresh_cache-b2c3eb4f-df1f-46d0-acb5-3ac9f16f9a82" {{(pid=74613) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 18:16:33 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-8b22462a-e554-44fb-96bd-96788f646710 tempest-AttachVolumeTestJSON-813984703 tempest-AttachVolumeTestJSON-813984703-project-member] Acquired lock "refresh_cache-b2c3eb4f-df1f-46d0-acb5-3ac9f16f9a82" {{(pid=74613) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 18:16:33 user nova-compute[74613]: DEBUG nova.network.neutron [None req-8b22462a-e554-44fb-96bd-96788f646710 tempest-AttachVolumeTestJSON-813984703 tempest-AttachVolumeTestJSON-813984703-project-member] [instance: b2c3eb4f-df1f-46d0-acb5-3ac9f16f9a82] Building network info cache for instance {{(pid=74613) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 29 18:16:33 user nova-compute[74613]: DEBUG nova.compute.manager [req-711d81e4-59cc-46ee-8310-d7ba97ed8741 req-cb7594e7-bfbe-40d6-abbb-4a84ca717415 service nova] [instance: b2c3eb4f-df1f-46d0-acb5-3ac9f16f9a82] Received event network-changed-d2959064-4006-4ab9-b71f-f6a391cbffcf {{(pid=74613) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 18:16:33 user nova-compute[74613]: DEBUG nova.compute.manager [req-711d81e4-59cc-46ee-8310-d7ba97ed8741 req-cb7594e7-bfbe-40d6-abbb-4a84ca717415 service nova] [instance: b2c3eb4f-df1f-46d0-acb5-3ac9f16f9a82] Refreshing instance network info cache due to event network-changed-d2959064-4006-4ab9-b71f-f6a391cbffcf. {{(pid=74613) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 18:16:33 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-711d81e4-59cc-46ee-8310-d7ba97ed8741 req-cb7594e7-bfbe-40d6-abbb-4a84ca717415 service nova] Acquiring lock "refresh_cache-b2c3eb4f-df1f-46d0-acb5-3ac9f16f9a82" {{(pid=74613) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 18:16:33 user nova-compute[74613]: DEBUG nova.network.neutron [None req-8b22462a-e554-44fb-96bd-96788f646710 tempest-AttachVolumeTestJSON-813984703 tempest-AttachVolumeTestJSON-813984703-project-member] [instance: b2c3eb4f-df1f-46d0-acb5-3ac9f16f9a82] Instance cache missing network info. {{(pid=74613) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 29 18:16:34 user nova-compute[74613]: DEBUG nova.network.neutron [None req-8b22462a-e554-44fb-96bd-96788f646710 tempest-AttachVolumeTestJSON-813984703 tempest-AttachVolumeTestJSON-813984703-project-member] [instance: b2c3eb4f-df1f-46d0-acb5-3ac9f16f9a82] Updating instance_info_cache with network_info: [{"id": "d2959064-4006-4ab9-b71f-f6a391cbffcf", "address": "fa:16:3e:4d:ba:5c", "network": {"id": "21147bc8-b1ac-40d5-8fc0-8dab8ade1ff5", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1502381061-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b5dc39bc30d84269a7ad073867e36436", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd2959064-40", "ovs_interfaceid": "d2959064-4006-4ab9-b71f-f6a391cbffcf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74613) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 18:16:34 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-8b22462a-e554-44fb-96bd-96788f646710 tempest-AttachVolumeTestJSON-813984703 tempest-AttachVolumeTestJSON-813984703-project-member] Releasing lock "refresh_cache-b2c3eb4f-df1f-46d0-acb5-3ac9f16f9a82" {{(pid=74613) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 18:16:34 user nova-compute[74613]: DEBUG nova.compute.manager [None req-8b22462a-e554-44fb-96bd-96788f646710 tempest-AttachVolumeTestJSON-813984703 tempest-AttachVolumeTestJSON-813984703-project-member] [instance: b2c3eb4f-df1f-46d0-acb5-3ac9f16f9a82] Instance network_info: |[{"id": "d2959064-4006-4ab9-b71f-f6a391cbffcf", "address": "fa:16:3e:4d:ba:5c", "network": {"id": "21147bc8-b1ac-40d5-8fc0-8dab8ade1ff5", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1502381061-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b5dc39bc30d84269a7ad073867e36436", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd2959064-40", "ovs_interfaceid": "d2959064-4006-4ab9-b71f-f6a391cbffcf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74613) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 29 18:16:34 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-711d81e4-59cc-46ee-8310-d7ba97ed8741 req-cb7594e7-bfbe-40d6-abbb-4a84ca717415 service nova] Acquired lock "refresh_cache-b2c3eb4f-df1f-46d0-acb5-3ac9f16f9a82" {{(pid=74613) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 18:16:34 user nova-compute[74613]: DEBUG nova.network.neutron [req-711d81e4-59cc-46ee-8310-d7ba97ed8741 req-cb7594e7-bfbe-40d6-abbb-4a84ca717415 service nova] [instance: b2c3eb4f-df1f-46d0-acb5-3ac9f16f9a82] Refreshing network info cache for port d2959064-4006-4ab9-b71f-f6a391cbffcf {{(pid=74613) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 18:16:34 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-8b22462a-e554-44fb-96bd-96788f646710 tempest-AttachVolumeTestJSON-813984703 tempest-AttachVolumeTestJSON-813984703-project-member] [instance: b2c3eb4f-df1f-46d0-acb5-3ac9f16f9a82] Start _get_guest_xml network_info=[{"id": "d2959064-4006-4ab9-b71f-f6a391cbffcf", "address": "fa:16:3e:4d:ba:5c", "network": {"id": "21147bc8-b1ac-40d5-8fc0-8dab8ade1ff5", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1502381061-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b5dc39bc30d84269a7ad073867e36436", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd2959064-40", "ovs_interfaceid": "d2959064-4006-4ab9-b71f-f6a391cbffcf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-29T17:47:38Z,direct_url=<?>,disk_format='qcow2',id=4217f428-8d9d-4ee1-9614-642d26d90c46,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='794b07cbd46a44b5865cfda741036bae',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-29T17:47:40Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'size': 0, 'device_type': 'disk', 'boot_index': 0, 'guest_format': None, 'encrypted': False, 'encryption_format': None, 'disk_bus': 'virtio', 'image_id': '4217f428-8d9d-4ee1-9614-642d26d90c46'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74613) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 29 18:16:34 user nova-compute[74613]: WARNING nova.virt.libvirt.driver [None req-8b22462a-e554-44fb-96bd-96788f646710 tempest-AttachVolumeTestJSON-813984703 tempest-AttachVolumeTestJSON-813984703-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 18:16:34 user nova-compute[74613]: WARNING nova.virt.libvirt.driver [None req-8b22462a-e554-44fb-96bd-96788f646710 tempest-AttachVolumeTestJSON-813984703 tempest-AttachVolumeTestJSON-813984703-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 18:16:34 user nova-compute[74613]: DEBUG nova.virt.libvirt.host [None req-8b22462a-e554-44fb-96bd-96788f646710 tempest-AttachVolumeTestJSON-813984703 tempest-AttachVolumeTestJSON-813984703-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74613) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 29 18:16:34 user nova-compute[74613]: DEBUG nova.virt.libvirt.host [None req-8b22462a-e554-44fb-96bd-96788f646710 tempest-AttachVolumeTestJSON-813984703 tempest-AttachVolumeTestJSON-813984703-project-member] CPU controller missing on host. {{(pid=74613) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 29 18:16:34 user nova-compute[74613]: DEBUG nova.virt.libvirt.host [None req-8b22462a-e554-44fb-96bd-96788f646710 tempest-AttachVolumeTestJSON-813984703 tempest-AttachVolumeTestJSON-813984703-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74613) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 29 18:16:34 user nova-compute[74613]: DEBUG nova.virt.libvirt.host [None req-8b22462a-e554-44fb-96bd-96788f646710 tempest-AttachVolumeTestJSON-813984703 tempest-AttachVolumeTestJSON-813984703-project-member] CPU controller found on host. {{(pid=74613) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 29 18:16:34 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-8b22462a-e554-44fb-96bd-96788f646710 tempest-AttachVolumeTestJSON-813984703 tempest-AttachVolumeTestJSON-813984703-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74613) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 29 18:16:34 user nova-compute[74613]: DEBUG nova.virt.hardware [None req-8b22462a-e554-44fb-96bd-96788f646710 tempest-AttachVolumeTestJSON-813984703 tempest-AttachVolumeTestJSON-813984703-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-29T17:47:27Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-29T17:47:38Z,direct_url=<?>,disk_format='qcow2',id=4217f428-8d9d-4ee1-9614-642d26d90c46,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='794b07cbd46a44b5865cfda741036bae',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-29T17:47:40Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74613) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 29 18:16:34 user nova-compute[74613]: DEBUG nova.virt.hardware [None req-8b22462a-e554-44fb-96bd-96788f646710 tempest-AttachVolumeTestJSON-813984703 tempest-AttachVolumeTestJSON-813984703-project-member] Flavor limits 0:0:0 {{(pid=74613) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 29 18:16:34 user nova-compute[74613]: DEBUG nova.virt.hardware [None req-8b22462a-e554-44fb-96bd-96788f646710 tempest-AttachVolumeTestJSON-813984703 tempest-AttachVolumeTestJSON-813984703-project-member] Image limits 0:0:0 {{(pid=74613) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 29 18:16:34 user nova-compute[74613]: DEBUG nova.virt.hardware [None req-8b22462a-e554-44fb-96bd-96788f646710 tempest-AttachVolumeTestJSON-813984703 tempest-AttachVolumeTestJSON-813984703-project-member] Flavor pref 0:0:0 {{(pid=74613) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 29 18:16:34 user nova-compute[74613]: DEBUG nova.virt.hardware [None req-8b22462a-e554-44fb-96bd-96788f646710 tempest-AttachVolumeTestJSON-813984703 tempest-AttachVolumeTestJSON-813984703-project-member] Image pref 0:0:0 {{(pid=74613) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 29 18:16:34 user nova-compute[74613]: DEBUG nova.virt.hardware [None req-8b22462a-e554-44fb-96bd-96788f646710 tempest-AttachVolumeTestJSON-813984703 tempest-AttachVolumeTestJSON-813984703-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74613) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 29 18:16:34 user nova-compute[74613]: DEBUG nova.virt.hardware [None req-8b22462a-e554-44fb-96bd-96788f646710 tempest-AttachVolumeTestJSON-813984703 tempest-AttachVolumeTestJSON-813984703-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74613) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 29 18:16:34 user nova-compute[74613]: DEBUG nova.virt.hardware [None req-8b22462a-e554-44fb-96bd-96788f646710 tempest-AttachVolumeTestJSON-813984703 tempest-AttachVolumeTestJSON-813984703-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74613) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 29 18:16:34 user nova-compute[74613]: DEBUG nova.virt.hardware [None req-8b22462a-e554-44fb-96bd-96788f646710 tempest-AttachVolumeTestJSON-813984703 tempest-AttachVolumeTestJSON-813984703-project-member] Got 1 possible topologies {{(pid=74613) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 29 18:16:34 user nova-compute[74613]: DEBUG nova.virt.hardware [None req-8b22462a-e554-44fb-96bd-96788f646710 tempest-AttachVolumeTestJSON-813984703 tempest-AttachVolumeTestJSON-813984703-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74613) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 29 18:16:34 user nova-compute[74613]: DEBUG nova.virt.hardware [None req-8b22462a-e554-44fb-96bd-96788f646710 tempest-AttachVolumeTestJSON-813984703 tempest-AttachVolumeTestJSON-813984703-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74613) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 29 18:16:34 user nova-compute[74613]: DEBUG nova.virt.libvirt.vif [None req-8b22462a-e554-44fb-96bd-96788f646710 tempest-AttachVolumeTestJSON-813984703 tempest-AttachVolumeTestJSON-813984703-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T18:16:31Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-373129504',display_name='tempest-AttachVolumeTestJSON-server-373129504',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-373129504',id=41,image_ref='4217f428-8d9d-4ee1-9614-642d26d90c46',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMySlviB2/wALpHmBnkFRvVz+D0DjciNjbWazEDlnUkezbm7EUGMgPEN6igBxid/jqpeuxxCe/TMFczNx3o5Rh5Oacj6fj/BIq5winKQr76MzAVjsrs0ukh3Vt2Fzwkg/g==',key_name='tempest-keypair-1002611988',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b5dc39bc30d84269a7ad073867e36436',ramdisk_id='',reservation_id='r-tq9c0o6r',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='4217f428-8d9d-4ee1-9614-642d26d90c46',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-813984703',owner_user_name='tempest-AttachVolumeTestJSON-813984703-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T18:16:32Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='14808f06536f477b8a2b413e3cf9d18f',uuid=b2c3eb4f-df1f-46d0-acb5-3ac9f16f9a82,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d2959064-4006-4ab9-b71f-f6a391cbffcf", "address": "fa:16:3e:4d:ba:5c", "network": {"id": "21147bc8-b1ac-40d5-8fc0-8dab8ade1ff5", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1502381061-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b5dc39bc30d84269a7ad073867e36436", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd2959064-40", "ovs_interfaceid": "d2959064-4006-4ab9-b71f-f6a391cbffcf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74613) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 29 18:16:34 user nova-compute[74613]: DEBUG nova.network.os_vif_util [None req-8b22462a-e554-44fb-96bd-96788f646710 tempest-AttachVolumeTestJSON-813984703 tempest-AttachVolumeTestJSON-813984703-project-member] Converting VIF {"id": "d2959064-4006-4ab9-b71f-f6a391cbffcf", "address": "fa:16:3e:4d:ba:5c", "network": {"id": "21147bc8-b1ac-40d5-8fc0-8dab8ade1ff5", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1502381061-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b5dc39bc30d84269a7ad073867e36436", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd2959064-40", "ovs_interfaceid": "d2959064-4006-4ab9-b71f-f6a391cbffcf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74613) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 18:16:34 user nova-compute[74613]: DEBUG nova.network.os_vif_util [None req-8b22462a-e554-44fb-96bd-96788f646710 tempest-AttachVolumeTestJSON-813984703 tempest-AttachVolumeTestJSON-813984703-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4d:ba:5c,bridge_name='br-int',has_traffic_filtering=True,id=d2959064-4006-4ab9-b71f-f6a391cbffcf,network=Network(21147bc8-b1ac-40d5-8fc0-8dab8ade1ff5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd2959064-40') {{(pid=74613) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 18:16:34 user nova-compute[74613]: DEBUG nova.objects.instance [None req-8b22462a-e554-44fb-96bd-96788f646710 tempest-AttachVolumeTestJSON-813984703 tempest-AttachVolumeTestJSON-813984703-project-member] Lazy-loading 'pci_devices' on Instance uuid b2c3eb4f-df1f-46d0-acb5-3ac9f16f9a82 {{(pid=74613) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 18:16:34 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-8b22462a-e554-44fb-96bd-96788f646710 tempest-AttachVolumeTestJSON-813984703 tempest-AttachVolumeTestJSON-813984703-project-member] [instance: b2c3eb4f-df1f-46d0-acb5-3ac9f16f9a82] End _get_guest_xml xml=<domain type="kvm">
Nov 29 18:16:34 user nova-compute[74613]:   <uuid>b2c3eb4f-df1f-46d0-acb5-3ac9f16f9a82</uuid>
Nov 29 18:16:34 user nova-compute[74613]:   <name>instance-00000029</name>
Nov 29 18:16:34 user nova-compute[74613]:   <memory>524288</memory>
Nov 29 18:16:34 user nova-compute[74613]:   <vcpu>1</vcpu>
Nov 29 18:16:34 user nova-compute[74613]:   <metadata>
Nov 29 18:16:34 user nova-compute[74613]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 29 18:16:34 user nova-compute[74613]:       <nova:package version="0.0.0"/>
Nov 29 18:16:34 user nova-compute[74613]:       <nova:name>tempest-AttachVolumeTestJSON-server-373129504</nova:name>
Nov 29 18:16:34 user nova-compute[74613]:       <nova:creationTime>2023-11-29 18:16:34</nova:creationTime>
Nov 29 18:16:34 user nova-compute[74613]:       <nova:flavor name="m1.tiny">
Nov 29 18:16:34 user nova-compute[74613]:         <nova:memory>512</nova:memory>
Nov 29 18:16:34 user nova-compute[74613]:         <nova:disk>1</nova:disk>
Nov 29 18:16:34 user nova-compute[74613]:         <nova:swap>0</nova:swap>
Nov 29 18:16:34 user nova-compute[74613]:         <nova:ephemeral>0</nova:ephemeral>
Nov 29 18:16:34 user nova-compute[74613]:         <nova:vcpus>1</nova:vcpus>
Nov 29 18:16:34 user nova-compute[74613]:       </nova:flavor>
Nov 29 18:16:34 user nova-compute[74613]:       <nova:owner>
Nov 29 18:16:34 user nova-compute[74613]:         <nova:user uuid="14808f06536f477b8a2b413e3cf9d18f">tempest-AttachVolumeTestJSON-813984703-project-member</nova:user>
Nov 29 18:16:34 user nova-compute[74613]:         <nova:project uuid="b5dc39bc30d84269a7ad073867e36436">tempest-AttachVolumeTestJSON-813984703</nova:project>
Nov 29 18:16:34 user nova-compute[74613]:       </nova:owner>
Nov 29 18:16:34 user nova-compute[74613]:       <nova:root type="image" uuid="4217f428-8d9d-4ee1-9614-642d26d90c46"/>
Nov 29 18:16:34 user nova-compute[74613]:       <nova:ports>
Nov 29 18:16:34 user nova-compute[74613]:         <nova:port uuid="d2959064-4006-4ab9-b71f-f6a391cbffcf">
Nov 29 18:16:34 user nova-compute[74613]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Nov 29 18:16:34 user nova-compute[74613]:         </nova:port>
Nov 29 18:16:34 user nova-compute[74613]:       </nova:ports>
Nov 29 18:16:34 user nova-compute[74613]:     </nova:instance>
Nov 29 18:16:34 user nova-compute[74613]:   </metadata>
Nov 29 18:16:34 user nova-compute[74613]:   <sysinfo type="smbios">
Nov 29 18:16:34 user nova-compute[74613]:     <system>
Nov 29 18:16:34 user nova-compute[74613]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 29 18:16:34 user nova-compute[74613]:       <entry name="product">OpenStack Nova</entry>
Nov 29 18:16:34 user nova-compute[74613]:       <entry name="version">0.0.0</entry>
Nov 29 18:16:34 user nova-compute[74613]:       <entry name="serial">b2c3eb4f-df1f-46d0-acb5-3ac9f16f9a82</entry>
Nov 29 18:16:34 user nova-compute[74613]:       <entry name="uuid">b2c3eb4f-df1f-46d0-acb5-3ac9f16f9a82</entry>
Nov 29 18:16:34 user nova-compute[74613]:       <entry name="family">Virtual Machine</entry>
Nov 29 18:16:34 user nova-compute[74613]:     </system>
Nov 29 18:16:34 user nova-compute[74613]:   </sysinfo>
Nov 29 18:16:34 user nova-compute[74613]:   <os>
Nov 29 18:16:34 user nova-compute[74613]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 29 18:16:34 user nova-compute[74613]:     <boot dev="hd"/>
Nov 29 18:16:34 user nova-compute[74613]:     <smbios mode="sysinfo"/>
Nov 29 18:16:34 user nova-compute[74613]:   </os>
Nov 29 18:16:34 user nova-compute[74613]:   <features>
Nov 29 18:16:34 user nova-compute[74613]:     <acpi/>
Nov 29 18:16:34 user nova-compute[74613]:     <apic/>
Nov 29 18:16:34 user nova-compute[74613]:     <vmcoreinfo/>
Nov 29 18:16:34 user nova-compute[74613]:   </features>
Nov 29 18:16:34 user nova-compute[74613]:   <clock offset="utc">
Nov 29 18:16:34 user nova-compute[74613]:     <timer name="pit" tickpolicy="delay"/>
Nov 29 18:16:34 user nova-compute[74613]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 29 18:16:34 user nova-compute[74613]:     <timer name="hpet" present="no"/>
Nov 29 18:16:34 user nova-compute[74613]:   </clock>
Nov 29 18:16:34 user nova-compute[74613]:   <cpu mode="custom" match="exact">
Nov 29 18:16:34 user nova-compute[74613]:     <model>Nehalem</model>
Nov 29 18:16:34 user nova-compute[74613]:     <topology sockets="1" cores="1" threads="1"/>
Nov 29 18:16:34 user nova-compute[74613]:   </cpu>
Nov 29 18:16:34 user nova-compute[74613]:   <devices>
Nov 29 18:16:34 user nova-compute[74613]:     <disk type="file" device="disk">
Nov 29 18:16:34 user nova-compute[74613]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 29 18:16:34 user nova-compute[74613]:       <source file="/opt/stack/data/nova/instances/b2c3eb4f-df1f-46d0-acb5-3ac9f16f9a82/disk"/>
Nov 29 18:16:34 user nova-compute[74613]:       <target dev="vda" bus="virtio"/>
Nov 29 18:16:34 user nova-compute[74613]:     </disk>
Nov 29 18:16:34 user nova-compute[74613]:     <interface type="ethernet">
Nov 29 18:16:34 user nova-compute[74613]:       <mac address="fa:16:3e:4d:ba:5c"/>
Nov 29 18:16:34 user nova-compute[74613]:       <model type="virtio"/>
Nov 29 18:16:34 user nova-compute[74613]:       <mtu size="1442"/>
Nov 29 18:16:34 user nova-compute[74613]:       <target dev="tapd2959064-40"/>
Nov 29 18:16:34 user nova-compute[74613]:     </interface>
Nov 29 18:16:34 user nova-compute[74613]:     <serial type="pty">
Nov 29 18:16:34 user nova-compute[74613]:       <log file="/opt/stack/data/nova/instances/b2c3eb4f-df1f-46d0-acb5-3ac9f16f9a82/console.log" append="off"/>
Nov 29 18:16:34 user nova-compute[74613]:     </serial>
Nov 29 18:16:34 user nova-compute[74613]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 29 18:16:34 user nova-compute[74613]:     <video>
Nov 29 18:16:34 user nova-compute[74613]:       <model type="virtio"/>
Nov 29 18:16:34 user nova-compute[74613]:     </video>
Nov 29 18:16:34 user nova-compute[74613]:     <rng model="virtio">
Nov 29 18:16:34 user nova-compute[74613]:       <backend model="random">/dev/urandom</backend>
Nov 29 18:16:34 user nova-compute[74613]:     </rng>
Nov 29 18:16:34 user nova-compute[74613]:     <controller type="usb" index="0" model="none"/>
Nov 29 18:16:34 user nova-compute[74613]:     <memballoon model="virtio">
Nov 29 18:16:34 user nova-compute[74613]:       <stats period="10"/>
Nov 29 18:16:34 user nova-compute[74613]:     </memballoon>
Nov 29 18:16:34 user nova-compute[74613]:   </devices>
Nov 29 18:16:34 user nova-compute[74613]: </domain>
Nov 29 18:16:34 user nova-compute[74613]:  {{(pid=74613) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 29 18:16:34 user nova-compute[74613]: DEBUG nova.virt.libvirt.vif [None req-8b22462a-e554-44fb-96bd-96788f646710 tempest-AttachVolumeTestJSON-813984703 tempest-AttachVolumeTestJSON-813984703-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T18:16:31Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-373129504',display_name='tempest-AttachVolumeTestJSON-server-373129504',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-373129504',id=41,image_ref='4217f428-8d9d-4ee1-9614-642d26d90c46',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMySlviB2/wALpHmBnkFRvVz+D0DjciNjbWazEDlnUkezbm7EUGMgPEN6igBxid/jqpeuxxCe/TMFczNx3o5Rh5Oacj6fj/BIq5winKQr76MzAVjsrs0ukh3Vt2Fzwkg/g==',key_name='tempest-keypair-1002611988',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b5dc39bc30d84269a7ad073867e36436',ramdisk_id='',reservation_id='r-tq9c0o6r',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='4217f428-8d9d-4ee1-9614-642d26d90c46',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-813984703',owner_user_name='tempest-AttachVolumeTestJSON-813984703-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T18:16:32Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='14808f06536f477b8a2b413e3cf9d18f',uuid=b2c3eb4f-df1f-46d0-acb5-3ac9f16f9a82,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d2959064-4006-4ab9-b71f-f6a391cbffcf", "address": "fa:16:3e:4d:ba:5c", "network": {"id": "21147bc8-b1ac-40d5-8fc0-8dab8ade1ff5", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1502381061-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b5dc39bc30d84269a7ad073867e36436", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd2959064-40", "ovs_interfaceid": "d2959064-4006-4ab9-b71f-f6a391cbffcf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74613) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 29 18:16:34 user nova-compute[74613]: DEBUG nova.network.os_vif_util [None req-8b22462a-e554-44fb-96bd-96788f646710 tempest-AttachVolumeTestJSON-813984703 tempest-AttachVolumeTestJSON-813984703-project-member] Converting VIF {"id": "d2959064-4006-4ab9-b71f-f6a391cbffcf", "address": "fa:16:3e:4d:ba:5c", "network": {"id": "21147bc8-b1ac-40d5-8fc0-8dab8ade1ff5", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1502381061-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b5dc39bc30d84269a7ad073867e36436", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd2959064-40", "ovs_interfaceid": "d2959064-4006-4ab9-b71f-f6a391cbffcf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74613) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 18:16:34 user nova-compute[74613]: DEBUG nova.network.os_vif_util [None req-8b22462a-e554-44fb-96bd-96788f646710 tempest-AttachVolumeTestJSON-813984703 tempest-AttachVolumeTestJSON-813984703-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4d:ba:5c,bridge_name='br-int',has_traffic_filtering=True,id=d2959064-4006-4ab9-b71f-f6a391cbffcf,network=Network(21147bc8-b1ac-40d5-8fc0-8dab8ade1ff5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd2959064-40') {{(pid=74613) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 18:16:34 user nova-compute[74613]: DEBUG os_vif [None req-8b22462a-e554-44fb-96bd-96788f646710 tempest-AttachVolumeTestJSON-813984703 tempest-AttachVolumeTestJSON-813984703-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:4d:ba:5c,bridge_name='br-int',has_traffic_filtering=True,id=d2959064-4006-4ab9-b71f-f6a391cbffcf,network=Network(21147bc8-b1ac-40d5-8fc0-8dab8ade1ff5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd2959064-40') {{(pid=74613) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 29 18:16:34 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:16:34 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74613) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 18:16:34 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74613) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 29 18:16:34 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:16:34 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'b0397bd6-8a00-5c11-819e-1a1100575cd5', '_type': 'linux-noop'}}, row=False) {{(pid=74613) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 18:16:34 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:16:34 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 18:16:34 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:16:34 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapd2959064-40, may_exist=True, interface_attrs={}) {{(pid=74613) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 18:16:34 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapd2959064-40, col_values=(('qos', UUID('fe049fc6-1a46-44a9-b0c6-98b55fc05f5b')),), if_exists=True) {{(pid=74613) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 18:16:34 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapd2959064-40, col_values=(('external_ids', {'iface-id': 'd2959064-4006-4ab9-b71f-f6a391cbffcf', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:4d:ba:5c', 'vm-uuid': 'b2c3eb4f-df1f-46d0-acb5-3ac9f16f9a82'}),), if_exists=True) {{(pid=74613) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 18:16:34 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:16:34 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 18:16:34 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:16:34 user nova-compute[74613]: INFO os_vif [None req-8b22462a-e554-44fb-96bd-96788f646710 tempest-AttachVolumeTestJSON-813984703 tempest-AttachVolumeTestJSON-813984703-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:4d:ba:5c,bridge_name='br-int',has_traffic_filtering=True,id=d2959064-4006-4ab9-b71f-f6a391cbffcf,network=Network(21147bc8-b1ac-40d5-8fc0-8dab8ade1ff5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd2959064-40')
Nov 29 18:16:34 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-8b22462a-e554-44fb-96bd-96788f646710 tempest-AttachVolumeTestJSON-813984703 tempest-AttachVolumeTestJSON-813984703-project-member] No BDM found with device name vda, not building metadata. {{(pid=74613) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 18:16:34 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-8b22462a-e554-44fb-96bd-96788f646710 tempest-AttachVolumeTestJSON-813984703 tempest-AttachVolumeTestJSON-813984703-project-member] No VIF found with MAC fa:16:3e:4d:ba:5c, not building metadata {{(pid=74613) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 29 18:16:34 user nova-compute[74613]: DEBUG nova.network.neutron [req-711d81e4-59cc-46ee-8310-d7ba97ed8741 req-cb7594e7-bfbe-40d6-abbb-4a84ca717415 service nova] [instance: b2c3eb4f-df1f-46d0-acb5-3ac9f16f9a82] Updated VIF entry in instance network info cache for port d2959064-4006-4ab9-b71f-f6a391cbffcf. {{(pid=74613) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 18:16:34 user nova-compute[74613]: DEBUG nova.network.neutron [req-711d81e4-59cc-46ee-8310-d7ba97ed8741 req-cb7594e7-bfbe-40d6-abbb-4a84ca717415 service nova] [instance: b2c3eb4f-df1f-46d0-acb5-3ac9f16f9a82] Updating instance_info_cache with network_info: [{"id": "d2959064-4006-4ab9-b71f-f6a391cbffcf", "address": "fa:16:3e:4d:ba:5c", "network": {"id": "21147bc8-b1ac-40d5-8fc0-8dab8ade1ff5", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1502381061-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b5dc39bc30d84269a7ad073867e36436", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd2959064-40", "ovs_interfaceid": "d2959064-4006-4ab9-b71f-f6a391cbffcf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74613) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 18:16:34 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-711d81e4-59cc-46ee-8310-d7ba97ed8741 req-cb7594e7-bfbe-40d6-abbb-4a84ca717415 service nova] Releasing lock "refresh_cache-b2c3eb4f-df1f-46d0-acb5-3ac9f16f9a82" {{(pid=74613) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 18:16:35 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:16:35 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:16:35 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:16:35 user nova-compute[74613]: DEBUG nova.compute.manager [req-7f091def-b3d4-4190-9013-e2b6da9a36ce req-6f675095-4c16-44c1-a407-e073bcaba392 service nova] [instance: b2c3eb4f-df1f-46d0-acb5-3ac9f16f9a82] Received event network-vif-plugged-d2959064-4006-4ab9-b71f-f6a391cbffcf {{(pid=74613) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 18:16:35 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-7f091def-b3d4-4190-9013-e2b6da9a36ce req-6f675095-4c16-44c1-a407-e073bcaba392 service nova] Acquiring lock "b2c3eb4f-df1f-46d0-acb5-3ac9f16f9a82-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 18:16:35 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-7f091def-b3d4-4190-9013-e2b6da9a36ce req-6f675095-4c16-44c1-a407-e073bcaba392 service nova] Lock "b2c3eb4f-df1f-46d0-acb5-3ac9f16f9a82-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 18:16:35 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-7f091def-b3d4-4190-9013-e2b6da9a36ce req-6f675095-4c16-44c1-a407-e073bcaba392 service nova] Lock "b2c3eb4f-df1f-46d0-acb5-3ac9f16f9a82-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 18:16:35 user nova-compute[74613]: DEBUG nova.compute.manager [req-7f091def-b3d4-4190-9013-e2b6da9a36ce req-6f675095-4c16-44c1-a407-e073bcaba392 service nova] [instance: b2c3eb4f-df1f-46d0-acb5-3ac9f16f9a82] No waiting events found dispatching network-vif-plugged-d2959064-4006-4ab9-b71f-f6a391cbffcf {{(pid=74613) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 18:16:35 user nova-compute[74613]: WARNING nova.compute.manager [req-7f091def-b3d4-4190-9013-e2b6da9a36ce req-6f675095-4c16-44c1-a407-e073bcaba392 service nova] [instance: b2c3eb4f-df1f-46d0-acb5-3ac9f16f9a82] Received unexpected event network-vif-plugged-d2959064-4006-4ab9-b71f-f6a391cbffcf for instance with vm_state building and task_state spawning.
Nov 29 18:16:36 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:16:36 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:16:36 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:16:36 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:16:36 user nova-compute[74613]: DEBUG oslo_service.periodic_task [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74613) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 18:16:36 user nova-compute[74613]: DEBUG oslo_service.periodic_task [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74613) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 18:16:36 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 18:16:36 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 18:16:36 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 18:16:36 user nova-compute[74613]: DEBUG nova.compute.resource_tracker [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Auditing locally available compute resources for user (node: user) {{(pid=74613) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 29 18:16:37 user nova-compute[74613]: DEBUG nova.compute.manager [req-11bcf609-5273-44be-900b-a8e8a3d1142c req-25436846-0f06-430b-aea1-e3a9ee385834 service nova] [instance: b2c3eb4f-df1f-46d0-acb5-3ac9f16f9a82] Received event network-vif-plugged-d2959064-4006-4ab9-b71f-f6a391cbffcf {{(pid=74613) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 18:16:37 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-11bcf609-5273-44be-900b-a8e8a3d1142c req-25436846-0f06-430b-aea1-e3a9ee385834 service nova] Acquiring lock "b2c3eb4f-df1f-46d0-acb5-3ac9f16f9a82-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 18:16:37 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-11bcf609-5273-44be-900b-a8e8a3d1142c req-25436846-0f06-430b-aea1-e3a9ee385834 service nova] Lock "b2c3eb4f-df1f-46d0-acb5-3ac9f16f9a82-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 18:16:37 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-11bcf609-5273-44be-900b-a8e8a3d1142c req-25436846-0f06-430b-aea1-e3a9ee385834 service nova] Lock "b2c3eb4f-df1f-46d0-acb5-3ac9f16f9a82-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 18:16:37 user nova-compute[74613]: DEBUG nova.compute.manager [req-11bcf609-5273-44be-900b-a8e8a3d1142c req-25436846-0f06-430b-aea1-e3a9ee385834 service nova] [instance: b2c3eb4f-df1f-46d0-acb5-3ac9f16f9a82] No waiting events found dispatching network-vif-plugged-d2959064-4006-4ab9-b71f-f6a391cbffcf {{(pid=74613) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 18:16:37 user nova-compute[74613]: WARNING nova.compute.manager [req-11bcf609-5273-44be-900b-a8e8a3d1142c req-25436846-0f06-430b-aea1-e3a9ee385834 service nova] [instance: b2c3eb4f-df1f-46d0-acb5-3ac9f16f9a82] Received unexpected event network-vif-plugged-d2959064-4006-4ab9-b71f-f6a391cbffcf for instance with vm_state building and task_state spawning.
Nov 29 18:16:38 user nova-compute[74613]: DEBUG nova.compute.manager [None req-8b22462a-e554-44fb-96bd-96788f646710 tempest-AttachVolumeTestJSON-813984703 tempest-AttachVolumeTestJSON-813984703-project-member] [instance: b2c3eb4f-df1f-46d0-acb5-3ac9f16f9a82] Instance event wait completed in 0 seconds for  {{(pid=74613) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 29 18:16:38 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-8b22462a-e554-44fb-96bd-96788f646710 tempest-AttachVolumeTestJSON-813984703 tempest-AttachVolumeTestJSON-813984703-project-member] [instance: b2c3eb4f-df1f-46d0-acb5-3ac9f16f9a82] Guest created on hypervisor {{(pid=74613) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 29 18:16:38 user nova-compute[74613]: INFO nova.virt.libvirt.driver [-] [instance: b2c3eb4f-df1f-46d0-acb5-3ac9f16f9a82] Instance spawned successfully.
Nov 29 18:16:38 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-8b22462a-e554-44fb-96bd-96788f646710 tempest-AttachVolumeTestJSON-813984703 tempest-AttachVolumeTestJSON-813984703-project-member] [instance: b2c3eb4f-df1f-46d0-acb5-3ac9f16f9a82] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74613) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 29 18:16:38 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-8b22462a-e554-44fb-96bd-96788f646710 tempest-AttachVolumeTestJSON-813984703 tempest-AttachVolumeTestJSON-813984703-project-member] [instance: b2c3eb4f-df1f-46d0-acb5-3ac9f16f9a82] Found default for hw_cdrom_bus of ide {{(pid=74613) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 18:16:38 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-8b22462a-e554-44fb-96bd-96788f646710 tempest-AttachVolumeTestJSON-813984703 tempest-AttachVolumeTestJSON-813984703-project-member] [instance: b2c3eb4f-df1f-46d0-acb5-3ac9f16f9a82] Found default for hw_disk_bus of virtio {{(pid=74613) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 18:16:38 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-8b22462a-e554-44fb-96bd-96788f646710 tempest-AttachVolumeTestJSON-813984703 tempest-AttachVolumeTestJSON-813984703-project-member] [instance: b2c3eb4f-df1f-46d0-acb5-3ac9f16f9a82] Found default for hw_input_bus of None {{(pid=74613) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 18:16:38 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-8b22462a-e554-44fb-96bd-96788f646710 tempest-AttachVolumeTestJSON-813984703 tempest-AttachVolumeTestJSON-813984703-project-member] [instance: b2c3eb4f-df1f-46d0-acb5-3ac9f16f9a82] Found default for hw_pointer_model of None {{(pid=74613) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 18:16:38 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-8b22462a-e554-44fb-96bd-96788f646710 tempest-AttachVolumeTestJSON-813984703 tempest-AttachVolumeTestJSON-813984703-project-member] [instance: b2c3eb4f-df1f-46d0-acb5-3ac9f16f9a82] Found default for hw_video_model of virtio {{(pid=74613) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 18:16:38 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-8b22462a-e554-44fb-96bd-96788f646710 tempest-AttachVolumeTestJSON-813984703 tempest-AttachVolumeTestJSON-813984703-project-member] [instance: b2c3eb4f-df1f-46d0-acb5-3ac9f16f9a82] Found default for hw_vif_model of virtio {{(pid=74613) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 18:16:38 user nova-compute[74613]: INFO nova.compute.manager [None req-8b22462a-e554-44fb-96bd-96788f646710 tempest-AttachVolumeTestJSON-813984703 tempest-AttachVolumeTestJSON-813984703-project-member] [instance: b2c3eb4f-df1f-46d0-acb5-3ac9f16f9a82] Took 6.09 seconds to spawn the instance on the hypervisor.
Nov 29 18:16:38 user nova-compute[74613]: DEBUG nova.compute.manager [None req-8b22462a-e554-44fb-96bd-96788f646710 tempest-AttachVolumeTestJSON-813984703 tempest-AttachVolumeTestJSON-813984703-project-member] [instance: b2c3eb4f-df1f-46d0-acb5-3ac9f16f9a82] Checking state {{(pid=74613) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 29 18:16:38 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1f2b4426-815f-4ef4-b98e-e5124fec93b7/disk.rescue --force-share --output=json {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:16:38 user nova-compute[74613]: INFO nova.compute.manager [None req-8b22462a-e554-44fb-96bd-96788f646710 tempest-AttachVolumeTestJSON-813984703 tempest-AttachVolumeTestJSON-813984703-project-member] [instance: b2c3eb4f-df1f-46d0-acb5-3ac9f16f9a82] Took 6.79 seconds to build instance.
Nov 29 18:16:38 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-8b22462a-e554-44fb-96bd-96788f646710 tempest-AttachVolumeTestJSON-813984703 tempest-AttachVolumeTestJSON-813984703-project-member] Lock "b2c3eb4f-df1f-46d0-acb5-3ac9f16f9a82" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.895s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 18:16:38 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1f2b4426-815f-4ef4-b98e-e5124fec93b7/disk.rescue --force-share --output=json" returned: 0 in 0.200s {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:16:38 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1f2b4426-815f-4ef4-b98e-e5124fec93b7/disk.rescue --force-share --output=json {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:16:38 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1f2b4426-815f-4ef4-b98e-e5124fec93b7/disk.rescue --force-share --output=json" returned: 0 in 0.175s {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:16:38 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] skipping disk /opt/stack/data/nova/instances/1f2b4426-815f-4ef4-b98e-e5124fec93b7/disk (vdb) as it is a volume {{(pid=74613) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 29 18:16:38 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b2c3eb4f-df1f-46d0-acb5-3ac9f16f9a82/disk --force-share --output=json {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:16:38 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b2c3eb4f-df1f-46d0-acb5-3ac9f16f9a82/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:16:38 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b2c3eb4f-df1f-46d0-acb5-3ac9f16f9a82/disk --force-share --output=json {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:16:39 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b2c3eb4f-df1f-46d0-acb5-3ac9f16f9a82/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:16:39 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ef9c2f4-23d0-44eb-9ba9-8c7c3f6b0874/disk --force-share --output=json {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:16:39 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:16:39 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ef9c2f4-23d0-44eb-9ba9-8c7c3f6b0874/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:16:39 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ef9c2f4-23d0-44eb-9ba9-8c7c3f6b0874/disk --force-share --output=json {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:16:39 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ef9c2f4-23d0-44eb-9ba9-8c7c3f6b0874/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:16:39 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f4a1329-b3b9-4d1c-8735-abddabc359fd/disk.rescue --force-share --output=json {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:16:39 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f4a1329-b3b9-4d1c-8735-abddabc359fd/disk.rescue --force-share --output=json" returned: 0 in 0.192s {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:16:39 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f4a1329-b3b9-4d1c-8735-abddabc359fd/disk.rescue --force-share --output=json {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:16:40 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f4a1329-b3b9-4d1c-8735-abddabc359fd/disk.rescue --force-share --output=json" returned: 0 in 0.266s {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:16:40 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f4a1329-b3b9-4d1c-8735-abddabc359fd/disk --force-share --output=json {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:16:40 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f4a1329-b3b9-4d1c-8735-abddabc359fd/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:16:40 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f4a1329-b3b9-4d1c-8735-abddabc359fd/disk --force-share --output=json {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:16:40 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f4a1329-b3b9-4d1c-8735-abddabc359fd/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:16:40 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d9f10bfb-5202-4b4a-a42d-f167501f597b/disk --force-share --output=json {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:16:40 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d9f10bfb-5202-4b4a-a42d-f167501f597b/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:16:40 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d9f10bfb-5202-4b4a-a42d-f167501f597b/disk --force-share --output=json {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:16:40 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d9f10bfb-5202-4b4a-a42d-f167501f597b/disk --force-share --output=json" returned: 0 in 0.213s {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:16:40 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6993e2e7-7e03-45b4-9d3d-3742589b6078/disk --force-share --output=json {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:16:41 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6993e2e7-7e03-45b4-9d3d-3742589b6078/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:16:41 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6993e2e7-7e03-45b4-9d3d-3742589b6078/disk --force-share --output=json {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:16:41 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:16:41 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6993e2e7-7e03-45b4-9d3d-3742589b6078/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:16:41 user nova-compute[74613]: WARNING nova.virt.libvirt.driver [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 18:16:41 user nova-compute[74613]: WARNING nova.virt.libvirt.driver [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 18:16:41 user nova-compute[74613]: DEBUG nova.compute.resource_tracker [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Hypervisor/Node resource view: name=user free_ram=8299MB free_disk=24.87939453125GB free_vcpus=6 pci_devices=[{"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74613) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 29 18:16:41 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 18:16:41 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 18:16:41 user nova-compute[74613]: DEBUG nova.compute.resource_tracker [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Instance 6993e2e7-7e03-45b4-9d3d-3742589b6078 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74613) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 18:16:41 user nova-compute[74613]: DEBUG nova.compute.resource_tracker [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Instance 6f4a1329-b3b9-4d1c-8735-abddabc359fd actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74613) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 18:16:41 user nova-compute[74613]: DEBUG nova.compute.resource_tracker [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Instance 1f2b4426-815f-4ef4-b98e-e5124fec93b7 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74613) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 18:16:41 user nova-compute[74613]: DEBUG nova.compute.resource_tracker [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Instance 8ef9c2f4-23d0-44eb-9ba9-8c7c3f6b0874 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74613) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 18:16:41 user nova-compute[74613]: DEBUG nova.compute.resource_tracker [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Instance d9f10bfb-5202-4b4a-a42d-f167501f597b actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74613) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 18:16:41 user nova-compute[74613]: DEBUG nova.compute.resource_tracker [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Instance b2c3eb4f-df1f-46d0-acb5-3ac9f16f9a82 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74613) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 18:16:41 user nova-compute[74613]: DEBUG nova.compute.resource_tracker [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Total usable vcpus: 12, total allocated vcpus: 6 {{(pid=74613) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 29 18:16:41 user nova-compute[74613]: DEBUG nova.compute.resource_tracker [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Final resource view: name=user phys_ram=16011MB used_ram=3584MB phys_disk=40GB used_disk=6GB total_vcpus=12 used_vcpus=6 pci_stats=[] {{(pid=74613) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 29 18:16:42 user nova-compute[74613]: DEBUG nova.compute.provider_tree [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Inventory has not changed in ProviderTree for provider: 639d980e-3b12-44b1-b8f4-1812416fa4dd {{(pid=74613) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 18:16:42 user nova-compute[74613]: DEBUG nova.scheduler.client.report [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Inventory has not changed for provider 639d980e-3b12-44b1-b8f4-1812416fa4dd based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74613) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 18:16:42 user nova-compute[74613]: DEBUG nova.compute.resource_tracker [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Compute_service record updated for user:user {{(pid=74613) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 29 18:16:42 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.444s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 18:16:42 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-13732cae-bbdd-4c77-9bdf-67d42cde31a9 tempest-VolumesActionsTest-1891851968 tempest-VolumesActionsTest-1891851968-project-member] Acquiring lock "8ef9c2f4-23d0-44eb-9ba9-8c7c3f6b0874" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 18:16:42 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-13732cae-bbdd-4c77-9bdf-67d42cde31a9 tempest-VolumesActionsTest-1891851968 tempest-VolumesActionsTest-1891851968-project-member] Lock "8ef9c2f4-23d0-44eb-9ba9-8c7c3f6b0874" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 18:16:42 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-13732cae-bbdd-4c77-9bdf-67d42cde31a9 tempest-VolumesActionsTest-1891851968 tempest-VolumesActionsTest-1891851968-project-member] Acquiring lock "8ef9c2f4-23d0-44eb-9ba9-8c7c3f6b0874-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 18:16:42 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-13732cae-bbdd-4c77-9bdf-67d42cde31a9 tempest-VolumesActionsTest-1891851968 tempest-VolumesActionsTest-1891851968-project-member] Lock "8ef9c2f4-23d0-44eb-9ba9-8c7c3f6b0874-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 18:16:42 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-13732cae-bbdd-4c77-9bdf-67d42cde31a9 tempest-VolumesActionsTest-1891851968 tempest-VolumesActionsTest-1891851968-project-member] Lock "8ef9c2f4-23d0-44eb-9ba9-8c7c3f6b0874-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 18:16:42 user nova-compute[74613]: INFO nova.compute.manager [None req-13732cae-bbdd-4c77-9bdf-67d42cde31a9 tempest-VolumesActionsTest-1891851968 tempest-VolumesActionsTest-1891851968-project-member] [instance: 8ef9c2f4-23d0-44eb-9ba9-8c7c3f6b0874] Terminating instance
Nov 29 18:16:42 user nova-compute[74613]: DEBUG nova.compute.manager [None req-13732cae-bbdd-4c77-9bdf-67d42cde31a9 tempest-VolumesActionsTest-1891851968 tempest-VolumesActionsTest-1891851968-project-member] [instance: 8ef9c2f4-23d0-44eb-9ba9-8c7c3f6b0874] Start destroying the instance on the hypervisor. {{(pid=74613) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 29 18:16:42 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:16:42 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:16:42 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:16:42 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:16:42 user nova-compute[74613]: DEBUG nova.compute.manager [req-833a470b-6f00-42bb-84b2-a51f85638a80 req-d66807de-fb49-4c6e-aeb5-7b2746f04a92 service nova] [instance: 8ef9c2f4-23d0-44eb-9ba9-8c7c3f6b0874] Received event network-vif-unplugged-1bf62fcc-5bb2-4457-880a-4fffbdd56514 {{(pid=74613) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 18:16:42 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-833a470b-6f00-42bb-84b2-a51f85638a80 req-d66807de-fb49-4c6e-aeb5-7b2746f04a92 service nova] Acquiring lock "8ef9c2f4-23d0-44eb-9ba9-8c7c3f6b0874-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 18:16:42 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-833a470b-6f00-42bb-84b2-a51f85638a80 req-d66807de-fb49-4c6e-aeb5-7b2746f04a92 service nova] Lock "8ef9c2f4-23d0-44eb-9ba9-8c7c3f6b0874-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 18:16:42 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-833a470b-6f00-42bb-84b2-a51f85638a80 req-d66807de-fb49-4c6e-aeb5-7b2746f04a92 service nova] Lock "8ef9c2f4-23d0-44eb-9ba9-8c7c3f6b0874-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 18:16:42 user nova-compute[74613]: DEBUG nova.compute.manager [req-833a470b-6f00-42bb-84b2-a51f85638a80 req-d66807de-fb49-4c6e-aeb5-7b2746f04a92 service nova] [instance: 8ef9c2f4-23d0-44eb-9ba9-8c7c3f6b0874] No waiting events found dispatching network-vif-unplugged-1bf62fcc-5bb2-4457-880a-4fffbdd56514 {{(pid=74613) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 18:16:42 user nova-compute[74613]: DEBUG nova.compute.manager [req-833a470b-6f00-42bb-84b2-a51f85638a80 req-d66807de-fb49-4c6e-aeb5-7b2746f04a92 service nova] [instance: 8ef9c2f4-23d0-44eb-9ba9-8c7c3f6b0874] Received event network-vif-unplugged-1bf62fcc-5bb2-4457-880a-4fffbdd56514 for instance with task_state deleting. {{(pid=74613) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 29 18:16:42 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:16:42 user nova-compute[74613]: INFO nova.virt.libvirt.driver [-] [instance: 8ef9c2f4-23d0-44eb-9ba9-8c7c3f6b0874] Instance destroyed successfully.
Nov 29 18:16:42 user nova-compute[74613]: DEBUG nova.objects.instance [None req-13732cae-bbdd-4c77-9bdf-67d42cde31a9 tempest-VolumesActionsTest-1891851968 tempest-VolumesActionsTest-1891851968-project-member] Lazy-loading 'resources' on Instance uuid 8ef9c2f4-23d0-44eb-9ba9-8c7c3f6b0874 {{(pid=74613) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 18:16:42 user nova-compute[74613]: DEBUG nova.virt.libvirt.vif [None req-13732cae-bbdd-4c77-9bdf-67d42cde31a9 tempest-VolumesActionsTest-1891851968 tempest-VolumesActionsTest-1891851968-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T18:14:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1151516964',display_name='tempest-VolumesActionsTest-instance-1151516964',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1151516964',id=39,image_ref='4217f428-8d9d-4ee1-9614-642d26d90c46',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-29T18:14:49Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='b45cf6afa1d8432aa734c6d7ba388d01',ramdisk_id='',reservation_id='r-edglceyz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='4217f428-8d9d-4ee1-9614-642d26d90c46',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesActionsTest-1891851968',owner_user_name='tempest-VolumesActionsTest-1891851968-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-29T18:14:50Z,user_data=None,user_id='ead62365fd2c4e17a70639f15b9ebf25',uuid=8ef9c2f4-23d0-44eb-9ba9-8c7c3f6b0874,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "1bf62fcc-5bb2-4457-880a-4fffbdd56514", "address": "fa:16:3e:00:cd:c7", "network": {"id": "da3e9619-3fb3-4a93-b70a-02ab4c0a47e6", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1370048768-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b45cf6afa1d8432aa734c6d7ba388d01", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1bf62fcc-5b", "ovs_interfaceid": "1bf62fcc-5bb2-4457-880a-4fffbdd56514", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74613) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 29 18:16:42 user nova-compute[74613]: DEBUG nova.network.os_vif_util [None req-13732cae-bbdd-4c77-9bdf-67d42cde31a9 tempest-VolumesActionsTest-1891851968 tempest-VolumesActionsTest-1891851968-project-member] Converting VIF {"id": "1bf62fcc-5bb2-4457-880a-4fffbdd56514", "address": "fa:16:3e:00:cd:c7", "network": {"id": "da3e9619-3fb3-4a93-b70a-02ab4c0a47e6", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1370048768-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b45cf6afa1d8432aa734c6d7ba388d01", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1bf62fcc-5b", "ovs_interfaceid": "1bf62fcc-5bb2-4457-880a-4fffbdd56514", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74613) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 18:16:42 user nova-compute[74613]: DEBUG nova.network.os_vif_util [None req-13732cae-bbdd-4c77-9bdf-67d42cde31a9 tempest-VolumesActionsTest-1891851968 tempest-VolumesActionsTest-1891851968-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:00:cd:c7,bridge_name='br-int',has_traffic_filtering=True,id=1bf62fcc-5bb2-4457-880a-4fffbdd56514,network=Network(da3e9619-3fb3-4a93-b70a-02ab4c0a47e6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1bf62fcc-5b') {{(pid=74613) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 18:16:42 user nova-compute[74613]: DEBUG os_vif [None req-13732cae-bbdd-4c77-9bdf-67d42cde31a9 tempest-VolumesActionsTest-1891851968 tempest-VolumesActionsTest-1891851968-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:00:cd:c7,bridge_name='br-int',has_traffic_filtering=True,id=1bf62fcc-5bb2-4457-880a-4fffbdd56514,network=Network(da3e9619-3fb3-4a93-b70a-02ab4c0a47e6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1bf62fcc-5b') {{(pid=74613) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 29 18:16:42 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:16:42 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap1bf62fcc-5b, bridge=br-int, if_exists=True) {{(pid=74613) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 18:16:42 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:16:42 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 18:16:42 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:16:42 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=9427f92d-f72c-4dbf-824c-cdf9efc95fa4) {{(pid=74613) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 18:16:42 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:16:42 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 18:16:42 user nova-compute[74613]: INFO os_vif [None req-13732cae-bbdd-4c77-9bdf-67d42cde31a9 tempest-VolumesActionsTest-1891851968 tempest-VolumesActionsTest-1891851968-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:00:cd:c7,bridge_name='br-int',has_traffic_filtering=True,id=1bf62fcc-5bb2-4457-880a-4fffbdd56514,network=Network(da3e9619-3fb3-4a93-b70a-02ab4c0a47e6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1bf62fcc-5b')
Nov 29 18:16:42 user nova-compute[74613]: INFO nova.virt.libvirt.driver [None req-13732cae-bbdd-4c77-9bdf-67d42cde31a9 tempest-VolumesActionsTest-1891851968 tempest-VolumesActionsTest-1891851968-project-member] [instance: 8ef9c2f4-23d0-44eb-9ba9-8c7c3f6b0874] Deleting instance files /opt/stack/data/nova/instances/8ef9c2f4-23d0-44eb-9ba9-8c7c3f6b0874_del
Nov 29 18:16:42 user nova-compute[74613]: INFO nova.virt.libvirt.driver [None req-13732cae-bbdd-4c77-9bdf-67d42cde31a9 tempest-VolumesActionsTest-1891851968 tempest-VolumesActionsTest-1891851968-project-member] [instance: 8ef9c2f4-23d0-44eb-9ba9-8c7c3f6b0874] Deletion of /opt/stack/data/nova/instances/8ef9c2f4-23d0-44eb-9ba9-8c7c3f6b0874_del complete
Nov 29 18:16:42 user nova-compute[74613]: INFO nova.compute.manager [None req-13732cae-bbdd-4c77-9bdf-67d42cde31a9 tempest-VolumesActionsTest-1891851968 tempest-VolumesActionsTest-1891851968-project-member] [instance: 8ef9c2f4-23d0-44eb-9ba9-8c7c3f6b0874] Took 0.74 seconds to destroy the instance on the hypervisor.
Nov 29 18:16:42 user nova-compute[74613]: DEBUG oslo.service.loopingcall [None req-13732cae-bbdd-4c77-9bdf-67d42cde31a9 tempest-VolumesActionsTest-1891851968 tempest-VolumesActionsTest-1891851968-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74613) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 29 18:16:42 user nova-compute[74613]: DEBUG nova.compute.manager [-] [instance: 8ef9c2f4-23d0-44eb-9ba9-8c7c3f6b0874] Deallocating network for instance {{(pid=74613) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 29 18:16:42 user nova-compute[74613]: DEBUG nova.network.neutron [-] [instance: 8ef9c2f4-23d0-44eb-9ba9-8c7c3f6b0874] deallocate_for_instance() {{(pid=74613) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 29 18:16:43 user nova-compute[74613]: DEBUG oslo_service.periodic_task [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74613) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 18:16:43 user nova-compute[74613]: DEBUG nova.compute.manager [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Starting heal instance info cache {{(pid=74613) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 29 18:16:43 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Acquiring lock "refresh_cache-6f4a1329-b3b9-4d1c-8735-abddabc359fd" {{(pid=74613) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 18:16:43 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Acquired lock "refresh_cache-6f4a1329-b3b9-4d1c-8735-abddabc359fd" {{(pid=74613) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 18:16:43 user nova-compute[74613]: DEBUG nova.network.neutron [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] [instance: 6f4a1329-b3b9-4d1c-8735-abddabc359fd] Forcefully refreshing network info cache for instance {{(pid=74613) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 29 18:16:43 user nova-compute[74613]: DEBUG nova.network.neutron [-] [instance: 8ef9c2f4-23d0-44eb-9ba9-8c7c3f6b0874] Updating instance_info_cache with network_info: [] {{(pid=74613) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 18:16:43 user nova-compute[74613]: INFO nova.compute.manager [-] [instance: 8ef9c2f4-23d0-44eb-9ba9-8c7c3f6b0874] Took 0.56 seconds to deallocate network for instance.
Nov 29 18:16:43 user nova-compute[74613]: DEBUG nova.compute.manager [req-32dc3a7e-3827-4301-a546-930c858eb256 req-b01850f1-4add-4fed-832d-5c4a79da3f47 service nova] [instance: 8ef9c2f4-23d0-44eb-9ba9-8c7c3f6b0874] Received event network-vif-deleted-1bf62fcc-5bb2-4457-880a-4fffbdd56514 {{(pid=74613) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 18:16:43 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-13732cae-bbdd-4c77-9bdf-67d42cde31a9 tempest-VolumesActionsTest-1891851968 tempest-VolumesActionsTest-1891851968-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 18:16:43 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-13732cae-bbdd-4c77-9bdf-67d42cde31a9 tempest-VolumesActionsTest-1891851968 tempest-VolumesActionsTest-1891851968-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 18:16:43 user nova-compute[74613]: DEBUG nova.network.neutron [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] [instance: 6f4a1329-b3b9-4d1c-8735-abddabc359fd] Updating instance_info_cache with network_info: [{"id": "6d82a9a2-81f2-4d4b-846e-178413db6ecf", "address": "fa:16:3e:53:4e:1d", "network": {"id": "db79433c-b21c-4058-b98c-f62822abbf7a", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1715530752-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e6a3eb6ea0294f9da705dca72ec2789a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6d82a9a2-81", "ovs_interfaceid": "6d82a9a2-81f2-4d4b-846e-178413db6ecf", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74613) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 18:16:43 user nova-compute[74613]: DEBUG nova.compute.provider_tree [None req-13732cae-bbdd-4c77-9bdf-67d42cde31a9 tempest-VolumesActionsTest-1891851968 tempest-VolumesActionsTest-1891851968-project-member] Inventory has not changed in ProviderTree for provider: 639d980e-3b12-44b1-b8f4-1812416fa4dd {{(pid=74613) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 18:16:43 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Releasing lock "refresh_cache-6f4a1329-b3b9-4d1c-8735-abddabc359fd" {{(pid=74613) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 18:16:43 user nova-compute[74613]: DEBUG nova.compute.manager [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] [instance: 6f4a1329-b3b9-4d1c-8735-abddabc359fd] Updated the network info_cache for instance {{(pid=74613) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 29 18:16:43 user nova-compute[74613]: DEBUG oslo_service.periodic_task [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74613) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 18:16:43 user nova-compute[74613]: DEBUG oslo_service.periodic_task [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74613) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 18:16:43 user nova-compute[74613]: DEBUG oslo_service.periodic_task [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74613) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 18:16:43 user nova-compute[74613]: DEBUG oslo_service.periodic_task [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74613) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 18:16:43 user nova-compute[74613]: DEBUG oslo_service.periodic_task [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74613) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 18:16:43 user nova-compute[74613]: DEBUG nova.compute.manager [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74613) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 29 18:16:43 user nova-compute[74613]: DEBUG nova.scheduler.client.report [None req-13732cae-bbdd-4c77-9bdf-67d42cde31a9 tempest-VolumesActionsTest-1891851968 tempest-VolumesActionsTest-1891851968-project-member] Inventory has not changed for provider 639d980e-3b12-44b1-b8f4-1812416fa4dd based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74613) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 18:16:43 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-13732cae-bbdd-4c77-9bdf-67d42cde31a9 tempest-VolumesActionsTest-1891851968 tempest-VolumesActionsTest-1891851968-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.264s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 18:16:43 user nova-compute[74613]: INFO nova.scheduler.client.report [None req-13732cae-bbdd-4c77-9bdf-67d42cde31a9 tempest-VolumesActionsTest-1891851968 tempest-VolumesActionsTest-1891851968-project-member] Deleted allocations for instance 8ef9c2f4-23d0-44eb-9ba9-8c7c3f6b0874
Nov 29 18:16:44 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-13732cae-bbdd-4c77-9bdf-67d42cde31a9 tempest-VolumesActionsTest-1891851968 tempest-VolumesActionsTest-1891851968-project-member] Lock "8ef9c2f4-23d0-44eb-9ba9-8c7c3f6b0874" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.759s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 18:16:44 user nova-compute[74613]: DEBUG nova.compute.manager [req-d1a13a52-a181-4ff8-8ea6-228e28098d0a req-f226f034-d297-4398-84a9-6f55955c368a service nova] [instance: 8ef9c2f4-23d0-44eb-9ba9-8c7c3f6b0874] Received event network-vif-plugged-1bf62fcc-5bb2-4457-880a-4fffbdd56514 {{(pid=74613) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 18:16:44 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-d1a13a52-a181-4ff8-8ea6-228e28098d0a req-f226f034-d297-4398-84a9-6f55955c368a service nova] Acquiring lock "8ef9c2f4-23d0-44eb-9ba9-8c7c3f6b0874-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 18:16:44 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-d1a13a52-a181-4ff8-8ea6-228e28098d0a req-f226f034-d297-4398-84a9-6f55955c368a service nova] Lock "8ef9c2f4-23d0-44eb-9ba9-8c7c3f6b0874-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 18:16:44 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-d1a13a52-a181-4ff8-8ea6-228e28098d0a req-f226f034-d297-4398-84a9-6f55955c368a service nova] Lock "8ef9c2f4-23d0-44eb-9ba9-8c7c3f6b0874-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 18:16:44 user nova-compute[74613]: DEBUG nova.compute.manager [req-d1a13a52-a181-4ff8-8ea6-228e28098d0a req-f226f034-d297-4398-84a9-6f55955c368a service nova] [instance: 8ef9c2f4-23d0-44eb-9ba9-8c7c3f6b0874] No waiting events found dispatching network-vif-plugged-1bf62fcc-5bb2-4457-880a-4fffbdd56514 {{(pid=74613) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 18:16:44 user nova-compute[74613]: WARNING nova.compute.manager [req-d1a13a52-a181-4ff8-8ea6-228e28098d0a req-f226f034-d297-4398-84a9-6f55955c368a service nova] [instance: 8ef9c2f4-23d0-44eb-9ba9-8c7c3f6b0874] Received unexpected event network-vif-plugged-1bf62fcc-5bb2-4457-880a-4fffbdd56514 for instance with vm_state deleted and task_state None.
Nov 29 18:16:45 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-fe284607-cdd4-48ec-84a8-208fde0abe22 tempest-TestVolumeBootPattern-1318569205 tempest-TestVolumeBootPattern-1318569205-project-member] Acquiring lock "3a2ac289-fc34-4c7b-a689-b499e2562578" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 18:16:45 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-fe284607-cdd4-48ec-84a8-208fde0abe22 tempest-TestVolumeBootPattern-1318569205 tempest-TestVolumeBootPattern-1318569205-project-member] Lock "3a2ac289-fc34-4c7b-a689-b499e2562578" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 18:16:45 user nova-compute[74613]: DEBUG nova.compute.manager [None req-fe284607-cdd4-48ec-84a8-208fde0abe22 tempest-TestVolumeBootPattern-1318569205 tempest-TestVolumeBootPattern-1318569205-project-member] [instance: 3a2ac289-fc34-4c7b-a689-b499e2562578] Starting instance... {{(pid=74613) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 29 18:16:45 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-fe284607-cdd4-48ec-84a8-208fde0abe22 tempest-TestVolumeBootPattern-1318569205 tempest-TestVolumeBootPattern-1318569205-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 18:16:45 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-fe284607-cdd4-48ec-84a8-208fde0abe22 tempest-TestVolumeBootPattern-1318569205 tempest-TestVolumeBootPattern-1318569205-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 18:16:45 user nova-compute[74613]: DEBUG nova.virt.hardware [None req-fe284607-cdd4-48ec-84a8-208fde0abe22 tempest-TestVolumeBootPattern-1318569205 tempest-TestVolumeBootPattern-1318569205-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74613) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 29 18:16:45 user nova-compute[74613]: INFO nova.compute.claims [None req-fe284607-cdd4-48ec-84a8-208fde0abe22 tempest-TestVolumeBootPattern-1318569205 tempest-TestVolumeBootPattern-1318569205-project-member] [instance: 3a2ac289-fc34-4c7b-a689-b499e2562578] Claim successful on node user
Nov 29 18:16:46 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:16:46 user nova-compute[74613]: DEBUG nova.compute.provider_tree [None req-fe284607-cdd4-48ec-84a8-208fde0abe22 tempest-TestVolumeBootPattern-1318569205 tempest-TestVolumeBootPattern-1318569205-project-member] Inventory has not changed in ProviderTree for provider: 639d980e-3b12-44b1-b8f4-1812416fa4dd {{(pid=74613) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 18:16:46 user nova-compute[74613]: DEBUG nova.scheduler.client.report [None req-fe284607-cdd4-48ec-84a8-208fde0abe22 tempest-TestVolumeBootPattern-1318569205 tempest-TestVolumeBootPattern-1318569205-project-member] Inventory has not changed for provider 639d980e-3b12-44b1-b8f4-1812416fa4dd based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74613) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 18:16:46 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-fe284607-cdd4-48ec-84a8-208fde0abe22 tempest-TestVolumeBootPattern-1318569205 tempest-TestVolumeBootPattern-1318569205-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.319s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 18:16:46 user nova-compute[74613]: DEBUG nova.compute.manager [None req-fe284607-cdd4-48ec-84a8-208fde0abe22 tempest-TestVolumeBootPattern-1318569205 tempest-TestVolumeBootPattern-1318569205-project-member] [instance: 3a2ac289-fc34-4c7b-a689-b499e2562578] Start building networks asynchronously for instance. {{(pid=74613) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 29 18:16:46 user nova-compute[74613]: DEBUG nova.compute.manager [None req-fe284607-cdd4-48ec-84a8-208fde0abe22 tempest-TestVolumeBootPattern-1318569205 tempest-TestVolumeBootPattern-1318569205-project-member] [instance: 3a2ac289-fc34-4c7b-a689-b499e2562578] Allocating IP information in the background. {{(pid=74613) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 29 18:16:46 user nova-compute[74613]: DEBUG nova.network.neutron [None req-fe284607-cdd4-48ec-84a8-208fde0abe22 tempest-TestVolumeBootPattern-1318569205 tempest-TestVolumeBootPattern-1318569205-project-member] [instance: 3a2ac289-fc34-4c7b-a689-b499e2562578] allocate_for_instance() {{(pid=74613) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 29 18:16:46 user nova-compute[74613]: INFO nova.virt.libvirt.driver [None req-fe284607-cdd4-48ec-84a8-208fde0abe22 tempest-TestVolumeBootPattern-1318569205 tempest-TestVolumeBootPattern-1318569205-project-member] [instance: 3a2ac289-fc34-4c7b-a689-b499e2562578] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 29 18:16:46 user nova-compute[74613]: DEBUG nova.compute.manager [None req-fe284607-cdd4-48ec-84a8-208fde0abe22 tempest-TestVolumeBootPattern-1318569205 tempest-TestVolumeBootPattern-1318569205-project-member] [instance: 3a2ac289-fc34-4c7b-a689-b499e2562578] Start building block device mappings for instance. {{(pid=74613) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 29 18:16:46 user nova-compute[74613]: DEBUG nova.policy [None req-fe284607-cdd4-48ec-84a8-208fde0abe22 tempest-TestVolumeBootPattern-1318569205 tempest-TestVolumeBootPattern-1318569205-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'bedbc6ed47394e2b9125543a8b88a71f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67390f1402214191904cfbd68c3142a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74613) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 29 18:16:46 user nova-compute[74613]: INFO nova.virt.block_device [None req-fe284607-cdd4-48ec-84a8-208fde0abe22 tempest-TestVolumeBootPattern-1318569205 tempest-TestVolumeBootPattern-1318569205-project-member] [instance: 3a2ac289-fc34-4c7b-a689-b499e2562578] Booting with volume 5d74e565-9547-4f44-8005-0615d625a275 at /dev/vda
Nov 29 18:16:46 user nova-compute[74613]: DEBUG os_brick.utils [None req-fe284607-cdd4-48ec-84a8-208fde0abe22 tempest-TestVolumeBootPattern-1318569205 tempest-TestVolumeBootPattern-1318569205-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74613) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 18:16:46 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:16:46 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:16:46 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[dee82124-0a1a-45af-8c8c-0e2b55f6c75c]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:400972819b5\n', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 18:16:46 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:16:46 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:16:46 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[18f1e09c-80a8-4f36-8286-dbd338d6e09a]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 18:16:46 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:16:46 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:16:46 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[614d4876-e833-4f4e-b90a-3cbaaf3ab978]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 18:16:46 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[80ad8b80-0047-47fc-a0eb-3aed44132af9]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 18:16:46 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-fe284607-cdd4-48ec-84a8-208fde0abe22 tempest-TestVolumeBootPattern-1318569205 tempest-TestVolumeBootPattern-1318569205-project-member] Running cmd (subprocess): nvme version {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:16:46 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-fe284607-cdd4-48ec-84a8-208fde0abe22 tempest-TestVolumeBootPattern-1318569205 tempest-TestVolumeBootPattern-1318569205-project-member] 'nvme version' failed. Not Retrying. {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 18:16:46 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.nvmeof [None req-fe284607-cdd4-48ec-84a8-208fde0abe22 tempest-TestVolumeBootPattern-1318569205 tempest-TestVolumeBootPattern-1318569205-project-member] nvme not present on system {{(pid=74613) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 29 18:16:46 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:16:46 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 18:16:46 user nova-compute[74613]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 29 18:16:46 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad5ff8ab-0f0c-4f28-ae32-635055f0286a]: (4, '') {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 18:16:46 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.lightos [None req-fe284607-cdd4-48ec-84a8-208fde0abe22 tempest-TestVolumeBootPattern-1318569205 tempest-TestVolumeBootPattern-1318569205-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74613) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 29 18:16:46 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.lightos [None req-fe284607-cdd4-48ec-84a8-208fde0abe22 tempest-TestVolumeBootPattern-1318569205 tempest-TestVolumeBootPattern-1318569205-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74613) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 29 18:16:46 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.lightos [None req-fe284607-cdd4-48ec-84a8-208fde0abe22 tempest-TestVolumeBootPattern-1318569205 tempest-TestVolumeBootPattern-1318569205-project-member] LIGHTOS: no hostnqn found. {{(pid=74613) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 29 18:16:46 user nova-compute[74613]: DEBUG os_brick.utils [None req-fe284607-cdd4-48ec-84a8-208fde0abe22 tempest-TestVolumeBootPattern-1318569205 tempest-TestVolumeBootPattern-1318569205-project-member] <== get_connector_properties: return (119ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:400972819b5', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74613) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 18:16:46 user nova-compute[74613]: DEBUG nova.virt.block_device [None req-fe284607-cdd4-48ec-84a8-208fde0abe22 tempest-TestVolumeBootPattern-1318569205 tempest-TestVolumeBootPattern-1318569205-project-member] [instance: 3a2ac289-fc34-4c7b-a689-b499e2562578] Updating existing volume attachment record: a4142f5a-8a42-4c82-ab39-cc3dc74711f8 {{(pid=74613) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 29 18:16:47 user nova-compute[74613]: DEBUG nova.network.neutron [None req-fe284607-cdd4-48ec-84a8-208fde0abe22 tempest-TestVolumeBootPattern-1318569205 tempest-TestVolumeBootPattern-1318569205-project-member] [instance: 3a2ac289-fc34-4c7b-a689-b499e2562578] Successfully created port: 6c245bc7-a2bd-47a5-a37b-a7d583d1b2e6 {{(pid=74613) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 29 18:16:47 user nova-compute[74613]: DEBUG nova.network.neutron [None req-fe284607-cdd4-48ec-84a8-208fde0abe22 tempest-TestVolumeBootPattern-1318569205 tempest-TestVolumeBootPattern-1318569205-project-member] [instance: 3a2ac289-fc34-4c7b-a689-b499e2562578] Successfully updated port: 6c245bc7-a2bd-47a5-a37b-a7d583d1b2e6 {{(pid=74613) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 29 18:16:47 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-fe284607-cdd4-48ec-84a8-208fde0abe22 tempest-TestVolumeBootPattern-1318569205 tempest-TestVolumeBootPattern-1318569205-project-member] Acquiring lock "refresh_cache-3a2ac289-fc34-4c7b-a689-b499e2562578" {{(pid=74613) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 18:16:47 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-fe284607-cdd4-48ec-84a8-208fde0abe22 tempest-TestVolumeBootPattern-1318569205 tempest-TestVolumeBootPattern-1318569205-project-member] Acquired lock "refresh_cache-3a2ac289-fc34-4c7b-a689-b499e2562578" {{(pid=74613) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 18:16:47 user nova-compute[74613]: DEBUG nova.network.neutron [None req-fe284607-cdd4-48ec-84a8-208fde0abe22 tempest-TestVolumeBootPattern-1318569205 tempest-TestVolumeBootPattern-1318569205-project-member] [instance: 3a2ac289-fc34-4c7b-a689-b499e2562578] Building network info cache for instance {{(pid=74613) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 29 18:16:47 user nova-compute[74613]: DEBUG nova.compute.manager [req-00e6d0d1-7439-49d1-a9f0-9f677369a7b5 req-d0138d6b-79d8-4437-96a1-22fcc80640cc service nova] [instance: 3a2ac289-fc34-4c7b-a689-b499e2562578] Received event network-changed-6c245bc7-a2bd-47a5-a37b-a7d583d1b2e6 {{(pid=74613) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 18:16:47 user nova-compute[74613]: DEBUG nova.compute.manager [req-00e6d0d1-7439-49d1-a9f0-9f677369a7b5 req-d0138d6b-79d8-4437-96a1-22fcc80640cc service nova] [instance: 3a2ac289-fc34-4c7b-a689-b499e2562578] Refreshing instance network info cache due to event network-changed-6c245bc7-a2bd-47a5-a37b-a7d583d1b2e6. {{(pid=74613) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 18:16:47 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-00e6d0d1-7439-49d1-a9f0-9f677369a7b5 req-d0138d6b-79d8-4437-96a1-22fcc80640cc service nova] Acquiring lock "refresh_cache-3a2ac289-fc34-4c7b-a689-b499e2562578" {{(pid=74613) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 18:16:47 user nova-compute[74613]: DEBUG nova.network.neutron [None req-fe284607-cdd4-48ec-84a8-208fde0abe22 tempest-TestVolumeBootPattern-1318569205 tempest-TestVolumeBootPattern-1318569205-project-member] [instance: 3a2ac289-fc34-4c7b-a689-b499e2562578] Instance cache missing network info. {{(pid=74613) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 29 18:16:47 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:16:47 user nova-compute[74613]: DEBUG nova.network.neutron [None req-fe284607-cdd4-48ec-84a8-208fde0abe22 tempest-TestVolumeBootPattern-1318569205 tempest-TestVolumeBootPattern-1318569205-project-member] [instance: 3a2ac289-fc34-4c7b-a689-b499e2562578] Updating instance_info_cache with network_info: [{"id": "6c245bc7-a2bd-47a5-a37b-a7d583d1b2e6", "address": "fa:16:3e:e4:33:64", "network": {"id": "4a5179dd-d0b1-44c3-80c1-08dd7b0152f1", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1296336996-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "67390f1402214191904cfbd68c3142a7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6c245bc7-a2", "ovs_interfaceid": "6c245bc7-a2bd-47a5-a37b-a7d583d1b2e6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74613) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 18:16:48 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-fe284607-cdd4-48ec-84a8-208fde0abe22 tempest-TestVolumeBootPattern-1318569205 tempest-TestVolumeBootPattern-1318569205-project-member] Releasing lock "refresh_cache-3a2ac289-fc34-4c7b-a689-b499e2562578" {{(pid=74613) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 18:16:48 user nova-compute[74613]: DEBUG nova.compute.manager [None req-fe284607-cdd4-48ec-84a8-208fde0abe22 tempest-TestVolumeBootPattern-1318569205 tempest-TestVolumeBootPattern-1318569205-project-member] [instance: 3a2ac289-fc34-4c7b-a689-b499e2562578] Instance network_info: |[{"id": "6c245bc7-a2bd-47a5-a37b-a7d583d1b2e6", "address": "fa:16:3e:e4:33:64", "network": {"id": "4a5179dd-d0b1-44c3-80c1-08dd7b0152f1", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1296336996-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "67390f1402214191904cfbd68c3142a7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6c245bc7-a2", "ovs_interfaceid": "6c245bc7-a2bd-47a5-a37b-a7d583d1b2e6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74613) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 29 18:16:48 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-00e6d0d1-7439-49d1-a9f0-9f677369a7b5 req-d0138d6b-79d8-4437-96a1-22fcc80640cc service nova] Acquired lock "refresh_cache-3a2ac289-fc34-4c7b-a689-b499e2562578" {{(pid=74613) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 18:16:48 user nova-compute[74613]: DEBUG nova.network.neutron [req-00e6d0d1-7439-49d1-a9f0-9f677369a7b5 req-d0138d6b-79d8-4437-96a1-22fcc80640cc service nova] [instance: 3a2ac289-fc34-4c7b-a689-b499e2562578] Refreshing network info cache for port 6c245bc7-a2bd-47a5-a37b-a7d583d1b2e6 {{(pid=74613) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 18:16:48 user nova-compute[74613]: DEBUG nova.network.neutron [req-00e6d0d1-7439-49d1-a9f0-9f677369a7b5 req-d0138d6b-79d8-4437-96a1-22fcc80640cc service nova] [instance: 3a2ac289-fc34-4c7b-a689-b499e2562578] Updated VIF entry in instance network info cache for port 6c245bc7-a2bd-47a5-a37b-a7d583d1b2e6. {{(pid=74613) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 18:16:48 user nova-compute[74613]: DEBUG nova.network.neutron [req-00e6d0d1-7439-49d1-a9f0-9f677369a7b5 req-d0138d6b-79d8-4437-96a1-22fcc80640cc service nova] [instance: 3a2ac289-fc34-4c7b-a689-b499e2562578] Updating instance_info_cache with network_info: [{"id": "6c245bc7-a2bd-47a5-a37b-a7d583d1b2e6", "address": "fa:16:3e:e4:33:64", "network": {"id": "4a5179dd-d0b1-44c3-80c1-08dd7b0152f1", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1296336996-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "67390f1402214191904cfbd68c3142a7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6c245bc7-a2", "ovs_interfaceid": "6c245bc7-a2bd-47a5-a37b-a7d583d1b2e6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74613) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 18:16:48 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-00e6d0d1-7439-49d1-a9f0-9f677369a7b5 req-d0138d6b-79d8-4437-96a1-22fcc80640cc service nova] Releasing lock "refresh_cache-3a2ac289-fc34-4c7b-a689-b499e2562578" {{(pid=74613) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 18:16:50 user nova-compute[74613]: INFO nova.compute.manager [None req-1f2110e2-8d00-45eb-a752-a0266d93c0c4 tempest-ServerRescueNegativeTestJSON-1891426908 tempest-ServerRescueNegativeTestJSON-1891426908-project-member] [instance: 1f2b4426-815f-4ef4-b98e-e5124fec93b7] Unrescuing
Nov 29 18:16:50 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-1f2110e2-8d00-45eb-a752-a0266d93c0c4 tempest-ServerRescueNegativeTestJSON-1891426908 tempest-ServerRescueNegativeTestJSON-1891426908-project-member] Acquiring lock "refresh_cache-1f2b4426-815f-4ef4-b98e-e5124fec93b7" {{(pid=74613) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 18:16:50 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-1f2110e2-8d00-45eb-a752-a0266d93c0c4 tempest-ServerRescueNegativeTestJSON-1891426908 tempest-ServerRescueNegativeTestJSON-1891426908-project-member] Acquired lock "refresh_cache-1f2b4426-815f-4ef4-b98e-e5124fec93b7" {{(pid=74613) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 18:16:50 user nova-compute[74613]: DEBUG nova.network.neutron [None req-1f2110e2-8d00-45eb-a752-a0266d93c0c4 tempest-ServerRescueNegativeTestJSON-1891426908 tempest-ServerRescueNegativeTestJSON-1891426908-project-member] [instance: 1f2b4426-815f-4ef4-b98e-e5124fec93b7] Building network info cache for instance {{(pid=74613) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 29 18:16:50 user nova-compute[74613]: DEBUG nova.network.neutron [None req-1f2110e2-8d00-45eb-a752-a0266d93c0c4 tempest-ServerRescueNegativeTestJSON-1891426908 tempest-ServerRescueNegativeTestJSON-1891426908-project-member] [instance: 1f2b4426-815f-4ef4-b98e-e5124fec93b7] Updating instance_info_cache with network_info: [{"id": "e89209f3-5532-4ff8-95c7-fb7a3334846a", "address": "fa:16:3e:98:a3:61", "network": {"id": "db79433c-b21c-4058-b98c-f62822abbf7a", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1715530752-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.251", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e6a3eb6ea0294f9da705dca72ec2789a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape89209f3-55", "ovs_interfaceid": "e89209f3-5532-4ff8-95c7-fb7a3334846a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74613) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 18:16:50 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-1f2110e2-8d00-45eb-a752-a0266d93c0c4 tempest-ServerRescueNegativeTestJSON-1891426908 tempest-ServerRescueNegativeTestJSON-1891426908-project-member] Releasing lock "refresh_cache-1f2b4426-815f-4ef4-b98e-e5124fec93b7" {{(pid=74613) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 18:16:50 user nova-compute[74613]: DEBUG nova.objects.instance [None req-1f2110e2-8d00-45eb-a752-a0266d93c0c4 tempest-ServerRescueNegativeTestJSON-1891426908 tempest-ServerRescueNegativeTestJSON-1891426908-project-member] Lazy-loading 'flavor' on Instance uuid 1f2b4426-815f-4ef4-b98e-e5124fec93b7 {{(pid=74613) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 18:16:50 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:16:50 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:16:51 user nova-compute[74613]: DEBUG nova.compute.manager [req-c7604eed-d976-4ca0-9d17-670cc6452fa9 req-ed0220b3-26b8-41ea-90c5-a5a464901bea service nova] [instance: 1f2b4426-815f-4ef4-b98e-e5124fec93b7] Received event network-vif-unplugged-e89209f3-5532-4ff8-95c7-fb7a3334846a {{(pid=74613) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 18:16:51 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-c7604eed-d976-4ca0-9d17-670cc6452fa9 req-ed0220b3-26b8-41ea-90c5-a5a464901bea service nova] Acquiring lock "1f2b4426-815f-4ef4-b98e-e5124fec93b7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 18:16:51 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-c7604eed-d976-4ca0-9d17-670cc6452fa9 req-ed0220b3-26b8-41ea-90c5-a5a464901bea service nova] Lock "1f2b4426-815f-4ef4-b98e-e5124fec93b7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 18:16:51 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-c7604eed-d976-4ca0-9d17-670cc6452fa9 req-ed0220b3-26b8-41ea-90c5-a5a464901bea service nova] Lock "1f2b4426-815f-4ef4-b98e-e5124fec93b7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 18:16:51 user nova-compute[74613]: DEBUG nova.compute.manager [req-c7604eed-d976-4ca0-9d17-670cc6452fa9 req-ed0220b3-26b8-41ea-90c5-a5a464901bea service nova] [instance: 1f2b4426-815f-4ef4-b98e-e5124fec93b7] No waiting events found dispatching network-vif-unplugged-e89209f3-5532-4ff8-95c7-fb7a3334846a {{(pid=74613) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 18:16:51 user nova-compute[74613]: WARNING nova.compute.manager [req-c7604eed-d976-4ca0-9d17-670cc6452fa9 req-ed0220b3-26b8-41ea-90c5-a5a464901bea service nova] [instance: 1f2b4426-815f-4ef4-b98e-e5124fec93b7] Received unexpected event network-vif-unplugged-e89209f3-5532-4ff8-95c7-fb7a3334846a for instance with vm_state rescued and task_state unrescuing.
Nov 29 18:16:51 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:16:51 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:16:51 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:16:51 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:16:51 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:16:51 user nova-compute[74613]: INFO nova.virt.libvirt.driver [-] [instance: 1f2b4426-815f-4ef4-b98e-e5124fec93b7] Instance destroyed successfully.
Nov 29 18:16:51 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:16:51 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:16:51 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:16:51 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:16:52 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:16:52 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:16:52 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:16:52 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:16:53 user nova-compute[74613]: DEBUG nova.compute.manager [req-475b2aaf-1cff-45a9-8989-3b6ab7f861fd req-eb6edce3-51c5-4b42-b04d-95379141d123 service nova] [instance: 1f2b4426-815f-4ef4-b98e-e5124fec93b7] Received event network-vif-plugged-e89209f3-5532-4ff8-95c7-fb7a3334846a {{(pid=74613) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 18:16:53 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-475b2aaf-1cff-45a9-8989-3b6ab7f861fd req-eb6edce3-51c5-4b42-b04d-95379141d123 service nova] Acquiring lock "1f2b4426-815f-4ef4-b98e-e5124fec93b7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 18:16:53 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-475b2aaf-1cff-45a9-8989-3b6ab7f861fd req-eb6edce3-51c5-4b42-b04d-95379141d123 service nova] Lock "1f2b4426-815f-4ef4-b98e-e5124fec93b7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.005s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 18:16:53 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-475b2aaf-1cff-45a9-8989-3b6ab7f861fd req-eb6edce3-51c5-4b42-b04d-95379141d123 service nova] Lock "1f2b4426-815f-4ef4-b98e-e5124fec93b7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 18:16:53 user nova-compute[74613]: DEBUG nova.compute.manager [req-475b2aaf-1cff-45a9-8989-3b6ab7f861fd req-eb6edce3-51c5-4b42-b04d-95379141d123 service nova] [instance: 1f2b4426-815f-4ef4-b98e-e5124fec93b7] No waiting events found dispatching network-vif-plugged-e89209f3-5532-4ff8-95c7-fb7a3334846a {{(pid=74613) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 18:16:53 user nova-compute[74613]: WARNING nova.compute.manager [req-475b2aaf-1cff-45a9-8989-3b6ab7f861fd req-eb6edce3-51c5-4b42-b04d-95379141d123 service nova] [instance: 1f2b4426-815f-4ef4-b98e-e5124fec93b7] Received unexpected event network-vif-plugged-e89209f3-5532-4ff8-95c7-fb7a3334846a for instance with vm_state rescued and task_state unrescuing.
Nov 29 18:16:53 user nova-compute[74613]: DEBUG nova.compute.manager [req-475b2aaf-1cff-45a9-8989-3b6ab7f861fd req-eb6edce3-51c5-4b42-b04d-95379141d123 service nova] [instance: 1f2b4426-815f-4ef4-b98e-e5124fec93b7] Received event network-vif-plugged-e89209f3-5532-4ff8-95c7-fb7a3334846a {{(pid=74613) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 18:16:53 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-475b2aaf-1cff-45a9-8989-3b6ab7f861fd req-eb6edce3-51c5-4b42-b04d-95379141d123 service nova] Acquiring lock "1f2b4426-815f-4ef4-b98e-e5124fec93b7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 18:16:53 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-475b2aaf-1cff-45a9-8989-3b6ab7f861fd req-eb6edce3-51c5-4b42-b04d-95379141d123 service nova] Lock "1f2b4426-815f-4ef4-b98e-e5124fec93b7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 18:16:53 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-475b2aaf-1cff-45a9-8989-3b6ab7f861fd req-eb6edce3-51c5-4b42-b04d-95379141d123 service nova] Lock "1f2b4426-815f-4ef4-b98e-e5124fec93b7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 18:16:53 user nova-compute[74613]: DEBUG nova.compute.manager [req-475b2aaf-1cff-45a9-8989-3b6ab7f861fd req-eb6edce3-51c5-4b42-b04d-95379141d123 service nova] [instance: 1f2b4426-815f-4ef4-b98e-e5124fec93b7] No waiting events found dispatching network-vif-plugged-e89209f3-5532-4ff8-95c7-fb7a3334846a {{(pid=74613) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 18:16:53 user nova-compute[74613]: WARNING nova.compute.manager [req-475b2aaf-1cff-45a9-8989-3b6ab7f861fd req-eb6edce3-51c5-4b42-b04d-95379141d123 service nova] [instance: 1f2b4426-815f-4ef4-b98e-e5124fec93b7] Received unexpected event network-vif-plugged-e89209f3-5532-4ff8-95c7-fb7a3334846a for instance with vm_state rescued and task_state unrescuing.
Nov 29 18:16:53 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:16:53 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:16:54 user nova-compute[74613]: DEBUG nova.compute.manager [None req-fe284607-cdd4-48ec-84a8-208fde0abe22 tempest-TestVolumeBootPattern-1318569205 tempest-TestVolumeBootPattern-1318569205-project-member] [instance: 3a2ac289-fc34-4c7b-a689-b499e2562578] Start spawning the instance on the hypervisor. {{(pid=74613) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 29 18:16:54 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-fe284607-cdd4-48ec-84a8-208fde0abe22 tempest-TestVolumeBootPattern-1318569205 tempest-TestVolumeBootPattern-1318569205-project-member] [instance: 3a2ac289-fc34-4c7b-a689-b499e2562578] Creating instance directory {{(pid=74613) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 29 18:16:54 user nova-compute[74613]: INFO nova.virt.libvirt.driver [None req-fe284607-cdd4-48ec-84a8-208fde0abe22 tempest-TestVolumeBootPattern-1318569205 tempest-TestVolumeBootPattern-1318569205-project-member] [instance: 3a2ac289-fc34-4c7b-a689-b499e2562578] Creating image(s)
Nov 29 18:16:54 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-fe284607-cdd4-48ec-84a8-208fde0abe22 tempest-TestVolumeBootPattern-1318569205 tempest-TestVolumeBootPattern-1318569205-project-member] [instance: 3a2ac289-fc34-4c7b-a689-b499e2562578] Did not create local disks {{(pid=74613) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 29 18:16:54 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-fe284607-cdd4-48ec-84a8-208fde0abe22 tempest-TestVolumeBootPattern-1318569205 tempest-TestVolumeBootPattern-1318569205-project-member] [instance: 3a2ac289-fc34-4c7b-a689-b499e2562578] Ensure instance console log exists: /opt/stack/data/nova/instances/3a2ac289-fc34-4c7b-a689-b499e2562578/console.log {{(pid=74613) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 29 18:16:54 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-fe284607-cdd4-48ec-84a8-208fde0abe22 tempest-TestVolumeBootPattern-1318569205 tempest-TestVolumeBootPattern-1318569205-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 18:16:54 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-fe284607-cdd4-48ec-84a8-208fde0abe22 tempest-TestVolumeBootPattern-1318569205 tempest-TestVolumeBootPattern-1318569205-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 18:16:54 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-fe284607-cdd4-48ec-84a8-208fde0abe22 tempest-TestVolumeBootPattern-1318569205 tempest-TestVolumeBootPattern-1318569205-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 18:16:54 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-fe284607-cdd4-48ec-84a8-208fde0abe22 tempest-TestVolumeBootPattern-1318569205 tempest-TestVolumeBootPattern-1318569205-project-member] [instance: 3a2ac289-fc34-4c7b-a689-b499e2562578] Start _get_guest_xml network_info=[{"id": "6c245bc7-a2bd-47a5-a37b-a7d583d1b2e6", "address": "fa:16:3e:e4:33:64", "network": {"id": "4a5179dd-d0b1-44c3-80c1-08dd7b0152f1", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1296336996-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "67390f1402214191904cfbd68c3142a7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6c245bc7-a2", "ovs_interfaceid": "6c245bc7-a2bd-47a5-a37b-a7d583d1b2e6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:5d74e565-9547-4f44-8005-0615d625a275', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'cfUYCiaq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '3a2ac289-fc34-4c7b-a689-b499e2562578', 'attached_at': '', 'detached_at': '', 'volume_id': '5d74e565-9547-4f44-8005-0615d625a275', 'serial': '5d74e565-9547-4f44-8005-0615d625a275'}, 'mount_device': '/dev/vda', 'delete_on_termination': True, 'device_type': 'disk', 'boot_index': 0, 'guest_format': None, 'attachment_id': 'a4142f5a-8a42-4c82-ab39-cc3dc74711f8', 'disk_bus': 'virtio', 'volume_type': None} {{(pid=74613) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 29 18:16:54 user nova-compute[74613]: WARNING nova.virt.libvirt.driver [None req-fe284607-cdd4-48ec-84a8-208fde0abe22 tempest-TestVolumeBootPattern-1318569205 tempest-TestVolumeBootPattern-1318569205-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 18:16:54 user nova-compute[74613]: WARNING nova.virt.libvirt.driver [None req-fe284607-cdd4-48ec-84a8-208fde0abe22 tempest-TestVolumeBootPattern-1318569205 tempest-TestVolumeBootPattern-1318569205-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 18:16:54 user nova-compute[74613]: DEBUG nova.virt.libvirt.host [None req-fe284607-cdd4-48ec-84a8-208fde0abe22 tempest-TestVolumeBootPattern-1318569205 tempest-TestVolumeBootPattern-1318569205-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74613) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 29 18:16:54 user nova-compute[74613]: DEBUG nova.virt.libvirt.host [None req-fe284607-cdd4-48ec-84a8-208fde0abe22 tempest-TestVolumeBootPattern-1318569205 tempest-TestVolumeBootPattern-1318569205-project-member] CPU controller missing on host. {{(pid=74613) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 29 18:16:54 user nova-compute[74613]: DEBUG nova.virt.libvirt.host [None req-fe284607-cdd4-48ec-84a8-208fde0abe22 tempest-TestVolumeBootPattern-1318569205 tempest-TestVolumeBootPattern-1318569205-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74613) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 29 18:16:54 user nova-compute[74613]: DEBUG nova.virt.libvirt.host [None req-fe284607-cdd4-48ec-84a8-208fde0abe22 tempest-TestVolumeBootPattern-1318569205 tempest-TestVolumeBootPattern-1318569205-project-member] CPU controller found on host. {{(pid=74613) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 29 18:16:54 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-fe284607-cdd4-48ec-84a8-208fde0abe22 tempest-TestVolumeBootPattern-1318569205 tempest-TestVolumeBootPattern-1318569205-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74613) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 29 18:16:54 user nova-compute[74613]: DEBUG nova.virt.hardware [None req-fe284607-cdd4-48ec-84a8-208fde0abe22 tempest-TestVolumeBootPattern-1318569205 tempest-TestVolumeBootPattern-1318569205-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-29T17:47:27Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74613) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 29 18:16:54 user nova-compute[74613]: DEBUG nova.virt.hardware [None req-fe284607-cdd4-48ec-84a8-208fde0abe22 tempest-TestVolumeBootPattern-1318569205 tempest-TestVolumeBootPattern-1318569205-project-member] Flavor limits 0:0:0 {{(pid=74613) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 29 18:16:54 user nova-compute[74613]: DEBUG nova.virt.hardware [None req-fe284607-cdd4-48ec-84a8-208fde0abe22 tempest-TestVolumeBootPattern-1318569205 tempest-TestVolumeBootPattern-1318569205-project-member] Image limits 0:0:0 {{(pid=74613) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 29 18:16:54 user nova-compute[74613]: DEBUG nova.virt.hardware [None req-fe284607-cdd4-48ec-84a8-208fde0abe22 tempest-TestVolumeBootPattern-1318569205 tempest-TestVolumeBootPattern-1318569205-project-member] Flavor pref 0:0:0 {{(pid=74613) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 29 18:16:54 user nova-compute[74613]: DEBUG nova.virt.hardware [None req-fe284607-cdd4-48ec-84a8-208fde0abe22 tempest-TestVolumeBootPattern-1318569205 tempest-TestVolumeBootPattern-1318569205-project-member] Image pref 0:0:0 {{(pid=74613) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 29 18:16:54 user nova-compute[74613]: DEBUG nova.virt.hardware [None req-fe284607-cdd4-48ec-84a8-208fde0abe22 tempest-TestVolumeBootPattern-1318569205 tempest-TestVolumeBootPattern-1318569205-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74613) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 29 18:16:54 user nova-compute[74613]: DEBUG nova.virt.hardware [None req-fe284607-cdd4-48ec-84a8-208fde0abe22 tempest-TestVolumeBootPattern-1318569205 tempest-TestVolumeBootPattern-1318569205-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74613) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 29 18:16:54 user nova-compute[74613]: DEBUG nova.virt.hardware [None req-fe284607-cdd4-48ec-84a8-208fde0abe22 tempest-TestVolumeBootPattern-1318569205 tempest-TestVolumeBootPattern-1318569205-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74613) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 29 18:16:54 user nova-compute[74613]: DEBUG nova.virt.hardware [None req-fe284607-cdd4-48ec-84a8-208fde0abe22 tempest-TestVolumeBootPattern-1318569205 tempest-TestVolumeBootPattern-1318569205-project-member] Got 1 possible topologies {{(pid=74613) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 29 18:16:54 user nova-compute[74613]: DEBUG nova.virt.hardware [None req-fe284607-cdd4-48ec-84a8-208fde0abe22 tempest-TestVolumeBootPattern-1318569205 tempest-TestVolumeBootPattern-1318569205-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74613) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 29 18:16:54 user nova-compute[74613]: DEBUG nova.virt.hardware [None req-fe284607-cdd4-48ec-84a8-208fde0abe22 tempest-TestVolumeBootPattern-1318569205 tempest-TestVolumeBootPattern-1318569205-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74613) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 29 18:16:54 user nova-compute[74613]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fe284607-cdd4-48ec-84a8-208fde0abe22 tempest-TestVolumeBootPattern-1318569205 tempest-TestVolumeBootPattern-1318569205-project-member] [instance: 3a2ac289-fc34-4c7b-a689-b499e2562578] Calling os-brick to attach iSCSI Volume {{(pid=74613) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 29 18:16:54 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe284607-cdd4-48ec-84a8-208fde0abe22 tempest-TestVolumeBootPattern-1318569205 tempest-TestVolumeBootPattern-1318569205-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff828156890>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:5d74e565-9547-4f44-8005-0615d625a275', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'cfUYCiaq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74613) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 18:16:54 user nova-compute[74613]: WARNING os_brick.initiator.connectors.base [None req-fe284607-cdd4-48ec-84a8-208fde0abe22 tempest-TestVolumeBootPattern-1318569205 tempest-TestVolumeBootPattern-1318569205-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 18:16:54 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.base [None req-fe284607-cdd4-48ec-84a8-208fde0abe22 tempest-TestVolumeBootPattern-1318569205 tempest-TestVolumeBootPattern-1318569205-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 18:16:54 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.base [None req-fe284607-cdd4-48ec-84a8-208fde0abe22 tempest-TestVolumeBootPattern-1318569205 tempest-TestVolumeBootPattern-1318569205-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 18:16:54 user nova-compute[74613]: WARNING os_brick.initiator.connectors.base [None req-fe284607-cdd4-48ec-84a8-208fde0abe22 tempest-TestVolumeBootPattern-1318569205 tempest-TestVolumeBootPattern-1318569205-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 18:16:54 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.base [None req-fe284607-cdd4-48ec-84a8-208fde0abe22 tempest-TestVolumeBootPattern-1318569205 tempest-TestVolumeBootPattern-1318569205-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5d74e565-9547-4f44-8005-0615d625a275" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 18:16:54 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.base [None req-fe284607-cdd4-48ec-84a8-208fde0abe22 tempest-TestVolumeBootPattern-1318569205 tempest-TestVolumeBootPattern-1318569205-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5d74e565-9547-4f44-8005-0615d625a275" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 18:16:54 user nova-compute[74613]: INFO os_brick.initiator.connectors.iscsi [None req-fe284607-cdd4-48ec-84a8-208fde0abe22 tempest-TestVolumeBootPattern-1318569205 tempest-TestVolumeBootPattern-1318569205-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 29 18:16:54 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5d74e565-9547-4f44-8005-0615d625a275 -p 172.16.0.220:3260 {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:16:54 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5d74e565-9547-4f44-8005-0615d625a275 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:16:54 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[2bd85e99-9d49-410c-9202-fd25b8b5ae1d]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 18:16:54 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe284607-cdd4-48ec-84a8-208fde0abe22 tempest-TestVolumeBootPattern-1318569205 tempest-TestVolumeBootPattern-1318569205-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 29 18:16:54 user nova-compute[74613]:  {{(pid=74613) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 18:16:54 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5d74e565-9547-4f44-8005-0615d625a275 -p 172.16.0.220:3260 --interface default --op new {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:16:54 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5d74e565-9547-4f44-8005-0615d625a275 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:16:54 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f9c61d6-4cdb-4f61-89fb-3f9ad46193ec]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:5d74e565-9547-4f44-8005-0615d625a275] added\n', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 18:16:54 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe284607-cdd4-48ec-84a8-208fde0abe22 tempest-TestVolumeBootPattern-1318569205 tempest-TestVolumeBootPattern-1318569205-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:5d74e565-9547-4f44-8005-0615d625a275] added
Nov 29 18:16:54 user nova-compute[74613]:  stderr= {{(pid=74613) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 18:16:54 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5d74e565-9547-4f44-8005-0615d625a275 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:16:54 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5d74e565-9547-4f44-8005-0615d625a275 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:16:54 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd0105f0-12a0-44b6-b803-f2a5a794d2f0]: (4, ('', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 18:16:54 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe284607-cdd4-48ec-84a8-208fde0abe22 tempest-TestVolumeBootPattern-1318569205 tempest-TestVolumeBootPattern-1318569205-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74613) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 18:16:54 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5d74e565-9547-4f44-8005-0615d625a275 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:16:54 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5d74e565-9547-4f44-8005-0615d625a275 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:16:54 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[e24805d3-b68e-451d-ad9b-7fe9e9cdc583]: (4, ('', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 18:16:54 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe284607-cdd4-48ec-84a8-208fde0abe22 tempest-TestVolumeBootPattern-1318569205 tempest-TestVolumeBootPattern-1318569205-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74613) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 18:16:54 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5d74e565-9547-4f44-8005-0615d625a275 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v cfUYCiaq {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:16:54 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5d74e565-9547-4f44-8005-0615d625a275 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v cfUYCiaq" returned: 0 in 0.018s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:16:54 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[7dae2faf-b260-44ca-8a96-6dac8d4fc921]: (4, ('', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 18:16:54 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe284607-cdd4-48ec-84a8-208fde0abe22 tempest-TestVolumeBootPattern-1318569205 tempest-TestVolumeBootPattern-1318569205-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'cfUYCiaq'): stdout= stderr= {{(pid=74613) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 18:16:54 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5d74e565-9547-4f44-8005-0615d625a275 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:16:54 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5d74e565-9547-4f44-8005-0615d625a275 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:16:54 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[449d446c-76d2-4e64-a94d-b1cd6833b96a]: (4, ('', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 18:16:54 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe284607-cdd4-48ec-84a8-208fde0abe22 tempest-TestVolumeBootPattern-1318569205 tempest-TestVolumeBootPattern-1318569205-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74613) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 18:16:54 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:16:54 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:16:54 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad4daf2d-c2a0-41f3-bb3e-a9395946c25e]: (4, ('tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:113c5dd9-52e5-46ba-8f15-faf70db70464 (non-flash)\n', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 18:16:54 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe284607-cdd4-48ec-84a8-208fde0abe22 tempest-TestVolumeBootPattern-1318569205 tempest-TestVolumeBootPattern-1318569205-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:113c5dd9-52e5-46ba-8f15-faf70db70464 (non-flash)
Nov 29 18:16:54 user nova-compute[74613]:  stderr= {{(pid=74613) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 18:16:54 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe284607-cdd4-48ec-84a8-208fde0abe22 tempest-TestVolumeBootPattern-1318569205 tempest-TestVolumeBootPattern-1318569205-project-member] iscsi session list stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:113c5dd9-52e5-46ba-8f15-faf70db70464 (non-flash)
Nov 29 18:16:54 user nova-compute[74613]:  stderr= {{(pid=74613) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 18:16:54 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5d74e565-9547-4f44-8005-0615d625a275 -p 172.16.0.220:3260 --login {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:16:54 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5d74e565-9547-4f44-8005-0615d625a275 -p 172.16.0.220:3260 --login" returned: 0 in 0.049s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:16:54 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[66feba3e-5c07-41bd-9e79-119608c64fa6]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:5d74e565-9547-4f44-8005-0615d625a275, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:5d74e565-9547-4f44-8005-0615d625a275, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 18:16:54 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe284607-cdd4-48ec-84a8-208fde0abe22 tempest-TestVolumeBootPattern-1318569205 tempest-TestVolumeBootPattern-1318569205-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:5d74e565-9547-4f44-8005-0615d625a275, portal: 172.16.0.220,3260]
Nov 29 18:16:54 user nova-compute[74613]: Login to [iface: default, target: iqn.2010-10.org.openstack:5d74e565-9547-4f44-8005-0615d625a275, portal: 172.16.0.220,3260] successful.
Nov 29 18:16:54 user nova-compute[74613]:  stderr= {{(pid=74613) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 18:16:54 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5d74e565-9547-4f44-8005-0615d625a275 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:16:54 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5d74e565-9547-4f44-8005-0615d625a275 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:16:54 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3a71901-0c0b-4ab9-a52d-34b9ca0724f3]: (4, ('', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 18:16:54 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe284607-cdd4-48ec-84a8-208fde0abe22 tempest-TestVolumeBootPattern-1318569205 tempest-TestVolumeBootPattern-1318569205-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74613) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 18:16:54 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:16:54 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:16:54 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[abac454f-1b7d-4e3f-a396-8088824eeaad]: (4, ('tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:113c5dd9-52e5-46ba-8f15-faf70db70464 (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d74e565-9547-4f44-8005-0615d625a275 (non-flash)\n', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 18:16:54 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe284607-cdd4-48ec-84a8-208fde0abe22 tempest-TestVolumeBootPattern-1318569205 tempest-TestVolumeBootPattern-1318569205-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:113c5dd9-52e5-46ba-8f15-faf70db70464 (non-flash)
Nov 29 18:16:54 user nova-compute[74613]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d74e565-9547-4f44-8005-0615d625a275 (non-flash)
Nov 29 18:16:54 user nova-compute[74613]:  stderr= {{(pid=74613) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 18:16:54 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe284607-cdd4-48ec-84a8-208fde0abe22 tempest-TestVolumeBootPattern-1318569205 tempest-TestVolumeBootPattern-1318569205-project-member] iscsi session list stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:113c5dd9-52e5-46ba-8f15-faf70db70464 (non-flash)
Nov 29 18:16:54 user nova-compute[74613]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d74e565-9547-4f44-8005-0615d625a275 (non-flash)
Nov 29 18:16:54 user nova-compute[74613]:  stderr= {{(pid=74613) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 18:16:54 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.base [None req-fe284607-cdd4-48ec-84a8-208fde0abe22 tempest-TestVolumeBootPattern-1318569205 tempest-TestVolumeBootPattern-1318569205-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5d74e565-9547-4f44-8005-0615d625a275" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.249s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 18:16:54 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe284607-cdd4-48ec-84a8-208fde0abe22 tempest-TestVolumeBootPattern-1318569205 tempest-TestVolumeBootPattern-1318569205-project-member] Connected to 172.16.0.220:3260 {{(pid=74613) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 29 18:16:54 user nova-compute[74613]: DEBUG os_brick.initiator.linuxscsi [None req-fe284607-cdd4-48ec-84a8-208fde0abe22 tempest-TestVolumeBootPattern-1318569205 tempest-TestVolumeBootPattern-1318569205-project-member] HCTL ('33', '-', '-', 0) found on session 45 with lun 0 {{(pid=74613) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 29 18:16:54 user nova-compute[74613]: DEBUG os_brick.initiator.linuxscsi [None req-fe284607-cdd4-48ec-84a8-208fde0abe22 tempest-TestVolumeBootPattern-1318569205 tempest-TestVolumeBootPattern-1318569205-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74613) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 29 18:16:54 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:16:54 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.016s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:16:54 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2216b62-12a9-4970-98c3-e4958a5cd4c4]: (4, ('- - 0', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 18:16:54 user nova-compute[74613]: DEBUG os_brick.initiator.linuxscsi [None req-fe284607-cdd4-48ec-84a8-208fde0abe22 tempest-TestVolumeBootPattern-1318569205 tempest-TestVolumeBootPattern-1318569205-project-member] Searching for a device in session 45 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74613) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 29 18:16:54 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe284607-cdd4-48ec-84a8-208fde0abe22 tempest-TestVolumeBootPattern-1318569205 tempest-TestVolumeBootPattern-1318569205-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:5d74e565-9547-4f44-8005-0615d625a275', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'cfUYCiaq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74613) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 29 18:16:54 user nova-compute[74613]: DEBUG nova.compute.manager [None req-1f2110e2-8d00-45eb-a752-a0266d93c0c4 tempest-ServerRescueNegativeTestJSON-1891426908 tempest-ServerRescueNegativeTestJSON-1891426908-project-member] [instance: 1f2b4426-815f-4ef4-b98e-e5124fec93b7] Checking state {{(pid=74613) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 29 18:16:55 user nova-compute[74613]: DEBUG nova.compute.manager [req-222ee0d3-7d56-4dca-94d5-9b2164bc1abc req-4e1a792e-3531-4cb9-b0fa-1cb40b5e8ae6 service nova] [instance: 1f2b4426-815f-4ef4-b98e-e5124fec93b7] Received event network-vif-plugged-e89209f3-5532-4ff8-95c7-fb7a3334846a {{(pid=74613) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 18:16:55 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-222ee0d3-7d56-4dca-94d5-9b2164bc1abc req-4e1a792e-3531-4cb9-b0fa-1cb40b5e8ae6 service nova] Acquiring lock "1f2b4426-815f-4ef4-b98e-e5124fec93b7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 18:16:55 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-222ee0d3-7d56-4dca-94d5-9b2164bc1abc req-4e1a792e-3531-4cb9-b0fa-1cb40b5e8ae6 service nova] Lock "1f2b4426-815f-4ef4-b98e-e5124fec93b7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 18:16:55 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-222ee0d3-7d56-4dca-94d5-9b2164bc1abc req-4e1a792e-3531-4cb9-b0fa-1cb40b5e8ae6 service nova] Lock "1f2b4426-815f-4ef4-b98e-e5124fec93b7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 18:16:55 user nova-compute[74613]: DEBUG nova.compute.manager [req-222ee0d3-7d56-4dca-94d5-9b2164bc1abc req-4e1a792e-3531-4cb9-b0fa-1cb40b5e8ae6 service nova] [instance: 1f2b4426-815f-4ef4-b98e-e5124fec93b7] No waiting events found dispatching network-vif-plugged-e89209f3-5532-4ff8-95c7-fb7a3334846a {{(pid=74613) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 18:16:55 user nova-compute[74613]: WARNING nova.compute.manager [req-222ee0d3-7d56-4dca-94d5-9b2164bc1abc req-4e1a792e-3531-4cb9-b0fa-1cb40b5e8ae6 service nova] [instance: 1f2b4426-815f-4ef4-b98e-e5124fec93b7] Received unexpected event network-vif-plugged-e89209f3-5532-4ff8-95c7-fb7a3334846a for instance with vm_state active and task_state None.
Nov 29 18:16:55 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.base [None req-fe284607-cdd4-48ec-84a8-208fde0abe22 tempest-TestVolumeBootPattern-1318569205 tempest-TestVolumeBootPattern-1318569205-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.278s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 18:16:55 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe284607-cdd4-48ec-84a8-208fde0abe22 tempest-TestVolumeBootPattern-1318569205 tempest-TestVolumeBootPattern-1318569205-project-member] <== connect_volume: return (1279ms) {'type': 'block', 'scsi_wwn': '23131396165386532', 'path': '/dev/sdb'} {{(pid=74613) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 18:16:55 user nova-compute[74613]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fe284607-cdd4-48ec-84a8-208fde0abe22 tempest-TestVolumeBootPattern-1318569205 tempest-TestVolumeBootPattern-1318569205-project-member] [instance: 3a2ac289-fc34-4c7b-a689-b499e2562578] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23131396165386532', 'path': '/dev/sdb'} {{(pid=74613) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 29 18:16:55 user nova-compute[74613]: DEBUG nova.virt.libvirt.vif [None req-fe284607-cdd4-48ec-84a8-208fde0abe22 tempest-TestVolumeBootPattern-1318569205 tempest-TestVolumeBootPattern-1318569205-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T18:16:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-volume-backed-server-257861033',display_name='tempest-TestVolumeBootPattern-volume-backed-server-257861033',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-volume-backed-server-257861033',id=42,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHVpe3YsNL5aCfPQencBmtVYIWZtsl1M/9qVsBwJz2DyylwrXlklzKDjKMQVQMqBAaYQTuulWArk2K4UyVCWxT9zgiLbzWUDgObRTvXtMBAZnLbA8OAXIKL+ldIYoQTu1w==',key_name='tempest-keypair-741566579',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='67390f1402214191904cfbd68c3142a7',ramdisk_id='',reservation_id='r-w9ym3zid',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1318569205',owner_user_name='tempest-TestVolumeBootPattern-1318569205-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T18:16:46Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='bedbc6ed47394e2b9125543a8b88a71f',uuid=3a2ac289-fc34-4c7b-a689-b499e2562578,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6c245bc7-a2bd-47a5-a37b-a7d583d1b2e6", "address": "fa:16:3e:e4:33:64", "network": {"id": "4a5179dd-d0b1-44c3-80c1-08dd7b0152f1", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1296336996-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "67390f1402214191904cfbd68c3142a7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6c245bc7-a2", "ovs_interfaceid": "6c245bc7-a2bd-47a5-a37b-a7d583d1b2e6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74613) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 29 18:16:55 user nova-compute[74613]: DEBUG nova.network.os_vif_util [None req-fe284607-cdd4-48ec-84a8-208fde0abe22 tempest-TestVolumeBootPattern-1318569205 tempest-TestVolumeBootPattern-1318569205-project-member] Converting VIF {"id": "6c245bc7-a2bd-47a5-a37b-a7d583d1b2e6", "address": "fa:16:3e:e4:33:64", "network": {"id": "4a5179dd-d0b1-44c3-80c1-08dd7b0152f1", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1296336996-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "67390f1402214191904cfbd68c3142a7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6c245bc7-a2", "ovs_interfaceid": "6c245bc7-a2bd-47a5-a37b-a7d583d1b2e6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74613) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 18:16:55 user nova-compute[74613]: DEBUG nova.network.os_vif_util [None req-fe284607-cdd4-48ec-84a8-208fde0abe22 tempest-TestVolumeBootPattern-1318569205 tempest-TestVolumeBootPattern-1318569205-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e4:33:64,bridge_name='br-int',has_traffic_filtering=True,id=6c245bc7-a2bd-47a5-a37b-a7d583d1b2e6,network=Network(4a5179dd-d0b1-44c3-80c1-08dd7b0152f1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6c245bc7-a2') {{(pid=74613) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 18:16:55 user nova-compute[74613]: DEBUG nova.objects.instance [None req-fe284607-cdd4-48ec-84a8-208fde0abe22 tempest-TestVolumeBootPattern-1318569205 tempest-TestVolumeBootPattern-1318569205-project-member] Lazy-loading 'pci_devices' on Instance uuid 3a2ac289-fc34-4c7b-a689-b499e2562578 {{(pid=74613) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 18:16:55 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-fe284607-cdd4-48ec-84a8-208fde0abe22 tempest-TestVolumeBootPattern-1318569205 tempest-TestVolumeBootPattern-1318569205-project-member] [instance: 3a2ac289-fc34-4c7b-a689-b499e2562578] End _get_guest_xml xml=<domain type="kvm">
Nov 29 18:16:55 user nova-compute[74613]:   <uuid>3a2ac289-fc34-4c7b-a689-b499e2562578</uuid>
Nov 29 18:16:55 user nova-compute[74613]:   <name>instance-0000002a</name>
Nov 29 18:16:55 user nova-compute[74613]:   <memory>524288</memory>
Nov 29 18:16:55 user nova-compute[74613]:   <vcpu>1</vcpu>
Nov 29 18:16:55 user nova-compute[74613]:   <metadata>
Nov 29 18:16:55 user nova-compute[74613]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 29 18:16:55 user nova-compute[74613]:       <nova:package version="0.0.0"/>
Nov 29 18:16:55 user nova-compute[74613]:       <nova:name>tempest-TestVolumeBootPattern-volume-backed-server-257861033</nova:name>
Nov 29 18:16:55 user nova-compute[74613]:       <nova:creationTime>2023-11-29 18:16:54</nova:creationTime>
Nov 29 18:16:55 user nova-compute[74613]:       <nova:flavor name="m1.tiny">
Nov 29 18:16:55 user nova-compute[74613]:         <nova:memory>512</nova:memory>
Nov 29 18:16:55 user nova-compute[74613]:         <nova:disk>1</nova:disk>
Nov 29 18:16:55 user nova-compute[74613]:         <nova:swap>0</nova:swap>
Nov 29 18:16:55 user nova-compute[74613]:         <nova:ephemeral>0</nova:ephemeral>
Nov 29 18:16:55 user nova-compute[74613]:         <nova:vcpus>1</nova:vcpus>
Nov 29 18:16:55 user nova-compute[74613]:       </nova:flavor>
Nov 29 18:16:55 user nova-compute[74613]:       <nova:owner>
Nov 29 18:16:55 user nova-compute[74613]:         <nova:user uuid="bedbc6ed47394e2b9125543a8b88a71f">tempest-TestVolumeBootPattern-1318569205-project-member</nova:user>
Nov 29 18:16:55 user nova-compute[74613]:         <nova:project uuid="67390f1402214191904cfbd68c3142a7">tempest-TestVolumeBootPattern-1318569205</nova:project>
Nov 29 18:16:55 user nova-compute[74613]:       </nova:owner>
Nov 29 18:16:55 user nova-compute[74613]:       <nova:ports>
Nov 29 18:16:55 user nova-compute[74613]:         <nova:port uuid="6c245bc7-a2bd-47a5-a37b-a7d583d1b2e6">
Nov 29 18:16:55 user nova-compute[74613]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Nov 29 18:16:55 user nova-compute[74613]:         </nova:port>
Nov 29 18:16:55 user nova-compute[74613]:       </nova:ports>
Nov 29 18:16:55 user nova-compute[74613]:     </nova:instance>
Nov 29 18:16:55 user nova-compute[74613]:   </metadata>
Nov 29 18:16:55 user nova-compute[74613]:   <sysinfo type="smbios">
Nov 29 18:16:55 user nova-compute[74613]:     <system>
Nov 29 18:16:55 user nova-compute[74613]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 29 18:16:55 user nova-compute[74613]:       <entry name="product">OpenStack Nova</entry>
Nov 29 18:16:55 user nova-compute[74613]:       <entry name="version">0.0.0</entry>
Nov 29 18:16:55 user nova-compute[74613]:       <entry name="serial">3a2ac289-fc34-4c7b-a689-b499e2562578</entry>
Nov 29 18:16:55 user nova-compute[74613]:       <entry name="uuid">3a2ac289-fc34-4c7b-a689-b499e2562578</entry>
Nov 29 18:16:55 user nova-compute[74613]:       <entry name="family">Virtual Machine</entry>
Nov 29 18:16:55 user nova-compute[74613]:     </system>
Nov 29 18:16:55 user nova-compute[74613]:   </sysinfo>
Nov 29 18:16:55 user nova-compute[74613]:   <os>
Nov 29 18:16:55 user nova-compute[74613]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 29 18:16:55 user nova-compute[74613]:     <boot dev="hd"/>
Nov 29 18:16:55 user nova-compute[74613]:     <smbios mode="sysinfo"/>
Nov 29 18:16:55 user nova-compute[74613]:   </os>
Nov 29 18:16:55 user nova-compute[74613]:   <features>
Nov 29 18:16:55 user nova-compute[74613]:     <acpi/>
Nov 29 18:16:55 user nova-compute[74613]:     <apic/>
Nov 29 18:16:55 user nova-compute[74613]:     <vmcoreinfo/>
Nov 29 18:16:55 user nova-compute[74613]:   </features>
Nov 29 18:16:55 user nova-compute[74613]:   <clock offset="utc">
Nov 29 18:16:55 user nova-compute[74613]:     <timer name="pit" tickpolicy="delay"/>
Nov 29 18:16:55 user nova-compute[74613]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 29 18:16:55 user nova-compute[74613]:     <timer name="hpet" present="no"/>
Nov 29 18:16:55 user nova-compute[74613]:   </clock>
Nov 29 18:16:55 user nova-compute[74613]:   <cpu mode="custom" match="exact">
Nov 29 18:16:55 user nova-compute[74613]:     <model>Nehalem</model>
Nov 29 18:16:55 user nova-compute[74613]:     <topology sockets="1" cores="1" threads="1"/>
Nov 29 18:16:55 user nova-compute[74613]:   </cpu>
Nov 29 18:16:55 user nova-compute[74613]:   <devices>
Nov 29 18:16:55 user nova-compute[74613]:     <disk type="block" device="disk">
Nov 29 18:16:55 user nova-compute[74613]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 18:16:55 user nova-compute[74613]:       <source dev="/dev/sdb"/>
Nov 29 18:16:55 user nova-compute[74613]:       <target dev="vda" bus="virtio"/>
Nov 29 18:16:55 user nova-compute[74613]:       <serial>5d74e565-9547-4f44-8005-0615d625a275</serial>
Nov 29 18:16:55 user nova-compute[74613]:     </disk>
Nov 29 18:16:55 user nova-compute[74613]:     <interface type="ethernet">
Nov 29 18:16:55 user nova-compute[74613]:       <mac address="fa:16:3e:e4:33:64"/>
Nov 29 18:16:55 user nova-compute[74613]:       <model type="virtio"/>
Nov 29 18:16:55 user nova-compute[74613]:       <mtu size="1442"/>
Nov 29 18:16:55 user nova-compute[74613]:       <target dev="tap6c245bc7-a2"/>
Nov 29 18:16:55 user nova-compute[74613]:     </interface>
Nov 29 18:16:55 user nova-compute[74613]:     <serial type="pty">
Nov 29 18:16:55 user nova-compute[74613]:       <log file="/opt/stack/data/nova/instances/3a2ac289-fc34-4c7b-a689-b499e2562578/console.log" append="off"/>
Nov 29 18:16:55 user nova-compute[74613]:     </serial>
Nov 29 18:16:55 user nova-compute[74613]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 29 18:16:55 user nova-compute[74613]:     <video>
Nov 29 18:16:55 user nova-compute[74613]:       <model type="virtio"/>
Nov 29 18:16:55 user nova-compute[74613]:     </video>
Nov 29 18:16:55 user nova-compute[74613]:     <rng model="virtio">
Nov 29 18:16:55 user nova-compute[74613]:       <backend model="random">/dev/urandom</backend>
Nov 29 18:16:55 user nova-compute[74613]:     </rng>
Nov 29 18:16:55 user nova-compute[74613]:     <controller type="usb" index="0" model="none"/>
Nov 29 18:16:55 user nova-compute[74613]:     <memballoon model="virtio">
Nov 29 18:16:55 user nova-compute[74613]:       <stats period="10"/>
Nov 29 18:16:55 user nova-compute[74613]:     </memballoon>
Nov 29 18:16:55 user nova-compute[74613]:   </devices>
Nov 29 18:16:55 user nova-compute[74613]: </domain>
Nov 29 18:16:55 user nova-compute[74613]:  {{(pid=74613) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 29 18:16:55 user nova-compute[74613]: DEBUG nova.virt.libvirt.vif [None req-fe284607-cdd4-48ec-84a8-208fde0abe22 tempest-TestVolumeBootPattern-1318569205 tempest-TestVolumeBootPattern-1318569205-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T18:16:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-volume-backed-server-257861033',display_name='tempest-TestVolumeBootPattern-volume-backed-server-257861033',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-volume-backed-server-257861033',id=42,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHVpe3YsNL5aCfPQencBmtVYIWZtsl1M/9qVsBwJz2DyylwrXlklzKDjKMQVQMqBAaYQTuulWArk2K4UyVCWxT9zgiLbzWUDgObRTvXtMBAZnLbA8OAXIKL+ldIYoQTu1w==',key_name='tempest-keypair-741566579',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='67390f1402214191904cfbd68c3142a7',ramdisk_id='',reservation_id='r-w9ym3zid',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1318569205',owner_user_name='tempest-TestVolumeBootPattern-1318569205-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T18:16:46Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='bedbc6ed47394e2b9125543a8b88a71f',uuid=3a2ac289-fc34-4c7b-a689-b499e2562578,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6c245bc7-a2bd-47a5-a37b-a7d583d1b2e6", "address": "fa:16:3e:e4:33:64", "network": {"id": "4a5179dd-d0b1-44c3-80c1-08dd7b0152f1", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1296336996-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "67390f1402214191904cfbd68c3142a7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6c245bc7-a2", "ovs_interfaceid": "6c245bc7-a2bd-47a5-a37b-a7d583d1b2e6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74613) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 29 18:16:55 user nova-compute[74613]: DEBUG nova.network.os_vif_util [None req-fe284607-cdd4-48ec-84a8-208fde0abe22 tempest-TestVolumeBootPattern-1318569205 tempest-TestVolumeBootPattern-1318569205-project-member] Converting VIF {"id": "6c245bc7-a2bd-47a5-a37b-a7d583d1b2e6", "address": "fa:16:3e:e4:33:64", "network": {"id": "4a5179dd-d0b1-44c3-80c1-08dd7b0152f1", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1296336996-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "67390f1402214191904cfbd68c3142a7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6c245bc7-a2", "ovs_interfaceid": "6c245bc7-a2bd-47a5-a37b-a7d583d1b2e6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74613) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 18:16:55 user nova-compute[74613]: DEBUG nova.network.os_vif_util [None req-fe284607-cdd4-48ec-84a8-208fde0abe22 tempest-TestVolumeBootPattern-1318569205 tempest-TestVolumeBootPattern-1318569205-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e4:33:64,bridge_name='br-int',has_traffic_filtering=True,id=6c245bc7-a2bd-47a5-a37b-a7d583d1b2e6,network=Network(4a5179dd-d0b1-44c3-80c1-08dd7b0152f1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6c245bc7-a2') {{(pid=74613) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 18:16:55 user nova-compute[74613]: DEBUG os_vif [None req-fe284607-cdd4-48ec-84a8-208fde0abe22 tempest-TestVolumeBootPattern-1318569205 tempest-TestVolumeBootPattern-1318569205-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e4:33:64,bridge_name='br-int',has_traffic_filtering=True,id=6c245bc7-a2bd-47a5-a37b-a7d583d1b2e6,network=Network(4a5179dd-d0b1-44c3-80c1-08dd7b0152f1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6c245bc7-a2') {{(pid=74613) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 29 18:16:55 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:16:55 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74613) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 18:16:55 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74613) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 29 18:16:55 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:16:55 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '2892c92a-568d-57b5-9475-1bfa3738624e', '_type': 'linux-noop'}}, row=False) {{(pid=74613) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 18:16:55 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:16:55 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 18:16:55 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:16:55 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap6c245bc7-a2, may_exist=True, interface_attrs={}) {{(pid=74613) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 18:16:55 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap6c245bc7-a2, col_values=(('qos', UUID('684728ec-7888-4ca2-9c68-b83b14263e56')),), if_exists=True) {{(pid=74613) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 18:16:55 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap6c245bc7-a2, col_values=(('external_ids', {'iface-id': '6c245bc7-a2bd-47a5-a37b-a7d583d1b2e6', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:e4:33:64', 'vm-uuid': '3a2ac289-fc34-4c7b-a689-b499e2562578'}),), if_exists=True) {{(pid=74613) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 18:16:55 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:16:55 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 18:16:55 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:16:55 user nova-compute[74613]: INFO os_vif [None req-fe284607-cdd4-48ec-84a8-208fde0abe22 tempest-TestVolumeBootPattern-1318569205 tempest-TestVolumeBootPattern-1318569205-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e4:33:64,bridge_name='br-int',has_traffic_filtering=True,id=6c245bc7-a2bd-47a5-a37b-a7d583d1b2e6,network=Network(4a5179dd-d0b1-44c3-80c1-08dd7b0152f1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6c245bc7-a2')
Nov 29 18:16:55 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-fe284607-cdd4-48ec-84a8-208fde0abe22 tempest-TestVolumeBootPattern-1318569205 tempest-TestVolumeBootPattern-1318569205-project-member] No BDM found with device name vda, not building metadata. {{(pid=74613) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 18:16:55 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-fe284607-cdd4-48ec-84a8-208fde0abe22 tempest-TestVolumeBootPattern-1318569205 tempest-TestVolumeBootPattern-1318569205-project-member] No VIF found with MAC fa:16:3e:e4:33:64, not building metadata {{(pid=74613) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 29 18:16:56 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:16:56 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:16:56 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:16:57 user nova-compute[74613]: DEBUG nova.compute.manager [req-2a8a37c3-f026-4c23-82aa-93dbe33511cb req-1847c6fe-1f40-445d-aa35-6cd96bf7d532 service nova] [instance: 3a2ac289-fc34-4c7b-a689-b499e2562578] Received event network-vif-plugged-6c245bc7-a2bd-47a5-a37b-a7d583d1b2e6 {{(pid=74613) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 18:16:57 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-2a8a37c3-f026-4c23-82aa-93dbe33511cb req-1847c6fe-1f40-445d-aa35-6cd96bf7d532 service nova] Acquiring lock "3a2ac289-fc34-4c7b-a689-b499e2562578-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 18:16:57 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-2a8a37c3-f026-4c23-82aa-93dbe33511cb req-1847c6fe-1f40-445d-aa35-6cd96bf7d532 service nova] Lock "3a2ac289-fc34-4c7b-a689-b499e2562578-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 18:16:57 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-2a8a37c3-f026-4c23-82aa-93dbe33511cb req-1847c6fe-1f40-445d-aa35-6cd96bf7d532 service nova] Lock "3a2ac289-fc34-4c7b-a689-b499e2562578-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 18:16:57 user nova-compute[74613]: DEBUG nova.compute.manager [req-2a8a37c3-f026-4c23-82aa-93dbe33511cb req-1847c6fe-1f40-445d-aa35-6cd96bf7d532 service nova] [instance: 3a2ac289-fc34-4c7b-a689-b499e2562578] No waiting events found dispatching network-vif-plugged-6c245bc7-a2bd-47a5-a37b-a7d583d1b2e6 {{(pid=74613) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 18:16:57 user nova-compute[74613]: WARNING nova.compute.manager [req-2a8a37c3-f026-4c23-82aa-93dbe33511cb req-1847c6fe-1f40-445d-aa35-6cd96bf7d532 service nova] [instance: 3a2ac289-fc34-4c7b-a689-b499e2562578] Received unexpected event network-vif-plugged-6c245bc7-a2bd-47a5-a37b-a7d583d1b2e6 for instance with vm_state building and task_state spawning.
Nov 29 18:16:57 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:16:57 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:16:57 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:16:57 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:16:59 user nova-compute[74613]: DEBUG nova.compute.manager [None req-fe284607-cdd4-48ec-84a8-208fde0abe22 tempest-TestVolumeBootPattern-1318569205 tempest-TestVolumeBootPattern-1318569205-project-member] [instance: 3a2ac289-fc34-4c7b-a689-b499e2562578] Instance event wait completed in 0 seconds for  {{(pid=74613) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 29 18:16:59 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-fe284607-cdd4-48ec-84a8-208fde0abe22 tempest-TestVolumeBootPattern-1318569205 tempest-TestVolumeBootPattern-1318569205-project-member] [instance: 3a2ac289-fc34-4c7b-a689-b499e2562578] Guest created on hypervisor {{(pid=74613) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 29 18:16:59 user nova-compute[74613]: INFO nova.virt.libvirt.driver [-] [instance: 3a2ac289-fc34-4c7b-a689-b499e2562578] Instance spawned successfully.
Nov 29 18:16:59 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-fe284607-cdd4-48ec-84a8-208fde0abe22 tempest-TestVolumeBootPattern-1318569205 tempest-TestVolumeBootPattern-1318569205-project-member] [instance: 3a2ac289-fc34-4c7b-a689-b499e2562578] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74613) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 29 18:16:59 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-fe284607-cdd4-48ec-84a8-208fde0abe22 tempest-TestVolumeBootPattern-1318569205 tempest-TestVolumeBootPattern-1318569205-project-member] [instance: 3a2ac289-fc34-4c7b-a689-b499e2562578] Found default for hw_cdrom_bus of ide {{(pid=74613) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 18:16:59 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-fe284607-cdd4-48ec-84a8-208fde0abe22 tempest-TestVolumeBootPattern-1318569205 tempest-TestVolumeBootPattern-1318569205-project-member] [instance: 3a2ac289-fc34-4c7b-a689-b499e2562578] Found default for hw_disk_bus of virtio {{(pid=74613) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 18:16:59 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-fe284607-cdd4-48ec-84a8-208fde0abe22 tempest-TestVolumeBootPattern-1318569205 tempest-TestVolumeBootPattern-1318569205-project-member] [instance: 3a2ac289-fc34-4c7b-a689-b499e2562578] Found default for hw_input_bus of None {{(pid=74613) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 18:16:59 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-fe284607-cdd4-48ec-84a8-208fde0abe22 tempest-TestVolumeBootPattern-1318569205 tempest-TestVolumeBootPattern-1318569205-project-member] [instance: 3a2ac289-fc34-4c7b-a689-b499e2562578] Found default for hw_pointer_model of None {{(pid=74613) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 18:16:59 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-fe284607-cdd4-48ec-84a8-208fde0abe22 tempest-TestVolumeBootPattern-1318569205 tempest-TestVolumeBootPattern-1318569205-project-member] [instance: 3a2ac289-fc34-4c7b-a689-b499e2562578] Found default for hw_video_model of virtio {{(pid=74613) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 18:16:59 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-fe284607-cdd4-48ec-84a8-208fde0abe22 tempest-TestVolumeBootPattern-1318569205 tempest-TestVolumeBootPattern-1318569205-project-member] [instance: 3a2ac289-fc34-4c7b-a689-b499e2562578] Found default for hw_vif_model of virtio {{(pid=74613) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 18:16:59 user nova-compute[74613]: DEBUG nova.compute.manager [req-64e5f702-4165-4ca4-bb56-a7efcab08eae req-1550e376-d048-4caa-857d-ec4c8e424c38 service nova] [instance: 3a2ac289-fc34-4c7b-a689-b499e2562578] Received event network-vif-plugged-6c245bc7-a2bd-47a5-a37b-a7d583d1b2e6 {{(pid=74613) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 18:16:59 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-64e5f702-4165-4ca4-bb56-a7efcab08eae req-1550e376-d048-4caa-857d-ec4c8e424c38 service nova] Acquiring lock "3a2ac289-fc34-4c7b-a689-b499e2562578-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 18:16:59 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-64e5f702-4165-4ca4-bb56-a7efcab08eae req-1550e376-d048-4caa-857d-ec4c8e424c38 service nova] Lock "3a2ac289-fc34-4c7b-a689-b499e2562578-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 18:16:59 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-64e5f702-4165-4ca4-bb56-a7efcab08eae req-1550e376-d048-4caa-857d-ec4c8e424c38 service nova] Lock "3a2ac289-fc34-4c7b-a689-b499e2562578-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 18:16:59 user nova-compute[74613]: DEBUG nova.compute.manager [req-64e5f702-4165-4ca4-bb56-a7efcab08eae req-1550e376-d048-4caa-857d-ec4c8e424c38 service nova] [instance: 3a2ac289-fc34-4c7b-a689-b499e2562578] No waiting events found dispatching network-vif-plugged-6c245bc7-a2bd-47a5-a37b-a7d583d1b2e6 {{(pid=74613) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 18:16:59 user nova-compute[74613]: WARNING nova.compute.manager [req-64e5f702-4165-4ca4-bb56-a7efcab08eae req-1550e376-d048-4caa-857d-ec4c8e424c38 service nova] [instance: 3a2ac289-fc34-4c7b-a689-b499e2562578] Received unexpected event network-vif-plugged-6c245bc7-a2bd-47a5-a37b-a7d583d1b2e6 for instance with vm_state building and task_state spawning.
Nov 29 18:16:59 user nova-compute[74613]: INFO nova.compute.manager [None req-fe284607-cdd4-48ec-84a8-208fde0abe22 tempest-TestVolumeBootPattern-1318569205 tempest-TestVolumeBootPattern-1318569205-project-member] [instance: 3a2ac289-fc34-4c7b-a689-b499e2562578] Took 5.13 seconds to spawn the instance on the hypervisor.
Nov 29 18:16:59 user nova-compute[74613]: DEBUG nova.compute.manager [None req-fe284607-cdd4-48ec-84a8-208fde0abe22 tempest-TestVolumeBootPattern-1318569205 tempest-TestVolumeBootPattern-1318569205-project-member] [instance: 3a2ac289-fc34-4c7b-a689-b499e2562578] Checking state {{(pid=74613) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 29 18:16:59 user nova-compute[74613]: INFO nova.compute.manager [None req-fe284607-cdd4-48ec-84a8-208fde0abe22 tempest-TestVolumeBootPattern-1318569205 tempest-TestVolumeBootPattern-1318569205-project-member] [instance: 3a2ac289-fc34-4c7b-a689-b499e2562578] Took 13.50 seconds to build instance.
Nov 29 18:16:59 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-fe284607-cdd4-48ec-84a8-208fde0abe22 tempest-TestVolumeBootPattern-1318569205 tempest-TestVolumeBootPattern-1318569205-project-member] Lock "3a2ac289-fc34-4c7b-a689-b499e2562578" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 13.586s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 18:17:00 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:17:01 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:17:05 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:17:06 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:17:10 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:17:11 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:17:15 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:17:16 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:17:20 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:17:21 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:17:25 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:17:26 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:17:30 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:17:31 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:17:33 user nova-compute[74613]: DEBUG oslo_service.periodic_task [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74613) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 18:17:35 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:17:36 user nova-compute[74613]: DEBUG oslo_service.periodic_task [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74613) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 18:17:38 user nova-compute[74613]: DEBUG oslo_service.periodic_task [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74613) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 18:17:38 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 18:17:38 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 18:17:38 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 18:17:38 user nova-compute[74613]: DEBUG nova.compute.resource_tracker [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Auditing locally available compute resources for user (node: user) {{(pid=74613) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 29 18:17:38 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1f2b4426-815f-4ef4-b98e-e5124fec93b7/disk --force-share --output=json {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:17:38 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1f2b4426-815f-4ef4-b98e-e5124fec93b7/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:17:38 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1f2b4426-815f-4ef4-b98e-e5124fec93b7/disk --force-share --output=json {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:17:39 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1f2b4426-815f-4ef4-b98e-e5124fec93b7/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:17:39 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=74613) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 29 18:17:39 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b2c3eb4f-df1f-46d0-acb5-3ac9f16f9a82/disk --force-share --output=json {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:17:39 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b2c3eb4f-df1f-46d0-acb5-3ac9f16f9a82/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:17:39 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b2c3eb4f-df1f-46d0-acb5-3ac9f16f9a82/disk --force-share --output=json {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:17:39 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b2c3eb4f-df1f-46d0-acb5-3ac9f16f9a82/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:17:39 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74613) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 29 18:17:39 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f4a1329-b3b9-4d1c-8735-abddabc359fd/disk.rescue --force-share --output=json {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:17:39 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f4a1329-b3b9-4d1c-8735-abddabc359fd/disk.rescue --force-share --output=json" returned: 0 in 0.181s {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:17:39 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f4a1329-b3b9-4d1c-8735-abddabc359fd/disk.rescue --force-share --output=json {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:17:39 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f4a1329-b3b9-4d1c-8735-abddabc359fd/disk.rescue --force-share --output=json" returned: 0 in 0.187s {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:17:39 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f4a1329-b3b9-4d1c-8735-abddabc359fd/disk --force-share --output=json {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:17:40 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f4a1329-b3b9-4d1c-8735-abddabc359fd/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:17:40 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f4a1329-b3b9-4d1c-8735-abddabc359fd/disk --force-share --output=json {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:17:40 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f4a1329-b3b9-4d1c-8735-abddabc359fd/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:17:40 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d9f10bfb-5202-4b4a-a42d-f167501f597b/disk --force-share --output=json {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:17:40 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d9f10bfb-5202-4b4a-a42d-f167501f597b/disk --force-share --output=json" returned: 0 in 0.167s {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:17:40 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d9f10bfb-5202-4b4a-a42d-f167501f597b/disk --force-share --output=json {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:17:40 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d9f10bfb-5202-4b4a-a42d-f167501f597b/disk --force-share --output=json" returned: 0 in 0.166s {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:17:40 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6993e2e7-7e03-45b4-9d3d-3742589b6078/disk --force-share --output=json {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:17:40 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:17:40 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6993e2e7-7e03-45b4-9d3d-3742589b6078/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:17:40 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6993e2e7-7e03-45b4-9d3d-3742589b6078/disk --force-share --output=json {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:17:40 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6993e2e7-7e03-45b4-9d3d-3742589b6078/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:17:41 user nova-compute[74613]: WARNING nova.virt.libvirt.driver [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 18:17:41 user nova-compute[74613]: WARNING nova.virt.libvirt.driver [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 18:17:41 user nova-compute[74613]: DEBUG nova.compute.resource_tracker [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Hypervisor/Node resource view: name=user free_ram=8201MB free_disk=24.874706268310547GB free_vcpus=6 pci_devices=[{"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74613) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 29 18:17:41 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 18:17:41 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 18:17:41 user nova-compute[74613]: DEBUG nova.compute.resource_tracker [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Instance 6993e2e7-7e03-45b4-9d3d-3742589b6078 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74613) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 18:17:41 user nova-compute[74613]: DEBUG nova.compute.resource_tracker [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Instance 6f4a1329-b3b9-4d1c-8735-abddabc359fd actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74613) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 18:17:41 user nova-compute[74613]: DEBUG nova.compute.resource_tracker [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Instance 1f2b4426-815f-4ef4-b98e-e5124fec93b7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74613) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 18:17:41 user nova-compute[74613]: DEBUG nova.compute.resource_tracker [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Instance d9f10bfb-5202-4b4a-a42d-f167501f597b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74613) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 18:17:41 user nova-compute[74613]: DEBUG nova.compute.resource_tracker [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Instance b2c3eb4f-df1f-46d0-acb5-3ac9f16f9a82 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74613) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 18:17:41 user nova-compute[74613]: DEBUG nova.compute.resource_tracker [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Instance 3a2ac289-fc34-4c7b-a689-b499e2562578 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74613) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 18:17:41 user nova-compute[74613]: DEBUG nova.compute.resource_tracker [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Total usable vcpus: 12, total allocated vcpus: 6 {{(pid=74613) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 29 18:17:41 user nova-compute[74613]: DEBUG nova.compute.resource_tracker [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Final resource view: name=user phys_ram=16011MB used_ram=3584MB phys_disk=40GB used_disk=5GB total_vcpus=12 used_vcpus=6 pci_stats=[] {{(pid=74613) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 29 18:17:41 user nova-compute[74613]: DEBUG nova.scheduler.client.report [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Refreshing inventories for resource provider 639d980e-3b12-44b1-b8f4-1812416fa4dd {{(pid=74613) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 29 18:17:41 user nova-compute[74613]: DEBUG nova.scheduler.client.report [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Updating ProviderTree inventory for provider 639d980e-3b12-44b1-b8f4-1812416fa4dd from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74613) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 29 18:17:41 user nova-compute[74613]: DEBUG nova.compute.provider_tree [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Updating inventory in ProviderTree for provider 639d980e-3b12-44b1-b8f4-1812416fa4dd with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74613) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 29 18:17:41 user nova-compute[74613]: DEBUG nova.scheduler.client.report [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Refreshing aggregate associations for resource provider 639d980e-3b12-44b1-b8f4-1812416fa4dd, aggregates: None {{(pid=74613) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 29 18:17:41 user nova-compute[74613]: DEBUG nova.scheduler.client.report [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Refreshing trait associations for resource provider 639d980e-3b12-44b1-b8f4-1812416fa4dd, traits: HW_CPU_X86_SSE,COMPUTE_VOLUME_EXTEND,COMPUTE_ACCELERATORS,HW_CPU_X86_SSE41,COMPUTE_STORAGE_BUS_IDE,COMPUTE_NODE,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,HW_CPU_X86_MMX,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,HW_CPU_X86_SSE2,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_STORAGE_BUS_USB,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_STORAGE_BUS_SATA,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_DEVICE_TAGGING,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_RESCUE_BFV,HW_CPU_X86_SSSE3,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_TRUSTED_CERTS,HW_CPU_X86_SSE42,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_STORAGE_BUS_FDC {{(pid=74613) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 29 18:17:41 user nova-compute[74613]: DEBUG nova.compute.provider_tree [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Inventory has not changed in ProviderTree for provider: 639d980e-3b12-44b1-b8f4-1812416fa4dd {{(pid=74613) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 18:17:41 user nova-compute[74613]: DEBUG nova.scheduler.client.report [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Inventory has not changed for provider 639d980e-3b12-44b1-b8f4-1812416fa4dd based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74613) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 18:17:41 user nova-compute[74613]: DEBUG nova.compute.resource_tracker [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Compute_service record updated for user:user {{(pid=74613) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 29 18:17:41 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.604s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 18:17:41 user nova-compute[74613]: DEBUG oslo_service.periodic_task [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=74613) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 18:17:41 user nova-compute[74613]: DEBUG nova.compute.manager [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Cleaning up deleted instances {{(pid=74613) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 29 18:17:41 user nova-compute[74613]: DEBUG nova.compute.manager [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] There are 0 instances to clean {{(pid=74613) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 29 18:17:42 user nova-compute[74613]: DEBUG oslo_service.periodic_task [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74613) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 18:17:42 user nova-compute[74613]: DEBUG nova.compute.manager [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Starting heal instance info cache {{(pid=74613) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 29 18:17:43 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Acquiring lock "refresh_cache-1f2b4426-815f-4ef4-b98e-e5124fec93b7" {{(pid=74613) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 18:17:43 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Acquired lock "refresh_cache-1f2b4426-815f-4ef4-b98e-e5124fec93b7" {{(pid=74613) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 18:17:43 user nova-compute[74613]: DEBUG nova.network.neutron [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] [instance: 1f2b4426-815f-4ef4-b98e-e5124fec93b7] Forcefully refreshing network info cache for instance {{(pid=74613) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 29 18:17:43 user nova-compute[74613]: DEBUG nova.network.neutron [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] [instance: 1f2b4426-815f-4ef4-b98e-e5124fec93b7] Updating instance_info_cache with network_info: [{"id": "e89209f3-5532-4ff8-95c7-fb7a3334846a", "address": "fa:16:3e:98:a3:61", "network": {"id": "db79433c-b21c-4058-b98c-f62822abbf7a", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1715530752-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.251", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e6a3eb6ea0294f9da705dca72ec2789a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape89209f3-55", "ovs_interfaceid": "e89209f3-5532-4ff8-95c7-fb7a3334846a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74613) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 18:17:43 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Releasing lock "refresh_cache-1f2b4426-815f-4ef4-b98e-e5124fec93b7" {{(pid=74613) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 18:17:43 user nova-compute[74613]: DEBUG nova.compute.manager [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] [instance: 1f2b4426-815f-4ef4-b98e-e5124fec93b7] Updated the network info_cache for instance {{(pid=74613) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 29 18:17:43 user nova-compute[74613]: DEBUG oslo_service.periodic_task [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74613) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 18:17:43 user nova-compute[74613]: DEBUG oslo_service.periodic_task [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74613) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 18:17:43 user nova-compute[74613]: DEBUG oslo_service.periodic_task [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74613) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 18:17:43 user nova-compute[74613]: DEBUG oslo_service.periodic_task [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74613) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 18:17:44 user nova-compute[74613]: DEBUG oslo_service.periodic_task [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74613) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 18:17:44 user nova-compute[74613]: DEBUG nova.compute.manager [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74613) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 29 18:17:45 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:17:46 user nova-compute[74613]: DEBUG oslo_service.periodic_task [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=74613) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 18:17:47 user nova-compute[74613]: DEBUG oslo_service.periodic_task [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=74613) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 18:17:47 user nova-compute[74613]: DEBUG nova.compute.manager [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Cleaning up deleted instances with incomplete migration  {{(pid=74613) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 29 18:17:50 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 18:17:50 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:17:50 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74613) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 29 18:17:50 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74613) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 18:17:50 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74613) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 18:17:50 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:17:51 user nova-compute[74613]: DEBUG oslo_service.periodic_task [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74613) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 18:17:55 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:17:57 user nova-compute[74613]: DEBUG oslo_service.periodic_task [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Running periodic task ComputeManager._cleanup_running_deleted_instances {{(pid=74613) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 18:18:00 user nova-compute[74613]: DEBUG nova.compute.manager [req-03e11baf-271c-443d-9129-3753bf5d0558 req-235e1568-c418-4cdb-96a9-5608560c2da5 service nova] [instance: d9f10bfb-5202-4b4a-a42d-f167501f597b] Received event network-changed-796b80c8-8509-4685-ac3b-6832f110bc9d {{(pid=74613) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 18:18:00 user nova-compute[74613]: DEBUG nova.compute.manager [req-03e11baf-271c-443d-9129-3753bf5d0558 req-235e1568-c418-4cdb-96a9-5608560c2da5 service nova] [instance: d9f10bfb-5202-4b4a-a42d-f167501f597b] Refreshing instance network info cache due to event network-changed-796b80c8-8509-4685-ac3b-6832f110bc9d. {{(pid=74613) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 18:18:00 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-03e11baf-271c-443d-9129-3753bf5d0558 req-235e1568-c418-4cdb-96a9-5608560c2da5 service nova] Acquiring lock "refresh_cache-d9f10bfb-5202-4b4a-a42d-f167501f597b" {{(pid=74613) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 18:18:00 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-03e11baf-271c-443d-9129-3753bf5d0558 req-235e1568-c418-4cdb-96a9-5608560c2da5 service nova] Acquired lock "refresh_cache-d9f10bfb-5202-4b4a-a42d-f167501f597b" {{(pid=74613) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 18:18:00 user nova-compute[74613]: DEBUG nova.network.neutron [req-03e11baf-271c-443d-9129-3753bf5d0558 req-235e1568-c418-4cdb-96a9-5608560c2da5 service nova] [instance: d9f10bfb-5202-4b4a-a42d-f167501f597b] Refreshing network info cache for port 796b80c8-8509-4685-ac3b-6832f110bc9d {{(pid=74613) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 18:18:00 user nova-compute[74613]: DEBUG nova.network.neutron [req-03e11baf-271c-443d-9129-3753bf5d0558 req-235e1568-c418-4cdb-96a9-5608560c2da5 service nova] [instance: d9f10bfb-5202-4b4a-a42d-f167501f597b] Updated VIF entry in instance network info cache for port 796b80c8-8509-4685-ac3b-6832f110bc9d. {{(pid=74613) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 18:18:00 user nova-compute[74613]: DEBUG nova.network.neutron [req-03e11baf-271c-443d-9129-3753bf5d0558 req-235e1568-c418-4cdb-96a9-5608560c2da5 service nova] [instance: d9f10bfb-5202-4b4a-a42d-f167501f597b] Updating instance_info_cache with network_info: [{"id": "796b80c8-8509-4685-ac3b-6832f110bc9d", "address": "fa:16:3e:29:a3:f5", "network": {"id": "c317481b-f8cf-40a0-a326-836a5ea4c495", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-887666255-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.178", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "37b89c13ba1d4a94805d6af69ad26fb8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap796b80c8-85", "ovs_interfaceid": "796b80c8-8509-4685-ac3b-6832f110bc9d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74613) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 18:18:00 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-03e11baf-271c-443d-9129-3753bf5d0558 req-235e1568-c418-4cdb-96a9-5608560c2da5 service nova] Releasing lock "refresh_cache-d9f10bfb-5202-4b4a-a42d-f167501f597b" {{(pid=74613) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 18:18:00 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 18:18:01 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:18:02 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-dd48f43a-d6ac-4ebc-a3e8-ada5987ed1aa tempest-AttachVolumeNegativeTest-483083654 tempest-AttachVolumeNegativeTest-483083654-project-member] Acquiring lock "d9f10bfb-5202-4b4a-a42d-f167501f597b" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 18:18:02 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-dd48f43a-d6ac-4ebc-a3e8-ada5987ed1aa tempest-AttachVolumeNegativeTest-483083654 tempest-AttachVolumeNegativeTest-483083654-project-member] Lock "d9f10bfb-5202-4b4a-a42d-f167501f597b" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 18:18:02 user nova-compute[74613]: DEBUG nova.objects.instance [None req-dd48f43a-d6ac-4ebc-a3e8-ada5987ed1aa tempest-AttachVolumeNegativeTest-483083654 tempest-AttachVolumeNegativeTest-483083654-project-member] Lazy-loading 'flavor' on Instance uuid d9f10bfb-5202-4b4a-a42d-f167501f597b {{(pid=74613) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 18:18:02 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-dd48f43a-d6ac-4ebc-a3e8-ada5987ed1aa tempest-AttachVolumeNegativeTest-483083654 tempest-AttachVolumeNegativeTest-483083654-project-member] Lock "d9f10bfb-5202-4b4a-a42d-f167501f597b" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.056s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 18:18:02 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-dd48f43a-d6ac-4ebc-a3e8-ada5987ed1aa tempest-AttachVolumeNegativeTest-483083654 tempest-AttachVolumeNegativeTest-483083654-project-member] Acquiring lock "d9f10bfb-5202-4b4a-a42d-f167501f597b" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 18:18:02 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-dd48f43a-d6ac-4ebc-a3e8-ada5987ed1aa tempest-AttachVolumeNegativeTest-483083654 tempest-AttachVolumeNegativeTest-483083654-project-member] Lock "d9f10bfb-5202-4b4a-a42d-f167501f597b" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 18:18:02 user nova-compute[74613]: INFO nova.compute.manager [None req-dd48f43a-d6ac-4ebc-a3e8-ada5987ed1aa tempest-AttachVolumeNegativeTest-483083654 tempest-AttachVolumeNegativeTest-483083654-project-member] [instance: d9f10bfb-5202-4b4a-a42d-f167501f597b] Attaching volume f2c0b94e-d018-479d-b037-7ca4cb5580a3 to /dev/vdb
Nov 29 18:18:03 user nova-compute[74613]: DEBUG os_brick.utils [None req-dd48f43a-d6ac-4ebc-a3e8-ada5987ed1aa tempest-AttachVolumeNegativeTest-483083654 tempest-AttachVolumeNegativeTest-483083654-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74613) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 18:18:03 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:18:03 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:18:03 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[77fa63f5-d43f-4838-8366-06d8d48a4343]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:400972819b5\n', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 18:18:03 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:18:03 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.024s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:18:03 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d4fc436-c7b2-4e13-b266-66277542fbf8]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 18:18:03 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:18:03 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.020s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:18:03 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[a04b337b-8b60-4f2a-88a7-e17cae360f67]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 18:18:03 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[4036db33-1010-4506-bd7d-48a6dbb9ad42]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 18:18:03 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-dd48f43a-d6ac-4ebc-a3e8-ada5987ed1aa tempest-AttachVolumeNegativeTest-483083654 tempest-AttachVolumeNegativeTest-483083654-project-member] Running cmd (subprocess): nvme version {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:18:03 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-dd48f43a-d6ac-4ebc-a3e8-ada5987ed1aa tempest-AttachVolumeNegativeTest-483083654 tempest-AttachVolumeNegativeTest-483083654-project-member] 'nvme version' failed. Not Retrying. {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 18:18:03 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.nvmeof [None req-dd48f43a-d6ac-4ebc-a3e8-ada5987ed1aa tempest-AttachVolumeNegativeTest-483083654 tempest-AttachVolumeNegativeTest-483083654-project-member] nvme not present on system {{(pid=74613) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 29 18:18:03 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:18:03 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 18:18:03 user nova-compute[74613]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 29 18:18:03 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6989278-6622-44f3-a0a9-825025ade773]: (4, '') {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 18:18:03 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.lightos [None req-dd48f43a-d6ac-4ebc-a3e8-ada5987ed1aa tempest-AttachVolumeNegativeTest-483083654 tempest-AttachVolumeNegativeTest-483083654-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74613) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 29 18:18:03 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.lightos [None req-dd48f43a-d6ac-4ebc-a3e8-ada5987ed1aa tempest-AttachVolumeNegativeTest-483083654 tempest-AttachVolumeNegativeTest-483083654-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74613) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 29 18:18:03 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.lightos [None req-dd48f43a-d6ac-4ebc-a3e8-ada5987ed1aa tempest-AttachVolumeNegativeTest-483083654 tempest-AttachVolumeNegativeTest-483083654-project-member] LIGHTOS: no hostnqn found. {{(pid=74613) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 29 18:18:03 user nova-compute[74613]: DEBUG os_brick.utils [None req-dd48f43a-d6ac-4ebc-a3e8-ada5987ed1aa tempest-AttachVolumeNegativeTest-483083654 tempest-AttachVolumeNegativeTest-483083654-project-member] <== get_connector_properties: return (136ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:400972819b5', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74613) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 18:18:03 user nova-compute[74613]: DEBUG nova.virt.block_device [None req-dd48f43a-d6ac-4ebc-a3e8-ada5987ed1aa tempest-AttachVolumeNegativeTest-483083654 tempest-AttachVolumeNegativeTest-483083654-project-member] [instance: d9f10bfb-5202-4b4a-a42d-f167501f597b] Updating existing volume attachment record: e2f19bbd-fab1-4dcd-ab1f-38cd11cbbd8c {{(pid=74613) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 29 18:18:05 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:18:06 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:18:10 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:18:11 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:18:13 user nova-compute[74613]: DEBUG nova.virt.libvirt.volume.iscsi [None req-dd48f43a-d6ac-4ebc-a3e8-ada5987ed1aa tempest-AttachVolumeNegativeTest-483083654 tempest-AttachVolumeNegativeTest-483083654-project-member] [instance: d9f10bfb-5202-4b4a-a42d-f167501f597b] Calling os-brick to attach iSCSI Volume {{(pid=74613) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 29 18:18:13 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd48f43a-d6ac-4ebc-a3e8-ada5987ed1aa tempest-AttachVolumeNegativeTest-483083654 tempest-AttachVolumeNegativeTest-483083654-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff828156890>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:f2c0b94e-d018-479d-b037-7ca4cb5580a3', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'bmtopViz', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74613) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 18:18:13 user nova-compute[74613]: WARNING os_brick.initiator.connectors.base [None req-dd48f43a-d6ac-4ebc-a3e8-ada5987ed1aa tempest-AttachVolumeNegativeTest-483083654 tempest-AttachVolumeNegativeTest-483083654-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 18:18:13 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.base [None req-dd48f43a-d6ac-4ebc-a3e8-ada5987ed1aa tempest-AttachVolumeNegativeTest-483083654 tempest-AttachVolumeNegativeTest-483083654-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 18:18:13 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.base [None req-dd48f43a-d6ac-4ebc-a3e8-ada5987ed1aa tempest-AttachVolumeNegativeTest-483083654 tempest-AttachVolumeNegativeTest-483083654-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.003s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 18:18:13 user nova-compute[74613]: WARNING os_brick.initiator.connectors.base [None req-dd48f43a-d6ac-4ebc-a3e8-ada5987ed1aa tempest-AttachVolumeNegativeTest-483083654 tempest-AttachVolumeNegativeTest-483083654-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 18:18:13 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.base [None req-dd48f43a-d6ac-4ebc-a3e8-ada5987ed1aa tempest-AttachVolumeNegativeTest-483083654 tempest-AttachVolumeNegativeTest-483083654-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f2c0b94e-d018-479d-b037-7ca4cb5580a3" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 18:18:13 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.base [None req-dd48f43a-d6ac-4ebc-a3e8-ada5987ed1aa tempest-AttachVolumeNegativeTest-483083654 tempest-AttachVolumeNegativeTest-483083654-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f2c0b94e-d018-479d-b037-7ca4cb5580a3" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 18:18:13 user nova-compute[74613]: INFO os_brick.initiator.connectors.iscsi [None req-dd48f43a-d6ac-4ebc-a3e8-ada5987ed1aa tempest-AttachVolumeNegativeTest-483083654 tempest-AttachVolumeNegativeTest-483083654-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 29 18:18:13 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f2c0b94e-d018-479d-b037-7ca4cb5580a3 -p 172.16.0.220:3260 {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:18:13 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f2c0b94e-d018-479d-b037-7ca4cb5580a3 -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:18:13 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[e16a4aff-6dd3-4423-b096-f7fab079efd0]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 18:18:13 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd48f43a-d6ac-4ebc-a3e8-ada5987ed1aa tempest-AttachVolumeNegativeTest-483083654 tempest-AttachVolumeNegativeTest-483083654-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 29 18:18:13 user nova-compute[74613]:  {{(pid=74613) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 18:18:13 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f2c0b94e-d018-479d-b037-7ca4cb5580a3 -p 172.16.0.220:3260 --interface default --op new {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:18:13 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f2c0b94e-d018-479d-b037-7ca4cb5580a3 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:18:13 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[07cf89f7-fea2-4ed6-a5f6-169311ed3372]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f2c0b94e-d018-479d-b037-7ca4cb5580a3] added\n', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 18:18:13 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd48f43a-d6ac-4ebc-a3e8-ada5987ed1aa tempest-AttachVolumeNegativeTest-483083654 tempest-AttachVolumeNegativeTest-483083654-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f2c0b94e-d018-479d-b037-7ca4cb5580a3] added
Nov 29 18:18:13 user nova-compute[74613]:  stderr= {{(pid=74613) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 18:18:13 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f2c0b94e-d018-479d-b037-7ca4cb5580a3 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:18:13 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f2c0b94e-d018-479d-b037-7ca4cb5580a3 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:18:13 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[f688ab58-220d-425a-91b5-5184f1935593]: (4, ('', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 18:18:13 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd48f43a-d6ac-4ebc-a3e8-ada5987ed1aa tempest-AttachVolumeNegativeTest-483083654 tempest-AttachVolumeNegativeTest-483083654-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74613) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 18:18:13 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f2c0b94e-d018-479d-b037-7ca4cb5580a3 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:18:13 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f2c0b94e-d018-479d-b037-7ca4cb5580a3 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:18:13 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[22d1b2dd-811d-4ca9-a02a-f6e1ff754fc7]: (4, ('', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 18:18:13 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd48f43a-d6ac-4ebc-a3e8-ada5987ed1aa tempest-AttachVolumeNegativeTest-483083654 tempest-AttachVolumeNegativeTest-483083654-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74613) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 18:18:13 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f2c0b94e-d018-479d-b037-7ca4cb5580a3 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v bmtopViz {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:18:13 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f2c0b94e-d018-479d-b037-7ca4cb5580a3 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v bmtopViz" returned: 0 in 0.018s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:18:13 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[0647975b-aee0-4a48-9364-a07c36f9d3da]: (4, ('', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 18:18:13 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd48f43a-d6ac-4ebc-a3e8-ada5987ed1aa tempest-AttachVolumeNegativeTest-483083654 tempest-AttachVolumeNegativeTest-483083654-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'bmtopViz'): stdout= stderr= {{(pid=74613) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 18:18:13 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f2c0b94e-d018-479d-b037-7ca4cb5580a3 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:18:13 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f2c0b94e-d018-479d-b037-7ca4cb5580a3 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:18:13 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe20696f-6435-4982-a2b4-0fcaf3d707cc]: (4, ('', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 18:18:13 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd48f43a-d6ac-4ebc-a3e8-ada5987ed1aa tempest-AttachVolumeNegativeTest-483083654 tempest-AttachVolumeNegativeTest-483083654-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74613) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 18:18:13 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:18:13 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:18:13 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[abc05fa8-40ff-4668-96ac-7fc308ab97a0]: (4, ('tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:113c5dd9-52e5-46ba-8f15-faf70db70464 (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d74e565-9547-4f44-8005-0615d625a275 (non-flash)\n', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 18:18:13 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd48f43a-d6ac-4ebc-a3e8-ada5987ed1aa tempest-AttachVolumeNegativeTest-483083654 tempest-AttachVolumeNegativeTest-483083654-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:113c5dd9-52e5-46ba-8f15-faf70db70464 (non-flash)
Nov 29 18:18:13 user nova-compute[74613]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d74e565-9547-4f44-8005-0615d625a275 (non-flash)
Nov 29 18:18:13 user nova-compute[74613]:  stderr= {{(pid=74613) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 18:18:13 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd48f43a-d6ac-4ebc-a3e8-ada5987ed1aa tempest-AttachVolumeNegativeTest-483083654 tempest-AttachVolumeNegativeTest-483083654-project-member] iscsi session list stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:113c5dd9-52e5-46ba-8f15-faf70db70464 (non-flash)
Nov 29 18:18:13 user nova-compute[74613]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d74e565-9547-4f44-8005-0615d625a275 (non-flash)
Nov 29 18:18:13 user nova-compute[74613]:  stderr= {{(pid=74613) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 18:18:13 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f2c0b94e-d018-479d-b037-7ca4cb5580a3 -p 172.16.0.220:3260 --login {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:18:13 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f2c0b94e-d018-479d-b037-7ca4cb5580a3 -p 172.16.0.220:3260 --login" returned: 0 in 0.055s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:18:13 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c3203ae-16f4-4076-8f14-51ff2874fafe]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:f2c0b94e-d018-479d-b037-7ca4cb5580a3, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:f2c0b94e-d018-479d-b037-7ca4cb5580a3, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 18:18:13 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd48f43a-d6ac-4ebc-a3e8-ada5987ed1aa tempest-AttachVolumeNegativeTest-483083654 tempest-AttachVolumeNegativeTest-483083654-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:f2c0b94e-d018-479d-b037-7ca4cb5580a3, portal: 172.16.0.220,3260]
Nov 29 18:18:13 user nova-compute[74613]: Login to [iface: default, target: iqn.2010-10.org.openstack:f2c0b94e-d018-479d-b037-7ca4cb5580a3, portal: 172.16.0.220,3260] successful.
Nov 29 18:18:13 user nova-compute[74613]:  stderr= {{(pid=74613) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 18:18:13 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f2c0b94e-d018-479d-b037-7ca4cb5580a3 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:18:13 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f2c0b94e-d018-479d-b037-7ca4cb5580a3 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.025s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:18:13 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[6309b3b1-fffa-458f-b045-434975ff8b92]: (4, ('', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 18:18:13 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd48f43a-d6ac-4ebc-a3e8-ada5987ed1aa tempest-AttachVolumeNegativeTest-483083654 tempest-AttachVolumeNegativeTest-483083654-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74613) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 18:18:13 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:18:13 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:18:13 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[6035ae10-d004-4b93-b1fb-50c5119e2580]: (4, ('tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:113c5dd9-52e5-46ba-8f15-faf70db70464 (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d74e565-9547-4f44-8005-0615d625a275 (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f2c0b94e-d018-479d-b037-7ca4cb5580a3 (non-flash)\n', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 18:18:13 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd48f43a-d6ac-4ebc-a3e8-ada5987ed1aa tempest-AttachVolumeNegativeTest-483083654 tempest-AttachVolumeNegativeTest-483083654-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:113c5dd9-52e5-46ba-8f15-faf70db70464 (non-flash)
Nov 29 18:18:13 user nova-compute[74613]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d74e565-9547-4f44-8005-0615d625a275 (non-flash)
Nov 29 18:18:13 user nova-compute[74613]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f2c0b94e-d018-479d-b037-7ca4cb5580a3 (non-flash)
Nov 29 18:18:13 user nova-compute[74613]:  stderr= {{(pid=74613) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 18:18:13 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd48f43a-d6ac-4ebc-a3e8-ada5987ed1aa tempest-AttachVolumeNegativeTest-483083654 tempest-AttachVolumeNegativeTest-483083654-project-member] iscsi session list stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:113c5dd9-52e5-46ba-8f15-faf70db70464 (non-flash)
Nov 29 18:18:13 user nova-compute[74613]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d74e565-9547-4f44-8005-0615d625a275 (non-flash)
Nov 29 18:18:13 user nova-compute[74613]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f2c0b94e-d018-479d-b037-7ca4cb5580a3 (non-flash)
Nov 29 18:18:13 user nova-compute[74613]:  stderr= {{(pid=74613) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 18:18:13 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.base [None req-dd48f43a-d6ac-4ebc-a3e8-ada5987ed1aa tempest-AttachVolumeNegativeTest-483083654 tempest-AttachVolumeNegativeTest-483083654-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f2c0b94e-d018-479d-b037-7ca4cb5580a3" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.285s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 18:18:13 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd48f43a-d6ac-4ebc-a3e8-ada5987ed1aa tempest-AttachVolumeNegativeTest-483083654 tempest-AttachVolumeNegativeTest-483083654-project-member] Connected to 172.16.0.220:3260 {{(pid=74613) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 29 18:18:13 user nova-compute[74613]: DEBUG os_brick.initiator.linuxscsi [None req-dd48f43a-d6ac-4ebc-a3e8-ada5987ed1aa tempest-AttachVolumeNegativeTest-483083654 tempest-AttachVolumeNegativeTest-483083654-project-member] HCTL ('35', '-', '-', 0) found on session 46 with lun 0 {{(pid=74613) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 29 18:18:13 user nova-compute[74613]: DEBUG os_brick.initiator.linuxscsi [None req-dd48f43a-d6ac-4ebc-a3e8-ada5987ed1aa tempest-AttachVolumeNegativeTest-483083654 tempest-AttachVolumeNegativeTest-483083654-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=74613) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 29 18:18:13 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:18:13 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.019s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:18:13 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a008c29-2328-4475-beb3-a1197d072623]: (4, ('- - 0', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 18:18:13 user nova-compute[74613]: DEBUG os_brick.initiator.linuxscsi [None req-dd48f43a-d6ac-4ebc-a3e8-ada5987ed1aa tempest-AttachVolumeNegativeTest-483083654 tempest-AttachVolumeNegativeTest-483083654-project-member] Searching for a device in session 46 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=74613) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 29 18:18:13 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd48f43a-d6ac-4ebc-a3e8-ada5987ed1aa tempest-AttachVolumeNegativeTest-483083654 tempest-AttachVolumeNegativeTest-483083654-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:f2c0b94e-d018-479d-b037-7ca4cb5580a3', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'bmtopViz', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74613) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 29 18:18:14 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.base [None req-dd48f43a-d6ac-4ebc-a3e8-ada5987ed1aa tempest-AttachVolumeNegativeTest-483083654 tempest-AttachVolumeNegativeTest-483083654-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.321s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 18:18:14 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd48f43a-d6ac-4ebc-a3e8-ada5987ed1aa tempest-AttachVolumeNegativeTest-483083654 tempest-AttachVolumeNegativeTest-483083654-project-member] <== connect_volume: return (1324ms) {'type': 'block', 'scsi_wwn': '23762366334353939', 'path': '/dev/sdd'} {{(pid=74613) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 18:18:14 user nova-compute[74613]: DEBUG nova.virt.libvirt.volume.iscsi [None req-dd48f43a-d6ac-4ebc-a3e8-ada5987ed1aa tempest-AttachVolumeNegativeTest-483083654 tempest-AttachVolumeNegativeTest-483083654-project-member] [instance: d9f10bfb-5202-4b4a-a42d-f167501f597b] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23762366334353939', 'path': '/dev/sdd'} {{(pid=74613) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 29 18:18:14 user nova-compute[74613]: DEBUG nova.objects.instance [None req-dd48f43a-d6ac-4ebc-a3e8-ada5987ed1aa tempest-AttachVolumeNegativeTest-483083654 tempest-AttachVolumeNegativeTest-483083654-project-member] Lazy-loading 'flavor' on Instance uuid d9f10bfb-5202-4b4a-a42d-f167501f597b {{(pid=74613) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 18:18:14 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:18:14 user nova-compute[74613]: DEBUG nova.virt.libvirt.guest [None req-dd48f43a-d6ac-4ebc-a3e8-ada5987ed1aa tempest-AttachVolumeNegativeTest-483083654 tempest-AttachVolumeNegativeTest-483083654-project-member] attach device xml: <disk type="block" device="disk">
Nov 29 18:18:14 user nova-compute[74613]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 18:18:14 user nova-compute[74613]:   <source dev="/dev/sdd"/>
Nov 29 18:18:14 user nova-compute[74613]:   <target dev="vdb" bus="virtio"/>
Nov 29 18:18:14 user nova-compute[74613]:   <serial>f2c0b94e-d018-479d-b037-7ca4cb5580a3</serial>
Nov 29 18:18:14 user nova-compute[74613]: </disk>
Nov 29 18:18:14 user nova-compute[74613]:  {{(pid=74613) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 29 18:18:15 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-dd48f43a-d6ac-4ebc-a3e8-ada5987ed1aa tempest-AttachVolumeNegativeTest-483083654 tempest-AttachVolumeNegativeTest-483083654-project-member] No BDM found with device name vda, not building metadata. {{(pid=74613) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 18:18:15 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-dd48f43a-d6ac-4ebc-a3e8-ada5987ed1aa tempest-AttachVolumeNegativeTest-483083654 tempest-AttachVolumeNegativeTest-483083654-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74613) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 18:18:15 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-dd48f43a-d6ac-4ebc-a3e8-ada5987ed1aa tempest-AttachVolumeNegativeTest-483083654 tempest-AttachVolumeNegativeTest-483083654-project-member] No VIF found with MAC fa:16:3e:29:a3:f5, not building metadata {{(pid=74613) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 29 18:18:15 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-dd48f43a-d6ac-4ebc-a3e8-ada5987ed1aa tempest-AttachVolumeNegativeTest-483083654 tempest-AttachVolumeNegativeTest-483083654-project-member] Lock "d9f10bfb-5202-4b4a-a42d-f167501f597b" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 12.535s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 18:18:15 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:18:16 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:18:16 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-aeaed006-94e4-42ab-bd94-8aff56c962e2 tempest-AttachVolumeNegativeTest-483083654 tempest-AttachVolumeNegativeTest-483083654-project-member] Acquiring lock "d9f10bfb-5202-4b4a-a42d-f167501f597b" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 18:18:16 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-aeaed006-94e4-42ab-bd94-8aff56c962e2 tempest-AttachVolumeNegativeTest-483083654 tempest-AttachVolumeNegativeTest-483083654-project-member] Lock "d9f10bfb-5202-4b4a-a42d-f167501f597b" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 18:18:16 user nova-compute[74613]: INFO nova.compute.manager [None req-aeaed006-94e4-42ab-bd94-8aff56c962e2 tempest-AttachVolumeNegativeTest-483083654 tempest-AttachVolumeNegativeTest-483083654-project-member] [instance: d9f10bfb-5202-4b4a-a42d-f167501f597b] Detaching volume f2c0b94e-d018-479d-b037-7ca4cb5580a3
Nov 29 18:18:16 user nova-compute[74613]: INFO nova.virt.block_device [None req-aeaed006-94e4-42ab-bd94-8aff56c962e2 tempest-AttachVolumeNegativeTest-483083654 tempest-AttachVolumeNegativeTest-483083654-project-member] [instance: d9f10bfb-5202-4b4a-a42d-f167501f597b] Attempting to driver detach volume f2c0b94e-d018-479d-b037-7ca4cb5580a3 from mountpoint /dev/vdb
Nov 29 18:18:16 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-aeaed006-94e4-42ab-bd94-8aff56c962e2 tempest-AttachVolumeNegativeTest-483083654 tempest-AttachVolumeNegativeTest-483083654-project-member] Attempting to detach device vdb from instance d9f10bfb-5202-4b4a-a42d-f167501f597b from the persistent domain config. {{(pid=74613) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 29 18:18:16 user nova-compute[74613]: DEBUG nova.virt.libvirt.guest [None req-aeaed006-94e4-42ab-bd94-8aff56c962e2 tempest-AttachVolumeNegativeTest-483083654 tempest-AttachVolumeNegativeTest-483083654-project-member] detach device xml: <disk type="block" device="disk">
Nov 29 18:18:16 user nova-compute[74613]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 18:18:16 user nova-compute[74613]:   <source dev="/dev/sdd"/>
Nov 29 18:18:16 user nova-compute[74613]:   <target dev="vdb" bus="virtio"/>
Nov 29 18:18:16 user nova-compute[74613]:   <serial>f2c0b94e-d018-479d-b037-7ca4cb5580a3</serial>
Nov 29 18:18:16 user nova-compute[74613]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 29 18:18:16 user nova-compute[74613]: </disk>
Nov 29 18:18:16 user nova-compute[74613]:  {{(pid=74613) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 29 18:18:16 user nova-compute[74613]: INFO nova.virt.libvirt.driver [None req-aeaed006-94e4-42ab-bd94-8aff56c962e2 tempest-AttachVolumeNegativeTest-483083654 tempest-AttachVolumeNegativeTest-483083654-project-member] Successfully detached device vdb from instance d9f10bfb-5202-4b4a-a42d-f167501f597b from the persistent domain config.
Nov 29 18:18:16 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-aeaed006-94e4-42ab-bd94-8aff56c962e2 tempest-AttachVolumeNegativeTest-483083654 tempest-AttachVolumeNegativeTest-483083654-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance d9f10bfb-5202-4b4a-a42d-f167501f597b from the live domain config. {{(pid=74613) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 29 18:18:16 user nova-compute[74613]: DEBUG nova.virt.libvirt.guest [None req-aeaed006-94e4-42ab-bd94-8aff56c962e2 tempest-AttachVolumeNegativeTest-483083654 tempest-AttachVolumeNegativeTest-483083654-project-member] detach device xml: <disk type="block" device="disk">
Nov 29 18:18:16 user nova-compute[74613]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 18:18:16 user nova-compute[74613]:   <source dev="/dev/sdd"/>
Nov 29 18:18:16 user nova-compute[74613]:   <target dev="vdb" bus="virtio"/>
Nov 29 18:18:16 user nova-compute[74613]:   <serial>f2c0b94e-d018-479d-b037-7ca4cb5580a3</serial>
Nov 29 18:18:16 user nova-compute[74613]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 29 18:18:16 user nova-compute[74613]: </disk>
Nov 29 18:18:16 user nova-compute[74613]:  {{(pid=74613) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 29 18:18:16 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-aeaed006-94e4-42ab-bd94-8aff56c962e2 tempest-AttachVolumeNegativeTest-483083654 tempest-AttachVolumeNegativeTest-483083654-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance d9f10bfb-5202-4b4a-a42d-f167501f597b {{(pid=74613) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 29 18:18:16 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:18:19 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:18:20 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:18:22 user nova-compute[74613]: DEBUG nova.compute.manager [req-9699d2cf-2edc-494a-bc94-3a084b3cefb0 req-4ae64258-54bd-4bbd-acaa-b3267ed54998 service nova] [instance: b2c3eb4f-df1f-46d0-acb5-3ac9f16f9a82] Received event network-changed-d2959064-4006-4ab9-b71f-f6a391cbffcf {{(pid=74613) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 18:18:22 user nova-compute[74613]: DEBUG nova.compute.manager [req-9699d2cf-2edc-494a-bc94-3a084b3cefb0 req-4ae64258-54bd-4bbd-acaa-b3267ed54998 service nova] [instance: b2c3eb4f-df1f-46d0-acb5-3ac9f16f9a82] Refreshing instance network info cache due to event network-changed-d2959064-4006-4ab9-b71f-f6a391cbffcf. {{(pid=74613) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 18:18:22 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-9699d2cf-2edc-494a-bc94-3a084b3cefb0 req-4ae64258-54bd-4bbd-acaa-b3267ed54998 service nova] Acquiring lock "refresh_cache-b2c3eb4f-df1f-46d0-acb5-3ac9f16f9a82" {{(pid=74613) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 18:18:22 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-9699d2cf-2edc-494a-bc94-3a084b3cefb0 req-4ae64258-54bd-4bbd-acaa-b3267ed54998 service nova] Acquired lock "refresh_cache-b2c3eb4f-df1f-46d0-acb5-3ac9f16f9a82" {{(pid=74613) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 18:18:22 user nova-compute[74613]: DEBUG nova.network.neutron [req-9699d2cf-2edc-494a-bc94-3a084b3cefb0 req-4ae64258-54bd-4bbd-acaa-b3267ed54998 service nova] [instance: b2c3eb4f-df1f-46d0-acb5-3ac9f16f9a82] Refreshing network info cache for port d2959064-4006-4ab9-b71f-f6a391cbffcf {{(pid=74613) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 18:18:23 user nova-compute[74613]: DEBUG nova.network.neutron [req-9699d2cf-2edc-494a-bc94-3a084b3cefb0 req-4ae64258-54bd-4bbd-acaa-b3267ed54998 service nova] [instance: b2c3eb4f-df1f-46d0-acb5-3ac9f16f9a82] Updated VIF entry in instance network info cache for port d2959064-4006-4ab9-b71f-f6a391cbffcf. {{(pid=74613) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 18:18:23 user nova-compute[74613]: DEBUG nova.network.neutron [req-9699d2cf-2edc-494a-bc94-3a084b3cefb0 req-4ae64258-54bd-4bbd-acaa-b3267ed54998 service nova] [instance: b2c3eb4f-df1f-46d0-acb5-3ac9f16f9a82] Updating instance_info_cache with network_info: [{"id": "d2959064-4006-4ab9-b71f-f6a391cbffcf", "address": "fa:16:3e:4d:ba:5c", "network": {"id": "21147bc8-b1ac-40d5-8fc0-8dab8ade1ff5", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1502381061-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.62", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b5dc39bc30d84269a7ad073867e36436", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd2959064-40", "ovs_interfaceid": "d2959064-4006-4ab9-b71f-f6a391cbffcf", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74613) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 18:18:23 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-9699d2cf-2edc-494a-bc94-3a084b3cefb0 req-4ae64258-54bd-4bbd-acaa-b3267ed54998 service nova] Releasing lock "refresh_cache-b2c3eb4f-df1f-46d0-acb5-3ac9f16f9a82" {{(pid=74613) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 18:18:25 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-ea6f93fc-869d-4034-b292-b6c0f9fb1194 tempest-AttachVolumeTestJSON-813984703 tempest-AttachVolumeTestJSON-813984703-project-member] Acquiring lock "b2c3eb4f-df1f-46d0-acb5-3ac9f16f9a82" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 18:18:25 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-ea6f93fc-869d-4034-b292-b6c0f9fb1194 tempest-AttachVolumeTestJSON-813984703 tempest-AttachVolumeTestJSON-813984703-project-member] Lock "b2c3eb4f-df1f-46d0-acb5-3ac9f16f9a82" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 18:18:25 user nova-compute[74613]: DEBUG nova.objects.instance [None req-ea6f93fc-869d-4034-b292-b6c0f9fb1194 tempest-AttachVolumeTestJSON-813984703 tempest-AttachVolumeTestJSON-813984703-project-member] Lazy-loading 'flavor' on Instance uuid b2c3eb4f-df1f-46d0-acb5-3ac9f16f9a82 {{(pid=74613) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 18:18:25 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-ea6f93fc-869d-4034-b292-b6c0f9fb1194 tempest-AttachVolumeTestJSON-813984703 tempest-AttachVolumeTestJSON-813984703-project-member] Lock "b2c3eb4f-df1f-46d0-acb5-3ac9f16f9a82" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.057s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 18:18:25 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 18:18:25 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:18:25 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74613) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 29 18:18:25 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74613) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 18:18:25 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74613) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 18:18:25 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:18:25 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-ea6f93fc-869d-4034-b292-b6c0f9fb1194 tempest-AttachVolumeTestJSON-813984703 tempest-AttachVolumeTestJSON-813984703-project-member] Acquiring lock "b2c3eb4f-df1f-46d0-acb5-3ac9f16f9a82" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 18:18:25 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-ea6f93fc-869d-4034-b292-b6c0f9fb1194 tempest-AttachVolumeTestJSON-813984703 tempest-AttachVolumeTestJSON-813984703-project-member] Lock "b2c3eb4f-df1f-46d0-acb5-3ac9f16f9a82" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 18:18:25 user nova-compute[74613]: INFO nova.compute.manager [None req-ea6f93fc-869d-4034-b292-b6c0f9fb1194 tempest-AttachVolumeTestJSON-813984703 tempest-AttachVolumeTestJSON-813984703-project-member] [instance: b2c3eb4f-df1f-46d0-acb5-3ac9f16f9a82] Attaching volume 9f9a0824-5da8-4aaa-bc2e-56c2f8688051 to /dev/vdb
Nov 29 18:18:25 user nova-compute[74613]: DEBUG os_brick.utils [None req-ea6f93fc-869d-4034-b292-b6c0f9fb1194 tempest-AttachVolumeTestJSON-813984703 tempest-AttachVolumeTestJSON-813984703-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74613) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 18:18:25 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:18:25 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:18:25 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[2403a7ad-4a12-452e-bd7e-9ae4987e858c]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:400972819b5\n', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 18:18:25 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:18:25 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:18:25 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[a95c1705-34c6-4462-a005-9d73628d6248]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 18:18:25 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:18:25 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:18:25 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9014209-c2af-4b05-9f6a-a74098c2efd7]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 18:18:25 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[57176026-ab65-4c0a-b466-4369ee68a84e]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 18:18:25 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-ea6f93fc-869d-4034-b292-b6c0f9fb1194 tempest-AttachVolumeTestJSON-813984703 tempest-AttachVolumeTestJSON-813984703-project-member] Running cmd (subprocess): nvme version {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:18:25 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-ea6f93fc-869d-4034-b292-b6c0f9fb1194 tempest-AttachVolumeTestJSON-813984703 tempest-AttachVolumeTestJSON-813984703-project-member] 'nvme version' failed. Not Retrying. {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 18:18:25 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.nvmeof [None req-ea6f93fc-869d-4034-b292-b6c0f9fb1194 tempest-AttachVolumeTestJSON-813984703 tempest-AttachVolumeTestJSON-813984703-project-member] nvme not present on system {{(pid=74613) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 29 18:18:25 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:18:25 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 18:18:25 user nova-compute[74613]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 29 18:18:25 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[342cb778-ee83-457e-a5b9-40e6b2616440]: (4, '') {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 18:18:25 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.lightos [None req-ea6f93fc-869d-4034-b292-b6c0f9fb1194 tempest-AttachVolumeTestJSON-813984703 tempest-AttachVolumeTestJSON-813984703-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74613) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 29 18:18:25 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.lightos [None req-ea6f93fc-869d-4034-b292-b6c0f9fb1194 tempest-AttachVolumeTestJSON-813984703 tempest-AttachVolumeTestJSON-813984703-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74613) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 29 18:18:25 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.lightos [None req-ea6f93fc-869d-4034-b292-b6c0f9fb1194 tempest-AttachVolumeTestJSON-813984703 tempest-AttachVolumeTestJSON-813984703-project-member] LIGHTOS: no hostnqn found. {{(pid=74613) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 29 18:18:25 user nova-compute[74613]: DEBUG os_brick.utils [None req-ea6f93fc-869d-4034-b292-b6c0f9fb1194 tempest-AttachVolumeTestJSON-813984703 tempest-AttachVolumeTestJSON-813984703-project-member] <== get_connector_properties: return (116ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:400972819b5', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74613) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 18:18:25 user nova-compute[74613]: DEBUG nova.virt.block_device [None req-ea6f93fc-869d-4034-b292-b6c0f9fb1194 tempest-AttachVolumeTestJSON-813984703 tempest-AttachVolumeTestJSON-813984703-project-member] [instance: b2c3eb4f-df1f-46d0-acb5-3ac9f16f9a82] Updating existing volume attachment record: 9abc54c3-3689-4737-a8d2-90d3924b3157 {{(pid=74613) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 29 18:18:26 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:18:30 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:18:31 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:18:32 user nova-compute[74613]: DEBUG oslo_service.periodic_task [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74613) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 18:18:33 user nova-compute[74613]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ea6f93fc-869d-4034-b292-b6c0f9fb1194 tempest-AttachVolumeTestJSON-813984703 tempest-AttachVolumeTestJSON-813984703-project-member] [instance: b2c3eb4f-df1f-46d0-acb5-3ac9f16f9a82] Calling os-brick to attach iSCSI Volume {{(pid=74613) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 29 18:18:33 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea6f93fc-869d-4034-b292-b6c0f9fb1194 tempest-AttachVolumeTestJSON-813984703 tempest-AttachVolumeTestJSON-813984703-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff828156890>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:9f9a0824-5da8-4aaa-bc2e-56c2f8688051', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QSNOVzpF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74613) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 18:18:33 user nova-compute[74613]: WARNING os_brick.initiator.connectors.base [None req-ea6f93fc-869d-4034-b292-b6c0f9fb1194 tempest-AttachVolumeTestJSON-813984703 tempest-AttachVolumeTestJSON-813984703-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 18:18:33 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.base [None req-ea6f93fc-869d-4034-b292-b6c0f9fb1194 tempest-AttachVolumeTestJSON-813984703 tempest-AttachVolumeTestJSON-813984703-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 18:18:33 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.base [None req-ea6f93fc-869d-4034-b292-b6c0f9fb1194 tempest-AttachVolumeTestJSON-813984703 tempest-AttachVolumeTestJSON-813984703-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 18:18:33 user nova-compute[74613]: WARNING os_brick.initiator.connectors.base [None req-ea6f93fc-869d-4034-b292-b6c0f9fb1194 tempest-AttachVolumeTestJSON-813984703 tempest-AttachVolumeTestJSON-813984703-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 18:18:33 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.base [None req-ea6f93fc-869d-4034-b292-b6c0f9fb1194 tempest-AttachVolumeTestJSON-813984703 tempest-AttachVolumeTestJSON-813984703-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9f9a0824-5da8-4aaa-bc2e-56c2f8688051" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 18:18:33 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.base [None req-ea6f93fc-869d-4034-b292-b6c0f9fb1194 tempest-AttachVolumeTestJSON-813984703 tempest-AttachVolumeTestJSON-813984703-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9f9a0824-5da8-4aaa-bc2e-56c2f8688051" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 18:18:33 user nova-compute[74613]: INFO os_brick.initiator.connectors.iscsi [None req-ea6f93fc-869d-4034-b292-b6c0f9fb1194 tempest-AttachVolumeTestJSON-813984703 tempest-AttachVolumeTestJSON-813984703-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 29 18:18:33 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9f9a0824-5da8-4aaa-bc2e-56c2f8688051 -p 172.16.0.220:3260 {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:18:33 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9f9a0824-5da8-4aaa-bc2e-56c2f8688051 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:18:33 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[fdf9e1ae-0dec-4576-b22b-b146bf8100ac]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 18:18:33 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea6f93fc-869d-4034-b292-b6c0f9fb1194 tempest-AttachVolumeTestJSON-813984703 tempest-AttachVolumeTestJSON-813984703-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 29 18:18:33 user nova-compute[74613]:  {{(pid=74613) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 18:18:33 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9f9a0824-5da8-4aaa-bc2e-56c2f8688051 -p 172.16.0.220:3260 --interface default --op new {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:18:33 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9f9a0824-5da8-4aaa-bc2e-56c2f8688051 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:18:33 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[231f6a89-45f6-43c7-9a2f-0789d12dc61d]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:9f9a0824-5da8-4aaa-bc2e-56c2f8688051] added\n', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 18:18:33 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea6f93fc-869d-4034-b292-b6c0f9fb1194 tempest-AttachVolumeTestJSON-813984703 tempest-AttachVolumeTestJSON-813984703-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:9f9a0824-5da8-4aaa-bc2e-56c2f8688051] added
Nov 29 18:18:33 user nova-compute[74613]:  stderr= {{(pid=74613) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 18:18:33 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9f9a0824-5da8-4aaa-bc2e-56c2f8688051 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:18:33 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9f9a0824-5da8-4aaa-bc2e-56c2f8688051 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:18:33 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[248cc59c-f8e7-49af-998b-48922567f0b2]: (4, ('', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 18:18:33 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea6f93fc-869d-4034-b292-b6c0f9fb1194 tempest-AttachVolumeTestJSON-813984703 tempest-AttachVolumeTestJSON-813984703-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74613) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 18:18:33 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9f9a0824-5da8-4aaa-bc2e-56c2f8688051 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:18:33 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9f9a0824-5da8-4aaa-bc2e-56c2f8688051 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:18:33 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[1bcc65ea-4497-486b-b52d-ffd72b9b91df]: (4, ('', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 18:18:33 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea6f93fc-869d-4034-b292-b6c0f9fb1194 tempest-AttachVolumeTestJSON-813984703 tempest-AttachVolumeTestJSON-813984703-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74613) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 18:18:33 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9f9a0824-5da8-4aaa-bc2e-56c2f8688051 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v QSNOVzpF {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:18:33 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9f9a0824-5da8-4aaa-bc2e-56c2f8688051 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v QSNOVzpF" returned: 0 in 0.022s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:18:33 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[f94afbe2-e8d0-4ebc-9b10-ed74fa3818e9]: (4, ('', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 18:18:33 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea6f93fc-869d-4034-b292-b6c0f9fb1194 tempest-AttachVolumeTestJSON-813984703 tempest-AttachVolumeTestJSON-813984703-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'QSNOVzpF'): stdout= stderr= {{(pid=74613) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 18:18:33 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9f9a0824-5da8-4aaa-bc2e-56c2f8688051 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:18:33 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9f9a0824-5da8-4aaa-bc2e-56c2f8688051 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.026s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:18:33 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1aa8ae3-ce52-493d-936c-eed2d6340398]: (4, ('', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 18:18:33 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea6f93fc-869d-4034-b292-b6c0f9fb1194 tempest-AttachVolumeTestJSON-813984703 tempest-AttachVolumeTestJSON-813984703-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74613) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 18:18:33 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:18:33 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:18:33 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d9eede4-3453-4907-bd61-8b1f7cb5a134]: (4, ('tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:113c5dd9-52e5-46ba-8f15-faf70db70464 (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d74e565-9547-4f44-8005-0615d625a275 (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f2c0b94e-d018-479d-b037-7ca4cb5580a3 (non-flash)\n', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 18:18:33 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea6f93fc-869d-4034-b292-b6c0f9fb1194 tempest-AttachVolumeTestJSON-813984703 tempest-AttachVolumeTestJSON-813984703-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:113c5dd9-52e5-46ba-8f15-faf70db70464 (non-flash)
Nov 29 18:18:33 user nova-compute[74613]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d74e565-9547-4f44-8005-0615d625a275 (non-flash)
Nov 29 18:18:33 user nova-compute[74613]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f2c0b94e-d018-479d-b037-7ca4cb5580a3 (non-flash)
Nov 29 18:18:33 user nova-compute[74613]:  stderr= {{(pid=74613) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 18:18:33 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea6f93fc-869d-4034-b292-b6c0f9fb1194 tempest-AttachVolumeTestJSON-813984703 tempest-AttachVolumeTestJSON-813984703-project-member] iscsi session list stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:113c5dd9-52e5-46ba-8f15-faf70db70464 (non-flash)
Nov 29 18:18:33 user nova-compute[74613]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d74e565-9547-4f44-8005-0615d625a275 (non-flash)
Nov 29 18:18:33 user nova-compute[74613]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f2c0b94e-d018-479d-b037-7ca4cb5580a3 (non-flash)
Nov 29 18:18:33 user nova-compute[74613]:  stderr= {{(pid=74613) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 18:18:33 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9f9a0824-5da8-4aaa-bc2e-56c2f8688051 -p 172.16.0.220:3260 --login {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:18:33 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9f9a0824-5da8-4aaa-bc2e-56c2f8688051 -p 172.16.0.220:3260 --login" returned: 0 in 0.065s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:18:33 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e0fcace-a04d-4059-ab8b-6dbc640ea752]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:9f9a0824-5da8-4aaa-bc2e-56c2f8688051, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:9f9a0824-5da8-4aaa-bc2e-56c2f8688051, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 18:18:33 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea6f93fc-869d-4034-b292-b6c0f9fb1194 tempest-AttachVolumeTestJSON-813984703 tempest-AttachVolumeTestJSON-813984703-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:9f9a0824-5da8-4aaa-bc2e-56c2f8688051, portal: 172.16.0.220,3260]
Nov 29 18:18:33 user nova-compute[74613]: Login to [iface: default, target: iqn.2010-10.org.openstack:9f9a0824-5da8-4aaa-bc2e-56c2f8688051, portal: 172.16.0.220,3260] successful.
Nov 29 18:18:33 user nova-compute[74613]:  stderr= {{(pid=74613) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 18:18:33 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9f9a0824-5da8-4aaa-bc2e-56c2f8688051 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:18:33 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9f9a0824-5da8-4aaa-bc2e-56c2f8688051 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:18:33 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[73af57c8-6988-4d1b-97a3-851ae45d813b]: (4, ('', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 18:18:33 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea6f93fc-869d-4034-b292-b6c0f9fb1194 tempest-AttachVolumeTestJSON-813984703 tempest-AttachVolumeTestJSON-813984703-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74613) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 18:18:33 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:18:33 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:18:33 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[88afc54f-1f5d-464c-891c-21fd4d78e7e9]: (4, ('tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:113c5dd9-52e5-46ba-8f15-faf70db70464 (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d74e565-9547-4f44-8005-0615d625a275 (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f2c0b94e-d018-479d-b037-7ca4cb5580a3 (non-flash)\ntcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f9a0824-5da8-4aaa-bc2e-56c2f8688051 (non-flash)\n', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 18:18:33 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea6f93fc-869d-4034-b292-b6c0f9fb1194 tempest-AttachVolumeTestJSON-813984703 tempest-AttachVolumeTestJSON-813984703-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:113c5dd9-52e5-46ba-8f15-faf70db70464 (non-flash)
Nov 29 18:18:33 user nova-compute[74613]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d74e565-9547-4f44-8005-0615d625a275 (non-flash)
Nov 29 18:18:33 user nova-compute[74613]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f2c0b94e-d018-479d-b037-7ca4cb5580a3 (non-flash)
Nov 29 18:18:33 user nova-compute[74613]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f9a0824-5da8-4aaa-bc2e-56c2f8688051 (non-flash)
Nov 29 18:18:33 user nova-compute[74613]:  stderr= {{(pid=74613) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 18:18:33 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea6f93fc-869d-4034-b292-b6c0f9fb1194 tempest-AttachVolumeTestJSON-813984703 tempest-AttachVolumeTestJSON-813984703-project-member] iscsi session list stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:113c5dd9-52e5-46ba-8f15-faf70db70464 (non-flash)
Nov 29 18:18:33 user nova-compute[74613]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d74e565-9547-4f44-8005-0615d625a275 (non-flash)
Nov 29 18:18:33 user nova-compute[74613]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f2c0b94e-d018-479d-b037-7ca4cb5580a3 (non-flash)
Nov 29 18:18:33 user nova-compute[74613]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f9a0824-5da8-4aaa-bc2e-56c2f8688051 (non-flash)
Nov 29 18:18:33 user nova-compute[74613]:  stderr= {{(pid=74613) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 18:18:33 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.base [None req-ea6f93fc-869d-4034-b292-b6c0f9fb1194 tempest-AttachVolumeTestJSON-813984703 tempest-AttachVolumeTestJSON-813984703-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9f9a0824-5da8-4aaa-bc2e-56c2f8688051" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.295s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 18:18:33 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea6f93fc-869d-4034-b292-b6c0f9fb1194 tempest-AttachVolumeTestJSON-813984703 tempest-AttachVolumeTestJSON-813984703-project-member] Connected to 172.16.0.220:3260 {{(pid=74613) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 29 18:18:33 user nova-compute[74613]: DEBUG os_brick.initiator.linuxscsi [None req-ea6f93fc-869d-4034-b292-b6c0f9fb1194 tempest-AttachVolumeTestJSON-813984703 tempest-AttachVolumeTestJSON-813984703-project-member] HCTL ('36', '-', '-', 0) found on session 47 with lun 0 {{(pid=74613) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 29 18:18:33 user nova-compute[74613]: DEBUG os_brick.initiator.linuxscsi [None req-ea6f93fc-869d-4034-b292-b6c0f9fb1194 tempest-AttachVolumeTestJSON-813984703 tempest-AttachVolumeTestJSON-813984703-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=74613) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 29 18:18:33 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:18:33 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.018s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:18:33 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[38f16155-9960-49a2-bdfb-9b25a5f4d96f]: (4, ('- - 0', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 18:18:33 user nova-compute[74613]: DEBUG os_brick.initiator.linuxscsi [None req-ea6f93fc-869d-4034-b292-b6c0f9fb1194 tempest-AttachVolumeTestJSON-813984703 tempest-AttachVolumeTestJSON-813984703-project-member] Searching for a device in session 47 and hctl ['36', '*', '*', 0] yield: sde {{(pid=74613) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 29 18:18:33 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea6f93fc-869d-4034-b292-b6c0f9fb1194 tempest-AttachVolumeTestJSON-813984703 tempest-AttachVolumeTestJSON-813984703-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:9f9a0824-5da8-4aaa-bc2e-56c2f8688051', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QSNOVzpF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74613) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 29 18:18:34 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.base [None req-ea6f93fc-869d-4034-b292-b6c0f9fb1194 tempest-AttachVolumeTestJSON-813984703 tempest-AttachVolumeTestJSON-813984703-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.326s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 18:18:34 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea6f93fc-869d-4034-b292-b6c0f9fb1194 tempest-AttachVolumeTestJSON-813984703 tempest-AttachVolumeTestJSON-813984703-project-member] <== connect_volume: return (1328ms) {'type': 'block', 'scsi_wwn': '23137613066313238', 'path': '/dev/sde'} {{(pid=74613) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 18:18:34 user nova-compute[74613]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ea6f93fc-869d-4034-b292-b6c0f9fb1194 tempest-AttachVolumeTestJSON-813984703 tempest-AttachVolumeTestJSON-813984703-project-member] [instance: b2c3eb4f-df1f-46d0-acb5-3ac9f16f9a82] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23137613066313238', 'path': '/dev/sde'} {{(pid=74613) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 29 18:18:34 user nova-compute[74613]: DEBUG nova.objects.instance [None req-ea6f93fc-869d-4034-b292-b6c0f9fb1194 tempest-AttachVolumeTestJSON-813984703 tempest-AttachVolumeTestJSON-813984703-project-member] Lazy-loading 'flavor' on Instance uuid b2c3eb4f-df1f-46d0-acb5-3ac9f16f9a82 {{(pid=74613) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 18:18:34 user nova-compute[74613]: DEBUG nova.virt.libvirt.guest [None req-ea6f93fc-869d-4034-b292-b6c0f9fb1194 tempest-AttachVolumeTestJSON-813984703 tempest-AttachVolumeTestJSON-813984703-project-member] attach device xml: <disk type="block" device="disk">
Nov 29 18:18:34 user nova-compute[74613]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 18:18:34 user nova-compute[74613]:   <source dev="/dev/sde"/>
Nov 29 18:18:34 user nova-compute[74613]:   <target dev="vdb" bus="virtio"/>
Nov 29 18:18:34 user nova-compute[74613]:   <serial>9f9a0824-5da8-4aaa-bc2e-56c2f8688051</serial>
Nov 29 18:18:34 user nova-compute[74613]: </disk>
Nov 29 18:18:34 user nova-compute[74613]:  {{(pid=74613) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 29 18:18:35 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-ea6f93fc-869d-4034-b292-b6c0f9fb1194 tempest-AttachVolumeTestJSON-813984703 tempest-AttachVolumeTestJSON-813984703-project-member] No BDM found with device name vda, not building metadata. {{(pid=74613) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 18:18:35 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-ea6f93fc-869d-4034-b292-b6c0f9fb1194 tempest-AttachVolumeTestJSON-813984703 tempest-AttachVolumeTestJSON-813984703-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74613) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 18:18:35 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-ea6f93fc-869d-4034-b292-b6c0f9fb1194 tempest-AttachVolumeTestJSON-813984703 tempest-AttachVolumeTestJSON-813984703-project-member] No VIF found with MAC fa:16:3e:4d:ba:5c, not building metadata {{(pid=74613) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 29 18:18:35 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-ea6f93fc-869d-4034-b292-b6c0f9fb1194 tempest-AttachVolumeTestJSON-813984703 tempest-AttachVolumeTestJSON-813984703-project-member] Lock "b2c3eb4f-df1f-46d0-acb5-3ac9f16f9a82" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 9.590s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 18:18:35 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:18:36 user nova-compute[74613]: WARNING nova.virt.libvirt.driver [None req-aeaed006-94e4-42ab-bd94-8aff56c962e2 tempest-AttachVolumeNegativeTest-483083654 tempest-AttachVolumeNegativeTest-483083654-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance d9f10bfb-5202-4b4a-a42d-f167501f597b is timed out.
Nov 29 18:18:36 user nova-compute[74613]: INFO nova.virt.libvirt.driver [None req-aeaed006-94e4-42ab-bd94-8aff56c962e2 tempest-AttachVolumeNegativeTest-483083654 tempest-AttachVolumeNegativeTest-483083654-project-member] Successfully detached device vdb from instance d9f10bfb-5202-4b4a-a42d-f167501f597b from the live domain config.
Nov 29 18:18:36 user nova-compute[74613]: DEBUG nova.virt.libvirt.volume.iscsi [None req-aeaed006-94e4-42ab-bd94-8aff56c962e2 tempest-AttachVolumeNegativeTest-483083654 tempest-AttachVolumeNegativeTest-483083654-project-member] [instance: d9f10bfb-5202-4b4a-a42d-f167501f597b] calling os-brick to detach iSCSI Volume {{(pid=74613) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 29 18:18:36 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-aeaed006-94e4-42ab-bd94-8aff56c962e2 tempest-AttachVolumeNegativeTest-483083654 tempest-AttachVolumeNegativeTest-483083654-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff828156890>, {'target_iqn': 'iqn.2010-10.org.openstack:f2c0b94e-d018-479d-b037-7ca4cb5580a3', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'bmtopViz', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=74613) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 18:18:36 user nova-compute[74613]: WARNING os_brick.initiator.connectors.base [None req-aeaed006-94e4-42ab-bd94-8aff56c962e2 tempest-AttachVolumeNegativeTest-483083654 tempest-AttachVolumeNegativeTest-483083654-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 18:18:36 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.base [None req-aeaed006-94e4-42ab-bd94-8aff56c962e2 tempest-AttachVolumeNegativeTest-483083654 tempest-AttachVolumeNegativeTest-483083654-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 18:18:36 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.base [None req-aeaed006-94e4-42ab-bd94-8aff56c962e2 tempest-AttachVolumeNegativeTest-483083654 tempest-AttachVolumeNegativeTest-483083654-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 18:18:36 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:18:36 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.027s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:18:36 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b546cb8-f5bf-4ba0-b1c4-7b43678395bd]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:113c5dd9-52e5-46ba-8f15-faf70db70464\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f2c0b94e-d018-479d-b037-7ca4cb5580a3\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:5d74e565-9547-4f44-8005-0615d625a275\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:9f9a0824-5da8-4aaa-bc2e-56c2f8688051\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 18:18:36 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-aeaed006-94e4-42ab-bd94-8aff56c962e2 tempest-AttachVolumeNegativeTest-483083654 tempest-AttachVolumeNegativeTest-483083654-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 29 18:18:36 user nova-compute[74613]: No targets found.
Nov 29 18:18:36 user nova-compute[74613]: iSNS:
Nov 29 18:18:36 user nova-compute[74613]: No targets found.
Nov 29 18:18:36 user nova-compute[74613]: STATIC:
Nov 29 18:18:36 user nova-compute[74613]: Target: iqn.2010-10.org.openstack:113c5dd9-52e5-46ba-8f15-faf70db70464
Nov 29 18:18:36 user nova-compute[74613]:         Portal: 172.16.0.220:3260,-1
Nov 29 18:18:36 user nova-compute[74613]:                 Iface Name: default
Nov 29 18:18:36 user nova-compute[74613]: Target: iqn.2010-10.org.openstack:f2c0b94e-d018-479d-b037-7ca4cb5580a3
Nov 29 18:18:36 user nova-compute[74613]:         Portal: 172.16.0.220:3260,-1
Nov 29 18:18:36 user nova-compute[74613]:                 Iface Name: default
Nov 29 18:18:36 user nova-compute[74613]: Target: iqn.2010-10.org.openstack:5d74e565-9547-4f44-8005-0615d625a275
Nov 29 18:18:36 user nova-compute[74613]:         Portal: 172.16.0.220:3260,-1
Nov 29 18:18:36 user nova-compute[74613]:                 Iface Name: default
Nov 29 18:18:36 user nova-compute[74613]: Target: iqn.2010-10.org.openstack:9f9a0824-5da8-4aaa-bc2e-56c2f8688051
Nov 29 18:18:36 user nova-compute[74613]:         Portal: 172.16.0.220:3260,-1
Nov 29 18:18:36 user nova-compute[74613]:                 Iface Name: default
Nov 29 18:18:36 user nova-compute[74613]: FIRMWARE:
Nov 29 18:18:36 user nova-compute[74613]: No targets found.
Nov 29 18:18:36 user nova-compute[74613]:  stderr= {{(pid=74613) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 18:18:36 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-aeaed006-94e4-42ab-bd94-8aff56c962e2 tempest-AttachVolumeNegativeTest-483083654 tempest-AttachVolumeNegativeTest-483083654-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 29 18:18:36 user nova-compute[74613]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 29 18:18:36 user nova-compute[74613]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74613) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 29 18:18:36 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-aeaed006-94e4-42ab-bd94-8aff56c962e2 tempest-AttachVolumeNegativeTest-483083654 tempest-AttachVolumeNegativeTest-483083654-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f2c0b94e-d018-479d-b037-7ca4cb5580a3', 0)] {{(pid=74613) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 29 18:18:36 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:18:36 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:18:36 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a416d20-4576-476b-aa99-878f2323c2a3]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:113c5dd9-52e5-46ba-8f15-faf70db70464\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5d74e565-9547-4f44-8005-0615d625a275\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9f9a0824-5da8-4aaa-bc2e-56c2f8688051\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f2c0b94e-d018-479d-b037-7ca4cb5580a3\n', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 18:18:36 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:18:36 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.032s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:18:36 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[10da6153-cd07-4452-b704-02d63ae36470]: (4, ('tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:113c5dd9-52e5-46ba-8f15-faf70db70464 (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d74e565-9547-4f44-8005-0615d625a275 (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f2c0b94e-d018-479d-b037-7ca4cb5580a3 (non-flash)\ntcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f9a0824-5da8-4aaa-bc2e-56c2f8688051 (non-flash)\n', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 18:18:36 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-aeaed006-94e4-42ab-bd94-8aff56c962e2 tempest-AttachVolumeNegativeTest-483083654 tempest-AttachVolumeNegativeTest-483083654-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:113c5dd9-52e5-46ba-8f15-faf70db70464 (non-flash)
Nov 29 18:18:36 user nova-compute[74613]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d74e565-9547-4f44-8005-0615d625a275 (non-flash)
Nov 29 18:18:36 user nova-compute[74613]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f2c0b94e-d018-479d-b037-7ca4cb5580a3 (non-flash)
Nov 29 18:18:36 user nova-compute[74613]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f9a0824-5da8-4aaa-bc2e-56c2f8688051 (non-flash)
Nov 29 18:18:36 user nova-compute[74613]:  stderr= {{(pid=74613) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 18:18:36 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-aeaed006-94e4-42ab-bd94-8aff56c962e2 tempest-AttachVolumeNegativeTest-483083654 tempest-AttachVolumeNegativeTest-483083654-project-member] iscsi session list stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:113c5dd9-52e5-46ba-8f15-faf70db70464 (non-flash)
Nov 29 18:18:36 user nova-compute[74613]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d74e565-9547-4f44-8005-0615d625a275 (non-flash)
Nov 29 18:18:36 user nova-compute[74613]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f2c0b94e-d018-479d-b037-7ca4cb5580a3 (non-flash)
Nov 29 18:18:36 user nova-compute[74613]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f9a0824-5da8-4aaa-bc2e-56c2f8688051 (non-flash)
Nov 29 18:18:36 user nova-compute[74613]:  stderr= {{(pid=74613) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 18:18:36 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-aeaed006-94e4-42ab-bd94-8aff56c962e2 tempest-AttachVolumeNegativeTest-483083654 tempest-AttachVolumeNegativeTest-483083654-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7ff7f86816c0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f2c0b94e-d018-479d-b037-7ca4cb5580a3'): ({'sdd'}, set())}) {{(pid=74613) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 29 18:18:36 user nova-compute[74613]: DEBUG os_brick.initiator.linuxscsi [None req-aeaed006-94e4-42ab-bd94-8aff56c962e2 tempest-AttachVolumeNegativeTest-483083654 tempest-AttachVolumeNegativeTest-483083654-project-member] Removing single pathed devices sdd {{(pid=74613) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 29 18:18:36 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:18:36 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.023s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:18:36 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee7f4ea5-f85d-4aa0-be9c-148b98c5ce12]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 18:18:36 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:18:36 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.022s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:18:36 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2e2e22e-a4cd-4bd7-b6ec-0eb81c9202d0]: (4, ('ok\n', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 18:18:36 user nova-compute[74613]: DEBUG os_brick.initiator.linuxscsi [None req-aeaed006-94e4-42ab-bd94-8aff56c962e2 tempest-AttachVolumeNegativeTest-483083654 tempest-AttachVolumeNegativeTest-483083654-project-member] Flushing IO for device /dev/sdd {{(pid=74613) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 29 18:18:36 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:18:36 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.018s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:18:36 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[d76fa2dc-d070-463a-9f9e-a5feb5975401]: (4, ('', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 18:18:36 user nova-compute[74613]: DEBUG os_brick.initiator.linuxscsi [None req-aeaed006-94e4-42ab-bd94-8aff56c962e2 tempest-AttachVolumeNegativeTest-483083654 tempest-AttachVolumeNegativeTest-483083654-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=74613) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 29 18:18:36 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:18:36 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.040s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:18:36 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c4eea9c-12de-459f-bd01-6370fd37d7ef]: (4, ('1', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 18:18:36 user nova-compute[74613]: DEBUG os_brick.initiator.linuxscsi [None req-aeaed006-94e4-42ab-bd94-8aff56c962e2 tempest-AttachVolumeNegativeTest-483083654 tempest-AttachVolumeNegativeTest-483083654-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=74613) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 29 18:18:36 user nova-compute[74613]: DEBUG os_brick.initiator.linuxscsi [None req-aeaed006-94e4-42ab-bd94-8aff56c962e2 tempest-AttachVolumeNegativeTest-483083654 tempest-AttachVolumeNegativeTest-483083654-project-member] SCSI volumes sdd have been removed. {{(pid=74613) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 29 18:18:36 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-aeaed006-94e4-42ab-bd94-8aff56c962e2 tempest-AttachVolumeNegativeTest-483083654 tempest-AttachVolumeNegativeTest-483083654-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f2c0b94e-d018-479d-b037-7ca4cb5580a3')] {{(pid=74613) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 29 18:18:36 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f2c0b94e-d018-479d-b037-7ca4cb5580a3 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:18:36 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f2c0b94e-d018-479d-b037-7ca4cb5580a3 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:18:36 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[41c1cea2-3eac-4a9a-94ff-ab9f5aac9f34]: (4, ('', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 18:18:36 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-aeaed006-94e4-42ab-bd94-8aff56c962e2 tempest-AttachVolumeNegativeTest-483083654 tempest-AttachVolumeNegativeTest-483083654-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74613) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 18:18:36 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f2c0b94e-d018-479d-b037-7ca4cb5580a3 -p 172.16.0.220:3260 --logout {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:18:37 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f2c0b94e-d018-479d-b037-7ca4cb5580a3 -p 172.16.0.220:3260 --logout" returned: 0 in 0.075s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:18:37 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[69120ca8-87ff-4f59-8f45-8b83ce82a866]: (4, ('Logging out of session [sid: 46, target: iqn.2010-10.org.openstack:f2c0b94e-d018-479d-b037-7ca4cb5580a3, portal: 172.16.0.220,3260]\nLogout of [sid: 46, target: iqn.2010-10.org.openstack:f2c0b94e-d018-479d-b037-7ca4cb5580a3, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 18:18:37 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-aeaed006-94e4-42ab-bd94-8aff56c962e2 tempest-AttachVolumeNegativeTest-483083654 tempest-AttachVolumeNegativeTest-483083654-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 46, target: iqn.2010-10.org.openstack:f2c0b94e-d018-479d-b037-7ca4cb5580a3, portal: 172.16.0.220,3260]
Nov 29 18:18:37 user nova-compute[74613]: Logout of [sid: 46, target: iqn.2010-10.org.openstack:f2c0b94e-d018-479d-b037-7ca4cb5580a3, portal: 172.16.0.220,3260] successful.
Nov 29 18:18:37 user nova-compute[74613]:  stderr= {{(pid=74613) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 18:18:37 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f2c0b94e-d018-479d-b037-7ca4cb5580a3 -p 172.16.0.220:3260 --op delete {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:18:37 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f2c0b94e-d018-479d-b037-7ca4cb5580a3 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.025s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:18:37 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[0911c229-aa06-4b5a-a89e-551b1339653b]: (4, ('', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 18:18:37 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-aeaed006-94e4-42ab-bd94-8aff56c962e2 tempest-AttachVolumeNegativeTest-483083654 tempest-AttachVolumeNegativeTest-483083654-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74613) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 18:18:37 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.base [None req-aeaed006-94e4-42ab-bd94-8aff56c962e2 tempest-AttachVolumeNegativeTest-483083654 tempest-AttachVolumeNegativeTest-483083654-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.370s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 18:18:37 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-aeaed006-94e4-42ab-bd94-8aff56c962e2 tempest-AttachVolumeNegativeTest-483083654 tempest-AttachVolumeNegativeTest-483083654-project-member] <== disconnect_volume: return (371ms) None {{(pid=74613) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 18:18:37 user nova-compute[74613]: DEBUG nova.virt.libvirt.volume.iscsi [None req-aeaed006-94e4-42ab-bd94-8aff56c962e2 tempest-AttachVolumeNegativeTest-483083654 tempest-AttachVolumeNegativeTest-483083654-project-member] [instance: d9f10bfb-5202-4b4a-a42d-f167501f597b] Disconnected iSCSI Volume {{(pid=74613) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 29 18:18:37 user nova-compute[74613]: DEBUG nova.compute.manager [req-e6e8e519-890e-483d-aaa7-e6597363e544 req-2b29de8c-8c52-4d07-a36f-fda9e95091cf service nova] [instance: 3a2ac289-fc34-4c7b-a689-b499e2562578] Received event network-changed-6c245bc7-a2bd-47a5-a37b-a7d583d1b2e6 {{(pid=74613) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 18:18:37 user nova-compute[74613]: DEBUG nova.compute.manager [req-e6e8e519-890e-483d-aaa7-e6597363e544 req-2b29de8c-8c52-4d07-a36f-fda9e95091cf service nova] [instance: 3a2ac289-fc34-4c7b-a689-b499e2562578] Refreshing instance network info cache due to event network-changed-6c245bc7-a2bd-47a5-a37b-a7d583d1b2e6. {{(pid=74613) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 18:18:37 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-e6e8e519-890e-483d-aaa7-e6597363e544 req-2b29de8c-8c52-4d07-a36f-fda9e95091cf service nova] Acquiring lock "refresh_cache-3a2ac289-fc34-4c7b-a689-b499e2562578" {{(pid=74613) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 18:18:37 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-e6e8e519-890e-483d-aaa7-e6597363e544 req-2b29de8c-8c52-4d07-a36f-fda9e95091cf service nova] Acquired lock "refresh_cache-3a2ac289-fc34-4c7b-a689-b499e2562578" {{(pid=74613) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 18:18:37 user nova-compute[74613]: DEBUG nova.network.neutron [req-e6e8e519-890e-483d-aaa7-e6597363e544 req-2b29de8c-8c52-4d07-a36f-fda9e95091cf service nova] [instance: 3a2ac289-fc34-4c7b-a689-b499e2562578] Refreshing network info cache for port 6c245bc7-a2bd-47a5-a37b-a7d583d1b2e6 {{(pid=74613) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 18:18:38 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-ccf62911-9a5c-4f29-9da0-e19dfb827014 tempest-AttachVolumeTestJSON-813984703 tempest-AttachVolumeTestJSON-813984703-project-member] Acquiring lock "b2c3eb4f-df1f-46d0-acb5-3ac9f16f9a82" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 18:18:38 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-ccf62911-9a5c-4f29-9da0-e19dfb827014 tempest-AttachVolumeTestJSON-813984703 tempest-AttachVolumeTestJSON-813984703-project-member] Lock "b2c3eb4f-df1f-46d0-acb5-3ac9f16f9a82" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 18:18:38 user nova-compute[74613]: DEBUG nova.objects.instance [None req-ccf62911-9a5c-4f29-9da0-e19dfb827014 tempest-AttachVolumeTestJSON-813984703 tempest-AttachVolumeTestJSON-813984703-project-member] Lazy-loading 'flavor' on Instance uuid b2c3eb4f-df1f-46d0-acb5-3ac9f16f9a82 {{(pid=74613) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 18:18:38 user nova-compute[74613]: DEBUG nova.network.neutron [req-e6e8e519-890e-483d-aaa7-e6597363e544 req-2b29de8c-8c52-4d07-a36f-fda9e95091cf service nova] [instance: 3a2ac289-fc34-4c7b-a689-b499e2562578] Updated VIF entry in instance network info cache for port 6c245bc7-a2bd-47a5-a37b-a7d583d1b2e6. {{(pid=74613) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 18:18:38 user nova-compute[74613]: DEBUG nova.network.neutron [req-e6e8e519-890e-483d-aaa7-e6597363e544 req-2b29de8c-8c52-4d07-a36f-fda9e95091cf service nova] [instance: 3a2ac289-fc34-4c7b-a689-b499e2562578] Updating instance_info_cache with network_info: [{"id": "6c245bc7-a2bd-47a5-a37b-a7d583d1b2e6", "address": "fa:16:3e:e4:33:64", "network": {"id": "4a5179dd-d0b1-44c3-80c1-08dd7b0152f1", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1296336996-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.32", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "67390f1402214191904cfbd68c3142a7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6c245bc7-a2", "ovs_interfaceid": "6c245bc7-a2bd-47a5-a37b-a7d583d1b2e6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74613) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 18:18:38 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-ccf62911-9a5c-4f29-9da0-e19dfb827014 tempest-AttachVolumeTestJSON-813984703 tempest-AttachVolumeTestJSON-813984703-project-member] Lock "b2c3eb4f-df1f-46d0-acb5-3ac9f16f9a82" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.073s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 18:18:38 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-e6e8e519-890e-483d-aaa7-e6597363e544 req-2b29de8c-8c52-4d07-a36f-fda9e95091cf service nova] Releasing lock "refresh_cache-3a2ac289-fc34-4c7b-a689-b499e2562578" {{(pid=74613) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 18:18:38 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-ccf62911-9a5c-4f29-9da0-e19dfb827014 tempest-AttachVolumeTestJSON-813984703 tempest-AttachVolumeTestJSON-813984703-project-member] Acquiring lock "b2c3eb4f-df1f-46d0-acb5-3ac9f16f9a82" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 18:18:38 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-ccf62911-9a5c-4f29-9da0-e19dfb827014 tempest-AttachVolumeTestJSON-813984703 tempest-AttachVolumeTestJSON-813984703-project-member] Lock "b2c3eb4f-df1f-46d0-acb5-3ac9f16f9a82" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 18:18:38 user nova-compute[74613]: INFO nova.compute.manager [None req-ccf62911-9a5c-4f29-9da0-e19dfb827014 tempest-AttachVolumeTestJSON-813984703 tempest-AttachVolumeTestJSON-813984703-project-member] [instance: b2c3eb4f-df1f-46d0-acb5-3ac9f16f9a82] Attaching volume 15659ea3-d18c-4cae-ba54-13c3fdcacd03 to /dev/vdc
Nov 29 18:18:38 user nova-compute[74613]: DEBUG nova.objects.instance [None req-aeaed006-94e4-42ab-bd94-8aff56c962e2 tempest-AttachVolumeNegativeTest-483083654 tempest-AttachVolumeNegativeTest-483083654-project-member] Lazy-loading 'flavor' on Instance uuid d9f10bfb-5202-4b4a-a42d-f167501f597b {{(pid=74613) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 18:18:38 user nova-compute[74613]: DEBUG os_brick.utils [None req-ccf62911-9a5c-4f29-9da0-e19dfb827014 tempest-AttachVolumeTestJSON-813984703 tempest-AttachVolumeTestJSON-813984703-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74613) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 18:18:38 user nova-compute[74613]: DEBUG oslo_service.periodic_task [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74613) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 18:18:38 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:18:38 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.021s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:18:38 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2a3b877-10b2-4999-9cec-393732439711]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:400972819b5\n', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 18:18:38 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-aeaed006-94e4-42ab-bd94-8aff56c962e2 tempest-AttachVolumeNegativeTest-483083654 tempest-AttachVolumeNegativeTest-483083654-project-member] Lock "d9f10bfb-5202-4b4a-a42d-f167501f597b" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.417s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 18:18:38 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:18:38 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.019s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:18:38 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[d42003d2-a481-4e95-a987-53c8f462dab1]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 18:18:38 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:18:38 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:18:38 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[5fc16e20-bb48-4ef1-b77a-bb7c0a41218e]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 18:18:38 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7b2903b-1c1e-444e-b281-1cabefe39636]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 18:18:38 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-ccf62911-9a5c-4f29-9da0-e19dfb827014 tempest-AttachVolumeTestJSON-813984703 tempest-AttachVolumeTestJSON-813984703-project-member] Running cmd (subprocess): nvme version {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:18:38 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-ccf62911-9a5c-4f29-9da0-e19dfb827014 tempest-AttachVolumeTestJSON-813984703 tempest-AttachVolumeTestJSON-813984703-project-member] 'nvme version' failed. Not Retrying. {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 18:18:38 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.nvmeof [None req-ccf62911-9a5c-4f29-9da0-e19dfb827014 tempest-AttachVolumeTestJSON-813984703 tempest-AttachVolumeTestJSON-813984703-project-member] nvme not present on system {{(pid=74613) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 29 18:18:38 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:18:38 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 18:18:38 user nova-compute[74613]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 29 18:18:38 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1bf204b-eff6-4a63-89c3-fa589e9da90e]: (4, '') {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 18:18:38 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.lightos [None req-ccf62911-9a5c-4f29-9da0-e19dfb827014 tempest-AttachVolumeTestJSON-813984703 tempest-AttachVolumeTestJSON-813984703-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74613) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 29 18:18:38 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.lightos [None req-ccf62911-9a5c-4f29-9da0-e19dfb827014 tempest-AttachVolumeTestJSON-813984703 tempest-AttachVolumeTestJSON-813984703-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74613) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 29 18:18:38 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.lightos [None req-ccf62911-9a5c-4f29-9da0-e19dfb827014 tempest-AttachVolumeTestJSON-813984703 tempest-AttachVolumeTestJSON-813984703-project-member] LIGHTOS: no hostnqn found. {{(pid=74613) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 29 18:18:38 user nova-compute[74613]: DEBUG os_brick.utils [None req-ccf62911-9a5c-4f29-9da0-e19dfb827014 tempest-AttachVolumeTestJSON-813984703 tempest-AttachVolumeTestJSON-813984703-project-member] <== get_connector_properties: return (134ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:400972819b5', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74613) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 18:18:38 user nova-compute[74613]: DEBUG nova.virt.block_device [None req-ccf62911-9a5c-4f29-9da0-e19dfb827014 tempest-AttachVolumeTestJSON-813984703 tempest-AttachVolumeTestJSON-813984703-project-member] [instance: b2c3eb4f-df1f-46d0-acb5-3ac9f16f9a82] Updating existing volume attachment record: 9d2e355c-b527-481d-a66a-bb219906b926 {{(pid=74613) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 29 18:18:40 user nova-compute[74613]: DEBUG oslo_service.periodic_task [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74613) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 18:18:40 user nova-compute[74613]: DEBUG oslo_service.periodic_task [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74613) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 18:18:40 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 18:18:40 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 18:18:40 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 18:18:40 user nova-compute[74613]: DEBUG nova.compute.resource_tracker [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Auditing locally available compute resources for user (node: user) {{(pid=74613) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 29 18:18:40 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 18:18:40 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1f2b4426-815f-4ef4-b98e-e5124fec93b7/disk --force-share --output=json {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:18:40 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1f2b4426-815f-4ef4-b98e-e5124fec93b7/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:18:40 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1f2b4426-815f-4ef4-b98e-e5124fec93b7/disk --force-share --output=json {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:18:41 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:18:41 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1f2b4426-815f-4ef4-b98e-e5124fec93b7/disk --force-share --output=json" returned: 0 in 0.214s {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:18:41 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=74613) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 29 18:18:41 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b2c3eb4f-df1f-46d0-acb5-3ac9f16f9a82/disk --force-share --output=json {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:18:41 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b2c3eb4f-df1f-46d0-acb5-3ac9f16f9a82/disk --force-share --output=json" returned: 0 in 0.214s {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:18:41 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b2c3eb4f-df1f-46d0-acb5-3ac9f16f9a82/disk --force-share --output=json {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:18:41 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b2c3eb4f-df1f-46d0-acb5-3ac9f16f9a82/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:18:41 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] skipping disk /dev/sde (vdb) as it is a volume {{(pid=74613) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 29 18:18:41 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74613) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 29 18:18:41 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f4a1329-b3b9-4d1c-8735-abddabc359fd/disk.rescue --force-share --output=json {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:18:41 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f4a1329-b3b9-4d1c-8735-abddabc359fd/disk.rescue --force-share --output=json" returned: 0 in 0.192s {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:18:41 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f4a1329-b3b9-4d1c-8735-abddabc359fd/disk.rescue --force-share --output=json {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:18:42 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f4a1329-b3b9-4d1c-8735-abddabc359fd/disk.rescue --force-share --output=json" returned: 0 in 0.183s {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:18:42 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f4a1329-b3b9-4d1c-8735-abddabc359fd/disk --force-share --output=json {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:18:42 user nova-compute[74613]: DEBUG nova.compute.manager [req-908f17c4-fb37-4120-bb5e-87a8f4b65ef0 req-a359d351-ebd5-4e1c-95b2-448f5fc4cfc8 service nova] [instance: 1f2b4426-815f-4ef4-b98e-e5124fec93b7] Received event network-changed-e89209f3-5532-4ff8-95c7-fb7a3334846a {{(pid=74613) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 18:18:42 user nova-compute[74613]: DEBUG nova.compute.manager [req-908f17c4-fb37-4120-bb5e-87a8f4b65ef0 req-a359d351-ebd5-4e1c-95b2-448f5fc4cfc8 service nova] [instance: 1f2b4426-815f-4ef4-b98e-e5124fec93b7] Refreshing instance network info cache due to event network-changed-e89209f3-5532-4ff8-95c7-fb7a3334846a. {{(pid=74613) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 18:18:42 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-908f17c4-fb37-4120-bb5e-87a8f4b65ef0 req-a359d351-ebd5-4e1c-95b2-448f5fc4cfc8 service nova] Acquiring lock "refresh_cache-1f2b4426-815f-4ef4-b98e-e5124fec93b7" {{(pid=74613) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 18:18:42 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-908f17c4-fb37-4120-bb5e-87a8f4b65ef0 req-a359d351-ebd5-4e1c-95b2-448f5fc4cfc8 service nova] Acquired lock "refresh_cache-1f2b4426-815f-4ef4-b98e-e5124fec93b7" {{(pid=74613) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 18:18:42 user nova-compute[74613]: DEBUG nova.network.neutron [req-908f17c4-fb37-4120-bb5e-87a8f4b65ef0 req-a359d351-ebd5-4e1c-95b2-448f5fc4cfc8 service nova] [instance: 1f2b4426-815f-4ef4-b98e-e5124fec93b7] Refreshing network info cache for port e89209f3-5532-4ff8-95c7-fb7a3334846a {{(pid=74613) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 18:18:42 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f4a1329-b3b9-4d1c-8735-abddabc359fd/disk --force-share --output=json" returned: 0 in 0.207s {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:18:42 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f4a1329-b3b9-4d1c-8735-abddabc359fd/disk --force-share --output=json {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:18:42 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f4a1329-b3b9-4d1c-8735-abddabc359fd/disk --force-share --output=json" returned: 0 in 0.215s {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:18:42 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d9f10bfb-5202-4b4a-a42d-f167501f597b/disk --force-share --output=json {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:18:42 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-7783518a-de7f-4a44-b814-594975cbde46 tempest-ServerRescueNegativeTestJSON-1891426908 tempest-ServerRescueNegativeTestJSON-1891426908-project-member] Acquiring lock "1f2b4426-815f-4ef4-b98e-e5124fec93b7" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 18:18:42 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-7783518a-de7f-4a44-b814-594975cbde46 tempest-ServerRescueNegativeTestJSON-1891426908 tempest-ServerRescueNegativeTestJSON-1891426908-project-member] Lock "1f2b4426-815f-4ef4-b98e-e5124fec93b7" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 18:18:42 user nova-compute[74613]: DEBUG nova.network.neutron [req-908f17c4-fb37-4120-bb5e-87a8f4b65ef0 req-a359d351-ebd5-4e1c-95b2-448f5fc4cfc8 service nova] [instance: 1f2b4426-815f-4ef4-b98e-e5124fec93b7] Updated VIF entry in instance network info cache for port e89209f3-5532-4ff8-95c7-fb7a3334846a. {{(pid=74613) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 18:18:42 user nova-compute[74613]: DEBUG nova.network.neutron [req-908f17c4-fb37-4120-bb5e-87a8f4b65ef0 req-a359d351-ebd5-4e1c-95b2-448f5fc4cfc8 service nova] [instance: 1f2b4426-815f-4ef4-b98e-e5124fec93b7] Updating instance_info_cache with network_info: [{"id": "e89209f3-5532-4ff8-95c7-fb7a3334846a", "address": "fa:16:3e:98:a3:61", "network": {"id": "db79433c-b21c-4058-b98c-f62822abbf7a", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1715530752-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.251", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e6a3eb6ea0294f9da705dca72ec2789a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape89209f3-55", "ovs_interfaceid": "e89209f3-5532-4ff8-95c7-fb7a3334846a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74613) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 18:18:42 user nova-compute[74613]: INFO nova.compute.manager [None req-7783518a-de7f-4a44-b814-594975cbde46 tempest-ServerRescueNegativeTestJSON-1891426908 tempest-ServerRescueNegativeTestJSON-1891426908-project-member] [instance: 1f2b4426-815f-4ef4-b98e-e5124fec93b7] Detaching volume 113c5dd9-52e5-46ba-8f15-faf70db70464
Nov 29 18:18:42 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-908f17c4-fb37-4120-bb5e-87a8f4b65ef0 req-a359d351-ebd5-4e1c-95b2-448f5fc4cfc8 service nova] Releasing lock "refresh_cache-1f2b4426-815f-4ef4-b98e-e5124fec93b7" {{(pid=74613) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 18:18:42 user nova-compute[74613]: INFO nova.virt.block_device [None req-7783518a-de7f-4a44-b814-594975cbde46 tempest-ServerRescueNegativeTestJSON-1891426908 tempest-ServerRescueNegativeTestJSON-1891426908-project-member] [instance: 1f2b4426-815f-4ef4-b98e-e5124fec93b7] Attempting to driver detach volume 113c5dd9-52e5-46ba-8f15-faf70db70464 from mountpoint /dev/vdb
Nov 29 18:18:42 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d9f10bfb-5202-4b4a-a42d-f167501f597b/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:18:42 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d9f10bfb-5202-4b4a-a42d-f167501f597b/disk --force-share --output=json {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:18:42 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-7783518a-de7f-4a44-b814-594975cbde46 tempest-ServerRescueNegativeTestJSON-1891426908 tempest-ServerRescueNegativeTestJSON-1891426908-project-member] Attempting to detach device vdb from instance 1f2b4426-815f-4ef4-b98e-e5124fec93b7 from the persistent domain config. {{(pid=74613) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 29 18:18:42 user nova-compute[74613]: DEBUG nova.virt.libvirt.guest [None req-7783518a-de7f-4a44-b814-594975cbde46 tempest-ServerRescueNegativeTestJSON-1891426908 tempest-ServerRescueNegativeTestJSON-1891426908-project-member] detach device xml: <disk type="block" device="disk">
Nov 29 18:18:42 user nova-compute[74613]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 18:18:42 user nova-compute[74613]:   <source dev="/dev/sdc"/>
Nov 29 18:18:42 user nova-compute[74613]:   <target dev="vdb" bus="virtio"/>
Nov 29 18:18:42 user nova-compute[74613]:   <serial>113c5dd9-52e5-46ba-8f15-faf70db70464</serial>
Nov 29 18:18:42 user nova-compute[74613]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 29 18:18:42 user nova-compute[74613]: </disk>
Nov 29 18:18:42 user nova-compute[74613]:  {{(pid=74613) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 29 18:18:42 user nova-compute[74613]: INFO nova.virt.libvirt.driver [None req-7783518a-de7f-4a44-b814-594975cbde46 tempest-ServerRescueNegativeTestJSON-1891426908 tempest-ServerRescueNegativeTestJSON-1891426908-project-member] Successfully detached device vdb from instance 1f2b4426-815f-4ef4-b98e-e5124fec93b7 from the persistent domain config.
Nov 29 18:18:42 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-7783518a-de7f-4a44-b814-594975cbde46 tempest-ServerRescueNegativeTestJSON-1891426908 tempest-ServerRescueNegativeTestJSON-1891426908-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 1f2b4426-815f-4ef4-b98e-e5124fec93b7 from the live domain config. {{(pid=74613) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 29 18:18:42 user nova-compute[74613]: DEBUG nova.virt.libvirt.guest [None req-7783518a-de7f-4a44-b814-594975cbde46 tempest-ServerRescueNegativeTestJSON-1891426908 tempest-ServerRescueNegativeTestJSON-1891426908-project-member] detach device xml: <disk type="block" device="disk">
Nov 29 18:18:42 user nova-compute[74613]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 18:18:42 user nova-compute[74613]:   <source dev="/dev/sdc"/>
Nov 29 18:18:42 user nova-compute[74613]:   <target dev="vdb" bus="virtio"/>
Nov 29 18:18:42 user nova-compute[74613]:   <serial>113c5dd9-52e5-46ba-8f15-faf70db70464</serial>
Nov 29 18:18:42 user nova-compute[74613]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 29 18:18:42 user nova-compute[74613]: </disk>
Nov 29 18:18:42 user nova-compute[74613]:  {{(pid=74613) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 29 18:18:42 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d9f10bfb-5202-4b4a-a42d-f167501f597b/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:18:42 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6993e2e7-7e03-45b4-9d3d-3742589b6078/disk --force-share --output=json {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:18:43 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6993e2e7-7e03-45b4-9d3d-3742589b6078/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:18:43 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6993e2e7-7e03-45b4-9d3d-3742589b6078/disk --force-share --output=json {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:18:43 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-7783518a-de7f-4a44-b814-594975cbde46 tempest-ServerRescueNegativeTestJSON-1891426908 tempest-ServerRescueNegativeTestJSON-1891426908-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 1f2b4426-815f-4ef4-b98e-e5124fec93b7 {{(pid=74613) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 29 18:18:43 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6993e2e7-7e03-45b4-9d3d-3742589b6078/disk --force-share --output=json" returned: 0 in 0.208s {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:18:43 user nova-compute[74613]: WARNING nova.virt.libvirt.driver [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 18:18:43 user nova-compute[74613]: WARNING nova.virt.libvirt.driver [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 18:18:43 user nova-compute[74613]: DEBUG nova.compute.resource_tracker [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Hypervisor/Node resource view: name=user free_ram=8330MB free_disk=24.863452911376953GB free_vcpus=6 pci_devices=[{"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74613) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 29 18:18:43 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 18:18:43 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 18:18:43 user nova-compute[74613]: DEBUG nova.compute.resource_tracker [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Instance 6993e2e7-7e03-45b4-9d3d-3742589b6078 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74613) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 18:18:43 user nova-compute[74613]: DEBUG nova.compute.resource_tracker [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Instance 6f4a1329-b3b9-4d1c-8735-abddabc359fd actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74613) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 18:18:43 user nova-compute[74613]: DEBUG nova.compute.resource_tracker [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Instance 1f2b4426-815f-4ef4-b98e-e5124fec93b7 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74613) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 18:18:43 user nova-compute[74613]: DEBUG nova.compute.resource_tracker [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Instance d9f10bfb-5202-4b4a-a42d-f167501f597b actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74613) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 18:18:43 user nova-compute[74613]: DEBUG nova.compute.resource_tracker [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Instance b2c3eb4f-df1f-46d0-acb5-3ac9f16f9a82 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74613) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 18:18:43 user nova-compute[74613]: DEBUG nova.compute.resource_tracker [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Instance 3a2ac289-fc34-4c7b-a689-b499e2562578 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74613) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 18:18:43 user nova-compute[74613]: DEBUG nova.compute.resource_tracker [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Total usable vcpus: 12, total allocated vcpus: 6 {{(pid=74613) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 29 18:18:43 user nova-compute[74613]: DEBUG nova.compute.resource_tracker [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Final resource view: name=user phys_ram=16011MB used_ram=3584MB phys_disk=40GB used_disk=5GB total_vcpus=12 used_vcpus=6 pci_stats=[] {{(pid=74613) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 29 18:18:43 user nova-compute[74613]: DEBUG nova.compute.provider_tree [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Inventory has not changed in ProviderTree for provider: 639d980e-3b12-44b1-b8f4-1812416fa4dd {{(pid=74613) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 18:18:43 user nova-compute[74613]: DEBUG nova.scheduler.client.report [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Inventory has not changed for provider 639d980e-3b12-44b1-b8f4-1812416fa4dd based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74613) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 18:18:44 user nova-compute[74613]: DEBUG nova.compute.resource_tracker [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Compute_service record updated for user:user {{(pid=74613) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 29 18:18:44 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.354s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 18:18:44 user nova-compute[74613]: DEBUG nova.compute.manager [req-d4fc55c6-435c-487a-be66-b91f1b30249c req-af11230f-9b3b-4082-b54e-b08ad4c1a113 service nova] [instance: 1f2b4426-815f-4ef4-b98e-e5124fec93b7] Received event network-changed-e89209f3-5532-4ff8-95c7-fb7a3334846a {{(pid=74613) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 18:18:44 user nova-compute[74613]: DEBUG nova.compute.manager [req-d4fc55c6-435c-487a-be66-b91f1b30249c req-af11230f-9b3b-4082-b54e-b08ad4c1a113 service nova] [instance: 1f2b4426-815f-4ef4-b98e-e5124fec93b7] Refreshing instance network info cache due to event network-changed-e89209f3-5532-4ff8-95c7-fb7a3334846a. {{(pid=74613) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 18:18:44 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-d4fc55c6-435c-487a-be66-b91f1b30249c req-af11230f-9b3b-4082-b54e-b08ad4c1a113 service nova] Acquiring lock "refresh_cache-1f2b4426-815f-4ef4-b98e-e5124fec93b7" {{(pid=74613) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 18:18:44 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-d4fc55c6-435c-487a-be66-b91f1b30249c req-af11230f-9b3b-4082-b54e-b08ad4c1a113 service nova] Acquired lock "refresh_cache-1f2b4426-815f-4ef4-b98e-e5124fec93b7" {{(pid=74613) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 18:18:44 user nova-compute[74613]: DEBUG nova.network.neutron [req-d4fc55c6-435c-487a-be66-b91f1b30249c req-af11230f-9b3b-4082-b54e-b08ad4c1a113 service nova] [instance: 1f2b4426-815f-4ef4-b98e-e5124fec93b7] Refreshing network info cache for port e89209f3-5532-4ff8-95c7-fb7a3334846a {{(pid=74613) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 18:18:45 user nova-compute[74613]: DEBUG oslo_service.periodic_task [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74613) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 18:18:45 user nova-compute[74613]: DEBUG nova.compute.manager [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Starting heal instance info cache {{(pid=74613) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 29 18:18:45 user nova-compute[74613]: DEBUG nova.compute.manager [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Didn't find any instances for network info cache update. {{(pid=74613) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 29 18:18:45 user nova-compute[74613]: DEBUG oslo_service.periodic_task [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74613) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 18:18:45 user nova-compute[74613]: DEBUG oslo_service.periodic_task [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74613) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 18:18:45 user nova-compute[74613]: DEBUG oslo_service.periodic_task [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74613) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 18:18:45 user nova-compute[74613]: DEBUG nova.network.neutron [req-d4fc55c6-435c-487a-be66-b91f1b30249c req-af11230f-9b3b-4082-b54e-b08ad4c1a113 service nova] [instance: 1f2b4426-815f-4ef4-b98e-e5124fec93b7] Updated VIF entry in instance network info cache for port e89209f3-5532-4ff8-95c7-fb7a3334846a. {{(pid=74613) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 18:18:45 user nova-compute[74613]: DEBUG nova.network.neutron [req-d4fc55c6-435c-487a-be66-b91f1b30249c req-af11230f-9b3b-4082-b54e-b08ad4c1a113 service nova] [instance: 1f2b4426-815f-4ef4-b98e-e5124fec93b7] Updating instance_info_cache with network_info: [{"id": "e89209f3-5532-4ff8-95c7-fb7a3334846a", "address": "fa:16:3e:98:a3:61", "network": {"id": "db79433c-b21c-4058-b98c-f62822abbf7a", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1715530752-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.251", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e6a3eb6ea0294f9da705dca72ec2789a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape89209f3-55", "ovs_interfaceid": "e89209f3-5532-4ff8-95c7-fb7a3334846a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74613) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 18:18:45 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-d4fc55c6-435c-487a-be66-b91f1b30249c req-af11230f-9b3b-4082-b54e-b08ad4c1a113 service nova] Releasing lock "refresh_cache-1f2b4426-815f-4ef4-b98e-e5124fec93b7" {{(pid=74613) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 18:18:45 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-0d9da0ba-18f6-490b-8790-c28028b7a3ad tempest-TestVolumeBootPattern-1318569205 tempest-TestVolumeBootPattern-1318569205-project-member] Acquiring lock "d4385666-cff6-4133-9833-5447218c8857" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 18:18:45 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-0d9da0ba-18f6-490b-8790-c28028b7a3ad tempest-TestVolumeBootPattern-1318569205 tempest-TestVolumeBootPattern-1318569205-project-member] Lock "d4385666-cff6-4133-9833-5447218c8857" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 18:18:45 user nova-compute[74613]: DEBUG nova.compute.manager [None req-0d9da0ba-18f6-490b-8790-c28028b7a3ad tempest-TestVolumeBootPattern-1318569205 tempest-TestVolumeBootPattern-1318569205-project-member] [instance: d4385666-cff6-4133-9833-5447218c8857] Starting instance... {{(pid=74613) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 29 18:18:45 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-0d9da0ba-18f6-490b-8790-c28028b7a3ad tempest-TestVolumeBootPattern-1318569205 tempest-TestVolumeBootPattern-1318569205-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 18:18:45 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-0d9da0ba-18f6-490b-8790-c28028b7a3ad tempest-TestVolumeBootPattern-1318569205 tempest-TestVolumeBootPattern-1318569205-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 18:18:45 user nova-compute[74613]: DEBUG nova.virt.hardware [None req-0d9da0ba-18f6-490b-8790-c28028b7a3ad tempest-TestVolumeBootPattern-1318569205 tempest-TestVolumeBootPattern-1318569205-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74613) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 29 18:18:45 user nova-compute[74613]: INFO nova.compute.claims [None req-0d9da0ba-18f6-490b-8790-c28028b7a3ad tempest-TestVolumeBootPattern-1318569205 tempest-TestVolumeBootPattern-1318569205-project-member] [instance: d4385666-cff6-4133-9833-5447218c8857] Claim successful on node user
Nov 29 18:18:45 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:18:45 user nova-compute[74613]: DEBUG nova.compute.provider_tree [None req-0d9da0ba-18f6-490b-8790-c28028b7a3ad tempest-TestVolumeBootPattern-1318569205 tempest-TestVolumeBootPattern-1318569205-project-member] Inventory has not changed in ProviderTree for provider: 639d980e-3b12-44b1-b8f4-1812416fa4dd {{(pid=74613) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 18:18:45 user nova-compute[74613]: DEBUG nova.scheduler.client.report [None req-0d9da0ba-18f6-490b-8790-c28028b7a3ad tempest-TestVolumeBootPattern-1318569205 tempest-TestVolumeBootPattern-1318569205-project-member] Inventory has not changed for provider 639d980e-3b12-44b1-b8f4-1812416fa4dd based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74613) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 18:18:45 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-0d9da0ba-18f6-490b-8790-c28028b7a3ad tempest-TestVolumeBootPattern-1318569205 tempest-TestVolumeBootPattern-1318569205-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.320s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 18:18:45 user nova-compute[74613]: DEBUG nova.compute.manager [None req-0d9da0ba-18f6-490b-8790-c28028b7a3ad tempest-TestVolumeBootPattern-1318569205 tempest-TestVolumeBootPattern-1318569205-project-member] [instance: d4385666-cff6-4133-9833-5447218c8857] Start building networks asynchronously for instance. {{(pid=74613) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 29 18:18:46 user nova-compute[74613]: INFO nova.virt.libvirt.driver [None req-0d9da0ba-18f6-490b-8790-c28028b7a3ad tempest-TestVolumeBootPattern-1318569205 tempest-TestVolumeBootPattern-1318569205-project-member] [instance: d4385666-cff6-4133-9833-5447218c8857] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 29 18:18:46 user nova-compute[74613]: DEBUG nova.compute.manager [None req-0d9da0ba-18f6-490b-8790-c28028b7a3ad tempest-TestVolumeBootPattern-1318569205 tempest-TestVolumeBootPattern-1318569205-project-member] [instance: d4385666-cff6-4133-9833-5447218c8857] Allocating IP information in the background. {{(pid=74613) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 29 18:18:46 user nova-compute[74613]: DEBUG nova.network.neutron [None req-0d9da0ba-18f6-490b-8790-c28028b7a3ad tempest-TestVolumeBootPattern-1318569205 tempest-TestVolumeBootPattern-1318569205-project-member] [instance: d4385666-cff6-4133-9833-5447218c8857] allocate_for_instance() {{(pid=74613) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 29 18:18:46 user nova-compute[74613]: DEBUG nova.compute.manager [None req-0d9da0ba-18f6-490b-8790-c28028b7a3ad tempest-TestVolumeBootPattern-1318569205 tempest-TestVolumeBootPattern-1318569205-project-member] [instance: d4385666-cff6-4133-9833-5447218c8857] Start building block device mappings for instance. {{(pid=74613) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 29 18:18:46 user nova-compute[74613]: INFO nova.virt.block_device [None req-0d9da0ba-18f6-490b-8790-c28028b7a3ad tempest-TestVolumeBootPattern-1318569205 tempest-TestVolumeBootPattern-1318569205-project-member] [instance: d4385666-cff6-4133-9833-5447218c8857] Booting with volume snapshot d0444217-a537-446e-ae0e-b933f414d234 at /dev/vda
Nov 29 18:18:46 user nova-compute[74613]: DEBUG nova.policy [None req-0d9da0ba-18f6-490b-8790-c28028b7a3ad tempest-TestVolumeBootPattern-1318569205 tempest-TestVolumeBootPattern-1318569205-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'bedbc6ed47394e2b9125543a8b88a71f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67390f1402214191904cfbd68c3142a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74613) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 29 18:18:46 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:18:46 user nova-compute[74613]: DEBUG oslo_service.periodic_task [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74613) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 18:18:46 user nova-compute[74613]: DEBUG nova.compute.manager [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74613) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 29 18:18:47 user nova-compute[74613]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ccf62911-9a5c-4f29-9da0-e19dfb827014 tempest-AttachVolumeTestJSON-813984703 tempest-AttachVolumeTestJSON-813984703-project-member] [instance: b2c3eb4f-df1f-46d0-acb5-3ac9f16f9a82] Calling os-brick to attach iSCSI Volume {{(pid=74613) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 29 18:18:47 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-ccf62911-9a5c-4f29-9da0-e19dfb827014 tempest-AttachVolumeTestJSON-813984703 tempest-AttachVolumeTestJSON-813984703-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff828156890>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:15659ea3-d18c-4cae-ba54-13c3fdcacd03', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wqvklJUE', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74613) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 18:18:47 user nova-compute[74613]: WARNING os_brick.initiator.connectors.base [None req-ccf62911-9a5c-4f29-9da0-e19dfb827014 tempest-AttachVolumeTestJSON-813984703 tempest-AttachVolumeTestJSON-813984703-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 18:18:47 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.base [None req-ccf62911-9a5c-4f29-9da0-e19dfb827014 tempest-AttachVolumeTestJSON-813984703 tempest-AttachVolumeTestJSON-813984703-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 18:18:47 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.base [None req-ccf62911-9a5c-4f29-9da0-e19dfb827014 tempest-AttachVolumeTestJSON-813984703 tempest-AttachVolumeTestJSON-813984703-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 18:18:47 user nova-compute[74613]: WARNING os_brick.initiator.connectors.base [None req-ccf62911-9a5c-4f29-9da0-e19dfb827014 tempest-AttachVolumeTestJSON-813984703 tempest-AttachVolumeTestJSON-813984703-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 18:18:47 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.base [None req-ccf62911-9a5c-4f29-9da0-e19dfb827014 tempest-AttachVolumeTestJSON-813984703 tempest-AttachVolumeTestJSON-813984703-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:15659ea3-d18c-4cae-ba54-13c3fdcacd03" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 18:18:47 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.base [None req-ccf62911-9a5c-4f29-9da0-e19dfb827014 tempest-AttachVolumeTestJSON-813984703 tempest-AttachVolumeTestJSON-813984703-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:15659ea3-d18c-4cae-ba54-13c3fdcacd03" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 18:18:47 user nova-compute[74613]: INFO os_brick.initiator.connectors.iscsi [None req-ccf62911-9a5c-4f29-9da0-e19dfb827014 tempest-AttachVolumeTestJSON-813984703 tempest-AttachVolumeTestJSON-813984703-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 29 18:18:47 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:15659ea3-d18c-4cae-ba54-13c3fdcacd03 -p 172.16.0.220:3260 {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:18:47 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:15659ea3-d18c-4cae-ba54-13c3fdcacd03 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:18:47 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[95eb6ad5-2944-485c-8e24-e702820a8613]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 18:18:47 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-ccf62911-9a5c-4f29-9da0-e19dfb827014 tempest-AttachVolumeTestJSON-813984703 tempest-AttachVolumeTestJSON-813984703-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 29 18:18:47 user nova-compute[74613]:  {{(pid=74613) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 18:18:47 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:15659ea3-d18c-4cae-ba54-13c3fdcacd03 -p 172.16.0.220:3260 --interface default --op new {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:18:47 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:15659ea3-d18c-4cae-ba54-13c3fdcacd03 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:18:47 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d1c1e30-e3d9-46f6-a2bb-52721c992047]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:15659ea3-d18c-4cae-ba54-13c3fdcacd03] added\n', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 18:18:47 user nova-compute[74613]: DEBUG nova.network.neutron [None req-0d9da0ba-18f6-490b-8790-c28028b7a3ad tempest-TestVolumeBootPattern-1318569205 tempest-TestVolumeBootPattern-1318569205-project-member] [instance: d4385666-cff6-4133-9833-5447218c8857] Successfully created port: a3798396-6b34-4ed7-b750-6a741a148340 {{(pid=74613) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 29 18:18:47 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-ccf62911-9a5c-4f29-9da0-e19dfb827014 tempest-AttachVolumeTestJSON-813984703 tempest-AttachVolumeTestJSON-813984703-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:15659ea3-d18c-4cae-ba54-13c3fdcacd03] added
Nov 29 18:18:47 user nova-compute[74613]:  stderr= {{(pid=74613) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 18:18:47 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:15659ea3-d18c-4cae-ba54-13c3fdcacd03 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:18:47 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:15659ea3-d18c-4cae-ba54-13c3fdcacd03 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:18:47 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[d667ed69-e8e1-49b6-9cc5-f12d0e0b2da0]: (4, ('', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 18:18:47 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-ccf62911-9a5c-4f29-9da0-e19dfb827014 tempest-AttachVolumeTestJSON-813984703 tempest-AttachVolumeTestJSON-813984703-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74613) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 18:18:47 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:15659ea3-d18c-4cae-ba54-13c3fdcacd03 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:18:47 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:15659ea3-d18c-4cae-ba54-13c3fdcacd03 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:18:47 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[54b7967e-3997-42bf-811f-e99597dd65fb]: (4, ('', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 18:18:47 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-ccf62911-9a5c-4f29-9da0-e19dfb827014 tempest-AttachVolumeTestJSON-813984703 tempest-AttachVolumeTestJSON-813984703-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74613) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 18:18:47 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:15659ea3-d18c-4cae-ba54-13c3fdcacd03 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v wqvklJUE {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:18:47 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:15659ea3-d18c-4cae-ba54-13c3fdcacd03 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v wqvklJUE" returned: 0 in 0.023s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:18:47 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[17742259-55ec-4877-a043-0049108bde2a]: (4, ('', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 18:18:47 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-ccf62911-9a5c-4f29-9da0-e19dfb827014 tempest-AttachVolumeTestJSON-813984703 tempest-AttachVolumeTestJSON-813984703-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'wqvklJUE'): stdout= stderr= {{(pid=74613) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 18:18:47 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:15659ea3-d18c-4cae-ba54-13c3fdcacd03 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:18:47 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:15659ea3-d18c-4cae-ba54-13c3fdcacd03 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.026s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:18:47 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a4f517f-7729-4137-a373-3a9e36e87146]: (4, ('', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 18:18:47 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-ccf62911-9a5c-4f29-9da0-e19dfb827014 tempest-AttachVolumeTestJSON-813984703 tempest-AttachVolumeTestJSON-813984703-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74613) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 18:18:47 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:18:47 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:18:47 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a35ce0e-f0e0-406e-a5fc-06a0baef703d]: (4, ('tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:113c5dd9-52e5-46ba-8f15-faf70db70464 (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d74e565-9547-4f44-8005-0615d625a275 (non-flash)\ntcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f9a0824-5da8-4aaa-bc2e-56c2f8688051 (non-flash)\n', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 18:18:47 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-ccf62911-9a5c-4f29-9da0-e19dfb827014 tempest-AttachVolumeTestJSON-813984703 tempest-AttachVolumeTestJSON-813984703-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:113c5dd9-52e5-46ba-8f15-faf70db70464 (non-flash)
Nov 29 18:18:47 user nova-compute[74613]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d74e565-9547-4f44-8005-0615d625a275 (non-flash)
Nov 29 18:18:47 user nova-compute[74613]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f9a0824-5da8-4aaa-bc2e-56c2f8688051 (non-flash)
Nov 29 18:18:47 user nova-compute[74613]:  stderr= {{(pid=74613) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 18:18:47 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-ccf62911-9a5c-4f29-9da0-e19dfb827014 tempest-AttachVolumeTestJSON-813984703 tempest-AttachVolumeTestJSON-813984703-project-member] iscsi session list stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:113c5dd9-52e5-46ba-8f15-faf70db70464 (non-flash)
Nov 29 18:18:47 user nova-compute[74613]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d74e565-9547-4f44-8005-0615d625a275 (non-flash)
Nov 29 18:18:47 user nova-compute[74613]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f9a0824-5da8-4aaa-bc2e-56c2f8688051 (non-flash)
Nov 29 18:18:47 user nova-compute[74613]:  stderr= {{(pid=74613) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 18:18:47 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:15659ea3-d18c-4cae-ba54-13c3fdcacd03 -p 172.16.0.220:3260 --login {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:18:47 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:15659ea3-d18c-4cae-ba54-13c3fdcacd03 -p 172.16.0.220:3260 --login" returned: 0 in 0.070s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:18:47 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd18463f-b51a-43e4-af2a-57c6733e07d7]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:15659ea3-d18c-4cae-ba54-13c3fdcacd03, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:15659ea3-d18c-4cae-ba54-13c3fdcacd03, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 18:18:47 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-ccf62911-9a5c-4f29-9da0-e19dfb827014 tempest-AttachVolumeTestJSON-813984703 tempest-AttachVolumeTestJSON-813984703-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:15659ea3-d18c-4cae-ba54-13c3fdcacd03, portal: 172.16.0.220,3260]
Nov 29 18:18:47 user nova-compute[74613]: Login to [iface: default, target: iqn.2010-10.org.openstack:15659ea3-d18c-4cae-ba54-13c3fdcacd03, portal: 172.16.0.220,3260] successful.
Nov 29 18:18:47 user nova-compute[74613]:  stderr= {{(pid=74613) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 18:18:47 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:15659ea3-d18c-4cae-ba54-13c3fdcacd03 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:18:47 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:15659ea3-d18c-4cae-ba54-13c3fdcacd03 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.029s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:18:47 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[403dc4ae-2abc-4818-95c8-79ab4fe301ab]: (4, ('', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 18:18:47 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-ccf62911-9a5c-4f29-9da0-e19dfb827014 tempest-AttachVolumeTestJSON-813984703 tempest-AttachVolumeTestJSON-813984703-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74613) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 18:18:47 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:18:47 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:18:47 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1856319-abee-45e9-bda5-c41859b98ef4]: (4, ('tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:113c5dd9-52e5-46ba-8f15-faf70db70464 (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d74e565-9547-4f44-8005-0615d625a275 (non-flash)\ntcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f9a0824-5da8-4aaa-bc2e-56c2f8688051 (non-flash)\ntcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15659ea3-d18c-4cae-ba54-13c3fdcacd03 (non-flash)\n', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 18:18:47 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-ccf62911-9a5c-4f29-9da0-e19dfb827014 tempest-AttachVolumeTestJSON-813984703 tempest-AttachVolumeTestJSON-813984703-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:113c5dd9-52e5-46ba-8f15-faf70db70464 (non-flash)
Nov 29 18:18:47 user nova-compute[74613]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d74e565-9547-4f44-8005-0615d625a275 (non-flash)
Nov 29 18:18:47 user nova-compute[74613]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f9a0824-5da8-4aaa-bc2e-56c2f8688051 (non-flash)
Nov 29 18:18:47 user nova-compute[74613]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15659ea3-d18c-4cae-ba54-13c3fdcacd03 (non-flash)
Nov 29 18:18:47 user nova-compute[74613]:  stderr= {{(pid=74613) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 18:18:47 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-ccf62911-9a5c-4f29-9da0-e19dfb827014 tempest-AttachVolumeTestJSON-813984703 tempest-AttachVolumeTestJSON-813984703-project-member] iscsi session list stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:113c5dd9-52e5-46ba-8f15-faf70db70464 (non-flash)
Nov 29 18:18:47 user nova-compute[74613]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d74e565-9547-4f44-8005-0615d625a275 (non-flash)
Nov 29 18:18:47 user nova-compute[74613]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f9a0824-5da8-4aaa-bc2e-56c2f8688051 (non-flash)
Nov 29 18:18:47 user nova-compute[74613]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15659ea3-d18c-4cae-ba54-13c3fdcacd03 (non-flash)
Nov 29 18:18:47 user nova-compute[74613]:  stderr= {{(pid=74613) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 18:18:47 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.base [None req-ccf62911-9a5c-4f29-9da0-e19dfb827014 tempest-AttachVolumeTestJSON-813984703 tempest-AttachVolumeTestJSON-813984703-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:15659ea3-d18c-4cae-ba54-13c3fdcacd03" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.323s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 18:18:47 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-ccf62911-9a5c-4f29-9da0-e19dfb827014 tempest-AttachVolumeTestJSON-813984703 tempest-AttachVolumeTestJSON-813984703-project-member] Connected to 172.16.0.220:3260 {{(pid=74613) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 29 18:18:47 user nova-compute[74613]: DEBUG os_brick.initiator.linuxscsi [None req-ccf62911-9a5c-4f29-9da0-e19dfb827014 tempest-AttachVolumeTestJSON-813984703 tempest-AttachVolumeTestJSON-813984703-project-member] HCTL ('35', '-', '-', 0) found on session 48 with lun 0 {{(pid=74613) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 29 18:18:47 user nova-compute[74613]: DEBUG os_brick.initiator.linuxscsi [None req-ccf62911-9a5c-4f29-9da0-e19dfb827014 tempest-AttachVolumeTestJSON-813984703 tempest-AttachVolumeTestJSON-813984703-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=74613) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 29 18:18:47 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:18:47 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.017s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:18:47 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[2516c86e-7b14-466b-9fc3-148cab3b74d9]: (4, ('- - 0', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 18:18:47 user nova-compute[74613]: DEBUG os_brick.initiator.linuxscsi [None req-ccf62911-9a5c-4f29-9da0-e19dfb827014 tempest-AttachVolumeTestJSON-813984703 tempest-AttachVolumeTestJSON-813984703-project-member] Searching for a device in session 48 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=74613) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 29 18:18:47 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-ccf62911-9a5c-4f29-9da0-e19dfb827014 tempest-AttachVolumeTestJSON-813984703 tempest-AttachVolumeTestJSON-813984703-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:15659ea3-d18c-4cae-ba54-13c3fdcacd03', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wqvklJUE', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74613) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 29 18:18:47 user nova-compute[74613]: DEBUG nova.network.neutron [None req-0d9da0ba-18f6-490b-8790-c28028b7a3ad tempest-TestVolumeBootPattern-1318569205 tempest-TestVolumeBootPattern-1318569205-project-member] [instance: d4385666-cff6-4133-9833-5447218c8857] Successfully updated port: a3798396-6b34-4ed7-b750-6a741a148340 {{(pid=74613) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 29 18:18:47 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-0d9da0ba-18f6-490b-8790-c28028b7a3ad tempest-TestVolumeBootPattern-1318569205 tempest-TestVolumeBootPattern-1318569205-project-member] Acquiring lock "refresh_cache-d4385666-cff6-4133-9833-5447218c8857" {{(pid=74613) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 18:18:47 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-0d9da0ba-18f6-490b-8790-c28028b7a3ad tempest-TestVolumeBootPattern-1318569205 tempest-TestVolumeBootPattern-1318569205-project-member] Acquired lock "refresh_cache-d4385666-cff6-4133-9833-5447218c8857" {{(pid=74613) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 18:18:47 user nova-compute[74613]: DEBUG nova.network.neutron [None req-0d9da0ba-18f6-490b-8790-c28028b7a3ad tempest-TestVolumeBootPattern-1318569205 tempest-TestVolumeBootPattern-1318569205-project-member] [instance: d4385666-cff6-4133-9833-5447218c8857] Building network info cache for instance {{(pid=74613) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 29 18:18:47 user nova-compute[74613]: DEBUG nova.compute.manager [req-d34f6c63-a1f2-497f-b3b4-90c5a3953824 req-d5568151-bc6f-4cc8-ae32-31a34811fbe1 service nova] [instance: d4385666-cff6-4133-9833-5447218c8857] Received event network-changed-a3798396-6b34-4ed7-b750-6a741a148340 {{(pid=74613) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 18:18:47 user nova-compute[74613]: DEBUG nova.compute.manager [req-d34f6c63-a1f2-497f-b3b4-90c5a3953824 req-d5568151-bc6f-4cc8-ae32-31a34811fbe1 service nova] [instance: d4385666-cff6-4133-9833-5447218c8857] Refreshing instance network info cache due to event network-changed-a3798396-6b34-4ed7-b750-6a741a148340. {{(pid=74613) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 18:18:47 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-d34f6c63-a1f2-497f-b3b4-90c5a3953824 req-d5568151-bc6f-4cc8-ae32-31a34811fbe1 service nova] Acquiring lock "refresh_cache-d4385666-cff6-4133-9833-5447218c8857" {{(pid=74613) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 18:18:47 user nova-compute[74613]: DEBUG nova.network.neutron [None req-0d9da0ba-18f6-490b-8790-c28028b7a3ad tempest-TestVolumeBootPattern-1318569205 tempest-TestVolumeBootPattern-1318569205-project-member] [instance: d4385666-cff6-4133-9833-5447218c8857] Instance cache missing network info. {{(pid=74613) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 29 18:18:48 user nova-compute[74613]: DEBUG nova.network.neutron [None req-0d9da0ba-18f6-490b-8790-c28028b7a3ad tempest-TestVolumeBootPattern-1318569205 tempest-TestVolumeBootPattern-1318569205-project-member] [instance: d4385666-cff6-4133-9833-5447218c8857] Updating instance_info_cache with network_info: [{"id": "a3798396-6b34-4ed7-b750-6a741a148340", "address": "fa:16:3e:4c:8d:a6", "network": {"id": "4a5179dd-d0b1-44c3-80c1-08dd7b0152f1", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1296336996-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "67390f1402214191904cfbd68c3142a7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa3798396-6b", "ovs_interfaceid": "a3798396-6b34-4ed7-b750-6a741a148340", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74613) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 18:18:48 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-0d9da0ba-18f6-490b-8790-c28028b7a3ad tempest-TestVolumeBootPattern-1318569205 tempest-TestVolumeBootPattern-1318569205-project-member] Releasing lock "refresh_cache-d4385666-cff6-4133-9833-5447218c8857" {{(pid=74613) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 18:18:48 user nova-compute[74613]: DEBUG nova.compute.manager [None req-0d9da0ba-18f6-490b-8790-c28028b7a3ad tempest-TestVolumeBootPattern-1318569205 tempest-TestVolumeBootPattern-1318569205-project-member] [instance: d4385666-cff6-4133-9833-5447218c8857] Instance network_info: |[{"id": "a3798396-6b34-4ed7-b750-6a741a148340", "address": "fa:16:3e:4c:8d:a6", "network": {"id": "4a5179dd-d0b1-44c3-80c1-08dd7b0152f1", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1296336996-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "67390f1402214191904cfbd68c3142a7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa3798396-6b", "ovs_interfaceid": "a3798396-6b34-4ed7-b750-6a741a148340", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74613) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 29 18:18:48 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-d34f6c63-a1f2-497f-b3b4-90c5a3953824 req-d5568151-bc6f-4cc8-ae32-31a34811fbe1 service nova] Acquired lock "refresh_cache-d4385666-cff6-4133-9833-5447218c8857" {{(pid=74613) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 18:18:48 user nova-compute[74613]: DEBUG nova.network.neutron [req-d34f6c63-a1f2-497f-b3b4-90c5a3953824 req-d5568151-bc6f-4cc8-ae32-31a34811fbe1 service nova] [instance: d4385666-cff6-4133-9833-5447218c8857] Refreshing network info cache for port a3798396-6b34-4ed7-b750-6a741a148340 {{(pid=74613) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 18:18:48 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.base [None req-ccf62911-9a5c-4f29-9da0-e19dfb827014 tempest-AttachVolumeTestJSON-813984703 tempest-AttachVolumeTestJSON-813984703-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.354s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 18:18:48 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-ccf62911-9a5c-4f29-9da0-e19dfb827014 tempest-AttachVolumeTestJSON-813984703 tempest-AttachVolumeTestJSON-813984703-project-member] <== connect_volume: return (1357ms) {'type': 'block', 'scsi_wwn': '23836326536623366', 'path': '/dev/sdd'} {{(pid=74613) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 18:18:48 user nova-compute[74613]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ccf62911-9a5c-4f29-9da0-e19dfb827014 tempest-AttachVolumeTestJSON-813984703 tempest-AttachVolumeTestJSON-813984703-project-member] [instance: b2c3eb4f-df1f-46d0-acb5-3ac9f16f9a82] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23836326536623366', 'path': '/dev/sdd'} {{(pid=74613) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 29 18:18:48 user nova-compute[74613]: DEBUG nova.objects.instance [None req-ccf62911-9a5c-4f29-9da0-e19dfb827014 tempest-AttachVolumeTestJSON-813984703 tempest-AttachVolumeTestJSON-813984703-project-member] Lazy-loading 'flavor' on Instance uuid b2c3eb4f-df1f-46d0-acb5-3ac9f16f9a82 {{(pid=74613) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 18:18:48 user nova-compute[74613]: DEBUG nova.virt.libvirt.guest [None req-ccf62911-9a5c-4f29-9da0-e19dfb827014 tempest-AttachVolumeTestJSON-813984703 tempest-AttachVolumeTestJSON-813984703-project-member] attach device xml: <disk type="block" device="disk">
Nov 29 18:18:48 user nova-compute[74613]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 18:18:48 user nova-compute[74613]:   <source dev="/dev/sdd"/>
Nov 29 18:18:48 user nova-compute[74613]:   <target dev="vdc" bus="virtio"/>
Nov 29 18:18:48 user nova-compute[74613]:   <serial>15659ea3-d18c-4cae-ba54-13c3fdcacd03</serial>
Nov 29 18:18:48 user nova-compute[74613]: </disk>
Nov 29 18:18:48 user nova-compute[74613]:  {{(pid=74613) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 29 18:18:48 user nova-compute[74613]: DEBUG nova.network.neutron [req-d34f6c63-a1f2-497f-b3b4-90c5a3953824 req-d5568151-bc6f-4cc8-ae32-31a34811fbe1 service nova] [instance: d4385666-cff6-4133-9833-5447218c8857] Updated VIF entry in instance network info cache for port a3798396-6b34-4ed7-b750-6a741a148340. {{(pid=74613) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 18:18:48 user nova-compute[74613]: DEBUG nova.network.neutron [req-d34f6c63-a1f2-497f-b3b4-90c5a3953824 req-d5568151-bc6f-4cc8-ae32-31a34811fbe1 service nova] [instance: d4385666-cff6-4133-9833-5447218c8857] Updating instance_info_cache with network_info: [{"id": "a3798396-6b34-4ed7-b750-6a741a148340", "address": "fa:16:3e:4c:8d:a6", "network": {"id": "4a5179dd-d0b1-44c3-80c1-08dd7b0152f1", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1296336996-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "67390f1402214191904cfbd68c3142a7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa3798396-6b", "ovs_interfaceid": "a3798396-6b34-4ed7-b750-6a741a148340", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74613) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 18:18:48 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-d34f6c63-a1f2-497f-b3b4-90c5a3953824 req-d5568151-bc6f-4cc8-ae32-31a34811fbe1 service nova] Releasing lock "refresh_cache-d4385666-cff6-4133-9833-5447218c8857" {{(pid=74613) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 18:18:49 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-ccf62911-9a5c-4f29-9da0-e19dfb827014 tempest-AttachVolumeTestJSON-813984703 tempest-AttachVolumeTestJSON-813984703-project-member] No BDM found with device name vda, not building metadata. {{(pid=74613) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 18:18:49 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-ccf62911-9a5c-4f29-9da0-e19dfb827014 tempest-AttachVolumeTestJSON-813984703 tempest-AttachVolumeTestJSON-813984703-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74613) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 18:18:49 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-ccf62911-9a5c-4f29-9da0-e19dfb827014 tempest-AttachVolumeTestJSON-813984703 tempest-AttachVolumeTestJSON-813984703-project-member] No BDM found with device name vdc, not building metadata. {{(pid=74613) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 18:18:49 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-ccf62911-9a5c-4f29-9da0-e19dfb827014 tempest-AttachVolumeTestJSON-813984703 tempest-AttachVolumeTestJSON-813984703-project-member] No VIF found with MAC fa:16:3e:4d:ba:5c, not building metadata {{(pid=74613) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 29 18:18:49 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-ccf62911-9a5c-4f29-9da0-e19dfb827014 tempest-AttachVolumeTestJSON-813984703 tempest-AttachVolumeTestJSON-813984703-project-member] Lock "b2c3eb4f-df1f-46d0-acb5-3ac9f16f9a82" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 10.705s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 18:18:49 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-d218b210-0dea-428e-9f7d-9a4db037c2b1 tempest-AttachVolumeTestJSON-813984703 tempest-AttachVolumeTestJSON-813984703-project-member] Acquiring lock "b2c3eb4f-df1f-46d0-acb5-3ac9f16f9a82" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 18:18:49 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-d218b210-0dea-428e-9f7d-9a4db037c2b1 tempest-AttachVolumeTestJSON-813984703 tempest-AttachVolumeTestJSON-813984703-project-member] Lock "b2c3eb4f-df1f-46d0-acb5-3ac9f16f9a82" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 18:18:49 user nova-compute[74613]: INFO nova.compute.manager [None req-d218b210-0dea-428e-9f7d-9a4db037c2b1 tempest-AttachVolumeTestJSON-813984703 tempest-AttachVolumeTestJSON-813984703-project-member] [instance: b2c3eb4f-df1f-46d0-acb5-3ac9f16f9a82] Detaching volume 9f9a0824-5da8-4aaa-bc2e-56c2f8688051
Nov 29 18:18:49 user nova-compute[74613]: INFO nova.virt.block_device [None req-d218b210-0dea-428e-9f7d-9a4db037c2b1 tempest-AttachVolumeTestJSON-813984703 tempest-AttachVolumeTestJSON-813984703-project-member] [instance: b2c3eb4f-df1f-46d0-acb5-3ac9f16f9a82] Attempting to driver detach volume 9f9a0824-5da8-4aaa-bc2e-56c2f8688051 from mountpoint /dev/vdb
Nov 29 18:18:49 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-d218b210-0dea-428e-9f7d-9a4db037c2b1 tempest-AttachVolumeTestJSON-813984703 tempest-AttachVolumeTestJSON-813984703-project-member] Attempting to detach device vdb from instance b2c3eb4f-df1f-46d0-acb5-3ac9f16f9a82 from the persistent domain config. {{(pid=74613) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 29 18:18:49 user nova-compute[74613]: DEBUG nova.virt.libvirt.guest [None req-d218b210-0dea-428e-9f7d-9a4db037c2b1 tempest-AttachVolumeTestJSON-813984703 tempest-AttachVolumeTestJSON-813984703-project-member] detach device xml: <disk type="block" device="disk">
Nov 29 18:18:49 user nova-compute[74613]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 18:18:49 user nova-compute[74613]:   <source dev="/dev/sde"/>
Nov 29 18:18:49 user nova-compute[74613]:   <target dev="vdb" bus="virtio"/>
Nov 29 18:18:49 user nova-compute[74613]:   <serial>9f9a0824-5da8-4aaa-bc2e-56c2f8688051</serial>
Nov 29 18:18:49 user nova-compute[74613]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 29 18:18:49 user nova-compute[74613]: </disk>
Nov 29 18:18:49 user nova-compute[74613]:  {{(pid=74613) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 29 18:18:49 user nova-compute[74613]: INFO nova.virt.libvirt.driver [None req-d218b210-0dea-428e-9f7d-9a4db037c2b1 tempest-AttachVolumeTestJSON-813984703 tempest-AttachVolumeTestJSON-813984703-project-member] Successfully detached device vdb from instance b2c3eb4f-df1f-46d0-acb5-3ac9f16f9a82 from the persistent domain config.
Nov 29 18:18:49 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-d218b210-0dea-428e-9f7d-9a4db037c2b1 tempest-AttachVolumeTestJSON-813984703 tempest-AttachVolumeTestJSON-813984703-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance b2c3eb4f-df1f-46d0-acb5-3ac9f16f9a82 from the live domain config. {{(pid=74613) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 29 18:18:49 user nova-compute[74613]: DEBUG nova.virt.libvirt.guest [None req-d218b210-0dea-428e-9f7d-9a4db037c2b1 tempest-AttachVolumeTestJSON-813984703 tempest-AttachVolumeTestJSON-813984703-project-member] detach device xml: <disk type="block" device="disk">
Nov 29 18:18:49 user nova-compute[74613]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 18:18:49 user nova-compute[74613]:   <source dev="/dev/sde"/>
Nov 29 18:18:49 user nova-compute[74613]:   <target dev="vdb" bus="virtio"/>
Nov 29 18:18:49 user nova-compute[74613]:   <serial>9f9a0824-5da8-4aaa-bc2e-56c2f8688051</serial>
Nov 29 18:18:49 user nova-compute[74613]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 29 18:18:49 user nova-compute[74613]: </disk>
Nov 29 18:18:49 user nova-compute[74613]:  {{(pid=74613) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 29 18:18:50 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-d218b210-0dea-428e-9f7d-9a4db037c2b1 tempest-AttachVolumeTestJSON-813984703 tempest-AttachVolumeTestJSON-813984703-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance b2c3eb4f-df1f-46d0-acb5-3ac9f16f9a82 {{(pid=74613) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 29 18:18:50 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:18:51 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:18:52 user nova-compute[74613]: DEBUG os_brick.utils [None req-0d9da0ba-18f6-490b-8790-c28028b7a3ad tempest-TestVolumeBootPattern-1318569205 tempest-TestVolumeBootPattern-1318569205-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74613) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 18:18:52 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:18:52 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:18:52 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a7e8813-7dd9-49a8-9439-f880b1041e47]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:400972819b5\n', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 18:18:52 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:18:52 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:18:52 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[984ab01e-ae9f-4c3a-92de-47f5cc8852e2]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 18:18:52 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:18:52 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.014s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:18:52 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[af980e33-5a3e-4f02-8ec9-b3f6bd59f4e2]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 18:18:52 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d8ebb5d-ed96-4e71-bffc-696ff2bd74e2]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 18:18:52 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-0d9da0ba-18f6-490b-8790-c28028b7a3ad tempest-TestVolumeBootPattern-1318569205 tempest-TestVolumeBootPattern-1318569205-project-member] Running cmd (subprocess): nvme version {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:18:52 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-0d9da0ba-18f6-490b-8790-c28028b7a3ad tempest-TestVolumeBootPattern-1318569205 tempest-TestVolumeBootPattern-1318569205-project-member] 'nvme version' failed. Not Retrying. {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 18:18:52 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.nvmeof [None req-0d9da0ba-18f6-490b-8790-c28028b7a3ad tempest-TestVolumeBootPattern-1318569205 tempest-TestVolumeBootPattern-1318569205-project-member] nvme not present on system {{(pid=74613) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 29 18:18:52 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:18:52 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 18:18:52 user nova-compute[74613]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 29 18:18:52 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[f43912df-6383-4af7-b591-3da425cd9d77]: (4, '') {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 18:18:52 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.lightos [None req-0d9da0ba-18f6-490b-8790-c28028b7a3ad tempest-TestVolumeBootPattern-1318569205 tempest-TestVolumeBootPattern-1318569205-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74613) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 29 18:18:52 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.lightos [None req-0d9da0ba-18f6-490b-8790-c28028b7a3ad tempest-TestVolumeBootPattern-1318569205 tempest-TestVolumeBootPattern-1318569205-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74613) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 29 18:18:52 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.lightos [None req-0d9da0ba-18f6-490b-8790-c28028b7a3ad tempest-TestVolumeBootPattern-1318569205 tempest-TestVolumeBootPattern-1318569205-project-member] LIGHTOS: no hostnqn found. {{(pid=74613) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 29 18:18:52 user nova-compute[74613]: DEBUG os_brick.utils [None req-0d9da0ba-18f6-490b-8790-c28028b7a3ad tempest-TestVolumeBootPattern-1318569205 tempest-TestVolumeBootPattern-1318569205-project-member] <== get_connector_properties: return (114ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:400972819b5', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74613) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 18:18:52 user nova-compute[74613]: DEBUG nova.virt.block_device [None req-0d9da0ba-18f6-490b-8790-c28028b7a3ad tempest-TestVolumeBootPattern-1318569205 tempest-TestVolumeBootPattern-1318569205-project-member] [instance: d4385666-cff6-4133-9833-5447218c8857] Updating existing volume attachment record: 0e351c6a-9771-40c9-98b8-1cf5bca70805 {{(pid=74613) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 29 18:18:52 user nova-compute[74613]: DEBUG oslo_service.periodic_task [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Running periodic task ComputeManager._sync_power_states {{(pid=74613) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 18:18:52 user nova-compute[74613]: WARNING nova.compute.manager [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] While synchronizing instance power states, found 7 instances in the database and 6 instances on the hypervisor.
Nov 29 18:18:52 user nova-compute[74613]: DEBUG nova.compute.manager [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Triggering sync for uuid 6993e2e7-7e03-45b4-9d3d-3742589b6078 {{(pid=74613) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 29 18:18:52 user nova-compute[74613]: DEBUG nova.compute.manager [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Triggering sync for uuid 6f4a1329-b3b9-4d1c-8735-abddabc359fd {{(pid=74613) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 29 18:18:52 user nova-compute[74613]: DEBUG nova.compute.manager [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Triggering sync for uuid 1f2b4426-815f-4ef4-b98e-e5124fec93b7 {{(pid=74613) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 29 18:18:52 user nova-compute[74613]: DEBUG nova.compute.manager [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Triggering sync for uuid d9f10bfb-5202-4b4a-a42d-f167501f597b {{(pid=74613) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 29 18:18:52 user nova-compute[74613]: DEBUG nova.compute.manager [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Triggering sync for uuid b2c3eb4f-df1f-46d0-acb5-3ac9f16f9a82 {{(pid=74613) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 29 18:18:52 user nova-compute[74613]: DEBUG nova.compute.manager [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Triggering sync for uuid 3a2ac289-fc34-4c7b-a689-b499e2562578 {{(pid=74613) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 29 18:18:52 user nova-compute[74613]: DEBUG nova.compute.manager [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Triggering sync for uuid d4385666-cff6-4133-9833-5447218c8857 {{(pid=74613) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 29 18:18:52 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Acquiring lock "6993e2e7-7e03-45b4-9d3d-3742589b6078" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 18:18:52 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Lock "6993e2e7-7e03-45b4-9d3d-3742589b6078" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 18:18:52 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Acquiring lock "6f4a1329-b3b9-4d1c-8735-abddabc359fd" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 18:18:52 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Lock "6f4a1329-b3b9-4d1c-8735-abddabc359fd" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 18:18:52 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Acquiring lock "1f2b4426-815f-4ef4-b98e-e5124fec93b7" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 18:18:52 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Acquiring lock "d9f10bfb-5202-4b4a-a42d-f167501f597b" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 18:18:52 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Lock "d9f10bfb-5202-4b4a-a42d-f167501f597b" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 18:18:52 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Acquiring lock "b2c3eb4f-df1f-46d0-acb5-3ac9f16f9a82" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 18:18:52 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Acquiring lock "3a2ac289-fc34-4c7b-a689-b499e2562578" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 18:18:52 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Lock "3a2ac289-fc34-4c7b-a689-b499e2562578" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 18:18:52 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Acquiring lock "d4385666-cff6-4133-9833-5447218c8857" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 18:18:52 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Lock "6f4a1329-b3b9-4d1c-8735-abddabc359fd" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.035s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 18:18:52 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Lock "6993e2e7-7e03-45b4-9d3d-3742589b6078" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.037s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 18:18:52 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Lock "3a2ac289-fc34-4c7b-a689-b499e2562578" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.035s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 18:18:52 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Lock "d9f10bfb-5202-4b4a-a42d-f167501f597b" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.042s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 18:18:55 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:18:56 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:19:00 user nova-compute[74613]: DEBUG nova.compute.manager [None req-0d9da0ba-18f6-490b-8790-c28028b7a3ad tempest-TestVolumeBootPattern-1318569205 tempest-TestVolumeBootPattern-1318569205-project-member] [instance: d4385666-cff6-4133-9833-5447218c8857] Start spawning the instance on the hypervisor. {{(pid=74613) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 29 18:19:00 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-0d9da0ba-18f6-490b-8790-c28028b7a3ad tempest-TestVolumeBootPattern-1318569205 tempest-TestVolumeBootPattern-1318569205-project-member] [instance: d4385666-cff6-4133-9833-5447218c8857] Creating instance directory {{(pid=74613) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 29 18:19:00 user nova-compute[74613]: INFO nova.virt.libvirt.driver [None req-0d9da0ba-18f6-490b-8790-c28028b7a3ad tempest-TestVolumeBootPattern-1318569205 tempest-TestVolumeBootPattern-1318569205-project-member] [instance: d4385666-cff6-4133-9833-5447218c8857] Creating image(s)
Nov 29 18:19:00 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-0d9da0ba-18f6-490b-8790-c28028b7a3ad tempest-TestVolumeBootPattern-1318569205 tempest-TestVolumeBootPattern-1318569205-project-member] [instance: d4385666-cff6-4133-9833-5447218c8857] Did not create local disks {{(pid=74613) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 29 18:19:00 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-0d9da0ba-18f6-490b-8790-c28028b7a3ad tempest-TestVolumeBootPattern-1318569205 tempest-TestVolumeBootPattern-1318569205-project-member] [instance: d4385666-cff6-4133-9833-5447218c8857] Ensure instance console log exists: /opt/stack/data/nova/instances/d4385666-cff6-4133-9833-5447218c8857/console.log {{(pid=74613) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 29 18:19:00 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-0d9da0ba-18f6-490b-8790-c28028b7a3ad tempest-TestVolumeBootPattern-1318569205 tempest-TestVolumeBootPattern-1318569205-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 18:19:00 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-0d9da0ba-18f6-490b-8790-c28028b7a3ad tempest-TestVolumeBootPattern-1318569205 tempest-TestVolumeBootPattern-1318569205-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 18:19:00 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-0d9da0ba-18f6-490b-8790-c28028b7a3ad tempest-TestVolumeBootPattern-1318569205 tempest-TestVolumeBootPattern-1318569205-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 18:19:00 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-0d9da0ba-18f6-490b-8790-c28028b7a3ad tempest-TestVolumeBootPattern-1318569205 tempest-TestVolumeBootPattern-1318569205-project-member] [instance: d4385666-cff6-4133-9833-5447218c8857] Start _get_guest_xml network_info=[{"id": "a3798396-6b34-4ed7-b750-6a741a148340", "address": "fa:16:3e:4c:8d:a6", "network": {"id": "4a5179dd-d0b1-44c3-80c1-08dd7b0152f1", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1296336996-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "67390f1402214191904cfbd68c3142a7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa3798396-6b", "ovs_interfaceid": "a3798396-6b34-4ed7-b750-6a741a148340", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='d41d8cd98f00b204e9800998ecf8427e',container_format='bare',created_at=2023-11-29T18:18:39Z,direct_url=<?>,disk_format='qcow2',id=a5bf22a6-bce2-4861-99b9-c57bf2cf9595,min_disk=1,min_ram=0,name='tempest-TestVolumeBootPatternsnapshot-1311145545',owner='67390f1402214191904cfbd68c3142a7',properties=ImageMetaProps,protected=<?>,size=0,status='active',tags=<?>,updated_at=2023-11-29T18:18:41Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:b4661fe9-8f60-4595-bc5b-6671702802af', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'oWCtefpz', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'd4385666-cff6-4133-9833-5447218c8857', 'attached_at': '', 'detached_at': '', 'volume_id': 'b4661fe9-8f60-4595-bc5b-6671702802af', 'serial': 'b4661fe9-8f60-4595-bc5b-6671702802af'}, 'mount_device': '/dev/vda', 'delete_on_termination': True, 'device_type': 'disk', 'boot_index': 0, 'guest_format': None, 'attachment_id': '0e351c6a-9771-40c9-98b8-1cf5bca70805', 'disk_bus': 'virtio', 'volume_type': None} {{(pid=74613) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 29 18:19:00 user nova-compute[74613]: WARNING nova.virt.libvirt.driver [None req-0d9da0ba-18f6-490b-8790-c28028b7a3ad tempest-TestVolumeBootPattern-1318569205 tempest-TestVolumeBootPattern-1318569205-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 18:19:00 user nova-compute[74613]: WARNING nova.virt.libvirt.driver [None req-0d9da0ba-18f6-490b-8790-c28028b7a3ad tempest-TestVolumeBootPattern-1318569205 tempest-TestVolumeBootPattern-1318569205-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 18:19:00 user nova-compute[74613]: DEBUG nova.virt.libvirt.host [None req-0d9da0ba-18f6-490b-8790-c28028b7a3ad tempest-TestVolumeBootPattern-1318569205 tempest-TestVolumeBootPattern-1318569205-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74613) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 29 18:19:00 user nova-compute[74613]: DEBUG nova.virt.libvirt.host [None req-0d9da0ba-18f6-490b-8790-c28028b7a3ad tempest-TestVolumeBootPattern-1318569205 tempest-TestVolumeBootPattern-1318569205-project-member] CPU controller missing on host. {{(pid=74613) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 29 18:19:00 user nova-compute[74613]: DEBUG nova.virt.libvirt.host [None req-0d9da0ba-18f6-490b-8790-c28028b7a3ad tempest-TestVolumeBootPattern-1318569205 tempest-TestVolumeBootPattern-1318569205-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74613) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 29 18:19:00 user nova-compute[74613]: DEBUG nova.virt.libvirt.host [None req-0d9da0ba-18f6-490b-8790-c28028b7a3ad tempest-TestVolumeBootPattern-1318569205 tempest-TestVolumeBootPattern-1318569205-project-member] CPU controller found on host. {{(pid=74613) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 29 18:19:00 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-0d9da0ba-18f6-490b-8790-c28028b7a3ad tempest-TestVolumeBootPattern-1318569205 tempest-TestVolumeBootPattern-1318569205-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74613) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 29 18:19:00 user nova-compute[74613]: DEBUG nova.virt.hardware [None req-0d9da0ba-18f6-490b-8790-c28028b7a3ad tempest-TestVolumeBootPattern-1318569205 tempest-TestVolumeBootPattern-1318569205-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-29T17:47:27Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='d41d8cd98f00b204e9800998ecf8427e',container_format='bare',created_at=2023-11-29T18:18:39Z,direct_url=<?>,disk_format='qcow2',id=a5bf22a6-bce2-4861-99b9-c57bf2cf9595,min_disk=1,min_ram=0,name='tempest-TestVolumeBootPatternsnapshot-1311145545',owner='67390f1402214191904cfbd68c3142a7',properties=ImageMetaProps,protected=<?>,size=0,status='active',tags=<?>,updated_at=2023-11-29T18:18:41Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74613) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 29 18:19:00 user nova-compute[74613]: DEBUG nova.virt.hardware [None req-0d9da0ba-18f6-490b-8790-c28028b7a3ad tempest-TestVolumeBootPattern-1318569205 tempest-TestVolumeBootPattern-1318569205-project-member] Flavor limits 0:0:0 {{(pid=74613) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 29 18:19:00 user nova-compute[74613]: DEBUG nova.virt.hardware [None req-0d9da0ba-18f6-490b-8790-c28028b7a3ad tempest-TestVolumeBootPattern-1318569205 tempest-TestVolumeBootPattern-1318569205-project-member] Image limits 0:0:0 {{(pid=74613) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 29 18:19:00 user nova-compute[74613]: DEBUG nova.virt.hardware [None req-0d9da0ba-18f6-490b-8790-c28028b7a3ad tempest-TestVolumeBootPattern-1318569205 tempest-TestVolumeBootPattern-1318569205-project-member] Flavor pref 0:0:0 {{(pid=74613) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 29 18:19:00 user nova-compute[74613]: DEBUG nova.virt.hardware [None req-0d9da0ba-18f6-490b-8790-c28028b7a3ad tempest-TestVolumeBootPattern-1318569205 tempest-TestVolumeBootPattern-1318569205-project-member] Image pref 0:0:0 {{(pid=74613) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 29 18:19:00 user nova-compute[74613]: DEBUG nova.virt.hardware [None req-0d9da0ba-18f6-490b-8790-c28028b7a3ad tempest-TestVolumeBootPattern-1318569205 tempest-TestVolumeBootPattern-1318569205-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74613) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 29 18:19:00 user nova-compute[74613]: DEBUG nova.virt.hardware [None req-0d9da0ba-18f6-490b-8790-c28028b7a3ad tempest-TestVolumeBootPattern-1318569205 tempest-TestVolumeBootPattern-1318569205-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74613) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 29 18:19:00 user nova-compute[74613]: DEBUG nova.virt.hardware [None req-0d9da0ba-18f6-490b-8790-c28028b7a3ad tempest-TestVolumeBootPattern-1318569205 tempest-TestVolumeBootPattern-1318569205-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74613) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 29 18:19:00 user nova-compute[74613]: DEBUG nova.virt.hardware [None req-0d9da0ba-18f6-490b-8790-c28028b7a3ad tempest-TestVolumeBootPattern-1318569205 tempest-TestVolumeBootPattern-1318569205-project-member] Got 1 possible topologies {{(pid=74613) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 29 18:19:00 user nova-compute[74613]: DEBUG nova.virt.hardware [None req-0d9da0ba-18f6-490b-8790-c28028b7a3ad tempest-TestVolumeBootPattern-1318569205 tempest-TestVolumeBootPattern-1318569205-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74613) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 29 18:19:00 user nova-compute[74613]: DEBUG nova.virt.hardware [None req-0d9da0ba-18f6-490b-8790-c28028b7a3ad tempest-TestVolumeBootPattern-1318569205 tempest-TestVolumeBootPattern-1318569205-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74613) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 29 18:19:00 user nova-compute[74613]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0d9da0ba-18f6-490b-8790-c28028b7a3ad tempest-TestVolumeBootPattern-1318569205 tempest-TestVolumeBootPattern-1318569205-project-member] [instance: d4385666-cff6-4133-9833-5447218c8857] Calling os-brick to attach iSCSI Volume {{(pid=74613) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 29 18:19:00 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d9da0ba-18f6-490b-8790-c28028b7a3ad tempest-TestVolumeBootPattern-1318569205 tempest-TestVolumeBootPattern-1318569205-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff828156890>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:b4661fe9-8f60-4595-bc5b-6671702802af', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'oWCtefpz', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74613) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 18:19:00 user nova-compute[74613]: WARNING os_brick.initiator.connectors.base [None req-0d9da0ba-18f6-490b-8790-c28028b7a3ad tempest-TestVolumeBootPattern-1318569205 tempest-TestVolumeBootPattern-1318569205-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 18:19:00 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.base [None req-0d9da0ba-18f6-490b-8790-c28028b7a3ad tempest-TestVolumeBootPattern-1318569205 tempest-TestVolumeBootPattern-1318569205-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 18:19:00 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.base [None req-0d9da0ba-18f6-490b-8790-c28028b7a3ad tempest-TestVolumeBootPattern-1318569205 tempest-TestVolumeBootPattern-1318569205-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 18:19:00 user nova-compute[74613]: WARNING os_brick.initiator.connectors.base [None req-0d9da0ba-18f6-490b-8790-c28028b7a3ad tempest-TestVolumeBootPattern-1318569205 tempest-TestVolumeBootPattern-1318569205-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 18:19:00 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.base [None req-0d9da0ba-18f6-490b-8790-c28028b7a3ad tempest-TestVolumeBootPattern-1318569205 tempest-TestVolumeBootPattern-1318569205-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b4661fe9-8f60-4595-bc5b-6671702802af" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 18:19:00 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.base [None req-0d9da0ba-18f6-490b-8790-c28028b7a3ad tempest-TestVolumeBootPattern-1318569205 tempest-TestVolumeBootPattern-1318569205-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b4661fe9-8f60-4595-bc5b-6671702802af" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 18:19:00 user nova-compute[74613]: INFO os_brick.initiator.connectors.iscsi [None req-0d9da0ba-18f6-490b-8790-c28028b7a3ad tempest-TestVolumeBootPattern-1318569205 tempest-TestVolumeBootPattern-1318569205-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 29 18:19:00 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b4661fe9-8f60-4595-bc5b-6671702802af -p 172.16.0.220:3260 {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:19:00 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b4661fe9-8f60-4595-bc5b-6671702802af -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:19:00 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[d848df07-7ddd-4ab6-8ff4-347baa1912bb]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 18:19:00 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d9da0ba-18f6-490b-8790-c28028b7a3ad tempest-TestVolumeBootPattern-1318569205 tempest-TestVolumeBootPattern-1318569205-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 29 18:19:00 user nova-compute[74613]:  {{(pid=74613) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 18:19:00 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b4661fe9-8f60-4595-bc5b-6671702802af -p 172.16.0.220:3260 --interface default --op new {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:19:00 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b4661fe9-8f60-4595-bc5b-6671702802af -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:19:00 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[70f5d1a8-6c37-4b8c-8426-b860182ae1bb]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b4661fe9-8f60-4595-bc5b-6671702802af] added\n', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 18:19:00 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d9da0ba-18f6-490b-8790-c28028b7a3ad tempest-TestVolumeBootPattern-1318569205 tempest-TestVolumeBootPattern-1318569205-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b4661fe9-8f60-4595-bc5b-6671702802af] added
Nov 29 18:19:00 user nova-compute[74613]:  stderr= {{(pid=74613) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 18:19:00 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b4661fe9-8f60-4595-bc5b-6671702802af -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:19:00 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b4661fe9-8f60-4595-bc5b-6671702802af -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:19:00 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[a321fb15-6074-452a-a9fb-93f1490f1422]: (4, ('', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 18:19:00 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d9da0ba-18f6-490b-8790-c28028b7a3ad tempest-TestVolumeBootPattern-1318569205 tempest-TestVolumeBootPattern-1318569205-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74613) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 18:19:00 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b4661fe9-8f60-4595-bc5b-6671702802af -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:19:00 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b4661fe9-8f60-4595-bc5b-6671702802af -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:19:00 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[cae407c7-80de-44ad-b039-d648fa91807a]: (4, ('', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 18:19:00 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d9da0ba-18f6-490b-8790-c28028b7a3ad tempest-TestVolumeBootPattern-1318569205 tempest-TestVolumeBootPattern-1318569205-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74613) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 18:19:00 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b4661fe9-8f60-4595-bc5b-6671702802af -p 172.16.0.220:3260 --op update -n node.session.auth.username -v oWCtefpz {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:19:00 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b4661fe9-8f60-4595-bc5b-6671702802af -p 172.16.0.220:3260 --op update -n node.session.auth.username -v oWCtefpz" returned: 0 in 0.020s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:19:00 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[4aaae726-6ca9-4ddf-874a-ddfb1981371e]: (4, ('', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 18:19:00 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d9da0ba-18f6-490b-8790-c28028b7a3ad tempest-TestVolumeBootPattern-1318569205 tempest-TestVolumeBootPattern-1318569205-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'oWCtefpz'): stdout= stderr= {{(pid=74613) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 18:19:00 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b4661fe9-8f60-4595-bc5b-6671702802af -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:19:00 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b4661fe9-8f60-4595-bc5b-6671702802af -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:19:00 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ca29dae-010b-42ad-b77d-7a76ebed46cd]: (4, ('', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 18:19:00 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d9da0ba-18f6-490b-8790-c28028b7a3ad tempest-TestVolumeBootPattern-1318569205 tempest-TestVolumeBootPattern-1318569205-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74613) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 18:19:00 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:19:00 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:19:00 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[40219694-876f-40df-9593-cc0029fd3017]: (4, ('tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:113c5dd9-52e5-46ba-8f15-faf70db70464 (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d74e565-9547-4f44-8005-0615d625a275 (non-flash)\ntcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f9a0824-5da8-4aaa-bc2e-56c2f8688051 (non-flash)\ntcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15659ea3-d18c-4cae-ba54-13c3fdcacd03 (non-flash)\n', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 18:19:00 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d9da0ba-18f6-490b-8790-c28028b7a3ad tempest-TestVolumeBootPattern-1318569205 tempest-TestVolumeBootPattern-1318569205-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:113c5dd9-52e5-46ba-8f15-faf70db70464 (non-flash)
Nov 29 18:19:00 user nova-compute[74613]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d74e565-9547-4f44-8005-0615d625a275 (non-flash)
Nov 29 18:19:00 user nova-compute[74613]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f9a0824-5da8-4aaa-bc2e-56c2f8688051 (non-flash)
Nov 29 18:19:00 user nova-compute[74613]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15659ea3-d18c-4cae-ba54-13c3fdcacd03 (non-flash)
Nov 29 18:19:00 user nova-compute[74613]:  stderr= {{(pid=74613) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 18:19:00 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d9da0ba-18f6-490b-8790-c28028b7a3ad tempest-TestVolumeBootPattern-1318569205 tempest-TestVolumeBootPattern-1318569205-project-member] iscsi session list stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:113c5dd9-52e5-46ba-8f15-faf70db70464 (non-flash)
Nov 29 18:19:00 user nova-compute[74613]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d74e565-9547-4f44-8005-0615d625a275 (non-flash)
Nov 29 18:19:00 user nova-compute[74613]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f9a0824-5da8-4aaa-bc2e-56c2f8688051 (non-flash)
Nov 29 18:19:00 user nova-compute[74613]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15659ea3-d18c-4cae-ba54-13c3fdcacd03 (non-flash)
Nov 29 18:19:00 user nova-compute[74613]:  stderr= {{(pid=74613) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 18:19:00 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b4661fe9-8f60-4595-bc5b-6671702802af -p 172.16.0.220:3260 --login {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:19:00 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b4661fe9-8f60-4595-bc5b-6671702802af -p 172.16.0.220:3260 --login" returned: 0 in 0.063s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:19:00 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[9fd97404-04ca-4fd6-bf38-0e7c8c5e0169]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:b4661fe9-8f60-4595-bc5b-6671702802af, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:b4661fe9-8f60-4595-bc5b-6671702802af, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 18:19:00 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d9da0ba-18f6-490b-8790-c28028b7a3ad tempest-TestVolumeBootPattern-1318569205 tempest-TestVolumeBootPattern-1318569205-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:b4661fe9-8f60-4595-bc5b-6671702802af, portal: 172.16.0.220,3260]
Nov 29 18:19:00 user nova-compute[74613]: Login to [iface: default, target: iqn.2010-10.org.openstack:b4661fe9-8f60-4595-bc5b-6671702802af, portal: 172.16.0.220,3260] successful.
Nov 29 18:19:00 user nova-compute[74613]:  stderr= {{(pid=74613) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 18:19:00 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b4661fe9-8f60-4595-bc5b-6671702802af -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:19:00 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b4661fe9-8f60-4595-bc5b-6671702802af -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.027s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:19:00 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[ddc22dc7-7e84-4bee-9cd8-4785cc192fe2]: (4, ('', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 18:19:00 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d9da0ba-18f6-490b-8790-c28028b7a3ad tempest-TestVolumeBootPattern-1318569205 tempest-TestVolumeBootPattern-1318569205-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74613) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 18:19:00 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:19:00 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.032s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:19:00 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[66634c05-a96e-4a23-9a71-5d19b60ddff3]: (4, ('tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:113c5dd9-52e5-46ba-8f15-faf70db70464 (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d74e565-9547-4f44-8005-0615d625a275 (non-flash)\ntcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f9a0824-5da8-4aaa-bc2e-56c2f8688051 (non-flash)\ntcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15659ea3-d18c-4cae-ba54-13c3fdcacd03 (non-flash)\ntcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4661fe9-8f60-4595-bc5b-6671702802af (non-flash)\n', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 18:19:00 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d9da0ba-18f6-490b-8790-c28028b7a3ad tempest-TestVolumeBootPattern-1318569205 tempest-TestVolumeBootPattern-1318569205-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:113c5dd9-52e5-46ba-8f15-faf70db70464 (non-flash)
Nov 29 18:19:00 user nova-compute[74613]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d74e565-9547-4f44-8005-0615d625a275 (non-flash)
Nov 29 18:19:00 user nova-compute[74613]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f9a0824-5da8-4aaa-bc2e-56c2f8688051 (non-flash)
Nov 29 18:19:00 user nova-compute[74613]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15659ea3-d18c-4cae-ba54-13c3fdcacd03 (non-flash)
Nov 29 18:19:00 user nova-compute[74613]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4661fe9-8f60-4595-bc5b-6671702802af (non-flash)
Nov 29 18:19:00 user nova-compute[74613]:  stderr= {{(pid=74613) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 18:19:00 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d9da0ba-18f6-490b-8790-c28028b7a3ad tempest-TestVolumeBootPattern-1318569205 tempest-TestVolumeBootPattern-1318569205-project-member] iscsi session list stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:113c5dd9-52e5-46ba-8f15-faf70db70464 (non-flash)
Nov 29 18:19:00 user nova-compute[74613]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d74e565-9547-4f44-8005-0615d625a275 (non-flash)
Nov 29 18:19:00 user nova-compute[74613]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f9a0824-5da8-4aaa-bc2e-56c2f8688051 (non-flash)
Nov 29 18:19:00 user nova-compute[74613]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15659ea3-d18c-4cae-ba54-13c3fdcacd03 (non-flash)
Nov 29 18:19:00 user nova-compute[74613]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4661fe9-8f60-4595-bc5b-6671702802af (non-flash)
Nov 29 18:19:00 user nova-compute[74613]:  stderr= {{(pid=74613) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 18:19:00 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.base [None req-0d9da0ba-18f6-490b-8790-c28028b7a3ad tempest-TestVolumeBootPattern-1318569205 tempest-TestVolumeBootPattern-1318569205-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b4661fe9-8f60-4595-bc5b-6671702802af" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.305s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 18:19:00 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d9da0ba-18f6-490b-8790-c28028b7a3ad tempest-TestVolumeBootPattern-1318569205 tempest-TestVolumeBootPattern-1318569205-project-member] Connected to 172.16.0.220:3260 {{(pid=74613) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 29 18:19:00 user nova-compute[74613]: DEBUG os_brick.initiator.linuxscsi [None req-0d9da0ba-18f6-490b-8790-c28028b7a3ad tempest-TestVolumeBootPattern-1318569205 tempest-TestVolumeBootPattern-1318569205-project-member] HCTL ('37', '-', '-', 0) found on session 49 with lun 0 {{(pid=74613) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 29 18:19:00 user nova-compute[74613]: DEBUG os_brick.initiator.linuxscsi [None req-0d9da0ba-18f6-490b-8790-c28028b7a3ad tempest-TestVolumeBootPattern-1318569205 tempest-TestVolumeBootPattern-1318569205-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=74613) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 29 18:19:00 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:19:00 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.019s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:19:00 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[e11c00a9-eb0a-4d6f-aa3e-c29d5323ced6]: (4, ('- - 0', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 18:19:00 user nova-compute[74613]: DEBUG os_brick.initiator.linuxscsi [None req-0d9da0ba-18f6-490b-8790-c28028b7a3ad tempest-TestVolumeBootPattern-1318569205 tempest-TestVolumeBootPattern-1318569205-project-member] Searching for a device in session 49 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=74613) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 29 18:19:00 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d9da0ba-18f6-490b-8790-c28028b7a3ad tempest-TestVolumeBootPattern-1318569205 tempest-TestVolumeBootPattern-1318569205-project-member] Connected to sdf using {'target_iqn': 'iqn.2010-10.org.openstack:b4661fe9-8f60-4595-bc5b-6671702802af', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'oWCtefpz', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74613) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 29 18:19:00 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:19:01 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.base [None req-0d9da0ba-18f6-490b-8790-c28028b7a3ad tempest-TestVolumeBootPattern-1318569205 tempest-TestVolumeBootPattern-1318569205-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.340s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 18:19:01 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d9da0ba-18f6-490b-8790-c28028b7a3ad tempest-TestVolumeBootPattern-1318569205 tempest-TestVolumeBootPattern-1318569205-project-member] <== connect_volume: return (1342ms) {'type': 'block', 'scsi_wwn': '23635316233373939', 'path': '/dev/sdf'} {{(pid=74613) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 18:19:01 user nova-compute[74613]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0d9da0ba-18f6-490b-8790-c28028b7a3ad tempest-TestVolumeBootPattern-1318569205 tempest-TestVolumeBootPattern-1318569205-project-member] [instance: d4385666-cff6-4133-9833-5447218c8857] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23635316233373939', 'path': '/dev/sdf'} {{(pid=74613) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 29 18:19:01 user nova-compute[74613]: DEBUG nova.virt.libvirt.vif [None req-0d9da0ba-18f6-490b-8790-c28028b7a3ad tempest-TestVolumeBootPattern-1318569205 tempest-TestVolumeBootPattern-1318569205-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T18:18:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-image-snapshot-server-2040298250',display_name='tempest-TestVolumeBootPattern-image-snapshot-server-2040298250',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-image-snapshot-server-2040298250',id=43,image_ref='a5bf22a6-bce2-4861-99b9-c57bf2cf9595',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOyq50KA7OSJawcZ9YWEOC8dFxQS6yxAcXEbEbKDvtskVvn9CXinCCgRWgfzIxC01ca44GeVgZo690xk+kh2W8GlYjQ1TcpgF2ynYNYqm/+rGy+smMM8WwbtyFokOzvnHQ==',key_name='tempest-keypair-902871575',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='67390f1402214191904cfbd68c3142a7',ramdisk_id='',reservation_id='r-gegiiuol',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_bdm_v2='True',image_boot_roles='member,reader',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_project_name='tempest-TestVolumeBootPattern-1318569205',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestVolumeBootPattern-1318569205-project-member',image_root_device_name='/dev/vda',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1318569205',owner_user_name='tempest-TestVolumeBootPattern-1318569205-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T18:18:46Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='bedbc6ed47394e2b9125543a8b88a71f',uuid=d4385666-cff6-4133-9833-5447218c8857,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a3798396-6b34-4ed7-b750-6a741a148340", "address": "fa:16:3e:4c:8d:a6", "network": {"id": "4a5179dd-d0b1-44c3-80c1-08dd7b0152f1", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1296336996-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "67390f1402214191904cfbd68c3142a7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa3798396-6b", "ovs_interfaceid": "a3798396-6b34-4ed7-b750-6a741a148340", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74613) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 29 18:19:01 user nova-compute[74613]: DEBUG nova.network.os_vif_util [None req-0d9da0ba-18f6-490b-8790-c28028b7a3ad tempest-TestVolumeBootPattern-1318569205 tempest-TestVolumeBootPattern-1318569205-project-member] Converting VIF {"id": "a3798396-6b34-4ed7-b750-6a741a148340", "address": "fa:16:3e:4c:8d:a6", "network": {"id": "4a5179dd-d0b1-44c3-80c1-08dd7b0152f1", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1296336996-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "67390f1402214191904cfbd68c3142a7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa3798396-6b", "ovs_interfaceid": "a3798396-6b34-4ed7-b750-6a741a148340", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74613) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 18:19:01 user nova-compute[74613]: DEBUG nova.network.os_vif_util [None req-0d9da0ba-18f6-490b-8790-c28028b7a3ad tempest-TestVolumeBootPattern-1318569205 tempest-TestVolumeBootPattern-1318569205-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4c:8d:a6,bridge_name='br-int',has_traffic_filtering=True,id=a3798396-6b34-4ed7-b750-6a741a148340,network=Network(4a5179dd-d0b1-44c3-80c1-08dd7b0152f1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa3798396-6b') {{(pid=74613) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 18:19:01 user nova-compute[74613]: DEBUG nova.objects.instance [None req-0d9da0ba-18f6-490b-8790-c28028b7a3ad tempest-TestVolumeBootPattern-1318569205 tempest-TestVolumeBootPattern-1318569205-project-member] Lazy-loading 'pci_devices' on Instance uuid d4385666-cff6-4133-9833-5447218c8857 {{(pid=74613) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 18:19:01 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-0d9da0ba-18f6-490b-8790-c28028b7a3ad tempest-TestVolumeBootPattern-1318569205 tempest-TestVolumeBootPattern-1318569205-project-member] [instance: d4385666-cff6-4133-9833-5447218c8857] End _get_guest_xml xml=<domain type="kvm">
Nov 29 18:19:01 user nova-compute[74613]:   <uuid>d4385666-cff6-4133-9833-5447218c8857</uuid>
Nov 29 18:19:01 user nova-compute[74613]:   <name>instance-0000002b</name>
Nov 29 18:19:01 user nova-compute[74613]:   <memory>524288</memory>
Nov 29 18:19:01 user nova-compute[74613]:   <vcpu>1</vcpu>
Nov 29 18:19:01 user nova-compute[74613]:   <metadata>
Nov 29 18:19:01 user nova-compute[74613]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 29 18:19:01 user nova-compute[74613]:       <nova:package version="0.0.0"/>
Nov 29 18:19:01 user nova-compute[74613]:       <nova:name>tempest-TestVolumeBootPattern-image-snapshot-server-2040298250</nova:name>
Nov 29 18:19:01 user nova-compute[74613]:       <nova:creationTime>2023-11-29 18:19:00</nova:creationTime>
Nov 29 18:19:01 user nova-compute[74613]:       <nova:flavor name="m1.tiny">
Nov 29 18:19:01 user nova-compute[74613]:         <nova:memory>512</nova:memory>
Nov 29 18:19:01 user nova-compute[74613]:         <nova:disk>1</nova:disk>
Nov 29 18:19:01 user nova-compute[74613]:         <nova:swap>0</nova:swap>
Nov 29 18:19:01 user nova-compute[74613]:         <nova:ephemeral>0</nova:ephemeral>
Nov 29 18:19:01 user nova-compute[74613]:         <nova:vcpus>1</nova:vcpus>
Nov 29 18:19:01 user nova-compute[74613]:       </nova:flavor>
Nov 29 18:19:01 user nova-compute[74613]:       <nova:owner>
Nov 29 18:19:01 user nova-compute[74613]:         <nova:user uuid="bedbc6ed47394e2b9125543a8b88a71f">tempest-TestVolumeBootPattern-1318569205-project-member</nova:user>
Nov 29 18:19:01 user nova-compute[74613]:         <nova:project uuid="67390f1402214191904cfbd68c3142a7">tempest-TestVolumeBootPattern-1318569205</nova:project>
Nov 29 18:19:01 user nova-compute[74613]:       </nova:owner>
Nov 29 18:19:01 user nova-compute[74613]:       <nova:root type="image" uuid="a5bf22a6-bce2-4861-99b9-c57bf2cf9595"/>
Nov 29 18:19:01 user nova-compute[74613]:       <nova:ports>
Nov 29 18:19:01 user nova-compute[74613]:         <nova:port uuid="a3798396-6b34-4ed7-b750-6a741a148340">
Nov 29 18:19:01 user nova-compute[74613]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Nov 29 18:19:01 user nova-compute[74613]:         </nova:port>
Nov 29 18:19:01 user nova-compute[74613]:       </nova:ports>
Nov 29 18:19:01 user nova-compute[74613]:     </nova:instance>
Nov 29 18:19:01 user nova-compute[74613]:   </metadata>
Nov 29 18:19:01 user nova-compute[74613]:   <sysinfo type="smbios">
Nov 29 18:19:01 user nova-compute[74613]:     <system>
Nov 29 18:19:01 user nova-compute[74613]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 29 18:19:01 user nova-compute[74613]:       <entry name="product">OpenStack Nova</entry>
Nov 29 18:19:01 user nova-compute[74613]:       <entry name="version">0.0.0</entry>
Nov 29 18:19:01 user nova-compute[74613]:       <entry name="serial">d4385666-cff6-4133-9833-5447218c8857</entry>
Nov 29 18:19:01 user nova-compute[74613]:       <entry name="uuid">d4385666-cff6-4133-9833-5447218c8857</entry>
Nov 29 18:19:01 user nova-compute[74613]:       <entry name="family">Virtual Machine</entry>
Nov 29 18:19:01 user nova-compute[74613]:     </system>
Nov 29 18:19:01 user nova-compute[74613]:   </sysinfo>
Nov 29 18:19:01 user nova-compute[74613]:   <os>
Nov 29 18:19:01 user nova-compute[74613]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 29 18:19:01 user nova-compute[74613]:     <boot dev="hd"/>
Nov 29 18:19:01 user nova-compute[74613]:     <smbios mode="sysinfo"/>
Nov 29 18:19:01 user nova-compute[74613]:   </os>
Nov 29 18:19:01 user nova-compute[74613]:   <features>
Nov 29 18:19:01 user nova-compute[74613]:     <acpi/>
Nov 29 18:19:01 user nova-compute[74613]:     <apic/>
Nov 29 18:19:01 user nova-compute[74613]:     <vmcoreinfo/>
Nov 29 18:19:01 user nova-compute[74613]:   </features>
Nov 29 18:19:01 user nova-compute[74613]:   <clock offset="utc">
Nov 29 18:19:01 user nova-compute[74613]:     <timer name="pit" tickpolicy="delay"/>
Nov 29 18:19:01 user nova-compute[74613]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 29 18:19:01 user nova-compute[74613]:     <timer name="hpet" present="no"/>
Nov 29 18:19:01 user nova-compute[74613]:   </clock>
Nov 29 18:19:01 user nova-compute[74613]:   <cpu mode="custom" match="exact">
Nov 29 18:19:01 user nova-compute[74613]:     <model>Nehalem</model>
Nov 29 18:19:01 user nova-compute[74613]:     <topology sockets="1" cores="1" threads="1"/>
Nov 29 18:19:01 user nova-compute[74613]:   </cpu>
Nov 29 18:19:01 user nova-compute[74613]:   <devices>
Nov 29 18:19:01 user nova-compute[74613]:     <disk type="block" device="disk">
Nov 29 18:19:01 user nova-compute[74613]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 18:19:01 user nova-compute[74613]:       <source dev="/dev/sdf"/>
Nov 29 18:19:01 user nova-compute[74613]:       <target dev="vda" bus="virtio"/>
Nov 29 18:19:01 user nova-compute[74613]:       <serial>b4661fe9-8f60-4595-bc5b-6671702802af</serial>
Nov 29 18:19:01 user nova-compute[74613]:     </disk>
Nov 29 18:19:01 user nova-compute[74613]:     <interface type="ethernet">
Nov 29 18:19:01 user nova-compute[74613]:       <mac address="fa:16:3e:4c:8d:a6"/>
Nov 29 18:19:01 user nova-compute[74613]:       <model type="virtio"/>
Nov 29 18:19:01 user nova-compute[74613]:       <mtu size="1442"/>
Nov 29 18:19:01 user nova-compute[74613]:       <target dev="tapa3798396-6b"/>
Nov 29 18:19:01 user nova-compute[74613]:     </interface>
Nov 29 18:19:01 user nova-compute[74613]:     <serial type="pty">
Nov 29 18:19:01 user nova-compute[74613]:       <log file="/opt/stack/data/nova/instances/d4385666-cff6-4133-9833-5447218c8857/console.log" append="off"/>
Nov 29 18:19:01 user nova-compute[74613]:     </serial>
Nov 29 18:19:01 user nova-compute[74613]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 29 18:19:01 user nova-compute[74613]:     <video>
Nov 29 18:19:01 user nova-compute[74613]:       <model type="virtio"/>
Nov 29 18:19:01 user nova-compute[74613]:     </video>
Nov 29 18:19:01 user nova-compute[74613]:     <rng model="virtio">
Nov 29 18:19:01 user nova-compute[74613]:       <backend model="random">/dev/urandom</backend>
Nov 29 18:19:01 user nova-compute[74613]:     </rng>
Nov 29 18:19:01 user nova-compute[74613]:     <controller type="usb" index="0" model="none"/>
Nov 29 18:19:01 user nova-compute[74613]:     <memballoon model="virtio">
Nov 29 18:19:01 user nova-compute[74613]:       <stats period="10"/>
Nov 29 18:19:01 user nova-compute[74613]:     </memballoon>
Nov 29 18:19:01 user nova-compute[74613]:   </devices>
Nov 29 18:19:01 user nova-compute[74613]: </domain>
Nov 29 18:19:01 user nova-compute[74613]:  {{(pid=74613) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 29 18:19:01 user nova-compute[74613]: DEBUG nova.virt.libvirt.vif [None req-0d9da0ba-18f6-490b-8790-c28028b7a3ad tempest-TestVolumeBootPattern-1318569205 tempest-TestVolumeBootPattern-1318569205-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T18:18:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-image-snapshot-server-2040298250',display_name='tempest-TestVolumeBootPattern-image-snapshot-server-2040298250',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-image-snapshot-server-2040298250',id=43,image_ref='a5bf22a6-bce2-4861-99b9-c57bf2cf9595',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOyq50KA7OSJawcZ9YWEOC8dFxQS6yxAcXEbEbKDvtskVvn9CXinCCgRWgfzIxC01ca44GeVgZo690xk+kh2W8GlYjQ1TcpgF2ynYNYqm/+rGy+smMM8WwbtyFokOzvnHQ==',key_name='tempest-keypair-902871575',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='67390f1402214191904cfbd68c3142a7',ramdisk_id='',reservation_id='r-gegiiuol',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_bdm_v2='True',image_boot_roles='member,reader',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_project_name='tempest-TestVolumeBootPattern-1318569205',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestVolumeBootPattern-1318569205-project-member',image_root_device_name='/dev/vda',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1318569205',owner_user_name='tempest-TestVolumeBootPattern-1318569205-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T18:18:46Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='bedbc6ed47394e2b9125543a8b88a71f',uuid=d4385666-cff6-4133-9833-5447218c8857,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a3798396-6b34-4ed7-b750-6a741a148340", "address": "fa:16:3e:4c:8d:a6", "network": {"id": "4a5179dd-d0b1-44c3-80c1-08dd7b0152f1", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1296336996-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "67390f1402214191904cfbd68c3142a7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa3798396-6b", "ovs_interfaceid": "a3798396-6b34-4ed7-b750-6a741a148340", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74613) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 29 18:19:01 user nova-compute[74613]: DEBUG nova.network.os_vif_util [None req-0d9da0ba-18f6-490b-8790-c28028b7a3ad tempest-TestVolumeBootPattern-1318569205 tempest-TestVolumeBootPattern-1318569205-project-member] Converting VIF {"id": "a3798396-6b34-4ed7-b750-6a741a148340", "address": "fa:16:3e:4c:8d:a6", "network": {"id": "4a5179dd-d0b1-44c3-80c1-08dd7b0152f1", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1296336996-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "67390f1402214191904cfbd68c3142a7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa3798396-6b", "ovs_interfaceid": "a3798396-6b34-4ed7-b750-6a741a148340", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74613) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 18:19:01 user nova-compute[74613]: DEBUG nova.network.os_vif_util [None req-0d9da0ba-18f6-490b-8790-c28028b7a3ad tempest-TestVolumeBootPattern-1318569205 tempest-TestVolumeBootPattern-1318569205-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4c:8d:a6,bridge_name='br-int',has_traffic_filtering=True,id=a3798396-6b34-4ed7-b750-6a741a148340,network=Network(4a5179dd-d0b1-44c3-80c1-08dd7b0152f1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa3798396-6b') {{(pid=74613) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 18:19:01 user nova-compute[74613]: DEBUG os_vif [None req-0d9da0ba-18f6-490b-8790-c28028b7a3ad tempest-TestVolumeBootPattern-1318569205 tempest-TestVolumeBootPattern-1318569205-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:4c:8d:a6,bridge_name='br-int',has_traffic_filtering=True,id=a3798396-6b34-4ed7-b750-6a741a148340,network=Network(4a5179dd-d0b1-44c3-80c1-08dd7b0152f1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa3798396-6b') {{(pid=74613) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 29 18:19:01 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:19:01 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74613) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 18:19:01 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74613) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 29 18:19:01 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:19:01 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'a79b7553-7986-5b78-9de0-8d33f5778d43', '_type': 'linux-noop'}}, row=False) {{(pid=74613) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 18:19:01 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:19:01 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 18:19:01 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:19:01 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapa3798396-6b, may_exist=True, interface_attrs={}) {{(pid=74613) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 18:19:01 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapa3798396-6b, col_values=(('qos', UUID('063bd309-1b9f-45d1-be35-f1e81c719c2c')),), if_exists=True) {{(pid=74613) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 18:19:01 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapa3798396-6b, col_values=(('external_ids', {'iface-id': 'a3798396-6b34-4ed7-b750-6a741a148340', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:4c:8d:a6', 'vm-uuid': 'd4385666-cff6-4133-9833-5447218c8857'}),), if_exists=True) {{(pid=74613) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 18:19:01 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:19:01 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 18:19:01 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:19:01 user nova-compute[74613]: INFO os_vif [None req-0d9da0ba-18f6-490b-8790-c28028b7a3ad tempest-TestVolumeBootPattern-1318569205 tempest-TestVolumeBootPattern-1318569205-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:4c:8d:a6,bridge_name='br-int',has_traffic_filtering=True,id=a3798396-6b34-4ed7-b750-6a741a148340,network=Network(4a5179dd-d0b1-44c3-80c1-08dd7b0152f1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa3798396-6b')
Nov 29 18:19:01 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-0d9da0ba-18f6-490b-8790-c28028b7a3ad tempest-TestVolumeBootPattern-1318569205 tempest-TestVolumeBootPattern-1318569205-project-member] No BDM found with device name vda, not building metadata. {{(pid=74613) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 18:19:01 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-0d9da0ba-18f6-490b-8790-c28028b7a3ad tempest-TestVolumeBootPattern-1318569205 tempest-TestVolumeBootPattern-1318569205-project-member] No VIF found with MAC fa:16:3e:4c:8d:a6, not building metadata {{(pid=74613) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 29 18:19:02 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:19:02 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:19:02 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:19:02 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:19:03 user nova-compute[74613]: WARNING nova.virt.libvirt.driver [None req-7783518a-de7f-4a44-b814-594975cbde46 tempest-ServerRescueNegativeTestJSON-1891426908 tempest-ServerRescueNegativeTestJSON-1891426908-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 1f2b4426-815f-4ef4-b98e-e5124fec93b7 is timed out.
Nov 29 18:19:03 user nova-compute[74613]: INFO nova.virt.libvirt.driver [None req-7783518a-de7f-4a44-b814-594975cbde46 tempest-ServerRescueNegativeTestJSON-1891426908 tempest-ServerRescueNegativeTestJSON-1891426908-project-member] Successfully detached device vdb from instance 1f2b4426-815f-4ef4-b98e-e5124fec93b7 from the live domain config.
Nov 29 18:19:03 user nova-compute[74613]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7783518a-de7f-4a44-b814-594975cbde46 tempest-ServerRescueNegativeTestJSON-1891426908 tempest-ServerRescueNegativeTestJSON-1891426908-project-member] [instance: 1f2b4426-815f-4ef4-b98e-e5124fec93b7] calling os-brick to detach iSCSI Volume {{(pid=74613) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 29 18:19:03 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-7783518a-de7f-4a44-b814-594975cbde46 tempest-ServerRescueNegativeTestJSON-1891426908 tempest-ServerRescueNegativeTestJSON-1891426908-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff828156890>, {'target_iqn': 'iqn.2010-10.org.openstack:113c5dd9-52e5-46ba-8f15-faf70db70464', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'hUtHORWv', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=74613) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 18:19:03 user nova-compute[74613]: WARNING os_brick.initiator.connectors.base [None req-7783518a-de7f-4a44-b814-594975cbde46 tempest-ServerRescueNegativeTestJSON-1891426908 tempest-ServerRescueNegativeTestJSON-1891426908-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 18:19:03 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.base [None req-7783518a-de7f-4a44-b814-594975cbde46 tempest-ServerRescueNegativeTestJSON-1891426908 tempest-ServerRescueNegativeTestJSON-1891426908-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 18:19:03 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.base [None req-7783518a-de7f-4a44-b814-594975cbde46 tempest-ServerRescueNegativeTestJSON-1891426908 tempest-ServerRescueNegativeTestJSON-1891426908-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.005s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 18:19:03 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:19:03 user nova-compute[74613]: DEBUG nova.compute.manager [req-17cfb16e-9a86-4a01-8cf8-ec4d78126878 req-b3cb2f1e-252d-4329-a5f0-48c2e6f9c53a service nova] [instance: d4385666-cff6-4133-9833-5447218c8857] Received event network-vif-plugged-a3798396-6b34-4ed7-b750-6a741a148340 {{(pid=74613) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 18:19:03 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-17cfb16e-9a86-4a01-8cf8-ec4d78126878 req-b3cb2f1e-252d-4329-a5f0-48c2e6f9c53a service nova] Acquiring lock "d4385666-cff6-4133-9833-5447218c8857-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 18:19:03 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-17cfb16e-9a86-4a01-8cf8-ec4d78126878 req-b3cb2f1e-252d-4329-a5f0-48c2e6f9c53a service nova] Lock "d4385666-cff6-4133-9833-5447218c8857-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 18:19:03 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-17cfb16e-9a86-4a01-8cf8-ec4d78126878 req-b3cb2f1e-252d-4329-a5f0-48c2e6f9c53a service nova] Lock "d4385666-cff6-4133-9833-5447218c8857-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 18:19:03 user nova-compute[74613]: DEBUG nova.compute.manager [req-17cfb16e-9a86-4a01-8cf8-ec4d78126878 req-b3cb2f1e-252d-4329-a5f0-48c2e6f9c53a service nova] [instance: d4385666-cff6-4133-9833-5447218c8857] No waiting events found dispatching network-vif-plugged-a3798396-6b34-4ed7-b750-6a741a148340 {{(pid=74613) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 18:19:03 user nova-compute[74613]: WARNING nova.compute.manager [req-17cfb16e-9a86-4a01-8cf8-ec4d78126878 req-b3cb2f1e-252d-4329-a5f0-48c2e6f9c53a service nova] [instance: d4385666-cff6-4133-9833-5447218c8857] Received unexpected event network-vif-plugged-a3798396-6b34-4ed7-b750-6a741a148340 for instance with vm_state building and task_state spawning.
Nov 29 18:19:03 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:19:03 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.023s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:19:03 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8ce71e8-2d25-4712-88c5-edbbe93a170b]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:113c5dd9-52e5-46ba-8f15-faf70db70464\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b4661fe9-8f60-4595-bc5b-6671702802af\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:5d74e565-9547-4f44-8005-0615d625a275\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:9f9a0824-5da8-4aaa-bc2e-56c2f8688051\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:15659ea3-d18c-4cae-ba54-13c3fdcacd03\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 18:19:03 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-7783518a-de7f-4a44-b814-594975cbde46 tempest-ServerRescueNegativeTestJSON-1891426908 tempest-ServerRescueNegativeTestJSON-1891426908-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 29 18:19:03 user nova-compute[74613]: No targets found.
Nov 29 18:19:03 user nova-compute[74613]: iSNS:
Nov 29 18:19:03 user nova-compute[74613]: No targets found.
Nov 29 18:19:03 user nova-compute[74613]: STATIC:
Nov 29 18:19:03 user nova-compute[74613]: Target: iqn.2010-10.org.openstack:113c5dd9-52e5-46ba-8f15-faf70db70464
Nov 29 18:19:03 user nova-compute[74613]:         Portal: 172.16.0.220:3260,-1
Nov 29 18:19:03 user nova-compute[74613]:                 Iface Name: default
Nov 29 18:19:03 user nova-compute[74613]: Target: iqn.2010-10.org.openstack:b4661fe9-8f60-4595-bc5b-6671702802af
Nov 29 18:19:03 user nova-compute[74613]:         Portal: 172.16.0.220:3260,-1
Nov 29 18:19:03 user nova-compute[74613]:                 Iface Name: default
Nov 29 18:19:03 user nova-compute[74613]: Target: iqn.2010-10.org.openstack:5d74e565-9547-4f44-8005-0615d625a275
Nov 29 18:19:03 user nova-compute[74613]:         Portal: 172.16.0.220:3260,-1
Nov 29 18:19:03 user nova-compute[74613]:                 Iface Name: default
Nov 29 18:19:03 user nova-compute[74613]: Target: iqn.2010-10.org.openstack:9f9a0824-5da8-4aaa-bc2e-56c2f8688051
Nov 29 18:19:03 user nova-compute[74613]:         Portal: 172.16.0.220:3260,-1
Nov 29 18:19:03 user nova-compute[74613]:                 Iface Name: default
Nov 29 18:19:03 user nova-compute[74613]: Target: iqn.2010-10.org.openstack:15659ea3-d18c-4cae-ba54-13c3fdcacd03
Nov 29 18:19:03 user nova-compute[74613]:         Portal: 172.16.0.220:3260,-1
Nov 29 18:19:03 user nova-compute[74613]:                 Iface Name: default
Nov 29 18:19:03 user nova-compute[74613]: FIRMWARE:
Nov 29 18:19:03 user nova-compute[74613]: No targets found.
Nov 29 18:19:03 user nova-compute[74613]:  stderr= {{(pid=74613) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 18:19:03 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-7783518a-de7f-4a44-b814-594975cbde46 tempest-ServerRescueNegativeTestJSON-1891426908 tempest-ServerRescueNegativeTestJSON-1891426908-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 29 18:19:03 user nova-compute[74613]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 29 18:19:03 user nova-compute[74613]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74613) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 29 18:19:03 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-7783518a-de7f-4a44-b814-594975cbde46 tempest-ServerRescueNegativeTestJSON-1891426908 tempest-ServerRescueNegativeTestJSON-1891426908-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:113c5dd9-52e5-46ba-8f15-faf70db70464', 0)] {{(pid=74613) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 29 18:19:03 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:19:03 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.025s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:19:03 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[4010905d-ab72-4ac7-8e6f-2819ac9bbaac]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:113c5dd9-52e5-46ba-8f15-faf70db70464\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:15659ea3-d18c-4cae-ba54-13c3fdcacd03\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5d74e565-9547-4f44-8005-0615d625a275\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9f9a0824-5da8-4aaa-bc2e-56c2f8688051\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b4661fe9-8f60-4595-bc5b-6671702802af\n', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 18:19:03 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:19:03 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.032s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:19:03 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[38b0a878-ba0a-45f0-b149-94e5cc6d737f]: (4, ('tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:113c5dd9-52e5-46ba-8f15-faf70db70464 (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d74e565-9547-4f44-8005-0615d625a275 (non-flash)\ntcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f9a0824-5da8-4aaa-bc2e-56c2f8688051 (non-flash)\ntcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15659ea3-d18c-4cae-ba54-13c3fdcacd03 (non-flash)\ntcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4661fe9-8f60-4595-bc5b-6671702802af (non-flash)\n', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 18:19:03 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-7783518a-de7f-4a44-b814-594975cbde46 tempest-ServerRescueNegativeTestJSON-1891426908 tempest-ServerRescueNegativeTestJSON-1891426908-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:113c5dd9-52e5-46ba-8f15-faf70db70464 (non-flash)
Nov 29 18:19:03 user nova-compute[74613]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d74e565-9547-4f44-8005-0615d625a275 (non-flash)
Nov 29 18:19:03 user nova-compute[74613]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f9a0824-5da8-4aaa-bc2e-56c2f8688051 (non-flash)
Nov 29 18:19:03 user nova-compute[74613]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15659ea3-d18c-4cae-ba54-13c3fdcacd03 (non-flash)
Nov 29 18:19:03 user nova-compute[74613]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4661fe9-8f60-4595-bc5b-6671702802af (non-flash)
Nov 29 18:19:03 user nova-compute[74613]:  stderr= {{(pid=74613) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 18:19:03 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-7783518a-de7f-4a44-b814-594975cbde46 tempest-ServerRescueNegativeTestJSON-1891426908 tempest-ServerRescueNegativeTestJSON-1891426908-project-member] iscsi session list stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:113c5dd9-52e5-46ba-8f15-faf70db70464 (non-flash)
Nov 29 18:19:03 user nova-compute[74613]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d74e565-9547-4f44-8005-0615d625a275 (non-flash)
Nov 29 18:19:03 user nova-compute[74613]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f9a0824-5da8-4aaa-bc2e-56c2f8688051 (non-flash)
Nov 29 18:19:03 user nova-compute[74613]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15659ea3-d18c-4cae-ba54-13c3fdcacd03 (non-flash)
Nov 29 18:19:03 user nova-compute[74613]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4661fe9-8f60-4595-bc5b-6671702802af (non-flash)
Nov 29 18:19:03 user nova-compute[74613]:  stderr= {{(pid=74613) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 18:19:03 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-7783518a-de7f-4a44-b814-594975cbde46 tempest-ServerRescueNegativeTestJSON-1891426908 tempest-ServerRescueNegativeTestJSON-1891426908-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7ff7f8675000>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:113c5dd9-52e5-46ba-8f15-faf70db70464'): ({'sdc'}, set())}) {{(pid=74613) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 29 18:19:03 user nova-compute[74613]: DEBUG os_brick.initiator.linuxscsi [None req-7783518a-de7f-4a44-b814-594975cbde46 tempest-ServerRescueNegativeTestJSON-1891426908 tempest-ServerRescueNegativeTestJSON-1891426908-project-member] Removing single pathed devices sdc {{(pid=74613) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 29 18:19:03 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:19:03 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:19:03 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[df65ff4f-9c80-4cee-915e-3dba269b175e]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 18:19:03 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:19:03 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.028s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:19:03 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f095da2-fc33-4b21-b1e9-d18751073f57]: (4, ('ok\n', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 18:19:03 user nova-compute[74613]: DEBUG os_brick.initiator.linuxscsi [None req-7783518a-de7f-4a44-b814-594975cbde46 tempest-ServerRescueNegativeTestJSON-1891426908 tempest-ServerRescueNegativeTestJSON-1891426908-project-member] Flushing IO for device /dev/sdc {{(pid=74613) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 29 18:19:03 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:19:03 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.014s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:19:03 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[f62ec2fb-31db-48fa-8929-ff5d52a967a4]: (4, ('', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 18:19:03 user nova-compute[74613]: DEBUG os_brick.initiator.linuxscsi [None req-7783518a-de7f-4a44-b814-594975cbde46 tempest-ServerRescueNegativeTestJSON-1891426908 tempest-ServerRescueNegativeTestJSON-1891426908-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=74613) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 29 18:19:03 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:19:03 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.047s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:19:03 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[298550b2-57ee-4bb4-9788-74fa2db41120]: (4, ('1', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 18:19:03 user nova-compute[74613]: DEBUG os_brick.initiator.linuxscsi [None req-7783518a-de7f-4a44-b814-594975cbde46 tempest-ServerRescueNegativeTestJSON-1891426908 tempest-ServerRescueNegativeTestJSON-1891426908-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=74613) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 29 18:19:03 user nova-compute[74613]: DEBUG os_brick.initiator.linuxscsi [None req-7783518a-de7f-4a44-b814-594975cbde46 tempest-ServerRescueNegativeTestJSON-1891426908 tempest-ServerRescueNegativeTestJSON-1891426908-project-member] SCSI volumes sdc have been removed. {{(pid=74613) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 29 18:19:03 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-7783518a-de7f-4a44-b814-594975cbde46 tempest-ServerRescueNegativeTestJSON-1891426908 tempest-ServerRescueNegativeTestJSON-1891426908-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:113c5dd9-52e5-46ba-8f15-faf70db70464')] {{(pid=74613) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 29 18:19:03 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:113c5dd9-52e5-46ba-8f15-faf70db70464 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:19:03 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:113c5dd9-52e5-46ba-8f15-faf70db70464 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:19:03 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[3feab271-0acd-459a-9ba3-a188efde3edf]: (4, ('', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 18:19:03 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-7783518a-de7f-4a44-b814-594975cbde46 tempest-ServerRescueNegativeTestJSON-1891426908 tempest-ServerRescueNegativeTestJSON-1891426908-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74613) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 18:19:03 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:113c5dd9-52e5-46ba-8f15-faf70db70464 -p 172.16.0.220:3260 --logout {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:19:03 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:113c5dd9-52e5-46ba-8f15-faf70db70464 -p 172.16.0.220:3260 --logout" returned: 0 in 0.056s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:19:03 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[fdae10d1-d11a-4261-98e8-0561c86d0e40]: (4, ('Logging out of session [sid: 44, target: iqn.2010-10.org.openstack:113c5dd9-52e5-46ba-8f15-faf70db70464, portal: 172.16.0.220,3260]\nLogout of [sid: 44, target: iqn.2010-10.org.openstack:113c5dd9-52e5-46ba-8f15-faf70db70464, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 18:19:03 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-7783518a-de7f-4a44-b814-594975cbde46 tempest-ServerRescueNegativeTestJSON-1891426908 tempest-ServerRescueNegativeTestJSON-1891426908-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 44, target: iqn.2010-10.org.openstack:113c5dd9-52e5-46ba-8f15-faf70db70464, portal: 172.16.0.220,3260]
Nov 29 18:19:03 user nova-compute[74613]: Logout of [sid: 44, target: iqn.2010-10.org.openstack:113c5dd9-52e5-46ba-8f15-faf70db70464, portal: 172.16.0.220,3260] successful.
Nov 29 18:19:03 user nova-compute[74613]:  stderr= {{(pid=74613) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 18:19:03 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:113c5dd9-52e5-46ba-8f15-faf70db70464 -p 172.16.0.220:3260 --op delete {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:19:03 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:113c5dd9-52e5-46ba-8f15-faf70db70464 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.038s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:19:03 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[821a3777-2848-407e-88ec-91b5a5366b2e]: (4, ('', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 18:19:03 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-7783518a-de7f-4a44-b814-594975cbde46 tempest-ServerRescueNegativeTestJSON-1891426908 tempest-ServerRescueNegativeTestJSON-1891426908-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74613) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 18:19:03 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.base [None req-7783518a-de7f-4a44-b814-594975cbde46 tempest-ServerRescueNegativeTestJSON-1891426908 tempest-ServerRescueNegativeTestJSON-1891426908-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.358s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 18:19:03 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-7783518a-de7f-4a44-b814-594975cbde46 tempest-ServerRescueNegativeTestJSON-1891426908 tempest-ServerRescueNegativeTestJSON-1891426908-project-member] <== disconnect_volume: return (363ms) None {{(pid=74613) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 18:19:03 user nova-compute[74613]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7783518a-de7f-4a44-b814-594975cbde46 tempest-ServerRescueNegativeTestJSON-1891426908 tempest-ServerRescueNegativeTestJSON-1891426908-project-member] [instance: 1f2b4426-815f-4ef4-b98e-e5124fec93b7] Disconnected iSCSI Volume {{(pid=74613) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 29 18:19:04 user nova-compute[74613]: DEBUG nova.objects.instance [None req-7783518a-de7f-4a44-b814-594975cbde46 tempest-ServerRescueNegativeTestJSON-1891426908 tempest-ServerRescueNegativeTestJSON-1891426908-project-member] Lazy-loading 'flavor' on Instance uuid 1f2b4426-815f-4ef4-b98e-e5124fec93b7 {{(pid=74613) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 18:19:04 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-7783518a-de7f-4a44-b814-594975cbde46 tempest-ServerRescueNegativeTestJSON-1891426908 tempest-ServerRescueNegativeTestJSON-1891426908-project-member] Lock "1f2b4426-815f-4ef4-b98e-e5124fec93b7" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.854s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 18:19:04 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Lock "1f2b4426-815f-4ef4-b98e-e5124fec93b7" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 11.703s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 18:19:04 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Lock "1f2b4426-815f-4ef4-b98e-e5124fec93b7" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.033s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 18:19:05 user nova-compute[74613]: DEBUG nova.compute.manager [None req-0d9da0ba-18f6-490b-8790-c28028b7a3ad tempest-TestVolumeBootPattern-1318569205 tempest-TestVolumeBootPattern-1318569205-project-member] [instance: d4385666-cff6-4133-9833-5447218c8857] Instance event wait completed in 0 seconds for  {{(pid=74613) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 29 18:19:05 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-0d9da0ba-18f6-490b-8790-c28028b7a3ad tempest-TestVolumeBootPattern-1318569205 tempest-TestVolumeBootPattern-1318569205-project-member] [instance: d4385666-cff6-4133-9833-5447218c8857] Guest created on hypervisor {{(pid=74613) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 29 18:19:05 user nova-compute[74613]: INFO nova.virt.libvirt.driver [-] [instance: d4385666-cff6-4133-9833-5447218c8857] Instance spawned successfully.
Nov 29 18:19:05 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-0d9da0ba-18f6-490b-8790-c28028b7a3ad tempest-TestVolumeBootPattern-1318569205 tempest-TestVolumeBootPattern-1318569205-project-member] [instance: d4385666-cff6-4133-9833-5447218c8857] Attempting to register defaults for the following image properties: ['hw_input_bus', 'hw_pointer_model'] {{(pid=74613) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 29 18:19:05 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-0d9da0ba-18f6-490b-8790-c28028b7a3ad tempest-TestVolumeBootPattern-1318569205 tempest-TestVolumeBootPattern-1318569205-project-member] [instance: d4385666-cff6-4133-9833-5447218c8857] Found default for hw_input_bus of None {{(pid=74613) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 18:19:05 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-0d9da0ba-18f6-490b-8790-c28028b7a3ad tempest-TestVolumeBootPattern-1318569205 tempest-TestVolumeBootPattern-1318569205-project-member] [instance: d4385666-cff6-4133-9833-5447218c8857] Found default for hw_pointer_model of None {{(pid=74613) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 18:19:05 user nova-compute[74613]: DEBUG nova.compute.manager [req-5b87706e-17bb-4716-b5d2-ca35fa17f5b9 req-c1d5c1ff-9c41-4351-80ba-5653590e3f17 service nova] [instance: d4385666-cff6-4133-9833-5447218c8857] Received event network-vif-plugged-a3798396-6b34-4ed7-b750-6a741a148340 {{(pid=74613) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 18:19:05 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-5b87706e-17bb-4716-b5d2-ca35fa17f5b9 req-c1d5c1ff-9c41-4351-80ba-5653590e3f17 service nova] Acquiring lock "d4385666-cff6-4133-9833-5447218c8857-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 18:19:05 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-5b87706e-17bb-4716-b5d2-ca35fa17f5b9 req-c1d5c1ff-9c41-4351-80ba-5653590e3f17 service nova] Lock "d4385666-cff6-4133-9833-5447218c8857-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 18:19:05 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-5b87706e-17bb-4716-b5d2-ca35fa17f5b9 req-c1d5c1ff-9c41-4351-80ba-5653590e3f17 service nova] Lock "d4385666-cff6-4133-9833-5447218c8857-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 18:19:05 user nova-compute[74613]: DEBUG nova.compute.manager [req-5b87706e-17bb-4716-b5d2-ca35fa17f5b9 req-c1d5c1ff-9c41-4351-80ba-5653590e3f17 service nova] [instance: d4385666-cff6-4133-9833-5447218c8857] No waiting events found dispatching network-vif-plugged-a3798396-6b34-4ed7-b750-6a741a148340 {{(pid=74613) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 18:19:05 user nova-compute[74613]: WARNING nova.compute.manager [req-5b87706e-17bb-4716-b5d2-ca35fa17f5b9 req-c1d5c1ff-9c41-4351-80ba-5653590e3f17 service nova] [instance: d4385666-cff6-4133-9833-5447218c8857] Received unexpected event network-vif-plugged-a3798396-6b34-4ed7-b750-6a741a148340 for instance with vm_state building and task_state spawning.
Nov 29 18:19:05 user nova-compute[74613]: INFO nova.compute.manager [None req-0d9da0ba-18f6-490b-8790-c28028b7a3ad tempest-TestVolumeBootPattern-1318569205 tempest-TestVolumeBootPattern-1318569205-project-member] [instance: d4385666-cff6-4133-9833-5447218c8857] Took 5.29 seconds to spawn the instance on the hypervisor.
Nov 29 18:19:05 user nova-compute[74613]: DEBUG nova.compute.manager [None req-0d9da0ba-18f6-490b-8790-c28028b7a3ad tempest-TestVolumeBootPattern-1318569205 tempest-TestVolumeBootPattern-1318569205-project-member] [instance: d4385666-cff6-4133-9833-5447218c8857] Checking state {{(pid=74613) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 29 18:19:05 user nova-compute[74613]: INFO nova.compute.manager [None req-0d9da0ba-18f6-490b-8790-c28028b7a3ad tempest-TestVolumeBootPattern-1318569205 tempest-TestVolumeBootPattern-1318569205-project-member] [instance: d4385666-cff6-4133-9833-5447218c8857] Took 19.83 seconds to build instance.
Nov 29 18:19:05 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-0d9da0ba-18f6-490b-8790-c28028b7a3ad tempest-TestVolumeBootPattern-1318569205 tempest-TestVolumeBootPattern-1318569205-project-member] Lock "d4385666-cff6-4133-9833-5447218c8857" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 19.939s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 18:19:05 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Lock "d4385666-cff6-4133-9833-5447218c8857" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 12.713s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 18:19:05 user nova-compute[74613]: INFO nova.compute.manager [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] [instance: d4385666-cff6-4133-9833-5447218c8857] During sync_power_state the instance has a pending task (block_device_mapping). Skip.
Nov 29 18:19:05 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Lock "d4385666-cff6-4133-9833-5447218c8857" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.001s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 18:19:06 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:19:06 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:19:06 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-44428875-b33e-488e-a6bf-42ee5f5a45cf tempest-AttachVolumeNegativeTest-483083654 tempest-AttachVolumeNegativeTest-483083654-project-member] Acquiring lock "d9f10bfb-5202-4b4a-a42d-f167501f597b" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 18:19:06 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-44428875-b33e-488e-a6bf-42ee5f5a45cf tempest-AttachVolumeNegativeTest-483083654 tempest-AttachVolumeNegativeTest-483083654-project-member] Lock "d9f10bfb-5202-4b4a-a42d-f167501f597b" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 18:19:06 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-44428875-b33e-488e-a6bf-42ee5f5a45cf tempest-AttachVolumeNegativeTest-483083654 tempest-AttachVolumeNegativeTest-483083654-project-member] Acquiring lock "d9f10bfb-5202-4b4a-a42d-f167501f597b-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 18:19:06 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-44428875-b33e-488e-a6bf-42ee5f5a45cf tempest-AttachVolumeNegativeTest-483083654 tempest-AttachVolumeNegativeTest-483083654-project-member] Lock "d9f10bfb-5202-4b4a-a42d-f167501f597b-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 18:19:06 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-44428875-b33e-488e-a6bf-42ee5f5a45cf tempest-AttachVolumeNegativeTest-483083654 tempest-AttachVolumeNegativeTest-483083654-project-member] Lock "d9f10bfb-5202-4b4a-a42d-f167501f597b-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 18:19:06 user nova-compute[74613]: INFO nova.compute.manager [None req-44428875-b33e-488e-a6bf-42ee5f5a45cf tempest-AttachVolumeNegativeTest-483083654 tempest-AttachVolumeNegativeTest-483083654-project-member] [instance: d9f10bfb-5202-4b4a-a42d-f167501f597b] Terminating instance
Nov 29 18:19:06 user nova-compute[74613]: DEBUG nova.compute.manager [None req-44428875-b33e-488e-a6bf-42ee5f5a45cf tempest-AttachVolumeNegativeTest-483083654 tempest-AttachVolumeNegativeTest-483083654-project-member] [instance: d9f10bfb-5202-4b4a-a42d-f167501f597b] Start destroying the instance on the hypervisor. {{(pid=74613) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 29 18:19:06 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:19:06 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:19:06 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:19:06 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:19:07 user nova-compute[74613]: DEBUG nova.compute.manager [req-7067d85b-49cc-4b72-a735-746e85d9659c req-c333f730-5546-4160-858e-bef93dd435ad service nova] [instance: d9f10bfb-5202-4b4a-a42d-f167501f597b] Received event network-vif-unplugged-796b80c8-8509-4685-ac3b-6832f110bc9d {{(pid=74613) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 18:19:07 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-7067d85b-49cc-4b72-a735-746e85d9659c req-c333f730-5546-4160-858e-bef93dd435ad service nova] Acquiring lock "d9f10bfb-5202-4b4a-a42d-f167501f597b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 18:19:07 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-7067d85b-49cc-4b72-a735-746e85d9659c req-c333f730-5546-4160-858e-bef93dd435ad service nova] Lock "d9f10bfb-5202-4b4a-a42d-f167501f597b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 18:19:07 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-7067d85b-49cc-4b72-a735-746e85d9659c req-c333f730-5546-4160-858e-bef93dd435ad service nova] Lock "d9f10bfb-5202-4b4a-a42d-f167501f597b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 18:19:07 user nova-compute[74613]: DEBUG nova.compute.manager [req-7067d85b-49cc-4b72-a735-746e85d9659c req-c333f730-5546-4160-858e-bef93dd435ad service nova] [instance: d9f10bfb-5202-4b4a-a42d-f167501f597b] No waiting events found dispatching network-vif-unplugged-796b80c8-8509-4685-ac3b-6832f110bc9d {{(pid=74613) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 18:19:07 user nova-compute[74613]: DEBUG nova.compute.manager [req-7067d85b-49cc-4b72-a735-746e85d9659c req-c333f730-5546-4160-858e-bef93dd435ad service nova] [instance: d9f10bfb-5202-4b4a-a42d-f167501f597b] Received event network-vif-unplugged-796b80c8-8509-4685-ac3b-6832f110bc9d for instance with task_state deleting. {{(pid=74613) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 29 18:19:07 user nova-compute[74613]: DEBUG nova.compute.manager [req-7067d85b-49cc-4b72-a735-746e85d9659c req-c333f730-5546-4160-858e-bef93dd435ad service nova] [instance: d9f10bfb-5202-4b4a-a42d-f167501f597b] Received event network-vif-plugged-796b80c8-8509-4685-ac3b-6832f110bc9d {{(pid=74613) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 18:19:07 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-7067d85b-49cc-4b72-a735-746e85d9659c req-c333f730-5546-4160-858e-bef93dd435ad service nova] Acquiring lock "d9f10bfb-5202-4b4a-a42d-f167501f597b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 18:19:07 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-7067d85b-49cc-4b72-a735-746e85d9659c req-c333f730-5546-4160-858e-bef93dd435ad service nova] Lock "d9f10bfb-5202-4b4a-a42d-f167501f597b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 18:19:07 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-7067d85b-49cc-4b72-a735-746e85d9659c req-c333f730-5546-4160-858e-bef93dd435ad service nova] Lock "d9f10bfb-5202-4b4a-a42d-f167501f597b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 18:19:07 user nova-compute[74613]: DEBUG nova.compute.manager [req-7067d85b-49cc-4b72-a735-746e85d9659c req-c333f730-5546-4160-858e-bef93dd435ad service nova] [instance: d9f10bfb-5202-4b4a-a42d-f167501f597b] No waiting events found dispatching network-vif-plugged-796b80c8-8509-4685-ac3b-6832f110bc9d {{(pid=74613) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 18:19:07 user nova-compute[74613]: WARNING nova.compute.manager [req-7067d85b-49cc-4b72-a735-746e85d9659c req-c333f730-5546-4160-858e-bef93dd435ad service nova] [instance: d9f10bfb-5202-4b4a-a42d-f167501f597b] Received unexpected event network-vif-plugged-796b80c8-8509-4685-ac3b-6832f110bc9d for instance with vm_state active and task_state deleting.
Nov 29 18:19:07 user nova-compute[74613]: INFO nova.virt.libvirt.driver [-] [instance: d9f10bfb-5202-4b4a-a42d-f167501f597b] Instance destroyed successfully.
Nov 29 18:19:07 user nova-compute[74613]: DEBUG nova.objects.instance [None req-44428875-b33e-488e-a6bf-42ee5f5a45cf tempest-AttachVolumeNegativeTest-483083654 tempest-AttachVolumeNegativeTest-483083654-project-member] Lazy-loading 'resources' on Instance uuid d9f10bfb-5202-4b4a-a42d-f167501f597b {{(pid=74613) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 18:19:07 user nova-compute[74613]: DEBUG nova.virt.libvirt.vif [None req-44428875-b33e-488e-a6bf-42ee5f5a45cf tempest-AttachVolumeNegativeTest-483083654 tempest-AttachVolumeNegativeTest-483083654-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T18:16:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-806279909',display_name='tempest-AttachVolumeNegativeTest-server-806279909',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-806279909',id=40,image_ref='4217f428-8d9d-4ee1-9614-642d26d90c46',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMlYJOBz64Wm2/6I5Fa8UIaS4tEJ8gD1GzFZQM3TUBZrixsEKCT/+6PiVLIgj9vYxVXbNvlDvzfxWTszI1rHYqBksKkh7r9w0AAl7FtwHxVzRvvr+RtPF51mwJrZomz2xQ==',key_name='tempest-keypair-2080746392',keypairs=<?>,launch_index=0,launched_at=2023-11-29T18:16:15Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='37b89c13ba1d4a94805d6af69ad26fb8',ramdisk_id='',reservation_id='r-84zr9e26',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='4217f428-8d9d-4ee1-9614-642d26d90c46',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-483083654',owner_user_name='tempest-AttachVolumeNegativeTest-483083654-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-29T18:16:15Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='57b1f3743f0e4cbdae1dab9e4761511e',uuid=d9f10bfb-5202-4b4a-a42d-f167501f597b,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "796b80c8-8509-4685-ac3b-6832f110bc9d", "address": "fa:16:3e:29:a3:f5", "network": {"id": "c317481b-f8cf-40a0-a326-836a5ea4c495", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-887666255-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.178", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "37b89c13ba1d4a94805d6af69ad26fb8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap796b80c8-85", "ovs_interfaceid": "796b80c8-8509-4685-ac3b-6832f110bc9d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74613) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 29 18:19:07 user nova-compute[74613]: DEBUG nova.network.os_vif_util [None req-44428875-b33e-488e-a6bf-42ee5f5a45cf tempest-AttachVolumeNegativeTest-483083654 tempest-AttachVolumeNegativeTest-483083654-project-member] Converting VIF {"id": "796b80c8-8509-4685-ac3b-6832f110bc9d", "address": "fa:16:3e:29:a3:f5", "network": {"id": "c317481b-f8cf-40a0-a326-836a5ea4c495", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-887666255-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.178", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "37b89c13ba1d4a94805d6af69ad26fb8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap796b80c8-85", "ovs_interfaceid": "796b80c8-8509-4685-ac3b-6832f110bc9d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74613) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 18:19:07 user nova-compute[74613]: DEBUG nova.network.os_vif_util [None req-44428875-b33e-488e-a6bf-42ee5f5a45cf tempest-AttachVolumeNegativeTest-483083654 tempest-AttachVolumeNegativeTest-483083654-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:29:a3:f5,bridge_name='br-int',has_traffic_filtering=True,id=796b80c8-8509-4685-ac3b-6832f110bc9d,network=Network(c317481b-f8cf-40a0-a326-836a5ea4c495),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap796b80c8-85') {{(pid=74613) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 18:19:07 user nova-compute[74613]: DEBUG os_vif [None req-44428875-b33e-488e-a6bf-42ee5f5a45cf tempest-AttachVolumeNegativeTest-483083654 tempest-AttachVolumeNegativeTest-483083654-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:29:a3:f5,bridge_name='br-int',has_traffic_filtering=True,id=796b80c8-8509-4685-ac3b-6832f110bc9d,network=Network(c317481b-f8cf-40a0-a326-836a5ea4c495),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap796b80c8-85') {{(pid=74613) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 29 18:19:07 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:19:07 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap796b80c8-85, bridge=br-int, if_exists=True) {{(pid=74613) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 18:19:07 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:19:07 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 18:19:07 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:19:07 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=2bb1cf5f-b3d6-4094-8cd8-da0f097f2c36) {{(pid=74613) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 18:19:07 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:19:07 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 18:19:07 user nova-compute[74613]: INFO os_vif [None req-44428875-b33e-488e-a6bf-42ee5f5a45cf tempest-AttachVolumeNegativeTest-483083654 tempest-AttachVolumeNegativeTest-483083654-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:29:a3:f5,bridge_name='br-int',has_traffic_filtering=True,id=796b80c8-8509-4685-ac3b-6832f110bc9d,network=Network(c317481b-f8cf-40a0-a326-836a5ea4c495),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap796b80c8-85')
Nov 29 18:19:07 user nova-compute[74613]: INFO nova.virt.libvirt.driver [None req-44428875-b33e-488e-a6bf-42ee5f5a45cf tempest-AttachVolumeNegativeTest-483083654 tempest-AttachVolumeNegativeTest-483083654-project-member] [instance: d9f10bfb-5202-4b4a-a42d-f167501f597b] Deleting instance files /opt/stack/data/nova/instances/d9f10bfb-5202-4b4a-a42d-f167501f597b_del
Nov 29 18:19:07 user nova-compute[74613]: INFO nova.virt.libvirt.driver [None req-44428875-b33e-488e-a6bf-42ee5f5a45cf tempest-AttachVolumeNegativeTest-483083654 tempest-AttachVolumeNegativeTest-483083654-project-member] [instance: d9f10bfb-5202-4b4a-a42d-f167501f597b] Deletion of /opt/stack/data/nova/instances/d9f10bfb-5202-4b4a-a42d-f167501f597b_del complete
Nov 29 18:19:07 user nova-compute[74613]: INFO nova.compute.manager [None req-44428875-b33e-488e-a6bf-42ee5f5a45cf tempest-AttachVolumeNegativeTest-483083654 tempest-AttachVolumeNegativeTest-483083654-project-member] [instance: d9f10bfb-5202-4b4a-a42d-f167501f597b] Took 1.11 seconds to destroy the instance on the hypervisor.
Nov 29 18:19:07 user nova-compute[74613]: DEBUG oslo.service.loopingcall [None req-44428875-b33e-488e-a6bf-42ee5f5a45cf tempest-AttachVolumeNegativeTest-483083654 tempest-AttachVolumeNegativeTest-483083654-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74613) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 29 18:19:07 user nova-compute[74613]: DEBUG nova.compute.manager [-] [instance: d9f10bfb-5202-4b4a-a42d-f167501f597b] Deallocating network for instance {{(pid=74613) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 29 18:19:07 user nova-compute[74613]: DEBUG nova.network.neutron [-] [instance: d9f10bfb-5202-4b4a-a42d-f167501f597b] deallocate_for_instance() {{(pid=74613) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 29 18:19:08 user nova-compute[74613]: DEBUG nova.network.neutron [-] [instance: d9f10bfb-5202-4b4a-a42d-f167501f597b] Updating instance_info_cache with network_info: [] {{(pid=74613) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 18:19:08 user nova-compute[74613]: INFO nova.compute.manager [-] [instance: d9f10bfb-5202-4b4a-a42d-f167501f597b] Took 0.75 seconds to deallocate network for instance.
Nov 29 18:19:08 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-44428875-b33e-488e-a6bf-42ee5f5a45cf tempest-AttachVolumeNegativeTest-483083654 tempest-AttachVolumeNegativeTest-483083654-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 18:19:08 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-44428875-b33e-488e-a6bf-42ee5f5a45cf tempest-AttachVolumeNegativeTest-483083654 tempest-AttachVolumeNegativeTest-483083654-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 18:19:08 user nova-compute[74613]: DEBUG nova.compute.provider_tree [None req-44428875-b33e-488e-a6bf-42ee5f5a45cf tempest-AttachVolumeNegativeTest-483083654 tempest-AttachVolumeNegativeTest-483083654-project-member] Inventory has not changed in ProviderTree for provider: 639d980e-3b12-44b1-b8f4-1812416fa4dd {{(pid=74613) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 18:19:08 user nova-compute[74613]: DEBUG nova.scheduler.client.report [None req-44428875-b33e-488e-a6bf-42ee5f5a45cf tempest-AttachVolumeNegativeTest-483083654 tempest-AttachVolumeNegativeTest-483083654-project-member] Inventory has not changed for provider 639d980e-3b12-44b1-b8f4-1812416fa4dd based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74613) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 18:19:08 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-44428875-b33e-488e-a6bf-42ee5f5a45cf tempest-AttachVolumeNegativeTest-483083654 tempest-AttachVolumeNegativeTest-483083654-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.278s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 18:19:08 user nova-compute[74613]: INFO nova.scheduler.client.report [None req-44428875-b33e-488e-a6bf-42ee5f5a45cf tempest-AttachVolumeNegativeTest-483083654 tempest-AttachVolumeNegativeTest-483083654-project-member] Deleted allocations for instance d9f10bfb-5202-4b4a-a42d-f167501f597b
Nov 29 18:19:08 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-44428875-b33e-488e-a6bf-42ee5f5a45cf tempest-AttachVolumeNegativeTest-483083654 tempest-AttachVolumeNegativeTest-483083654-project-member] Lock "d9f10bfb-5202-4b4a-a42d-f167501f597b" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.316s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 18:19:09 user nova-compute[74613]: DEBUG nova.compute.manager [req-10be99e2-79de-457a-a013-441766fc544e req-ec7a001d-bc24-4d34-a815-3752a1193189 service nova] [instance: d9f10bfb-5202-4b4a-a42d-f167501f597b] Received event network-vif-deleted-796b80c8-8509-4685-ac3b-6832f110bc9d {{(pid=74613) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 18:19:10 user nova-compute[74613]: WARNING nova.virt.libvirt.driver [None req-d218b210-0dea-428e-9f7d-9a4db037c2b1 tempest-AttachVolumeTestJSON-813984703 tempest-AttachVolumeTestJSON-813984703-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance b2c3eb4f-df1f-46d0-acb5-3ac9f16f9a82 is timed out.
Nov 29 18:19:10 user nova-compute[74613]: INFO nova.virt.libvirt.driver [None req-d218b210-0dea-428e-9f7d-9a4db037c2b1 tempest-AttachVolumeTestJSON-813984703 tempest-AttachVolumeTestJSON-813984703-project-member] Successfully detached device vdb from instance b2c3eb4f-df1f-46d0-acb5-3ac9f16f9a82 from the live domain config.
Nov 29 18:19:10 user nova-compute[74613]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d218b210-0dea-428e-9f7d-9a4db037c2b1 tempest-AttachVolumeTestJSON-813984703 tempest-AttachVolumeTestJSON-813984703-project-member] [instance: b2c3eb4f-df1f-46d0-acb5-3ac9f16f9a82] calling os-brick to detach iSCSI Volume {{(pid=74613) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 29 18:19:10 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-d218b210-0dea-428e-9f7d-9a4db037c2b1 tempest-AttachVolumeTestJSON-813984703 tempest-AttachVolumeTestJSON-813984703-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff828156890>, {'target_iqn': 'iqn.2010-10.org.openstack:9f9a0824-5da8-4aaa-bc2e-56c2f8688051', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QSNOVzpF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': False}}" {{(pid=74613) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 18:19:10 user nova-compute[74613]: WARNING os_brick.initiator.connectors.base [None req-d218b210-0dea-428e-9f7d-9a4db037c2b1 tempest-AttachVolumeTestJSON-813984703 tempest-AttachVolumeTestJSON-813984703-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 18:19:10 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.base [None req-d218b210-0dea-428e-9f7d-9a4db037c2b1 tempest-AttachVolumeTestJSON-813984703 tempest-AttachVolumeTestJSON-813984703-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 18:19:10 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.base [None req-d218b210-0dea-428e-9f7d-9a4db037c2b1 tempest-AttachVolumeTestJSON-813984703 tempest-AttachVolumeTestJSON-813984703-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.003s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 18:19:10 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:19:10 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:19:10 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3ce21fa-8108-48d8-bfe1-c14884821123]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:b4661fe9-8f60-4595-bc5b-6671702802af\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:5d74e565-9547-4f44-8005-0615d625a275\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:9f9a0824-5da8-4aaa-bc2e-56c2f8688051\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:15659ea3-d18c-4cae-ba54-13c3fdcacd03\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 18:19:10 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-d218b210-0dea-428e-9f7d-9a4db037c2b1 tempest-AttachVolumeTestJSON-813984703 tempest-AttachVolumeTestJSON-813984703-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 29 18:19:10 user nova-compute[74613]: No targets found.
Nov 29 18:19:10 user nova-compute[74613]: iSNS:
Nov 29 18:19:10 user nova-compute[74613]: No targets found.
Nov 29 18:19:10 user nova-compute[74613]: STATIC:
Nov 29 18:19:10 user nova-compute[74613]: Target: iqn.2010-10.org.openstack:b4661fe9-8f60-4595-bc5b-6671702802af
Nov 29 18:19:10 user nova-compute[74613]:         Portal: 172.16.0.220:3260,-1
Nov 29 18:19:10 user nova-compute[74613]:                 Iface Name: default
Nov 29 18:19:10 user nova-compute[74613]: Target: iqn.2010-10.org.openstack:5d74e565-9547-4f44-8005-0615d625a275
Nov 29 18:19:10 user nova-compute[74613]:         Portal: 172.16.0.220:3260,-1
Nov 29 18:19:10 user nova-compute[74613]:                 Iface Name: default
Nov 29 18:19:10 user nova-compute[74613]: Target: iqn.2010-10.org.openstack:9f9a0824-5da8-4aaa-bc2e-56c2f8688051
Nov 29 18:19:10 user nova-compute[74613]:         Portal: 172.16.0.220:3260,-1
Nov 29 18:19:10 user nova-compute[74613]:                 Iface Name: default
Nov 29 18:19:10 user nova-compute[74613]: Target: iqn.2010-10.org.openstack:15659ea3-d18c-4cae-ba54-13c3fdcacd03
Nov 29 18:19:10 user nova-compute[74613]:         Portal: 172.16.0.220:3260,-1
Nov 29 18:19:10 user nova-compute[74613]:                 Iface Name: default
Nov 29 18:19:10 user nova-compute[74613]: FIRMWARE:
Nov 29 18:19:10 user nova-compute[74613]: No targets found.
Nov 29 18:19:10 user nova-compute[74613]:  stderr= {{(pid=74613) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 18:19:10 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-d218b210-0dea-428e-9f7d-9a4db037c2b1 tempest-AttachVolumeTestJSON-813984703 tempest-AttachVolumeTestJSON-813984703-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 29 18:19:10 user nova-compute[74613]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 29 18:19:10 user nova-compute[74613]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74613) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 29 18:19:10 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-d218b210-0dea-428e-9f7d-9a4db037c2b1 tempest-AttachVolumeTestJSON-813984703 tempest-AttachVolumeTestJSON-813984703-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9f9a0824-5da8-4aaa-bc2e-56c2f8688051', 0)] {{(pid=74613) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 29 18:19:10 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:19:10 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:19:10 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f4ba489-3ed7-4357-9cfe-c3a451e43755]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:15659ea3-d18c-4cae-ba54-13c3fdcacd03\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5d74e565-9547-4f44-8005-0615d625a275\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9f9a0824-5da8-4aaa-bc2e-56c2f8688051\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b4661fe9-8f60-4595-bc5b-6671702802af\n', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 18:19:10 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:19:10 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:19:10 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a33eb1f-2bf3-45ff-bf58-1c15ff4469a7]: (4, ('tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d74e565-9547-4f44-8005-0615d625a275 (non-flash)\ntcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f9a0824-5da8-4aaa-bc2e-56c2f8688051 (non-flash)\ntcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15659ea3-d18c-4cae-ba54-13c3fdcacd03 (non-flash)\ntcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4661fe9-8f60-4595-bc5b-6671702802af (non-flash)\n', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 18:19:10 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-d218b210-0dea-428e-9f7d-9a4db037c2b1 tempest-AttachVolumeTestJSON-813984703 tempest-AttachVolumeTestJSON-813984703-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d74e565-9547-4f44-8005-0615d625a275 (non-flash)
Nov 29 18:19:10 user nova-compute[74613]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f9a0824-5da8-4aaa-bc2e-56c2f8688051 (non-flash)
Nov 29 18:19:10 user nova-compute[74613]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15659ea3-d18c-4cae-ba54-13c3fdcacd03 (non-flash)
Nov 29 18:19:10 user nova-compute[74613]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4661fe9-8f60-4595-bc5b-6671702802af (non-flash)
Nov 29 18:19:10 user nova-compute[74613]:  stderr= {{(pid=74613) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 18:19:10 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-d218b210-0dea-428e-9f7d-9a4db037c2b1 tempest-AttachVolumeTestJSON-813984703 tempest-AttachVolumeTestJSON-813984703-project-member] iscsi session list stdout=tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d74e565-9547-4f44-8005-0615d625a275 (non-flash)
Nov 29 18:19:10 user nova-compute[74613]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f9a0824-5da8-4aaa-bc2e-56c2f8688051 (non-flash)
Nov 29 18:19:10 user nova-compute[74613]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15659ea3-d18c-4cae-ba54-13c3fdcacd03 (non-flash)
Nov 29 18:19:10 user nova-compute[74613]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4661fe9-8f60-4595-bc5b-6671702802af (non-flash)
Nov 29 18:19:10 user nova-compute[74613]:  stderr= {{(pid=74613) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 18:19:10 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-d218b210-0dea-428e-9f7d-9a4db037c2b1 tempest-AttachVolumeTestJSON-813984703 tempest-AttachVolumeTestJSON-813984703-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7ff7f868b520>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9f9a0824-5da8-4aaa-bc2e-56c2f8688051'): ({'sde'}, set())}) {{(pid=74613) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 29 18:19:10 user nova-compute[74613]: DEBUG os_brick.initiator.linuxscsi [None req-d218b210-0dea-428e-9f7d-9a4db037c2b1 tempest-AttachVolumeTestJSON-813984703 tempest-AttachVolumeTestJSON-813984703-project-member] Removing single pathed devices sde {{(pid=74613) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 29 18:19:10 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:19:10 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:19:10 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[42c5ba06-90a9-42f7-ac29-f97dc33130c4]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 18:19:10 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:19:10 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.018s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:19:10 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[a29bfa40-f3ec-42bf-b8ae-8c9089daed8a]: (4, ('ok\n', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 18:19:10 user nova-compute[74613]: DEBUG os_brick.initiator.linuxscsi [None req-d218b210-0dea-428e-9f7d-9a4db037c2b1 tempest-AttachVolumeTestJSON-813984703 tempest-AttachVolumeTestJSON-813984703-project-member] Flushing IO for device /dev/sde {{(pid=74613) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 29 18:19:10 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:19:10 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.012s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:19:10 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[409d7f1d-6c0b-492e-9dcc-059b96665151]: (4, ('', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 18:19:10 user nova-compute[74613]: DEBUG os_brick.initiator.linuxscsi [None req-d218b210-0dea-428e-9f7d-9a4db037c2b1 tempest-AttachVolumeTestJSON-813984703 tempest-AttachVolumeTestJSON-813984703-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=74613) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 29 18:19:10 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:19:10 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.046s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:19:10 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[46e3b868-6131-49da-9e90-118e2fbcf7e4]: (4, ('1', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 18:19:10 user nova-compute[74613]: DEBUG os_brick.initiator.linuxscsi [None req-d218b210-0dea-428e-9f7d-9a4db037c2b1 tempest-AttachVolumeTestJSON-813984703 tempest-AttachVolumeTestJSON-813984703-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=74613) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 29 18:19:10 user nova-compute[74613]: DEBUG os_brick.initiator.linuxscsi [None req-d218b210-0dea-428e-9f7d-9a4db037c2b1 tempest-AttachVolumeTestJSON-813984703 tempest-AttachVolumeTestJSON-813984703-project-member] SCSI volumes sde have been removed. {{(pid=74613) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 29 18:19:10 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-d218b210-0dea-428e-9f7d-9a4db037c2b1 tempest-AttachVolumeTestJSON-813984703 tempest-AttachVolumeTestJSON-813984703-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9f9a0824-5da8-4aaa-bc2e-56c2f8688051')] {{(pid=74613) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 29 18:19:10 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9f9a0824-5da8-4aaa-bc2e-56c2f8688051 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:19:10 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9f9a0824-5da8-4aaa-bc2e-56c2f8688051 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.017s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:19:10 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[38235535-04f3-4fca-a761-ca9042bf50cf]: (4, ('', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 18:19:10 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-d218b210-0dea-428e-9f7d-9a4db037c2b1 tempest-AttachVolumeTestJSON-813984703 tempest-AttachVolumeTestJSON-813984703-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74613) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 18:19:10 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9f9a0824-5da8-4aaa-bc2e-56c2f8688051 -p 172.16.0.220:3260 --logout {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:19:10 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9f9a0824-5da8-4aaa-bc2e-56c2f8688051 -p 172.16.0.220:3260 --logout" returned: 0 in 0.056s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:19:10 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[a86b46e7-ab0b-4a2f-a9a8-c6ec2e6c4fca]: (4, ('Logging out of session [sid: 47, target: iqn.2010-10.org.openstack:9f9a0824-5da8-4aaa-bc2e-56c2f8688051, portal: 172.16.0.220,3260]\nLogout of [sid: 47, target: iqn.2010-10.org.openstack:9f9a0824-5da8-4aaa-bc2e-56c2f8688051, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 18:19:10 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-d218b210-0dea-428e-9f7d-9a4db037c2b1 tempest-AttachVolumeTestJSON-813984703 tempest-AttachVolumeTestJSON-813984703-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 47, target: iqn.2010-10.org.openstack:9f9a0824-5da8-4aaa-bc2e-56c2f8688051, portal: 172.16.0.220,3260]
Nov 29 18:19:10 user nova-compute[74613]: Logout of [sid: 47, target: iqn.2010-10.org.openstack:9f9a0824-5da8-4aaa-bc2e-56c2f8688051, portal: 172.16.0.220,3260] successful.
Nov 29 18:19:10 user nova-compute[74613]:  stderr= {{(pid=74613) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 18:19:10 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9f9a0824-5da8-4aaa-bc2e-56c2f8688051 -p 172.16.0.220:3260 --op delete {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:19:10 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9f9a0824-5da8-4aaa-bc2e-56c2f8688051 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.024s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:19:10 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e288abc-e3fa-477c-8991-d66bbf7e23ba]: (4, ('', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 18:19:10 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-d218b210-0dea-428e-9f7d-9a4db037c2b1 tempest-AttachVolumeTestJSON-813984703 tempest-AttachVolumeTestJSON-813984703-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74613) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 18:19:10 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.base [None req-d218b210-0dea-428e-9f7d-9a4db037c2b1 tempest-AttachVolumeTestJSON-813984703 tempest-AttachVolumeTestJSON-813984703-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.292s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 18:19:10 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-d218b210-0dea-428e-9f7d-9a4db037c2b1 tempest-AttachVolumeTestJSON-813984703 tempest-AttachVolumeTestJSON-813984703-project-member] <== disconnect_volume: return (295ms) None {{(pid=74613) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 18:19:10 user nova-compute[74613]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d218b210-0dea-428e-9f7d-9a4db037c2b1 tempest-AttachVolumeTestJSON-813984703 tempest-AttachVolumeTestJSON-813984703-project-member] [instance: b2c3eb4f-df1f-46d0-acb5-3ac9f16f9a82] Disconnected iSCSI Volume {{(pid=74613) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 29 18:19:11 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:19:11 user nova-compute[74613]: DEBUG nova.objects.instance [None req-d218b210-0dea-428e-9f7d-9a4db037c2b1 tempest-AttachVolumeTestJSON-813984703 tempest-AttachVolumeTestJSON-813984703-project-member] Lazy-loading 'flavor' on Instance uuid b2c3eb4f-df1f-46d0-acb5-3ac9f16f9a82 {{(pid=74613) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 18:19:11 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-d218b210-0dea-428e-9f7d-9a4db037c2b1 tempest-AttachVolumeTestJSON-813984703 tempest-AttachVolumeTestJSON-813984703-project-member] Lock "b2c3eb4f-df1f-46d0-acb5-3ac9f16f9a82" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.752s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 18:19:11 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Lock "b2c3eb4f-df1f-46d0-acb5-3ac9f16f9a82" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 18.820s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 18:19:11 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Lock "b2c3eb4f-df1f-46d0-acb5-3ac9f16f9a82" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.025s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 18:19:12 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-6d507cde-fc2e-47d5-8138-1557b95ec426 tempest-AttachVolumeTestJSON-813984703 tempest-AttachVolumeTestJSON-813984703-project-member] Acquiring lock "b2c3eb4f-df1f-46d0-acb5-3ac9f16f9a82" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 18:19:12 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-6d507cde-fc2e-47d5-8138-1557b95ec426 tempest-AttachVolumeTestJSON-813984703 tempest-AttachVolumeTestJSON-813984703-project-member] Lock "b2c3eb4f-df1f-46d0-acb5-3ac9f16f9a82" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 18:19:12 user nova-compute[74613]: INFO nova.compute.manager [None req-6d507cde-fc2e-47d5-8138-1557b95ec426 tempest-AttachVolumeTestJSON-813984703 tempest-AttachVolumeTestJSON-813984703-project-member] [instance: b2c3eb4f-df1f-46d0-acb5-3ac9f16f9a82] Detaching volume 15659ea3-d18c-4cae-ba54-13c3fdcacd03
Nov 29 18:19:12 user nova-compute[74613]: INFO nova.virt.block_device [None req-6d507cde-fc2e-47d5-8138-1557b95ec426 tempest-AttachVolumeTestJSON-813984703 tempest-AttachVolumeTestJSON-813984703-project-member] [instance: b2c3eb4f-df1f-46d0-acb5-3ac9f16f9a82] Attempting to driver detach volume 15659ea3-d18c-4cae-ba54-13c3fdcacd03 from mountpoint /dev/vdc
Nov 29 18:19:12 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-6d507cde-fc2e-47d5-8138-1557b95ec426 tempest-AttachVolumeTestJSON-813984703 tempest-AttachVolumeTestJSON-813984703-project-member] Attempting to detach device vdc from instance b2c3eb4f-df1f-46d0-acb5-3ac9f16f9a82 from the persistent domain config. {{(pid=74613) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 29 18:19:12 user nova-compute[74613]: DEBUG nova.virt.libvirt.guest [None req-6d507cde-fc2e-47d5-8138-1557b95ec426 tempest-AttachVolumeTestJSON-813984703 tempest-AttachVolumeTestJSON-813984703-project-member] detach device xml: <disk type="block" device="disk">
Nov 29 18:19:12 user nova-compute[74613]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 18:19:12 user nova-compute[74613]:   <source dev="/dev/sdd"/>
Nov 29 18:19:12 user nova-compute[74613]:   <target dev="vdc" bus="virtio"/>
Nov 29 18:19:12 user nova-compute[74613]:   <serial>15659ea3-d18c-4cae-ba54-13c3fdcacd03</serial>
Nov 29 18:19:12 user nova-compute[74613]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Nov 29 18:19:12 user nova-compute[74613]: </disk>
Nov 29 18:19:12 user nova-compute[74613]:  {{(pid=74613) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 29 18:19:12 user nova-compute[74613]: INFO nova.virt.libvirt.driver [None req-6d507cde-fc2e-47d5-8138-1557b95ec426 tempest-AttachVolumeTestJSON-813984703 tempest-AttachVolumeTestJSON-813984703-project-member] Successfully detached device vdc from instance b2c3eb4f-df1f-46d0-acb5-3ac9f16f9a82 from the persistent domain config.
Nov 29 18:19:12 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-6d507cde-fc2e-47d5-8138-1557b95ec426 tempest-AttachVolumeTestJSON-813984703 tempest-AttachVolumeTestJSON-813984703-project-member] (1/8): Attempting to detach device vdc with device alias virtio-disk2 from instance b2c3eb4f-df1f-46d0-acb5-3ac9f16f9a82 from the live domain config. {{(pid=74613) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 29 18:19:12 user nova-compute[74613]: DEBUG nova.virt.libvirt.guest [None req-6d507cde-fc2e-47d5-8138-1557b95ec426 tempest-AttachVolumeTestJSON-813984703 tempest-AttachVolumeTestJSON-813984703-project-member] detach device xml: <disk type="block" device="disk">
Nov 29 18:19:12 user nova-compute[74613]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 18:19:12 user nova-compute[74613]:   <source dev="/dev/sdd"/>
Nov 29 18:19:12 user nova-compute[74613]:   <target dev="vdc" bus="virtio"/>
Nov 29 18:19:12 user nova-compute[74613]:   <serial>15659ea3-d18c-4cae-ba54-13c3fdcacd03</serial>
Nov 29 18:19:12 user nova-compute[74613]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Nov 29 18:19:12 user nova-compute[74613]: </disk>
Nov 29 18:19:12 user nova-compute[74613]:  {{(pid=74613) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 29 18:19:12 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:19:12 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-6d507cde-fc2e-47d5-8138-1557b95ec426 tempest-AttachVolumeTestJSON-813984703 tempest-AttachVolumeTestJSON-813984703-project-member] Start waiting for the detach event from libvirt for device vdc with device alias virtio-disk2 for instance b2c3eb4f-df1f-46d0-acb5-3ac9f16f9a82 {{(pid=74613) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 29 18:19:17 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:19:21 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:19:22 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:19:26 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:19:27 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:19:31 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:19:32 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:19:32 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-51ef2843-d9ff-4b0b-aa21-bcfd1a0e7330 tempest-ServerRescueNegativeTestJSON-1891426908 tempest-ServerRescueNegativeTestJSON-1891426908-project-member] Acquiring lock "1f2b4426-815f-4ef4-b98e-e5124fec93b7" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 18:19:32 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-51ef2843-d9ff-4b0b-aa21-bcfd1a0e7330 tempest-ServerRescueNegativeTestJSON-1891426908 tempest-ServerRescueNegativeTestJSON-1891426908-project-member] Lock "1f2b4426-815f-4ef4-b98e-e5124fec93b7" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 18:19:32 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-51ef2843-d9ff-4b0b-aa21-bcfd1a0e7330 tempest-ServerRescueNegativeTestJSON-1891426908 tempest-ServerRescueNegativeTestJSON-1891426908-project-member] Acquiring lock "1f2b4426-815f-4ef4-b98e-e5124fec93b7-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 18:19:32 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-51ef2843-d9ff-4b0b-aa21-bcfd1a0e7330 tempest-ServerRescueNegativeTestJSON-1891426908 tempest-ServerRescueNegativeTestJSON-1891426908-project-member] Lock "1f2b4426-815f-4ef4-b98e-e5124fec93b7-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 18:19:32 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-51ef2843-d9ff-4b0b-aa21-bcfd1a0e7330 tempest-ServerRescueNegativeTestJSON-1891426908 tempest-ServerRescueNegativeTestJSON-1891426908-project-member] Lock "1f2b4426-815f-4ef4-b98e-e5124fec93b7-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 18:19:32 user nova-compute[74613]: INFO nova.compute.manager [None req-51ef2843-d9ff-4b0b-aa21-bcfd1a0e7330 tempest-ServerRescueNegativeTestJSON-1891426908 tempest-ServerRescueNegativeTestJSON-1891426908-project-member] [instance: 1f2b4426-815f-4ef4-b98e-e5124fec93b7] Terminating instance
Nov 29 18:19:32 user nova-compute[74613]: DEBUG nova.compute.manager [None req-51ef2843-d9ff-4b0b-aa21-bcfd1a0e7330 tempest-ServerRescueNegativeTestJSON-1891426908 tempest-ServerRescueNegativeTestJSON-1891426908-project-member] [instance: 1f2b4426-815f-4ef4-b98e-e5124fec93b7] Start destroying the instance on the hypervisor. {{(pid=74613) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 29 18:19:32 user nova-compute[74613]: WARNING nova.virt.libvirt.driver [None req-6d507cde-fc2e-47d5-8138-1557b95ec426 tempest-AttachVolumeTestJSON-813984703 tempest-AttachVolumeTestJSON-813984703-project-member] Waiting for libvirt event about the detach of device vdc with device alias virtio-disk2 from instance b2c3eb4f-df1f-46d0-acb5-3ac9f16f9a82 is timed out.
Nov 29 18:19:32 user nova-compute[74613]: INFO nova.virt.libvirt.driver [None req-6d507cde-fc2e-47d5-8138-1557b95ec426 tempest-AttachVolumeTestJSON-813984703 tempest-AttachVolumeTestJSON-813984703-project-member] Successfully detached device vdc from instance b2c3eb4f-df1f-46d0-acb5-3ac9f16f9a82 from the live domain config.
Nov 29 18:19:32 user nova-compute[74613]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6d507cde-fc2e-47d5-8138-1557b95ec426 tempest-AttachVolumeTestJSON-813984703 tempest-AttachVolumeTestJSON-813984703-project-member] [instance: b2c3eb4f-df1f-46d0-acb5-3ac9f16f9a82] calling os-brick to detach iSCSI Volume {{(pid=74613) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 29 18:19:32 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d507cde-fc2e-47d5-8138-1557b95ec426 tempest-AttachVolumeTestJSON-813984703 tempest-AttachVolumeTestJSON-813984703-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff828156890>, {'target_iqn': 'iqn.2010-10.org.openstack:15659ea3-d18c-4cae-ba54-13c3fdcacd03', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wqvklJUE', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=74613) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 18:19:32 user nova-compute[74613]: WARNING os_brick.initiator.connectors.base [None req-6d507cde-fc2e-47d5-8138-1557b95ec426 tempest-AttachVolumeTestJSON-813984703 tempest-AttachVolumeTestJSON-813984703-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 18:19:32 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.base [None req-6d507cde-fc2e-47d5-8138-1557b95ec426 tempest-AttachVolumeTestJSON-813984703 tempest-AttachVolumeTestJSON-813984703-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 18:19:32 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.base [None req-6d507cde-fc2e-47d5-8138-1557b95ec426 tempest-AttachVolumeTestJSON-813984703 tempest-AttachVolumeTestJSON-813984703-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 18:19:32 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:19:32 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:19:32 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[4456326b-c6d7-4389-8371-a03df66648a5]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:b4661fe9-8f60-4595-bc5b-6671702802af\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:5d74e565-9547-4f44-8005-0615d625a275\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:15659ea3-d18c-4cae-ba54-13c3fdcacd03\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 18:19:32 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d507cde-fc2e-47d5-8138-1557b95ec426 tempest-AttachVolumeTestJSON-813984703 tempest-AttachVolumeTestJSON-813984703-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 29 18:19:32 user nova-compute[74613]: No targets found.
Nov 29 18:19:32 user nova-compute[74613]: iSNS:
Nov 29 18:19:32 user nova-compute[74613]: No targets found.
Nov 29 18:19:32 user nova-compute[74613]: STATIC:
Nov 29 18:19:32 user nova-compute[74613]: Target: iqn.2010-10.org.openstack:b4661fe9-8f60-4595-bc5b-6671702802af
Nov 29 18:19:32 user nova-compute[74613]:         Portal: 172.16.0.220:3260,-1
Nov 29 18:19:32 user nova-compute[74613]:                 Iface Name: default
Nov 29 18:19:32 user nova-compute[74613]: Target: iqn.2010-10.org.openstack:5d74e565-9547-4f44-8005-0615d625a275
Nov 29 18:19:32 user nova-compute[74613]:         Portal: 172.16.0.220:3260,-1
Nov 29 18:19:32 user nova-compute[74613]:                 Iface Name: default
Nov 29 18:19:32 user nova-compute[74613]: Target: iqn.2010-10.org.openstack:15659ea3-d18c-4cae-ba54-13c3fdcacd03
Nov 29 18:19:32 user nova-compute[74613]:         Portal: 172.16.0.220:3260,-1
Nov 29 18:19:32 user nova-compute[74613]:                 Iface Name: default
Nov 29 18:19:32 user nova-compute[74613]: FIRMWARE:
Nov 29 18:19:32 user nova-compute[74613]: No targets found.
Nov 29 18:19:32 user nova-compute[74613]:  stderr= {{(pid=74613) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 18:19:32 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d507cde-fc2e-47d5-8138-1557b95ec426 tempest-AttachVolumeTestJSON-813984703 tempest-AttachVolumeTestJSON-813984703-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 29 18:19:32 user nova-compute[74613]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 29 18:19:32 user nova-compute[74613]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74613) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 29 18:19:32 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d507cde-fc2e-47d5-8138-1557b95ec426 tempest-AttachVolumeTestJSON-813984703 tempest-AttachVolumeTestJSON-813984703-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:15659ea3-d18c-4cae-ba54-13c3fdcacd03', 0)] {{(pid=74613) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 29 18:19:32 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:19:32 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:19:32 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:19:32 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1e2309d-db3b-4309-bc19-84c1e48ad298]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:15659ea3-d18c-4cae-ba54-13c3fdcacd03\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5d74e565-9547-4f44-8005-0615d625a275\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b4661fe9-8f60-4595-bc5b-6671702802af\n', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 18:19:32 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:19:32 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:19:33 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:19:33 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[12f3242e-8120-4ffb-8f36-029cb470b1e5]: (4, ('tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d74e565-9547-4f44-8005-0615d625a275 (non-flash)\ntcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15659ea3-d18c-4cae-ba54-13c3fdcacd03 (non-flash)\ntcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4661fe9-8f60-4595-bc5b-6671702802af (non-flash)\n', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 18:19:33 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d507cde-fc2e-47d5-8138-1557b95ec426 tempest-AttachVolumeTestJSON-813984703 tempest-AttachVolumeTestJSON-813984703-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d74e565-9547-4f44-8005-0615d625a275 (non-flash)
Nov 29 18:19:33 user nova-compute[74613]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15659ea3-d18c-4cae-ba54-13c3fdcacd03 (non-flash)
Nov 29 18:19:33 user nova-compute[74613]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4661fe9-8f60-4595-bc5b-6671702802af (non-flash)
Nov 29 18:19:33 user nova-compute[74613]:  stderr= {{(pid=74613) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 18:19:33 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d507cde-fc2e-47d5-8138-1557b95ec426 tempest-AttachVolumeTestJSON-813984703 tempest-AttachVolumeTestJSON-813984703-project-member] iscsi session list stdout=tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d74e565-9547-4f44-8005-0615d625a275 (non-flash)
Nov 29 18:19:33 user nova-compute[74613]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15659ea3-d18c-4cae-ba54-13c3fdcacd03 (non-flash)
Nov 29 18:19:33 user nova-compute[74613]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4661fe9-8f60-4595-bc5b-6671702802af (non-flash)
Nov 29 18:19:33 user nova-compute[74613]:  stderr= {{(pid=74613) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 18:19:33 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d507cde-fc2e-47d5-8138-1557b95ec426 tempest-AttachVolumeTestJSON-813984703 tempest-AttachVolumeTestJSON-813984703-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7ff8184f3ac0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:15659ea3-d18c-4cae-ba54-13c3fdcacd03'): ({'sdd'}, set())}) {{(pid=74613) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 29 18:19:33 user nova-compute[74613]: DEBUG os_brick.initiator.linuxscsi [None req-6d507cde-fc2e-47d5-8138-1557b95ec426 tempest-AttachVolumeTestJSON-813984703 tempest-AttachVolumeTestJSON-813984703-project-member] Removing single pathed devices sdd {{(pid=74613) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 29 18:19:33 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:19:33 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:19:33 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e0592e0-7a42-4ac5-8182-e073d2f50058]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 18:19:33 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:19:33 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.019s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:19:33 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[13ccc172-bacb-4a4f-a30b-e3ee93a091a3]: (4, ('ok\n', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 18:19:33 user nova-compute[74613]: DEBUG os_brick.initiator.linuxscsi [None req-6d507cde-fc2e-47d5-8138-1557b95ec426 tempest-AttachVolumeTestJSON-813984703 tempest-AttachVolumeTestJSON-813984703-project-member] Flushing IO for device /dev/sdd {{(pid=74613) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 29 18:19:33 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:19:33 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.014s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:19:33 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[80241957-855d-4fb3-b8a5-938bd4d84cb9]: (4, ('', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 18:19:33 user nova-compute[74613]: DEBUG os_brick.initiator.linuxscsi [None req-6d507cde-fc2e-47d5-8138-1557b95ec426 tempest-AttachVolumeTestJSON-813984703 tempest-AttachVolumeTestJSON-813984703-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=74613) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 29 18:19:33 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:19:33 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.035s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:19:33 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[135d4dfa-db77-4675-99be-962222e83ce5]: (4, ('1', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 18:19:33 user nova-compute[74613]: DEBUG os_brick.initiator.linuxscsi [None req-6d507cde-fc2e-47d5-8138-1557b95ec426 tempest-AttachVolumeTestJSON-813984703 tempest-AttachVolumeTestJSON-813984703-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=74613) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 29 18:19:33 user nova-compute[74613]: DEBUG os_brick.initiator.linuxscsi [None req-6d507cde-fc2e-47d5-8138-1557b95ec426 tempest-AttachVolumeTestJSON-813984703 tempest-AttachVolumeTestJSON-813984703-project-member] SCSI volumes sdd have been removed. {{(pid=74613) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 29 18:19:33 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d507cde-fc2e-47d5-8138-1557b95ec426 tempest-AttachVolumeTestJSON-813984703 tempest-AttachVolumeTestJSON-813984703-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:15659ea3-d18c-4cae-ba54-13c3fdcacd03')] {{(pid=74613) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 29 18:19:33 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:15659ea3-d18c-4cae-ba54-13c3fdcacd03 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:19:33 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:15659ea3-d18c-4cae-ba54-13c3fdcacd03 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:19:33 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[8492de85-c232-4a4d-b53e-ae7eba0f8a81]: (4, ('', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 18:19:33 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d507cde-fc2e-47d5-8138-1557b95ec426 tempest-AttachVolumeTestJSON-813984703 tempest-AttachVolumeTestJSON-813984703-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74613) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 18:19:33 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:15659ea3-d18c-4cae-ba54-13c3fdcacd03 -p 172.16.0.220:3260 --logout {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:19:33 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:15659ea3-d18c-4cae-ba54-13c3fdcacd03 -p 172.16.0.220:3260 --logout" returned: 0 in 0.074s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:19:33 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[47fc23fb-1f45-4920-a538-497592b91e9c]: (4, ('Logging out of session [sid: 48, target: iqn.2010-10.org.openstack:15659ea3-d18c-4cae-ba54-13c3fdcacd03, portal: 172.16.0.220,3260]\nLogout of [sid: 48, target: iqn.2010-10.org.openstack:15659ea3-d18c-4cae-ba54-13c3fdcacd03, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 18:19:33 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d507cde-fc2e-47d5-8138-1557b95ec426 tempest-AttachVolumeTestJSON-813984703 tempest-AttachVolumeTestJSON-813984703-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 48, target: iqn.2010-10.org.openstack:15659ea3-d18c-4cae-ba54-13c3fdcacd03, portal: 172.16.0.220,3260]
Nov 29 18:19:33 user nova-compute[74613]: Logout of [sid: 48, target: iqn.2010-10.org.openstack:15659ea3-d18c-4cae-ba54-13c3fdcacd03, portal: 172.16.0.220,3260] successful.
Nov 29 18:19:33 user nova-compute[74613]:  stderr= {{(pid=74613) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 18:19:33 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:15659ea3-d18c-4cae-ba54-13c3fdcacd03 -p 172.16.0.220:3260 --op delete {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:19:33 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:19:33 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:15659ea3-d18c-4cae-ba54-13c3fdcacd03 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.027s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:19:33 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4c53039-50bf-4322-91e8-5d98cfee93de]: (4, ('', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 18:19:33 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d507cde-fc2e-47d5-8138-1557b95ec426 tempest-AttachVolumeTestJSON-813984703 tempest-AttachVolumeTestJSON-813984703-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74613) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 18:19:33 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.base [None req-6d507cde-fc2e-47d5-8138-1557b95ec426 tempest-AttachVolumeTestJSON-813984703 tempest-AttachVolumeTestJSON-813984703-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.328s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 18:19:33 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d507cde-fc2e-47d5-8138-1557b95ec426 tempest-AttachVolumeTestJSON-813984703 tempest-AttachVolumeTestJSON-813984703-project-member] <== disconnect_volume: return (329ms) None {{(pid=74613) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 18:19:33 user nova-compute[74613]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6d507cde-fc2e-47d5-8138-1557b95ec426 tempest-AttachVolumeTestJSON-813984703 tempest-AttachVolumeTestJSON-813984703-project-member] [instance: b2c3eb4f-df1f-46d0-acb5-3ac9f16f9a82] Disconnected iSCSI Volume {{(pid=74613) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 29 18:19:33 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:19:33 user nova-compute[74613]: DEBUG nova.compute.manager [req-93784489-4660-4906-ab4e-8a12eb2b0651 req-eceede9a-f537-4db1-a15b-c144aa2979b8 service nova] [instance: 1f2b4426-815f-4ef4-b98e-e5124fec93b7] Received event network-vif-unplugged-e89209f3-5532-4ff8-95c7-fb7a3334846a {{(pid=74613) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 18:19:33 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-93784489-4660-4906-ab4e-8a12eb2b0651 req-eceede9a-f537-4db1-a15b-c144aa2979b8 service nova] Acquiring lock "1f2b4426-815f-4ef4-b98e-e5124fec93b7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 18:19:33 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-93784489-4660-4906-ab4e-8a12eb2b0651 req-eceede9a-f537-4db1-a15b-c144aa2979b8 service nova] Lock "1f2b4426-815f-4ef4-b98e-e5124fec93b7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 18:19:33 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-93784489-4660-4906-ab4e-8a12eb2b0651 req-eceede9a-f537-4db1-a15b-c144aa2979b8 service nova] Lock "1f2b4426-815f-4ef4-b98e-e5124fec93b7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 18:19:33 user nova-compute[74613]: DEBUG nova.compute.manager [req-93784489-4660-4906-ab4e-8a12eb2b0651 req-eceede9a-f537-4db1-a15b-c144aa2979b8 service nova] [instance: 1f2b4426-815f-4ef4-b98e-e5124fec93b7] No waiting events found dispatching network-vif-unplugged-e89209f3-5532-4ff8-95c7-fb7a3334846a {{(pid=74613) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 18:19:33 user nova-compute[74613]: DEBUG nova.compute.manager [req-93784489-4660-4906-ab4e-8a12eb2b0651 req-eceede9a-f537-4db1-a15b-c144aa2979b8 service nova] [instance: 1f2b4426-815f-4ef4-b98e-e5124fec93b7] Received event network-vif-unplugged-e89209f3-5532-4ff8-95c7-fb7a3334846a for instance with task_state deleting. {{(pid=74613) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 29 18:19:33 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:19:33 user nova-compute[74613]: INFO nova.virt.libvirt.driver [-] [instance: 1f2b4426-815f-4ef4-b98e-e5124fec93b7] Instance destroyed successfully.
Nov 29 18:19:33 user nova-compute[74613]: DEBUG nova.objects.instance [None req-51ef2843-d9ff-4b0b-aa21-bcfd1a0e7330 tempest-ServerRescueNegativeTestJSON-1891426908 tempest-ServerRescueNegativeTestJSON-1891426908-project-member] Lazy-loading 'resources' on Instance uuid 1f2b4426-815f-4ef4-b98e-e5124fec93b7 {{(pid=74613) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 18:19:33 user nova-compute[74613]: DEBUG nova.virt.libvirt.vif [None req-51ef2843-d9ff-4b0b-aa21-bcfd1a0e7330 tempest-ServerRescueNegativeTestJSON-1891426908 tempest-ServerRescueNegativeTestJSON-1891426908-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T18:12:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1726006672',display_name='tempest-ServerRescueNegativeTestJSON-server-1726006672',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1726006672',id=37,image_ref='4217f428-8d9d-4ee1-9614-642d26d90c46',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMgPoXgDUW7nk75D69xzLfcbvWDEVu3o5D9tsIFqy77Ta+ar2r8agObqLmmaHBpRVe2srT806cnX5IaVx4iIVSCtnRfzPCKkokoW4ZMSXWu1sEMn3RQK+XuNeGnG5ClNRw==',key_name='tempest-keypair-716087799',keypairs=<?>,launch_index=0,launched_at=2023-11-29T18:15:05Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='e6a3eb6ea0294f9da705dca72ec2789a',ramdisk_id='',reservation_id='r-sx0019fy',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='4217f428-8d9d-4ee1-9614-642d26d90c46',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-1891426908',owner_user_name='tempest-ServerRescueNegativeTestJSON-1891426908-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-29T18:16:55Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4e984d45838e441680b9948c213728fb',uuid=1f2b4426-815f-4ef4-b98e-e5124fec93b7,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "e89209f3-5532-4ff8-95c7-fb7a3334846a", "address": "fa:16:3e:98:a3:61", "network": {"id": "db79433c-b21c-4058-b98c-f62822abbf7a", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1715530752-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.251", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e6a3eb6ea0294f9da705dca72ec2789a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape89209f3-55", "ovs_interfaceid": "e89209f3-5532-4ff8-95c7-fb7a3334846a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74613) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 29 18:19:33 user nova-compute[74613]: DEBUG nova.network.os_vif_util [None req-51ef2843-d9ff-4b0b-aa21-bcfd1a0e7330 tempest-ServerRescueNegativeTestJSON-1891426908 tempest-ServerRescueNegativeTestJSON-1891426908-project-member] Converting VIF {"id": "e89209f3-5532-4ff8-95c7-fb7a3334846a", "address": "fa:16:3e:98:a3:61", "network": {"id": "db79433c-b21c-4058-b98c-f62822abbf7a", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1715530752-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.251", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e6a3eb6ea0294f9da705dca72ec2789a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape89209f3-55", "ovs_interfaceid": "e89209f3-5532-4ff8-95c7-fb7a3334846a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74613) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 18:19:33 user nova-compute[74613]: DEBUG nova.network.os_vif_util [None req-51ef2843-d9ff-4b0b-aa21-bcfd1a0e7330 tempest-ServerRescueNegativeTestJSON-1891426908 tempest-ServerRescueNegativeTestJSON-1891426908-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:98:a3:61,bridge_name='br-int',has_traffic_filtering=True,id=e89209f3-5532-4ff8-95c7-fb7a3334846a,network=Network(db79433c-b21c-4058-b98c-f62822abbf7a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape89209f3-55') {{(pid=74613) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 18:19:33 user nova-compute[74613]: DEBUG os_vif [None req-51ef2843-d9ff-4b0b-aa21-bcfd1a0e7330 tempest-ServerRescueNegativeTestJSON-1891426908 tempest-ServerRescueNegativeTestJSON-1891426908-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:98:a3:61,bridge_name='br-int',has_traffic_filtering=True,id=e89209f3-5532-4ff8-95c7-fb7a3334846a,network=Network(db79433c-b21c-4058-b98c-f62822abbf7a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape89209f3-55') {{(pid=74613) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 29 18:19:33 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:19:33 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tape89209f3-55, bridge=br-int, if_exists=True) {{(pid=74613) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 18:19:33 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:19:33 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 18:19:33 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:19:33 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=d84a34d9-6c41-45c4-a04b-536823f0b033) {{(pid=74613) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 18:19:33 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:19:33 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 18:19:33 user nova-compute[74613]: INFO os_vif [None req-51ef2843-d9ff-4b0b-aa21-bcfd1a0e7330 tempest-ServerRescueNegativeTestJSON-1891426908 tempest-ServerRescueNegativeTestJSON-1891426908-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:98:a3:61,bridge_name='br-int',has_traffic_filtering=True,id=e89209f3-5532-4ff8-95c7-fb7a3334846a,network=Network(db79433c-b21c-4058-b98c-f62822abbf7a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape89209f3-55')
Nov 29 18:19:33 user nova-compute[74613]: INFO nova.virt.libvirt.driver [None req-51ef2843-d9ff-4b0b-aa21-bcfd1a0e7330 tempest-ServerRescueNegativeTestJSON-1891426908 tempest-ServerRescueNegativeTestJSON-1891426908-project-member] [instance: 1f2b4426-815f-4ef4-b98e-e5124fec93b7] Deleting instance files /opt/stack/data/nova/instances/1f2b4426-815f-4ef4-b98e-e5124fec93b7_del
Nov 29 18:19:33 user nova-compute[74613]: INFO nova.virt.libvirt.driver [None req-51ef2843-d9ff-4b0b-aa21-bcfd1a0e7330 tempest-ServerRescueNegativeTestJSON-1891426908 tempest-ServerRescueNegativeTestJSON-1891426908-project-member] [instance: 1f2b4426-815f-4ef4-b98e-e5124fec93b7] Deletion of /opt/stack/data/nova/instances/1f2b4426-815f-4ef4-b98e-e5124fec93b7_del complete
Nov 29 18:19:33 user nova-compute[74613]: INFO nova.compute.manager [None req-51ef2843-d9ff-4b0b-aa21-bcfd1a0e7330 tempest-ServerRescueNegativeTestJSON-1891426908 tempest-ServerRescueNegativeTestJSON-1891426908-project-member] [instance: 1f2b4426-815f-4ef4-b98e-e5124fec93b7] Took 0.86 seconds to destroy the instance on the hypervisor.
Nov 29 18:19:33 user nova-compute[74613]: DEBUG oslo.service.loopingcall [None req-51ef2843-d9ff-4b0b-aa21-bcfd1a0e7330 tempest-ServerRescueNegativeTestJSON-1891426908 tempest-ServerRescueNegativeTestJSON-1891426908-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74613) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 29 18:19:33 user nova-compute[74613]: DEBUG nova.compute.manager [-] [instance: 1f2b4426-815f-4ef4-b98e-e5124fec93b7] Deallocating network for instance {{(pid=74613) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 29 18:19:33 user nova-compute[74613]: DEBUG nova.network.neutron [-] [instance: 1f2b4426-815f-4ef4-b98e-e5124fec93b7] deallocate_for_instance() {{(pid=74613) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 29 18:19:34 user nova-compute[74613]: DEBUG nova.objects.instance [None req-6d507cde-fc2e-47d5-8138-1557b95ec426 tempest-AttachVolumeTestJSON-813984703 tempest-AttachVolumeTestJSON-813984703-project-member] Lazy-loading 'flavor' on Instance uuid b2c3eb4f-df1f-46d0-acb5-3ac9f16f9a82 {{(pid=74613) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 18:19:34 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-6d507cde-fc2e-47d5-8138-1557b95ec426 tempest-AttachVolumeTestJSON-813984703 tempest-AttachVolumeTestJSON-813984703-project-member] Lock "b2c3eb4f-df1f-46d0-acb5-3ac9f16f9a82" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.689s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 18:19:34 user nova-compute[74613]: DEBUG nova.network.neutron [-] [instance: 1f2b4426-815f-4ef4-b98e-e5124fec93b7] Updating instance_info_cache with network_info: [] {{(pid=74613) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 18:19:34 user nova-compute[74613]: INFO nova.compute.manager [-] [instance: 1f2b4426-815f-4ef4-b98e-e5124fec93b7] Took 0.70 seconds to deallocate network for instance.
Nov 29 18:19:34 user nova-compute[74613]: DEBUG nova.compute.manager [req-3763ba4d-cd0f-488b-b50b-1d0b61e917a1 req-110dc7f9-bce2-4017-ac01-adc704e91aca service nova] [instance: 1f2b4426-815f-4ef4-b98e-e5124fec93b7] Received event network-vif-deleted-e89209f3-5532-4ff8-95c7-fb7a3334846a {{(pid=74613) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 18:19:34 user nova-compute[74613]: INFO nova.compute.manager [req-3763ba4d-cd0f-488b-b50b-1d0b61e917a1 req-110dc7f9-bce2-4017-ac01-adc704e91aca service nova] [instance: 1f2b4426-815f-4ef4-b98e-e5124fec93b7] Neutron deleted interface e89209f3-5532-4ff8-95c7-fb7a3334846a; detaching it from the instance and deleting it from the info cache
Nov 29 18:19:34 user nova-compute[74613]: DEBUG nova.network.neutron [req-3763ba4d-cd0f-488b-b50b-1d0b61e917a1 req-110dc7f9-bce2-4017-ac01-adc704e91aca service nova] [instance: 1f2b4426-815f-4ef4-b98e-e5124fec93b7] Updating instance_info_cache with network_info: [] {{(pid=74613) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 18:19:34 user nova-compute[74613]: DEBUG nova.compute.manager [req-3763ba4d-cd0f-488b-b50b-1d0b61e917a1 req-110dc7f9-bce2-4017-ac01-adc704e91aca service nova] [instance: 1f2b4426-815f-4ef4-b98e-e5124fec93b7] Detach interface failed, port_id=e89209f3-5532-4ff8-95c7-fb7a3334846a, reason: Instance 1f2b4426-815f-4ef4-b98e-e5124fec93b7 could not be found. {{(pid=74613) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 29 18:19:34 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-51ef2843-d9ff-4b0b-aa21-bcfd1a0e7330 tempest-ServerRescueNegativeTestJSON-1891426908 tempest-ServerRescueNegativeTestJSON-1891426908-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 18:19:34 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-51ef2843-d9ff-4b0b-aa21-bcfd1a0e7330 tempest-ServerRescueNegativeTestJSON-1891426908 tempest-ServerRescueNegativeTestJSON-1891426908-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 18:19:34 user nova-compute[74613]: DEBUG oslo_service.periodic_task [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74613) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 18:19:34 user nova-compute[74613]: DEBUG nova.compute.provider_tree [None req-51ef2843-d9ff-4b0b-aa21-bcfd1a0e7330 tempest-ServerRescueNegativeTestJSON-1891426908 tempest-ServerRescueNegativeTestJSON-1891426908-project-member] Inventory has not changed in ProviderTree for provider: 639d980e-3b12-44b1-b8f4-1812416fa4dd {{(pid=74613) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 18:19:34 user nova-compute[74613]: DEBUG nova.scheduler.client.report [None req-51ef2843-d9ff-4b0b-aa21-bcfd1a0e7330 tempest-ServerRescueNegativeTestJSON-1891426908 tempest-ServerRescueNegativeTestJSON-1891426908-project-member] Inventory has not changed for provider 639d980e-3b12-44b1-b8f4-1812416fa4dd based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74613) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 18:19:34 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-51ef2843-d9ff-4b0b-aa21-bcfd1a0e7330 tempest-ServerRescueNegativeTestJSON-1891426908 tempest-ServerRescueNegativeTestJSON-1891426908-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.221s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 18:19:34 user nova-compute[74613]: INFO nova.scheduler.client.report [None req-51ef2843-d9ff-4b0b-aa21-bcfd1a0e7330 tempest-ServerRescueNegativeTestJSON-1891426908 tempest-ServerRescueNegativeTestJSON-1891426908-project-member] Deleted allocations for instance 1f2b4426-815f-4ef4-b98e-e5124fec93b7
Nov 29 18:19:34 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-51ef2843-d9ff-4b0b-aa21-bcfd1a0e7330 tempest-ServerRescueNegativeTestJSON-1891426908 tempest-ServerRescueNegativeTestJSON-1891426908-project-member] Lock "1f2b4426-815f-4ef4-b98e-e5124fec93b7" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.956s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 18:19:35 user nova-compute[74613]: DEBUG nova.compute.manager [req-a916f2a7-c894-44ab-94e8-155299336d5f req-74a83859-3cd3-4595-a37b-b67610ffdffb service nova] [instance: 1f2b4426-815f-4ef4-b98e-e5124fec93b7] Received event network-vif-plugged-e89209f3-5532-4ff8-95c7-fb7a3334846a {{(pid=74613) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 18:19:35 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-a916f2a7-c894-44ab-94e8-155299336d5f req-74a83859-3cd3-4595-a37b-b67610ffdffb service nova] Acquiring lock "1f2b4426-815f-4ef4-b98e-e5124fec93b7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 18:19:35 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-a916f2a7-c894-44ab-94e8-155299336d5f req-74a83859-3cd3-4595-a37b-b67610ffdffb service nova] Lock "1f2b4426-815f-4ef4-b98e-e5124fec93b7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 18:19:35 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-a916f2a7-c894-44ab-94e8-155299336d5f req-74a83859-3cd3-4595-a37b-b67610ffdffb service nova] Lock "1f2b4426-815f-4ef4-b98e-e5124fec93b7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 18:19:35 user nova-compute[74613]: DEBUG nova.compute.manager [req-a916f2a7-c894-44ab-94e8-155299336d5f req-74a83859-3cd3-4595-a37b-b67610ffdffb service nova] [instance: 1f2b4426-815f-4ef4-b98e-e5124fec93b7] No waiting events found dispatching network-vif-plugged-e89209f3-5532-4ff8-95c7-fb7a3334846a {{(pid=74613) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 18:19:35 user nova-compute[74613]: WARNING nova.compute.manager [req-a916f2a7-c894-44ab-94e8-155299336d5f req-74a83859-3cd3-4595-a37b-b67610ffdffb service nova] [instance: 1f2b4426-815f-4ef4-b98e-e5124fec93b7] Received unexpected event network-vif-plugged-e89209f3-5532-4ff8-95c7-fb7a3334846a for instance with vm_state deleted and task_state None.
Nov 29 18:19:35 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-a98fb043-a2a1-4c96-b944-e8b4b389942f tempest-AttachVolumeTestJSON-813984703 tempest-AttachVolumeTestJSON-813984703-project-member] Acquiring lock "b2c3eb4f-df1f-46d0-acb5-3ac9f16f9a82" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 18:19:35 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-a98fb043-a2a1-4c96-b944-e8b4b389942f tempest-AttachVolumeTestJSON-813984703 tempest-AttachVolumeTestJSON-813984703-project-member] Lock "b2c3eb4f-df1f-46d0-acb5-3ac9f16f9a82" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 18:19:35 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-a98fb043-a2a1-4c96-b944-e8b4b389942f tempest-AttachVolumeTestJSON-813984703 tempest-AttachVolumeTestJSON-813984703-project-member] Acquiring lock "b2c3eb4f-df1f-46d0-acb5-3ac9f16f9a82-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 18:19:35 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-a98fb043-a2a1-4c96-b944-e8b4b389942f tempest-AttachVolumeTestJSON-813984703 tempest-AttachVolumeTestJSON-813984703-project-member] Lock "b2c3eb4f-df1f-46d0-acb5-3ac9f16f9a82-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 18:19:35 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-a98fb043-a2a1-4c96-b944-e8b4b389942f tempest-AttachVolumeTestJSON-813984703 tempest-AttachVolumeTestJSON-813984703-project-member] Lock "b2c3eb4f-df1f-46d0-acb5-3ac9f16f9a82-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 18:19:35 user nova-compute[74613]: INFO nova.compute.manager [None req-a98fb043-a2a1-4c96-b944-e8b4b389942f tempest-AttachVolumeTestJSON-813984703 tempest-AttachVolumeTestJSON-813984703-project-member] [instance: b2c3eb4f-df1f-46d0-acb5-3ac9f16f9a82] Terminating instance
Nov 29 18:19:35 user nova-compute[74613]: DEBUG nova.compute.manager [None req-a98fb043-a2a1-4c96-b944-e8b4b389942f tempest-AttachVolumeTestJSON-813984703 tempest-AttachVolumeTestJSON-813984703-project-member] [instance: b2c3eb4f-df1f-46d0-acb5-3ac9f16f9a82] Start destroying the instance on the hypervisor. {{(pid=74613) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 29 18:19:35 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:19:35 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:19:35 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:19:35 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:19:36 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:19:36 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:19:36 user nova-compute[74613]: INFO nova.virt.libvirt.driver [-] [instance: b2c3eb4f-df1f-46d0-acb5-3ac9f16f9a82] Instance destroyed successfully.
Nov 29 18:19:36 user nova-compute[74613]: DEBUG nova.objects.instance [None req-a98fb043-a2a1-4c96-b944-e8b4b389942f tempest-AttachVolumeTestJSON-813984703 tempest-AttachVolumeTestJSON-813984703-project-member] Lazy-loading 'resources' on Instance uuid b2c3eb4f-df1f-46d0-acb5-3ac9f16f9a82 {{(pid=74613) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 18:19:36 user nova-compute[74613]: DEBUG nova.virt.libvirt.vif [None req-a98fb043-a2a1-4c96-b944-e8b4b389942f tempest-AttachVolumeTestJSON-813984703 tempest-AttachVolumeTestJSON-813984703-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T18:16:31Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-373129504',display_name='tempest-AttachVolumeTestJSON-server-373129504',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-373129504',id=41,image_ref='4217f428-8d9d-4ee1-9614-642d26d90c46',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMySlviB2/wALpHmBnkFRvVz+D0DjciNjbWazEDlnUkezbm7EUGMgPEN6igBxid/jqpeuxxCe/TMFczNx3o5Rh5Oacj6fj/BIq5winKQr76MzAVjsrs0ukh3Vt2Fzwkg/g==',key_name='tempest-keypair-1002611988',keypairs=<?>,launch_index=0,launched_at=2023-11-29T18:16:38Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='b5dc39bc30d84269a7ad073867e36436',ramdisk_id='',reservation_id='r-tq9c0o6r',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='4217f428-8d9d-4ee1-9614-642d26d90c46',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-813984703',owner_user_name='tempest-AttachVolumeTestJSON-813984703-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-29T18:16:38Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='14808f06536f477b8a2b413e3cf9d18f',uuid=b2c3eb4f-df1f-46d0-acb5-3ac9f16f9a82,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "d2959064-4006-4ab9-b71f-f6a391cbffcf", "address": "fa:16:3e:4d:ba:5c", "network": {"id": "21147bc8-b1ac-40d5-8fc0-8dab8ade1ff5", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1502381061-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.62", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b5dc39bc30d84269a7ad073867e36436", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd2959064-40", "ovs_interfaceid": "d2959064-4006-4ab9-b71f-f6a391cbffcf", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74613) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 29 18:19:36 user nova-compute[74613]: DEBUG nova.network.os_vif_util [None req-a98fb043-a2a1-4c96-b944-e8b4b389942f tempest-AttachVolumeTestJSON-813984703 tempest-AttachVolumeTestJSON-813984703-project-member] Converting VIF {"id": "d2959064-4006-4ab9-b71f-f6a391cbffcf", "address": "fa:16:3e:4d:ba:5c", "network": {"id": "21147bc8-b1ac-40d5-8fc0-8dab8ade1ff5", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1502381061-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.62", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b5dc39bc30d84269a7ad073867e36436", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd2959064-40", "ovs_interfaceid": "d2959064-4006-4ab9-b71f-f6a391cbffcf", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74613) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 18:19:36 user nova-compute[74613]: DEBUG nova.network.os_vif_util [None req-a98fb043-a2a1-4c96-b944-e8b4b389942f tempest-AttachVolumeTestJSON-813984703 tempest-AttachVolumeTestJSON-813984703-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:4d:ba:5c,bridge_name='br-int',has_traffic_filtering=True,id=d2959064-4006-4ab9-b71f-f6a391cbffcf,network=Network(21147bc8-b1ac-40d5-8fc0-8dab8ade1ff5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd2959064-40') {{(pid=74613) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 18:19:36 user nova-compute[74613]: DEBUG os_vif [None req-a98fb043-a2a1-4c96-b944-e8b4b389942f tempest-AttachVolumeTestJSON-813984703 tempest-AttachVolumeTestJSON-813984703-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:4d:ba:5c,bridge_name='br-int',has_traffic_filtering=True,id=d2959064-4006-4ab9-b71f-f6a391cbffcf,network=Network(21147bc8-b1ac-40d5-8fc0-8dab8ade1ff5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd2959064-40') {{(pid=74613) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 29 18:19:36 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:19:36 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapd2959064-40, bridge=br-int, if_exists=True) {{(pid=74613) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 18:19:36 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:19:36 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 18:19:36 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:19:36 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=fe049fc6-1a46-44a9-b0c6-98b55fc05f5b) {{(pid=74613) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 18:19:36 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:19:36 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 18:19:36 user nova-compute[74613]: INFO os_vif [None req-a98fb043-a2a1-4c96-b944-e8b4b389942f tempest-AttachVolumeTestJSON-813984703 tempest-AttachVolumeTestJSON-813984703-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:4d:ba:5c,bridge_name='br-int',has_traffic_filtering=True,id=d2959064-4006-4ab9-b71f-f6a391cbffcf,network=Network(21147bc8-b1ac-40d5-8fc0-8dab8ade1ff5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd2959064-40')
Nov 29 18:19:36 user nova-compute[74613]: INFO nova.virt.libvirt.driver [None req-a98fb043-a2a1-4c96-b944-e8b4b389942f tempest-AttachVolumeTestJSON-813984703 tempest-AttachVolumeTestJSON-813984703-project-member] [instance: b2c3eb4f-df1f-46d0-acb5-3ac9f16f9a82] Deleting instance files /opt/stack/data/nova/instances/b2c3eb4f-df1f-46d0-acb5-3ac9f16f9a82_del
Nov 29 18:19:36 user nova-compute[74613]: INFO nova.virt.libvirt.driver [None req-a98fb043-a2a1-4c96-b944-e8b4b389942f tempest-AttachVolumeTestJSON-813984703 tempest-AttachVolumeTestJSON-813984703-project-member] [instance: b2c3eb4f-df1f-46d0-acb5-3ac9f16f9a82] Deletion of /opt/stack/data/nova/instances/b2c3eb4f-df1f-46d0-acb5-3ac9f16f9a82_del complete
Nov 29 18:19:36 user nova-compute[74613]: INFO nova.compute.manager [None req-a98fb043-a2a1-4c96-b944-e8b4b389942f tempest-AttachVolumeTestJSON-813984703 tempest-AttachVolumeTestJSON-813984703-project-member] [instance: b2c3eb4f-df1f-46d0-acb5-3ac9f16f9a82] Took 0.95 seconds to destroy the instance on the hypervisor.
Nov 29 18:19:36 user nova-compute[74613]: DEBUG oslo.service.loopingcall [None req-a98fb043-a2a1-4c96-b944-e8b4b389942f tempest-AttachVolumeTestJSON-813984703 tempest-AttachVolumeTestJSON-813984703-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74613) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 29 18:19:36 user nova-compute[74613]: DEBUG nova.compute.manager [-] [instance: b2c3eb4f-df1f-46d0-acb5-3ac9f16f9a82] Deallocating network for instance {{(pid=74613) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 29 18:19:36 user nova-compute[74613]: DEBUG nova.network.neutron [-] [instance: b2c3eb4f-df1f-46d0-acb5-3ac9f16f9a82] deallocate_for_instance() {{(pid=74613) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 29 18:19:36 user nova-compute[74613]: DEBUG nova.compute.manager [req-34b21d8c-b3fb-4169-af73-348f2597a455 req-74f6f5d1-d08f-480d-8c95-c8e2becf0118 service nova] [instance: b2c3eb4f-df1f-46d0-acb5-3ac9f16f9a82] Received event network-vif-unplugged-d2959064-4006-4ab9-b71f-f6a391cbffcf {{(pid=74613) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 18:19:36 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-34b21d8c-b3fb-4169-af73-348f2597a455 req-74f6f5d1-d08f-480d-8c95-c8e2becf0118 service nova] Acquiring lock "b2c3eb4f-df1f-46d0-acb5-3ac9f16f9a82-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 18:19:36 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-34b21d8c-b3fb-4169-af73-348f2597a455 req-74f6f5d1-d08f-480d-8c95-c8e2becf0118 service nova] Lock "b2c3eb4f-df1f-46d0-acb5-3ac9f16f9a82-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 18:19:36 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-34b21d8c-b3fb-4169-af73-348f2597a455 req-74f6f5d1-d08f-480d-8c95-c8e2becf0118 service nova] Lock "b2c3eb4f-df1f-46d0-acb5-3ac9f16f9a82-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 18:19:36 user nova-compute[74613]: DEBUG nova.compute.manager [req-34b21d8c-b3fb-4169-af73-348f2597a455 req-74f6f5d1-d08f-480d-8c95-c8e2becf0118 service nova] [instance: b2c3eb4f-df1f-46d0-acb5-3ac9f16f9a82] No waiting events found dispatching network-vif-unplugged-d2959064-4006-4ab9-b71f-f6a391cbffcf {{(pid=74613) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 18:19:36 user nova-compute[74613]: DEBUG nova.compute.manager [req-34b21d8c-b3fb-4169-af73-348f2597a455 req-74f6f5d1-d08f-480d-8c95-c8e2becf0118 service nova] [instance: b2c3eb4f-df1f-46d0-acb5-3ac9f16f9a82] Received event network-vif-unplugged-d2959064-4006-4ab9-b71f-f6a391cbffcf for instance with task_state deleting. {{(pid=74613) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 29 18:19:36 user nova-compute[74613]: DEBUG nova.compute.manager [req-34b21d8c-b3fb-4169-af73-348f2597a455 req-74f6f5d1-d08f-480d-8c95-c8e2becf0118 service nova] [instance: b2c3eb4f-df1f-46d0-acb5-3ac9f16f9a82] Received event network-vif-plugged-d2959064-4006-4ab9-b71f-f6a391cbffcf {{(pid=74613) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 18:19:36 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-34b21d8c-b3fb-4169-af73-348f2597a455 req-74f6f5d1-d08f-480d-8c95-c8e2becf0118 service nova] Acquiring lock "b2c3eb4f-df1f-46d0-acb5-3ac9f16f9a82-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 18:19:36 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-34b21d8c-b3fb-4169-af73-348f2597a455 req-74f6f5d1-d08f-480d-8c95-c8e2becf0118 service nova] Lock "b2c3eb4f-df1f-46d0-acb5-3ac9f16f9a82-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 18:19:36 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-34b21d8c-b3fb-4169-af73-348f2597a455 req-74f6f5d1-d08f-480d-8c95-c8e2becf0118 service nova] Lock "b2c3eb4f-df1f-46d0-acb5-3ac9f16f9a82-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 18:19:36 user nova-compute[74613]: DEBUG nova.compute.manager [req-34b21d8c-b3fb-4169-af73-348f2597a455 req-74f6f5d1-d08f-480d-8c95-c8e2becf0118 service nova] [instance: b2c3eb4f-df1f-46d0-acb5-3ac9f16f9a82] No waiting events found dispatching network-vif-plugged-d2959064-4006-4ab9-b71f-f6a391cbffcf {{(pid=74613) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 18:19:36 user nova-compute[74613]: WARNING nova.compute.manager [req-34b21d8c-b3fb-4169-af73-348f2597a455 req-74f6f5d1-d08f-480d-8c95-c8e2becf0118 service nova] [instance: b2c3eb4f-df1f-46d0-acb5-3ac9f16f9a82] Received unexpected event network-vif-plugged-d2959064-4006-4ab9-b71f-f6a391cbffcf for instance with vm_state active and task_state deleting.
Nov 29 18:19:37 user nova-compute[74613]: DEBUG nova.network.neutron [-] [instance: b2c3eb4f-df1f-46d0-acb5-3ac9f16f9a82] Updating instance_info_cache with network_info: [] {{(pid=74613) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 18:19:37 user nova-compute[74613]: INFO nova.compute.manager [-] [instance: b2c3eb4f-df1f-46d0-acb5-3ac9f16f9a82] Took 0.90 seconds to deallocate network for instance.
Nov 29 18:19:37 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-a98fb043-a2a1-4c96-b944-e8b4b389942f tempest-AttachVolumeTestJSON-813984703 tempest-AttachVolumeTestJSON-813984703-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 18:19:37 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-a98fb043-a2a1-4c96-b944-e8b4b389942f tempest-AttachVolumeTestJSON-813984703 tempest-AttachVolumeTestJSON-813984703-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 18:19:37 user nova-compute[74613]: DEBUG nova.compute.provider_tree [None req-a98fb043-a2a1-4c96-b944-e8b4b389942f tempest-AttachVolumeTestJSON-813984703 tempest-AttachVolumeTestJSON-813984703-project-member] Inventory has not changed in ProviderTree for provider: 639d980e-3b12-44b1-b8f4-1812416fa4dd {{(pid=74613) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 18:19:37 user nova-compute[74613]: DEBUG nova.scheduler.client.report [None req-a98fb043-a2a1-4c96-b944-e8b4b389942f tempest-AttachVolumeTestJSON-813984703 tempest-AttachVolumeTestJSON-813984703-project-member] Inventory has not changed for provider 639d980e-3b12-44b1-b8f4-1812416fa4dd based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74613) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 18:19:37 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-a98fb043-a2a1-4c96-b944-e8b4b389942f tempest-AttachVolumeTestJSON-813984703 tempest-AttachVolumeTestJSON-813984703-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.201s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 18:19:37 user nova-compute[74613]: INFO nova.scheduler.client.report [None req-a98fb043-a2a1-4c96-b944-e8b4b389942f tempest-AttachVolumeTestJSON-813984703 tempest-AttachVolumeTestJSON-813984703-project-member] Deleted allocations for instance b2c3eb4f-df1f-46d0-acb5-3ac9f16f9a82
Nov 29 18:19:37 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-a98fb043-a2a1-4c96-b944-e8b4b389942f tempest-AttachVolumeTestJSON-813984703 tempest-AttachVolumeTestJSON-813984703-project-member] Lock "b2c3eb4f-df1f-46d0-acb5-3ac9f16f9a82" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.239s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 18:19:38 user nova-compute[74613]: DEBUG oslo_service.periodic_task [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74613) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 18:19:38 user nova-compute[74613]: DEBUG nova.compute.manager [req-a846822c-dd37-46e8-b5bf-644be2dd6e4d req-ca11bde8-ae9d-488e-bcf2-b2684686b807 service nova] [instance: b2c3eb4f-df1f-46d0-acb5-3ac9f16f9a82] Received event network-vif-deleted-d2959064-4006-4ab9-b71f-f6a391cbffcf {{(pid=74613) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 18:19:40 user nova-compute[74613]: DEBUG oslo_service.periodic_task [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74613) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 18:19:41 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:19:41 user nova-compute[74613]: DEBUG oslo_service.periodic_task [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74613) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 18:19:42 user nova-compute[74613]: DEBUG oslo_service.periodic_task [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74613) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 18:19:42 user nova-compute[74613]: DEBUG nova.compute.manager [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Starting heal instance info cache {{(pid=74613) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 29 18:19:42 user nova-compute[74613]: DEBUG nova.compute.manager [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Rebuilding the list of instances to heal {{(pid=74613) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 29 18:19:42 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Acquiring lock "refresh_cache-6993e2e7-7e03-45b4-9d3d-3742589b6078" {{(pid=74613) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 18:19:42 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Acquired lock "refresh_cache-6993e2e7-7e03-45b4-9d3d-3742589b6078" {{(pid=74613) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 18:19:42 user nova-compute[74613]: DEBUG nova.network.neutron [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] [instance: 6993e2e7-7e03-45b4-9d3d-3742589b6078] Forcefully refreshing network info cache for instance {{(pid=74613) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 29 18:19:42 user nova-compute[74613]: DEBUG nova.objects.instance [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Lazy-loading 'info_cache' on Instance uuid 6993e2e7-7e03-45b4-9d3d-3742589b6078 {{(pid=74613) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 18:19:43 user nova-compute[74613]: DEBUG nova.network.neutron [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] [instance: 6993e2e7-7e03-45b4-9d3d-3742589b6078] Updating instance_info_cache with network_info: [{"id": "5216b7ab-6e2b-4d7f-8c7f-e52b03d282b9", "address": "fa:16:3e:e8:7b:54", "network": {"id": "db79433c-b21c-4058-b98c-f62822abbf7a", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1715530752-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e6a3eb6ea0294f9da705dca72ec2789a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5216b7ab-6e", "ovs_interfaceid": "5216b7ab-6e2b-4d7f-8c7f-e52b03d282b9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74613) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 18:19:43 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Releasing lock "refresh_cache-6993e2e7-7e03-45b4-9d3d-3742589b6078" {{(pid=74613) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 18:19:43 user nova-compute[74613]: DEBUG nova.compute.manager [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] [instance: 6993e2e7-7e03-45b4-9d3d-3742589b6078] Updated the network info_cache for instance {{(pid=74613) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 29 18:19:43 user nova-compute[74613]: DEBUG oslo_service.periodic_task [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74613) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 18:19:43 user nova-compute[74613]: DEBUG oslo_service.periodic_task [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74613) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 18:19:43 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 18:19:43 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 18:19:43 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 18:19:43 user nova-compute[74613]: DEBUG nova.compute.resource_tracker [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Auditing locally available compute resources for user (node: user) {{(pid=74613) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 29 18:19:43 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74613) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 29 18:19:43 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] skipping disk /dev/sdf (vda) as it is a volume {{(pid=74613) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 29 18:19:43 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f4a1329-b3b9-4d1c-8735-abddabc359fd/disk.rescue --force-share --output=json {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:19:43 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f4a1329-b3b9-4d1c-8735-abddabc359fd/disk.rescue --force-share --output=json" returned: 0 in 0.179s {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:19:43 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f4a1329-b3b9-4d1c-8735-abddabc359fd/disk.rescue --force-share --output=json {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:19:43 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f4a1329-b3b9-4d1c-8735-abddabc359fd/disk.rescue --force-share --output=json" returned: 0 in 0.176s {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:19:43 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f4a1329-b3b9-4d1c-8735-abddabc359fd/disk --force-share --output=json {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:19:43 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f4a1329-b3b9-4d1c-8735-abddabc359fd/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:19:43 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f4a1329-b3b9-4d1c-8735-abddabc359fd/disk --force-share --output=json {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:19:43 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f4a1329-b3b9-4d1c-8735-abddabc359fd/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:19:43 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6993e2e7-7e03-45b4-9d3d-3742589b6078/disk --force-share --output=json {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:19:44 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6993e2e7-7e03-45b4-9d3d-3742589b6078/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:19:44 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6993e2e7-7e03-45b4-9d3d-3742589b6078/disk --force-share --output=json {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:19:44 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6993e2e7-7e03-45b4-9d3d-3742589b6078/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:19:44 user nova-compute[74613]: WARNING nova.virt.libvirt.driver [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 18:19:44 user nova-compute[74613]: WARNING nova.virt.libvirt.driver [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 18:19:44 user nova-compute[74613]: DEBUG nova.compute.resource_tracker [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Hypervisor/Node resource view: name=user free_ram=8498MB free_disk=24.943798065185547GB free_vcpus=8 pci_devices=[{"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74613) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 29 18:19:44 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 18:19:44 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 18:19:44 user nova-compute[74613]: DEBUG nova.compute.resource_tracker [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Instance 6993e2e7-7e03-45b4-9d3d-3742589b6078 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74613) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 18:19:44 user nova-compute[74613]: DEBUG nova.compute.resource_tracker [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Instance 6f4a1329-b3b9-4d1c-8735-abddabc359fd actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74613) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 18:19:44 user nova-compute[74613]: DEBUG nova.compute.resource_tracker [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Instance 3a2ac289-fc34-4c7b-a689-b499e2562578 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74613) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 18:19:44 user nova-compute[74613]: DEBUG nova.compute.resource_tracker [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Instance d4385666-cff6-4133-9833-5447218c8857 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74613) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 18:19:44 user nova-compute[74613]: DEBUG nova.compute.resource_tracker [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Total usable vcpus: 12, total allocated vcpus: 4 {{(pid=74613) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 29 18:19:44 user nova-compute[74613]: DEBUG nova.compute.resource_tracker [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Final resource view: name=user phys_ram=16011MB used_ram=2560MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=4 pci_stats=[] {{(pid=74613) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 29 18:19:45 user nova-compute[74613]: DEBUG nova.compute.provider_tree [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Inventory has not changed in ProviderTree for provider: 639d980e-3b12-44b1-b8f4-1812416fa4dd {{(pid=74613) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 18:19:45 user nova-compute[74613]: DEBUG nova.scheduler.client.report [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Inventory has not changed for provider 639d980e-3b12-44b1-b8f4-1812416fa4dd based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74613) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 18:19:45 user nova-compute[74613]: DEBUG nova.compute.resource_tracker [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Compute_service record updated for user:user {{(pid=74613) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 29 18:19:45 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.327s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 18:19:46 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 18:19:46 user nova-compute[74613]: DEBUG oslo_service.periodic_task [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74613) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 18:19:47 user nova-compute[74613]: DEBUG oslo_service.periodic_task [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74613) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 18:19:47 user nova-compute[74613]: DEBUG nova.compute.manager [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74613) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 29 18:19:51 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 18:19:54 user nova-compute[74613]: DEBUG oslo_service.periodic_task [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74613) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 18:19:56 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:20:01 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 18:20:01 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:20:01 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74613) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 29 18:20:01 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74613) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 18:20:01 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74613) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 18:20:01 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:20:06 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:20:11 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:20:12 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:20:14 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:20:16 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:20:21 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 18:20:26 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:20:31 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:20:34 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-48eca193-1f50-4e8b-b36b-a6096b322c75 tempest-ServerRescueNegativeTestJSON-1891426908 tempest-ServerRescueNegativeTestJSON-1891426908-project-member] Acquiring lock "6f4a1329-b3b9-4d1c-8735-abddabc359fd" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 18:20:34 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-48eca193-1f50-4e8b-b36b-a6096b322c75 tempest-ServerRescueNegativeTestJSON-1891426908 tempest-ServerRescueNegativeTestJSON-1891426908-project-member] Lock "6f4a1329-b3b9-4d1c-8735-abddabc359fd" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 18:20:34 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-48eca193-1f50-4e8b-b36b-a6096b322c75 tempest-ServerRescueNegativeTestJSON-1891426908 tempest-ServerRescueNegativeTestJSON-1891426908-project-member] Acquiring lock "6f4a1329-b3b9-4d1c-8735-abddabc359fd-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 18:20:34 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-48eca193-1f50-4e8b-b36b-a6096b322c75 tempest-ServerRescueNegativeTestJSON-1891426908 tempest-ServerRescueNegativeTestJSON-1891426908-project-member] Lock "6f4a1329-b3b9-4d1c-8735-abddabc359fd-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 18:20:34 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-48eca193-1f50-4e8b-b36b-a6096b322c75 tempest-ServerRescueNegativeTestJSON-1891426908 tempest-ServerRescueNegativeTestJSON-1891426908-project-member] Lock "6f4a1329-b3b9-4d1c-8735-abddabc359fd-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 18:20:34 user nova-compute[74613]: INFO nova.compute.manager [None req-48eca193-1f50-4e8b-b36b-a6096b322c75 tempest-ServerRescueNegativeTestJSON-1891426908 tempest-ServerRescueNegativeTestJSON-1891426908-project-member] [instance: 6f4a1329-b3b9-4d1c-8735-abddabc359fd] Terminating instance
Nov 29 18:20:34 user nova-compute[74613]: DEBUG nova.compute.manager [None req-48eca193-1f50-4e8b-b36b-a6096b322c75 tempest-ServerRescueNegativeTestJSON-1891426908 tempest-ServerRescueNegativeTestJSON-1891426908-project-member] [instance: 6f4a1329-b3b9-4d1c-8735-abddabc359fd] Start destroying the instance on the hypervisor. {{(pid=74613) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 29 18:20:34 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:20:34 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:20:34 user nova-compute[74613]: DEBUG nova.compute.manager [req-2be50a14-a7c9-4d7f-87bf-273fb436d0ee req-923e86c9-f2f9-430d-a062-cf2250c47cbc service nova] [instance: 6f4a1329-b3b9-4d1c-8735-abddabc359fd] Received event network-vif-unplugged-6d82a9a2-81f2-4d4b-846e-178413db6ecf {{(pid=74613) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 18:20:34 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-2be50a14-a7c9-4d7f-87bf-273fb436d0ee req-923e86c9-f2f9-430d-a062-cf2250c47cbc service nova] Acquiring lock "6f4a1329-b3b9-4d1c-8735-abddabc359fd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 18:20:34 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-2be50a14-a7c9-4d7f-87bf-273fb436d0ee req-923e86c9-f2f9-430d-a062-cf2250c47cbc service nova] Lock "6f4a1329-b3b9-4d1c-8735-abddabc359fd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 18:20:34 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-2be50a14-a7c9-4d7f-87bf-273fb436d0ee req-923e86c9-f2f9-430d-a062-cf2250c47cbc service nova] Lock "6f4a1329-b3b9-4d1c-8735-abddabc359fd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 18:20:34 user nova-compute[74613]: DEBUG nova.compute.manager [req-2be50a14-a7c9-4d7f-87bf-273fb436d0ee req-923e86c9-f2f9-430d-a062-cf2250c47cbc service nova] [instance: 6f4a1329-b3b9-4d1c-8735-abddabc359fd] No waiting events found dispatching network-vif-unplugged-6d82a9a2-81f2-4d4b-846e-178413db6ecf {{(pid=74613) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 18:20:34 user nova-compute[74613]: DEBUG nova.compute.manager [req-2be50a14-a7c9-4d7f-87bf-273fb436d0ee req-923e86c9-f2f9-430d-a062-cf2250c47cbc service nova] [instance: 6f4a1329-b3b9-4d1c-8735-abddabc359fd] Received event network-vif-unplugged-6d82a9a2-81f2-4d4b-846e-178413db6ecf for instance with task_state deleting. {{(pid=74613) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 29 18:20:35 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:20:35 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:20:35 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:20:35 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:20:35 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:20:35 user nova-compute[74613]: INFO nova.virt.libvirt.driver [-] [instance: 6f4a1329-b3b9-4d1c-8735-abddabc359fd] Instance destroyed successfully.
Nov 29 18:20:35 user nova-compute[74613]: DEBUG nova.objects.instance [None req-48eca193-1f50-4e8b-b36b-a6096b322c75 tempest-ServerRescueNegativeTestJSON-1891426908 tempest-ServerRescueNegativeTestJSON-1891426908-project-member] Lazy-loading 'resources' on Instance uuid 6f4a1329-b3b9-4d1c-8735-abddabc359fd {{(pid=74613) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 18:20:35 user nova-compute[74613]: DEBUG nova.virt.libvirt.vif [None req-48eca193-1f50-4e8b-b36b-a6096b322c75 tempest-ServerRescueNegativeTestJSON-1891426908 tempest-ServerRescueNegativeTestJSON-1891426908-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T18:04:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1233675414',display_name='tempest-ServerRescueNegativeTestJSON-server-1233675414',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1233675414',id=29,image_ref='4217f428-8d9d-4ee1-9614-642d26d90c46',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-29T18:06:21Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='e6a3eb6ea0294f9da705dca72ec2789a',ramdisk_id='',reservation_id='r-17bsbhc1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='4217f428-8d9d-4ee1-9614-642d26d90c46',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-1891426908',owner_user_name='tempest-ServerRescueNegativeTestJSON-1891426908-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-29T18:06:22Z,user_data=None,user_id='4e984d45838e441680b9948c213728fb',uuid=6f4a1329-b3b9-4d1c-8735-abddabc359fd,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='rescued') vif={"id": "6d82a9a2-81f2-4d4b-846e-178413db6ecf", "address": "fa:16:3e:53:4e:1d", "network": {"id": "db79433c-b21c-4058-b98c-f62822abbf7a", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1715530752-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e6a3eb6ea0294f9da705dca72ec2789a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6d82a9a2-81", "ovs_interfaceid": "6d82a9a2-81f2-4d4b-846e-178413db6ecf", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74613) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 29 18:20:35 user nova-compute[74613]: DEBUG nova.network.os_vif_util [None req-48eca193-1f50-4e8b-b36b-a6096b322c75 tempest-ServerRescueNegativeTestJSON-1891426908 tempest-ServerRescueNegativeTestJSON-1891426908-project-member] Converting VIF {"id": "6d82a9a2-81f2-4d4b-846e-178413db6ecf", "address": "fa:16:3e:53:4e:1d", "network": {"id": "db79433c-b21c-4058-b98c-f62822abbf7a", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1715530752-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e6a3eb6ea0294f9da705dca72ec2789a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6d82a9a2-81", "ovs_interfaceid": "6d82a9a2-81f2-4d4b-846e-178413db6ecf", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74613) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 18:20:35 user nova-compute[74613]: DEBUG nova.network.os_vif_util [None req-48eca193-1f50-4e8b-b36b-a6096b322c75 tempest-ServerRescueNegativeTestJSON-1891426908 tempest-ServerRescueNegativeTestJSON-1891426908-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:53:4e:1d,bridge_name='br-int',has_traffic_filtering=True,id=6d82a9a2-81f2-4d4b-846e-178413db6ecf,network=Network(db79433c-b21c-4058-b98c-f62822abbf7a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6d82a9a2-81') {{(pid=74613) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 18:20:35 user nova-compute[74613]: DEBUG os_vif [None req-48eca193-1f50-4e8b-b36b-a6096b322c75 tempest-ServerRescueNegativeTestJSON-1891426908 tempest-ServerRescueNegativeTestJSON-1891426908-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:53:4e:1d,bridge_name='br-int',has_traffic_filtering=True,id=6d82a9a2-81f2-4d4b-846e-178413db6ecf,network=Network(db79433c-b21c-4058-b98c-f62822abbf7a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6d82a9a2-81') {{(pid=74613) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 29 18:20:35 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:20:35 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap6d82a9a2-81, bridge=br-int, if_exists=True) {{(pid=74613) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 18:20:35 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:20:35 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 18:20:35 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:20:35 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=60bad99e-602d-4a60-9cb8-65fa47fb1f40) {{(pid=74613) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 18:20:35 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:20:35 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 18:20:35 user nova-compute[74613]: INFO os_vif [None req-48eca193-1f50-4e8b-b36b-a6096b322c75 tempest-ServerRescueNegativeTestJSON-1891426908 tempest-ServerRescueNegativeTestJSON-1891426908-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:53:4e:1d,bridge_name='br-int',has_traffic_filtering=True,id=6d82a9a2-81f2-4d4b-846e-178413db6ecf,network=Network(db79433c-b21c-4058-b98c-f62822abbf7a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6d82a9a2-81')
Nov 29 18:20:35 user nova-compute[74613]: INFO nova.virt.libvirt.driver [None req-48eca193-1f50-4e8b-b36b-a6096b322c75 tempest-ServerRescueNegativeTestJSON-1891426908 tempest-ServerRescueNegativeTestJSON-1891426908-project-member] [instance: 6f4a1329-b3b9-4d1c-8735-abddabc359fd] Deleting instance files /opt/stack/data/nova/instances/6f4a1329-b3b9-4d1c-8735-abddabc359fd_del
Nov 29 18:20:35 user nova-compute[74613]: INFO nova.virt.libvirt.driver [None req-48eca193-1f50-4e8b-b36b-a6096b322c75 tempest-ServerRescueNegativeTestJSON-1891426908 tempest-ServerRescueNegativeTestJSON-1891426908-project-member] [instance: 6f4a1329-b3b9-4d1c-8735-abddabc359fd] Deletion of /opt/stack/data/nova/instances/6f4a1329-b3b9-4d1c-8735-abddabc359fd_del complete
Nov 29 18:20:35 user nova-compute[74613]: DEBUG oslo_service.periodic_task [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74613) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 18:20:35 user nova-compute[74613]: INFO nova.compute.manager [None req-48eca193-1f50-4e8b-b36b-a6096b322c75 tempest-ServerRescueNegativeTestJSON-1891426908 tempest-ServerRescueNegativeTestJSON-1891426908-project-member] [instance: 6f4a1329-b3b9-4d1c-8735-abddabc359fd] Took 0.91 seconds to destroy the instance on the hypervisor.
Nov 29 18:20:35 user nova-compute[74613]: DEBUG oslo.service.loopingcall [None req-48eca193-1f50-4e8b-b36b-a6096b322c75 tempest-ServerRescueNegativeTestJSON-1891426908 tempest-ServerRescueNegativeTestJSON-1891426908-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74613) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 29 18:20:35 user nova-compute[74613]: DEBUG nova.compute.manager [-] [instance: 6f4a1329-b3b9-4d1c-8735-abddabc359fd] Deallocating network for instance {{(pid=74613) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 29 18:20:35 user nova-compute[74613]: DEBUG nova.network.neutron [-] [instance: 6f4a1329-b3b9-4d1c-8735-abddabc359fd] deallocate_for_instance() {{(pid=74613) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 29 18:20:35 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:20:35 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:20:35 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:20:35 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:20:36 user nova-compute[74613]: DEBUG nova.network.neutron [-] [instance: 6f4a1329-b3b9-4d1c-8735-abddabc359fd] Updating instance_info_cache with network_info: [] {{(pid=74613) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 18:20:36 user nova-compute[74613]: INFO nova.compute.manager [-] [instance: 6f4a1329-b3b9-4d1c-8735-abddabc359fd] Took 0.72 seconds to deallocate network for instance.
Nov 29 18:20:36 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-48eca193-1f50-4e8b-b36b-a6096b322c75 tempest-ServerRescueNegativeTestJSON-1891426908 tempest-ServerRescueNegativeTestJSON-1891426908-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 18:20:36 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-48eca193-1f50-4e8b-b36b-a6096b322c75 tempest-ServerRescueNegativeTestJSON-1891426908 tempest-ServerRescueNegativeTestJSON-1891426908-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 18:20:36 user nova-compute[74613]: DEBUG nova.compute.manager [req-7e60d6a3-7c24-4241-b06c-559617355055 req-136edeb8-afe8-4b2c-8b7e-9ba27c63307c service nova] [instance: d4385666-cff6-4133-9833-5447218c8857] Received event network-changed-a3798396-6b34-4ed7-b750-6a741a148340 {{(pid=74613) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 18:20:36 user nova-compute[74613]: DEBUG nova.compute.manager [req-7e60d6a3-7c24-4241-b06c-559617355055 req-136edeb8-afe8-4b2c-8b7e-9ba27c63307c service nova] [instance: d4385666-cff6-4133-9833-5447218c8857] Refreshing instance network info cache due to event network-changed-a3798396-6b34-4ed7-b750-6a741a148340. {{(pid=74613) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 18:20:36 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-7e60d6a3-7c24-4241-b06c-559617355055 req-136edeb8-afe8-4b2c-8b7e-9ba27c63307c service nova] Acquiring lock "refresh_cache-d4385666-cff6-4133-9833-5447218c8857" {{(pid=74613) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 18:20:36 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-7e60d6a3-7c24-4241-b06c-559617355055 req-136edeb8-afe8-4b2c-8b7e-9ba27c63307c service nova] Acquired lock "refresh_cache-d4385666-cff6-4133-9833-5447218c8857" {{(pid=74613) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 18:20:36 user nova-compute[74613]: DEBUG nova.network.neutron [req-7e60d6a3-7c24-4241-b06c-559617355055 req-136edeb8-afe8-4b2c-8b7e-9ba27c63307c service nova] [instance: d4385666-cff6-4133-9833-5447218c8857] Refreshing network info cache for port a3798396-6b34-4ed7-b750-6a741a148340 {{(pid=74613) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 18:20:36 user nova-compute[74613]: DEBUG nova.compute.provider_tree [None req-48eca193-1f50-4e8b-b36b-a6096b322c75 tempest-ServerRescueNegativeTestJSON-1891426908 tempest-ServerRescueNegativeTestJSON-1891426908-project-member] Inventory has not changed in ProviderTree for provider: 639d980e-3b12-44b1-b8f4-1812416fa4dd {{(pid=74613) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 18:20:36 user nova-compute[74613]: DEBUG nova.scheduler.client.report [None req-48eca193-1f50-4e8b-b36b-a6096b322c75 tempest-ServerRescueNegativeTestJSON-1891426908 tempest-ServerRescueNegativeTestJSON-1891426908-project-member] Inventory has not changed for provider 639d980e-3b12-44b1-b8f4-1812416fa4dd based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74613) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 18:20:36 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-48eca193-1f50-4e8b-b36b-a6096b322c75 tempest-ServerRescueNegativeTestJSON-1891426908 tempest-ServerRescueNegativeTestJSON-1891426908-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.280s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 18:20:36 user nova-compute[74613]: INFO nova.scheduler.client.report [None req-48eca193-1f50-4e8b-b36b-a6096b322c75 tempest-ServerRescueNegativeTestJSON-1891426908 tempest-ServerRescueNegativeTestJSON-1891426908-project-member] Deleted allocations for instance 6f4a1329-b3b9-4d1c-8735-abddabc359fd
Nov 29 18:20:36 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-48eca193-1f50-4e8b-b36b-a6096b322c75 tempest-ServerRescueNegativeTestJSON-1891426908 tempest-ServerRescueNegativeTestJSON-1891426908-project-member] Lock "6f4a1329-b3b9-4d1c-8735-abddabc359fd" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.169s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 18:20:37 user nova-compute[74613]: DEBUG nova.network.neutron [req-7e60d6a3-7c24-4241-b06c-559617355055 req-136edeb8-afe8-4b2c-8b7e-9ba27c63307c service nova] [instance: d4385666-cff6-4133-9833-5447218c8857] Updated VIF entry in instance network info cache for port a3798396-6b34-4ed7-b750-6a741a148340. {{(pid=74613) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 18:20:37 user nova-compute[74613]: DEBUG nova.network.neutron [req-7e60d6a3-7c24-4241-b06c-559617355055 req-136edeb8-afe8-4b2c-8b7e-9ba27c63307c service nova] [instance: d4385666-cff6-4133-9833-5447218c8857] Updating instance_info_cache with network_info: [{"id": "a3798396-6b34-4ed7-b750-6a741a148340", "address": "fa:16:3e:4c:8d:a6", "network": {"id": "4a5179dd-d0b1-44c3-80c1-08dd7b0152f1", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1296336996-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.230", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "67390f1402214191904cfbd68c3142a7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa3798396-6b", "ovs_interfaceid": "a3798396-6b34-4ed7-b750-6a741a148340", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74613) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 18:20:37 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-7e60d6a3-7c24-4241-b06c-559617355055 req-136edeb8-afe8-4b2c-8b7e-9ba27c63307c service nova] Releasing lock "refresh_cache-d4385666-cff6-4133-9833-5447218c8857" {{(pid=74613) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 18:20:37 user nova-compute[74613]: DEBUG nova.compute.manager [req-bb57dac9-8c7b-4e83-bf18-2e599dbe6f86 req-3ce18bc2-4546-4b4f-ac02-736f60a10371 service nova] [instance: 6f4a1329-b3b9-4d1c-8735-abddabc359fd] Received event network-vif-plugged-6d82a9a2-81f2-4d4b-846e-178413db6ecf {{(pid=74613) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 18:20:37 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-bb57dac9-8c7b-4e83-bf18-2e599dbe6f86 req-3ce18bc2-4546-4b4f-ac02-736f60a10371 service nova] Acquiring lock "6f4a1329-b3b9-4d1c-8735-abddabc359fd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 18:20:37 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-bb57dac9-8c7b-4e83-bf18-2e599dbe6f86 req-3ce18bc2-4546-4b4f-ac02-736f60a10371 service nova] Lock "6f4a1329-b3b9-4d1c-8735-abddabc359fd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 18:20:37 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-bb57dac9-8c7b-4e83-bf18-2e599dbe6f86 req-3ce18bc2-4546-4b4f-ac02-736f60a10371 service nova] Lock "6f4a1329-b3b9-4d1c-8735-abddabc359fd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 18:20:37 user nova-compute[74613]: DEBUG nova.compute.manager [req-bb57dac9-8c7b-4e83-bf18-2e599dbe6f86 req-3ce18bc2-4546-4b4f-ac02-736f60a10371 service nova] [instance: 6f4a1329-b3b9-4d1c-8735-abddabc359fd] No waiting events found dispatching network-vif-plugged-6d82a9a2-81f2-4d4b-846e-178413db6ecf {{(pid=74613) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 18:20:37 user nova-compute[74613]: WARNING nova.compute.manager [req-bb57dac9-8c7b-4e83-bf18-2e599dbe6f86 req-3ce18bc2-4546-4b4f-ac02-736f60a10371 service nova] [instance: 6f4a1329-b3b9-4d1c-8735-abddabc359fd] Received unexpected event network-vif-plugged-6d82a9a2-81f2-4d4b-846e-178413db6ecf for instance with vm_state deleted and task_state None.
Nov 29 18:20:37 user nova-compute[74613]: DEBUG nova.compute.manager [req-bb57dac9-8c7b-4e83-bf18-2e599dbe6f86 req-3ce18bc2-4546-4b4f-ac02-736f60a10371 service nova] [instance: 6f4a1329-b3b9-4d1c-8735-abddabc359fd] Received event network-vif-deleted-6d82a9a2-81f2-4d4b-846e-178413db6ecf {{(pid=74613) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 18:20:38 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-cbda49fd-3faf-4697-84d6-b52365a04cb8 tempest-TestVolumeBootPattern-1318569205 tempest-TestVolumeBootPattern-1318569205-project-member] Acquiring lock "d4385666-cff6-4133-9833-5447218c8857" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 18:20:38 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-cbda49fd-3faf-4697-84d6-b52365a04cb8 tempest-TestVolumeBootPattern-1318569205 tempest-TestVolumeBootPattern-1318569205-project-member] Lock "d4385666-cff6-4133-9833-5447218c8857" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 18:20:38 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-cbda49fd-3faf-4697-84d6-b52365a04cb8 tempest-TestVolumeBootPattern-1318569205 tempest-TestVolumeBootPattern-1318569205-project-member] Acquiring lock "d4385666-cff6-4133-9833-5447218c8857-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 18:20:38 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-cbda49fd-3faf-4697-84d6-b52365a04cb8 tempest-TestVolumeBootPattern-1318569205 tempest-TestVolumeBootPattern-1318569205-project-member] Lock "d4385666-cff6-4133-9833-5447218c8857-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 18:20:38 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-cbda49fd-3faf-4697-84d6-b52365a04cb8 tempest-TestVolumeBootPattern-1318569205 tempest-TestVolumeBootPattern-1318569205-project-member] Lock "d4385666-cff6-4133-9833-5447218c8857-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 18:20:38 user nova-compute[74613]: INFO nova.compute.manager [None req-cbda49fd-3faf-4697-84d6-b52365a04cb8 tempest-TestVolumeBootPattern-1318569205 tempest-TestVolumeBootPattern-1318569205-project-member] [instance: d4385666-cff6-4133-9833-5447218c8857] Terminating instance
Nov 29 18:20:38 user nova-compute[74613]: DEBUG nova.compute.manager [None req-cbda49fd-3faf-4697-84d6-b52365a04cb8 tempest-TestVolumeBootPattern-1318569205 tempest-TestVolumeBootPattern-1318569205-project-member] [instance: d4385666-cff6-4133-9833-5447218c8857] Start destroying the instance on the hypervisor. {{(pid=74613) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 29 18:20:38 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:20:38 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:20:38 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:20:38 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:20:39 user nova-compute[74613]: INFO nova.virt.libvirt.driver [-] [instance: d4385666-cff6-4133-9833-5447218c8857] Instance destroyed successfully.
Nov 29 18:20:39 user nova-compute[74613]: DEBUG nova.objects.instance [None req-cbda49fd-3faf-4697-84d6-b52365a04cb8 tempest-TestVolumeBootPattern-1318569205 tempest-TestVolumeBootPattern-1318569205-project-member] Lazy-loading 'resources' on Instance uuid d4385666-cff6-4133-9833-5447218c8857 {{(pid=74613) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 18:20:39 user nova-compute[74613]: DEBUG nova.virt.libvirt.vif [None req-cbda49fd-3faf-4697-84d6-b52365a04cb8 tempest-TestVolumeBootPattern-1318569205 tempest-TestVolumeBootPattern-1318569205-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T18:18:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-image-snapshot-server-2040298250',display_name='tempest-TestVolumeBootPattern-image-snapshot-server-2040298250',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-image-snapshot-server-2040298250',id=43,image_ref='a5bf22a6-bce2-4861-99b9-c57bf2cf9595',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOyq50KA7OSJawcZ9YWEOC8dFxQS6yxAcXEbEbKDvtskVvn9CXinCCgRWgfzIxC01ca44GeVgZo690xk+kh2W8GlYjQ1TcpgF2ynYNYqm/+rGy+smMM8WwbtyFokOzvnHQ==',key_name='tempest-keypair-902871575',keypairs=<?>,launch_index=0,launched_at=2023-11-29T18:19:05Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='67390f1402214191904cfbd68c3142a7',ramdisk_id='',reservation_id='r-gegiiuol',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_bdm_v2='True',image_boot_roles='member,reader',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_project_name='tempest-TestVolumeBootPattern-1318569205',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestVolumeBootPattern-1318569205-project-member',image_root_device_name='/dev/vda',owner_project_name='tempest-TestVolumeBootPattern-1318569205',owner_user_name='tempest-TestVolumeBootPattern-1318569205-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-29T18:19:05Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='bedbc6ed47394e2b9125543a8b88a71f',uuid=d4385666-cff6-4133-9833-5447218c8857,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "a3798396-6b34-4ed7-b750-6a741a148340", "address": "fa:16:3e:4c:8d:a6", "network": {"id": "4a5179dd-d0b1-44c3-80c1-08dd7b0152f1", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1296336996-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.230", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "67390f1402214191904cfbd68c3142a7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa3798396-6b", "ovs_interfaceid": "a3798396-6b34-4ed7-b750-6a741a148340", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74613) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 29 18:20:39 user nova-compute[74613]: DEBUG nova.network.os_vif_util [None req-cbda49fd-3faf-4697-84d6-b52365a04cb8 tempest-TestVolumeBootPattern-1318569205 tempest-TestVolumeBootPattern-1318569205-project-member] Converting VIF {"id": "a3798396-6b34-4ed7-b750-6a741a148340", "address": "fa:16:3e:4c:8d:a6", "network": {"id": "4a5179dd-d0b1-44c3-80c1-08dd7b0152f1", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1296336996-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.230", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "67390f1402214191904cfbd68c3142a7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa3798396-6b", "ovs_interfaceid": "a3798396-6b34-4ed7-b750-6a741a148340", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74613) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 18:20:39 user nova-compute[74613]: DEBUG nova.network.os_vif_util [None req-cbda49fd-3faf-4697-84d6-b52365a04cb8 tempest-TestVolumeBootPattern-1318569205 tempest-TestVolumeBootPattern-1318569205-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:4c:8d:a6,bridge_name='br-int',has_traffic_filtering=True,id=a3798396-6b34-4ed7-b750-6a741a148340,network=Network(4a5179dd-d0b1-44c3-80c1-08dd7b0152f1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa3798396-6b') {{(pid=74613) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 18:20:39 user nova-compute[74613]: DEBUG os_vif [None req-cbda49fd-3faf-4697-84d6-b52365a04cb8 tempest-TestVolumeBootPattern-1318569205 tempest-TestVolumeBootPattern-1318569205-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:4c:8d:a6,bridge_name='br-int',has_traffic_filtering=True,id=a3798396-6b34-4ed7-b750-6a741a148340,network=Network(4a5179dd-d0b1-44c3-80c1-08dd7b0152f1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa3798396-6b') {{(pid=74613) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 29 18:20:39 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:20:39 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapa3798396-6b, bridge=br-int, if_exists=True) {{(pid=74613) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 18:20:39 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:20:39 user nova-compute[74613]: DEBUG nova.compute.manager [req-27a98168-d31b-428d-953c-341f260bd186 req-fa80b685-ec72-47f8-b5ba-b9d4e896126f service nova] [instance: d4385666-cff6-4133-9833-5447218c8857] Received event network-vif-unplugged-a3798396-6b34-4ed7-b750-6a741a148340 {{(pid=74613) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 18:20:39 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-27a98168-d31b-428d-953c-341f260bd186 req-fa80b685-ec72-47f8-b5ba-b9d4e896126f service nova] Acquiring lock "d4385666-cff6-4133-9833-5447218c8857-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 18:20:39 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-27a98168-d31b-428d-953c-341f260bd186 req-fa80b685-ec72-47f8-b5ba-b9d4e896126f service nova] Lock "d4385666-cff6-4133-9833-5447218c8857-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 18:20:39 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-27a98168-d31b-428d-953c-341f260bd186 req-fa80b685-ec72-47f8-b5ba-b9d4e896126f service nova] Lock "d4385666-cff6-4133-9833-5447218c8857-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 18:20:39 user nova-compute[74613]: DEBUG nova.compute.manager [req-27a98168-d31b-428d-953c-341f260bd186 req-fa80b685-ec72-47f8-b5ba-b9d4e896126f service nova] [instance: d4385666-cff6-4133-9833-5447218c8857] No waiting events found dispatching network-vif-unplugged-a3798396-6b34-4ed7-b750-6a741a148340 {{(pid=74613) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 18:20:39 user nova-compute[74613]: DEBUG nova.compute.manager [req-27a98168-d31b-428d-953c-341f260bd186 req-fa80b685-ec72-47f8-b5ba-b9d4e896126f service nova] [instance: d4385666-cff6-4133-9833-5447218c8857] Received event network-vif-unplugged-a3798396-6b34-4ed7-b750-6a741a148340 for instance with task_state deleting. {{(pid=74613) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 29 18:20:39 user nova-compute[74613]: DEBUG nova.compute.manager [req-27a98168-d31b-428d-953c-341f260bd186 req-fa80b685-ec72-47f8-b5ba-b9d4e896126f service nova] [instance: d4385666-cff6-4133-9833-5447218c8857] Received event network-vif-plugged-a3798396-6b34-4ed7-b750-6a741a148340 {{(pid=74613) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 18:20:39 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-27a98168-d31b-428d-953c-341f260bd186 req-fa80b685-ec72-47f8-b5ba-b9d4e896126f service nova] Acquiring lock "d4385666-cff6-4133-9833-5447218c8857-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 18:20:39 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-27a98168-d31b-428d-953c-341f260bd186 req-fa80b685-ec72-47f8-b5ba-b9d4e896126f service nova] Lock "d4385666-cff6-4133-9833-5447218c8857-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 18:20:39 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-27a98168-d31b-428d-953c-341f260bd186 req-fa80b685-ec72-47f8-b5ba-b9d4e896126f service nova] Lock "d4385666-cff6-4133-9833-5447218c8857-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 18:20:39 user nova-compute[74613]: DEBUG nova.compute.manager [req-27a98168-d31b-428d-953c-341f260bd186 req-fa80b685-ec72-47f8-b5ba-b9d4e896126f service nova] [instance: d4385666-cff6-4133-9833-5447218c8857] No waiting events found dispatching network-vif-plugged-a3798396-6b34-4ed7-b750-6a741a148340 {{(pid=74613) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 18:20:39 user nova-compute[74613]: WARNING nova.compute.manager [req-27a98168-d31b-428d-953c-341f260bd186 req-fa80b685-ec72-47f8-b5ba-b9d4e896126f service nova] [instance: d4385666-cff6-4133-9833-5447218c8857] Received unexpected event network-vif-plugged-a3798396-6b34-4ed7-b750-6a741a148340 for instance with vm_state active and task_state deleting.
Nov 29 18:20:39 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 18:20:39 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:20:39 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=063bd309-1b9f-45d1-be35-f1e81c719c2c) {{(pid=74613) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 18:20:39 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:20:39 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 18:20:39 user nova-compute[74613]: INFO os_vif [None req-cbda49fd-3faf-4697-84d6-b52365a04cb8 tempest-TestVolumeBootPattern-1318569205 tempest-TestVolumeBootPattern-1318569205-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:4c:8d:a6,bridge_name='br-int',has_traffic_filtering=True,id=a3798396-6b34-4ed7-b750-6a741a148340,network=Network(4a5179dd-d0b1-44c3-80c1-08dd7b0152f1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa3798396-6b')
Nov 29 18:20:39 user nova-compute[74613]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cbda49fd-3faf-4697-84d6-b52365a04cb8 tempest-TestVolumeBootPattern-1318569205 tempest-TestVolumeBootPattern-1318569205-project-member] [instance: d4385666-cff6-4133-9833-5447218c8857] calling os-brick to detach iSCSI Volume {{(pid=74613) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 29 18:20:39 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-cbda49fd-3faf-4697-84d6-b52365a04cb8 tempest-TestVolumeBootPattern-1318569205 tempest-TestVolumeBootPattern-1318569205-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff828156890>, {'target_iqn': 'iqn.2010-10.org.openstack:b4661fe9-8f60-4595-bc5b-6671702802af', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'oWCtefpz', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, None), 'kwargs': True}}" {{(pid=74613) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 18:20:39 user nova-compute[74613]: WARNING os_brick.initiator.connectors.base [None req-cbda49fd-3faf-4697-84d6-b52365a04cb8 tempest-TestVolumeBootPattern-1318569205 tempest-TestVolumeBootPattern-1318569205-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 18:20:39 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.base [None req-cbda49fd-3faf-4697-84d6-b52365a04cb8 tempest-TestVolumeBootPattern-1318569205 tempest-TestVolumeBootPattern-1318569205-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 18:20:39 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.base [None req-cbda49fd-3faf-4697-84d6-b52365a04cb8 tempest-TestVolumeBootPattern-1318569205 tempest-TestVolumeBootPattern-1318569205-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 18:20:39 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:20:39 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:20:39 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[a17219b1-3a9d-4ef6-ae05-07eba01196df]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:b4661fe9-8f60-4595-bc5b-6671702802af\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:5d74e565-9547-4f44-8005-0615d625a275\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 18:20:39 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-cbda49fd-3faf-4697-84d6-b52365a04cb8 tempest-TestVolumeBootPattern-1318569205 tempest-TestVolumeBootPattern-1318569205-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 29 18:20:39 user nova-compute[74613]: No targets found.
Nov 29 18:20:39 user nova-compute[74613]: iSNS:
Nov 29 18:20:39 user nova-compute[74613]: No targets found.
Nov 29 18:20:39 user nova-compute[74613]: STATIC:
Nov 29 18:20:39 user nova-compute[74613]: Target: iqn.2010-10.org.openstack:b4661fe9-8f60-4595-bc5b-6671702802af
Nov 29 18:20:39 user nova-compute[74613]:         Portal: 172.16.0.220:3260,-1
Nov 29 18:20:39 user nova-compute[74613]:                 Iface Name: default
Nov 29 18:20:39 user nova-compute[74613]: Target: iqn.2010-10.org.openstack:5d74e565-9547-4f44-8005-0615d625a275
Nov 29 18:20:39 user nova-compute[74613]:         Portal: 172.16.0.220:3260,-1
Nov 29 18:20:39 user nova-compute[74613]:                 Iface Name: default
Nov 29 18:20:39 user nova-compute[74613]: FIRMWARE:
Nov 29 18:20:39 user nova-compute[74613]: No targets found.
Nov 29 18:20:39 user nova-compute[74613]:  stderr= {{(pid=74613) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 18:20:39 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-cbda49fd-3faf-4697-84d6-b52365a04cb8 tempest-TestVolumeBootPattern-1318569205 tempest-TestVolumeBootPattern-1318569205-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 29 18:20:39 user nova-compute[74613]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 29 18:20:39 user nova-compute[74613]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74613) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 29 18:20:39 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-cbda49fd-3faf-4697-84d6-b52365a04cb8 tempest-TestVolumeBootPattern-1318569205 tempest-TestVolumeBootPattern-1318569205-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b4661fe9-8f60-4595-bc5b-6671702802af', 0)] {{(pid=74613) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 29 18:20:39 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:20:39 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.016s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:20:39 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[5653de83-ef43-481c-83b3-101e9f842bd1]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5d74e565-9547-4f44-8005-0615d625a275\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b4661fe9-8f60-4595-bc5b-6671702802af\n', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 18:20:39 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:20:39 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:20:39 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[4396be25-0589-4302-9439-95fd0b4242e0]: (4, ('tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d74e565-9547-4f44-8005-0615d625a275 (non-flash)\ntcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4661fe9-8f60-4595-bc5b-6671702802af (non-flash)\n', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 18:20:39 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-cbda49fd-3faf-4697-84d6-b52365a04cb8 tempest-TestVolumeBootPattern-1318569205 tempest-TestVolumeBootPattern-1318569205-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d74e565-9547-4f44-8005-0615d625a275 (non-flash)
Nov 29 18:20:39 user nova-compute[74613]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4661fe9-8f60-4595-bc5b-6671702802af (non-flash)
Nov 29 18:20:39 user nova-compute[74613]:  stderr= {{(pid=74613) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 18:20:39 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-cbda49fd-3faf-4697-84d6-b52365a04cb8 tempest-TestVolumeBootPattern-1318569205 tempest-TestVolumeBootPattern-1318569205-project-member] iscsi session list stdout=tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d74e565-9547-4f44-8005-0615d625a275 (non-flash)
Nov 29 18:20:39 user nova-compute[74613]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4661fe9-8f60-4595-bc5b-6671702802af (non-flash)
Nov 29 18:20:39 user nova-compute[74613]:  stderr= {{(pid=74613) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 18:20:39 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-cbda49fd-3faf-4697-84d6-b52365a04cb8 tempest-TestVolumeBootPattern-1318569205 tempest-TestVolumeBootPattern-1318569205-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7ff818119a20>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b4661fe9-8f60-4595-bc5b-6671702802af'): ({'sdf'}, set())}) {{(pid=74613) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 29 18:20:39 user nova-compute[74613]: DEBUG os_brick.initiator.linuxscsi [None req-cbda49fd-3faf-4697-84d6-b52365a04cb8 tempest-TestVolumeBootPattern-1318569205 tempest-TestVolumeBootPattern-1318569205-project-member] Removing single pathed devices sdf {{(pid=74613) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 29 18:20:39 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:20:39 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:20:39 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[039eb0ec-103e-47f1-842f-ee17f79bb32f]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 18:20:39 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:20:39 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.018s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:20:39 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc3894d2-e66e-40c3-bcf0-178f2998e3e4]: (4, ('ok\n', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 18:20:39 user nova-compute[74613]: DEBUG os_brick.initiator.linuxscsi [None req-cbda49fd-3faf-4697-84d6-b52365a04cb8 tempest-TestVolumeBootPattern-1318569205 tempest-TestVolumeBootPattern-1318569205-project-member] Flushing IO for device /dev/sdf {{(pid=74613) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 29 18:20:39 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:20:39 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.014s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:20:39 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ee2ed52-b816-44e3-8098-ce6a10d5cd93]: (4, ('', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 18:20:39 user nova-compute[74613]: DEBUG os_brick.initiator.linuxscsi [None req-cbda49fd-3faf-4697-84d6-b52365a04cb8 tempest-TestVolumeBootPattern-1318569205 tempest-TestVolumeBootPattern-1318569205-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=74613) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 29 18:20:39 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:20:39 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.048s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:20:39 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[57edf538-b977-4605-b4d5-974d9d5820c3]: (4, ('1', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 18:20:39 user nova-compute[74613]: DEBUG os_brick.initiator.linuxscsi [None req-cbda49fd-3faf-4697-84d6-b52365a04cb8 tempest-TestVolumeBootPattern-1318569205 tempest-TestVolumeBootPattern-1318569205-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=74613) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 29 18:20:39 user nova-compute[74613]: DEBUG os_brick.initiator.linuxscsi [None req-cbda49fd-3faf-4697-84d6-b52365a04cb8 tempest-TestVolumeBootPattern-1318569205 tempest-TestVolumeBootPattern-1318569205-project-member] SCSI volumes sdf have been removed. {{(pid=74613) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 29 18:20:39 user nova-compute[74613]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-23635316233373939', '/dev/disk/by-id/scsi-1SCST_BIOc9d8098a-651b379929f0ba3a', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_c9d8098a') {{(pid=85376) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Nov 29 18:20:39 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1c8b070-6751-40c0-9812-59d5199562d5]: (4, None) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 18:20:39 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-cbda49fd-3faf-4697-84d6-b52365a04cb8 tempest-TestVolumeBootPattern-1318569205 tempest-TestVolumeBootPattern-1318569205-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b4661fe9-8f60-4595-bc5b-6671702802af')] {{(pid=74613) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 29 18:20:39 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b4661fe9-8f60-4595-bc5b-6671702802af -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:20:39 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b4661fe9-8f60-4595-bc5b-6671702802af -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.025s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:20:39 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[744dc02e-59be-48ab-8f73-450bc8800581]: (4, ('', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 18:20:39 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-cbda49fd-3faf-4697-84d6-b52365a04cb8 tempest-TestVolumeBootPattern-1318569205 tempest-TestVolumeBootPattern-1318569205-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74613) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 18:20:39 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b4661fe9-8f60-4595-bc5b-6671702802af -p 172.16.0.220:3260 --logout {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:20:39 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b4661fe9-8f60-4595-bc5b-6671702802af -p 172.16.0.220:3260 --logout" returned: 0 in 0.057s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:20:39 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[188f558f-55e1-4ee3-8b34-89d21bea3a8e]: (4, ('Logging out of session [sid: 49, target: iqn.2010-10.org.openstack:b4661fe9-8f60-4595-bc5b-6671702802af, portal: 172.16.0.220,3260]\nLogout of [sid: 49, target: iqn.2010-10.org.openstack:b4661fe9-8f60-4595-bc5b-6671702802af, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 18:20:39 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-cbda49fd-3faf-4697-84d6-b52365a04cb8 tempest-TestVolumeBootPattern-1318569205 tempest-TestVolumeBootPattern-1318569205-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 49, target: iqn.2010-10.org.openstack:b4661fe9-8f60-4595-bc5b-6671702802af, portal: 172.16.0.220,3260]
Nov 29 18:20:39 user nova-compute[74613]: Logout of [sid: 49, target: iqn.2010-10.org.openstack:b4661fe9-8f60-4595-bc5b-6671702802af, portal: 172.16.0.220,3260] successful.
Nov 29 18:20:39 user nova-compute[74613]:  stderr= {{(pid=74613) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 18:20:39 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b4661fe9-8f60-4595-bc5b-6671702802af -p 172.16.0.220:3260 --op delete {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:20:39 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b4661fe9-8f60-4595-bc5b-6671702802af -p 172.16.0.220:3260 --op delete" returned: 0 in 0.022s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:20:39 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[959a1137-15f9-47d6-8e82-2368fb0a6c8b]: (4, ('', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 18:20:39 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-cbda49fd-3faf-4697-84d6-b52365a04cb8 tempest-TestVolumeBootPattern-1318569205 tempest-TestVolumeBootPattern-1318569205-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74613) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 18:20:39 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.base [None req-cbda49fd-3faf-4697-84d6-b52365a04cb8 tempest-TestVolumeBootPattern-1318569205 tempest-TestVolumeBootPattern-1318569205-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.312s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 18:20:39 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-cbda49fd-3faf-4697-84d6-b52365a04cb8 tempest-TestVolumeBootPattern-1318569205 tempest-TestVolumeBootPattern-1318569205-project-member] <== disconnect_volume: return (314ms) None {{(pid=74613) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 18:20:39 user nova-compute[74613]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cbda49fd-3faf-4697-84d6-b52365a04cb8 tempest-TestVolumeBootPattern-1318569205 tempest-TestVolumeBootPattern-1318569205-project-member] [instance: d4385666-cff6-4133-9833-5447218c8857] Disconnected iSCSI Volume {{(pid=74613) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 29 18:20:39 user nova-compute[74613]: INFO nova.virt.libvirt.driver [None req-cbda49fd-3faf-4697-84d6-b52365a04cb8 tempest-TestVolumeBootPattern-1318569205 tempest-TestVolumeBootPattern-1318569205-project-member] [instance: d4385666-cff6-4133-9833-5447218c8857] Deleting instance files /opt/stack/data/nova/instances/d4385666-cff6-4133-9833-5447218c8857_del
Nov 29 18:20:39 user nova-compute[74613]: INFO nova.virt.libvirt.driver [None req-cbda49fd-3faf-4697-84d6-b52365a04cb8 tempest-TestVolumeBootPattern-1318569205 tempest-TestVolumeBootPattern-1318569205-project-member] [instance: d4385666-cff6-4133-9833-5447218c8857] Deletion of /opt/stack/data/nova/instances/d4385666-cff6-4133-9833-5447218c8857_del complete
Nov 29 18:20:39 user nova-compute[74613]: INFO nova.compute.manager [None req-cbda49fd-3faf-4697-84d6-b52365a04cb8 tempest-TestVolumeBootPattern-1318569205 tempest-TestVolumeBootPattern-1318569205-project-member] [instance: d4385666-cff6-4133-9833-5447218c8857] Took 1.19 seconds to destroy the instance on the hypervisor.
Nov 29 18:20:39 user nova-compute[74613]: DEBUG oslo.service.loopingcall [None req-cbda49fd-3faf-4697-84d6-b52365a04cb8 tempest-TestVolumeBootPattern-1318569205 tempest-TestVolumeBootPattern-1318569205-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74613) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 29 18:20:39 user nova-compute[74613]: DEBUG nova.compute.manager [-] [instance: d4385666-cff6-4133-9833-5447218c8857] Deallocating network for instance {{(pid=74613) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 29 18:20:39 user nova-compute[74613]: DEBUG nova.network.neutron [-] [instance: d4385666-cff6-4133-9833-5447218c8857] deallocate_for_instance() {{(pid=74613) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 29 18:20:40 user nova-compute[74613]: DEBUG oslo_service.periodic_task [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74613) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 18:20:40 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:20:40 user nova-compute[74613]: DEBUG nova.network.neutron [-] [instance: d4385666-cff6-4133-9833-5447218c8857] Updating instance_info_cache with network_info: [] {{(pid=74613) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 18:20:40 user nova-compute[74613]: INFO nova.compute.manager [-] [instance: d4385666-cff6-4133-9833-5447218c8857] Took 1.34 seconds to deallocate network for instance.
Nov 29 18:20:41 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:20:41 user nova-compute[74613]: DEBUG nova.compute.manager [req-78015011-4409-4176-8745-8554e0d79f3c req-3c9879ff-fb50-4808-aadb-4391b31f5408 service nova] [instance: d4385666-cff6-4133-9833-5447218c8857] Received event network-vif-deleted-a3798396-6b34-4ed7-b750-6a741a148340 {{(pid=74613) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 18:20:41 user nova-compute[74613]: DEBUG oslo_service.periodic_task [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74613) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 18:20:41 user nova-compute[74613]: DEBUG oslo_service.periodic_task [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74613) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 18:20:41 user nova-compute[74613]: INFO nova.compute.manager [None req-cbda49fd-3faf-4697-84d6-b52365a04cb8 tempest-TestVolumeBootPattern-1318569205 tempest-TestVolumeBootPattern-1318569205-project-member] [instance: d4385666-cff6-4133-9833-5447218c8857] Took 0.85 seconds to detach 1 volumes for instance.
Nov 29 18:20:41 user nova-compute[74613]: DEBUG nova.compute.manager [None req-cbda49fd-3faf-4697-84d6-b52365a04cb8 tempest-TestVolumeBootPattern-1318569205 tempest-TestVolumeBootPattern-1318569205-project-member] [instance: d4385666-cff6-4133-9833-5447218c8857] Deleting volume: b4661fe9-8f60-4595-bc5b-6671702802af {{(pid=74613) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3237}}
Nov 29 18:20:41 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-cbda49fd-3faf-4697-84d6-b52365a04cb8 tempest-TestVolumeBootPattern-1318569205 tempest-TestVolumeBootPattern-1318569205-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 18:20:41 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-cbda49fd-3faf-4697-84d6-b52365a04cb8 tempest-TestVolumeBootPattern-1318569205 tempest-TestVolumeBootPattern-1318569205-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 18:20:42 user nova-compute[74613]: DEBUG nova.compute.provider_tree [None req-cbda49fd-3faf-4697-84d6-b52365a04cb8 tempest-TestVolumeBootPattern-1318569205 tempest-TestVolumeBootPattern-1318569205-project-member] Inventory has not changed in ProviderTree for provider: 639d980e-3b12-44b1-b8f4-1812416fa4dd {{(pid=74613) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 18:20:42 user nova-compute[74613]: DEBUG nova.scheduler.client.report [None req-cbda49fd-3faf-4697-84d6-b52365a04cb8 tempest-TestVolumeBootPattern-1318569205 tempest-TestVolumeBootPattern-1318569205-project-member] Inventory has not changed for provider 639d980e-3b12-44b1-b8f4-1812416fa4dd based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74613) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 18:20:42 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-cbda49fd-3faf-4697-84d6-b52365a04cb8 tempest-TestVolumeBootPattern-1318569205 tempest-TestVolumeBootPattern-1318569205-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.188s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 18:20:42 user nova-compute[74613]: INFO nova.scheduler.client.report [None req-cbda49fd-3faf-4697-84d6-b52365a04cb8 tempest-TestVolumeBootPattern-1318569205 tempest-TestVolumeBootPattern-1318569205-project-member] Deleted allocations for instance d4385666-cff6-4133-9833-5447218c8857
Nov 29 18:20:42 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-cbda49fd-3faf-4697-84d6-b52365a04cb8 tempest-TestVolumeBootPattern-1318569205 tempest-TestVolumeBootPattern-1318569205-project-member] Lock "d4385666-cff6-4133-9833-5447218c8857" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.920s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 18:20:42 user nova-compute[74613]: DEBUG oslo_service.periodic_task [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74613) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 18:20:42 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 18:20:42 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 18:20:42 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 18:20:42 user nova-compute[74613]: DEBUG nova.compute.resource_tracker [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Auditing locally available compute resources for user (node: user) {{(pid=74613) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 29 18:20:42 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74613) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 29 18:20:42 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6993e2e7-7e03-45b4-9d3d-3742589b6078/disk --force-share --output=json {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:20:42 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6993e2e7-7e03-45b4-9d3d-3742589b6078/disk --force-share --output=json" returned: 0 in 0.207s {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:20:42 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6993e2e7-7e03-45b4-9d3d-3742589b6078/disk --force-share --output=json {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:20:43 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6993e2e7-7e03-45b4-9d3d-3742589b6078/disk --force-share --output=json" returned: 0 in 0.212s {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:20:43 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:20:43 user nova-compute[74613]: WARNING nova.virt.libvirt.driver [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 18:20:43 user nova-compute[74613]: WARNING nova.virt.libvirt.driver [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 18:20:43 user nova-compute[74613]: DEBUG nova.compute.resource_tracker [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Hypervisor/Node resource view: name=user free_ram=8775MB free_disk=24.95315933227539GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74613) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 29 18:20:43 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 18:20:43 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 18:20:43 user nova-compute[74613]: DEBUG nova.compute.resource_tracker [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Instance 6993e2e7-7e03-45b4-9d3d-3742589b6078 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74613) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 18:20:43 user nova-compute[74613]: DEBUG nova.compute.resource_tracker [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Instance 3a2ac289-fc34-4c7b-a689-b499e2562578 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74613) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 18:20:43 user nova-compute[74613]: DEBUG nova.compute.resource_tracker [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=74613) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 29 18:20:43 user nova-compute[74613]: DEBUG nova.compute.resource_tracker [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=74613) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 29 18:20:43 user nova-compute[74613]: DEBUG nova.compute.provider_tree [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Inventory has not changed in ProviderTree for provider: 639d980e-3b12-44b1-b8f4-1812416fa4dd {{(pid=74613) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 18:20:43 user nova-compute[74613]: DEBUG nova.scheduler.client.report [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Inventory has not changed for provider 639d980e-3b12-44b1-b8f4-1812416fa4dd based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74613) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 18:20:43 user nova-compute[74613]: DEBUG nova.compute.resource_tracker [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Compute_service record updated for user:user {{(pid=74613) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 29 18:20:43 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.233s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 18:20:44 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:20:44 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:20:45 user nova-compute[74613]: DEBUG oslo_service.periodic_task [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74613) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 18:20:45 user nova-compute[74613]: DEBUG nova.compute.manager [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Starting heal instance info cache {{(pid=74613) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 29 18:20:45 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Acquiring lock "refresh_cache-3a2ac289-fc34-4c7b-a689-b499e2562578" {{(pid=74613) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 18:20:45 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Acquired lock "refresh_cache-3a2ac289-fc34-4c7b-a689-b499e2562578" {{(pid=74613) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 18:20:45 user nova-compute[74613]: DEBUG nova.network.neutron [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] [instance: 3a2ac289-fc34-4c7b-a689-b499e2562578] Forcefully refreshing network info cache for instance {{(pid=74613) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 29 18:20:46 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:20:46 user nova-compute[74613]: DEBUG nova.network.neutron [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] [instance: 3a2ac289-fc34-4c7b-a689-b499e2562578] Updating instance_info_cache with network_info: [{"id": "6c245bc7-a2bd-47a5-a37b-a7d583d1b2e6", "address": "fa:16:3e:e4:33:64", "network": {"id": "4a5179dd-d0b1-44c3-80c1-08dd7b0152f1", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1296336996-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.32", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "67390f1402214191904cfbd68c3142a7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6c245bc7-a2", "ovs_interfaceid": "6c245bc7-a2bd-47a5-a37b-a7d583d1b2e6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74613) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 18:20:46 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Releasing lock "refresh_cache-3a2ac289-fc34-4c7b-a689-b499e2562578" {{(pid=74613) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 18:20:46 user nova-compute[74613]: DEBUG nova.compute.manager [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] [instance: 3a2ac289-fc34-4c7b-a689-b499e2562578] Updated the network info_cache for instance {{(pid=74613) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 29 18:20:46 user nova-compute[74613]: DEBUG oslo_service.periodic_task [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74613) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 18:20:46 user nova-compute[74613]: DEBUG oslo_service.periodic_task [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74613) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 18:20:47 user nova-compute[74613]: DEBUG oslo_service.periodic_task [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74613) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 18:20:47 user nova-compute[74613]: DEBUG nova.compute.manager [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74613) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 29 18:20:47 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:20:49 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:20:49 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:20:51 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:20:53 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-ab20d5a7-e83c-4624-931a-f706a915b756 tempest-SnapshotDataIntegrityTests-1810787156 tempest-SnapshotDataIntegrityTests-1810787156-project-member] Acquiring lock "5227902d-b2b9-40a6-988f-3c02c52404f3" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 18:20:53 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-ab20d5a7-e83c-4624-931a-f706a915b756 tempest-SnapshotDataIntegrityTests-1810787156 tempest-SnapshotDataIntegrityTests-1810787156-project-member] Lock "5227902d-b2b9-40a6-988f-3c02c52404f3" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 18:20:53 user nova-compute[74613]: DEBUG nova.compute.manager [None req-ab20d5a7-e83c-4624-931a-f706a915b756 tempest-SnapshotDataIntegrityTests-1810787156 tempest-SnapshotDataIntegrityTests-1810787156-project-member] [instance: 5227902d-b2b9-40a6-988f-3c02c52404f3] Starting instance... {{(pid=74613) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 29 18:20:53 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-ab20d5a7-e83c-4624-931a-f706a915b756 tempest-SnapshotDataIntegrityTests-1810787156 tempest-SnapshotDataIntegrityTests-1810787156-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 18:20:53 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-ab20d5a7-e83c-4624-931a-f706a915b756 tempest-SnapshotDataIntegrityTests-1810787156 tempest-SnapshotDataIntegrityTests-1810787156-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 18:20:53 user nova-compute[74613]: DEBUG nova.virt.hardware [None req-ab20d5a7-e83c-4624-931a-f706a915b756 tempest-SnapshotDataIntegrityTests-1810787156 tempest-SnapshotDataIntegrityTests-1810787156-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74613) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 29 18:20:53 user nova-compute[74613]: INFO nova.compute.claims [None req-ab20d5a7-e83c-4624-931a-f706a915b756 tempest-SnapshotDataIntegrityTests-1810787156 tempest-SnapshotDataIntegrityTests-1810787156-project-member] [instance: 5227902d-b2b9-40a6-988f-3c02c52404f3] Claim successful on node user
Nov 29 18:20:54 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:20:54 user nova-compute[74613]: DEBUG nova.compute.provider_tree [None req-ab20d5a7-e83c-4624-931a-f706a915b756 tempest-SnapshotDataIntegrityTests-1810787156 tempest-SnapshotDataIntegrityTests-1810787156-project-member] Inventory has not changed in ProviderTree for provider: 639d980e-3b12-44b1-b8f4-1812416fa4dd {{(pid=74613) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 18:20:54 user nova-compute[74613]: DEBUG nova.scheduler.client.report [None req-ab20d5a7-e83c-4624-931a-f706a915b756 tempest-SnapshotDataIntegrityTests-1810787156 tempest-SnapshotDataIntegrityTests-1810787156-project-member] Inventory has not changed for provider 639d980e-3b12-44b1-b8f4-1812416fa4dd based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74613) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 18:20:54 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-ab20d5a7-e83c-4624-931a-f706a915b756 tempest-SnapshotDataIntegrityTests-1810787156 tempest-SnapshotDataIntegrityTests-1810787156-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.263s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 18:20:54 user nova-compute[74613]: DEBUG nova.compute.manager [None req-ab20d5a7-e83c-4624-931a-f706a915b756 tempest-SnapshotDataIntegrityTests-1810787156 tempest-SnapshotDataIntegrityTests-1810787156-project-member] [instance: 5227902d-b2b9-40a6-988f-3c02c52404f3] Start building networks asynchronously for instance. {{(pid=74613) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 29 18:20:54 user nova-compute[74613]: DEBUG nova.compute.manager [None req-ab20d5a7-e83c-4624-931a-f706a915b756 tempest-SnapshotDataIntegrityTests-1810787156 tempest-SnapshotDataIntegrityTests-1810787156-project-member] [instance: 5227902d-b2b9-40a6-988f-3c02c52404f3] Allocating IP information in the background. {{(pid=74613) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 29 18:20:54 user nova-compute[74613]: DEBUG nova.network.neutron [None req-ab20d5a7-e83c-4624-931a-f706a915b756 tempest-SnapshotDataIntegrityTests-1810787156 tempest-SnapshotDataIntegrityTests-1810787156-project-member] [instance: 5227902d-b2b9-40a6-988f-3c02c52404f3] allocate_for_instance() {{(pid=74613) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 29 18:20:54 user nova-compute[74613]: INFO nova.virt.libvirt.driver [None req-ab20d5a7-e83c-4624-931a-f706a915b756 tempest-SnapshotDataIntegrityTests-1810787156 tempest-SnapshotDataIntegrityTests-1810787156-project-member] [instance: 5227902d-b2b9-40a6-988f-3c02c52404f3] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 29 18:20:54 user nova-compute[74613]: DEBUG nova.compute.manager [None req-ab20d5a7-e83c-4624-931a-f706a915b756 tempest-SnapshotDataIntegrityTests-1810787156 tempest-SnapshotDataIntegrityTests-1810787156-project-member] [instance: 5227902d-b2b9-40a6-988f-3c02c52404f3] Start building block device mappings for instance. {{(pid=74613) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 29 18:20:54 user nova-compute[74613]: DEBUG nova.policy [None req-ab20d5a7-e83c-4624-931a-f706a915b756 tempest-SnapshotDataIntegrityTests-1810787156 tempest-SnapshotDataIntegrityTests-1810787156-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '8acdfa3d177c42b98b6d320668aad126', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31a87cb1f6e14287abcfae98de155491', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74613) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 29 18:20:54 user nova-compute[74613]: DEBUG nova.compute.manager [None req-ab20d5a7-e83c-4624-931a-f706a915b756 tempest-SnapshotDataIntegrityTests-1810787156 tempest-SnapshotDataIntegrityTests-1810787156-project-member] [instance: 5227902d-b2b9-40a6-988f-3c02c52404f3] Start spawning the instance on the hypervisor. {{(pid=74613) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 29 18:20:54 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-ab20d5a7-e83c-4624-931a-f706a915b756 tempest-SnapshotDataIntegrityTests-1810787156 tempest-SnapshotDataIntegrityTests-1810787156-project-member] [instance: 5227902d-b2b9-40a6-988f-3c02c52404f3] Creating instance directory {{(pid=74613) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 29 18:20:54 user nova-compute[74613]: INFO nova.virt.libvirt.driver [None req-ab20d5a7-e83c-4624-931a-f706a915b756 tempest-SnapshotDataIntegrityTests-1810787156 tempest-SnapshotDataIntegrityTests-1810787156-project-member] [instance: 5227902d-b2b9-40a6-988f-3c02c52404f3] Creating image(s)
Nov 29 18:20:54 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-ab20d5a7-e83c-4624-931a-f706a915b756 tempest-SnapshotDataIntegrityTests-1810787156 tempest-SnapshotDataIntegrityTests-1810787156-project-member] Acquiring lock "/opt/stack/data/nova/instances/5227902d-b2b9-40a6-988f-3c02c52404f3/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 18:20:54 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-ab20d5a7-e83c-4624-931a-f706a915b756 tempest-SnapshotDataIntegrityTests-1810787156 tempest-SnapshotDataIntegrityTests-1810787156-project-member] Lock "/opt/stack/data/nova/instances/5227902d-b2b9-40a6-988f-3c02c52404f3/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 18:20:54 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-ab20d5a7-e83c-4624-931a-f706a915b756 tempest-SnapshotDataIntegrityTests-1810787156 tempest-SnapshotDataIntegrityTests-1810787156-project-member] Lock "/opt/stack/data/nova/instances/5227902d-b2b9-40a6-988f-3c02c52404f3/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 18:20:54 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-ab20d5a7-e83c-4624-931a-f706a915b756 tempest-SnapshotDataIntegrityTests-1810787156 tempest-SnapshotDataIntegrityTests-1810787156-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/21faea9e6951f3bdd0153b76ac89fe1a60a34758 --force-share --output=json {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:20:54 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-ab20d5a7-e83c-4624-931a-f706a915b756 tempest-SnapshotDataIntegrityTests-1810787156 tempest-SnapshotDataIntegrityTests-1810787156-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/21faea9e6951f3bdd0153b76ac89fe1a60a34758 --force-share --output=json" returned: 0 in 0.181s {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:20:54 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-ab20d5a7-e83c-4624-931a-f706a915b756 tempest-SnapshotDataIntegrityTests-1810787156 tempest-SnapshotDataIntegrityTests-1810787156-project-member] Acquiring lock "21faea9e6951f3bdd0153b76ac89fe1a60a34758" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 18:20:54 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-ab20d5a7-e83c-4624-931a-f706a915b756 tempest-SnapshotDataIntegrityTests-1810787156 tempest-SnapshotDataIntegrityTests-1810787156-project-member] Lock "21faea9e6951f3bdd0153b76ac89fe1a60a34758" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 18:20:54 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-ab20d5a7-e83c-4624-931a-f706a915b756 tempest-SnapshotDataIntegrityTests-1810787156 tempest-SnapshotDataIntegrityTests-1810787156-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/21faea9e6951f3bdd0153b76ac89fe1a60a34758 --force-share --output=json {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:20:54 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-ab20d5a7-e83c-4624-931a-f706a915b756 tempest-SnapshotDataIntegrityTests-1810787156 tempest-SnapshotDataIntegrityTests-1810787156-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/21faea9e6951f3bdd0153b76ac89fe1a60a34758 --force-share --output=json" returned: 0 in 0.173s {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:20:54 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-ab20d5a7-e83c-4624-931a-f706a915b756 tempest-SnapshotDataIntegrityTests-1810787156 tempest-SnapshotDataIntegrityTests-1810787156-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/21faea9e6951f3bdd0153b76ac89fe1a60a34758,backing_fmt=raw /opt/stack/data/nova/instances/5227902d-b2b9-40a6-988f-3c02c52404f3/disk 1073741824 {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:20:54 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-ab20d5a7-e83c-4624-931a-f706a915b756 tempest-SnapshotDataIntegrityTests-1810787156 tempest-SnapshotDataIntegrityTests-1810787156-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/21faea9e6951f3bdd0153b76ac89fe1a60a34758,backing_fmt=raw /opt/stack/data/nova/instances/5227902d-b2b9-40a6-988f-3c02c52404f3/disk 1073741824" returned: 0 in 0.050s {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:20:54 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-ab20d5a7-e83c-4624-931a-f706a915b756 tempest-SnapshotDataIntegrityTests-1810787156 tempest-SnapshotDataIntegrityTests-1810787156-project-member] Lock "21faea9e6951f3bdd0153b76ac89fe1a60a34758" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.232s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 18:20:54 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-ab20d5a7-e83c-4624-931a-f706a915b756 tempest-SnapshotDataIntegrityTests-1810787156 tempest-SnapshotDataIntegrityTests-1810787156-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/21faea9e6951f3bdd0153b76ac89fe1a60a34758 --force-share --output=json {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:20:55 user nova-compute[74613]: DEBUG nova.network.neutron [None req-ab20d5a7-e83c-4624-931a-f706a915b756 tempest-SnapshotDataIntegrityTests-1810787156 tempest-SnapshotDataIntegrityTests-1810787156-project-member] [instance: 5227902d-b2b9-40a6-988f-3c02c52404f3] Successfully created port: 11900168-d650-4db6-8f65-21f1f9c4b603 {{(pid=74613) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 29 18:20:55 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-ab20d5a7-e83c-4624-931a-f706a915b756 tempest-SnapshotDataIntegrityTests-1810787156 tempest-SnapshotDataIntegrityTests-1810787156-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/21faea9e6951f3bdd0153b76ac89fe1a60a34758 --force-share --output=json" returned: 0 in 0.194s {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:20:55 user nova-compute[74613]: DEBUG nova.virt.disk.api [None req-ab20d5a7-e83c-4624-931a-f706a915b756 tempest-SnapshotDataIntegrityTests-1810787156 tempest-SnapshotDataIntegrityTests-1810787156-project-member] Checking if we can resize image /opt/stack/data/nova/instances/5227902d-b2b9-40a6-988f-3c02c52404f3/disk. size=1073741824 {{(pid=74613) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 29 18:20:55 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-ab20d5a7-e83c-4624-931a-f706a915b756 tempest-SnapshotDataIntegrityTests-1810787156 tempest-SnapshotDataIntegrityTests-1810787156-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5227902d-b2b9-40a6-988f-3c02c52404f3/disk --force-share --output=json {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:20:55 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-ab20d5a7-e83c-4624-931a-f706a915b756 tempest-SnapshotDataIntegrityTests-1810787156 tempest-SnapshotDataIntegrityTests-1810787156-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5227902d-b2b9-40a6-988f-3c02c52404f3/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:20:55 user nova-compute[74613]: DEBUG nova.virt.disk.api [None req-ab20d5a7-e83c-4624-931a-f706a915b756 tempest-SnapshotDataIntegrityTests-1810787156 tempest-SnapshotDataIntegrityTests-1810787156-project-member] Cannot resize image /opt/stack/data/nova/instances/5227902d-b2b9-40a6-988f-3c02c52404f3/disk to a smaller size. {{(pid=74613) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 29 18:20:55 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-ab20d5a7-e83c-4624-931a-f706a915b756 tempest-SnapshotDataIntegrityTests-1810787156 tempest-SnapshotDataIntegrityTests-1810787156-project-member] [instance: 5227902d-b2b9-40a6-988f-3c02c52404f3] Created local disks {{(pid=74613) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 29 18:20:55 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-ab20d5a7-e83c-4624-931a-f706a915b756 tempest-SnapshotDataIntegrityTests-1810787156 tempest-SnapshotDataIntegrityTests-1810787156-project-member] [instance: 5227902d-b2b9-40a6-988f-3c02c52404f3] Ensure instance console log exists: /opt/stack/data/nova/instances/5227902d-b2b9-40a6-988f-3c02c52404f3/console.log {{(pid=74613) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 29 18:20:55 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-ab20d5a7-e83c-4624-931a-f706a915b756 tempest-SnapshotDataIntegrityTests-1810787156 tempest-SnapshotDataIntegrityTests-1810787156-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 18:20:55 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-ab20d5a7-e83c-4624-931a-f706a915b756 tempest-SnapshotDataIntegrityTests-1810787156 tempest-SnapshotDataIntegrityTests-1810787156-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 18:20:55 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-ab20d5a7-e83c-4624-931a-f706a915b756 tempest-SnapshotDataIntegrityTests-1810787156 tempest-SnapshotDataIntegrityTests-1810787156-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 18:20:55 user nova-compute[74613]: DEBUG nova.network.neutron [None req-ab20d5a7-e83c-4624-931a-f706a915b756 tempest-SnapshotDataIntegrityTests-1810787156 tempest-SnapshotDataIntegrityTests-1810787156-project-member] [instance: 5227902d-b2b9-40a6-988f-3c02c52404f3] Successfully updated port: 11900168-d650-4db6-8f65-21f1f9c4b603 {{(pid=74613) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 29 18:20:55 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-ab20d5a7-e83c-4624-931a-f706a915b756 tempest-SnapshotDataIntegrityTests-1810787156 tempest-SnapshotDataIntegrityTests-1810787156-project-member] Acquiring lock "refresh_cache-5227902d-b2b9-40a6-988f-3c02c52404f3" {{(pid=74613) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 18:20:55 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-ab20d5a7-e83c-4624-931a-f706a915b756 tempest-SnapshotDataIntegrityTests-1810787156 tempest-SnapshotDataIntegrityTests-1810787156-project-member] Acquired lock "refresh_cache-5227902d-b2b9-40a6-988f-3c02c52404f3" {{(pid=74613) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 18:20:55 user nova-compute[74613]: DEBUG nova.network.neutron [None req-ab20d5a7-e83c-4624-931a-f706a915b756 tempest-SnapshotDataIntegrityTests-1810787156 tempest-SnapshotDataIntegrityTests-1810787156-project-member] [instance: 5227902d-b2b9-40a6-988f-3c02c52404f3] Building network info cache for instance {{(pid=74613) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 29 18:20:55 user nova-compute[74613]: DEBUG nova.compute.manager [req-0db96fcb-1387-4398-8b7c-20c42a3cde4f req-ec8b352c-9322-4374-aa9a-4cbb44a22715 service nova] [instance: 5227902d-b2b9-40a6-988f-3c02c52404f3] Received event network-changed-11900168-d650-4db6-8f65-21f1f9c4b603 {{(pid=74613) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 18:20:55 user nova-compute[74613]: DEBUG nova.compute.manager [req-0db96fcb-1387-4398-8b7c-20c42a3cde4f req-ec8b352c-9322-4374-aa9a-4cbb44a22715 service nova] [instance: 5227902d-b2b9-40a6-988f-3c02c52404f3] Refreshing instance network info cache due to event network-changed-11900168-d650-4db6-8f65-21f1f9c4b603. {{(pid=74613) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 18:20:55 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-0db96fcb-1387-4398-8b7c-20c42a3cde4f req-ec8b352c-9322-4374-aa9a-4cbb44a22715 service nova] Acquiring lock "refresh_cache-5227902d-b2b9-40a6-988f-3c02c52404f3" {{(pid=74613) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 18:20:55 user nova-compute[74613]: DEBUG nova.network.neutron [None req-ab20d5a7-e83c-4624-931a-f706a915b756 tempest-SnapshotDataIntegrityTests-1810787156 tempest-SnapshotDataIntegrityTests-1810787156-project-member] [instance: 5227902d-b2b9-40a6-988f-3c02c52404f3] Instance cache missing network info. {{(pid=74613) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 29 18:20:56 user nova-compute[74613]: DEBUG nova.network.neutron [None req-ab20d5a7-e83c-4624-931a-f706a915b756 tempest-SnapshotDataIntegrityTests-1810787156 tempest-SnapshotDataIntegrityTests-1810787156-project-member] [instance: 5227902d-b2b9-40a6-988f-3c02c52404f3] Updating instance_info_cache with network_info: [{"id": "11900168-d650-4db6-8f65-21f1f9c4b603", "address": "fa:16:3e:40:72:ca", "network": {"id": "8951bb42-2dd0-4887-b0d1-fdb8d3ac7589", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1016730518-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "31a87cb1f6e14287abcfae98de155491", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap11900168-d6", "ovs_interfaceid": "11900168-d650-4db6-8f65-21f1f9c4b603", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74613) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 18:20:56 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-ab20d5a7-e83c-4624-931a-f706a915b756 tempest-SnapshotDataIntegrityTests-1810787156 tempest-SnapshotDataIntegrityTests-1810787156-project-member] Releasing lock "refresh_cache-5227902d-b2b9-40a6-988f-3c02c52404f3" {{(pid=74613) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 18:20:56 user nova-compute[74613]: DEBUG nova.compute.manager [None req-ab20d5a7-e83c-4624-931a-f706a915b756 tempest-SnapshotDataIntegrityTests-1810787156 tempest-SnapshotDataIntegrityTests-1810787156-project-member] [instance: 5227902d-b2b9-40a6-988f-3c02c52404f3] Instance network_info: |[{"id": "11900168-d650-4db6-8f65-21f1f9c4b603", "address": "fa:16:3e:40:72:ca", "network": {"id": "8951bb42-2dd0-4887-b0d1-fdb8d3ac7589", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1016730518-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "31a87cb1f6e14287abcfae98de155491", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap11900168-d6", "ovs_interfaceid": "11900168-d650-4db6-8f65-21f1f9c4b603", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74613) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 29 18:20:56 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-0db96fcb-1387-4398-8b7c-20c42a3cde4f req-ec8b352c-9322-4374-aa9a-4cbb44a22715 service nova] Acquired lock "refresh_cache-5227902d-b2b9-40a6-988f-3c02c52404f3" {{(pid=74613) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 18:20:56 user nova-compute[74613]: DEBUG nova.network.neutron [req-0db96fcb-1387-4398-8b7c-20c42a3cde4f req-ec8b352c-9322-4374-aa9a-4cbb44a22715 service nova] [instance: 5227902d-b2b9-40a6-988f-3c02c52404f3] Refreshing network info cache for port 11900168-d650-4db6-8f65-21f1f9c4b603 {{(pid=74613) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 18:20:56 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-ab20d5a7-e83c-4624-931a-f706a915b756 tempest-SnapshotDataIntegrityTests-1810787156 tempest-SnapshotDataIntegrityTests-1810787156-project-member] [instance: 5227902d-b2b9-40a6-988f-3c02c52404f3] Start _get_guest_xml network_info=[{"id": "11900168-d650-4db6-8f65-21f1f9c4b603", "address": "fa:16:3e:40:72:ca", "network": {"id": "8951bb42-2dd0-4887-b0d1-fdb8d3ac7589", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1016730518-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "31a87cb1f6e14287abcfae98de155491", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap11900168-d6", "ovs_interfaceid": "11900168-d650-4db6-8f65-21f1f9c4b603", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-29T17:47:38Z,direct_url=<?>,disk_format='qcow2',id=4217f428-8d9d-4ee1-9614-642d26d90c46,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='794b07cbd46a44b5865cfda741036bae',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-29T17:47:40Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'size': 0, 'device_type': 'disk', 'boot_index': 0, 'guest_format': None, 'encrypted': False, 'encryption_format': None, 'disk_bus': 'virtio', 'image_id': '4217f428-8d9d-4ee1-9614-642d26d90c46'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74613) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 29 18:20:56 user nova-compute[74613]: WARNING nova.virt.libvirt.driver [None req-ab20d5a7-e83c-4624-931a-f706a915b756 tempest-SnapshotDataIntegrityTests-1810787156 tempest-SnapshotDataIntegrityTests-1810787156-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 18:20:56 user nova-compute[74613]: WARNING nova.virt.libvirt.driver [None req-ab20d5a7-e83c-4624-931a-f706a915b756 tempest-SnapshotDataIntegrityTests-1810787156 tempest-SnapshotDataIntegrityTests-1810787156-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 18:20:56 user nova-compute[74613]: DEBUG nova.virt.libvirt.host [None req-ab20d5a7-e83c-4624-931a-f706a915b756 tempest-SnapshotDataIntegrityTests-1810787156 tempest-SnapshotDataIntegrityTests-1810787156-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74613) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 29 18:20:56 user nova-compute[74613]: DEBUG nova.virt.libvirt.host [None req-ab20d5a7-e83c-4624-931a-f706a915b756 tempest-SnapshotDataIntegrityTests-1810787156 tempest-SnapshotDataIntegrityTests-1810787156-project-member] CPU controller missing on host. {{(pid=74613) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 29 18:20:56 user nova-compute[74613]: DEBUG nova.virt.libvirt.host [None req-ab20d5a7-e83c-4624-931a-f706a915b756 tempest-SnapshotDataIntegrityTests-1810787156 tempest-SnapshotDataIntegrityTests-1810787156-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74613) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 29 18:20:56 user nova-compute[74613]: DEBUG nova.virt.libvirt.host [None req-ab20d5a7-e83c-4624-931a-f706a915b756 tempest-SnapshotDataIntegrityTests-1810787156 tempest-SnapshotDataIntegrityTests-1810787156-project-member] CPU controller found on host. {{(pid=74613) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 29 18:20:56 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-ab20d5a7-e83c-4624-931a-f706a915b756 tempest-SnapshotDataIntegrityTests-1810787156 tempest-SnapshotDataIntegrityTests-1810787156-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74613) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 29 18:20:56 user nova-compute[74613]: DEBUG nova.virt.hardware [None req-ab20d5a7-e83c-4624-931a-f706a915b756 tempest-SnapshotDataIntegrityTests-1810787156 tempest-SnapshotDataIntegrityTests-1810787156-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-29T17:47:27Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-29T17:47:38Z,direct_url=<?>,disk_format='qcow2',id=4217f428-8d9d-4ee1-9614-642d26d90c46,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='794b07cbd46a44b5865cfda741036bae',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-29T17:47:40Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74613) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 29 18:20:56 user nova-compute[74613]: DEBUG nova.virt.hardware [None req-ab20d5a7-e83c-4624-931a-f706a915b756 tempest-SnapshotDataIntegrityTests-1810787156 tempest-SnapshotDataIntegrityTests-1810787156-project-member] Flavor limits 0:0:0 {{(pid=74613) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 29 18:20:56 user nova-compute[74613]: DEBUG nova.virt.hardware [None req-ab20d5a7-e83c-4624-931a-f706a915b756 tempest-SnapshotDataIntegrityTests-1810787156 tempest-SnapshotDataIntegrityTests-1810787156-project-member] Image limits 0:0:0 {{(pid=74613) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 29 18:20:56 user nova-compute[74613]: DEBUG nova.virt.hardware [None req-ab20d5a7-e83c-4624-931a-f706a915b756 tempest-SnapshotDataIntegrityTests-1810787156 tempest-SnapshotDataIntegrityTests-1810787156-project-member] Flavor pref 0:0:0 {{(pid=74613) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 29 18:20:56 user nova-compute[74613]: DEBUG nova.virt.hardware [None req-ab20d5a7-e83c-4624-931a-f706a915b756 tempest-SnapshotDataIntegrityTests-1810787156 tempest-SnapshotDataIntegrityTests-1810787156-project-member] Image pref 0:0:0 {{(pid=74613) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 29 18:20:56 user nova-compute[74613]: DEBUG nova.virt.hardware [None req-ab20d5a7-e83c-4624-931a-f706a915b756 tempest-SnapshotDataIntegrityTests-1810787156 tempest-SnapshotDataIntegrityTests-1810787156-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74613) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 29 18:20:56 user nova-compute[74613]: DEBUG nova.virt.hardware [None req-ab20d5a7-e83c-4624-931a-f706a915b756 tempest-SnapshotDataIntegrityTests-1810787156 tempest-SnapshotDataIntegrityTests-1810787156-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74613) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 29 18:20:56 user nova-compute[74613]: DEBUG nova.virt.hardware [None req-ab20d5a7-e83c-4624-931a-f706a915b756 tempest-SnapshotDataIntegrityTests-1810787156 tempest-SnapshotDataIntegrityTests-1810787156-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74613) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 29 18:20:56 user nova-compute[74613]: DEBUG nova.virt.hardware [None req-ab20d5a7-e83c-4624-931a-f706a915b756 tempest-SnapshotDataIntegrityTests-1810787156 tempest-SnapshotDataIntegrityTests-1810787156-project-member] Got 1 possible topologies {{(pid=74613) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 29 18:20:56 user nova-compute[74613]: DEBUG nova.virt.hardware [None req-ab20d5a7-e83c-4624-931a-f706a915b756 tempest-SnapshotDataIntegrityTests-1810787156 tempest-SnapshotDataIntegrityTests-1810787156-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74613) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 29 18:20:56 user nova-compute[74613]: DEBUG nova.virt.hardware [None req-ab20d5a7-e83c-4624-931a-f706a915b756 tempest-SnapshotDataIntegrityTests-1810787156 tempest-SnapshotDataIntegrityTests-1810787156-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74613) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 29 18:20:56 user nova-compute[74613]: DEBUG nova.virt.libvirt.vif [None req-ab20d5a7-e83c-4624-931a-f706a915b756 tempest-SnapshotDataIntegrityTests-1810787156 tempest-SnapshotDataIntegrityTests-1810787156-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T18:20:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-1230319266',display_name='tempest-SnapshotDataIntegrityTests-server-1230319266',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-1230319266',id=44,image_ref='4217f428-8d9d-4ee1-9614-642d26d90c46',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBK/8JM2RiAE977sqn2CDbjaI/GaK+vQXJgKx2mefD/Di7V3UryfYnJ6tRssF59ZZL0dPxhn/FkiNzSo8zeqcl3VxbkmNOgzfTwZ7SEeKGN/6sflv/HsVRPadR+Y2yhA3uw==',key_name='tempest-keypair-1596414286',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='31a87cb1f6e14287abcfae98de155491',ramdisk_id='',reservation_id='r-viuvf1mj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='4217f428-8d9d-4ee1-9614-642d26d90c46',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-SnapshotDataIntegrityTests-1810787156',owner_user_name='tempest-SnapshotDataIntegrityTests-1810787156-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T18:20:54Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8acdfa3d177c42b98b6d320668aad126',uuid=5227902d-b2b9-40a6-988f-3c02c52404f3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "11900168-d650-4db6-8f65-21f1f9c4b603", "address": "fa:16:3e:40:72:ca", "network": {"id": "8951bb42-2dd0-4887-b0d1-fdb8d3ac7589", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1016730518-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "31a87cb1f6e14287abcfae98de155491", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap11900168-d6", "ovs_interfaceid": "11900168-d650-4db6-8f65-21f1f9c4b603", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74613) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 29 18:20:56 user nova-compute[74613]: DEBUG nova.network.os_vif_util [None req-ab20d5a7-e83c-4624-931a-f706a915b756 tempest-SnapshotDataIntegrityTests-1810787156 tempest-SnapshotDataIntegrityTests-1810787156-project-member] Converting VIF {"id": "11900168-d650-4db6-8f65-21f1f9c4b603", "address": "fa:16:3e:40:72:ca", "network": {"id": "8951bb42-2dd0-4887-b0d1-fdb8d3ac7589", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1016730518-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "31a87cb1f6e14287abcfae98de155491", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap11900168-d6", "ovs_interfaceid": "11900168-d650-4db6-8f65-21f1f9c4b603", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74613) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 18:20:56 user nova-compute[74613]: DEBUG nova.network.os_vif_util [None req-ab20d5a7-e83c-4624-931a-f706a915b756 tempest-SnapshotDataIntegrityTests-1810787156 tempest-SnapshotDataIntegrityTests-1810787156-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:40:72:ca,bridge_name='br-int',has_traffic_filtering=True,id=11900168-d650-4db6-8f65-21f1f9c4b603,network=Network(8951bb42-2dd0-4887-b0d1-fdb8d3ac7589),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap11900168-d6') {{(pid=74613) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 18:20:56 user nova-compute[74613]: DEBUG nova.objects.instance [None req-ab20d5a7-e83c-4624-931a-f706a915b756 tempest-SnapshotDataIntegrityTests-1810787156 tempest-SnapshotDataIntegrityTests-1810787156-project-member] Lazy-loading 'pci_devices' on Instance uuid 5227902d-b2b9-40a6-988f-3c02c52404f3 {{(pid=74613) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 18:20:56 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:20:56 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-ab20d5a7-e83c-4624-931a-f706a915b756 tempest-SnapshotDataIntegrityTests-1810787156 tempest-SnapshotDataIntegrityTests-1810787156-project-member] [instance: 5227902d-b2b9-40a6-988f-3c02c52404f3] End _get_guest_xml xml=<domain type="kvm">
Nov 29 18:20:56 user nova-compute[74613]:   <uuid>5227902d-b2b9-40a6-988f-3c02c52404f3</uuid>
Nov 29 18:20:56 user nova-compute[74613]:   <name>instance-0000002c</name>
Nov 29 18:20:56 user nova-compute[74613]:   <memory>524288</memory>
Nov 29 18:20:56 user nova-compute[74613]:   <vcpu>1</vcpu>
Nov 29 18:20:56 user nova-compute[74613]:   <metadata>
Nov 29 18:20:56 user nova-compute[74613]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 29 18:20:56 user nova-compute[74613]:       <nova:package version="0.0.0"/>
Nov 29 18:20:56 user nova-compute[74613]:       <nova:name>tempest-SnapshotDataIntegrityTests-server-1230319266</nova:name>
Nov 29 18:20:56 user nova-compute[74613]:       <nova:creationTime>2023-11-29 18:20:56</nova:creationTime>
Nov 29 18:20:56 user nova-compute[74613]:       <nova:flavor name="m1.tiny">
Nov 29 18:20:56 user nova-compute[74613]:         <nova:memory>512</nova:memory>
Nov 29 18:20:56 user nova-compute[74613]:         <nova:disk>1</nova:disk>
Nov 29 18:20:56 user nova-compute[74613]:         <nova:swap>0</nova:swap>
Nov 29 18:20:56 user nova-compute[74613]:         <nova:ephemeral>0</nova:ephemeral>
Nov 29 18:20:56 user nova-compute[74613]:         <nova:vcpus>1</nova:vcpus>
Nov 29 18:20:56 user nova-compute[74613]:       </nova:flavor>
Nov 29 18:20:56 user nova-compute[74613]:       <nova:owner>
Nov 29 18:20:56 user nova-compute[74613]:         <nova:user uuid="8acdfa3d177c42b98b6d320668aad126">tempest-SnapshotDataIntegrityTests-1810787156-project-member</nova:user>
Nov 29 18:20:56 user nova-compute[74613]:         <nova:project uuid="31a87cb1f6e14287abcfae98de155491">tempest-SnapshotDataIntegrityTests-1810787156</nova:project>
Nov 29 18:20:56 user nova-compute[74613]:       </nova:owner>
Nov 29 18:20:56 user nova-compute[74613]:       <nova:root type="image" uuid="4217f428-8d9d-4ee1-9614-642d26d90c46"/>
Nov 29 18:20:56 user nova-compute[74613]:       <nova:ports>
Nov 29 18:20:56 user nova-compute[74613]:         <nova:port uuid="11900168-d650-4db6-8f65-21f1f9c4b603">
Nov 29 18:20:56 user nova-compute[74613]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Nov 29 18:20:56 user nova-compute[74613]:         </nova:port>
Nov 29 18:20:56 user nova-compute[74613]:       </nova:ports>
Nov 29 18:20:56 user nova-compute[74613]:     </nova:instance>
Nov 29 18:20:56 user nova-compute[74613]:   </metadata>
Nov 29 18:20:56 user nova-compute[74613]:   <sysinfo type="smbios">
Nov 29 18:20:56 user nova-compute[74613]:     <system>
Nov 29 18:20:56 user nova-compute[74613]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 29 18:20:56 user nova-compute[74613]:       <entry name="product">OpenStack Nova</entry>
Nov 29 18:20:56 user nova-compute[74613]:       <entry name="version">0.0.0</entry>
Nov 29 18:20:56 user nova-compute[74613]:       <entry name="serial">5227902d-b2b9-40a6-988f-3c02c52404f3</entry>
Nov 29 18:20:56 user nova-compute[74613]:       <entry name="uuid">5227902d-b2b9-40a6-988f-3c02c52404f3</entry>
Nov 29 18:20:56 user nova-compute[74613]:       <entry name="family">Virtual Machine</entry>
Nov 29 18:20:56 user nova-compute[74613]:     </system>
Nov 29 18:20:56 user nova-compute[74613]:   </sysinfo>
Nov 29 18:20:56 user nova-compute[74613]:   <os>
Nov 29 18:20:56 user nova-compute[74613]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 29 18:20:56 user nova-compute[74613]:     <boot dev="hd"/>
Nov 29 18:20:56 user nova-compute[74613]:     <smbios mode="sysinfo"/>
Nov 29 18:20:56 user nova-compute[74613]:   </os>
Nov 29 18:20:56 user nova-compute[74613]:   <features>
Nov 29 18:20:56 user nova-compute[74613]:     <acpi/>
Nov 29 18:20:56 user nova-compute[74613]:     <apic/>
Nov 29 18:20:56 user nova-compute[74613]:     <vmcoreinfo/>
Nov 29 18:20:56 user nova-compute[74613]:   </features>
Nov 29 18:20:56 user nova-compute[74613]:   <clock offset="utc">
Nov 29 18:20:56 user nova-compute[74613]:     <timer name="pit" tickpolicy="delay"/>
Nov 29 18:20:56 user nova-compute[74613]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 29 18:20:56 user nova-compute[74613]:     <timer name="hpet" present="no"/>
Nov 29 18:20:56 user nova-compute[74613]:   </clock>
Nov 29 18:20:56 user nova-compute[74613]:   <cpu mode="custom" match="exact">
Nov 29 18:20:56 user nova-compute[74613]:     <model>Nehalem</model>
Nov 29 18:20:56 user nova-compute[74613]:     <topology sockets="1" cores="1" threads="1"/>
Nov 29 18:20:56 user nova-compute[74613]:   </cpu>
Nov 29 18:20:56 user nova-compute[74613]:   <devices>
Nov 29 18:20:56 user nova-compute[74613]:     <disk type="file" device="disk">
Nov 29 18:20:56 user nova-compute[74613]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 29 18:20:56 user nova-compute[74613]:       <source file="/opt/stack/data/nova/instances/5227902d-b2b9-40a6-988f-3c02c52404f3/disk"/>
Nov 29 18:20:56 user nova-compute[74613]:       <target dev="vda" bus="virtio"/>
Nov 29 18:20:56 user nova-compute[74613]:     </disk>
Nov 29 18:20:56 user nova-compute[74613]:     <interface type="ethernet">
Nov 29 18:20:56 user nova-compute[74613]:       <mac address="fa:16:3e:40:72:ca"/>
Nov 29 18:20:56 user nova-compute[74613]:       <model type="virtio"/>
Nov 29 18:20:56 user nova-compute[74613]:       <mtu size="1442"/>
Nov 29 18:20:56 user nova-compute[74613]:       <target dev="tap11900168-d6"/>
Nov 29 18:20:56 user nova-compute[74613]:     </interface>
Nov 29 18:20:56 user nova-compute[74613]:     <serial type="pty">
Nov 29 18:20:56 user nova-compute[74613]:       <log file="/opt/stack/data/nova/instances/5227902d-b2b9-40a6-988f-3c02c52404f3/console.log" append="off"/>
Nov 29 18:20:56 user nova-compute[74613]:     </serial>
Nov 29 18:20:56 user nova-compute[74613]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 29 18:20:56 user nova-compute[74613]:     <video>
Nov 29 18:20:56 user nova-compute[74613]:       <model type="virtio"/>
Nov 29 18:20:56 user nova-compute[74613]:     </video>
Nov 29 18:20:56 user nova-compute[74613]:     <rng model="virtio">
Nov 29 18:20:56 user nova-compute[74613]:       <backend model="random">/dev/urandom</backend>
Nov 29 18:20:56 user nova-compute[74613]:     </rng>
Nov 29 18:20:56 user nova-compute[74613]:     <controller type="usb" index="0" model="none"/>
Nov 29 18:20:56 user nova-compute[74613]:     <memballoon model="virtio">
Nov 29 18:20:56 user nova-compute[74613]:       <stats period="10"/>
Nov 29 18:20:56 user nova-compute[74613]:     </memballoon>
Nov 29 18:20:56 user nova-compute[74613]:   </devices>
Nov 29 18:20:56 user nova-compute[74613]: </domain>
Nov 29 18:20:56 user nova-compute[74613]:  {{(pid=74613) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 29 18:20:56 user nova-compute[74613]: DEBUG nova.virt.libvirt.vif [None req-ab20d5a7-e83c-4624-931a-f706a915b756 tempest-SnapshotDataIntegrityTests-1810787156 tempest-SnapshotDataIntegrityTests-1810787156-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T18:20:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-1230319266',display_name='tempest-SnapshotDataIntegrityTests-server-1230319266',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-1230319266',id=44,image_ref='4217f428-8d9d-4ee1-9614-642d26d90c46',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBK/8JM2RiAE977sqn2CDbjaI/GaK+vQXJgKx2mefD/Di7V3UryfYnJ6tRssF59ZZL0dPxhn/FkiNzSo8zeqcl3VxbkmNOgzfTwZ7SEeKGN/6sflv/HsVRPadR+Y2yhA3uw==',key_name='tempest-keypair-1596414286',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='31a87cb1f6e14287abcfae98de155491',ramdisk_id='',reservation_id='r-viuvf1mj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='4217f428-8d9d-4ee1-9614-642d26d90c46',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-SnapshotDataIntegrityTests-1810787156',owner_user_name='tempest-SnapshotDataIntegrityTests-1810787156-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T18:20:54Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8acdfa3d177c42b98b6d320668aad126',uuid=5227902d-b2b9-40a6-988f-3c02c52404f3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "11900168-d650-4db6-8f65-21f1f9c4b603", "address": "fa:16:3e:40:72:ca", "network": {"id": "8951bb42-2dd0-4887-b0d1-fdb8d3ac7589", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1016730518-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "31a87cb1f6e14287abcfae98de155491", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap11900168-d6", "ovs_interfaceid": "11900168-d650-4db6-8f65-21f1f9c4b603", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74613) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 29 18:20:56 user nova-compute[74613]: DEBUG nova.network.os_vif_util [None req-ab20d5a7-e83c-4624-931a-f706a915b756 tempest-SnapshotDataIntegrityTests-1810787156 tempest-SnapshotDataIntegrityTests-1810787156-project-member] Converting VIF {"id": "11900168-d650-4db6-8f65-21f1f9c4b603", "address": "fa:16:3e:40:72:ca", "network": {"id": "8951bb42-2dd0-4887-b0d1-fdb8d3ac7589", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1016730518-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "31a87cb1f6e14287abcfae98de155491", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap11900168-d6", "ovs_interfaceid": "11900168-d650-4db6-8f65-21f1f9c4b603", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74613) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 18:20:56 user nova-compute[74613]: DEBUG nova.network.os_vif_util [None req-ab20d5a7-e83c-4624-931a-f706a915b756 tempest-SnapshotDataIntegrityTests-1810787156 tempest-SnapshotDataIntegrityTests-1810787156-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:40:72:ca,bridge_name='br-int',has_traffic_filtering=True,id=11900168-d650-4db6-8f65-21f1f9c4b603,network=Network(8951bb42-2dd0-4887-b0d1-fdb8d3ac7589),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap11900168-d6') {{(pid=74613) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 18:20:56 user nova-compute[74613]: DEBUG os_vif [None req-ab20d5a7-e83c-4624-931a-f706a915b756 tempest-SnapshotDataIntegrityTests-1810787156 tempest-SnapshotDataIntegrityTests-1810787156-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:40:72:ca,bridge_name='br-int',has_traffic_filtering=True,id=11900168-d650-4db6-8f65-21f1f9c4b603,network=Network(8951bb42-2dd0-4887-b0d1-fdb8d3ac7589),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap11900168-d6') {{(pid=74613) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 29 18:20:56 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:20:56 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74613) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 18:20:56 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74613) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 29 18:20:56 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:20:56 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'c37ce854-76e1-5e9c-8201-b8cc3bbe5b16', '_type': 'linux-noop'}}, row=False) {{(pid=74613) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 18:20:56 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:20:56 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:20:56 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:20:56 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap11900168-d6, may_exist=True, interface_attrs={}) {{(pid=74613) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 18:20:56 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap11900168-d6, col_values=(('qos', UUID('effea2a8-9c19-4e0a-9c80-ec4b3c3dabb3')),), if_exists=True) {{(pid=74613) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 18:20:56 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap11900168-d6, col_values=(('external_ids', {'iface-id': '11900168-d650-4db6-8f65-21f1f9c4b603', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:40:72:ca', 'vm-uuid': '5227902d-b2b9-40a6-988f-3c02c52404f3'}),), if_exists=True) {{(pid=74613) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 18:20:56 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:20:56 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 18:20:56 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:20:56 user nova-compute[74613]: INFO os_vif [None req-ab20d5a7-e83c-4624-931a-f706a915b756 tempest-SnapshotDataIntegrityTests-1810787156 tempest-SnapshotDataIntegrityTests-1810787156-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:40:72:ca,bridge_name='br-int',has_traffic_filtering=True,id=11900168-d650-4db6-8f65-21f1f9c4b603,network=Network(8951bb42-2dd0-4887-b0d1-fdb8d3ac7589),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap11900168-d6')
Nov 29 18:20:56 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-ab20d5a7-e83c-4624-931a-f706a915b756 tempest-SnapshotDataIntegrityTests-1810787156 tempest-SnapshotDataIntegrityTests-1810787156-project-member] No BDM found with device name vda, not building metadata. {{(pid=74613) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 18:20:56 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-ab20d5a7-e83c-4624-931a-f706a915b756 tempest-SnapshotDataIntegrityTests-1810787156 tempest-SnapshotDataIntegrityTests-1810787156-project-member] No VIF found with MAC fa:16:3e:40:72:ca, not building metadata {{(pid=74613) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 29 18:20:56 user nova-compute[74613]: DEBUG nova.network.neutron [req-0db96fcb-1387-4398-8b7c-20c42a3cde4f req-ec8b352c-9322-4374-aa9a-4cbb44a22715 service nova] [instance: 5227902d-b2b9-40a6-988f-3c02c52404f3] Updated VIF entry in instance network info cache for port 11900168-d650-4db6-8f65-21f1f9c4b603. {{(pid=74613) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 18:20:56 user nova-compute[74613]: DEBUG nova.network.neutron [req-0db96fcb-1387-4398-8b7c-20c42a3cde4f req-ec8b352c-9322-4374-aa9a-4cbb44a22715 service nova] [instance: 5227902d-b2b9-40a6-988f-3c02c52404f3] Updating instance_info_cache with network_info: [{"id": "11900168-d650-4db6-8f65-21f1f9c4b603", "address": "fa:16:3e:40:72:ca", "network": {"id": "8951bb42-2dd0-4887-b0d1-fdb8d3ac7589", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1016730518-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "31a87cb1f6e14287abcfae98de155491", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap11900168-d6", "ovs_interfaceid": "11900168-d650-4db6-8f65-21f1f9c4b603", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74613) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 18:20:56 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-0db96fcb-1387-4398-8b7c-20c42a3cde4f req-ec8b352c-9322-4374-aa9a-4cbb44a22715 service nova] Releasing lock "refresh_cache-5227902d-b2b9-40a6-988f-3c02c52404f3" {{(pid=74613) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 18:20:57 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:20:57 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:20:57 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:20:57 user nova-compute[74613]: DEBUG nova.compute.manager [req-abcb71c5-4a46-4e8d-beae-eb528241e038 req-106cbd0d-769e-4799-b651-e0b4ecc2640c service nova] [instance: 5227902d-b2b9-40a6-988f-3c02c52404f3] Received event network-vif-plugged-11900168-d650-4db6-8f65-21f1f9c4b603 {{(pid=74613) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 18:20:57 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-abcb71c5-4a46-4e8d-beae-eb528241e038 req-106cbd0d-769e-4799-b651-e0b4ecc2640c service nova] Acquiring lock "5227902d-b2b9-40a6-988f-3c02c52404f3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 18:20:57 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-abcb71c5-4a46-4e8d-beae-eb528241e038 req-106cbd0d-769e-4799-b651-e0b4ecc2640c service nova] Lock "5227902d-b2b9-40a6-988f-3c02c52404f3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 18:20:57 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-abcb71c5-4a46-4e8d-beae-eb528241e038 req-106cbd0d-769e-4799-b651-e0b4ecc2640c service nova] Lock "5227902d-b2b9-40a6-988f-3c02c52404f3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 18:20:57 user nova-compute[74613]: DEBUG nova.compute.manager [req-abcb71c5-4a46-4e8d-beae-eb528241e038 req-106cbd0d-769e-4799-b651-e0b4ecc2640c service nova] [instance: 5227902d-b2b9-40a6-988f-3c02c52404f3] No waiting events found dispatching network-vif-plugged-11900168-d650-4db6-8f65-21f1f9c4b603 {{(pid=74613) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 18:20:57 user nova-compute[74613]: WARNING nova.compute.manager [req-abcb71c5-4a46-4e8d-beae-eb528241e038 req-106cbd0d-769e-4799-b651-e0b4ecc2640c service nova] [instance: 5227902d-b2b9-40a6-988f-3c02c52404f3] Received unexpected event network-vif-plugged-11900168-d650-4db6-8f65-21f1f9c4b603 for instance with vm_state building and task_state spawning.
Nov 29 18:20:58 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:20:58 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:20:58 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:20:58 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:20:59 user nova-compute[74613]: DEBUG nova.compute.manager [None req-ab20d5a7-e83c-4624-931a-f706a915b756 tempest-SnapshotDataIntegrityTests-1810787156 tempest-SnapshotDataIntegrityTests-1810787156-project-member] [instance: 5227902d-b2b9-40a6-988f-3c02c52404f3] Instance event wait completed in 0 seconds for  {{(pid=74613) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 29 18:20:59 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-ab20d5a7-e83c-4624-931a-f706a915b756 tempest-SnapshotDataIntegrityTests-1810787156 tempest-SnapshotDataIntegrityTests-1810787156-project-member] [instance: 5227902d-b2b9-40a6-988f-3c02c52404f3] Guest created on hypervisor {{(pid=74613) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 29 18:20:59 user nova-compute[74613]: INFO nova.virt.libvirt.driver [-] [instance: 5227902d-b2b9-40a6-988f-3c02c52404f3] Instance spawned successfully.
Nov 29 18:20:59 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-ab20d5a7-e83c-4624-931a-f706a915b756 tempest-SnapshotDataIntegrityTests-1810787156 tempest-SnapshotDataIntegrityTests-1810787156-project-member] [instance: 5227902d-b2b9-40a6-988f-3c02c52404f3] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74613) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 29 18:20:59 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-ab20d5a7-e83c-4624-931a-f706a915b756 tempest-SnapshotDataIntegrityTests-1810787156 tempest-SnapshotDataIntegrityTests-1810787156-project-member] [instance: 5227902d-b2b9-40a6-988f-3c02c52404f3] Found default for hw_cdrom_bus of ide {{(pid=74613) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 18:20:59 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-ab20d5a7-e83c-4624-931a-f706a915b756 tempest-SnapshotDataIntegrityTests-1810787156 tempest-SnapshotDataIntegrityTests-1810787156-project-member] [instance: 5227902d-b2b9-40a6-988f-3c02c52404f3] Found default for hw_disk_bus of virtio {{(pid=74613) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 18:20:59 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-ab20d5a7-e83c-4624-931a-f706a915b756 tempest-SnapshotDataIntegrityTests-1810787156 tempest-SnapshotDataIntegrityTests-1810787156-project-member] [instance: 5227902d-b2b9-40a6-988f-3c02c52404f3] Found default for hw_input_bus of None {{(pid=74613) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 18:20:59 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-ab20d5a7-e83c-4624-931a-f706a915b756 tempest-SnapshotDataIntegrityTests-1810787156 tempest-SnapshotDataIntegrityTests-1810787156-project-member] [instance: 5227902d-b2b9-40a6-988f-3c02c52404f3] Found default for hw_pointer_model of None {{(pid=74613) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 18:20:59 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-ab20d5a7-e83c-4624-931a-f706a915b756 tempest-SnapshotDataIntegrityTests-1810787156 tempest-SnapshotDataIntegrityTests-1810787156-project-member] [instance: 5227902d-b2b9-40a6-988f-3c02c52404f3] Found default for hw_video_model of virtio {{(pid=74613) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 18:20:59 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-ab20d5a7-e83c-4624-931a-f706a915b756 tempest-SnapshotDataIntegrityTests-1810787156 tempest-SnapshotDataIntegrityTests-1810787156-project-member] [instance: 5227902d-b2b9-40a6-988f-3c02c52404f3] Found default for hw_vif_model of virtio {{(pid=74613) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 18:20:59 user nova-compute[74613]: INFO nova.compute.manager [None req-ab20d5a7-e83c-4624-931a-f706a915b756 tempest-SnapshotDataIntegrityTests-1810787156 tempest-SnapshotDataIntegrityTests-1810787156-project-member] [instance: 5227902d-b2b9-40a6-988f-3c02c52404f3] Took 5.44 seconds to spawn the instance on the hypervisor.
Nov 29 18:20:59 user nova-compute[74613]: DEBUG nova.compute.manager [None req-ab20d5a7-e83c-4624-931a-f706a915b756 tempest-SnapshotDataIntegrityTests-1810787156 tempest-SnapshotDataIntegrityTests-1810787156-project-member] [instance: 5227902d-b2b9-40a6-988f-3c02c52404f3] Checking state {{(pid=74613) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 29 18:20:59 user nova-compute[74613]: DEBUG nova.compute.manager [req-23f723a4-f396-4cf3-acae-6ec16f621462 req-fa8d7f54-3dfb-4f7c-b18c-7a9674a6a5e5 service nova] [instance: 5227902d-b2b9-40a6-988f-3c02c52404f3] Received event network-vif-plugged-11900168-d650-4db6-8f65-21f1f9c4b603 {{(pid=74613) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 18:20:59 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-23f723a4-f396-4cf3-acae-6ec16f621462 req-fa8d7f54-3dfb-4f7c-b18c-7a9674a6a5e5 service nova] Acquiring lock "5227902d-b2b9-40a6-988f-3c02c52404f3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 18:20:59 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-23f723a4-f396-4cf3-acae-6ec16f621462 req-fa8d7f54-3dfb-4f7c-b18c-7a9674a6a5e5 service nova] Lock "5227902d-b2b9-40a6-988f-3c02c52404f3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 18:20:59 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-23f723a4-f396-4cf3-acae-6ec16f621462 req-fa8d7f54-3dfb-4f7c-b18c-7a9674a6a5e5 service nova] Lock "5227902d-b2b9-40a6-988f-3c02c52404f3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 18:20:59 user nova-compute[74613]: DEBUG nova.compute.manager [req-23f723a4-f396-4cf3-acae-6ec16f621462 req-fa8d7f54-3dfb-4f7c-b18c-7a9674a6a5e5 service nova] [instance: 5227902d-b2b9-40a6-988f-3c02c52404f3] No waiting events found dispatching network-vif-plugged-11900168-d650-4db6-8f65-21f1f9c4b603 {{(pid=74613) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 18:20:59 user nova-compute[74613]: WARNING nova.compute.manager [req-23f723a4-f396-4cf3-acae-6ec16f621462 req-fa8d7f54-3dfb-4f7c-b18c-7a9674a6a5e5 service nova] [instance: 5227902d-b2b9-40a6-988f-3c02c52404f3] Received unexpected event network-vif-plugged-11900168-d650-4db6-8f65-21f1f9c4b603 for instance with vm_state building and task_state spawning.
Nov 29 18:21:00 user nova-compute[74613]: INFO nova.compute.manager [None req-ab20d5a7-e83c-4624-931a-f706a915b756 tempest-SnapshotDataIntegrityTests-1810787156 tempest-SnapshotDataIntegrityTests-1810787156-project-member] [instance: 5227902d-b2b9-40a6-988f-3c02c52404f3] Took 6.04 seconds to build instance.
Nov 29 18:21:00 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-ab20d5a7-e83c-4624-931a-f706a915b756 tempest-SnapshotDataIntegrityTests-1810787156 tempest-SnapshotDataIntegrityTests-1810787156-project-member] Lock "5227902d-b2b9-40a6-988f-3c02c52404f3" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.137s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 18:21:01 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:21:01 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:21:06 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:21:06 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:21:11 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 18:21:16 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:21:16 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:21:21 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:21:21 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:21:21 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:21:25 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-64959016-475a-41e2-af1c-f0bf56d10d64 tempest-ServerRescueNegativeTestJSON-1891426908 tempest-ServerRescueNegativeTestJSON-1891426908-project-member] Acquiring lock "6993e2e7-7e03-45b4-9d3d-3742589b6078" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 18:21:25 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-64959016-475a-41e2-af1c-f0bf56d10d64 tempest-ServerRescueNegativeTestJSON-1891426908 tempest-ServerRescueNegativeTestJSON-1891426908-project-member] Lock "6993e2e7-7e03-45b4-9d3d-3742589b6078" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 18:21:25 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-64959016-475a-41e2-af1c-f0bf56d10d64 tempest-ServerRescueNegativeTestJSON-1891426908 tempest-ServerRescueNegativeTestJSON-1891426908-project-member] Acquiring lock "6993e2e7-7e03-45b4-9d3d-3742589b6078-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 18:21:25 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-64959016-475a-41e2-af1c-f0bf56d10d64 tempest-ServerRescueNegativeTestJSON-1891426908 tempest-ServerRescueNegativeTestJSON-1891426908-project-member] Lock "6993e2e7-7e03-45b4-9d3d-3742589b6078-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 18:21:25 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-64959016-475a-41e2-af1c-f0bf56d10d64 tempest-ServerRescueNegativeTestJSON-1891426908 tempest-ServerRescueNegativeTestJSON-1891426908-project-member] Lock "6993e2e7-7e03-45b4-9d3d-3742589b6078-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 18:21:25 user nova-compute[74613]: INFO nova.compute.manager [None req-64959016-475a-41e2-af1c-f0bf56d10d64 tempest-ServerRescueNegativeTestJSON-1891426908 tempest-ServerRescueNegativeTestJSON-1891426908-project-member] [instance: 6993e2e7-7e03-45b4-9d3d-3742589b6078] Terminating instance
Nov 29 18:21:25 user nova-compute[74613]: DEBUG nova.compute.manager [None req-64959016-475a-41e2-af1c-f0bf56d10d64 tempest-ServerRescueNegativeTestJSON-1891426908 tempest-ServerRescueNegativeTestJSON-1891426908-project-member] [instance: 6993e2e7-7e03-45b4-9d3d-3742589b6078] Start destroying the instance on the hypervisor. {{(pid=74613) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 29 18:21:25 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:21:25 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:21:25 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:21:25 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:21:25 user nova-compute[74613]: DEBUG nova.compute.manager [req-21d05fd3-fafd-4aca-84b5-a1f29708ee1d req-b4318d1d-8c5d-43e8-8cb0-743e5e908a53 service nova] [instance: 6993e2e7-7e03-45b4-9d3d-3742589b6078] Received event network-vif-unplugged-5216b7ab-6e2b-4d7f-8c7f-e52b03d282b9 {{(pid=74613) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 18:21:25 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-21d05fd3-fafd-4aca-84b5-a1f29708ee1d req-b4318d1d-8c5d-43e8-8cb0-743e5e908a53 service nova] Acquiring lock "6993e2e7-7e03-45b4-9d3d-3742589b6078-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 18:21:25 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-21d05fd3-fafd-4aca-84b5-a1f29708ee1d req-b4318d1d-8c5d-43e8-8cb0-743e5e908a53 service nova] Lock "6993e2e7-7e03-45b4-9d3d-3742589b6078-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 18:21:25 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-21d05fd3-fafd-4aca-84b5-a1f29708ee1d req-b4318d1d-8c5d-43e8-8cb0-743e5e908a53 service nova] Lock "6993e2e7-7e03-45b4-9d3d-3742589b6078-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 18:21:25 user nova-compute[74613]: DEBUG nova.compute.manager [req-21d05fd3-fafd-4aca-84b5-a1f29708ee1d req-b4318d1d-8c5d-43e8-8cb0-743e5e908a53 service nova] [instance: 6993e2e7-7e03-45b4-9d3d-3742589b6078] No waiting events found dispatching network-vif-unplugged-5216b7ab-6e2b-4d7f-8c7f-e52b03d282b9 {{(pid=74613) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 18:21:25 user nova-compute[74613]: DEBUG nova.compute.manager [req-21d05fd3-fafd-4aca-84b5-a1f29708ee1d req-b4318d1d-8c5d-43e8-8cb0-743e5e908a53 service nova] [instance: 6993e2e7-7e03-45b4-9d3d-3742589b6078] Received event network-vif-unplugged-5216b7ab-6e2b-4d7f-8c7f-e52b03d282b9 for instance with task_state deleting. {{(pid=74613) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 29 18:21:25 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:21:25 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:21:25 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:21:26 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:21:26 user nova-compute[74613]: INFO nova.virt.libvirt.driver [-] [instance: 6993e2e7-7e03-45b4-9d3d-3742589b6078] Instance destroyed successfully.
Nov 29 18:21:26 user nova-compute[74613]: DEBUG nova.objects.instance [None req-64959016-475a-41e2-af1c-f0bf56d10d64 tempest-ServerRescueNegativeTestJSON-1891426908 tempest-ServerRescueNegativeTestJSON-1891426908-project-member] Lazy-loading 'resources' on Instance uuid 6993e2e7-7e03-45b4-9d3d-3742589b6078 {{(pid=74613) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 18:21:26 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:21:26 user nova-compute[74613]: DEBUG nova.virt.libvirt.vif [None req-64959016-475a-41e2-af1c-f0bf56d10d64 tempest-ServerRescueNegativeTestJSON-1891426908 tempest-ServerRescueNegativeTestJSON-1891426908-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T18:04:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1218880828',display_name='tempest-ServerRescueNegativeTestJSON-server-1218880828',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1218880828',id=28,image_ref='4217f428-8d9d-4ee1-9614-642d26d90c46',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-29T18:09:15Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='e6a3eb6ea0294f9da705dca72ec2789a',ramdisk_id='',reservation_id='r-llk4pbtb',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='4217f428-8d9d-4ee1-9614-642d26d90c46',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-1891426908',owner_user_name='tempest-ServerRescueNegativeTestJSON-1891426908-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-29T18:11:05Z,user_data=None,user_id='4e984d45838e441680b9948c213728fb',uuid=6993e2e7-7e03-45b4-9d3d-3742589b6078,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "5216b7ab-6e2b-4d7f-8c7f-e52b03d282b9", "address": "fa:16:3e:e8:7b:54", "network": {"id": "db79433c-b21c-4058-b98c-f62822abbf7a", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1715530752-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e6a3eb6ea0294f9da705dca72ec2789a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5216b7ab-6e", "ovs_interfaceid": "5216b7ab-6e2b-4d7f-8c7f-e52b03d282b9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74613) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 29 18:21:26 user nova-compute[74613]: DEBUG nova.network.os_vif_util [None req-64959016-475a-41e2-af1c-f0bf56d10d64 tempest-ServerRescueNegativeTestJSON-1891426908 tempest-ServerRescueNegativeTestJSON-1891426908-project-member] Converting VIF {"id": "5216b7ab-6e2b-4d7f-8c7f-e52b03d282b9", "address": "fa:16:3e:e8:7b:54", "network": {"id": "db79433c-b21c-4058-b98c-f62822abbf7a", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1715530752-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e6a3eb6ea0294f9da705dca72ec2789a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5216b7ab-6e", "ovs_interfaceid": "5216b7ab-6e2b-4d7f-8c7f-e52b03d282b9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74613) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 18:21:26 user nova-compute[74613]: DEBUG nova.network.os_vif_util [None req-64959016-475a-41e2-af1c-f0bf56d10d64 tempest-ServerRescueNegativeTestJSON-1891426908 tempest-ServerRescueNegativeTestJSON-1891426908-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:e8:7b:54,bridge_name='br-int',has_traffic_filtering=True,id=5216b7ab-6e2b-4d7f-8c7f-e52b03d282b9,network=Network(db79433c-b21c-4058-b98c-f62822abbf7a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5216b7ab-6e') {{(pid=74613) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 18:21:26 user nova-compute[74613]: DEBUG os_vif [None req-64959016-475a-41e2-af1c-f0bf56d10d64 tempest-ServerRescueNegativeTestJSON-1891426908 tempest-ServerRescueNegativeTestJSON-1891426908-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:e8:7b:54,bridge_name='br-int',has_traffic_filtering=True,id=5216b7ab-6e2b-4d7f-8c7f-e52b03d282b9,network=Network(db79433c-b21c-4058-b98c-f62822abbf7a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5216b7ab-6e') {{(pid=74613) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 29 18:21:26 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:21:26 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap5216b7ab-6e, bridge=br-int, if_exists=True) {{(pid=74613) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 18:21:26 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:21:26 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 18:21:26 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:21:26 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=52edecc4-814f-489d-9f4e-67a1c410ac2f) {{(pid=74613) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 18:21:26 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:21:26 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 18:21:26 user nova-compute[74613]: INFO os_vif [None req-64959016-475a-41e2-af1c-f0bf56d10d64 tempest-ServerRescueNegativeTestJSON-1891426908 tempest-ServerRescueNegativeTestJSON-1891426908-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:e8:7b:54,bridge_name='br-int',has_traffic_filtering=True,id=5216b7ab-6e2b-4d7f-8c7f-e52b03d282b9,network=Network(db79433c-b21c-4058-b98c-f62822abbf7a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5216b7ab-6e')
Nov 29 18:21:26 user nova-compute[74613]: INFO nova.virt.libvirt.driver [None req-64959016-475a-41e2-af1c-f0bf56d10d64 tempest-ServerRescueNegativeTestJSON-1891426908 tempest-ServerRescueNegativeTestJSON-1891426908-project-member] [instance: 6993e2e7-7e03-45b4-9d3d-3742589b6078] Deleting instance files /opt/stack/data/nova/instances/6993e2e7-7e03-45b4-9d3d-3742589b6078_del
Nov 29 18:21:26 user nova-compute[74613]: INFO nova.virt.libvirt.driver [None req-64959016-475a-41e2-af1c-f0bf56d10d64 tempest-ServerRescueNegativeTestJSON-1891426908 tempest-ServerRescueNegativeTestJSON-1891426908-project-member] [instance: 6993e2e7-7e03-45b4-9d3d-3742589b6078] Deletion of /opt/stack/data/nova/instances/6993e2e7-7e03-45b4-9d3d-3742589b6078_del complete
Nov 29 18:21:26 user nova-compute[74613]: INFO nova.compute.manager [None req-64959016-475a-41e2-af1c-f0bf56d10d64 tempest-ServerRescueNegativeTestJSON-1891426908 tempest-ServerRescueNegativeTestJSON-1891426908-project-member] [instance: 6993e2e7-7e03-45b4-9d3d-3742589b6078] Took 0.69 seconds to destroy the instance on the hypervisor.
Nov 29 18:21:26 user nova-compute[74613]: DEBUG oslo.service.loopingcall [None req-64959016-475a-41e2-af1c-f0bf56d10d64 tempest-ServerRescueNegativeTestJSON-1891426908 tempest-ServerRescueNegativeTestJSON-1891426908-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74613) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 29 18:21:26 user nova-compute[74613]: DEBUG nova.compute.manager [-] [instance: 6993e2e7-7e03-45b4-9d3d-3742589b6078] Deallocating network for instance {{(pid=74613) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 29 18:21:26 user nova-compute[74613]: DEBUG nova.network.neutron [-] [instance: 6993e2e7-7e03-45b4-9d3d-3742589b6078] deallocate_for_instance() {{(pid=74613) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 29 18:21:26 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:21:26 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:21:26 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:21:26 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:21:26 user nova-compute[74613]: DEBUG nova.network.neutron [-] [instance: 6993e2e7-7e03-45b4-9d3d-3742589b6078] Updating instance_info_cache with network_info: [] {{(pid=74613) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 18:21:26 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:21:26 user nova-compute[74613]: INFO nova.compute.manager [-] [instance: 6993e2e7-7e03-45b4-9d3d-3742589b6078] Took 0.61 seconds to deallocate network for instance.
Nov 29 18:21:26 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-64959016-475a-41e2-af1c-f0bf56d10d64 tempest-ServerRescueNegativeTestJSON-1891426908 tempest-ServerRescueNegativeTestJSON-1891426908-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 18:21:26 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-64959016-475a-41e2-af1c-f0bf56d10d64 tempest-ServerRescueNegativeTestJSON-1891426908 tempest-ServerRescueNegativeTestJSON-1891426908-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 18:21:26 user nova-compute[74613]: DEBUG nova.compute.manager [req-d0de99f6-885d-4854-bccd-8f8838120ea5 req-3222e49f-017b-4265-88db-21dcc2637eec service nova] [instance: 6993e2e7-7e03-45b4-9d3d-3742589b6078] Received event network-vif-deleted-5216b7ab-6e2b-4d7f-8c7f-e52b03d282b9 {{(pid=74613) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 18:21:26 user nova-compute[74613]: DEBUG nova.compute.provider_tree [None req-64959016-475a-41e2-af1c-f0bf56d10d64 tempest-ServerRescueNegativeTestJSON-1891426908 tempest-ServerRescueNegativeTestJSON-1891426908-project-member] Inventory has not changed in ProviderTree for provider: 639d980e-3b12-44b1-b8f4-1812416fa4dd {{(pid=74613) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 18:21:26 user nova-compute[74613]: DEBUG nova.scheduler.client.report [None req-64959016-475a-41e2-af1c-f0bf56d10d64 tempest-ServerRescueNegativeTestJSON-1891426908 tempest-ServerRescueNegativeTestJSON-1891426908-project-member] Inventory has not changed for provider 639d980e-3b12-44b1-b8f4-1812416fa4dd based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74613) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 18:21:26 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-64959016-475a-41e2-af1c-f0bf56d10d64 tempest-ServerRescueNegativeTestJSON-1891426908 tempest-ServerRescueNegativeTestJSON-1891426908-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.160s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 18:21:27 user nova-compute[74613]: INFO nova.scheduler.client.report [None req-64959016-475a-41e2-af1c-f0bf56d10d64 tempest-ServerRescueNegativeTestJSON-1891426908 tempest-ServerRescueNegativeTestJSON-1891426908-project-member] Deleted allocations for instance 6993e2e7-7e03-45b4-9d3d-3742589b6078
Nov 29 18:21:27 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-64959016-475a-41e2-af1c-f0bf56d10d64 tempest-ServerRescueNegativeTestJSON-1891426908 tempest-ServerRescueNegativeTestJSON-1891426908-project-member] Lock "6993e2e7-7e03-45b4-9d3d-3742589b6078" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.698s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 18:21:27 user nova-compute[74613]: DEBUG nova.compute.manager [req-dab3c69b-25a8-4289-96c2-bf9e3395cc55 req-899a7989-f711-4cec-ab04-c6e01339a0f2 service nova] [instance: 6993e2e7-7e03-45b4-9d3d-3742589b6078] Received event network-vif-plugged-5216b7ab-6e2b-4d7f-8c7f-e52b03d282b9 {{(pid=74613) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 18:21:27 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-dab3c69b-25a8-4289-96c2-bf9e3395cc55 req-899a7989-f711-4cec-ab04-c6e01339a0f2 service nova] Acquiring lock "6993e2e7-7e03-45b4-9d3d-3742589b6078-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 18:21:27 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-dab3c69b-25a8-4289-96c2-bf9e3395cc55 req-899a7989-f711-4cec-ab04-c6e01339a0f2 service nova] Lock "6993e2e7-7e03-45b4-9d3d-3742589b6078-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 18:21:27 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-dab3c69b-25a8-4289-96c2-bf9e3395cc55 req-899a7989-f711-4cec-ab04-c6e01339a0f2 service nova] Lock "6993e2e7-7e03-45b4-9d3d-3742589b6078-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 18:21:27 user nova-compute[74613]: DEBUG nova.compute.manager [req-dab3c69b-25a8-4289-96c2-bf9e3395cc55 req-899a7989-f711-4cec-ab04-c6e01339a0f2 service nova] [instance: 6993e2e7-7e03-45b4-9d3d-3742589b6078] No waiting events found dispatching network-vif-plugged-5216b7ab-6e2b-4d7f-8c7f-e52b03d282b9 {{(pid=74613) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 18:21:27 user nova-compute[74613]: WARNING nova.compute.manager [req-dab3c69b-25a8-4289-96c2-bf9e3395cc55 req-899a7989-f711-4cec-ab04-c6e01339a0f2 service nova] [instance: 6993e2e7-7e03-45b4-9d3d-3742589b6078] Received unexpected event network-vif-plugged-5216b7ab-6e2b-4d7f-8c7f-e52b03d282b9 for instance with vm_state deleted and task_state None.
Nov 29 18:21:27 user nova-compute[74613]: DEBUG nova.compute.manager [req-dab3c69b-25a8-4289-96c2-bf9e3395cc55 req-899a7989-f711-4cec-ab04-c6e01339a0f2 service nova] [instance: 6993e2e7-7e03-45b4-9d3d-3742589b6078] Received event network-vif-plugged-5216b7ab-6e2b-4d7f-8c7f-e52b03d282b9 {{(pid=74613) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 18:21:27 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-dab3c69b-25a8-4289-96c2-bf9e3395cc55 req-899a7989-f711-4cec-ab04-c6e01339a0f2 service nova] Acquiring lock "6993e2e7-7e03-45b4-9d3d-3742589b6078-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 18:21:27 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-dab3c69b-25a8-4289-96c2-bf9e3395cc55 req-899a7989-f711-4cec-ab04-c6e01339a0f2 service nova] Lock "6993e2e7-7e03-45b4-9d3d-3742589b6078-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 18:21:27 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-dab3c69b-25a8-4289-96c2-bf9e3395cc55 req-899a7989-f711-4cec-ab04-c6e01339a0f2 service nova] Lock "6993e2e7-7e03-45b4-9d3d-3742589b6078-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 18:21:27 user nova-compute[74613]: DEBUG nova.compute.manager [req-dab3c69b-25a8-4289-96c2-bf9e3395cc55 req-899a7989-f711-4cec-ab04-c6e01339a0f2 service nova] [instance: 6993e2e7-7e03-45b4-9d3d-3742589b6078] No waiting events found dispatching network-vif-plugged-5216b7ab-6e2b-4d7f-8c7f-e52b03d282b9 {{(pid=74613) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 18:21:27 user nova-compute[74613]: WARNING nova.compute.manager [req-dab3c69b-25a8-4289-96c2-bf9e3395cc55 req-899a7989-f711-4cec-ab04-c6e01339a0f2 service nova] [instance: 6993e2e7-7e03-45b4-9d3d-3742589b6078] Received unexpected event network-vif-plugged-5216b7ab-6e2b-4d7f-8c7f-e52b03d282b9 for instance with vm_state deleted and task_state None.
Nov 29 18:21:27 user nova-compute[74613]: DEBUG nova.compute.manager [req-dab3c69b-25a8-4289-96c2-bf9e3395cc55 req-899a7989-f711-4cec-ab04-c6e01339a0f2 service nova] [instance: 6993e2e7-7e03-45b4-9d3d-3742589b6078] Received event network-vif-plugged-5216b7ab-6e2b-4d7f-8c7f-e52b03d282b9 {{(pid=74613) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 18:21:27 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-dab3c69b-25a8-4289-96c2-bf9e3395cc55 req-899a7989-f711-4cec-ab04-c6e01339a0f2 service nova] Acquiring lock "6993e2e7-7e03-45b4-9d3d-3742589b6078-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 18:21:27 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-dab3c69b-25a8-4289-96c2-bf9e3395cc55 req-899a7989-f711-4cec-ab04-c6e01339a0f2 service nova] Lock "6993e2e7-7e03-45b4-9d3d-3742589b6078-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 18:21:27 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-dab3c69b-25a8-4289-96c2-bf9e3395cc55 req-899a7989-f711-4cec-ab04-c6e01339a0f2 service nova] Lock "6993e2e7-7e03-45b4-9d3d-3742589b6078-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 18:21:27 user nova-compute[74613]: DEBUG nova.compute.manager [req-dab3c69b-25a8-4289-96c2-bf9e3395cc55 req-899a7989-f711-4cec-ab04-c6e01339a0f2 service nova] [instance: 6993e2e7-7e03-45b4-9d3d-3742589b6078] No waiting events found dispatching network-vif-plugged-5216b7ab-6e2b-4d7f-8c7f-e52b03d282b9 {{(pid=74613) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 18:21:27 user nova-compute[74613]: WARNING nova.compute.manager [req-dab3c69b-25a8-4289-96c2-bf9e3395cc55 req-899a7989-f711-4cec-ab04-c6e01339a0f2 service nova] [instance: 6993e2e7-7e03-45b4-9d3d-3742589b6078] Received unexpected event network-vif-plugged-5216b7ab-6e2b-4d7f-8c7f-e52b03d282b9 for instance with vm_state deleted and task_state None.
Nov 29 18:21:27 user nova-compute[74613]: DEBUG nova.compute.manager [req-dab3c69b-25a8-4289-96c2-bf9e3395cc55 req-899a7989-f711-4cec-ab04-c6e01339a0f2 service nova] [instance: 6993e2e7-7e03-45b4-9d3d-3742589b6078] Received event network-vif-unplugged-5216b7ab-6e2b-4d7f-8c7f-e52b03d282b9 {{(pid=74613) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 18:21:27 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-dab3c69b-25a8-4289-96c2-bf9e3395cc55 req-899a7989-f711-4cec-ab04-c6e01339a0f2 service nova] Acquiring lock "6993e2e7-7e03-45b4-9d3d-3742589b6078-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 18:21:27 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-dab3c69b-25a8-4289-96c2-bf9e3395cc55 req-899a7989-f711-4cec-ab04-c6e01339a0f2 service nova] Lock "6993e2e7-7e03-45b4-9d3d-3742589b6078-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 18:21:27 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-dab3c69b-25a8-4289-96c2-bf9e3395cc55 req-899a7989-f711-4cec-ab04-c6e01339a0f2 service nova] Lock "6993e2e7-7e03-45b4-9d3d-3742589b6078-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 18:21:27 user nova-compute[74613]: DEBUG nova.compute.manager [req-dab3c69b-25a8-4289-96c2-bf9e3395cc55 req-899a7989-f711-4cec-ab04-c6e01339a0f2 service nova] [instance: 6993e2e7-7e03-45b4-9d3d-3742589b6078] No waiting events found dispatching network-vif-unplugged-5216b7ab-6e2b-4d7f-8c7f-e52b03d282b9 {{(pid=74613) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 18:21:27 user nova-compute[74613]: WARNING nova.compute.manager [req-dab3c69b-25a8-4289-96c2-bf9e3395cc55 req-899a7989-f711-4cec-ab04-c6e01339a0f2 service nova] [instance: 6993e2e7-7e03-45b4-9d3d-3742589b6078] Received unexpected event network-vif-unplugged-5216b7ab-6e2b-4d7f-8c7f-e52b03d282b9 for instance with vm_state deleted and task_state None.
Nov 29 18:21:27 user nova-compute[74613]: DEBUG nova.compute.manager [req-dab3c69b-25a8-4289-96c2-bf9e3395cc55 req-899a7989-f711-4cec-ab04-c6e01339a0f2 service nova] [instance: 6993e2e7-7e03-45b4-9d3d-3742589b6078] Received event network-vif-plugged-5216b7ab-6e2b-4d7f-8c7f-e52b03d282b9 {{(pid=74613) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 18:21:27 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-dab3c69b-25a8-4289-96c2-bf9e3395cc55 req-899a7989-f711-4cec-ab04-c6e01339a0f2 service nova] Acquiring lock "6993e2e7-7e03-45b4-9d3d-3742589b6078-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 18:21:27 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-dab3c69b-25a8-4289-96c2-bf9e3395cc55 req-899a7989-f711-4cec-ab04-c6e01339a0f2 service nova] Lock "6993e2e7-7e03-45b4-9d3d-3742589b6078-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 18:21:27 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-dab3c69b-25a8-4289-96c2-bf9e3395cc55 req-899a7989-f711-4cec-ab04-c6e01339a0f2 service nova] Lock "6993e2e7-7e03-45b4-9d3d-3742589b6078-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 18:21:27 user nova-compute[74613]: DEBUG nova.compute.manager [req-dab3c69b-25a8-4289-96c2-bf9e3395cc55 req-899a7989-f711-4cec-ab04-c6e01339a0f2 service nova] [instance: 6993e2e7-7e03-45b4-9d3d-3742589b6078] No waiting events found dispatching network-vif-plugged-5216b7ab-6e2b-4d7f-8c7f-e52b03d282b9 {{(pid=74613) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 18:21:27 user nova-compute[74613]: WARNING nova.compute.manager [req-dab3c69b-25a8-4289-96c2-bf9e3395cc55 req-899a7989-f711-4cec-ab04-c6e01339a0f2 service nova] [instance: 6993e2e7-7e03-45b4-9d3d-3742589b6078] Received unexpected event network-vif-plugged-5216b7ab-6e2b-4d7f-8c7f-e52b03d282b9 for instance with vm_state deleted and task_state None.
Nov 29 18:21:31 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:21:31 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:21:33 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-9db30b79-147f-46b8-8995-73123c3703aa tempest-TestVolumeBootPattern-1318569205 tempest-TestVolumeBootPattern-1318569205-project-member] Acquiring lock "3a2ac289-fc34-4c7b-a689-b499e2562578" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 18:21:33 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-9db30b79-147f-46b8-8995-73123c3703aa tempest-TestVolumeBootPattern-1318569205 tempest-TestVolumeBootPattern-1318569205-project-member] Lock "3a2ac289-fc34-4c7b-a689-b499e2562578" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 18:21:33 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-9db30b79-147f-46b8-8995-73123c3703aa tempest-TestVolumeBootPattern-1318569205 tempest-TestVolumeBootPattern-1318569205-project-member] Acquiring lock "3a2ac289-fc34-4c7b-a689-b499e2562578-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 18:21:33 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-9db30b79-147f-46b8-8995-73123c3703aa tempest-TestVolumeBootPattern-1318569205 tempest-TestVolumeBootPattern-1318569205-project-member] Lock "3a2ac289-fc34-4c7b-a689-b499e2562578-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 18:21:33 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-9db30b79-147f-46b8-8995-73123c3703aa tempest-TestVolumeBootPattern-1318569205 tempest-TestVolumeBootPattern-1318569205-project-member] Lock "3a2ac289-fc34-4c7b-a689-b499e2562578-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 18:21:33 user nova-compute[74613]: INFO nova.compute.manager [None req-9db30b79-147f-46b8-8995-73123c3703aa tempest-TestVolumeBootPattern-1318569205 tempest-TestVolumeBootPattern-1318569205-project-member] [instance: 3a2ac289-fc34-4c7b-a689-b499e2562578] Terminating instance
Nov 29 18:21:33 user nova-compute[74613]: DEBUG nova.compute.manager [None req-9db30b79-147f-46b8-8995-73123c3703aa tempest-TestVolumeBootPattern-1318569205 tempest-TestVolumeBootPattern-1318569205-project-member] [instance: 3a2ac289-fc34-4c7b-a689-b499e2562578] Start destroying the instance on the hypervisor. {{(pid=74613) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 29 18:21:33 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:21:33 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:21:33 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:21:33 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:21:33 user nova-compute[74613]: DEBUG nova.compute.manager [req-c1affd65-08aa-4b59-b8db-7a560062a603 req-ba06e43c-f0c0-4fb4-ab2c-d93495d569e6 service nova] [instance: 3a2ac289-fc34-4c7b-a689-b499e2562578] Received event network-vif-unplugged-6c245bc7-a2bd-47a5-a37b-a7d583d1b2e6 {{(pid=74613) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 18:21:33 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-c1affd65-08aa-4b59-b8db-7a560062a603 req-ba06e43c-f0c0-4fb4-ab2c-d93495d569e6 service nova] Acquiring lock "3a2ac289-fc34-4c7b-a689-b499e2562578-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 18:21:33 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-c1affd65-08aa-4b59-b8db-7a560062a603 req-ba06e43c-f0c0-4fb4-ab2c-d93495d569e6 service nova] Lock "3a2ac289-fc34-4c7b-a689-b499e2562578-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 18:21:33 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-c1affd65-08aa-4b59-b8db-7a560062a603 req-ba06e43c-f0c0-4fb4-ab2c-d93495d569e6 service nova] Lock "3a2ac289-fc34-4c7b-a689-b499e2562578-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 18:21:33 user nova-compute[74613]: DEBUG nova.compute.manager [req-c1affd65-08aa-4b59-b8db-7a560062a603 req-ba06e43c-f0c0-4fb4-ab2c-d93495d569e6 service nova] [instance: 3a2ac289-fc34-4c7b-a689-b499e2562578] No waiting events found dispatching network-vif-unplugged-6c245bc7-a2bd-47a5-a37b-a7d583d1b2e6 {{(pid=74613) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 18:21:33 user nova-compute[74613]: DEBUG nova.compute.manager [req-c1affd65-08aa-4b59-b8db-7a560062a603 req-ba06e43c-f0c0-4fb4-ab2c-d93495d569e6 service nova] [instance: 3a2ac289-fc34-4c7b-a689-b499e2562578] Received event network-vif-unplugged-6c245bc7-a2bd-47a5-a37b-a7d583d1b2e6 for instance with task_state deleting. {{(pid=74613) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 29 18:21:33 user nova-compute[74613]: INFO nova.virt.libvirt.driver [-] [instance: 3a2ac289-fc34-4c7b-a689-b499e2562578] Instance destroyed successfully.
Nov 29 18:21:33 user nova-compute[74613]: DEBUG nova.objects.instance [None req-9db30b79-147f-46b8-8995-73123c3703aa tempest-TestVolumeBootPattern-1318569205 tempest-TestVolumeBootPattern-1318569205-project-member] Lazy-loading 'resources' on Instance uuid 3a2ac289-fc34-4c7b-a689-b499e2562578 {{(pid=74613) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 18:21:33 user nova-compute[74613]: DEBUG nova.virt.libvirt.vif [None req-9db30b79-147f-46b8-8995-73123c3703aa tempest-TestVolumeBootPattern-1318569205 tempest-TestVolumeBootPattern-1318569205-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T18:16:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-volume-backed-server-257861033',display_name='tempest-TestVolumeBootPattern-volume-backed-server-257861033',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-volume-backed-server-257861033',id=42,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHVpe3YsNL5aCfPQencBmtVYIWZtsl1M/9qVsBwJz2DyylwrXlklzKDjKMQVQMqBAaYQTuulWArk2K4UyVCWxT9zgiLbzWUDgObRTvXtMBAZnLbA8OAXIKL+ldIYoQTu1w==',key_name='tempest-keypair-741566579',keypairs=<?>,launch_index=0,launched_at=2023-11-29T18:16:59Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='67390f1402214191904cfbd68c3142a7',ramdisk_id='',reservation_id='r-w9ym3zid',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-1318569205',owner_user_name='tempest-TestVolumeBootPattern-1318569205-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-29T18:16:59Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='bedbc6ed47394e2b9125543a8b88a71f',uuid=3a2ac289-fc34-4c7b-a689-b499e2562578,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "6c245bc7-a2bd-47a5-a37b-a7d583d1b2e6", "address": "fa:16:3e:e4:33:64", "network": {"id": "4a5179dd-d0b1-44c3-80c1-08dd7b0152f1", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1296336996-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.32", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "67390f1402214191904cfbd68c3142a7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6c245bc7-a2", "ovs_interfaceid": "6c245bc7-a2bd-47a5-a37b-a7d583d1b2e6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74613) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 29 18:21:33 user nova-compute[74613]: DEBUG nova.network.os_vif_util [None req-9db30b79-147f-46b8-8995-73123c3703aa tempest-TestVolumeBootPattern-1318569205 tempest-TestVolumeBootPattern-1318569205-project-member] Converting VIF {"id": "6c245bc7-a2bd-47a5-a37b-a7d583d1b2e6", "address": "fa:16:3e:e4:33:64", "network": {"id": "4a5179dd-d0b1-44c3-80c1-08dd7b0152f1", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1296336996-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.32", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "67390f1402214191904cfbd68c3142a7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6c245bc7-a2", "ovs_interfaceid": "6c245bc7-a2bd-47a5-a37b-a7d583d1b2e6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74613) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 18:21:33 user nova-compute[74613]: DEBUG nova.network.os_vif_util [None req-9db30b79-147f-46b8-8995-73123c3703aa tempest-TestVolumeBootPattern-1318569205 tempest-TestVolumeBootPattern-1318569205-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:e4:33:64,bridge_name='br-int',has_traffic_filtering=True,id=6c245bc7-a2bd-47a5-a37b-a7d583d1b2e6,network=Network(4a5179dd-d0b1-44c3-80c1-08dd7b0152f1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6c245bc7-a2') {{(pid=74613) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 18:21:33 user nova-compute[74613]: DEBUG os_vif [None req-9db30b79-147f-46b8-8995-73123c3703aa tempest-TestVolumeBootPattern-1318569205 tempest-TestVolumeBootPattern-1318569205-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:e4:33:64,bridge_name='br-int',has_traffic_filtering=True,id=6c245bc7-a2bd-47a5-a37b-a7d583d1b2e6,network=Network(4a5179dd-d0b1-44c3-80c1-08dd7b0152f1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6c245bc7-a2') {{(pid=74613) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 29 18:21:33 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:21:33 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap6c245bc7-a2, bridge=br-int, if_exists=True) {{(pid=74613) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 18:21:33 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:21:33 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 18:21:33 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:21:33 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=684728ec-7888-4ca2-9c68-b83b14263e56) {{(pid=74613) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 18:21:33 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:21:33 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 18:21:33 user nova-compute[74613]: INFO os_vif [None req-9db30b79-147f-46b8-8995-73123c3703aa tempest-TestVolumeBootPattern-1318569205 tempest-TestVolumeBootPattern-1318569205-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:e4:33:64,bridge_name='br-int',has_traffic_filtering=True,id=6c245bc7-a2bd-47a5-a37b-a7d583d1b2e6,network=Network(4a5179dd-d0b1-44c3-80c1-08dd7b0152f1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6c245bc7-a2')
Nov 29 18:21:33 user nova-compute[74613]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9db30b79-147f-46b8-8995-73123c3703aa tempest-TestVolumeBootPattern-1318569205 tempest-TestVolumeBootPattern-1318569205-project-member] [instance: 3a2ac289-fc34-4c7b-a689-b499e2562578] calling os-brick to detach iSCSI Volume {{(pid=74613) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 29 18:21:33 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-9db30b79-147f-46b8-8995-73123c3703aa tempest-TestVolumeBootPattern-1318569205 tempest-TestVolumeBootPattern-1318569205-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff828156890>, {'target_iqn': 'iqn.2010-10.org.openstack:5d74e565-9547-4f44-8005-0615d625a275', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'cfUYCiaq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=74613) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 18:21:33 user nova-compute[74613]: WARNING os_brick.initiator.connectors.base [None req-9db30b79-147f-46b8-8995-73123c3703aa tempest-TestVolumeBootPattern-1318569205 tempest-TestVolumeBootPattern-1318569205-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 18:21:33 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.base [None req-9db30b79-147f-46b8-8995-73123c3703aa tempest-TestVolumeBootPattern-1318569205 tempest-TestVolumeBootPattern-1318569205-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 18:21:33 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.base [None req-9db30b79-147f-46b8-8995-73123c3703aa tempest-TestVolumeBootPattern-1318569205 tempest-TestVolumeBootPattern-1318569205-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 18:21:33 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:21:33 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:21:33 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f774ed6-658a-41a6-8a67-49f8905cd3ec]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:5d74e565-9547-4f44-8005-0615d625a275\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 18:21:33 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-9db30b79-147f-46b8-8995-73123c3703aa tempest-TestVolumeBootPattern-1318569205 tempest-TestVolumeBootPattern-1318569205-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 29 18:21:33 user nova-compute[74613]: No targets found.
Nov 29 18:21:33 user nova-compute[74613]: iSNS:
Nov 29 18:21:33 user nova-compute[74613]: No targets found.
Nov 29 18:21:33 user nova-compute[74613]: STATIC:
Nov 29 18:21:33 user nova-compute[74613]: Target: iqn.2010-10.org.openstack:5d74e565-9547-4f44-8005-0615d625a275
Nov 29 18:21:33 user nova-compute[74613]:         Portal: 172.16.0.220:3260,-1
Nov 29 18:21:33 user nova-compute[74613]:                 Iface Name: default
Nov 29 18:21:33 user nova-compute[74613]: FIRMWARE:
Nov 29 18:21:33 user nova-compute[74613]: No targets found.
Nov 29 18:21:33 user nova-compute[74613]:  stderr= {{(pid=74613) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 18:21:33 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-9db30b79-147f-46b8-8995-73123c3703aa tempest-TestVolumeBootPattern-1318569205 tempest-TestVolumeBootPattern-1318569205-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 29 18:21:33 user nova-compute[74613]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 29 18:21:33 user nova-compute[74613]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74613) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 29 18:21:33 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-9db30b79-147f-46b8-8995-73123c3703aa tempest-TestVolumeBootPattern-1318569205 tempest-TestVolumeBootPattern-1318569205-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5d74e565-9547-4f44-8005-0615d625a275', 0)] {{(pid=74613) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 29 18:21:33 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:21:33 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:21:33 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[6335c058-ab54-4bfb-9de9-6a8c1a8697f1]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5d74e565-9547-4f44-8005-0615d625a275\n', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 18:21:33 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:21:33 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:21:33 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[1bd23954-a90f-47da-876f-b3dc2751d1b6]: (4, ('tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d74e565-9547-4f44-8005-0615d625a275 (non-flash)\n', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 18:21:33 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-9db30b79-147f-46b8-8995-73123c3703aa tempest-TestVolumeBootPattern-1318569205 tempest-TestVolumeBootPattern-1318569205-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d74e565-9547-4f44-8005-0615d625a275 (non-flash)
Nov 29 18:21:33 user nova-compute[74613]:  stderr= {{(pid=74613) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 18:21:33 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-9db30b79-147f-46b8-8995-73123c3703aa tempest-TestVolumeBootPattern-1318569205 tempest-TestVolumeBootPattern-1318569205-project-member] iscsi session list stdout=tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d74e565-9547-4f44-8005-0615d625a275 (non-flash)
Nov 29 18:21:33 user nova-compute[74613]:  stderr= {{(pid=74613) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 18:21:33 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-9db30b79-147f-46b8-8995-73123c3703aa tempest-TestVolumeBootPattern-1318569205 tempest-TestVolumeBootPattern-1318569205-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7ff832b87910>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5d74e565-9547-4f44-8005-0615d625a275'): ({'sdb'}, set())}) {{(pid=74613) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 29 18:21:33 user nova-compute[74613]: DEBUG os_brick.initiator.linuxscsi [None req-9db30b79-147f-46b8-8995-73123c3703aa tempest-TestVolumeBootPattern-1318569205 tempest-TestVolumeBootPattern-1318569205-project-member] Removing single pathed devices sdb {{(pid=74613) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 29 18:21:33 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:21:33 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:21:33 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b8680a5-33f1-42cc-b0ad-7853fc35d06b]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 18:21:33 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:21:33 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.018s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:21:33 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[65b48b70-e17a-465e-839d-5328026e15ea]: (4, ('ok\n', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 18:21:33 user nova-compute[74613]: DEBUG os_brick.initiator.linuxscsi [None req-9db30b79-147f-46b8-8995-73123c3703aa tempest-TestVolumeBootPattern-1318569205 tempest-TestVolumeBootPattern-1318569205-project-member] Flushing IO for device /dev/sdb {{(pid=74613) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 29 18:21:33 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:21:33 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.014s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:21:33 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[d11ef75d-f85d-4f81-8e5f-3d220b9672d6]: (4, ('', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 18:21:33 user nova-compute[74613]: DEBUG os_brick.initiator.linuxscsi [None req-9db30b79-147f-46b8-8995-73123c3703aa tempest-TestVolumeBootPattern-1318569205 tempest-TestVolumeBootPattern-1318569205-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74613) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 29 18:21:33 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:21:34 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.059s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:21:34 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[3218bbf0-b37e-4e5b-8fab-b1c6e0583619]: (4, ('1', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 18:21:34 user nova-compute[74613]: DEBUG os_brick.initiator.linuxscsi [None req-9db30b79-147f-46b8-8995-73123c3703aa tempest-TestVolumeBootPattern-1318569205 tempest-TestVolumeBootPattern-1318569205-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74613) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 29 18:21:34 user nova-compute[74613]: DEBUG os_brick.initiator.linuxscsi [None req-9db30b79-147f-46b8-8995-73123c3703aa tempest-TestVolumeBootPattern-1318569205 tempest-TestVolumeBootPattern-1318569205-project-member] SCSI volumes sdb have been removed. {{(pid=74613) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 29 18:21:34 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-9db30b79-147f-46b8-8995-73123c3703aa tempest-TestVolumeBootPattern-1318569205 tempest-TestVolumeBootPattern-1318569205-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5d74e565-9547-4f44-8005-0615d625a275')] {{(pid=74613) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 29 18:21:34 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5d74e565-9547-4f44-8005-0615d625a275 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:21:34 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5d74e565-9547-4f44-8005-0615d625a275 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:21:34 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[3cba5a97-9fe2-4b66-b374-9be34a27a732]: (4, ('', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 18:21:34 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-9db30b79-147f-46b8-8995-73123c3703aa tempest-TestVolumeBootPattern-1318569205 tempest-TestVolumeBootPattern-1318569205-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74613) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 18:21:34 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5d74e565-9547-4f44-8005-0615d625a275 -p 172.16.0.220:3260 --logout {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:21:34 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5d74e565-9547-4f44-8005-0615d625a275 -p 172.16.0.220:3260 --logout" returned: 0 in 0.062s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:21:34 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[67682364-1bca-4462-af1b-c640a6a0a909]: (4, ('Logging out of session [sid: 45, target: iqn.2010-10.org.openstack:5d74e565-9547-4f44-8005-0615d625a275, portal: 172.16.0.220,3260]\nLogout of [sid: 45, target: iqn.2010-10.org.openstack:5d74e565-9547-4f44-8005-0615d625a275, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 18:21:34 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-9db30b79-147f-46b8-8995-73123c3703aa tempest-TestVolumeBootPattern-1318569205 tempest-TestVolumeBootPattern-1318569205-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 45, target: iqn.2010-10.org.openstack:5d74e565-9547-4f44-8005-0615d625a275, portal: 172.16.0.220,3260]
Nov 29 18:21:34 user nova-compute[74613]: Logout of [sid: 45, target: iqn.2010-10.org.openstack:5d74e565-9547-4f44-8005-0615d625a275, portal: 172.16.0.220,3260] successful.
Nov 29 18:21:34 user nova-compute[74613]:  stderr= {{(pid=74613) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 18:21:34 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5d74e565-9547-4f44-8005-0615d625a275 -p 172.16.0.220:3260 --op delete {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:21:34 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5d74e565-9547-4f44-8005-0615d625a275 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.017s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:21:34 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[c66a9de8-6c63-4715-b289-f3a45f270f4d]: (4, ('', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 18:21:34 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-9db30b79-147f-46b8-8995-73123c3703aa tempest-TestVolumeBootPattern-1318569205 tempest-TestVolumeBootPattern-1318569205-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74613) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 18:21:34 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.base [None req-9db30b79-147f-46b8-8995-73123c3703aa tempest-TestVolumeBootPattern-1318569205 tempest-TestVolumeBootPattern-1318569205-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.318s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 18:21:34 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-9db30b79-147f-46b8-8995-73123c3703aa tempest-TestVolumeBootPattern-1318569205 tempest-TestVolumeBootPattern-1318569205-project-member] <== disconnect_volume: return (320ms) None {{(pid=74613) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 18:21:34 user nova-compute[74613]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9db30b79-147f-46b8-8995-73123c3703aa tempest-TestVolumeBootPattern-1318569205 tempest-TestVolumeBootPattern-1318569205-project-member] [instance: 3a2ac289-fc34-4c7b-a689-b499e2562578] Disconnected iSCSI Volume {{(pid=74613) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 29 18:21:34 user nova-compute[74613]: INFO nova.virt.libvirt.driver [None req-9db30b79-147f-46b8-8995-73123c3703aa tempest-TestVolumeBootPattern-1318569205 tempest-TestVolumeBootPattern-1318569205-project-member] [instance: 3a2ac289-fc34-4c7b-a689-b499e2562578] Deleting instance files /opt/stack/data/nova/instances/3a2ac289-fc34-4c7b-a689-b499e2562578_del
Nov 29 18:21:34 user nova-compute[74613]: INFO nova.virt.libvirt.driver [None req-9db30b79-147f-46b8-8995-73123c3703aa tempest-TestVolumeBootPattern-1318569205 tempest-TestVolumeBootPattern-1318569205-project-member] [instance: 3a2ac289-fc34-4c7b-a689-b499e2562578] Deletion of /opt/stack/data/nova/instances/3a2ac289-fc34-4c7b-a689-b499e2562578_del complete
Nov 29 18:21:34 user nova-compute[74613]: INFO nova.compute.manager [None req-9db30b79-147f-46b8-8995-73123c3703aa tempest-TestVolumeBootPattern-1318569205 tempest-TestVolumeBootPattern-1318569205-project-member] [instance: 3a2ac289-fc34-4c7b-a689-b499e2562578] Took 1.16 seconds to destroy the instance on the hypervisor.
Nov 29 18:21:34 user nova-compute[74613]: DEBUG oslo.service.loopingcall [None req-9db30b79-147f-46b8-8995-73123c3703aa tempest-TestVolumeBootPattern-1318569205 tempest-TestVolumeBootPattern-1318569205-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74613) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 29 18:21:34 user nova-compute[74613]: DEBUG nova.compute.manager [-] [instance: 3a2ac289-fc34-4c7b-a689-b499e2562578] Deallocating network for instance {{(pid=74613) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 29 18:21:34 user nova-compute[74613]: DEBUG nova.network.neutron [-] [instance: 3a2ac289-fc34-4c7b-a689-b499e2562578] deallocate_for_instance() {{(pid=74613) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 29 18:21:35 user nova-compute[74613]: DEBUG nova.network.neutron [-] [instance: 3a2ac289-fc34-4c7b-a689-b499e2562578] Updating instance_info_cache with network_info: [] {{(pid=74613) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 18:21:35 user nova-compute[74613]: INFO nova.compute.manager [-] [instance: 3a2ac289-fc34-4c7b-a689-b499e2562578] Took 0.97 seconds to deallocate network for instance.
Nov 29 18:21:35 user nova-compute[74613]: DEBUG nova.compute.manager [req-d21c2e24-d9ab-47b6-8c2a-9db94cae9479 req-5f4bb1a7-35cf-483d-a5a2-860b44038869 service nova] [instance: 3a2ac289-fc34-4c7b-a689-b499e2562578] Received event network-vif-deleted-6c245bc7-a2bd-47a5-a37b-a7d583d1b2e6 {{(pid=74613) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 18:21:35 user nova-compute[74613]: INFO nova.compute.manager [req-d21c2e24-d9ab-47b6-8c2a-9db94cae9479 req-5f4bb1a7-35cf-483d-a5a2-860b44038869 service nova] [instance: 3a2ac289-fc34-4c7b-a689-b499e2562578] Neutron deleted interface 6c245bc7-a2bd-47a5-a37b-a7d583d1b2e6; detaching it from the instance and deleting it from the info cache
Nov 29 18:21:35 user nova-compute[74613]: DEBUG nova.network.neutron [req-d21c2e24-d9ab-47b6-8c2a-9db94cae9479 req-5f4bb1a7-35cf-483d-a5a2-860b44038869 service nova] [instance: 3a2ac289-fc34-4c7b-a689-b499e2562578] Updating instance_info_cache with network_info: [] {{(pid=74613) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 18:21:35 user nova-compute[74613]: DEBUG nova.compute.manager [req-d21c2e24-d9ab-47b6-8c2a-9db94cae9479 req-5f4bb1a7-35cf-483d-a5a2-860b44038869 service nova] [instance: 3a2ac289-fc34-4c7b-a689-b499e2562578] Detach interface failed, port_id=6c245bc7-a2bd-47a5-a37b-a7d583d1b2e6, reason: Instance 3a2ac289-fc34-4c7b-a689-b499e2562578 could not be found. {{(pid=74613) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 29 18:21:35 user nova-compute[74613]: DEBUG nova.compute.manager [req-b1acef44-861b-4d18-94f3-23acfdc0d8b4 req-e723a000-e6e7-4b4e-a0dc-bd87a43a1176 service nova] [instance: 3a2ac289-fc34-4c7b-a689-b499e2562578] Received event network-vif-plugged-6c245bc7-a2bd-47a5-a37b-a7d583d1b2e6 {{(pid=74613) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 18:21:35 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-b1acef44-861b-4d18-94f3-23acfdc0d8b4 req-e723a000-e6e7-4b4e-a0dc-bd87a43a1176 service nova] Acquiring lock "3a2ac289-fc34-4c7b-a689-b499e2562578-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 18:21:35 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-b1acef44-861b-4d18-94f3-23acfdc0d8b4 req-e723a000-e6e7-4b4e-a0dc-bd87a43a1176 service nova] Lock "3a2ac289-fc34-4c7b-a689-b499e2562578-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 18:21:35 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-b1acef44-861b-4d18-94f3-23acfdc0d8b4 req-e723a000-e6e7-4b4e-a0dc-bd87a43a1176 service nova] Lock "3a2ac289-fc34-4c7b-a689-b499e2562578-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 18:21:35 user nova-compute[74613]: DEBUG nova.compute.manager [req-b1acef44-861b-4d18-94f3-23acfdc0d8b4 req-e723a000-e6e7-4b4e-a0dc-bd87a43a1176 service nova] [instance: 3a2ac289-fc34-4c7b-a689-b499e2562578] No waiting events found dispatching network-vif-plugged-6c245bc7-a2bd-47a5-a37b-a7d583d1b2e6 {{(pid=74613) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 18:21:35 user nova-compute[74613]: WARNING nova.compute.manager [req-b1acef44-861b-4d18-94f3-23acfdc0d8b4 req-e723a000-e6e7-4b4e-a0dc-bd87a43a1176 service nova] [instance: 3a2ac289-fc34-4c7b-a689-b499e2562578] Received unexpected event network-vif-plugged-6c245bc7-a2bd-47a5-a37b-a7d583d1b2e6 for instance with vm_state active and task_state deleting.
Nov 29 18:21:35 user nova-compute[74613]: INFO nova.compute.manager [None req-9db30b79-147f-46b8-8995-73123c3703aa tempest-TestVolumeBootPattern-1318569205 tempest-TestVolumeBootPattern-1318569205-project-member] [instance: 3a2ac289-fc34-4c7b-a689-b499e2562578] Took 0.76 seconds to detach 1 volumes for instance.
Nov 29 18:21:35 user nova-compute[74613]: DEBUG nova.compute.manager [None req-9db30b79-147f-46b8-8995-73123c3703aa tempest-TestVolumeBootPattern-1318569205 tempest-TestVolumeBootPattern-1318569205-project-member] [instance: 3a2ac289-fc34-4c7b-a689-b499e2562578] Deleting volume: 5d74e565-9547-4f44-8005-0615d625a275 {{(pid=74613) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3237}}
Nov 29 18:21:36 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-9db30b79-147f-46b8-8995-73123c3703aa tempest-TestVolumeBootPattern-1318569205 tempest-TestVolumeBootPattern-1318569205-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 18:21:36 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-9db30b79-147f-46b8-8995-73123c3703aa tempest-TestVolumeBootPattern-1318569205 tempest-TestVolumeBootPattern-1318569205-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 18:21:36 user nova-compute[74613]: DEBUG nova.compute.provider_tree [None req-9db30b79-147f-46b8-8995-73123c3703aa tempest-TestVolumeBootPattern-1318569205 tempest-TestVolumeBootPattern-1318569205-project-member] Inventory has not changed in ProviderTree for provider: 639d980e-3b12-44b1-b8f4-1812416fa4dd {{(pid=74613) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 18:21:36 user nova-compute[74613]: DEBUG nova.scheduler.client.report [None req-9db30b79-147f-46b8-8995-73123c3703aa tempest-TestVolumeBootPattern-1318569205 tempest-TestVolumeBootPattern-1318569205-project-member] Inventory has not changed for provider 639d980e-3b12-44b1-b8f4-1812416fa4dd based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74613) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 18:21:36 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-9db30b79-147f-46b8-8995-73123c3703aa tempest-TestVolumeBootPattern-1318569205 tempest-TestVolumeBootPattern-1318569205-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.189s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 18:21:36 user nova-compute[74613]: INFO nova.scheduler.client.report [None req-9db30b79-147f-46b8-8995-73123c3703aa tempest-TestVolumeBootPattern-1318569205 tempest-TestVolumeBootPattern-1318569205-project-member] Deleted allocations for instance 3a2ac289-fc34-4c7b-a689-b499e2562578
Nov 29 18:21:36 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-9db30b79-147f-46b8-8995-73123c3703aa tempest-TestVolumeBootPattern-1318569205 tempest-TestVolumeBootPattern-1318569205-project-member] Lock "3a2ac289-fc34-4c7b-a689-b499e2562578" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.407s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 18:21:36 user nova-compute[74613]: DEBUG oslo_service.periodic_task [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74613) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 18:21:38 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:21:39 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:21:40 user nova-compute[74613]: DEBUG oslo_service.periodic_task [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74613) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 18:21:41 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:21:42 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:21:42 user nova-compute[74613]: DEBUG oslo_service.periodic_task [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74613) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 18:21:42 user nova-compute[74613]: DEBUG oslo_service.periodic_task [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74613) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 18:21:43 user nova-compute[74613]: DEBUG oslo_service.periodic_task [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74613) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 18:21:43 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 18:21:43 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 18:21:43 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 18:21:43 user nova-compute[74613]: DEBUG nova.compute.resource_tracker [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Auditing locally available compute resources for user (node: user) {{(pid=74613) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 29 18:21:43 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5227902d-b2b9-40a6-988f-3c02c52404f3/disk --force-share --output=json {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:21:43 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:21:43 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5227902d-b2b9-40a6-988f-3c02c52404f3/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:21:43 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5227902d-b2b9-40a6-988f-3c02c52404f3/disk --force-share --output=json {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:21:44 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5227902d-b2b9-40a6-988f-3c02c52404f3/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:21:44 user nova-compute[74613]: WARNING nova.virt.libvirt.driver [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 18:21:44 user nova-compute[74613]: WARNING nova.virt.libvirt.driver [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 18:21:44 user nova-compute[74613]: DEBUG nova.compute.resource_tracker [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Hypervisor/Node resource view: name=user free_ram=8802MB free_disk=24.940185546875GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74613) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 29 18:21:44 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 18:21:44 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 18:21:44 user nova-compute[74613]: DEBUG nova.compute.resource_tracker [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Instance 5227902d-b2b9-40a6-988f-3c02c52404f3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74613) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 18:21:44 user nova-compute[74613]: DEBUG nova.compute.resource_tracker [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=74613) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 29 18:21:44 user nova-compute[74613]: DEBUG nova.compute.resource_tracker [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=74613) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 29 18:21:44 user nova-compute[74613]: DEBUG nova.compute.provider_tree [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Inventory has not changed in ProviderTree for provider: 639d980e-3b12-44b1-b8f4-1812416fa4dd {{(pid=74613) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 18:21:44 user nova-compute[74613]: DEBUG nova.scheduler.client.report [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Inventory has not changed for provider 639d980e-3b12-44b1-b8f4-1812416fa4dd based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74613) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 18:21:44 user nova-compute[74613]: DEBUG nova.compute.resource_tracker [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Compute_service record updated for user:user {{(pid=74613) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 29 18:21:44 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.218s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 18:21:46 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:21:46 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-a30c959b-ed50-4b1b-aee6-ee997adb1a66 tempest-VolumesActionsTest-576062334 tempest-VolumesActionsTest-576062334-project-member] Acquiring lock "465b35fe-8c8c-476c-97b1-feff13778cc1" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 18:21:46 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-a30c959b-ed50-4b1b-aee6-ee997adb1a66 tempest-VolumesActionsTest-576062334 tempest-VolumesActionsTest-576062334-project-member] Lock "465b35fe-8c8c-476c-97b1-feff13778cc1" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 18:21:46 user nova-compute[74613]: DEBUG nova.compute.manager [None req-a30c959b-ed50-4b1b-aee6-ee997adb1a66 tempest-VolumesActionsTest-576062334 tempest-VolumesActionsTest-576062334-project-member] [instance: 465b35fe-8c8c-476c-97b1-feff13778cc1] Starting instance... {{(pid=74613) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 29 18:21:46 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-a30c959b-ed50-4b1b-aee6-ee997adb1a66 tempest-VolumesActionsTest-576062334 tempest-VolumesActionsTest-576062334-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 18:21:46 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-a30c959b-ed50-4b1b-aee6-ee997adb1a66 tempest-VolumesActionsTest-576062334 tempest-VolumesActionsTest-576062334-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.000s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 18:21:46 user nova-compute[74613]: DEBUG nova.virt.hardware [None req-a30c959b-ed50-4b1b-aee6-ee997adb1a66 tempest-VolumesActionsTest-576062334 tempest-VolumesActionsTest-576062334-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74613) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 29 18:21:46 user nova-compute[74613]: INFO nova.compute.claims [None req-a30c959b-ed50-4b1b-aee6-ee997adb1a66 tempest-VolumesActionsTest-576062334 tempest-VolumesActionsTest-576062334-project-member] [instance: 465b35fe-8c8c-476c-97b1-feff13778cc1] Claim successful on node user
Nov 29 18:21:46 user nova-compute[74613]: DEBUG nova.compute.provider_tree [None req-a30c959b-ed50-4b1b-aee6-ee997adb1a66 tempest-VolumesActionsTest-576062334 tempest-VolumesActionsTest-576062334-project-member] Inventory has not changed in ProviderTree for provider: 639d980e-3b12-44b1-b8f4-1812416fa4dd {{(pid=74613) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 18:21:46 user nova-compute[74613]: DEBUG nova.scheduler.client.report [None req-a30c959b-ed50-4b1b-aee6-ee997adb1a66 tempest-VolumesActionsTest-576062334 tempest-VolumesActionsTest-576062334-project-member] Inventory has not changed for provider 639d980e-3b12-44b1-b8f4-1812416fa4dd based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74613) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 18:21:46 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-a30c959b-ed50-4b1b-aee6-ee997adb1a66 tempest-VolumesActionsTest-576062334 tempest-VolumesActionsTest-576062334-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.209s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 18:21:46 user nova-compute[74613]: DEBUG nova.compute.manager [None req-a30c959b-ed50-4b1b-aee6-ee997adb1a66 tempest-VolumesActionsTest-576062334 tempest-VolumesActionsTest-576062334-project-member] [instance: 465b35fe-8c8c-476c-97b1-feff13778cc1] Start building networks asynchronously for instance. {{(pid=74613) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 29 18:21:46 user nova-compute[74613]: DEBUG nova.compute.manager [None req-a30c959b-ed50-4b1b-aee6-ee997adb1a66 tempest-VolumesActionsTest-576062334 tempest-VolumesActionsTest-576062334-project-member] [instance: 465b35fe-8c8c-476c-97b1-feff13778cc1] Allocating IP information in the background. {{(pid=74613) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 29 18:21:46 user nova-compute[74613]: DEBUG nova.network.neutron [None req-a30c959b-ed50-4b1b-aee6-ee997adb1a66 tempest-VolumesActionsTest-576062334 tempest-VolumesActionsTest-576062334-project-member] [instance: 465b35fe-8c8c-476c-97b1-feff13778cc1] allocate_for_instance() {{(pid=74613) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 29 18:21:46 user nova-compute[74613]: INFO nova.virt.libvirt.driver [None req-a30c959b-ed50-4b1b-aee6-ee997adb1a66 tempest-VolumesActionsTest-576062334 tempest-VolumesActionsTest-576062334-project-member] [instance: 465b35fe-8c8c-476c-97b1-feff13778cc1] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 29 18:21:46 user nova-compute[74613]: DEBUG nova.compute.manager [None req-a30c959b-ed50-4b1b-aee6-ee997adb1a66 tempest-VolumesActionsTest-576062334 tempest-VolumesActionsTest-576062334-project-member] [instance: 465b35fe-8c8c-476c-97b1-feff13778cc1] Start building block device mappings for instance. {{(pid=74613) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 29 18:21:47 user nova-compute[74613]: DEBUG nova.policy [None req-a30c959b-ed50-4b1b-aee6-ee997adb1a66 tempest-VolumesActionsTest-576062334 tempest-VolumesActionsTest-576062334-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '680fbea8ee2e489b9e7a4274b5f66b62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13bf1cb7deec45aea930f4a0092572d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74613) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 29 18:21:47 user nova-compute[74613]: DEBUG nova.compute.manager [None req-a30c959b-ed50-4b1b-aee6-ee997adb1a66 tempest-VolumesActionsTest-576062334 tempest-VolumesActionsTest-576062334-project-member] [instance: 465b35fe-8c8c-476c-97b1-feff13778cc1] Start spawning the instance on the hypervisor. {{(pid=74613) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 29 18:21:47 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-a30c959b-ed50-4b1b-aee6-ee997adb1a66 tempest-VolumesActionsTest-576062334 tempest-VolumesActionsTest-576062334-project-member] [instance: 465b35fe-8c8c-476c-97b1-feff13778cc1] Creating instance directory {{(pid=74613) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 29 18:21:47 user nova-compute[74613]: INFO nova.virt.libvirt.driver [None req-a30c959b-ed50-4b1b-aee6-ee997adb1a66 tempest-VolumesActionsTest-576062334 tempest-VolumesActionsTest-576062334-project-member] [instance: 465b35fe-8c8c-476c-97b1-feff13778cc1] Creating image(s)
Nov 29 18:21:47 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-a30c959b-ed50-4b1b-aee6-ee997adb1a66 tempest-VolumesActionsTest-576062334 tempest-VolumesActionsTest-576062334-project-member] Acquiring lock "/opt/stack/data/nova/instances/465b35fe-8c8c-476c-97b1-feff13778cc1/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 18:21:47 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-a30c959b-ed50-4b1b-aee6-ee997adb1a66 tempest-VolumesActionsTest-576062334 tempest-VolumesActionsTest-576062334-project-member] Lock "/opt/stack/data/nova/instances/465b35fe-8c8c-476c-97b1-feff13778cc1/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 18:21:47 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-a30c959b-ed50-4b1b-aee6-ee997adb1a66 tempest-VolumesActionsTest-576062334 tempest-VolumesActionsTest-576062334-project-member] Lock "/opt/stack/data/nova/instances/465b35fe-8c8c-476c-97b1-feff13778cc1/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 18:21:47 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-a30c959b-ed50-4b1b-aee6-ee997adb1a66 tempest-VolumesActionsTest-576062334 tempest-VolumesActionsTest-576062334-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/21faea9e6951f3bdd0153b76ac89fe1a60a34758 --force-share --output=json {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:21:47 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-a30c959b-ed50-4b1b-aee6-ee997adb1a66 tempest-VolumesActionsTest-576062334 tempest-VolumesActionsTest-576062334-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/21faea9e6951f3bdd0153b76ac89fe1a60a34758 --force-share --output=json" returned: 0 in 0.207s {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:21:47 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-a30c959b-ed50-4b1b-aee6-ee997adb1a66 tempest-VolumesActionsTest-576062334 tempest-VolumesActionsTest-576062334-project-member] Acquiring lock "21faea9e6951f3bdd0153b76ac89fe1a60a34758" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 18:21:47 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-a30c959b-ed50-4b1b-aee6-ee997adb1a66 tempest-VolumesActionsTest-576062334 tempest-VolumesActionsTest-576062334-project-member] Lock "21faea9e6951f3bdd0153b76ac89fe1a60a34758" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 18:21:47 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-a30c959b-ed50-4b1b-aee6-ee997adb1a66 tempest-VolumesActionsTest-576062334 tempest-VolumesActionsTest-576062334-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/21faea9e6951f3bdd0153b76ac89fe1a60a34758 --force-share --output=json {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:21:47 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-a30c959b-ed50-4b1b-aee6-ee997adb1a66 tempest-VolumesActionsTest-576062334 tempest-VolumesActionsTest-576062334-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/21faea9e6951f3bdd0153b76ac89fe1a60a34758 --force-share --output=json" returned: 0 in 0.177s {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:21:47 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-a30c959b-ed50-4b1b-aee6-ee997adb1a66 tempest-VolumesActionsTest-576062334 tempest-VolumesActionsTest-576062334-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/21faea9e6951f3bdd0153b76ac89fe1a60a34758,backing_fmt=raw /opt/stack/data/nova/instances/465b35fe-8c8c-476c-97b1-feff13778cc1/disk 1073741824 {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:21:47 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-a30c959b-ed50-4b1b-aee6-ee997adb1a66 tempest-VolumesActionsTest-576062334 tempest-VolumesActionsTest-576062334-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/21faea9e6951f3bdd0153b76ac89fe1a60a34758,backing_fmt=raw /opt/stack/data/nova/instances/465b35fe-8c8c-476c-97b1-feff13778cc1/disk 1073741824" returned: 0 in 0.047s {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:21:47 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-a30c959b-ed50-4b1b-aee6-ee997adb1a66 tempest-VolumesActionsTest-576062334 tempest-VolumesActionsTest-576062334-project-member] Lock "21faea9e6951f3bdd0153b76ac89fe1a60a34758" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.231s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 18:21:47 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-a30c959b-ed50-4b1b-aee6-ee997adb1a66 tempest-VolumesActionsTest-576062334 tempest-VolumesActionsTest-576062334-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/21faea9e6951f3bdd0153b76ac89fe1a60a34758 --force-share --output=json {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:21:47 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-a30c959b-ed50-4b1b-aee6-ee997adb1a66 tempest-VolumesActionsTest-576062334 tempest-VolumesActionsTest-576062334-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/21faea9e6951f3bdd0153b76ac89fe1a60a34758 --force-share --output=json" returned: 0 in 0.172s {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:21:47 user nova-compute[74613]: DEBUG nova.virt.disk.api [None req-a30c959b-ed50-4b1b-aee6-ee997adb1a66 tempest-VolumesActionsTest-576062334 tempest-VolumesActionsTest-576062334-project-member] Checking if we can resize image /opt/stack/data/nova/instances/465b35fe-8c8c-476c-97b1-feff13778cc1/disk. size=1073741824 {{(pid=74613) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 29 18:21:47 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-a30c959b-ed50-4b1b-aee6-ee997adb1a66 tempest-VolumesActionsTest-576062334 tempest-VolumesActionsTest-576062334-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/465b35fe-8c8c-476c-97b1-feff13778cc1/disk --force-share --output=json {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:21:47 user nova-compute[74613]: DEBUG oslo_service.periodic_task [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74613) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 18:21:47 user nova-compute[74613]: DEBUG nova.compute.manager [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Starting heal instance info cache {{(pid=74613) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 29 18:21:47 user nova-compute[74613]: DEBUG nova.compute.manager [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Didn't find any instances for network info cache update. {{(pid=74613) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 29 18:21:47 user nova-compute[74613]: DEBUG oslo_service.periodic_task [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74613) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 18:21:47 user nova-compute[74613]: DEBUG oslo_service.periodic_task [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74613) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 18:21:47 user nova-compute[74613]: DEBUG nova.compute.manager [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74613) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 29 18:21:47 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-a30c959b-ed50-4b1b-aee6-ee997adb1a66 tempest-VolumesActionsTest-576062334 tempest-VolumesActionsTest-576062334-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/465b35fe-8c8c-476c-97b1-feff13778cc1/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:21:47 user nova-compute[74613]: DEBUG nova.virt.disk.api [None req-a30c959b-ed50-4b1b-aee6-ee997adb1a66 tempest-VolumesActionsTest-576062334 tempest-VolumesActionsTest-576062334-project-member] Cannot resize image /opt/stack/data/nova/instances/465b35fe-8c8c-476c-97b1-feff13778cc1/disk to a smaller size. {{(pid=74613) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 29 18:21:47 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-a30c959b-ed50-4b1b-aee6-ee997adb1a66 tempest-VolumesActionsTest-576062334 tempest-VolumesActionsTest-576062334-project-member] [instance: 465b35fe-8c8c-476c-97b1-feff13778cc1] Created local disks {{(pid=74613) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 29 18:21:47 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-a30c959b-ed50-4b1b-aee6-ee997adb1a66 tempest-VolumesActionsTest-576062334 tempest-VolumesActionsTest-576062334-project-member] [instance: 465b35fe-8c8c-476c-97b1-feff13778cc1] Ensure instance console log exists: /opt/stack/data/nova/instances/465b35fe-8c8c-476c-97b1-feff13778cc1/console.log {{(pid=74613) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 29 18:21:47 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-a30c959b-ed50-4b1b-aee6-ee997adb1a66 tempest-VolumesActionsTest-576062334 tempest-VolumesActionsTest-576062334-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 18:21:47 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-a30c959b-ed50-4b1b-aee6-ee997adb1a66 tempest-VolumesActionsTest-576062334 tempest-VolumesActionsTest-576062334-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 18:21:47 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-a30c959b-ed50-4b1b-aee6-ee997adb1a66 tempest-VolumesActionsTest-576062334 tempest-VolumesActionsTest-576062334-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 18:21:47 user nova-compute[74613]: DEBUG nova.network.neutron [None req-a30c959b-ed50-4b1b-aee6-ee997adb1a66 tempest-VolumesActionsTest-576062334 tempest-VolumesActionsTest-576062334-project-member] [instance: 465b35fe-8c8c-476c-97b1-feff13778cc1] Successfully created port: dce464f3-e0ed-4708-a833-224a83b01f86 {{(pid=74613) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 29 18:21:48 user nova-compute[74613]: DEBUG nova.network.neutron [None req-a30c959b-ed50-4b1b-aee6-ee997adb1a66 tempest-VolumesActionsTest-576062334 tempest-VolumesActionsTest-576062334-project-member] [instance: 465b35fe-8c8c-476c-97b1-feff13778cc1] Successfully updated port: dce464f3-e0ed-4708-a833-224a83b01f86 {{(pid=74613) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 29 18:21:48 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-a30c959b-ed50-4b1b-aee6-ee997adb1a66 tempest-VolumesActionsTest-576062334 tempest-VolumesActionsTest-576062334-project-member] Acquiring lock "refresh_cache-465b35fe-8c8c-476c-97b1-feff13778cc1" {{(pid=74613) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 18:21:48 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-a30c959b-ed50-4b1b-aee6-ee997adb1a66 tempest-VolumesActionsTest-576062334 tempest-VolumesActionsTest-576062334-project-member] Acquired lock "refresh_cache-465b35fe-8c8c-476c-97b1-feff13778cc1" {{(pid=74613) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 18:21:48 user nova-compute[74613]: DEBUG nova.network.neutron [None req-a30c959b-ed50-4b1b-aee6-ee997adb1a66 tempest-VolumesActionsTest-576062334 tempest-VolumesActionsTest-576062334-project-member] [instance: 465b35fe-8c8c-476c-97b1-feff13778cc1] Building network info cache for instance {{(pid=74613) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 29 18:21:48 user nova-compute[74613]: DEBUG nova.compute.manager [req-ce84e8e5-5e39-4514-8932-a05fea7ea16e req-b9c50617-2157-48ee-b69a-3282ac7040a6 service nova] [instance: 465b35fe-8c8c-476c-97b1-feff13778cc1] Received event network-changed-dce464f3-e0ed-4708-a833-224a83b01f86 {{(pid=74613) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 18:21:48 user nova-compute[74613]: DEBUG nova.compute.manager [req-ce84e8e5-5e39-4514-8932-a05fea7ea16e req-b9c50617-2157-48ee-b69a-3282ac7040a6 service nova] [instance: 465b35fe-8c8c-476c-97b1-feff13778cc1] Refreshing instance network info cache due to event network-changed-dce464f3-e0ed-4708-a833-224a83b01f86. {{(pid=74613) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 18:21:48 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-ce84e8e5-5e39-4514-8932-a05fea7ea16e req-b9c50617-2157-48ee-b69a-3282ac7040a6 service nova] Acquiring lock "refresh_cache-465b35fe-8c8c-476c-97b1-feff13778cc1" {{(pid=74613) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 18:21:48 user nova-compute[74613]: DEBUG nova.network.neutron [None req-a30c959b-ed50-4b1b-aee6-ee997adb1a66 tempest-VolumesActionsTest-576062334 tempest-VolumesActionsTest-576062334-project-member] [instance: 465b35fe-8c8c-476c-97b1-feff13778cc1] Instance cache missing network info. {{(pid=74613) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 29 18:21:48 user nova-compute[74613]: DEBUG oslo_service.periodic_task [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74613) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 18:21:48 user nova-compute[74613]: DEBUG nova.network.neutron [None req-a30c959b-ed50-4b1b-aee6-ee997adb1a66 tempest-VolumesActionsTest-576062334 tempest-VolumesActionsTest-576062334-project-member] [instance: 465b35fe-8c8c-476c-97b1-feff13778cc1] Updating instance_info_cache with network_info: [{"id": "dce464f3-e0ed-4708-a833-224a83b01f86", "address": "fa:16:3e:b5:50:4e", "network": {"id": "74c4d111-4731-4d90-b6a9-a72b112d18ca", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1404505506-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "13bf1cb7deec45aea930f4a0092572d1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdce464f3-e0", "ovs_interfaceid": "dce464f3-e0ed-4708-a833-224a83b01f86", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74613) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 18:21:48 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-a30c959b-ed50-4b1b-aee6-ee997adb1a66 tempest-VolumesActionsTest-576062334 tempest-VolumesActionsTest-576062334-project-member] Releasing lock "refresh_cache-465b35fe-8c8c-476c-97b1-feff13778cc1" {{(pid=74613) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 18:21:48 user nova-compute[74613]: DEBUG nova.compute.manager [None req-a30c959b-ed50-4b1b-aee6-ee997adb1a66 tempest-VolumesActionsTest-576062334 tempest-VolumesActionsTest-576062334-project-member] [instance: 465b35fe-8c8c-476c-97b1-feff13778cc1] Instance network_info: |[{"id": "dce464f3-e0ed-4708-a833-224a83b01f86", "address": "fa:16:3e:b5:50:4e", "network": {"id": "74c4d111-4731-4d90-b6a9-a72b112d18ca", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1404505506-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "13bf1cb7deec45aea930f4a0092572d1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdce464f3-e0", "ovs_interfaceid": "dce464f3-e0ed-4708-a833-224a83b01f86", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74613) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 29 18:21:48 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-ce84e8e5-5e39-4514-8932-a05fea7ea16e req-b9c50617-2157-48ee-b69a-3282ac7040a6 service nova] Acquired lock "refresh_cache-465b35fe-8c8c-476c-97b1-feff13778cc1" {{(pid=74613) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 18:21:48 user nova-compute[74613]: DEBUG nova.network.neutron [req-ce84e8e5-5e39-4514-8932-a05fea7ea16e req-b9c50617-2157-48ee-b69a-3282ac7040a6 service nova] [instance: 465b35fe-8c8c-476c-97b1-feff13778cc1] Refreshing network info cache for port dce464f3-e0ed-4708-a833-224a83b01f86 {{(pid=74613) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 18:21:48 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-a30c959b-ed50-4b1b-aee6-ee997adb1a66 tempest-VolumesActionsTest-576062334 tempest-VolumesActionsTest-576062334-project-member] [instance: 465b35fe-8c8c-476c-97b1-feff13778cc1] Start _get_guest_xml network_info=[{"id": "dce464f3-e0ed-4708-a833-224a83b01f86", "address": "fa:16:3e:b5:50:4e", "network": {"id": "74c4d111-4731-4d90-b6a9-a72b112d18ca", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1404505506-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "13bf1cb7deec45aea930f4a0092572d1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdce464f3-e0", "ovs_interfaceid": "dce464f3-e0ed-4708-a833-224a83b01f86", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-29T17:47:38Z,direct_url=<?>,disk_format='qcow2',id=4217f428-8d9d-4ee1-9614-642d26d90c46,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='794b07cbd46a44b5865cfda741036bae',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-29T17:47:40Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'size': 0, 'device_type': 'disk', 'boot_index': 0, 'guest_format': None, 'encrypted': False, 'encryption_format': None, 'disk_bus': 'virtio', 'image_id': '4217f428-8d9d-4ee1-9614-642d26d90c46'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74613) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 29 18:21:48 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:21:48 user nova-compute[74613]: WARNING nova.virt.libvirt.driver [None req-a30c959b-ed50-4b1b-aee6-ee997adb1a66 tempest-VolumesActionsTest-576062334 tempest-VolumesActionsTest-576062334-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 18:21:48 user nova-compute[74613]: WARNING nova.virt.libvirt.driver [None req-a30c959b-ed50-4b1b-aee6-ee997adb1a66 tempest-VolumesActionsTest-576062334 tempest-VolumesActionsTest-576062334-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 18:21:48 user nova-compute[74613]: DEBUG nova.virt.libvirt.host [None req-a30c959b-ed50-4b1b-aee6-ee997adb1a66 tempest-VolumesActionsTest-576062334 tempest-VolumesActionsTest-576062334-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74613) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 29 18:21:48 user nova-compute[74613]: DEBUG nova.virt.libvirt.host [None req-a30c959b-ed50-4b1b-aee6-ee997adb1a66 tempest-VolumesActionsTest-576062334 tempest-VolumesActionsTest-576062334-project-member] CPU controller missing on host. {{(pid=74613) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 29 18:21:48 user nova-compute[74613]: DEBUG nova.virt.libvirt.host [None req-a30c959b-ed50-4b1b-aee6-ee997adb1a66 tempest-VolumesActionsTest-576062334 tempest-VolumesActionsTest-576062334-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74613) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 29 18:21:48 user nova-compute[74613]: DEBUG nova.virt.libvirt.host [None req-a30c959b-ed50-4b1b-aee6-ee997adb1a66 tempest-VolumesActionsTest-576062334 tempest-VolumesActionsTest-576062334-project-member] CPU controller found on host. {{(pid=74613) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 29 18:21:48 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-a30c959b-ed50-4b1b-aee6-ee997adb1a66 tempest-VolumesActionsTest-576062334 tempest-VolumesActionsTest-576062334-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74613) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 29 18:21:48 user nova-compute[74613]: DEBUG nova.virt.hardware [None req-a30c959b-ed50-4b1b-aee6-ee997adb1a66 tempest-VolumesActionsTest-576062334 tempest-VolumesActionsTest-576062334-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-29T17:47:27Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-29T17:47:38Z,direct_url=<?>,disk_format='qcow2',id=4217f428-8d9d-4ee1-9614-642d26d90c46,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='794b07cbd46a44b5865cfda741036bae',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-29T17:47:40Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74613) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 29 18:21:48 user nova-compute[74613]: DEBUG nova.virt.hardware [None req-a30c959b-ed50-4b1b-aee6-ee997adb1a66 tempest-VolumesActionsTest-576062334 tempest-VolumesActionsTest-576062334-project-member] Flavor limits 0:0:0 {{(pid=74613) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 29 18:21:48 user nova-compute[74613]: DEBUG nova.virt.hardware [None req-a30c959b-ed50-4b1b-aee6-ee997adb1a66 tempest-VolumesActionsTest-576062334 tempest-VolumesActionsTest-576062334-project-member] Image limits 0:0:0 {{(pid=74613) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 29 18:21:48 user nova-compute[74613]: DEBUG nova.virt.hardware [None req-a30c959b-ed50-4b1b-aee6-ee997adb1a66 tempest-VolumesActionsTest-576062334 tempest-VolumesActionsTest-576062334-project-member] Flavor pref 0:0:0 {{(pid=74613) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 29 18:21:48 user nova-compute[74613]: DEBUG nova.virt.hardware [None req-a30c959b-ed50-4b1b-aee6-ee997adb1a66 tempest-VolumesActionsTest-576062334 tempest-VolumesActionsTest-576062334-project-member] Image pref 0:0:0 {{(pid=74613) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 29 18:21:48 user nova-compute[74613]: DEBUG nova.virt.hardware [None req-a30c959b-ed50-4b1b-aee6-ee997adb1a66 tempest-VolumesActionsTest-576062334 tempest-VolumesActionsTest-576062334-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74613) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 29 18:21:48 user nova-compute[74613]: DEBUG nova.virt.hardware [None req-a30c959b-ed50-4b1b-aee6-ee997adb1a66 tempest-VolumesActionsTest-576062334 tempest-VolumesActionsTest-576062334-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74613) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 29 18:21:48 user nova-compute[74613]: DEBUG nova.virt.hardware [None req-a30c959b-ed50-4b1b-aee6-ee997adb1a66 tempest-VolumesActionsTest-576062334 tempest-VolumesActionsTest-576062334-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74613) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 29 18:21:48 user nova-compute[74613]: DEBUG nova.virt.hardware [None req-a30c959b-ed50-4b1b-aee6-ee997adb1a66 tempest-VolumesActionsTest-576062334 tempest-VolumesActionsTest-576062334-project-member] Got 1 possible topologies {{(pid=74613) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 29 18:21:48 user nova-compute[74613]: DEBUG nova.virt.hardware [None req-a30c959b-ed50-4b1b-aee6-ee997adb1a66 tempest-VolumesActionsTest-576062334 tempest-VolumesActionsTest-576062334-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74613) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 29 18:21:48 user nova-compute[74613]: DEBUG nova.virt.hardware [None req-a30c959b-ed50-4b1b-aee6-ee997adb1a66 tempest-VolumesActionsTest-576062334 tempest-VolumesActionsTest-576062334-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74613) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 29 18:21:48 user nova-compute[74613]: DEBUG nova.virt.libvirt.vif [None req-a30c959b-ed50-4b1b-aee6-ee997adb1a66 tempest-VolumesActionsTest-576062334 tempest-VolumesActionsTest-576062334-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T18:21:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1482723050',display_name='tempest-VolumesActionsTest-instance-1482723050',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1482723050',id=45,image_ref='4217f428-8d9d-4ee1-9614-642d26d90c46',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='13bf1cb7deec45aea930f4a0092572d1',ramdisk_id='',reservation_id='r-pdx44nfp',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='4217f428-8d9d-4ee1-9614-642d26d90c46',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-576062334',owner_user_name='tempest-VolumesActionsTest-576062334-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T18:21:47Z,user_data=None,user_id='680fbea8ee2e489b9e7a4274b5f66b62',uuid=465b35fe-8c8c-476c-97b1-feff13778cc1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "dce464f3-e0ed-4708-a833-224a83b01f86", "address": "fa:16:3e:b5:50:4e", "network": {"id": "74c4d111-4731-4d90-b6a9-a72b112d18ca", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1404505506-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "13bf1cb7deec45aea930f4a0092572d1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdce464f3-e0", "ovs_interfaceid": "dce464f3-e0ed-4708-a833-224a83b01f86", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74613) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 29 18:21:48 user nova-compute[74613]: DEBUG nova.network.os_vif_util [None req-a30c959b-ed50-4b1b-aee6-ee997adb1a66 tempest-VolumesActionsTest-576062334 tempest-VolumesActionsTest-576062334-project-member] Converting VIF {"id": "dce464f3-e0ed-4708-a833-224a83b01f86", "address": "fa:16:3e:b5:50:4e", "network": {"id": "74c4d111-4731-4d90-b6a9-a72b112d18ca", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1404505506-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "13bf1cb7deec45aea930f4a0092572d1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdce464f3-e0", "ovs_interfaceid": "dce464f3-e0ed-4708-a833-224a83b01f86", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74613) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 18:21:48 user nova-compute[74613]: DEBUG nova.network.os_vif_util [None req-a30c959b-ed50-4b1b-aee6-ee997adb1a66 tempest-VolumesActionsTest-576062334 tempest-VolumesActionsTest-576062334-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b5:50:4e,bridge_name='br-int',has_traffic_filtering=True,id=dce464f3-e0ed-4708-a833-224a83b01f86,network=Network(74c4d111-4731-4d90-b6a9-a72b112d18ca),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdce464f3-e0') {{(pid=74613) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 18:21:48 user nova-compute[74613]: DEBUG nova.objects.instance [None req-a30c959b-ed50-4b1b-aee6-ee997adb1a66 tempest-VolumesActionsTest-576062334 tempest-VolumesActionsTest-576062334-project-member] Lazy-loading 'pci_devices' on Instance uuid 465b35fe-8c8c-476c-97b1-feff13778cc1 {{(pid=74613) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 18:21:48 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-a30c959b-ed50-4b1b-aee6-ee997adb1a66 tempest-VolumesActionsTest-576062334 tempest-VolumesActionsTest-576062334-project-member] [instance: 465b35fe-8c8c-476c-97b1-feff13778cc1] End _get_guest_xml xml=<domain type="kvm">
Nov 29 18:21:48 user nova-compute[74613]:   <uuid>465b35fe-8c8c-476c-97b1-feff13778cc1</uuid>
Nov 29 18:21:48 user nova-compute[74613]:   <name>instance-0000002d</name>
Nov 29 18:21:48 user nova-compute[74613]:   <memory>524288</memory>
Nov 29 18:21:48 user nova-compute[74613]:   <vcpu>1</vcpu>
Nov 29 18:21:48 user nova-compute[74613]:   <metadata>
Nov 29 18:21:48 user nova-compute[74613]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 29 18:21:48 user nova-compute[74613]:       <nova:package version="0.0.0"/>
Nov 29 18:21:48 user nova-compute[74613]:       <nova:name>tempest-VolumesActionsTest-instance-1482723050</nova:name>
Nov 29 18:21:48 user nova-compute[74613]:       <nova:creationTime>2023-11-29 18:21:48</nova:creationTime>
Nov 29 18:21:48 user nova-compute[74613]:       <nova:flavor name="m1.tiny">
Nov 29 18:21:48 user nova-compute[74613]:         <nova:memory>512</nova:memory>
Nov 29 18:21:48 user nova-compute[74613]:         <nova:disk>1</nova:disk>
Nov 29 18:21:48 user nova-compute[74613]:         <nova:swap>0</nova:swap>
Nov 29 18:21:48 user nova-compute[74613]:         <nova:ephemeral>0</nova:ephemeral>
Nov 29 18:21:48 user nova-compute[74613]:         <nova:vcpus>1</nova:vcpus>
Nov 29 18:21:48 user nova-compute[74613]:       </nova:flavor>
Nov 29 18:21:48 user nova-compute[74613]:       <nova:owner>
Nov 29 18:21:48 user nova-compute[74613]:         <nova:user uuid="680fbea8ee2e489b9e7a4274b5f66b62">tempest-VolumesActionsTest-576062334-project-member</nova:user>
Nov 29 18:21:48 user nova-compute[74613]:         <nova:project uuid="13bf1cb7deec45aea930f4a0092572d1">tempest-VolumesActionsTest-576062334</nova:project>
Nov 29 18:21:48 user nova-compute[74613]:       </nova:owner>
Nov 29 18:21:48 user nova-compute[74613]:       <nova:root type="image" uuid="4217f428-8d9d-4ee1-9614-642d26d90c46"/>
Nov 29 18:21:48 user nova-compute[74613]:       <nova:ports>
Nov 29 18:21:48 user nova-compute[74613]:         <nova:port uuid="dce464f3-e0ed-4708-a833-224a83b01f86">
Nov 29 18:21:48 user nova-compute[74613]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Nov 29 18:21:48 user nova-compute[74613]:         </nova:port>
Nov 29 18:21:48 user nova-compute[74613]:       </nova:ports>
Nov 29 18:21:48 user nova-compute[74613]:     </nova:instance>
Nov 29 18:21:48 user nova-compute[74613]:   </metadata>
Nov 29 18:21:48 user nova-compute[74613]:   <sysinfo type="smbios">
Nov 29 18:21:48 user nova-compute[74613]:     <system>
Nov 29 18:21:48 user nova-compute[74613]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 29 18:21:48 user nova-compute[74613]:       <entry name="product">OpenStack Nova</entry>
Nov 29 18:21:48 user nova-compute[74613]:       <entry name="version">0.0.0</entry>
Nov 29 18:21:48 user nova-compute[74613]:       <entry name="serial">465b35fe-8c8c-476c-97b1-feff13778cc1</entry>
Nov 29 18:21:48 user nova-compute[74613]:       <entry name="uuid">465b35fe-8c8c-476c-97b1-feff13778cc1</entry>
Nov 29 18:21:48 user nova-compute[74613]:       <entry name="family">Virtual Machine</entry>
Nov 29 18:21:48 user nova-compute[74613]:     </system>
Nov 29 18:21:48 user nova-compute[74613]:   </sysinfo>
Nov 29 18:21:48 user nova-compute[74613]:   <os>
Nov 29 18:21:48 user nova-compute[74613]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 29 18:21:48 user nova-compute[74613]:     <boot dev="hd"/>
Nov 29 18:21:48 user nova-compute[74613]:     <smbios mode="sysinfo"/>
Nov 29 18:21:48 user nova-compute[74613]:   </os>
Nov 29 18:21:48 user nova-compute[74613]:   <features>
Nov 29 18:21:48 user nova-compute[74613]:     <acpi/>
Nov 29 18:21:48 user nova-compute[74613]:     <apic/>
Nov 29 18:21:48 user nova-compute[74613]:     <vmcoreinfo/>
Nov 29 18:21:48 user nova-compute[74613]:   </features>
Nov 29 18:21:48 user nova-compute[74613]:   <clock offset="utc">
Nov 29 18:21:48 user nova-compute[74613]:     <timer name="pit" tickpolicy="delay"/>
Nov 29 18:21:48 user nova-compute[74613]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 29 18:21:48 user nova-compute[74613]:     <timer name="hpet" present="no"/>
Nov 29 18:21:48 user nova-compute[74613]:   </clock>
Nov 29 18:21:48 user nova-compute[74613]:   <cpu mode="custom" match="exact">
Nov 29 18:21:48 user nova-compute[74613]:     <model>Nehalem</model>
Nov 29 18:21:48 user nova-compute[74613]:     <topology sockets="1" cores="1" threads="1"/>
Nov 29 18:21:48 user nova-compute[74613]:   </cpu>
Nov 29 18:21:48 user nova-compute[74613]:   <devices>
Nov 29 18:21:48 user nova-compute[74613]:     <disk type="file" device="disk">
Nov 29 18:21:48 user nova-compute[74613]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 29 18:21:48 user nova-compute[74613]:       <source file="/opt/stack/data/nova/instances/465b35fe-8c8c-476c-97b1-feff13778cc1/disk"/>
Nov 29 18:21:48 user nova-compute[74613]:       <target dev="vda" bus="virtio"/>
Nov 29 18:21:48 user nova-compute[74613]:     </disk>
Nov 29 18:21:48 user nova-compute[74613]:     <interface type="ethernet">
Nov 29 18:21:48 user nova-compute[74613]:       <mac address="fa:16:3e:b5:50:4e"/>
Nov 29 18:21:48 user nova-compute[74613]:       <model type="virtio"/>
Nov 29 18:21:48 user nova-compute[74613]:       <mtu size="1442"/>
Nov 29 18:21:48 user nova-compute[74613]:       <target dev="tapdce464f3-e0"/>
Nov 29 18:21:48 user nova-compute[74613]:     </interface>
Nov 29 18:21:48 user nova-compute[74613]:     <serial type="pty">
Nov 29 18:21:48 user nova-compute[74613]:       <log file="/opt/stack/data/nova/instances/465b35fe-8c8c-476c-97b1-feff13778cc1/console.log" append="off"/>
Nov 29 18:21:48 user nova-compute[74613]:     </serial>
Nov 29 18:21:48 user nova-compute[74613]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 29 18:21:48 user nova-compute[74613]:     <video>
Nov 29 18:21:48 user nova-compute[74613]:       <model type="virtio"/>
Nov 29 18:21:48 user nova-compute[74613]:     </video>
Nov 29 18:21:48 user nova-compute[74613]:     <rng model="virtio">
Nov 29 18:21:48 user nova-compute[74613]:       <backend model="random">/dev/urandom</backend>
Nov 29 18:21:48 user nova-compute[74613]:     </rng>
Nov 29 18:21:48 user nova-compute[74613]:     <controller type="usb" index="0" model="none"/>
Nov 29 18:21:48 user nova-compute[74613]:     <memballoon model="virtio">
Nov 29 18:21:48 user nova-compute[74613]:       <stats period="10"/>
Nov 29 18:21:48 user nova-compute[74613]:     </memballoon>
Nov 29 18:21:48 user nova-compute[74613]:   </devices>
Nov 29 18:21:48 user nova-compute[74613]: </domain>
Nov 29 18:21:48 user nova-compute[74613]:  {{(pid=74613) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 29 18:21:48 user nova-compute[74613]: DEBUG nova.virt.libvirt.vif [None req-a30c959b-ed50-4b1b-aee6-ee997adb1a66 tempest-VolumesActionsTest-576062334 tempest-VolumesActionsTest-576062334-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T18:21:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1482723050',display_name='tempest-VolumesActionsTest-instance-1482723050',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1482723050',id=45,image_ref='4217f428-8d9d-4ee1-9614-642d26d90c46',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='13bf1cb7deec45aea930f4a0092572d1',ramdisk_id='',reservation_id='r-pdx44nfp',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='4217f428-8d9d-4ee1-9614-642d26d90c46',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-576062334',owner_user_name='tempest-VolumesActionsTest-576062334-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T18:21:47Z,user_data=None,user_id='680fbea8ee2e489b9e7a4274b5f66b62',uuid=465b35fe-8c8c-476c-97b1-feff13778cc1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "dce464f3-e0ed-4708-a833-224a83b01f86", "address": "fa:16:3e:b5:50:4e", "network": {"id": "74c4d111-4731-4d90-b6a9-a72b112d18ca", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1404505506-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "13bf1cb7deec45aea930f4a0092572d1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdce464f3-e0", "ovs_interfaceid": "dce464f3-e0ed-4708-a833-224a83b01f86", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74613) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 29 18:21:48 user nova-compute[74613]: DEBUG nova.network.os_vif_util [None req-a30c959b-ed50-4b1b-aee6-ee997adb1a66 tempest-VolumesActionsTest-576062334 tempest-VolumesActionsTest-576062334-project-member] Converting VIF {"id": "dce464f3-e0ed-4708-a833-224a83b01f86", "address": "fa:16:3e:b5:50:4e", "network": {"id": "74c4d111-4731-4d90-b6a9-a72b112d18ca", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1404505506-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "13bf1cb7deec45aea930f4a0092572d1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdce464f3-e0", "ovs_interfaceid": "dce464f3-e0ed-4708-a833-224a83b01f86", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74613) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 18:21:48 user nova-compute[74613]: DEBUG nova.network.os_vif_util [None req-a30c959b-ed50-4b1b-aee6-ee997adb1a66 tempest-VolumesActionsTest-576062334 tempest-VolumesActionsTest-576062334-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b5:50:4e,bridge_name='br-int',has_traffic_filtering=True,id=dce464f3-e0ed-4708-a833-224a83b01f86,network=Network(74c4d111-4731-4d90-b6a9-a72b112d18ca),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdce464f3-e0') {{(pid=74613) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 18:21:48 user nova-compute[74613]: DEBUG os_vif [None req-a30c959b-ed50-4b1b-aee6-ee997adb1a66 tempest-VolumesActionsTest-576062334 tempest-VolumesActionsTest-576062334-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b5:50:4e,bridge_name='br-int',has_traffic_filtering=True,id=dce464f3-e0ed-4708-a833-224a83b01f86,network=Network(74c4d111-4731-4d90-b6a9-a72b112d18ca),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdce464f3-e0') {{(pid=74613) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 29 18:21:48 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:21:48 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74613) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 18:21:48 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74613) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 29 18:21:48 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:21:48 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'f2511517-e8a4-58db-afd8-ff38f777eb92', '_type': 'linux-noop'}}, row=False) {{(pid=74613) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 18:21:48 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:21:48 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 18:21:48 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:21:48 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapdce464f3-e0, may_exist=True, interface_attrs={}) {{(pid=74613) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 18:21:48 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapdce464f3-e0, col_values=(('qos', UUID('2b3f5833-6428-414d-854d-c7891cfd4bca')),), if_exists=True) {{(pid=74613) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 18:21:48 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapdce464f3-e0, col_values=(('external_ids', {'iface-id': 'dce464f3-e0ed-4708-a833-224a83b01f86', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:b5:50:4e', 'vm-uuid': '465b35fe-8c8c-476c-97b1-feff13778cc1'}),), if_exists=True) {{(pid=74613) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 18:21:48 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:21:48 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 18:21:48 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:21:48 user nova-compute[74613]: INFO os_vif [None req-a30c959b-ed50-4b1b-aee6-ee997adb1a66 tempest-VolumesActionsTest-576062334 tempest-VolumesActionsTest-576062334-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b5:50:4e,bridge_name='br-int',has_traffic_filtering=True,id=dce464f3-e0ed-4708-a833-224a83b01f86,network=Network(74c4d111-4731-4d90-b6a9-a72b112d18ca),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdce464f3-e0')
Nov 29 18:21:48 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-a30c959b-ed50-4b1b-aee6-ee997adb1a66 tempest-VolumesActionsTest-576062334 tempest-VolumesActionsTest-576062334-project-member] No BDM found with device name vda, not building metadata. {{(pid=74613) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 18:21:48 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-a30c959b-ed50-4b1b-aee6-ee997adb1a66 tempest-VolumesActionsTest-576062334 tempest-VolumesActionsTest-576062334-project-member] No VIF found with MAC fa:16:3e:b5:50:4e, not building metadata {{(pid=74613) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 29 18:21:49 user nova-compute[74613]: DEBUG nova.network.neutron [req-ce84e8e5-5e39-4514-8932-a05fea7ea16e req-b9c50617-2157-48ee-b69a-3282ac7040a6 service nova] [instance: 465b35fe-8c8c-476c-97b1-feff13778cc1] Updated VIF entry in instance network info cache for port dce464f3-e0ed-4708-a833-224a83b01f86. {{(pid=74613) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 18:21:49 user nova-compute[74613]: DEBUG nova.network.neutron [req-ce84e8e5-5e39-4514-8932-a05fea7ea16e req-b9c50617-2157-48ee-b69a-3282ac7040a6 service nova] [instance: 465b35fe-8c8c-476c-97b1-feff13778cc1] Updating instance_info_cache with network_info: [{"id": "dce464f3-e0ed-4708-a833-224a83b01f86", "address": "fa:16:3e:b5:50:4e", "network": {"id": "74c4d111-4731-4d90-b6a9-a72b112d18ca", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1404505506-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "13bf1cb7deec45aea930f4a0092572d1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdce464f3-e0", "ovs_interfaceid": "dce464f3-e0ed-4708-a833-224a83b01f86", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74613) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 18:21:49 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-ce84e8e5-5e39-4514-8932-a05fea7ea16e req-b9c50617-2157-48ee-b69a-3282ac7040a6 service nova] Releasing lock "refresh_cache-465b35fe-8c8c-476c-97b1-feff13778cc1" {{(pid=74613) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 18:21:50 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:21:50 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:21:50 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:21:50 user nova-compute[74613]: DEBUG nova.compute.manager [req-ac600a96-823a-4594-a283-a6797922364d req-8b7d23b5-d708-436e-9be7-5543dbfcc45b service nova] [instance: 465b35fe-8c8c-476c-97b1-feff13778cc1] Received event network-vif-plugged-dce464f3-e0ed-4708-a833-224a83b01f86 {{(pid=74613) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 18:21:50 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-ac600a96-823a-4594-a283-a6797922364d req-8b7d23b5-d708-436e-9be7-5543dbfcc45b service nova] Acquiring lock "465b35fe-8c8c-476c-97b1-feff13778cc1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 18:21:50 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-ac600a96-823a-4594-a283-a6797922364d req-8b7d23b5-d708-436e-9be7-5543dbfcc45b service nova] Lock "465b35fe-8c8c-476c-97b1-feff13778cc1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 18:21:50 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-ac600a96-823a-4594-a283-a6797922364d req-8b7d23b5-d708-436e-9be7-5543dbfcc45b service nova] Lock "465b35fe-8c8c-476c-97b1-feff13778cc1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 18:21:50 user nova-compute[74613]: DEBUG nova.compute.manager [req-ac600a96-823a-4594-a283-a6797922364d req-8b7d23b5-d708-436e-9be7-5543dbfcc45b service nova] [instance: 465b35fe-8c8c-476c-97b1-feff13778cc1] No waiting events found dispatching network-vif-plugged-dce464f3-e0ed-4708-a833-224a83b01f86 {{(pid=74613) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 18:21:50 user nova-compute[74613]: WARNING nova.compute.manager [req-ac600a96-823a-4594-a283-a6797922364d req-8b7d23b5-d708-436e-9be7-5543dbfcc45b service nova] [instance: 465b35fe-8c8c-476c-97b1-feff13778cc1] Received unexpected event network-vif-plugged-dce464f3-e0ed-4708-a833-224a83b01f86 for instance with vm_state building and task_state spawning.
Nov 29 18:21:50 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:21:50 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:21:50 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:21:51 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:21:52 user nova-compute[74613]: DEBUG nova.compute.manager [None req-a30c959b-ed50-4b1b-aee6-ee997adb1a66 tempest-VolumesActionsTest-576062334 tempest-VolumesActionsTest-576062334-project-member] [instance: 465b35fe-8c8c-476c-97b1-feff13778cc1] Instance event wait completed in 0 seconds for  {{(pid=74613) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 29 18:21:52 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-a30c959b-ed50-4b1b-aee6-ee997adb1a66 tempest-VolumesActionsTest-576062334 tempest-VolumesActionsTest-576062334-project-member] [instance: 465b35fe-8c8c-476c-97b1-feff13778cc1] Guest created on hypervisor {{(pid=74613) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 29 18:21:52 user nova-compute[74613]: INFO nova.virt.libvirt.driver [-] [instance: 465b35fe-8c8c-476c-97b1-feff13778cc1] Instance spawned successfully.
Nov 29 18:21:52 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-a30c959b-ed50-4b1b-aee6-ee997adb1a66 tempest-VolumesActionsTest-576062334 tempest-VolumesActionsTest-576062334-project-member] [instance: 465b35fe-8c8c-476c-97b1-feff13778cc1] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74613) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 29 18:21:52 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-a30c959b-ed50-4b1b-aee6-ee997adb1a66 tempest-VolumesActionsTest-576062334 tempest-VolumesActionsTest-576062334-project-member] [instance: 465b35fe-8c8c-476c-97b1-feff13778cc1] Found default for hw_cdrom_bus of ide {{(pid=74613) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 18:21:52 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-a30c959b-ed50-4b1b-aee6-ee997adb1a66 tempest-VolumesActionsTest-576062334 tempest-VolumesActionsTest-576062334-project-member] [instance: 465b35fe-8c8c-476c-97b1-feff13778cc1] Found default for hw_disk_bus of virtio {{(pid=74613) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 18:21:52 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-a30c959b-ed50-4b1b-aee6-ee997adb1a66 tempest-VolumesActionsTest-576062334 tempest-VolumesActionsTest-576062334-project-member] [instance: 465b35fe-8c8c-476c-97b1-feff13778cc1] Found default for hw_input_bus of None {{(pid=74613) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 18:21:52 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-a30c959b-ed50-4b1b-aee6-ee997adb1a66 tempest-VolumesActionsTest-576062334 tempest-VolumesActionsTest-576062334-project-member] [instance: 465b35fe-8c8c-476c-97b1-feff13778cc1] Found default for hw_pointer_model of None {{(pid=74613) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 18:21:52 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-a30c959b-ed50-4b1b-aee6-ee997adb1a66 tempest-VolumesActionsTest-576062334 tempest-VolumesActionsTest-576062334-project-member] [instance: 465b35fe-8c8c-476c-97b1-feff13778cc1] Found default for hw_video_model of virtio {{(pid=74613) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 18:21:52 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-a30c959b-ed50-4b1b-aee6-ee997adb1a66 tempest-VolumesActionsTest-576062334 tempest-VolumesActionsTest-576062334-project-member] [instance: 465b35fe-8c8c-476c-97b1-feff13778cc1] Found default for hw_vif_model of virtio {{(pid=74613) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 18:21:52 user nova-compute[74613]: INFO nova.compute.manager [None req-a30c959b-ed50-4b1b-aee6-ee997adb1a66 tempest-VolumesActionsTest-576062334 tempest-VolumesActionsTest-576062334-project-member] [instance: 465b35fe-8c8c-476c-97b1-feff13778cc1] Took 5.37 seconds to spawn the instance on the hypervisor.
Nov 29 18:21:52 user nova-compute[74613]: DEBUG nova.compute.manager [None req-a30c959b-ed50-4b1b-aee6-ee997adb1a66 tempest-VolumesActionsTest-576062334 tempest-VolumesActionsTest-576062334-project-member] [instance: 465b35fe-8c8c-476c-97b1-feff13778cc1] Checking state {{(pid=74613) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 29 18:21:52 user nova-compute[74613]: INFO nova.compute.manager [None req-a30c959b-ed50-4b1b-aee6-ee997adb1a66 tempest-VolumesActionsTest-576062334 tempest-VolumesActionsTest-576062334-project-member] [instance: 465b35fe-8c8c-476c-97b1-feff13778cc1] Took 5.90 seconds to build instance.
Nov 29 18:21:52 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-a30c959b-ed50-4b1b-aee6-ee997adb1a66 tempest-VolumesActionsTest-576062334 tempest-VolumesActionsTest-576062334-project-member] Lock "465b35fe-8c8c-476c-97b1-feff13778cc1" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 5.991s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 18:21:52 user nova-compute[74613]: DEBUG nova.compute.manager [req-872c10cc-9c6e-4910-9c97-840accecfc35 req-171d063e-a8b8-40c4-b93f-d579d0259f38 service nova] [instance: 465b35fe-8c8c-476c-97b1-feff13778cc1] Received event network-vif-plugged-dce464f3-e0ed-4708-a833-224a83b01f86 {{(pid=74613) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 18:21:52 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-872c10cc-9c6e-4910-9c97-840accecfc35 req-171d063e-a8b8-40c4-b93f-d579d0259f38 service nova] Acquiring lock "465b35fe-8c8c-476c-97b1-feff13778cc1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 18:21:52 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-872c10cc-9c6e-4910-9c97-840accecfc35 req-171d063e-a8b8-40c4-b93f-d579d0259f38 service nova] Lock "465b35fe-8c8c-476c-97b1-feff13778cc1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 18:21:52 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-872c10cc-9c6e-4910-9c97-840accecfc35 req-171d063e-a8b8-40c4-b93f-d579d0259f38 service nova] Lock "465b35fe-8c8c-476c-97b1-feff13778cc1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 18:21:52 user nova-compute[74613]: DEBUG nova.compute.manager [req-872c10cc-9c6e-4910-9c97-840accecfc35 req-171d063e-a8b8-40c4-b93f-d579d0259f38 service nova] [instance: 465b35fe-8c8c-476c-97b1-feff13778cc1] No waiting events found dispatching network-vif-plugged-dce464f3-e0ed-4708-a833-224a83b01f86 {{(pid=74613) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 18:21:52 user nova-compute[74613]: WARNING nova.compute.manager [req-872c10cc-9c6e-4910-9c97-840accecfc35 req-171d063e-a8b8-40c4-b93f-d579d0259f38 service nova] [instance: 465b35fe-8c8c-476c-97b1-feff13778cc1] Received unexpected event network-vif-plugged-dce464f3-e0ed-4708-a833-224a83b01f86 for instance with vm_state active and task_state None.
Nov 29 18:21:53 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:21:56 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:21:56 user nova-compute[74613]: DEBUG oslo_service.periodic_task [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74613) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 18:21:58 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:22:03 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:22:06 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:22:08 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:22:11 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:22:13 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:22:16 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:22:17 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:22:18 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:22:21 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:22:23 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:22:23 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:22:28 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 18:22:28 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:22:28 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74613) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 29 18:22:28 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74613) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 18:22:28 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74613) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 18:22:28 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:22:33 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 18:22:34 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-5135448a-3e8f-4182-ae39-08738d274512 tempest-TestVolumeBootPattern-1318569205 tempest-TestVolumeBootPattern-1318569205-project-member] Acquiring lock "6d839255-e713-4234-8443-6ba0d5635a6e" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 18:22:34 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-5135448a-3e8f-4182-ae39-08738d274512 tempest-TestVolumeBootPattern-1318569205 tempest-TestVolumeBootPattern-1318569205-project-member] Lock "6d839255-e713-4234-8443-6ba0d5635a6e" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 18:22:34 user nova-compute[74613]: DEBUG nova.compute.manager [None req-5135448a-3e8f-4182-ae39-08738d274512 tempest-TestVolumeBootPattern-1318569205 tempest-TestVolumeBootPattern-1318569205-project-member] [instance: 6d839255-e713-4234-8443-6ba0d5635a6e] Starting instance... {{(pid=74613) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 29 18:22:34 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-5135448a-3e8f-4182-ae39-08738d274512 tempest-TestVolumeBootPattern-1318569205 tempest-TestVolumeBootPattern-1318569205-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 18:22:34 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-5135448a-3e8f-4182-ae39-08738d274512 tempest-TestVolumeBootPattern-1318569205 tempest-TestVolumeBootPattern-1318569205-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 18:22:34 user nova-compute[74613]: DEBUG nova.virt.hardware [None req-5135448a-3e8f-4182-ae39-08738d274512 tempest-TestVolumeBootPattern-1318569205 tempest-TestVolumeBootPattern-1318569205-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74613) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 29 18:22:34 user nova-compute[74613]: INFO nova.compute.claims [None req-5135448a-3e8f-4182-ae39-08738d274512 tempest-TestVolumeBootPattern-1318569205 tempest-TestVolumeBootPattern-1318569205-project-member] [instance: 6d839255-e713-4234-8443-6ba0d5635a6e] Claim successful on node user
Nov 29 18:22:34 user nova-compute[74613]: DEBUG nova.compute.provider_tree [None req-5135448a-3e8f-4182-ae39-08738d274512 tempest-TestVolumeBootPattern-1318569205 tempest-TestVolumeBootPattern-1318569205-project-member] Inventory has not changed in ProviderTree for provider: 639d980e-3b12-44b1-b8f4-1812416fa4dd {{(pid=74613) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 18:22:34 user nova-compute[74613]: DEBUG nova.scheduler.client.report [None req-5135448a-3e8f-4182-ae39-08738d274512 tempest-TestVolumeBootPattern-1318569205 tempest-TestVolumeBootPattern-1318569205-project-member] Inventory has not changed for provider 639d980e-3b12-44b1-b8f4-1812416fa4dd based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74613) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 18:22:34 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-5135448a-3e8f-4182-ae39-08738d274512 tempest-TestVolumeBootPattern-1318569205 tempest-TestVolumeBootPattern-1318569205-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.251s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 18:22:34 user nova-compute[74613]: DEBUG nova.compute.manager [None req-5135448a-3e8f-4182-ae39-08738d274512 tempest-TestVolumeBootPattern-1318569205 tempest-TestVolumeBootPattern-1318569205-project-member] [instance: 6d839255-e713-4234-8443-6ba0d5635a6e] Start building networks asynchronously for instance. {{(pid=74613) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 29 18:22:34 user nova-compute[74613]: DEBUG nova.compute.manager [None req-5135448a-3e8f-4182-ae39-08738d274512 tempest-TestVolumeBootPattern-1318569205 tempest-TestVolumeBootPattern-1318569205-project-member] [instance: 6d839255-e713-4234-8443-6ba0d5635a6e] Allocating IP information in the background. {{(pid=74613) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 29 18:22:34 user nova-compute[74613]: DEBUG nova.network.neutron [None req-5135448a-3e8f-4182-ae39-08738d274512 tempest-TestVolumeBootPattern-1318569205 tempest-TestVolumeBootPattern-1318569205-project-member] [instance: 6d839255-e713-4234-8443-6ba0d5635a6e] allocate_for_instance() {{(pid=74613) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 29 18:22:34 user nova-compute[74613]: INFO nova.virt.libvirt.driver [None req-5135448a-3e8f-4182-ae39-08738d274512 tempest-TestVolumeBootPattern-1318569205 tempest-TestVolumeBootPattern-1318569205-project-member] [instance: 6d839255-e713-4234-8443-6ba0d5635a6e] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 29 18:22:34 user nova-compute[74613]: DEBUG nova.compute.manager [None req-5135448a-3e8f-4182-ae39-08738d274512 tempest-TestVolumeBootPattern-1318569205 tempest-TestVolumeBootPattern-1318569205-project-member] [instance: 6d839255-e713-4234-8443-6ba0d5635a6e] Start building block device mappings for instance. {{(pid=74613) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 29 18:22:34 user nova-compute[74613]: INFO nova.virt.block_device [None req-5135448a-3e8f-4182-ae39-08738d274512 tempest-TestVolumeBootPattern-1318569205 tempest-TestVolumeBootPattern-1318569205-project-member] [instance: 6d839255-e713-4234-8443-6ba0d5635a6e] Booting with volume 6f39cfde-47c7-4b9f-83d3-13c147be6792 at /dev/vda
Nov 29 18:22:34 user nova-compute[74613]: DEBUG nova.policy [None req-5135448a-3e8f-4182-ae39-08738d274512 tempest-TestVolumeBootPattern-1318569205 tempest-TestVolumeBootPattern-1318569205-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'bedbc6ed47394e2b9125543a8b88a71f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67390f1402214191904cfbd68c3142a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74613) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 29 18:22:34 user nova-compute[74613]: DEBUG os_brick.utils [None req-5135448a-3e8f-4182-ae39-08738d274512 tempest-TestVolumeBootPattern-1318569205 tempest-TestVolumeBootPattern-1318569205-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74613) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 18:22:34 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:22:34 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:22:34 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[7dba62d0-2bbb-4edf-a514-4118104e463e]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:400972819b5\n', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 18:22:34 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:22:34 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.014s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:22:34 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ad5883f-06c8-4f02-8988-cecb9bb56c40]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 18:22:34 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:22:34 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:22:34 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[13728976-7027-409b-b6cd-e8578098e432]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 18:22:35 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6127aa7-190c-4fff-b3a4-5c0aeb5bc695]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 18:22:35 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-5135448a-3e8f-4182-ae39-08738d274512 tempest-TestVolumeBootPattern-1318569205 tempest-TestVolumeBootPattern-1318569205-project-member] Running cmd (subprocess): nvme version {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:22:35 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-5135448a-3e8f-4182-ae39-08738d274512 tempest-TestVolumeBootPattern-1318569205 tempest-TestVolumeBootPattern-1318569205-project-member] 'nvme version' failed. Not Retrying. {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 18:22:35 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.nvmeof [None req-5135448a-3e8f-4182-ae39-08738d274512 tempest-TestVolumeBootPattern-1318569205 tempest-TestVolumeBootPattern-1318569205-project-member] nvme not present on system {{(pid=74613) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 29 18:22:35 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:22:35 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 18:22:35 user nova-compute[74613]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 29 18:22:35 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a6aa61c-e854-4093-8ab3-84b379448f62]: (4, '') {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 18:22:35 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.lightos [None req-5135448a-3e8f-4182-ae39-08738d274512 tempest-TestVolumeBootPattern-1318569205 tempest-TestVolumeBootPattern-1318569205-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74613) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 29 18:22:35 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.lightos [None req-5135448a-3e8f-4182-ae39-08738d274512 tempest-TestVolumeBootPattern-1318569205 tempest-TestVolumeBootPattern-1318569205-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74613) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 29 18:22:35 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.lightos [None req-5135448a-3e8f-4182-ae39-08738d274512 tempest-TestVolumeBootPattern-1318569205 tempest-TestVolumeBootPattern-1318569205-project-member] LIGHTOS: no hostnqn found. {{(pid=74613) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 29 18:22:35 user nova-compute[74613]: DEBUG os_brick.utils [None req-5135448a-3e8f-4182-ae39-08738d274512 tempest-TestVolumeBootPattern-1318569205 tempest-TestVolumeBootPattern-1318569205-project-member] <== get_connector_properties: return (123ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:400972819b5', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74613) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 18:22:35 user nova-compute[74613]: DEBUG nova.virt.block_device [None req-5135448a-3e8f-4182-ae39-08738d274512 tempest-TestVolumeBootPattern-1318569205 tempest-TestVolumeBootPattern-1318569205-project-member] [instance: 6d839255-e713-4234-8443-6ba0d5635a6e] Updating existing volume attachment record: 1a24c130-224b-41e9-89d6-54f65a9e0495 {{(pid=74613) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 29 18:22:35 user nova-compute[74613]: DEBUG nova.network.neutron [None req-5135448a-3e8f-4182-ae39-08738d274512 tempest-TestVolumeBootPattern-1318569205 tempest-TestVolumeBootPattern-1318569205-project-member] [instance: 6d839255-e713-4234-8443-6ba0d5635a6e] Successfully created port: 4e54478e-1eb5-4ae4-8e1a-faa3738f3914 {{(pid=74613) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 29 18:22:36 user nova-compute[74613]: DEBUG nova.network.neutron [None req-5135448a-3e8f-4182-ae39-08738d274512 tempest-TestVolumeBootPattern-1318569205 tempest-TestVolumeBootPattern-1318569205-project-member] [instance: 6d839255-e713-4234-8443-6ba0d5635a6e] Successfully updated port: 4e54478e-1eb5-4ae4-8e1a-faa3738f3914 {{(pid=74613) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 29 18:22:36 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-5135448a-3e8f-4182-ae39-08738d274512 tempest-TestVolumeBootPattern-1318569205 tempest-TestVolumeBootPattern-1318569205-project-member] Acquiring lock "refresh_cache-6d839255-e713-4234-8443-6ba0d5635a6e" {{(pid=74613) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 18:22:36 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-5135448a-3e8f-4182-ae39-08738d274512 tempest-TestVolumeBootPattern-1318569205 tempest-TestVolumeBootPattern-1318569205-project-member] Acquired lock "refresh_cache-6d839255-e713-4234-8443-6ba0d5635a6e" {{(pid=74613) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 18:22:36 user nova-compute[74613]: DEBUG nova.network.neutron [None req-5135448a-3e8f-4182-ae39-08738d274512 tempest-TestVolumeBootPattern-1318569205 tempest-TestVolumeBootPattern-1318569205-project-member] [instance: 6d839255-e713-4234-8443-6ba0d5635a6e] Building network info cache for instance {{(pid=74613) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 29 18:22:36 user nova-compute[74613]: DEBUG nova.compute.manager [req-fabd63de-fcca-4a90-86bc-da2030b3fd6b req-6e00ef9d-68f2-437f-9f8d-11380aa487d1 service nova] [instance: 6d839255-e713-4234-8443-6ba0d5635a6e] Received event network-changed-4e54478e-1eb5-4ae4-8e1a-faa3738f3914 {{(pid=74613) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 18:22:36 user nova-compute[74613]: DEBUG nova.compute.manager [req-fabd63de-fcca-4a90-86bc-da2030b3fd6b req-6e00ef9d-68f2-437f-9f8d-11380aa487d1 service nova] [instance: 6d839255-e713-4234-8443-6ba0d5635a6e] Refreshing instance network info cache due to event network-changed-4e54478e-1eb5-4ae4-8e1a-faa3738f3914. {{(pid=74613) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 18:22:36 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-fabd63de-fcca-4a90-86bc-da2030b3fd6b req-6e00ef9d-68f2-437f-9f8d-11380aa487d1 service nova] Acquiring lock "refresh_cache-6d839255-e713-4234-8443-6ba0d5635a6e" {{(pid=74613) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 18:22:36 user nova-compute[74613]: DEBUG nova.network.neutron [None req-5135448a-3e8f-4182-ae39-08738d274512 tempest-TestVolumeBootPattern-1318569205 tempest-TestVolumeBootPattern-1318569205-project-member] [instance: 6d839255-e713-4234-8443-6ba0d5635a6e] Instance cache missing network info. {{(pid=74613) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 29 18:22:37 user nova-compute[74613]: DEBUG nova.network.neutron [None req-5135448a-3e8f-4182-ae39-08738d274512 tempest-TestVolumeBootPattern-1318569205 tempest-TestVolumeBootPattern-1318569205-project-member] [instance: 6d839255-e713-4234-8443-6ba0d5635a6e] Updating instance_info_cache with network_info: [{"id": "4e54478e-1eb5-4ae4-8e1a-faa3738f3914", "address": "fa:16:3e:99:af:c8", "network": {"id": "4a5179dd-d0b1-44c3-80c1-08dd7b0152f1", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1296336996-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "67390f1402214191904cfbd68c3142a7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4e54478e-1e", "ovs_interfaceid": "4e54478e-1eb5-4ae4-8e1a-faa3738f3914", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74613) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 18:22:37 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-5135448a-3e8f-4182-ae39-08738d274512 tempest-TestVolumeBootPattern-1318569205 tempest-TestVolumeBootPattern-1318569205-project-member] Releasing lock "refresh_cache-6d839255-e713-4234-8443-6ba0d5635a6e" {{(pid=74613) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 18:22:37 user nova-compute[74613]: DEBUG nova.compute.manager [None req-5135448a-3e8f-4182-ae39-08738d274512 tempest-TestVolumeBootPattern-1318569205 tempest-TestVolumeBootPattern-1318569205-project-member] [instance: 6d839255-e713-4234-8443-6ba0d5635a6e] Instance network_info: |[{"id": "4e54478e-1eb5-4ae4-8e1a-faa3738f3914", "address": "fa:16:3e:99:af:c8", "network": {"id": "4a5179dd-d0b1-44c3-80c1-08dd7b0152f1", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1296336996-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "67390f1402214191904cfbd68c3142a7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4e54478e-1e", "ovs_interfaceid": "4e54478e-1eb5-4ae4-8e1a-faa3738f3914", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74613) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 29 18:22:37 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-fabd63de-fcca-4a90-86bc-da2030b3fd6b req-6e00ef9d-68f2-437f-9f8d-11380aa487d1 service nova] Acquired lock "refresh_cache-6d839255-e713-4234-8443-6ba0d5635a6e" {{(pid=74613) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 18:22:37 user nova-compute[74613]: DEBUG nova.network.neutron [req-fabd63de-fcca-4a90-86bc-da2030b3fd6b req-6e00ef9d-68f2-437f-9f8d-11380aa487d1 service nova] [instance: 6d839255-e713-4234-8443-6ba0d5635a6e] Refreshing network info cache for port 4e54478e-1eb5-4ae4-8e1a-faa3738f3914 {{(pid=74613) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 18:22:37 user nova-compute[74613]: DEBUG nova.network.neutron [req-fabd63de-fcca-4a90-86bc-da2030b3fd6b req-6e00ef9d-68f2-437f-9f8d-11380aa487d1 service nova] [instance: 6d839255-e713-4234-8443-6ba0d5635a6e] Updated VIF entry in instance network info cache for port 4e54478e-1eb5-4ae4-8e1a-faa3738f3914. {{(pid=74613) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 18:22:37 user nova-compute[74613]: DEBUG nova.network.neutron [req-fabd63de-fcca-4a90-86bc-da2030b3fd6b req-6e00ef9d-68f2-437f-9f8d-11380aa487d1 service nova] [instance: 6d839255-e713-4234-8443-6ba0d5635a6e] Updating instance_info_cache with network_info: [{"id": "4e54478e-1eb5-4ae4-8e1a-faa3738f3914", "address": "fa:16:3e:99:af:c8", "network": {"id": "4a5179dd-d0b1-44c3-80c1-08dd7b0152f1", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1296336996-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "67390f1402214191904cfbd68c3142a7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4e54478e-1e", "ovs_interfaceid": "4e54478e-1eb5-4ae4-8e1a-faa3738f3914", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74613) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 18:22:37 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-fabd63de-fcca-4a90-86bc-da2030b3fd6b req-6e00ef9d-68f2-437f-9f8d-11380aa487d1 service nova] Releasing lock "refresh_cache-6d839255-e713-4234-8443-6ba0d5635a6e" {{(pid=74613) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 18:22:38 user nova-compute[74613]: DEBUG oslo_service.periodic_task [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74613) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 18:22:38 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 18:22:40 user nova-compute[74613]: DEBUG oslo_service.periodic_task [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74613) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 18:22:43 user nova-compute[74613]: DEBUG nova.compute.manager [None req-5135448a-3e8f-4182-ae39-08738d274512 tempest-TestVolumeBootPattern-1318569205 tempest-TestVolumeBootPattern-1318569205-project-member] [instance: 6d839255-e713-4234-8443-6ba0d5635a6e] Start spawning the instance on the hypervisor. {{(pid=74613) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 29 18:22:43 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-5135448a-3e8f-4182-ae39-08738d274512 tempest-TestVolumeBootPattern-1318569205 tempest-TestVolumeBootPattern-1318569205-project-member] [instance: 6d839255-e713-4234-8443-6ba0d5635a6e] Creating instance directory {{(pid=74613) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 29 18:22:43 user nova-compute[74613]: INFO nova.virt.libvirt.driver [None req-5135448a-3e8f-4182-ae39-08738d274512 tempest-TestVolumeBootPattern-1318569205 tempest-TestVolumeBootPattern-1318569205-project-member] [instance: 6d839255-e713-4234-8443-6ba0d5635a6e] Creating image(s)
Nov 29 18:22:43 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-5135448a-3e8f-4182-ae39-08738d274512 tempest-TestVolumeBootPattern-1318569205 tempest-TestVolumeBootPattern-1318569205-project-member] [instance: 6d839255-e713-4234-8443-6ba0d5635a6e] Did not create local disks {{(pid=74613) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 29 18:22:43 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-5135448a-3e8f-4182-ae39-08738d274512 tempest-TestVolumeBootPattern-1318569205 tempest-TestVolumeBootPattern-1318569205-project-member] [instance: 6d839255-e713-4234-8443-6ba0d5635a6e] Ensure instance console log exists: /opt/stack/data/nova/instances/6d839255-e713-4234-8443-6ba0d5635a6e/console.log {{(pid=74613) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 29 18:22:43 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-5135448a-3e8f-4182-ae39-08738d274512 tempest-TestVolumeBootPattern-1318569205 tempest-TestVolumeBootPattern-1318569205-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 18:22:43 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-5135448a-3e8f-4182-ae39-08738d274512 tempest-TestVolumeBootPattern-1318569205 tempest-TestVolumeBootPattern-1318569205-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 18:22:43 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-5135448a-3e8f-4182-ae39-08738d274512 tempest-TestVolumeBootPattern-1318569205 tempest-TestVolumeBootPattern-1318569205-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 18:22:43 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-5135448a-3e8f-4182-ae39-08738d274512 tempest-TestVolumeBootPattern-1318569205 tempest-TestVolumeBootPattern-1318569205-project-member] [instance: 6d839255-e713-4234-8443-6ba0d5635a6e] Start _get_guest_xml network_info=[{"id": "4e54478e-1eb5-4ae4-8e1a-faa3738f3914", "address": "fa:16:3e:99:af:c8", "network": {"id": "4a5179dd-d0b1-44c3-80c1-08dd7b0152f1", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1296336996-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "67390f1402214191904cfbd68c3142a7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4e54478e-1e", "ovs_interfaceid": "4e54478e-1eb5-4ae4-8e1a-faa3738f3914", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:6f39cfde-47c7-4b9f-83d3-13c147be6792', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XJWrqIuP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '6d839255-e713-4234-8443-6ba0d5635a6e', 'attached_at': '', 'detached_at': '', 'volume_id': '6f39cfde-47c7-4b9f-83d3-13c147be6792', 'serial': '6f39cfde-47c7-4b9f-83d3-13c147be6792'}, 'mount_device': '/dev/vda', 'delete_on_termination': False, 'device_type': 'disk', 'boot_index': 0, 'guest_format': None, 'attachment_id': '1a24c130-224b-41e9-89d6-54f65a9e0495', 'disk_bus': 'virtio', 'volume_type': None} {{(pid=74613) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 29 18:22:43 user nova-compute[74613]: WARNING nova.virt.libvirt.driver [None req-5135448a-3e8f-4182-ae39-08738d274512 tempest-TestVolumeBootPattern-1318569205 tempest-TestVolumeBootPattern-1318569205-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 18:22:43 user nova-compute[74613]: WARNING nova.virt.libvirt.driver [None req-5135448a-3e8f-4182-ae39-08738d274512 tempest-TestVolumeBootPattern-1318569205 tempest-TestVolumeBootPattern-1318569205-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 18:22:43 user nova-compute[74613]: DEBUG nova.virt.libvirt.host [None req-5135448a-3e8f-4182-ae39-08738d274512 tempest-TestVolumeBootPattern-1318569205 tempest-TestVolumeBootPattern-1318569205-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74613) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 29 18:22:43 user nova-compute[74613]: DEBUG nova.virt.libvirt.host [None req-5135448a-3e8f-4182-ae39-08738d274512 tempest-TestVolumeBootPattern-1318569205 tempest-TestVolumeBootPattern-1318569205-project-member] CPU controller missing on host. {{(pid=74613) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 29 18:22:43 user nova-compute[74613]: DEBUG nova.virt.libvirt.host [None req-5135448a-3e8f-4182-ae39-08738d274512 tempest-TestVolumeBootPattern-1318569205 tempest-TestVolumeBootPattern-1318569205-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74613) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 29 18:22:43 user nova-compute[74613]: DEBUG nova.virt.libvirt.host [None req-5135448a-3e8f-4182-ae39-08738d274512 tempest-TestVolumeBootPattern-1318569205 tempest-TestVolumeBootPattern-1318569205-project-member] CPU controller found on host. {{(pid=74613) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 29 18:22:43 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-5135448a-3e8f-4182-ae39-08738d274512 tempest-TestVolumeBootPattern-1318569205 tempest-TestVolumeBootPattern-1318569205-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74613) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 29 18:22:43 user nova-compute[74613]: DEBUG nova.virt.hardware [None req-5135448a-3e8f-4182-ae39-08738d274512 tempest-TestVolumeBootPattern-1318569205 tempest-TestVolumeBootPattern-1318569205-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-29T17:47:27Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74613) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 29 18:22:43 user nova-compute[74613]: DEBUG nova.virt.hardware [None req-5135448a-3e8f-4182-ae39-08738d274512 tempest-TestVolumeBootPattern-1318569205 tempest-TestVolumeBootPattern-1318569205-project-member] Flavor limits 0:0:0 {{(pid=74613) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 29 18:22:43 user nova-compute[74613]: DEBUG nova.virt.hardware [None req-5135448a-3e8f-4182-ae39-08738d274512 tempest-TestVolumeBootPattern-1318569205 tempest-TestVolumeBootPattern-1318569205-project-member] Image limits 0:0:0 {{(pid=74613) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 29 18:22:43 user nova-compute[74613]: DEBUG nova.virt.hardware [None req-5135448a-3e8f-4182-ae39-08738d274512 tempest-TestVolumeBootPattern-1318569205 tempest-TestVolumeBootPattern-1318569205-project-member] Flavor pref 0:0:0 {{(pid=74613) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 29 18:22:43 user nova-compute[74613]: DEBUG nova.virt.hardware [None req-5135448a-3e8f-4182-ae39-08738d274512 tempest-TestVolumeBootPattern-1318569205 tempest-TestVolumeBootPattern-1318569205-project-member] Image pref 0:0:0 {{(pid=74613) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 29 18:22:43 user nova-compute[74613]: DEBUG nova.virt.hardware [None req-5135448a-3e8f-4182-ae39-08738d274512 tempest-TestVolumeBootPattern-1318569205 tempest-TestVolumeBootPattern-1318569205-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74613) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 29 18:22:43 user nova-compute[74613]: DEBUG nova.virt.hardware [None req-5135448a-3e8f-4182-ae39-08738d274512 tempest-TestVolumeBootPattern-1318569205 tempest-TestVolumeBootPattern-1318569205-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74613) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 29 18:22:43 user nova-compute[74613]: DEBUG nova.virt.hardware [None req-5135448a-3e8f-4182-ae39-08738d274512 tempest-TestVolumeBootPattern-1318569205 tempest-TestVolumeBootPattern-1318569205-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74613) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 29 18:22:43 user nova-compute[74613]: DEBUG nova.virt.hardware [None req-5135448a-3e8f-4182-ae39-08738d274512 tempest-TestVolumeBootPattern-1318569205 tempest-TestVolumeBootPattern-1318569205-project-member] Got 1 possible topologies {{(pid=74613) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 29 18:22:43 user nova-compute[74613]: DEBUG nova.virt.hardware [None req-5135448a-3e8f-4182-ae39-08738d274512 tempest-TestVolumeBootPattern-1318569205 tempest-TestVolumeBootPattern-1318569205-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74613) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 29 18:22:43 user nova-compute[74613]: DEBUG nova.virt.hardware [None req-5135448a-3e8f-4182-ae39-08738d274512 tempest-TestVolumeBootPattern-1318569205 tempest-TestVolumeBootPattern-1318569205-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74613) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 29 18:22:43 user nova-compute[74613]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5135448a-3e8f-4182-ae39-08738d274512 tempest-TestVolumeBootPattern-1318569205 tempest-TestVolumeBootPattern-1318569205-project-member] [instance: 6d839255-e713-4234-8443-6ba0d5635a6e] Calling os-brick to attach iSCSI Volume {{(pid=74613) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 29 18:22:43 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-5135448a-3e8f-4182-ae39-08738d274512 tempest-TestVolumeBootPattern-1318569205 tempest-TestVolumeBootPattern-1318569205-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff828156890>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:6f39cfde-47c7-4b9f-83d3-13c147be6792', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XJWrqIuP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74613) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 18:22:43 user nova-compute[74613]: WARNING os_brick.initiator.connectors.base [None req-5135448a-3e8f-4182-ae39-08738d274512 tempest-TestVolumeBootPattern-1318569205 tempest-TestVolumeBootPattern-1318569205-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 18:22:43 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.base [None req-5135448a-3e8f-4182-ae39-08738d274512 tempest-TestVolumeBootPattern-1318569205 tempest-TestVolumeBootPattern-1318569205-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 18:22:43 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.base [None req-5135448a-3e8f-4182-ae39-08738d274512 tempest-TestVolumeBootPattern-1318569205 tempest-TestVolumeBootPattern-1318569205-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 18:22:43 user nova-compute[74613]: WARNING os_brick.initiator.connectors.base [None req-5135448a-3e8f-4182-ae39-08738d274512 tempest-TestVolumeBootPattern-1318569205 tempest-TestVolumeBootPattern-1318569205-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 18:22:43 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.base [None req-5135448a-3e8f-4182-ae39-08738d274512 tempest-TestVolumeBootPattern-1318569205 tempest-TestVolumeBootPattern-1318569205-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6f39cfde-47c7-4b9f-83d3-13c147be6792" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 18:22:43 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.base [None req-5135448a-3e8f-4182-ae39-08738d274512 tempest-TestVolumeBootPattern-1318569205 tempest-TestVolumeBootPattern-1318569205-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6f39cfde-47c7-4b9f-83d3-13c147be6792" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 18:22:43 user nova-compute[74613]: INFO os_brick.initiator.connectors.iscsi [None req-5135448a-3e8f-4182-ae39-08738d274512 tempest-TestVolumeBootPattern-1318569205 tempest-TestVolumeBootPattern-1318569205-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 29 18:22:43 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6f39cfde-47c7-4b9f-83d3-13c147be6792 -p 172.16.0.220:3260 {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:22:43 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6f39cfde-47c7-4b9f-83d3-13c147be6792 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:22:43 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[568f75aa-0bfa-4715-9cce-73b43f0e4cd7]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 18:22:43 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-5135448a-3e8f-4182-ae39-08738d274512 tempest-TestVolumeBootPattern-1318569205 tempest-TestVolumeBootPattern-1318569205-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 29 18:22:43 user nova-compute[74613]:  {{(pid=74613) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 18:22:43 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6f39cfde-47c7-4b9f-83d3-13c147be6792 -p 172.16.0.220:3260 --interface default --op new {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:22:43 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6f39cfde-47c7-4b9f-83d3-13c147be6792 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.017s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:22:43 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[235c2278-02a1-4b47-88c9-088a677087a2]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:6f39cfde-47c7-4b9f-83d3-13c147be6792] added\n', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 18:22:43 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-5135448a-3e8f-4182-ae39-08738d274512 tempest-TestVolumeBootPattern-1318569205 tempest-TestVolumeBootPattern-1318569205-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:6f39cfde-47c7-4b9f-83d3-13c147be6792] added
Nov 29 18:22:43 user nova-compute[74613]:  stderr= {{(pid=74613) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 18:22:43 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6f39cfde-47c7-4b9f-83d3-13c147be6792 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:22:43 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6f39cfde-47c7-4b9f-83d3-13c147be6792 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:22:43 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[8fd71054-f0ea-4df3-9138-657946c40940]: (4, ('', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 18:22:43 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-5135448a-3e8f-4182-ae39-08738d274512 tempest-TestVolumeBootPattern-1318569205 tempest-TestVolumeBootPattern-1318569205-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74613) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 18:22:43 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6f39cfde-47c7-4b9f-83d3-13c147be6792 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:22:43 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6f39cfde-47c7-4b9f-83d3-13c147be6792 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:22:43 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[f883b67c-3862-4c7e-a229-88678f58e27c]: (4, ('', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 18:22:43 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-5135448a-3e8f-4182-ae39-08738d274512 tempest-TestVolumeBootPattern-1318569205 tempest-TestVolumeBootPattern-1318569205-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74613) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 18:22:43 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6f39cfde-47c7-4b9f-83d3-13c147be6792 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v XJWrqIuP {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:22:43 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6f39cfde-47c7-4b9f-83d3-13c147be6792 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v XJWrqIuP" returned: 0 in 0.018s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:22:43 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[f909139e-2f93-43e0-aacd-3ddc82826ce3]: (4, ('', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 18:22:43 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-5135448a-3e8f-4182-ae39-08738d274512 tempest-TestVolumeBootPattern-1318569205 tempest-TestVolumeBootPattern-1318569205-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'XJWrqIuP'): stdout= stderr= {{(pid=74613) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 18:22:43 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6f39cfde-47c7-4b9f-83d3-13c147be6792 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:22:43 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6f39cfde-47c7-4b9f-83d3-13c147be6792 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.016s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:22:43 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[546a24cd-0733-4468-a711-ede3bb26e0ec]: (4, ('', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 18:22:43 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-5135448a-3e8f-4182-ae39-08738d274512 tempest-TestVolumeBootPattern-1318569205 tempest-TestVolumeBootPattern-1318569205-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74613) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 18:22:43 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:22:43 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.016s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:22:43 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[2367ba76-198b-4bcc-a681-840aaed46f5e]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 18:22:43 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-5135448a-3e8f-4182-ae39-08738d274512 tempest-TestVolumeBootPattern-1318569205 tempest-TestVolumeBootPattern-1318569205-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Nov 29 18:22:43 user nova-compute[74613]:  {{(pid=74613) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 18:22:43 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-5135448a-3e8f-4182-ae39-08738d274512 tempest-TestVolumeBootPattern-1318569205 tempest-TestVolumeBootPattern-1318569205-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Nov 29 18:22:43 user nova-compute[74613]:  {{(pid=74613) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 18:22:43 user nova-compute[74613]: WARNING os_brick.initiator.connectors.iscsi [None req-5135448a-3e8f-4182-ae39-08738d274512 tempest-TestVolumeBootPattern-1318569205 tempest-TestVolumeBootPattern-1318569205-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Nov 29 18:22:43 user nova-compute[74613]: 
Nov 29 18:22:43 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6f39cfde-47c7-4b9f-83d3-13c147be6792 -p 172.16.0.220:3260 --login {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:22:43 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6f39cfde-47c7-4b9f-83d3-13c147be6792 -p 172.16.0.220:3260 --login" returned: 0 in 0.057s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:22:43 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[3203c996-68c1-42f6-9e09-67b708a01992]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:6f39cfde-47c7-4b9f-83d3-13c147be6792, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:6f39cfde-47c7-4b9f-83d3-13c147be6792, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 18:22:43 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-5135448a-3e8f-4182-ae39-08738d274512 tempest-TestVolumeBootPattern-1318569205 tempest-TestVolumeBootPattern-1318569205-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:6f39cfde-47c7-4b9f-83d3-13c147be6792, portal: 172.16.0.220,3260]
Nov 29 18:22:43 user nova-compute[74613]: Login to [iface: default, target: iqn.2010-10.org.openstack:6f39cfde-47c7-4b9f-83d3-13c147be6792, portal: 172.16.0.220,3260] successful.
Nov 29 18:22:43 user nova-compute[74613]:  stderr= {{(pid=74613) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 18:22:43 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6f39cfde-47c7-4b9f-83d3-13c147be6792 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:22:43 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6f39cfde-47c7-4b9f-83d3-13c147be6792 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:22:43 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b1b8180-1eaa-409f-bd81-9481440425da]: (4, ('', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 18:22:43 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-5135448a-3e8f-4182-ae39-08738d274512 tempest-TestVolumeBootPattern-1318569205 tempest-TestVolumeBootPattern-1318569205-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74613) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 18:22:43 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:22:43 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:22:43 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc604d98-67fd-4891-b46a-d6f4664b91d6]: (4, ('tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f39cfde-47c7-4b9f-83d3-13c147be6792 (non-flash)\n', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 18:22:43 user nova-compute[74613]: DEBUG oslo_service.periodic_task [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74613) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 18:22:43 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-5135448a-3e8f-4182-ae39-08738d274512 tempest-TestVolumeBootPattern-1318569205 tempest-TestVolumeBootPattern-1318569205-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f39cfde-47c7-4b9f-83d3-13c147be6792 (non-flash)
Nov 29 18:22:43 user nova-compute[74613]:  stderr= {{(pid=74613) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 18:22:43 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-5135448a-3e8f-4182-ae39-08738d274512 tempest-TestVolumeBootPattern-1318569205 tempest-TestVolumeBootPattern-1318569205-project-member] iscsi session list stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f39cfde-47c7-4b9f-83d3-13c147be6792 (non-flash)
Nov 29 18:22:43 user nova-compute[74613]:  stderr= {{(pid=74613) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 18:22:43 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.base [None req-5135448a-3e8f-4182-ae39-08738d274512 tempest-TestVolumeBootPattern-1318569205 tempest-TestVolumeBootPattern-1318569205-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6f39cfde-47c7-4b9f-83d3-13c147be6792" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.262s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 18:22:43 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-5135448a-3e8f-4182-ae39-08738d274512 tempest-TestVolumeBootPattern-1318569205 tempest-TestVolumeBootPattern-1318569205-project-member] Connected to 172.16.0.220:3260 {{(pid=74613) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 29 18:22:43 user nova-compute[74613]: DEBUG os_brick.initiator.linuxscsi [None req-5135448a-3e8f-4182-ae39-08738d274512 tempest-TestVolumeBootPattern-1318569205 tempest-TestVolumeBootPattern-1318569205-project-member] HCTL ('33', '-', '-', 0) found on session 50 with lun 0 {{(pid=74613) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 29 18:22:43 user nova-compute[74613]: DEBUG os_brick.initiator.linuxscsi [None req-5135448a-3e8f-4182-ae39-08738d274512 tempest-TestVolumeBootPattern-1318569205 tempest-TestVolumeBootPattern-1318569205-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74613) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 29 18:22:43 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:22:43 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.018s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:22:43 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[ccbd0722-6fed-488d-b8c8-0f611cfcbfb0]: (4, ('- - 0', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 18:22:43 user nova-compute[74613]: DEBUG os_brick.initiator.linuxscsi [None req-5135448a-3e8f-4182-ae39-08738d274512 tempest-TestVolumeBootPattern-1318569205 tempest-TestVolumeBootPattern-1318569205-project-member] Searching for a device in session 50 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74613) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 29 18:22:43 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-5135448a-3e8f-4182-ae39-08738d274512 tempest-TestVolumeBootPattern-1318569205 tempest-TestVolumeBootPattern-1318569205-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:6f39cfde-47c7-4b9f-83d3-13c147be6792', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XJWrqIuP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74613) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 29 18:22:43 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 18:22:43 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 18:22:43 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74613) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 29 18:22:43 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74613) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 18:22:43 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74613) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 18:22:43 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:22:44 user nova-compute[74613]: DEBUG oslo_service.periodic_task [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74613) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 18:22:44 user nova-compute[74613]: DEBUG oslo_service.periodic_task [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74613) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 18:22:44 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 18:22:44 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 18:22:44 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 18:22:44 user nova-compute[74613]: DEBUG nova.compute.resource_tracker [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Auditing locally available compute resources for user (node: user) {{(pid=74613) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 29 18:22:44 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.base [None req-5135448a-3e8f-4182-ae39-08738d274512 tempest-TestVolumeBootPattern-1318569205 tempest-TestVolumeBootPattern-1318569205-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.302s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 18:22:44 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-5135448a-3e8f-4182-ae39-08738d274512 tempest-TestVolumeBootPattern-1318569205 tempest-TestVolumeBootPattern-1318569205-project-member] <== connect_volume: return (1304ms) {'type': 'block', 'scsi_wwn': '26633323734326238', 'path': '/dev/sdb'} {{(pid=74613) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 18:22:44 user nova-compute[74613]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5135448a-3e8f-4182-ae39-08738d274512 tempest-TestVolumeBootPattern-1318569205 tempest-TestVolumeBootPattern-1318569205-project-member] [instance: 6d839255-e713-4234-8443-6ba0d5635a6e] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26633323734326238', 'path': '/dev/sdb'} {{(pid=74613) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 29 18:22:44 user nova-compute[74613]: DEBUG nova.virt.libvirt.vif [None req-5135448a-3e8f-4182-ae39-08738d274512 tempest-TestVolumeBootPattern-1318569205 tempest-TestVolumeBootPattern-1318569205-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T18:22:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-8068559',display_name='tempest-TestVolumeBootPattern-server-8068559',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-8068559',id=46,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBF68W8p1zDe0zv1nt+x55p88jNtkp+KefAo7j9aGY4lI4rRNz+cx5GFQLxMQlgNyvRcFIVQErVtli+AYTX2wE/wzDsGd1AkTeB1AuDgBox6TZ+l5dYZcMLLtIJDQcAEEBg==',key_name='tempest-TestVolumeBootPattern-792688502',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='67390f1402214191904cfbd68c3142a7',ramdisk_id='',reservation_id='r-1z0h3gcd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1318569205',owner_user_name='tempest-TestVolumeBootPattern-1318569205-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T18:22:35Z,user_data=None,user_id='bedbc6ed47394e2b9125543a8b88a71f',uuid=6d839255-e713-4234-8443-6ba0d5635a6e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4e54478e-1eb5-4ae4-8e1a-faa3738f3914", "address": "fa:16:3e:99:af:c8", "network": {"id": "4a5179dd-d0b1-44c3-80c1-08dd7b0152f1", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1296336996-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "67390f1402214191904cfbd68c3142a7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4e54478e-1e", "ovs_interfaceid": "4e54478e-1eb5-4ae4-8e1a-faa3738f3914", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74613) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 29 18:22:44 user nova-compute[74613]: DEBUG nova.network.os_vif_util [None req-5135448a-3e8f-4182-ae39-08738d274512 tempest-TestVolumeBootPattern-1318569205 tempest-TestVolumeBootPattern-1318569205-project-member] Converting VIF {"id": "4e54478e-1eb5-4ae4-8e1a-faa3738f3914", "address": "fa:16:3e:99:af:c8", "network": {"id": "4a5179dd-d0b1-44c3-80c1-08dd7b0152f1", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1296336996-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "67390f1402214191904cfbd68c3142a7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4e54478e-1e", "ovs_interfaceid": "4e54478e-1eb5-4ae4-8e1a-faa3738f3914", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74613) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 18:22:44 user nova-compute[74613]: DEBUG nova.network.os_vif_util [None req-5135448a-3e8f-4182-ae39-08738d274512 tempest-TestVolumeBootPattern-1318569205 tempest-TestVolumeBootPattern-1318569205-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:99:af:c8,bridge_name='br-int',has_traffic_filtering=True,id=4e54478e-1eb5-4ae4-8e1a-faa3738f3914,network=Network(4a5179dd-d0b1-44c3-80c1-08dd7b0152f1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4e54478e-1e') {{(pid=74613) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 18:22:44 user nova-compute[74613]: DEBUG nova.objects.instance [None req-5135448a-3e8f-4182-ae39-08738d274512 tempest-TestVolumeBootPattern-1318569205 tempest-TestVolumeBootPattern-1318569205-project-member] Lazy-loading 'pci_devices' on Instance uuid 6d839255-e713-4234-8443-6ba0d5635a6e {{(pid=74613) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 18:22:44 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-5135448a-3e8f-4182-ae39-08738d274512 tempest-TestVolumeBootPattern-1318569205 tempest-TestVolumeBootPattern-1318569205-project-member] [instance: 6d839255-e713-4234-8443-6ba0d5635a6e] End _get_guest_xml xml=<domain type="kvm">
Nov 29 18:22:44 user nova-compute[74613]:   <uuid>6d839255-e713-4234-8443-6ba0d5635a6e</uuid>
Nov 29 18:22:44 user nova-compute[74613]:   <name>instance-0000002e</name>
Nov 29 18:22:44 user nova-compute[74613]:   <memory>524288</memory>
Nov 29 18:22:44 user nova-compute[74613]:   <vcpu>1</vcpu>
Nov 29 18:22:44 user nova-compute[74613]:   <metadata>
Nov 29 18:22:44 user nova-compute[74613]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 29 18:22:44 user nova-compute[74613]:       <nova:package version="0.0.0"/>
Nov 29 18:22:44 user nova-compute[74613]:       <nova:name>tempest-TestVolumeBootPattern-server-8068559</nova:name>
Nov 29 18:22:44 user nova-compute[74613]:       <nova:creationTime>2023-11-29 18:22:43</nova:creationTime>
Nov 29 18:22:44 user nova-compute[74613]:       <nova:flavor name="m1.tiny">
Nov 29 18:22:44 user nova-compute[74613]:         <nova:memory>512</nova:memory>
Nov 29 18:22:44 user nova-compute[74613]:         <nova:disk>1</nova:disk>
Nov 29 18:22:44 user nova-compute[74613]:         <nova:swap>0</nova:swap>
Nov 29 18:22:44 user nova-compute[74613]:         <nova:ephemeral>0</nova:ephemeral>
Nov 29 18:22:44 user nova-compute[74613]:         <nova:vcpus>1</nova:vcpus>
Nov 29 18:22:44 user nova-compute[74613]:       </nova:flavor>
Nov 29 18:22:44 user nova-compute[74613]:       <nova:owner>
Nov 29 18:22:44 user nova-compute[74613]:         <nova:user uuid="bedbc6ed47394e2b9125543a8b88a71f">tempest-TestVolumeBootPattern-1318569205-project-member</nova:user>
Nov 29 18:22:44 user nova-compute[74613]:         <nova:project uuid="67390f1402214191904cfbd68c3142a7">tempest-TestVolumeBootPattern-1318569205</nova:project>
Nov 29 18:22:44 user nova-compute[74613]:       </nova:owner>
Nov 29 18:22:44 user nova-compute[74613]:       <nova:ports>
Nov 29 18:22:44 user nova-compute[74613]:         <nova:port uuid="4e54478e-1eb5-4ae4-8e1a-faa3738f3914">
Nov 29 18:22:44 user nova-compute[74613]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Nov 29 18:22:44 user nova-compute[74613]:         </nova:port>
Nov 29 18:22:44 user nova-compute[74613]:       </nova:ports>
Nov 29 18:22:44 user nova-compute[74613]:     </nova:instance>
Nov 29 18:22:44 user nova-compute[74613]:   </metadata>
Nov 29 18:22:44 user nova-compute[74613]:   <sysinfo type="smbios">
Nov 29 18:22:44 user nova-compute[74613]:     <system>
Nov 29 18:22:44 user nova-compute[74613]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 29 18:22:44 user nova-compute[74613]:       <entry name="product">OpenStack Nova</entry>
Nov 29 18:22:44 user nova-compute[74613]:       <entry name="version">0.0.0</entry>
Nov 29 18:22:44 user nova-compute[74613]:       <entry name="serial">6d839255-e713-4234-8443-6ba0d5635a6e</entry>
Nov 29 18:22:44 user nova-compute[74613]:       <entry name="uuid">6d839255-e713-4234-8443-6ba0d5635a6e</entry>
Nov 29 18:22:44 user nova-compute[74613]:       <entry name="family">Virtual Machine</entry>
Nov 29 18:22:44 user nova-compute[74613]:     </system>
Nov 29 18:22:44 user nova-compute[74613]:   </sysinfo>
Nov 29 18:22:44 user nova-compute[74613]:   <os>
Nov 29 18:22:44 user nova-compute[74613]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 29 18:22:44 user nova-compute[74613]:     <boot dev="hd"/>
Nov 29 18:22:44 user nova-compute[74613]:     <smbios mode="sysinfo"/>
Nov 29 18:22:44 user nova-compute[74613]:   </os>
Nov 29 18:22:44 user nova-compute[74613]:   <features>
Nov 29 18:22:44 user nova-compute[74613]:     <acpi/>
Nov 29 18:22:44 user nova-compute[74613]:     <apic/>
Nov 29 18:22:44 user nova-compute[74613]:     <vmcoreinfo/>
Nov 29 18:22:44 user nova-compute[74613]:   </features>
Nov 29 18:22:44 user nova-compute[74613]:   <clock offset="utc">
Nov 29 18:22:44 user nova-compute[74613]:     <timer name="pit" tickpolicy="delay"/>
Nov 29 18:22:44 user nova-compute[74613]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 29 18:22:44 user nova-compute[74613]:     <timer name="hpet" present="no"/>
Nov 29 18:22:44 user nova-compute[74613]:   </clock>
Nov 29 18:22:44 user nova-compute[74613]:   <cpu mode="custom" match="exact">
Nov 29 18:22:44 user nova-compute[74613]:     <model>Nehalem</model>
Nov 29 18:22:44 user nova-compute[74613]:     <topology sockets="1" cores="1" threads="1"/>
Nov 29 18:22:44 user nova-compute[74613]:   </cpu>
Nov 29 18:22:44 user nova-compute[74613]:   <devices>
Nov 29 18:22:44 user nova-compute[74613]:     <disk type="block" device="disk">
Nov 29 18:22:44 user nova-compute[74613]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 18:22:44 user nova-compute[74613]:       <source dev="/dev/sdb"/>
Nov 29 18:22:44 user nova-compute[74613]:       <target dev="vda" bus="virtio"/>
Nov 29 18:22:44 user nova-compute[74613]:       <serial>6f39cfde-47c7-4b9f-83d3-13c147be6792</serial>
Nov 29 18:22:44 user nova-compute[74613]:     </disk>
Nov 29 18:22:44 user nova-compute[74613]:     <interface type="ethernet">
Nov 29 18:22:44 user nova-compute[74613]:       <mac address="fa:16:3e:99:af:c8"/>
Nov 29 18:22:44 user nova-compute[74613]:       <model type="virtio"/>
Nov 29 18:22:44 user nova-compute[74613]:       <mtu size="1442"/>
Nov 29 18:22:44 user nova-compute[74613]:       <target dev="tap4e54478e-1e"/>
Nov 29 18:22:44 user nova-compute[74613]:     </interface>
Nov 29 18:22:44 user nova-compute[74613]:     <serial type="pty">
Nov 29 18:22:44 user nova-compute[74613]:       <log file="/opt/stack/data/nova/instances/6d839255-e713-4234-8443-6ba0d5635a6e/console.log" append="off"/>
Nov 29 18:22:44 user nova-compute[74613]:     </serial>
Nov 29 18:22:44 user nova-compute[74613]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 29 18:22:44 user nova-compute[74613]:     <video>
Nov 29 18:22:44 user nova-compute[74613]:       <model type="virtio"/>
Nov 29 18:22:44 user nova-compute[74613]:     </video>
Nov 29 18:22:44 user nova-compute[74613]:     <rng model="virtio">
Nov 29 18:22:44 user nova-compute[74613]:       <backend model="random">/dev/urandom</backend>
Nov 29 18:22:44 user nova-compute[74613]:     </rng>
Nov 29 18:22:44 user nova-compute[74613]:     <controller type="usb" index="0" model="none"/>
Nov 29 18:22:44 user nova-compute[74613]:     <memballoon model="virtio">
Nov 29 18:22:44 user nova-compute[74613]:       <stats period="10"/>
Nov 29 18:22:44 user nova-compute[74613]:     </memballoon>
Nov 29 18:22:44 user nova-compute[74613]:   </devices>
Nov 29 18:22:44 user nova-compute[74613]: </domain>
Nov 29 18:22:44 user nova-compute[74613]:  {{(pid=74613) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 29 18:22:44 user nova-compute[74613]: DEBUG nova.virt.libvirt.vif [None req-5135448a-3e8f-4182-ae39-08738d274512 tempest-TestVolumeBootPattern-1318569205 tempest-TestVolumeBootPattern-1318569205-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T18:22:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-8068559',display_name='tempest-TestVolumeBootPattern-server-8068559',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-8068559',id=46,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBF68W8p1zDe0zv1nt+x55p88jNtkp+KefAo7j9aGY4lI4rRNz+cx5GFQLxMQlgNyvRcFIVQErVtli+AYTX2wE/wzDsGd1AkTeB1AuDgBox6TZ+l5dYZcMLLtIJDQcAEEBg==',key_name='tempest-TestVolumeBootPattern-792688502',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='67390f1402214191904cfbd68c3142a7',ramdisk_id='',reservation_id='r-1z0h3gcd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1318569205',owner_user_name='tempest-TestVolumeBootPattern-1318569205-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T18:22:35Z,user_data=None,user_id='bedbc6ed47394e2b9125543a8b88a71f',uuid=6d839255-e713-4234-8443-6ba0d5635a6e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4e54478e-1eb5-4ae4-8e1a-faa3738f3914", "address": "fa:16:3e:99:af:c8", "network": {"id": "4a5179dd-d0b1-44c3-80c1-08dd7b0152f1", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1296336996-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "67390f1402214191904cfbd68c3142a7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4e54478e-1e", "ovs_interfaceid": "4e54478e-1eb5-4ae4-8e1a-faa3738f3914", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74613) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 29 18:22:44 user nova-compute[74613]: DEBUG nova.network.os_vif_util [None req-5135448a-3e8f-4182-ae39-08738d274512 tempest-TestVolumeBootPattern-1318569205 tempest-TestVolumeBootPattern-1318569205-project-member] Converting VIF {"id": "4e54478e-1eb5-4ae4-8e1a-faa3738f3914", "address": "fa:16:3e:99:af:c8", "network": {"id": "4a5179dd-d0b1-44c3-80c1-08dd7b0152f1", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1296336996-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "67390f1402214191904cfbd68c3142a7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4e54478e-1e", "ovs_interfaceid": "4e54478e-1eb5-4ae4-8e1a-faa3738f3914", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74613) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 18:22:44 user nova-compute[74613]: DEBUG nova.network.os_vif_util [None req-5135448a-3e8f-4182-ae39-08738d274512 tempest-TestVolumeBootPattern-1318569205 tempest-TestVolumeBootPattern-1318569205-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:99:af:c8,bridge_name='br-int',has_traffic_filtering=True,id=4e54478e-1eb5-4ae4-8e1a-faa3738f3914,network=Network(4a5179dd-d0b1-44c3-80c1-08dd7b0152f1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4e54478e-1e') {{(pid=74613) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 18:22:44 user nova-compute[74613]: DEBUG os_vif [None req-5135448a-3e8f-4182-ae39-08738d274512 tempest-TestVolumeBootPattern-1318569205 tempest-TestVolumeBootPattern-1318569205-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:99:af:c8,bridge_name='br-int',has_traffic_filtering=True,id=4e54478e-1eb5-4ae4-8e1a-faa3738f3914,network=Network(4a5179dd-d0b1-44c3-80c1-08dd7b0152f1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4e54478e-1e') {{(pid=74613) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 29 18:22:44 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:22:44 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74613) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 18:22:44 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74613) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 29 18:22:44 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:22:44 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '2518042f-4692-598f-8118-abe386473729', '_type': 'linux-noop'}}, row=False) {{(pid=74613) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 18:22:44 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:22:44 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 18:22:44 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:22:44 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap4e54478e-1e, may_exist=True, interface_attrs={}) {{(pid=74613) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 18:22:44 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap4e54478e-1e, col_values=(('qos', UUID('0276985a-0843-42c5-8962-dcf8f9694a4d')),), if_exists=True) {{(pid=74613) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 18:22:44 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap4e54478e-1e, col_values=(('external_ids', {'iface-id': '4e54478e-1eb5-4ae4-8e1a-faa3738f3914', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:99:af:c8', 'vm-uuid': '6d839255-e713-4234-8443-6ba0d5635a6e'}),), if_exists=True) {{(pid=74613) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 18:22:44 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:22:44 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 18:22:44 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:22:44 user nova-compute[74613]: INFO os_vif [None req-5135448a-3e8f-4182-ae39-08738d274512 tempest-TestVolumeBootPattern-1318569205 tempest-TestVolumeBootPattern-1318569205-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:99:af:c8,bridge_name='br-int',has_traffic_filtering=True,id=4e54478e-1eb5-4ae4-8e1a-faa3738f3914,network=Network(4a5179dd-d0b1-44c3-80c1-08dd7b0152f1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4e54478e-1e')
Nov 29 18:22:44 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5227902d-b2b9-40a6-988f-3c02c52404f3/disk --force-share --output=json {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:22:44 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-5135448a-3e8f-4182-ae39-08738d274512 tempest-TestVolumeBootPattern-1318569205 tempest-TestVolumeBootPattern-1318569205-project-member] No BDM found with device name vda, not building metadata. {{(pid=74613) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 18:22:44 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-5135448a-3e8f-4182-ae39-08738d274512 tempest-TestVolumeBootPattern-1318569205 tempest-TestVolumeBootPattern-1318569205-project-member] No VIF found with MAC fa:16:3e:99:af:c8, not building metadata {{(pid=74613) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 29 18:22:44 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5227902d-b2b9-40a6-988f-3c02c52404f3/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:22:44 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5227902d-b2b9-40a6-988f-3c02c52404f3/disk --force-share --output=json {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:22:45 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5227902d-b2b9-40a6-988f-3c02c52404f3/disk --force-share --output=json" returned: 0 in 0.231s {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:22:45 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/465b35fe-8c8c-476c-97b1-feff13778cc1/disk --force-share --output=json {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:22:45 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/465b35fe-8c8c-476c-97b1-feff13778cc1/disk --force-share --output=json" returned: 0 in 0.205s {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:22:45 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/465b35fe-8c8c-476c-97b1-feff13778cc1/disk --force-share --output=json {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:22:45 user nova-compute[74613]: DEBUG nova.compute.manager [req-cdae2eae-eb2f-404e-a2f5-3f7e5b7c112a req-b095827d-6a00-4ddd-8e92-fedc3f70e65d service nova] [instance: 5227902d-b2b9-40a6-988f-3c02c52404f3] Received event network-changed-11900168-d650-4db6-8f65-21f1f9c4b603 {{(pid=74613) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 18:22:45 user nova-compute[74613]: DEBUG nova.compute.manager [req-cdae2eae-eb2f-404e-a2f5-3f7e5b7c112a req-b095827d-6a00-4ddd-8e92-fedc3f70e65d service nova] [instance: 5227902d-b2b9-40a6-988f-3c02c52404f3] Refreshing instance network info cache due to event network-changed-11900168-d650-4db6-8f65-21f1f9c4b603. {{(pid=74613) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 18:22:45 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-cdae2eae-eb2f-404e-a2f5-3f7e5b7c112a req-b095827d-6a00-4ddd-8e92-fedc3f70e65d service nova] Acquiring lock "refresh_cache-5227902d-b2b9-40a6-988f-3c02c52404f3" {{(pid=74613) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 18:22:45 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-cdae2eae-eb2f-404e-a2f5-3f7e5b7c112a req-b095827d-6a00-4ddd-8e92-fedc3f70e65d service nova] Acquired lock "refresh_cache-5227902d-b2b9-40a6-988f-3c02c52404f3" {{(pid=74613) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 18:22:45 user nova-compute[74613]: DEBUG nova.network.neutron [req-cdae2eae-eb2f-404e-a2f5-3f7e5b7c112a req-b095827d-6a00-4ddd-8e92-fedc3f70e65d service nova] [instance: 5227902d-b2b9-40a6-988f-3c02c52404f3] Refreshing network info cache for port 11900168-d650-4db6-8f65-21f1f9c4b603 {{(pid=74613) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 18:22:45 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/465b35fe-8c8c-476c-97b1-feff13778cc1/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:22:48 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:22:48 user nova-compute[74613]: DEBUG nova.compute.manager [None req-5135448a-3e8f-4182-ae39-08738d274512 tempest-TestVolumeBootPattern-1318569205 tempest-TestVolumeBootPattern-1318569205-project-member] [instance: 6d839255-e713-4234-8443-6ba0d5635a6e] Instance event wait completed in 0 seconds for  {{(pid=74613) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 29 18:22:48 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-5135448a-3e8f-4182-ae39-08738d274512 tempest-TestVolumeBootPattern-1318569205 tempest-TestVolumeBootPattern-1318569205-project-member] [instance: 6d839255-e713-4234-8443-6ba0d5635a6e] Guest created on hypervisor {{(pid=74613) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 29 18:22:48 user nova-compute[74613]: DEBUG nova.compute.manager [req-3a93abf2-614e-420e-b0d3-949597330f26 req-06c29a2a-a2a1-41e2-bbcd-90c1453f14ef service nova] [instance: 6d839255-e713-4234-8443-6ba0d5635a6e] Received event network-vif-plugged-4e54478e-1eb5-4ae4-8e1a-faa3738f3914 {{(pid=74613) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 18:22:48 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-3a93abf2-614e-420e-b0d3-949597330f26 req-06c29a2a-a2a1-41e2-bbcd-90c1453f14ef service nova] Acquiring lock "6d839255-e713-4234-8443-6ba0d5635a6e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 18:22:48 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-3a93abf2-614e-420e-b0d3-949597330f26 req-06c29a2a-a2a1-41e2-bbcd-90c1453f14ef service nova] Lock "6d839255-e713-4234-8443-6ba0d5635a6e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 18:22:48 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-3a93abf2-614e-420e-b0d3-949597330f26 req-06c29a2a-a2a1-41e2-bbcd-90c1453f14ef service nova] Lock "6d839255-e713-4234-8443-6ba0d5635a6e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 18:22:48 user nova-compute[74613]: DEBUG nova.compute.manager [req-3a93abf2-614e-420e-b0d3-949597330f26 req-06c29a2a-a2a1-41e2-bbcd-90c1453f14ef service nova] [instance: 6d839255-e713-4234-8443-6ba0d5635a6e] No waiting events found dispatching network-vif-plugged-4e54478e-1eb5-4ae4-8e1a-faa3738f3914 {{(pid=74613) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 18:22:48 user nova-compute[74613]: WARNING nova.compute.manager [req-3a93abf2-614e-420e-b0d3-949597330f26 req-06c29a2a-a2a1-41e2-bbcd-90c1453f14ef service nova] [instance: 6d839255-e713-4234-8443-6ba0d5635a6e] Received unexpected event network-vif-plugged-4e54478e-1eb5-4ae4-8e1a-faa3738f3914 for instance with vm_state building and task_state spawning.
Nov 29 18:22:48 user nova-compute[74613]: DEBUG nova.compute.manager [req-3a93abf2-614e-420e-b0d3-949597330f26 req-06c29a2a-a2a1-41e2-bbcd-90c1453f14ef service nova] [instance: 6d839255-e713-4234-8443-6ba0d5635a6e] Received event network-vif-plugged-4e54478e-1eb5-4ae4-8e1a-faa3738f3914 {{(pid=74613) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 18:22:48 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-3a93abf2-614e-420e-b0d3-949597330f26 req-06c29a2a-a2a1-41e2-bbcd-90c1453f14ef service nova] Acquiring lock "6d839255-e713-4234-8443-6ba0d5635a6e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 18:22:48 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-3a93abf2-614e-420e-b0d3-949597330f26 req-06c29a2a-a2a1-41e2-bbcd-90c1453f14ef service nova] Lock "6d839255-e713-4234-8443-6ba0d5635a6e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 18:22:48 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-3a93abf2-614e-420e-b0d3-949597330f26 req-06c29a2a-a2a1-41e2-bbcd-90c1453f14ef service nova] Lock "6d839255-e713-4234-8443-6ba0d5635a6e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 18:22:48 user nova-compute[74613]: DEBUG nova.compute.manager [req-3a93abf2-614e-420e-b0d3-949597330f26 req-06c29a2a-a2a1-41e2-bbcd-90c1453f14ef service nova] [instance: 6d839255-e713-4234-8443-6ba0d5635a6e] No waiting events found dispatching network-vif-plugged-4e54478e-1eb5-4ae4-8e1a-faa3738f3914 {{(pid=74613) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 18:22:48 user nova-compute[74613]: WARNING nova.compute.manager [req-3a93abf2-614e-420e-b0d3-949597330f26 req-06c29a2a-a2a1-41e2-bbcd-90c1453f14ef service nova] [instance: 6d839255-e713-4234-8443-6ba0d5635a6e] Received unexpected event network-vif-plugged-4e54478e-1eb5-4ae4-8e1a-faa3738f3914 for instance with vm_state building and task_state spawning.
Nov 29 18:22:48 user nova-compute[74613]: WARNING nova.virt.libvirt.driver [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 18:22:48 user nova-compute[74613]: WARNING nova.virt.libvirt.driver [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 18:22:48 user nova-compute[74613]: DEBUG nova.compute.resource_tracker [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Hypervisor/Node resource view: name=user free_ram=8720MB free_disk=24.900775909423828GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74613) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 29 18:22:48 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 18:22:48 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 18:22:48 user nova-compute[74613]: INFO nova.virt.libvirt.driver [-] [instance: 6d839255-e713-4234-8443-6ba0d5635a6e] Instance spawned successfully.
Nov 29 18:22:48 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-5135448a-3e8f-4182-ae39-08738d274512 tempest-TestVolumeBootPattern-1318569205 tempest-TestVolumeBootPattern-1318569205-project-member] [instance: 6d839255-e713-4234-8443-6ba0d5635a6e] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74613) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 29 18:22:48 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-5135448a-3e8f-4182-ae39-08738d274512 tempest-TestVolumeBootPattern-1318569205 tempest-TestVolumeBootPattern-1318569205-project-member] [instance: 6d839255-e713-4234-8443-6ba0d5635a6e] Found default for hw_cdrom_bus of ide {{(pid=74613) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 18:22:48 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-5135448a-3e8f-4182-ae39-08738d274512 tempest-TestVolumeBootPattern-1318569205 tempest-TestVolumeBootPattern-1318569205-project-member] [instance: 6d839255-e713-4234-8443-6ba0d5635a6e] Found default for hw_disk_bus of virtio {{(pid=74613) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 18:22:48 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-5135448a-3e8f-4182-ae39-08738d274512 tempest-TestVolumeBootPattern-1318569205 tempest-TestVolumeBootPattern-1318569205-project-member] [instance: 6d839255-e713-4234-8443-6ba0d5635a6e] Found default for hw_input_bus of None {{(pid=74613) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 18:22:48 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-5135448a-3e8f-4182-ae39-08738d274512 tempest-TestVolumeBootPattern-1318569205 tempest-TestVolumeBootPattern-1318569205-project-member] [instance: 6d839255-e713-4234-8443-6ba0d5635a6e] Found default for hw_pointer_model of None {{(pid=74613) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 18:22:48 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-5135448a-3e8f-4182-ae39-08738d274512 tempest-TestVolumeBootPattern-1318569205 tempest-TestVolumeBootPattern-1318569205-project-member] [instance: 6d839255-e713-4234-8443-6ba0d5635a6e] Found default for hw_video_model of virtio {{(pid=74613) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 18:22:48 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-5135448a-3e8f-4182-ae39-08738d274512 tempest-TestVolumeBootPattern-1318569205 tempest-TestVolumeBootPattern-1318569205-project-member] [instance: 6d839255-e713-4234-8443-6ba0d5635a6e] Found default for hw_vif_model of virtio {{(pid=74613) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 18:22:48 user nova-compute[74613]: INFO nova.compute.manager [None req-5135448a-3e8f-4182-ae39-08738d274512 tempest-TestVolumeBootPattern-1318569205 tempest-TestVolumeBootPattern-1318569205-project-member] [instance: 6d839255-e713-4234-8443-6ba0d5635a6e] Took 5.42 seconds to spawn the instance on the hypervisor.
Nov 29 18:22:48 user nova-compute[74613]: DEBUG nova.compute.manager [None req-5135448a-3e8f-4182-ae39-08738d274512 tempest-TestVolumeBootPattern-1318569205 tempest-TestVolumeBootPattern-1318569205-project-member] [instance: 6d839255-e713-4234-8443-6ba0d5635a6e] Checking state {{(pid=74613) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 29 18:22:48 user nova-compute[74613]: INFO nova.compute.manager [None req-5135448a-3e8f-4182-ae39-08738d274512 tempest-TestVolumeBootPattern-1318569205 tempest-TestVolumeBootPattern-1318569205-project-member] [instance: 6d839255-e713-4234-8443-6ba0d5635a6e] Took 14.36 seconds to build instance.
Nov 29 18:22:48 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-5135448a-3e8f-4182-ae39-08738d274512 tempest-TestVolumeBootPattern-1318569205 tempest-TestVolumeBootPattern-1318569205-project-member] Lock "6d839255-e713-4234-8443-6ba0d5635a6e" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 14.458s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 18:22:48 user nova-compute[74613]: DEBUG nova.compute.resource_tracker [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Instance 5227902d-b2b9-40a6-988f-3c02c52404f3 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74613) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 18:22:48 user nova-compute[74613]: DEBUG nova.compute.resource_tracker [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Instance 465b35fe-8c8c-476c-97b1-feff13778cc1 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74613) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 18:22:48 user nova-compute[74613]: DEBUG nova.compute.resource_tracker [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Instance 6d839255-e713-4234-8443-6ba0d5635a6e actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74613) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 18:22:48 user nova-compute[74613]: DEBUG nova.compute.resource_tracker [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=74613) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 29 18:22:48 user nova-compute[74613]: DEBUG nova.compute.resource_tracker [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Final resource view: name=user phys_ram=16011MB used_ram=2048MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=3 pci_stats=[] {{(pid=74613) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 29 18:22:48 user nova-compute[74613]: DEBUG nova.scheduler.client.report [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Refreshing inventories for resource provider 639d980e-3b12-44b1-b8f4-1812416fa4dd {{(pid=74613) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 29 18:22:48 user nova-compute[74613]: DEBUG nova.scheduler.client.report [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Updating ProviderTree inventory for provider 639d980e-3b12-44b1-b8f4-1812416fa4dd from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74613) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 29 18:22:48 user nova-compute[74613]: DEBUG nova.compute.provider_tree [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Updating inventory in ProviderTree for provider 639d980e-3b12-44b1-b8f4-1812416fa4dd with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74613) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 29 18:22:48 user nova-compute[74613]: DEBUG nova.scheduler.client.report [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Refreshing aggregate associations for resource provider 639d980e-3b12-44b1-b8f4-1812416fa4dd, aggregates: None {{(pid=74613) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 29 18:22:48 user nova-compute[74613]: DEBUG nova.scheduler.client.report [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Refreshing trait associations for resource provider 639d980e-3b12-44b1-b8f4-1812416fa4dd, traits: HW_CPU_X86_SSE,COMPUTE_VOLUME_EXTEND,COMPUTE_ACCELERATORS,HW_CPU_X86_SSE41,COMPUTE_STORAGE_BUS_IDE,COMPUTE_NODE,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,HW_CPU_X86_MMX,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,HW_CPU_X86_SSE2,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_STORAGE_BUS_USB,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_STORAGE_BUS_SATA,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_DEVICE_TAGGING,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_RESCUE_BFV,HW_CPU_X86_SSSE3,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_TRUSTED_CERTS,HW_CPU_X86_SSE42,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_STORAGE_BUS_FDC {{(pid=74613) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 29 18:22:48 user nova-compute[74613]: DEBUG nova.network.neutron [req-cdae2eae-eb2f-404e-a2f5-3f7e5b7c112a req-b095827d-6a00-4ddd-8e92-fedc3f70e65d service nova] [instance: 5227902d-b2b9-40a6-988f-3c02c52404f3] Updated VIF entry in instance network info cache for port 11900168-d650-4db6-8f65-21f1f9c4b603. {{(pid=74613) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 18:22:48 user nova-compute[74613]: DEBUG nova.network.neutron [req-cdae2eae-eb2f-404e-a2f5-3f7e5b7c112a req-b095827d-6a00-4ddd-8e92-fedc3f70e65d service nova] [instance: 5227902d-b2b9-40a6-988f-3c02c52404f3] Updating instance_info_cache with network_info: [{"id": "11900168-d650-4db6-8f65-21f1f9c4b603", "address": "fa:16:3e:40:72:ca", "network": {"id": "8951bb42-2dd0-4887-b0d1-fdb8d3ac7589", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1016730518-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.120", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "31a87cb1f6e14287abcfae98de155491", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap11900168-d6", "ovs_interfaceid": "11900168-d650-4db6-8f65-21f1f9c4b603", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74613) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 18:22:49 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-cdae2eae-eb2f-404e-a2f5-3f7e5b7c112a req-b095827d-6a00-4ddd-8e92-fedc3f70e65d service nova] Releasing lock "refresh_cache-5227902d-b2b9-40a6-988f-3c02c52404f3" {{(pid=74613) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 18:22:49 user nova-compute[74613]: DEBUG nova.compute.provider_tree [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Inventory has not changed in ProviderTree for provider: 639d980e-3b12-44b1-b8f4-1812416fa4dd {{(pid=74613) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 18:22:49 user nova-compute[74613]: DEBUG nova.scheduler.client.report [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Inventory has not changed for provider 639d980e-3b12-44b1-b8f4-1812416fa4dd based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74613) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 18:22:49 user nova-compute[74613]: DEBUG nova.compute.resource_tracker [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Compute_service record updated for user:user {{(pid=74613) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 29 18:22:49 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.557s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 18:22:49 user nova-compute[74613]: DEBUG oslo_service.periodic_task [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74613) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 18:22:49 user nova-compute[74613]: DEBUG nova.compute.manager [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Starting heal instance info cache {{(pid=74613) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 29 18:22:49 user nova-compute[74613]: DEBUG nova.compute.manager [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Rebuilding the list of instances to heal {{(pid=74613) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 29 18:22:49 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Acquiring lock "refresh_cache-5227902d-b2b9-40a6-988f-3c02c52404f3" {{(pid=74613) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 18:22:49 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Acquired lock "refresh_cache-5227902d-b2b9-40a6-988f-3c02c52404f3" {{(pid=74613) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 18:22:49 user nova-compute[74613]: DEBUG nova.network.neutron [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] [instance: 5227902d-b2b9-40a6-988f-3c02c52404f3] Forcefully refreshing network info cache for instance {{(pid=74613) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 29 18:22:49 user nova-compute[74613]: DEBUG nova.objects.instance [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Lazy-loading 'info_cache' on Instance uuid 5227902d-b2b9-40a6-988f-3c02c52404f3 {{(pid=74613) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 18:22:49 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:22:50 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-b17b3208-7fa2-4299-a72f-c56413513cee tempest-SnapshotDataIntegrityTests-1810787156 tempest-SnapshotDataIntegrityTests-1810787156-project-member] Acquiring lock "5227902d-b2b9-40a6-988f-3c02c52404f3" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 18:22:50 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-b17b3208-7fa2-4299-a72f-c56413513cee tempest-SnapshotDataIntegrityTests-1810787156 tempest-SnapshotDataIntegrityTests-1810787156-project-member] Lock "5227902d-b2b9-40a6-988f-3c02c52404f3" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 18:22:50 user nova-compute[74613]: DEBUG nova.objects.instance [None req-b17b3208-7fa2-4299-a72f-c56413513cee tempest-SnapshotDataIntegrityTests-1810787156 tempest-SnapshotDataIntegrityTests-1810787156-project-member] Lazy-loading 'flavor' on Instance uuid 5227902d-b2b9-40a6-988f-3c02c52404f3 {{(pid=74613) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 18:22:50 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-b17b3208-7fa2-4299-a72f-c56413513cee tempest-SnapshotDataIntegrityTests-1810787156 tempest-SnapshotDataIntegrityTests-1810787156-project-member] Lock "5227902d-b2b9-40a6-988f-3c02c52404f3" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.068s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 18:22:50 user nova-compute[74613]: DEBUG nova.network.neutron [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] [instance: 5227902d-b2b9-40a6-988f-3c02c52404f3] Updating instance_info_cache with network_info: [{"id": "11900168-d650-4db6-8f65-21f1f9c4b603", "address": "fa:16:3e:40:72:ca", "network": {"id": "8951bb42-2dd0-4887-b0d1-fdb8d3ac7589", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1016730518-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.120", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "31a87cb1f6e14287abcfae98de155491", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap11900168-d6", "ovs_interfaceid": "11900168-d650-4db6-8f65-21f1f9c4b603", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74613) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 18:22:50 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Releasing lock "refresh_cache-5227902d-b2b9-40a6-988f-3c02c52404f3" {{(pid=74613) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 18:22:50 user nova-compute[74613]: DEBUG nova.compute.manager [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] [instance: 5227902d-b2b9-40a6-988f-3c02c52404f3] Updated the network info_cache for instance {{(pid=74613) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 29 18:22:50 user nova-compute[74613]: DEBUG oslo_service.periodic_task [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74613) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 18:22:50 user nova-compute[74613]: DEBUG oslo_service.periodic_task [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74613) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 18:22:50 user nova-compute[74613]: DEBUG nova.compute.manager [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74613) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 29 18:22:50 user nova-compute[74613]: DEBUG oslo_service.periodic_task [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=74613) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 18:22:50 user nova-compute[74613]: DEBUG nova.compute.manager [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Cleaning up deleted instances {{(pid=74613) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 29 18:22:50 user nova-compute[74613]: DEBUG nova.compute.manager [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] There are 0 instances to clean {{(pid=74613) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 29 18:22:50 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-b17b3208-7fa2-4299-a72f-c56413513cee tempest-SnapshotDataIntegrityTests-1810787156 tempest-SnapshotDataIntegrityTests-1810787156-project-member] Acquiring lock "5227902d-b2b9-40a6-988f-3c02c52404f3" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 18:22:50 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-b17b3208-7fa2-4299-a72f-c56413513cee tempest-SnapshotDataIntegrityTests-1810787156 tempest-SnapshotDataIntegrityTests-1810787156-project-member] Lock "5227902d-b2b9-40a6-988f-3c02c52404f3" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 18:22:50 user nova-compute[74613]: INFO nova.compute.manager [None req-b17b3208-7fa2-4299-a72f-c56413513cee tempest-SnapshotDataIntegrityTests-1810787156 tempest-SnapshotDataIntegrityTests-1810787156-project-member] [instance: 5227902d-b2b9-40a6-988f-3c02c52404f3] Attaching volume 006dd20a-67a1-4f86-bf83-0c8121326d7b to /dev/vdb
Nov 29 18:22:50 user nova-compute[74613]: DEBUG oslo_service.periodic_task [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74613) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 18:22:50 user nova-compute[74613]: DEBUG oslo_service.periodic_task [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=74613) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 18:22:50 user nova-compute[74613]: DEBUG nova.compute.manager [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Cleaning up deleted instances with incomplete migration  {{(pid=74613) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 29 18:22:50 user nova-compute[74613]: DEBUG os_brick.utils [None req-b17b3208-7fa2-4299-a72f-c56413513cee tempest-SnapshotDataIntegrityTests-1810787156 tempest-SnapshotDataIntegrityTests-1810787156-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74613) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 18:22:50 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:22:50 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:22:50 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1032914-7864-4ec3-8aa8-8a4e94f72869]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:400972819b5\n', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 18:22:50 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:22:50 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:22:50 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[06af7d32-568f-464e-877b-cece1154d961]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 18:22:50 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:22:50 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:22:50 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7aa92b1-8f05-4cd5-a9a1-0502b2e8ea0b]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 18:22:50 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[34b34998-af30-4c4f-804f-a02541bbeba8]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 18:22:50 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-b17b3208-7fa2-4299-a72f-c56413513cee tempest-SnapshotDataIntegrityTests-1810787156 tempest-SnapshotDataIntegrityTests-1810787156-project-member] Running cmd (subprocess): nvme version {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:22:50 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-b17b3208-7fa2-4299-a72f-c56413513cee tempest-SnapshotDataIntegrityTests-1810787156 tempest-SnapshotDataIntegrityTests-1810787156-project-member] 'nvme version' failed. Not Retrying. {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 18:22:50 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.nvmeof [None req-b17b3208-7fa2-4299-a72f-c56413513cee tempest-SnapshotDataIntegrityTests-1810787156 tempest-SnapshotDataIntegrityTests-1810787156-project-member] nvme not present on system {{(pid=74613) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 29 18:22:50 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:22:50 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 18:22:50 user nova-compute[74613]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 29 18:22:50 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[160ad3b4-6414-42ed-8d72-4485bfe3d592]: (4, '') {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 18:22:50 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.lightos [None req-b17b3208-7fa2-4299-a72f-c56413513cee tempest-SnapshotDataIntegrityTests-1810787156 tempest-SnapshotDataIntegrityTests-1810787156-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74613) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 29 18:22:50 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.lightos [None req-b17b3208-7fa2-4299-a72f-c56413513cee tempest-SnapshotDataIntegrityTests-1810787156 tempest-SnapshotDataIntegrityTests-1810787156-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74613) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 29 18:22:50 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.lightos [None req-b17b3208-7fa2-4299-a72f-c56413513cee tempest-SnapshotDataIntegrityTests-1810787156 tempest-SnapshotDataIntegrityTests-1810787156-project-member] LIGHTOS: no hostnqn found. {{(pid=74613) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 29 18:22:50 user nova-compute[74613]: DEBUG os_brick.utils [None req-b17b3208-7fa2-4299-a72f-c56413513cee tempest-SnapshotDataIntegrityTests-1810787156 tempest-SnapshotDataIntegrityTests-1810787156-project-member] <== get_connector_properties: return (135ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:400972819b5', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74613) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 18:22:50 user nova-compute[74613]: DEBUG nova.virt.block_device [None req-b17b3208-7fa2-4299-a72f-c56413513cee tempest-SnapshotDataIntegrityTests-1810787156 tempest-SnapshotDataIntegrityTests-1810787156-project-member] [instance: 5227902d-b2b9-40a6-988f-3c02c52404f3] Updating existing volume attachment record: 5e689a27-98af-4660-9a6f-270c9de21922 {{(pid=74613) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 29 18:22:51 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:22:54 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:22:55 user nova-compute[74613]: DEBUG oslo_service.periodic_task [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=74613) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 18:22:56 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:22:58 user nova-compute[74613]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b17b3208-7fa2-4299-a72f-c56413513cee tempest-SnapshotDataIntegrityTests-1810787156 tempest-SnapshotDataIntegrityTests-1810787156-project-member] [instance: 5227902d-b2b9-40a6-988f-3c02c52404f3] Calling os-brick to attach iSCSI Volume {{(pid=74613) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 29 18:22:58 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-b17b3208-7fa2-4299-a72f-c56413513cee tempest-SnapshotDataIntegrityTests-1810787156 tempest-SnapshotDataIntegrityTests-1810787156-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff828156890>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:006dd20a-67a1-4f86-bf83-0c8121326d7b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zIXCufSy', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74613) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 18:22:58 user nova-compute[74613]: WARNING os_brick.initiator.connectors.base [None req-b17b3208-7fa2-4299-a72f-c56413513cee tempest-SnapshotDataIntegrityTests-1810787156 tempest-SnapshotDataIntegrityTests-1810787156-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 18:22:58 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.base [None req-b17b3208-7fa2-4299-a72f-c56413513cee tempest-SnapshotDataIntegrityTests-1810787156 tempest-SnapshotDataIntegrityTests-1810787156-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 18:22:58 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.base [None req-b17b3208-7fa2-4299-a72f-c56413513cee tempest-SnapshotDataIntegrityTests-1810787156 tempest-SnapshotDataIntegrityTests-1810787156-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 18:22:58 user nova-compute[74613]: WARNING os_brick.initiator.connectors.base [None req-b17b3208-7fa2-4299-a72f-c56413513cee tempest-SnapshotDataIntegrityTests-1810787156 tempest-SnapshotDataIntegrityTests-1810787156-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 18:22:58 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.base [None req-b17b3208-7fa2-4299-a72f-c56413513cee tempest-SnapshotDataIntegrityTests-1810787156 tempest-SnapshotDataIntegrityTests-1810787156-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:006dd20a-67a1-4f86-bf83-0c8121326d7b" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 18:22:58 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.base [None req-b17b3208-7fa2-4299-a72f-c56413513cee tempest-SnapshotDataIntegrityTests-1810787156 tempest-SnapshotDataIntegrityTests-1810787156-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:006dd20a-67a1-4f86-bf83-0c8121326d7b" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 18:22:58 user nova-compute[74613]: INFO os_brick.initiator.connectors.iscsi [None req-b17b3208-7fa2-4299-a72f-c56413513cee tempest-SnapshotDataIntegrityTests-1810787156 tempest-SnapshotDataIntegrityTests-1810787156-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 29 18:22:58 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:006dd20a-67a1-4f86-bf83-0c8121326d7b -p 172.16.0.220:3260 {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:22:58 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:006dd20a-67a1-4f86-bf83-0c8121326d7b -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:22:58 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf15990b-dec8-4047-9ff7-133df41ec311]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 18:22:58 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-b17b3208-7fa2-4299-a72f-c56413513cee tempest-SnapshotDataIntegrityTests-1810787156 tempest-SnapshotDataIntegrityTests-1810787156-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 29 18:22:58 user nova-compute[74613]:  {{(pid=74613) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 18:22:58 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:006dd20a-67a1-4f86-bf83-0c8121326d7b -p 172.16.0.220:3260 --interface default --op new {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:22:58 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:006dd20a-67a1-4f86-bf83-0c8121326d7b -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.017s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:22:58 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[04a5f391-324f-4977-97a7-fbf09f674f29]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:006dd20a-67a1-4f86-bf83-0c8121326d7b] added\n', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 18:22:58 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-b17b3208-7fa2-4299-a72f-c56413513cee tempest-SnapshotDataIntegrityTests-1810787156 tempest-SnapshotDataIntegrityTests-1810787156-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:006dd20a-67a1-4f86-bf83-0c8121326d7b] added
Nov 29 18:22:58 user nova-compute[74613]:  stderr= {{(pid=74613) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 18:22:58 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:006dd20a-67a1-4f86-bf83-0c8121326d7b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:22:58 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:006dd20a-67a1-4f86-bf83-0c8121326d7b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:22:58 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff206b44-2696-4d59-979f-8e1658171c6e]: (4, ('', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 18:22:58 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-b17b3208-7fa2-4299-a72f-c56413513cee tempest-SnapshotDataIntegrityTests-1810787156 tempest-SnapshotDataIntegrityTests-1810787156-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74613) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 18:22:58 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:006dd20a-67a1-4f86-bf83-0c8121326d7b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:22:58 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:006dd20a-67a1-4f86-bf83-0c8121326d7b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.016s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:22:58 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[8405c283-116b-4dfa-82f4-4b319e69e378]: (4, ('', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 18:22:58 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-b17b3208-7fa2-4299-a72f-c56413513cee tempest-SnapshotDataIntegrityTests-1810787156 tempest-SnapshotDataIntegrityTests-1810787156-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74613) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 18:22:58 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:006dd20a-67a1-4f86-bf83-0c8121326d7b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v zIXCufSy {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:22:58 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:006dd20a-67a1-4f86-bf83-0c8121326d7b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v zIXCufSy" returned: 0 in 0.018s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:22:58 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[eface078-b8c0-4b51-a36e-e6270c05c25a]: (4, ('', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 18:22:58 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-b17b3208-7fa2-4299-a72f-c56413513cee tempest-SnapshotDataIntegrityTests-1810787156 tempest-SnapshotDataIntegrityTests-1810787156-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'zIXCufSy'): stdout= stderr= {{(pid=74613) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 18:22:58 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:006dd20a-67a1-4f86-bf83-0c8121326d7b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:22:58 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:006dd20a-67a1-4f86-bf83-0c8121326d7b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.016s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:22:58 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[24046b0d-84a9-4456-949f-c67d27b2869a]: (4, ('', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 18:22:58 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-b17b3208-7fa2-4299-a72f-c56413513cee tempest-SnapshotDataIntegrityTests-1810787156 tempest-SnapshotDataIntegrityTests-1810787156-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74613) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 18:22:58 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:22:58 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:22:58 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[37bc72f9-9849-41c8-b7bc-2089d2230d55]: (4, ('tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f39cfde-47c7-4b9f-83d3-13c147be6792 (non-flash)\n', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 18:22:58 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-b17b3208-7fa2-4299-a72f-c56413513cee tempest-SnapshotDataIntegrityTests-1810787156 tempest-SnapshotDataIntegrityTests-1810787156-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f39cfde-47c7-4b9f-83d3-13c147be6792 (non-flash)
Nov 29 18:22:58 user nova-compute[74613]:  stderr= {{(pid=74613) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 18:22:58 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-b17b3208-7fa2-4299-a72f-c56413513cee tempest-SnapshotDataIntegrityTests-1810787156 tempest-SnapshotDataIntegrityTests-1810787156-project-member] iscsi session list stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f39cfde-47c7-4b9f-83d3-13c147be6792 (non-flash)
Nov 29 18:22:58 user nova-compute[74613]:  stderr= {{(pid=74613) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 18:22:58 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:006dd20a-67a1-4f86-bf83-0c8121326d7b -p 172.16.0.220:3260 --login {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:22:58 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:006dd20a-67a1-4f86-bf83-0c8121326d7b -p 172.16.0.220:3260 --login" returned: 0 in 0.054s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:22:58 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0570ca3-450e-4b69-8262-03a0324021fd]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:006dd20a-67a1-4f86-bf83-0c8121326d7b, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:006dd20a-67a1-4f86-bf83-0c8121326d7b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 18:22:58 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-b17b3208-7fa2-4299-a72f-c56413513cee tempest-SnapshotDataIntegrityTests-1810787156 tempest-SnapshotDataIntegrityTests-1810787156-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:006dd20a-67a1-4f86-bf83-0c8121326d7b, portal: 172.16.0.220,3260]
Nov 29 18:22:58 user nova-compute[74613]: Login to [iface: default, target: iqn.2010-10.org.openstack:006dd20a-67a1-4f86-bf83-0c8121326d7b, portal: 172.16.0.220,3260] successful.
Nov 29 18:22:58 user nova-compute[74613]:  stderr= {{(pid=74613) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 18:22:58 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:006dd20a-67a1-4f86-bf83-0c8121326d7b -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:22:58 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:006dd20a-67a1-4f86-bf83-0c8121326d7b -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:22:58 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[643ecee8-ec22-4dff-b3a9-97439ad4bae5]: (4, ('', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 18:22:58 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-b17b3208-7fa2-4299-a72f-c56413513cee tempest-SnapshotDataIntegrityTests-1810787156 tempest-SnapshotDataIntegrityTests-1810787156-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74613) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 18:22:58 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:22:58 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:22:58 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5836c25-d1c8-42a8-ae3d-94bf937788c8]: (4, ('tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f39cfde-47c7-4b9f-83d3-13c147be6792 (non-flash)\ntcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:006dd20a-67a1-4f86-bf83-0c8121326d7b (non-flash)\n', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 18:22:58 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-b17b3208-7fa2-4299-a72f-c56413513cee tempest-SnapshotDataIntegrityTests-1810787156 tempest-SnapshotDataIntegrityTests-1810787156-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f39cfde-47c7-4b9f-83d3-13c147be6792 (non-flash)
Nov 29 18:22:58 user nova-compute[74613]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:006dd20a-67a1-4f86-bf83-0c8121326d7b (non-flash)
Nov 29 18:22:58 user nova-compute[74613]:  stderr= {{(pid=74613) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 18:22:58 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-b17b3208-7fa2-4299-a72f-c56413513cee tempest-SnapshotDataIntegrityTests-1810787156 tempest-SnapshotDataIntegrityTests-1810787156-project-member] iscsi session list stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f39cfde-47c7-4b9f-83d3-13c147be6792 (non-flash)
Nov 29 18:22:58 user nova-compute[74613]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:006dd20a-67a1-4f86-bf83-0c8121326d7b (non-flash)
Nov 29 18:22:58 user nova-compute[74613]:  stderr= {{(pid=74613) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 18:22:58 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.base [None req-b17b3208-7fa2-4299-a72f-c56413513cee tempest-SnapshotDataIntegrityTests-1810787156 tempest-SnapshotDataIntegrityTests-1810787156-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:006dd20a-67a1-4f86-bf83-0c8121326d7b" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.252s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 18:22:58 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-b17b3208-7fa2-4299-a72f-c56413513cee tempest-SnapshotDataIntegrityTests-1810787156 tempest-SnapshotDataIntegrityTests-1810787156-project-member] Connected to 172.16.0.220:3260 {{(pid=74613) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 29 18:22:58 user nova-compute[74613]: DEBUG os_brick.initiator.linuxscsi [None req-b17b3208-7fa2-4299-a72f-c56413513cee tempest-SnapshotDataIntegrityTests-1810787156 tempest-SnapshotDataIntegrityTests-1810787156-project-member] HCTL ('34', '-', '-', 0) found on session 51 with lun 0 {{(pid=74613) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 29 18:22:58 user nova-compute[74613]: DEBUG os_brick.initiator.linuxscsi [None req-b17b3208-7fa2-4299-a72f-c56413513cee tempest-SnapshotDataIntegrityTests-1810787156 tempest-SnapshotDataIntegrityTests-1810787156-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=74613) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 29 18:22:58 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:22:58 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.016s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:22:58 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[c90adf1c-391d-444e-acf5-e44c5eb51a49]: (4, ('- - 0', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 18:22:58 user nova-compute[74613]: DEBUG os_brick.initiator.linuxscsi [None req-b17b3208-7fa2-4299-a72f-c56413513cee tempest-SnapshotDataIntegrityTests-1810787156 tempest-SnapshotDataIntegrityTests-1810787156-project-member] Searching for a device in session 51 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=74613) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 29 18:22:58 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-b17b3208-7fa2-4299-a72f-c56413513cee tempest-SnapshotDataIntegrityTests-1810787156 tempest-SnapshotDataIntegrityTests-1810787156-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:006dd20a-67a1-4f86-bf83-0c8121326d7b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zIXCufSy', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74613) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 29 18:22:59 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.base [None req-b17b3208-7fa2-4299-a72f-c56413513cee tempest-SnapshotDataIntegrityTests-1810787156 tempest-SnapshotDataIntegrityTests-1810787156-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.281s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 18:22:59 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-b17b3208-7fa2-4299-a72f-c56413513cee tempest-SnapshotDataIntegrityTests-1810787156 tempest-SnapshotDataIntegrityTests-1810787156-project-member] <== connect_volume: return (1283ms) {'type': 'block', 'scsi_wwn': '26566326261323666', 'path': '/dev/sdc'} {{(pid=74613) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 18:22:59 user nova-compute[74613]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b17b3208-7fa2-4299-a72f-c56413513cee tempest-SnapshotDataIntegrityTests-1810787156 tempest-SnapshotDataIntegrityTests-1810787156-project-member] [instance: 5227902d-b2b9-40a6-988f-3c02c52404f3] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26566326261323666', 'path': '/dev/sdc'} {{(pid=74613) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 29 18:22:59 user nova-compute[74613]: DEBUG nova.objects.instance [None req-b17b3208-7fa2-4299-a72f-c56413513cee tempest-SnapshotDataIntegrityTests-1810787156 tempest-SnapshotDataIntegrityTests-1810787156-project-member] Lazy-loading 'flavor' on Instance uuid 5227902d-b2b9-40a6-988f-3c02c52404f3 {{(pid=74613) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 18:22:59 user nova-compute[74613]: DEBUG nova.virt.libvirt.guest [None req-b17b3208-7fa2-4299-a72f-c56413513cee tempest-SnapshotDataIntegrityTests-1810787156 tempest-SnapshotDataIntegrityTests-1810787156-project-member] attach device xml: <disk type="block" device="disk">
Nov 29 18:22:59 user nova-compute[74613]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 18:22:59 user nova-compute[74613]:   <source dev="/dev/sdc"/>
Nov 29 18:22:59 user nova-compute[74613]:   <target dev="vdb" bus="virtio"/>
Nov 29 18:22:59 user nova-compute[74613]:   <serial>006dd20a-67a1-4f86-bf83-0c8121326d7b</serial>
Nov 29 18:22:59 user nova-compute[74613]: </disk>
Nov 29 18:22:59 user nova-compute[74613]:  {{(pid=74613) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 29 18:22:59 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:22:59 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-b17b3208-7fa2-4299-a72f-c56413513cee tempest-SnapshotDataIntegrityTests-1810787156 tempest-SnapshotDataIntegrityTests-1810787156-project-member] No BDM found with device name vda, not building metadata. {{(pid=74613) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 18:22:59 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-b17b3208-7fa2-4299-a72f-c56413513cee tempest-SnapshotDataIntegrityTests-1810787156 tempest-SnapshotDataIntegrityTests-1810787156-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74613) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 18:22:59 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-b17b3208-7fa2-4299-a72f-c56413513cee tempest-SnapshotDataIntegrityTests-1810787156 tempest-SnapshotDataIntegrityTests-1810787156-project-member] No VIF found with MAC fa:16:3e:40:72:ca, not building metadata {{(pid=74613) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 29 18:22:59 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-b17b3208-7fa2-4299-a72f-c56413513cee tempest-SnapshotDataIntegrityTests-1810787156 tempest-SnapshotDataIntegrityTests-1810787156-project-member] Lock "5227902d-b2b9-40a6-988f-3c02c52404f3" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 9.364s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 18:23:01 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:23:04 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:23:06 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:23:09 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:23:11 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:23:14 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:23:16 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:23:18 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-e285907b-d2da-422c-8e7e-01fdd862b20d tempest-SnapshotDataIntegrityTests-1810787156 tempest-SnapshotDataIntegrityTests-1810787156-project-member] Acquiring lock "5227902d-b2b9-40a6-988f-3c02c52404f3" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 18:23:18 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-e285907b-d2da-422c-8e7e-01fdd862b20d tempest-SnapshotDataIntegrityTests-1810787156 tempest-SnapshotDataIntegrityTests-1810787156-project-member] Lock "5227902d-b2b9-40a6-988f-3c02c52404f3" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 18:23:18 user nova-compute[74613]: INFO nova.compute.manager [None req-e285907b-d2da-422c-8e7e-01fdd862b20d tempest-SnapshotDataIntegrityTests-1810787156 tempest-SnapshotDataIntegrityTests-1810787156-project-member] [instance: 5227902d-b2b9-40a6-988f-3c02c52404f3] Detaching volume 006dd20a-67a1-4f86-bf83-0c8121326d7b
Nov 29 18:23:18 user nova-compute[74613]: INFO nova.virt.block_device [None req-e285907b-d2da-422c-8e7e-01fdd862b20d tempest-SnapshotDataIntegrityTests-1810787156 tempest-SnapshotDataIntegrityTests-1810787156-project-member] [instance: 5227902d-b2b9-40a6-988f-3c02c52404f3] Attempting to driver detach volume 006dd20a-67a1-4f86-bf83-0c8121326d7b from mountpoint /dev/vdb
Nov 29 18:23:18 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-e285907b-d2da-422c-8e7e-01fdd862b20d tempest-SnapshotDataIntegrityTests-1810787156 tempest-SnapshotDataIntegrityTests-1810787156-project-member] Attempting to detach device vdb from instance 5227902d-b2b9-40a6-988f-3c02c52404f3 from the persistent domain config. {{(pid=74613) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 29 18:23:18 user nova-compute[74613]: DEBUG nova.virt.libvirt.guest [None req-e285907b-d2da-422c-8e7e-01fdd862b20d tempest-SnapshotDataIntegrityTests-1810787156 tempest-SnapshotDataIntegrityTests-1810787156-project-member] detach device xml: <disk type="block" device="disk">
Nov 29 18:23:18 user nova-compute[74613]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 18:23:18 user nova-compute[74613]:   <source dev="/dev/sdc"/>
Nov 29 18:23:18 user nova-compute[74613]:   <target dev="vdb" bus="virtio"/>
Nov 29 18:23:18 user nova-compute[74613]:   <serial>006dd20a-67a1-4f86-bf83-0c8121326d7b</serial>
Nov 29 18:23:18 user nova-compute[74613]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 29 18:23:18 user nova-compute[74613]: </disk>
Nov 29 18:23:18 user nova-compute[74613]:  {{(pid=74613) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 29 18:23:18 user nova-compute[74613]: INFO nova.virt.libvirt.driver [None req-e285907b-d2da-422c-8e7e-01fdd862b20d tempest-SnapshotDataIntegrityTests-1810787156 tempest-SnapshotDataIntegrityTests-1810787156-project-member] Successfully detached device vdb from instance 5227902d-b2b9-40a6-988f-3c02c52404f3 from the persistent domain config.
Nov 29 18:23:18 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-e285907b-d2da-422c-8e7e-01fdd862b20d tempest-SnapshotDataIntegrityTests-1810787156 tempest-SnapshotDataIntegrityTests-1810787156-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 5227902d-b2b9-40a6-988f-3c02c52404f3 from the live domain config. {{(pid=74613) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 29 18:23:18 user nova-compute[74613]: DEBUG nova.virt.libvirt.guest [None req-e285907b-d2da-422c-8e7e-01fdd862b20d tempest-SnapshotDataIntegrityTests-1810787156 tempest-SnapshotDataIntegrityTests-1810787156-project-member] detach device xml: <disk type="block" device="disk">
Nov 29 18:23:18 user nova-compute[74613]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 18:23:18 user nova-compute[74613]:   <source dev="/dev/sdc"/>
Nov 29 18:23:18 user nova-compute[74613]:   <target dev="vdb" bus="virtio"/>
Nov 29 18:23:18 user nova-compute[74613]:   <serial>006dd20a-67a1-4f86-bf83-0c8121326d7b</serial>
Nov 29 18:23:18 user nova-compute[74613]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 29 18:23:18 user nova-compute[74613]: </disk>
Nov 29 18:23:18 user nova-compute[74613]:  {{(pid=74613) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 29 18:23:18 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-e285907b-d2da-422c-8e7e-01fdd862b20d tempest-SnapshotDataIntegrityTests-1810787156 tempest-SnapshotDataIntegrityTests-1810787156-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 5227902d-b2b9-40a6-988f-3c02c52404f3 {{(pid=74613) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 29 18:23:19 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:23:21 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:23:24 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:23:29 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:23:34 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:23:37 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-6b26420a-a0de-4a15-b187-b2dcdae5d56f tempest-VolumesActionsTest-576062334 tempest-VolumesActionsTest-576062334-project-member] Acquiring lock "465b35fe-8c8c-476c-97b1-feff13778cc1" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 18:23:37 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-6b26420a-a0de-4a15-b187-b2dcdae5d56f tempest-VolumesActionsTest-576062334 tempest-VolumesActionsTest-576062334-project-member] Lock "465b35fe-8c8c-476c-97b1-feff13778cc1" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 18:23:37 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-6b26420a-a0de-4a15-b187-b2dcdae5d56f tempest-VolumesActionsTest-576062334 tempest-VolumesActionsTest-576062334-project-member] Acquiring lock "465b35fe-8c8c-476c-97b1-feff13778cc1-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 18:23:37 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-6b26420a-a0de-4a15-b187-b2dcdae5d56f tempest-VolumesActionsTest-576062334 tempest-VolumesActionsTest-576062334-project-member] Lock "465b35fe-8c8c-476c-97b1-feff13778cc1-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 18:23:37 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-6b26420a-a0de-4a15-b187-b2dcdae5d56f tempest-VolumesActionsTest-576062334 tempest-VolumesActionsTest-576062334-project-member] Lock "465b35fe-8c8c-476c-97b1-feff13778cc1-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 18:23:37 user nova-compute[74613]: INFO nova.compute.manager [None req-6b26420a-a0de-4a15-b187-b2dcdae5d56f tempest-VolumesActionsTest-576062334 tempest-VolumesActionsTest-576062334-project-member] [instance: 465b35fe-8c8c-476c-97b1-feff13778cc1] Terminating instance
Nov 29 18:23:37 user nova-compute[74613]: DEBUG nova.compute.manager [None req-6b26420a-a0de-4a15-b187-b2dcdae5d56f tempest-VolumesActionsTest-576062334 tempest-VolumesActionsTest-576062334-project-member] [instance: 465b35fe-8c8c-476c-97b1-feff13778cc1] Start destroying the instance on the hypervisor. {{(pid=74613) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 29 18:23:37 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:23:37 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:23:37 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:23:37 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:23:37 user nova-compute[74613]: DEBUG nova.compute.manager [req-85592334-1427-4866-b341-f22b4d1d56cd req-a42b2ae1-0ce3-43b0-8786-b44ccb4371ab service nova] [instance: 465b35fe-8c8c-476c-97b1-feff13778cc1] Received event network-vif-unplugged-dce464f3-e0ed-4708-a833-224a83b01f86 {{(pid=74613) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 18:23:37 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-85592334-1427-4866-b341-f22b4d1d56cd req-a42b2ae1-0ce3-43b0-8786-b44ccb4371ab service nova] Acquiring lock "465b35fe-8c8c-476c-97b1-feff13778cc1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 18:23:37 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-85592334-1427-4866-b341-f22b4d1d56cd req-a42b2ae1-0ce3-43b0-8786-b44ccb4371ab service nova] Lock "465b35fe-8c8c-476c-97b1-feff13778cc1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 18:23:37 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-85592334-1427-4866-b341-f22b4d1d56cd req-a42b2ae1-0ce3-43b0-8786-b44ccb4371ab service nova] Lock "465b35fe-8c8c-476c-97b1-feff13778cc1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 18:23:37 user nova-compute[74613]: DEBUG nova.compute.manager [req-85592334-1427-4866-b341-f22b4d1d56cd req-a42b2ae1-0ce3-43b0-8786-b44ccb4371ab service nova] [instance: 465b35fe-8c8c-476c-97b1-feff13778cc1] No waiting events found dispatching network-vif-unplugged-dce464f3-e0ed-4708-a833-224a83b01f86 {{(pid=74613) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 18:23:37 user nova-compute[74613]: DEBUG nova.compute.manager [req-85592334-1427-4866-b341-f22b4d1d56cd req-a42b2ae1-0ce3-43b0-8786-b44ccb4371ab service nova] [instance: 465b35fe-8c8c-476c-97b1-feff13778cc1] Received event network-vif-unplugged-dce464f3-e0ed-4708-a833-224a83b01f86 for instance with task_state deleting. {{(pid=74613) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 29 18:23:38 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:23:38 user nova-compute[74613]: INFO nova.virt.libvirt.driver [-] [instance: 465b35fe-8c8c-476c-97b1-feff13778cc1] Instance destroyed successfully.
Nov 29 18:23:38 user nova-compute[74613]: DEBUG nova.objects.instance [None req-6b26420a-a0de-4a15-b187-b2dcdae5d56f tempest-VolumesActionsTest-576062334 tempest-VolumesActionsTest-576062334-project-member] Lazy-loading 'resources' on Instance uuid 465b35fe-8c8c-476c-97b1-feff13778cc1 {{(pid=74613) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 18:23:38 user nova-compute[74613]: DEBUG nova.virt.libvirt.vif [None req-6b26420a-a0de-4a15-b187-b2dcdae5d56f tempest-VolumesActionsTest-576062334 tempest-VolumesActionsTest-576062334-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T18:21:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1482723050',display_name='tempest-VolumesActionsTest-instance-1482723050',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1482723050',id=45,image_ref='4217f428-8d9d-4ee1-9614-642d26d90c46',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-29T18:21:52Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='13bf1cb7deec45aea930f4a0092572d1',ramdisk_id='',reservation_id='r-pdx44nfp',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='4217f428-8d9d-4ee1-9614-642d26d90c46',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesActionsTest-576062334',owner_user_name='tempest-VolumesActionsTest-576062334-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-29T18:21:52Z,user_data=None,user_id='680fbea8ee2e489b9e7a4274b5f66b62',uuid=465b35fe-8c8c-476c-97b1-feff13778cc1,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "dce464f3-e0ed-4708-a833-224a83b01f86", "address": "fa:16:3e:b5:50:4e", "network": {"id": "74c4d111-4731-4d90-b6a9-a72b112d18ca", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1404505506-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "13bf1cb7deec45aea930f4a0092572d1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdce464f3-e0", "ovs_interfaceid": "dce464f3-e0ed-4708-a833-224a83b01f86", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74613) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 29 18:23:38 user nova-compute[74613]: DEBUG nova.network.os_vif_util [None req-6b26420a-a0de-4a15-b187-b2dcdae5d56f tempest-VolumesActionsTest-576062334 tempest-VolumesActionsTest-576062334-project-member] Converting VIF {"id": "dce464f3-e0ed-4708-a833-224a83b01f86", "address": "fa:16:3e:b5:50:4e", "network": {"id": "74c4d111-4731-4d90-b6a9-a72b112d18ca", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1404505506-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "13bf1cb7deec45aea930f4a0092572d1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdce464f3-e0", "ovs_interfaceid": "dce464f3-e0ed-4708-a833-224a83b01f86", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74613) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 18:23:38 user nova-compute[74613]: DEBUG nova.network.os_vif_util [None req-6b26420a-a0de-4a15-b187-b2dcdae5d56f tempest-VolumesActionsTest-576062334 tempest-VolumesActionsTest-576062334-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b5:50:4e,bridge_name='br-int',has_traffic_filtering=True,id=dce464f3-e0ed-4708-a833-224a83b01f86,network=Network(74c4d111-4731-4d90-b6a9-a72b112d18ca),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdce464f3-e0') {{(pid=74613) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 18:23:38 user nova-compute[74613]: DEBUG os_vif [None req-6b26420a-a0de-4a15-b187-b2dcdae5d56f tempest-VolumesActionsTest-576062334 tempest-VolumesActionsTest-576062334-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b5:50:4e,bridge_name='br-int',has_traffic_filtering=True,id=dce464f3-e0ed-4708-a833-224a83b01f86,network=Network(74c4d111-4731-4d90-b6a9-a72b112d18ca),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdce464f3-e0') {{(pid=74613) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 29 18:23:38 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:23:38 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapdce464f3-e0, bridge=br-int, if_exists=True) {{(pid=74613) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 18:23:38 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 18:23:38 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:23:38 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=2b3f5833-6428-414d-854d-c7891cfd4bca) {{(pid=74613) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 18:23:38 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:23:38 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:23:38 user nova-compute[74613]: INFO os_vif [None req-6b26420a-a0de-4a15-b187-b2dcdae5d56f tempest-VolumesActionsTest-576062334 tempest-VolumesActionsTest-576062334-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b5:50:4e,bridge_name='br-int',has_traffic_filtering=True,id=dce464f3-e0ed-4708-a833-224a83b01f86,network=Network(74c4d111-4731-4d90-b6a9-a72b112d18ca),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdce464f3-e0')
Nov 29 18:23:38 user nova-compute[74613]: INFO nova.virt.libvirt.driver [None req-6b26420a-a0de-4a15-b187-b2dcdae5d56f tempest-VolumesActionsTest-576062334 tempest-VolumesActionsTest-576062334-project-member] [instance: 465b35fe-8c8c-476c-97b1-feff13778cc1] Deleting instance files /opt/stack/data/nova/instances/465b35fe-8c8c-476c-97b1-feff13778cc1_del
Nov 29 18:23:38 user nova-compute[74613]: INFO nova.virt.libvirt.driver [None req-6b26420a-a0de-4a15-b187-b2dcdae5d56f tempest-VolumesActionsTest-576062334 tempest-VolumesActionsTest-576062334-project-member] [instance: 465b35fe-8c8c-476c-97b1-feff13778cc1] Deletion of /opt/stack/data/nova/instances/465b35fe-8c8c-476c-97b1-feff13778cc1_del complete
Nov 29 18:23:38 user nova-compute[74613]: INFO nova.compute.manager [None req-6b26420a-a0de-4a15-b187-b2dcdae5d56f tempest-VolumesActionsTest-576062334 tempest-VolumesActionsTest-576062334-project-member] [instance: 465b35fe-8c8c-476c-97b1-feff13778cc1] Took 0.68 seconds to destroy the instance on the hypervisor.
Nov 29 18:23:38 user nova-compute[74613]: DEBUG oslo.service.loopingcall [None req-6b26420a-a0de-4a15-b187-b2dcdae5d56f tempest-VolumesActionsTest-576062334 tempest-VolumesActionsTest-576062334-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74613) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 29 18:23:38 user nova-compute[74613]: DEBUG nova.compute.manager [-] [instance: 465b35fe-8c8c-476c-97b1-feff13778cc1] Deallocating network for instance {{(pid=74613) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 29 18:23:38 user nova-compute[74613]: DEBUG nova.network.neutron [-] [instance: 465b35fe-8c8c-476c-97b1-feff13778cc1] deallocate_for_instance() {{(pid=74613) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 29 18:23:38 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:23:38 user nova-compute[74613]: DEBUG nova.network.neutron [-] [instance: 465b35fe-8c8c-476c-97b1-feff13778cc1] Updating instance_info_cache with network_info: [] {{(pid=74613) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 18:23:38 user nova-compute[74613]: INFO nova.compute.manager [-] [instance: 465b35fe-8c8c-476c-97b1-feff13778cc1] Took 0.50 seconds to deallocate network for instance.
Nov 29 18:23:38 user nova-compute[74613]: DEBUG nova.compute.manager [req-117af519-e222-4a7f-875b-a6ea4a3841d8 req-d8e148a2-7bd8-42b1-964b-c533cb60af65 service nova] [instance: 465b35fe-8c8c-476c-97b1-feff13778cc1] Received event network-vif-deleted-dce464f3-e0ed-4708-a833-224a83b01f86 {{(pid=74613) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 18:23:38 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-6b26420a-a0de-4a15-b187-b2dcdae5d56f tempest-VolumesActionsTest-576062334 tempest-VolumesActionsTest-576062334-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 18:23:38 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-6b26420a-a0de-4a15-b187-b2dcdae5d56f tempest-VolumesActionsTest-576062334 tempest-VolumesActionsTest-576062334-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 18:23:38 user nova-compute[74613]: WARNING nova.virt.libvirt.driver [None req-e285907b-d2da-422c-8e7e-01fdd862b20d tempest-SnapshotDataIntegrityTests-1810787156 tempest-SnapshotDataIntegrityTests-1810787156-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 5227902d-b2b9-40a6-988f-3c02c52404f3 is timed out.
Nov 29 18:23:38 user nova-compute[74613]: INFO nova.virt.libvirt.driver [None req-e285907b-d2da-422c-8e7e-01fdd862b20d tempest-SnapshotDataIntegrityTests-1810787156 tempest-SnapshotDataIntegrityTests-1810787156-project-member] Successfully detached device vdb from instance 5227902d-b2b9-40a6-988f-3c02c52404f3 from the live domain config.
Nov 29 18:23:38 user nova-compute[74613]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e285907b-d2da-422c-8e7e-01fdd862b20d tempest-SnapshotDataIntegrityTests-1810787156 tempest-SnapshotDataIntegrityTests-1810787156-project-member] [instance: 5227902d-b2b9-40a6-988f-3c02c52404f3] calling os-brick to detach iSCSI Volume {{(pid=74613) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 29 18:23:38 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-e285907b-d2da-422c-8e7e-01fdd862b20d tempest-SnapshotDataIntegrityTests-1810787156 tempest-SnapshotDataIntegrityTests-1810787156-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff828156890>, {'target_iqn': 'iqn.2010-10.org.openstack:006dd20a-67a1-4f86-bf83-0c8121326d7b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zIXCufSy', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=74613) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 18:23:38 user nova-compute[74613]: WARNING os_brick.initiator.connectors.base [None req-e285907b-d2da-422c-8e7e-01fdd862b20d tempest-SnapshotDataIntegrityTests-1810787156 tempest-SnapshotDataIntegrityTests-1810787156-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 18:23:38 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.base [None req-e285907b-d2da-422c-8e7e-01fdd862b20d tempest-SnapshotDataIntegrityTests-1810787156 tempest-SnapshotDataIntegrityTests-1810787156-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 18:23:38 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.base [None req-e285907b-d2da-422c-8e7e-01fdd862b20d tempest-SnapshotDataIntegrityTests-1810787156 tempest-SnapshotDataIntegrityTests-1810787156-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 18:23:38 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:23:38 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:23:38 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[e789233b-f847-4796-8b9d-19595f4f5d31]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:006dd20a-67a1-4f86-bf83-0c8121326d7b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:6f39cfde-47c7-4b9f-83d3-13c147be6792\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 18:23:38 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-e285907b-d2da-422c-8e7e-01fdd862b20d tempest-SnapshotDataIntegrityTests-1810787156 tempest-SnapshotDataIntegrityTests-1810787156-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 29 18:23:38 user nova-compute[74613]: No targets found.
Nov 29 18:23:38 user nova-compute[74613]: iSNS:
Nov 29 18:23:38 user nova-compute[74613]: No targets found.
Nov 29 18:23:38 user nova-compute[74613]: STATIC:
Nov 29 18:23:38 user nova-compute[74613]: Target: iqn.2010-10.org.openstack:006dd20a-67a1-4f86-bf83-0c8121326d7b
Nov 29 18:23:38 user nova-compute[74613]:         Portal: 172.16.0.220:3260,-1
Nov 29 18:23:38 user nova-compute[74613]:                 Iface Name: default
Nov 29 18:23:38 user nova-compute[74613]: Target: iqn.2010-10.org.openstack:6f39cfde-47c7-4b9f-83d3-13c147be6792
Nov 29 18:23:38 user nova-compute[74613]:         Portal: 172.16.0.220:3260,-1
Nov 29 18:23:38 user nova-compute[74613]:                 Iface Name: default
Nov 29 18:23:38 user nova-compute[74613]: FIRMWARE:
Nov 29 18:23:38 user nova-compute[74613]: No targets found.
Nov 29 18:23:38 user nova-compute[74613]:  stderr= {{(pid=74613) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 18:23:38 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-e285907b-d2da-422c-8e7e-01fdd862b20d tempest-SnapshotDataIntegrityTests-1810787156 tempest-SnapshotDataIntegrityTests-1810787156-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 29 18:23:38 user nova-compute[74613]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 29 18:23:38 user nova-compute[74613]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74613) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 29 18:23:38 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-e285907b-d2da-422c-8e7e-01fdd862b20d tempest-SnapshotDataIntegrityTests-1810787156 tempest-SnapshotDataIntegrityTests-1810787156-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:006dd20a-67a1-4f86-bf83-0c8121326d7b', 0)] {{(pid=74613) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 29 18:23:38 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:23:38 user nova-compute[74613]: DEBUG nova.compute.provider_tree [None req-6b26420a-a0de-4a15-b187-b2dcdae5d56f tempest-VolumesActionsTest-576062334 tempest-VolumesActionsTest-576062334-project-member] Inventory has not changed in ProviderTree for provider: 639d980e-3b12-44b1-b8f4-1812416fa4dd {{(pid=74613) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 18:23:38 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:23:38 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd4cd34f-c896-4b67-883e-7e96b669e335]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:006dd20a-67a1-4f86-bf83-0c8121326d7b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6f39cfde-47c7-4b9f-83d3-13c147be6792\n', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 18:23:38 user nova-compute[74613]: DEBUG nova.scheduler.client.report [None req-6b26420a-a0de-4a15-b187-b2dcdae5d56f tempest-VolumesActionsTest-576062334 tempest-VolumesActionsTest-576062334-project-member] Inventory has not changed for provider 639d980e-3b12-44b1-b8f4-1812416fa4dd based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74613) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 18:23:38 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:23:38 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:23:38 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[7925a43d-0644-40f4-9fc2-0205901a3208]: (4, ('tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f39cfde-47c7-4b9f-83d3-13c147be6792 (non-flash)\ntcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:006dd20a-67a1-4f86-bf83-0c8121326d7b (non-flash)\n', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 18:23:38 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-e285907b-d2da-422c-8e7e-01fdd862b20d tempest-SnapshotDataIntegrityTests-1810787156 tempest-SnapshotDataIntegrityTests-1810787156-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f39cfde-47c7-4b9f-83d3-13c147be6792 (non-flash)
Nov 29 18:23:38 user nova-compute[74613]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:006dd20a-67a1-4f86-bf83-0c8121326d7b (non-flash)
Nov 29 18:23:38 user nova-compute[74613]:  stderr= {{(pid=74613) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 18:23:38 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-e285907b-d2da-422c-8e7e-01fdd862b20d tempest-SnapshotDataIntegrityTests-1810787156 tempest-SnapshotDataIntegrityTests-1810787156-project-member] iscsi session list stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f39cfde-47c7-4b9f-83d3-13c147be6792 (non-flash)
Nov 29 18:23:38 user nova-compute[74613]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:006dd20a-67a1-4f86-bf83-0c8121326d7b (non-flash)
Nov 29 18:23:38 user nova-compute[74613]:  stderr= {{(pid=74613) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 18:23:38 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-e285907b-d2da-422c-8e7e-01fdd862b20d tempest-SnapshotDataIntegrityTests-1810787156 tempest-SnapshotDataIntegrityTests-1810787156-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7ff8182e24d0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:006dd20a-67a1-4f86-bf83-0c8121326d7b'): ({'sdc'}, set())}) {{(pid=74613) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 29 18:23:38 user nova-compute[74613]: DEBUG os_brick.initiator.linuxscsi [None req-e285907b-d2da-422c-8e7e-01fdd862b20d tempest-SnapshotDataIntegrityTests-1810787156 tempest-SnapshotDataIntegrityTests-1810787156-project-member] Removing single pathed devices sdc {{(pid=74613) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 29 18:23:38 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:23:38 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-6b26420a-a0de-4a15-b187-b2dcdae5d56f tempest-VolumesActionsTest-576062334 tempest-VolumesActionsTest-576062334-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.172s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 18:23:38 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:23:38 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[9bf4ae5e-a108-40a7-a0f7-5153efdd4d6c]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 18:23:38 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:23:38 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.019s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:23:38 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b7f8b0b-8771-49b1-b147-071b8be0b6e2]: (4, ('ok\n', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 18:23:38 user nova-compute[74613]: DEBUG os_brick.initiator.linuxscsi [None req-e285907b-d2da-422c-8e7e-01fdd862b20d tempest-SnapshotDataIntegrityTests-1810787156 tempest-SnapshotDataIntegrityTests-1810787156-project-member] Flushing IO for device /dev/sdc {{(pid=74613) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 29 18:23:38 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:23:38 user nova-compute[74613]: INFO nova.scheduler.client.report [None req-6b26420a-a0de-4a15-b187-b2dcdae5d56f tempest-VolumesActionsTest-576062334 tempest-VolumesActionsTest-576062334-project-member] Deleted allocations for instance 465b35fe-8c8c-476c-97b1-feff13778cc1
Nov 29 18:23:38 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.015s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:23:38 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ef61a46-e10d-414f-b934-83c29cd9fe93]: (4, ('', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 18:23:38 user nova-compute[74613]: DEBUG os_brick.initiator.linuxscsi [None req-e285907b-d2da-422c-8e7e-01fdd862b20d tempest-SnapshotDataIntegrityTests-1810787156 tempest-SnapshotDataIntegrityTests-1810787156-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=74613) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 29 18:23:38 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:23:38 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.043s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:23:38 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[526e9eda-e496-44b1-9db4-b84e2b85c1b6]: (4, ('1', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 18:23:38 user nova-compute[74613]: DEBUG os_brick.initiator.linuxscsi [None req-e285907b-d2da-422c-8e7e-01fdd862b20d tempest-SnapshotDataIntegrityTests-1810787156 tempest-SnapshotDataIntegrityTests-1810787156-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=74613) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 29 18:23:38 user nova-compute[74613]: DEBUG os_brick.initiator.linuxscsi [None req-e285907b-d2da-422c-8e7e-01fdd862b20d tempest-SnapshotDataIntegrityTests-1810787156 tempest-SnapshotDataIntegrityTests-1810787156-project-member] SCSI volumes sdc have been removed. {{(pid=74613) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 29 18:23:38 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-e285907b-d2da-422c-8e7e-01fdd862b20d tempest-SnapshotDataIntegrityTests-1810787156 tempest-SnapshotDataIntegrityTests-1810787156-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:006dd20a-67a1-4f86-bf83-0c8121326d7b')] {{(pid=74613) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 29 18:23:38 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:006dd20a-67a1-4f86-bf83-0c8121326d7b -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:23:39 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-6b26420a-a0de-4a15-b187-b2dcdae5d56f tempest-VolumesActionsTest-576062334 tempest-VolumesActionsTest-576062334-project-member] Lock "465b35fe-8c8c-476c-97b1-feff13778cc1" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.536s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 18:23:39 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:006dd20a-67a1-4f86-bf83-0c8121326d7b -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:23:39 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae0cc053-2b93-4227-9eb3-cc5a4aea0c68]: (4, ('', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 18:23:39 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-e285907b-d2da-422c-8e7e-01fdd862b20d tempest-SnapshotDataIntegrityTests-1810787156 tempest-SnapshotDataIntegrityTests-1810787156-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74613) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 18:23:39 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:006dd20a-67a1-4f86-bf83-0c8121326d7b -p 172.16.0.220:3260 --logout {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:23:39 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:006dd20a-67a1-4f86-bf83-0c8121326d7b -p 172.16.0.220:3260 --logout" returned: 0 in 0.054s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:23:39 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b2b4511-e223-41e4-a8d6-7b1e2ffe9e65]: (4, ('Logging out of session [sid: 51, target: iqn.2010-10.org.openstack:006dd20a-67a1-4f86-bf83-0c8121326d7b, portal: 172.16.0.220,3260]\nLogout of [sid: 51, target: iqn.2010-10.org.openstack:006dd20a-67a1-4f86-bf83-0c8121326d7b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 18:23:39 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-e285907b-d2da-422c-8e7e-01fdd862b20d tempest-SnapshotDataIntegrityTests-1810787156 tempest-SnapshotDataIntegrityTests-1810787156-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 51, target: iqn.2010-10.org.openstack:006dd20a-67a1-4f86-bf83-0c8121326d7b, portal: 172.16.0.220,3260]
Nov 29 18:23:39 user nova-compute[74613]: Logout of [sid: 51, target: iqn.2010-10.org.openstack:006dd20a-67a1-4f86-bf83-0c8121326d7b, portal: 172.16.0.220,3260] successful.
Nov 29 18:23:39 user nova-compute[74613]:  stderr= {{(pid=74613) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 18:23:39 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:006dd20a-67a1-4f86-bf83-0c8121326d7b -p 172.16.0.220:3260 --op delete {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:23:39 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:006dd20a-67a1-4f86-bf83-0c8121326d7b -p 172.16.0.220:3260 --op delete" returned: 0 in 0.021s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:23:39 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[76226e26-b79d-4fac-965e-43cd3d79a17c]: (4, ('', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 18:23:39 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-e285907b-d2da-422c-8e7e-01fdd862b20d tempest-SnapshotDataIntegrityTests-1810787156 tempest-SnapshotDataIntegrityTests-1810787156-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74613) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 18:23:39 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.base [None req-e285907b-d2da-422c-8e7e-01fdd862b20d tempest-SnapshotDataIntegrityTests-1810787156 tempest-SnapshotDataIntegrityTests-1810787156-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.294s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 18:23:39 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-e285907b-d2da-422c-8e7e-01fdd862b20d tempest-SnapshotDataIntegrityTests-1810787156 tempest-SnapshotDataIntegrityTests-1810787156-project-member] <== disconnect_volume: return (295ms) None {{(pid=74613) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 18:23:39 user nova-compute[74613]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e285907b-d2da-422c-8e7e-01fdd862b20d tempest-SnapshotDataIntegrityTests-1810787156 tempest-SnapshotDataIntegrityTests-1810787156-project-member] [instance: 5227902d-b2b9-40a6-988f-3c02c52404f3] Disconnected iSCSI Volume {{(pid=74613) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 29 18:23:39 user nova-compute[74613]: DEBUG oslo_service.periodic_task [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74613) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 18:23:39 user nova-compute[74613]: DEBUG nova.compute.manager [req-e8fad029-e949-4291-b039-8c27c5ee099d req-d5831e5e-44fc-4759-8d75-d95c74153aad service nova] [instance: 465b35fe-8c8c-476c-97b1-feff13778cc1] Received event network-vif-plugged-dce464f3-e0ed-4708-a833-224a83b01f86 {{(pid=74613) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 18:23:39 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-e8fad029-e949-4291-b039-8c27c5ee099d req-d5831e5e-44fc-4759-8d75-d95c74153aad service nova] Acquiring lock "465b35fe-8c8c-476c-97b1-feff13778cc1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 18:23:39 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-e8fad029-e949-4291-b039-8c27c5ee099d req-d5831e5e-44fc-4759-8d75-d95c74153aad service nova] Lock "465b35fe-8c8c-476c-97b1-feff13778cc1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 18:23:39 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-e8fad029-e949-4291-b039-8c27c5ee099d req-d5831e5e-44fc-4759-8d75-d95c74153aad service nova] Lock "465b35fe-8c8c-476c-97b1-feff13778cc1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 18:23:39 user nova-compute[74613]: DEBUG nova.compute.manager [req-e8fad029-e949-4291-b039-8c27c5ee099d req-d5831e5e-44fc-4759-8d75-d95c74153aad service nova] [instance: 465b35fe-8c8c-476c-97b1-feff13778cc1] No waiting events found dispatching network-vif-plugged-dce464f3-e0ed-4708-a833-224a83b01f86 {{(pid=74613) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 18:23:39 user nova-compute[74613]: WARNING nova.compute.manager [req-e8fad029-e949-4291-b039-8c27c5ee099d req-d5831e5e-44fc-4759-8d75-d95c74153aad service nova] [instance: 465b35fe-8c8c-476c-97b1-feff13778cc1] Received unexpected event network-vif-plugged-dce464f3-e0ed-4708-a833-224a83b01f86 for instance with vm_state deleted and task_state None.
Nov 29 18:23:39 user nova-compute[74613]: DEBUG nova.objects.instance [None req-e285907b-d2da-422c-8e7e-01fdd862b20d tempest-SnapshotDataIntegrityTests-1810787156 tempest-SnapshotDataIntegrityTests-1810787156-project-member] Lazy-loading 'flavor' on Instance uuid 5227902d-b2b9-40a6-988f-3c02c52404f3 {{(pid=74613) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 18:23:39 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-e285907b-d2da-422c-8e7e-01fdd862b20d tempest-SnapshotDataIntegrityTests-1810787156 tempest-SnapshotDataIntegrityTests-1810787156-project-member] Lock "5227902d-b2b9-40a6-988f-3c02c52404f3" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.700s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 18:23:41 user nova-compute[74613]: DEBUG oslo_service.periodic_task [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74613) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 18:23:43 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:23:44 user nova-compute[74613]: DEBUG oslo_service.periodic_task [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74613) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 18:23:44 user nova-compute[74613]: DEBUG oslo_service.periodic_task [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74613) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 18:23:44 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 18:23:44 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 18:23:44 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 18:23:44 user nova-compute[74613]: DEBUG nova.compute.resource_tracker [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Auditing locally available compute resources for user (node: user) {{(pid=74613) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 29 18:23:44 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74613) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 29 18:23:44 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5227902d-b2b9-40a6-988f-3c02c52404f3/disk --force-share --output=json {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:23:45 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5227902d-b2b9-40a6-988f-3c02c52404f3/disk --force-share --output=json" returned: 0 in 0.207s {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:23:45 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5227902d-b2b9-40a6-988f-3c02c52404f3/disk --force-share --output=json {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:23:45 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5227902d-b2b9-40a6-988f-3c02c52404f3/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:23:45 user nova-compute[74613]: WARNING nova.virt.libvirt.driver [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 18:23:45 user nova-compute[74613]: WARNING nova.virt.libvirt.driver [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 18:23:45 user nova-compute[74613]: DEBUG nova.compute.resource_tracker [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Hypervisor/Node resource view: name=user free_ram=8682MB free_disk=24.924819946289062GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74613) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 29 18:23:45 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 18:23:45 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 18:23:45 user nova-compute[74613]: DEBUG nova.compute.resource_tracker [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Instance 5227902d-b2b9-40a6-988f-3c02c52404f3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74613) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 18:23:45 user nova-compute[74613]: DEBUG nova.compute.resource_tracker [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Instance 6d839255-e713-4234-8443-6ba0d5635a6e actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74613) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 18:23:45 user nova-compute[74613]: DEBUG nova.compute.resource_tracker [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=74613) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 29 18:23:45 user nova-compute[74613]: DEBUG nova.compute.resource_tracker [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=74613) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 29 18:23:45 user nova-compute[74613]: DEBUG nova.compute.provider_tree [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Inventory has not changed in ProviderTree for provider: 639d980e-3b12-44b1-b8f4-1812416fa4dd {{(pid=74613) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 18:23:45 user nova-compute[74613]: DEBUG nova.scheduler.client.report [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Inventory has not changed for provider 639d980e-3b12-44b1-b8f4-1812416fa4dd based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74613) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 18:23:45 user nova-compute[74613]: DEBUG nova.compute.resource_tracker [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Compute_service record updated for user:user {{(pid=74613) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 29 18:23:45 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.233s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 18:23:46 user nova-compute[74613]: DEBUG oslo_service.periodic_task [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74613) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 18:23:47 user nova-compute[74613]: DEBUG oslo_service.periodic_task [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74613) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 18:23:47 user nova-compute[74613]: DEBUG nova.compute.manager [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Starting heal instance info cache {{(pid=74613) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 29 18:23:47 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Acquiring lock "refresh_cache-6d839255-e713-4234-8443-6ba0d5635a6e" {{(pid=74613) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 18:23:47 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Acquired lock "refresh_cache-6d839255-e713-4234-8443-6ba0d5635a6e" {{(pid=74613) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 18:23:47 user nova-compute[74613]: DEBUG nova.network.neutron [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] [instance: 6d839255-e713-4234-8443-6ba0d5635a6e] Forcefully refreshing network info cache for instance {{(pid=74613) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 29 18:23:48 user nova-compute[74613]: DEBUG nova.network.neutron [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] [instance: 6d839255-e713-4234-8443-6ba0d5635a6e] Updating instance_info_cache with network_info: [{"id": "4e54478e-1eb5-4ae4-8e1a-faa3738f3914", "address": "fa:16:3e:99:af:c8", "network": {"id": "4a5179dd-d0b1-44c3-80c1-08dd7b0152f1", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1296336996-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "67390f1402214191904cfbd68c3142a7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4e54478e-1e", "ovs_interfaceid": "4e54478e-1eb5-4ae4-8e1a-faa3738f3914", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74613) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 18:23:48 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Releasing lock "refresh_cache-6d839255-e713-4234-8443-6ba0d5635a6e" {{(pid=74613) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 18:23:48 user nova-compute[74613]: DEBUG nova.compute.manager [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] [instance: 6d839255-e713-4234-8443-6ba0d5635a6e] Updated the network info_cache for instance {{(pid=74613) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 29 18:23:48 user nova-compute[74613]: DEBUG oslo_service.periodic_task [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74613) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 18:23:48 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:23:48 user nova-compute[74613]: DEBUG oslo_service.periodic_task [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74613) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 18:23:48 user nova-compute[74613]: DEBUG nova.compute.manager [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74613) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 29 18:23:51 user nova-compute[74613]: DEBUG oslo_service.periodic_task [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74613) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 18:23:53 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:23:56 user nova-compute[74613]: DEBUG oslo_service.periodic_task [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74613) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 18:23:58 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 18:23:58 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:23:58 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=74613) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 29 18:23:58 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74613) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 18:23:58 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74613) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 18:23:58 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:24:03 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:24:08 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:24:11 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-48410653-f109-49a2-b352-6af523956e3c tempest-SnapshotDataIntegrityTests-1810787156 tempest-SnapshotDataIntegrityTests-1810787156-project-member] Acquiring lock "5227902d-b2b9-40a6-988f-3c02c52404f3" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 18:24:11 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-48410653-f109-49a2-b352-6af523956e3c tempest-SnapshotDataIntegrityTests-1810787156 tempest-SnapshotDataIntegrityTests-1810787156-project-member] Lock "5227902d-b2b9-40a6-988f-3c02c52404f3" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 18:24:11 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:24:11 user nova-compute[74613]: DEBUG nova.objects.instance [None req-48410653-f109-49a2-b352-6af523956e3c tempest-SnapshotDataIntegrityTests-1810787156 tempest-SnapshotDataIntegrityTests-1810787156-project-member] Lazy-loading 'flavor' on Instance uuid 5227902d-b2b9-40a6-988f-3c02c52404f3 {{(pid=74613) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 18:24:11 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-48410653-f109-49a2-b352-6af523956e3c tempest-SnapshotDataIntegrityTests-1810787156 tempest-SnapshotDataIntegrityTests-1810787156-project-member] Lock "5227902d-b2b9-40a6-988f-3c02c52404f3" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.062s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 18:24:11 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-48410653-f109-49a2-b352-6af523956e3c tempest-SnapshotDataIntegrityTests-1810787156 tempest-SnapshotDataIntegrityTests-1810787156-project-member] Acquiring lock "5227902d-b2b9-40a6-988f-3c02c52404f3" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 18:24:11 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-48410653-f109-49a2-b352-6af523956e3c tempest-SnapshotDataIntegrityTests-1810787156 tempest-SnapshotDataIntegrityTests-1810787156-project-member] Lock "5227902d-b2b9-40a6-988f-3c02c52404f3" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.002s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 18:24:11 user nova-compute[74613]: INFO nova.compute.manager [None req-48410653-f109-49a2-b352-6af523956e3c tempest-SnapshotDataIntegrityTests-1810787156 tempest-SnapshotDataIntegrityTests-1810787156-project-member] [instance: 5227902d-b2b9-40a6-988f-3c02c52404f3] Attaching volume 6c9b7b59-9da2-47b6-a0f0-f533803e54f6 to /dev/vdb
Nov 29 18:24:11 user nova-compute[74613]: DEBUG os_brick.utils [None req-48410653-f109-49a2-b352-6af523956e3c tempest-SnapshotDataIntegrityTests-1810787156 tempest-SnapshotDataIntegrityTests-1810787156-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74613) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 18:24:11 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:24:11 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:24:11 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[afa256f0-3a35-4f75-8d64-5dff3a1410d6]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:400972819b5\n', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 18:24:11 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:24:11 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:24:11 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f16ba4d-829b-43d8-a831-0a655921956f]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 18:24:11 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:24:11 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.014s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:24:11 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb932688-fb64-44e3-8946-78d900a75263]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 18:24:11 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[155c3e1d-1892-49a4-ad4b-f12801b4f9e3]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 18:24:11 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-48410653-f109-49a2-b352-6af523956e3c tempest-SnapshotDataIntegrityTests-1810787156 tempest-SnapshotDataIntegrityTests-1810787156-project-member] Running cmd (subprocess): nvme version {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:24:11 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-48410653-f109-49a2-b352-6af523956e3c tempest-SnapshotDataIntegrityTests-1810787156 tempest-SnapshotDataIntegrityTests-1810787156-project-member] 'nvme version' failed. Not Retrying. {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 18:24:11 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.nvmeof [None req-48410653-f109-49a2-b352-6af523956e3c tempest-SnapshotDataIntegrityTests-1810787156 tempest-SnapshotDataIntegrityTests-1810787156-project-member] nvme not present on system {{(pid=74613) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 29 18:24:11 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:24:11 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 18:24:11 user nova-compute[74613]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 29 18:24:11 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[8aa1eb16-849a-4aee-988c-0d47c8923d00]: (4, '') {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 18:24:11 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.lightos [None req-48410653-f109-49a2-b352-6af523956e3c tempest-SnapshotDataIntegrityTests-1810787156 tempest-SnapshotDataIntegrityTests-1810787156-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74613) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 29 18:24:11 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.lightos [None req-48410653-f109-49a2-b352-6af523956e3c tempest-SnapshotDataIntegrityTests-1810787156 tempest-SnapshotDataIntegrityTests-1810787156-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74613) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 29 18:24:11 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.lightos [None req-48410653-f109-49a2-b352-6af523956e3c tempest-SnapshotDataIntegrityTests-1810787156 tempest-SnapshotDataIntegrityTests-1810787156-project-member] LIGHTOS: no hostnqn found. {{(pid=74613) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 29 18:24:11 user nova-compute[74613]: DEBUG os_brick.utils [None req-48410653-f109-49a2-b352-6af523956e3c tempest-SnapshotDataIntegrityTests-1810787156 tempest-SnapshotDataIntegrityTests-1810787156-project-member] <== get_connector_properties: return (136ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:400972819b5', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74613) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 18:24:11 user nova-compute[74613]: DEBUG nova.virt.block_device [None req-48410653-f109-49a2-b352-6af523956e3c tempest-SnapshotDataIntegrityTests-1810787156 tempest-SnapshotDataIntegrityTests-1810787156-project-member] [instance: 5227902d-b2b9-40a6-988f-3c02c52404f3] Updating existing volume attachment record: 1636c62a-1cb1-4142-8208-d36c21e98e2c {{(pid=74613) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 29 18:24:13 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:24:16 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:24:18 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:24:18 user nova-compute[74613]: DEBUG nova.virt.libvirt.volume.iscsi [None req-48410653-f109-49a2-b352-6af523956e3c tempest-SnapshotDataIntegrityTests-1810787156 tempest-SnapshotDataIntegrityTests-1810787156-project-member] [instance: 5227902d-b2b9-40a6-988f-3c02c52404f3] Calling os-brick to attach iSCSI Volume {{(pid=74613) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 29 18:24:18 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-48410653-f109-49a2-b352-6af523956e3c tempest-SnapshotDataIntegrityTests-1810787156 tempest-SnapshotDataIntegrityTests-1810787156-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff828156890>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:6c9b7b59-9da2-47b6-a0f0-f533803e54f6', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'aNRXefsz', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74613) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 18:24:18 user nova-compute[74613]: WARNING os_brick.initiator.connectors.base [None req-48410653-f109-49a2-b352-6af523956e3c tempest-SnapshotDataIntegrityTests-1810787156 tempest-SnapshotDataIntegrityTests-1810787156-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 18:24:18 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.base [None req-48410653-f109-49a2-b352-6af523956e3c tempest-SnapshotDataIntegrityTests-1810787156 tempest-SnapshotDataIntegrityTests-1810787156-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 18:24:18 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.base [None req-48410653-f109-49a2-b352-6af523956e3c tempest-SnapshotDataIntegrityTests-1810787156 tempest-SnapshotDataIntegrityTests-1810787156-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 18:24:18 user nova-compute[74613]: WARNING os_brick.initiator.connectors.base [None req-48410653-f109-49a2-b352-6af523956e3c tempest-SnapshotDataIntegrityTests-1810787156 tempest-SnapshotDataIntegrityTests-1810787156-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 18:24:18 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.base [None req-48410653-f109-49a2-b352-6af523956e3c tempest-SnapshotDataIntegrityTests-1810787156 tempest-SnapshotDataIntegrityTests-1810787156-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6c9b7b59-9da2-47b6-a0f0-f533803e54f6" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 18:24:18 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.base [None req-48410653-f109-49a2-b352-6af523956e3c tempest-SnapshotDataIntegrityTests-1810787156 tempest-SnapshotDataIntegrityTests-1810787156-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6c9b7b59-9da2-47b6-a0f0-f533803e54f6" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 18:24:18 user nova-compute[74613]: INFO os_brick.initiator.connectors.iscsi [None req-48410653-f109-49a2-b352-6af523956e3c tempest-SnapshotDataIntegrityTests-1810787156 tempest-SnapshotDataIntegrityTests-1810787156-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 29 18:24:18 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6c9b7b59-9da2-47b6-a0f0-f533803e54f6 -p 172.16.0.220:3260 {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:24:18 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6c9b7b59-9da2-47b6-a0f0-f533803e54f6 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:24:18 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5ff6e06-9db0-4112-8b9a-f9be2ba2d9f8]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 18:24:18 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-48410653-f109-49a2-b352-6af523956e3c tempest-SnapshotDataIntegrityTests-1810787156 tempest-SnapshotDataIntegrityTests-1810787156-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 29 18:24:18 user nova-compute[74613]:  {{(pid=74613) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 18:24:18 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6c9b7b59-9da2-47b6-a0f0-f533803e54f6 -p 172.16.0.220:3260 --interface default --op new {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:24:18 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6c9b7b59-9da2-47b6-a0f0-f533803e54f6 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:24:18 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[52bd58cb-5309-4be5-b0d4-e8f56627b9e1]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:6c9b7b59-9da2-47b6-a0f0-f533803e54f6] added\n', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 18:24:18 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-48410653-f109-49a2-b352-6af523956e3c tempest-SnapshotDataIntegrityTests-1810787156 tempest-SnapshotDataIntegrityTests-1810787156-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:6c9b7b59-9da2-47b6-a0f0-f533803e54f6] added
Nov 29 18:24:18 user nova-compute[74613]:  stderr= {{(pid=74613) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 18:24:18 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6c9b7b59-9da2-47b6-a0f0-f533803e54f6 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:24:18 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6c9b7b59-9da2-47b6-a0f0-f533803e54f6 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:24:18 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e11c6e9-314b-47d1-b3f4-4b590218418f]: (4, ('', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 18:24:18 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-48410653-f109-49a2-b352-6af523956e3c tempest-SnapshotDataIntegrityTests-1810787156 tempest-SnapshotDataIntegrityTests-1810787156-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74613) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 18:24:18 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6c9b7b59-9da2-47b6-a0f0-f533803e54f6 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:24:18 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6c9b7b59-9da2-47b6-a0f0-f533803e54f6 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:24:18 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[ffc3eff3-1871-4716-b566-eac1b001b638]: (4, ('', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 18:24:18 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-48410653-f109-49a2-b352-6af523956e3c tempest-SnapshotDataIntegrityTests-1810787156 tempest-SnapshotDataIntegrityTests-1810787156-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74613) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 18:24:18 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6c9b7b59-9da2-47b6-a0f0-f533803e54f6 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v aNRXefsz {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:24:18 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6c9b7b59-9da2-47b6-a0f0-f533803e54f6 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v aNRXefsz" returned: 0 in 0.017s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:24:18 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[466815ba-2083-4eae-b366-68a12e3e558c]: (4, ('', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 18:24:18 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-48410653-f109-49a2-b352-6af523956e3c tempest-SnapshotDataIntegrityTests-1810787156 tempest-SnapshotDataIntegrityTests-1810787156-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'aNRXefsz'): stdout= stderr= {{(pid=74613) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 18:24:18 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6c9b7b59-9da2-47b6-a0f0-f533803e54f6 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:24:18 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6c9b7b59-9da2-47b6-a0f0-f533803e54f6 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.050s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:24:18 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e1e0584-3318-4f5a-b4e5-2ea43e1613ee]: (4, ('', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 18:24:18 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-48410653-f109-49a2-b352-6af523956e3c tempest-SnapshotDataIntegrityTests-1810787156 tempest-SnapshotDataIntegrityTests-1810787156-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74613) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 18:24:18 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:24:18 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:24:18 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[1514fa9f-b8a5-4391-8781-ea5cfe6624e6]: (4, ('tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f39cfde-47c7-4b9f-83d3-13c147be6792 (non-flash)\n', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 18:24:18 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-48410653-f109-49a2-b352-6af523956e3c tempest-SnapshotDataIntegrityTests-1810787156 tempest-SnapshotDataIntegrityTests-1810787156-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f39cfde-47c7-4b9f-83d3-13c147be6792 (non-flash)
Nov 29 18:24:18 user nova-compute[74613]:  stderr= {{(pid=74613) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 18:24:18 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-48410653-f109-49a2-b352-6af523956e3c tempest-SnapshotDataIntegrityTests-1810787156 tempest-SnapshotDataIntegrityTests-1810787156-project-member] iscsi session list stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f39cfde-47c7-4b9f-83d3-13c147be6792 (non-flash)
Nov 29 18:24:18 user nova-compute[74613]:  stderr= {{(pid=74613) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 18:24:18 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6c9b7b59-9da2-47b6-a0f0-f533803e54f6 -p 172.16.0.220:3260 --login {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:24:18 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6c9b7b59-9da2-47b6-a0f0-f533803e54f6 -p 172.16.0.220:3260 --login" returned: 0 in 0.051s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:24:18 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[d78500bf-b1ae-4e2f-b81f-a7a6ffc37997]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:6c9b7b59-9da2-47b6-a0f0-f533803e54f6, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:6c9b7b59-9da2-47b6-a0f0-f533803e54f6, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 18:24:18 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-48410653-f109-49a2-b352-6af523956e3c tempest-SnapshotDataIntegrityTests-1810787156 tempest-SnapshotDataIntegrityTests-1810787156-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:6c9b7b59-9da2-47b6-a0f0-f533803e54f6, portal: 172.16.0.220,3260]
Nov 29 18:24:18 user nova-compute[74613]: Login to [iface: default, target: iqn.2010-10.org.openstack:6c9b7b59-9da2-47b6-a0f0-f533803e54f6, portal: 172.16.0.220,3260] successful.
Nov 29 18:24:18 user nova-compute[74613]:  stderr= {{(pid=74613) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 18:24:18 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6c9b7b59-9da2-47b6-a0f0-f533803e54f6 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:24:18 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6c9b7b59-9da2-47b6-a0f0-f533803e54f6 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:24:18 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[abd7aabe-7b21-496b-a5da-acacfa6cad7b]: (4, ('', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 18:24:18 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-48410653-f109-49a2-b352-6af523956e3c tempest-SnapshotDataIntegrityTests-1810787156 tempest-SnapshotDataIntegrityTests-1810787156-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74613) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 18:24:18 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:24:19 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:24:19 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[5be719b8-b40f-4e12-bd7b-4513aee764b9]: (4, ('tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f39cfde-47c7-4b9f-83d3-13c147be6792 (non-flash)\ntcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c9b7b59-9da2-47b6-a0f0-f533803e54f6 (non-flash)\n', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 18:24:19 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-48410653-f109-49a2-b352-6af523956e3c tempest-SnapshotDataIntegrityTests-1810787156 tempest-SnapshotDataIntegrityTests-1810787156-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f39cfde-47c7-4b9f-83d3-13c147be6792 (non-flash)
Nov 29 18:24:19 user nova-compute[74613]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c9b7b59-9da2-47b6-a0f0-f533803e54f6 (non-flash)
Nov 29 18:24:19 user nova-compute[74613]:  stderr= {{(pid=74613) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 18:24:19 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-48410653-f109-49a2-b352-6af523956e3c tempest-SnapshotDataIntegrityTests-1810787156 tempest-SnapshotDataIntegrityTests-1810787156-project-member] iscsi session list stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f39cfde-47c7-4b9f-83d3-13c147be6792 (non-flash)
Nov 29 18:24:19 user nova-compute[74613]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c9b7b59-9da2-47b6-a0f0-f533803e54f6 (non-flash)
Nov 29 18:24:19 user nova-compute[74613]:  stderr= {{(pid=74613) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 18:24:19 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.base [None req-48410653-f109-49a2-b352-6af523956e3c tempest-SnapshotDataIntegrityTests-1810787156 tempest-SnapshotDataIntegrityTests-1810787156-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6c9b7b59-9da2-47b6-a0f0-f533803e54f6" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.297s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 18:24:19 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-48410653-f109-49a2-b352-6af523956e3c tempest-SnapshotDataIntegrityTests-1810787156 tempest-SnapshotDataIntegrityTests-1810787156-project-member] Connected to 172.16.0.220:3260 {{(pid=74613) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 29 18:24:19 user nova-compute[74613]: DEBUG os_brick.initiator.linuxscsi [None req-48410653-f109-49a2-b352-6af523956e3c tempest-SnapshotDataIntegrityTests-1810787156 tempest-SnapshotDataIntegrityTests-1810787156-project-member] HCTL ('34', '-', '-', 0) found on session 52 with lun 0 {{(pid=74613) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 29 18:24:19 user nova-compute[74613]: DEBUG os_brick.initiator.linuxscsi [None req-48410653-f109-49a2-b352-6af523956e3c tempest-SnapshotDataIntegrityTests-1810787156 tempest-SnapshotDataIntegrityTests-1810787156-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=74613) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 29 18:24:19 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:24:19 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.015s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:24:19 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[798e8a90-ee8b-4ed9-a5ec-85b4bc2f2302]: (4, ('- - 0', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 18:24:19 user nova-compute[74613]: DEBUG os_brick.initiator.linuxscsi [None req-48410653-f109-49a2-b352-6af523956e3c tempest-SnapshotDataIntegrityTests-1810787156 tempest-SnapshotDataIntegrityTests-1810787156-project-member] Searching for a device in session 52 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=74613) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 29 18:24:19 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-48410653-f109-49a2-b352-6af523956e3c tempest-SnapshotDataIntegrityTests-1810787156 tempest-SnapshotDataIntegrityTests-1810787156-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:6c9b7b59-9da2-47b6-a0f0-f533803e54f6', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'aNRXefsz', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74613) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 29 18:24:20 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.base [None req-48410653-f109-49a2-b352-6af523956e3c tempest-SnapshotDataIntegrityTests-1810787156 tempest-SnapshotDataIntegrityTests-1810787156-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.328s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 18:24:20 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-48410653-f109-49a2-b352-6af523956e3c tempest-SnapshotDataIntegrityTests-1810787156 tempest-SnapshotDataIntegrityTests-1810787156-project-member] <== connect_volume: return (1330ms) {'type': 'block', 'scsi_wwn': '23133376164383666', 'path': '/dev/sdc'} {{(pid=74613) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 18:24:20 user nova-compute[74613]: DEBUG nova.virt.libvirt.volume.iscsi [None req-48410653-f109-49a2-b352-6af523956e3c tempest-SnapshotDataIntegrityTests-1810787156 tempest-SnapshotDataIntegrityTests-1810787156-project-member] [instance: 5227902d-b2b9-40a6-988f-3c02c52404f3] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23133376164383666', 'path': '/dev/sdc'} {{(pid=74613) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 29 18:24:20 user nova-compute[74613]: DEBUG nova.objects.instance [None req-48410653-f109-49a2-b352-6af523956e3c tempest-SnapshotDataIntegrityTests-1810787156 tempest-SnapshotDataIntegrityTests-1810787156-project-member] Lazy-loading 'flavor' on Instance uuid 5227902d-b2b9-40a6-988f-3c02c52404f3 {{(pid=74613) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 18:24:20 user nova-compute[74613]: DEBUG nova.virt.libvirt.guest [None req-48410653-f109-49a2-b352-6af523956e3c tempest-SnapshotDataIntegrityTests-1810787156 tempest-SnapshotDataIntegrityTests-1810787156-project-member] attach device xml: <disk type="block" device="disk">
Nov 29 18:24:20 user nova-compute[74613]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 18:24:20 user nova-compute[74613]:   <source dev="/dev/sdc"/>
Nov 29 18:24:20 user nova-compute[74613]:   <target dev="vdb" bus="virtio"/>
Nov 29 18:24:20 user nova-compute[74613]:   <serial>6c9b7b59-9da2-47b6-a0f0-f533803e54f6</serial>
Nov 29 18:24:20 user nova-compute[74613]: </disk>
Nov 29 18:24:20 user nova-compute[74613]:  {{(pid=74613) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 29 18:24:20 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-48410653-f109-49a2-b352-6af523956e3c tempest-SnapshotDataIntegrityTests-1810787156 tempest-SnapshotDataIntegrityTests-1810787156-project-member] No BDM found with device name vda, not building metadata. {{(pid=74613) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 18:24:20 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-48410653-f109-49a2-b352-6af523956e3c tempest-SnapshotDataIntegrityTests-1810787156 tempest-SnapshotDataIntegrityTests-1810787156-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74613) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 18:24:20 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-48410653-f109-49a2-b352-6af523956e3c tempest-SnapshotDataIntegrityTests-1810787156 tempest-SnapshotDataIntegrityTests-1810787156-project-member] No VIF found with MAC fa:16:3e:40:72:ca, not building metadata {{(pid=74613) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 29 18:24:20 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-48410653-f109-49a2-b352-6af523956e3c tempest-SnapshotDataIntegrityTests-1810787156 tempest-SnapshotDataIntegrityTests-1810787156-project-member] Lock "5227902d-b2b9-40a6-988f-3c02c52404f3" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 9.084s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 18:24:21 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:24:22 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-88754764-c394-467f-8a26-9015a42c7c1d tempest-SnapshotDataIntegrityTests-1810787156 tempest-SnapshotDataIntegrityTests-1810787156-project-member] Acquiring lock "5227902d-b2b9-40a6-988f-3c02c52404f3" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 18:24:22 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-88754764-c394-467f-8a26-9015a42c7c1d tempest-SnapshotDataIntegrityTests-1810787156 tempest-SnapshotDataIntegrityTests-1810787156-project-member] Lock "5227902d-b2b9-40a6-988f-3c02c52404f3" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 18:24:22 user nova-compute[74613]: INFO nova.compute.manager [None req-88754764-c394-467f-8a26-9015a42c7c1d tempest-SnapshotDataIntegrityTests-1810787156 tempest-SnapshotDataIntegrityTests-1810787156-project-member] [instance: 5227902d-b2b9-40a6-988f-3c02c52404f3] Detaching volume 6c9b7b59-9da2-47b6-a0f0-f533803e54f6
Nov 29 18:24:22 user nova-compute[74613]: INFO nova.virt.block_device [None req-88754764-c394-467f-8a26-9015a42c7c1d tempest-SnapshotDataIntegrityTests-1810787156 tempest-SnapshotDataIntegrityTests-1810787156-project-member] [instance: 5227902d-b2b9-40a6-988f-3c02c52404f3] Attempting to driver detach volume 6c9b7b59-9da2-47b6-a0f0-f533803e54f6 from mountpoint /dev/vdb
Nov 29 18:24:22 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-88754764-c394-467f-8a26-9015a42c7c1d tempest-SnapshotDataIntegrityTests-1810787156 tempest-SnapshotDataIntegrityTests-1810787156-project-member] Attempting to detach device vdb from instance 5227902d-b2b9-40a6-988f-3c02c52404f3 from the persistent domain config. {{(pid=74613) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 29 18:24:22 user nova-compute[74613]: DEBUG nova.virt.libvirt.guest [None req-88754764-c394-467f-8a26-9015a42c7c1d tempest-SnapshotDataIntegrityTests-1810787156 tempest-SnapshotDataIntegrityTests-1810787156-project-member] detach device xml: <disk type="block" device="disk">
Nov 29 18:24:22 user nova-compute[74613]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 18:24:22 user nova-compute[74613]:   <source dev="/dev/sdc"/>
Nov 29 18:24:22 user nova-compute[74613]:   <target dev="vdb" bus="virtio"/>
Nov 29 18:24:22 user nova-compute[74613]:   <serial>6c9b7b59-9da2-47b6-a0f0-f533803e54f6</serial>
Nov 29 18:24:22 user nova-compute[74613]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 29 18:24:22 user nova-compute[74613]: </disk>
Nov 29 18:24:22 user nova-compute[74613]:  {{(pid=74613) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 29 18:24:22 user nova-compute[74613]: INFO nova.virt.libvirt.driver [None req-88754764-c394-467f-8a26-9015a42c7c1d tempest-SnapshotDataIntegrityTests-1810787156 tempest-SnapshotDataIntegrityTests-1810787156-project-member] Successfully detached device vdb from instance 5227902d-b2b9-40a6-988f-3c02c52404f3 from the persistent domain config.
Nov 29 18:24:22 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-88754764-c394-467f-8a26-9015a42c7c1d tempest-SnapshotDataIntegrityTests-1810787156 tempest-SnapshotDataIntegrityTests-1810787156-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 5227902d-b2b9-40a6-988f-3c02c52404f3 from the live domain config. {{(pid=74613) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 29 18:24:22 user nova-compute[74613]: DEBUG nova.virt.libvirt.guest [None req-88754764-c394-467f-8a26-9015a42c7c1d tempest-SnapshotDataIntegrityTests-1810787156 tempest-SnapshotDataIntegrityTests-1810787156-project-member] detach device xml: <disk type="block" device="disk">
Nov 29 18:24:22 user nova-compute[74613]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 18:24:22 user nova-compute[74613]:   <source dev="/dev/sdc"/>
Nov 29 18:24:22 user nova-compute[74613]:   <target dev="vdb" bus="virtio"/>
Nov 29 18:24:22 user nova-compute[74613]:   <serial>6c9b7b59-9da2-47b6-a0f0-f533803e54f6</serial>
Nov 29 18:24:22 user nova-compute[74613]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 29 18:24:22 user nova-compute[74613]: </disk>
Nov 29 18:24:22 user nova-compute[74613]:  {{(pid=74613) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 29 18:24:23 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:24:23 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-88754764-c394-467f-8a26-9015a42c7c1d tempest-SnapshotDataIntegrityTests-1810787156 tempest-SnapshotDataIntegrityTests-1810787156-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 5227902d-b2b9-40a6-988f-3c02c52404f3 {{(pid=74613) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 29 18:24:26 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:24:26 user nova-compute[74613]: DEBUG nova.compute.manager [req-160871aa-6d61-4441-ae35-cc9bdf90f6e7 req-c8dae7c3-4220-44cb-9a6d-0873a180a063 service nova] [instance: 6d839255-e713-4234-8443-6ba0d5635a6e] Received event network-changed-4e54478e-1eb5-4ae4-8e1a-faa3738f3914 {{(pid=74613) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 18:24:26 user nova-compute[74613]: DEBUG nova.compute.manager [req-160871aa-6d61-4441-ae35-cc9bdf90f6e7 req-c8dae7c3-4220-44cb-9a6d-0873a180a063 service nova] [instance: 6d839255-e713-4234-8443-6ba0d5635a6e] Refreshing instance network info cache due to event network-changed-4e54478e-1eb5-4ae4-8e1a-faa3738f3914. {{(pid=74613) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 18:24:26 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-160871aa-6d61-4441-ae35-cc9bdf90f6e7 req-c8dae7c3-4220-44cb-9a6d-0873a180a063 service nova] Acquiring lock "refresh_cache-6d839255-e713-4234-8443-6ba0d5635a6e" {{(pid=74613) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 18:24:26 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-160871aa-6d61-4441-ae35-cc9bdf90f6e7 req-c8dae7c3-4220-44cb-9a6d-0873a180a063 service nova] Acquired lock "refresh_cache-6d839255-e713-4234-8443-6ba0d5635a6e" {{(pid=74613) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 18:24:26 user nova-compute[74613]: DEBUG nova.network.neutron [req-160871aa-6d61-4441-ae35-cc9bdf90f6e7 req-c8dae7c3-4220-44cb-9a6d-0873a180a063 service nova] [instance: 6d839255-e713-4234-8443-6ba0d5635a6e] Refreshing network info cache for port 4e54478e-1eb5-4ae4-8e1a-faa3738f3914 {{(pid=74613) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 18:24:26 user nova-compute[74613]: DEBUG nova.network.neutron [req-160871aa-6d61-4441-ae35-cc9bdf90f6e7 req-c8dae7c3-4220-44cb-9a6d-0873a180a063 service nova] [instance: 6d839255-e713-4234-8443-6ba0d5635a6e] Updated VIF entry in instance network info cache for port 4e54478e-1eb5-4ae4-8e1a-faa3738f3914. {{(pid=74613) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 18:24:26 user nova-compute[74613]: DEBUG nova.network.neutron [req-160871aa-6d61-4441-ae35-cc9bdf90f6e7 req-c8dae7c3-4220-44cb-9a6d-0873a180a063 service nova] [instance: 6d839255-e713-4234-8443-6ba0d5635a6e] Updating instance_info_cache with network_info: [{"id": "4e54478e-1eb5-4ae4-8e1a-faa3738f3914", "address": "fa:16:3e:99:af:c8", "network": {"id": "4a5179dd-d0b1-44c3-80c1-08dd7b0152f1", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1296336996-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.17", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "67390f1402214191904cfbd68c3142a7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4e54478e-1e", "ovs_interfaceid": "4e54478e-1eb5-4ae4-8e1a-faa3738f3914", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74613) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 18:24:27 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-160871aa-6d61-4441-ae35-cc9bdf90f6e7 req-c8dae7c3-4220-44cb-9a6d-0873a180a063 service nova] Releasing lock "refresh_cache-6d839255-e713-4234-8443-6ba0d5635a6e" {{(pid=74613) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 18:24:28 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:24:28 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-3202cd81-6bb9-4d5b-9159-a6dc2999ab72 tempest-TestVolumeBootPattern-1318569205 tempest-TestVolumeBootPattern-1318569205-project-member] Acquiring lock "6d839255-e713-4234-8443-6ba0d5635a6e" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 18:24:28 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-3202cd81-6bb9-4d5b-9159-a6dc2999ab72 tempest-TestVolumeBootPattern-1318569205 tempest-TestVolumeBootPattern-1318569205-project-member] Lock "6d839255-e713-4234-8443-6ba0d5635a6e" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 18:24:28 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-3202cd81-6bb9-4d5b-9159-a6dc2999ab72 tempest-TestVolumeBootPattern-1318569205 tempest-TestVolumeBootPattern-1318569205-project-member] Acquiring lock "6d839255-e713-4234-8443-6ba0d5635a6e-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 18:24:28 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-3202cd81-6bb9-4d5b-9159-a6dc2999ab72 tempest-TestVolumeBootPattern-1318569205 tempest-TestVolumeBootPattern-1318569205-project-member] Lock "6d839255-e713-4234-8443-6ba0d5635a6e-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 18:24:28 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-3202cd81-6bb9-4d5b-9159-a6dc2999ab72 tempest-TestVolumeBootPattern-1318569205 tempest-TestVolumeBootPattern-1318569205-project-member] Lock "6d839255-e713-4234-8443-6ba0d5635a6e-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 18:24:28 user nova-compute[74613]: INFO nova.compute.manager [None req-3202cd81-6bb9-4d5b-9159-a6dc2999ab72 tempest-TestVolumeBootPattern-1318569205 tempest-TestVolumeBootPattern-1318569205-project-member] [instance: 6d839255-e713-4234-8443-6ba0d5635a6e] Terminating instance
Nov 29 18:24:28 user nova-compute[74613]: DEBUG nova.compute.manager [None req-3202cd81-6bb9-4d5b-9159-a6dc2999ab72 tempest-TestVolumeBootPattern-1318569205 tempest-TestVolumeBootPattern-1318569205-project-member] [instance: 6d839255-e713-4234-8443-6ba0d5635a6e] Start destroying the instance on the hypervisor. {{(pid=74613) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 29 18:24:28 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:24:28 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:24:28 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:24:28 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:24:28 user nova-compute[74613]: DEBUG nova.compute.manager [req-348c5f28-13fb-4428-bd62-7e8d749f65f3 req-a19e9a43-c30d-4f2b-a3d3-50f56601530a service nova] [instance: 6d839255-e713-4234-8443-6ba0d5635a6e] Received event network-vif-unplugged-4e54478e-1eb5-4ae4-8e1a-faa3738f3914 {{(pid=74613) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 18:24:28 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-348c5f28-13fb-4428-bd62-7e8d749f65f3 req-a19e9a43-c30d-4f2b-a3d3-50f56601530a service nova] Acquiring lock "6d839255-e713-4234-8443-6ba0d5635a6e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 18:24:28 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-348c5f28-13fb-4428-bd62-7e8d749f65f3 req-a19e9a43-c30d-4f2b-a3d3-50f56601530a service nova] Lock "6d839255-e713-4234-8443-6ba0d5635a6e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 18:24:28 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-348c5f28-13fb-4428-bd62-7e8d749f65f3 req-a19e9a43-c30d-4f2b-a3d3-50f56601530a service nova] Lock "6d839255-e713-4234-8443-6ba0d5635a6e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 18:24:28 user nova-compute[74613]: DEBUG nova.compute.manager [req-348c5f28-13fb-4428-bd62-7e8d749f65f3 req-a19e9a43-c30d-4f2b-a3d3-50f56601530a service nova] [instance: 6d839255-e713-4234-8443-6ba0d5635a6e] No waiting events found dispatching network-vif-unplugged-4e54478e-1eb5-4ae4-8e1a-faa3738f3914 {{(pid=74613) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 18:24:28 user nova-compute[74613]: DEBUG nova.compute.manager [req-348c5f28-13fb-4428-bd62-7e8d749f65f3 req-a19e9a43-c30d-4f2b-a3d3-50f56601530a service nova] [instance: 6d839255-e713-4234-8443-6ba0d5635a6e] Received event network-vif-unplugged-4e54478e-1eb5-4ae4-8e1a-faa3738f3914 for instance with task_state deleting. {{(pid=74613) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 29 18:24:28 user nova-compute[74613]: INFO nova.virt.libvirt.driver [-] [instance: 6d839255-e713-4234-8443-6ba0d5635a6e] Instance destroyed successfully.
Nov 29 18:24:28 user nova-compute[74613]: DEBUG nova.objects.instance [None req-3202cd81-6bb9-4d5b-9159-a6dc2999ab72 tempest-TestVolumeBootPattern-1318569205 tempest-TestVolumeBootPattern-1318569205-project-member] Lazy-loading 'resources' on Instance uuid 6d839255-e713-4234-8443-6ba0d5635a6e {{(pid=74613) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 18:24:28 user nova-compute[74613]: DEBUG nova.virt.libvirt.vif [None req-3202cd81-6bb9-4d5b-9159-a6dc2999ab72 tempest-TestVolumeBootPattern-1318569205 tempest-TestVolumeBootPattern-1318569205-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T18:22:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-8068559',display_name='tempest-TestVolumeBootPattern-server-8068559',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-8068559',id=46,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBF68W8p1zDe0zv1nt+x55p88jNtkp+KefAo7j9aGY4lI4rRNz+cx5GFQLxMQlgNyvRcFIVQErVtli+AYTX2wE/wzDsGd1AkTeB1AuDgBox6TZ+l5dYZcMLLtIJDQcAEEBg==',key_name='tempest-TestVolumeBootPattern-792688502',keypairs=<?>,launch_index=0,launched_at=2023-11-29T18:22:48Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='67390f1402214191904cfbd68c3142a7',ramdisk_id='',reservation_id='r-1z0h3gcd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-1318569205',owner_user_name='tempest-TestVolumeBootPattern-1318569205-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-29T18:22:49Z,user_data=None,user_id='bedbc6ed47394e2b9125543a8b88a71f',uuid=6d839255-e713-4234-8443-6ba0d5635a6e,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "4e54478e-1eb5-4ae4-8e1a-faa3738f3914", "address": "fa:16:3e:99:af:c8", "network": {"id": "4a5179dd-d0b1-44c3-80c1-08dd7b0152f1", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1296336996-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.17", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "67390f1402214191904cfbd68c3142a7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4e54478e-1e", "ovs_interfaceid": "4e54478e-1eb5-4ae4-8e1a-faa3738f3914", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74613) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 29 18:24:28 user nova-compute[74613]: DEBUG nova.network.os_vif_util [None req-3202cd81-6bb9-4d5b-9159-a6dc2999ab72 tempest-TestVolumeBootPattern-1318569205 tempest-TestVolumeBootPattern-1318569205-project-member] Converting VIF {"id": "4e54478e-1eb5-4ae4-8e1a-faa3738f3914", "address": "fa:16:3e:99:af:c8", "network": {"id": "4a5179dd-d0b1-44c3-80c1-08dd7b0152f1", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1296336996-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.17", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "67390f1402214191904cfbd68c3142a7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4e54478e-1e", "ovs_interfaceid": "4e54478e-1eb5-4ae4-8e1a-faa3738f3914", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74613) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 18:24:28 user nova-compute[74613]: DEBUG nova.network.os_vif_util [None req-3202cd81-6bb9-4d5b-9159-a6dc2999ab72 tempest-TestVolumeBootPattern-1318569205 tempest-TestVolumeBootPattern-1318569205-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:99:af:c8,bridge_name='br-int',has_traffic_filtering=True,id=4e54478e-1eb5-4ae4-8e1a-faa3738f3914,network=Network(4a5179dd-d0b1-44c3-80c1-08dd7b0152f1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4e54478e-1e') {{(pid=74613) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 18:24:28 user nova-compute[74613]: DEBUG os_vif [None req-3202cd81-6bb9-4d5b-9159-a6dc2999ab72 tempest-TestVolumeBootPattern-1318569205 tempest-TestVolumeBootPattern-1318569205-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:99:af:c8,bridge_name='br-int',has_traffic_filtering=True,id=4e54478e-1eb5-4ae4-8e1a-faa3738f3914,network=Network(4a5179dd-d0b1-44c3-80c1-08dd7b0152f1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4e54478e-1e') {{(pid=74613) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 29 18:24:28 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:24:28 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap4e54478e-1e, bridge=br-int, if_exists=True) {{(pid=74613) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 18:24:28 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:24:28 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 18:24:28 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:24:28 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=0276985a-0843-42c5-8962-dcf8f9694a4d) {{(pid=74613) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 18:24:28 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:24:28 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 18:24:28 user nova-compute[74613]: INFO os_vif [None req-3202cd81-6bb9-4d5b-9159-a6dc2999ab72 tempest-TestVolumeBootPattern-1318569205 tempest-TestVolumeBootPattern-1318569205-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:99:af:c8,bridge_name='br-int',has_traffic_filtering=True,id=4e54478e-1eb5-4ae4-8e1a-faa3738f3914,network=Network(4a5179dd-d0b1-44c3-80c1-08dd7b0152f1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4e54478e-1e')
Nov 29 18:24:28 user nova-compute[74613]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3202cd81-6bb9-4d5b-9159-a6dc2999ab72 tempest-TestVolumeBootPattern-1318569205 tempest-TestVolumeBootPattern-1318569205-project-member] [instance: 6d839255-e713-4234-8443-6ba0d5635a6e] calling os-brick to detach iSCSI Volume {{(pid=74613) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 29 18:24:28 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-3202cd81-6bb9-4d5b-9159-a6dc2999ab72 tempest-TestVolumeBootPattern-1318569205 tempest-TestVolumeBootPattern-1318569205-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff828156890>, {'target_iqn': 'iqn.2010-10.org.openstack:6f39cfde-47c7-4b9f-83d3-13c147be6792', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XJWrqIuP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=74613) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 18:24:28 user nova-compute[74613]: WARNING os_brick.initiator.connectors.base [None req-3202cd81-6bb9-4d5b-9159-a6dc2999ab72 tempest-TestVolumeBootPattern-1318569205 tempest-TestVolumeBootPattern-1318569205-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 18:24:28 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.base [None req-3202cd81-6bb9-4d5b-9159-a6dc2999ab72 tempest-TestVolumeBootPattern-1318569205 tempest-TestVolumeBootPattern-1318569205-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 18:24:28 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.base [None req-3202cd81-6bb9-4d5b-9159-a6dc2999ab72 tempest-TestVolumeBootPattern-1318569205 tempest-TestVolumeBootPattern-1318569205-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 18:24:28 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:24:28 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:24:28 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5582e98-d870-4cc0-8acb-837c0ef27d74]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:6c9b7b59-9da2-47b6-a0f0-f533803e54f6\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:6f39cfde-47c7-4b9f-83d3-13c147be6792\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 18:24:28 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-3202cd81-6bb9-4d5b-9159-a6dc2999ab72 tempest-TestVolumeBootPattern-1318569205 tempest-TestVolumeBootPattern-1318569205-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 29 18:24:28 user nova-compute[74613]: No targets found.
Nov 29 18:24:28 user nova-compute[74613]: iSNS:
Nov 29 18:24:28 user nova-compute[74613]: No targets found.
Nov 29 18:24:28 user nova-compute[74613]: STATIC:
Nov 29 18:24:28 user nova-compute[74613]: Target: iqn.2010-10.org.openstack:6c9b7b59-9da2-47b6-a0f0-f533803e54f6
Nov 29 18:24:28 user nova-compute[74613]:         Portal: 172.16.0.220:3260,-1
Nov 29 18:24:28 user nova-compute[74613]:                 Iface Name: default
Nov 29 18:24:28 user nova-compute[74613]: Target: iqn.2010-10.org.openstack:6f39cfde-47c7-4b9f-83d3-13c147be6792
Nov 29 18:24:28 user nova-compute[74613]:         Portal: 172.16.0.220:3260,-1
Nov 29 18:24:28 user nova-compute[74613]:                 Iface Name: default
Nov 29 18:24:28 user nova-compute[74613]: FIRMWARE:
Nov 29 18:24:28 user nova-compute[74613]: No targets found.
Nov 29 18:24:28 user nova-compute[74613]:  stderr= {{(pid=74613) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 18:24:28 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-3202cd81-6bb9-4d5b-9159-a6dc2999ab72 tempest-TestVolumeBootPattern-1318569205 tempest-TestVolumeBootPattern-1318569205-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 29 18:24:28 user nova-compute[74613]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 29 18:24:28 user nova-compute[74613]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74613) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 29 18:24:28 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-3202cd81-6bb9-4d5b-9159-a6dc2999ab72 tempest-TestVolumeBootPattern-1318569205 tempest-TestVolumeBootPattern-1318569205-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6f39cfde-47c7-4b9f-83d3-13c147be6792', 0)] {{(pid=74613) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 29 18:24:28 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:24:29 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.016s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:24:29 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[de114e90-38df-4697-825a-31843c89d887]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6c9b7b59-9da2-47b6-a0f0-f533803e54f6\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6f39cfde-47c7-4b9f-83d3-13c147be6792\n', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 18:24:29 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:24:29 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:24:29 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[f66feb76-6413-4051-a299-f2d0aa11a5ce]: (4, ('tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f39cfde-47c7-4b9f-83d3-13c147be6792 (non-flash)\ntcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c9b7b59-9da2-47b6-a0f0-f533803e54f6 (non-flash)\n', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 18:24:29 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-3202cd81-6bb9-4d5b-9159-a6dc2999ab72 tempest-TestVolumeBootPattern-1318569205 tempest-TestVolumeBootPattern-1318569205-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f39cfde-47c7-4b9f-83d3-13c147be6792 (non-flash)
Nov 29 18:24:29 user nova-compute[74613]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c9b7b59-9da2-47b6-a0f0-f533803e54f6 (non-flash)
Nov 29 18:24:29 user nova-compute[74613]:  stderr= {{(pid=74613) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 18:24:29 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-3202cd81-6bb9-4d5b-9159-a6dc2999ab72 tempest-TestVolumeBootPattern-1318569205 tempest-TestVolumeBootPattern-1318569205-project-member] iscsi session list stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f39cfde-47c7-4b9f-83d3-13c147be6792 (non-flash)
Nov 29 18:24:29 user nova-compute[74613]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c9b7b59-9da2-47b6-a0f0-f533803e54f6 (non-flash)
Nov 29 18:24:29 user nova-compute[74613]:  stderr= {{(pid=74613) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 18:24:29 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-3202cd81-6bb9-4d5b-9159-a6dc2999ab72 tempest-TestVolumeBootPattern-1318569205 tempest-TestVolumeBootPattern-1318569205-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7ff8182900d0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6f39cfde-47c7-4b9f-83d3-13c147be6792'): ({'sdb'}, set())}) {{(pid=74613) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 29 18:24:29 user nova-compute[74613]: DEBUG os_brick.initiator.linuxscsi [None req-3202cd81-6bb9-4d5b-9159-a6dc2999ab72 tempest-TestVolumeBootPattern-1318569205 tempest-TestVolumeBootPattern-1318569205-project-member] Removing single pathed devices sdb {{(pid=74613) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 29 18:24:29 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:24:29 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:24:29 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[078fb528-8343-4b2f-ac38-793ca6f5171a]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 18:24:29 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:24:29 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.018s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:24:29 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[61540589-7bf6-40b9-bb1b-b8480e510d70]: (4, ('ok\n', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 18:24:29 user nova-compute[74613]: DEBUG os_brick.initiator.linuxscsi [None req-3202cd81-6bb9-4d5b-9159-a6dc2999ab72 tempest-TestVolumeBootPattern-1318569205 tempest-TestVolumeBootPattern-1318569205-project-member] Flushing IO for device /dev/sdb {{(pid=74613) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 29 18:24:29 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:24:29 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.016s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:24:29 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff90e1cb-3361-42ff-a145-51830ab1b9d0]: (4, ('', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 18:24:29 user nova-compute[74613]: DEBUG os_brick.initiator.linuxscsi [None req-3202cd81-6bb9-4d5b-9159-a6dc2999ab72 tempest-TestVolumeBootPattern-1318569205 tempest-TestVolumeBootPattern-1318569205-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74613) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 29 18:24:29 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:24:29 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.056s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:24:29 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd1d184d-db50-4d10-ab72-e81c1c4d8c86]: (4, ('1', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 18:24:29 user nova-compute[74613]: DEBUG os_brick.initiator.linuxscsi [None req-3202cd81-6bb9-4d5b-9159-a6dc2999ab72 tempest-TestVolumeBootPattern-1318569205 tempest-TestVolumeBootPattern-1318569205-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74613) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 29 18:24:29 user nova-compute[74613]: DEBUG os_brick.initiator.linuxscsi [None req-3202cd81-6bb9-4d5b-9159-a6dc2999ab72 tempest-TestVolumeBootPattern-1318569205 tempest-TestVolumeBootPattern-1318569205-project-member] SCSI volumes sdb have been removed. {{(pid=74613) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 29 18:24:29 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-3202cd81-6bb9-4d5b-9159-a6dc2999ab72 tempest-TestVolumeBootPattern-1318569205 tempest-TestVolumeBootPattern-1318569205-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6f39cfde-47c7-4b9f-83d3-13c147be6792')] {{(pid=74613) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 29 18:24:29 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6f39cfde-47c7-4b9f-83d3-13c147be6792 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:24:29 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6f39cfde-47c7-4b9f-83d3-13c147be6792 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:24:29 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[004dba50-3e06-436a-8dce-861f7a5c1b0d]: (4, ('', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 18:24:29 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-3202cd81-6bb9-4d5b-9159-a6dc2999ab72 tempest-TestVolumeBootPattern-1318569205 tempest-TestVolumeBootPattern-1318569205-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74613) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 18:24:29 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6f39cfde-47c7-4b9f-83d3-13c147be6792 -p 172.16.0.220:3260 --logout {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:24:29 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6f39cfde-47c7-4b9f-83d3-13c147be6792 -p 172.16.0.220:3260 --logout" returned: 0 in 0.052s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:24:29 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[4162e812-c039-476c-b2ae-8555cc8cf8be]: (4, ('Logging out of session [sid: 50, target: iqn.2010-10.org.openstack:6f39cfde-47c7-4b9f-83d3-13c147be6792, portal: 172.16.0.220,3260]\nLogout of [sid: 50, target: iqn.2010-10.org.openstack:6f39cfde-47c7-4b9f-83d3-13c147be6792, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 18:24:29 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-3202cd81-6bb9-4d5b-9159-a6dc2999ab72 tempest-TestVolumeBootPattern-1318569205 tempest-TestVolumeBootPattern-1318569205-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 50, target: iqn.2010-10.org.openstack:6f39cfde-47c7-4b9f-83d3-13c147be6792, portal: 172.16.0.220,3260]
Nov 29 18:24:29 user nova-compute[74613]: Logout of [sid: 50, target: iqn.2010-10.org.openstack:6f39cfde-47c7-4b9f-83d3-13c147be6792, portal: 172.16.0.220,3260] successful.
Nov 29 18:24:29 user nova-compute[74613]:  stderr= {{(pid=74613) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 18:24:29 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6f39cfde-47c7-4b9f-83d3-13c147be6792 -p 172.16.0.220:3260 --op delete {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:24:29 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6f39cfde-47c7-4b9f-83d3-13c147be6792 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.020s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:24:29 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[02f2fdc0-9548-45aa-a37c-96f82abc58df]: (4, ('', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 18:24:29 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-3202cd81-6bb9-4d5b-9159-a6dc2999ab72 tempest-TestVolumeBootPattern-1318569205 tempest-TestVolumeBootPattern-1318569205-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74613) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 18:24:29 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.base [None req-3202cd81-6bb9-4d5b-9159-a6dc2999ab72 tempest-TestVolumeBootPattern-1318569205 tempest-TestVolumeBootPattern-1318569205-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.312s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 18:24:29 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-3202cd81-6bb9-4d5b-9159-a6dc2999ab72 tempest-TestVolumeBootPattern-1318569205 tempest-TestVolumeBootPattern-1318569205-project-member] <== disconnect_volume: return (313ms) None {{(pid=74613) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 18:24:29 user nova-compute[74613]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3202cd81-6bb9-4d5b-9159-a6dc2999ab72 tempest-TestVolumeBootPattern-1318569205 tempest-TestVolumeBootPattern-1318569205-project-member] [instance: 6d839255-e713-4234-8443-6ba0d5635a6e] Disconnected iSCSI Volume {{(pid=74613) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 29 18:24:29 user nova-compute[74613]: INFO nova.virt.libvirt.driver [None req-3202cd81-6bb9-4d5b-9159-a6dc2999ab72 tempest-TestVolumeBootPattern-1318569205 tempest-TestVolumeBootPattern-1318569205-project-member] [instance: 6d839255-e713-4234-8443-6ba0d5635a6e] Deleting instance files /opt/stack/data/nova/instances/6d839255-e713-4234-8443-6ba0d5635a6e_del
Nov 29 18:24:29 user nova-compute[74613]: INFO nova.virt.libvirt.driver [None req-3202cd81-6bb9-4d5b-9159-a6dc2999ab72 tempest-TestVolumeBootPattern-1318569205 tempest-TestVolumeBootPattern-1318569205-project-member] [instance: 6d839255-e713-4234-8443-6ba0d5635a6e] Deletion of /opt/stack/data/nova/instances/6d839255-e713-4234-8443-6ba0d5635a6e_del complete
Nov 29 18:24:29 user nova-compute[74613]: INFO nova.compute.manager [None req-3202cd81-6bb9-4d5b-9159-a6dc2999ab72 tempest-TestVolumeBootPattern-1318569205 tempest-TestVolumeBootPattern-1318569205-project-member] [instance: 6d839255-e713-4234-8443-6ba0d5635a6e] Took 1.16 seconds to destroy the instance on the hypervisor.
Nov 29 18:24:29 user nova-compute[74613]: DEBUG oslo.service.loopingcall [None req-3202cd81-6bb9-4d5b-9159-a6dc2999ab72 tempest-TestVolumeBootPattern-1318569205 tempest-TestVolumeBootPattern-1318569205-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74613) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 29 18:24:29 user nova-compute[74613]: DEBUG nova.compute.manager [-] [instance: 6d839255-e713-4234-8443-6ba0d5635a6e] Deallocating network for instance {{(pid=74613) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 29 18:24:29 user nova-compute[74613]: DEBUG nova.network.neutron [-] [instance: 6d839255-e713-4234-8443-6ba0d5635a6e] deallocate_for_instance() {{(pid=74613) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 29 18:24:29 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-61594795-c969-4dc7-a7ab-5719a46d8ad1 tempest-VolumesActionsTest-576062334 tempest-VolumesActionsTest-576062334-project-member] Acquiring lock "35c09e0b-55fa-42c4-a47a-707909e184f9" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 18:24:29 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-61594795-c969-4dc7-a7ab-5719a46d8ad1 tempest-VolumesActionsTest-576062334 tempest-VolumesActionsTest-576062334-project-member] Lock "35c09e0b-55fa-42c4-a47a-707909e184f9" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 18:24:29 user nova-compute[74613]: DEBUG nova.compute.manager [None req-61594795-c969-4dc7-a7ab-5719a46d8ad1 tempest-VolumesActionsTest-576062334 tempest-VolumesActionsTest-576062334-project-member] [instance: 35c09e0b-55fa-42c4-a47a-707909e184f9] Starting instance... {{(pid=74613) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 29 18:24:29 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-61594795-c969-4dc7-a7ab-5719a46d8ad1 tempest-VolumesActionsTest-576062334 tempest-VolumesActionsTest-576062334-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 18:24:29 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-61594795-c969-4dc7-a7ab-5719a46d8ad1 tempest-VolumesActionsTest-576062334 tempest-VolumesActionsTest-576062334-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 18:24:29 user nova-compute[74613]: DEBUG nova.virt.hardware [None req-61594795-c969-4dc7-a7ab-5719a46d8ad1 tempest-VolumesActionsTest-576062334 tempest-VolumesActionsTest-576062334-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74613) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 29 18:24:29 user nova-compute[74613]: INFO nova.compute.claims [None req-61594795-c969-4dc7-a7ab-5719a46d8ad1 tempest-VolumesActionsTest-576062334 tempest-VolumesActionsTest-576062334-project-member] [instance: 35c09e0b-55fa-42c4-a47a-707909e184f9] Claim successful on node user
Nov 29 18:24:29 user nova-compute[74613]: DEBUG nova.compute.provider_tree [None req-61594795-c969-4dc7-a7ab-5719a46d8ad1 tempest-VolumesActionsTest-576062334 tempest-VolumesActionsTest-576062334-project-member] Inventory has not changed in ProviderTree for provider: 639d980e-3b12-44b1-b8f4-1812416fa4dd {{(pid=74613) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 18:24:29 user nova-compute[74613]: DEBUG nova.scheduler.client.report [None req-61594795-c969-4dc7-a7ab-5719a46d8ad1 tempest-VolumesActionsTest-576062334 tempest-VolumesActionsTest-576062334-project-member] Inventory has not changed for provider 639d980e-3b12-44b1-b8f4-1812416fa4dd based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74613) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 18:24:29 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-61594795-c969-4dc7-a7ab-5719a46d8ad1 tempest-VolumesActionsTest-576062334 tempest-VolumesActionsTest-576062334-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.220s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 18:24:29 user nova-compute[74613]: DEBUG nova.compute.manager [None req-61594795-c969-4dc7-a7ab-5719a46d8ad1 tempest-VolumesActionsTest-576062334 tempest-VolumesActionsTest-576062334-project-member] [instance: 35c09e0b-55fa-42c4-a47a-707909e184f9] Start building networks asynchronously for instance. {{(pid=74613) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 29 18:24:29 user nova-compute[74613]: DEBUG nova.compute.manager [None req-61594795-c969-4dc7-a7ab-5719a46d8ad1 tempest-VolumesActionsTest-576062334 tempest-VolumesActionsTest-576062334-project-member] [instance: 35c09e0b-55fa-42c4-a47a-707909e184f9] Allocating IP information in the background. {{(pid=74613) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 29 18:24:29 user nova-compute[74613]: DEBUG nova.network.neutron [None req-61594795-c969-4dc7-a7ab-5719a46d8ad1 tempest-VolumesActionsTest-576062334 tempest-VolumesActionsTest-576062334-project-member] [instance: 35c09e0b-55fa-42c4-a47a-707909e184f9] allocate_for_instance() {{(pid=74613) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 29 18:24:29 user nova-compute[74613]: INFO nova.virt.libvirt.driver [None req-61594795-c969-4dc7-a7ab-5719a46d8ad1 tempest-VolumesActionsTest-576062334 tempest-VolumesActionsTest-576062334-project-member] [instance: 35c09e0b-55fa-42c4-a47a-707909e184f9] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 29 18:24:29 user nova-compute[74613]: DEBUG nova.compute.manager [None req-61594795-c969-4dc7-a7ab-5719a46d8ad1 tempest-VolumesActionsTest-576062334 tempest-VolumesActionsTest-576062334-project-member] [instance: 35c09e0b-55fa-42c4-a47a-707909e184f9] Start building block device mappings for instance. {{(pid=74613) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 29 18:24:29 user nova-compute[74613]: DEBUG nova.policy [None req-61594795-c969-4dc7-a7ab-5719a46d8ad1 tempest-VolumesActionsTest-576062334 tempest-VolumesActionsTest-576062334-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '680fbea8ee2e489b9e7a4274b5f66b62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13bf1cb7deec45aea930f4a0092572d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74613) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 29 18:24:30 user nova-compute[74613]: DEBUG nova.compute.manager [None req-61594795-c969-4dc7-a7ab-5719a46d8ad1 tempest-VolumesActionsTest-576062334 tempest-VolumesActionsTest-576062334-project-member] [instance: 35c09e0b-55fa-42c4-a47a-707909e184f9] Start spawning the instance on the hypervisor. {{(pid=74613) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 29 18:24:30 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-61594795-c969-4dc7-a7ab-5719a46d8ad1 tempest-VolumesActionsTest-576062334 tempest-VolumesActionsTest-576062334-project-member] [instance: 35c09e0b-55fa-42c4-a47a-707909e184f9] Creating instance directory {{(pid=74613) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 29 18:24:30 user nova-compute[74613]: INFO nova.virt.libvirt.driver [None req-61594795-c969-4dc7-a7ab-5719a46d8ad1 tempest-VolumesActionsTest-576062334 tempest-VolumesActionsTest-576062334-project-member] [instance: 35c09e0b-55fa-42c4-a47a-707909e184f9] Creating image(s)
Nov 29 18:24:30 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-61594795-c969-4dc7-a7ab-5719a46d8ad1 tempest-VolumesActionsTest-576062334 tempest-VolumesActionsTest-576062334-project-member] Acquiring lock "/opt/stack/data/nova/instances/35c09e0b-55fa-42c4-a47a-707909e184f9/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 18:24:30 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-61594795-c969-4dc7-a7ab-5719a46d8ad1 tempest-VolumesActionsTest-576062334 tempest-VolumesActionsTest-576062334-project-member] Lock "/opt/stack/data/nova/instances/35c09e0b-55fa-42c4-a47a-707909e184f9/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 18:24:30 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-61594795-c969-4dc7-a7ab-5719a46d8ad1 tempest-VolumesActionsTest-576062334 tempest-VolumesActionsTest-576062334-project-member] Lock "/opt/stack/data/nova/instances/35c09e0b-55fa-42c4-a47a-707909e184f9/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.004s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 18:24:30 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-61594795-c969-4dc7-a7ab-5719a46d8ad1 tempest-VolumesActionsTest-576062334 tempest-VolumesActionsTest-576062334-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/21faea9e6951f3bdd0153b76ac89fe1a60a34758 --force-share --output=json {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:24:30 user nova-compute[74613]: DEBUG nova.network.neutron [-] [instance: 6d839255-e713-4234-8443-6ba0d5635a6e] Updating instance_info_cache with network_info: [] {{(pid=74613) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 18:24:30 user nova-compute[74613]: DEBUG nova.compute.manager [req-9c18efe6-34be-48d5-815c-1cbc998b0ffe req-7e3002f5-fbbe-43a6-ae33-023bbc20b34f service nova] [instance: 6d839255-e713-4234-8443-6ba0d5635a6e] Received event network-vif-deleted-4e54478e-1eb5-4ae4-8e1a-faa3738f3914 {{(pid=74613) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 18:24:30 user nova-compute[74613]: INFO nova.compute.manager [req-9c18efe6-34be-48d5-815c-1cbc998b0ffe req-7e3002f5-fbbe-43a6-ae33-023bbc20b34f service nova] [instance: 6d839255-e713-4234-8443-6ba0d5635a6e] Neutron deleted interface 4e54478e-1eb5-4ae4-8e1a-faa3738f3914; detaching it from the instance and deleting it from the info cache
Nov 29 18:24:30 user nova-compute[74613]: DEBUG nova.network.neutron [req-9c18efe6-34be-48d5-815c-1cbc998b0ffe req-7e3002f5-fbbe-43a6-ae33-023bbc20b34f service nova] [instance: 6d839255-e713-4234-8443-6ba0d5635a6e] Updating instance_info_cache with network_info: [] {{(pid=74613) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 18:24:30 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-61594795-c969-4dc7-a7ab-5719a46d8ad1 tempest-VolumesActionsTest-576062334 tempest-VolumesActionsTest-576062334-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/21faea9e6951f3bdd0153b76ac89fe1a60a34758 --force-share --output=json" returned: 0 in 0.223s {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:24:30 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-61594795-c969-4dc7-a7ab-5719a46d8ad1 tempest-VolumesActionsTest-576062334 tempest-VolumesActionsTest-576062334-project-member] Acquiring lock "21faea9e6951f3bdd0153b76ac89fe1a60a34758" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 18:24:30 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-61594795-c969-4dc7-a7ab-5719a46d8ad1 tempest-VolumesActionsTest-576062334 tempest-VolumesActionsTest-576062334-project-member] Lock "21faea9e6951f3bdd0153b76ac89fe1a60a34758" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 18:24:30 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-61594795-c969-4dc7-a7ab-5719a46d8ad1 tempest-VolumesActionsTest-576062334 tempest-VolumesActionsTest-576062334-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/21faea9e6951f3bdd0153b76ac89fe1a60a34758 --force-share --output=json {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:24:30 user nova-compute[74613]: INFO nova.compute.manager [-] [instance: 6d839255-e713-4234-8443-6ba0d5635a6e] Took 0.94 seconds to deallocate network for instance.
Nov 29 18:24:30 user nova-compute[74613]: DEBUG nova.compute.manager [req-9c18efe6-34be-48d5-815c-1cbc998b0ffe req-7e3002f5-fbbe-43a6-ae33-023bbc20b34f service nova] [instance: 6d839255-e713-4234-8443-6ba0d5635a6e] Detach interface failed, port_id=4e54478e-1eb5-4ae4-8e1a-faa3738f3914, reason: Instance 6d839255-e713-4234-8443-6ba0d5635a6e could not be found. {{(pid=74613) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 29 18:24:30 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-61594795-c969-4dc7-a7ab-5719a46d8ad1 tempest-VolumesActionsTest-576062334 tempest-VolumesActionsTest-576062334-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/21faea9e6951f3bdd0153b76ac89fe1a60a34758 --force-share --output=json" returned: 0 in 0.174s {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:24:30 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-61594795-c969-4dc7-a7ab-5719a46d8ad1 tempest-VolumesActionsTest-576062334 tempest-VolumesActionsTest-576062334-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/21faea9e6951f3bdd0153b76ac89fe1a60a34758,backing_fmt=raw /opt/stack/data/nova/instances/35c09e0b-55fa-42c4-a47a-707909e184f9/disk 1073741824 {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:24:30 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-61594795-c969-4dc7-a7ab-5719a46d8ad1 tempest-VolumesActionsTest-576062334 tempest-VolumesActionsTest-576062334-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/21faea9e6951f3bdd0153b76ac89fe1a60a34758,backing_fmt=raw /opt/stack/data/nova/instances/35c09e0b-55fa-42c4-a47a-707909e184f9/disk 1073741824" returned: 0 in 0.049s {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:24:30 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-61594795-c969-4dc7-a7ab-5719a46d8ad1 tempest-VolumesActionsTest-576062334 tempest-VolumesActionsTest-576062334-project-member] Lock "21faea9e6951f3bdd0153b76ac89fe1a60a34758" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.228s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 18:24:30 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-61594795-c969-4dc7-a7ab-5719a46d8ad1 tempest-VolumesActionsTest-576062334 tempest-VolumesActionsTest-576062334-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/21faea9e6951f3bdd0153b76ac89fe1a60a34758 --force-share --output=json {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:24:30 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:24:30 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-61594795-c969-4dc7-a7ab-5719a46d8ad1 tempest-VolumesActionsTest-576062334 tempest-VolumesActionsTest-576062334-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/21faea9e6951f3bdd0153b76ac89fe1a60a34758 --force-share --output=json" returned: 0 in 0.181s {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:24:30 user nova-compute[74613]: DEBUG nova.virt.disk.api [None req-61594795-c969-4dc7-a7ab-5719a46d8ad1 tempest-VolumesActionsTest-576062334 tempest-VolumesActionsTest-576062334-project-member] Checking if we can resize image /opt/stack/data/nova/instances/35c09e0b-55fa-42c4-a47a-707909e184f9/disk. size=1073741824 {{(pid=74613) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 29 18:24:30 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-61594795-c969-4dc7-a7ab-5719a46d8ad1 tempest-VolumesActionsTest-576062334 tempest-VolumesActionsTest-576062334-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/35c09e0b-55fa-42c4-a47a-707909e184f9/disk --force-share --output=json {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:24:30 user nova-compute[74613]: DEBUG nova.network.neutron [None req-61594795-c969-4dc7-a7ab-5719a46d8ad1 tempest-VolumesActionsTest-576062334 tempest-VolumesActionsTest-576062334-project-member] [instance: 35c09e0b-55fa-42c4-a47a-707909e184f9] Successfully created port: 4e69c843-312f-47a8-8e75-4e857f6423d5 {{(pid=74613) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 29 18:24:30 user nova-compute[74613]: DEBUG nova.compute.manager [req-6b9c65e6-52b0-46d7-966e-2f87433050c6 req-88b1d091-efca-4acc-85ac-7c98526b115a service nova] [instance: 6d839255-e713-4234-8443-6ba0d5635a6e] Received event network-vif-plugged-4e54478e-1eb5-4ae4-8e1a-faa3738f3914 {{(pid=74613) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 18:24:30 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-6b9c65e6-52b0-46d7-966e-2f87433050c6 req-88b1d091-efca-4acc-85ac-7c98526b115a service nova] Acquiring lock "6d839255-e713-4234-8443-6ba0d5635a6e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 18:24:30 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-6b9c65e6-52b0-46d7-966e-2f87433050c6 req-88b1d091-efca-4acc-85ac-7c98526b115a service nova] Lock "6d839255-e713-4234-8443-6ba0d5635a6e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 18:24:30 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-6b9c65e6-52b0-46d7-966e-2f87433050c6 req-88b1d091-efca-4acc-85ac-7c98526b115a service nova] Lock "6d839255-e713-4234-8443-6ba0d5635a6e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 18:24:30 user nova-compute[74613]: DEBUG nova.compute.manager [req-6b9c65e6-52b0-46d7-966e-2f87433050c6 req-88b1d091-efca-4acc-85ac-7c98526b115a service nova] [instance: 6d839255-e713-4234-8443-6ba0d5635a6e] No waiting events found dispatching network-vif-plugged-4e54478e-1eb5-4ae4-8e1a-faa3738f3914 {{(pid=74613) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 18:24:30 user nova-compute[74613]: WARNING nova.compute.manager [req-6b9c65e6-52b0-46d7-966e-2f87433050c6 req-88b1d091-efca-4acc-85ac-7c98526b115a service nova] [instance: 6d839255-e713-4234-8443-6ba0d5635a6e] Received unexpected event network-vif-plugged-4e54478e-1eb5-4ae4-8e1a-faa3738f3914 for instance with vm_state active and task_state deleting.
Nov 29 18:24:30 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-61594795-c969-4dc7-a7ab-5719a46d8ad1 tempest-VolumesActionsTest-576062334 tempest-VolumesActionsTest-576062334-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/35c09e0b-55fa-42c4-a47a-707909e184f9/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:24:30 user nova-compute[74613]: DEBUG nova.virt.disk.api [None req-61594795-c969-4dc7-a7ab-5719a46d8ad1 tempest-VolumesActionsTest-576062334 tempest-VolumesActionsTest-576062334-project-member] Cannot resize image /opt/stack/data/nova/instances/35c09e0b-55fa-42c4-a47a-707909e184f9/disk to a smaller size. {{(pid=74613) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 29 18:24:30 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-61594795-c969-4dc7-a7ab-5719a46d8ad1 tempest-VolumesActionsTest-576062334 tempest-VolumesActionsTest-576062334-project-member] [instance: 35c09e0b-55fa-42c4-a47a-707909e184f9] Created local disks {{(pid=74613) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 29 18:24:30 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-61594795-c969-4dc7-a7ab-5719a46d8ad1 tempest-VolumesActionsTest-576062334 tempest-VolumesActionsTest-576062334-project-member] [instance: 35c09e0b-55fa-42c4-a47a-707909e184f9] Ensure instance console log exists: /opt/stack/data/nova/instances/35c09e0b-55fa-42c4-a47a-707909e184f9/console.log {{(pid=74613) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 29 18:24:30 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-61594795-c969-4dc7-a7ab-5719a46d8ad1 tempest-VolumesActionsTest-576062334 tempest-VolumesActionsTest-576062334-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 18:24:30 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-61594795-c969-4dc7-a7ab-5719a46d8ad1 tempest-VolumesActionsTest-576062334 tempest-VolumesActionsTest-576062334-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 18:24:30 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-61594795-c969-4dc7-a7ab-5719a46d8ad1 tempest-VolumesActionsTest-576062334 tempest-VolumesActionsTest-576062334-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 18:24:31 user nova-compute[74613]: INFO nova.compute.manager [None req-3202cd81-6bb9-4d5b-9159-a6dc2999ab72 tempest-TestVolumeBootPattern-1318569205 tempest-TestVolumeBootPattern-1318569205-project-member] [instance: 6d839255-e713-4234-8443-6ba0d5635a6e] Took 0.98 seconds to detach 1 volumes for instance.
Nov 29 18:24:31 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:24:31 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-3202cd81-6bb9-4d5b-9159-a6dc2999ab72 tempest-TestVolumeBootPattern-1318569205 tempest-TestVolumeBootPattern-1318569205-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 18:24:31 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-3202cd81-6bb9-4d5b-9159-a6dc2999ab72 tempest-TestVolumeBootPattern-1318569205 tempest-TestVolumeBootPattern-1318569205-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 18:24:31 user nova-compute[74613]: DEBUG nova.network.neutron [None req-61594795-c969-4dc7-a7ab-5719a46d8ad1 tempest-VolumesActionsTest-576062334 tempest-VolumesActionsTest-576062334-project-member] [instance: 35c09e0b-55fa-42c4-a47a-707909e184f9] Successfully updated port: 4e69c843-312f-47a8-8e75-4e857f6423d5 {{(pid=74613) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 29 18:24:31 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-61594795-c969-4dc7-a7ab-5719a46d8ad1 tempest-VolumesActionsTest-576062334 tempest-VolumesActionsTest-576062334-project-member] Acquiring lock "refresh_cache-35c09e0b-55fa-42c4-a47a-707909e184f9" {{(pid=74613) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 18:24:31 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-61594795-c969-4dc7-a7ab-5719a46d8ad1 tempest-VolumesActionsTest-576062334 tempest-VolumesActionsTest-576062334-project-member] Acquired lock "refresh_cache-35c09e0b-55fa-42c4-a47a-707909e184f9" {{(pid=74613) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 18:24:31 user nova-compute[74613]: DEBUG nova.network.neutron [None req-61594795-c969-4dc7-a7ab-5719a46d8ad1 tempest-VolumesActionsTest-576062334 tempest-VolumesActionsTest-576062334-project-member] [instance: 35c09e0b-55fa-42c4-a47a-707909e184f9] Building network info cache for instance {{(pid=74613) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 29 18:24:31 user nova-compute[74613]: DEBUG nova.compute.manager [req-79874f06-6d4b-488e-ac5b-203a67bfd3ae req-aa2299ac-75eb-4db0-8158-ec97850d179a service nova] [instance: 35c09e0b-55fa-42c4-a47a-707909e184f9] Received event network-changed-4e69c843-312f-47a8-8e75-4e857f6423d5 {{(pid=74613) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 18:24:31 user nova-compute[74613]: DEBUG nova.compute.manager [req-79874f06-6d4b-488e-ac5b-203a67bfd3ae req-aa2299ac-75eb-4db0-8158-ec97850d179a service nova] [instance: 35c09e0b-55fa-42c4-a47a-707909e184f9] Refreshing instance network info cache due to event network-changed-4e69c843-312f-47a8-8e75-4e857f6423d5. {{(pid=74613) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 18:24:31 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-79874f06-6d4b-488e-ac5b-203a67bfd3ae req-aa2299ac-75eb-4db0-8158-ec97850d179a service nova] Acquiring lock "refresh_cache-35c09e0b-55fa-42c4-a47a-707909e184f9" {{(pid=74613) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 18:24:31 user nova-compute[74613]: DEBUG nova.network.neutron [None req-61594795-c969-4dc7-a7ab-5719a46d8ad1 tempest-VolumesActionsTest-576062334 tempest-VolumesActionsTest-576062334-project-member] [instance: 35c09e0b-55fa-42c4-a47a-707909e184f9] Instance cache missing network info. {{(pid=74613) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 29 18:24:31 user nova-compute[74613]: DEBUG nova.compute.provider_tree [None req-3202cd81-6bb9-4d5b-9159-a6dc2999ab72 tempest-TestVolumeBootPattern-1318569205 tempest-TestVolumeBootPattern-1318569205-project-member] Inventory has not changed in ProviderTree for provider: 639d980e-3b12-44b1-b8f4-1812416fa4dd {{(pid=74613) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 18:24:31 user nova-compute[74613]: DEBUG nova.scheduler.client.report [None req-3202cd81-6bb9-4d5b-9159-a6dc2999ab72 tempest-TestVolumeBootPattern-1318569205 tempest-TestVolumeBootPattern-1318569205-project-member] Inventory has not changed for provider 639d980e-3b12-44b1-b8f4-1812416fa4dd based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74613) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 18:24:31 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-3202cd81-6bb9-4d5b-9159-a6dc2999ab72 tempest-TestVolumeBootPattern-1318569205 tempest-TestVolumeBootPattern-1318569205-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.156s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 18:24:31 user nova-compute[74613]: INFO nova.scheduler.client.report [None req-3202cd81-6bb9-4d5b-9159-a6dc2999ab72 tempest-TestVolumeBootPattern-1318569205 tempest-TestVolumeBootPattern-1318569205-project-member] Deleted allocations for instance 6d839255-e713-4234-8443-6ba0d5635a6e
Nov 29 18:24:31 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-3202cd81-6bb9-4d5b-9159-a6dc2999ab72 tempest-TestVolumeBootPattern-1318569205 tempest-TestVolumeBootPattern-1318569205-project-member] Lock "6d839255-e713-4234-8443-6ba0d5635a6e" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.435s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 18:24:31 user nova-compute[74613]: DEBUG nova.network.neutron [None req-61594795-c969-4dc7-a7ab-5719a46d8ad1 tempest-VolumesActionsTest-576062334 tempest-VolumesActionsTest-576062334-project-member] [instance: 35c09e0b-55fa-42c4-a47a-707909e184f9] Updating instance_info_cache with network_info: [{"id": "4e69c843-312f-47a8-8e75-4e857f6423d5", "address": "fa:16:3e:62:82:5f", "network": {"id": "74c4d111-4731-4d90-b6a9-a72b112d18ca", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1404505506-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "13bf1cb7deec45aea930f4a0092572d1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4e69c843-31", "ovs_interfaceid": "4e69c843-312f-47a8-8e75-4e857f6423d5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74613) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 18:24:31 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-61594795-c969-4dc7-a7ab-5719a46d8ad1 tempest-VolumesActionsTest-576062334 tempest-VolumesActionsTest-576062334-project-member] Releasing lock "refresh_cache-35c09e0b-55fa-42c4-a47a-707909e184f9" {{(pid=74613) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 18:24:31 user nova-compute[74613]: DEBUG nova.compute.manager [None req-61594795-c969-4dc7-a7ab-5719a46d8ad1 tempest-VolumesActionsTest-576062334 tempest-VolumesActionsTest-576062334-project-member] [instance: 35c09e0b-55fa-42c4-a47a-707909e184f9] Instance network_info: |[{"id": "4e69c843-312f-47a8-8e75-4e857f6423d5", "address": "fa:16:3e:62:82:5f", "network": {"id": "74c4d111-4731-4d90-b6a9-a72b112d18ca", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1404505506-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "13bf1cb7deec45aea930f4a0092572d1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4e69c843-31", "ovs_interfaceid": "4e69c843-312f-47a8-8e75-4e857f6423d5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74613) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 29 18:24:31 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-79874f06-6d4b-488e-ac5b-203a67bfd3ae req-aa2299ac-75eb-4db0-8158-ec97850d179a service nova] Acquired lock "refresh_cache-35c09e0b-55fa-42c4-a47a-707909e184f9" {{(pid=74613) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 18:24:31 user nova-compute[74613]: DEBUG nova.network.neutron [req-79874f06-6d4b-488e-ac5b-203a67bfd3ae req-aa2299ac-75eb-4db0-8158-ec97850d179a service nova] [instance: 35c09e0b-55fa-42c4-a47a-707909e184f9] Refreshing network info cache for port 4e69c843-312f-47a8-8e75-4e857f6423d5 {{(pid=74613) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 18:24:31 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-61594795-c969-4dc7-a7ab-5719a46d8ad1 tempest-VolumesActionsTest-576062334 tempest-VolumesActionsTest-576062334-project-member] [instance: 35c09e0b-55fa-42c4-a47a-707909e184f9] Start _get_guest_xml network_info=[{"id": "4e69c843-312f-47a8-8e75-4e857f6423d5", "address": "fa:16:3e:62:82:5f", "network": {"id": "74c4d111-4731-4d90-b6a9-a72b112d18ca", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1404505506-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "13bf1cb7deec45aea930f4a0092572d1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4e69c843-31", "ovs_interfaceid": "4e69c843-312f-47a8-8e75-4e857f6423d5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-29T17:47:38Z,direct_url=<?>,disk_format='qcow2',id=4217f428-8d9d-4ee1-9614-642d26d90c46,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='794b07cbd46a44b5865cfda741036bae',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-29T17:47:40Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'size': 0, 'device_type': 'disk', 'boot_index': 0, 'guest_format': None, 'encrypted': False, 'encryption_format': None, 'disk_bus': 'virtio', 'image_id': '4217f428-8d9d-4ee1-9614-642d26d90c46'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74613) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 29 18:24:31 user nova-compute[74613]: WARNING nova.virt.libvirt.driver [None req-61594795-c969-4dc7-a7ab-5719a46d8ad1 tempest-VolumesActionsTest-576062334 tempest-VolumesActionsTest-576062334-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 18:24:31 user nova-compute[74613]: WARNING nova.virt.libvirt.driver [None req-61594795-c969-4dc7-a7ab-5719a46d8ad1 tempest-VolumesActionsTest-576062334 tempest-VolumesActionsTest-576062334-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 18:24:31 user nova-compute[74613]: DEBUG nova.virt.libvirt.host [None req-61594795-c969-4dc7-a7ab-5719a46d8ad1 tempest-VolumesActionsTest-576062334 tempest-VolumesActionsTest-576062334-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74613) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 29 18:24:31 user nova-compute[74613]: DEBUG nova.virt.libvirt.host [None req-61594795-c969-4dc7-a7ab-5719a46d8ad1 tempest-VolumesActionsTest-576062334 tempest-VolumesActionsTest-576062334-project-member] CPU controller missing on host. {{(pid=74613) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 29 18:24:31 user nova-compute[74613]: DEBUG nova.virt.libvirt.host [None req-61594795-c969-4dc7-a7ab-5719a46d8ad1 tempest-VolumesActionsTest-576062334 tempest-VolumesActionsTest-576062334-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74613) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 29 18:24:31 user nova-compute[74613]: DEBUG nova.virt.libvirt.host [None req-61594795-c969-4dc7-a7ab-5719a46d8ad1 tempest-VolumesActionsTest-576062334 tempest-VolumesActionsTest-576062334-project-member] CPU controller found on host. {{(pid=74613) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 29 18:24:31 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-61594795-c969-4dc7-a7ab-5719a46d8ad1 tempest-VolumesActionsTest-576062334 tempest-VolumesActionsTest-576062334-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74613) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 29 18:24:31 user nova-compute[74613]: DEBUG nova.virt.hardware [None req-61594795-c969-4dc7-a7ab-5719a46d8ad1 tempest-VolumesActionsTest-576062334 tempest-VolumesActionsTest-576062334-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-29T17:47:27Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-29T17:47:38Z,direct_url=<?>,disk_format='qcow2',id=4217f428-8d9d-4ee1-9614-642d26d90c46,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='794b07cbd46a44b5865cfda741036bae',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-29T17:47:40Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74613) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 29 18:24:31 user nova-compute[74613]: DEBUG nova.virt.hardware [None req-61594795-c969-4dc7-a7ab-5719a46d8ad1 tempest-VolumesActionsTest-576062334 tempest-VolumesActionsTest-576062334-project-member] Flavor limits 0:0:0 {{(pid=74613) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 29 18:24:31 user nova-compute[74613]: DEBUG nova.virt.hardware [None req-61594795-c969-4dc7-a7ab-5719a46d8ad1 tempest-VolumesActionsTest-576062334 tempest-VolumesActionsTest-576062334-project-member] Image limits 0:0:0 {{(pid=74613) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 29 18:24:31 user nova-compute[74613]: DEBUG nova.virt.hardware [None req-61594795-c969-4dc7-a7ab-5719a46d8ad1 tempest-VolumesActionsTest-576062334 tempest-VolumesActionsTest-576062334-project-member] Flavor pref 0:0:0 {{(pid=74613) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 29 18:24:31 user nova-compute[74613]: DEBUG nova.virt.hardware [None req-61594795-c969-4dc7-a7ab-5719a46d8ad1 tempest-VolumesActionsTest-576062334 tempest-VolumesActionsTest-576062334-project-member] Image pref 0:0:0 {{(pid=74613) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 29 18:24:31 user nova-compute[74613]: DEBUG nova.virt.hardware [None req-61594795-c969-4dc7-a7ab-5719a46d8ad1 tempest-VolumesActionsTest-576062334 tempest-VolumesActionsTest-576062334-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74613) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 29 18:24:31 user nova-compute[74613]: DEBUG nova.virt.hardware [None req-61594795-c969-4dc7-a7ab-5719a46d8ad1 tempest-VolumesActionsTest-576062334 tempest-VolumesActionsTest-576062334-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74613) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 29 18:24:31 user nova-compute[74613]: DEBUG nova.virt.hardware [None req-61594795-c969-4dc7-a7ab-5719a46d8ad1 tempest-VolumesActionsTest-576062334 tempest-VolumesActionsTest-576062334-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74613) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 29 18:24:31 user nova-compute[74613]: DEBUG nova.virt.hardware [None req-61594795-c969-4dc7-a7ab-5719a46d8ad1 tempest-VolumesActionsTest-576062334 tempest-VolumesActionsTest-576062334-project-member] Got 1 possible topologies {{(pid=74613) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 29 18:24:31 user nova-compute[74613]: DEBUG nova.virt.hardware [None req-61594795-c969-4dc7-a7ab-5719a46d8ad1 tempest-VolumesActionsTest-576062334 tempest-VolumesActionsTest-576062334-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74613) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 29 18:24:31 user nova-compute[74613]: DEBUG nova.virt.hardware [None req-61594795-c969-4dc7-a7ab-5719a46d8ad1 tempest-VolumesActionsTest-576062334 tempest-VolumesActionsTest-576062334-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74613) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 29 18:24:31 user nova-compute[74613]: DEBUG nova.virt.libvirt.vif [None req-61594795-c969-4dc7-a7ab-5719a46d8ad1 tempest-VolumesActionsTest-576062334 tempest-VolumesActionsTest-576062334-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T18:24:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-2092330219',display_name='tempest-VolumesActionsTest-instance-2092330219',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-2092330219',id=47,image_ref='4217f428-8d9d-4ee1-9614-642d26d90c46',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='13bf1cb7deec45aea930f4a0092572d1',ramdisk_id='',reservation_id='r-jnotmc1e',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='4217f428-8d9d-4ee1-9614-642d26d90c46',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-576062334',owner_user_name='tempest-VolumesActionsTest-576062334-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T18:24:30Z,user_data=None,user_id='680fbea8ee2e489b9e7a4274b5f66b62',uuid=35c09e0b-55fa-42c4-a47a-707909e184f9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4e69c843-312f-47a8-8e75-4e857f6423d5", "address": "fa:16:3e:62:82:5f", "network": {"id": "74c4d111-4731-4d90-b6a9-a72b112d18ca", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1404505506-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "13bf1cb7deec45aea930f4a0092572d1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4e69c843-31", "ovs_interfaceid": "4e69c843-312f-47a8-8e75-4e857f6423d5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74613) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 29 18:24:31 user nova-compute[74613]: DEBUG nova.network.os_vif_util [None req-61594795-c969-4dc7-a7ab-5719a46d8ad1 tempest-VolumesActionsTest-576062334 tempest-VolumesActionsTest-576062334-project-member] Converting VIF {"id": "4e69c843-312f-47a8-8e75-4e857f6423d5", "address": "fa:16:3e:62:82:5f", "network": {"id": "74c4d111-4731-4d90-b6a9-a72b112d18ca", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1404505506-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "13bf1cb7deec45aea930f4a0092572d1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4e69c843-31", "ovs_interfaceid": "4e69c843-312f-47a8-8e75-4e857f6423d5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74613) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 18:24:31 user nova-compute[74613]: DEBUG nova.network.os_vif_util [None req-61594795-c969-4dc7-a7ab-5719a46d8ad1 tempest-VolumesActionsTest-576062334 tempest-VolumesActionsTest-576062334-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:62:82:5f,bridge_name='br-int',has_traffic_filtering=True,id=4e69c843-312f-47a8-8e75-4e857f6423d5,network=Network(74c4d111-4731-4d90-b6a9-a72b112d18ca),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4e69c843-31') {{(pid=74613) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 18:24:31 user nova-compute[74613]: DEBUG nova.objects.instance [None req-61594795-c969-4dc7-a7ab-5719a46d8ad1 tempest-VolumesActionsTest-576062334 tempest-VolumesActionsTest-576062334-project-member] Lazy-loading 'pci_devices' on Instance uuid 35c09e0b-55fa-42c4-a47a-707909e184f9 {{(pid=74613) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 18:24:31 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-61594795-c969-4dc7-a7ab-5719a46d8ad1 tempest-VolumesActionsTest-576062334 tempest-VolumesActionsTest-576062334-project-member] [instance: 35c09e0b-55fa-42c4-a47a-707909e184f9] End _get_guest_xml xml=<domain type="kvm">
Nov 29 18:24:31 user nova-compute[74613]:   <uuid>35c09e0b-55fa-42c4-a47a-707909e184f9</uuid>
Nov 29 18:24:31 user nova-compute[74613]:   <name>instance-0000002f</name>
Nov 29 18:24:31 user nova-compute[74613]:   <memory>524288</memory>
Nov 29 18:24:31 user nova-compute[74613]:   <vcpu>1</vcpu>
Nov 29 18:24:31 user nova-compute[74613]:   <metadata>
Nov 29 18:24:31 user nova-compute[74613]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 29 18:24:31 user nova-compute[74613]:       <nova:package version="0.0.0"/>
Nov 29 18:24:31 user nova-compute[74613]:       <nova:name>tempest-VolumesActionsTest-instance-2092330219</nova:name>
Nov 29 18:24:31 user nova-compute[74613]:       <nova:creationTime>2023-11-29 18:24:31</nova:creationTime>
Nov 29 18:24:31 user nova-compute[74613]:       <nova:flavor name="m1.tiny">
Nov 29 18:24:31 user nova-compute[74613]:         <nova:memory>512</nova:memory>
Nov 29 18:24:31 user nova-compute[74613]:         <nova:disk>1</nova:disk>
Nov 29 18:24:31 user nova-compute[74613]:         <nova:swap>0</nova:swap>
Nov 29 18:24:31 user nova-compute[74613]:         <nova:ephemeral>0</nova:ephemeral>
Nov 29 18:24:31 user nova-compute[74613]:         <nova:vcpus>1</nova:vcpus>
Nov 29 18:24:31 user nova-compute[74613]:       </nova:flavor>
Nov 29 18:24:31 user nova-compute[74613]:       <nova:owner>
Nov 29 18:24:31 user nova-compute[74613]:         <nova:user uuid="680fbea8ee2e489b9e7a4274b5f66b62">tempest-VolumesActionsTest-576062334-project-member</nova:user>
Nov 29 18:24:31 user nova-compute[74613]:         <nova:project uuid="13bf1cb7deec45aea930f4a0092572d1">tempest-VolumesActionsTest-576062334</nova:project>
Nov 29 18:24:31 user nova-compute[74613]:       </nova:owner>
Nov 29 18:24:31 user nova-compute[74613]:       <nova:root type="image" uuid="4217f428-8d9d-4ee1-9614-642d26d90c46"/>
Nov 29 18:24:31 user nova-compute[74613]:       <nova:ports>
Nov 29 18:24:31 user nova-compute[74613]:         <nova:port uuid="4e69c843-312f-47a8-8e75-4e857f6423d5">
Nov 29 18:24:31 user nova-compute[74613]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Nov 29 18:24:31 user nova-compute[74613]:         </nova:port>
Nov 29 18:24:31 user nova-compute[74613]:       </nova:ports>
Nov 29 18:24:31 user nova-compute[74613]:     </nova:instance>
Nov 29 18:24:31 user nova-compute[74613]:   </metadata>
Nov 29 18:24:31 user nova-compute[74613]:   <sysinfo type="smbios">
Nov 29 18:24:31 user nova-compute[74613]:     <system>
Nov 29 18:24:31 user nova-compute[74613]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 29 18:24:31 user nova-compute[74613]:       <entry name="product">OpenStack Nova</entry>
Nov 29 18:24:31 user nova-compute[74613]:       <entry name="version">0.0.0</entry>
Nov 29 18:24:31 user nova-compute[74613]:       <entry name="serial">35c09e0b-55fa-42c4-a47a-707909e184f9</entry>
Nov 29 18:24:31 user nova-compute[74613]:       <entry name="uuid">35c09e0b-55fa-42c4-a47a-707909e184f9</entry>
Nov 29 18:24:31 user nova-compute[74613]:       <entry name="family">Virtual Machine</entry>
Nov 29 18:24:31 user nova-compute[74613]:     </system>
Nov 29 18:24:31 user nova-compute[74613]:   </sysinfo>
Nov 29 18:24:31 user nova-compute[74613]:   <os>
Nov 29 18:24:31 user nova-compute[74613]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 29 18:24:31 user nova-compute[74613]:     <boot dev="hd"/>
Nov 29 18:24:31 user nova-compute[74613]:     <smbios mode="sysinfo"/>
Nov 29 18:24:31 user nova-compute[74613]:   </os>
Nov 29 18:24:31 user nova-compute[74613]:   <features>
Nov 29 18:24:31 user nova-compute[74613]:     <acpi/>
Nov 29 18:24:31 user nova-compute[74613]:     <apic/>
Nov 29 18:24:31 user nova-compute[74613]:     <vmcoreinfo/>
Nov 29 18:24:31 user nova-compute[74613]:   </features>
Nov 29 18:24:31 user nova-compute[74613]:   <clock offset="utc">
Nov 29 18:24:31 user nova-compute[74613]:     <timer name="pit" tickpolicy="delay"/>
Nov 29 18:24:31 user nova-compute[74613]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 29 18:24:31 user nova-compute[74613]:     <timer name="hpet" present="no"/>
Nov 29 18:24:31 user nova-compute[74613]:   </clock>
Nov 29 18:24:31 user nova-compute[74613]:   <cpu mode="custom" match="exact">
Nov 29 18:24:31 user nova-compute[74613]:     <model>Nehalem</model>
Nov 29 18:24:31 user nova-compute[74613]:     <topology sockets="1" cores="1" threads="1"/>
Nov 29 18:24:31 user nova-compute[74613]:   </cpu>
Nov 29 18:24:31 user nova-compute[74613]:   <devices>
Nov 29 18:24:31 user nova-compute[74613]:     <disk type="file" device="disk">
Nov 29 18:24:31 user nova-compute[74613]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 29 18:24:31 user nova-compute[74613]:       <source file="/opt/stack/data/nova/instances/35c09e0b-55fa-42c4-a47a-707909e184f9/disk"/>
Nov 29 18:24:31 user nova-compute[74613]:       <target dev="vda" bus="virtio"/>
Nov 29 18:24:31 user nova-compute[74613]:     </disk>
Nov 29 18:24:31 user nova-compute[74613]:     <interface type="ethernet">
Nov 29 18:24:31 user nova-compute[74613]:       <mac address="fa:16:3e:62:82:5f"/>
Nov 29 18:24:31 user nova-compute[74613]:       <model type="virtio"/>
Nov 29 18:24:31 user nova-compute[74613]:       <mtu size="1442"/>
Nov 29 18:24:31 user nova-compute[74613]:       <target dev="tap4e69c843-31"/>
Nov 29 18:24:31 user nova-compute[74613]:     </interface>
Nov 29 18:24:31 user nova-compute[74613]:     <serial type="pty">
Nov 29 18:24:31 user nova-compute[74613]:       <log file="/opt/stack/data/nova/instances/35c09e0b-55fa-42c4-a47a-707909e184f9/console.log" append="off"/>
Nov 29 18:24:31 user nova-compute[74613]:     </serial>
Nov 29 18:24:31 user nova-compute[74613]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 29 18:24:31 user nova-compute[74613]:     <video>
Nov 29 18:24:31 user nova-compute[74613]:       <model type="virtio"/>
Nov 29 18:24:31 user nova-compute[74613]:     </video>
Nov 29 18:24:31 user nova-compute[74613]:     <rng model="virtio">
Nov 29 18:24:31 user nova-compute[74613]:       <backend model="random">/dev/urandom</backend>
Nov 29 18:24:31 user nova-compute[74613]:     </rng>
Nov 29 18:24:31 user nova-compute[74613]:     <controller type="usb" index="0" model="none"/>
Nov 29 18:24:31 user nova-compute[74613]:     <memballoon model="virtio">
Nov 29 18:24:31 user nova-compute[74613]:       <stats period="10"/>
Nov 29 18:24:31 user nova-compute[74613]:     </memballoon>
Nov 29 18:24:31 user nova-compute[74613]:   </devices>
Nov 29 18:24:31 user nova-compute[74613]: </domain>
Nov 29 18:24:31 user nova-compute[74613]:  {{(pid=74613) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 29 18:24:31 user nova-compute[74613]: DEBUG nova.virt.libvirt.vif [None req-61594795-c969-4dc7-a7ab-5719a46d8ad1 tempest-VolumesActionsTest-576062334 tempest-VolumesActionsTest-576062334-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T18:24:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-2092330219',display_name='tempest-VolumesActionsTest-instance-2092330219',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-2092330219',id=47,image_ref='4217f428-8d9d-4ee1-9614-642d26d90c46',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='13bf1cb7deec45aea930f4a0092572d1',ramdisk_id='',reservation_id='r-jnotmc1e',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='4217f428-8d9d-4ee1-9614-642d26d90c46',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-576062334',owner_user_name='tempest-VolumesActionsTest-576062334-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T18:24:30Z,user_data=None,user_id='680fbea8ee2e489b9e7a4274b5f66b62',uuid=35c09e0b-55fa-42c4-a47a-707909e184f9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4e69c843-312f-47a8-8e75-4e857f6423d5", "address": "fa:16:3e:62:82:5f", "network": {"id": "74c4d111-4731-4d90-b6a9-a72b112d18ca", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1404505506-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "13bf1cb7deec45aea930f4a0092572d1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4e69c843-31", "ovs_interfaceid": "4e69c843-312f-47a8-8e75-4e857f6423d5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74613) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 29 18:24:31 user nova-compute[74613]: DEBUG nova.network.os_vif_util [None req-61594795-c969-4dc7-a7ab-5719a46d8ad1 tempest-VolumesActionsTest-576062334 tempest-VolumesActionsTest-576062334-project-member] Converting VIF {"id": "4e69c843-312f-47a8-8e75-4e857f6423d5", "address": "fa:16:3e:62:82:5f", "network": {"id": "74c4d111-4731-4d90-b6a9-a72b112d18ca", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1404505506-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "13bf1cb7deec45aea930f4a0092572d1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4e69c843-31", "ovs_interfaceid": "4e69c843-312f-47a8-8e75-4e857f6423d5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74613) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 18:24:31 user nova-compute[74613]: DEBUG nova.network.os_vif_util [None req-61594795-c969-4dc7-a7ab-5719a46d8ad1 tempest-VolumesActionsTest-576062334 tempest-VolumesActionsTest-576062334-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:62:82:5f,bridge_name='br-int',has_traffic_filtering=True,id=4e69c843-312f-47a8-8e75-4e857f6423d5,network=Network(74c4d111-4731-4d90-b6a9-a72b112d18ca),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4e69c843-31') {{(pid=74613) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 18:24:31 user nova-compute[74613]: DEBUG os_vif [None req-61594795-c969-4dc7-a7ab-5719a46d8ad1 tempest-VolumesActionsTest-576062334 tempest-VolumesActionsTest-576062334-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:62:82:5f,bridge_name='br-int',has_traffic_filtering=True,id=4e69c843-312f-47a8-8e75-4e857f6423d5,network=Network(74c4d111-4731-4d90-b6a9-a72b112d18ca),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4e69c843-31') {{(pid=74613) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 29 18:24:31 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:24:31 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74613) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 18:24:31 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74613) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 29 18:24:31 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:24:31 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'f08a6aff-a0c3-5c04-b13e-9d51e2bda12b', '_type': 'linux-noop'}}, row=False) {{(pid=74613) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 18:24:31 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:24:31 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 18:24:31 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:24:31 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap4e69c843-31, may_exist=True, interface_attrs={}) {{(pid=74613) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 18:24:31 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap4e69c843-31, col_values=(('qos', UUID('3590ba25-060a-4675-99c6-a6f2ea05123c')),), if_exists=True) {{(pid=74613) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 18:24:31 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap4e69c843-31, col_values=(('external_ids', {'iface-id': '4e69c843-312f-47a8-8e75-4e857f6423d5', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:62:82:5f', 'vm-uuid': '35c09e0b-55fa-42c4-a47a-707909e184f9'}),), if_exists=True) {{(pid=74613) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 18:24:31 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:24:31 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 18:24:31 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:24:31 user nova-compute[74613]: INFO os_vif [None req-61594795-c969-4dc7-a7ab-5719a46d8ad1 tempest-VolumesActionsTest-576062334 tempest-VolumesActionsTest-576062334-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:62:82:5f,bridge_name='br-int',has_traffic_filtering=True,id=4e69c843-312f-47a8-8e75-4e857f6423d5,network=Network(74c4d111-4731-4d90-b6a9-a72b112d18ca),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4e69c843-31')
Nov 29 18:24:31 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-61594795-c969-4dc7-a7ab-5719a46d8ad1 tempest-VolumesActionsTest-576062334 tempest-VolumesActionsTest-576062334-project-member] No BDM found with device name vda, not building metadata. {{(pid=74613) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 18:24:31 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-61594795-c969-4dc7-a7ab-5719a46d8ad1 tempest-VolumesActionsTest-576062334 tempest-VolumesActionsTest-576062334-project-member] No VIF found with MAC fa:16:3e:62:82:5f, not building metadata {{(pid=74613) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 29 18:24:32 user nova-compute[74613]: DEBUG nova.network.neutron [req-79874f06-6d4b-488e-ac5b-203a67bfd3ae req-aa2299ac-75eb-4db0-8158-ec97850d179a service nova] [instance: 35c09e0b-55fa-42c4-a47a-707909e184f9] Updated VIF entry in instance network info cache for port 4e69c843-312f-47a8-8e75-4e857f6423d5. {{(pid=74613) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 18:24:32 user nova-compute[74613]: DEBUG nova.network.neutron [req-79874f06-6d4b-488e-ac5b-203a67bfd3ae req-aa2299ac-75eb-4db0-8158-ec97850d179a service nova] [instance: 35c09e0b-55fa-42c4-a47a-707909e184f9] Updating instance_info_cache with network_info: [{"id": "4e69c843-312f-47a8-8e75-4e857f6423d5", "address": "fa:16:3e:62:82:5f", "network": {"id": "74c4d111-4731-4d90-b6a9-a72b112d18ca", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1404505506-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "13bf1cb7deec45aea930f4a0092572d1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4e69c843-31", "ovs_interfaceid": "4e69c843-312f-47a8-8e75-4e857f6423d5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74613) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 18:24:32 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-79874f06-6d4b-488e-ac5b-203a67bfd3ae req-aa2299ac-75eb-4db0-8158-ec97850d179a service nova] Releasing lock "refresh_cache-35c09e0b-55fa-42c4-a47a-707909e184f9" {{(pid=74613) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 18:24:33 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:24:33 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:24:33 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:24:33 user nova-compute[74613]: DEBUG nova.compute.manager [req-bb4b08f0-8f97-4291-a809-e73ca59c9032 req-f725fa9f-48d4-42f8-9d71-5b176fa76a2d service nova] [instance: 35c09e0b-55fa-42c4-a47a-707909e184f9] Received event network-vif-plugged-4e69c843-312f-47a8-8e75-4e857f6423d5 {{(pid=74613) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 18:24:33 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-bb4b08f0-8f97-4291-a809-e73ca59c9032 req-f725fa9f-48d4-42f8-9d71-5b176fa76a2d service nova] Acquiring lock "35c09e0b-55fa-42c4-a47a-707909e184f9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 18:24:33 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-bb4b08f0-8f97-4291-a809-e73ca59c9032 req-f725fa9f-48d4-42f8-9d71-5b176fa76a2d service nova] Lock "35c09e0b-55fa-42c4-a47a-707909e184f9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 18:24:33 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-bb4b08f0-8f97-4291-a809-e73ca59c9032 req-f725fa9f-48d4-42f8-9d71-5b176fa76a2d service nova] Lock "35c09e0b-55fa-42c4-a47a-707909e184f9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 18:24:33 user nova-compute[74613]: DEBUG nova.compute.manager [req-bb4b08f0-8f97-4291-a809-e73ca59c9032 req-f725fa9f-48d4-42f8-9d71-5b176fa76a2d service nova] [instance: 35c09e0b-55fa-42c4-a47a-707909e184f9] No waiting events found dispatching network-vif-plugged-4e69c843-312f-47a8-8e75-4e857f6423d5 {{(pid=74613) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 18:24:33 user nova-compute[74613]: WARNING nova.compute.manager [req-bb4b08f0-8f97-4291-a809-e73ca59c9032 req-f725fa9f-48d4-42f8-9d71-5b176fa76a2d service nova] [instance: 35c09e0b-55fa-42c4-a47a-707909e184f9] Received unexpected event network-vif-plugged-4e69c843-312f-47a8-8e75-4e857f6423d5 for instance with vm_state building and task_state spawning.
Nov 29 18:24:33 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:24:33 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:24:33 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:24:35 user nova-compute[74613]: DEBUG nova.compute.manager [None req-61594795-c969-4dc7-a7ab-5719a46d8ad1 tempest-VolumesActionsTest-576062334 tempest-VolumesActionsTest-576062334-project-member] [instance: 35c09e0b-55fa-42c4-a47a-707909e184f9] Instance event wait completed in 0 seconds for  {{(pid=74613) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 29 18:24:35 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-61594795-c969-4dc7-a7ab-5719a46d8ad1 tempest-VolumesActionsTest-576062334 tempest-VolumesActionsTest-576062334-project-member] [instance: 35c09e0b-55fa-42c4-a47a-707909e184f9] Guest created on hypervisor {{(pid=74613) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 29 18:24:35 user nova-compute[74613]: INFO nova.virt.libvirt.driver [-] [instance: 35c09e0b-55fa-42c4-a47a-707909e184f9] Instance spawned successfully.
Nov 29 18:24:35 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-61594795-c969-4dc7-a7ab-5719a46d8ad1 tempest-VolumesActionsTest-576062334 tempest-VolumesActionsTest-576062334-project-member] [instance: 35c09e0b-55fa-42c4-a47a-707909e184f9] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74613) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 29 18:24:35 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-61594795-c969-4dc7-a7ab-5719a46d8ad1 tempest-VolumesActionsTest-576062334 tempest-VolumesActionsTest-576062334-project-member] [instance: 35c09e0b-55fa-42c4-a47a-707909e184f9] Found default for hw_cdrom_bus of ide {{(pid=74613) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 18:24:35 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-61594795-c969-4dc7-a7ab-5719a46d8ad1 tempest-VolumesActionsTest-576062334 tempest-VolumesActionsTest-576062334-project-member] [instance: 35c09e0b-55fa-42c4-a47a-707909e184f9] Found default for hw_disk_bus of virtio {{(pid=74613) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 18:24:35 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-61594795-c969-4dc7-a7ab-5719a46d8ad1 tempest-VolumesActionsTest-576062334 tempest-VolumesActionsTest-576062334-project-member] [instance: 35c09e0b-55fa-42c4-a47a-707909e184f9] Found default for hw_input_bus of None {{(pid=74613) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 18:24:35 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-61594795-c969-4dc7-a7ab-5719a46d8ad1 tempest-VolumesActionsTest-576062334 tempest-VolumesActionsTest-576062334-project-member] [instance: 35c09e0b-55fa-42c4-a47a-707909e184f9] Found default for hw_pointer_model of None {{(pid=74613) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 18:24:35 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-61594795-c969-4dc7-a7ab-5719a46d8ad1 tempest-VolumesActionsTest-576062334 tempest-VolumesActionsTest-576062334-project-member] [instance: 35c09e0b-55fa-42c4-a47a-707909e184f9] Found default for hw_video_model of virtio {{(pid=74613) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 18:24:35 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-61594795-c969-4dc7-a7ab-5719a46d8ad1 tempest-VolumesActionsTest-576062334 tempest-VolumesActionsTest-576062334-project-member] [instance: 35c09e0b-55fa-42c4-a47a-707909e184f9] Found default for hw_vif_model of virtio {{(pid=74613) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 18:24:35 user nova-compute[74613]: INFO nova.compute.manager [None req-61594795-c969-4dc7-a7ab-5719a46d8ad1 tempest-VolumesActionsTest-576062334 tempest-VolumesActionsTest-576062334-project-member] [instance: 35c09e0b-55fa-42c4-a47a-707909e184f9] Took 5.28 seconds to spawn the instance on the hypervisor.
Nov 29 18:24:35 user nova-compute[74613]: DEBUG nova.compute.manager [None req-61594795-c969-4dc7-a7ab-5719a46d8ad1 tempest-VolumesActionsTest-576062334 tempest-VolumesActionsTest-576062334-project-member] [instance: 35c09e0b-55fa-42c4-a47a-707909e184f9] Checking state {{(pid=74613) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 29 18:24:35 user nova-compute[74613]: INFO nova.compute.manager [None req-61594795-c969-4dc7-a7ab-5719a46d8ad1 tempest-VolumesActionsTest-576062334 tempest-VolumesActionsTest-576062334-project-member] [instance: 35c09e0b-55fa-42c4-a47a-707909e184f9] Took 5.84 seconds to build instance.
Nov 29 18:24:35 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-61594795-c969-4dc7-a7ab-5719a46d8ad1 tempest-VolumesActionsTest-576062334 tempest-VolumesActionsTest-576062334-project-member] Lock "35c09e0b-55fa-42c4-a47a-707909e184f9" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 5.924s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 18:24:35 user nova-compute[74613]: DEBUG nova.compute.manager [req-3b94d72f-beab-4a57-9b04-800bd324f5fe req-e5dd863c-371e-43fb-ac36-188db1442f9e service nova] [instance: 35c09e0b-55fa-42c4-a47a-707909e184f9] Received event network-vif-plugged-4e69c843-312f-47a8-8e75-4e857f6423d5 {{(pid=74613) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 18:24:35 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-3b94d72f-beab-4a57-9b04-800bd324f5fe req-e5dd863c-371e-43fb-ac36-188db1442f9e service nova] Acquiring lock "35c09e0b-55fa-42c4-a47a-707909e184f9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 18:24:35 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-3b94d72f-beab-4a57-9b04-800bd324f5fe req-e5dd863c-371e-43fb-ac36-188db1442f9e service nova] Lock "35c09e0b-55fa-42c4-a47a-707909e184f9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 18:24:35 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-3b94d72f-beab-4a57-9b04-800bd324f5fe req-e5dd863c-371e-43fb-ac36-188db1442f9e service nova] Lock "35c09e0b-55fa-42c4-a47a-707909e184f9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 18:24:35 user nova-compute[74613]: DEBUG nova.compute.manager [req-3b94d72f-beab-4a57-9b04-800bd324f5fe req-e5dd863c-371e-43fb-ac36-188db1442f9e service nova] [instance: 35c09e0b-55fa-42c4-a47a-707909e184f9] No waiting events found dispatching network-vif-plugged-4e69c843-312f-47a8-8e75-4e857f6423d5 {{(pid=74613) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 18:24:35 user nova-compute[74613]: WARNING nova.compute.manager [req-3b94d72f-beab-4a57-9b04-800bd324f5fe req-e5dd863c-371e-43fb-ac36-188db1442f9e service nova] [instance: 35c09e0b-55fa-42c4-a47a-707909e184f9] Received unexpected event network-vif-plugged-4e69c843-312f-47a8-8e75-4e857f6423d5 for instance with vm_state active and task_state None.
Nov 29 18:24:36 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:24:36 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:24:40 user nova-compute[74613]: DEBUG oslo_service.periodic_task [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74613) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 18:24:41 user nova-compute[74613]: DEBUG oslo_service.periodic_task [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74613) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 18:24:41 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 18:24:41 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 18:24:41 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74613) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 29 18:24:41 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74613) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 18:24:41 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:24:41 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74613) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 18:24:41 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 18:24:43 user nova-compute[74613]: WARNING nova.virt.libvirt.driver [None req-88754764-c394-467f-8a26-9015a42c7c1d tempest-SnapshotDataIntegrityTests-1810787156 tempest-SnapshotDataIntegrityTests-1810787156-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 5227902d-b2b9-40a6-988f-3c02c52404f3 is timed out.
Nov 29 18:24:43 user nova-compute[74613]: INFO nova.virt.libvirt.driver [None req-88754764-c394-467f-8a26-9015a42c7c1d tempest-SnapshotDataIntegrityTests-1810787156 tempest-SnapshotDataIntegrityTests-1810787156-project-member] Successfully detached device vdb from instance 5227902d-b2b9-40a6-988f-3c02c52404f3 from the live domain config.
Nov 29 18:24:43 user nova-compute[74613]: DEBUG nova.virt.libvirt.volume.iscsi [None req-88754764-c394-467f-8a26-9015a42c7c1d tempest-SnapshotDataIntegrityTests-1810787156 tempest-SnapshotDataIntegrityTests-1810787156-project-member] [instance: 5227902d-b2b9-40a6-988f-3c02c52404f3] calling os-brick to detach iSCSI Volume {{(pid=74613) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 29 18:24:43 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-88754764-c394-467f-8a26-9015a42c7c1d tempest-SnapshotDataIntegrityTests-1810787156 tempest-SnapshotDataIntegrityTests-1810787156-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff828156890>, {'target_iqn': 'iqn.2010-10.org.openstack:6c9b7b59-9da2-47b6-a0f0-f533803e54f6', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'aNRXefsz', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=74613) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 18:24:43 user nova-compute[74613]: WARNING os_brick.initiator.connectors.base [None req-88754764-c394-467f-8a26-9015a42c7c1d tempest-SnapshotDataIntegrityTests-1810787156 tempest-SnapshotDataIntegrityTests-1810787156-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 18:24:43 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.base [None req-88754764-c394-467f-8a26-9015a42c7c1d tempest-SnapshotDataIntegrityTests-1810787156 tempest-SnapshotDataIntegrityTests-1810787156-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 18:24:43 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.base [None req-88754764-c394-467f-8a26-9015a42c7c1d tempest-SnapshotDataIntegrityTests-1810787156 tempest-SnapshotDataIntegrityTests-1810787156-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 18:24:43 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:24:43 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.017s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:24:43 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[75e48430-3748-4923-a324-a5e906cc38a7]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:6c9b7b59-9da2-47b6-a0f0-f533803e54f6\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 18:24:43 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-88754764-c394-467f-8a26-9015a42c7c1d tempest-SnapshotDataIntegrityTests-1810787156 tempest-SnapshotDataIntegrityTests-1810787156-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 29 18:24:43 user nova-compute[74613]: No targets found.
Nov 29 18:24:43 user nova-compute[74613]: iSNS:
Nov 29 18:24:43 user nova-compute[74613]: No targets found.
Nov 29 18:24:43 user nova-compute[74613]: STATIC:
Nov 29 18:24:43 user nova-compute[74613]: Target: iqn.2010-10.org.openstack:6c9b7b59-9da2-47b6-a0f0-f533803e54f6
Nov 29 18:24:43 user nova-compute[74613]:         Portal: 172.16.0.220:3260,-1
Nov 29 18:24:43 user nova-compute[74613]:                 Iface Name: default
Nov 29 18:24:43 user nova-compute[74613]: FIRMWARE:
Nov 29 18:24:43 user nova-compute[74613]: No targets found.
Nov 29 18:24:43 user nova-compute[74613]:  stderr= {{(pid=74613) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 18:24:43 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-88754764-c394-467f-8a26-9015a42c7c1d tempest-SnapshotDataIntegrityTests-1810787156 tempest-SnapshotDataIntegrityTests-1810787156-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 29 18:24:43 user nova-compute[74613]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 29 18:24:43 user nova-compute[74613]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74613) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 29 18:24:43 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-88754764-c394-467f-8a26-9015a42c7c1d tempest-SnapshotDataIntegrityTests-1810787156 tempest-SnapshotDataIntegrityTests-1810787156-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6c9b7b59-9da2-47b6-a0f0-f533803e54f6', 0)] {{(pid=74613) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 29 18:24:43 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:24:43 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.016s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:24:43 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[a39638ca-04a1-4bb2-a240-ee685dfaa5bd]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6c9b7b59-9da2-47b6-a0f0-f533803e54f6\n', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 18:24:43 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:24:43 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.017s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:24:43 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[090f38f1-02bd-46a3-a313-a014178a5795]: (4, ('tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c9b7b59-9da2-47b6-a0f0-f533803e54f6 (non-flash)\n', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 18:24:43 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-88754764-c394-467f-8a26-9015a42c7c1d tempest-SnapshotDataIntegrityTests-1810787156 tempest-SnapshotDataIntegrityTests-1810787156-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c9b7b59-9da2-47b6-a0f0-f533803e54f6 (non-flash)
Nov 29 18:24:43 user nova-compute[74613]:  stderr= {{(pid=74613) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 18:24:43 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-88754764-c394-467f-8a26-9015a42c7c1d tempest-SnapshotDataIntegrityTests-1810787156 tempest-SnapshotDataIntegrityTests-1810787156-project-member] iscsi session list stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c9b7b59-9da2-47b6-a0f0-f533803e54f6 (non-flash)
Nov 29 18:24:43 user nova-compute[74613]:  stderr= {{(pid=74613) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 18:24:43 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-88754764-c394-467f-8a26-9015a42c7c1d tempest-SnapshotDataIntegrityTests-1810787156 tempest-SnapshotDataIntegrityTests-1810787156-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7ff81811b910>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6c9b7b59-9da2-47b6-a0f0-f533803e54f6'): ({'sdc'}, set())}) {{(pid=74613) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 29 18:24:43 user nova-compute[74613]: DEBUG os_brick.initiator.linuxscsi [None req-88754764-c394-467f-8a26-9015a42c7c1d tempest-SnapshotDataIntegrityTests-1810787156 tempest-SnapshotDataIntegrityTests-1810787156-project-member] Removing single pathed devices sdc {{(pid=74613) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 29 18:24:43 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:24:43 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:24:43 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[b535ba1e-4383-440d-8fd4-ba4d974f395a]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 18:24:43 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:24:43 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.017s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:24:43 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[078ea42d-e21d-4d21-b5d6-08e2bd11170a]: (4, ('ok\n', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 18:24:43 user nova-compute[74613]: DEBUG os_brick.initiator.linuxscsi [None req-88754764-c394-467f-8a26-9015a42c7c1d tempest-SnapshotDataIntegrityTests-1810787156 tempest-SnapshotDataIntegrityTests-1810787156-project-member] Flushing IO for device /dev/sdc {{(pid=74613) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 29 18:24:43 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:24:43 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.012s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:24:43 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d7b74a6-31c3-47e9-9123-42d8a6921a61]: (4, ('', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 18:24:43 user nova-compute[74613]: DEBUG os_brick.initiator.linuxscsi [None req-88754764-c394-467f-8a26-9015a42c7c1d tempest-SnapshotDataIntegrityTests-1810787156 tempest-SnapshotDataIntegrityTests-1810787156-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=74613) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 29 18:24:43 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:24:43 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.048s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:24:43 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf25a93d-33e0-4f0e-992e-bbbc5003e546]: (4, ('1', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 18:24:43 user nova-compute[74613]: DEBUG os_brick.initiator.linuxscsi [None req-88754764-c394-467f-8a26-9015a42c7c1d tempest-SnapshotDataIntegrityTests-1810787156 tempest-SnapshotDataIntegrityTests-1810787156-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=74613) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 29 18:24:43 user nova-compute[74613]: DEBUG os_brick.initiator.linuxscsi [None req-88754764-c394-467f-8a26-9015a42c7c1d tempest-SnapshotDataIntegrityTests-1810787156 tempest-SnapshotDataIntegrityTests-1810787156-project-member] SCSI volumes sdc have been removed. {{(pid=74613) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 29 18:24:43 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-88754764-c394-467f-8a26-9015a42c7c1d tempest-SnapshotDataIntegrityTests-1810787156 tempest-SnapshotDataIntegrityTests-1810787156-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6c9b7b59-9da2-47b6-a0f0-f533803e54f6')] {{(pid=74613) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 29 18:24:43 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6c9b7b59-9da2-47b6-a0f0-f533803e54f6 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:24:43 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6c9b7b59-9da2-47b6-a0f0-f533803e54f6 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.017s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:24:43 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd89cb8f-e72d-4197-b5c3-ad9845eb0747]: (4, ('', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 18:24:43 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-88754764-c394-467f-8a26-9015a42c7c1d tempest-SnapshotDataIntegrityTests-1810787156 tempest-SnapshotDataIntegrityTests-1810787156-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74613) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 18:24:43 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6c9b7b59-9da2-47b6-a0f0-f533803e54f6 -p 172.16.0.220:3260 --logout {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:24:43 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6c9b7b59-9da2-47b6-a0f0-f533803e54f6 -p 172.16.0.220:3260 --logout" returned: 0 in 0.048s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:24:43 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef57c70f-d02d-40f4-9a99-9f9930ff0954]: (4, ('Logging out of session [sid: 52, target: iqn.2010-10.org.openstack:6c9b7b59-9da2-47b6-a0f0-f533803e54f6, portal: 172.16.0.220,3260]\nLogout of [sid: 52, target: iqn.2010-10.org.openstack:6c9b7b59-9da2-47b6-a0f0-f533803e54f6, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 18:24:43 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-88754764-c394-467f-8a26-9015a42c7c1d tempest-SnapshotDataIntegrityTests-1810787156 tempest-SnapshotDataIntegrityTests-1810787156-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 52, target: iqn.2010-10.org.openstack:6c9b7b59-9da2-47b6-a0f0-f533803e54f6, portal: 172.16.0.220,3260]
Nov 29 18:24:43 user nova-compute[74613]: Logout of [sid: 52, target: iqn.2010-10.org.openstack:6c9b7b59-9da2-47b6-a0f0-f533803e54f6, portal: 172.16.0.220,3260] successful.
Nov 29 18:24:43 user nova-compute[74613]:  stderr= {{(pid=74613) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 18:24:43 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6c9b7b59-9da2-47b6-a0f0-f533803e54f6 -p 172.16.0.220:3260 --op delete {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:24:43 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6c9b7b59-9da2-47b6-a0f0-f533803e54f6 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.017s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:24:43 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ed1e2e6-8efa-489d-90e5-2336bfa5e5d2]: (4, ('', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 18:24:43 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-88754764-c394-467f-8a26-9015a42c7c1d tempest-SnapshotDataIntegrityTests-1810787156 tempest-SnapshotDataIntegrityTests-1810787156-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74613) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 18:24:43 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.base [None req-88754764-c394-467f-8a26-9015a42c7c1d tempest-SnapshotDataIntegrityTests-1810787156 tempest-SnapshotDataIntegrityTests-1810787156-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.269s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 18:24:43 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-88754764-c394-467f-8a26-9015a42c7c1d tempest-SnapshotDataIntegrityTests-1810787156 tempest-SnapshotDataIntegrityTests-1810787156-project-member] <== disconnect_volume: return (271ms) None {{(pid=74613) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 18:24:43 user nova-compute[74613]: DEBUG nova.virt.libvirt.volume.iscsi [None req-88754764-c394-467f-8a26-9015a42c7c1d tempest-SnapshotDataIntegrityTests-1810787156 tempest-SnapshotDataIntegrityTests-1810787156-project-member] [instance: 5227902d-b2b9-40a6-988f-3c02c52404f3] Disconnected iSCSI Volume {{(pid=74613) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 29 18:24:44 user nova-compute[74613]: DEBUG nova.objects.instance [None req-88754764-c394-467f-8a26-9015a42c7c1d tempest-SnapshotDataIntegrityTests-1810787156 tempest-SnapshotDataIntegrityTests-1810787156-project-member] Lazy-loading 'flavor' on Instance uuid 5227902d-b2b9-40a6-988f-3c02c52404f3 {{(pid=74613) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 18:24:44 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-88754764-c394-467f-8a26-9015a42c7c1d tempest-SnapshotDataIntegrityTests-1810787156 tempest-SnapshotDataIntegrityTests-1810787156-project-member] Lock "5227902d-b2b9-40a6-988f-3c02c52404f3" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.640s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 18:24:45 user nova-compute[74613]: DEBUG oslo_service.periodic_task [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74613) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 18:24:45 user nova-compute[74613]: DEBUG oslo_service.periodic_task [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74613) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 18:24:45 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 18:24:45 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 18:24:45 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 18:24:45 user nova-compute[74613]: DEBUG nova.compute.resource_tracker [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Auditing locally available compute resources for user (node: user) {{(pid=74613) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 29 18:24:45 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/35c09e0b-55fa-42c4-a47a-707909e184f9/disk --force-share --output=json {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:24:45 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/35c09e0b-55fa-42c4-a47a-707909e184f9/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:24:45 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/35c09e0b-55fa-42c4-a47a-707909e184f9/disk --force-share --output=json {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:24:46 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/35c09e0b-55fa-42c4-a47a-707909e184f9/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:24:46 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5227902d-b2b9-40a6-988f-3c02c52404f3/disk --force-share --output=json {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:24:46 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5227902d-b2b9-40a6-988f-3c02c52404f3/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:24:46 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5227902d-b2b9-40a6-988f-3c02c52404f3/disk --force-share --output=json {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:24:46 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5227902d-b2b9-40a6-988f-3c02c52404f3/disk --force-share --output=json" returned: 0 in 0.224s {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:24:46 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:24:46 user nova-compute[74613]: WARNING nova.virt.libvirt.driver [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 18:24:46 user nova-compute[74613]: WARNING nova.virt.libvirt.driver [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 18:24:46 user nova-compute[74613]: DEBUG nova.compute.resource_tracker [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Hypervisor/Node resource view: name=user free_ram=8705MB free_disk=24.921688079833984GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74613) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 29 18:24:46 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 18:24:46 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 18:24:46 user nova-compute[74613]: DEBUG nova.compute.resource_tracker [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Instance 5227902d-b2b9-40a6-988f-3c02c52404f3 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74613) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 18:24:46 user nova-compute[74613]: DEBUG nova.compute.resource_tracker [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Instance 35c09e0b-55fa-42c4-a47a-707909e184f9 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74613) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 18:24:46 user nova-compute[74613]: DEBUG nova.compute.resource_tracker [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=74613) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 29 18:24:46 user nova-compute[74613]: DEBUG nova.compute.resource_tracker [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=74613) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 29 18:24:46 user nova-compute[74613]: DEBUG nova.compute.provider_tree [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Inventory has not changed in ProviderTree for provider: 639d980e-3b12-44b1-b8f4-1812416fa4dd {{(pid=74613) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 18:24:46 user nova-compute[74613]: DEBUG nova.scheduler.client.report [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Inventory has not changed for provider 639d980e-3b12-44b1-b8f4-1812416fa4dd based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74613) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 18:24:47 user nova-compute[74613]: DEBUG nova.compute.resource_tracker [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Compute_service record updated for user:user {{(pid=74613) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 29 18:24:47 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.230s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 18:24:49 user nova-compute[74613]: DEBUG oslo_service.periodic_task [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74613) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 18:24:49 user nova-compute[74613]: DEBUG nova.compute.manager [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Starting heal instance info cache {{(pid=74613) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 29 18:24:49 user nova-compute[74613]: DEBUG nova.compute.manager [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Rebuilding the list of instances to heal {{(pid=74613) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 29 18:24:49 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Acquiring lock "refresh_cache-5227902d-b2b9-40a6-988f-3c02c52404f3" {{(pid=74613) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 18:24:49 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Acquired lock "refresh_cache-5227902d-b2b9-40a6-988f-3c02c52404f3" {{(pid=74613) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 18:24:49 user nova-compute[74613]: DEBUG nova.network.neutron [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] [instance: 5227902d-b2b9-40a6-988f-3c02c52404f3] Forcefully refreshing network info cache for instance {{(pid=74613) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 29 18:24:49 user nova-compute[74613]: DEBUG nova.objects.instance [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Lazy-loading 'info_cache' on Instance uuid 5227902d-b2b9-40a6-988f-3c02c52404f3 {{(pid=74613) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 18:24:49 user nova-compute[74613]: DEBUG nova.network.neutron [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] [instance: 5227902d-b2b9-40a6-988f-3c02c52404f3] Updating instance_info_cache with network_info: [{"id": "11900168-d650-4db6-8f65-21f1f9c4b603", "address": "fa:16:3e:40:72:ca", "network": {"id": "8951bb42-2dd0-4887-b0d1-fdb8d3ac7589", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1016730518-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.120", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "31a87cb1f6e14287abcfae98de155491", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap11900168-d6", "ovs_interfaceid": "11900168-d650-4db6-8f65-21f1f9c4b603", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74613) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 18:24:49 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Releasing lock "refresh_cache-5227902d-b2b9-40a6-988f-3c02c52404f3" {{(pid=74613) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 18:24:49 user nova-compute[74613]: DEBUG nova.compute.manager [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] [instance: 5227902d-b2b9-40a6-988f-3c02c52404f3] Updated the network info_cache for instance {{(pid=74613) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 29 18:24:49 user nova-compute[74613]: DEBUG oslo_service.periodic_task [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74613) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 18:24:49 user nova-compute[74613]: DEBUG oslo_service.periodic_task [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74613) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 18:24:49 user nova-compute[74613]: DEBUG oslo_service.periodic_task [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74613) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 18:24:49 user nova-compute[74613]: DEBUG nova.compute.manager [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74613) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 29 18:24:51 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:24:51 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:24:53 user nova-compute[74613]: DEBUG oslo_service.periodic_task [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74613) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 18:24:56 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:24:56 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:25:01 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:25:01 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:25:06 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:25:06 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:25:11 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 18:25:11 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 18:25:11 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=74613) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 29 18:25:11 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74613) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 18:25:11 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74613) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 18:25:11 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:25:15 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-36235368-08a4-4947-bc5a-dd6e0d80c468 tempest-SnapshotDataIntegrityTests-1810787156 tempest-SnapshotDataIntegrityTests-1810787156-project-member] Acquiring lock "5227902d-b2b9-40a6-988f-3c02c52404f3" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 18:25:15 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-36235368-08a4-4947-bc5a-dd6e0d80c468 tempest-SnapshotDataIntegrityTests-1810787156 tempest-SnapshotDataIntegrityTests-1810787156-project-member] Lock "5227902d-b2b9-40a6-988f-3c02c52404f3" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 18:25:15 user nova-compute[74613]: DEBUG nova.objects.instance [None req-36235368-08a4-4947-bc5a-dd6e0d80c468 tempest-SnapshotDataIntegrityTests-1810787156 tempest-SnapshotDataIntegrityTests-1810787156-project-member] Lazy-loading 'flavor' on Instance uuid 5227902d-b2b9-40a6-988f-3c02c52404f3 {{(pid=74613) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 18:25:15 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-36235368-08a4-4947-bc5a-dd6e0d80c468 tempest-SnapshotDataIntegrityTests-1810787156 tempest-SnapshotDataIntegrityTests-1810787156-project-member] Lock "5227902d-b2b9-40a6-988f-3c02c52404f3" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.050s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 18:25:15 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-36235368-08a4-4947-bc5a-dd6e0d80c468 tempest-SnapshotDataIntegrityTests-1810787156 tempest-SnapshotDataIntegrityTests-1810787156-project-member] Acquiring lock "5227902d-b2b9-40a6-988f-3c02c52404f3" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 18:25:15 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-36235368-08a4-4947-bc5a-dd6e0d80c468 tempest-SnapshotDataIntegrityTests-1810787156 tempest-SnapshotDataIntegrityTests-1810787156-project-member] Lock "5227902d-b2b9-40a6-988f-3c02c52404f3" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 18:25:15 user nova-compute[74613]: INFO nova.compute.manager [None req-36235368-08a4-4947-bc5a-dd6e0d80c468 tempest-SnapshotDataIntegrityTests-1810787156 tempest-SnapshotDataIntegrityTests-1810787156-project-member] [instance: 5227902d-b2b9-40a6-988f-3c02c52404f3] Attaching volume 69f38afd-fc23-439c-8149-17a04be10706 to /dev/vdb
Nov 29 18:25:15 user nova-compute[74613]: DEBUG os_brick.utils [None req-36235368-08a4-4947-bc5a-dd6e0d80c468 tempest-SnapshotDataIntegrityTests-1810787156 tempest-SnapshotDataIntegrityTests-1810787156-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74613) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 18:25:15 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:25:15 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:25:15 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac19794e-0071-48f9-bb1a-fa2e20eb1578]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:400972819b5\n', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 18:25:15 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:25:15 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:25:15 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[5edaa12b-6948-4bb5-bff9-26696af90dc1]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 18:25:15 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:25:15 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:25:15 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee313e58-59aa-4311-bea4-28e817683960]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 18:25:15 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[617f5c33-caff-4b09-8169-5b72215654a3]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 18:25:15 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-36235368-08a4-4947-bc5a-dd6e0d80c468 tempest-SnapshotDataIntegrityTests-1810787156 tempest-SnapshotDataIntegrityTests-1810787156-project-member] Running cmd (subprocess): nvme version {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:25:15 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-36235368-08a4-4947-bc5a-dd6e0d80c468 tempest-SnapshotDataIntegrityTests-1810787156 tempest-SnapshotDataIntegrityTests-1810787156-project-member] 'nvme version' failed. Not Retrying. {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 18:25:16 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.nvmeof [None req-36235368-08a4-4947-bc5a-dd6e0d80c468 tempest-SnapshotDataIntegrityTests-1810787156 tempest-SnapshotDataIntegrityTests-1810787156-project-member] nvme not present on system {{(pid=74613) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 29 18:25:16 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:25:16 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 18:25:16 user nova-compute[74613]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 29 18:25:16 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[74770f2c-f629-423f-b984-3eb7a585691d]: (4, '') {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 18:25:16 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.lightos [None req-36235368-08a4-4947-bc5a-dd6e0d80c468 tempest-SnapshotDataIntegrityTests-1810787156 tempest-SnapshotDataIntegrityTests-1810787156-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74613) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 29 18:25:16 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.lightos [None req-36235368-08a4-4947-bc5a-dd6e0d80c468 tempest-SnapshotDataIntegrityTests-1810787156 tempest-SnapshotDataIntegrityTests-1810787156-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74613) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 29 18:25:16 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.lightos [None req-36235368-08a4-4947-bc5a-dd6e0d80c468 tempest-SnapshotDataIntegrityTests-1810787156 tempest-SnapshotDataIntegrityTests-1810787156-project-member] LIGHTOS: no hostnqn found. {{(pid=74613) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 29 18:25:16 user nova-compute[74613]: DEBUG os_brick.utils [None req-36235368-08a4-4947-bc5a-dd6e0d80c468 tempest-SnapshotDataIntegrityTests-1810787156 tempest-SnapshotDataIntegrityTests-1810787156-project-member] <== get_connector_properties: return (117ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:400972819b5', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74613) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 18:25:16 user nova-compute[74613]: DEBUG nova.virt.block_device [None req-36235368-08a4-4947-bc5a-dd6e0d80c468 tempest-SnapshotDataIntegrityTests-1810787156 tempest-SnapshotDataIntegrityTests-1810787156-project-member] [instance: 5227902d-b2b9-40a6-988f-3c02c52404f3] Updating existing volume attachment record: effccf3f-c24e-43a9-8afb-22fad9bed53c {{(pid=74613) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 29 18:25:16 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:25:16 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:25:19 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-1e7c1f9a-e7bf-40d3-88fd-0af1eea50b34 tempest-TestVolumeBootPattern-1318569205 tempest-TestVolumeBootPattern-1318569205-project-member] Acquiring lock "059e3f87-a811-4ac7-b846-2f6d202a919f" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 18:25:19 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-1e7c1f9a-e7bf-40d3-88fd-0af1eea50b34 tempest-TestVolumeBootPattern-1318569205 tempest-TestVolumeBootPattern-1318569205-project-member] Lock "059e3f87-a811-4ac7-b846-2f6d202a919f" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 18:25:19 user nova-compute[74613]: DEBUG nova.compute.manager [None req-1e7c1f9a-e7bf-40d3-88fd-0af1eea50b34 tempest-TestVolumeBootPattern-1318569205 tempest-TestVolumeBootPattern-1318569205-project-member] [instance: 059e3f87-a811-4ac7-b846-2f6d202a919f] Starting instance... {{(pid=74613) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 29 18:25:20 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-1e7c1f9a-e7bf-40d3-88fd-0af1eea50b34 tempest-TestVolumeBootPattern-1318569205 tempest-TestVolumeBootPattern-1318569205-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 18:25:20 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-1e7c1f9a-e7bf-40d3-88fd-0af1eea50b34 tempest-TestVolumeBootPattern-1318569205 tempest-TestVolumeBootPattern-1318569205-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 18:25:20 user nova-compute[74613]: DEBUG nova.virt.hardware [None req-1e7c1f9a-e7bf-40d3-88fd-0af1eea50b34 tempest-TestVolumeBootPattern-1318569205 tempest-TestVolumeBootPattern-1318569205-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74613) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 29 18:25:20 user nova-compute[74613]: INFO nova.compute.claims [None req-1e7c1f9a-e7bf-40d3-88fd-0af1eea50b34 tempest-TestVolumeBootPattern-1318569205 tempest-TestVolumeBootPattern-1318569205-project-member] [instance: 059e3f87-a811-4ac7-b846-2f6d202a919f] Claim successful on node user
Nov 29 18:25:20 user nova-compute[74613]: DEBUG nova.compute.provider_tree [None req-1e7c1f9a-e7bf-40d3-88fd-0af1eea50b34 tempest-TestVolumeBootPattern-1318569205 tempest-TestVolumeBootPattern-1318569205-project-member] Inventory has not changed in ProviderTree for provider: 639d980e-3b12-44b1-b8f4-1812416fa4dd {{(pid=74613) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 18:25:20 user nova-compute[74613]: DEBUG nova.scheduler.client.report [None req-1e7c1f9a-e7bf-40d3-88fd-0af1eea50b34 tempest-TestVolumeBootPattern-1318569205 tempest-TestVolumeBootPattern-1318569205-project-member] Inventory has not changed for provider 639d980e-3b12-44b1-b8f4-1812416fa4dd based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74613) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 18:25:20 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-1e7c1f9a-e7bf-40d3-88fd-0af1eea50b34 tempest-TestVolumeBootPattern-1318569205 tempest-TestVolumeBootPattern-1318569205-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.317s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 18:25:20 user nova-compute[74613]: DEBUG nova.compute.manager [None req-1e7c1f9a-e7bf-40d3-88fd-0af1eea50b34 tempest-TestVolumeBootPattern-1318569205 tempest-TestVolumeBootPattern-1318569205-project-member] [instance: 059e3f87-a811-4ac7-b846-2f6d202a919f] Start building networks asynchronously for instance. {{(pid=74613) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 29 18:25:20 user nova-compute[74613]: DEBUG nova.compute.manager [None req-1e7c1f9a-e7bf-40d3-88fd-0af1eea50b34 tempest-TestVolumeBootPattern-1318569205 tempest-TestVolumeBootPattern-1318569205-project-member] [instance: 059e3f87-a811-4ac7-b846-2f6d202a919f] Allocating IP information in the background. {{(pid=74613) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 29 18:25:20 user nova-compute[74613]: DEBUG nova.network.neutron [None req-1e7c1f9a-e7bf-40d3-88fd-0af1eea50b34 tempest-TestVolumeBootPattern-1318569205 tempest-TestVolumeBootPattern-1318569205-project-member] [instance: 059e3f87-a811-4ac7-b846-2f6d202a919f] allocate_for_instance() {{(pid=74613) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 29 18:25:20 user nova-compute[74613]: INFO nova.virt.libvirt.driver [None req-1e7c1f9a-e7bf-40d3-88fd-0af1eea50b34 tempest-TestVolumeBootPattern-1318569205 tempest-TestVolumeBootPattern-1318569205-project-member] [instance: 059e3f87-a811-4ac7-b846-2f6d202a919f] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 29 18:25:20 user nova-compute[74613]: DEBUG nova.compute.manager [None req-1e7c1f9a-e7bf-40d3-88fd-0af1eea50b34 tempest-TestVolumeBootPattern-1318569205 tempest-TestVolumeBootPattern-1318569205-project-member] [instance: 059e3f87-a811-4ac7-b846-2f6d202a919f] Start building block device mappings for instance. {{(pid=74613) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 29 18:25:20 user nova-compute[74613]: DEBUG nova.policy [None req-1e7c1f9a-e7bf-40d3-88fd-0af1eea50b34 tempest-TestVolumeBootPattern-1318569205 tempest-TestVolumeBootPattern-1318569205-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'bedbc6ed47394e2b9125543a8b88a71f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67390f1402214191904cfbd68c3142a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74613) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 29 18:25:20 user nova-compute[74613]: INFO nova.virt.block_device [None req-1e7c1f9a-e7bf-40d3-88fd-0af1eea50b34 tempest-TestVolumeBootPattern-1318569205 tempest-TestVolumeBootPattern-1318569205-project-member] [instance: 059e3f87-a811-4ac7-b846-2f6d202a919f] Booting with volume 6f39cfde-47c7-4b9f-83d3-13c147be6792 at /dev/vda
Nov 29 18:25:20 user nova-compute[74613]: DEBUG os_brick.utils [None req-1e7c1f9a-e7bf-40d3-88fd-0af1eea50b34 tempest-TestVolumeBootPattern-1318569205 tempest-TestVolumeBootPattern-1318569205-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74613) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 18:25:20 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:25:20 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:25:20 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[cac804d4-2774-4c07-9a79-da9bd9e27f27]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:400972819b5\n', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 18:25:20 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:25:20 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:25:20 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[e515b0b4-b285-44fa-ba88-25f0b50d6124]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 18:25:20 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:25:20 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:25:20 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8b7bb0b-a4b3-45f2-8c05-b2fab1c0fa31]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 18:25:20 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e4fb693-4945-4286-8cda-d25232df2af4]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 18:25:20 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-1e7c1f9a-e7bf-40d3-88fd-0af1eea50b34 tempest-TestVolumeBootPattern-1318569205 tempest-TestVolumeBootPattern-1318569205-project-member] Running cmd (subprocess): nvme version {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:25:20 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-1e7c1f9a-e7bf-40d3-88fd-0af1eea50b34 tempest-TestVolumeBootPattern-1318569205 tempest-TestVolumeBootPattern-1318569205-project-member] 'nvme version' failed. Not Retrying. {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 18:25:20 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.nvmeof [None req-1e7c1f9a-e7bf-40d3-88fd-0af1eea50b34 tempest-TestVolumeBootPattern-1318569205 tempest-TestVolumeBootPattern-1318569205-project-member] nvme not present on system {{(pid=74613) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 29 18:25:20 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:25:20 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 18:25:20 user nova-compute[74613]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 29 18:25:20 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8d79980-a8c7-4265-80d6-204d73d81090]: (4, '') {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 18:25:20 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.lightos [None req-1e7c1f9a-e7bf-40d3-88fd-0af1eea50b34 tempest-TestVolumeBootPattern-1318569205 tempest-TestVolumeBootPattern-1318569205-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74613) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 29 18:25:20 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.lightos [None req-1e7c1f9a-e7bf-40d3-88fd-0af1eea50b34 tempest-TestVolumeBootPattern-1318569205 tempest-TestVolumeBootPattern-1318569205-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74613) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 29 18:25:20 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.lightos [None req-1e7c1f9a-e7bf-40d3-88fd-0af1eea50b34 tempest-TestVolumeBootPattern-1318569205 tempest-TestVolumeBootPattern-1318569205-project-member] LIGHTOS: no hostnqn found. {{(pid=74613) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 29 18:25:20 user nova-compute[74613]: DEBUG os_brick.utils [None req-1e7c1f9a-e7bf-40d3-88fd-0af1eea50b34 tempest-TestVolumeBootPattern-1318569205 tempest-TestVolumeBootPattern-1318569205-project-member] <== get_connector_properties: return (123ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:400972819b5', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74613) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 18:25:20 user nova-compute[74613]: DEBUG nova.virt.block_device [None req-1e7c1f9a-e7bf-40d3-88fd-0af1eea50b34 tempest-TestVolumeBootPattern-1318569205 tempest-TestVolumeBootPattern-1318569205-project-member] [instance: 059e3f87-a811-4ac7-b846-2f6d202a919f] Updating existing volume attachment record: 243228e0-ab29-4e80-9495-487fa0bbe507 {{(pid=74613) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 29 18:25:21 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 18:25:21 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:25:21 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=74613) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 29 18:25:21 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74613) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 18:25:21 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74613) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 18:25:21 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:25:21 user nova-compute[74613]: DEBUG nova.network.neutron [None req-1e7c1f9a-e7bf-40d3-88fd-0af1eea50b34 tempest-TestVolumeBootPattern-1318569205 tempest-TestVolumeBootPattern-1318569205-project-member] [instance: 059e3f87-a811-4ac7-b846-2f6d202a919f] Successfully created port: 91dd58f7-d736-4a98-b6a6-f4d1bc6dd8dd {{(pid=74613) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 29 18:25:22 user nova-compute[74613]: DEBUG nova.network.neutron [None req-1e7c1f9a-e7bf-40d3-88fd-0af1eea50b34 tempest-TestVolumeBootPattern-1318569205 tempest-TestVolumeBootPattern-1318569205-project-member] [instance: 059e3f87-a811-4ac7-b846-2f6d202a919f] Successfully updated port: 91dd58f7-d736-4a98-b6a6-f4d1bc6dd8dd {{(pid=74613) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 29 18:25:22 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-1e7c1f9a-e7bf-40d3-88fd-0af1eea50b34 tempest-TestVolumeBootPattern-1318569205 tempest-TestVolumeBootPattern-1318569205-project-member] Acquiring lock "refresh_cache-059e3f87-a811-4ac7-b846-2f6d202a919f" {{(pid=74613) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 18:25:22 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-1e7c1f9a-e7bf-40d3-88fd-0af1eea50b34 tempest-TestVolumeBootPattern-1318569205 tempest-TestVolumeBootPattern-1318569205-project-member] Acquired lock "refresh_cache-059e3f87-a811-4ac7-b846-2f6d202a919f" {{(pid=74613) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 18:25:22 user nova-compute[74613]: DEBUG nova.network.neutron [None req-1e7c1f9a-e7bf-40d3-88fd-0af1eea50b34 tempest-TestVolumeBootPattern-1318569205 tempest-TestVolumeBootPattern-1318569205-project-member] [instance: 059e3f87-a811-4ac7-b846-2f6d202a919f] Building network info cache for instance {{(pid=74613) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 29 18:25:22 user nova-compute[74613]: DEBUG nova.compute.manager [req-beec2cd6-65f5-4a1a-9e3c-649d26a956c8 req-5e23a63c-7afc-41f4-8601-ca0e21712050 service nova] [instance: 059e3f87-a811-4ac7-b846-2f6d202a919f] Received event network-changed-91dd58f7-d736-4a98-b6a6-f4d1bc6dd8dd {{(pid=74613) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 18:25:22 user nova-compute[74613]: DEBUG nova.compute.manager [req-beec2cd6-65f5-4a1a-9e3c-649d26a956c8 req-5e23a63c-7afc-41f4-8601-ca0e21712050 service nova] [instance: 059e3f87-a811-4ac7-b846-2f6d202a919f] Refreshing instance network info cache due to event network-changed-91dd58f7-d736-4a98-b6a6-f4d1bc6dd8dd. {{(pid=74613) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 18:25:22 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-beec2cd6-65f5-4a1a-9e3c-649d26a956c8 req-5e23a63c-7afc-41f4-8601-ca0e21712050 service nova] Acquiring lock "refresh_cache-059e3f87-a811-4ac7-b846-2f6d202a919f" {{(pid=74613) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 18:25:22 user nova-compute[74613]: DEBUG nova.network.neutron [None req-1e7c1f9a-e7bf-40d3-88fd-0af1eea50b34 tempest-TestVolumeBootPattern-1318569205 tempest-TestVolumeBootPattern-1318569205-project-member] [instance: 059e3f87-a811-4ac7-b846-2f6d202a919f] Instance cache missing network info. {{(pid=74613) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 29 18:25:22 user nova-compute[74613]: DEBUG nova.network.neutron [None req-1e7c1f9a-e7bf-40d3-88fd-0af1eea50b34 tempest-TestVolumeBootPattern-1318569205 tempest-TestVolumeBootPattern-1318569205-project-member] [instance: 059e3f87-a811-4ac7-b846-2f6d202a919f] Updating instance_info_cache with network_info: [{"id": "91dd58f7-d736-4a98-b6a6-f4d1bc6dd8dd", "address": "fa:16:3e:6a:c5:f2", "network": {"id": "4a5179dd-d0b1-44c3-80c1-08dd7b0152f1", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1296336996-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "67390f1402214191904cfbd68c3142a7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap91dd58f7-d7", "ovs_interfaceid": "91dd58f7-d736-4a98-b6a6-f4d1bc6dd8dd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74613) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 18:25:22 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-1e7c1f9a-e7bf-40d3-88fd-0af1eea50b34 tempest-TestVolumeBootPattern-1318569205 tempest-TestVolumeBootPattern-1318569205-project-member] Releasing lock "refresh_cache-059e3f87-a811-4ac7-b846-2f6d202a919f" {{(pid=74613) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 18:25:22 user nova-compute[74613]: DEBUG nova.compute.manager [None req-1e7c1f9a-e7bf-40d3-88fd-0af1eea50b34 tempest-TestVolumeBootPattern-1318569205 tempest-TestVolumeBootPattern-1318569205-project-member] [instance: 059e3f87-a811-4ac7-b846-2f6d202a919f] Instance network_info: |[{"id": "91dd58f7-d736-4a98-b6a6-f4d1bc6dd8dd", "address": "fa:16:3e:6a:c5:f2", "network": {"id": "4a5179dd-d0b1-44c3-80c1-08dd7b0152f1", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1296336996-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "67390f1402214191904cfbd68c3142a7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap91dd58f7-d7", "ovs_interfaceid": "91dd58f7-d736-4a98-b6a6-f4d1bc6dd8dd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74613) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 29 18:25:22 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-beec2cd6-65f5-4a1a-9e3c-649d26a956c8 req-5e23a63c-7afc-41f4-8601-ca0e21712050 service nova] Acquired lock "refresh_cache-059e3f87-a811-4ac7-b846-2f6d202a919f" {{(pid=74613) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 18:25:22 user nova-compute[74613]: DEBUG nova.network.neutron [req-beec2cd6-65f5-4a1a-9e3c-649d26a956c8 req-5e23a63c-7afc-41f4-8601-ca0e21712050 service nova] [instance: 059e3f87-a811-4ac7-b846-2f6d202a919f] Refreshing network info cache for port 91dd58f7-d736-4a98-b6a6-f4d1bc6dd8dd {{(pid=74613) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 18:25:23 user nova-compute[74613]: DEBUG nova.network.neutron [req-beec2cd6-65f5-4a1a-9e3c-649d26a956c8 req-5e23a63c-7afc-41f4-8601-ca0e21712050 service nova] [instance: 059e3f87-a811-4ac7-b846-2f6d202a919f] Updated VIF entry in instance network info cache for port 91dd58f7-d736-4a98-b6a6-f4d1bc6dd8dd. {{(pid=74613) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 18:25:23 user nova-compute[74613]: DEBUG nova.network.neutron [req-beec2cd6-65f5-4a1a-9e3c-649d26a956c8 req-5e23a63c-7afc-41f4-8601-ca0e21712050 service nova] [instance: 059e3f87-a811-4ac7-b846-2f6d202a919f] Updating instance_info_cache with network_info: [{"id": "91dd58f7-d736-4a98-b6a6-f4d1bc6dd8dd", "address": "fa:16:3e:6a:c5:f2", "network": {"id": "4a5179dd-d0b1-44c3-80c1-08dd7b0152f1", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1296336996-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "67390f1402214191904cfbd68c3142a7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap91dd58f7-d7", "ovs_interfaceid": "91dd58f7-d736-4a98-b6a6-f4d1bc6dd8dd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74613) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 18:25:23 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-beec2cd6-65f5-4a1a-9e3c-649d26a956c8 req-5e23a63c-7afc-41f4-8601-ca0e21712050 service nova] Releasing lock "refresh_cache-059e3f87-a811-4ac7-b846-2f6d202a919f" {{(pid=74613) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 18:25:23 user nova-compute[74613]: DEBUG nova.virt.libvirt.volume.iscsi [None req-36235368-08a4-4947-bc5a-dd6e0d80c468 tempest-SnapshotDataIntegrityTests-1810787156 tempest-SnapshotDataIntegrityTests-1810787156-project-member] [instance: 5227902d-b2b9-40a6-988f-3c02c52404f3] Calling os-brick to attach iSCSI Volume {{(pid=74613) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 29 18:25:23 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-36235368-08a4-4947-bc5a-dd6e0d80c468 tempest-SnapshotDataIntegrityTests-1810787156 tempest-SnapshotDataIntegrityTests-1810787156-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff828156890>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:69f38afd-fc23-439c-8149-17a04be10706', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'GfojpnsK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74613) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 18:25:23 user nova-compute[74613]: WARNING os_brick.initiator.connectors.base [None req-36235368-08a4-4947-bc5a-dd6e0d80c468 tempest-SnapshotDataIntegrityTests-1810787156 tempest-SnapshotDataIntegrityTests-1810787156-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 18:25:23 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.base [None req-36235368-08a4-4947-bc5a-dd6e0d80c468 tempest-SnapshotDataIntegrityTests-1810787156 tempest-SnapshotDataIntegrityTests-1810787156-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 18:25:23 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.base [None req-36235368-08a4-4947-bc5a-dd6e0d80c468 tempest-SnapshotDataIntegrityTests-1810787156 tempest-SnapshotDataIntegrityTests-1810787156-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 18:25:23 user nova-compute[74613]: WARNING os_brick.initiator.connectors.base [None req-36235368-08a4-4947-bc5a-dd6e0d80c468 tempest-SnapshotDataIntegrityTests-1810787156 tempest-SnapshotDataIntegrityTests-1810787156-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 18:25:23 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.base [None req-36235368-08a4-4947-bc5a-dd6e0d80c468 tempest-SnapshotDataIntegrityTests-1810787156 tempest-SnapshotDataIntegrityTests-1810787156-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:69f38afd-fc23-439c-8149-17a04be10706" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 18:25:23 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.base [None req-36235368-08a4-4947-bc5a-dd6e0d80c468 tempest-SnapshotDataIntegrityTests-1810787156 tempest-SnapshotDataIntegrityTests-1810787156-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:69f38afd-fc23-439c-8149-17a04be10706" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 18:25:23 user nova-compute[74613]: INFO os_brick.initiator.connectors.iscsi [None req-36235368-08a4-4947-bc5a-dd6e0d80c468 tempest-SnapshotDataIntegrityTests-1810787156 tempest-SnapshotDataIntegrityTests-1810787156-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 29 18:25:23 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:69f38afd-fc23-439c-8149-17a04be10706 -p 172.16.0.220:3260 {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:25:23 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:69f38afd-fc23-439c-8149-17a04be10706 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:25:23 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e45e635-9f42-419d-a2a8-286fa617aa58]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 18:25:23 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-36235368-08a4-4947-bc5a-dd6e0d80c468 tempest-SnapshotDataIntegrityTests-1810787156 tempest-SnapshotDataIntegrityTests-1810787156-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 29 18:25:23 user nova-compute[74613]:  {{(pid=74613) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 18:25:23 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:69f38afd-fc23-439c-8149-17a04be10706 -p 172.16.0.220:3260 --interface default --op new {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:25:23 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:69f38afd-fc23-439c-8149-17a04be10706 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:25:23 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[56e6e013-1911-4a51-84e0-25454f920a21]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:69f38afd-fc23-439c-8149-17a04be10706] added\n', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 18:25:23 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-36235368-08a4-4947-bc5a-dd6e0d80c468 tempest-SnapshotDataIntegrityTests-1810787156 tempest-SnapshotDataIntegrityTests-1810787156-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:69f38afd-fc23-439c-8149-17a04be10706] added
Nov 29 18:25:23 user nova-compute[74613]:  stderr= {{(pid=74613) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 18:25:23 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:69f38afd-fc23-439c-8149-17a04be10706 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:25:23 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:69f38afd-fc23-439c-8149-17a04be10706 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:25:23 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a3339e7-1ea8-4d78-ac13-e0e453e941b0]: (4, ('', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 18:25:23 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-36235368-08a4-4947-bc5a-dd6e0d80c468 tempest-SnapshotDataIntegrityTests-1810787156 tempest-SnapshotDataIntegrityTests-1810787156-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74613) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 18:25:23 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:69f38afd-fc23-439c-8149-17a04be10706 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:25:23 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:69f38afd-fc23-439c-8149-17a04be10706 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:25:23 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[84c9b071-0349-4c6e-8f86-2f21e258d6f7]: (4, ('', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 18:25:23 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-36235368-08a4-4947-bc5a-dd6e0d80c468 tempest-SnapshotDataIntegrityTests-1810787156 tempest-SnapshotDataIntegrityTests-1810787156-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74613) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 18:25:23 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:69f38afd-fc23-439c-8149-17a04be10706 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v GfojpnsK {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:25:23 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:69f38afd-fc23-439c-8149-17a04be10706 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v GfojpnsK" returned: 0 in 0.016s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:25:23 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[09d91b3c-5a24-4a13-b181-1cb1fec89cc3]: (4, ('', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 18:25:23 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-36235368-08a4-4947-bc5a-dd6e0d80c468 tempest-SnapshotDataIntegrityTests-1810787156 tempest-SnapshotDataIntegrityTests-1810787156-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'GfojpnsK'): stdout= stderr= {{(pid=74613) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 18:25:23 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:69f38afd-fc23-439c-8149-17a04be10706 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:25:23 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:69f38afd-fc23-439c-8149-17a04be10706 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:25:23 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[b21e8a29-ad71-4578-9af2-5820ba5b5f39]: (4, ('', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 18:25:23 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-36235368-08a4-4947-bc5a-dd6e0d80c468 tempest-SnapshotDataIntegrityTests-1810787156 tempest-SnapshotDataIntegrityTests-1810787156-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74613) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 18:25:23 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:25:23 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.017s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:25:23 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[40152fcd-8a3a-4e41-9b77-0a2b8d08aec0]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 18:25:23 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-36235368-08a4-4947-bc5a-dd6e0d80c468 tempest-SnapshotDataIntegrityTests-1810787156 tempest-SnapshotDataIntegrityTests-1810787156-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Nov 29 18:25:23 user nova-compute[74613]:  {{(pid=74613) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 18:25:23 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-36235368-08a4-4947-bc5a-dd6e0d80c468 tempest-SnapshotDataIntegrityTests-1810787156 tempest-SnapshotDataIntegrityTests-1810787156-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Nov 29 18:25:23 user nova-compute[74613]:  {{(pid=74613) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 18:25:23 user nova-compute[74613]: WARNING os_brick.initiator.connectors.iscsi [None req-36235368-08a4-4947-bc5a-dd6e0d80c468 tempest-SnapshotDataIntegrityTests-1810787156 tempest-SnapshotDataIntegrityTests-1810787156-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Nov 29 18:25:23 user nova-compute[74613]: 
Nov 29 18:25:23 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:69f38afd-fc23-439c-8149-17a04be10706 -p 172.16.0.220:3260 --login {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:25:23 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:69f38afd-fc23-439c-8149-17a04be10706 -p 172.16.0.220:3260 --login" returned: 0 in 0.045s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:25:23 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[975b48c3-8cdf-4af6-a317-35237781b077]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:69f38afd-fc23-439c-8149-17a04be10706, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:69f38afd-fc23-439c-8149-17a04be10706, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 18:25:23 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-36235368-08a4-4947-bc5a-dd6e0d80c468 tempest-SnapshotDataIntegrityTests-1810787156 tempest-SnapshotDataIntegrityTests-1810787156-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:69f38afd-fc23-439c-8149-17a04be10706, portal: 172.16.0.220,3260]
Nov 29 18:25:23 user nova-compute[74613]: Login to [iface: default, target: iqn.2010-10.org.openstack:69f38afd-fc23-439c-8149-17a04be10706, portal: 172.16.0.220,3260] successful.
Nov 29 18:25:23 user nova-compute[74613]:  stderr= {{(pid=74613) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 18:25:23 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:69f38afd-fc23-439c-8149-17a04be10706 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:25:23 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:69f38afd-fc23-439c-8149-17a04be10706 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.017s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:25:23 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1293184-bc0f-43a9-b153-cc99ec9ba0b9]: (4, ('', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 18:25:23 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-36235368-08a4-4947-bc5a-dd6e0d80c468 tempest-SnapshotDataIntegrityTests-1810787156 tempest-SnapshotDataIntegrityTests-1810787156-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74613) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 18:25:23 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:25:23 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:25:23 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[c249b11e-a529-4142-86f6-3acc3b321425]: (4, ('tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69f38afd-fc23-439c-8149-17a04be10706 (non-flash)\n', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 18:25:23 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-36235368-08a4-4947-bc5a-dd6e0d80c468 tempest-SnapshotDataIntegrityTests-1810787156 tempest-SnapshotDataIntegrityTests-1810787156-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69f38afd-fc23-439c-8149-17a04be10706 (non-flash)
Nov 29 18:25:23 user nova-compute[74613]:  stderr= {{(pid=74613) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 18:25:23 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-36235368-08a4-4947-bc5a-dd6e0d80c468 tempest-SnapshotDataIntegrityTests-1810787156 tempest-SnapshotDataIntegrityTests-1810787156-project-member] iscsi session list stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69f38afd-fc23-439c-8149-17a04be10706 (non-flash)
Nov 29 18:25:23 user nova-compute[74613]:  stderr= {{(pid=74613) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 18:25:23 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.base [None req-36235368-08a4-4947-bc5a-dd6e0d80c468 tempest-SnapshotDataIntegrityTests-1810787156 tempest-SnapshotDataIntegrityTests-1810787156-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:69f38afd-fc23-439c-8149-17a04be10706" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.245s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 18:25:23 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-36235368-08a4-4947-bc5a-dd6e0d80c468 tempest-SnapshotDataIntegrityTests-1810787156 tempest-SnapshotDataIntegrityTests-1810787156-project-member] Connected to 172.16.0.220:3260 {{(pid=74613) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 29 18:25:23 user nova-compute[74613]: DEBUG os_brick.initiator.linuxscsi [None req-36235368-08a4-4947-bc5a-dd6e0d80c468 tempest-SnapshotDataIntegrityTests-1810787156 tempest-SnapshotDataIntegrityTests-1810787156-project-member] HCTL ('33', '-', '-', 0) found on session 53 with lun 0 {{(pid=74613) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 29 18:25:23 user nova-compute[74613]: DEBUG os_brick.initiator.linuxscsi [None req-36235368-08a4-4947-bc5a-dd6e0d80c468 tempest-SnapshotDataIntegrityTests-1810787156 tempest-SnapshotDataIntegrityTests-1810787156-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74613) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 29 18:25:23 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:25:23 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.016s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:25:23 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[bfb9922b-bcd1-41ea-813a-c17f20bfef4d]: (4, ('- - 0', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 18:25:23 user nova-compute[74613]: DEBUG os_brick.initiator.linuxscsi [None req-36235368-08a4-4947-bc5a-dd6e0d80c468 tempest-SnapshotDataIntegrityTests-1810787156 tempest-SnapshotDataIntegrityTests-1810787156-project-member] Searching for a device in session 53 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74613) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 29 18:25:23 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-36235368-08a4-4947-bc5a-dd6e0d80c468 tempest-SnapshotDataIntegrityTests-1810787156 tempest-SnapshotDataIntegrityTests-1810787156-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:69f38afd-fc23-439c-8149-17a04be10706', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'GfojpnsK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74613) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 29 18:25:24 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.base [None req-36235368-08a4-4947-bc5a-dd6e0d80c468 tempest-SnapshotDataIntegrityTests-1810787156 tempest-SnapshotDataIntegrityTests-1810787156-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.274s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 18:25:24 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-36235368-08a4-4947-bc5a-dd6e0d80c468 tempest-SnapshotDataIntegrityTests-1810787156 tempest-SnapshotDataIntegrityTests-1810787156-project-member] <== connect_volume: return (1276ms) {'type': 'block', 'scsi_wwn': '23663616531383639', 'path': '/dev/sdb'} {{(pid=74613) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 18:25:24 user nova-compute[74613]: DEBUG nova.virt.libvirt.volume.iscsi [None req-36235368-08a4-4947-bc5a-dd6e0d80c468 tempest-SnapshotDataIntegrityTests-1810787156 tempest-SnapshotDataIntegrityTests-1810787156-project-member] [instance: 5227902d-b2b9-40a6-988f-3c02c52404f3] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23663616531383639', 'path': '/dev/sdb'} {{(pid=74613) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 29 18:25:24 user nova-compute[74613]: DEBUG nova.objects.instance [None req-36235368-08a4-4947-bc5a-dd6e0d80c468 tempest-SnapshotDataIntegrityTests-1810787156 tempest-SnapshotDataIntegrityTests-1810787156-project-member] Lazy-loading 'flavor' on Instance uuid 5227902d-b2b9-40a6-988f-3c02c52404f3 {{(pid=74613) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 18:25:24 user nova-compute[74613]: DEBUG nova.virt.libvirt.guest [None req-36235368-08a4-4947-bc5a-dd6e0d80c468 tempest-SnapshotDataIntegrityTests-1810787156 tempest-SnapshotDataIntegrityTests-1810787156-project-member] attach device xml: <disk type="block" device="disk">
Nov 29 18:25:24 user nova-compute[74613]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 18:25:24 user nova-compute[74613]:   <source dev="/dev/sdb"/>
Nov 29 18:25:24 user nova-compute[74613]:   <target dev="vdb" bus="virtio"/>
Nov 29 18:25:24 user nova-compute[74613]:   <serial>69f38afd-fc23-439c-8149-17a04be10706</serial>
Nov 29 18:25:24 user nova-compute[74613]: </disk>
Nov 29 18:25:24 user nova-compute[74613]:  {{(pid=74613) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 29 18:25:25 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-36235368-08a4-4947-bc5a-dd6e0d80c468 tempest-SnapshotDataIntegrityTests-1810787156 tempest-SnapshotDataIntegrityTests-1810787156-project-member] No BDM found with device name vda, not building metadata. {{(pid=74613) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 18:25:25 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-36235368-08a4-4947-bc5a-dd6e0d80c468 tempest-SnapshotDataIntegrityTests-1810787156 tempest-SnapshotDataIntegrityTests-1810787156-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74613) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 18:25:25 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-36235368-08a4-4947-bc5a-dd6e0d80c468 tempest-SnapshotDataIntegrityTests-1810787156 tempest-SnapshotDataIntegrityTests-1810787156-project-member] No VIF found with MAC fa:16:3e:40:72:ca, not building metadata {{(pid=74613) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 29 18:25:25 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-36235368-08a4-4947-bc5a-dd6e0d80c468 tempest-SnapshotDataIntegrityTests-1810787156 tempest-SnapshotDataIntegrityTests-1810787156-project-member] Lock "5227902d-b2b9-40a6-988f-3c02c52404f3" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 9.345s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 18:25:26 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:25:26 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:25:27 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-eb0d35e6-af00-4c42-a186-38adf73660d8 tempest-SnapshotDataIntegrityTests-1810787156 tempest-SnapshotDataIntegrityTests-1810787156-project-member] Acquiring lock "5227902d-b2b9-40a6-988f-3c02c52404f3" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 18:25:27 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-eb0d35e6-af00-4c42-a186-38adf73660d8 tempest-SnapshotDataIntegrityTests-1810787156 tempest-SnapshotDataIntegrityTests-1810787156-project-member] Lock "5227902d-b2b9-40a6-988f-3c02c52404f3" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 18:25:27 user nova-compute[74613]: INFO nova.compute.manager [None req-eb0d35e6-af00-4c42-a186-38adf73660d8 tempest-SnapshotDataIntegrityTests-1810787156 tempest-SnapshotDataIntegrityTests-1810787156-project-member] [instance: 5227902d-b2b9-40a6-988f-3c02c52404f3] Detaching volume 69f38afd-fc23-439c-8149-17a04be10706
Nov 29 18:25:27 user nova-compute[74613]: INFO nova.virt.block_device [None req-eb0d35e6-af00-4c42-a186-38adf73660d8 tempest-SnapshotDataIntegrityTests-1810787156 tempest-SnapshotDataIntegrityTests-1810787156-project-member] [instance: 5227902d-b2b9-40a6-988f-3c02c52404f3] Attempting to driver detach volume 69f38afd-fc23-439c-8149-17a04be10706 from mountpoint /dev/vdb
Nov 29 18:25:27 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-eb0d35e6-af00-4c42-a186-38adf73660d8 tempest-SnapshotDataIntegrityTests-1810787156 tempest-SnapshotDataIntegrityTests-1810787156-project-member] Attempting to detach device vdb from instance 5227902d-b2b9-40a6-988f-3c02c52404f3 from the persistent domain config. {{(pid=74613) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 29 18:25:27 user nova-compute[74613]: DEBUG nova.virt.libvirt.guest [None req-eb0d35e6-af00-4c42-a186-38adf73660d8 tempest-SnapshotDataIntegrityTests-1810787156 tempest-SnapshotDataIntegrityTests-1810787156-project-member] detach device xml: <disk type="block" device="disk">
Nov 29 18:25:27 user nova-compute[74613]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 18:25:27 user nova-compute[74613]:   <source dev="/dev/sdb"/>
Nov 29 18:25:27 user nova-compute[74613]:   <target dev="vdb" bus="virtio"/>
Nov 29 18:25:27 user nova-compute[74613]:   <serial>69f38afd-fc23-439c-8149-17a04be10706</serial>
Nov 29 18:25:27 user nova-compute[74613]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 29 18:25:27 user nova-compute[74613]: </disk>
Nov 29 18:25:27 user nova-compute[74613]:  {{(pid=74613) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 29 18:25:27 user nova-compute[74613]: INFO nova.virt.libvirt.driver [None req-eb0d35e6-af00-4c42-a186-38adf73660d8 tempest-SnapshotDataIntegrityTests-1810787156 tempest-SnapshotDataIntegrityTests-1810787156-project-member] Successfully detached device vdb from instance 5227902d-b2b9-40a6-988f-3c02c52404f3 from the persistent domain config.
Nov 29 18:25:27 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-eb0d35e6-af00-4c42-a186-38adf73660d8 tempest-SnapshotDataIntegrityTests-1810787156 tempest-SnapshotDataIntegrityTests-1810787156-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 5227902d-b2b9-40a6-988f-3c02c52404f3 from the live domain config. {{(pid=74613) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 29 18:25:27 user nova-compute[74613]: DEBUG nova.virt.libvirt.guest [None req-eb0d35e6-af00-4c42-a186-38adf73660d8 tempest-SnapshotDataIntegrityTests-1810787156 tempest-SnapshotDataIntegrityTests-1810787156-project-member] detach device xml: <disk type="block" device="disk">
Nov 29 18:25:27 user nova-compute[74613]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 18:25:27 user nova-compute[74613]:   <source dev="/dev/sdb"/>
Nov 29 18:25:27 user nova-compute[74613]:   <target dev="vdb" bus="virtio"/>
Nov 29 18:25:27 user nova-compute[74613]:   <serial>69f38afd-fc23-439c-8149-17a04be10706</serial>
Nov 29 18:25:27 user nova-compute[74613]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 29 18:25:27 user nova-compute[74613]: </disk>
Nov 29 18:25:27 user nova-compute[74613]:  {{(pid=74613) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 29 18:25:27 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-eb0d35e6-af00-4c42-a186-38adf73660d8 tempest-SnapshotDataIntegrityTests-1810787156 tempest-SnapshotDataIntegrityTests-1810787156-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 5227902d-b2b9-40a6-988f-3c02c52404f3 {{(pid=74613) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 29 18:25:28 user nova-compute[74613]: DEBUG nova.compute.manager [None req-1e7c1f9a-e7bf-40d3-88fd-0af1eea50b34 tempest-TestVolumeBootPattern-1318569205 tempest-TestVolumeBootPattern-1318569205-project-member] [instance: 059e3f87-a811-4ac7-b846-2f6d202a919f] Start spawning the instance on the hypervisor. {{(pid=74613) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 29 18:25:28 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-1e7c1f9a-e7bf-40d3-88fd-0af1eea50b34 tempest-TestVolumeBootPattern-1318569205 tempest-TestVolumeBootPattern-1318569205-project-member] [instance: 059e3f87-a811-4ac7-b846-2f6d202a919f] Creating instance directory {{(pid=74613) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 29 18:25:28 user nova-compute[74613]: INFO nova.virt.libvirt.driver [None req-1e7c1f9a-e7bf-40d3-88fd-0af1eea50b34 tempest-TestVolumeBootPattern-1318569205 tempest-TestVolumeBootPattern-1318569205-project-member] [instance: 059e3f87-a811-4ac7-b846-2f6d202a919f] Creating image(s)
Nov 29 18:25:28 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-1e7c1f9a-e7bf-40d3-88fd-0af1eea50b34 tempest-TestVolumeBootPattern-1318569205 tempest-TestVolumeBootPattern-1318569205-project-member] [instance: 059e3f87-a811-4ac7-b846-2f6d202a919f] Did not create local disks {{(pid=74613) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 29 18:25:28 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-1e7c1f9a-e7bf-40d3-88fd-0af1eea50b34 tempest-TestVolumeBootPattern-1318569205 tempest-TestVolumeBootPattern-1318569205-project-member] [instance: 059e3f87-a811-4ac7-b846-2f6d202a919f] Ensure instance console log exists: /opt/stack/data/nova/instances/059e3f87-a811-4ac7-b846-2f6d202a919f/console.log {{(pid=74613) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 29 18:25:28 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-1e7c1f9a-e7bf-40d3-88fd-0af1eea50b34 tempest-TestVolumeBootPattern-1318569205 tempest-TestVolumeBootPattern-1318569205-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 18:25:28 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-1e7c1f9a-e7bf-40d3-88fd-0af1eea50b34 tempest-TestVolumeBootPattern-1318569205 tempest-TestVolumeBootPattern-1318569205-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 18:25:28 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-1e7c1f9a-e7bf-40d3-88fd-0af1eea50b34 tempest-TestVolumeBootPattern-1318569205 tempest-TestVolumeBootPattern-1318569205-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 18:25:28 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-1e7c1f9a-e7bf-40d3-88fd-0af1eea50b34 tempest-TestVolumeBootPattern-1318569205 tempest-TestVolumeBootPattern-1318569205-project-member] [instance: 059e3f87-a811-4ac7-b846-2f6d202a919f] Start _get_guest_xml network_info=[{"id": "91dd58f7-d736-4a98-b6a6-f4d1bc6dd8dd", "address": "fa:16:3e:6a:c5:f2", "network": {"id": "4a5179dd-d0b1-44c3-80c1-08dd7b0152f1", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1296336996-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "67390f1402214191904cfbd68c3142a7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap91dd58f7-d7", "ovs_interfaceid": "91dd58f7-d736-4a98-b6a6-f4d1bc6dd8dd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:6f39cfde-47c7-4b9f-83d3-13c147be6792', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XJWrqIuP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '059e3f87-a811-4ac7-b846-2f6d202a919f', 'attached_at': '', 'detached_at': '', 'volume_id': '6f39cfde-47c7-4b9f-83d3-13c147be6792', 'serial': '6f39cfde-47c7-4b9f-83d3-13c147be6792'}, 'mount_device': '/dev/vda', 'delete_on_termination': False, 'device_type': 'disk', 'boot_index': 0, 'guest_format': None, 'attachment_id': '243228e0-ab29-4e80-9495-487fa0bbe507', 'disk_bus': 'virtio', 'volume_type': None} {{(pid=74613) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 29 18:25:28 user nova-compute[74613]: WARNING nova.virt.libvirt.driver [None req-1e7c1f9a-e7bf-40d3-88fd-0af1eea50b34 tempest-TestVolumeBootPattern-1318569205 tempest-TestVolumeBootPattern-1318569205-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 18:25:28 user nova-compute[74613]: WARNING nova.virt.libvirt.driver [None req-1e7c1f9a-e7bf-40d3-88fd-0af1eea50b34 tempest-TestVolumeBootPattern-1318569205 tempest-TestVolumeBootPattern-1318569205-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 18:25:28 user nova-compute[74613]: DEBUG nova.virt.libvirt.host [None req-1e7c1f9a-e7bf-40d3-88fd-0af1eea50b34 tempest-TestVolumeBootPattern-1318569205 tempest-TestVolumeBootPattern-1318569205-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74613) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 29 18:25:28 user nova-compute[74613]: DEBUG nova.virt.libvirt.host [None req-1e7c1f9a-e7bf-40d3-88fd-0af1eea50b34 tempest-TestVolumeBootPattern-1318569205 tempest-TestVolumeBootPattern-1318569205-project-member] CPU controller missing on host. {{(pid=74613) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 29 18:25:28 user nova-compute[74613]: DEBUG nova.virt.libvirt.host [None req-1e7c1f9a-e7bf-40d3-88fd-0af1eea50b34 tempest-TestVolumeBootPattern-1318569205 tempest-TestVolumeBootPattern-1318569205-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74613) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 29 18:25:28 user nova-compute[74613]: DEBUG nova.virt.libvirt.host [None req-1e7c1f9a-e7bf-40d3-88fd-0af1eea50b34 tempest-TestVolumeBootPattern-1318569205 tempest-TestVolumeBootPattern-1318569205-project-member] CPU controller found on host. {{(pid=74613) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 29 18:25:28 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-1e7c1f9a-e7bf-40d3-88fd-0af1eea50b34 tempest-TestVolumeBootPattern-1318569205 tempest-TestVolumeBootPattern-1318569205-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74613) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 29 18:25:28 user nova-compute[74613]: DEBUG nova.virt.hardware [None req-1e7c1f9a-e7bf-40d3-88fd-0af1eea50b34 tempest-TestVolumeBootPattern-1318569205 tempest-TestVolumeBootPattern-1318569205-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-29T17:47:27Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74613) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 29 18:25:28 user nova-compute[74613]: DEBUG nova.virt.hardware [None req-1e7c1f9a-e7bf-40d3-88fd-0af1eea50b34 tempest-TestVolumeBootPattern-1318569205 tempest-TestVolumeBootPattern-1318569205-project-member] Flavor limits 0:0:0 {{(pid=74613) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 29 18:25:28 user nova-compute[74613]: DEBUG nova.virt.hardware [None req-1e7c1f9a-e7bf-40d3-88fd-0af1eea50b34 tempest-TestVolumeBootPattern-1318569205 tempest-TestVolumeBootPattern-1318569205-project-member] Image limits 0:0:0 {{(pid=74613) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 29 18:25:28 user nova-compute[74613]: DEBUG nova.virt.hardware [None req-1e7c1f9a-e7bf-40d3-88fd-0af1eea50b34 tempest-TestVolumeBootPattern-1318569205 tempest-TestVolumeBootPattern-1318569205-project-member] Flavor pref 0:0:0 {{(pid=74613) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 29 18:25:28 user nova-compute[74613]: DEBUG nova.virt.hardware [None req-1e7c1f9a-e7bf-40d3-88fd-0af1eea50b34 tempest-TestVolumeBootPattern-1318569205 tempest-TestVolumeBootPattern-1318569205-project-member] Image pref 0:0:0 {{(pid=74613) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 29 18:25:28 user nova-compute[74613]: DEBUG nova.virt.hardware [None req-1e7c1f9a-e7bf-40d3-88fd-0af1eea50b34 tempest-TestVolumeBootPattern-1318569205 tempest-TestVolumeBootPattern-1318569205-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74613) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 29 18:25:28 user nova-compute[74613]: DEBUG nova.virt.hardware [None req-1e7c1f9a-e7bf-40d3-88fd-0af1eea50b34 tempest-TestVolumeBootPattern-1318569205 tempest-TestVolumeBootPattern-1318569205-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74613) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 29 18:25:28 user nova-compute[74613]: DEBUG nova.virt.hardware [None req-1e7c1f9a-e7bf-40d3-88fd-0af1eea50b34 tempest-TestVolumeBootPattern-1318569205 tempest-TestVolumeBootPattern-1318569205-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74613) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 29 18:25:28 user nova-compute[74613]: DEBUG nova.virt.hardware [None req-1e7c1f9a-e7bf-40d3-88fd-0af1eea50b34 tempest-TestVolumeBootPattern-1318569205 tempest-TestVolumeBootPattern-1318569205-project-member] Got 1 possible topologies {{(pid=74613) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 29 18:25:28 user nova-compute[74613]: DEBUG nova.virt.hardware [None req-1e7c1f9a-e7bf-40d3-88fd-0af1eea50b34 tempest-TestVolumeBootPattern-1318569205 tempest-TestVolumeBootPattern-1318569205-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74613) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 29 18:25:28 user nova-compute[74613]: DEBUG nova.virt.hardware [None req-1e7c1f9a-e7bf-40d3-88fd-0af1eea50b34 tempest-TestVolumeBootPattern-1318569205 tempest-TestVolumeBootPattern-1318569205-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74613) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 29 18:25:28 user nova-compute[74613]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1e7c1f9a-e7bf-40d3-88fd-0af1eea50b34 tempest-TestVolumeBootPattern-1318569205 tempest-TestVolumeBootPattern-1318569205-project-member] [instance: 059e3f87-a811-4ac7-b846-2f6d202a919f] Calling os-brick to attach iSCSI Volume {{(pid=74613) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 29 18:25:28 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-1e7c1f9a-e7bf-40d3-88fd-0af1eea50b34 tempest-TestVolumeBootPattern-1318569205 tempest-TestVolumeBootPattern-1318569205-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff828156890>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:6f39cfde-47c7-4b9f-83d3-13c147be6792', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XJWrqIuP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74613) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 18:25:28 user nova-compute[74613]: WARNING os_brick.initiator.connectors.base [None req-1e7c1f9a-e7bf-40d3-88fd-0af1eea50b34 tempest-TestVolumeBootPattern-1318569205 tempest-TestVolumeBootPattern-1318569205-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 18:25:28 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.base [None req-1e7c1f9a-e7bf-40d3-88fd-0af1eea50b34 tempest-TestVolumeBootPattern-1318569205 tempest-TestVolumeBootPattern-1318569205-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 18:25:28 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.base [None req-1e7c1f9a-e7bf-40d3-88fd-0af1eea50b34 tempest-TestVolumeBootPattern-1318569205 tempest-TestVolumeBootPattern-1318569205-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 18:25:28 user nova-compute[74613]: WARNING os_brick.initiator.connectors.base [None req-1e7c1f9a-e7bf-40d3-88fd-0af1eea50b34 tempest-TestVolumeBootPattern-1318569205 tempest-TestVolumeBootPattern-1318569205-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 18:25:28 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.base [None req-1e7c1f9a-e7bf-40d3-88fd-0af1eea50b34 tempest-TestVolumeBootPattern-1318569205 tempest-TestVolumeBootPattern-1318569205-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6f39cfde-47c7-4b9f-83d3-13c147be6792" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 18:25:28 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.base [None req-1e7c1f9a-e7bf-40d3-88fd-0af1eea50b34 tempest-TestVolumeBootPattern-1318569205 tempest-TestVolumeBootPattern-1318569205-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6f39cfde-47c7-4b9f-83d3-13c147be6792" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 18:25:28 user nova-compute[74613]: INFO os_brick.initiator.connectors.iscsi [None req-1e7c1f9a-e7bf-40d3-88fd-0af1eea50b34 tempest-TestVolumeBootPattern-1318569205 tempest-TestVolumeBootPattern-1318569205-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 29 18:25:28 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6f39cfde-47c7-4b9f-83d3-13c147be6792 -p 172.16.0.220:3260 {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:25:28 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6f39cfde-47c7-4b9f-83d3-13c147be6792 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:25:28 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[18f0b1d0-56fa-40ba-83c5-7a13d8d56874]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 18:25:28 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-1e7c1f9a-e7bf-40d3-88fd-0af1eea50b34 tempest-TestVolumeBootPattern-1318569205 tempest-TestVolumeBootPattern-1318569205-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 29 18:25:28 user nova-compute[74613]:  {{(pid=74613) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 18:25:28 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6f39cfde-47c7-4b9f-83d3-13c147be6792 -p 172.16.0.220:3260 --interface default --op new {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:25:28 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6f39cfde-47c7-4b9f-83d3-13c147be6792 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:25:28 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[656f2bb7-311f-4f64-8146-920d0ebdbcc7]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:6f39cfde-47c7-4b9f-83d3-13c147be6792] added\n', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 18:25:28 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-1e7c1f9a-e7bf-40d3-88fd-0af1eea50b34 tempest-TestVolumeBootPattern-1318569205 tempest-TestVolumeBootPattern-1318569205-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:6f39cfde-47c7-4b9f-83d3-13c147be6792] added
Nov 29 18:25:28 user nova-compute[74613]:  stderr= {{(pid=74613) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 18:25:28 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6f39cfde-47c7-4b9f-83d3-13c147be6792 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:25:28 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6f39cfde-47c7-4b9f-83d3-13c147be6792 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:25:28 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[206e9738-7811-4b09-9f3e-dc5c05894473]: (4, ('', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 18:25:28 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-1e7c1f9a-e7bf-40d3-88fd-0af1eea50b34 tempest-TestVolumeBootPattern-1318569205 tempest-TestVolumeBootPattern-1318569205-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74613) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 18:25:28 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6f39cfde-47c7-4b9f-83d3-13c147be6792 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:25:28 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6f39cfde-47c7-4b9f-83d3-13c147be6792 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:25:28 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[44b7e42b-c596-49c2-b8ad-3d5876472fc9]: (4, ('', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 18:25:28 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-1e7c1f9a-e7bf-40d3-88fd-0af1eea50b34 tempest-TestVolumeBootPattern-1318569205 tempest-TestVolumeBootPattern-1318569205-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74613) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 18:25:28 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6f39cfde-47c7-4b9f-83d3-13c147be6792 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v XJWrqIuP {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:25:28 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6f39cfde-47c7-4b9f-83d3-13c147be6792 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v XJWrqIuP" returned: 0 in 0.017s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:25:28 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[860330b6-b969-4112-8624-95455b8f0674]: (4, ('', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 18:25:28 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-1e7c1f9a-e7bf-40d3-88fd-0af1eea50b34 tempest-TestVolumeBootPattern-1318569205 tempest-TestVolumeBootPattern-1318569205-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'XJWrqIuP'): stdout= stderr= {{(pid=74613) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 18:25:28 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6f39cfde-47c7-4b9f-83d3-13c147be6792 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:25:28 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6f39cfde-47c7-4b9f-83d3-13c147be6792 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:25:28 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[96d6794a-a593-4342-a053-a218a1c75fda]: (4, ('', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 18:25:28 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-1e7c1f9a-e7bf-40d3-88fd-0af1eea50b34 tempest-TestVolumeBootPattern-1318569205 tempest-TestVolumeBootPattern-1318569205-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74613) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 18:25:28 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:25:28 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:25:28 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1401803-a200-47e7-99d0-fcd4e7661c70]: (4, ('tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69f38afd-fc23-439c-8149-17a04be10706 (non-flash)\n', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 18:25:28 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-1e7c1f9a-e7bf-40d3-88fd-0af1eea50b34 tempest-TestVolumeBootPattern-1318569205 tempest-TestVolumeBootPattern-1318569205-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69f38afd-fc23-439c-8149-17a04be10706 (non-flash)
Nov 29 18:25:28 user nova-compute[74613]:  stderr= {{(pid=74613) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 18:25:28 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-1e7c1f9a-e7bf-40d3-88fd-0af1eea50b34 tempest-TestVolumeBootPattern-1318569205 tempest-TestVolumeBootPattern-1318569205-project-member] iscsi session list stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69f38afd-fc23-439c-8149-17a04be10706 (non-flash)
Nov 29 18:25:28 user nova-compute[74613]:  stderr= {{(pid=74613) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 18:25:28 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6f39cfde-47c7-4b9f-83d3-13c147be6792 -p 172.16.0.220:3260 --login {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:25:28 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6f39cfde-47c7-4b9f-83d3-13c147be6792 -p 172.16.0.220:3260 --login" returned: 0 in 0.052s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:25:28 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[fcf160ff-eb08-44ac-8e7d-36f8294f3a50]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:6f39cfde-47c7-4b9f-83d3-13c147be6792, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:6f39cfde-47c7-4b9f-83d3-13c147be6792, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 18:25:28 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-1e7c1f9a-e7bf-40d3-88fd-0af1eea50b34 tempest-TestVolumeBootPattern-1318569205 tempest-TestVolumeBootPattern-1318569205-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:6f39cfde-47c7-4b9f-83d3-13c147be6792, portal: 172.16.0.220,3260]
Nov 29 18:25:28 user nova-compute[74613]: Login to [iface: default, target: iqn.2010-10.org.openstack:6f39cfde-47c7-4b9f-83d3-13c147be6792, portal: 172.16.0.220,3260] successful.
Nov 29 18:25:28 user nova-compute[74613]:  stderr= {{(pid=74613) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 18:25:28 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6f39cfde-47c7-4b9f-83d3-13c147be6792 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:25:28 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6f39cfde-47c7-4b9f-83d3-13c147be6792 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.017s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:25:28 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ef52f9c-4223-4da1-badf-6c98f7b604ec]: (4, ('', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 18:25:28 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-1e7c1f9a-e7bf-40d3-88fd-0af1eea50b34 tempest-TestVolumeBootPattern-1318569205 tempest-TestVolumeBootPattern-1318569205-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74613) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 18:25:28 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:25:28 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:25:28 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[cdb06781-844c-48f2-bba4-e0dbfae9892a]: (4, ('tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69f38afd-fc23-439c-8149-17a04be10706 (non-flash)\ntcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f39cfde-47c7-4b9f-83d3-13c147be6792 (non-flash)\n', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 18:25:28 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-1e7c1f9a-e7bf-40d3-88fd-0af1eea50b34 tempest-TestVolumeBootPattern-1318569205 tempest-TestVolumeBootPattern-1318569205-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69f38afd-fc23-439c-8149-17a04be10706 (non-flash)
Nov 29 18:25:28 user nova-compute[74613]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f39cfde-47c7-4b9f-83d3-13c147be6792 (non-flash)
Nov 29 18:25:28 user nova-compute[74613]:  stderr= {{(pid=74613) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 18:25:28 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-1e7c1f9a-e7bf-40d3-88fd-0af1eea50b34 tempest-TestVolumeBootPattern-1318569205 tempest-TestVolumeBootPattern-1318569205-project-member] iscsi session list stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69f38afd-fc23-439c-8149-17a04be10706 (non-flash)
Nov 29 18:25:28 user nova-compute[74613]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f39cfde-47c7-4b9f-83d3-13c147be6792 (non-flash)
Nov 29 18:25:28 user nova-compute[74613]:  stderr= {{(pid=74613) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 18:25:28 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.base [None req-1e7c1f9a-e7bf-40d3-88fd-0af1eea50b34 tempest-TestVolumeBootPattern-1318569205 tempest-TestVolumeBootPattern-1318569205-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6f39cfde-47c7-4b9f-83d3-13c147be6792" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.248s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 18:25:28 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-1e7c1f9a-e7bf-40d3-88fd-0af1eea50b34 tempest-TestVolumeBootPattern-1318569205 tempest-TestVolumeBootPattern-1318569205-project-member] Connected to 172.16.0.220:3260 {{(pid=74613) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 29 18:25:28 user nova-compute[74613]: DEBUG os_brick.initiator.linuxscsi [None req-1e7c1f9a-e7bf-40d3-88fd-0af1eea50b34 tempest-TestVolumeBootPattern-1318569205 tempest-TestVolumeBootPattern-1318569205-project-member] HCTL ('34', '-', '-', 0) found on session 54 with lun 0 {{(pid=74613) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 29 18:25:28 user nova-compute[74613]: DEBUG os_brick.initiator.linuxscsi [None req-1e7c1f9a-e7bf-40d3-88fd-0af1eea50b34 tempest-TestVolumeBootPattern-1318569205 tempest-TestVolumeBootPattern-1318569205-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=74613) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 29 18:25:28 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:25:28 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.016s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:25:28 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[0109b177-f6e8-4690-9e9c-6fca8cf8e2df]: (4, ('- - 0', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 18:25:28 user nova-compute[74613]: DEBUG os_brick.initiator.linuxscsi [None req-1e7c1f9a-e7bf-40d3-88fd-0af1eea50b34 tempest-TestVolumeBootPattern-1318569205 tempest-TestVolumeBootPattern-1318569205-project-member] Searching for a device in session 54 and hctl ['34', '*', '*', 0] yield: None {{(pid=74613) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 29 18:25:29 user nova-compute[74613]: DEBUG os_brick.initiator.linuxscsi [None req-1e7c1f9a-e7bf-40d3-88fd-0af1eea50b34 tempest-TestVolumeBootPattern-1318569205 tempest-TestVolumeBootPattern-1318569205-project-member] Searching for a device in session 54 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=74613) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 29 18:25:29 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-1e7c1f9a-e7bf-40d3-88fd-0af1eea50b34 tempest-TestVolumeBootPattern-1318569205 tempest-TestVolumeBootPattern-1318569205-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:6f39cfde-47c7-4b9f-83d3-13c147be6792', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XJWrqIuP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74613) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 29 18:25:29 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.base [None req-1e7c1f9a-e7bf-40d3-88fd-0af1eea50b34 tempest-TestVolumeBootPattern-1318569205 tempest-TestVolumeBootPattern-1318569205-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.277s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 18:25:29 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-1e7c1f9a-e7bf-40d3-88fd-0af1eea50b34 tempest-TestVolumeBootPattern-1318569205 tempest-TestVolumeBootPattern-1318569205-project-member] <== connect_volume: return (1279ms) {'type': 'block', 'scsi_wwn': '26633323734326238', 'path': '/dev/sdc'} {{(pid=74613) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 18:25:29 user nova-compute[74613]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1e7c1f9a-e7bf-40d3-88fd-0af1eea50b34 tempest-TestVolumeBootPattern-1318569205 tempest-TestVolumeBootPattern-1318569205-project-member] [instance: 059e3f87-a811-4ac7-b846-2f6d202a919f] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26633323734326238', 'path': '/dev/sdc'} {{(pid=74613) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 29 18:25:29 user nova-compute[74613]: DEBUG nova.virt.libvirt.vif [None req-1e7c1f9a-e7bf-40d3-88fd-0af1eea50b34 tempest-TestVolumeBootPattern-1318569205 tempest-TestVolumeBootPattern-1318569205-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T18:25:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1347441807',display_name='tempest-TestVolumeBootPattern-server-1347441807',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1347441807',id=48,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBF68W8p1zDe0zv1nt+x55p88jNtkp+KefAo7j9aGY4lI4rRNz+cx5GFQLxMQlgNyvRcFIVQErVtli+AYTX2wE/wzDsGd1AkTeB1AuDgBox6TZ+l5dYZcMLLtIJDQcAEEBg==',key_name='tempest-TestVolumeBootPattern-792688502',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='67390f1402214191904cfbd68c3142a7',ramdisk_id='',reservation_id='r-jdxw31r6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1318569205',owner_user_name='tempest-TestVolumeBootPattern-1318569205-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T18:25:20Z,user_data=None,user_id='bedbc6ed47394e2b9125543a8b88a71f',uuid=059e3f87-a811-4ac7-b846-2f6d202a919f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "91dd58f7-d736-4a98-b6a6-f4d1bc6dd8dd", "address": "fa:16:3e:6a:c5:f2", "network": {"id": "4a5179dd-d0b1-44c3-80c1-08dd7b0152f1", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1296336996-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "67390f1402214191904cfbd68c3142a7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap91dd58f7-d7", "ovs_interfaceid": "91dd58f7-d736-4a98-b6a6-f4d1bc6dd8dd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74613) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 29 18:25:29 user nova-compute[74613]: DEBUG nova.network.os_vif_util [None req-1e7c1f9a-e7bf-40d3-88fd-0af1eea50b34 tempest-TestVolumeBootPattern-1318569205 tempest-TestVolumeBootPattern-1318569205-project-member] Converting VIF {"id": "91dd58f7-d736-4a98-b6a6-f4d1bc6dd8dd", "address": "fa:16:3e:6a:c5:f2", "network": {"id": "4a5179dd-d0b1-44c3-80c1-08dd7b0152f1", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1296336996-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "67390f1402214191904cfbd68c3142a7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap91dd58f7-d7", "ovs_interfaceid": "91dd58f7-d736-4a98-b6a6-f4d1bc6dd8dd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74613) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 18:25:29 user nova-compute[74613]: DEBUG nova.network.os_vif_util [None req-1e7c1f9a-e7bf-40d3-88fd-0af1eea50b34 tempest-TestVolumeBootPattern-1318569205 tempest-TestVolumeBootPattern-1318569205-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6a:c5:f2,bridge_name='br-int',has_traffic_filtering=True,id=91dd58f7-d736-4a98-b6a6-f4d1bc6dd8dd,network=Network(4a5179dd-d0b1-44c3-80c1-08dd7b0152f1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap91dd58f7-d7') {{(pid=74613) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 18:25:29 user nova-compute[74613]: DEBUG nova.objects.instance [None req-1e7c1f9a-e7bf-40d3-88fd-0af1eea50b34 tempest-TestVolumeBootPattern-1318569205 tempest-TestVolumeBootPattern-1318569205-project-member] Lazy-loading 'pci_devices' on Instance uuid 059e3f87-a811-4ac7-b846-2f6d202a919f {{(pid=74613) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 18:25:29 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-1e7c1f9a-e7bf-40d3-88fd-0af1eea50b34 tempest-TestVolumeBootPattern-1318569205 tempest-TestVolumeBootPattern-1318569205-project-member] [instance: 059e3f87-a811-4ac7-b846-2f6d202a919f] End _get_guest_xml xml=<domain type="kvm">
Nov 29 18:25:29 user nova-compute[74613]:   <uuid>059e3f87-a811-4ac7-b846-2f6d202a919f</uuid>
Nov 29 18:25:29 user nova-compute[74613]:   <name>instance-00000030</name>
Nov 29 18:25:29 user nova-compute[74613]:   <memory>524288</memory>
Nov 29 18:25:29 user nova-compute[74613]:   <vcpu>1</vcpu>
Nov 29 18:25:29 user nova-compute[74613]:   <metadata>
Nov 29 18:25:29 user nova-compute[74613]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 29 18:25:29 user nova-compute[74613]:       <nova:package version="0.0.0"/>
Nov 29 18:25:29 user nova-compute[74613]:       <nova:name>tempest-TestVolumeBootPattern-server-1347441807</nova:name>
Nov 29 18:25:29 user nova-compute[74613]:       <nova:creationTime>2023-11-29 18:25:28</nova:creationTime>
Nov 29 18:25:29 user nova-compute[74613]:       <nova:flavor name="m1.tiny">
Nov 29 18:25:29 user nova-compute[74613]:         <nova:memory>512</nova:memory>
Nov 29 18:25:29 user nova-compute[74613]:         <nova:disk>1</nova:disk>
Nov 29 18:25:29 user nova-compute[74613]:         <nova:swap>0</nova:swap>
Nov 29 18:25:29 user nova-compute[74613]:         <nova:ephemeral>0</nova:ephemeral>
Nov 29 18:25:29 user nova-compute[74613]:         <nova:vcpus>1</nova:vcpus>
Nov 29 18:25:29 user nova-compute[74613]:       </nova:flavor>
Nov 29 18:25:29 user nova-compute[74613]:       <nova:owner>
Nov 29 18:25:29 user nova-compute[74613]:         <nova:user uuid="bedbc6ed47394e2b9125543a8b88a71f">tempest-TestVolumeBootPattern-1318569205-project-member</nova:user>
Nov 29 18:25:29 user nova-compute[74613]:         <nova:project uuid="67390f1402214191904cfbd68c3142a7">tempest-TestVolumeBootPattern-1318569205</nova:project>
Nov 29 18:25:29 user nova-compute[74613]:       </nova:owner>
Nov 29 18:25:29 user nova-compute[74613]:       <nova:ports>
Nov 29 18:25:29 user nova-compute[74613]:         <nova:port uuid="91dd58f7-d736-4a98-b6a6-f4d1bc6dd8dd">
Nov 29 18:25:29 user nova-compute[74613]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Nov 29 18:25:29 user nova-compute[74613]:         </nova:port>
Nov 29 18:25:29 user nova-compute[74613]:       </nova:ports>
Nov 29 18:25:29 user nova-compute[74613]:     </nova:instance>
Nov 29 18:25:29 user nova-compute[74613]:   </metadata>
Nov 29 18:25:29 user nova-compute[74613]:   <sysinfo type="smbios">
Nov 29 18:25:29 user nova-compute[74613]:     <system>
Nov 29 18:25:29 user nova-compute[74613]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 29 18:25:29 user nova-compute[74613]:       <entry name="product">OpenStack Nova</entry>
Nov 29 18:25:29 user nova-compute[74613]:       <entry name="version">0.0.0</entry>
Nov 29 18:25:29 user nova-compute[74613]:       <entry name="serial">059e3f87-a811-4ac7-b846-2f6d202a919f</entry>
Nov 29 18:25:29 user nova-compute[74613]:       <entry name="uuid">059e3f87-a811-4ac7-b846-2f6d202a919f</entry>
Nov 29 18:25:29 user nova-compute[74613]:       <entry name="family">Virtual Machine</entry>
Nov 29 18:25:29 user nova-compute[74613]:     </system>
Nov 29 18:25:29 user nova-compute[74613]:   </sysinfo>
Nov 29 18:25:29 user nova-compute[74613]:   <os>
Nov 29 18:25:29 user nova-compute[74613]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 29 18:25:29 user nova-compute[74613]:     <boot dev="hd"/>
Nov 29 18:25:29 user nova-compute[74613]:     <smbios mode="sysinfo"/>
Nov 29 18:25:29 user nova-compute[74613]:   </os>
Nov 29 18:25:29 user nova-compute[74613]:   <features>
Nov 29 18:25:29 user nova-compute[74613]:     <acpi/>
Nov 29 18:25:29 user nova-compute[74613]:     <apic/>
Nov 29 18:25:29 user nova-compute[74613]:     <vmcoreinfo/>
Nov 29 18:25:29 user nova-compute[74613]:   </features>
Nov 29 18:25:29 user nova-compute[74613]:   <clock offset="utc">
Nov 29 18:25:29 user nova-compute[74613]:     <timer name="pit" tickpolicy="delay"/>
Nov 29 18:25:29 user nova-compute[74613]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 29 18:25:29 user nova-compute[74613]:     <timer name="hpet" present="no"/>
Nov 29 18:25:29 user nova-compute[74613]:   </clock>
Nov 29 18:25:29 user nova-compute[74613]:   <cpu mode="custom" match="exact">
Nov 29 18:25:29 user nova-compute[74613]:     <model>Nehalem</model>
Nov 29 18:25:29 user nova-compute[74613]:     <topology sockets="1" cores="1" threads="1"/>
Nov 29 18:25:29 user nova-compute[74613]:   </cpu>
Nov 29 18:25:29 user nova-compute[74613]:   <devices>
Nov 29 18:25:29 user nova-compute[74613]:     <disk type="block" device="disk">
Nov 29 18:25:29 user nova-compute[74613]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 18:25:29 user nova-compute[74613]:       <source dev="/dev/sdc"/>
Nov 29 18:25:29 user nova-compute[74613]:       <target dev="vda" bus="virtio"/>
Nov 29 18:25:29 user nova-compute[74613]:       <serial>6f39cfde-47c7-4b9f-83d3-13c147be6792</serial>
Nov 29 18:25:29 user nova-compute[74613]:     </disk>
Nov 29 18:25:29 user nova-compute[74613]:     <interface type="ethernet">
Nov 29 18:25:29 user nova-compute[74613]:       <mac address="fa:16:3e:6a:c5:f2"/>
Nov 29 18:25:29 user nova-compute[74613]:       <model type="virtio"/>
Nov 29 18:25:29 user nova-compute[74613]:       <mtu size="1442"/>
Nov 29 18:25:29 user nova-compute[74613]:       <target dev="tap91dd58f7-d7"/>
Nov 29 18:25:29 user nova-compute[74613]:     </interface>
Nov 29 18:25:29 user nova-compute[74613]:     <serial type="pty">
Nov 29 18:25:29 user nova-compute[74613]:       <log file="/opt/stack/data/nova/instances/059e3f87-a811-4ac7-b846-2f6d202a919f/console.log" append="off"/>
Nov 29 18:25:29 user nova-compute[74613]:     </serial>
Nov 29 18:25:29 user nova-compute[74613]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 29 18:25:29 user nova-compute[74613]:     <video>
Nov 29 18:25:29 user nova-compute[74613]:       <model type="virtio"/>
Nov 29 18:25:29 user nova-compute[74613]:     </video>
Nov 29 18:25:29 user nova-compute[74613]:     <rng model="virtio">
Nov 29 18:25:29 user nova-compute[74613]:       <backend model="random">/dev/urandom</backend>
Nov 29 18:25:29 user nova-compute[74613]:     </rng>
Nov 29 18:25:29 user nova-compute[74613]:     <controller type="usb" index="0" model="none"/>
Nov 29 18:25:29 user nova-compute[74613]:     <memballoon model="virtio">
Nov 29 18:25:29 user nova-compute[74613]:       <stats period="10"/>
Nov 29 18:25:29 user nova-compute[74613]:     </memballoon>
Nov 29 18:25:29 user nova-compute[74613]:   </devices>
Nov 29 18:25:29 user nova-compute[74613]: </domain>
Nov 29 18:25:29 user nova-compute[74613]:  {{(pid=74613) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 29 18:25:29 user nova-compute[74613]: DEBUG nova.virt.libvirt.vif [None req-1e7c1f9a-e7bf-40d3-88fd-0af1eea50b34 tempest-TestVolumeBootPattern-1318569205 tempest-TestVolumeBootPattern-1318569205-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T18:25:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1347441807',display_name='tempest-TestVolumeBootPattern-server-1347441807',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1347441807',id=48,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBF68W8p1zDe0zv1nt+x55p88jNtkp+KefAo7j9aGY4lI4rRNz+cx5GFQLxMQlgNyvRcFIVQErVtli+AYTX2wE/wzDsGd1AkTeB1AuDgBox6TZ+l5dYZcMLLtIJDQcAEEBg==',key_name='tempest-TestVolumeBootPattern-792688502',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='67390f1402214191904cfbd68c3142a7',ramdisk_id='',reservation_id='r-jdxw31r6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1318569205',owner_user_name='tempest-TestVolumeBootPattern-1318569205-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T18:25:20Z,user_data=None,user_id='bedbc6ed47394e2b9125543a8b88a71f',uuid=059e3f87-a811-4ac7-b846-2f6d202a919f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "91dd58f7-d736-4a98-b6a6-f4d1bc6dd8dd", "address": "fa:16:3e:6a:c5:f2", "network": {"id": "4a5179dd-d0b1-44c3-80c1-08dd7b0152f1", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1296336996-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "67390f1402214191904cfbd68c3142a7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap91dd58f7-d7", "ovs_interfaceid": "91dd58f7-d736-4a98-b6a6-f4d1bc6dd8dd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74613) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 29 18:25:29 user nova-compute[74613]: DEBUG nova.network.os_vif_util [None req-1e7c1f9a-e7bf-40d3-88fd-0af1eea50b34 tempest-TestVolumeBootPattern-1318569205 tempest-TestVolumeBootPattern-1318569205-project-member] Converting VIF {"id": "91dd58f7-d736-4a98-b6a6-f4d1bc6dd8dd", "address": "fa:16:3e:6a:c5:f2", "network": {"id": "4a5179dd-d0b1-44c3-80c1-08dd7b0152f1", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1296336996-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "67390f1402214191904cfbd68c3142a7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap91dd58f7-d7", "ovs_interfaceid": "91dd58f7-d736-4a98-b6a6-f4d1bc6dd8dd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74613) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 18:25:29 user nova-compute[74613]: DEBUG nova.network.os_vif_util [None req-1e7c1f9a-e7bf-40d3-88fd-0af1eea50b34 tempest-TestVolumeBootPattern-1318569205 tempest-TestVolumeBootPattern-1318569205-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6a:c5:f2,bridge_name='br-int',has_traffic_filtering=True,id=91dd58f7-d736-4a98-b6a6-f4d1bc6dd8dd,network=Network(4a5179dd-d0b1-44c3-80c1-08dd7b0152f1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap91dd58f7-d7') {{(pid=74613) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 18:25:29 user nova-compute[74613]: DEBUG os_vif [None req-1e7c1f9a-e7bf-40d3-88fd-0af1eea50b34 tempest-TestVolumeBootPattern-1318569205 tempest-TestVolumeBootPattern-1318569205-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:6a:c5:f2,bridge_name='br-int',has_traffic_filtering=True,id=91dd58f7-d736-4a98-b6a6-f4d1bc6dd8dd,network=Network(4a5179dd-d0b1-44c3-80c1-08dd7b0152f1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap91dd58f7-d7') {{(pid=74613) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 29 18:25:29 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:25:29 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74613) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 18:25:29 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74613) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 29 18:25:29 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:25:29 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'd41b4a15-cd49-5d78-ac3f-61e56371eb4c', '_type': 'linux-noop'}}, row=False) {{(pid=74613) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 18:25:29 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:25:29 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 18:25:29 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:25:29 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap91dd58f7-d7, may_exist=True, interface_attrs={}) {{(pid=74613) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 18:25:29 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap91dd58f7-d7, col_values=(('qos', UUID('00067d0d-9e02-4645-8122-47378ad96027')),), if_exists=True) {{(pid=74613) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 18:25:29 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap91dd58f7-d7, col_values=(('external_ids', {'iface-id': '91dd58f7-d736-4a98-b6a6-f4d1bc6dd8dd', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:6a:c5:f2', 'vm-uuid': '059e3f87-a811-4ac7-b846-2f6d202a919f'}),), if_exists=True) {{(pid=74613) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 18:25:29 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:25:29 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 18:25:29 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:25:29 user nova-compute[74613]: INFO os_vif [None req-1e7c1f9a-e7bf-40d3-88fd-0af1eea50b34 tempest-TestVolumeBootPattern-1318569205 tempest-TestVolumeBootPattern-1318569205-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:6a:c5:f2,bridge_name='br-int',has_traffic_filtering=True,id=91dd58f7-d736-4a98-b6a6-f4d1bc6dd8dd,network=Network(4a5179dd-d0b1-44c3-80c1-08dd7b0152f1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap91dd58f7-d7')
Nov 29 18:25:29 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-1e7c1f9a-e7bf-40d3-88fd-0af1eea50b34 tempest-TestVolumeBootPattern-1318569205 tempest-TestVolumeBootPattern-1318569205-project-member] No BDM found with device name vda, not building metadata. {{(pid=74613) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 18:25:29 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-1e7c1f9a-e7bf-40d3-88fd-0af1eea50b34 tempest-TestVolumeBootPattern-1318569205 tempest-TestVolumeBootPattern-1318569205-project-member] No VIF found with MAC fa:16:3e:6a:c5:f2, not building metadata {{(pid=74613) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 29 18:25:30 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:25:30 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:25:30 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:25:30 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:25:30 user nova-compute[74613]: DEBUG nova.compute.manager [req-ea88a59c-a429-46e5-9f61-06e6f724fd54 req-5f994b26-4f3a-405c-b1b3-5df2c7822065 service nova] [instance: 059e3f87-a811-4ac7-b846-2f6d202a919f] Received event network-vif-plugged-91dd58f7-d736-4a98-b6a6-f4d1bc6dd8dd {{(pid=74613) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 18:25:30 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-ea88a59c-a429-46e5-9f61-06e6f724fd54 req-5f994b26-4f3a-405c-b1b3-5df2c7822065 service nova] Acquiring lock "059e3f87-a811-4ac7-b846-2f6d202a919f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 18:25:30 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-ea88a59c-a429-46e5-9f61-06e6f724fd54 req-5f994b26-4f3a-405c-b1b3-5df2c7822065 service nova] Lock "059e3f87-a811-4ac7-b846-2f6d202a919f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 18:25:30 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-ea88a59c-a429-46e5-9f61-06e6f724fd54 req-5f994b26-4f3a-405c-b1b3-5df2c7822065 service nova] Lock "059e3f87-a811-4ac7-b846-2f6d202a919f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 18:25:31 user nova-compute[74613]: DEBUG nova.compute.manager [req-ea88a59c-a429-46e5-9f61-06e6f724fd54 req-5f994b26-4f3a-405c-b1b3-5df2c7822065 service nova] [instance: 059e3f87-a811-4ac7-b846-2f6d202a919f] No waiting events found dispatching network-vif-plugged-91dd58f7-d736-4a98-b6a6-f4d1bc6dd8dd {{(pid=74613) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 18:25:31 user nova-compute[74613]: WARNING nova.compute.manager [req-ea88a59c-a429-46e5-9f61-06e6f724fd54 req-5f994b26-4f3a-405c-b1b3-5df2c7822065 service nova] [instance: 059e3f87-a811-4ac7-b846-2f6d202a919f] Received unexpected event network-vif-plugged-91dd58f7-d736-4a98-b6a6-f4d1bc6dd8dd for instance with vm_state building and task_state spawning.
Nov 29 18:25:31 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:25:31 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:25:31 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:25:31 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:25:31 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:25:32 user nova-compute[74613]: DEBUG nova.compute.manager [None req-1e7c1f9a-e7bf-40d3-88fd-0af1eea50b34 tempest-TestVolumeBootPattern-1318569205 tempest-TestVolumeBootPattern-1318569205-project-member] [instance: 059e3f87-a811-4ac7-b846-2f6d202a919f] Instance event wait completed in 0 seconds for  {{(pid=74613) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 29 18:25:32 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-1e7c1f9a-e7bf-40d3-88fd-0af1eea50b34 tempest-TestVolumeBootPattern-1318569205 tempest-TestVolumeBootPattern-1318569205-project-member] [instance: 059e3f87-a811-4ac7-b846-2f6d202a919f] Guest created on hypervisor {{(pid=74613) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 29 18:25:32 user nova-compute[74613]: INFO nova.virt.libvirt.driver [-] [instance: 059e3f87-a811-4ac7-b846-2f6d202a919f] Instance spawned successfully.
Nov 29 18:25:33 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-1e7c1f9a-e7bf-40d3-88fd-0af1eea50b34 tempest-TestVolumeBootPattern-1318569205 tempest-TestVolumeBootPattern-1318569205-project-member] [instance: 059e3f87-a811-4ac7-b846-2f6d202a919f] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74613) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 29 18:25:33 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-1e7c1f9a-e7bf-40d3-88fd-0af1eea50b34 tempest-TestVolumeBootPattern-1318569205 tempest-TestVolumeBootPattern-1318569205-project-member] [instance: 059e3f87-a811-4ac7-b846-2f6d202a919f] Found default for hw_cdrom_bus of ide {{(pid=74613) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 18:25:33 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-1e7c1f9a-e7bf-40d3-88fd-0af1eea50b34 tempest-TestVolumeBootPattern-1318569205 tempest-TestVolumeBootPattern-1318569205-project-member] [instance: 059e3f87-a811-4ac7-b846-2f6d202a919f] Found default for hw_disk_bus of virtio {{(pid=74613) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 18:25:33 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-1e7c1f9a-e7bf-40d3-88fd-0af1eea50b34 tempest-TestVolumeBootPattern-1318569205 tempest-TestVolumeBootPattern-1318569205-project-member] [instance: 059e3f87-a811-4ac7-b846-2f6d202a919f] Found default for hw_input_bus of None {{(pid=74613) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 18:25:33 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-1e7c1f9a-e7bf-40d3-88fd-0af1eea50b34 tempest-TestVolumeBootPattern-1318569205 tempest-TestVolumeBootPattern-1318569205-project-member] [instance: 059e3f87-a811-4ac7-b846-2f6d202a919f] Found default for hw_pointer_model of None {{(pid=74613) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 18:25:33 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-1e7c1f9a-e7bf-40d3-88fd-0af1eea50b34 tempest-TestVolumeBootPattern-1318569205 tempest-TestVolumeBootPattern-1318569205-project-member] [instance: 059e3f87-a811-4ac7-b846-2f6d202a919f] Found default for hw_video_model of virtio {{(pid=74613) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 18:25:33 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-1e7c1f9a-e7bf-40d3-88fd-0af1eea50b34 tempest-TestVolumeBootPattern-1318569205 tempest-TestVolumeBootPattern-1318569205-project-member] [instance: 059e3f87-a811-4ac7-b846-2f6d202a919f] Found default for hw_vif_model of virtio {{(pid=74613) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 18:25:33 user nova-compute[74613]: DEBUG nova.compute.manager [req-a451d8d0-7c6a-4816-ad7d-5273fd971a1a req-a37408ae-63d6-4135-82c8-8306b1bc04c5 service nova] [instance: 059e3f87-a811-4ac7-b846-2f6d202a919f] Received event network-vif-plugged-91dd58f7-d736-4a98-b6a6-f4d1bc6dd8dd {{(pid=74613) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 18:25:33 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-a451d8d0-7c6a-4816-ad7d-5273fd971a1a req-a37408ae-63d6-4135-82c8-8306b1bc04c5 service nova] Acquiring lock "059e3f87-a811-4ac7-b846-2f6d202a919f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 18:25:33 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-a451d8d0-7c6a-4816-ad7d-5273fd971a1a req-a37408ae-63d6-4135-82c8-8306b1bc04c5 service nova] Lock "059e3f87-a811-4ac7-b846-2f6d202a919f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 18:25:33 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-a451d8d0-7c6a-4816-ad7d-5273fd971a1a req-a37408ae-63d6-4135-82c8-8306b1bc04c5 service nova] Lock "059e3f87-a811-4ac7-b846-2f6d202a919f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 18:25:33 user nova-compute[74613]: DEBUG nova.compute.manager [req-a451d8d0-7c6a-4816-ad7d-5273fd971a1a req-a37408ae-63d6-4135-82c8-8306b1bc04c5 service nova] [instance: 059e3f87-a811-4ac7-b846-2f6d202a919f] No waiting events found dispatching network-vif-plugged-91dd58f7-d736-4a98-b6a6-f4d1bc6dd8dd {{(pid=74613) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 18:25:33 user nova-compute[74613]: WARNING nova.compute.manager [req-a451d8d0-7c6a-4816-ad7d-5273fd971a1a req-a37408ae-63d6-4135-82c8-8306b1bc04c5 service nova] [instance: 059e3f87-a811-4ac7-b846-2f6d202a919f] Received unexpected event network-vif-plugged-91dd58f7-d736-4a98-b6a6-f4d1bc6dd8dd for instance with vm_state building and task_state spawning.
Nov 29 18:25:33 user nova-compute[74613]: INFO nova.compute.manager [None req-1e7c1f9a-e7bf-40d3-88fd-0af1eea50b34 tempest-TestVolumeBootPattern-1318569205 tempest-TestVolumeBootPattern-1318569205-project-member] [instance: 059e3f87-a811-4ac7-b846-2f6d202a919f] Took 4.93 seconds to spawn the instance on the hypervisor.
Nov 29 18:25:33 user nova-compute[74613]: DEBUG nova.compute.manager [None req-1e7c1f9a-e7bf-40d3-88fd-0af1eea50b34 tempest-TestVolumeBootPattern-1318569205 tempest-TestVolumeBootPattern-1318569205-project-member] [instance: 059e3f87-a811-4ac7-b846-2f6d202a919f] Checking state {{(pid=74613) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 29 18:25:33 user nova-compute[74613]: INFO nova.compute.manager [None req-1e7c1f9a-e7bf-40d3-88fd-0af1eea50b34 tempest-TestVolumeBootPattern-1318569205 tempest-TestVolumeBootPattern-1318569205-project-member] [instance: 059e3f87-a811-4ac7-b846-2f6d202a919f] Took 13.18 seconds to build instance.
Nov 29 18:25:33 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-1e7c1f9a-e7bf-40d3-88fd-0af1eea50b34 tempest-TestVolumeBootPattern-1318569205 tempest-TestVolumeBootPattern-1318569205-project-member] Lock "059e3f87-a811-4ac7-b846-2f6d202a919f" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 13.284s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 18:25:34 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:25:36 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:25:39 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:25:42 user nova-compute[74613]: DEBUG oslo_service.periodic_task [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74613) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 18:25:43 user nova-compute[74613]: DEBUG oslo_service.periodic_task [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74613) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 18:25:44 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 18:25:44 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 18:25:44 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=74613) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 29 18:25:44 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74613) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 18:25:44 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74613) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 18:25:44 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:25:46 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:25:46 user nova-compute[74613]: DEBUG oslo_service.periodic_task [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74613) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 18:25:47 user nova-compute[74613]: DEBUG oslo_service.periodic_task [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74613) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 18:25:47 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 18:25:47 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 18:25:47 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 18:25:47 user nova-compute[74613]: DEBUG nova.compute.resource_tracker [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Auditing locally available compute resources for user (node: user) {{(pid=74613) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 29 18:25:47 user nova-compute[74613]: WARNING nova.virt.libvirt.driver [None req-eb0d35e6-af00-4c42-a186-38adf73660d8 tempest-SnapshotDataIntegrityTests-1810787156 tempest-SnapshotDataIntegrityTests-1810787156-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 5227902d-b2b9-40a6-988f-3c02c52404f3 is timed out.
Nov 29 18:25:47 user nova-compute[74613]: INFO nova.virt.libvirt.driver [None req-eb0d35e6-af00-4c42-a186-38adf73660d8 tempest-SnapshotDataIntegrityTests-1810787156 tempest-SnapshotDataIntegrityTests-1810787156-project-member] Successfully detached device vdb from instance 5227902d-b2b9-40a6-988f-3c02c52404f3 from the live domain config.
Nov 29 18:25:47 user nova-compute[74613]: DEBUG nova.virt.libvirt.volume.iscsi [None req-eb0d35e6-af00-4c42-a186-38adf73660d8 tempest-SnapshotDataIntegrityTests-1810787156 tempest-SnapshotDataIntegrityTests-1810787156-project-member] [instance: 5227902d-b2b9-40a6-988f-3c02c52404f3] calling os-brick to detach iSCSI Volume {{(pid=74613) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 29 18:25:47 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb0d35e6-af00-4c42-a186-38adf73660d8 tempest-SnapshotDataIntegrityTests-1810787156 tempest-SnapshotDataIntegrityTests-1810787156-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff828156890>, {'target_iqn': 'iqn.2010-10.org.openstack:69f38afd-fc23-439c-8149-17a04be10706', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'GfojpnsK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=74613) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 18:25:47 user nova-compute[74613]: WARNING os_brick.initiator.connectors.base [None req-eb0d35e6-af00-4c42-a186-38adf73660d8 tempest-SnapshotDataIntegrityTests-1810787156 tempest-SnapshotDataIntegrityTests-1810787156-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 18:25:47 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.base [None req-eb0d35e6-af00-4c42-a186-38adf73660d8 tempest-SnapshotDataIntegrityTests-1810787156 tempest-SnapshotDataIntegrityTests-1810787156-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 18:25:47 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.base [None req-eb0d35e6-af00-4c42-a186-38adf73660d8 tempest-SnapshotDataIntegrityTests-1810787156 tempest-SnapshotDataIntegrityTests-1810787156-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 18:25:47 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:25:47 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/35c09e0b-55fa-42c4-a47a-707909e184f9/disk --force-share --output=json {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:25:47 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:25:47 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa97fe2a-bdc1-43dd-8fb0-20f17b42cefd]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:69f38afd-fc23-439c-8149-17a04be10706\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:6f39cfde-47c7-4b9f-83d3-13c147be6792\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 18:25:47 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb0d35e6-af00-4c42-a186-38adf73660d8 tempest-SnapshotDataIntegrityTests-1810787156 tempest-SnapshotDataIntegrityTests-1810787156-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 29 18:25:47 user nova-compute[74613]: No targets found.
Nov 29 18:25:47 user nova-compute[74613]: iSNS:
Nov 29 18:25:47 user nova-compute[74613]: No targets found.
Nov 29 18:25:47 user nova-compute[74613]: STATIC:
Nov 29 18:25:47 user nova-compute[74613]: Target: iqn.2010-10.org.openstack:69f38afd-fc23-439c-8149-17a04be10706
Nov 29 18:25:47 user nova-compute[74613]:         Portal: 172.16.0.220:3260,-1
Nov 29 18:25:47 user nova-compute[74613]:                 Iface Name: default
Nov 29 18:25:47 user nova-compute[74613]: Target: iqn.2010-10.org.openstack:6f39cfde-47c7-4b9f-83d3-13c147be6792
Nov 29 18:25:47 user nova-compute[74613]:         Portal: 172.16.0.220:3260,-1
Nov 29 18:25:47 user nova-compute[74613]:                 Iface Name: default
Nov 29 18:25:47 user nova-compute[74613]: FIRMWARE:
Nov 29 18:25:47 user nova-compute[74613]: No targets found.
Nov 29 18:25:47 user nova-compute[74613]:  stderr= {{(pid=74613) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 18:25:47 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb0d35e6-af00-4c42-a186-38adf73660d8 tempest-SnapshotDataIntegrityTests-1810787156 tempest-SnapshotDataIntegrityTests-1810787156-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 29 18:25:47 user nova-compute[74613]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 29 18:25:47 user nova-compute[74613]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74613) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 29 18:25:47 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb0d35e6-af00-4c42-a186-38adf73660d8 tempest-SnapshotDataIntegrityTests-1810787156 tempest-SnapshotDataIntegrityTests-1810787156-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:69f38afd-fc23-439c-8149-17a04be10706', 0)] {{(pid=74613) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 29 18:25:47 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:25:47 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:25:47 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9ebcde4-3b73-4f5b-ad56-b008aabf3a49]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:69f38afd-fc23-439c-8149-17a04be10706\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6f39cfde-47c7-4b9f-83d3-13c147be6792\n', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 18:25:47 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:25:47 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:25:47 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[98fce46e-69a4-421e-865f-d7be99cd5281]: (4, ('tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69f38afd-fc23-439c-8149-17a04be10706 (non-flash)\ntcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f39cfde-47c7-4b9f-83d3-13c147be6792 (non-flash)\n', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 18:25:47 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb0d35e6-af00-4c42-a186-38adf73660d8 tempest-SnapshotDataIntegrityTests-1810787156 tempest-SnapshotDataIntegrityTests-1810787156-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69f38afd-fc23-439c-8149-17a04be10706 (non-flash)
Nov 29 18:25:47 user nova-compute[74613]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f39cfde-47c7-4b9f-83d3-13c147be6792 (non-flash)
Nov 29 18:25:47 user nova-compute[74613]:  stderr= {{(pid=74613) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 18:25:47 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb0d35e6-af00-4c42-a186-38adf73660d8 tempest-SnapshotDataIntegrityTests-1810787156 tempest-SnapshotDataIntegrityTests-1810787156-project-member] iscsi session list stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69f38afd-fc23-439c-8149-17a04be10706 (non-flash)
Nov 29 18:25:47 user nova-compute[74613]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f39cfde-47c7-4b9f-83d3-13c147be6792 (non-flash)
Nov 29 18:25:47 user nova-compute[74613]:  stderr= {{(pid=74613) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 18:25:47 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb0d35e6-af00-4c42-a186-38adf73660d8 tempest-SnapshotDataIntegrityTests-1810787156 tempest-SnapshotDataIntegrityTests-1810787156-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7ff81878dea0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:69f38afd-fc23-439c-8149-17a04be10706'): ({'sdb'}, set())}) {{(pid=74613) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 29 18:25:47 user nova-compute[74613]: DEBUG os_brick.initiator.linuxscsi [None req-eb0d35e6-af00-4c42-a186-38adf73660d8 tempest-SnapshotDataIntegrityTests-1810787156 tempest-SnapshotDataIntegrityTests-1810787156-project-member] Removing single pathed devices sdb {{(pid=74613) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 29 18:25:47 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:25:47 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:25:47 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[9eddce9c-65dd-40b7-9aae-e9945ce4a65e]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 18:25:47 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:25:47 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.018s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:25:47 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[b436cb70-84fc-44ea-94c2-41d2c99b6b34]: (4, ('ok\n', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 18:25:47 user nova-compute[74613]: DEBUG os_brick.initiator.linuxscsi [None req-eb0d35e6-af00-4c42-a186-38adf73660d8 tempest-SnapshotDataIntegrityTests-1810787156 tempest-SnapshotDataIntegrityTests-1810787156-project-member] Flushing IO for device /dev/sdb {{(pid=74613) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 29 18:25:47 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:25:47 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.012s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:25:47 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7518bce-ea40-4a09-b2db-1353c0e32858]: (4, ('', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 18:25:47 user nova-compute[74613]: DEBUG os_brick.initiator.linuxscsi [None req-eb0d35e6-af00-4c42-a186-38adf73660d8 tempest-SnapshotDataIntegrityTests-1810787156 tempest-SnapshotDataIntegrityTests-1810787156-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74613) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 29 18:25:47 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:25:47 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/35c09e0b-55fa-42c4-a47a-707909e184f9/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:25:47 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/35c09e0b-55fa-42c4-a47a-707909e184f9/disk --force-share --output=json {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:25:47 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.061s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:25:47 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a8eda9f-d39a-44ba-a540-d0b890464a61]: (4, ('1', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 18:25:47 user nova-compute[74613]: DEBUG os_brick.initiator.linuxscsi [None req-eb0d35e6-af00-4c42-a186-38adf73660d8 tempest-SnapshotDataIntegrityTests-1810787156 tempest-SnapshotDataIntegrityTests-1810787156-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74613) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 29 18:25:47 user nova-compute[74613]: DEBUG os_brick.initiator.linuxscsi [None req-eb0d35e6-af00-4c42-a186-38adf73660d8 tempest-SnapshotDataIntegrityTests-1810787156 tempest-SnapshotDataIntegrityTests-1810787156-project-member] SCSI volumes sdb have been removed. {{(pid=74613) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 29 18:25:47 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb0d35e6-af00-4c42-a186-38adf73660d8 tempest-SnapshotDataIntegrityTests-1810787156 tempest-SnapshotDataIntegrityTests-1810787156-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:69f38afd-fc23-439c-8149-17a04be10706')] {{(pid=74613) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 29 18:25:47 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:69f38afd-fc23-439c-8149-17a04be10706 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:25:47 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:69f38afd-fc23-439c-8149-17a04be10706 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:25:47 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac57ab52-b30a-4fad-b159-125f7b82888b]: (4, ('', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 18:25:47 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb0d35e6-af00-4c42-a186-38adf73660d8 tempest-SnapshotDataIntegrityTests-1810787156 tempest-SnapshotDataIntegrityTests-1810787156-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74613) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 18:25:47 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:69f38afd-fc23-439c-8149-17a04be10706 -p 172.16.0.220:3260 --logout {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:25:48 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:69f38afd-fc23-439c-8149-17a04be10706 -p 172.16.0.220:3260 --logout" returned: 0 in 0.051s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:25:48 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1bca910-a90c-4eac-adae-bf63a47e733e]: (4, ('Logging out of session [sid: 53, target: iqn.2010-10.org.openstack:69f38afd-fc23-439c-8149-17a04be10706, portal: 172.16.0.220,3260]\nLogout of [sid: 53, target: iqn.2010-10.org.openstack:69f38afd-fc23-439c-8149-17a04be10706, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 18:25:48 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb0d35e6-af00-4c42-a186-38adf73660d8 tempest-SnapshotDataIntegrityTests-1810787156 tempest-SnapshotDataIntegrityTests-1810787156-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 53, target: iqn.2010-10.org.openstack:69f38afd-fc23-439c-8149-17a04be10706, portal: 172.16.0.220,3260]
Nov 29 18:25:48 user nova-compute[74613]: Logout of [sid: 53, target: iqn.2010-10.org.openstack:69f38afd-fc23-439c-8149-17a04be10706, portal: 172.16.0.220,3260] successful.
Nov 29 18:25:48 user nova-compute[74613]:  stderr= {{(pid=74613) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 18:25:48 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:69f38afd-fc23-439c-8149-17a04be10706 -p 172.16.0.220:3260 --op delete {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:25:48 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:69f38afd-fc23-439c-8149-17a04be10706 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.020s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:25:48 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[717b814c-c337-42cc-8fd2-a42938c37312]: (4, ('', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 18:25:48 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb0d35e6-af00-4c42-a186-38adf73660d8 tempest-SnapshotDataIntegrityTests-1810787156 tempest-SnapshotDataIntegrityTests-1810787156-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74613) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 18:25:48 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.base [None req-eb0d35e6-af00-4c42-a186-38adf73660d8 tempest-SnapshotDataIntegrityTests-1810787156 tempest-SnapshotDataIntegrityTests-1810787156-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.331s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 18:25:48 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb0d35e6-af00-4c42-a186-38adf73660d8 tempest-SnapshotDataIntegrityTests-1810787156 tempest-SnapshotDataIntegrityTests-1810787156-project-member] <== disconnect_volume: return (333ms) None {{(pid=74613) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 18:25:48 user nova-compute[74613]: DEBUG nova.virt.libvirt.volume.iscsi [None req-eb0d35e6-af00-4c42-a186-38adf73660d8 tempest-SnapshotDataIntegrityTests-1810787156 tempest-SnapshotDataIntegrityTests-1810787156-project-member] [instance: 5227902d-b2b9-40a6-988f-3c02c52404f3] Disconnected iSCSI Volume {{(pid=74613) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 29 18:25:48 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/35c09e0b-55fa-42c4-a47a-707909e184f9/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:25:48 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5227902d-b2b9-40a6-988f-3c02c52404f3/disk --force-share --output=json {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:25:48 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5227902d-b2b9-40a6-988f-3c02c52404f3/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:25:48 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5227902d-b2b9-40a6-988f-3c02c52404f3/disk --force-share --output=json {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:25:48 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5227902d-b2b9-40a6-988f-3c02c52404f3/disk --force-share --output=json" returned: 0 in 0.214s {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:25:48 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=74613) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 29 18:25:48 user nova-compute[74613]: DEBUG nova.objects.instance [None req-eb0d35e6-af00-4c42-a186-38adf73660d8 tempest-SnapshotDataIntegrityTests-1810787156 tempest-SnapshotDataIntegrityTests-1810787156-project-member] Lazy-loading 'flavor' on Instance uuid 5227902d-b2b9-40a6-988f-3c02c52404f3 {{(pid=74613) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 18:25:48 user nova-compute[74613]: WARNING nova.virt.libvirt.driver [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 18:25:48 user nova-compute[74613]: WARNING nova.virt.libvirt.driver [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 18:25:48 user nova-compute[74613]: DEBUG nova.compute.resource_tracker [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Hypervisor/Node resource view: name=user free_ram=8582MB free_disk=24.891921997070312GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74613) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 29 18:25:48 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 18:25:48 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 18:25:48 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-eb0d35e6-af00-4c42-a186-38adf73660d8 tempest-SnapshotDataIntegrityTests-1810787156 tempest-SnapshotDataIntegrityTests-1810787156-project-member] Lock "5227902d-b2b9-40a6-988f-3c02c52404f3" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.753s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 18:25:48 user nova-compute[74613]: DEBUG nova.compute.resource_tracker [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Instance 5227902d-b2b9-40a6-988f-3c02c52404f3 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74613) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 18:25:48 user nova-compute[74613]: DEBUG nova.compute.resource_tracker [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Instance 35c09e0b-55fa-42c4-a47a-707909e184f9 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74613) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 18:25:48 user nova-compute[74613]: DEBUG nova.compute.resource_tracker [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Instance 059e3f87-a811-4ac7-b846-2f6d202a919f actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74613) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 18:25:48 user nova-compute[74613]: DEBUG nova.compute.resource_tracker [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=74613) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 29 18:25:48 user nova-compute[74613]: DEBUG nova.compute.resource_tracker [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Final resource view: name=user phys_ram=16011MB used_ram=2048MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=3 pci_stats=[] {{(pid=74613) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 29 18:25:49 user nova-compute[74613]: DEBUG nova.compute.provider_tree [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Inventory has not changed in ProviderTree for provider: 639d980e-3b12-44b1-b8f4-1812416fa4dd {{(pid=74613) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 18:25:49 user nova-compute[74613]: DEBUG nova.scheduler.client.report [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Inventory has not changed for provider 639d980e-3b12-44b1-b8f4-1812416fa4dd based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74613) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 18:25:49 user nova-compute[74613]: DEBUG nova.compute.resource_tracker [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Compute_service record updated for user:user {{(pid=74613) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 29 18:25:49 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.221s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 18:25:49 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:25:50 user nova-compute[74613]: DEBUG oslo_service.periodic_task [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74613) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 18:25:50 user nova-compute[74613]: DEBUG nova.compute.manager [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Starting heal instance info cache {{(pid=74613) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 29 18:25:50 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Acquiring lock "refresh_cache-35c09e0b-55fa-42c4-a47a-707909e184f9" {{(pid=74613) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 18:25:50 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Acquired lock "refresh_cache-35c09e0b-55fa-42c4-a47a-707909e184f9" {{(pid=74613) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 18:25:50 user nova-compute[74613]: DEBUG nova.network.neutron [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] [instance: 35c09e0b-55fa-42c4-a47a-707909e184f9] Forcefully refreshing network info cache for instance {{(pid=74613) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 29 18:25:50 user nova-compute[74613]: DEBUG nova.network.neutron [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] [instance: 35c09e0b-55fa-42c4-a47a-707909e184f9] Updating instance_info_cache with network_info: [{"id": "4e69c843-312f-47a8-8e75-4e857f6423d5", "address": "fa:16:3e:62:82:5f", "network": {"id": "74c4d111-4731-4d90-b6a9-a72b112d18ca", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1404505506-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "13bf1cb7deec45aea930f4a0092572d1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4e69c843-31", "ovs_interfaceid": "4e69c843-312f-47a8-8e75-4e857f6423d5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74613) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 18:25:50 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Releasing lock "refresh_cache-35c09e0b-55fa-42c4-a47a-707909e184f9" {{(pid=74613) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 18:25:50 user nova-compute[74613]: DEBUG nova.compute.manager [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] [instance: 35c09e0b-55fa-42c4-a47a-707909e184f9] Updated the network info_cache for instance {{(pid=74613) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 29 18:25:50 user nova-compute[74613]: DEBUG oslo_service.periodic_task [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74613) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 18:25:50 user nova-compute[74613]: DEBUG oslo_service.periodic_task [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74613) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 18:25:50 user nova-compute[74613]: DEBUG nova.compute.manager [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74613) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 29 18:25:51 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:25:51 user nova-compute[74613]: DEBUG oslo_service.periodic_task [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74613) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 18:25:53 user nova-compute[74613]: DEBUG oslo_service.periodic_task [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74613) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 18:25:54 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:25:56 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:25:57 user nova-compute[74613]: DEBUG oslo_service.periodic_task [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74613) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 18:25:59 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:26:01 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:26:04 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:26:09 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 18:26:09 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:26:09 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=74613) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 29 18:26:09 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74613) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 18:26:09 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74613) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 18:26:09 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:26:14 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 18:26:14 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:26:14 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74613) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 29 18:26:14 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74613) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 18:26:14 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74613) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 18:26:14 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:26:19 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 18:26:19 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:26:19 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=74613) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 29 18:26:19 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74613) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 18:26:19 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74613) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 18:26:19 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:26:20 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-f13ac3a5-4322-4882-a82a-91aad574a119 tempest-VolumesActionsTest-576062334 tempest-VolumesActionsTest-576062334-project-member] Acquiring lock "35c09e0b-55fa-42c4-a47a-707909e184f9" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 18:26:20 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-f13ac3a5-4322-4882-a82a-91aad574a119 tempest-VolumesActionsTest-576062334 tempest-VolumesActionsTest-576062334-project-member] Lock "35c09e0b-55fa-42c4-a47a-707909e184f9" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 18:26:20 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-f13ac3a5-4322-4882-a82a-91aad574a119 tempest-VolumesActionsTest-576062334 tempest-VolumesActionsTest-576062334-project-member] Acquiring lock "35c09e0b-55fa-42c4-a47a-707909e184f9-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 18:26:20 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-f13ac3a5-4322-4882-a82a-91aad574a119 tempest-VolumesActionsTest-576062334 tempest-VolumesActionsTest-576062334-project-member] Lock "35c09e0b-55fa-42c4-a47a-707909e184f9-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 18:26:20 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-f13ac3a5-4322-4882-a82a-91aad574a119 tempest-VolumesActionsTest-576062334 tempest-VolumesActionsTest-576062334-project-member] Lock "35c09e0b-55fa-42c4-a47a-707909e184f9-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 18:26:20 user nova-compute[74613]: INFO nova.compute.manager [None req-f13ac3a5-4322-4882-a82a-91aad574a119 tempest-VolumesActionsTest-576062334 tempest-VolumesActionsTest-576062334-project-member] [instance: 35c09e0b-55fa-42c4-a47a-707909e184f9] Terminating instance
Nov 29 18:26:20 user nova-compute[74613]: DEBUG nova.compute.manager [None req-f13ac3a5-4322-4882-a82a-91aad574a119 tempest-VolumesActionsTest-576062334 tempest-VolumesActionsTest-576062334-project-member] [instance: 35c09e0b-55fa-42c4-a47a-707909e184f9] Start destroying the instance on the hypervisor. {{(pid=74613) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 29 18:26:20 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:26:20 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:26:20 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:26:20 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:26:20 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-9da8898e-7f9f-4b1c-9727-54b9472e5028 tempest-SnapshotDataIntegrityTests-1810787156 tempest-SnapshotDataIntegrityTests-1810787156-project-member] Acquiring lock "5227902d-b2b9-40a6-988f-3c02c52404f3" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 18:26:20 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-9da8898e-7f9f-4b1c-9727-54b9472e5028 tempest-SnapshotDataIntegrityTests-1810787156 tempest-SnapshotDataIntegrityTests-1810787156-project-member] Lock "5227902d-b2b9-40a6-988f-3c02c52404f3" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 18:26:20 user nova-compute[74613]: DEBUG nova.compute.manager [req-2ccc4fb5-40c6-46e4-8052-75b472e4b096 req-ab9d5ede-48b5-4aac-9324-0338bb40392f service nova] [instance: 35c09e0b-55fa-42c4-a47a-707909e184f9] Received event network-vif-unplugged-4e69c843-312f-47a8-8e75-4e857f6423d5 {{(pid=74613) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 18:26:20 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-2ccc4fb5-40c6-46e4-8052-75b472e4b096 req-ab9d5ede-48b5-4aac-9324-0338bb40392f service nova] Acquiring lock "35c09e0b-55fa-42c4-a47a-707909e184f9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 18:26:20 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-2ccc4fb5-40c6-46e4-8052-75b472e4b096 req-ab9d5ede-48b5-4aac-9324-0338bb40392f service nova] Lock "35c09e0b-55fa-42c4-a47a-707909e184f9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 18:26:20 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-2ccc4fb5-40c6-46e4-8052-75b472e4b096 req-ab9d5ede-48b5-4aac-9324-0338bb40392f service nova] Lock "35c09e0b-55fa-42c4-a47a-707909e184f9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 18:26:20 user nova-compute[74613]: DEBUG nova.compute.manager [req-2ccc4fb5-40c6-46e4-8052-75b472e4b096 req-ab9d5ede-48b5-4aac-9324-0338bb40392f service nova] [instance: 35c09e0b-55fa-42c4-a47a-707909e184f9] No waiting events found dispatching network-vif-unplugged-4e69c843-312f-47a8-8e75-4e857f6423d5 {{(pid=74613) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 18:26:20 user nova-compute[74613]: DEBUG nova.compute.manager [req-2ccc4fb5-40c6-46e4-8052-75b472e4b096 req-ab9d5ede-48b5-4aac-9324-0338bb40392f service nova] [instance: 35c09e0b-55fa-42c4-a47a-707909e184f9] Received event network-vif-unplugged-4e69c843-312f-47a8-8e75-4e857f6423d5 for instance with task_state deleting. {{(pid=74613) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 29 18:26:20 user nova-compute[74613]: DEBUG nova.objects.instance [None req-9da8898e-7f9f-4b1c-9727-54b9472e5028 tempest-SnapshotDataIntegrityTests-1810787156 tempest-SnapshotDataIntegrityTests-1810787156-project-member] Lazy-loading 'flavor' on Instance uuid 5227902d-b2b9-40a6-988f-3c02c52404f3 {{(pid=74613) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 18:26:20 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-9da8898e-7f9f-4b1c-9727-54b9472e5028 tempest-SnapshotDataIntegrityTests-1810787156 tempest-SnapshotDataIntegrityTests-1810787156-project-member] Lock "5227902d-b2b9-40a6-988f-3c02c52404f3" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.065s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 18:26:20 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:26:20 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:26:20 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-9da8898e-7f9f-4b1c-9727-54b9472e5028 tempest-SnapshotDataIntegrityTests-1810787156 tempest-SnapshotDataIntegrityTests-1810787156-project-member] Acquiring lock "5227902d-b2b9-40a6-988f-3c02c52404f3" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 18:26:20 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-9da8898e-7f9f-4b1c-9727-54b9472e5028 tempest-SnapshotDataIntegrityTests-1810787156 tempest-SnapshotDataIntegrityTests-1810787156-project-member] Lock "5227902d-b2b9-40a6-988f-3c02c52404f3" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 18:26:20 user nova-compute[74613]: INFO nova.compute.manager [None req-9da8898e-7f9f-4b1c-9727-54b9472e5028 tempest-SnapshotDataIntegrityTests-1810787156 tempest-SnapshotDataIntegrityTests-1810787156-project-member] [instance: 5227902d-b2b9-40a6-988f-3c02c52404f3] Attaching volume e7ab2332-2ab0-4213-a15f-478d9f612aff to /dev/vdb
Nov 29 18:26:20 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:26:20 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:26:20 user nova-compute[74613]: INFO nova.virt.libvirt.driver [-] [instance: 35c09e0b-55fa-42c4-a47a-707909e184f9] Instance destroyed successfully.
Nov 29 18:26:20 user nova-compute[74613]: DEBUG nova.objects.instance [None req-f13ac3a5-4322-4882-a82a-91aad574a119 tempest-VolumesActionsTest-576062334 tempest-VolumesActionsTest-576062334-project-member] Lazy-loading 'resources' on Instance uuid 35c09e0b-55fa-42c4-a47a-707909e184f9 {{(pid=74613) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 18:26:20 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:26:20 user nova-compute[74613]: DEBUG nova.virt.libvirt.vif [None req-f13ac3a5-4322-4882-a82a-91aad574a119 tempest-VolumesActionsTest-576062334 tempest-VolumesActionsTest-576062334-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T18:24:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-2092330219',display_name='tempest-VolumesActionsTest-instance-2092330219',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-2092330219',id=47,image_ref='4217f428-8d9d-4ee1-9614-642d26d90c46',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-29T18:24:35Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='13bf1cb7deec45aea930f4a0092572d1',ramdisk_id='',reservation_id='r-jnotmc1e',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='4217f428-8d9d-4ee1-9614-642d26d90c46',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesActionsTest-576062334',owner_user_name='tempest-VolumesActionsTest-576062334-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-29T18:24:35Z,user_data=None,user_id='680fbea8ee2e489b9e7a4274b5f66b62',uuid=35c09e0b-55fa-42c4-a47a-707909e184f9,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "4e69c843-312f-47a8-8e75-4e857f6423d5", "address": "fa:16:3e:62:82:5f", "network": {"id": "74c4d111-4731-4d90-b6a9-a72b112d18ca", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1404505506-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "13bf1cb7deec45aea930f4a0092572d1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4e69c843-31", "ovs_interfaceid": "4e69c843-312f-47a8-8e75-4e857f6423d5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74613) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 29 18:26:20 user nova-compute[74613]: DEBUG nova.network.os_vif_util [None req-f13ac3a5-4322-4882-a82a-91aad574a119 tempest-VolumesActionsTest-576062334 tempest-VolumesActionsTest-576062334-project-member] Converting VIF {"id": "4e69c843-312f-47a8-8e75-4e857f6423d5", "address": "fa:16:3e:62:82:5f", "network": {"id": "74c4d111-4731-4d90-b6a9-a72b112d18ca", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1404505506-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "13bf1cb7deec45aea930f4a0092572d1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4e69c843-31", "ovs_interfaceid": "4e69c843-312f-47a8-8e75-4e857f6423d5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74613) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 18:26:20 user nova-compute[74613]: DEBUG nova.network.os_vif_util [None req-f13ac3a5-4322-4882-a82a-91aad574a119 tempest-VolumesActionsTest-576062334 tempest-VolumesActionsTest-576062334-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:62:82:5f,bridge_name='br-int',has_traffic_filtering=True,id=4e69c843-312f-47a8-8e75-4e857f6423d5,network=Network(74c4d111-4731-4d90-b6a9-a72b112d18ca),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4e69c843-31') {{(pid=74613) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 18:26:20 user nova-compute[74613]: DEBUG os_vif [None req-f13ac3a5-4322-4882-a82a-91aad574a119 tempest-VolumesActionsTest-576062334 tempest-VolumesActionsTest-576062334-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:62:82:5f,bridge_name='br-int',has_traffic_filtering=True,id=4e69c843-312f-47a8-8e75-4e857f6423d5,network=Network(74c4d111-4731-4d90-b6a9-a72b112d18ca),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4e69c843-31') {{(pid=74613) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 29 18:26:20 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:26:20 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap4e69c843-31, bridge=br-int, if_exists=True) {{(pid=74613) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 18:26:20 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:26:20 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 18:26:20 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:26:20 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=3590ba25-060a-4675-99c6-a6f2ea05123c) {{(pid=74613) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 18:26:20 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:26:20 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:26:20 user nova-compute[74613]: INFO os_vif [None req-f13ac3a5-4322-4882-a82a-91aad574a119 tempest-VolumesActionsTest-576062334 tempest-VolumesActionsTest-576062334-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:62:82:5f,bridge_name='br-int',has_traffic_filtering=True,id=4e69c843-312f-47a8-8e75-4e857f6423d5,network=Network(74c4d111-4731-4d90-b6a9-a72b112d18ca),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4e69c843-31')
Nov 29 18:26:20 user nova-compute[74613]: INFO nova.virt.libvirt.driver [None req-f13ac3a5-4322-4882-a82a-91aad574a119 tempest-VolumesActionsTest-576062334 tempest-VolumesActionsTest-576062334-project-member] [instance: 35c09e0b-55fa-42c4-a47a-707909e184f9] Deleting instance files /opt/stack/data/nova/instances/35c09e0b-55fa-42c4-a47a-707909e184f9_del
Nov 29 18:26:20 user nova-compute[74613]: INFO nova.virt.libvirt.driver [None req-f13ac3a5-4322-4882-a82a-91aad574a119 tempest-VolumesActionsTest-576062334 tempest-VolumesActionsTest-576062334-project-member] [instance: 35c09e0b-55fa-42c4-a47a-707909e184f9] Deletion of /opt/stack/data/nova/instances/35c09e0b-55fa-42c4-a47a-707909e184f9_del complete
Nov 29 18:26:20 user nova-compute[74613]: DEBUG os_brick.utils [None req-9da8898e-7f9f-4b1c-9727-54b9472e5028 tempest-SnapshotDataIntegrityTests-1810787156 tempest-SnapshotDataIntegrityTests-1810787156-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74613) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 18:26:20 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:26:20 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:26:20 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[6106bae6-1e13-430f-813e-67336e3d6d98]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:400972819b5\n', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 18:26:20 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:26:20 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:26:20 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[865a6dc5-9668-43cf-a412-7f557fa4e40b]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 18:26:20 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:26:20 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:26:20 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[70d72949-d564-4cdd-9cc7-95f27358cc20]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 18:26:20 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[58d62fcf-3528-4a98-9055-623f6c3facee]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 18:26:20 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-9da8898e-7f9f-4b1c-9727-54b9472e5028 tempest-SnapshotDataIntegrityTests-1810787156 tempest-SnapshotDataIntegrityTests-1810787156-project-member] Running cmd (subprocess): nvme version {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:26:20 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-9da8898e-7f9f-4b1c-9727-54b9472e5028 tempest-SnapshotDataIntegrityTests-1810787156 tempest-SnapshotDataIntegrityTests-1810787156-project-member] 'nvme version' failed. Not Retrying. {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 18:26:20 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.nvmeof [None req-9da8898e-7f9f-4b1c-9727-54b9472e5028 tempest-SnapshotDataIntegrityTests-1810787156 tempest-SnapshotDataIntegrityTests-1810787156-project-member] nvme not present on system {{(pid=74613) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 29 18:26:20 user nova-compute[74613]: INFO nova.compute.manager [None req-f13ac3a5-4322-4882-a82a-91aad574a119 tempest-VolumesActionsTest-576062334 tempest-VolumesActionsTest-576062334-project-member] [instance: 35c09e0b-55fa-42c4-a47a-707909e184f9] Took 0.79 seconds to destroy the instance on the hypervisor.
Nov 29 18:26:20 user nova-compute[74613]: DEBUG oslo.service.loopingcall [None req-f13ac3a5-4322-4882-a82a-91aad574a119 tempest-VolumesActionsTest-576062334 tempest-VolumesActionsTest-576062334-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74613) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 29 18:26:20 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:26:20 user nova-compute[74613]: DEBUG nova.compute.manager [-] [instance: 35c09e0b-55fa-42c4-a47a-707909e184f9] Deallocating network for instance {{(pid=74613) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 29 18:26:20 user nova-compute[74613]: DEBUG nova.network.neutron [-] [instance: 35c09e0b-55fa-42c4-a47a-707909e184f9] deallocate_for_instance() {{(pid=74613) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 29 18:26:20 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 18:26:20 user nova-compute[74613]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 29 18:26:20 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce5c5c0d-48ce-4c02-9ffc-0a87a8b79d1d]: (4, '') {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 18:26:20 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.lightos [None req-9da8898e-7f9f-4b1c-9727-54b9472e5028 tempest-SnapshotDataIntegrityTests-1810787156 tempest-SnapshotDataIntegrityTests-1810787156-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74613) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 29 18:26:20 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.lightos [None req-9da8898e-7f9f-4b1c-9727-54b9472e5028 tempest-SnapshotDataIntegrityTests-1810787156 tempest-SnapshotDataIntegrityTests-1810787156-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74613) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 29 18:26:20 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.lightos [None req-9da8898e-7f9f-4b1c-9727-54b9472e5028 tempest-SnapshotDataIntegrityTests-1810787156 tempest-SnapshotDataIntegrityTests-1810787156-project-member] LIGHTOS: no hostnqn found. {{(pid=74613) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 29 18:26:20 user nova-compute[74613]: DEBUG os_brick.utils [None req-9da8898e-7f9f-4b1c-9727-54b9472e5028 tempest-SnapshotDataIntegrityTests-1810787156 tempest-SnapshotDataIntegrityTests-1810787156-project-member] <== get_connector_properties: return (143ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:400972819b5', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74613) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 18:26:20 user nova-compute[74613]: DEBUG nova.virt.block_device [None req-9da8898e-7f9f-4b1c-9727-54b9472e5028 tempest-SnapshotDataIntegrityTests-1810787156 tempest-SnapshotDataIntegrityTests-1810787156-project-member] [instance: 5227902d-b2b9-40a6-988f-3c02c52404f3] Updating existing volume attachment record: cd9afa81-6050-49b8-9bb5-3baaaeec6716 {{(pid=74613) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 29 18:26:21 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:26:21 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:26:21 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:26:21 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:26:21 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:26:21 user nova-compute[74613]: DEBUG nova.network.neutron [-] [instance: 35c09e0b-55fa-42c4-a47a-707909e184f9] Updating instance_info_cache with network_info: [] {{(pid=74613) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 18:26:21 user nova-compute[74613]: INFO nova.compute.manager [-] [instance: 35c09e0b-55fa-42c4-a47a-707909e184f9] Took 0.92 seconds to deallocate network for instance.
Nov 29 18:26:21 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-f13ac3a5-4322-4882-a82a-91aad574a119 tempest-VolumesActionsTest-576062334 tempest-VolumesActionsTest-576062334-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 18:26:21 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-f13ac3a5-4322-4882-a82a-91aad574a119 tempest-VolumesActionsTest-576062334 tempest-VolumesActionsTest-576062334-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 18:26:21 user nova-compute[74613]: DEBUG nova.compute.provider_tree [None req-f13ac3a5-4322-4882-a82a-91aad574a119 tempest-VolumesActionsTest-576062334 tempest-VolumesActionsTest-576062334-project-member] Inventory has not changed in ProviderTree for provider: 639d980e-3b12-44b1-b8f4-1812416fa4dd {{(pid=74613) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 18:26:22 user nova-compute[74613]: DEBUG nova.scheduler.client.report [None req-f13ac3a5-4322-4882-a82a-91aad574a119 tempest-VolumesActionsTest-576062334 tempest-VolumesActionsTest-576062334-project-member] Inventory has not changed for provider 639d980e-3b12-44b1-b8f4-1812416fa4dd based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74613) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 18:26:22 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-f13ac3a5-4322-4882-a82a-91aad574a119 tempest-VolumesActionsTest-576062334 tempest-VolumesActionsTest-576062334-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.169s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 18:26:22 user nova-compute[74613]: INFO nova.scheduler.client.report [None req-f13ac3a5-4322-4882-a82a-91aad574a119 tempest-VolumesActionsTest-576062334 tempest-VolumesActionsTest-576062334-project-member] Deleted allocations for instance 35c09e0b-55fa-42c4-a47a-707909e184f9
Nov 29 18:26:22 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-f13ac3a5-4322-4882-a82a-91aad574a119 tempest-VolumesActionsTest-576062334 tempest-VolumesActionsTest-576062334-project-member] Lock "35c09e0b-55fa-42c4-a47a-707909e184f9" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.200s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 18:26:22 user nova-compute[74613]: DEBUG nova.compute.manager [req-08d390d6-95ba-4c49-9090-1da4f65deeb1 req-3d7370f6-ccb7-41f9-86f3-7d48b0857f1e service nova] [instance: 35c09e0b-55fa-42c4-a47a-707909e184f9] Received event network-vif-plugged-4e69c843-312f-47a8-8e75-4e857f6423d5 {{(pid=74613) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 18:26:22 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-08d390d6-95ba-4c49-9090-1da4f65deeb1 req-3d7370f6-ccb7-41f9-86f3-7d48b0857f1e service nova] Acquiring lock "35c09e0b-55fa-42c4-a47a-707909e184f9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 18:26:22 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-08d390d6-95ba-4c49-9090-1da4f65deeb1 req-3d7370f6-ccb7-41f9-86f3-7d48b0857f1e service nova] Lock "35c09e0b-55fa-42c4-a47a-707909e184f9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 18:26:22 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-08d390d6-95ba-4c49-9090-1da4f65deeb1 req-3d7370f6-ccb7-41f9-86f3-7d48b0857f1e service nova] Lock "35c09e0b-55fa-42c4-a47a-707909e184f9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 18:26:22 user nova-compute[74613]: DEBUG nova.compute.manager [req-08d390d6-95ba-4c49-9090-1da4f65deeb1 req-3d7370f6-ccb7-41f9-86f3-7d48b0857f1e service nova] [instance: 35c09e0b-55fa-42c4-a47a-707909e184f9] No waiting events found dispatching network-vif-plugged-4e69c843-312f-47a8-8e75-4e857f6423d5 {{(pid=74613) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 18:26:22 user nova-compute[74613]: WARNING nova.compute.manager [req-08d390d6-95ba-4c49-9090-1da4f65deeb1 req-3d7370f6-ccb7-41f9-86f3-7d48b0857f1e service nova] [instance: 35c09e0b-55fa-42c4-a47a-707909e184f9] Received unexpected event network-vif-plugged-4e69c843-312f-47a8-8e75-4e857f6423d5 for instance with vm_state deleted and task_state None.
Nov 29 18:26:22 user nova-compute[74613]: DEBUG nova.compute.manager [req-08d390d6-95ba-4c49-9090-1da4f65deeb1 req-3d7370f6-ccb7-41f9-86f3-7d48b0857f1e service nova] [instance: 35c09e0b-55fa-42c4-a47a-707909e184f9] Received event network-vif-plugged-4e69c843-312f-47a8-8e75-4e857f6423d5 {{(pid=74613) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 18:26:22 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-08d390d6-95ba-4c49-9090-1da4f65deeb1 req-3d7370f6-ccb7-41f9-86f3-7d48b0857f1e service nova] Acquiring lock "35c09e0b-55fa-42c4-a47a-707909e184f9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 18:26:22 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-08d390d6-95ba-4c49-9090-1da4f65deeb1 req-3d7370f6-ccb7-41f9-86f3-7d48b0857f1e service nova] Lock "35c09e0b-55fa-42c4-a47a-707909e184f9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 18:26:22 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-08d390d6-95ba-4c49-9090-1da4f65deeb1 req-3d7370f6-ccb7-41f9-86f3-7d48b0857f1e service nova] Lock "35c09e0b-55fa-42c4-a47a-707909e184f9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 18:26:22 user nova-compute[74613]: DEBUG nova.compute.manager [req-08d390d6-95ba-4c49-9090-1da4f65deeb1 req-3d7370f6-ccb7-41f9-86f3-7d48b0857f1e service nova] [instance: 35c09e0b-55fa-42c4-a47a-707909e184f9] No waiting events found dispatching network-vif-plugged-4e69c843-312f-47a8-8e75-4e857f6423d5 {{(pid=74613) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 18:26:22 user nova-compute[74613]: WARNING nova.compute.manager [req-08d390d6-95ba-4c49-9090-1da4f65deeb1 req-3d7370f6-ccb7-41f9-86f3-7d48b0857f1e service nova] [instance: 35c09e0b-55fa-42c4-a47a-707909e184f9] Received unexpected event network-vif-plugged-4e69c843-312f-47a8-8e75-4e857f6423d5 for instance with vm_state deleted and task_state None.
Nov 29 18:26:22 user nova-compute[74613]: DEBUG nova.compute.manager [req-08d390d6-95ba-4c49-9090-1da4f65deeb1 req-3d7370f6-ccb7-41f9-86f3-7d48b0857f1e service nova] [instance: 35c09e0b-55fa-42c4-a47a-707909e184f9] Received event network-vif-plugged-4e69c843-312f-47a8-8e75-4e857f6423d5 {{(pid=74613) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 18:26:22 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-08d390d6-95ba-4c49-9090-1da4f65deeb1 req-3d7370f6-ccb7-41f9-86f3-7d48b0857f1e service nova] Acquiring lock "35c09e0b-55fa-42c4-a47a-707909e184f9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 18:26:22 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-08d390d6-95ba-4c49-9090-1da4f65deeb1 req-3d7370f6-ccb7-41f9-86f3-7d48b0857f1e service nova] Lock "35c09e0b-55fa-42c4-a47a-707909e184f9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 18:26:22 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-08d390d6-95ba-4c49-9090-1da4f65deeb1 req-3d7370f6-ccb7-41f9-86f3-7d48b0857f1e service nova] Lock "35c09e0b-55fa-42c4-a47a-707909e184f9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 18:26:22 user nova-compute[74613]: DEBUG nova.compute.manager [req-08d390d6-95ba-4c49-9090-1da4f65deeb1 req-3d7370f6-ccb7-41f9-86f3-7d48b0857f1e service nova] [instance: 35c09e0b-55fa-42c4-a47a-707909e184f9] No waiting events found dispatching network-vif-plugged-4e69c843-312f-47a8-8e75-4e857f6423d5 {{(pid=74613) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 18:26:22 user nova-compute[74613]: WARNING nova.compute.manager [req-08d390d6-95ba-4c49-9090-1da4f65deeb1 req-3d7370f6-ccb7-41f9-86f3-7d48b0857f1e service nova] [instance: 35c09e0b-55fa-42c4-a47a-707909e184f9] Received unexpected event network-vif-plugged-4e69c843-312f-47a8-8e75-4e857f6423d5 for instance with vm_state deleted and task_state None.
Nov 29 18:26:22 user nova-compute[74613]: DEBUG nova.compute.manager [req-08d390d6-95ba-4c49-9090-1da4f65deeb1 req-3d7370f6-ccb7-41f9-86f3-7d48b0857f1e service nova] [instance: 35c09e0b-55fa-42c4-a47a-707909e184f9] Received event network-vif-unplugged-4e69c843-312f-47a8-8e75-4e857f6423d5 {{(pid=74613) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 18:26:22 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-08d390d6-95ba-4c49-9090-1da4f65deeb1 req-3d7370f6-ccb7-41f9-86f3-7d48b0857f1e service nova] Acquiring lock "35c09e0b-55fa-42c4-a47a-707909e184f9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 18:26:22 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-08d390d6-95ba-4c49-9090-1da4f65deeb1 req-3d7370f6-ccb7-41f9-86f3-7d48b0857f1e service nova] Lock "35c09e0b-55fa-42c4-a47a-707909e184f9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 18:26:22 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-08d390d6-95ba-4c49-9090-1da4f65deeb1 req-3d7370f6-ccb7-41f9-86f3-7d48b0857f1e service nova] Lock "35c09e0b-55fa-42c4-a47a-707909e184f9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 18:26:22 user nova-compute[74613]: DEBUG nova.compute.manager [req-08d390d6-95ba-4c49-9090-1da4f65deeb1 req-3d7370f6-ccb7-41f9-86f3-7d48b0857f1e service nova] [instance: 35c09e0b-55fa-42c4-a47a-707909e184f9] No waiting events found dispatching network-vif-unplugged-4e69c843-312f-47a8-8e75-4e857f6423d5 {{(pid=74613) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 18:26:22 user nova-compute[74613]: WARNING nova.compute.manager [req-08d390d6-95ba-4c49-9090-1da4f65deeb1 req-3d7370f6-ccb7-41f9-86f3-7d48b0857f1e service nova] [instance: 35c09e0b-55fa-42c4-a47a-707909e184f9] Received unexpected event network-vif-unplugged-4e69c843-312f-47a8-8e75-4e857f6423d5 for instance with vm_state deleted and task_state None.
Nov 29 18:26:22 user nova-compute[74613]: DEBUG nova.compute.manager [req-08d390d6-95ba-4c49-9090-1da4f65deeb1 req-3d7370f6-ccb7-41f9-86f3-7d48b0857f1e service nova] [instance: 35c09e0b-55fa-42c4-a47a-707909e184f9] Received event network-vif-plugged-4e69c843-312f-47a8-8e75-4e857f6423d5 {{(pid=74613) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 18:26:22 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-08d390d6-95ba-4c49-9090-1da4f65deeb1 req-3d7370f6-ccb7-41f9-86f3-7d48b0857f1e service nova] Acquiring lock "35c09e0b-55fa-42c4-a47a-707909e184f9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 18:26:22 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-08d390d6-95ba-4c49-9090-1da4f65deeb1 req-3d7370f6-ccb7-41f9-86f3-7d48b0857f1e service nova] Lock "35c09e0b-55fa-42c4-a47a-707909e184f9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 18:26:22 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-08d390d6-95ba-4c49-9090-1da4f65deeb1 req-3d7370f6-ccb7-41f9-86f3-7d48b0857f1e service nova] Lock "35c09e0b-55fa-42c4-a47a-707909e184f9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 18:26:22 user nova-compute[74613]: DEBUG nova.compute.manager [req-08d390d6-95ba-4c49-9090-1da4f65deeb1 req-3d7370f6-ccb7-41f9-86f3-7d48b0857f1e service nova] [instance: 35c09e0b-55fa-42c4-a47a-707909e184f9] No waiting events found dispatching network-vif-plugged-4e69c843-312f-47a8-8e75-4e857f6423d5 {{(pid=74613) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 18:26:22 user nova-compute[74613]: WARNING nova.compute.manager [req-08d390d6-95ba-4c49-9090-1da4f65deeb1 req-3d7370f6-ccb7-41f9-86f3-7d48b0857f1e service nova] [instance: 35c09e0b-55fa-42c4-a47a-707909e184f9] Received unexpected event network-vif-plugged-4e69c843-312f-47a8-8e75-4e857f6423d5 for instance with vm_state deleted and task_state None.
Nov 29 18:26:22 user nova-compute[74613]: DEBUG nova.compute.manager [req-08d390d6-95ba-4c49-9090-1da4f65deeb1 req-3d7370f6-ccb7-41f9-86f3-7d48b0857f1e service nova] [instance: 35c09e0b-55fa-42c4-a47a-707909e184f9] Received event network-vif-deleted-4e69c843-312f-47a8-8e75-4e857f6423d5 {{(pid=74613) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 18:26:25 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:26:28 user nova-compute[74613]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9da8898e-7f9f-4b1c-9727-54b9472e5028 tempest-SnapshotDataIntegrityTests-1810787156 tempest-SnapshotDataIntegrityTests-1810787156-project-member] [instance: 5227902d-b2b9-40a6-988f-3c02c52404f3] Calling os-brick to attach iSCSI Volume {{(pid=74613) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 29 18:26:28 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-9da8898e-7f9f-4b1c-9727-54b9472e5028 tempest-SnapshotDataIntegrityTests-1810787156 tempest-SnapshotDataIntegrityTests-1810787156-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff828156890>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:e7ab2332-2ab0-4213-a15f-478d9f612aff', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xRvicyuz', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74613) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 18:26:28 user nova-compute[74613]: WARNING os_brick.initiator.connectors.base [None req-9da8898e-7f9f-4b1c-9727-54b9472e5028 tempest-SnapshotDataIntegrityTests-1810787156 tempest-SnapshotDataIntegrityTests-1810787156-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 18:26:28 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.base [None req-9da8898e-7f9f-4b1c-9727-54b9472e5028 tempest-SnapshotDataIntegrityTests-1810787156 tempest-SnapshotDataIntegrityTests-1810787156-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 18:26:28 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.base [None req-9da8898e-7f9f-4b1c-9727-54b9472e5028 tempest-SnapshotDataIntegrityTests-1810787156 tempest-SnapshotDataIntegrityTests-1810787156-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 18:26:28 user nova-compute[74613]: WARNING os_brick.initiator.connectors.base [None req-9da8898e-7f9f-4b1c-9727-54b9472e5028 tempest-SnapshotDataIntegrityTests-1810787156 tempest-SnapshotDataIntegrityTests-1810787156-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 18:26:28 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.base [None req-9da8898e-7f9f-4b1c-9727-54b9472e5028 tempest-SnapshotDataIntegrityTests-1810787156 tempest-SnapshotDataIntegrityTests-1810787156-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e7ab2332-2ab0-4213-a15f-478d9f612aff" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 18:26:28 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.base [None req-9da8898e-7f9f-4b1c-9727-54b9472e5028 tempest-SnapshotDataIntegrityTests-1810787156 tempest-SnapshotDataIntegrityTests-1810787156-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e7ab2332-2ab0-4213-a15f-478d9f612aff" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 18:26:28 user nova-compute[74613]: INFO os_brick.initiator.connectors.iscsi [None req-9da8898e-7f9f-4b1c-9727-54b9472e5028 tempest-SnapshotDataIntegrityTests-1810787156 tempest-SnapshotDataIntegrityTests-1810787156-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 29 18:26:28 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e7ab2332-2ab0-4213-a15f-478d9f612aff -p 172.16.0.220:3260 {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:26:28 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e7ab2332-2ab0-4213-a15f-478d9f612aff -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:26:28 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf1785f7-21ad-46a9-82c2-05ee7e546c8c]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 18:26:28 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-9da8898e-7f9f-4b1c-9727-54b9472e5028 tempest-SnapshotDataIntegrityTests-1810787156 tempest-SnapshotDataIntegrityTests-1810787156-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 29 18:26:28 user nova-compute[74613]:  {{(pid=74613) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 18:26:28 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e7ab2332-2ab0-4213-a15f-478d9f612aff -p 172.16.0.220:3260 --interface default --op new {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:26:28 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e7ab2332-2ab0-4213-a15f-478d9f612aff -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:26:28 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[089a2d70-0018-407f-a575-41424d292898]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e7ab2332-2ab0-4213-a15f-478d9f612aff] added\n', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 18:26:28 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-9da8898e-7f9f-4b1c-9727-54b9472e5028 tempest-SnapshotDataIntegrityTests-1810787156 tempest-SnapshotDataIntegrityTests-1810787156-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e7ab2332-2ab0-4213-a15f-478d9f612aff] added
Nov 29 18:26:28 user nova-compute[74613]:  stderr= {{(pid=74613) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 18:26:28 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e7ab2332-2ab0-4213-a15f-478d9f612aff -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:26:28 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e7ab2332-2ab0-4213-a15f-478d9f612aff -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:26:28 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ed03c91-3476-4d0c-9c07-061129678fc5]: (4, ('', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 18:26:28 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-9da8898e-7f9f-4b1c-9727-54b9472e5028 tempest-SnapshotDataIntegrityTests-1810787156 tempest-SnapshotDataIntegrityTests-1810787156-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74613) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 18:26:28 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e7ab2332-2ab0-4213-a15f-478d9f612aff -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:26:28 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e7ab2332-2ab0-4213-a15f-478d9f612aff -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.153s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:26:28 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[30f7c397-1c97-432e-8fd0-6b655488e029]: (4, ('', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 18:26:28 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-9da8898e-7f9f-4b1c-9727-54b9472e5028 tempest-SnapshotDataIntegrityTests-1810787156 tempest-SnapshotDataIntegrityTests-1810787156-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74613) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 18:26:28 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e7ab2332-2ab0-4213-a15f-478d9f612aff -p 172.16.0.220:3260 --op update -n node.session.auth.username -v xRvicyuz {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:26:28 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e7ab2332-2ab0-4213-a15f-478d9f612aff -p 172.16.0.220:3260 --op update -n node.session.auth.username -v xRvicyuz" returned: 0 in 0.019s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:26:28 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ded1a89-dac6-4ff4-b09f-70c1602c7a7e]: (4, ('', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 18:26:28 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-9da8898e-7f9f-4b1c-9727-54b9472e5028 tempest-SnapshotDataIntegrityTests-1810787156 tempest-SnapshotDataIntegrityTests-1810787156-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'xRvicyuz'): stdout= stderr= {{(pid=74613) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 18:26:28 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e7ab2332-2ab0-4213-a15f-478d9f612aff -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:26:28 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e7ab2332-2ab0-4213-a15f-478d9f612aff -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:26:28 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1a50ec8-6def-4d3c-8411-d31263ffbeb0]: (4, ('', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 18:26:28 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-9da8898e-7f9f-4b1c-9727-54b9472e5028 tempest-SnapshotDataIntegrityTests-1810787156 tempest-SnapshotDataIntegrityTests-1810787156-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74613) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 18:26:28 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:26:28 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.017s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:26:28 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9a017db-e8d9-4e68-a770-d2499567b111]: (4, ('tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f39cfde-47c7-4b9f-83d3-13c147be6792 (non-flash)\n', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 18:26:28 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-9da8898e-7f9f-4b1c-9727-54b9472e5028 tempest-SnapshotDataIntegrityTests-1810787156 tempest-SnapshotDataIntegrityTests-1810787156-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f39cfde-47c7-4b9f-83d3-13c147be6792 (non-flash)
Nov 29 18:26:28 user nova-compute[74613]:  stderr= {{(pid=74613) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 18:26:28 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-9da8898e-7f9f-4b1c-9727-54b9472e5028 tempest-SnapshotDataIntegrityTests-1810787156 tempest-SnapshotDataIntegrityTests-1810787156-project-member] iscsi session list stdout=tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f39cfde-47c7-4b9f-83d3-13c147be6792 (non-flash)
Nov 29 18:26:28 user nova-compute[74613]:  stderr= {{(pid=74613) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 18:26:28 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e7ab2332-2ab0-4213-a15f-478d9f612aff -p 172.16.0.220:3260 --login {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:26:28 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e7ab2332-2ab0-4213-a15f-478d9f612aff -p 172.16.0.220:3260 --login" returned: 0 in 0.047s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:26:28 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[c477a287-fdbb-4e22-b34d-1a192c04e51d]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:e7ab2332-2ab0-4213-a15f-478d9f612aff, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:e7ab2332-2ab0-4213-a15f-478d9f612aff, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 18:26:28 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-9da8898e-7f9f-4b1c-9727-54b9472e5028 tempest-SnapshotDataIntegrityTests-1810787156 tempest-SnapshotDataIntegrityTests-1810787156-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:e7ab2332-2ab0-4213-a15f-478d9f612aff, portal: 172.16.0.220,3260]
Nov 29 18:26:28 user nova-compute[74613]: Login to [iface: default, target: iqn.2010-10.org.openstack:e7ab2332-2ab0-4213-a15f-478d9f612aff, portal: 172.16.0.220,3260] successful.
Nov 29 18:26:28 user nova-compute[74613]:  stderr= {{(pid=74613) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 18:26:28 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e7ab2332-2ab0-4213-a15f-478d9f612aff -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:26:28 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e7ab2332-2ab0-4213-a15f-478d9f612aff -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.017s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:26:28 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[09b095c2-2c39-41e5-9e23-674534a6a277]: (4, ('', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 18:26:28 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-9da8898e-7f9f-4b1c-9727-54b9472e5028 tempest-SnapshotDataIntegrityTests-1810787156 tempest-SnapshotDataIntegrityTests-1810787156-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74613) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 18:26:28 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:26:28 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:26:28 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b96a258-b730-4004-9de2-c5ea7bb01621]: (4, ('tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f39cfde-47c7-4b9f-83d3-13c147be6792 (non-flash)\ntcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e7ab2332-2ab0-4213-a15f-478d9f612aff (non-flash)\n', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 18:26:28 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-9da8898e-7f9f-4b1c-9727-54b9472e5028 tempest-SnapshotDataIntegrityTests-1810787156 tempest-SnapshotDataIntegrityTests-1810787156-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f39cfde-47c7-4b9f-83d3-13c147be6792 (non-flash)
Nov 29 18:26:28 user nova-compute[74613]: tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e7ab2332-2ab0-4213-a15f-478d9f612aff (non-flash)
Nov 29 18:26:28 user nova-compute[74613]:  stderr= {{(pid=74613) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 18:26:28 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-9da8898e-7f9f-4b1c-9727-54b9472e5028 tempest-SnapshotDataIntegrityTests-1810787156 tempest-SnapshotDataIntegrityTests-1810787156-project-member] iscsi session list stdout=tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f39cfde-47c7-4b9f-83d3-13c147be6792 (non-flash)
Nov 29 18:26:28 user nova-compute[74613]: tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e7ab2332-2ab0-4213-a15f-478d9f612aff (non-flash)
Nov 29 18:26:28 user nova-compute[74613]:  stderr= {{(pid=74613) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 18:26:28 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.base [None req-9da8898e-7f9f-4b1c-9727-54b9472e5028 tempest-SnapshotDataIntegrityTests-1810787156 tempest-SnapshotDataIntegrityTests-1810787156-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e7ab2332-2ab0-4213-a15f-478d9f612aff" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.382s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 18:26:28 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-9da8898e-7f9f-4b1c-9727-54b9472e5028 tempest-SnapshotDataIntegrityTests-1810787156 tempest-SnapshotDataIntegrityTests-1810787156-project-member] Connected to 172.16.0.220:3260 {{(pid=74613) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 29 18:26:28 user nova-compute[74613]: DEBUG os_brick.initiator.linuxscsi [None req-9da8898e-7f9f-4b1c-9727-54b9472e5028 tempest-SnapshotDataIntegrityTests-1810787156 tempest-SnapshotDataIntegrityTests-1810787156-project-member] HCTL ('33', '-', '-', 0) found on session 55 with lun 0 {{(pid=74613) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 29 18:26:28 user nova-compute[74613]: DEBUG os_brick.initiator.linuxscsi [None req-9da8898e-7f9f-4b1c-9727-54b9472e5028 tempest-SnapshotDataIntegrityTests-1810787156 tempest-SnapshotDataIntegrityTests-1810787156-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74613) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 29 18:26:28 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:26:28 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.016s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:26:28 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[f40112e7-49c4-4d1c-8c16-d9a2ec676ebd]: (4, ('- - 0', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 18:26:28 user nova-compute[74613]: DEBUG os_brick.initiator.linuxscsi [None req-9da8898e-7f9f-4b1c-9727-54b9472e5028 tempest-SnapshotDataIntegrityTests-1810787156 tempest-SnapshotDataIntegrityTests-1810787156-project-member] Searching for a device in session 55 and hctl ['33', '*', '*', 0] yield: None {{(pid=74613) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 29 18:26:29 user nova-compute[74613]: DEBUG os_brick.initiator.linuxscsi [None req-9da8898e-7f9f-4b1c-9727-54b9472e5028 tempest-SnapshotDataIntegrityTests-1810787156 tempest-SnapshotDataIntegrityTests-1810787156-project-member] Searching for a device in session 55 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74613) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 29 18:26:29 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-9da8898e-7f9f-4b1c-9727-54b9472e5028 tempest-SnapshotDataIntegrityTests-1810787156 tempest-SnapshotDataIntegrityTests-1810787156-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:e7ab2332-2ab0-4213-a15f-478d9f612aff', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xRvicyuz', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74613) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 29 18:26:29 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.base [None req-9da8898e-7f9f-4b1c-9727-54b9472e5028 tempest-SnapshotDataIntegrityTests-1810787156 tempest-SnapshotDataIntegrityTests-1810787156-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.412s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 18:26:29 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-9da8898e-7f9f-4b1c-9727-54b9472e5028 tempest-SnapshotDataIntegrityTests-1810787156 tempest-SnapshotDataIntegrityTests-1810787156-project-member] <== connect_volume: return (1413ms) {'type': 'block', 'scsi_wwn': '26239633032613633', 'path': '/dev/sdb'} {{(pid=74613) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 18:26:29 user nova-compute[74613]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9da8898e-7f9f-4b1c-9727-54b9472e5028 tempest-SnapshotDataIntegrityTests-1810787156 tempest-SnapshotDataIntegrityTests-1810787156-project-member] [instance: 5227902d-b2b9-40a6-988f-3c02c52404f3] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26239633032613633', 'path': '/dev/sdb'} {{(pid=74613) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 29 18:26:29 user nova-compute[74613]: DEBUG nova.objects.instance [None req-9da8898e-7f9f-4b1c-9727-54b9472e5028 tempest-SnapshotDataIntegrityTests-1810787156 tempest-SnapshotDataIntegrityTests-1810787156-project-member] Lazy-loading 'flavor' on Instance uuid 5227902d-b2b9-40a6-988f-3c02c52404f3 {{(pid=74613) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 18:26:29 user nova-compute[74613]: DEBUG nova.virt.libvirt.guest [None req-9da8898e-7f9f-4b1c-9727-54b9472e5028 tempest-SnapshotDataIntegrityTests-1810787156 tempest-SnapshotDataIntegrityTests-1810787156-project-member] attach device xml: <disk type="block" device="disk">
Nov 29 18:26:29 user nova-compute[74613]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 18:26:29 user nova-compute[74613]:   <source dev="/dev/sdb"/>
Nov 29 18:26:29 user nova-compute[74613]:   <target dev="vdb" bus="virtio"/>
Nov 29 18:26:29 user nova-compute[74613]:   <serial>e7ab2332-2ab0-4213-a15f-478d9f612aff</serial>
Nov 29 18:26:29 user nova-compute[74613]: </disk>
Nov 29 18:26:29 user nova-compute[74613]:  {{(pid=74613) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 29 18:26:30 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-9da8898e-7f9f-4b1c-9727-54b9472e5028 tempest-SnapshotDataIntegrityTests-1810787156 tempest-SnapshotDataIntegrityTests-1810787156-project-member] No BDM found with device name vda, not building metadata. {{(pid=74613) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 18:26:30 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-9da8898e-7f9f-4b1c-9727-54b9472e5028 tempest-SnapshotDataIntegrityTests-1810787156 tempest-SnapshotDataIntegrityTests-1810787156-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74613) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 18:26:30 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-9da8898e-7f9f-4b1c-9727-54b9472e5028 tempest-SnapshotDataIntegrityTests-1810787156 tempest-SnapshotDataIntegrityTests-1810787156-project-member] No VIF found with MAC fa:16:3e:40:72:ca, not building metadata {{(pid=74613) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 29 18:26:30 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-9da8898e-7f9f-4b1c-9727-54b9472e5028 tempest-SnapshotDataIntegrityTests-1810787156 tempest-SnapshotDataIntegrityTests-1810787156-project-member] Lock "5227902d-b2b9-40a6-988f-3c02c52404f3" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 9.500s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 18:26:30 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:26:31 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:26:31 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-10f3069f-c0b2-48d3-8920-f47b238abe5d tempest-SnapshotDataIntegrityTests-1810787156 tempest-SnapshotDataIntegrityTests-1810787156-project-member] Acquiring lock "5227902d-b2b9-40a6-988f-3c02c52404f3" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 18:26:31 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-10f3069f-c0b2-48d3-8920-f47b238abe5d tempest-SnapshotDataIntegrityTests-1810787156 tempest-SnapshotDataIntegrityTests-1810787156-project-member] Lock "5227902d-b2b9-40a6-988f-3c02c52404f3" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 18:26:32 user nova-compute[74613]: INFO nova.compute.manager [None req-10f3069f-c0b2-48d3-8920-f47b238abe5d tempest-SnapshotDataIntegrityTests-1810787156 tempest-SnapshotDataIntegrityTests-1810787156-project-member] [instance: 5227902d-b2b9-40a6-988f-3c02c52404f3] Detaching volume e7ab2332-2ab0-4213-a15f-478d9f612aff
Nov 29 18:26:32 user nova-compute[74613]: INFO nova.virt.block_device [None req-10f3069f-c0b2-48d3-8920-f47b238abe5d tempest-SnapshotDataIntegrityTests-1810787156 tempest-SnapshotDataIntegrityTests-1810787156-project-member] [instance: 5227902d-b2b9-40a6-988f-3c02c52404f3] Attempting to driver detach volume e7ab2332-2ab0-4213-a15f-478d9f612aff from mountpoint /dev/vdb
Nov 29 18:26:32 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-10f3069f-c0b2-48d3-8920-f47b238abe5d tempest-SnapshotDataIntegrityTests-1810787156 tempest-SnapshotDataIntegrityTests-1810787156-project-member] Attempting to detach device vdb from instance 5227902d-b2b9-40a6-988f-3c02c52404f3 from the persistent domain config. {{(pid=74613) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 29 18:26:32 user nova-compute[74613]: DEBUG nova.virt.libvirt.guest [None req-10f3069f-c0b2-48d3-8920-f47b238abe5d tempest-SnapshotDataIntegrityTests-1810787156 tempest-SnapshotDataIntegrityTests-1810787156-project-member] detach device xml: <disk type="block" device="disk">
Nov 29 18:26:32 user nova-compute[74613]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 18:26:32 user nova-compute[74613]:   <source dev="/dev/sdb"/>
Nov 29 18:26:32 user nova-compute[74613]:   <target dev="vdb" bus="virtio"/>
Nov 29 18:26:32 user nova-compute[74613]:   <serial>e7ab2332-2ab0-4213-a15f-478d9f612aff</serial>
Nov 29 18:26:32 user nova-compute[74613]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 29 18:26:32 user nova-compute[74613]: </disk>
Nov 29 18:26:32 user nova-compute[74613]:  {{(pid=74613) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 29 18:26:32 user nova-compute[74613]: INFO nova.virt.libvirt.driver [None req-10f3069f-c0b2-48d3-8920-f47b238abe5d tempest-SnapshotDataIntegrityTests-1810787156 tempest-SnapshotDataIntegrityTests-1810787156-project-member] Successfully detached device vdb from instance 5227902d-b2b9-40a6-988f-3c02c52404f3 from the persistent domain config.
Nov 29 18:26:32 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-10f3069f-c0b2-48d3-8920-f47b238abe5d tempest-SnapshotDataIntegrityTests-1810787156 tempest-SnapshotDataIntegrityTests-1810787156-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 5227902d-b2b9-40a6-988f-3c02c52404f3 from the live domain config. {{(pid=74613) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 29 18:26:32 user nova-compute[74613]: DEBUG nova.virt.libvirt.guest [None req-10f3069f-c0b2-48d3-8920-f47b238abe5d tempest-SnapshotDataIntegrityTests-1810787156 tempest-SnapshotDataIntegrityTests-1810787156-project-member] detach device xml: <disk type="block" device="disk">
Nov 29 18:26:32 user nova-compute[74613]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 18:26:32 user nova-compute[74613]:   <source dev="/dev/sdb"/>
Nov 29 18:26:32 user nova-compute[74613]:   <target dev="vdb" bus="virtio"/>
Nov 29 18:26:32 user nova-compute[74613]:   <serial>e7ab2332-2ab0-4213-a15f-478d9f612aff</serial>
Nov 29 18:26:32 user nova-compute[74613]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 29 18:26:32 user nova-compute[74613]: </disk>
Nov 29 18:26:32 user nova-compute[74613]:  {{(pid=74613) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 29 18:26:32 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-10f3069f-c0b2-48d3-8920-f47b238abe5d tempest-SnapshotDataIntegrityTests-1810787156 tempest-SnapshotDataIntegrityTests-1810787156-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 5227902d-b2b9-40a6-988f-3c02c52404f3 {{(pid=74613) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 29 18:26:35 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:26:36 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:26:40 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:26:43 user nova-compute[74613]: DEBUG oslo_service.periodic_task [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74613) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 18:26:44 user nova-compute[74613]: DEBUG oslo_service.periodic_task [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74613) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 18:26:45 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 18:26:45 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:26:45 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74613) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 29 18:26:45 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74613) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 18:26:45 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74613) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 18:26:45 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:26:47 user nova-compute[74613]: DEBUG oslo_service.periodic_task [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74613) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 18:26:48 user nova-compute[74613]: DEBUG oslo_service.periodic_task [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74613) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 18:26:48 user nova-compute[74613]: DEBUG nova.compute.manager [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Starting heal instance info cache {{(pid=74613) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 29 18:26:48 user nova-compute[74613]: DEBUG nova.compute.manager [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Rebuilding the list of instances to heal {{(pid=74613) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 29 18:26:48 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Acquiring lock "refresh_cache-5227902d-b2b9-40a6-988f-3c02c52404f3" {{(pid=74613) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 18:26:48 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Acquired lock "refresh_cache-5227902d-b2b9-40a6-988f-3c02c52404f3" {{(pid=74613) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 18:26:48 user nova-compute[74613]: DEBUG nova.network.neutron [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] [instance: 5227902d-b2b9-40a6-988f-3c02c52404f3] Forcefully refreshing network info cache for instance {{(pid=74613) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 29 18:26:48 user nova-compute[74613]: DEBUG nova.objects.instance [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Lazy-loading 'info_cache' on Instance uuid 5227902d-b2b9-40a6-988f-3c02c52404f3 {{(pid=74613) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 18:26:49 user nova-compute[74613]: DEBUG nova.network.neutron [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] [instance: 5227902d-b2b9-40a6-988f-3c02c52404f3] Updating instance_info_cache with network_info: [{"id": "11900168-d650-4db6-8f65-21f1f9c4b603", "address": "fa:16:3e:40:72:ca", "network": {"id": "8951bb42-2dd0-4887-b0d1-fdb8d3ac7589", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1016730518-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.120", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "31a87cb1f6e14287abcfae98de155491", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap11900168-d6", "ovs_interfaceid": "11900168-d650-4db6-8f65-21f1f9c4b603", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74613) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 18:26:49 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Releasing lock "refresh_cache-5227902d-b2b9-40a6-988f-3c02c52404f3" {{(pid=74613) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 18:26:49 user nova-compute[74613]: DEBUG nova.compute.manager [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] [instance: 5227902d-b2b9-40a6-988f-3c02c52404f3] Updated the network info_cache for instance {{(pid=74613) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 29 18:26:49 user nova-compute[74613]: DEBUG oslo_service.periodic_task [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74613) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 18:26:49 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 18:26:49 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 18:26:49 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 18:26:49 user nova-compute[74613]: DEBUG nova.compute.resource_tracker [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Auditing locally available compute resources for user (node: user) {{(pid=74613) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 29 18:26:49 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5227902d-b2b9-40a6-988f-3c02c52404f3/disk --force-share --output=json {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:26:49 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5227902d-b2b9-40a6-988f-3c02c52404f3/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:26:49 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5227902d-b2b9-40a6-988f-3c02c52404f3/disk --force-share --output=json {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:26:49 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5227902d-b2b9-40a6-988f-3c02c52404f3/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:26:49 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=74613) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 29 18:26:50 user nova-compute[74613]: WARNING nova.virt.libvirt.driver [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 18:26:50 user nova-compute[74613]: WARNING nova.virt.libvirt.driver [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 18:26:50 user nova-compute[74613]: DEBUG nova.compute.resource_tracker [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Hypervisor/Node resource view: name=user free_ram=8763MB free_disk=24.9105224609375GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74613) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 29 18:26:50 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 18:26:50 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 18:26:50 user nova-compute[74613]: DEBUG nova.compute.resource_tracker [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Instance 5227902d-b2b9-40a6-988f-3c02c52404f3 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74613) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 18:26:50 user nova-compute[74613]: DEBUG nova.compute.resource_tracker [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Instance 059e3f87-a811-4ac7-b846-2f6d202a919f actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74613) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 18:26:50 user nova-compute[74613]: DEBUG nova.compute.resource_tracker [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=74613) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 29 18:26:50 user nova-compute[74613]: DEBUG nova.compute.resource_tracker [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=74613) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 29 18:26:50 user nova-compute[74613]: DEBUG nova.compute.provider_tree [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Inventory has not changed in ProviderTree for provider: 639d980e-3b12-44b1-b8f4-1812416fa4dd {{(pid=74613) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 18:26:50 user nova-compute[74613]: DEBUG nova.scheduler.client.report [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Inventory has not changed for provider 639d980e-3b12-44b1-b8f4-1812416fa4dd based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74613) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 18:26:50 user nova-compute[74613]: DEBUG nova.compute.resource_tracker [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Compute_service record updated for user:user {{(pid=74613) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 29 18:26:50 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.252s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 18:26:50 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 18:26:52 user nova-compute[74613]: WARNING nova.virt.libvirt.driver [None req-10f3069f-c0b2-48d3-8920-f47b238abe5d tempest-SnapshotDataIntegrityTests-1810787156 tempest-SnapshotDataIntegrityTests-1810787156-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 5227902d-b2b9-40a6-988f-3c02c52404f3 is timed out.
Nov 29 18:26:52 user nova-compute[74613]: INFO nova.virt.libvirt.driver [None req-10f3069f-c0b2-48d3-8920-f47b238abe5d tempest-SnapshotDataIntegrityTests-1810787156 tempest-SnapshotDataIntegrityTests-1810787156-project-member] Successfully detached device vdb from instance 5227902d-b2b9-40a6-988f-3c02c52404f3 from the live domain config.
Nov 29 18:26:52 user nova-compute[74613]: DEBUG nova.virt.libvirt.volume.iscsi [None req-10f3069f-c0b2-48d3-8920-f47b238abe5d tempest-SnapshotDataIntegrityTests-1810787156 tempest-SnapshotDataIntegrityTests-1810787156-project-member] [instance: 5227902d-b2b9-40a6-988f-3c02c52404f3] calling os-brick to detach iSCSI Volume {{(pid=74613) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 29 18:26:52 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-10f3069f-c0b2-48d3-8920-f47b238abe5d tempest-SnapshotDataIntegrityTests-1810787156 tempest-SnapshotDataIntegrityTests-1810787156-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff828156890>, {'target_iqn': 'iqn.2010-10.org.openstack:e7ab2332-2ab0-4213-a15f-478d9f612aff', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xRvicyuz', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=74613) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 18:26:52 user nova-compute[74613]: WARNING os_brick.initiator.connectors.base [None req-10f3069f-c0b2-48d3-8920-f47b238abe5d tempest-SnapshotDataIntegrityTests-1810787156 tempest-SnapshotDataIntegrityTests-1810787156-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 18:26:52 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.base [None req-10f3069f-c0b2-48d3-8920-f47b238abe5d tempest-SnapshotDataIntegrityTests-1810787156 tempest-SnapshotDataIntegrityTests-1810787156-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 18:26:52 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.base [None req-10f3069f-c0b2-48d3-8920-f47b238abe5d tempest-SnapshotDataIntegrityTests-1810787156 tempest-SnapshotDataIntegrityTests-1810787156-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 18:26:52 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:26:52 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:26:52 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[de604411-a91f-4cbd-87a4-3c90ffef61a2]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:6f39cfde-47c7-4b9f-83d3-13c147be6792\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e7ab2332-2ab0-4213-a15f-478d9f612aff\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 18:26:52 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-10f3069f-c0b2-48d3-8920-f47b238abe5d tempest-SnapshotDataIntegrityTests-1810787156 tempest-SnapshotDataIntegrityTests-1810787156-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 29 18:26:52 user nova-compute[74613]: No targets found.
Nov 29 18:26:52 user nova-compute[74613]: iSNS:
Nov 29 18:26:52 user nova-compute[74613]: No targets found.
Nov 29 18:26:52 user nova-compute[74613]: STATIC:
Nov 29 18:26:52 user nova-compute[74613]: Target: iqn.2010-10.org.openstack:6f39cfde-47c7-4b9f-83d3-13c147be6792
Nov 29 18:26:52 user nova-compute[74613]:         Portal: 172.16.0.220:3260,-1
Nov 29 18:26:52 user nova-compute[74613]:                 Iface Name: default
Nov 29 18:26:52 user nova-compute[74613]: Target: iqn.2010-10.org.openstack:e7ab2332-2ab0-4213-a15f-478d9f612aff
Nov 29 18:26:52 user nova-compute[74613]:         Portal: 172.16.0.220:3260,-1
Nov 29 18:26:52 user nova-compute[74613]:                 Iface Name: default
Nov 29 18:26:52 user nova-compute[74613]: FIRMWARE:
Nov 29 18:26:52 user nova-compute[74613]: No targets found.
Nov 29 18:26:52 user nova-compute[74613]:  stderr= {{(pid=74613) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 18:26:52 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-10f3069f-c0b2-48d3-8920-f47b238abe5d tempest-SnapshotDataIntegrityTests-1810787156 tempest-SnapshotDataIntegrityTests-1810787156-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 29 18:26:52 user nova-compute[74613]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 29 18:26:52 user nova-compute[74613]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74613) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 29 18:26:52 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-10f3069f-c0b2-48d3-8920-f47b238abe5d tempest-SnapshotDataIntegrityTests-1810787156 tempest-SnapshotDataIntegrityTests-1810787156-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e7ab2332-2ab0-4213-a15f-478d9f612aff', 0)] {{(pid=74613) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 29 18:26:52 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:26:52 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.016s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:26:52 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[b713f103-299f-4e41-a077-f8b5cf164b35]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6f39cfde-47c7-4b9f-83d3-13c147be6792\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e7ab2332-2ab0-4213-a15f-478d9f612aff\n', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 18:26:52 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:26:52 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:26:52 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[81ec5db6-9284-4a3f-b47a-96a586a333e3]: (4, ('tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f39cfde-47c7-4b9f-83d3-13c147be6792 (non-flash)\ntcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e7ab2332-2ab0-4213-a15f-478d9f612aff (non-flash)\n', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 18:26:52 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-10f3069f-c0b2-48d3-8920-f47b238abe5d tempest-SnapshotDataIntegrityTests-1810787156 tempest-SnapshotDataIntegrityTests-1810787156-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f39cfde-47c7-4b9f-83d3-13c147be6792 (non-flash)
Nov 29 18:26:52 user nova-compute[74613]: tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e7ab2332-2ab0-4213-a15f-478d9f612aff (non-flash)
Nov 29 18:26:52 user nova-compute[74613]:  stderr= {{(pid=74613) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 18:26:52 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-10f3069f-c0b2-48d3-8920-f47b238abe5d tempest-SnapshotDataIntegrityTests-1810787156 tempest-SnapshotDataIntegrityTests-1810787156-project-member] iscsi session list stdout=tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f39cfde-47c7-4b9f-83d3-13c147be6792 (non-flash)
Nov 29 18:26:52 user nova-compute[74613]: tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e7ab2332-2ab0-4213-a15f-478d9f612aff (non-flash)
Nov 29 18:26:52 user nova-compute[74613]:  stderr= {{(pid=74613) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 18:26:52 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-10f3069f-c0b2-48d3-8920-f47b238abe5d tempest-SnapshotDataIntegrityTests-1810787156 tempest-SnapshotDataIntegrityTests-1810787156-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7ff828533e20>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e7ab2332-2ab0-4213-a15f-478d9f612aff'): ({'sdb'}, set())}) {{(pid=74613) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 29 18:26:52 user nova-compute[74613]: DEBUG os_brick.initiator.linuxscsi [None req-10f3069f-c0b2-48d3-8920-f47b238abe5d tempest-SnapshotDataIntegrityTests-1810787156 tempest-SnapshotDataIntegrityTests-1810787156-project-member] Removing single pathed devices sdb {{(pid=74613) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 29 18:26:52 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:26:52 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:26:52 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[510fff4b-e596-4143-99c2-815876f09d71]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 18:26:52 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:26:52 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.017s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:26:52 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a141516-8efa-4b2f-9c89-541d5d66d487]: (4, ('ok\n', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 18:26:52 user nova-compute[74613]: DEBUG os_brick.initiator.linuxscsi [None req-10f3069f-c0b2-48d3-8920-f47b238abe5d tempest-SnapshotDataIntegrityTests-1810787156 tempest-SnapshotDataIntegrityTests-1810787156-project-member] Flushing IO for device /dev/sdb {{(pid=74613) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 29 18:26:52 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:26:52 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.014s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:26:52 user nova-compute[74613]: DEBUG oslo_service.periodic_task [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74613) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 18:26:52 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[b521a749-c595-4962-8528-5be4a4f978bc]: (4, ('', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 18:26:52 user nova-compute[74613]: DEBUG oslo_service.periodic_task [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74613) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 18:26:52 user nova-compute[74613]: DEBUG os_brick.initiator.linuxscsi [None req-10f3069f-c0b2-48d3-8920-f47b238abe5d tempest-SnapshotDataIntegrityTests-1810787156 tempest-SnapshotDataIntegrityTests-1810787156-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74613) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 29 18:26:52 user nova-compute[74613]: DEBUG oslo_service.periodic_task [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74613) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 18:26:52 user nova-compute[74613]: DEBUG nova.compute.manager [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74613) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 29 18:26:52 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:26:52 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.041s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:26:52 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[7224ba4f-dbd2-4264-8284-097b60aeae3c]: (4, ('1', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 18:26:52 user nova-compute[74613]: DEBUG os_brick.initiator.linuxscsi [None req-10f3069f-c0b2-48d3-8920-f47b238abe5d tempest-SnapshotDataIntegrityTests-1810787156 tempest-SnapshotDataIntegrityTests-1810787156-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74613) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 29 18:26:52 user nova-compute[74613]: DEBUG os_brick.initiator.linuxscsi [None req-10f3069f-c0b2-48d3-8920-f47b238abe5d tempest-SnapshotDataIntegrityTests-1810787156 tempest-SnapshotDataIntegrityTests-1810787156-project-member] SCSI volumes sdb have been removed. {{(pid=74613) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 29 18:26:52 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-10f3069f-c0b2-48d3-8920-f47b238abe5d tempest-SnapshotDataIntegrityTests-1810787156 tempest-SnapshotDataIntegrityTests-1810787156-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e7ab2332-2ab0-4213-a15f-478d9f612aff')] {{(pid=74613) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 29 18:26:52 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e7ab2332-2ab0-4213-a15f-478d9f612aff -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:26:52 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e7ab2332-2ab0-4213-a15f-478d9f612aff -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.017s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:26:52 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce84551f-eda6-4ac0-bedc-9fc380df838f]: (4, ('', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 18:26:52 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-10f3069f-c0b2-48d3-8920-f47b238abe5d tempest-SnapshotDataIntegrityTests-1810787156 tempest-SnapshotDataIntegrityTests-1810787156-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74613) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 18:26:52 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e7ab2332-2ab0-4213-a15f-478d9f612aff -p 172.16.0.220:3260 --logout {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:26:52 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e7ab2332-2ab0-4213-a15f-478d9f612aff -p 172.16.0.220:3260 --logout" returned: 0 in 0.055s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:26:52 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[297fdd72-1479-4ba6-a23b-241a95571968]: (4, ('Logging out of session [sid: 55, target: iqn.2010-10.org.openstack:e7ab2332-2ab0-4213-a15f-478d9f612aff, portal: 172.16.0.220,3260]\nLogout of [sid: 55, target: iqn.2010-10.org.openstack:e7ab2332-2ab0-4213-a15f-478d9f612aff, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 18:26:52 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-10f3069f-c0b2-48d3-8920-f47b238abe5d tempest-SnapshotDataIntegrityTests-1810787156 tempest-SnapshotDataIntegrityTests-1810787156-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 55, target: iqn.2010-10.org.openstack:e7ab2332-2ab0-4213-a15f-478d9f612aff, portal: 172.16.0.220,3260]
Nov 29 18:26:52 user nova-compute[74613]: Logout of [sid: 55, target: iqn.2010-10.org.openstack:e7ab2332-2ab0-4213-a15f-478d9f612aff, portal: 172.16.0.220,3260] successful.
Nov 29 18:26:52 user nova-compute[74613]:  stderr= {{(pid=74613) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 18:26:52 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e7ab2332-2ab0-4213-a15f-478d9f612aff -p 172.16.0.220:3260 --op delete {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:26:52 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e7ab2332-2ab0-4213-a15f-478d9f612aff -p 172.16.0.220:3260 --op delete" returned: 0 in 0.021s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:26:52 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[340df33d-60bf-4659-a7ec-c6acb83f8890]: (4, ('', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 18:26:52 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-10f3069f-c0b2-48d3-8920-f47b238abe5d tempest-SnapshotDataIntegrityTests-1810787156 tempest-SnapshotDataIntegrityTests-1810787156-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74613) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 18:26:52 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.base [None req-10f3069f-c0b2-48d3-8920-f47b238abe5d tempest-SnapshotDataIntegrityTests-1810787156 tempest-SnapshotDataIntegrityTests-1810787156-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.278s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 18:26:52 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-10f3069f-c0b2-48d3-8920-f47b238abe5d tempest-SnapshotDataIntegrityTests-1810787156 tempest-SnapshotDataIntegrityTests-1810787156-project-member] <== disconnect_volume: return (279ms) None {{(pid=74613) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 18:26:52 user nova-compute[74613]: DEBUG nova.virt.libvirt.volume.iscsi [None req-10f3069f-c0b2-48d3-8920-f47b238abe5d tempest-SnapshotDataIntegrityTests-1810787156 tempest-SnapshotDataIntegrityTests-1810787156-project-member] [instance: 5227902d-b2b9-40a6-988f-3c02c52404f3] Disconnected iSCSI Volume {{(pid=74613) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 29 18:26:53 user nova-compute[74613]: DEBUG oslo_service.periodic_task [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74613) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 18:26:53 user nova-compute[74613]: DEBUG nova.objects.instance [None req-10f3069f-c0b2-48d3-8920-f47b238abe5d tempest-SnapshotDataIntegrityTests-1810787156 tempest-SnapshotDataIntegrityTests-1810787156-project-member] Lazy-loading 'flavor' on Instance uuid 5227902d-b2b9-40a6-988f-3c02c52404f3 {{(pid=74613) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 18:26:53 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-10f3069f-c0b2-48d3-8920-f47b238abe5d tempest-SnapshotDataIntegrityTests-1810787156 tempest-SnapshotDataIntegrityTests-1810787156-project-member] Lock "5227902d-b2b9-40a6-988f-3c02c52404f3" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.802s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 18:26:55 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 18:27:00 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 18:27:00 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:27:00 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74613) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 29 18:27:00 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74613) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 18:27:00 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74613) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 18:27:00 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:27:05 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 18:27:09 user nova-compute[74613]: DEBUG oslo_service.periodic_task [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Running periodic task ComputeManager._run_image_cache_manager_pass {{(pid=74613) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 18:27:09 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Acquiring lock "storage-registry-lock" by "nova.virt.storage_users.register_storage_use.<locals>.do_register_storage_use" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 18:27:09 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Lock "storage-registry-lock" acquired by "nova.virt.storage_users.register_storage_use.<locals>.do_register_storage_use" :: waited 0.001s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 18:27:09 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Lock "storage-registry-lock" "released" by "nova.virt.storage_users.register_storage_use.<locals>.do_register_storage_use" :: held 0.001s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 18:27:09 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Acquiring lock "storage-registry-lock" by "nova.virt.storage_users.get_storage_users.<locals>.do_get_storage_users" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 18:27:09 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Lock "storage-registry-lock" acquired by "nova.virt.storage_users.get_storage_users.<locals>.do_get_storage_users" :: waited 0.000s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 18:27:09 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Lock "storage-registry-lock" "released" by "nova.virt.storage_users.get_storage_users.<locals>.do_get_storage_users" :: held 0.001s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 18:27:09 user nova-compute[74613]: DEBUG nova.virt.libvirt.imagecache [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Verify base images {{(pid=74613) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:314}}
Nov 29 18:27:09 user nova-compute[74613]: DEBUG nova.virt.libvirt.imagecache [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Image id  yields fingerprint da39a3ee5e6b4b0d3255bfef95601890afd80709 {{(pid=74613) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:319}}
Nov 29 18:27:09 user nova-compute[74613]: DEBUG nova.virt.libvirt.imagecache [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Image id 4217f428-8d9d-4ee1-9614-642d26d90c46 yields fingerprint 21faea9e6951f3bdd0153b76ac89fe1a60a34758 {{(pid=74613) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:319}}
Nov 29 18:27:09 user nova-compute[74613]: INFO nova.virt.libvirt.imagecache [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] image 4217f428-8d9d-4ee1-9614-642d26d90c46 at (/opt/stack/data/nova/instances/_base/21faea9e6951f3bdd0153b76ac89fe1a60a34758): checking
Nov 29 18:27:09 user nova-compute[74613]: DEBUG nova.virt.libvirt.imagecache [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] image 4217f428-8d9d-4ee1-9614-642d26d90c46 at (/opt/stack/data/nova/instances/_base/21faea9e6951f3bdd0153b76ac89fe1a60a34758): image is in use {{(pid=74613) _mark_in_use /opt/stack/nova/nova/virt/libvirt/imagecache.py:279}}
Nov 29 18:27:09 user nova-compute[74613]: DEBUG nova.virt.libvirt.imagecache [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] 5227902d-b2b9-40a6-988f-3c02c52404f3 is a valid instance name {{(pid=74613) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:126}}
Nov 29 18:27:09 user nova-compute[74613]: DEBUG nova.virt.libvirt.imagecache [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] 5227902d-b2b9-40a6-988f-3c02c52404f3 has a disk file {{(pid=74613) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:129}}
Nov 29 18:27:09 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5227902d-b2b9-40a6-988f-3c02c52404f3/disk --force-share --output=json {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:27:09 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5227902d-b2b9-40a6-988f-3c02c52404f3/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:27:09 user nova-compute[74613]: DEBUG nova.virt.libvirt.imagecache [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Instance 5227902d-b2b9-40a6-988f-3c02c52404f3 is backed by 21faea9e6951f3bdd0153b76ac89fe1a60a34758 {{(pid=74613) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:141}}
Nov 29 18:27:09 user nova-compute[74613]: DEBUG nova.virt.libvirt.imagecache [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] 059e3f87-a811-4ac7-b846-2f6d202a919f is a valid instance name {{(pid=74613) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:126}}
Nov 29 18:27:09 user nova-compute[74613]: WARNING nova.virt.libvirt.imagecache [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Unknown base file: /opt/stack/data/nova/instances/_base/f555a336fa02620cd7ad8eb02d7ee22fe12aadf5
Nov 29 18:27:09 user nova-compute[74613]: WARNING nova.virt.libvirt.imagecache [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Unknown base file: /opt/stack/data/nova/instances/_base/4b1d3c6e93f4177d81652a25f8bdb62406dd0afd
Nov 29 18:27:09 user nova-compute[74613]: WARNING nova.virt.libvirt.imagecache [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Unknown base file: /opt/stack/data/nova/instances/_base/36147db75febd28c17568c36a5e1593865890afd
Nov 29 18:27:09 user nova-compute[74613]: WARNING nova.virt.libvirt.imagecache [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Unknown base file: /opt/stack/data/nova/instances/_base/2d5634798fda50d354bea5b67a8aef5bccbe0f87
Nov 29 18:27:09 user nova-compute[74613]: WARNING nova.virt.libvirt.imagecache [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Unknown base file: /opt/stack/data/nova/instances/_base/d6570baddb6b0892e26a58acfaba2fc682212e3b
Nov 29 18:27:09 user nova-compute[74613]: WARNING nova.virt.libvirt.imagecache [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Unknown base file: /opt/stack/data/nova/instances/_base/373425078c28309c9e5f9061b6ed4f3b9a080def
Nov 29 18:27:09 user nova-compute[74613]: WARNING nova.virt.libvirt.imagecache [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Unknown base file: /opt/stack/data/nova/instances/_base/f5309f8810b06e37eebc76add857c30fc6b64f33
Nov 29 18:27:09 user nova-compute[74613]: INFO nova.virt.libvirt.imagecache [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Active base files: /opt/stack/data/nova/instances/_base/21faea9e6951f3bdd0153b76ac89fe1a60a34758
Nov 29 18:27:09 user nova-compute[74613]: INFO nova.virt.libvirt.imagecache [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Removable base files: /opt/stack/data/nova/instances/_base/f555a336fa02620cd7ad8eb02d7ee22fe12aadf5 /opt/stack/data/nova/instances/_base/4b1d3c6e93f4177d81652a25f8bdb62406dd0afd /opt/stack/data/nova/instances/_base/36147db75febd28c17568c36a5e1593865890afd /opt/stack/data/nova/instances/_base/2d5634798fda50d354bea5b67a8aef5bccbe0f87 /opt/stack/data/nova/instances/_base/d6570baddb6b0892e26a58acfaba2fc682212e3b /opt/stack/data/nova/instances/_base/373425078c28309c9e5f9061b6ed4f3b9a080def /opt/stack/data/nova/instances/_base/f5309f8810b06e37eebc76add857c30fc6b64f33
Nov 29 18:27:09 user nova-compute[74613]: INFO nova.virt.libvirt.imagecache [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/f555a336fa02620cd7ad8eb02d7ee22fe12aadf5
Nov 29 18:27:09 user nova-compute[74613]: INFO nova.virt.libvirt.imagecache [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/4b1d3c6e93f4177d81652a25f8bdb62406dd0afd
Nov 29 18:27:09 user nova-compute[74613]: INFO nova.virt.libvirt.imagecache [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/36147db75febd28c17568c36a5e1593865890afd
Nov 29 18:27:09 user nova-compute[74613]: INFO nova.virt.libvirt.imagecache [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/2d5634798fda50d354bea5b67a8aef5bccbe0f87
Nov 29 18:27:09 user nova-compute[74613]: INFO nova.virt.libvirt.imagecache [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/d6570baddb6b0892e26a58acfaba2fc682212e3b
Nov 29 18:27:09 user nova-compute[74613]: INFO nova.virt.libvirt.imagecache [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/373425078c28309c9e5f9061b6ed4f3b9a080def
Nov 29 18:27:09 user nova-compute[74613]: INFO nova.virt.libvirt.imagecache [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/f5309f8810b06e37eebc76add857c30fc6b64f33
Nov 29 18:27:09 user nova-compute[74613]: DEBUG nova.virt.libvirt.imagecache [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Verification complete {{(pid=74613) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:350}}
Nov 29 18:27:09 user nova-compute[74613]: DEBUG nova.virt.libvirt.imagecache [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Verify swap images {{(pid=74613) _age_and_verify_swap_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:299}}
Nov 29 18:27:09 user nova-compute[74613]: DEBUG nova.virt.libvirt.imagecache [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Verify ephemeral images {{(pid=74613) _age_and_verify_ephemeral_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:284}}
Nov 29 18:27:10 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:27:11 user nova-compute[74613]: DEBUG nova.compute.manager [req-d81e7145-2ce8-404c-98d9-ec3240115d4f req-f6dea615-0797-4583-8023-14ddd73f9051 service nova] [instance: 059e3f87-a811-4ac7-b846-2f6d202a919f] Received event network-changed-91dd58f7-d736-4a98-b6a6-f4d1bc6dd8dd {{(pid=74613) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 18:27:11 user nova-compute[74613]: DEBUG nova.compute.manager [req-d81e7145-2ce8-404c-98d9-ec3240115d4f req-f6dea615-0797-4583-8023-14ddd73f9051 service nova] [instance: 059e3f87-a811-4ac7-b846-2f6d202a919f] Refreshing instance network info cache due to event network-changed-91dd58f7-d736-4a98-b6a6-f4d1bc6dd8dd. {{(pid=74613) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 18:27:11 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-d81e7145-2ce8-404c-98d9-ec3240115d4f req-f6dea615-0797-4583-8023-14ddd73f9051 service nova] Acquiring lock "refresh_cache-059e3f87-a811-4ac7-b846-2f6d202a919f" {{(pid=74613) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 18:27:11 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-d81e7145-2ce8-404c-98d9-ec3240115d4f req-f6dea615-0797-4583-8023-14ddd73f9051 service nova] Acquired lock "refresh_cache-059e3f87-a811-4ac7-b846-2f6d202a919f" {{(pid=74613) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 18:27:11 user nova-compute[74613]: DEBUG nova.network.neutron [req-d81e7145-2ce8-404c-98d9-ec3240115d4f req-f6dea615-0797-4583-8023-14ddd73f9051 service nova] [instance: 059e3f87-a811-4ac7-b846-2f6d202a919f] Refreshing network info cache for port 91dd58f7-d736-4a98-b6a6-f4d1bc6dd8dd {{(pid=74613) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 18:27:12 user nova-compute[74613]: DEBUG nova.network.neutron [req-d81e7145-2ce8-404c-98d9-ec3240115d4f req-f6dea615-0797-4583-8023-14ddd73f9051 service nova] [instance: 059e3f87-a811-4ac7-b846-2f6d202a919f] Updated VIF entry in instance network info cache for port 91dd58f7-d736-4a98-b6a6-f4d1bc6dd8dd. {{(pid=74613) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 18:27:12 user nova-compute[74613]: DEBUG nova.network.neutron [req-d81e7145-2ce8-404c-98d9-ec3240115d4f req-f6dea615-0797-4583-8023-14ddd73f9051 service nova] [instance: 059e3f87-a811-4ac7-b846-2f6d202a919f] Updating instance_info_cache with network_info: [{"id": "91dd58f7-d736-4a98-b6a6-f4d1bc6dd8dd", "address": "fa:16:3e:6a:c5:f2", "network": {"id": "4a5179dd-d0b1-44c3-80c1-08dd7b0152f1", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1296336996-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.212", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "67390f1402214191904cfbd68c3142a7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap91dd58f7-d7", "ovs_interfaceid": "91dd58f7-d736-4a98-b6a6-f4d1bc6dd8dd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74613) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 18:27:12 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-d81e7145-2ce8-404c-98d9-ec3240115d4f req-f6dea615-0797-4583-8023-14ddd73f9051 service nova] Releasing lock "refresh_cache-059e3f87-a811-4ac7-b846-2f6d202a919f" {{(pid=74613) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 18:27:15 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 18:27:15 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 18:27:15 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74613) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 29 18:27:15 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74613) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 18:27:15 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74613) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 18:27:15 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:27:16 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:27:19 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-e92d9deb-2554-4e3d-8e0d-1cf0f3cc832a tempest-TestVolumeBootPattern-1318569205 tempest-TestVolumeBootPattern-1318569205-project-member] Acquiring lock "ce15a55a-61a8-48ac-89e5-3a8723284e38" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 18:27:19 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-e92d9deb-2554-4e3d-8e0d-1cf0f3cc832a tempest-TestVolumeBootPattern-1318569205 tempest-TestVolumeBootPattern-1318569205-project-member] Lock "ce15a55a-61a8-48ac-89e5-3a8723284e38" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 18:27:19 user nova-compute[74613]: DEBUG nova.compute.manager [None req-e92d9deb-2554-4e3d-8e0d-1cf0f3cc832a tempest-TestVolumeBootPattern-1318569205 tempest-TestVolumeBootPattern-1318569205-project-member] [instance: ce15a55a-61a8-48ac-89e5-3a8723284e38] Starting instance... {{(pid=74613) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 29 18:27:20 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-e92d9deb-2554-4e3d-8e0d-1cf0f3cc832a tempest-TestVolumeBootPattern-1318569205 tempest-TestVolumeBootPattern-1318569205-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 18:27:20 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-e92d9deb-2554-4e3d-8e0d-1cf0f3cc832a tempest-TestVolumeBootPattern-1318569205 tempest-TestVolumeBootPattern-1318569205-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 18:27:20 user nova-compute[74613]: DEBUG nova.virt.hardware [None req-e92d9deb-2554-4e3d-8e0d-1cf0f3cc832a tempest-TestVolumeBootPattern-1318569205 tempest-TestVolumeBootPattern-1318569205-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74613) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 29 18:27:20 user nova-compute[74613]: INFO nova.compute.claims [None req-e92d9deb-2554-4e3d-8e0d-1cf0f3cc832a tempest-TestVolumeBootPattern-1318569205 tempest-TestVolumeBootPattern-1318569205-project-member] [instance: ce15a55a-61a8-48ac-89e5-3a8723284e38] Claim successful on node user
Nov 29 18:27:20 user nova-compute[74613]: DEBUG nova.compute.provider_tree [None req-e92d9deb-2554-4e3d-8e0d-1cf0f3cc832a tempest-TestVolumeBootPattern-1318569205 tempest-TestVolumeBootPattern-1318569205-project-member] Inventory has not changed in ProviderTree for provider: 639d980e-3b12-44b1-b8f4-1812416fa4dd {{(pid=74613) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 18:27:20 user nova-compute[74613]: DEBUG nova.scheduler.client.report [None req-e92d9deb-2554-4e3d-8e0d-1cf0f3cc832a tempest-TestVolumeBootPattern-1318569205 tempest-TestVolumeBootPattern-1318569205-project-member] Inventory has not changed for provider 639d980e-3b12-44b1-b8f4-1812416fa4dd based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74613) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 18:27:20 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-e92d9deb-2554-4e3d-8e0d-1cf0f3cc832a tempest-TestVolumeBootPattern-1318569205 tempest-TestVolumeBootPattern-1318569205-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.349s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 18:27:20 user nova-compute[74613]: DEBUG nova.compute.manager [None req-e92d9deb-2554-4e3d-8e0d-1cf0f3cc832a tempest-TestVolumeBootPattern-1318569205 tempest-TestVolumeBootPattern-1318569205-project-member] [instance: ce15a55a-61a8-48ac-89e5-3a8723284e38] Start building networks asynchronously for instance. {{(pid=74613) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 29 18:27:20 user nova-compute[74613]: DEBUG nova.compute.manager [None req-e92d9deb-2554-4e3d-8e0d-1cf0f3cc832a tempest-TestVolumeBootPattern-1318569205 tempest-TestVolumeBootPattern-1318569205-project-member] [instance: ce15a55a-61a8-48ac-89e5-3a8723284e38] Allocating IP information in the background. {{(pid=74613) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 29 18:27:20 user nova-compute[74613]: DEBUG nova.network.neutron [None req-e92d9deb-2554-4e3d-8e0d-1cf0f3cc832a tempest-TestVolumeBootPattern-1318569205 tempest-TestVolumeBootPattern-1318569205-project-member] [instance: ce15a55a-61a8-48ac-89e5-3a8723284e38] allocate_for_instance() {{(pid=74613) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 29 18:27:20 user nova-compute[74613]: INFO nova.virt.libvirt.driver [None req-e92d9deb-2554-4e3d-8e0d-1cf0f3cc832a tempest-TestVolumeBootPattern-1318569205 tempest-TestVolumeBootPattern-1318569205-project-member] [instance: ce15a55a-61a8-48ac-89e5-3a8723284e38] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 29 18:27:20 user nova-compute[74613]: DEBUG nova.compute.manager [None req-e92d9deb-2554-4e3d-8e0d-1cf0f3cc832a tempest-TestVolumeBootPattern-1318569205 tempest-TestVolumeBootPattern-1318569205-project-member] [instance: ce15a55a-61a8-48ac-89e5-3a8723284e38] Start building block device mappings for instance. {{(pid=74613) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 29 18:27:20 user nova-compute[74613]: DEBUG nova.policy [None req-e92d9deb-2554-4e3d-8e0d-1cf0f3cc832a tempest-TestVolumeBootPattern-1318569205 tempest-TestVolumeBootPattern-1318569205-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'bedbc6ed47394e2b9125543a8b88a71f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67390f1402214191904cfbd68c3142a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74613) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 29 18:27:20 user nova-compute[74613]: INFO nova.virt.block_device [None req-e92d9deb-2554-4e3d-8e0d-1cf0f3cc832a tempest-TestVolumeBootPattern-1318569205 tempest-TestVolumeBootPattern-1318569205-project-member] [instance: ce15a55a-61a8-48ac-89e5-3a8723284e38] Booting with volume df32b250-81a8-44eb-8094-e63e572541fb at /dev/vda
Nov 29 18:27:20 user nova-compute[74613]: DEBUG os_brick.utils [None req-e92d9deb-2554-4e3d-8e0d-1cf0f3cc832a tempest-TestVolumeBootPattern-1318569205 tempest-TestVolumeBootPattern-1318569205-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74613) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 18:27:20 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:27:20 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:27:20 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[8926da6a-36c9-4485-a2b3-a30fb1ea4eb5]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:400972819b5\n', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 18:27:20 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:27:20 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.014s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:27:20 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f92872a-55cd-4d50-955a-1ba394e9cfee]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 18:27:20 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:27:20 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:27:20 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0f5d847-2108-4c97-b0ed-efddfa62c080]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 18:27:20 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d60f969-63a2-4645-903c-71e8ef98e2ce]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 18:27:20 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-e92d9deb-2554-4e3d-8e0d-1cf0f3cc832a tempest-TestVolumeBootPattern-1318569205 tempest-TestVolumeBootPattern-1318569205-project-member] Running cmd (subprocess): nvme version {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:27:20 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-e92d9deb-2554-4e3d-8e0d-1cf0f3cc832a tempest-TestVolumeBootPattern-1318569205 tempest-TestVolumeBootPattern-1318569205-project-member] 'nvme version' failed. Not Retrying. {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 18:27:20 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.nvmeof [None req-e92d9deb-2554-4e3d-8e0d-1cf0f3cc832a tempest-TestVolumeBootPattern-1318569205 tempest-TestVolumeBootPattern-1318569205-project-member] nvme not present on system {{(pid=74613) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 29 18:27:20 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:27:20 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 18:27:20 user nova-compute[74613]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 29 18:27:20 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[7770728f-c679-48f0-a389-60287e4293d9]: (4, '') {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 18:27:20 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.lightos [None req-e92d9deb-2554-4e3d-8e0d-1cf0f3cc832a tempest-TestVolumeBootPattern-1318569205 tempest-TestVolumeBootPattern-1318569205-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74613) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 29 18:27:20 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.lightos [None req-e92d9deb-2554-4e3d-8e0d-1cf0f3cc832a tempest-TestVolumeBootPattern-1318569205 tempest-TestVolumeBootPattern-1318569205-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74613) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 29 18:27:20 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.lightos [None req-e92d9deb-2554-4e3d-8e0d-1cf0f3cc832a tempest-TestVolumeBootPattern-1318569205 tempest-TestVolumeBootPattern-1318569205-project-member] LIGHTOS: no hostnqn found. {{(pid=74613) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 29 18:27:20 user nova-compute[74613]: DEBUG os_brick.utils [None req-e92d9deb-2554-4e3d-8e0d-1cf0f3cc832a tempest-TestVolumeBootPattern-1318569205 tempest-TestVolumeBootPattern-1318569205-project-member] <== get_connector_properties: return (127ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:400972819b5', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74613) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 18:27:20 user nova-compute[74613]: DEBUG nova.virt.block_device [None req-e92d9deb-2554-4e3d-8e0d-1cf0f3cc832a tempest-TestVolumeBootPattern-1318569205 tempest-TestVolumeBootPattern-1318569205-project-member] [instance: ce15a55a-61a8-48ac-89e5-3a8723284e38] Updating existing volume attachment record: bf5756a2-c2ae-4509-98d0-53421d87c702 {{(pid=74613) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 29 18:27:20 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:27:21 user nova-compute[74613]: DEBUG nova.network.neutron [None req-e92d9deb-2554-4e3d-8e0d-1cf0f3cc832a tempest-TestVolumeBootPattern-1318569205 tempest-TestVolumeBootPattern-1318569205-project-member] [instance: ce15a55a-61a8-48ac-89e5-3a8723284e38] Successfully created port: 5b0f17f1-f9ba-4cf2-a11d-0303c81eb08f {{(pid=74613) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 29 18:27:21 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:27:21 user nova-compute[74613]: DEBUG nova.network.neutron [None req-e92d9deb-2554-4e3d-8e0d-1cf0f3cc832a tempest-TestVolumeBootPattern-1318569205 tempest-TestVolumeBootPattern-1318569205-project-member] [instance: ce15a55a-61a8-48ac-89e5-3a8723284e38] Successfully updated port: 5b0f17f1-f9ba-4cf2-a11d-0303c81eb08f {{(pid=74613) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 29 18:27:21 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-e92d9deb-2554-4e3d-8e0d-1cf0f3cc832a tempest-TestVolumeBootPattern-1318569205 tempest-TestVolumeBootPattern-1318569205-project-member] Acquiring lock "refresh_cache-ce15a55a-61a8-48ac-89e5-3a8723284e38" {{(pid=74613) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 18:27:21 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-e92d9deb-2554-4e3d-8e0d-1cf0f3cc832a tempest-TestVolumeBootPattern-1318569205 tempest-TestVolumeBootPattern-1318569205-project-member] Acquired lock "refresh_cache-ce15a55a-61a8-48ac-89e5-3a8723284e38" {{(pid=74613) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 18:27:21 user nova-compute[74613]: DEBUG nova.network.neutron [None req-e92d9deb-2554-4e3d-8e0d-1cf0f3cc832a tempest-TestVolumeBootPattern-1318569205 tempest-TestVolumeBootPattern-1318569205-project-member] [instance: ce15a55a-61a8-48ac-89e5-3a8723284e38] Building network info cache for instance {{(pid=74613) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 29 18:27:21 user nova-compute[74613]: DEBUG nova.compute.manager [req-827211b0-1694-46c5-9e29-3ff327dd25be req-56bedbc1-5a76-4aab-97a2-3fd4b423307d service nova] [instance: ce15a55a-61a8-48ac-89e5-3a8723284e38] Received event network-changed-5b0f17f1-f9ba-4cf2-a11d-0303c81eb08f {{(pid=74613) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 18:27:21 user nova-compute[74613]: DEBUG nova.compute.manager [req-827211b0-1694-46c5-9e29-3ff327dd25be req-56bedbc1-5a76-4aab-97a2-3fd4b423307d service nova] [instance: ce15a55a-61a8-48ac-89e5-3a8723284e38] Refreshing instance network info cache due to event network-changed-5b0f17f1-f9ba-4cf2-a11d-0303c81eb08f. {{(pid=74613) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 18:27:21 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-827211b0-1694-46c5-9e29-3ff327dd25be req-56bedbc1-5a76-4aab-97a2-3fd4b423307d service nova] Acquiring lock "refresh_cache-ce15a55a-61a8-48ac-89e5-3a8723284e38" {{(pid=74613) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 18:27:21 user nova-compute[74613]: DEBUG nova.network.neutron [None req-e92d9deb-2554-4e3d-8e0d-1cf0f3cc832a tempest-TestVolumeBootPattern-1318569205 tempest-TestVolumeBootPattern-1318569205-project-member] [instance: ce15a55a-61a8-48ac-89e5-3a8723284e38] Instance cache missing network info. {{(pid=74613) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 29 18:27:22 user nova-compute[74613]: DEBUG nova.network.neutron [None req-e92d9deb-2554-4e3d-8e0d-1cf0f3cc832a tempest-TestVolumeBootPattern-1318569205 tempest-TestVolumeBootPattern-1318569205-project-member] [instance: ce15a55a-61a8-48ac-89e5-3a8723284e38] Updating instance_info_cache with network_info: [{"id": "5b0f17f1-f9ba-4cf2-a11d-0303c81eb08f", "address": "fa:16:3e:9f:c9:eb", "network": {"id": "4a5179dd-d0b1-44c3-80c1-08dd7b0152f1", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1296336996-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "67390f1402214191904cfbd68c3142a7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5b0f17f1-f9", "ovs_interfaceid": "5b0f17f1-f9ba-4cf2-a11d-0303c81eb08f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74613) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 18:27:22 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-e92d9deb-2554-4e3d-8e0d-1cf0f3cc832a tempest-TestVolumeBootPattern-1318569205 tempest-TestVolumeBootPattern-1318569205-project-member] Releasing lock "refresh_cache-ce15a55a-61a8-48ac-89e5-3a8723284e38" {{(pid=74613) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 18:27:22 user nova-compute[74613]: DEBUG nova.compute.manager [None req-e92d9deb-2554-4e3d-8e0d-1cf0f3cc832a tempest-TestVolumeBootPattern-1318569205 tempest-TestVolumeBootPattern-1318569205-project-member] [instance: ce15a55a-61a8-48ac-89e5-3a8723284e38] Instance network_info: |[{"id": "5b0f17f1-f9ba-4cf2-a11d-0303c81eb08f", "address": "fa:16:3e:9f:c9:eb", "network": {"id": "4a5179dd-d0b1-44c3-80c1-08dd7b0152f1", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1296336996-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "67390f1402214191904cfbd68c3142a7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5b0f17f1-f9", "ovs_interfaceid": "5b0f17f1-f9ba-4cf2-a11d-0303c81eb08f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74613) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 29 18:27:22 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-827211b0-1694-46c5-9e29-3ff327dd25be req-56bedbc1-5a76-4aab-97a2-3fd4b423307d service nova] Acquired lock "refresh_cache-ce15a55a-61a8-48ac-89e5-3a8723284e38" {{(pid=74613) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 18:27:22 user nova-compute[74613]: DEBUG nova.network.neutron [req-827211b0-1694-46c5-9e29-3ff327dd25be req-56bedbc1-5a76-4aab-97a2-3fd4b423307d service nova] [instance: ce15a55a-61a8-48ac-89e5-3a8723284e38] Refreshing network info cache for port 5b0f17f1-f9ba-4cf2-a11d-0303c81eb08f {{(pid=74613) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 18:27:22 user nova-compute[74613]: DEBUG nova.network.neutron [req-827211b0-1694-46c5-9e29-3ff327dd25be req-56bedbc1-5a76-4aab-97a2-3fd4b423307d service nova] [instance: ce15a55a-61a8-48ac-89e5-3a8723284e38] Updated VIF entry in instance network info cache for port 5b0f17f1-f9ba-4cf2-a11d-0303c81eb08f. {{(pid=74613) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 18:27:22 user nova-compute[74613]: DEBUG nova.network.neutron [req-827211b0-1694-46c5-9e29-3ff327dd25be req-56bedbc1-5a76-4aab-97a2-3fd4b423307d service nova] [instance: ce15a55a-61a8-48ac-89e5-3a8723284e38] Updating instance_info_cache with network_info: [{"id": "5b0f17f1-f9ba-4cf2-a11d-0303c81eb08f", "address": "fa:16:3e:9f:c9:eb", "network": {"id": "4a5179dd-d0b1-44c3-80c1-08dd7b0152f1", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1296336996-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "67390f1402214191904cfbd68c3142a7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5b0f17f1-f9", "ovs_interfaceid": "5b0f17f1-f9ba-4cf2-a11d-0303c81eb08f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74613) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 18:27:22 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-827211b0-1694-46c5-9e29-3ff327dd25be req-56bedbc1-5a76-4aab-97a2-3fd4b423307d service nova] Releasing lock "refresh_cache-ce15a55a-61a8-48ac-89e5-3a8723284e38" {{(pid=74613) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 18:27:25 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:27:26 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:27:29 user nova-compute[74613]: DEBUG nova.compute.manager [None req-e92d9deb-2554-4e3d-8e0d-1cf0f3cc832a tempest-TestVolumeBootPattern-1318569205 tempest-TestVolumeBootPattern-1318569205-project-member] [instance: ce15a55a-61a8-48ac-89e5-3a8723284e38] Start spawning the instance on the hypervisor. {{(pid=74613) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 29 18:27:29 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-e92d9deb-2554-4e3d-8e0d-1cf0f3cc832a tempest-TestVolumeBootPattern-1318569205 tempest-TestVolumeBootPattern-1318569205-project-member] [instance: ce15a55a-61a8-48ac-89e5-3a8723284e38] Creating instance directory {{(pid=74613) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 29 18:27:29 user nova-compute[74613]: INFO nova.virt.libvirt.driver [None req-e92d9deb-2554-4e3d-8e0d-1cf0f3cc832a tempest-TestVolumeBootPattern-1318569205 tempest-TestVolumeBootPattern-1318569205-project-member] [instance: ce15a55a-61a8-48ac-89e5-3a8723284e38] Creating image(s)
Nov 29 18:27:29 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-e92d9deb-2554-4e3d-8e0d-1cf0f3cc832a tempest-TestVolumeBootPattern-1318569205 tempest-TestVolumeBootPattern-1318569205-project-member] [instance: ce15a55a-61a8-48ac-89e5-3a8723284e38] Did not create local disks {{(pid=74613) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 29 18:27:29 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-e92d9deb-2554-4e3d-8e0d-1cf0f3cc832a tempest-TestVolumeBootPattern-1318569205 tempest-TestVolumeBootPattern-1318569205-project-member] [instance: ce15a55a-61a8-48ac-89e5-3a8723284e38] Ensure instance console log exists: /opt/stack/data/nova/instances/ce15a55a-61a8-48ac-89e5-3a8723284e38/console.log {{(pid=74613) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 29 18:27:29 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-e92d9deb-2554-4e3d-8e0d-1cf0f3cc832a tempest-TestVolumeBootPattern-1318569205 tempest-TestVolumeBootPattern-1318569205-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 18:27:29 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-e92d9deb-2554-4e3d-8e0d-1cf0f3cc832a tempest-TestVolumeBootPattern-1318569205 tempest-TestVolumeBootPattern-1318569205-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 18:27:29 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-e92d9deb-2554-4e3d-8e0d-1cf0f3cc832a tempest-TestVolumeBootPattern-1318569205 tempest-TestVolumeBootPattern-1318569205-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 18:27:29 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-e92d9deb-2554-4e3d-8e0d-1cf0f3cc832a tempest-TestVolumeBootPattern-1318569205 tempest-TestVolumeBootPattern-1318569205-project-member] [instance: ce15a55a-61a8-48ac-89e5-3a8723284e38] Start _get_guest_xml network_info=[{"id": "5b0f17f1-f9ba-4cf2-a11d-0303c81eb08f", "address": "fa:16:3e:9f:c9:eb", "network": {"id": "4a5179dd-d0b1-44c3-80c1-08dd7b0152f1", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1296336996-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "67390f1402214191904cfbd68c3142a7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5b0f17f1-f9", "ovs_interfaceid": "5b0f17f1-f9ba-4cf2-a11d-0303c81eb08f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:df32b250-81a8-44eb-8094-e63e572541fb', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'FAwyonBK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'ce15a55a-61a8-48ac-89e5-3a8723284e38', 'attached_at': '', 'detached_at': '', 'volume_id': 'df32b250-81a8-44eb-8094-e63e572541fb', 'serial': 'df32b250-81a8-44eb-8094-e63e572541fb'}, 'mount_device': '/dev/vda', 'delete_on_termination': False, 'device_type': 'disk', 'boot_index': 0, 'guest_format': None, 'attachment_id': 'bf5756a2-c2ae-4509-98d0-53421d87c702', 'disk_bus': 'virtio', 'volume_type': None} {{(pid=74613) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 29 18:27:29 user nova-compute[74613]: WARNING nova.virt.libvirt.driver [None req-e92d9deb-2554-4e3d-8e0d-1cf0f3cc832a tempest-TestVolumeBootPattern-1318569205 tempest-TestVolumeBootPattern-1318569205-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 18:27:29 user nova-compute[74613]: WARNING nova.virt.libvirt.driver [None req-e92d9deb-2554-4e3d-8e0d-1cf0f3cc832a tempest-TestVolumeBootPattern-1318569205 tempest-TestVolumeBootPattern-1318569205-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 18:27:29 user nova-compute[74613]: DEBUG nova.virt.libvirt.host [None req-e92d9deb-2554-4e3d-8e0d-1cf0f3cc832a tempest-TestVolumeBootPattern-1318569205 tempest-TestVolumeBootPattern-1318569205-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74613) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 29 18:27:29 user nova-compute[74613]: DEBUG nova.virt.libvirt.host [None req-e92d9deb-2554-4e3d-8e0d-1cf0f3cc832a tempest-TestVolumeBootPattern-1318569205 tempest-TestVolumeBootPattern-1318569205-project-member] CPU controller missing on host. {{(pid=74613) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 29 18:27:29 user nova-compute[74613]: DEBUG nova.virt.libvirt.host [None req-e92d9deb-2554-4e3d-8e0d-1cf0f3cc832a tempest-TestVolumeBootPattern-1318569205 tempest-TestVolumeBootPattern-1318569205-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74613) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 29 18:27:29 user nova-compute[74613]: DEBUG nova.virt.libvirt.host [None req-e92d9deb-2554-4e3d-8e0d-1cf0f3cc832a tempest-TestVolumeBootPattern-1318569205 tempest-TestVolumeBootPattern-1318569205-project-member] CPU controller found on host. {{(pid=74613) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 29 18:27:29 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-e92d9deb-2554-4e3d-8e0d-1cf0f3cc832a tempest-TestVolumeBootPattern-1318569205 tempest-TestVolumeBootPattern-1318569205-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74613) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 29 18:27:29 user nova-compute[74613]: DEBUG nova.virt.hardware [None req-e92d9deb-2554-4e3d-8e0d-1cf0f3cc832a tempest-TestVolumeBootPattern-1318569205 tempest-TestVolumeBootPattern-1318569205-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-29T17:47:27Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74613) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 29 18:27:29 user nova-compute[74613]: DEBUG nova.virt.hardware [None req-e92d9deb-2554-4e3d-8e0d-1cf0f3cc832a tempest-TestVolumeBootPattern-1318569205 tempest-TestVolumeBootPattern-1318569205-project-member] Flavor limits 0:0:0 {{(pid=74613) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 29 18:27:29 user nova-compute[74613]: DEBUG nova.virt.hardware [None req-e92d9deb-2554-4e3d-8e0d-1cf0f3cc832a tempest-TestVolumeBootPattern-1318569205 tempest-TestVolumeBootPattern-1318569205-project-member] Image limits 0:0:0 {{(pid=74613) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 29 18:27:29 user nova-compute[74613]: DEBUG nova.virt.hardware [None req-e92d9deb-2554-4e3d-8e0d-1cf0f3cc832a tempest-TestVolumeBootPattern-1318569205 tempest-TestVolumeBootPattern-1318569205-project-member] Flavor pref 0:0:0 {{(pid=74613) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 29 18:27:29 user nova-compute[74613]: DEBUG nova.virt.hardware [None req-e92d9deb-2554-4e3d-8e0d-1cf0f3cc832a tempest-TestVolumeBootPattern-1318569205 tempest-TestVolumeBootPattern-1318569205-project-member] Image pref 0:0:0 {{(pid=74613) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 29 18:27:29 user nova-compute[74613]: DEBUG nova.virt.hardware [None req-e92d9deb-2554-4e3d-8e0d-1cf0f3cc832a tempest-TestVolumeBootPattern-1318569205 tempest-TestVolumeBootPattern-1318569205-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74613) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 29 18:27:29 user nova-compute[74613]: DEBUG nova.virt.hardware [None req-e92d9deb-2554-4e3d-8e0d-1cf0f3cc832a tempest-TestVolumeBootPattern-1318569205 tempest-TestVolumeBootPattern-1318569205-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74613) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 29 18:27:29 user nova-compute[74613]: DEBUG nova.virt.hardware [None req-e92d9deb-2554-4e3d-8e0d-1cf0f3cc832a tempest-TestVolumeBootPattern-1318569205 tempest-TestVolumeBootPattern-1318569205-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74613) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 29 18:27:29 user nova-compute[74613]: DEBUG nova.virt.hardware [None req-e92d9deb-2554-4e3d-8e0d-1cf0f3cc832a tempest-TestVolumeBootPattern-1318569205 tempest-TestVolumeBootPattern-1318569205-project-member] Got 1 possible topologies {{(pid=74613) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 29 18:27:29 user nova-compute[74613]: DEBUG nova.virt.hardware [None req-e92d9deb-2554-4e3d-8e0d-1cf0f3cc832a tempest-TestVolumeBootPattern-1318569205 tempest-TestVolumeBootPattern-1318569205-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74613) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 29 18:27:29 user nova-compute[74613]: DEBUG nova.virt.hardware [None req-e92d9deb-2554-4e3d-8e0d-1cf0f3cc832a tempest-TestVolumeBootPattern-1318569205 tempest-TestVolumeBootPattern-1318569205-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74613) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 29 18:27:29 user nova-compute[74613]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e92d9deb-2554-4e3d-8e0d-1cf0f3cc832a tempest-TestVolumeBootPattern-1318569205 tempest-TestVolumeBootPattern-1318569205-project-member] [instance: ce15a55a-61a8-48ac-89e5-3a8723284e38] Calling os-brick to attach iSCSI Volume {{(pid=74613) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 29 18:27:29 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-e92d9deb-2554-4e3d-8e0d-1cf0f3cc832a tempest-TestVolumeBootPattern-1318569205 tempest-TestVolumeBootPattern-1318569205-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff828156890>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:df32b250-81a8-44eb-8094-e63e572541fb', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'FAwyonBK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74613) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 18:27:29 user nova-compute[74613]: WARNING os_brick.initiator.connectors.base [None req-e92d9deb-2554-4e3d-8e0d-1cf0f3cc832a tempest-TestVolumeBootPattern-1318569205 tempest-TestVolumeBootPattern-1318569205-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 18:27:29 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.base [None req-e92d9deb-2554-4e3d-8e0d-1cf0f3cc832a tempest-TestVolumeBootPattern-1318569205 tempest-TestVolumeBootPattern-1318569205-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 18:27:29 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.base [None req-e92d9deb-2554-4e3d-8e0d-1cf0f3cc832a tempest-TestVolumeBootPattern-1318569205 tempest-TestVolumeBootPattern-1318569205-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 18:27:29 user nova-compute[74613]: WARNING os_brick.initiator.connectors.base [None req-e92d9deb-2554-4e3d-8e0d-1cf0f3cc832a tempest-TestVolumeBootPattern-1318569205 tempest-TestVolumeBootPattern-1318569205-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 18:27:29 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.base [None req-e92d9deb-2554-4e3d-8e0d-1cf0f3cc832a tempest-TestVolumeBootPattern-1318569205 tempest-TestVolumeBootPattern-1318569205-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:df32b250-81a8-44eb-8094-e63e572541fb" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 18:27:29 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.base [None req-e92d9deb-2554-4e3d-8e0d-1cf0f3cc832a tempest-TestVolumeBootPattern-1318569205 tempest-TestVolumeBootPattern-1318569205-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:df32b250-81a8-44eb-8094-e63e572541fb" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 18:27:29 user nova-compute[74613]: INFO os_brick.initiator.connectors.iscsi [None req-e92d9deb-2554-4e3d-8e0d-1cf0f3cc832a tempest-TestVolumeBootPattern-1318569205 tempest-TestVolumeBootPattern-1318569205-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 29 18:27:29 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:df32b250-81a8-44eb-8094-e63e572541fb -p 172.16.0.220:3260 {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:27:29 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:df32b250-81a8-44eb-8094-e63e572541fb -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:27:29 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[bcab870a-7d01-4872-946c-5557fed8f039]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 18:27:29 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-e92d9deb-2554-4e3d-8e0d-1cf0f3cc832a tempest-TestVolumeBootPattern-1318569205 tempest-TestVolumeBootPattern-1318569205-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 29 18:27:29 user nova-compute[74613]:  {{(pid=74613) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 18:27:29 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:df32b250-81a8-44eb-8094-e63e572541fb -p 172.16.0.220:3260 --interface default --op new {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:27:29 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:df32b250-81a8-44eb-8094-e63e572541fb -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:27:29 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[6432112e-2d13-4f1d-bab5-22e0ad0c0b5a]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:df32b250-81a8-44eb-8094-e63e572541fb] added\n', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 18:27:29 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-e92d9deb-2554-4e3d-8e0d-1cf0f3cc832a tempest-TestVolumeBootPattern-1318569205 tempest-TestVolumeBootPattern-1318569205-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:df32b250-81a8-44eb-8094-e63e572541fb] added
Nov 29 18:27:29 user nova-compute[74613]:  stderr= {{(pid=74613) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 18:27:29 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:df32b250-81a8-44eb-8094-e63e572541fb -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:27:29 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:df32b250-81a8-44eb-8094-e63e572541fb -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:27:29 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[785f4eba-5ac1-4dfc-b7d1-85a58708c873]: (4, ('', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 18:27:29 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-e92d9deb-2554-4e3d-8e0d-1cf0f3cc832a tempest-TestVolumeBootPattern-1318569205 tempest-TestVolumeBootPattern-1318569205-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74613) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 18:27:29 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:df32b250-81a8-44eb-8094-e63e572541fb -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:27:29 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:df32b250-81a8-44eb-8094-e63e572541fb -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:27:29 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e58a1e8-fa32-4ef4-8cbe-6ac3b8cc7e45]: (4, ('', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 18:27:29 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-e92d9deb-2554-4e3d-8e0d-1cf0f3cc832a tempest-TestVolumeBootPattern-1318569205 tempest-TestVolumeBootPattern-1318569205-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74613) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 18:27:29 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:df32b250-81a8-44eb-8094-e63e572541fb -p 172.16.0.220:3260 --op update -n node.session.auth.username -v FAwyonBK {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:27:29 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:df32b250-81a8-44eb-8094-e63e572541fb -p 172.16.0.220:3260 --op update -n node.session.auth.username -v FAwyonBK" returned: 0 in 0.017s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:27:29 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[4deb4afb-4143-4e06-8ab7-31f86636d547]: (4, ('', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 18:27:29 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-e92d9deb-2554-4e3d-8e0d-1cf0f3cc832a tempest-TestVolumeBootPattern-1318569205 tempest-TestVolumeBootPattern-1318569205-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'FAwyonBK'): stdout= stderr= {{(pid=74613) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 18:27:29 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:df32b250-81a8-44eb-8094-e63e572541fb -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:27:29 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:df32b250-81a8-44eb-8094-e63e572541fb -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.024s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:27:29 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3c11287-aa45-4a66-b983-d7b1b863420c]: (4, ('', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 18:27:29 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-e92d9deb-2554-4e3d-8e0d-1cf0f3cc832a tempest-TestVolumeBootPattern-1318569205 tempest-TestVolumeBootPattern-1318569205-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74613) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 18:27:29 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:27:29 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:27:29 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[6607a067-eb56-40e6-a63d-fe8157e88a7d]: (4, ('tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f39cfde-47c7-4b9f-83d3-13c147be6792 (non-flash)\ntcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7a229f58-b438-46c6-9218-d70490c1c0f7 (non-flash)\n', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 18:27:29 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-e92d9deb-2554-4e3d-8e0d-1cf0f3cc832a tempest-TestVolumeBootPattern-1318569205 tempest-TestVolumeBootPattern-1318569205-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f39cfde-47c7-4b9f-83d3-13c147be6792 (non-flash)
Nov 29 18:27:29 user nova-compute[74613]: tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7a229f58-b438-46c6-9218-d70490c1c0f7 (non-flash)
Nov 29 18:27:29 user nova-compute[74613]:  stderr= {{(pid=74613) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 18:27:29 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-e92d9deb-2554-4e3d-8e0d-1cf0f3cc832a tempest-TestVolumeBootPattern-1318569205 tempest-TestVolumeBootPattern-1318569205-project-member] iscsi session list stdout=tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f39cfde-47c7-4b9f-83d3-13c147be6792 (non-flash)
Nov 29 18:27:29 user nova-compute[74613]: tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7a229f58-b438-46c6-9218-d70490c1c0f7 (non-flash)
Nov 29 18:27:29 user nova-compute[74613]:  stderr= {{(pid=74613) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 18:27:29 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:df32b250-81a8-44eb-8094-e63e572541fb -p 172.16.0.220:3260 --login {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:27:29 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:df32b250-81a8-44eb-8094-e63e572541fb -p 172.16.0.220:3260 --login" returned: 0 in 0.058s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:27:29 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8ec6a77-4050-4866-bbe4-d5f04c4a785c]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:df32b250-81a8-44eb-8094-e63e572541fb, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:df32b250-81a8-44eb-8094-e63e572541fb, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 18:27:29 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-e92d9deb-2554-4e3d-8e0d-1cf0f3cc832a tempest-TestVolumeBootPattern-1318569205 tempest-TestVolumeBootPattern-1318569205-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:df32b250-81a8-44eb-8094-e63e572541fb, portal: 172.16.0.220,3260]
Nov 29 18:27:29 user nova-compute[74613]: Login to [iface: default, target: iqn.2010-10.org.openstack:df32b250-81a8-44eb-8094-e63e572541fb, portal: 172.16.0.220,3260] successful.
Nov 29 18:27:29 user nova-compute[74613]:  stderr= {{(pid=74613) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 18:27:29 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:df32b250-81a8-44eb-8094-e63e572541fb -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:27:29 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:df32b250-81a8-44eb-8094-e63e572541fb -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.017s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:27:29 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0376287-a72d-4a2c-bc5f-b172ba154e08]: (4, ('', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 18:27:29 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-e92d9deb-2554-4e3d-8e0d-1cf0f3cc832a tempest-TestVolumeBootPattern-1318569205 tempest-TestVolumeBootPattern-1318569205-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74613) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 18:27:29 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:27:29 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:27:29 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[8313672f-0cf5-4977-af5a-8ec2f0798b5a]: (4, ('tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f39cfde-47c7-4b9f-83d3-13c147be6792 (non-flash)\ntcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7a229f58-b438-46c6-9218-d70490c1c0f7 (non-flash)\ntcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:df32b250-81a8-44eb-8094-e63e572541fb (non-flash)\n', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 18:27:29 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-e92d9deb-2554-4e3d-8e0d-1cf0f3cc832a tempest-TestVolumeBootPattern-1318569205 tempest-TestVolumeBootPattern-1318569205-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f39cfde-47c7-4b9f-83d3-13c147be6792 (non-flash)
Nov 29 18:27:29 user nova-compute[74613]: tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7a229f58-b438-46c6-9218-d70490c1c0f7 (non-flash)
Nov 29 18:27:29 user nova-compute[74613]: tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:df32b250-81a8-44eb-8094-e63e572541fb (non-flash)
Nov 29 18:27:29 user nova-compute[74613]:  stderr= {{(pid=74613) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 18:27:29 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-e92d9deb-2554-4e3d-8e0d-1cf0f3cc832a tempest-TestVolumeBootPattern-1318569205 tempest-TestVolumeBootPattern-1318569205-project-member] iscsi session list stdout=tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f39cfde-47c7-4b9f-83d3-13c147be6792 (non-flash)
Nov 29 18:27:29 user nova-compute[74613]: tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7a229f58-b438-46c6-9218-d70490c1c0f7 (non-flash)
Nov 29 18:27:29 user nova-compute[74613]: tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:df32b250-81a8-44eb-8094-e63e572541fb (non-flash)
Nov 29 18:27:29 user nova-compute[74613]:  stderr= {{(pid=74613) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 18:27:29 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.base [None req-e92d9deb-2554-4e3d-8e0d-1cf0f3cc832a tempest-TestVolumeBootPattern-1318569205 tempest-TestVolumeBootPattern-1318569205-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:df32b250-81a8-44eb-8094-e63e572541fb" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.283s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 18:27:29 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-e92d9deb-2554-4e3d-8e0d-1cf0f3cc832a tempest-TestVolumeBootPattern-1318569205 tempest-TestVolumeBootPattern-1318569205-project-member] Connected to 172.16.0.220:3260 {{(pid=74613) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 29 18:27:29 user nova-compute[74613]: DEBUG os_brick.initiator.linuxscsi [None req-e92d9deb-2554-4e3d-8e0d-1cf0f3cc832a tempest-TestVolumeBootPattern-1318569205 tempest-TestVolumeBootPattern-1318569205-project-member] HCTL ('35', '-', '-', 0) found on session 57 with lun 0 {{(pid=74613) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 29 18:27:29 user nova-compute[74613]: DEBUG os_brick.initiator.linuxscsi [None req-e92d9deb-2554-4e3d-8e0d-1cf0f3cc832a tempest-TestVolumeBootPattern-1318569205 tempest-TestVolumeBootPattern-1318569205-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=74613) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 29 18:27:29 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:27:29 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.019s {{(pid=85376) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:27:29 user nova-compute[74613]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd96a14c-5ae0-4b3b-a6ef-1fdfe80d881f]: (4, ('- - 0', '')) {{(pid=85376) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 18:27:29 user nova-compute[74613]: DEBUG os_brick.initiator.linuxscsi [None req-e92d9deb-2554-4e3d-8e0d-1cf0f3cc832a tempest-TestVolumeBootPattern-1318569205 tempest-TestVolumeBootPattern-1318569205-project-member] Searching for a device in session 57 and hctl ['35', '*', '*', 0] yield: None {{(pid=74613) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 29 18:27:30 user nova-compute[74613]: DEBUG os_brick.initiator.linuxscsi [None req-e92d9deb-2554-4e3d-8e0d-1cf0f3cc832a tempest-TestVolumeBootPattern-1318569205 tempest-TestVolumeBootPattern-1318569205-project-member] Searching for a device in session 57 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=74613) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 29 18:27:30 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-e92d9deb-2554-4e3d-8e0d-1cf0f3cc832a tempest-TestVolumeBootPattern-1318569205 tempest-TestVolumeBootPattern-1318569205-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:df32b250-81a8-44eb-8094-e63e572541fb', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'FAwyonBK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74613) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 29 18:27:30 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.base [None req-e92d9deb-2554-4e3d-8e0d-1cf0f3cc832a tempest-TestVolumeBootPattern-1318569205 tempest-TestVolumeBootPattern-1318569205-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.317s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 18:27:30 user nova-compute[74613]: DEBUG os_brick.initiator.connectors.iscsi [None req-e92d9deb-2554-4e3d-8e0d-1cf0f3cc832a tempest-TestVolumeBootPattern-1318569205 tempest-TestVolumeBootPattern-1318569205-project-member] <== connect_volume: return (1319ms) {'type': 'block', 'scsi_wwn': '23239343930623233', 'path': '/dev/sdd'} {{(pid=74613) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 18:27:30 user nova-compute[74613]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e92d9deb-2554-4e3d-8e0d-1cf0f3cc832a tempest-TestVolumeBootPattern-1318569205 tempest-TestVolumeBootPattern-1318569205-project-member] [instance: ce15a55a-61a8-48ac-89e5-3a8723284e38] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23239343930623233', 'path': '/dev/sdd'} {{(pid=74613) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 29 18:27:30 user nova-compute[74613]: DEBUG nova.virt.libvirt.vif [None req-e92d9deb-2554-4e3d-8e0d-1cf0f3cc832a tempest-TestVolumeBootPattern-1318569205 tempest-TestVolumeBootPattern-1318569205-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T18:27:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-374059741',display_name='tempest-TestVolumeBootPattern-server-374059741',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-374059741',id=49,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBF68W8p1zDe0zv1nt+x55p88jNtkp+KefAo7j9aGY4lI4rRNz+cx5GFQLxMQlgNyvRcFIVQErVtli+AYTX2wE/wzDsGd1AkTeB1AuDgBox6TZ+l5dYZcMLLtIJDQcAEEBg==',key_name='tempest-TestVolumeBootPattern-792688502',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='67390f1402214191904cfbd68c3142a7',ramdisk_id='',reservation_id='r-39gek3k1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1318569205',owner_user_name='tempest-TestVolumeBootPattern-1318569205-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T18:27:21Z,user_data=None,user_id='bedbc6ed47394e2b9125543a8b88a71f',uuid=ce15a55a-61a8-48ac-89e5-3a8723284e38,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5b0f17f1-f9ba-4cf2-a11d-0303c81eb08f", "address": "fa:16:3e:9f:c9:eb", "network": {"id": "4a5179dd-d0b1-44c3-80c1-08dd7b0152f1", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1296336996-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "67390f1402214191904cfbd68c3142a7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5b0f17f1-f9", "ovs_interfaceid": "5b0f17f1-f9ba-4cf2-a11d-0303c81eb08f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74613) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 29 18:27:30 user nova-compute[74613]: DEBUG nova.network.os_vif_util [None req-e92d9deb-2554-4e3d-8e0d-1cf0f3cc832a tempest-TestVolumeBootPattern-1318569205 tempest-TestVolumeBootPattern-1318569205-project-member] Converting VIF {"id": "5b0f17f1-f9ba-4cf2-a11d-0303c81eb08f", "address": "fa:16:3e:9f:c9:eb", "network": {"id": "4a5179dd-d0b1-44c3-80c1-08dd7b0152f1", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1296336996-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "67390f1402214191904cfbd68c3142a7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5b0f17f1-f9", "ovs_interfaceid": "5b0f17f1-f9ba-4cf2-a11d-0303c81eb08f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74613) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 18:27:30 user nova-compute[74613]: DEBUG nova.network.os_vif_util [None req-e92d9deb-2554-4e3d-8e0d-1cf0f3cc832a tempest-TestVolumeBootPattern-1318569205 tempest-TestVolumeBootPattern-1318569205-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9f:c9:eb,bridge_name='br-int',has_traffic_filtering=True,id=5b0f17f1-f9ba-4cf2-a11d-0303c81eb08f,network=Network(4a5179dd-d0b1-44c3-80c1-08dd7b0152f1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5b0f17f1-f9') {{(pid=74613) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 18:27:30 user nova-compute[74613]: DEBUG nova.objects.instance [None req-e92d9deb-2554-4e3d-8e0d-1cf0f3cc832a tempest-TestVolumeBootPattern-1318569205 tempest-TestVolumeBootPattern-1318569205-project-member] Lazy-loading 'pci_devices' on Instance uuid ce15a55a-61a8-48ac-89e5-3a8723284e38 {{(pid=74613) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 18:27:30 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-e92d9deb-2554-4e3d-8e0d-1cf0f3cc832a tempest-TestVolumeBootPattern-1318569205 tempest-TestVolumeBootPattern-1318569205-project-member] [instance: ce15a55a-61a8-48ac-89e5-3a8723284e38] End _get_guest_xml xml=<domain type="kvm">
Nov 29 18:27:30 user nova-compute[74613]:   <uuid>ce15a55a-61a8-48ac-89e5-3a8723284e38</uuid>
Nov 29 18:27:30 user nova-compute[74613]:   <name>instance-00000031</name>
Nov 29 18:27:30 user nova-compute[74613]:   <memory>524288</memory>
Nov 29 18:27:30 user nova-compute[74613]:   <vcpu>1</vcpu>
Nov 29 18:27:30 user nova-compute[74613]:   <metadata>
Nov 29 18:27:30 user nova-compute[74613]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 29 18:27:30 user nova-compute[74613]:       <nova:package version="0.0.0"/>
Nov 29 18:27:30 user nova-compute[74613]:       <nova:name>tempest-TestVolumeBootPattern-server-374059741</nova:name>
Nov 29 18:27:30 user nova-compute[74613]:       <nova:creationTime>2023-11-29 18:27:29</nova:creationTime>
Nov 29 18:27:30 user nova-compute[74613]:       <nova:flavor name="m1.tiny">
Nov 29 18:27:30 user nova-compute[74613]:         <nova:memory>512</nova:memory>
Nov 29 18:27:30 user nova-compute[74613]:         <nova:disk>1</nova:disk>
Nov 29 18:27:30 user nova-compute[74613]:         <nova:swap>0</nova:swap>
Nov 29 18:27:30 user nova-compute[74613]:         <nova:ephemeral>0</nova:ephemeral>
Nov 29 18:27:30 user nova-compute[74613]:         <nova:vcpus>1</nova:vcpus>
Nov 29 18:27:30 user nova-compute[74613]:       </nova:flavor>
Nov 29 18:27:30 user nova-compute[74613]:       <nova:owner>
Nov 29 18:27:30 user nova-compute[74613]:         <nova:user uuid="bedbc6ed47394e2b9125543a8b88a71f">tempest-TestVolumeBootPattern-1318569205-project-member</nova:user>
Nov 29 18:27:30 user nova-compute[74613]:         <nova:project uuid="67390f1402214191904cfbd68c3142a7">tempest-TestVolumeBootPattern-1318569205</nova:project>
Nov 29 18:27:30 user nova-compute[74613]:       </nova:owner>
Nov 29 18:27:30 user nova-compute[74613]:       <nova:ports>
Nov 29 18:27:30 user nova-compute[74613]:         <nova:port uuid="5b0f17f1-f9ba-4cf2-a11d-0303c81eb08f">
Nov 29 18:27:30 user nova-compute[74613]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Nov 29 18:27:30 user nova-compute[74613]:         </nova:port>
Nov 29 18:27:30 user nova-compute[74613]:       </nova:ports>
Nov 29 18:27:30 user nova-compute[74613]:     </nova:instance>
Nov 29 18:27:30 user nova-compute[74613]:   </metadata>
Nov 29 18:27:30 user nova-compute[74613]:   <sysinfo type="smbios">
Nov 29 18:27:30 user nova-compute[74613]:     <system>
Nov 29 18:27:30 user nova-compute[74613]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 29 18:27:30 user nova-compute[74613]:       <entry name="product">OpenStack Nova</entry>
Nov 29 18:27:30 user nova-compute[74613]:       <entry name="version">0.0.0</entry>
Nov 29 18:27:30 user nova-compute[74613]:       <entry name="serial">ce15a55a-61a8-48ac-89e5-3a8723284e38</entry>
Nov 29 18:27:30 user nova-compute[74613]:       <entry name="uuid">ce15a55a-61a8-48ac-89e5-3a8723284e38</entry>
Nov 29 18:27:30 user nova-compute[74613]:       <entry name="family">Virtual Machine</entry>
Nov 29 18:27:30 user nova-compute[74613]:     </system>
Nov 29 18:27:30 user nova-compute[74613]:   </sysinfo>
Nov 29 18:27:30 user nova-compute[74613]:   <os>
Nov 29 18:27:30 user nova-compute[74613]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 29 18:27:30 user nova-compute[74613]:     <boot dev="hd"/>
Nov 29 18:27:30 user nova-compute[74613]:     <smbios mode="sysinfo"/>
Nov 29 18:27:30 user nova-compute[74613]:   </os>
Nov 29 18:27:30 user nova-compute[74613]:   <features>
Nov 29 18:27:30 user nova-compute[74613]:     <acpi/>
Nov 29 18:27:30 user nova-compute[74613]:     <apic/>
Nov 29 18:27:30 user nova-compute[74613]:     <vmcoreinfo/>
Nov 29 18:27:30 user nova-compute[74613]:   </features>
Nov 29 18:27:30 user nova-compute[74613]:   <clock offset="utc">
Nov 29 18:27:30 user nova-compute[74613]:     <timer name="pit" tickpolicy="delay"/>
Nov 29 18:27:30 user nova-compute[74613]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 29 18:27:30 user nova-compute[74613]:     <timer name="hpet" present="no"/>
Nov 29 18:27:30 user nova-compute[74613]:   </clock>
Nov 29 18:27:30 user nova-compute[74613]:   <cpu mode="custom" match="exact">
Nov 29 18:27:30 user nova-compute[74613]:     <model>Nehalem</model>
Nov 29 18:27:30 user nova-compute[74613]:     <topology sockets="1" cores="1" threads="1"/>
Nov 29 18:27:30 user nova-compute[74613]:   </cpu>
Nov 29 18:27:30 user nova-compute[74613]:   <devices>
Nov 29 18:27:30 user nova-compute[74613]:     <disk type="block" device="disk">
Nov 29 18:27:30 user nova-compute[74613]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 18:27:30 user nova-compute[74613]:       <source dev="/dev/sdd"/>
Nov 29 18:27:30 user nova-compute[74613]:       <target dev="vda" bus="virtio"/>
Nov 29 18:27:30 user nova-compute[74613]:       <serial>df32b250-81a8-44eb-8094-e63e572541fb</serial>
Nov 29 18:27:30 user nova-compute[74613]:     </disk>
Nov 29 18:27:30 user nova-compute[74613]:     <interface type="ethernet">
Nov 29 18:27:30 user nova-compute[74613]:       <mac address="fa:16:3e:9f:c9:eb"/>
Nov 29 18:27:30 user nova-compute[74613]:       <model type="virtio"/>
Nov 29 18:27:30 user nova-compute[74613]:       <mtu size="1442"/>
Nov 29 18:27:30 user nova-compute[74613]:       <target dev="tap5b0f17f1-f9"/>
Nov 29 18:27:30 user nova-compute[74613]:     </interface>
Nov 29 18:27:30 user nova-compute[74613]:     <serial type="pty">
Nov 29 18:27:30 user nova-compute[74613]:       <log file="/opt/stack/data/nova/instances/ce15a55a-61a8-48ac-89e5-3a8723284e38/console.log" append="off"/>
Nov 29 18:27:30 user nova-compute[74613]:     </serial>
Nov 29 18:27:30 user nova-compute[74613]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 29 18:27:30 user nova-compute[74613]:     <video>
Nov 29 18:27:30 user nova-compute[74613]:       <model type="virtio"/>
Nov 29 18:27:30 user nova-compute[74613]:     </video>
Nov 29 18:27:30 user nova-compute[74613]:     <rng model="virtio">
Nov 29 18:27:30 user nova-compute[74613]:       <backend model="random">/dev/urandom</backend>
Nov 29 18:27:30 user nova-compute[74613]:     </rng>
Nov 29 18:27:30 user nova-compute[74613]:     <controller type="usb" index="0" model="none"/>
Nov 29 18:27:30 user nova-compute[74613]:     <memballoon model="virtio">
Nov 29 18:27:30 user nova-compute[74613]:       <stats period="10"/>
Nov 29 18:27:30 user nova-compute[74613]:     </memballoon>
Nov 29 18:27:30 user nova-compute[74613]:   </devices>
Nov 29 18:27:30 user nova-compute[74613]: </domain>
Nov 29 18:27:30 user nova-compute[74613]:  {{(pid=74613) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 29 18:27:30 user nova-compute[74613]: DEBUG nova.virt.libvirt.vif [None req-e92d9deb-2554-4e3d-8e0d-1cf0f3cc832a tempest-TestVolumeBootPattern-1318569205 tempest-TestVolumeBootPattern-1318569205-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T18:27:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-374059741',display_name='tempest-TestVolumeBootPattern-server-374059741',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-374059741',id=49,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBF68W8p1zDe0zv1nt+x55p88jNtkp+KefAo7j9aGY4lI4rRNz+cx5GFQLxMQlgNyvRcFIVQErVtli+AYTX2wE/wzDsGd1AkTeB1AuDgBox6TZ+l5dYZcMLLtIJDQcAEEBg==',key_name='tempest-TestVolumeBootPattern-792688502',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='67390f1402214191904cfbd68c3142a7',ramdisk_id='',reservation_id='r-39gek3k1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1318569205',owner_user_name='tempest-TestVolumeBootPattern-1318569205-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T18:27:21Z,user_data=None,user_id='bedbc6ed47394e2b9125543a8b88a71f',uuid=ce15a55a-61a8-48ac-89e5-3a8723284e38,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5b0f17f1-f9ba-4cf2-a11d-0303c81eb08f", "address": "fa:16:3e:9f:c9:eb", "network": {"id": "4a5179dd-d0b1-44c3-80c1-08dd7b0152f1", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1296336996-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "67390f1402214191904cfbd68c3142a7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5b0f17f1-f9", "ovs_interfaceid": "5b0f17f1-f9ba-4cf2-a11d-0303c81eb08f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74613) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 29 18:27:30 user nova-compute[74613]: DEBUG nova.network.os_vif_util [None req-e92d9deb-2554-4e3d-8e0d-1cf0f3cc832a tempest-TestVolumeBootPattern-1318569205 tempest-TestVolumeBootPattern-1318569205-project-member] Converting VIF {"id": "5b0f17f1-f9ba-4cf2-a11d-0303c81eb08f", "address": "fa:16:3e:9f:c9:eb", "network": {"id": "4a5179dd-d0b1-44c3-80c1-08dd7b0152f1", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1296336996-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "67390f1402214191904cfbd68c3142a7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5b0f17f1-f9", "ovs_interfaceid": "5b0f17f1-f9ba-4cf2-a11d-0303c81eb08f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74613) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 18:27:30 user nova-compute[74613]: DEBUG nova.network.os_vif_util [None req-e92d9deb-2554-4e3d-8e0d-1cf0f3cc832a tempest-TestVolumeBootPattern-1318569205 tempest-TestVolumeBootPattern-1318569205-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9f:c9:eb,bridge_name='br-int',has_traffic_filtering=True,id=5b0f17f1-f9ba-4cf2-a11d-0303c81eb08f,network=Network(4a5179dd-d0b1-44c3-80c1-08dd7b0152f1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5b0f17f1-f9') {{(pid=74613) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 18:27:30 user nova-compute[74613]: DEBUG os_vif [None req-e92d9deb-2554-4e3d-8e0d-1cf0f3cc832a tempest-TestVolumeBootPattern-1318569205 tempest-TestVolumeBootPattern-1318569205-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:9f:c9:eb,bridge_name='br-int',has_traffic_filtering=True,id=5b0f17f1-f9ba-4cf2-a11d-0303c81eb08f,network=Network(4a5179dd-d0b1-44c3-80c1-08dd7b0152f1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5b0f17f1-f9') {{(pid=74613) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 29 18:27:30 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:27:30 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74613) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 18:27:30 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74613) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 29 18:27:30 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:27:30 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '4c4eb9a4-7bbf-5a83-89f5-bea4021517a1', '_type': 'linux-noop'}}, row=False) {{(pid=74613) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 18:27:30 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:27:30 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 18:27:30 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:27:30 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap5b0f17f1-f9, may_exist=True, interface_attrs={}) {{(pid=74613) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 18:27:30 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap5b0f17f1-f9, col_values=(('qos', UUID('6bc60a3f-caf6-4a2d-b8a7-97a4184572b2')),), if_exists=True) {{(pid=74613) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 18:27:30 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap5b0f17f1-f9, col_values=(('external_ids', {'iface-id': '5b0f17f1-f9ba-4cf2-a11d-0303c81eb08f', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:9f:c9:eb', 'vm-uuid': 'ce15a55a-61a8-48ac-89e5-3a8723284e38'}),), if_exists=True) {{(pid=74613) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 18:27:30 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:27:30 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 18:27:30 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:27:30 user nova-compute[74613]: INFO os_vif [None req-e92d9deb-2554-4e3d-8e0d-1cf0f3cc832a tempest-TestVolumeBootPattern-1318569205 tempest-TestVolumeBootPattern-1318569205-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:9f:c9:eb,bridge_name='br-int',has_traffic_filtering=True,id=5b0f17f1-f9ba-4cf2-a11d-0303c81eb08f,network=Network(4a5179dd-d0b1-44c3-80c1-08dd7b0152f1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5b0f17f1-f9')
Nov 29 18:27:30 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-e92d9deb-2554-4e3d-8e0d-1cf0f3cc832a tempest-TestVolumeBootPattern-1318569205 tempest-TestVolumeBootPattern-1318569205-project-member] No BDM found with device name vda, not building metadata. {{(pid=74613) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 18:27:30 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-e92d9deb-2554-4e3d-8e0d-1cf0f3cc832a tempest-TestVolumeBootPattern-1318569205 tempest-TestVolumeBootPattern-1318569205-project-member] No VIF found with MAC fa:16:3e:9f:c9:eb, not building metadata {{(pid=74613) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 29 18:27:31 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:27:32 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:27:32 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:27:32 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:27:32 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:27:32 user nova-compute[74613]: DEBUG nova.compute.manager [req-f8d3daf0-d2e2-4794-acb1-9e5f058ac611 req-b0109da8-1602-45aa-be88-8ee0da574f38 service nova] [instance: ce15a55a-61a8-48ac-89e5-3a8723284e38] Received event network-vif-plugged-5b0f17f1-f9ba-4cf2-a11d-0303c81eb08f {{(pid=74613) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 18:27:32 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-f8d3daf0-d2e2-4794-acb1-9e5f058ac611 req-b0109da8-1602-45aa-be88-8ee0da574f38 service nova] Acquiring lock "ce15a55a-61a8-48ac-89e5-3a8723284e38-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 18:27:32 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-f8d3daf0-d2e2-4794-acb1-9e5f058ac611 req-b0109da8-1602-45aa-be88-8ee0da574f38 service nova] Lock "ce15a55a-61a8-48ac-89e5-3a8723284e38-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 18:27:32 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-f8d3daf0-d2e2-4794-acb1-9e5f058ac611 req-b0109da8-1602-45aa-be88-8ee0da574f38 service nova] Lock "ce15a55a-61a8-48ac-89e5-3a8723284e38-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 18:27:32 user nova-compute[74613]: DEBUG nova.compute.manager [req-f8d3daf0-d2e2-4794-acb1-9e5f058ac611 req-b0109da8-1602-45aa-be88-8ee0da574f38 service nova] [instance: ce15a55a-61a8-48ac-89e5-3a8723284e38] No waiting events found dispatching network-vif-plugged-5b0f17f1-f9ba-4cf2-a11d-0303c81eb08f {{(pid=74613) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 18:27:32 user nova-compute[74613]: WARNING nova.compute.manager [req-f8d3daf0-d2e2-4794-acb1-9e5f058ac611 req-b0109da8-1602-45aa-be88-8ee0da574f38 service nova] [instance: ce15a55a-61a8-48ac-89e5-3a8723284e38] Received unexpected event network-vif-plugged-5b0f17f1-f9ba-4cf2-a11d-0303c81eb08f for instance with vm_state building and task_state spawning.
Nov 29 18:27:34 user nova-compute[74613]: DEBUG nova.compute.manager [req-f7ba62ee-c916-4661-8a88-fc9141df4282 req-62b3f5cb-efad-4236-849b-05fa105eecee service nova] [instance: ce15a55a-61a8-48ac-89e5-3a8723284e38] Received event network-vif-plugged-5b0f17f1-f9ba-4cf2-a11d-0303c81eb08f {{(pid=74613) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 18:27:34 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-f7ba62ee-c916-4661-8a88-fc9141df4282 req-62b3f5cb-efad-4236-849b-05fa105eecee service nova] Acquiring lock "ce15a55a-61a8-48ac-89e5-3a8723284e38-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 18:27:34 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-f7ba62ee-c916-4661-8a88-fc9141df4282 req-62b3f5cb-efad-4236-849b-05fa105eecee service nova] Lock "ce15a55a-61a8-48ac-89e5-3a8723284e38-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 18:27:34 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-f7ba62ee-c916-4661-8a88-fc9141df4282 req-62b3f5cb-efad-4236-849b-05fa105eecee service nova] Lock "ce15a55a-61a8-48ac-89e5-3a8723284e38-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 18:27:34 user nova-compute[74613]: DEBUG nova.compute.manager [req-f7ba62ee-c916-4661-8a88-fc9141df4282 req-62b3f5cb-efad-4236-849b-05fa105eecee service nova] [instance: ce15a55a-61a8-48ac-89e5-3a8723284e38] No waiting events found dispatching network-vif-plugged-5b0f17f1-f9ba-4cf2-a11d-0303c81eb08f {{(pid=74613) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 18:27:34 user nova-compute[74613]: WARNING nova.compute.manager [req-f7ba62ee-c916-4661-8a88-fc9141df4282 req-62b3f5cb-efad-4236-849b-05fa105eecee service nova] [instance: ce15a55a-61a8-48ac-89e5-3a8723284e38] Received unexpected event network-vif-plugged-5b0f17f1-f9ba-4cf2-a11d-0303c81eb08f for instance with vm_state building and task_state spawning.
Nov 29 18:27:35 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:27:36 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:27:36 user nova-compute[74613]: DEBUG nova.compute.manager [None req-e92d9deb-2554-4e3d-8e0d-1cf0f3cc832a tempest-TestVolumeBootPattern-1318569205 tempest-TestVolumeBootPattern-1318569205-project-member] [instance: ce15a55a-61a8-48ac-89e5-3a8723284e38] Instance event wait completed in 0 seconds for  {{(pid=74613) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 29 18:27:36 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-e92d9deb-2554-4e3d-8e0d-1cf0f3cc832a tempest-TestVolumeBootPattern-1318569205 tempest-TestVolumeBootPattern-1318569205-project-member] [instance: ce15a55a-61a8-48ac-89e5-3a8723284e38] Guest created on hypervisor {{(pid=74613) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 29 18:27:36 user nova-compute[74613]: INFO nova.virt.libvirt.driver [-] [instance: ce15a55a-61a8-48ac-89e5-3a8723284e38] Instance spawned successfully.
Nov 29 18:27:36 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-e92d9deb-2554-4e3d-8e0d-1cf0f3cc832a tempest-TestVolumeBootPattern-1318569205 tempest-TestVolumeBootPattern-1318569205-project-member] [instance: ce15a55a-61a8-48ac-89e5-3a8723284e38] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74613) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 29 18:27:36 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-e92d9deb-2554-4e3d-8e0d-1cf0f3cc832a tempest-TestVolumeBootPattern-1318569205 tempest-TestVolumeBootPattern-1318569205-project-member] [instance: ce15a55a-61a8-48ac-89e5-3a8723284e38] Found default for hw_cdrom_bus of ide {{(pid=74613) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 18:27:36 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-e92d9deb-2554-4e3d-8e0d-1cf0f3cc832a tempest-TestVolumeBootPattern-1318569205 tempest-TestVolumeBootPattern-1318569205-project-member] [instance: ce15a55a-61a8-48ac-89e5-3a8723284e38] Found default for hw_disk_bus of virtio {{(pid=74613) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 18:27:36 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-e92d9deb-2554-4e3d-8e0d-1cf0f3cc832a tempest-TestVolumeBootPattern-1318569205 tempest-TestVolumeBootPattern-1318569205-project-member] [instance: ce15a55a-61a8-48ac-89e5-3a8723284e38] Found default for hw_input_bus of None {{(pid=74613) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 18:27:36 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-e92d9deb-2554-4e3d-8e0d-1cf0f3cc832a tempest-TestVolumeBootPattern-1318569205 tempest-TestVolumeBootPattern-1318569205-project-member] [instance: ce15a55a-61a8-48ac-89e5-3a8723284e38] Found default for hw_pointer_model of None {{(pid=74613) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 18:27:36 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-e92d9deb-2554-4e3d-8e0d-1cf0f3cc832a tempest-TestVolumeBootPattern-1318569205 tempest-TestVolumeBootPattern-1318569205-project-member] [instance: ce15a55a-61a8-48ac-89e5-3a8723284e38] Found default for hw_video_model of virtio {{(pid=74613) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 18:27:36 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-e92d9deb-2554-4e3d-8e0d-1cf0f3cc832a tempest-TestVolumeBootPattern-1318569205 tempest-TestVolumeBootPattern-1318569205-project-member] [instance: ce15a55a-61a8-48ac-89e5-3a8723284e38] Found default for hw_vif_model of virtio {{(pid=74613) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 18:27:36 user nova-compute[74613]: INFO nova.compute.manager [None req-e92d9deb-2554-4e3d-8e0d-1cf0f3cc832a tempest-TestVolumeBootPattern-1318569205 tempest-TestVolumeBootPattern-1318569205-project-member] [instance: ce15a55a-61a8-48ac-89e5-3a8723284e38] Took 7.80 seconds to spawn the instance on the hypervisor.
Nov 29 18:27:36 user nova-compute[74613]: DEBUG nova.compute.manager [None req-e92d9deb-2554-4e3d-8e0d-1cf0f3cc832a tempest-TestVolumeBootPattern-1318569205 tempest-TestVolumeBootPattern-1318569205-project-member] [instance: ce15a55a-61a8-48ac-89e5-3a8723284e38] Checking state {{(pid=74613) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 29 18:27:37 user nova-compute[74613]: INFO nova.compute.manager [None req-e92d9deb-2554-4e3d-8e0d-1cf0f3cc832a tempest-TestVolumeBootPattern-1318569205 tempest-TestVolumeBootPattern-1318569205-project-member] [instance: ce15a55a-61a8-48ac-89e5-3a8723284e38] Took 17.12 seconds to build instance.
Nov 29 18:27:37 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-e92d9deb-2554-4e3d-8e0d-1cf0f3cc832a tempest-TestVolumeBootPattern-1318569205 tempest-TestVolumeBootPattern-1318569205-project-member] Lock "ce15a55a-61a8-48ac-89e5-3a8723284e38" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 17.466s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 18:27:40 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:27:45 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 18:27:45 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:27:45 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74613) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 29 18:27:45 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74613) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 18:27:45 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74613) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 18:27:45 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:27:45 user nova-compute[74613]: DEBUG oslo_service.periodic_task [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74613) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 18:27:46 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:27:46 user nova-compute[74613]: DEBUG oslo_service.periodic_task [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74613) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 18:27:47 user nova-compute[74613]: DEBUG oslo_service.periodic_task [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74613) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 18:27:48 user nova-compute[74613]: DEBUG oslo_service.periodic_task [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74613) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 18:27:48 user nova-compute[74613]: DEBUG nova.compute.manager [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Starting heal instance info cache {{(pid=74613) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 29 18:27:48 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Acquiring lock "refresh_cache-059e3f87-a811-4ac7-b846-2f6d202a919f" {{(pid=74613) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 18:27:48 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Acquired lock "refresh_cache-059e3f87-a811-4ac7-b846-2f6d202a919f" {{(pid=74613) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 18:27:48 user nova-compute[74613]: DEBUG nova.network.neutron [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] [instance: 059e3f87-a811-4ac7-b846-2f6d202a919f] Forcefully refreshing network info cache for instance {{(pid=74613) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 29 18:27:49 user nova-compute[74613]: DEBUG nova.network.neutron [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] [instance: 059e3f87-a811-4ac7-b846-2f6d202a919f] Updating instance_info_cache with network_info: [{"id": "91dd58f7-d736-4a98-b6a6-f4d1bc6dd8dd", "address": "fa:16:3e:6a:c5:f2", "network": {"id": "4a5179dd-d0b1-44c3-80c1-08dd7b0152f1", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1296336996-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.212", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "67390f1402214191904cfbd68c3142a7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap91dd58f7-d7", "ovs_interfaceid": "91dd58f7-d736-4a98-b6a6-f4d1bc6dd8dd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74613) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 18:27:49 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Releasing lock "refresh_cache-059e3f87-a811-4ac7-b846-2f6d202a919f" {{(pid=74613) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 18:27:49 user nova-compute[74613]: DEBUG nova.compute.manager [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] [instance: 059e3f87-a811-4ac7-b846-2f6d202a919f] Updated the network info_cache for instance {{(pid=74613) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 29 18:27:49 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:27:50 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:27:50 user nova-compute[74613]: DEBUG oslo_service.periodic_task [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74613) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 18:27:50 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 18:27:50 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 18:27:50 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 18:27:50 user nova-compute[74613]: DEBUG nova.compute.resource_tracker [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Auditing locally available compute resources for user (node: user) {{(pid=74613) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 29 18:27:50 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:27:50 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=74613) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 29 18:27:50 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5227902d-b2b9-40a6-988f-3c02c52404f3/disk --force-share --output=json {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:27:50 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5227902d-b2b9-40a6-988f-3c02c52404f3/disk --force-share --output=json" returned: 0 in 0.220s {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:27:50 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5227902d-b2b9-40a6-988f-3c02c52404f3/disk --force-share --output=json {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:27:51 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5227902d-b2b9-40a6-988f-3c02c52404f3/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:27:51 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=74613) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 29 18:27:51 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:27:51 user nova-compute[74613]: WARNING nova.virt.libvirt.driver [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 18:27:51 user nova-compute[74613]: WARNING nova.virt.libvirt.driver [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 18:27:51 user nova-compute[74613]: DEBUG nova.compute.resource_tracker [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Hypervisor/Node resource view: name=user free_ram=8612MB free_disk=24.907569885253906GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74613) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 29 18:27:51 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 18:27:51 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 18:27:51 user nova-compute[74613]: DEBUG nova.compute.resource_tracker [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Instance 5227902d-b2b9-40a6-988f-3c02c52404f3 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74613) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 18:27:51 user nova-compute[74613]: DEBUG nova.compute.resource_tracker [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Instance 059e3f87-a811-4ac7-b846-2f6d202a919f actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74613) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 18:27:51 user nova-compute[74613]: DEBUG nova.compute.resource_tracker [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Instance ce15a55a-61a8-48ac-89e5-3a8723284e38 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74613) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 18:27:51 user nova-compute[74613]: DEBUG nova.compute.resource_tracker [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=74613) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 29 18:27:51 user nova-compute[74613]: DEBUG nova.compute.resource_tracker [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Final resource view: name=user phys_ram=16011MB used_ram=2048MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=3 pci_stats=[] {{(pid=74613) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 29 18:27:51 user nova-compute[74613]: DEBUG nova.scheduler.client.report [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Refreshing inventories for resource provider 639d980e-3b12-44b1-b8f4-1812416fa4dd {{(pid=74613) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 29 18:27:51 user nova-compute[74613]: DEBUG nova.scheduler.client.report [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Updating ProviderTree inventory for provider 639d980e-3b12-44b1-b8f4-1812416fa4dd from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74613) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 29 18:27:51 user nova-compute[74613]: DEBUG nova.compute.provider_tree [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Updating inventory in ProviderTree for provider 639d980e-3b12-44b1-b8f4-1812416fa4dd with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74613) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 29 18:27:51 user nova-compute[74613]: DEBUG nova.scheduler.client.report [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Refreshing aggregate associations for resource provider 639d980e-3b12-44b1-b8f4-1812416fa4dd, aggregates: None {{(pid=74613) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 29 18:27:51 user nova-compute[74613]: DEBUG nova.scheduler.client.report [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Refreshing trait associations for resource provider 639d980e-3b12-44b1-b8f4-1812416fa4dd, traits: HW_CPU_X86_SSE,COMPUTE_VOLUME_EXTEND,COMPUTE_ACCELERATORS,HW_CPU_X86_SSE41,COMPUTE_STORAGE_BUS_IDE,COMPUTE_NODE,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,HW_CPU_X86_MMX,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,HW_CPU_X86_SSE2,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_STORAGE_BUS_USB,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_STORAGE_BUS_SATA,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_DEVICE_TAGGING,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_RESCUE_BFV,HW_CPU_X86_SSSE3,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_TRUSTED_CERTS,HW_CPU_X86_SSE42,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_STORAGE_BUS_FDC {{(pid=74613) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 29 18:27:52 user nova-compute[74613]: DEBUG nova.compute.provider_tree [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Inventory has not changed in ProviderTree for provider: 639d980e-3b12-44b1-b8f4-1812416fa4dd {{(pid=74613) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 18:27:52 user nova-compute[74613]: DEBUG nova.scheduler.client.report [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Inventory has not changed for provider 639d980e-3b12-44b1-b8f4-1812416fa4dd based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74613) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 18:27:52 user nova-compute[74613]: DEBUG nova.compute.resource_tracker [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Compute_service record updated for user:user {{(pid=74613) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 29 18:27:52 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.556s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 18:27:53 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-fe29fd42-9102-4a99-b4fb-c8a3832b210b tempest-SnapshotDataIntegrityTests-1810787156 tempest-SnapshotDataIntegrityTests-1810787156-project-member] Acquiring lock "5227902d-b2b9-40a6-988f-3c02c52404f3" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 18:27:53 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-fe29fd42-9102-4a99-b4fb-c8a3832b210b tempest-SnapshotDataIntegrityTests-1810787156 tempest-SnapshotDataIntegrityTests-1810787156-project-member] Lock "5227902d-b2b9-40a6-988f-3c02c52404f3" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 18:27:53 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-fe29fd42-9102-4a99-b4fb-c8a3832b210b tempest-SnapshotDataIntegrityTests-1810787156 tempest-SnapshotDataIntegrityTests-1810787156-project-member] Acquiring lock "5227902d-b2b9-40a6-988f-3c02c52404f3-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 18:27:53 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-fe29fd42-9102-4a99-b4fb-c8a3832b210b tempest-SnapshotDataIntegrityTests-1810787156 tempest-SnapshotDataIntegrityTests-1810787156-project-member] Lock "5227902d-b2b9-40a6-988f-3c02c52404f3-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 18:27:53 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-fe29fd42-9102-4a99-b4fb-c8a3832b210b tempest-SnapshotDataIntegrityTests-1810787156 tempest-SnapshotDataIntegrityTests-1810787156-project-member] Lock "5227902d-b2b9-40a6-988f-3c02c52404f3-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 18:27:53 user nova-compute[74613]: INFO nova.compute.manager [None req-fe29fd42-9102-4a99-b4fb-c8a3832b210b tempest-SnapshotDataIntegrityTests-1810787156 tempest-SnapshotDataIntegrityTests-1810787156-project-member] [instance: 5227902d-b2b9-40a6-988f-3c02c52404f3] Terminating instance
Nov 29 18:27:53 user nova-compute[74613]: DEBUG nova.compute.manager [None req-fe29fd42-9102-4a99-b4fb-c8a3832b210b tempest-SnapshotDataIntegrityTests-1810787156 tempest-SnapshotDataIntegrityTests-1810787156-project-member] [instance: 5227902d-b2b9-40a6-988f-3c02c52404f3] Start destroying the instance on the hypervisor. {{(pid=74613) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 29 18:27:53 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:27:53 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:27:53 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:27:53 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:27:54 user nova-compute[74613]: DEBUG oslo_service.periodic_task [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74613) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 18:27:54 user nova-compute[74613]: DEBUG oslo_service.periodic_task [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74613) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 18:27:54 user nova-compute[74613]: DEBUG oslo_service.periodic_task [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74613) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 18:27:54 user nova-compute[74613]: DEBUG oslo_service.periodic_task [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74613) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 18:27:54 user nova-compute[74613]: DEBUG nova.compute.manager [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74613) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 29 18:27:54 user nova-compute[74613]: DEBUG nova.compute.manager [req-81007c39-4a5c-4db5-bc04-f1a5781b55e6 req-83386a20-3056-46bd-b5a7-718d23305709 service nova] [instance: 5227902d-b2b9-40a6-988f-3c02c52404f3] Received event network-vif-unplugged-11900168-d650-4db6-8f65-21f1f9c4b603 {{(pid=74613) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 18:27:54 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-81007c39-4a5c-4db5-bc04-f1a5781b55e6 req-83386a20-3056-46bd-b5a7-718d23305709 service nova] Acquiring lock "5227902d-b2b9-40a6-988f-3c02c52404f3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 18:27:54 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-81007c39-4a5c-4db5-bc04-f1a5781b55e6 req-83386a20-3056-46bd-b5a7-718d23305709 service nova] Lock "5227902d-b2b9-40a6-988f-3c02c52404f3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 18:27:54 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-81007c39-4a5c-4db5-bc04-f1a5781b55e6 req-83386a20-3056-46bd-b5a7-718d23305709 service nova] Lock "5227902d-b2b9-40a6-988f-3c02c52404f3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 18:27:54 user nova-compute[74613]: DEBUG nova.compute.manager [req-81007c39-4a5c-4db5-bc04-f1a5781b55e6 req-83386a20-3056-46bd-b5a7-718d23305709 service nova] [instance: 5227902d-b2b9-40a6-988f-3c02c52404f3] No waiting events found dispatching network-vif-unplugged-11900168-d650-4db6-8f65-21f1f9c4b603 {{(pid=74613) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 18:27:54 user nova-compute[74613]: DEBUG nova.compute.manager [req-81007c39-4a5c-4db5-bc04-f1a5781b55e6 req-83386a20-3056-46bd-b5a7-718d23305709 service nova] [instance: 5227902d-b2b9-40a6-988f-3c02c52404f3] Received event network-vif-unplugged-11900168-d650-4db6-8f65-21f1f9c4b603 for instance with task_state deleting. {{(pid=74613) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 29 18:27:54 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:27:54 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:27:54 user nova-compute[74613]: INFO nova.virt.libvirt.driver [-] [instance: 5227902d-b2b9-40a6-988f-3c02c52404f3] Instance destroyed successfully.
Nov 29 18:27:54 user nova-compute[74613]: DEBUG nova.objects.instance [None req-fe29fd42-9102-4a99-b4fb-c8a3832b210b tempest-SnapshotDataIntegrityTests-1810787156 tempest-SnapshotDataIntegrityTests-1810787156-project-member] Lazy-loading 'resources' on Instance uuid 5227902d-b2b9-40a6-988f-3c02c52404f3 {{(pid=74613) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 18:27:54 user nova-compute[74613]: DEBUG nova.virt.libvirt.vif [None req-fe29fd42-9102-4a99-b4fb-c8a3832b210b tempest-SnapshotDataIntegrityTests-1810787156 tempest-SnapshotDataIntegrityTests-1810787156-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T18:20:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-1230319266',display_name='tempest-SnapshotDataIntegrityTests-server-1230319266',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-1230319266',id=44,image_ref='4217f428-8d9d-4ee1-9614-642d26d90c46',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBK/8JM2RiAE977sqn2CDbjaI/GaK+vQXJgKx2mefD/Di7V3UryfYnJ6tRssF59ZZL0dPxhn/FkiNzSo8zeqcl3VxbkmNOgzfTwZ7SEeKGN/6sflv/HsVRPadR+Y2yhA3uw==',key_name='tempest-keypair-1596414286',keypairs=<?>,launch_index=0,launched_at=2023-11-29T18:20:59Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='31a87cb1f6e14287abcfae98de155491',ramdisk_id='',reservation_id='r-viuvf1mj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='4217f428-8d9d-4ee1-9614-642d26d90c46',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-SnapshotDataIntegrityTests-1810787156',owner_user_name='tempest-SnapshotDataIntegrityTests-1810787156-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-29T18:21:00Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8acdfa3d177c42b98b6d320668aad126',uuid=5227902d-b2b9-40a6-988f-3c02c52404f3,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "11900168-d650-4db6-8f65-21f1f9c4b603", "address": "fa:16:3e:40:72:ca", "network": {"id": "8951bb42-2dd0-4887-b0d1-fdb8d3ac7589", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1016730518-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.120", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "31a87cb1f6e14287abcfae98de155491", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap11900168-d6", "ovs_interfaceid": "11900168-d650-4db6-8f65-21f1f9c4b603", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74613) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 29 18:27:54 user nova-compute[74613]: DEBUG nova.network.os_vif_util [None req-fe29fd42-9102-4a99-b4fb-c8a3832b210b tempest-SnapshotDataIntegrityTests-1810787156 tempest-SnapshotDataIntegrityTests-1810787156-project-member] Converting VIF {"id": "11900168-d650-4db6-8f65-21f1f9c4b603", "address": "fa:16:3e:40:72:ca", "network": {"id": "8951bb42-2dd0-4887-b0d1-fdb8d3ac7589", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1016730518-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.120", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "31a87cb1f6e14287abcfae98de155491", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap11900168-d6", "ovs_interfaceid": "11900168-d650-4db6-8f65-21f1f9c4b603", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74613) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 18:27:54 user nova-compute[74613]: DEBUG nova.network.os_vif_util [None req-fe29fd42-9102-4a99-b4fb-c8a3832b210b tempest-SnapshotDataIntegrityTests-1810787156 tempest-SnapshotDataIntegrityTests-1810787156-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:40:72:ca,bridge_name='br-int',has_traffic_filtering=True,id=11900168-d650-4db6-8f65-21f1f9c4b603,network=Network(8951bb42-2dd0-4887-b0d1-fdb8d3ac7589),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap11900168-d6') {{(pid=74613) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 18:27:54 user nova-compute[74613]: DEBUG os_vif [None req-fe29fd42-9102-4a99-b4fb-c8a3832b210b tempest-SnapshotDataIntegrityTests-1810787156 tempest-SnapshotDataIntegrityTests-1810787156-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:40:72:ca,bridge_name='br-int',has_traffic_filtering=True,id=11900168-d650-4db6-8f65-21f1f9c4b603,network=Network(8951bb42-2dd0-4887-b0d1-fdb8d3ac7589),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap11900168-d6') {{(pid=74613) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 29 18:27:54 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:27:54 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap11900168-d6, bridge=br-int, if_exists=True) {{(pid=74613) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 18:27:54 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:27:54 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 18:27:54 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:27:54 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=effea2a8-9c19-4e0a-9c80-ec4b3c3dabb3) {{(pid=74613) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 18:27:54 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:27:54 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:27:54 user nova-compute[74613]: INFO os_vif [None req-fe29fd42-9102-4a99-b4fb-c8a3832b210b tempest-SnapshotDataIntegrityTests-1810787156 tempest-SnapshotDataIntegrityTests-1810787156-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:40:72:ca,bridge_name='br-int',has_traffic_filtering=True,id=11900168-d650-4db6-8f65-21f1f9c4b603,network=Network(8951bb42-2dd0-4887-b0d1-fdb8d3ac7589),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap11900168-d6')
Nov 29 18:27:54 user nova-compute[74613]: INFO nova.virt.libvirt.driver [None req-fe29fd42-9102-4a99-b4fb-c8a3832b210b tempest-SnapshotDataIntegrityTests-1810787156 tempest-SnapshotDataIntegrityTests-1810787156-project-member] [instance: 5227902d-b2b9-40a6-988f-3c02c52404f3] Deleting instance files /opt/stack/data/nova/instances/5227902d-b2b9-40a6-988f-3c02c52404f3_del
Nov 29 18:27:54 user nova-compute[74613]: INFO nova.virt.libvirt.driver [None req-fe29fd42-9102-4a99-b4fb-c8a3832b210b tempest-SnapshotDataIntegrityTests-1810787156 tempest-SnapshotDataIntegrityTests-1810787156-project-member] [instance: 5227902d-b2b9-40a6-988f-3c02c52404f3] Deletion of /opt/stack/data/nova/instances/5227902d-b2b9-40a6-988f-3c02c52404f3_del complete
Nov 29 18:27:54 user nova-compute[74613]: INFO nova.compute.manager [None req-fe29fd42-9102-4a99-b4fb-c8a3832b210b tempest-SnapshotDataIntegrityTests-1810787156 tempest-SnapshotDataIntegrityTests-1810787156-project-member] [instance: 5227902d-b2b9-40a6-988f-3c02c52404f3] Took 0.87 seconds to destroy the instance on the hypervisor.
Nov 29 18:27:54 user nova-compute[74613]: DEBUG oslo.service.loopingcall [None req-fe29fd42-9102-4a99-b4fb-c8a3832b210b tempest-SnapshotDataIntegrityTests-1810787156 tempest-SnapshotDataIntegrityTests-1810787156-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74613) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 29 18:27:54 user nova-compute[74613]: DEBUG nova.compute.manager [-] [instance: 5227902d-b2b9-40a6-988f-3c02c52404f3] Deallocating network for instance {{(pid=74613) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 29 18:27:54 user nova-compute[74613]: DEBUG nova.network.neutron [-] [instance: 5227902d-b2b9-40a6-988f-3c02c52404f3] deallocate_for_instance() {{(pid=74613) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 29 18:27:56 user nova-compute[74613]: DEBUG nova.compute.manager [req-2060f97e-c043-4932-86e4-4ffce855634b req-1a96d43d-b59b-4ff7-b6fa-e24e1785f571 service nova] [instance: 5227902d-b2b9-40a6-988f-3c02c52404f3] Received event network-vif-plugged-11900168-d650-4db6-8f65-21f1f9c4b603 {{(pid=74613) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 18:27:56 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-2060f97e-c043-4932-86e4-4ffce855634b req-1a96d43d-b59b-4ff7-b6fa-e24e1785f571 service nova] Acquiring lock "5227902d-b2b9-40a6-988f-3c02c52404f3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 18:27:56 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-2060f97e-c043-4932-86e4-4ffce855634b req-1a96d43d-b59b-4ff7-b6fa-e24e1785f571 service nova] Lock "5227902d-b2b9-40a6-988f-3c02c52404f3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 18:27:56 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-2060f97e-c043-4932-86e4-4ffce855634b req-1a96d43d-b59b-4ff7-b6fa-e24e1785f571 service nova] Lock "5227902d-b2b9-40a6-988f-3c02c52404f3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 18:27:56 user nova-compute[74613]: DEBUG nova.compute.manager [req-2060f97e-c043-4932-86e4-4ffce855634b req-1a96d43d-b59b-4ff7-b6fa-e24e1785f571 service nova] [instance: 5227902d-b2b9-40a6-988f-3c02c52404f3] No waiting events found dispatching network-vif-plugged-11900168-d650-4db6-8f65-21f1f9c4b603 {{(pid=74613) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 18:27:56 user nova-compute[74613]: WARNING nova.compute.manager [req-2060f97e-c043-4932-86e4-4ffce855634b req-1a96d43d-b59b-4ff7-b6fa-e24e1785f571 service nova] [instance: 5227902d-b2b9-40a6-988f-3c02c52404f3] Received unexpected event network-vif-plugged-11900168-d650-4db6-8f65-21f1f9c4b603 for instance with vm_state active and task_state deleting.
Nov 29 18:27:56 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:27:56 user nova-compute[74613]: DEBUG nova.network.neutron [-] [instance: 5227902d-b2b9-40a6-988f-3c02c52404f3] Updating instance_info_cache with network_info: [] {{(pid=74613) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 18:27:56 user nova-compute[74613]: INFO nova.compute.manager [-] [instance: 5227902d-b2b9-40a6-988f-3c02c52404f3] Took 1.75 seconds to deallocate network for instance.
Nov 29 18:27:56 user nova-compute[74613]: DEBUG nova.compute.manager [req-7834b0a6-c761-43b3-a1fc-c7ac3756b8fb req-d606ec3a-3ffe-4fee-9367-11890fcb7dcb service nova] [instance: 5227902d-b2b9-40a6-988f-3c02c52404f3] Received event network-vif-deleted-11900168-d650-4db6-8f65-21f1f9c4b603 {{(pid=74613) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 18:27:56 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-fe29fd42-9102-4a99-b4fb-c8a3832b210b tempest-SnapshotDataIntegrityTests-1810787156 tempest-SnapshotDataIntegrityTests-1810787156-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 18:27:56 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-fe29fd42-9102-4a99-b4fb-c8a3832b210b tempest-SnapshotDataIntegrityTests-1810787156 tempest-SnapshotDataIntegrityTests-1810787156-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 18:27:56 user nova-compute[74613]: DEBUG nova.compute.provider_tree [None req-fe29fd42-9102-4a99-b4fb-c8a3832b210b tempest-SnapshotDataIntegrityTests-1810787156 tempest-SnapshotDataIntegrityTests-1810787156-project-member] Inventory has not changed in ProviderTree for provider: 639d980e-3b12-44b1-b8f4-1812416fa4dd {{(pid=74613) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 18:27:56 user nova-compute[74613]: DEBUG nova.scheduler.client.report [None req-fe29fd42-9102-4a99-b4fb-c8a3832b210b tempest-SnapshotDataIntegrityTests-1810787156 tempest-SnapshotDataIntegrityTests-1810787156-project-member] Inventory has not changed for provider 639d980e-3b12-44b1-b8f4-1812416fa4dd based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74613) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 18:27:56 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-fe29fd42-9102-4a99-b4fb-c8a3832b210b tempest-SnapshotDataIntegrityTests-1810787156 tempest-SnapshotDataIntegrityTests-1810787156-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.160s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 18:27:56 user nova-compute[74613]: INFO nova.scheduler.client.report [None req-fe29fd42-9102-4a99-b4fb-c8a3832b210b tempest-SnapshotDataIntegrityTests-1810787156 tempest-SnapshotDataIntegrityTests-1810787156-project-member] Deleted allocations for instance 5227902d-b2b9-40a6-988f-3c02c52404f3
Nov 29 18:27:56 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-fe29fd42-9102-4a99-b4fb-c8a3832b210b tempest-SnapshotDataIntegrityTests-1810787156 tempest-SnapshotDataIntegrityTests-1810787156-project-member] Lock "5227902d-b2b9-40a6-988f-3c02c52404f3" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.958s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 18:27:56 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:27:58 user nova-compute[74613]: DEBUG oslo_service.periodic_task [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=74613) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 18:27:58 user nova-compute[74613]: DEBUG nova.compute.manager [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Cleaning up deleted instances {{(pid=74613) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 29 18:27:58 user nova-compute[74613]: DEBUG nova.compute.manager [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] There are 0 instances to clean {{(pid=74613) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 29 18:27:58 user nova-compute[74613]: DEBUG oslo_service.periodic_task [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=74613) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 18:27:58 user nova-compute[74613]: DEBUG nova.compute.manager [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Cleaning up deleted instances with incomplete migration  {{(pid=74613) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 29 18:27:58 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:27:59 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:28:01 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:28:01 user nova-compute[74613]: DEBUG oslo_service.periodic_task [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74613) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 18:28:02 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:28:04 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:28:05 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:28:06 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:28:07 user nova-compute[74613]: DEBUG oslo_service.periodic_task [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=74613) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 18:28:08 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-94544dd2-5dec-47c7-9969-7e547967e049 tempest-TestMinimumBasicScenario-1484766802 tempest-TestMinimumBasicScenario-1484766802-project-member] Acquiring lock "bc13be44-f39f-4521-b209-0234f0515ffd" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 18:28:08 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-94544dd2-5dec-47c7-9969-7e547967e049 tempest-TestMinimumBasicScenario-1484766802 tempest-TestMinimumBasicScenario-1484766802-project-member] Lock "bc13be44-f39f-4521-b209-0234f0515ffd" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 18:28:08 user nova-compute[74613]: DEBUG nova.compute.manager [None req-94544dd2-5dec-47c7-9969-7e547967e049 tempest-TestMinimumBasicScenario-1484766802 tempest-TestMinimumBasicScenario-1484766802-project-member] [instance: bc13be44-f39f-4521-b209-0234f0515ffd] Starting instance... {{(pid=74613) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 29 18:28:08 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-94544dd2-5dec-47c7-9969-7e547967e049 tempest-TestMinimumBasicScenario-1484766802 tempest-TestMinimumBasicScenario-1484766802-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 18:28:08 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-94544dd2-5dec-47c7-9969-7e547967e049 tempest-TestMinimumBasicScenario-1484766802 tempest-TestMinimumBasicScenario-1484766802-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 18:28:09 user nova-compute[74613]: DEBUG nova.virt.hardware [None req-94544dd2-5dec-47c7-9969-7e547967e049 tempest-TestMinimumBasicScenario-1484766802 tempest-TestMinimumBasicScenario-1484766802-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74613) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 29 18:28:09 user nova-compute[74613]: INFO nova.compute.claims [None req-94544dd2-5dec-47c7-9969-7e547967e049 tempest-TestMinimumBasicScenario-1484766802 tempest-TestMinimumBasicScenario-1484766802-project-member] [instance: bc13be44-f39f-4521-b209-0234f0515ffd] Claim successful on node user
Nov 29 18:28:09 user nova-compute[74613]: DEBUG nova.compute.provider_tree [None req-94544dd2-5dec-47c7-9969-7e547967e049 tempest-TestMinimumBasicScenario-1484766802 tempest-TestMinimumBasicScenario-1484766802-project-member] Inventory has not changed in ProviderTree for provider: 639d980e-3b12-44b1-b8f4-1812416fa4dd {{(pid=74613) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 18:28:09 user nova-compute[74613]: DEBUG nova.scheduler.client.report [None req-94544dd2-5dec-47c7-9969-7e547967e049 tempest-TestMinimumBasicScenario-1484766802 tempest-TestMinimumBasicScenario-1484766802-project-member] Inventory has not changed for provider 639d980e-3b12-44b1-b8f4-1812416fa4dd based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74613) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 18:28:09 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-94544dd2-5dec-47c7-9969-7e547967e049 tempest-TestMinimumBasicScenario-1484766802 tempest-TestMinimumBasicScenario-1484766802-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.261s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 18:28:09 user nova-compute[74613]: DEBUG nova.compute.manager [None req-94544dd2-5dec-47c7-9969-7e547967e049 tempest-TestMinimumBasicScenario-1484766802 tempest-TestMinimumBasicScenario-1484766802-project-member] [instance: bc13be44-f39f-4521-b209-0234f0515ffd] Start building networks asynchronously for instance. {{(pid=74613) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 29 18:28:09 user nova-compute[74613]: DEBUG nova.compute.manager [None req-94544dd2-5dec-47c7-9969-7e547967e049 tempest-TestMinimumBasicScenario-1484766802 tempest-TestMinimumBasicScenario-1484766802-project-member] [instance: bc13be44-f39f-4521-b209-0234f0515ffd] Allocating IP information in the background. {{(pid=74613) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 29 18:28:09 user nova-compute[74613]: DEBUG nova.network.neutron [None req-94544dd2-5dec-47c7-9969-7e547967e049 tempest-TestMinimumBasicScenario-1484766802 tempest-TestMinimumBasicScenario-1484766802-project-member] [instance: bc13be44-f39f-4521-b209-0234f0515ffd] allocate_for_instance() {{(pid=74613) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 29 18:28:09 user nova-compute[74613]: INFO nova.virt.libvirt.driver [None req-94544dd2-5dec-47c7-9969-7e547967e049 tempest-TestMinimumBasicScenario-1484766802 tempest-TestMinimumBasicScenario-1484766802-project-member] [instance: bc13be44-f39f-4521-b209-0234f0515ffd] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 29 18:28:09 user nova-compute[74613]: DEBUG nova.compute.manager [None req-94544dd2-5dec-47c7-9969-7e547967e049 tempest-TestMinimumBasicScenario-1484766802 tempest-TestMinimumBasicScenario-1484766802-project-member] [instance: bc13be44-f39f-4521-b209-0234f0515ffd] Start building block device mappings for instance. {{(pid=74613) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 29 18:28:09 user nova-compute[74613]: DEBUG nova.policy [None req-94544dd2-5dec-47c7-9969-7e547967e049 tempest-TestMinimumBasicScenario-1484766802 tempest-TestMinimumBasicScenario-1484766802-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'e34c7321ef954c23a591fdb8641df8bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad92722fce424af588f1a0067e8726a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74613) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 29 18:28:09 user nova-compute[74613]: DEBUG nova.compute.manager [None req-94544dd2-5dec-47c7-9969-7e547967e049 tempest-TestMinimumBasicScenario-1484766802 tempest-TestMinimumBasicScenario-1484766802-project-member] [instance: bc13be44-f39f-4521-b209-0234f0515ffd] Start spawning the instance on the hypervisor. {{(pid=74613) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 29 18:28:09 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-94544dd2-5dec-47c7-9969-7e547967e049 tempest-TestMinimumBasicScenario-1484766802 tempest-TestMinimumBasicScenario-1484766802-project-member] [instance: bc13be44-f39f-4521-b209-0234f0515ffd] Creating instance directory {{(pid=74613) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 29 18:28:09 user nova-compute[74613]: INFO nova.virt.libvirt.driver [None req-94544dd2-5dec-47c7-9969-7e547967e049 tempest-TestMinimumBasicScenario-1484766802 tempest-TestMinimumBasicScenario-1484766802-project-member] [instance: bc13be44-f39f-4521-b209-0234f0515ffd] Creating image(s)
Nov 29 18:28:09 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-94544dd2-5dec-47c7-9969-7e547967e049 tempest-TestMinimumBasicScenario-1484766802 tempest-TestMinimumBasicScenario-1484766802-project-member] Acquiring lock "/opt/stack/data/nova/instances/bc13be44-f39f-4521-b209-0234f0515ffd/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 18:28:09 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-94544dd2-5dec-47c7-9969-7e547967e049 tempest-TestMinimumBasicScenario-1484766802 tempest-TestMinimumBasicScenario-1484766802-project-member] Lock "/opt/stack/data/nova/instances/bc13be44-f39f-4521-b209-0234f0515ffd/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 18:28:09 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-94544dd2-5dec-47c7-9969-7e547967e049 tempest-TestMinimumBasicScenario-1484766802 tempest-TestMinimumBasicScenario-1484766802-project-member] Lock "/opt/stack/data/nova/instances/bc13be44-f39f-4521-b209-0234f0515ffd/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.003s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 18:28:09 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-94544dd2-5dec-47c7-9969-7e547967e049 tempest-TestMinimumBasicScenario-1484766802 tempest-TestMinimumBasicScenario-1484766802-project-member] Acquiring lock "a2e90d06e3b7de2b1766e5d969062e5abb05f2a2" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 18:28:09 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-94544dd2-5dec-47c7-9969-7e547967e049 tempest-TestMinimumBasicScenario-1484766802 tempest-TestMinimumBasicScenario-1484766802-project-member] Lock "a2e90d06e3b7de2b1766e5d969062e5abb05f2a2" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 18:28:09 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-94544dd2-5dec-47c7-9969-7e547967e049 tempest-TestMinimumBasicScenario-1484766802 tempest-TestMinimumBasicScenario-1484766802-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a2e90d06e3b7de2b1766e5d969062e5abb05f2a2.part --force-share --output=json {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:28:09 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:28:09 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-94544dd2-5dec-47c7-9969-7e547967e049 tempest-TestMinimumBasicScenario-1484766802 tempest-TestMinimumBasicScenario-1484766802-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a2e90d06e3b7de2b1766e5d969062e5abb05f2a2.part --force-share --output=json" returned: 0 in 0.179s {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:28:09 user nova-compute[74613]: DEBUG nova.virt.images [None req-94544dd2-5dec-47c7-9969-7e547967e049 tempest-TestMinimumBasicScenario-1484766802 tempest-TestMinimumBasicScenario-1484766802-project-member] 9f5a7e41-d5de-4a0d-a4a7-8e4d2d241607 was qcow2, converting to raw {{(pid=74613) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 29 18:28:09 user nova-compute[74613]: DEBUG nova.privsep.utils [None req-94544dd2-5dec-47c7-9969-7e547967e049 tempest-TestMinimumBasicScenario-1484766802 tempest-TestMinimumBasicScenario-1484766802-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74613) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 29 18:28:09 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-94544dd2-5dec-47c7-9969-7e547967e049 tempest-TestMinimumBasicScenario-1484766802 tempest-TestMinimumBasicScenario-1484766802-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/a2e90d06e3b7de2b1766e5d969062e5abb05f2a2.part /opt/stack/data/nova/instances/_base/a2e90d06e3b7de2b1766e5d969062e5abb05f2a2.converted {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:28:10 user nova-compute[74613]: DEBUG nova.network.neutron [None req-94544dd2-5dec-47c7-9969-7e547967e049 tempest-TestMinimumBasicScenario-1484766802 tempest-TestMinimumBasicScenario-1484766802-project-member] [instance: bc13be44-f39f-4521-b209-0234f0515ffd] Successfully created port: d31ddcc9-20c8-435a-aa9c-d376ec3f9708 {{(pid=74613) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 29 18:28:10 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-94544dd2-5dec-47c7-9969-7e547967e049 tempest-TestMinimumBasicScenario-1484766802 tempest-TestMinimumBasicScenario-1484766802-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/a2e90d06e3b7de2b1766e5d969062e5abb05f2a2.part /opt/stack/data/nova/instances/_base/a2e90d06e3b7de2b1766e5d969062e5abb05f2a2.converted" returned: 0 in 0.129s {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:28:10 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-94544dd2-5dec-47c7-9969-7e547967e049 tempest-TestMinimumBasicScenario-1484766802 tempest-TestMinimumBasicScenario-1484766802-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a2e90d06e3b7de2b1766e5d969062e5abb05f2a2.converted --force-share --output=json {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:28:10 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-94544dd2-5dec-47c7-9969-7e547967e049 tempest-TestMinimumBasicScenario-1484766802 tempest-TestMinimumBasicScenario-1484766802-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a2e90d06e3b7de2b1766e5d969062e5abb05f2a2.converted --force-share --output=json" returned: 0 in 0.183s {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:28:10 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-94544dd2-5dec-47c7-9969-7e547967e049 tempest-TestMinimumBasicScenario-1484766802 tempest-TestMinimumBasicScenario-1484766802-project-member] Lock "a2e90d06e3b7de2b1766e5d969062e5abb05f2a2" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 0.838s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 18:28:10 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-94544dd2-5dec-47c7-9969-7e547967e049 tempest-TestMinimumBasicScenario-1484766802 tempest-TestMinimumBasicScenario-1484766802-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a2e90d06e3b7de2b1766e5d969062e5abb05f2a2 --force-share --output=json {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:28:10 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-94544dd2-5dec-47c7-9969-7e547967e049 tempest-TestMinimumBasicScenario-1484766802 tempest-TestMinimumBasicScenario-1484766802-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a2e90d06e3b7de2b1766e5d969062e5abb05f2a2 --force-share --output=json" returned: 0 in 0.211s {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:28:10 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-94544dd2-5dec-47c7-9969-7e547967e049 tempest-TestMinimumBasicScenario-1484766802 tempest-TestMinimumBasicScenario-1484766802-project-member] Acquiring lock "a2e90d06e3b7de2b1766e5d969062e5abb05f2a2" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 18:28:10 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-94544dd2-5dec-47c7-9969-7e547967e049 tempest-TestMinimumBasicScenario-1484766802 tempest-TestMinimumBasicScenario-1484766802-project-member] Lock "a2e90d06e3b7de2b1766e5d969062e5abb05f2a2" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 18:28:10 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-94544dd2-5dec-47c7-9969-7e547967e049 tempest-TestMinimumBasicScenario-1484766802 tempest-TestMinimumBasicScenario-1484766802-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a2e90d06e3b7de2b1766e5d969062e5abb05f2a2 --force-share --output=json {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:28:10 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-94544dd2-5dec-47c7-9969-7e547967e049 tempest-TestMinimumBasicScenario-1484766802 tempest-TestMinimumBasicScenario-1484766802-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a2e90d06e3b7de2b1766e5d969062e5abb05f2a2 --force-share --output=json" returned: 0 in 0.183s {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:28:10 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-94544dd2-5dec-47c7-9969-7e547967e049 tempest-TestMinimumBasicScenario-1484766802 tempest-TestMinimumBasicScenario-1484766802-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a2e90d06e3b7de2b1766e5d969062e5abb05f2a2,backing_fmt=raw /opt/stack/data/nova/instances/bc13be44-f39f-4521-b209-0234f0515ffd/disk 1073741824 {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:28:10 user nova-compute[74613]: DEBUG nova.network.neutron [None req-94544dd2-5dec-47c7-9969-7e547967e049 tempest-TestMinimumBasicScenario-1484766802 tempest-TestMinimumBasicScenario-1484766802-project-member] [instance: bc13be44-f39f-4521-b209-0234f0515ffd] Successfully updated port: d31ddcc9-20c8-435a-aa9c-d376ec3f9708 {{(pid=74613) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 29 18:28:10 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-94544dd2-5dec-47c7-9969-7e547967e049 tempest-TestMinimumBasicScenario-1484766802 tempest-TestMinimumBasicScenario-1484766802-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a2e90d06e3b7de2b1766e5d969062e5abb05f2a2,backing_fmt=raw /opt/stack/data/nova/instances/bc13be44-f39f-4521-b209-0234f0515ffd/disk 1073741824" returned: 0 in 0.053s {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:28:10 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-94544dd2-5dec-47c7-9969-7e547967e049 tempest-TestMinimumBasicScenario-1484766802 tempest-TestMinimumBasicScenario-1484766802-project-member] Lock "a2e90d06e3b7de2b1766e5d969062e5abb05f2a2" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.244s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 18:28:10 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-94544dd2-5dec-47c7-9969-7e547967e049 tempest-TestMinimumBasicScenario-1484766802 tempest-TestMinimumBasicScenario-1484766802-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a2e90d06e3b7de2b1766e5d969062e5abb05f2a2 --force-share --output=json {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:28:10 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-94544dd2-5dec-47c7-9969-7e547967e049 tempest-TestMinimumBasicScenario-1484766802 tempest-TestMinimumBasicScenario-1484766802-project-member] Acquiring lock "refresh_cache-bc13be44-f39f-4521-b209-0234f0515ffd" {{(pid=74613) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 18:28:10 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-94544dd2-5dec-47c7-9969-7e547967e049 tempest-TestMinimumBasicScenario-1484766802 tempest-TestMinimumBasicScenario-1484766802-project-member] Acquired lock "refresh_cache-bc13be44-f39f-4521-b209-0234f0515ffd" {{(pid=74613) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 18:28:10 user nova-compute[74613]: DEBUG nova.network.neutron [None req-94544dd2-5dec-47c7-9969-7e547967e049 tempest-TestMinimumBasicScenario-1484766802 tempest-TestMinimumBasicScenario-1484766802-project-member] [instance: bc13be44-f39f-4521-b209-0234f0515ffd] Building network info cache for instance {{(pid=74613) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 29 18:28:10 user nova-compute[74613]: DEBUG nova.compute.manager [req-d30867f0-c5cf-4235-ad2e-685883a228e7 req-10c6ef7a-1197-4880-b908-20d0c030e6e7 service nova] [instance: bc13be44-f39f-4521-b209-0234f0515ffd] Received event network-changed-d31ddcc9-20c8-435a-aa9c-d376ec3f9708 {{(pid=74613) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 18:28:10 user nova-compute[74613]: DEBUG nova.compute.manager [req-d30867f0-c5cf-4235-ad2e-685883a228e7 req-10c6ef7a-1197-4880-b908-20d0c030e6e7 service nova] [instance: bc13be44-f39f-4521-b209-0234f0515ffd] Refreshing instance network info cache due to event network-changed-d31ddcc9-20c8-435a-aa9c-d376ec3f9708. {{(pid=74613) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 18:28:10 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-d30867f0-c5cf-4235-ad2e-685883a228e7 req-10c6ef7a-1197-4880-b908-20d0c030e6e7 service nova] Acquiring lock "refresh_cache-bc13be44-f39f-4521-b209-0234f0515ffd" {{(pid=74613) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 18:28:10 user nova-compute[74613]: DEBUG nova.network.neutron [None req-94544dd2-5dec-47c7-9969-7e547967e049 tempest-TestMinimumBasicScenario-1484766802 tempest-TestMinimumBasicScenario-1484766802-project-member] [instance: bc13be44-f39f-4521-b209-0234f0515ffd] Instance cache missing network info. {{(pid=74613) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 29 18:28:11 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-94544dd2-5dec-47c7-9969-7e547967e049 tempest-TestMinimumBasicScenario-1484766802 tempest-TestMinimumBasicScenario-1484766802-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a2e90d06e3b7de2b1766e5d969062e5abb05f2a2 --force-share --output=json" returned: 0 in 0.239s {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:28:11 user nova-compute[74613]: DEBUG nova.virt.disk.api [None req-94544dd2-5dec-47c7-9969-7e547967e049 tempest-TestMinimumBasicScenario-1484766802 tempest-TestMinimumBasicScenario-1484766802-project-member] Checking if we can resize image /opt/stack/data/nova/instances/bc13be44-f39f-4521-b209-0234f0515ffd/disk. size=1073741824 {{(pid=74613) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 29 18:28:11 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-94544dd2-5dec-47c7-9969-7e547967e049 tempest-TestMinimumBasicScenario-1484766802 tempest-TestMinimumBasicScenario-1484766802-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bc13be44-f39f-4521-b209-0234f0515ffd/disk --force-share --output=json {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:28:11 user nova-compute[74613]: DEBUG nova.network.neutron [None req-94544dd2-5dec-47c7-9969-7e547967e049 tempest-TestMinimumBasicScenario-1484766802 tempest-TestMinimumBasicScenario-1484766802-project-member] [instance: bc13be44-f39f-4521-b209-0234f0515ffd] Updating instance_info_cache with network_info: [{"id": "d31ddcc9-20c8-435a-aa9c-d376ec3f9708", "address": "fa:16:3e:1f:44:40", "network": {"id": "38552e53-6380-4671-abc9-ff5efee30f62", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-789596793-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ad92722fce424af588f1a0067e8726a1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd31ddcc9-20", "ovs_interfaceid": "d31ddcc9-20c8-435a-aa9c-d376ec3f9708", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74613) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 18:28:11 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-94544dd2-5dec-47c7-9969-7e547967e049 tempest-TestMinimumBasicScenario-1484766802 tempest-TestMinimumBasicScenario-1484766802-project-member] Releasing lock "refresh_cache-bc13be44-f39f-4521-b209-0234f0515ffd" {{(pid=74613) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 18:28:11 user nova-compute[74613]: DEBUG nova.compute.manager [None req-94544dd2-5dec-47c7-9969-7e547967e049 tempest-TestMinimumBasicScenario-1484766802 tempest-TestMinimumBasicScenario-1484766802-project-member] [instance: bc13be44-f39f-4521-b209-0234f0515ffd] Instance network_info: |[{"id": "d31ddcc9-20c8-435a-aa9c-d376ec3f9708", "address": "fa:16:3e:1f:44:40", "network": {"id": "38552e53-6380-4671-abc9-ff5efee30f62", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-789596793-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ad92722fce424af588f1a0067e8726a1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd31ddcc9-20", "ovs_interfaceid": "d31ddcc9-20c8-435a-aa9c-d376ec3f9708", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74613) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 29 18:28:11 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-d30867f0-c5cf-4235-ad2e-685883a228e7 req-10c6ef7a-1197-4880-b908-20d0c030e6e7 service nova] Acquired lock "refresh_cache-bc13be44-f39f-4521-b209-0234f0515ffd" {{(pid=74613) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 18:28:11 user nova-compute[74613]: DEBUG nova.network.neutron [req-d30867f0-c5cf-4235-ad2e-685883a228e7 req-10c6ef7a-1197-4880-b908-20d0c030e6e7 service nova] [instance: bc13be44-f39f-4521-b209-0234f0515ffd] Refreshing network info cache for port d31ddcc9-20c8-435a-aa9c-d376ec3f9708 {{(pid=74613) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 18:28:11 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-94544dd2-5dec-47c7-9969-7e547967e049 tempest-TestMinimumBasicScenario-1484766802 tempest-TestMinimumBasicScenario-1484766802-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bc13be44-f39f-4521-b209-0234f0515ffd/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:28:11 user nova-compute[74613]: DEBUG nova.virt.disk.api [None req-94544dd2-5dec-47c7-9969-7e547967e049 tempest-TestMinimumBasicScenario-1484766802 tempest-TestMinimumBasicScenario-1484766802-project-member] Cannot resize image /opt/stack/data/nova/instances/bc13be44-f39f-4521-b209-0234f0515ffd/disk to a smaller size. {{(pid=74613) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 29 18:28:11 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-94544dd2-5dec-47c7-9969-7e547967e049 tempest-TestMinimumBasicScenario-1484766802 tempest-TestMinimumBasicScenario-1484766802-project-member] [instance: bc13be44-f39f-4521-b209-0234f0515ffd] Created local disks {{(pid=74613) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 29 18:28:11 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-94544dd2-5dec-47c7-9969-7e547967e049 tempest-TestMinimumBasicScenario-1484766802 tempest-TestMinimumBasicScenario-1484766802-project-member] [instance: bc13be44-f39f-4521-b209-0234f0515ffd] Ensure instance console log exists: /opt/stack/data/nova/instances/bc13be44-f39f-4521-b209-0234f0515ffd/console.log {{(pid=74613) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 29 18:28:11 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-94544dd2-5dec-47c7-9969-7e547967e049 tempest-TestMinimumBasicScenario-1484766802 tempest-TestMinimumBasicScenario-1484766802-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 18:28:11 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-94544dd2-5dec-47c7-9969-7e547967e049 tempest-TestMinimumBasicScenario-1484766802 tempest-TestMinimumBasicScenario-1484766802-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 18:28:11 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-94544dd2-5dec-47c7-9969-7e547967e049 tempest-TestMinimumBasicScenario-1484766802 tempest-TestMinimumBasicScenario-1484766802-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 18:28:11 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-94544dd2-5dec-47c7-9969-7e547967e049 tempest-TestMinimumBasicScenario-1484766802 tempest-TestMinimumBasicScenario-1484766802-project-member] [instance: bc13be44-f39f-4521-b209-0234f0515ffd] Start _get_guest_xml network_info=[{"id": "d31ddcc9-20c8-435a-aa9c-d376ec3f9708", "address": "fa:16:3e:1f:44:40", "network": {"id": "38552e53-6380-4671-abc9-ff5efee30f62", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-789596793-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ad92722fce424af588f1a0067e8726a1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd31ddcc9-20", "ovs_interfaceid": "d31ddcc9-20c8-435a-aa9c-d376ec3f9708", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-29T18:28:06Z,direct_url=<?>,disk_format='qcow2',id=9f5a7e41-d5de-4a0d-a4a7-8e4d2d241607,min_disk=0,min_ram=0,name='tempest-scenario-img--423865790',owner='ad92722fce424af588f1a0067e8726a1',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-29T18:28:07Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'size': 0, 'device_type': 'disk', 'boot_index': 0, 'guest_format': None, 'encrypted': False, 'encryption_format': None, 'disk_bus': 'virtio', 'image_id': '9f5a7e41-d5de-4a0d-a4a7-8e4d2d241607'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74613) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 29 18:28:11 user nova-compute[74613]: WARNING nova.virt.libvirt.driver [None req-94544dd2-5dec-47c7-9969-7e547967e049 tempest-TestMinimumBasicScenario-1484766802 tempest-TestMinimumBasicScenario-1484766802-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 18:28:11 user nova-compute[74613]: WARNING nova.virt.libvirt.driver [None req-94544dd2-5dec-47c7-9969-7e547967e049 tempest-TestMinimumBasicScenario-1484766802 tempest-TestMinimumBasicScenario-1484766802-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 18:28:11 user nova-compute[74613]: DEBUG nova.virt.libvirt.host [None req-94544dd2-5dec-47c7-9969-7e547967e049 tempest-TestMinimumBasicScenario-1484766802 tempest-TestMinimumBasicScenario-1484766802-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74613) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 29 18:28:11 user nova-compute[74613]: DEBUG nova.virt.libvirt.host [None req-94544dd2-5dec-47c7-9969-7e547967e049 tempest-TestMinimumBasicScenario-1484766802 tempest-TestMinimumBasicScenario-1484766802-project-member] CPU controller missing on host. {{(pid=74613) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 29 18:28:11 user nova-compute[74613]: DEBUG nova.virt.libvirt.host [None req-94544dd2-5dec-47c7-9969-7e547967e049 tempest-TestMinimumBasicScenario-1484766802 tempest-TestMinimumBasicScenario-1484766802-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74613) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 29 18:28:11 user nova-compute[74613]: DEBUG nova.virt.libvirt.host [None req-94544dd2-5dec-47c7-9969-7e547967e049 tempest-TestMinimumBasicScenario-1484766802 tempest-TestMinimumBasicScenario-1484766802-project-member] CPU controller found on host. {{(pid=74613) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 29 18:28:11 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-94544dd2-5dec-47c7-9969-7e547967e049 tempest-TestMinimumBasicScenario-1484766802 tempest-TestMinimumBasicScenario-1484766802-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74613) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 29 18:28:11 user nova-compute[74613]: DEBUG nova.virt.hardware [None req-94544dd2-5dec-47c7-9969-7e547967e049 tempest-TestMinimumBasicScenario-1484766802 tempest-TestMinimumBasicScenario-1484766802-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-29T17:47:27Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-29T18:28:06Z,direct_url=<?>,disk_format='qcow2',id=9f5a7e41-d5de-4a0d-a4a7-8e4d2d241607,min_disk=0,min_ram=0,name='tempest-scenario-img--423865790',owner='ad92722fce424af588f1a0067e8726a1',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-29T18:28:07Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74613) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 29 18:28:11 user nova-compute[74613]: DEBUG nova.virt.hardware [None req-94544dd2-5dec-47c7-9969-7e547967e049 tempest-TestMinimumBasicScenario-1484766802 tempest-TestMinimumBasicScenario-1484766802-project-member] Flavor limits 0:0:0 {{(pid=74613) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 29 18:28:11 user nova-compute[74613]: DEBUG nova.virt.hardware [None req-94544dd2-5dec-47c7-9969-7e547967e049 tempest-TestMinimumBasicScenario-1484766802 tempest-TestMinimumBasicScenario-1484766802-project-member] Image limits 0:0:0 {{(pid=74613) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 29 18:28:11 user nova-compute[74613]: DEBUG nova.virt.hardware [None req-94544dd2-5dec-47c7-9969-7e547967e049 tempest-TestMinimumBasicScenario-1484766802 tempest-TestMinimumBasicScenario-1484766802-project-member] Flavor pref 0:0:0 {{(pid=74613) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 29 18:28:11 user nova-compute[74613]: DEBUG nova.virt.hardware [None req-94544dd2-5dec-47c7-9969-7e547967e049 tempest-TestMinimumBasicScenario-1484766802 tempest-TestMinimumBasicScenario-1484766802-project-member] Image pref 0:0:0 {{(pid=74613) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 29 18:28:11 user nova-compute[74613]: DEBUG nova.virt.hardware [None req-94544dd2-5dec-47c7-9969-7e547967e049 tempest-TestMinimumBasicScenario-1484766802 tempest-TestMinimumBasicScenario-1484766802-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74613) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 29 18:28:11 user nova-compute[74613]: DEBUG nova.virt.hardware [None req-94544dd2-5dec-47c7-9969-7e547967e049 tempest-TestMinimumBasicScenario-1484766802 tempest-TestMinimumBasicScenario-1484766802-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74613) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 29 18:28:11 user nova-compute[74613]: DEBUG nova.virt.hardware [None req-94544dd2-5dec-47c7-9969-7e547967e049 tempest-TestMinimumBasicScenario-1484766802 tempest-TestMinimumBasicScenario-1484766802-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74613) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 29 18:28:11 user nova-compute[74613]: DEBUG nova.virt.hardware [None req-94544dd2-5dec-47c7-9969-7e547967e049 tempest-TestMinimumBasicScenario-1484766802 tempest-TestMinimumBasicScenario-1484766802-project-member] Got 1 possible topologies {{(pid=74613) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 29 18:28:11 user nova-compute[74613]: DEBUG nova.virt.hardware [None req-94544dd2-5dec-47c7-9969-7e547967e049 tempest-TestMinimumBasicScenario-1484766802 tempest-TestMinimumBasicScenario-1484766802-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74613) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 29 18:28:11 user nova-compute[74613]: DEBUG nova.virt.hardware [None req-94544dd2-5dec-47c7-9969-7e547967e049 tempest-TestMinimumBasicScenario-1484766802 tempest-TestMinimumBasicScenario-1484766802-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74613) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 29 18:28:11 user nova-compute[74613]: DEBUG nova.virt.libvirt.vif [None req-94544dd2-5dec-47c7-9969-7e547967e049 tempest-TestMinimumBasicScenario-1484766802 tempest-TestMinimumBasicScenario-1484766802-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T18:28:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1251467943',display_name='tempest-TestMinimumBasicScenario-server-1251467943',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1251467943',id=50,image_ref='9f5a7e41-d5de-4a0d-a4a7-8e4d2d241607',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAfWQHqPUzSc0NHHFrTbTERoz7hqSVNFF7zq3g/6h0gfizix11R5+BfssWS+Oj3QGHBIaRJUep/t1vmsvZjgJj3mDi+isrZuQc3YlP0PE7aXW3LAQBwO0V9i9VWv8FtFdA==',key_name='tempest-TestMinimumBasicScenario-1552013529',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ad92722fce424af588f1a0067e8726a1',ramdisk_id='',reservation_id='r-gfy8ejbb',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='9f5a7e41-d5de-4a0d-a4a7-8e4d2d241607',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-1484766802',owner_user_name='tempest-TestMinimumBasicScenario-1484766802-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T18:28:09Z,user_data=None,user_id='e34c7321ef954c23a591fdb8641df8bb',uuid=bc13be44-f39f-4521-b209-0234f0515ffd,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d31ddcc9-20c8-435a-aa9c-d376ec3f9708", "address": "fa:16:3e:1f:44:40", "network": {"id": "38552e53-6380-4671-abc9-ff5efee30f62", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-789596793-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ad92722fce424af588f1a0067e8726a1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd31ddcc9-20", "ovs_interfaceid": "d31ddcc9-20c8-435a-aa9c-d376ec3f9708", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74613) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 29 18:28:11 user nova-compute[74613]: DEBUG nova.network.os_vif_util [None req-94544dd2-5dec-47c7-9969-7e547967e049 tempest-TestMinimumBasicScenario-1484766802 tempest-TestMinimumBasicScenario-1484766802-project-member] Converting VIF {"id": "d31ddcc9-20c8-435a-aa9c-d376ec3f9708", "address": "fa:16:3e:1f:44:40", "network": {"id": "38552e53-6380-4671-abc9-ff5efee30f62", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-789596793-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ad92722fce424af588f1a0067e8726a1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd31ddcc9-20", "ovs_interfaceid": "d31ddcc9-20c8-435a-aa9c-d376ec3f9708", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74613) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 18:28:11 user nova-compute[74613]: DEBUG nova.network.os_vif_util [None req-94544dd2-5dec-47c7-9969-7e547967e049 tempest-TestMinimumBasicScenario-1484766802 tempest-TestMinimumBasicScenario-1484766802-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1f:44:40,bridge_name='br-int',has_traffic_filtering=True,id=d31ddcc9-20c8-435a-aa9c-d376ec3f9708,network=Network(38552e53-6380-4671-abc9-ff5efee30f62),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd31ddcc9-20') {{(pid=74613) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 18:28:11 user nova-compute[74613]: DEBUG nova.objects.instance [None req-94544dd2-5dec-47c7-9969-7e547967e049 tempest-TestMinimumBasicScenario-1484766802 tempest-TestMinimumBasicScenario-1484766802-project-member] Lazy-loading 'pci_devices' on Instance uuid bc13be44-f39f-4521-b209-0234f0515ffd {{(pid=74613) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 18:28:11 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-94544dd2-5dec-47c7-9969-7e547967e049 tempest-TestMinimumBasicScenario-1484766802 tempest-TestMinimumBasicScenario-1484766802-project-member] [instance: bc13be44-f39f-4521-b209-0234f0515ffd] End _get_guest_xml xml=<domain type="kvm">
Nov 29 18:28:11 user nova-compute[74613]:   <uuid>bc13be44-f39f-4521-b209-0234f0515ffd</uuid>
Nov 29 18:28:11 user nova-compute[74613]:   <name>instance-00000032</name>
Nov 29 18:28:11 user nova-compute[74613]:   <memory>524288</memory>
Nov 29 18:28:11 user nova-compute[74613]:   <vcpu>1</vcpu>
Nov 29 18:28:11 user nova-compute[74613]:   <metadata>
Nov 29 18:28:11 user nova-compute[74613]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 29 18:28:11 user nova-compute[74613]:       <nova:package version="0.0.0"/>
Nov 29 18:28:11 user nova-compute[74613]:       <nova:name>tempest-TestMinimumBasicScenario-server-1251467943</nova:name>
Nov 29 18:28:11 user nova-compute[74613]:       <nova:creationTime>2023-11-29 18:28:11</nova:creationTime>
Nov 29 18:28:11 user nova-compute[74613]:       <nova:flavor name="m1.tiny">
Nov 29 18:28:11 user nova-compute[74613]:         <nova:memory>512</nova:memory>
Nov 29 18:28:11 user nova-compute[74613]:         <nova:disk>1</nova:disk>
Nov 29 18:28:11 user nova-compute[74613]:         <nova:swap>0</nova:swap>
Nov 29 18:28:11 user nova-compute[74613]:         <nova:ephemeral>0</nova:ephemeral>
Nov 29 18:28:11 user nova-compute[74613]:         <nova:vcpus>1</nova:vcpus>
Nov 29 18:28:11 user nova-compute[74613]:       </nova:flavor>
Nov 29 18:28:11 user nova-compute[74613]:       <nova:owner>
Nov 29 18:28:11 user nova-compute[74613]:         <nova:user uuid="e34c7321ef954c23a591fdb8641df8bb">tempest-TestMinimumBasicScenario-1484766802-project-member</nova:user>
Nov 29 18:28:11 user nova-compute[74613]:         <nova:project uuid="ad92722fce424af588f1a0067e8726a1">tempest-TestMinimumBasicScenario-1484766802</nova:project>
Nov 29 18:28:11 user nova-compute[74613]:       </nova:owner>
Nov 29 18:28:11 user nova-compute[74613]:       <nova:root type="image" uuid="9f5a7e41-d5de-4a0d-a4a7-8e4d2d241607"/>
Nov 29 18:28:11 user nova-compute[74613]:       <nova:ports>
Nov 29 18:28:11 user nova-compute[74613]:         <nova:port uuid="d31ddcc9-20c8-435a-aa9c-d376ec3f9708">
Nov 29 18:28:11 user nova-compute[74613]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Nov 29 18:28:11 user nova-compute[74613]:         </nova:port>
Nov 29 18:28:11 user nova-compute[74613]:       </nova:ports>
Nov 29 18:28:11 user nova-compute[74613]:     </nova:instance>
Nov 29 18:28:11 user nova-compute[74613]:   </metadata>
Nov 29 18:28:11 user nova-compute[74613]:   <sysinfo type="smbios">
Nov 29 18:28:11 user nova-compute[74613]:     <system>
Nov 29 18:28:11 user nova-compute[74613]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 29 18:28:11 user nova-compute[74613]:       <entry name="product">OpenStack Nova</entry>
Nov 29 18:28:11 user nova-compute[74613]:       <entry name="version">0.0.0</entry>
Nov 29 18:28:11 user nova-compute[74613]:       <entry name="serial">bc13be44-f39f-4521-b209-0234f0515ffd</entry>
Nov 29 18:28:11 user nova-compute[74613]:       <entry name="uuid">bc13be44-f39f-4521-b209-0234f0515ffd</entry>
Nov 29 18:28:11 user nova-compute[74613]:       <entry name="family">Virtual Machine</entry>
Nov 29 18:28:11 user nova-compute[74613]:     </system>
Nov 29 18:28:11 user nova-compute[74613]:   </sysinfo>
Nov 29 18:28:11 user nova-compute[74613]:   <os>
Nov 29 18:28:11 user nova-compute[74613]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 29 18:28:11 user nova-compute[74613]:     <boot dev="hd"/>
Nov 29 18:28:11 user nova-compute[74613]:     <smbios mode="sysinfo"/>
Nov 29 18:28:11 user nova-compute[74613]:   </os>
Nov 29 18:28:11 user nova-compute[74613]:   <features>
Nov 29 18:28:11 user nova-compute[74613]:     <acpi/>
Nov 29 18:28:11 user nova-compute[74613]:     <apic/>
Nov 29 18:28:11 user nova-compute[74613]:     <vmcoreinfo/>
Nov 29 18:28:11 user nova-compute[74613]:   </features>
Nov 29 18:28:11 user nova-compute[74613]:   <clock offset="utc">
Nov 29 18:28:11 user nova-compute[74613]:     <timer name="pit" tickpolicy="delay"/>
Nov 29 18:28:11 user nova-compute[74613]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 29 18:28:11 user nova-compute[74613]:     <timer name="hpet" present="no"/>
Nov 29 18:28:11 user nova-compute[74613]:   </clock>
Nov 29 18:28:11 user nova-compute[74613]:   <cpu mode="custom" match="exact">
Nov 29 18:28:11 user nova-compute[74613]:     <model>Nehalem</model>
Nov 29 18:28:11 user nova-compute[74613]:     <topology sockets="1" cores="1" threads="1"/>
Nov 29 18:28:11 user nova-compute[74613]:   </cpu>
Nov 29 18:28:11 user nova-compute[74613]:   <devices>
Nov 29 18:28:11 user nova-compute[74613]:     <disk type="file" device="disk">
Nov 29 18:28:11 user nova-compute[74613]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 29 18:28:11 user nova-compute[74613]:       <source file="/opt/stack/data/nova/instances/bc13be44-f39f-4521-b209-0234f0515ffd/disk"/>
Nov 29 18:28:11 user nova-compute[74613]:       <target dev="vda" bus="virtio"/>
Nov 29 18:28:11 user nova-compute[74613]:     </disk>
Nov 29 18:28:11 user nova-compute[74613]:     <interface type="ethernet">
Nov 29 18:28:11 user nova-compute[74613]:       <mac address="fa:16:3e:1f:44:40"/>
Nov 29 18:28:11 user nova-compute[74613]:       <model type="virtio"/>
Nov 29 18:28:11 user nova-compute[74613]:       <mtu size="1442"/>
Nov 29 18:28:11 user nova-compute[74613]:       <target dev="tapd31ddcc9-20"/>
Nov 29 18:28:11 user nova-compute[74613]:     </interface>
Nov 29 18:28:11 user nova-compute[74613]:     <serial type="pty">
Nov 29 18:28:11 user nova-compute[74613]:       <log file="/opt/stack/data/nova/instances/bc13be44-f39f-4521-b209-0234f0515ffd/console.log" append="off"/>
Nov 29 18:28:11 user nova-compute[74613]:     </serial>
Nov 29 18:28:11 user nova-compute[74613]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 29 18:28:11 user nova-compute[74613]:     <video>
Nov 29 18:28:11 user nova-compute[74613]:       <model type="virtio"/>
Nov 29 18:28:11 user nova-compute[74613]:     </video>
Nov 29 18:28:11 user nova-compute[74613]:     <rng model="virtio">
Nov 29 18:28:11 user nova-compute[74613]:       <backend model="random">/dev/urandom</backend>
Nov 29 18:28:11 user nova-compute[74613]:     </rng>
Nov 29 18:28:11 user nova-compute[74613]:     <controller type="usb" index="0" model="none"/>
Nov 29 18:28:11 user nova-compute[74613]:     <memballoon model="virtio">
Nov 29 18:28:11 user nova-compute[74613]:       <stats period="10"/>
Nov 29 18:28:11 user nova-compute[74613]:     </memballoon>
Nov 29 18:28:11 user nova-compute[74613]:   </devices>
Nov 29 18:28:11 user nova-compute[74613]: </domain>
Nov 29 18:28:11 user nova-compute[74613]:  {{(pid=74613) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 29 18:28:11 user nova-compute[74613]: DEBUG nova.virt.libvirt.vif [None req-94544dd2-5dec-47c7-9969-7e547967e049 tempest-TestMinimumBasicScenario-1484766802 tempest-TestMinimumBasicScenario-1484766802-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T18:28:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1251467943',display_name='tempest-TestMinimumBasicScenario-server-1251467943',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1251467943',id=50,image_ref='9f5a7e41-d5de-4a0d-a4a7-8e4d2d241607',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAfWQHqPUzSc0NHHFrTbTERoz7hqSVNFF7zq3g/6h0gfizix11R5+BfssWS+Oj3QGHBIaRJUep/t1vmsvZjgJj3mDi+isrZuQc3YlP0PE7aXW3LAQBwO0V9i9VWv8FtFdA==',key_name='tempest-TestMinimumBasicScenario-1552013529',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ad92722fce424af588f1a0067e8726a1',ramdisk_id='',reservation_id='r-gfy8ejbb',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='9f5a7e41-d5de-4a0d-a4a7-8e4d2d241607',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-1484766802',owner_user_name='tempest-TestMinimumBasicScenario-1484766802-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T18:28:09Z,user_data=None,user_id='e34c7321ef954c23a591fdb8641df8bb',uuid=bc13be44-f39f-4521-b209-0234f0515ffd,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d31ddcc9-20c8-435a-aa9c-d376ec3f9708", "address": "fa:16:3e:1f:44:40", "network": {"id": "38552e53-6380-4671-abc9-ff5efee30f62", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-789596793-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ad92722fce424af588f1a0067e8726a1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd31ddcc9-20", "ovs_interfaceid": "d31ddcc9-20c8-435a-aa9c-d376ec3f9708", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74613) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 29 18:28:11 user nova-compute[74613]: DEBUG nova.network.os_vif_util [None req-94544dd2-5dec-47c7-9969-7e547967e049 tempest-TestMinimumBasicScenario-1484766802 tempest-TestMinimumBasicScenario-1484766802-project-member] Converting VIF {"id": "d31ddcc9-20c8-435a-aa9c-d376ec3f9708", "address": "fa:16:3e:1f:44:40", "network": {"id": "38552e53-6380-4671-abc9-ff5efee30f62", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-789596793-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ad92722fce424af588f1a0067e8726a1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd31ddcc9-20", "ovs_interfaceid": "d31ddcc9-20c8-435a-aa9c-d376ec3f9708", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74613) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 18:28:11 user nova-compute[74613]: DEBUG nova.network.os_vif_util [None req-94544dd2-5dec-47c7-9969-7e547967e049 tempest-TestMinimumBasicScenario-1484766802 tempest-TestMinimumBasicScenario-1484766802-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1f:44:40,bridge_name='br-int',has_traffic_filtering=True,id=d31ddcc9-20c8-435a-aa9c-d376ec3f9708,network=Network(38552e53-6380-4671-abc9-ff5efee30f62),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd31ddcc9-20') {{(pid=74613) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 18:28:11 user nova-compute[74613]: DEBUG os_vif [None req-94544dd2-5dec-47c7-9969-7e547967e049 tempest-TestMinimumBasicScenario-1484766802 tempest-TestMinimumBasicScenario-1484766802-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:1f:44:40,bridge_name='br-int',has_traffic_filtering=True,id=d31ddcc9-20c8-435a-aa9c-d376ec3f9708,network=Network(38552e53-6380-4671-abc9-ff5efee30f62),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd31ddcc9-20') {{(pid=74613) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 29 18:28:11 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:28:11 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74613) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 18:28:11 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74613) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 29 18:28:11 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:28:11 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '77f4336e-40be-5af0-9808-7dc8000b879b', '_type': 'linux-noop'}}, row=False) {{(pid=74613) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 18:28:11 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:28:11 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 18:28:11 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:28:11 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapd31ddcc9-20, may_exist=True, interface_attrs={}) {{(pid=74613) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 18:28:11 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapd31ddcc9-20, col_values=(('qos', UUID('fc678305-cf20-4d96-9708-3570b08080b7')),), if_exists=True) {{(pid=74613) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 18:28:11 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapd31ddcc9-20, col_values=(('external_ids', {'iface-id': 'd31ddcc9-20c8-435a-aa9c-d376ec3f9708', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:1f:44:40', 'vm-uuid': 'bc13be44-f39f-4521-b209-0234f0515ffd'}),), if_exists=True) {{(pid=74613) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 18:28:11 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:28:11 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 18:28:11 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:28:11 user nova-compute[74613]: INFO os_vif [None req-94544dd2-5dec-47c7-9969-7e547967e049 tempest-TestMinimumBasicScenario-1484766802 tempest-TestMinimumBasicScenario-1484766802-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:1f:44:40,bridge_name='br-int',has_traffic_filtering=True,id=d31ddcc9-20c8-435a-aa9c-d376ec3f9708,network=Network(38552e53-6380-4671-abc9-ff5efee30f62),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd31ddcc9-20')
Nov 29 18:28:11 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:28:11 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-94544dd2-5dec-47c7-9969-7e547967e049 tempest-TestMinimumBasicScenario-1484766802 tempest-TestMinimumBasicScenario-1484766802-project-member] No BDM found with device name vda, not building metadata. {{(pid=74613) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 18:28:11 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-94544dd2-5dec-47c7-9969-7e547967e049 tempest-TestMinimumBasicScenario-1484766802 tempest-TestMinimumBasicScenario-1484766802-project-member] No VIF found with MAC fa:16:3e:1f:44:40, not building metadata {{(pid=74613) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 29 18:28:11 user nova-compute[74613]: DEBUG nova.network.neutron [req-d30867f0-c5cf-4235-ad2e-685883a228e7 req-10c6ef7a-1197-4880-b908-20d0c030e6e7 service nova] [instance: bc13be44-f39f-4521-b209-0234f0515ffd] Updated VIF entry in instance network info cache for port d31ddcc9-20c8-435a-aa9c-d376ec3f9708. {{(pid=74613) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 18:28:11 user nova-compute[74613]: DEBUG nova.network.neutron [req-d30867f0-c5cf-4235-ad2e-685883a228e7 req-10c6ef7a-1197-4880-b908-20d0c030e6e7 service nova] [instance: bc13be44-f39f-4521-b209-0234f0515ffd] Updating instance_info_cache with network_info: [{"id": "d31ddcc9-20c8-435a-aa9c-d376ec3f9708", "address": "fa:16:3e:1f:44:40", "network": {"id": "38552e53-6380-4671-abc9-ff5efee30f62", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-789596793-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ad92722fce424af588f1a0067e8726a1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd31ddcc9-20", "ovs_interfaceid": "d31ddcc9-20c8-435a-aa9c-d376ec3f9708", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74613) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 18:28:11 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-d30867f0-c5cf-4235-ad2e-685883a228e7 req-10c6ef7a-1197-4880-b908-20d0c030e6e7 service nova] Releasing lock "refresh_cache-bc13be44-f39f-4521-b209-0234f0515ffd" {{(pid=74613) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 18:28:12 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:28:12 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:28:12 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:28:12 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:28:12 user nova-compute[74613]: DEBUG nova.compute.manager [req-3c44f0a7-2fd6-4324-aeb1-aa8ae6259d79 req-378250fc-5599-4398-9967-00015b7fce79 service nova] [instance: bc13be44-f39f-4521-b209-0234f0515ffd] Received event network-vif-plugged-d31ddcc9-20c8-435a-aa9c-d376ec3f9708 {{(pid=74613) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 18:28:12 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-3c44f0a7-2fd6-4324-aeb1-aa8ae6259d79 req-378250fc-5599-4398-9967-00015b7fce79 service nova] Acquiring lock "bc13be44-f39f-4521-b209-0234f0515ffd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 18:28:12 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-3c44f0a7-2fd6-4324-aeb1-aa8ae6259d79 req-378250fc-5599-4398-9967-00015b7fce79 service nova] Lock "bc13be44-f39f-4521-b209-0234f0515ffd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 18:28:12 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-3c44f0a7-2fd6-4324-aeb1-aa8ae6259d79 req-378250fc-5599-4398-9967-00015b7fce79 service nova] Lock "bc13be44-f39f-4521-b209-0234f0515ffd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 18:28:12 user nova-compute[74613]: DEBUG nova.compute.manager [req-3c44f0a7-2fd6-4324-aeb1-aa8ae6259d79 req-378250fc-5599-4398-9967-00015b7fce79 service nova] [instance: bc13be44-f39f-4521-b209-0234f0515ffd] No waiting events found dispatching network-vif-plugged-d31ddcc9-20c8-435a-aa9c-d376ec3f9708 {{(pid=74613) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 18:28:12 user nova-compute[74613]: WARNING nova.compute.manager [req-3c44f0a7-2fd6-4324-aeb1-aa8ae6259d79 req-378250fc-5599-4398-9967-00015b7fce79 service nova] [instance: bc13be44-f39f-4521-b209-0234f0515ffd] Received unexpected event network-vif-plugged-d31ddcc9-20c8-435a-aa9c-d376ec3f9708 for instance with vm_state building and task_state spawning.
Nov 29 18:28:13 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:28:13 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:28:13 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:28:13 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:28:13 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:28:14 user nova-compute[74613]: DEBUG nova.compute.manager [None req-94544dd2-5dec-47c7-9969-7e547967e049 tempest-TestMinimumBasicScenario-1484766802 tempest-TestMinimumBasicScenario-1484766802-project-member] [instance: bc13be44-f39f-4521-b209-0234f0515ffd] Instance event wait completed in 0 seconds for  {{(pid=74613) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 29 18:28:14 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-94544dd2-5dec-47c7-9969-7e547967e049 tempest-TestMinimumBasicScenario-1484766802 tempest-TestMinimumBasicScenario-1484766802-project-member] [instance: bc13be44-f39f-4521-b209-0234f0515ffd] Guest created on hypervisor {{(pid=74613) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 29 18:28:14 user nova-compute[74613]: INFO nova.virt.libvirt.driver [-] [instance: bc13be44-f39f-4521-b209-0234f0515ffd] Instance spawned successfully.
Nov 29 18:28:14 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-94544dd2-5dec-47c7-9969-7e547967e049 tempest-TestMinimumBasicScenario-1484766802 tempest-TestMinimumBasicScenario-1484766802-project-member] [instance: bc13be44-f39f-4521-b209-0234f0515ffd] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74613) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 29 18:28:14 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-94544dd2-5dec-47c7-9969-7e547967e049 tempest-TestMinimumBasicScenario-1484766802 tempest-TestMinimumBasicScenario-1484766802-project-member] [instance: bc13be44-f39f-4521-b209-0234f0515ffd] Found default for hw_cdrom_bus of ide {{(pid=74613) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 18:28:14 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-94544dd2-5dec-47c7-9969-7e547967e049 tempest-TestMinimumBasicScenario-1484766802 tempest-TestMinimumBasicScenario-1484766802-project-member] [instance: bc13be44-f39f-4521-b209-0234f0515ffd] Found default for hw_disk_bus of virtio {{(pid=74613) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 18:28:14 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-94544dd2-5dec-47c7-9969-7e547967e049 tempest-TestMinimumBasicScenario-1484766802 tempest-TestMinimumBasicScenario-1484766802-project-member] [instance: bc13be44-f39f-4521-b209-0234f0515ffd] Found default for hw_input_bus of None {{(pid=74613) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 18:28:14 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-94544dd2-5dec-47c7-9969-7e547967e049 tempest-TestMinimumBasicScenario-1484766802 tempest-TestMinimumBasicScenario-1484766802-project-member] [instance: bc13be44-f39f-4521-b209-0234f0515ffd] Found default for hw_pointer_model of None {{(pid=74613) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 18:28:14 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-94544dd2-5dec-47c7-9969-7e547967e049 tempest-TestMinimumBasicScenario-1484766802 tempest-TestMinimumBasicScenario-1484766802-project-member] [instance: bc13be44-f39f-4521-b209-0234f0515ffd] Found default for hw_video_model of virtio {{(pid=74613) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 18:28:14 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-94544dd2-5dec-47c7-9969-7e547967e049 tempest-TestMinimumBasicScenario-1484766802 tempest-TestMinimumBasicScenario-1484766802-project-member] [instance: bc13be44-f39f-4521-b209-0234f0515ffd] Found default for hw_vif_model of virtio {{(pid=74613) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 18:28:14 user nova-compute[74613]: INFO nova.compute.manager [None req-94544dd2-5dec-47c7-9969-7e547967e049 tempest-TestMinimumBasicScenario-1484766802 tempest-TestMinimumBasicScenario-1484766802-project-member] [instance: bc13be44-f39f-4521-b209-0234f0515ffd] Took 5.37 seconds to spawn the instance on the hypervisor.
Nov 29 18:28:14 user nova-compute[74613]: DEBUG nova.compute.manager [None req-94544dd2-5dec-47c7-9969-7e547967e049 tempest-TestMinimumBasicScenario-1484766802 tempest-TestMinimumBasicScenario-1484766802-project-member] [instance: bc13be44-f39f-4521-b209-0234f0515ffd] Checking state {{(pid=74613) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 29 18:28:14 user nova-compute[74613]: INFO nova.compute.manager [None req-94544dd2-5dec-47c7-9969-7e547967e049 tempest-TestMinimumBasicScenario-1484766802 tempest-TestMinimumBasicScenario-1484766802-project-member] [instance: bc13be44-f39f-4521-b209-0234f0515ffd] Took 5.94 seconds to build instance.
Nov 29 18:28:14 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-94544dd2-5dec-47c7-9969-7e547967e049 tempest-TestMinimumBasicScenario-1484766802 tempest-TestMinimumBasicScenario-1484766802-project-member] Lock "bc13be44-f39f-4521-b209-0234f0515ffd" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.030s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 18:28:15 user nova-compute[74613]: DEBUG nova.compute.manager [req-df62bfe6-1435-4d20-8441-9011bfcfbf5d req-3762d3db-97c6-47a7-8514-0f4724027f8c service nova] [instance: bc13be44-f39f-4521-b209-0234f0515ffd] Received event network-vif-plugged-d31ddcc9-20c8-435a-aa9c-d376ec3f9708 {{(pid=74613) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 18:28:15 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-df62bfe6-1435-4d20-8441-9011bfcfbf5d req-3762d3db-97c6-47a7-8514-0f4724027f8c service nova] Acquiring lock "bc13be44-f39f-4521-b209-0234f0515ffd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 18:28:15 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-df62bfe6-1435-4d20-8441-9011bfcfbf5d req-3762d3db-97c6-47a7-8514-0f4724027f8c service nova] Lock "bc13be44-f39f-4521-b209-0234f0515ffd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 18:28:15 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [req-df62bfe6-1435-4d20-8441-9011bfcfbf5d req-3762d3db-97c6-47a7-8514-0f4724027f8c service nova] Lock "bc13be44-f39f-4521-b209-0234f0515ffd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 18:28:15 user nova-compute[74613]: DEBUG nova.compute.manager [req-df62bfe6-1435-4d20-8441-9011bfcfbf5d req-3762d3db-97c6-47a7-8514-0f4724027f8c service nova] [instance: bc13be44-f39f-4521-b209-0234f0515ffd] No waiting events found dispatching network-vif-plugged-d31ddcc9-20c8-435a-aa9c-d376ec3f9708 {{(pid=74613) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 18:28:15 user nova-compute[74613]: WARNING nova.compute.manager [req-df62bfe6-1435-4d20-8441-9011bfcfbf5d req-3762d3db-97c6-47a7-8514-0f4724027f8c service nova] [instance: bc13be44-f39f-4521-b209-0234f0515ffd] Received unexpected event network-vif-plugged-d31ddcc9-20c8-435a-aa9c-d376ec3f9708 for instance with vm_state active and task_state None.
Nov 29 18:28:16 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:28:16 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:28:21 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:28:21 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:28:26 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:28:31 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 18:28:31 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 18:28:31 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74613) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 29 18:28:31 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74613) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 18:28:31 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74613) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 18:28:31 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:28:31 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:28:36 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:28:36 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:28:41 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:28:41 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:28:44 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:28:45 user nova-compute[74613]: DEBUG oslo_service.periodic_task [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74613) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 18:28:46 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:28:46 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:28:46 user nova-compute[74613]: DEBUG oslo_service.periodic_task [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74613) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 18:28:48 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:28:49 user nova-compute[74613]: DEBUG oslo_service.periodic_task [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74613) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 18:28:49 user nova-compute[74613]: DEBUG nova.compute.manager [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Starting heal instance info cache {{(pid=74613) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 29 18:28:49 user nova-compute[74613]: DEBUG nova.compute.manager [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Rebuilding the list of instances to heal {{(pid=74613) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 29 18:28:49 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Acquiring lock "refresh_cache-059e3f87-a811-4ac7-b846-2f6d202a919f" {{(pid=74613) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 18:28:49 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Acquired lock "refresh_cache-059e3f87-a811-4ac7-b846-2f6d202a919f" {{(pid=74613) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 18:28:49 user nova-compute[74613]: DEBUG nova.network.neutron [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] [instance: 059e3f87-a811-4ac7-b846-2f6d202a919f] Forcefully refreshing network info cache for instance {{(pid=74613) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 29 18:28:49 user nova-compute[74613]: DEBUG nova.objects.instance [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Lazy-loading 'info_cache' on Instance uuid 059e3f87-a811-4ac7-b846-2f6d202a919f {{(pid=74613) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 18:28:50 user nova-compute[74613]: DEBUG nova.network.neutron [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] [instance: 059e3f87-a811-4ac7-b846-2f6d202a919f] Updating instance_info_cache with network_info: [{"id": "91dd58f7-d736-4a98-b6a6-f4d1bc6dd8dd", "address": "fa:16:3e:6a:c5:f2", "network": {"id": "4a5179dd-d0b1-44c3-80c1-08dd7b0152f1", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1296336996-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.212", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "67390f1402214191904cfbd68c3142a7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap91dd58f7-d7", "ovs_interfaceid": "91dd58f7-d736-4a98-b6a6-f4d1bc6dd8dd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74613) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 18:28:50 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Releasing lock "refresh_cache-059e3f87-a811-4ac7-b846-2f6d202a919f" {{(pid=74613) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 18:28:50 user nova-compute[74613]: DEBUG nova.compute.manager [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] [instance: 059e3f87-a811-4ac7-b846-2f6d202a919f] Updated the network info_cache for instance {{(pid=74613) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 29 18:28:50 user nova-compute[74613]: DEBUG oslo_service.periodic_task [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74613) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 18:28:51 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:28:51 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 18:28:52 user nova-compute[74613]: DEBUG oslo_service.periodic_task [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74613) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 18:28:52 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 18:28:52 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 18:28:52 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 18:28:52 user nova-compute[74613]: DEBUG nova.compute.resource_tracker [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Auditing locally available compute resources for user (node: user) {{(pid=74613) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 29 18:28:52 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=74613) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 29 18:28:52 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bc13be44-f39f-4521-b209-0234f0515ffd/disk --force-share --output=json {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:28:53 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bc13be44-f39f-4521-b209-0234f0515ffd/disk --force-share --output=json" returned: 0 in 0.209s {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:28:53 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bc13be44-f39f-4521-b209-0234f0515ffd/disk --force-share --output=json {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:28:53 user nova-compute[74613]: DEBUG oslo_concurrency.processutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bc13be44-f39f-4521-b209-0234f0515ffd/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=74613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:28:53 user nova-compute[74613]: DEBUG nova.virt.libvirt.driver [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=74613) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 29 18:28:53 user nova-compute[74613]: WARNING nova.virt.libvirt.driver [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 18:28:53 user nova-compute[74613]: WARNING nova.virt.libvirt.driver [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 18:28:53 user nova-compute[74613]: DEBUG nova.compute.resource_tracker [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Hypervisor/Node resource view: name=user free_ram=8651MB free_disk=24.835445404052734GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74613) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 29 18:28:53 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 18:28:53 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 18:28:53 user nova-compute[74613]: DEBUG nova.compute.resource_tracker [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Instance 059e3f87-a811-4ac7-b846-2f6d202a919f actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74613) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 18:28:53 user nova-compute[74613]: DEBUG nova.compute.resource_tracker [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Instance ce15a55a-61a8-48ac-89e5-3a8723284e38 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74613) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 18:28:53 user nova-compute[74613]: DEBUG nova.compute.resource_tracker [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Instance bc13be44-f39f-4521-b209-0234f0515ffd actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74613) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 18:28:53 user nova-compute[74613]: DEBUG nova.compute.resource_tracker [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=74613) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 29 18:28:53 user nova-compute[74613]: DEBUG nova.compute.resource_tracker [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Final resource view: name=user phys_ram=16011MB used_ram=2048MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=3 pci_stats=[] {{(pid=74613) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 29 18:28:53 user nova-compute[74613]: DEBUG nova.compute.provider_tree [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Inventory has not changed in ProviderTree for provider: 639d980e-3b12-44b1-b8f4-1812416fa4dd {{(pid=74613) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 18:28:53 user nova-compute[74613]: DEBUG nova.scheduler.client.report [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Inventory has not changed for provider 639d980e-3b12-44b1-b8f4-1812416fa4dd based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74613) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 18:28:53 user nova-compute[74613]: DEBUG nova.compute.resource_tracker [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Compute_service record updated for user:user {{(pid=74613) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 29 18:28:53 user nova-compute[74613]: DEBUG oslo_concurrency.lockutils [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.237s {{(pid=74613) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 18:28:54 user nova-compute[74613]: DEBUG oslo_service.periodic_task [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74613) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 18:28:54 user nova-compute[74613]: DEBUG oslo_service.periodic_task [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74613) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 18:28:54 user nova-compute[74613]: DEBUG oslo_service.periodic_task [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74613) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 18:28:54 user nova-compute[74613]: DEBUG nova.compute.manager [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74613) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 29 18:28:55 user nova-compute[74613]: DEBUG oslo_service.periodic_task [None req-28398a74-b316-4607-908a-10ce11da9aa1 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74613) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 18:28:56 user nova-compute[74613]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74613) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}